2024-05-09T09:34:06.286 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-09T09:34:06.286 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_kkeithle@teuthology --description rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} --name kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi --archive /home/teuthworker/archive/kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi/7699626 --verbose -- /home/teuthworker/archive/kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi/7699626/orig.config.yaml 2024-05-09T09:34:06.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-09T09:34:06.415 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi/7699626 branch: wip-kkeithley-zipper-ec description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} email: null first_in_suite: false job_id: '7699626' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-kkeithley-zipper-ec ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: 2d4f3997312aba36846da54fe4ed144c644dd8fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 2d4f3997312aba36846da54fe4ed144c644dd8fc rgw: ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast s3tests: slow_backend: true thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-kkeithley-zipper-ec sha1: 2d4f3997312aba36846da54fe4ed144c644dd8fc owner: scheduled_kkeithle@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 3428 sha1: 2d4f3997312aba36846da54fe4ed144c644dd8fc sleep_before_teardown: 0 subset: 1/2 suite: rgw suite_branch: wip-kkeithley-zipper-ec suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_2d4f3997312aba36846da54fe4ed144c644dd8fc/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 2d4f3997312aba36846da54fe4ed144c644dd8fc targets: smithi110.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNdve4RrPCexiH0ju5WIDDBd6ejl/AMp129UJy17ummF8AIp/Qlfjn6IgksGotyKQ510zi75u1U85RoPmR8fN5U= smithi157.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEzmM3H3jRPvOoCdNsicJ2V+hcHjhqNgbKdh6KGo0keQ2LK++8UtKg2N4bjWJpYqgYj8R0Exv7XPTSO9OzHLDS0= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-09_09:15:11 tube: smithi user: kkeithle verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-09T09:34:06.415 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_2d4f3997312aba36846da54fe4ed144c644dd8fc/qa; will attempt to use it 2024-05-09T09:34:06.416 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_2d4f3997312aba36846da54fe4ed144c644dd8fc/qa/tasks 2024-05-09T09:34:06.416 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-09T09:34:06.418 INFO:teuthology.task.internal:Checking packages... 2024-05-09T09:34:06.450 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '2d4f3997312aba36846da54fe4ed144c644dd8fc' 2024-05-09T09:34:06.450 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-09T09:34:06.450 INFO:teuthology.packaging:ref: None 2024-05-09T09:34:06.450 INFO:teuthology.packaging:tag: None 2024-05-09T09:34:06.450 INFO:teuthology.packaging:branch: wip-kkeithley-zipper-ec 2024-05-09T09:34:06.451 INFO:teuthology.packaging:sha1: 2d4f3997312aba36846da54fe4ed144c644dd8fc 2024-05-09T09:34:06.451 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-kkeithley-zipper-ec 2024-05-09T09:34:06.677 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3093-g2d4f3997-1jammy 2024-05-09T09:34:06.679 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-09T09:34:06.685 INFO:teuthology.task.internal:no buildpackages task found 2024-05-09T09:34:06.685 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-09T09:34:06.728 INFO:teuthology.task.internal:Saving configuration 2024-05-09T09:34:06.745 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-09T09:34:06.751 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-09T09:34:06.778 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi/7699626', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 09:27:54.885292', 'locked_by': 'scheduled_kkeithle@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHzFbwnk9bmhaNIdZPbdCbC9u2gEhC0Dr/UF0TtU6jPl'} 2024-05-09T09:34:06.799 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi/7699626', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 09:27:54.887263', 'locked_by': 'scheduled_kkeithle@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICibydTy5c3epUhF3S7tEM82GWrxyZGD7FVcKs+l+nqz'} 2024-05-09T09:34:06.799 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-09T09:34:06.850 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-05-09T09:34:06.850 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-05-09T09:34:06.850 INFO:teuthology.run_tasks:Running task console_log... 2024-05-09T09:34:06.991 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f08e4c543a0>, signals=[15]) 2024-05-09T09:34:06.991 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-09T09:34:06.997 INFO:teuthology.task.internal:Opening connections... 2024-05-09T09:34:06.997 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi110.front.sepia.ceph.com 2024-05-09T09:34:06.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T09:34:07.083 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi157.front.sepia.ceph.com 2024-05-09T09:34:07.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T09:34:07.161 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-09T09:34:07.389 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2024-05-09T09:34:07.396 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2024-05-09T09:34:07.396 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-05-09T09:34:07.442 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-09T09:34:07.442 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Ubuntu" 2024-05-09T09:34:07.442 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="22.04" 2024-05-09T09:34:07.443 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-09T09:34:07.443 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_CODENAME=jammy 2024-05-09T09:34:07.443 INFO:teuthology.orchestra.run.smithi110.stdout:ID=ubuntu 2024-05-09T09:34:07.443 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE=debian 2024-05-09T09:34:07.443 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-09T09:34:07.443 INFO:teuthology.orchestra.run.smithi110.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-09T09:34:07.443 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-09T09:34:07.443 INFO:teuthology.orchestra.run.smithi110.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-09T09:34:07.443 INFO:teuthology.orchestra.run.smithi110.stdout:UBUNTU_CODENAME=jammy 2024-05-09T09:34:07.444 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-05-09T09:34:07.473 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2024-05-09T09:34:07.480 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2024-05-09T09:34:07.480 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2024-05-09T09:34:07.528 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-09T09:34:07.528 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Ubuntu" 2024-05-09T09:34:07.528 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="22.04" 2024-05-09T09:34:07.529 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-09T09:34:07.529 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_CODENAME=jammy 2024-05-09T09:34:07.529 INFO:teuthology.orchestra.run.smithi157.stdout:ID=ubuntu 2024-05-09T09:34:07.529 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE=debian 2024-05-09T09:34:07.529 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-09T09:34:07.529 INFO:teuthology.orchestra.run.smithi157.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-09T09:34:07.529 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-09T09:34:07.529 INFO:teuthology.orchestra.run.smithi157.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-09T09:34:07.529 INFO:teuthology.orchestra.run.smithi157.stdout:UBUNTU_CODENAME=jammy 2024-05-09T09:34:07.529 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2024-05-09T09:34:07.548 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-09T09:34:07.558 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-09T09:34:07.595 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-09T09:34:07.595 DEBUG:teuthology.orchestra.run.smithi110:> test '!' -e /home/ubuntu/cephtest 2024-05-09T09:34:07.598 DEBUG:teuthology.orchestra.run.smithi157:> test '!' -e /home/ubuntu/cephtest 2024-05-09T09:34:07.604 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-09T09:34:07.627 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-09T09:34:07.627 DEBUG:teuthology.orchestra.run.smithi110:> test -z $(ls -A /var/lib/ceph) 2024-05-09T09:34:07.643 DEBUG:teuthology.orchestra.run.smithi157:> test -z $(ls -A /var/lib/ceph) 2024-05-09T09:34:07.659 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-09T09:34:07.714 INFO:teuthology.run_tasks:Running task kernel... 2024-05-09T09:34:07.728 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-05-09T09:34:07.728 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-05-09T09:34:07.729 DEBUG:teuthology.orchestra.run.smithi110:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-09T09:34:07.729 DEBUG:teuthology.orchestra.run.smithi157:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-09T09:34:07.733 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T09:34:07.733 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-05-09T09:34:07.734 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T09:34:07.734 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2024-05-09T09:34:07.783 INFO:teuthology.orchestra.run.smithi110.stdout:5.15.0-56-generic 2024-05-09T09:34:07.783 INFO:teuthology.task.kernel:Running kernel on smithi110: 5.15.0-56-generic 2024-05-09T09:34:07.783 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get clean 2024-05-09T09:34:07.784 INFO:teuthology.orchestra.run.smithi157.stdout:5.15.0-56-generic 2024-05-09T09:34:07.784 INFO:teuthology.task.kernel:Running kernel on smithi157: 5.15.0-56-generic 2024-05-09T09:34:07.785 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get clean 2024-05-09T09:34:07.902 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get update 2024-05-09T09:34:07.913 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get update 2024-05-09T09:34:08.046 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-09T09:34:08.050 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-09T09:34:08.060 INFO:teuthology.orchestra.run.smithi110.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-09T09:34:08.084 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-09T09:34:08.139 INFO:teuthology.orchestra.run.smithi110.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-09T09:34:08.166 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-09T09:34:08.269 INFO:teuthology.orchestra.run.smithi110.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [624 kB] 2024-05-09T09:34:08.317 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,638 kB] 2024-05-09T09:34:08.356 INFO:teuthology.orchestra.run.smithi110.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,638 kB] 2024-05-09T09:34:08.404 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [307 kB] 2024-05-09T09:34:08.410 INFO:teuthology.orchestra.run.smithi110.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-09T09:34:08.410 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,864 kB] 2024-05-09T09:34:08.453 INFO:teuthology.orchestra.run.smithi110.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-09T09:34:08.454 INFO:teuthology.orchestra.run.smithi110.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [316 kB] 2024-05-09T09:34:08.459 INFO:teuthology.orchestra.run.smithi110.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-09T09:34:08.459 INFO:teuthology.orchestra.run.smithi110.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [702 kB] 2024-05-09T09:34:08.475 INFO:teuthology.orchestra.run.smithi110.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,073 kB] 2024-05-09T09:34:08.481 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [624 kB] 2024-05-09T09:34:08.539 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [307 kB] 2024-05-09T09:34:08.544 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-09T09:34:08.545 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-09T09:34:08.546 INFO:teuthology.orchestra.run.smithi110.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-05-09T09:34:08.546 INFO:teuthology.orchestra.run.smithi157.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,864 kB] 2024-05-09T09:34:08.568 INFO:teuthology.orchestra.run.smithi110.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-09T09:34:08.569 INFO:teuthology.orchestra.run.smithi110.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-09T09:34:08.569 INFO:teuthology.orchestra.run.smithi110.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-09T09:34:08.571 INFO:teuthology.orchestra.run.smithi110.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-09T09:34:08.578 INFO:teuthology.orchestra.run.smithi157.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [316 kB] 2024-05-09T09:34:08.583 INFO:teuthology.orchestra.run.smithi157.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-09T09:34:08.583 INFO:teuthology.orchestra.run.smithi157.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [702 kB] 2024-05-09T09:34:08.593 INFO:teuthology.orchestra.run.smithi157.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,073 kB] 2024-05-09T09:34:08.594 INFO:teuthology.orchestra.run.smithi110.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-09T09:34:08.594 INFO:teuthology.orchestra.run.smithi110.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-09T09:34:08.595 INFO:teuthology.orchestra.run.smithi110.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-09T09:34:08.597 INFO:teuthology.orchestra.run.smithi110.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-09T09:34:08.597 INFO:teuthology.orchestra.run.smithi110.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-09T09:34:08.597 INFO:teuthology.orchestra.run.smithi110.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-09T09:34:08.598 INFO:teuthology.orchestra.run.smithi110.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-09T09:34:08.605 INFO:teuthology.orchestra.run.smithi157.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-05-09T09:34:08.608 INFO:teuthology.orchestra.run.smithi157.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-09T09:34:08.608 INFO:teuthology.orchestra.run.smithi157.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-09T09:34:08.614 INFO:teuthology.orchestra.run.smithi110.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-09T09:34:08.629 INFO:teuthology.orchestra.run.smithi157.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-09T09:34:08.630 INFO:teuthology.orchestra.run.smithi157.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-09T09:34:08.630 INFO:teuthology.orchestra.run.smithi157.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-09T09:34:08.630 INFO:teuthology.orchestra.run.smithi157.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-09T09:34:08.631 INFO:teuthology.orchestra.run.smithi157.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-09T09:34:08.634 INFO:teuthology.orchestra.run.smithi157.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-09T09:34:08.635 INFO:teuthology.orchestra.run.smithi157.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-09T09:34:08.635 INFO:teuthology.orchestra.run.smithi157.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-09T09:34:08.636 INFO:teuthology.orchestra.run.smithi110.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-09T09:34:08.654 INFO:teuthology.orchestra.run.smithi157.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-09T09:34:08.655 INFO:teuthology.orchestra.run.smithi157.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-09T09:34:08.655 INFO:teuthology.orchestra.run.smithi157.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-09T09:34:08.915 INFO:teuthology.orchestra.run.smithi110.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-09T09:34:09.033 INFO:teuthology.orchestra.run.smithi157.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-09T09:34:09.079 INFO:teuthology.orchestra.run.smithi110.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,421 kB] 2024-05-09T09:34:09.191 INFO:teuthology.orchestra.run.smithi110.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [458 kB] 2024-05-09T09:34:09.200 INFO:teuthology.orchestra.run.smithi110.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [246 kB] 2024-05-09T09:34:09.206 INFO:teuthology.orchestra.run.smithi110.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-09T09:34:09.206 INFO:teuthology.orchestra.run.smithi110.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-09T09:34:09.208 INFO:teuthology.orchestra.run.smithi110.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,807 kB] 2024-05-09T09:34:09.237 INFO:teuthology.orchestra.run.smithi110.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [307 kB] 2024-05-09T09:34:09.241 INFO:teuthology.orchestra.run.smithi110.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-09T09:34:09.242 INFO:teuthology.orchestra.run.smithi110.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [602 kB] 2024-05-09T09:34:09.248 INFO:teuthology.orchestra.run.smithi110.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [849 kB] 2024-05-09T09:34:09.257 INFO:teuthology.orchestra.run.smithi110.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-05-09T09:34:09.259 INFO:teuthology.orchestra.run.smithi110.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-09T09:34:09.260 INFO:teuthology.orchestra.run.smithi110.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-09T09:34:09.260 INFO:teuthology.orchestra.run.smithi110.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-09T09:34:09.260 INFO:teuthology.orchestra.run.smithi110.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-09T09:34:09.279 INFO:teuthology.orchestra.run.smithi110.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-09T09:34:09.463 INFO:teuthology.orchestra.run.smithi157.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,421 kB] 2024-05-09T09:34:09.877 INFO:teuthology.orchestra.run.smithi157.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [458 kB] 2024-05-09T09:34:09.894 INFO:teuthology.orchestra.run.smithi157.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [246 kB] 2024-05-09T09:34:09.904 INFO:teuthology.orchestra.run.smithi157.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-09T09:34:09.904 INFO:teuthology.orchestra.run.smithi157.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-09T09:34:09.906 INFO:teuthology.orchestra.run.smithi157.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,807 kB] 2024-05-09T09:34:09.999 INFO:teuthology.orchestra.run.smithi157.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [307 kB] 2024-05-09T09:34:10.010 INFO:teuthology.orchestra.run.smithi157.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-09T09:34:10.010 INFO:teuthology.orchestra.run.smithi157.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [849 kB] 2024-05-09T09:34:10.038 INFO:teuthology.orchestra.run.smithi157.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [602 kB] 2024-05-09T09:34:10.216 INFO:teuthology.orchestra.run.smithi157.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-05-09T09:34:10.622 INFO:teuthology.orchestra.run.smithi157.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-09T09:34:10.627 INFO:teuthology.orchestra.run.smithi157.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-09T09:34:10.628 INFO:teuthology.orchestra.run.smithi157.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-09T09:34:10.641 INFO:teuthology.orchestra.run.smithi157.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-09T09:34:10.645 INFO:teuthology.orchestra.run.smithi157.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-09T09:34:14.394 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 13.4 MB in 2s (7,246 kB/s) 2024-05-09T09:34:14.838 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 13.4 MB in 3s (5,026 kB/s) 2024-05-09T09:34:15.665 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-05-09T09:34:15.683 DEBUG:teuthology.orchestra.run.smithi110:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-09T09:34:15.742 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-05-09T09:34:15.943 INFO:teuthology.orchestra.run.smithi110.stdout:Building dependency tree... 2024-05-09T09:34:15.943 INFO:teuthology.orchestra.run.smithi110.stdout:Reading state information... 2024-05-09T09:34:16.106 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-05-09T09:34:16.120 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages were automatically installed and are no longer required: 2024-05-09T09:34:16.120 INFO:teuthology.orchestra.run.smithi110.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-09T09:34:16.120 INFO:teuthology.orchestra.run.smithi110.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-09T09:34:16.120 INFO:teuthology.orchestra.run.smithi110.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-09T09:34:16.120 INFO:teuthology.orchestra.run.smithi110.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-09T09:34:16.121 INFO:teuthology.orchestra.run.smithi110.stdout: python2.7-minimal 2024-05-09T09:34:16.121 INFO:teuthology.orchestra.run.smithi110.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-09T09:34:16.122 INFO:teuthology.orchestra.run.smithi110.stdout:The following additional packages will be installed: 2024-05-09T09:34:16.122 INFO:teuthology.orchestra.run.smithi110.stdout: linux-generic linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-09T09:34:16.122 INFO:teuthology.orchestra.run.smithi110.stdout: linux-headers-generic linux-image-5.15.0-106-generic 2024-05-09T09:34:16.123 INFO:teuthology.orchestra.run.smithi110.stdout: linux-modules-5.15.0-106-generic linux-modules-extra-5.15.0-106-generic 2024-05-09T09:34:16.124 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-09T09:34:16.124 INFO:teuthology.orchestra.run.smithi110.stdout:Suggested packages: 2024-05-09T09:34:16.124 INFO:teuthology.orchestra.run.smithi110.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-09T09:34:16.124 INFO:teuthology.orchestra.run.smithi110.stdout:Recommended packages: 2024-05-09T09:34:16.124 INFO:teuthology.orchestra.run.smithi110.stdout: thermald 2024-05-09T09:34:16.176 INFO:teuthology.orchestra.run.smithi110.stdout:The following NEW packages will be installed: 2024-05-09T09:34:16.176 INFO:teuthology.orchestra.run.smithi110.stdout: linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-09T09:34:16.177 INFO:teuthology.orchestra.run.smithi110.stdout: linux-image-5.15.0-106-generic linux-modules-5.15.0-106-generic 2024-05-09T09:34:16.177 INFO:teuthology.orchestra.run.smithi110.stdout: linux-modules-extra-5.15.0-106-generic 2024-05-09T09:34:16.178 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages will be upgraded: 2024-05-09T09:34:16.179 INFO:teuthology.orchestra.run.smithi110.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-09T09:34:16.186 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-05-09T09:34:16.359 INFO:teuthology.orchestra.run.smithi110.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-05-09T09:34:16.359 INFO:teuthology.orchestra.run.smithi110.stdout:Need to get 113 MB of archives. 2024-05-09T09:34:16.359 INFO:teuthology.orchestra.run.smithi110.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-09T09:34:16.359 INFO:teuthology.orchestra.run.smithi110.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-106-generic amd64 5.15.0-106.116 [22.7 MB] 2024-05-09T09:34:16.393 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-05-09T09:34:16.393 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-05-09T09:34:16.577 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2024-05-09T09:34:16.577 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-09T09:34:16.578 INFO:teuthology.orchestra.run.smithi157.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-09T09:34:16.578 INFO:teuthology.orchestra.run.smithi157.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-09T09:34:16.578 INFO:teuthology.orchestra.run.smithi157.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-09T09:34:16.578 INFO:teuthology.orchestra.run.smithi157.stdout: python2.7-minimal 2024-05-09T09:34:16.579 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-09T09:34:16.579 INFO:teuthology.orchestra.run.smithi157.stdout:The following additional packages will be installed: 2024-05-09T09:34:16.579 INFO:teuthology.orchestra.run.smithi157.stdout: linux-generic linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-09T09:34:16.579 INFO:teuthology.orchestra.run.smithi157.stdout: linux-headers-generic linux-image-5.15.0-106-generic 2024-05-09T09:34:16.580 INFO:teuthology.orchestra.run.smithi157.stdout: linux-modules-5.15.0-106-generic linux-modules-extra-5.15.0-106-generic 2024-05-09T09:34:16.581 INFO:teuthology.orchestra.run.smithi157.stdout:Suggested packages: 2024-05-09T09:34:16.581 INFO:teuthology.orchestra.run.smithi157.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-09T09:34:16.581 INFO:teuthology.orchestra.run.smithi157.stdout:Recommended packages: 2024-05-09T09:34:16.581 INFO:teuthology.orchestra.run.smithi157.stdout: thermald 2024-05-09T09:34:16.631 INFO:teuthology.orchestra.run.smithi157.stdout:The following NEW packages will be installed: 2024-05-09T09:34:16.631 INFO:teuthology.orchestra.run.smithi157.stdout: linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-09T09:34:16.631 INFO:teuthology.orchestra.run.smithi157.stdout: linux-image-5.15.0-106-generic linux-modules-5.15.0-106-generic 2024-05-09T09:34:16.632 INFO:teuthology.orchestra.run.smithi157.stdout: linux-modules-extra-5.15.0-106-generic 2024-05-09T09:34:16.633 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages will be upgraded: 2024-05-09T09:34:16.633 INFO:teuthology.orchestra.run.smithi157.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-09T09:34:16.815 INFO:teuthology.orchestra.run.smithi157.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-05-09T09:34:16.815 INFO:teuthology.orchestra.run.smithi157.stdout:Need to get 113 MB of archives. 2024-05-09T09:34:16.815 INFO:teuthology.orchestra.run.smithi157.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-09T09:34:16.815 INFO:teuthology.orchestra.run.smithi157.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-106-generic amd64 5.15.0-106.116 [22.7 MB] 2024-05-09T09:34:17.785 INFO:teuthology.orchestra.run.smithi110.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-106-generic amd64 5.15.0-106.116 [11.5 MB] 2024-05-09T09:34:18.134 INFO:teuthology.orchestra.run.smithi110.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-106-generic amd64 5.15.0-106.116 [63.9 MB] 2024-05-09T09:34:20.277 INFO:teuthology.orchestra.run.smithi110.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.106.106 [1,692 B] 2024-05-09T09:34:20.277 INFO:teuthology.orchestra.run.smithi110.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.106.106 [2,502 B] 2024-05-09T09:34:20.278 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106 all 5.15.0-106.116 [12.3 MB] 2024-05-09T09:34:20.319 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-106-generic amd64 5.15.0-106.116 [11.5 MB] 2024-05-09T09:34:20.917 INFO:teuthology.orchestra.run.smithi110.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106-generic amd64 5.15.0-106.116 [2,876 kB] 2024-05-09T09:34:20.985 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.106.106 [2,366 B] 2024-05-09T09:34:21.072 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-106-generic amd64 5.15.0-106.116 [63.9 MB] 2024-05-09T09:34:21.385 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 113 MB in 5s (23.6 MB/s) 2024-05-09T09:34:21.571 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-modules-5.15.0-106-generic. 2024-05-09T09:34:23.529 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-09T09:34:23.533 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../0-linux-modules-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-09T09:34:23.602 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:34:24.343 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.106.106 [1,692 B] 2024-05-09T09:34:24.343 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.106.106 [2,502 B] 2024-05-09T09:34:24.354 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106 all 5.15.0-106.116 [12.3 MB] 2024-05-09T09:34:24.751 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106-generic amd64 5.15.0-106.116 [2,876 kB] 2024-05-09T09:34:24.834 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.106.106 [2,366 B] 2024-05-09T09:34:25.272 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 113 MB in 8s (13.8 MB/s) 2024-05-09T09:34:25.465 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-modules-5.15.0-106-generic. 2024-05-09T09:34:26.121 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-image-5.15.0-106-generic. 2024-05-09T09:34:26.142 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../1-linux-image-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-09T09:34:26.225 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:34:26.649 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-106-generic. 2024-05-09T09:34:26.670 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-09T09:34:26.707 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:34:27.421 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-09T09:34:27.425 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../0-linux-modules-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-09T09:34:27.504 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:34:29.639 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-image-5.15.0-106-generic. 2024-05-09T09:34:29.661 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../1-linux-image-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-09T09:34:29.735 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:34:30.234 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-106-generic. 2024-05-09T09:34:30.255 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-09T09:34:30.292 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:34:32.987 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../3-linux-generic_5.15.0.106.106_amd64.deb ... 2024-05-09T09:34:33.113 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-09T09:34:33.437 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.106.106_amd64.deb ... 2024-05-09T09:34:33.567 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-image-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-09T09:34:33.870 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-headers-5.15.0-106. 2024-05-09T09:34:33.892 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../5-linux-headers-5.15.0-106_5.15.0-106.116_all.deb ... 2024-05-09T09:34:33.937 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-09T09:34:37.219 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../3-linux-generic_5.15.0.106.106_amd64.deb ... 2024-05-09T09:34:37.362 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-09T09:34:37.678 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.106.106_amd64.deb ... 2024-05-09T09:34:37.807 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-image-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-09T09:34:38.110 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-headers-5.15.0-106. 2024-05-09T09:34:38.132 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../5-linux-headers-5.15.0-106_5.15.0-106.116_all.deb ... 2024-05-09T09:34:38.176 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-09T09:34:39.333 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-headers-5.15.0-106-generic. 2024-05-09T09:34:39.371 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../6-linux-headers-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-09T09:34:39.408 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:34:42.488 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.106.106_amd64.deb ... 2024-05-09T09:34:42.613 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-headers-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-09T09:34:42.954 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-09T09:34:43.060 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:34:43.161 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-headers-generic (5.15.0.106.106) ... 2024-05-09T09:34:43.290 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:34:43.974 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-headers-5.15.0-106-generic. 2024-05-09T09:34:44.011 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../6-linux-headers-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-09T09:34:44.331 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:34:44.618 INFO:teuthology.orchestra.run.smithi110.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-09T09:34:44.618 INFO:teuthology.orchestra.run.smithi110.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-09T09:34:44.618 INFO:teuthology.orchestra.run.smithi110.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-106-generic 2024-05-09T09:34:44.618 INFO:teuthology.orchestra.run.smithi110.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-106-generic 2024-05-09T09:34:44.778 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:34:46.152 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:34:47.493 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.106.106_amd64.deb ... 2024-05-09T09:34:47.520 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-image-generic (5.15.0.106.106) ... 2024-05-09T09:34:47.616 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-headers-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-09T09:34:47.649 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-generic (5.15.0.106.106) ... 2024-05-09T09:34:47.773 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:34:47.842 INFO:teuthology.orchestra.run.smithi110.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-09T09:34:47.842 INFO:teuthology.orchestra.run.smithi110.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-106-generic 2024-05-09T09:34:47.957 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-09T09:34:48.079 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:34:48.214 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-headers-generic (5.15.0.106.106) ... 2024-05-09T09:34:48.325 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:34:49.822 INFO:teuthology.orchestra.run.smithi157.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-09T09:34:49.822 INFO:teuthology.orchestra.run.smithi157.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-09T09:34:49.822 INFO:teuthology.orchestra.run.smithi157.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-106-generic 2024-05-09T09:34:49.822 INFO:teuthology.orchestra.run.smithi157.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-106-generic 2024-05-09T09:34:50.252 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:34:51.662 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:34:53.046 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-image-generic (5.15.0.106.106) ... 2024-05-09T09:34:53.181 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-generic (5.15.0.106.106) ... 2024-05-09T09:34:53.307 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-09T09:34:53.380 INFO:teuthology.orchestra.run.smithi157.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-09T09:34:53.380 INFO:teuthology.orchestra.run.smithi157.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-106-generic 2024-05-09T09:35:02.001 INFO:teuthology.orchestra.run.smithi110.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-09T09:35:02.001 INFO:teuthology.orchestra.run.smithi110.stdout:Sourcing file `/etc/default/grub' 2024-05-09T09:35:02.022 INFO:teuthology.orchestra.run.smithi110.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-09T09:35:02.040 INFO:teuthology.orchestra.run.smithi110.stdout:Generating grub configuration file ... 2024-05-09T09:35:02.395 INFO:teuthology.orchestra.run.smithi110.stdout:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-09T09:35:02.416 INFO:teuthology.orchestra.run.smithi110.stdout:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-09T09:35:02.770 INFO:teuthology.orchestra.run.smithi110.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-09T09:35:02.776 INFO:teuthology.orchestra.run.smithi110.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-09T09:35:02.846 INFO:teuthology.orchestra.run.smithi110.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-09T09:35:02.851 INFO:teuthology.orchestra.run.smithi110.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-09T09:35:03.011 INFO:teuthology.orchestra.run.smithi110.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-09T09:35:03.011 INFO:teuthology.orchestra.run.smithi110.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-09T09:35:03.011 INFO:teuthology.orchestra.run.smithi110.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-09T09:35:03.056 INFO:teuthology.orchestra.run.smithi110.stdout:done 2024-05-09T09:35:03.498 DEBUG:teuthology.orchestra.run.smithi110:> dpkg -s linux-image-generic 2024-05-09T09:35:03.549 INFO:teuthology.orchestra.run.smithi110.stdout:Package: linux-image-generic 2024-05-09T09:35:03.549 INFO:teuthology.orchestra.run.smithi110.stdout:Status: install ok installed 2024-05-09T09:35:03.549 INFO:teuthology.orchestra.run.smithi110.stdout:Priority: optional 2024-05-09T09:35:03.549 INFO:teuthology.orchestra.run.smithi110.stdout:Section: kernel 2024-05-09T09:35:03.550 INFO:teuthology.orchestra.run.smithi110.stdout:Installed-Size: 21 2024-05-09T09:35:03.550 INFO:teuthology.orchestra.run.smithi110.stdout:Maintainer: Ubuntu Kernel Team 2024-05-09T09:35:03.550 INFO:teuthology.orchestra.run.smithi110.stdout:Architecture: amd64 2024-05-09T09:35:03.550 INFO:teuthology.orchestra.run.smithi110.stdout:Source: linux-meta 2024-05-09T09:35:03.550 INFO:teuthology.orchestra.run.smithi110.stdout:Version: 5.15.0.106.106 2024-05-09T09:35:03.550 INFO:teuthology.orchestra.run.smithi110.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-09T09:35:03.550 INFO:teuthology.orchestra.run.smithi110.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-09T09:35:03.550 INFO:teuthology.orchestra.run.smithi110.stdout:Recommends: thermald 2024-05-09T09:35:03.550 INFO:teuthology.orchestra.run.smithi110.stdout:Description: Generic Linux kernel image 2024-05-09T09:35:03.550 INFO:teuthology.orchestra.run.smithi110.stdout: This package will always depend on the latest generic kernel image 2024-05-09T09:35:03.550 INFO:teuthology.orchestra.run.smithi110.stdout: available. 2024-05-09T09:35:03.551 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-106-generic 2024-05-09T09:35:03.551 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-09T09:35:03.551 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-09T09:35:03.551 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-09T09:35:03.551 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi110.front.sepia.ceph.com, path=None, version=distro) 2024-05-09T09:35:03.552 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get clean 2024-05-09T09:35:03.716 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get update 2024-05-09T09:35:03.970 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-09T09:35:03.970 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-09T09:35:04.037 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-09T09:35:04.118 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-09T09:35:05.407 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-05-09T09:35:05.424 DEBUG:teuthology.orchestra.run.smithi110:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-09T09:35:05.473 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-05-09T09:35:05.650 INFO:teuthology.orchestra.run.smithi110.stdout:Building dependency tree... 2024-05-09T09:35:05.651 INFO:teuthology.orchestra.run.smithi110.stdout:Reading state information... 2024-05-09T09:35:05.809 INFO:teuthology.orchestra.run.smithi110.stdout:linux-image-generic is already the newest version (5.15.0.106.106). 2024-05-09T09:35:05.809 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages were automatically installed and are no longer required: 2024-05-09T09:35:05.809 INFO:teuthology.orchestra.run.smithi110.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-09T09:35:05.809 INFO:teuthology.orchestra.run.smithi110.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-09T09:35:05.809 INFO:teuthology.orchestra.run.smithi110.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-09T09:35:05.809 INFO:teuthology.orchestra.run.smithi110.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-09T09:35:05.809 INFO:teuthology.orchestra.run.smithi110.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-09T09:35:05.809 INFO:teuthology.orchestra.run.smithi110.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-09T09:35:05.849 INFO:teuthology.orchestra.run.smithi110.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-05-09T09:35:05.851 DEBUG:teuthology.orchestra.run.smithi110:> dpkg -s linux-image-generic 2024-05-09T09:35:05.908 INFO:teuthology.orchestra.run.smithi110.stdout:Package: linux-image-generic 2024-05-09T09:35:05.909 INFO:teuthology.orchestra.run.smithi110.stdout:Status: install ok installed 2024-05-09T09:35:05.909 INFO:teuthology.orchestra.run.smithi110.stdout:Priority: optional 2024-05-09T09:35:05.909 INFO:teuthology.orchestra.run.smithi110.stdout:Section: kernel 2024-05-09T09:35:05.909 INFO:teuthology.orchestra.run.smithi110.stdout:Installed-Size: 21 2024-05-09T09:35:05.909 INFO:teuthology.orchestra.run.smithi110.stdout:Maintainer: Ubuntu Kernel Team 2024-05-09T09:35:05.909 INFO:teuthology.orchestra.run.smithi110.stdout:Architecture: amd64 2024-05-09T09:35:05.909 INFO:teuthology.orchestra.run.smithi110.stdout:Source: linux-meta 2024-05-09T09:35:05.909 INFO:teuthology.orchestra.run.smithi110.stdout:Version: 5.15.0.106.106 2024-05-09T09:35:05.909 INFO:teuthology.orchestra.run.smithi110.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-09T09:35:05.909 INFO:teuthology.orchestra.run.smithi110.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-09T09:35:05.909 INFO:teuthology.orchestra.run.smithi110.stdout:Recommends: thermald 2024-05-09T09:35:05.910 INFO:teuthology.orchestra.run.smithi110.stdout:Description: Generic Linux kernel image 2024-05-09T09:35:05.910 INFO:teuthology.orchestra.run.smithi110.stdout: This package will always depend on the latest generic kernel image 2024-05-09T09:35:05.910 INFO:teuthology.orchestra.run.smithi110.stdout: available. 2024-05-09T09:35:05.910 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-05-09T09:35:05.954 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.Ton5lvJqNc 2024-05-09T09:35:05.954 DEBUG:teuthology.orchestra.run.smithi110:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Ton5lvJqNc 2024-05-09T09:35:06.009 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.Ton5lvJqNc 2024-05-09T09:35:06.124 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.Ton5lvJqNc is 10KB 2024-05-09T09:35:06.136 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.Ton5lvJqNc 2024-05-09T09:35:06.142 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-09T09:35:06.197 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T09:35:06.198 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-09T09:35:06.198 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-09T09:35:06.265 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-106-generic 2024-05-09T09:35:06.265 DEBUG:teuthology.orchestra.run.smithi110:> sudo update-grub 2024-05-09T09:35:07.406 INFO:teuthology.orchestra.run.smithi157.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-09T09:35:07.406 INFO:teuthology.orchestra.run.smithi157.stdout:Sourcing file `/etc/default/grub' 2024-05-09T09:35:07.424 INFO:teuthology.orchestra.run.smithi157.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-09T09:35:07.440 INFO:teuthology.orchestra.run.smithi157.stdout:Generating grub configuration file ... 2024-05-09T09:35:07.509 INFO:teuthology.orchestra.run.smithi110.stderr:Sourcing file `/etc/default/grub' 2024-05-09T09:35:07.510 INFO:teuthology.orchestra.run.smithi110.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-09T09:35:07.512 INFO:teuthology.orchestra.run.smithi110.stderr:Generating grub configuration file ... 2024-05-09T09:35:07.689 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-09T09:35:07.695 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-09T09:35:07.750 INFO:teuthology.orchestra.run.smithi157.stdout:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-09T09:35:07.767 INFO:teuthology.orchestra.run.smithi157.stdout:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-09T09:35:07.902 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-09T09:35:07.907 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-09T09:35:07.944 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-09T09:35:07.948 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-09T09:35:08.061 INFO:teuthology.orchestra.run.smithi157.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-09T09:35:08.066 INFO:teuthology.orchestra.run.smithi157.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-09T09:35:08.077 INFO:teuthology.orchestra.run.smithi110.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-09T09:35:08.077 INFO:teuthology.orchestra.run.smithi110.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-09T09:35:08.077 INFO:teuthology.orchestra.run.smithi110.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-09T09:35:08.098 INFO:teuthology.orchestra.run.smithi110.stderr:done 2024-05-09T09:35:08.118 DEBUG:teuthology.orchestra.run.smithi110:> sudo shutdown -r now 2024-05-09T09:35:08.133 INFO:teuthology.orchestra.run.smithi157.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-09T09:35:08.138 INFO:teuthology.orchestra.run.smithi157.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-09T09:35:08.311 INFO:teuthology.orchestra.run.smithi157.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-09T09:35:08.312 INFO:teuthology.orchestra.run.smithi157.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-09T09:35:08.312 INFO:teuthology.orchestra.run.smithi157.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-09T09:35:08.346 INFO:teuthology.orchestra.run.smithi157.stdout:done 2024-05-09T09:35:08.821 DEBUG:teuthology.orchestra.run.smithi157:> dpkg -s linux-image-generic 2024-05-09T09:35:08.848 INFO:teuthology.orchestra.run.smithi157.stdout:Package: linux-image-generic 2024-05-09T09:35:08.848 INFO:teuthology.orchestra.run.smithi157.stdout:Status: install ok installed 2024-05-09T09:35:08.848 INFO:teuthology.orchestra.run.smithi157.stdout:Priority: optional 2024-05-09T09:35:08.848 INFO:teuthology.orchestra.run.smithi157.stdout:Section: kernel 2024-05-09T09:35:08.849 INFO:teuthology.orchestra.run.smithi157.stdout:Installed-Size: 21 2024-05-09T09:35:08.849 INFO:teuthology.orchestra.run.smithi157.stdout:Maintainer: Ubuntu Kernel Team 2024-05-09T09:35:08.849 INFO:teuthology.orchestra.run.smithi157.stdout:Architecture: amd64 2024-05-09T09:35:08.849 INFO:teuthology.orchestra.run.smithi157.stdout:Source: linux-meta 2024-05-09T09:35:08.849 INFO:teuthology.orchestra.run.smithi157.stdout:Version: 5.15.0.106.106 2024-05-09T09:35:08.849 INFO:teuthology.orchestra.run.smithi157.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-09T09:35:08.849 INFO:teuthology.orchestra.run.smithi157.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-09T09:35:08.849 INFO:teuthology.orchestra.run.smithi157.stdout:Recommends: thermald 2024-05-09T09:35:08.849 INFO:teuthology.orchestra.run.smithi157.stdout:Description: Generic Linux kernel image 2024-05-09T09:35:08.849 INFO:teuthology.orchestra.run.smithi157.stdout: This package will always depend on the latest generic kernel image 2024-05-09T09:35:08.849 INFO:teuthology.orchestra.run.smithi157.stdout: available. 2024-05-09T09:35:08.849 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-106-generic 2024-05-09T09:35:08.850 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-09T09:35:08.850 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-09T09:35:08.850 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-05-09T09:35:08.850 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi157.front.sepia.ceph.com, path=None, version=distro) 2024-05-09T09:35:08.850 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get clean 2024-05-09T09:35:09.029 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get update 2024-05-09T09:35:09.161 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-09T09:35:09.161 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-09T09:35:09.173 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-09T09:35:09.194 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-09T09:35:10.543 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-05-09T09:35:10.562 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-09T09:35:10.622 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-05-09T09:35:10.829 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-05-09T09:35:10.830 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-05-09T09:35:11.004 INFO:teuthology.orchestra.run.smithi157.stdout:linux-image-generic is already the newest version (5.15.0.106.106). 2024-05-09T09:35:11.004 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2024-05-09T09:35:11.004 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-09T09:35:11.004 INFO:teuthology.orchestra.run.smithi157.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-09T09:35:11.004 INFO:teuthology.orchestra.run.smithi157.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-09T09:35:11.005 INFO:teuthology.orchestra.run.smithi157.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-09T09:35:11.005 INFO:teuthology.orchestra.run.smithi157.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-09T09:35:11.005 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-09T09:35:11.045 INFO:teuthology.orchestra.run.smithi157.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-05-09T09:35:11.047 DEBUG:teuthology.orchestra.run.smithi157:> dpkg -s linux-image-generic 2024-05-09T09:35:11.063 INFO:teuthology.orchestra.run.smithi157.stdout:Package: linux-image-generic 2024-05-09T09:35:11.063 INFO:teuthology.orchestra.run.smithi157.stdout:Status: install ok installed 2024-05-09T09:35:11.063 INFO:teuthology.orchestra.run.smithi157.stdout:Priority: optional 2024-05-09T09:35:11.063 INFO:teuthology.orchestra.run.smithi157.stdout:Section: kernel 2024-05-09T09:35:11.063 INFO:teuthology.orchestra.run.smithi157.stdout:Installed-Size: 21 2024-05-09T09:35:11.063 INFO:teuthology.orchestra.run.smithi157.stdout:Maintainer: Ubuntu Kernel Team 2024-05-09T09:35:11.063 INFO:teuthology.orchestra.run.smithi157.stdout:Architecture: amd64 2024-05-09T09:35:11.063 INFO:teuthology.orchestra.run.smithi157.stdout:Source: linux-meta 2024-05-09T09:35:11.063 INFO:teuthology.orchestra.run.smithi157.stdout:Version: 5.15.0.106.106 2024-05-09T09:35:11.063 INFO:teuthology.orchestra.run.smithi157.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-09T09:35:11.063 INFO:teuthology.orchestra.run.smithi157.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-09T09:35:11.064 INFO:teuthology.orchestra.run.smithi157.stdout:Recommends: thermald 2024-05-09T09:35:11.064 INFO:teuthology.orchestra.run.smithi157.stdout:Description: Generic Linux kernel image 2024-05-09T09:35:11.064 INFO:teuthology.orchestra.run.smithi157.stdout: This package will always depend on the latest generic kernel image 2024-05-09T09:35:11.064 INFO:teuthology.orchestra.run.smithi157.stdout: available. 2024-05-09T09:35:11.064 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-05-09T09:35:11.115 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.OFtBCuRKi1 2024-05-09T09:35:11.115 DEBUG:teuthology.orchestra.run.smithi157:> sudo cp /boot/grub/grub.cfg /tmp/tmp.OFtBCuRKi1 2024-05-09T09:35:11.171 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.OFtBCuRKi1 2024-05-09T09:35:11.287 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.OFtBCuRKi1 is 10KB 2024-05-09T09:35:11.300 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.OFtBCuRKi1 2024-05-09T09:35:11.305 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-09T09:35:11.360 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-09T09:35:11.360 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-09T09:35:11.360 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-09T09:35:11.425 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-106-generic 2024-05-09T09:35:11.425 DEBUG:teuthology.orchestra.run.smithi157:> sudo update-grub 2024-05-09T09:35:12.587 INFO:teuthology.orchestra.run.smithi157.stderr:Sourcing file `/etc/default/grub' 2024-05-09T09:35:12.588 INFO:teuthology.orchestra.run.smithi157.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-09T09:35:12.590 INFO:teuthology.orchestra.run.smithi157.stderr:Generating grub configuration file ... 2024-05-09T09:35:12.768 INFO:teuthology.orchestra.run.smithi157.stderr:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-09T09:35:12.774 INFO:teuthology.orchestra.run.smithi157.stderr:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-09T09:35:13.008 INFO:teuthology.orchestra.run.smithi157.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-09T09:35:13.014 INFO:teuthology.orchestra.run.smithi157.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-09T09:35:13.056 INFO:teuthology.orchestra.run.smithi157.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-09T09:35:13.062 INFO:teuthology.orchestra.run.smithi157.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-09T09:35:13.179 INFO:teuthology.orchestra.run.smithi157.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-09T09:35:13.179 INFO:teuthology.orchestra.run.smithi157.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-09T09:35:13.179 INFO:teuthology.orchestra.run.smithi157.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-09T09:35:13.213 INFO:teuthology.orchestra.run.smithi157.stderr:done 2024-05-09T09:35:13.215 DEBUG:teuthology.orchestra.run.smithi157:> sudo shutdown -r now 2024-05-09T09:35:38.142 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-09T09:35:38.143 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-05-09T09:35:38.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T09:35:43.219 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-05-09T09:35:43.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-05-09T09:35:43.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T09:36:12.831 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-05-09T09:36:17.694 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-05-09T09:36:21.834 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-05-09T09:36:21.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T09:36:26.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-05-09T09:36:26.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T09:36:29.758 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-05-09T09:36:40.227 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-05-09T09:36:41.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-05-09T09:36:41.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T09:36:52.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-05-09T09:36:52.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T09:36:52.924 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-05-09T09:36:54.059 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-05-09T09:36:54.059 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-106-generic"... 2024-05-09T09:36:54.059 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-05-09T09:36:54.109 INFO:teuthology.orchestra.run.smithi110.stdout:5.15.0-106-generic 2024-05-09T09:36:54.109 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-106-generic vs 5.15.0-106-generic 2024-05-09T09:36:54.110 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-09T09:36:54.110 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-09T09:36:55.110 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-09T09:36:55.110 DEBUG:teuthology.orchestra.run.smithi110:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-09T09:36:55.393 INFO:teuthology.orchestra.run.smithi110.stdout:ttyS1 2024-05-09T09:36:55.420 DEBUG:teuthology.parallel:result is None 2024-05-09T09:37:00.190 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-05-09T09:37:15.191 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-05-09T09:37:15.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T09:37:15.510 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-05-09T09:37:16.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-05-09T09:37:16.300 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.15.0-106-generic"... 2024-05-09T09:37:16.301 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2024-05-09T09:37:16.306 INFO:teuthology.orchestra.run.smithi157.stdout:5.15.0-106-generic 2024-05-09T09:37:16.306 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-106-generic vs 5.15.0-106-generic 2024-05-09T09:37:16.306 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-09T09:37:16.306 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-09T09:37:17.307 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-05-09T09:37:17.307 DEBUG:teuthology.orchestra.run.smithi157:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-09T09:37:17.396 INFO:teuthology.orchestra.run.smithi157.stdout:ttyS1 2024-05-09T09:37:17.422 DEBUG:teuthology.parallel:result is None 2024-05-09T09:37:17.423 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-09T09:37:17.431 INFO:teuthology.task.internal:Creating test directory... 2024-05-09T09:37:17.431 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-09T09:37:17.434 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-09T09:37:17.439 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-09T09:37:17.445 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-09T09:37:17.454 INFO:teuthology.task.internal:Creating archive directory... 2024-05-09T09:37:17.454 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-09T09:37:17.483 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-09T09:37:17.567 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-09T09:37:17.574 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-09T09:37:17.574 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-09T09:37:17.577 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-09T09:37:17.595 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T09:37:17.599 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T09:37:17.603 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T09:37:17.606 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T09:37:17.607 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-09T09:37:17.628 INFO:teuthology.task.internal:Configuring sudo... 2024-05-09T09:37:17.629 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-09T09:37:17.652 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-09T09:37:17.670 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-09T09:37:17.700 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-09T09:37:17.701 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-09T09:37:17.717 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-09T09:37:17.729 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T09:37:17.771 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T09:37:17.823 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T09:37:17.823 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-09T09:37:17.895 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T09:37:17.904 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T09:37:17.956 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-09T09:37:17.956 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-09T09:37:18.021 DEBUG:teuthology.orchestra.run.smithi110:> sudo service rsyslog restart 2024-05-09T09:37:18.025 DEBUG:teuthology.orchestra.run.smithi157:> sudo service rsyslog restart 2024-05-09T09:37:18.100 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-09T09:37:18.109 INFO:teuthology.task.internal:Starting timer... 2024-05-09T09:37:18.109 INFO:teuthology.run_tasks:Running task pcp... 2024-05-09T09:37:18.178 INFO:teuthology.run_tasks:Running task selinux... 2024-05-09T09:37:18.187 DEBUG:teuthology.task.selinux:Excluding smithi110: OS 'ubuntu' does not support SELinux 2024-05-09T09:37:18.187 DEBUG:teuthology.task.selinux:Excluding smithi157: OS 'ubuntu' does not support SELinux 2024-05-09T09:37:18.188 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-09T09:37:18.188 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-05-09T09:37:18.188 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-09T09:37:18.188 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-09T09:37:18.199 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-09T09:37:18.204 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-09T09:37:18.329 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-09T09:37:18.345 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-09T09:37:18.347 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi110.front.sepia.ceph.com,smithi157.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-09T09:44:20.169 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi110.front.sepia.ceph.com'), Remote(name='ubuntu@smithi157.front.sepia.ceph.com')] 2024-05-09T09:44:20.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-05-09T09:44:20.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T09:44:20.256 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-05-09T09:44:20.338 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-05-09T09:44:20.338 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-05-09T09:44:20.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T09:44:20.440 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-05-09T09:44:20.523 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-05-09T09:44:20.524 INFO:teuthology.run_tasks:Running task clock... 2024-05-09T09:44:20.536 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-09T09:44:20.536 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-09T09:44:20.537 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T09:44:20.539 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-09T09:44:20.540 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T09:44:20.567 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 09:44:20 ntpd[17259]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-09T09:44:20.567 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 09:44:20 ntpd[17259]: Command line: ntpd -gq 2024-05-09T09:44:20.567 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 09:44:20 ntpd[17259]: ---------------------------------------------------- 2024-05-09T09:44:20.567 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 09:44:20 ntpd[17259]: ntp-4 is maintained by Network Time Foundation, 2024-05-09T09:44:20.567 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 09:44:20 ntpd[17259]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-09T09:44:20.567 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 09:44:20 ntpd[17259]: corporation. Support and training for ntp-4 are 2024-05-09T09:44:20.567 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 09:44:20 ntpd[17259]: available at https://www.nwtime.org/support 2024-05-09T09:44:20.567 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 09:44:20 ntpd[17259]: ---------------------------------------------------- 2024-05-09T09:44:20.569 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 09:44:20 ntpd[17259]: proto: precision = 0.069 usec (-24) 2024-05-09T09:44:20.569 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 09:44:20 ntpd[17259]: basedate set to 2022-02-04 2024-05-09T09:44:20.569 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 09:44:20 ntpd[17259]: gps base set to 2022-02-06 (week 2196) 2024-05-09T09:44:20.569 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 09:44:20 ntpd[17259]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-09T09:44:20.569 INFO:teuthology.orchestra.run.smithi110.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-09T09:44:20.569 INFO:teuthology.orchestra.run.smithi110.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-09T09:44:20.570 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 09:44:20 ntpd[17259]: restrict ::: KOD does nothing without LIMITED. 2024-05-09T09:44:20.570 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 09:44:20 ntpd[17259]: Listen and drop on 0 v6wildcard [::]:123 2024-05-09T09:44:20.571 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 09:44:20 ntpd[17259]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-09T09:44:20.571 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 09:44:20 ntpd[17259]: Listen normally on 2 lo 127.0.0.1:123 2024-05-09T09:44:20.571 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 09:44:20 ntpd[17259]: Listen normally on 3 enp3s0f1 172.21.15.110:123 2024-05-09T09:44:20.571 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 09:44:20 ntpd[17259]: Listen normally on 4 lo [::1]:123 2024-05-09T09:44:20.571 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 09:44:20 ntpd[17259]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc35%5]:123 2024-05-09T09:44:20.571 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 09:44:20 ntpd[17259]: Listening on routing socket on fd #22 for interface updates 2024-05-09T09:44:20.593 INFO:teuthology.orchestra.run.smithi157.stdout: 9 May 09:44:20 ntpd[17234]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-09T09:44:20.593 INFO:teuthology.orchestra.run.smithi157.stdout: 9 May 09:44:20 ntpd[17234]: Command line: ntpd -gq 2024-05-09T09:44:20.593 INFO:teuthology.orchestra.run.smithi157.stdout: 9 May 09:44:20 ntpd[17234]: ---------------------------------------------------- 2024-05-09T09:44:20.593 INFO:teuthology.orchestra.run.smithi157.stdout: 9 May 09:44:20 ntpd[17234]: ntp-4 is maintained by Network Time Foundation, 2024-05-09T09:44:20.593 INFO:teuthology.orchestra.run.smithi157.stdout: 9 May 09:44:20 ntpd[17234]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-09T09:44:20.594 INFO:teuthology.orchestra.run.smithi157.stdout: 9 May 09:44:20 ntpd[17234]: corporation. Support and training for ntp-4 are 2024-05-09T09:44:20.594 INFO:teuthology.orchestra.run.smithi157.stdout: 9 May 09:44:20 ntpd[17234]: available at https://www.nwtime.org/support 2024-05-09T09:44:20.594 INFO:teuthology.orchestra.run.smithi157.stdout: 9 May 09:44:20 ntpd[17234]: ---------------------------------------------------- 2024-05-09T09:44:20.594 INFO:teuthology.orchestra.run.smithi157.stdout: 9 May 09:44:20 ntpd[17234]: proto: precision = 0.060 usec (-24) 2024-05-09T09:44:20.594 INFO:teuthology.orchestra.run.smithi157.stdout: 9 May 09:44:20 ntpd[17234]: basedate set to 2022-02-04 2024-05-09T09:44:20.594 INFO:teuthology.orchestra.run.smithi157.stdout: 9 May 09:44:20 ntpd[17234]: gps base set to 2022-02-06 (week 2196) 2024-05-09T09:44:20.595 INFO:teuthology.orchestra.run.smithi157.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-09T09:44:20.595 INFO:teuthology.orchestra.run.smithi157.stdout: 9 May 09:44:20 ntpd[17234]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-09T09:44:20.595 INFO:teuthology.orchestra.run.smithi157.stdout: 9 May 09:44:20 ntpd[17234]: restrict ::: KOD does nothing without LIMITED. 2024-05-09T09:44:20.595 INFO:teuthology.orchestra.run.smithi157.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-09T09:44:20.596 INFO:teuthology.orchestra.run.smithi157.stdout: 9 May 09:44:20 ntpd[17234]: Listen and drop on 0 v6wildcard [::]:123 2024-05-09T09:44:20.596 INFO:teuthology.orchestra.run.smithi157.stdout: 9 May 09:44:20 ntpd[17234]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-09T09:44:20.596 INFO:teuthology.orchestra.run.smithi157.stdout: 9 May 09:44:20 ntpd[17234]: Listen normally on 2 lo 127.0.0.1:123 2024-05-09T09:44:20.596 INFO:teuthology.orchestra.run.smithi157.stdout: 9 May 09:44:20 ntpd[17234]: Listen normally on 3 enp3s0f1 172.21.15.157:123 2024-05-09T09:44:20.596 INFO:teuthology.orchestra.run.smithi157.stdout: 9 May 09:44:20 ntpd[17234]: Listen normally on 4 lo [::1]:123 2024-05-09T09:44:20.597 INFO:teuthology.orchestra.run.smithi157.stdout: 9 May 09:44:20 ntpd[17234]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7ea1%5]:123 2024-05-09T09:44:20.597 INFO:teuthology.orchestra.run.smithi157.stdout: 9 May 09:44:20 ntpd[17234]: Listening on routing socket on fd #22 for interface updates 2024-05-09T09:44:21.568 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:21 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:21.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:21 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:21.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:21 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:21.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:21 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:21.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:21 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:21.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:21 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:21.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:21 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:21.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:21 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:21.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:21 ntpd[17259]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:44:21.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:21 ntpd[17259]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:44:21.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:21 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:21.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:21 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:21.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:21 ntpd[17259]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:44:21.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:21 ntpd[17259]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:44:21.593 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:21 ntpd[17234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:21.594 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:21 ntpd[17234]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:21.594 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:21 ntpd[17234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:21.594 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:21 ntpd[17234]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:21.594 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:21 ntpd[17234]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:44:21.594 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:21 ntpd[17234]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:44:23.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:23 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:23.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:23 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:23.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:23 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:23.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:23 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:23.570 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:23 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:23.570 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:23 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:23.570 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:23 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:23.570 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:23 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:23.570 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:23 ntpd[17259]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:44:23.570 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:23 ntpd[17259]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:44:23.570 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:23 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:23.570 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:23 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:23.570 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:23 ntpd[17259]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:44:23.570 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:23 ntpd[17259]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:44:23.570 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:23 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:23.570 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:23 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:23.570 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:23 ntpd[17259]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:44:23.571 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:23 ntpd[17259]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:44:23.596 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:23 ntpd[17234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:23.596 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:23 ntpd[17234]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:23.596 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:23 ntpd[17234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:23.596 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:23 ntpd[17234]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:23.596 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:23 ntpd[17234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:23.596 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:23 ntpd[17234]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:23.596 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:23 ntpd[17234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:23.596 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:23 ntpd[17234]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:23.596 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:23 ntpd[17234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:23.596 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:23 ntpd[17234]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:23.596 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:23 ntpd[17234]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:44:23.596 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:23 ntpd[17234]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:44:23.597 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:23 ntpd[17234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:23.597 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:23 ntpd[17234]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:23.597 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:23 ntpd[17234]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:44:23.597 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:23 ntpd[17234]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:44:23.597 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:23 ntpd[17234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:23.597 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:23 ntpd[17234]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:23.597 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:23 ntpd[17234]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:44:23.597 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:23 ntpd[17234]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:44:25.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:25 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:25.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:25 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:25.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:25 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:25.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:25 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:25.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:25 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:25.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:25 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:25.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:25 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:25.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:25 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:25.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:25 ntpd[17259]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:44:25.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:25 ntpd[17259]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:44:25.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:25 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:25.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:25 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:25.570 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:25 ntpd[17259]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:44:25.570 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:25 ntpd[17259]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:44:25.570 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:25 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:25.570 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:25 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:25.570 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:25 ntpd[17259]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:44:25.570 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:25 ntpd[17259]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:44:25.595 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:25 ntpd[17234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:25.595 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:25 ntpd[17234]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:25.595 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:25 ntpd[17234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:25.595 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:25 ntpd[17234]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:25.595 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:25 ntpd[17234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:25.596 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:25 ntpd[17234]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:25.596 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:25 ntpd[17234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:25.596 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:25 ntpd[17234]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:25.596 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:25 ntpd[17234]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:44:25.596 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:25 ntpd[17234]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:44:25.596 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:25 ntpd[17234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:25.596 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:25 ntpd[17234]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:25.596 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:25 ntpd[17234]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:44:25.596 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:25 ntpd[17234]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:44:25.596 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:25 ntpd[17234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:25.596 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:25 ntpd[17234]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:25.596 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:25 ntpd[17234]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:44:25.596 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:25 ntpd[17234]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:44:27.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:27 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:27.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:27 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:27.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:27 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:27.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:27 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:27.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:27 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:27.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:27 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:27.569 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:27 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:27.570 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:27 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:27.570 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:27 ntpd[17259]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:44:27.570 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:27 ntpd[17259]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:44:27.570 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:27 ntpd[17259]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:27.570 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:27 ntpd[17259]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:27.570 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:27 ntpd[17259]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:44:27.570 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:27 ntpd[17259]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:44:27.570 INFO:teuthology.orchestra.run.smithi110.stdout: 9 May 09:44:27 ntpd[17259]: ntpd: time slew +0.000183 s 2024-05-09T09:44:27.570 INFO:teuthology.orchestra.run.smithi110.stdout:ntpd: time slew +0.000183s 2024-05-09T09:44:27.571 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:27 ntpd[17259]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-09T09:44:27.571 INFO:teuthology.orchestra.run.smithi110.stderr: 9 May 09:44:27 ntpd[17259]: can't open /var/log/ntpstats/loopstats.20240509: Permission denied 2024-05-09T09:44:27.595 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:27 ntpd[17234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:27.595 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:27 ntpd[17234]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:27.595 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:27 ntpd[17234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:27.595 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:27 ntpd[17234]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:27.595 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:27 ntpd[17234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:27.595 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:27 ntpd[17234]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:27.595 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:27 ntpd[17234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:27.595 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:27 ntpd[17234]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:27.595 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:27 ntpd[17234]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:44:27.595 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:27 ntpd[17234]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:44:27.595 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:27 ntpd[17234]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-09T09:44:27.595 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:27 ntpd[17234]: can't open /var/log/ntpstats/rawstats.20240509: Permission denied 2024-05-09T09:44:27.596 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:27 ntpd[17234]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-09T09:44:27.596 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:27 ntpd[17234]: can't open /var/log/ntpstats/peerstats.20240509: Permission denied 2024-05-09T09:44:27.596 INFO:teuthology.orchestra.run.smithi157.stdout: 9 May 09:44:27 ntpd[17234]: ntpd: time slew -0.000147 s 2024-05-09T09:44:27.596 INFO:teuthology.orchestra.run.smithi157.stdout:ntpd: time slew -0.000147s 2024-05-09T09:44:27.596 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:27 ntpd[17234]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-09T09:44:27.596 INFO:teuthology.orchestra.run.smithi157.stderr: 9 May 09:44:27 ntpd[17234]: can't open /var/log/ntpstats/loopstats.20240509: Permission denied 2024-05-09T09:44:27.625 INFO:teuthology.orchestra.run.smithi110.stdout: remote refid st t when poll reach delay offset jitter 2024-05-09T09:44:27.625 INFO:teuthology.orchestra.run.smithi110.stdout:============================================================================== 2024-05-09T09:44:27.625 INFO:teuthology.orchestra.run.smithi110.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-09T09:44:27.625 INFO:teuthology.orchestra.run.smithi110.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-09T09:44:27.625 INFO:teuthology.orchestra.run.smithi110.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-09T09:44:27.625 INFO:teuthology.orchestra.run.smithi110.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-09T09:44:27.638 INFO:teuthology.orchestra.run.smithi157.stdout: remote refid st t when poll reach delay offset jitter 2024-05-09T09:44:27.638 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================== 2024-05-09T09:44:27.638 INFO:teuthology.orchestra.run.smithi157.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-09T09:44:27.638 INFO:teuthology.orchestra.run.smithi157.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-09T09:44:27.638 INFO:teuthology.orchestra.run.smithi157.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-09T09:44:27.638 INFO:teuthology.orchestra.run.smithi157.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-09T09:44:27.639 INFO:teuthology.run_tasks:Running task install... 2024-05-09T09:44:27.649 DEBUG:teuthology.task.install:project ceph 2024-05-09T09:44:27.650 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2d4f3997312aba36846da54fe4ed144c644dd8fc'}} 2024-05-09T09:44:27.650 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '2d4f3997312aba36846da54fe4ed144c644dd8fc'} 2024-05-09T09:44:27.650 INFO:teuthology.task.install:Using flavor: default 2024-05-09T09:44:27.657 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-09T09:44:27.657 INFO:teuthology.task.install:extra packages: [] 2024-05-09T09:44:27.657 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-key list | grep Ceph 2024-05-09T09:44:27.658 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-key list | grep Ceph 2024-05-09T09:44:27.725 INFO:teuthology.orchestra.run.smithi110.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-09T09:44:27.739 INFO:teuthology.orchestra.run.smithi157.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-09T09:44:27.756 INFO:teuthology.orchestra.run.smithi110.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-09T09:44:27.756 INFO:teuthology.orchestra.run.smithi110.stdout:uid [ unknown] Ceph.com (release key) 2024-05-09T09:44:27.756 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-05-09T09:44:27.757 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2d4f3997312aba36846da54fe4ed144c644dd8fc 2024-05-09T09:44:27.768 INFO:teuthology.orchestra.run.smithi157.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-09T09:44:27.769 INFO:teuthology.orchestra.run.smithi157.stdout:uid [ unknown] Ceph.com (release key) 2024-05-09T09:44:27.769 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-05-09T09:44:27.770 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2d4f3997312aba36846da54fe4ed144c644dd8fc 2024-05-09T09:44:27.900 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default/ 2024-05-09T09:44:27.901 INFO:teuthology.task.install.deb:Package version is 19.0.0-3093-g2d4f3997-1jammy 2024-05-09T09:44:27.913 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default/ 2024-05-09T09:44:27.913 INFO:teuthology.task.install.deb:Package version is 19.0.0-3093-g2d4f3997-1jammy 2024-05-09T09:44:28.026 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T09:44:28.026 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-09T09:44:28.040 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get update 2024-05-09T09:44:28.095 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-09T09:44:28.096 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-09T09:44:28.110 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get update 2024-05-09T09:44:28.284 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-09T09:44:28.284 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-09T09:44:28.298 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-09T09:44:28.323 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-09T09:44:28.339 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-09T09:44:28.339 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-09T09:44:28.412 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-09T09:44:28.496 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-09T09:44:28.638 INFO:teuthology.orchestra.run.smithi157.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy InRelease 2024-05-09T09:44:28.675 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2024-05-09T09:44:28.721 INFO:teuthology.orchestra.run.smithi157.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-09T09:44:28.759 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.3 kB] 2024-05-09T09:44:28.843 INFO:teuthology.orchestra.run.smithi157.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,417 B] 2024-05-09T09:44:28.928 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 28.7 kB in 1s (45.7 kB/s) 2024-05-09T09:44:29.343 INFO:teuthology.orchestra.run.smithi110.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy InRelease 2024-05-09T09:44:29.380 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2024-05-09T09:44:29.421 INFO:teuthology.orchestra.run.smithi110.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-09T09:44:29.460 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.3 kB] 2024-05-09T09:44:29.508 INFO:teuthology.orchestra.run.smithi110.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,417 B] 2024-05-09T09:44:29.599 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 28.7 kB in 1s (21.0 kB/s) 2024-05-09T09:44:29.911 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-05-09T09:44:29.928 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3093-g2d4f3997-1jammy cephadm=19.0.0-3093-g2d4f3997-1jammy ceph-mds=19.0.0-3093-g2d4f3997-1jammy ceph-mgr=19.0.0-3093-g2d4f3997-1jammy ceph-common=19.0.0-3093-g2d4f3997-1jammy ceph-fuse=19.0.0-3093-g2d4f3997-1jammy ceph-test=19.0.0-3093-g2d4f3997-1jammy ceph-volume=19.0.0-3093-g2d4f3997-1jammy radosgw=19.0.0-3093-g2d4f3997-1jammy python3-rados=19.0.0-3093-g2d4f3997-1jammy python3-rgw=19.0.0-3093-g2d4f3997-1jammy python3-cephfs=19.0.0-3093-g2d4f3997-1jammy python3-rbd=19.0.0-3093-g2d4f3997-1jammy libcephfs2=19.0.0-3093-g2d4f3997-1jammy libcephfs-dev=19.0.0-3093-g2d4f3997-1jammy librados2=19.0.0-3093-g2d4f3997-1jammy librbd1=19.0.0-3093-g2d4f3997-1jammy rbd-fuse=19.0.0-3093-g2d4f3997-1jammy 2024-05-09T09:44:29.980 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-05-09T09:44:30.158 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-05-09T09:44:30.158 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-05-09T09:44:30.329 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2024-05-09T09:44:30.329 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-09T09:44:30.330 INFO:teuthology.orchestra.run.smithi157.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-09T09:44:30.330 INFO:teuthology.orchestra.run.smithi157.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-09T09:44:30.330 INFO:teuthology.orchestra.run.smithi157.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-09T09:44:30.332 INFO:teuthology.orchestra.run.smithi157.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-09T09:44:30.332 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-09T09:44:30.332 INFO:teuthology.orchestra.run.smithi157.stdout:The following additional packages will be installed: 2024-05-09T09:44:30.332 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-09T09:44:30.332 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-09T09:44:30.332 INFO:teuthology.orchestra.run.smithi157.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-09T09:44:30.332 INFO:teuthology.orchestra.run.smithi157.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-09T09:44:30.332 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-09T09:44:30.332 INFO:teuthology.orchestra.run.smithi157.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-09T09:44:30.332 INFO:teuthology.orchestra.run.smithi157.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-09T09:44:30.332 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-09T09:44:30.332 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-09T09:44:30.332 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-09T09:44:30.333 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-09T09:44:30.333 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-09T09:44:30.333 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-09T09:44:30.333 INFO:teuthology.orchestra.run.smithi157.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-09T09:44:30.333 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-09T09:44:30.333 INFO:teuthology.orchestra.run.smithi157.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-09T09:44:30.333 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-05-09T09:44:30.333 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-05-09T09:44:30.333 INFO:teuthology.orchestra.run.smithi157.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-09T09:44:30.333 INFO:teuthology.orchestra.run.smithi157.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-09T09:44:30.333 INFO:teuthology.orchestra.run.smithi157.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-09T09:44:30.333 INFO:teuthology.orchestra.run.smithi157.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-09T09:44:30.333 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-05-09T09:44:30.333 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet zip 2024-05-09T09:44:30.334 INFO:teuthology.orchestra.run.smithi157.stdout:Suggested packages: 2024-05-09T09:44:30.334 INFO:teuthology.orchestra.run.smithi157.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-09T09:44:30.334 INFO:teuthology.orchestra.run.smithi157.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-09T09:44:30.334 INFO:teuthology.orchestra.run.smithi157.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-09T09:44:30.334 INFO:teuthology.orchestra.run.smithi157.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-09T09:44:30.334 INFO:teuthology.orchestra.run.smithi157.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-09T09:44:30.334 INFO:teuthology.orchestra.run.smithi157.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-09T09:44:30.334 INFO:teuthology.orchestra.run.smithi157.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-09T09:44:30.334 INFO:teuthology.orchestra.run.smithi157.stdout:Recommended packages: 2024-05-09T09:44:30.334 INFO:teuthology.orchestra.run.smithi157.stdout: btrfs-tools 2024-05-09T09:44:30.437 INFO:teuthology.orchestra.run.smithi157.stdout:The following NEW packages will be installed: 2024-05-09T09:44:30.437 INFO:teuthology.orchestra.run.smithi157.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-09T09:44:30.437 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-09T09:44:30.437 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-05-09T09:44:30.437 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-05-09T09:44:30.437 INFO:teuthology.orchestra.run.smithi157.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-05-09T09:44:30.437 INFO:teuthology.orchestra.run.smithi157.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-05-09T09:44:30.438 INFO:teuthology.orchestra.run.smithi157.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-05-09T09:44:30.439 INFO:teuthology.orchestra.run.smithi157.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-05-09T09:44:30.439 INFO:teuthology.orchestra.run.smithi157.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-05-09T09:44:30.439 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-05-09T09:44:30.439 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-05-09T09:44:30.439 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-09T09:44:30.439 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-09T09:44:30.439 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-09T09:44:30.439 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-09T09:44:30.439 INFO:teuthology.orchestra.run.smithi157.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-09T09:44:30.439 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-09T09:44:30.439 INFO:teuthology.orchestra.run.smithi157.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-09T09:44:30.439 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-05-09T09:44:30.439 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-05-09T09:44:30.439 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-05-09T09:44:30.440 INFO:teuthology.orchestra.run.smithi157.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-05-09T09:44:30.440 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-05-09T09:44:30.440 INFO:teuthology.orchestra.run.smithi157.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-05-09T09:44:30.440 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-05-09T09:44:30.440 INFO:teuthology.orchestra.run.smithi157.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-05-09T09:44:30.569 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-05-09T09:44:30.581 INFO:teuthology.orchestra.run.smithi157.stdout:0 upgraded, 118 newly installed, 0 to remove and 303 not upgraded. 2024-05-09T09:44:30.582 INFO:teuthology.orchestra.run.smithi157.stdout:Need to get 199 MB of archives. 2024-05-09T09:44:30.582 INFO:teuthology.orchestra.run.smithi157.stdout:After this operation, 891 MB of additional disk space will be used. 2024-05-09T09:44:30.582 INFO:teuthology.orchestra.run.smithi157.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3093-g2d4f3997-1jammy [3,547 kB] 2024-05-09T09:44:30.586 DEBUG:teuthology.orchestra.run.smithi110:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3093-g2d4f3997-1jammy cephadm=19.0.0-3093-g2d4f3997-1jammy ceph-mds=19.0.0-3093-g2d4f3997-1jammy ceph-mgr=19.0.0-3093-g2d4f3997-1jammy ceph-common=19.0.0-3093-g2d4f3997-1jammy ceph-fuse=19.0.0-3093-g2d4f3997-1jammy ceph-test=19.0.0-3093-g2d4f3997-1jammy ceph-volume=19.0.0-3093-g2d4f3997-1jammy radosgw=19.0.0-3093-g2d4f3997-1jammy python3-rados=19.0.0-3093-g2d4f3997-1jammy python3-rgw=19.0.0-3093-g2d4f3997-1jammy python3-cephfs=19.0.0-3093-g2d4f3997-1jammy python3-rbd=19.0.0-3093-g2d4f3997-1jammy libcephfs2=19.0.0-3093-g2d4f3997-1jammy libcephfs-dev=19.0.0-3093-g2d4f3997-1jammy librados2=19.0.0-3093-g2d4f3997-1jammy librbd1=19.0.0-3093-g2d4f3997-1jammy rbd-fuse=19.0.0-3093-g2d4f3997-1jammy 2024-05-09T09:44:30.628 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-09T09:44:30.642 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-05-09T09:44:30.790 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3093-g2d4f3997-1jammy [3,224 kB] 2024-05-09T09:44:30.818 INFO:teuthology.orchestra.run.smithi110.stdout:Building dependency tree... 2024-05-09T09:44:30.819 INFO:teuthology.orchestra.run.smithi110.stdout:Reading state information... 2024-05-09T09:44:30.888 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3093-g2d4f3997-1jammy [712 kB] 2024-05-09T09:44:30.910 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3093-g2d4f3997-1jammy [357 kB] 2024-05-09T09:44:30.923 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3093-g2d4f3997-1jammy [32.8 kB] 2024-05-09T09:44:30.924 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3093-g2d4f3997-1jammy [180 kB] 2024-05-09T09:44:30.929 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3093-g2d4f3997-1jammy [66.9 kB] 2024-05-09T09:44:30.931 INFO:teuthology.orchestra.run.smithi157.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3093-g2d4f3997-1jammy [330 kB] 2024-05-09T09:44:30.942 INFO:teuthology.orchestra.run.smithi157.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3093-g2d4f3997-1jammy [6,890 kB] 2024-05-09T09:44:30.992 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages were automatically installed and are no longer required: 2024-05-09T09:44:30.992 INFO:teuthology.orchestra.run.smithi110.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-09T09:44:30.992 INFO:teuthology.orchestra.run.smithi110.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-09T09:44:30.992 INFO:teuthology.orchestra.run.smithi110.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-09T09:44:30.993 INFO:teuthology.orchestra.run.smithi110.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-09T09:44:30.993 INFO:teuthology.orchestra.run.smithi110.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-09T09:44:30.993 INFO:teuthology.orchestra.run.smithi110.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-09T09:44:30.995 INFO:teuthology.orchestra.run.smithi110.stdout:The following additional packages will be installed: 2024-05-09T09:44:30.995 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-09T09:44:30.995 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-09T09:44:30.995 INFO:teuthology.orchestra.run.smithi110.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-09T09:44:30.995 INFO:teuthology.orchestra.run.smithi110.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-09T09:44:30.995 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-09T09:44:30.995 INFO:teuthology.orchestra.run.smithi110.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-09T09:44:30.995 INFO:teuthology.orchestra.run.smithi110.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-09T09:44:30.995 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-09T09:44:30.995 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-09T09:44:30.995 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-09T09:44:30.995 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-09T09:44:30.995 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-09T09:44:30.995 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-09T09:44:30.996 INFO:teuthology.orchestra.run.smithi110.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-09T09:44:30.996 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-09T09:44:30.996 INFO:teuthology.orchestra.run.smithi110.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-09T09:44:30.996 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-05-09T09:44:30.996 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-05-09T09:44:30.996 INFO:teuthology.orchestra.run.smithi110.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-09T09:44:30.996 INFO:teuthology.orchestra.run.smithi110.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-09T09:44:30.996 INFO:teuthology.orchestra.run.smithi110.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-09T09:44:30.996 INFO:teuthology.orchestra.run.smithi110.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-09T09:44:30.996 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-05-09T09:44:30.996 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet zip 2024-05-09T09:44:30.997 INFO:teuthology.orchestra.run.smithi110.stdout:Suggested packages: 2024-05-09T09:44:30.997 INFO:teuthology.orchestra.run.smithi110.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-09T09:44:30.997 INFO:teuthology.orchestra.run.smithi110.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-09T09:44:30.997 INFO:teuthology.orchestra.run.smithi110.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-09T09:44:30.997 INFO:teuthology.orchestra.run.smithi110.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-09T09:44:30.997 INFO:teuthology.orchestra.run.smithi110.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-09T09:44:30.997 INFO:teuthology.orchestra.run.smithi110.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-09T09:44:30.997 INFO:teuthology.orchestra.run.smithi110.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-09T09:44:30.997 INFO:teuthology.orchestra.run.smithi110.stdout:Recommended packages: 2024-05-09T09:44:30.997 INFO:teuthology.orchestra.run.smithi110.stdout: btrfs-tools 2024-05-09T09:44:31.050 INFO:teuthology.orchestra.run.smithi157.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-09T09:44:31.064 INFO:teuthology.orchestra.run.smithi157.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-09T09:44:31.093 INFO:teuthology.orchestra.run.smithi110.stdout:The following NEW packages will be installed: 2024-05-09T09:44:31.094 INFO:teuthology.orchestra.run.smithi110.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-09T09:44:31.094 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-09T09:44:31.094 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-05-09T09:44:31.094 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-05-09T09:44:31.094 INFO:teuthology.orchestra.run.smithi110.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-05-09T09:44:31.094 INFO:teuthology.orchestra.run.smithi110.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-05-09T09:44:31.095 INFO:teuthology.orchestra.run.smithi110.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-05-09T09:44:31.095 INFO:teuthology.orchestra.run.smithi110.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-05-09T09:44:31.095 INFO:teuthology.orchestra.run.smithi110.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-05-09T09:44:31.095 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-05-09T09:44:31.095 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-05-09T09:44:31.095 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-09T09:44:31.096 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-09T09:44:31.096 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-09T09:44:31.096 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-09T09:44:31.096 INFO:teuthology.orchestra.run.smithi110.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-09T09:44:31.096 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-09T09:44:31.096 INFO:teuthology.orchestra.run.smithi110.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-09T09:44:31.096 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-05-09T09:44:31.096 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-05-09T09:44:31.096 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-05-09T09:44:31.096 INFO:teuthology.orchestra.run.smithi110.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-05-09T09:44:31.096 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-05-09T09:44:31.096 INFO:teuthology.orchestra.run.smithi110.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-05-09T09:44:31.096 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-05-09T09:44:31.096 INFO:teuthology.orchestra.run.smithi110.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-05-09T09:44:31.144 INFO:teuthology.orchestra.run.smithi157.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-09T09:44:31.173 INFO:teuthology.orchestra.run.smithi157.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3093-g2d4f3997-1jammy [112 kB] 2024-05-09T09:44:31.176 INFO:teuthology.orchestra.run.smithi157.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3093-g2d4f3997-1jammy [466 kB] 2024-05-09T09:44:31.188 INFO:teuthology.orchestra.run.smithi157.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3093-g2d4f3997-1jammy [25.7 MB] 2024-05-09T09:44:31.287 INFO:teuthology.orchestra.run.smithi110.stdout:0 upgraded, 118 newly installed, 0 to remove and 303 not upgraded. 2024-05-09T09:44:31.287 INFO:teuthology.orchestra.run.smithi110.stdout:Need to get 199 MB of archives. 2024-05-09T09:44:31.287 INFO:teuthology.orchestra.run.smithi110.stdout:After this operation, 891 MB of additional disk space will be used. 2024-05-09T09:44:31.287 INFO:teuthology.orchestra.run.smithi110.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-09T09:44:31.376 INFO:teuthology.orchestra.run.smithi157.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-09T09:44:31.387 INFO:teuthology.orchestra.run.smithi157.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-09T09:44:31.418 INFO:teuthology.orchestra.run.smithi157.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-09T09:44:31.426 INFO:teuthology.orchestra.run.smithi157.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-09T09:44:31.428 INFO:teuthology.orchestra.run.smithi157.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-09T09:44:31.429 INFO:teuthology.orchestra.run.smithi157.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-09T09:44:31.447 INFO:teuthology.orchestra.run.smithi157.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-09T09:44:31.578 INFO:teuthology.orchestra.run.smithi110.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3093-g2d4f3997-1jammy [3,547 kB] 2024-05-09T09:44:31.616 INFO:teuthology.orchestra.run.smithi157.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-09T09:44:31.714 INFO:teuthology.orchestra.run.smithi110.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-09T09:44:31.726 INFO:teuthology.orchestra.run.smithi110.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-09T09:44:31.808 INFO:teuthology.orchestra.run.smithi110.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-09T09:44:32.023 INFO:teuthology.orchestra.run.smithi157.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-09T09:44:32.038 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-09T09:44:32.049 INFO:teuthology.orchestra.run.smithi110.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-09T09:44:32.056 INFO:teuthology.orchestra.run.smithi157.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-09T09:44:32.059 INFO:teuthology.orchestra.run.smithi157.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-09T09:44:32.079 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-09T09:44:32.088 INFO:teuthology.orchestra.run.smithi110.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-09T09:44:32.089 INFO:teuthology.orchestra.run.smithi110.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-09T09:44:32.093 INFO:teuthology.orchestra.run.smithi110.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-09T09:44:32.109 INFO:teuthology.orchestra.run.smithi110.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-09T09:44:32.141 INFO:teuthology.orchestra.run.smithi157.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-09T09:44:32.204 INFO:teuthology.orchestra.run.smithi157.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-09T09:44:32.205 INFO:teuthology.orchestra.run.smithi157.stdout:Get:30 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3093-g2d4f3997-1jammy [23.8 MB] 2024-05-09T09:44:32.212 INFO:teuthology.orchestra.run.smithi157.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-09T09:44:32.218 INFO:teuthology.orchestra.run.smithi157.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-09T09:44:32.219 INFO:teuthology.orchestra.run.smithi157.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-09T09:44:32.231 INFO:teuthology.orchestra.run.smithi157.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-09T09:44:32.232 INFO:teuthology.orchestra.run.smithi157.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-09T09:44:32.277 INFO:teuthology.orchestra.run.smithi110.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-09T09:44:32.398 INFO:teuthology.orchestra.run.smithi157.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-09T09:44:32.482 INFO:teuthology.orchestra.run.smithi157.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-09T09:44:32.510 INFO:teuthology.orchestra.run.smithi157.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-09T09:44:32.527 INFO:teuthology.orchestra.run.smithi157.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-09T09:44:32.572 INFO:teuthology.orchestra.run.smithi157.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-09T09:44:32.688 INFO:teuthology.orchestra.run.smithi110.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-09T09:44:32.722 INFO:teuthology.orchestra.run.smithi110.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-09T09:44:32.725 INFO:teuthology.orchestra.run.smithi110.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-09T09:44:32.763 INFO:teuthology.orchestra.run.smithi110.stdout:Get:17 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3093-g2d4f3997-1jammy [3,224 kB] 2024-05-09T09:44:32.783 INFO:teuthology.orchestra.run.smithi157.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-09T09:44:32.798 INFO:teuthology.orchestra.run.smithi157.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-09T09:44:32.804 INFO:teuthology.orchestra.run.smithi110.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-09T09:44:32.805 INFO:teuthology.orchestra.run.smithi157.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-09T09:44:32.810 INFO:teuthology.orchestra.run.smithi157.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-09T09:44:32.831 INFO:teuthology.orchestra.run.smithi157.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-09T09:44:32.835 INFO:teuthology.orchestra.run.smithi157.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-09T09:44:32.855 INFO:teuthology.orchestra.run.smithi110.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-09T09:44:32.877 INFO:teuthology.orchestra.run.smithi110.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-09T09:44:32.884 INFO:teuthology.orchestra.run.smithi110.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-09T09:44:32.885 INFO:teuthology.orchestra.run.smithi110.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-09T09:44:32.896 INFO:teuthology.orchestra.run.smithi110.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-09T09:44:32.897 INFO:teuthology.orchestra.run.smithi110.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-09T09:44:33.002 INFO:teuthology.orchestra.run.smithi157.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-09T09:44:33.063 INFO:teuthology.orchestra.run.smithi110.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-09T09:44:33.146 INFO:teuthology.orchestra.run.smithi110.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-09T09:44:33.149 INFO:teuthology.orchestra.run.smithi157.stdout:Get:48 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3093-g2d4f3997-1jammy [244 kB] 2024-05-09T09:44:33.154 INFO:teuthology.orchestra.run.smithi157.stdout:Get:49 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3093-g2d4f3997-1jammy [124 kB] 2024-05-09T09:44:33.157 INFO:teuthology.orchestra.run.smithi157.stdout:Get:50 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3093-g2d4f3997-1jammy [1,525 kB] 2024-05-09T09:44:33.175 INFO:teuthology.orchestra.run.smithi110.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-09T09:44:33.186 INFO:teuthology.orchestra.run.smithi157.stdout:Get:51 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3093-g2d4f3997-1jammy [6,258 kB] 2024-05-09T09:44:33.191 INFO:teuthology.orchestra.run.smithi110.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-09T09:44:33.236 INFO:teuthology.orchestra.run.smithi110.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-09T09:44:33.324 INFO:teuthology.orchestra.run.smithi157.stdout:Get:52 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3093-g2d4f3997-1jammy [22.8 MB] 2024-05-09T09:44:33.335 INFO:teuthology.orchestra.run.smithi157.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-09T09:44:33.349 INFO:teuthology.orchestra.run.smithi110.stdout:Get:30 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3093-g2d4f3997-1jammy [712 kB] 2024-05-09T09:44:33.367 INFO:teuthology.orchestra.run.smithi157.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-09T09:44:33.377 INFO:teuthology.orchestra.run.smithi157.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-09T09:44:33.445 INFO:teuthology.orchestra.run.smithi110.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-09T09:44:33.460 INFO:teuthology.orchestra.run.smithi110.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-09T09:44:33.467 INFO:teuthology.orchestra.run.smithi110.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-09T09:44:33.472 INFO:teuthology.orchestra.run.smithi110.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-09T09:44:33.494 INFO:teuthology.orchestra.run.smithi110.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-09T09:44:33.497 INFO:teuthology.orchestra.run.smithi110.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-09T09:44:33.509 INFO:teuthology.orchestra.run.smithi110.stdout:Get:37 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3093-g2d4f3997-1jammy [357 kB] 2024-05-09T09:44:33.583 INFO:teuthology.orchestra.run.smithi110.stdout:Get:38 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3093-g2d4f3997-1jammy [32.8 kB] 2024-05-09T09:44:33.584 INFO:teuthology.orchestra.run.smithi157.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-09T09:44:33.585 INFO:teuthology.orchestra.run.smithi157.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-09T09:44:33.588 INFO:teuthology.orchestra.run.smithi110.stdout:Get:39 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3093-g2d4f3997-1jammy [180 kB] 2024-05-09T09:44:33.590 INFO:teuthology.orchestra.run.smithi157.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-09T09:44:33.596 INFO:teuthology.orchestra.run.smithi157.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-09T09:44:33.612 INFO:teuthology.orchestra.run.smithi157.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-09T09:44:33.634 INFO:teuthology.orchestra.run.smithi157.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-09T09:44:33.637 INFO:teuthology.orchestra.run.smithi110.stdout:Get:40 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3093-g2d4f3997-1jammy [66.9 kB] 2024-05-09T09:44:33.641 INFO:teuthology.orchestra.run.smithi157.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-09T09:44:33.658 INFO:teuthology.orchestra.run.smithi110.stdout:Get:41 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3093-g2d4f3997-1jammy [330 kB] 2024-05-09T09:44:33.663 INFO:teuthology.orchestra.run.smithi110.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-09T09:44:33.719 INFO:teuthology.orchestra.run.smithi110.stdout:Get:43 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3093-g2d4f3997-1jammy [6,890 kB] 2024-05-09T09:44:33.816 INFO:teuthology.orchestra.run.smithi157.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-09T09:44:33.998 INFO:teuthology.orchestra.run.smithi110.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-09T09:44:34.029 INFO:teuthology.orchestra.run.smithi110.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-09T09:44:34.040 INFO:teuthology.orchestra.run.smithi110.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-09T09:44:34.083 INFO:teuthology.orchestra.run.smithi157.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-09T09:44:34.243 INFO:teuthology.orchestra.run.smithi110.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-09T09:44:34.244 INFO:teuthology.orchestra.run.smithi110.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-09T09:44:34.250 INFO:teuthology.orchestra.run.smithi110.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-09T09:44:34.256 INFO:teuthology.orchestra.run.smithi110.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-09T09:44:34.271 INFO:teuthology.orchestra.run.smithi110.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-09T09:44:34.293 INFO:teuthology.orchestra.run.smithi110.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-09T09:44:34.299 INFO:teuthology.orchestra.run.smithi110.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-09T09:44:34.307 INFO:teuthology.orchestra.run.smithi157.stdout:Get:65 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3093-g2d4f3997-1jammy [14.0 kB] 2024-05-09T09:44:34.307 INFO:teuthology.orchestra.run.smithi157.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-09T09:44:34.307 INFO:teuthology.orchestra.run.smithi157.stdout:Get:67 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3093-g2d4f3997-1jammy [870 kB] 2024-05-09T09:44:34.308 INFO:teuthology.orchestra.run.smithi157.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-09T09:44:34.309 INFO:teuthology.orchestra.run.smithi157.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-09T09:44:34.324 INFO:teuthology.orchestra.run.smithi157.stdout:Get:70 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3093-g2d4f3997-1jammy [2,437 kB] 2024-05-09T09:44:34.359 INFO:teuthology.orchestra.run.smithi157.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-09T09:44:34.366 INFO:teuthology.orchestra.run.smithi157.stdout:Get:72 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3093-g2d4f3997-1jammy [792 kB] 2024-05-09T09:44:34.375 INFO:teuthology.orchestra.run.smithi157.stdout:Get:73 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3093-g2d4f3997-1jammy [148 kB] 2024-05-09T09:44:34.380 INFO:teuthology.orchestra.run.smithi157.stdout:Get:74 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3093-g2d4f3997-1jammy [2,304 kB] 2024-05-09T09:44:34.469 INFO:teuthology.orchestra.run.smithi157.stdout:Get:75 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3093-g2d4f3997-1jammy [8,625 kB] 2024-05-09T09:44:34.473 INFO:teuthology.orchestra.run.smithi110.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-09T09:44:34.654 INFO:teuthology.orchestra.run.smithi157.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-09T09:44:34.657 INFO:teuthology.orchestra.run.smithi157.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-09T09:44:34.660 INFO:teuthology.orchestra.run.smithi157.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-09T09:44:34.660 INFO:teuthology.orchestra.run.smithi157.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-09T09:44:34.663 INFO:teuthology.orchestra.run.smithi157.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-09T09:44:34.736 INFO:teuthology.orchestra.run.smithi110.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-09T09:44:34.811 INFO:teuthology.orchestra.run.smithi157.stdout:Get:81 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3093-g2d4f3997-1jammy [14.2 kB] 2024-05-09T09:44:34.811 INFO:teuthology.orchestra.run.smithi157.stdout:Get:82 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3093-g2d4f3997-1jammy [51.4 MB] 2024-05-09T09:44:34.885 INFO:teuthology.orchestra.run.smithi157.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-09T09:44:34.914 INFO:teuthology.orchestra.run.smithi110.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-09T09:44:34.928 INFO:teuthology.orchestra.run.smithi110.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-09T09:44:34.947 INFO:teuthology.orchestra.run.smithi110.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-09T09:44:35.012 INFO:teuthology.orchestra.run.smithi110.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-09T09:44:35.061 INFO:teuthology.orchestra.run.smithi110.stdout:Get:60 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3093-g2d4f3997-1jammy [112 kB] 2024-05-09T09:44:35.079 INFO:teuthology.orchestra.run.smithi110.stdout:Get:61 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3093-g2d4f3997-1jammy [466 kB] 2024-05-09T09:44:35.171 INFO:teuthology.orchestra.run.smithi110.stdout:Get:62 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3093-g2d4f3997-1jammy [25.7 MB] 2024-05-09T09:44:35.299 INFO:teuthology.orchestra.run.smithi110.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-09T09:44:35.302 INFO:teuthology.orchestra.run.smithi110.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-09T09:44:35.305 INFO:teuthology.orchestra.run.smithi110.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-09T09:44:35.305 INFO:teuthology.orchestra.run.smithi110.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-09T09:44:35.308 INFO:teuthology.orchestra.run.smithi110.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-09T09:44:35.315 INFO:teuthology.orchestra.run.smithi157.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-09T09:44:35.320 INFO:teuthology.orchestra.run.smithi157.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-09T09:44:35.532 INFO:teuthology.orchestra.run.smithi110.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-09T09:44:35.611 INFO:teuthology.orchestra.run.smithi157.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-09T09:44:35.611 INFO:teuthology.orchestra.run.smithi157.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-09T09:44:35.613 INFO:teuthology.orchestra.run.smithi157.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-09T09:44:35.614 INFO:teuthology.orchestra.run.smithi157.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-09T09:44:35.616 INFO:teuthology.orchestra.run.smithi157.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-09T09:44:35.618 INFO:teuthology.orchestra.run.smithi157.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-09T09:44:35.619 INFO:teuthology.orchestra.run.smithi157.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-09T09:44:35.621 INFO:teuthology.orchestra.run.smithi157.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-09T09:44:35.802 INFO:teuthology.orchestra.run.smithi157.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-09T09:44:35.963 INFO:teuthology.orchestra.run.smithi110.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-09T09:44:35.969 INFO:teuthology.orchestra.run.smithi110.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-09T09:44:36.216 INFO:teuthology.orchestra.run.smithi157.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-09T09:44:36.257 INFO:teuthology.orchestra.run.smithi110.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-09T09:44:36.258 INFO:teuthology.orchestra.run.smithi110.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-09T09:44:36.260 INFO:teuthology.orchestra.run.smithi110.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-09T09:44:36.262 INFO:teuthology.orchestra.run.smithi110.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-09T09:44:36.262 INFO:teuthology.orchestra.run.smithi157.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-09T09:44:36.263 INFO:teuthology.orchestra.run.smithi110.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-09T09:44:36.265 INFO:teuthology.orchestra.run.smithi110.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-09T09:44:36.266 INFO:teuthology.orchestra.run.smithi110.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-09T09:44:36.268 INFO:teuthology.orchestra.run.smithi110.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-09T09:44:36.297 INFO:teuthology.orchestra.run.smithi157.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-09T09:44:36.394 INFO:teuthology.orchestra.run.smithi157.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-09T09:44:36.434 INFO:teuthology.orchestra.run.smithi157.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-09T09:44:36.445 INFO:teuthology.orchestra.run.smithi157.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-09T09:44:36.449 INFO:teuthology.orchestra.run.smithi110.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-09T09:44:36.451 INFO:teuthology.orchestra.run.smithi157.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-09T09:44:36.498 INFO:teuthology.orchestra.run.smithi157.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-09T09:44:36.501 INFO:teuthology.orchestra.run.smithi157.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-09T09:44:36.522 INFO:teuthology.orchestra.run.smithi157.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-09T09:44:36.686 INFO:teuthology.orchestra.run.smithi157.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-09T09:44:36.858 INFO:teuthology.orchestra.run.smithi110.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-09T09:44:36.905 INFO:teuthology.orchestra.run.smithi110.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-09T09:44:36.939 INFO:teuthology.orchestra.run.smithi110.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-09T09:44:37.018 INFO:teuthology.orchestra.run.smithi157.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-09T09:44:37.037 INFO:teuthology.orchestra.run.smithi110.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-09T09:44:37.076 INFO:teuthology.orchestra.run.smithi110.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-09T09:44:37.077 INFO:teuthology.orchestra.run.smithi157.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-09T09:44:37.078 INFO:teuthology.orchestra.run.smithi157.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3093-g2d4f3997-1jammy [124 kB] 2024-05-09T09:44:37.081 INFO:teuthology.orchestra.run.smithi157.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3093-g2d4f3997-1jammy [38.9 kB] 2024-05-09T09:44:37.082 INFO:teuthology.orchestra.run.smithi157.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3093-g2d4f3997-1jammy [13.6 MB] 2024-05-09T09:44:37.088 INFO:teuthology.orchestra.run.smithi110.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-09T09:44:37.093 INFO:teuthology.orchestra.run.smithi110.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-09T09:44:37.141 INFO:teuthology.orchestra.run.smithi110.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-09T09:44:37.144 INFO:teuthology.orchestra.run.smithi110.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-09T09:44:37.165 INFO:teuthology.orchestra.run.smithi110.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-09T09:44:37.190 INFO:teuthology.orchestra.run.smithi157.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-09T09:44:37.219 INFO:teuthology.orchestra.run.smithi157.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-09T09:44:37.332 INFO:teuthology.orchestra.run.smithi110.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-09T09:44:37.377 INFO:teuthology.orchestra.run.smithi157.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-09T09:44:37.379 INFO:teuthology.orchestra.run.smithi157.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-09T09:44:37.381 INFO:teuthology.orchestra.run.smithi157.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-09T09:44:37.404 INFO:teuthology.orchestra.run.smithi157.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-09T09:44:37.409 INFO:teuthology.orchestra.run.smithi157.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-09T09:44:37.486 INFO:teuthology.orchestra.run.smithi157.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3093-g2d4f3997-1jammy [91.6 kB] 2024-05-09T09:44:37.606 INFO:teuthology.orchestra.run.smithi110.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-09T09:44:37.623 INFO:teuthology.orchestra.run.smithi110.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-09T09:44:37.778 INFO:teuthology.orchestra.run.smithi110.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-09T09:44:37.807 INFO:teuthology.orchestra.run.smithi110.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-09T09:44:37.964 INFO:teuthology.orchestra.run.smithi110.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-09T09:44:37.967 INFO:teuthology.orchestra.run.smithi110.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-09T09:44:37.968 INFO:teuthology.orchestra.run.smithi110.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-09T09:44:37.991 INFO:teuthology.orchestra.run.smithi110.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-09T09:44:37.996 INFO:teuthology.orchestra.run.smithi110.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-09T09:44:38.075 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 199 MB in 7s (28.2 MB/s) 2024-05-09T09:44:38.266 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-09T09:44:38.367 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-05-09T09:44:38.373 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-09T09:44:38.465 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-09T09:44:38.793 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-09T09:44:38.819 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-09T09:44:38.859 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-09T09:44:38.964 INFO:teuthology.orchestra.run.smithi110.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3093-g2d4f3997-1jammy [23.8 MB] 2024-05-09T09:44:39.137 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-09T09:44:39.164 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-09T09:44:39.196 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-09T09:44:39.633 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-09T09:44:39.659 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-09T09:44:39.707 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T09:44:40.086 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-09T09:44:40.113 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-09T09:44:40.169 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T09:44:40.564 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-09T09:44:40.590 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-09T09:44:40.630 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T09:44:41.009 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-09T09:44:41.036 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-09T09:44:41.075 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-09T09:44:41.387 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librados2. 2024-05-09T09:44:41.413 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../007-librados2_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:44:41.453 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librados2 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:44:41.898 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librbd1. 2024-05-09T09:44:41.925 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../008-librbd1_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:44:41.964 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librbd1 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:44:42.351 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libcephfs2. 2024-05-09T09:44:42.373 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:44:42.409 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libcephfs2 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:44:42.458 INFO:teuthology.orchestra.run.smithi110.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3093-g2d4f3997-1jammy [244 kB] 2024-05-09T09:44:42.464 INFO:teuthology.orchestra.run.smithi110.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3093-g2d4f3997-1jammy [124 kB] 2024-05-09T09:44:42.466 INFO:teuthology.orchestra.run.smithi110.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3093-g2d4f3997-1jammy [1,525 kB] 2024-05-09T09:44:42.621 INFO:teuthology.orchestra.run.smithi110.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3093-g2d4f3997-1jammy [6,258 kB] 2024-05-09T09:44:42.653 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rados. 2024-05-09T09:44:42.668 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:44:42.711 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rados (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:44:43.039 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-09T09:44:43.065 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:44:43.105 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-ceph-argparse (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:44:43.341 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cephfs. 2024-05-09T09:44:43.357 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:44:43.376 INFO:teuthology.orchestra.run.smithi110.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3093-g2d4f3997-1jammy [22.8 MB] 2024-05-09T09:44:43.400 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cephfs (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:44:43.877 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-09T09:44:43.904 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:44:43.936 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-ceph-common (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:44:44.214 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-09T09:44:44.229 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-09T09:44:44.263 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-09T09:44:44.583 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-prettytable. 2024-05-09T09:44:44.610 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-05-09T09:44:44.650 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-09T09:44:44.919 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rbd. 2024-05-09T09:44:44.934 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:44:44.977 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rbd (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:44:45.297 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-09T09:44:45.320 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-09T09:44:45.355 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-09T09:44:45.616 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-09T09:44:45.631 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-09T09:44:45.666 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-09T09:44:45.945 INFO:teuthology.orchestra.run.smithi110.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3093-g2d4f3997-1jammy [14.0 kB] 2024-05-09T09:44:45.945 INFO:teuthology.orchestra.run.smithi110.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3093-g2d4f3997-1jammy [870 kB] 2024-05-09T09:44:45.961 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-09T09:44:45.976 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-09T09:44:45.984 INFO:teuthology.orchestra.run.smithi110.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3093-g2d4f3997-1jammy [2,437 kB] 2024-05-09T09:44:46.019 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-09T09:44:46.231 INFO:teuthology.orchestra.run.smithi110.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3093-g2d4f3997-1jammy [792 kB] 2024-05-09T09:44:46.304 INFO:teuthology.orchestra.run.smithi110.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3093-g2d4f3997-1jammy [148 kB] 2024-05-09T09:44:46.313 INFO:teuthology.orchestra.run.smithi110.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3093-g2d4f3997-1jammy [2,304 kB] 2024-05-09T09:44:46.355 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package lua5.1. 2024-05-09T09:44:46.382 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-09T09:44:46.422 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-09T09:44:46.532 INFO:teuthology.orchestra.run.smithi110.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3093-g2d4f3997-1jammy [8,625 kB] 2024-05-09T09:44:46.700 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package lua-any. 2024-05-09T09:44:46.715 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-05-09T09:44:46.750 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-09T09:44:46.986 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package zip. 2024-05-09T09:44:47.012 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-05-09T09:44:47.053 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking zip (3.0-12build2) ... 2024-05-09T09:44:47.355 INFO:teuthology.orchestra.run.smithi110.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3093-g2d4f3997-1jammy [14.2 kB] 2024-05-09T09:44:47.355 INFO:teuthology.orchestra.run.smithi110.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3093-g2d4f3997-1jammy [51.4 MB] 2024-05-09T09:44:47.372 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package unzip. 2024-05-09T09:44:47.396 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-09T09:44:47.442 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-09T09:44:47.818 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package luarocks. 2024-05-09T09:44:47.844 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-09T09:44:47.876 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-09T09:44:48.259 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package librgw2. 2024-05-09T09:44:48.286 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../025-librgw2_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:44:48.325 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking librgw2 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:44:48.870 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rgw. 2024-05-09T09:44:48.885 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:44:48.928 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rgw (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:44:49.490 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-09T09:44:49.516 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-09T09:44:49.556 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-09T09:44:49.834 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libradosstriper1. 2024-05-09T09:44:49.861 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:44:49.900 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libradosstriper1 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:44:50.314 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-common. 2024-05-09T09:44:50.339 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:44:50.378 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-common (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:44:51.718 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-base. 2024-05-09T09:44:51.744 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:44:51.793 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-base (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:44:52.182 INFO:teuthology.orchestra.run.smithi110.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3093-g2d4f3997-1jammy [124 kB] 2024-05-09T09:44:52.184 INFO:teuthology.orchestra.run.smithi110.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3093-g2d4f3997-1jammy [38.9 kB] 2024-05-09T09:44:52.185 INFO:teuthology.orchestra.run.smithi110.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3093-g2d4f3997-1jammy [13.6 MB] 2024-05-09T09:44:52.840 INFO:teuthology.orchestra.run.smithi110.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-kkeithley-zipper-ec/2d4f3997312aba36846da54fe4ed144c644dd8fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3093-g2d4f3997-1jammy [91.6 kB] 2024-05-09T09:44:53.071 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-09T09:44:53.098 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-09T09:44:53.138 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-09T09:44:53.391 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cheroot. 2024-05-09T09:44:53.395 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 199 MB in 22s (9,177 kB/s) 2024-05-09T09:44:53.406 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-09T09:44:53.441 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-09T09:44:53.528 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-09T09:44:53.627 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-05-09T09:44:53.632 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-09T09:44:53.710 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-09T09:44:53.727 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-09T09:44:53.753 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-09T09:44:53.793 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-09T09:44:54.105 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-09T09:44:54.131 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-09T09:44:54.171 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-09T09:44:54.180 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-09T09:44:54.207 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-09T09:44:54.247 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-09T09:44:54.458 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-09T09:44:54.473 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-09T09:44:54.516 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-09T09:44:54.617 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-09T09:44:54.644 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-09T09:44:54.683 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-09T09:44:54.819 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-tempora. 2024-05-09T09:44:54.845 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-05-09T09:44:54.885 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-09T09:44:55.112 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-09T09:44:55.139 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-09T09:44:55.187 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T09:44:55.188 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-portend. 2024-05-09T09:44:55.215 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-05-09T09:44:55.255 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-09T09:44:55.524 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-09T09:44:55.540 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-09T09:44:55.565 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-09T09:44:55.574 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-09T09:44:55.592 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-09T09:44:55.632 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T09:44:55.861 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-09T09:44:55.888 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-09T09:44:55.927 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-09T09:44:55.977 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-09T09:44:56.003 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-09T09:44:56.043 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T09:44:56.306 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-natsort. 2024-05-09T09:44:56.332 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-05-09T09:44:56.371 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-09T09:44:56.372 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-09T09:44:56.387 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-09T09:44:56.421 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-09T09:44:56.684 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-logutils. 2024-05-09T09:44:56.711 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-05-09T09:44:56.733 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librados2. 2024-05-09T09:44:56.751 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-09T09:44:56.759 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../007-librados2_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:44:56.799 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librados2 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:44:57.012 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-09T09:44:57.027 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-09T09:44:57.062 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-09T09:44:57.261 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librbd1. 2024-05-09T09:44:57.287 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../008-librbd1_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:44:57.323 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-mako. 2024-05-09T09:44:57.327 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librbd1 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:44:57.338 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-09T09:44:57.381 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-09T09:44:57.711 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-09T09:44:57.738 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-09T09:44:57.778 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-09T09:44:57.788 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libcephfs2. 2024-05-09T09:44:57.815 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:44:57.855 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libcephfs2 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:44:58.107 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rados. 2024-05-09T09:44:58.122 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-09T09:44:58.123 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:44:58.149 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-09T09:44:58.157 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rados (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:44:58.197 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-09T09:44:58.460 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-09T09:44:58.487 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:44:58.508 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-webob. 2024-05-09T09:44:58.526 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-ceph-argparse (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:44:58.535 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-09T09:44:58.575 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-09T09:44:58.804 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cephfs. 2024-05-09T09:44:58.819 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:44:58.862 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cephfs (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:44:58.920 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-waitress. 2024-05-09T09:44:58.946 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-09T09:44:58.990 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-09T09:44:59.264 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-tempita. 2024-05-09T09:44:59.291 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-09T09:44:59.331 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-09T09:44:59.345 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-09T09:44:59.372 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:44:59.416 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-ceph-common (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:44:59.727 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-09T09:44:59.753 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-09T09:44:59.785 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-09T09:44:59.867 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-paste. 2024-05-09T09:44:59.894 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-09T09:44:59.934 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-09T09:45:00.080 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-prettytable. 2024-05-09T09:45:00.107 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-05-09T09:45:00.146 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-09T09:45:00.254 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-09T09:45:00.269 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-09T09:45:00.312 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-09T09:45:00.407 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rbd. 2024-05-09T09:45:00.434 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:00.474 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rbd (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:00.615 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-09T09:45:00.641 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-09T09:45:00.681 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-09T09:45:00.819 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-09T09:45:00.845 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-09T09:45:00.885 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-09T09:45:01.051 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-webtest. 2024-05-09T09:45:01.078 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-05-09T09:45:01.126 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-09T09:45:01.146 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-09T09:45:01.162 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-09T09:45:01.196 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-09T09:45:01.454 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pecan. 2024-05-09T09:45:01.480 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-09T09:45:01.516 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-09T09:45:01.529 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-09T09:45:01.543 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-09T09:45:01.582 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-09T09:45:01.892 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-certifi. 2024-05-09T09:45:01.918 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-05-09T09:45:01.927 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package lua5.1. 2024-05-09T09:45:01.955 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-09T09:45:01.958 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-09T09:45:01.994 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-09T09:45:02.270 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-idna. 2024-05-09T09:45:02.280 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package lua-any. 2024-05-09T09:45:02.296 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-05-09T09:45:02.296 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-05-09T09:45:02.330 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-09T09:45:02.336 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-09T09:45:02.558 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package zip. 2024-05-09T09:45:02.585 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-05-09T09:45:02.625 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking zip (3.0-12build2) ... 2024-05-09T09:45:02.648 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-urllib3. 2024-05-09T09:45:02.674 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-09T09:45:02.714 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-09T09:45:03.034 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-requests. 2024-05-09T09:45:03.053 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package unzip. 2024-05-09T09:45:03.060 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-09T09:45:03.080 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-09T09:45:03.109 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-09T09:45:03.128 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-09T09:45:03.445 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-09T09:45:03.472 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-09T09:45:03.512 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-09T09:45:03.615 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package luarocks. 2024-05-09T09:45:03.642 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-09T09:45:04.049 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-09T09:45:04.623 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-09T09:45:04.650 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:45:04.690 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:04.957 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librgw2. 2024-05-09T09:45:04.983 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../025-librgw2_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:05.023 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librgw2 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:05.212 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-09T09:45:05.238 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:05.278 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:05.551 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rgw. 2024-05-09T09:45:05.566 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:05.589 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-09T09:45:05.609 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rgw (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:05.616 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-09T09:45:05.656 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-09T09:45:05.954 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-09T09:45:05.975 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-openssl. 2024-05-09T09:45:05.980 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-09T09:45:06.002 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-05-09T09:45:06.020 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-09T09:45:06.041 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-09T09:45:06.337 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr. 2024-05-09T09:45:06.357 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libradosstriper1. 2024-05-09T09:45:06.363 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:06.383 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:06.395 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:06.423 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libradosstriper1 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:06.781 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mon. 2024-05-09T09:45:06.793 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-common. 2024-05-09T09:45:06.808 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:06.820 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:06.847 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mon (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:06.851 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-common (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:07.510 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-osd. 2024-05-09T09:45:07.537 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:07.576 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-osd (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:08.249 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-base. 2024-05-09T09:45:08.275 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:08.325 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-base (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:08.621 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph. 2024-05-09T09:45:08.637 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../066-ceph_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:08.679 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:08.998 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-fuse. 2024-05-09T09:45:09.025 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:09.065 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-fuse (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:09.469 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mds. 2024-05-09T09:45:09.495 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:09.535 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mds (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:09.753 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-09T09:45:09.780 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-09T09:45:09.820 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-09T09:45:09.896 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package cephadm. 2024-05-09T09:45:09.923 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../069-cephadm_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:09.963 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking cephadm (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:10.139 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cheroot. 2024-05-09T09:45:10.166 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-09T09:45:10.206 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-09T09:45:10.274 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-09T09:45:10.301 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-09T09:45:10.340 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-09T09:45:10.517 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-09T09:45:10.544 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-09T09:45:10.584 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-09T09:45:10.701 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-09T09:45:10.718 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-09T09:45:10.760 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-09T09:45:10.854 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-09T09:45:10.880 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-09T09:45:10.920 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-09T09:45:11.248 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-09T09:45:11.275 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-09T09:45:11.314 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-09T09:45:11.626 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-tempora. 2024-05-09T09:45:11.652 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-05-09T09:45:11.692 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-09T09:45:11.731 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-babel. 2024-05-09T09:45:11.759 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-09T09:45:11.797 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-09T09:45:11.937 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-portend. 2024-05-09T09:45:11.952 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-05-09T09:45:11.987 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-09T09:45:12.126 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-jinja2. 2024-05-09T09:45:12.152 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-09T09:45:12.201 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-09T09:45:12.348 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-09T09:45:12.374 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-09T09:45:12.414 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-09T09:45:12.545 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-09T09:45:12.572 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:45:12.612 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:12.793 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-09T09:45:12.819 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-09T09:45:12.868 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-09T09:45:12.932 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-09T09:45:12.959 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-05-09T09:45:12.998 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-09T09:45:13.221 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-natsort. 2024-05-09T09:45:13.250 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-05-09T09:45:13.288 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-09T09:45:13.310 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-routes. 2024-05-09T09:45:13.337 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-09T09:45:13.376 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-09T09:45:13.658 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-logutils. 2024-05-09T09:45:13.684 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-05-09T09:45:13.713 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-09T09:45:13.732 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-09T09:45:13.740 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:45:13.779 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:14.077 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-09T09:45:14.103 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-09T09:45:14.144 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-09T09:45:14.446 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-mako. 2024-05-09T09:45:14.473 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-09T09:45:14.513 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-09T09:45:14.852 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-09T09:45:14.878 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-09T09:45:14.910 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-09T09:45:15.084 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-09T09:45:15.100 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-09T09:45:15.151 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-09T09:45:15.238 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-09T09:45:15.264 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-09T09:45:15.304 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-09T09:45:15.632 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-webob. 2024-05-09T09:45:15.658 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-09T09:45:15.699 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-09T09:45:15.837 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-joblib. 2024-05-09T09:45:15.853 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-09T09:45:15.887 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-09T09:45:16.060 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-waitress. 2024-05-09T09:45:16.087 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-09T09:45:16.130 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-09T09:45:16.241 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-09T09:45:16.268 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-09T09:45:16.307 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-09T09:45:16.413 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-tempita. 2024-05-09T09:45:16.439 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-09T09:45:16.471 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-09T09:45:16.610 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-sklearn. 2024-05-09T09:45:16.637 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-09T09:45:16.676 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-09T09:45:16.749 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-paste. 2024-05-09T09:45:16.775 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-09T09:45:16.816 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-09T09:45:17.127 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-09T09:45:17.143 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-09T09:45:17.177 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-09T09:45:17.318 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-09T09:45:17.347 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:45:17.430 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-09T09:45:17.457 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-09T09:45:17.478 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:17.497 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-09T09:45:17.800 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-webtest. 2024-05-09T09:45:17.826 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-05-09T09:45:17.866 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-09T09:45:18.178 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pecan. 2024-05-09T09:45:18.204 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-09T09:45:18.244 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-09T09:45:18.482 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-cachetools. 2024-05-09T09:45:18.509 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-05-09T09:45:18.548 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-09T09:45:18.607 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-certifi. 2024-05-09T09:45:18.633 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-05-09T09:45:18.674 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-09T09:45:18.810 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-09T09:45:18.826 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-09T09:45:18.862 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-09T09:45:18.960 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-idna. 2024-05-09T09:45:18.975 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-05-09T09:45:19.019 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-09T09:45:19.163 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-09T09:45:19.191 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-09T09:45:19.229 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-09T09:45:19.330 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-urllib3. 2024-05-09T09:45:19.356 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-09T09:45:19.396 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-09T09:45:19.516 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-rsa. 2024-05-09T09:45:19.544 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-05-09T09:45:19.582 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-09T09:45:19.708 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-requests. 2024-05-09T09:45:19.734 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-09T09:45:19.774 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-09T09:45:19.903 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-google-auth. 2024-05-09T09:45:19.920 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-05-09T09:45:19.961 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-09T09:45:20.103 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-09T09:45:20.129 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-09T09:45:20.215 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-09T09:45:20.281 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-09T09:45:20.309 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-09T09:45:20.347 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-09T09:45:20.617 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-websocket. 2024-05-09T09:45:20.633 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-05-09T09:45:20.647 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-09T09:45:20.663 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:45:20.667 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-09T09:45:20.697 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:21.004 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-09T09:45:21.032 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-09T09:45:21.070 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-09T09:45:21.094 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-09T09:45:21.121 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:21.160 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:21.488 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-09T09:45:21.515 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-09T09:45:21.555 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-09T09:45:21.709 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-09T09:45:21.726 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:45:21.767 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:21.816 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-openssl. 2024-05-09T09:45:21.831 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-05-09T09:45:21.866 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-09T09:45:22.104 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-09T09:45:22.131 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-09T09:45:22.170 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-09T09:45:22.177 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr. 2024-05-09T09:45:22.204 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:22.244 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:22.457 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-09T09:45:22.485 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-09T09:45:22.515 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-09T09:45:22.656 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mon. 2024-05-09T09:45:22.682 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:22.722 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mon (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:22.759 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package jq. 2024-05-09T09:45:22.775 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-09T09:45:22.817 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-09T09:45:23.053 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package socat. 2024-05-09T09:45:23.069 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-09T09:45:23.111 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-09T09:45:23.309 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-osd. 2024-05-09T09:45:23.335 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:23.367 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-osd (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:23.423 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package xmlstarlet. 2024-05-09T09:45:23.439 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-09T09:45:23.481 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-09T09:45:23.852 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-test. 2024-05-09T09:45:23.868 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:23.910 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-test (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:24.404 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph. 2024-05-09T09:45:24.431 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../066-ceph_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:24.470 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:24.881 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-fuse. 2024-05-09T09:45:24.908 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:24.948 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-fuse (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:25.334 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mds. 2024-05-09T09:45:25.361 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:25.401 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mds (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:25.796 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package cephadm. 2024-05-09T09:45:25.823 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../069-cephadm_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:25.862 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking cephadm (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:26.140 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-09T09:45:26.167 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-09T09:45:26.198 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-09T09:45:26.423 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package ceph-volume. 2024-05-09T09:45:26.440 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:45:26.481 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking ceph-volume (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:26.501 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-09T09:45:26.517 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-09T09:45:26.551 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-09T09:45:26.785 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-09T09:45:26.813 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:26.852 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking libcephfs-dev (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:27.146 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-09T09:45:27.174 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-09T09:45:27.212 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-09T09:45:27.500 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-09T09:45:27.517 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-05-09T09:45:27.548 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-babel. 2024-05-09T09:45:27.550 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-09T09:45:27.575 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-09T09:45:27.606 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-09T09:45:27.884 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jinja2. 2024-05-09T09:45:27.911 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-09T09:45:27.921 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package nvme-cli. 2024-05-09T09:45:27.942 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-09T09:45:27.949 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-09T09:45:27.987 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-09T09:45:28.254 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-09T09:45:28.269 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:45:28.303 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:28.434 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package pkg-config. 2024-05-09T09:45:28.462 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-09T09:45:28.501 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-09T09:45:28.574 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-09T09:45:28.600 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-05-09T09:45:28.632 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-09T09:45:28.737 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-09T09:45:28.753 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-09T09:45:28.787 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-09T09:45:28.926 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-routes. 2024-05-09T09:45:28.953 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-09T09:45:28.992 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-09T09:45:29.223 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-09T09:45:29.251 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-09T09:45:29.289 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-09T09:45:29.313 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-09T09:45:29.339 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:45:29.379 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:29.551 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pastescript. 2024-05-09T09:45:29.578 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-05-09T09:45:29.610 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-09T09:45:29.904 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pluggy. 2024-05-09T09:45:29.932 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-09T09:45:29.971 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-09T09:45:30.282 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-psutil. 2024-05-09T09:45:30.310 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-09T09:45:30.348 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-09T09:45:30.677 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-py. 2024-05-09T09:45:30.704 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-05-09T09:45:30.743 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-09T09:45:30.826 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-09T09:45:30.842 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-09T09:45:30.884 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-09T09:45:31.063 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pygments. 2024-05-09T09:45:31.091 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-09T09:45:31.129 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-09T09:45:31.355 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-joblib. 2024-05-09T09:45:31.382 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-09T09:45:31.421 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-09T09:45:31.592 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-09T09:45:31.620 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-09T09:45:31.658 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-09T09:45:31.816 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-09T09:45:31.844 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-09T09:45:31.883 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-09T09:45:31.945 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-toml. 2024-05-09T09:45:31.973 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-05-09T09:45:32.028 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-09T09:45:32.160 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-sklearn. 2024-05-09T09:45:32.184 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-09T09:45:32.218 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-09T09:45:32.330 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-pytest. 2024-05-09T09:45:32.359 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-09T09:45:32.397 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-09T09:45:32.717 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package python3-simplejson. 2024-05-09T09:45:32.745 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-09T09:45:32.792 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-09T09:45:32.927 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-09T09:45:32.955 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:45:33.078 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-09T09:45:33.079 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:33.107 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-09T09:45:33.145 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-09T09:45:33.882 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package radosgw. 2024-05-09T09:45:33.910 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../116-radosgw_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:33.948 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking radosgw (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:33.983 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cachetools. 2024-05-09T09:45:33.999 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-05-09T09:45:34.041 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-09T09:45:34.344 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-09T09:45:34.372 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-09T09:45:34.411 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-09T09:45:34.748 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-09T09:45:34.760 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package rbd-fuse. 2024-05-09T09:45:34.775 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-09T09:45:34.788 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:34.815 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-09T09:45:34.826 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking rbd-fuse (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:35.126 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rsa. 2024-05-09T09:45:35.131 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-09T09:45:35.153 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-05-09T09:45:35.192 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-09T09:45:35.389 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-09T09:45:35.471 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-google-auth. 2024-05-09T09:45:35.498 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-05-09T09:45:35.515 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-09T09:45:35.549 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-09T09:45:35.780 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-09T09:45:35.841 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-09T09:45:35.868 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-09T09:45:35.907 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-09T09:45:36.105 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-09T09:45:36.227 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-websocket. 2024-05-09T09:45:36.254 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-05-09T09:45:36.293 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-09T09:45:36.541 INFO:teuthology.orchestra.run.smithi157.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-09T09:45:36.614 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-09T09:45:36.634 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up cephadm (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:36.641 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-09T09:45:36.680 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-09T09:45:37.093 INFO:teuthology.orchestra.run.smithi157.stdout:Adding system user cephadm....done 2024-05-09T09:45:37.240 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-09T09:45:37.319 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-09T09:45:37.335 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:45:37.377 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:37.525 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-09T09:45:37.705 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-09T09:45:37.732 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-09T09:45:37.751 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-09T09:45:37.771 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-09T09:45:37.879 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-09T09:45:38.083 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-09T09:45:38.110 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-09T09:45:38.130 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-09T09:45:38.149 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-09T09:45:38.389 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-09T09:45:38.411 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package jq. 2024-05-09T09:45:38.426 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-09T09:45:38.468 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-09T09:45:38.516 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-09T09:45:38.713 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package socat. 2024-05-09T09:45:38.729 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-09T09:45:38.763 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-09T09:45:38.859 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-09T09:45:39.024 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package xmlstarlet. 2024-05-09T09:45:39.040 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-09T09:45:39.074 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-09T09:45:39.236 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-09T09:45:39.387 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-test. 2024-05-09T09:45:39.403 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:39.436 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-test (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:39.504 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-09T09:45:39.780 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-09T09:45:40.048 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-09T09:45:40.299 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-09T09:45:40.584 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-09T09:45:40.818 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-ceph-argparse (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:41.086 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-09T09:45:41.220 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-09T09:45:41.346 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-09T09:45:41.472 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-09T09:45:41.732 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-09T09:45:41.808 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-volume. 2024-05-09T09:45:41.836 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3093-g2d4f3997-1jammy_all.deb ... 2024-05-09T09:45:41.874 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-volume (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:42.110 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-09T09:45:42.138 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-09T09:45:42.179 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-09T09:45:42.195 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:42.201 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-09T09:45:42.245 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libcephfs-dev (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:42.328 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-09T09:45:42.565 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-09T09:45:42.592 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-09T09:45:42.631 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-09T09:45:42.687 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-09T09:45:42.838 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-09T09:45:43.003 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-09T09:45:43.031 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-05-09T09:45:43.077 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-09T09:45:43.118 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-09T09:45:43.382 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-09T09:45:43.457 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package nvme-cli. 2024-05-09T09:45:43.484 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-09T09:45:43.526 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-09T09:45:43.717 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up zip (3.0-12build2) ... 2024-05-09T09:45:43.868 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-09T09:45:43.962 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package pkg-config. 2024-05-09T09:45:43.989 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-09T09:45:44.028 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-09T09:45:44.290 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-09T09:45:44.318 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-09T09:45:44.356 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-09T09:45:44.520 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-09T09:45:44.726 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-09T09:45:44.753 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-09T09:45:44.779 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-09T09:45:44.783 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-09T09:45:44.905 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-09T09:45:45.031 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-09T09:45:45.062 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pastescript. 2024-05-09T09:45:45.089 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-05-09T09:45:45.128 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-09T09:45:45.324 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-09T09:45:45.448 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pluggy. 2024-05-09T09:45:45.476 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-09T09:45:45.515 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-09T09:45:45.700 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-09T09:45:45.826 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-psutil. 2024-05-09T09:45:45.854 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-09T09:45:45.892 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-09T09:45:45.959 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-09T09:45:46.221 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-py. 2024-05-09T09:45:46.248 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-05-09T09:45:46.287 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-09T09:45:46.378 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-09T09:45:46.607 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pygments. 2024-05-09T09:45:46.635 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-09T09:45:46.674 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-09T09:45:46.688 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-09T09:45:47.031 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-09T09:45:47.119 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-09T09:45:47.147 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-09T09:45:47.186 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-09T09:45:47.282 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-09T09:45:47.383 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-ceph-common (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:47.447 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-toml. 2024-05-09T09:45:47.475 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-05-09T09:45:47.514 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-09T09:45:47.676 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-idna (3.3-1) ... 2024-05-09T09:45:47.833 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pytest. 2024-05-09T09:45:47.861 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-09T09:45:47.900 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-09T09:45:48.002 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-09T09:45:48.186 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-simplejson. 2024-05-09T09:45:48.202 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-09T09:45:48.236 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-09T09:45:48.489 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-09T09:45:48.505 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-09T09:45:48.547 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-09T09:45:49.166 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-09T09:45:49.251 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package radosgw. 2024-05-09T09:45:49.279 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../116-radosgw_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:49.318 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking radosgw (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:49.384 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T09:45:49.519 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-09T09:45:49.795 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-09T09:45:49.937 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-09T09:45:50.063 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-09T09:45:50.112 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package rbd-fuse. 2024-05-09T09:45:50.125 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3093-g2d4f3997-1jammy_amd64.deb ... 2024-05-09T09:45:50.162 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking rbd-fuse (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:50.373 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-09T09:45:50.466 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-09T09:45:50.632 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-09T09:45:50.784 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-09T09:45:50.900 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T09:45:50.910 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-09T09:45:51.018 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-09T09:45:51.178 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-09T09:45:51.319 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-09T09:45:51.554 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-09T09:45:51.570 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-09T09:45:51.838 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-09T09:45:52.010 INFO:teuthology.orchestra.run.smithi110.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-09T09:45:52.079 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up cephadm (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:52.098 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-09T09:45:52.340 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-09T09:45:52.592 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-09T09:45:52.596 INFO:teuthology.orchestra.run.smithi110.stdout:Adding system user cephadm....done 2024-05-09T09:45:52.734 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-09T09:45:52.752 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-09T09:45:53.027 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-09T09:45:53.028 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-09T09:45:53.162 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-09T09:45:53.279 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-09T09:45:53.406 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-09T09:45:53.454 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-09T09:45:53.665 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-09T09:45:53.780 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-09T09:45:53.900 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-09T09:45:54.009 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-09T09:45:54.040 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-09T09:45:54.191 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-09T09:45:54.319 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-09T09:45:54.342 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-09T09:45:54.431 INFO:teuthology.orchestra.run.smithi157.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-09T09:45:54.660 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-09T09:45:54.681 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-09T09:45:54.795 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-09T09:45:54.907 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-09T09:45:55.159 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-09T09:45:55.188 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-09T09:45:55.410 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-09T09:45:55.464 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-09T09:45:55.590 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-09T09:45:55.661 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-09T09:45:55.858 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T09:45:55.937 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-09T09:45:55.967 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-09T09:45:56.213 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-ceph-argparse (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:56.301 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-09T09:45:56.472 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-09T09:45:56.599 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-09T09:45:56.619 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-09T09:45:56.699 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-09T09:45:56.800 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-09T09:45:56.896 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-09T09:45:57.022 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-09T09:45:57.043 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-09T09:45:57.315 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-09T09:45:57.411 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-09T09:45:57.441 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-09T09:45:57.505 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-09T09:45:57.576 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-09T09:45:57.631 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-09T09:45:57.936 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-09T09:45:58.007 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-09T09:45:58.108 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-09T09:45:58.329 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-09T09:45:58.350 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-09T09:45:58.610 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-09T09:45:58.614 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-09T09:45:58.941 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-09T09:45:58.944 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up zip (3.0-12build2) ... 2024-05-09T09:45:59.051 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librados2 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:59.070 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-09T09:45:59.177 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:59.303 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-09T09:45:59.639 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libcephfs2 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:59.756 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-09T09:45:59.757 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libradosstriper1 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:45:59.875 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-09T09:45:59.998 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-09T09:46:00.114 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-09T09:46:00.134 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librbd1 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:00.234 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-09T09:46:00.261 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-modules-core (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:00.387 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-fuse (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:00.518 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-09T09:46:00.595 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-09T09:46:00.595 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-09T09:46:00.886 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-09T09:46:01.080 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up libcephfs-dev (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:01.137 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-09T09:46:01.206 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rados (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:01.332 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up librgw2 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:01.433 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-09T09:46:01.497 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-09T09:46:01.790 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-09T09:46:02.117 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-09T09:46:02.351 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-09T09:46:02.477 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-ceph-common (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:02.628 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rbd (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:02.754 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up rbd-fuse (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:02.770 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-idna (3.3-1) ... 2024-05-09T09:46:02.880 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-rgw (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:03.015 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up python3-cephfs (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:03.087 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-09T09:46:03.166 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-common (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:03.733 INFO:teuthology.orchestra.run.smithi157.stdout:Adding group ceph....done 2024-05-09T09:46:04.102 INFO:teuthology.orchestra.run.smithi157.stdout:Adding system user ceph....done 2024-05-09T09:46:04.287 INFO:teuthology.orchestra.run.smithi157.stdout:Setting system user ceph properties....done 2024-05-09T09:46:04.301 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-09T09:46:04.307 INFO:teuthology.orchestra.run.smithi157.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-09T09:46:04.446 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-09T09:46:04.544 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T09:46:04.679 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-09T09:46:04.738 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-09T09:46:04.947 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-09T09:46:05.089 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-09T09:46:05.207 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-09T09:46:05.483 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-09T09:46:05.500 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-test (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:05.627 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up radosgw (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:05.734 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-09T09:46:05.986 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T09:46:06.111 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-09T09:46:06.135 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-09T09:46:06.135 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-09T09:46:06.413 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-09T09:46:06.604 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-base (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:06.672 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-09T09:46:06.923 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-09T09:46:06.948 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-09T09:46:07.150 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-09T09:46:07.392 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-09T09:46:07.431 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mds (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:07.635 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-09T09:46:07.674 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-09T09:46:07.674 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-09T09:46:07.761 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-09T09:46:08.045 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-09T09:46:08.125 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:08.171 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-09T09:46:08.342 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-09T09:46:08.343 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-09T09:46:08.465 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-09T09:46:08.740 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-09T09:46:08.784 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-osd (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:08.966 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-09T09:46:09.054 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-09T09:46:09.054 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-09T09:46:09.067 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-09T09:46:09.177 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-09T09:46:09.265 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-09T09:46:09.506 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-09T09:46:09.511 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:09.629 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-09T09:46:09.638 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:09.789 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mon (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:10.006 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-09T09:46:10.023 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-09T09:46:10.023 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-09T09:46:10.274 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-09T09:46:10.375 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-09T09:46:10.502 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-cephadm (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:10.625 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-09T09:46:10.733 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:10.735 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-09T09:46:10.950 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-mgr-dashboard (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:11.053 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-09T09:46:11.209 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up ceph-volume (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:11.354 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-09T09:46:11.622 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-09T09:46:11.660 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-09T09:46:11.747 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-09T09:46:11.765 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-09T09:46:11.917 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-09T09:46:12.024 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-09T09:46:12.584 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-09T09:46:12.718 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-09T09:46:12.903 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-09T09:46:13.280 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-09T09:46:13.365 INFO:teuthology.orchestra.run.smithi157.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-09T09:46:13.370 DEBUG:teuthology.parallel:result is None 2024-05-09T09:46:13.573 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-09T09:46:13.909 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-09T09:46:14.035 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librados2 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:14.161 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:14.287 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-09T09:46:14.623 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libcephfs2 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:14.724 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libradosstriper1 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:14.825 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-09T09:46:15.093 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librbd1 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:15.219 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-modules-core (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:15.345 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-fuse (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:15.557 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-09T09:46:15.557 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-09T09:46:16.038 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libcephfs-dev (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:16.164 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rados (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:16.290 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librgw2 (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:16.391 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-09T09:46:17.603 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rbd (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:17.729 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up rbd-fuse (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:17.871 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rgw (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:17.997 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cephfs (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:18.107 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-common (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:18.583 INFO:teuthology.orchestra.run.smithi110.stdout:Adding group ceph....done 2024-05-09T09:46:18.900 INFO:teuthology.orchestra.run.smithi110.stdout:Adding system user ceph....done 2024-05-09T09:46:19.069 INFO:teuthology.orchestra.run.smithi110.stdout:Setting system user ceph properties....done 2024-05-09T09:46:19.084 INFO:teuthology.orchestra.run.smithi110.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-09T09:46:19.218 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-09T09:46:19.538 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-09T09:46:20.041 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-test (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:20.150 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up radosgw (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:20.624 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-09T09:46:20.624 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-09T09:46:21.093 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-base (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:21.448 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-09T09:46:22.087 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mds (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:22.444 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-09T09:46:22.444 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-09T09:46:22.914 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:23.124 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-09T09:46:23.125 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-09T09:46:23.607 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-osd (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:23.862 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-09T09:46:23.863 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-09T09:46:24.350 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:24.476 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:24.619 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mon (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:24.856 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-09T09:46:24.856 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-09T09:46:25.328 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-cephadm (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:25.479 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:25.605 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-dashboard (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:25.756 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-volume (19.0.0-3093-g2d4f3997-1jammy) ... 2024-05-09T09:46:26.109 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-09T09:46:26.210 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-09T09:46:26.362 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-09T09:46:27.512 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-09T09:46:28.178 INFO:teuthology.orchestra.run.smithi110.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-09T09:46:28.183 DEBUG:teuthology.parallel:result is None 2024-05-09T09:46:28.184 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2d4f3997312aba36846da54fe4ed144c644dd8fc 2024-05-09T09:46:28.330 DEBUG:teuthology.orchestra.run.smithi110:> dpkg-query -W -f '${Version}' ceph 2024-05-09T09:46:28.348 INFO:teuthology.orchestra.run.smithi110.stdout:19.0.0-3093-g2d4f3997-1jammy 2024-05-09T09:46:28.349 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3093-g2d4f3997-1jammy 2024-05-09T09:46:28.349 INFO:teuthology.task.install:The correct ceph version 19.0.0-3093-g2d4f3997-1jammy is installed. 2024-05-09T09:46:28.351 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2d4f3997312aba36846da54fe4ed144c644dd8fc 2024-05-09T09:46:28.589 DEBUG:teuthology.orchestra.run.smithi157:> dpkg-query -W -f '${Version}' ceph 2024-05-09T09:46:28.609 INFO:teuthology.orchestra.run.smithi157.stdout:19.0.0-3093-g2d4f3997-1jammy 2024-05-09T09:46:28.609 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3093-g2d4f3997-1jammy 2024-05-09T09:46:28.609 INFO:teuthology.task.install:The correct ceph version 19.0.0-3093-g2d4f3997-1jammy is installed. 2024-05-09T09:46:28.611 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-09T09:46:28.611 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T09:46:28.611 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-09T09:46:28.626 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-09T09:46:28.626 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-09T09:46:28.666 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-09T09:46:28.667 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T09:46:28.667 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/daemon-helper 2024-05-09T09:46:28.680 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-09T09:46:28.735 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-09T09:46:28.735 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/daemon-helper 2024-05-09T09:46:28.749 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-09T09:46:28.804 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-09T09:46:28.805 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T09:46:28.805 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-09T09:46:28.817 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-09T09:46:28.870 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-09T09:46:28.870 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-09T09:46:28.884 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-09T09:46:28.936 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-09T09:46:28.936 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T09:46:28.936 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/stdin-killer 2024-05-09T09:46:28.949 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-09T09:46:29.003 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-09T09:46:29.004 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/stdin-killer 2024-05-09T09:46:29.016 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-09T09:46:29.072 INFO:teuthology.run_tasks:Running task ceph... 2024-05-09T09:46:29.167 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-09T09:46:29.167 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 777 /var/log/ceph 2024-05-09T09:46:29.170 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 777 /var/log/ceph 2024-05-09T09:46:29.182 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-09T09:46:29.183 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-09T09:46:29.225 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-09T09:46:29.237 INFO:tasks.ceph:Creating extra log directories... 2024-05-09T09:46:29.237 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-09T09:46:29.281 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-09T09:46:29.324 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-09T09:46:29.324 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-09T09:46:29.324 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi/7699626', 'branch': 'wip-kkeithley-zipper-ec', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}}', 'email': None, 'first_in_suite': False, 'job_id': '7699626', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-kkeithley-zipper-ec'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '2d4f3997312aba36846da54fe4ed144c644dd8fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2d4f3997312aba36846da54fe4ed144c644dd8fc'}}, 'rgw': {'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-kkeithley-zipper-ec', 'sha1': '2d4f3997312aba36846da54fe4ed144c644dd8fc'}}, 'owner': 'scheduled_kkeithle@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 3428, 'sha1': '2d4f3997312aba36846da54fe4ed144c644dd8fc', 'sleep_before_teardown': 0, 'subset': '1/2', 'suite': 'rgw', 'suite_branch': 'wip-kkeithley-zipper-ec', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_2d4f3997312aba36846da54fe4ed144c644dd8fc/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '2d4f3997312aba36846da54fe4ed144c644dd8fc', 'targets': {'smithi110.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNdve4RrPCexiH0ju5WIDDBd6ejl/AMp129UJy17ummF8AIp/Qlfjn6IgksGotyKQ510zi75u1U85RoPmR8fN5U=', 'smithi157.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEzmM3H3jRPvOoCdNsicJ2V+hcHjhqNgbKdh6KGo0keQ2LK++8UtKg2N4bjWJpYqgYj8R0Exv7XPTSO9OzHLDS0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '2d4f3997312aba36846da54fe4ed144c644dd8fc', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-09_09:15:11', 'tube': 'smithi', 'user': 'kkeithle', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-09T09:46:29.325 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-09T09:46:29.337 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-09T09:46:29.342 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/run/ceph 2024-05-09T09:46:29.385 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m0777 -- /var/run/ceph 2024-05-09T09:46:29.398 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T09:46:29.399 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T09:46:29.443 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T09:46:29.444 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_1 2024-05-09T09:46:29.492 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T09:46:29.492 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T09:46:29.492 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 877 Links: 1 2024-05-09T09:46:29.492 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T09:46:29.492 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-05-09 09:41:04.302771626 +0000 2024-05-09T09:46:29.492 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-05-09 09:41:04.034774022 +0000 2024-05-09T09:46:29.492 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-05-09 09:41:04.034774022 +0000 2024-05-09T09:46:29.492 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-05-09T09:46:29.493 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T09:46:29.546 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-05-09T09:46:29.546 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-05-09T09:46:29.546 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000315854 s, 1.6 MB/s 2024-05-09T09:46:29.547 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T09:46:29.600 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_2 2024-05-09T09:46:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T09:46:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T09:46:29.647 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 889 Links: 1 2024-05-09T09:46:29.648 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T09:46:29.648 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-05-09 09:41:04.534769552 +0000 2024-05-09T09:46:29.648 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-05-09 09:41:04.530769589 +0000 2024-05-09T09:46:29.648 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-05-09 09:41:04.530769589 +0000 2024-05-09T09:46:29.648 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-05-09T09:46:29.648 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T09:46:29.701 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-05-09T09:46:29.701 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-05-09T09:46:29.701 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.00030928 s, 1.7 MB/s 2024-05-09T09:46:29.703 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T09:46:29.753 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_3 2024-05-09T09:46:29.804 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T09:46:29.804 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T09:46:29.804 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-05-09T09:46:29.804 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T09:46:29.804 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-05-09 09:41:05.302762689 +0000 2024-05-09T09:46:29.805 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-05-09 09:41:05.030765119 +0000 2024-05-09T09:46:29.805 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-05-09 09:41:05.030765119 +0000 2024-05-09T09:46:29.805 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-05-09T09:46:29.805 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T09:46:29.858 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-05-09T09:46:29.858 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-05-09T09:46:29.858 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000252465 s, 2.0 MB/s 2024-05-09T09:46:29.859 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T09:46:29.908 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_4 2024-05-09T09:46:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T09:46:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T09:46:29.957 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 921 Links: 1 2024-05-09T09:46:29.957 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T09:46:29.957 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-05-09 09:41:05.830757969 +0000 2024-05-09T09:46:29.957 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-05-09 09:41:05.550760473 +0000 2024-05-09T09:46:29.957 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-05-09 09:41:05.550760473 +0000 2024-05-09T09:46:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-05-09T09:46:29.958 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T09:46:30.012 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-05-09T09:46:30.013 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-05-09T09:46:30.013 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000209164 s, 2.4 MB/s 2024-05-09T09:46:30.014 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T09:46:30.061 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-05-09T09:46:30.061 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-09T09:46:30.061 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T09:46:30.067 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T09:46:30.067 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_1 2024-05-09T09:46:30.114 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T09:46:30.115 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T09:46:30.115 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 876 Links: 1 2024-05-09T09:46:30.115 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T09:46:30.115 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-05-09 09:41:04.080330662 +0000 2024-05-09T09:46:30.115 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-05-09 09:41:03.804333127 +0000 2024-05-09T09:46:30.115 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-05-09 09:41:03.804333127 +0000 2024-05-09T09:46:30.116 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-05-09T09:46:30.116 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T09:46:30.171 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-05-09T09:46:30.172 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-05-09T09:46:30.172 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000319464 s, 1.6 MB/s 2024-05-09T09:46:30.173 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T09:46:30.223 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_2 2024-05-09T09:46:30.269 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T09:46:30.269 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T09:46:30.269 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-05-09T09:46:30.269 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T09:46:30.270 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-05-09 09:41:04.532326625 +0000 2024-05-09T09:46:30.270 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-05-09 09:41:04.296328731 +0000 2024-05-09T09:46:30.270 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-05-09 09:41:04.296328731 +0000 2024-05-09T09:46:30.270 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-05-09T09:46:30.270 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T09:46:30.324 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-05-09T09:46:30.324 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-05-09T09:46:30.324 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000314007 s, 1.6 MB/s 2024-05-09T09:46:30.325 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T09:46:30.374 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_3 2024-05-09T09:46:30.421 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T09:46:30.421 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T09:46:30.421 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 908 Links: 1 2024-05-09T09:46:30.421 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T09:46:30.421 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-05-09 09:41:05.016322302 +0000 2024-05-09T09:46:30.421 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-05-09 09:41:04.764324551 +0000 2024-05-09T09:46:30.421 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-05-09 09:41:04.764324551 +0000 2024-05-09T09:46:30.421 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-05-09T09:46:30.422 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T09:46:30.475 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-05-09T09:46:30.475 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-05-09T09:46:30.476 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000300334 s, 1.7 MB/s 2024-05-09T09:46:30.477 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T09:46:30.526 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_4 2024-05-09T09:46:30.573 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T09:46:30.573 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T09:46:30.573 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 925 Links: 1 2024-05-09T09:46:30.573 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T09:46:30.573 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-05-09 09:41:05.256320158 +0000 2024-05-09T09:46:30.573 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-05-09 09:41:05.252320194 +0000 2024-05-09T09:46:30.573 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-05-09 09:41:05.252320194 +0000 2024-05-09T09:46:30.573 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-05-09T09:46:30.574 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T09:46:30.628 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-05-09T09:46:30.628 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-05-09T09:46:30.629 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.00029238 s, 1.8 MB/s 2024-05-09T09:46:30.630 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T09:46:30.678 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-05-09T09:46:30.678 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi157.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-05-09T09:46:30.678 INFO:tasks.ceph:Generating config... 2024-05-09T09:46:30.679 INFO:tasks.ceph:[client] debug ms = 1 2024-05-09T09:46:30.679 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-05-09T09:46:30.680 INFO:tasks.ceph:[client] debug rgw = 20 2024-05-09T09:46:30.680 INFO:tasks.ceph:[client] setgroup = ceph 2024-05-09T09:46:30.680 INFO:tasks.ceph:[client] setuser = ceph 2024-05-09T09:46:30.680 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-09T09:46:30.680 INFO:tasks.ceph:[osd] debug objclass = 20 2024-05-09T09:46:30.680 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-09T09:46:30.680 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-09T09:46:30.680 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-09T09:46:30.680 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-09T09:46:30.680 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-09T09:46:30.680 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-09T09:46:30.680 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-09T09:46:30.680 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-09T09:46:30.680 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-09T09:46:30.680 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-09T09:46:30.681 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-09T09:46:30.681 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-09T09:46:30.681 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-09T09:46:30.681 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-09T09:46:30.681 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-09T09:46:30.681 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-09T09:46:30.681 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-09T09:46:30.681 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-09T09:46:30.681 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-09T09:46:30.681 INFO:tasks.ceph:Setting up mon.a... 2024-05-09T09:46:30.681 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-09T09:46:30.716 INFO:teuthology.orchestra.run.smithi110.stdout:creating /etc/ceph/ceph.keyring 2024-05-09T09:46:30.730 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-09T09:46:30.806 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-09T09:46:30.859 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.110')] 2024-05-09T09:46:30.859 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.110'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-05-09T09:46:30.860 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T09:46:30.860 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-09T09:46:30.908 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.110 --print /home/ubuntu/cephtest/ceph.monmap 2024-05-09T09:46:30.986 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:46:30.986 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:46:30.986 INFO:teuthology.orchestra.run.smithi110.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-09T09:46:30.986 INFO:teuthology.orchestra.run.smithi110.stdout:monmaptool: generated fsid c05d0fe5-e814-4a03-b82b-3bb6168d5691 2024-05-09T09:46:30.987 INFO:teuthology.orchestra.run.smithi110.stdout:setting min_mon_release = quincy 2024-05-09T09:46:30.987 INFO:teuthology.orchestra.run.smithi110.stdout:epoch 0 2024-05-09T09:46:30.987 INFO:teuthology.orchestra.run.smithi110.stdout:fsid c05d0fe5-e814-4a03-b82b-3bb6168d5691 2024-05-09T09:46:30.987 INFO:teuthology.orchestra.run.smithi110.stdout:last_changed 2024-05-09T09:46:30.989803+0000 2024-05-09T09:46:30.987 INFO:teuthology.orchestra.run.smithi110.stdout:created 2024-05-09T09:46:30.989803+0000 2024-05-09T09:46:30.987 INFO:teuthology.orchestra.run.smithi110.stdout:min_mon_release 17 (quincy) 2024-05-09T09:46:30.987 INFO:teuthology.orchestra.run.smithi110.stdout:election_strategy: 1 2024-05-09T09:46:30.987 INFO:teuthology.orchestra.run.smithi110.stdout:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-05-09T09:46:30.987 INFO:teuthology.orchestra.run.smithi110.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-05-09T09:46:30.988 DEBUG:teuthology.orchestra.run.smithi110:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-09T09:46:31.036 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c05d0fe5-e814-4a03-b82b-3bb6168d5691... 2024-05-09T09:46:31.037 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-09T09:46:31.081 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-09T09:46:31.109 INFO:teuthology.orchestra.run.smithi110.stdout:[global] 2024-05-09T09:46:31.109 INFO:teuthology.orchestra.run.smithi110.stdout: chdir = "" 2024-05-09T09:46:31.109 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-09T09:46:31.109 INFO:teuthology.orchestra.run.smithi110.stdout: auth supported = cephx 2024-05-09T09:46:31.109 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:31.109 INFO:teuthology.orchestra.run.smithi110.stdout: filestore xattr use omap = true 2024-05-09T09:46:31.109 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:31.109 INFO:teuthology.orchestra.run.smithi110.stdout: mon clock drift allowed = 1.000 2024-05-09T09:46:31.109 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:31.109 INFO:teuthology.orchestra.run.smithi110.stdout: osd crush chooseleaf type = 0 2024-05-09T09:46:31.109 INFO:teuthology.orchestra.run.smithi110.stdout: auth debug = true 2024-05-09T09:46:31.109 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:31.110 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on old message = true 2024-05-09T09:46:31.110 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on bug = true 2024-05-09T09:46:31.110 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:31.110 INFO:teuthology.orchestra.run.smithi110.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-09T09:46:31.110 INFO:teuthology.orchestra.run.smithi110.stdout: mon pg warn max object skew = 0 2024-05-09T09:46:31.110 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:31.110 INFO:teuthology.orchestra.run.smithi110.stdout: # disable pg_autoscaler by default for new pools 2024-05-09T09:46:31.110 INFO:teuthology.orchestra.run.smithi110.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-09T09:46:31.110 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:31.110 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default size = 2 2024-05-09T09:46:31.110 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:31.110 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow primary affinity = true 2024-05-09T09:46:31.110 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow pg remap = true 2024-05-09T09:46:31.110 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on legacy crush tunables = false 2024-05-09T09:46:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on crush straw calc version zero = false 2024-05-09T09:46:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on no sortbitwise = false 2024-05-09T09:46:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on osd down out interval zero = false 2024-05-09T09:46:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on too few osds = false 2024-05-09T09:46:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-09T09:46:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-09T09:46:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: mon_allow_pool_size_one = true 2024-05-09T09:46:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-09T09:46:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: osd default data pool replay window = 5 2024-05-09T09:46:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: mon allow pool delete = true 2024-05-09T09:46:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: mon cluster log file level = debug 2024-05-09T09:46:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: debug asserts on shutdown = true 2024-05-09T09:46:31.112 INFO:teuthology.orchestra.run.smithi110.stdout: mon health detail to clog = false 2024-05-09T09:46:31.112 INFO:teuthology.orchestra.run.smithi110.stdout: mon host = 172.21.15.110 2024-05-09T09:46:31.112 INFO:teuthology.orchestra.run.smithi110.stdout: fsid = c05d0fe5-e814-4a03-b82b-3bb6168d5691 2024-05-09T09:46:31.112 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:31.112 INFO:teuthology.orchestra.run.smithi110.stdout:[osd] 2024-05-09T09:46:31.112 INFO:teuthology.orchestra.run.smithi110.stdout: osd journal size = 100 2024-05-09T09:46:31.112 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:31.112 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub load threshold = 5.0 2024-05-09T09:46:31.112 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub max interval = 600 2024-05-09T09:46:31.112 INFO:teuthology.orchestra.run.smithi110.stdout: osd mclock profile = high_recovery_ops 2024-05-09T09:46:31.112 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:31.112 INFO:teuthology.orchestra.run.smithi110.stdout: osd recover clone overlap = true 2024-05-09T09:46:31.112 INFO:teuthology.orchestra.run.smithi110.stdout: osd recovery max chunk = 1048576 2024-05-09T09:46:31.112 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:31.112 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug shutdown = true 2024-05-09T09:46:31.112 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug op order = true 2024-05-09T09:46:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug verify stray on activate = true 2024-05-09T09:46:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug trim objects = true 2024-05-09T09:46:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: osd open classes on start = true 2024-05-09T09:46:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug pg log writeout = true 2024-05-09T09:46:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: osd deep scrub update digest min age = 30 2024-05-09T09:46:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: osd map max advance = 10 2024-05-09T09:46:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: journal zero on create = true 2024-05-09T09:46:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: filestore ondisk finisher threads = 3 2024-05-09T09:46:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: filestore apply finisher threads = 3 2024-05-09T09:46:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: bdev debug aio = true 2024-05-09T09:46:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug misdirected ops = true 2024-05-09T09:46:31.114 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-05-09T09:46:31.114 INFO:teuthology.orchestra.run.smithi110.stdout: debug objclass = 20 2024-05-09T09:46:31.114 INFO:teuthology.orchestra.run.smithi110.stdout: bdev async discard = True 2024-05-09T09:46:31.114 INFO:teuthology.orchestra.run.smithi110.stdout: bdev enable discard = True 2024-05-09T09:46:31.114 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore allocator = bitmap 2024-05-09T09:46:31.114 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore block size = 96636764160 2024-05-09T09:46:31.114 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore fsck on mount = True 2024-05-09T09:46:31.114 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluefs = 1/20 2024-05-09T09:46:31.114 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluestore = 1/20 2024-05-09T09:46:31.114 INFO:teuthology.orchestra.run.smithi110.stdout: debug osd = 20 2024-05-09T09:46:31.114 INFO:teuthology.orchestra.run.smithi110.stdout: debug rocksdb = 4/10 2024-05-09T09:46:31.114 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd backfillfull_ratio = 0.85 2024-05-09T09:46:31.114 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd full ratio = 0.9 2024-05-09T09:46:31.114 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd nearfull ratio = 0.8 2024-05-09T09:46:31.114 INFO:teuthology.orchestra.run.smithi110.stdout: osd failsafe full ratio = 0.95 2024-05-09T09:46:31.115 INFO:teuthology.orchestra.run.smithi110.stdout: osd objectstore = bluestore 2024-05-09T09:46:31.115 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:31.115 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr] 2024-05-09T09:46:31.115 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-05-09T09:46:31.115 INFO:teuthology.orchestra.run.smithi110.stdout: debug mgr = 20 2024-05-09T09:46:31.115 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-05-09T09:46:31.115 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-05-09T09:46:31.115 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-05-09T09:46:31.115 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-05-09T09:46:31.115 INFO:teuthology.orchestra.run.smithi110.stdout: mgr/telemetry/nag = false 2024-05-09T09:46:31.115 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:31.115 INFO:teuthology.orchestra.run.smithi110.stdout:[mon] 2024-05-09T09:46:31.115 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-05-09T09:46:31.115 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-05-09T09:46:31.115 INFO:teuthology.orchestra.run.smithi110.stdout: debug paxos = 20 2024-05-09T09:46:31.115 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-05-09T09:46:31.116 INFO:teuthology.orchestra.run.smithi110.stdout: mon data avail warn = 5 2024-05-09T09:46:31.116 INFO:teuthology.orchestra.run.smithi110.stdout: mon mgr mkfs grace = 240 2024-05-09T09:46:31.116 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-05-09T09:46:31.116 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd reporter subtree level = osd 2024-05-09T09:46:31.116 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd prime pg temp = true 2024-05-09T09:46:31.116 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-05-09T09:46:31.116 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:31.116 INFO:teuthology.orchestra.run.smithi110.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-09T09:46:31.116 INFO:teuthology.orchestra.run.smithi110.stdout: auth mon ticket ttl = 660 # 11m 2024-05-09T09:46:31.116 INFO:teuthology.orchestra.run.smithi110.stdout: auth service ticket ttl = 240 # 4m 2024-05-09T09:46:31.116 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:31.116 INFO:teuthology.orchestra.run.smithi110.stdout: # don't complain about insecure global_id in the test suite 2024-05-09T09:46:31.116 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-09T09:46:31.116 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-09T09:46:31.116 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:31.117 INFO:teuthology.orchestra.run.smithi110.stdout: # 1m isn't quite enough 2024-05-09T09:46:31.117 INFO:teuthology.orchestra.run.smithi110.stdout: mon_down_mkfs_grace = 2m 2024-05-09T09:46:31.117 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:31.117 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_filestore_osds = false 2024-05-09T09:46:31.117 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:31.117 INFO:teuthology.orchestra.run.smithi110.stdout:[client] 2024-05-09T09:46:31.117 INFO:teuthology.orchestra.run.smithi110.stdout: rgw cache enabled = true 2024-05-09T09:46:31.117 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable ops log = true 2024-05-09T09:46:31.117 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable usage log = true 2024-05-09T09:46:31.117 INFO:teuthology.orchestra.run.smithi110.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-09T09:46:31.117 INFO:teuthology.orchestra.run.smithi110.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-09T09:46:31.117 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-05-09T09:46:31.117 INFO:teuthology.orchestra.run.smithi110.stdout: rgw gc obj min wait = 15 2024-05-09T09:46:31.117 INFO:teuthology.orchestra.run.smithi110.stdout: debug rgw = 20 2024-05-09T09:46:31.117 INFO:teuthology.orchestra.run.smithi110.stdout: setgroup = ceph 2024-05-09T09:46:31.117 INFO:teuthology.orchestra.run.smithi110.stdout: setuser = ceph 2024-05-09T09:46:31.118 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.a] 2024-05-09T09:46:31.118 INFO:teuthology.orchestra.run.smithi157.stdout:[global] 2024-05-09T09:46:31.118 INFO:teuthology.orchestra.run.smithi157.stdout: chdir = "" 2024-05-09T09:46:31.118 INFO:teuthology.orchestra.run.smithi157.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-09T09:46:31.118 INFO:teuthology.orchestra.run.smithi157.stdout: auth supported = cephx 2024-05-09T09:46:31.118 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-09T09:46:31.118 INFO:teuthology.orchestra.run.smithi157.stdout: filestore xattr use omap = true 2024-05-09T09:46:31.119 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-09T09:46:31.119 INFO:teuthology.orchestra.run.smithi157.stdout: mon clock drift allowed = 1.000 2024-05-09T09:46:31.119 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-09T09:46:31.119 INFO:teuthology.orchestra.run.smithi157.stdout: osd crush chooseleaf type = 0 2024-05-09T09:46:31.119 INFO:teuthology.orchestra.run.smithi157.stdout: auth debug = true 2024-05-09T09:46:31.119 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-09T09:46:31.119 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on old message = true 2024-05-09T09:46:31.119 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on bug = true 2024-05-09T09:46:31.119 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-09T09:46:31.119 INFO:teuthology.orchestra.run.smithi157.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-09T09:46:31.119 INFO:teuthology.orchestra.run.smithi157.stdout: mon pg warn max object skew = 0 2024-05-09T09:46:31.119 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-09T09:46:31.119 INFO:teuthology.orchestra.run.smithi157.stdout: # disable pg_autoscaler by default for new pools 2024-05-09T09:46:31.119 INFO:teuthology.orchestra.run.smithi157.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-09T09:46:31.119 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-09T09:46:31.119 INFO:teuthology.orchestra.run.smithi157.stdout: osd pool default size = 2 2024-05-09T09:46:31.120 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-09T09:46:31.120 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd allow primary affinity = true 2024-05-09T09:46:31.120 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd allow pg remap = true 2024-05-09T09:46:31.120 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on legacy crush tunables = false 2024-05-09T09:46:31.120 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on crush straw calc version zero = false 2024-05-09T09:46:31.120 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on no sortbitwise = false 2024-05-09T09:46:31.120 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on osd down out interval zero = false 2024-05-09T09:46:31.120 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on too few osds = false 2024-05-09T09:46:31.120 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-09T09:46:31.120 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-09T09:46:31.120 INFO:teuthology.orchestra.run.smithi157.stdout: mon_allow_pool_size_one = true 2024-05-09T09:46:31.120 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-09T09:46:31.120 INFO:teuthology.orchestra.run.smithi157.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-09T09:46:31.120 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-09T09:46:31.120 INFO:teuthology.orchestra.run.smithi157.stdout: osd default data pool replay window = 5 2024-05-09T09:46:31.120 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-09T09:46:31.121 INFO:teuthology.orchestra.run.smithi157.stdout: mon allow pool delete = true 2024-05-09T09:46:31.121 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-09T09:46:31.121 INFO:teuthology.orchestra.run.smithi157.stdout: mon cluster log file level = debug 2024-05-09T09:46:31.121 INFO:teuthology.orchestra.run.smithi157.stdout: debug asserts on shutdown = true 2024-05-09T09:46:31.121 INFO:teuthology.orchestra.run.smithi157.stdout: mon health detail to clog = false 2024-05-09T09:46:31.121 INFO:teuthology.orchestra.run.smithi157.stdout: mon host = 172.21.15.110 2024-05-09T09:46:31.121 INFO:teuthology.orchestra.run.smithi157.stdout: fsid = c05d0fe5-e814-4a03-b82b-3bb6168d5691 2024-05-09T09:46:31.121 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-09T09:46:31.121 INFO:teuthology.orchestra.run.smithi157.stdout:[osd] 2024-05-09T09:46:31.121 INFO:teuthology.orchestra.run.smithi157.stdout: osd journal size = 100 2024-05-09T09:46:31.121 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-09T09:46:31.121 INFO:teuthology.orchestra.run.smithi157.stdout: osd scrub load threshold = 5.0 2024-05-09T09:46:31.121 INFO:teuthology.orchestra.run.smithi157.stdout: osd scrub max interval = 600 2024-05-09T09:46:31.121 INFO:teuthology.orchestra.run.smithi157.stdout: osd mclock profile = high_recovery_ops 2024-05-09T09:46:31.121 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-09T09:46:31.121 INFO:teuthology.orchestra.run.smithi157.stdout: osd recover clone overlap = true 2024-05-09T09:46:31.122 INFO:teuthology.orchestra.run.smithi157.stdout: osd recovery max chunk = 1048576 2024-05-09T09:46:31.122 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-09T09:46:31.122 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug shutdown = true 2024-05-09T09:46:31.122 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug op order = true 2024-05-09T09:46:31.122 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug verify stray on activate = true 2024-05-09T09:46:31.122 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug trim objects = true 2024-05-09T09:46:31.122 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-09T09:46:31.122 INFO:teuthology.orchestra.run.smithi157.stdout: osd open classes on start = true 2024-05-09T09:46:31.122 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug pg log writeout = true 2024-05-09T09:46:31.122 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-09T09:46:31.122 INFO:teuthology.orchestra.run.smithi157.stdout: osd deep scrub update digest min age = 30 2024-05-09T09:46:31.122 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-09T09:46:31.122 INFO:teuthology.orchestra.run.smithi157.stdout: osd map max advance = 10 2024-05-09T09:46:31.122 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-09T09:46:31.123 INFO:teuthology.orchestra.run.smithi157.stdout: journal zero on create = true 2024-05-09T09:46:31.123 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-09T09:46:31.123 INFO:teuthology.orchestra.run.smithi157.stdout: filestore ondisk finisher threads = 3 2024-05-09T09:46:31.123 INFO:teuthology.orchestra.run.smithi157.stdout: filestore apply finisher threads = 3 2024-05-09T09:46:31.123 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-09T09:46:31.123 INFO:teuthology.orchestra.run.smithi157.stdout: bdev debug aio = true 2024-05-09T09:46:31.123 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug misdirected ops = true 2024-05-09T09:46:31.123 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-05-09T09:46:31.123 INFO:teuthology.orchestra.run.smithi157.stdout: debug objclass = 20 2024-05-09T09:46:31.123 INFO:teuthology.orchestra.run.smithi157.stdout: bdev async discard = True 2024-05-09T09:46:31.123 INFO:teuthology.orchestra.run.smithi157.stdout: bdev enable discard = True 2024-05-09T09:46:31.123 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore allocator = bitmap 2024-05-09T09:46:31.123 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore block size = 96636764160 2024-05-09T09:46:31.123 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore fsck on mount = True 2024-05-09T09:46:31.123 INFO:teuthology.orchestra.run.smithi157.stdout: debug bluefs = 1/20 2024-05-09T09:46:31.123 INFO:teuthology.orchestra.run.smithi157.stdout: debug bluestore = 1/20 2024-05-09T09:46:31.124 INFO:teuthology.orchestra.run.smithi157.stdout: debug osd = 20 2024-05-09T09:46:31.124 INFO:teuthology.orchestra.run.smithi157.stdout: debug rocksdb = 4/10 2024-05-09T09:46:31.124 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd backfillfull_ratio = 0.85 2024-05-09T09:46:31.124 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd full ratio = 0.9 2024-05-09T09:46:31.124 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd nearfull ratio = 0.8 2024-05-09T09:46:31.124 INFO:teuthology.orchestra.run.smithi157.stdout: osd failsafe full ratio = 0.95 2024-05-09T09:46:31.124 INFO:teuthology.orchestra.run.smithi157.stdout: osd objectstore = bluestore 2024-05-09T09:46:31.124 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-09T09:46:31.124 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr] 2024-05-09T09:46:31.124 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-05-09T09:46:31.124 INFO:teuthology.orchestra.run.smithi157.stdout: debug mgr = 20 2024-05-09T09:46:31.124 INFO:teuthology.orchestra.run.smithi157.stdout: debug mon = 20 2024-05-09T09:46:31.124 INFO:teuthology.orchestra.run.smithi157.stdout: debug auth = 20 2024-05-09T09:46:31.124 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min pgs per osd = 4 2024-05-09T09:46:31.124 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min bytes per osd = 10 2024-05-09T09:46:31.124 INFO:teuthology.orchestra.run.smithi157.stdout: mgr/telemetry/nag = false 2024-05-09T09:46:31.125 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-09T09:46:31.125 INFO:teuthology.orchestra.run.smithi157.stdout:[mon] 2024-05-09T09:46:31.125 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-05-09T09:46:31.125 INFO:teuthology.orchestra.run.smithi157.stdout: debug mon = 20 2024-05-09T09:46:31.125 INFO:teuthology.orchestra.run.smithi157.stdout: debug paxos = 20 2024-05-09T09:46:31.125 INFO:teuthology.orchestra.run.smithi157.stdout: debug auth = 20 2024-05-09T09:46:31.125 INFO:teuthology.orchestra.run.smithi157.stdout: mon data avail warn = 5 2024-05-09T09:46:31.125 INFO:teuthology.orchestra.run.smithi157.stdout: mon mgr mkfs grace = 240 2024-05-09T09:46:31.125 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min pgs per osd = 4 2024-05-09T09:46:31.125 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd reporter subtree level = osd 2024-05-09T09:46:31.125 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd prime pg temp = true 2024-05-09T09:46:31.125 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min bytes per osd = 10 2024-05-09T09:46:31.125 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-09T09:46:31.125 INFO:teuthology.orchestra.run.smithi157.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-09T09:46:31.125 INFO:teuthology.orchestra.run.smithi157.stdout: auth mon ticket ttl = 660 # 11m 2024-05-09T09:46:31.126 INFO:teuthology.orchestra.run.smithi157.stdout: auth service ticket ttl = 240 # 4m 2024-05-09T09:46:31.126 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-09T09:46:31.126 INFO:teuthology.orchestra.run.smithi157.stdout: # don't complain about insecure global_id in the test suite 2024-05-09T09:46:31.126 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-09T09:46:31.126 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-09T09:46:31.126 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-09T09:46:31.126 INFO:teuthology.orchestra.run.smithi157.stdout: # 1m isn't quite enough 2024-05-09T09:46:31.126 INFO:teuthology.orchestra.run.smithi157.stdout: mon_down_mkfs_grace = 2m 2024-05-09T09:46:31.126 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-09T09:46:31.126 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_filestore_osds = false 2024-05-09T09:46:31.126 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-05-09T09:46:31.126 INFO:teuthology.orchestra.run.smithi157.stdout:[client] 2024-05-09T09:46:31.126 INFO:teuthology.orchestra.run.smithi157.stdout: rgw cache enabled = true 2024-05-09T09:46:31.126 INFO:teuthology.orchestra.run.smithi157.stdout: rgw enable ops log = true 2024-05-09T09:46:31.126 INFO:teuthology.orchestra.run.smithi157.stdout: rgw enable usage log = true 2024-05-09T09:46:31.127 INFO:teuthology.orchestra.run.smithi157.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-09T09:46:31.127 INFO:teuthology.orchestra.run.smithi157.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-09T09:46:31.127 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-05-09T09:46:31.127 INFO:teuthology.orchestra.run.smithi157.stdout: rgw gc obj min wait = 15 2024-05-09T09:46:31.127 INFO:teuthology.orchestra.run.smithi157.stdout: debug rgw = 20 2024-05-09T09:46:31.127 INFO:teuthology.orchestra.run.smithi157.stdout: setgroup = ceph 2024-05-09T09:46:31.127 INFO:teuthology.orchestra.run.smithi157.stdout: setuser = ceph 2024-05-09T09:46:31.127 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.a] 2024-05-09T09:46:31.128 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-09T09:46:31.128 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-09T09:46:31.219 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-09T09:46:31.219 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T09:46:31.219 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-09T09:46:31.268 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T09:46:31.268 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-09T09:46:31.316 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi110.front.sepia.ceph.com 2024-05-09T09:46:31.316 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T09:46:31.317 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-09T09:46:31.317 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-09T09:46:31.381 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T09:46:31.381 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-09T09:46:31.428 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi157.front.sepia.ceph.com 2024-05-09T09:46:31.428 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-09T09:46:31.428 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-09T09:46:31.428 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-09T09:46:31.452 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-09T09:46:31.452 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-09T09:46:31.505 INFO:tasks.ceph:Setting up mon nodes... 2024-05-09T09:46:31.506 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-09T09:46:31.506 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-09T09:46:31.591 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-09T09:46:31.604 INFO:tasks.ceph:Setting up mds nodes... 2024-05-09T09:46:31.604 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-09T09:46:31.604 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-09T09:46:31.682 INFO:teuthology.orchestra.run.smithi157.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-09T09:46:31.692 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-09T09:46:31.692 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi157.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-05-09T09:46:31.692 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-09T09:46:31.707 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-05-09T09:46:31.707 INFO:tasks.ceph:role: osd.0 2024-05-09T09:46:31.707 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com 2024-05-09T09:46:31.707 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-09T09:46:31.766 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T09:46:31.766 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T09:46:31.766 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T09:46:31.766 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-09T09:46:31.766 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T09:46:31.767 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-05-09T09:46:31.767 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T09:46:31.767 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-09T09:46:31.767 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T09:46:31.767 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T09:46:31.790 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-05-09T09:46:31.792 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-05-09T09:46:31.792 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-09T09:46:31.851 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-09T09:46:31.904 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T09:46:31.905 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: /sbin/restorecon: command not found 2024-05-09T09:46:31.905 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T09:46:32.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:32.017+0000 7fc644a1c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-09T09:46:32.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:32.017+0000 7fc644a1c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-09T09:46:32.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:32.017+0000 7fc644a1c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-09T09:46:32.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:32.017+0000 7fc644a1c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-09T09:46:32.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:32.017+0000 7fc644a1c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-09T09:46:32.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:32.017+0000 7fc644a1c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-09T09:46:34.984 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-09T09:46:34.997 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-09T09:46:35.012 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-05-09T09:46:35.012 INFO:tasks.ceph:role: osd.1 2024-05-09T09:46:35.012 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi157.front.sepia.ceph.com 2024-05-09T09:46:35.012 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-09T09:46:35.069 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T09:46:35.069 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T09:46:35.069 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T09:46:35.070 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-09T09:46:35.070 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T09:46:35.070 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-05-09T09:46:35.070 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T09:46:35.070 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-09T09:46:35.070 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T09:46:35.070 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T09:46:35.093 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-05-09T09:46:35.095 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-05-09T09:46:35.095 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-05-09T09:46:35.153 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-09T09:46:35.206 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T09:46:35.206 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2024-05-09T09:46:35.207 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-09T09:46:35.258 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-05-09T09:46:35.258 INFO:tasks.ceph:role: osd.2 2024-05-09T09:46:35.259 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi157.front.sepia.ceph.com 2024-05-09T09:46:35.259 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-09T09:46:35.311 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T09:46:35.311 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T09:46:35.311 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T09:46:35.312 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-09T09:46:35.312 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T09:46:35.312 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-05-09T09:46:35.312 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T09:46:35.312 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-09T09:46:35.312 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T09:46:35.312 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T09:46:35.335 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-05-09T09:46:35.337 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-05-09T09:46:35.337 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-05-09T09:46:35.397 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-09T09:46:35.449 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T09:46:35.450 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2024-05-09T09:46:35.450 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-09T09:46:35.506 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-05-09T09:46:35.507 INFO:tasks.ceph:role: osd.3 2024-05-09T09:46:35.507 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi157.front.sepia.ceph.com 2024-05-09T09:46:35.507 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-09T09:46:35.562 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T09:46:35.562 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T09:46:35.562 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T09:46:35.562 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-09T09:46:35.562 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T09:46:35.562 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-05-09T09:46:35.562 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T09:46:35.563 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-09T09:46:35.563 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T09:46:35.563 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T09:46:35.586 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-05-09T09:46:35.589 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-05-09T09:46:35.589 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-05-09T09:46:35.649 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-09T09:46:35.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T09:46:35.702 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: /sbin/restorecon: command not found 2024-05-09T09:46:35.702 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T09:46:35.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:35.808+0000 7f5f72eaa7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-09T09:46:35.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:35.808+0000 7f5f72eaa7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-09T09:46:35.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:35.808+0000 7f5f72eaa7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-09T09:46:35.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:35.808+0000 7f5f72eaa7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-09T09:46:35.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:35.808+0000 7f5f72eaa7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-09T09:46:35.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:35.808+0000 7f5f72eaa7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-09T09:46:38.797 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-09T09:46:38.811 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T09:46:38.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:38.892+0000 7f8eb00327c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-09T09:46:38.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:38.892+0000 7f8eb00327c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-09T09:46:38.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:38.892+0000 7f8eb00327c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-09T09:46:38.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:38.892+0000 7f8eb00327c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-09T09:46:38.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:38.892+0000 7f8eb00327c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-09T09:46:38.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:38.892+0000 7f8eb00327c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-09T09:46:41.884 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-09T09:46:41.941 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T09:46:42.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:42.020+0000 7f654bce47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-09T09:46:42.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:42.020+0000 7f654bce47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-09T09:46:42.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:42.020+0000 7f654bce47c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-09T09:46:42.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:42.020+0000 7f654bce47c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-09T09:46:42.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:42.020+0000 7f654bce47c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-09T09:46:42.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:42.024+0000 7f654bce47c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-09T09:46:44.989 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-09T09:46:45.045 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-09T09:46:45.046 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T09:46:45.046 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-09T09:46:45.060 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-09T09:46:45.060 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-09T09:46:45.099 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-09T09:46:45.099 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-09T09:46:45.152 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-09T09:46:45.152 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-09T09:46:45.207 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-09T09:46:45.208 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-09T09:46:45.259 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-09T09:46:45.259 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-09T09:46:45.304 INFO:tasks.ceph:Adding keys to all mons... 2024-05-09T09:46:45.305 DEBUG:teuthology.orchestra.run.smithi110:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-09T09:46:45.317 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.0] 2024-05-09T09:46:45.317 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQB4mzxmKx5BARAA/gpD4/iHff3Yf2pWoPaQEA== 2024-05-09T09:46:45.317 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.x] 2024-05-09T09:46:45.317 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQB3mzxm0alqIxAAKyZ7hi0dRv9CrjK7//d4vQ== 2024-05-09T09:46:45.317 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.1] 2024-05-09T09:46:45.317 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQB7mzxm2y2UMBAAQ/vLYztqDNfJUOu1ccde5w== 2024-05-09T09:46:45.317 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.2] 2024-05-09T09:46:45.317 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQB+mzxmszeANRAAil+/tFvCUAVfkfgAUeANfw== 2024-05-09T09:46:45.317 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.3] 2024-05-09T09:46:45.317 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCCmzxmJeugARAAiLDGOEf4WgO36XlVuaAe/w== 2024-05-09T09:46:45.317 INFO:teuthology.orchestra.run.smithi110.stdout:[client.0] 2024-05-09T09:46:45.318 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQB3mzxm+QbcKBAATwvIVhgxSvJ2kQzGvRZUiw== 2024-05-09T09:46:45.318 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T09:46:45.408 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T09:46:45.449 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T09:46:45.532 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T09:46:45.614 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T09:46:45.693 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-09T09:46:45.778 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-09T09:46:45.778 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-09T09:46:45.830 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-09T09:46:45.920 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-09T09:46:45.930 DEBUG:teuthology.orchestra.run.smithi110:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-09T09:46:45.978 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-09T09:46:45.978 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-09T09:46:45.978 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-09T09:46:46.020 INFO:tasks.ceph.mon.a:Started 2024-05-09T09:46:46.020 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-09T09:46:46.021 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-09T09:46:46.021 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-09T09:46:46.023 INFO:tasks.ceph.mgr.x:Started 2024-05-09T09:46:46.023 INFO:tasks.ceph:Setting crush tunables to default 2024-05-09T09:46:46.023 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd crush tunables default 2024-05-09T09:46:46.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.145+0000 7f7880cf4640 1 Processor -- start 2024-05-09T09:46:46.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.145+0000 7f7880cf4640 1 -- start start 2024-05-09T09:46:46.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.145+0000 7f7880cf4640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f787c12fc60 0x7f787c132050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:46:46.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.145+0000 7f7880cf4640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f787c0965c0 con 0x7f787c06d2d0 2024-05-09T09:46:46.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.145+0000 7f7880cf4640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f787c06ce10 con 0x7f787c12fc60 2024-05-09T09:46:46.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.145+0000 7f787a59c640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f787c06d2d0 0x7f787c06d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:50674/0 (socket says 172.21.15.110:50674) 2024-05-09T09:46:46.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.145+0000 7f787a59c640 1 -- 172.21.15.110:0/2606813162 learned_addr learned my addr 172.21.15.110:0/2606813162 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:46:46.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.157+0000 7f7879d9b640 1 --2- 172.21.15.110:0/2606813162 >> v2:172.21.15.110:3300/0 conn(0x7f787c12fc60 0x7f787c132050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:46:46.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.157+0000 7f787959a640 1 -- 172.21.15.110:0/2606813162 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3673464695 0 0) 0x7f787c0965c0 con 0x7f787c06d2d0 2024-05-09T09:46:46.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.157+0000 7f787959a640 1 -- 172.21.15.110:0/2606813162 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7864003530 con 0x7f787c06d2d0 2024-05-09T09:46:46.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.157+0000 7f7879d9b640 1 -- 172.21.15.110:0/2606813162 >> v1:172.21.15.110:6789/0 conn(0x7f787c06d2d0 legacy=0x7f787c06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:46:46.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.157+0000 7f7879d9b640 1 -- 172.21.15.110:0/2606813162 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787c09b310 con 0x7f787c12fc60 2024-05-09T09:46:46.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.161+0000 7f7879d9b640 1 --2- 172.21.15.110:0/2606813162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f787c12fc60 0x7f787c132050 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f7870009740 tx=0x7f787001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31eb2740431010a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:46:46.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.161+0000 7f787959a640 1 -- 172.21.15.110:0/2606813162 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78700b0070 con 0x7f787c12fc60 2024-05-09T09:46:46.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.161+0000 7f787959a640 1 -- 172.21.15.110:0/2606813162 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78700ab530 con 0x7f787c12fc60 2024-05-09T09:46:46.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.161+0000 7f787959a640 1 -- 172.21.15.110:0/2606813162 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78700ab830 con 0x7f787c12fc60 2024-05-09T09:46:46.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.161+0000 7f7880cf4640 1 -- 172.21.15.110:0/2606813162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f787c12fc60 msgr2=0x7f787c132050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:46:46.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.161+0000 7f7880cf4640 1 --2- 172.21.15.110:0/2606813162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f787c12fc60 0x7f787c132050 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f7870009740 tx=0x7f787001c370 comp rx=0 tx=0).stop 2024-05-09T09:46:46.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.161+0000 7f7880cf4640 1 -- 172.21.15.110:0/2606813162 shutdown_connections 2024-05-09T09:46:46.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.161+0000 7f7880cf4640 1 --2- 172.21.15.110:0/2606813162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f787c12fc60 0x7f787c132050 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:46:46.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.161+0000 7f7880cf4640 1 -- 172.21.15.110:0/2606813162 >> 172.21.15.110:0/2606813162 conn(0x7f787c09e4a0 msgr2=0x7f787c09a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:46:46.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.161+0000 7f7880cf4640 1 -- 172.21.15.110:0/2606813162 shutdown_connections 2024-05-09T09:46:46.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.161+0000 7f7880cf4640 1 -- 172.21.15.110:0/2606813162 wait complete. 2024-05-09T09:46:46.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.161+0000 7f7880cf4640 1 Processor -- start 2024-05-09T09:46:46.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.161+0000 7f7880cf4640 1 -- start start 2024-05-09T09:46:46.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.161+0000 7f7880cf4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f787c06d2d0 0x7f787c1c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:46:46.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.161+0000 7f7880cf4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f787c135140 con 0x7f787c06d2d0 2024-05-09T09:46:46.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.161+0000 7f787a59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f787c06d2d0 0x7f787c1c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:46:46.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.161+0000 7f787a59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f787c06d2d0 0x7f787c1c4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58736/0 (socket says 172.21.15.110:58736) 2024-05-09T09:46:46.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.161+0000 7f787a59c640 1 -- 172.21.15.110:0/3375453718 learned_addr learned my addr 172.21.15.110:0/3375453718 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:46:46.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.161+0000 7f787a59c640 1 -- 172.21.15.110:0/3375453718 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787c1266c0 con 0x7f787c06d2d0 2024-05-09T09:46:46.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.161+0000 7f787a59c640 1 --2- 172.21.15.110:0/3375453718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f787c06d2d0 0x7f787c1c4640 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f786c00c450 tx=0x7f786c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:46:46.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.161+0000 7f786affd640 1 -- 172.21.15.110:0/3375453718 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f786c017070 con 0x7f787c06d2d0 2024-05-09T09:46:46.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.161+0000 7f786affd640 1 -- 172.21.15.110:0/3375453718 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f786c005c20 con 0x7f787c06d2d0 2024-05-09T09:46:46.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.161+0000 7f7880cf4640 1 -- 172.21.15.110:0/3375453718 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f787c12b300 con 0x7f787c06d2d0 2024-05-09T09:46:46.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.161+0000 7f786affd640 1 -- 172.21.15.110:0/3375453718 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f786c007070 con 0x7f787c06d2d0 2024-05-09T09:46:46.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.161+0000 7f7880cf4640 1 -- 172.21.15.110:0/3375453718 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f787c1c4b80 con 0x7f787c06d2d0 2024-05-09T09:46:46.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.165+0000 7f786affd640 1 -- 172.21.15.110:0/3375453718 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f786c01a070 con 0x7f787c06d2d0 2024-05-09T09:46:46.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.165+0000 7f786affd640 1 -- 172.21.15.110:0/3375453718 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f786c012400 con 0x7f787c06d2d0 2024-05-09T09:46:46.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.165+0000 7f7880cf4640 1 -- 172.21.15.110:0/3375453718 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f787c063710 con 0x7f787c06d2d0 2024-05-09T09:46:46.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.177+0000 7f786affd640 1 -- 172.21.15.110:0/3375453718 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f786c01c4a0 con 0x7f787c06d2d0 2024-05-09T09:46:46.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.237+0000 7f7880cf4640 1 -- 172.21.15.110:0/3375453718 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f787c067fd0 con 0x7f787c06d2d0 2024-05-09T09:46:46.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.241+0000 7f786affd640 1 -- 172.21.15.110:0/3375453718 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f786c01c680 con 0x7f787c06d2d0 2024-05-09T09:46:46.240 INFO:teuthology.orchestra.run.smithi110.stderr:adjusted tunables profile to default 2024-05-09T09:46:46.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.241+0000 7f7880cf4640 1 -- 172.21.15.110:0/3375453718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f787c06d2d0 msgr2=0x7f787c1c4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:46:46.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.241+0000 7f7880cf4640 1 --2- 172.21.15.110:0/3375453718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f787c06d2d0 0x7f787c1c4640 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f786c00c450 tx=0x7f786c00c910 comp rx=0 tx=0).stop 2024-05-09T09:46:46.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.241+0000 7f7880cf4640 1 -- 172.21.15.110:0/3375453718 shutdown_connections 2024-05-09T09:46:46.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.241+0000 7f7880cf4640 1 --2- 172.21.15.110:0/3375453718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f787c06d2d0 0x7f787c1c4640 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:46:46.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.241+0000 7f7880cf4640 1 -- 172.21.15.110:0/3375453718 >> 172.21.15.110:0/3375453718 conn(0x7f787c09e4a0 msgr2=0x7f787c1273c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:46:46.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.241+0000 7f7880cf4640 1 -- 172.21.15.110:0/3375453718 shutdown_connections 2024-05-09T09:46:46.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:46.241+0000 7f7880cf4640 1 -- 172.21.15.110:0/3375453718 wait complete. 2024-05-09T09:46:46.257 INFO:tasks.ceph:check_enable_crimson: False 2024-05-09T09:46:46.258 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-09T09:46:46.258 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T09:46:46.258 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-09T09:46:46.269 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-09T09:46:46.269 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-09T09:46:46.282 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-09T09:46:46.282 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-09T09:46:46.335 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-05-09T09:46:46.335 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-09T09:46:46.342 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-09T09:46:46.340+0000 7f9489438180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T09:46:46.353 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new c7cc58db-ea92-4134-a9e4-01f3d21592f5 0 2024-05-09T09:46:46.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.512+0000 7fc72fd1e640 1 Processor -- start 2024-05-09T09:46:46.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.512+0000 7fc72fd1e640 1 -- start start 2024-05-09T09:46:46.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.512+0000 7fc72fd1e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc728111220 0x7fc728111600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:46:46.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.512+0000 7fc72fd1e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7281168a0 con 0x7fc728111b70 2024-05-09T09:46:46.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.512+0000 7fc72fd1e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fc728116a90 con 0x7fc728111220 2024-05-09T09:46:46.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.512+0000 7fc72daba640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc728111220 0x7fc728111600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:46:46.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.512+0000 7fc72d2b9640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc728111b70 0x7fc728116050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:46772/0 (socket says 172.21.15.157:46772) 2024-05-09T09:46:46.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.512+0000 7fc72d2b9640 1 -- 172.21.15.157:0/3546321225 learned_addr learned my addr 172.21.15.157:0/3546321225 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:46:46.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.512+0000 7fc72daba640 1 -- 172.21.15.157:0/3546321225 >> v1:172.21.15.110:6789/0 conn(0x7fc728111b70 legacy=0x7fc728116050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:46:46.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.512+0000 7fc72daba640 1 -- 172.21.15.157:0/3546321225 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc728116c40 con 0x7fc728111220 2024-05-09T09:46:46.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.516+0000 7fc72daba640 1 --2- 172.21.15.157:0/3546321225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc728111220 0x7fc728111600 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc724009740 tx=0x7fc72401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ff72caa19834e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:46:46.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.516+0000 7fc72cab8640 1 -- 172.21.15.157:0/3546321225 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7240b0070 con 0x7fc728111220 2024-05-09T09:46:46.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.516+0000 7fc72cab8640 1 -- 172.21.15.157:0/3546321225 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7240ab530 con 0x7fc728111220 2024-05-09T09:46:46.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.516+0000 7fc72cab8640 1 -- 172.21.15.157:0/3546321225 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7240ab830 con 0x7fc728111220 2024-05-09T09:46:46.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.516+0000 7fc72fd1e640 1 -- 172.21.15.157:0/3546321225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc728111220 msgr2=0x7fc728111600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:46:46.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.516+0000 7fc72fd1e640 1 --2- 172.21.15.157:0/3546321225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc728111220 0x7fc728111600 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc724009740 tx=0x7fc72401c370 comp rx=0 tx=0).stop 2024-05-09T09:46:46.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.516+0000 7fc72fd1e640 1 -- 172.21.15.157:0/3546321225 shutdown_connections 2024-05-09T09:46:46.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.516+0000 7fc72fd1e640 1 --2- 172.21.15.157:0/3546321225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc728111220 0x7fc728111600 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:46:46.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.516+0000 7fc72fd1e640 1 -- 172.21.15.157:0/3546321225 >> 172.21.15.157:0/3546321225 conn(0x7fc7280701f0 msgr2=0x7fc728072610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:46:46.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.516+0000 7fc72fd1e640 1 -- 172.21.15.157:0/3546321225 shutdown_connections 2024-05-09T09:46:46.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.516+0000 7fc72fd1e640 1 -- 172.21.15.157:0/3546321225 wait complete. 2024-05-09T09:46:46.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.520+0000 7fc72fd1e640 1 Processor -- start 2024-05-09T09:46:46.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.520+0000 7fc72fd1e640 1 -- start start 2024-05-09T09:46:46.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.520+0000 7fc72fd1e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc728111220 0x7fc72810ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:46:46.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.520+0000 7fc72fd1e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc72811ed30 con 0x7fc728111220 2024-05-09T09:46:46.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.520+0000 7fc72daba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc728111220 0x7fc72810ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:46:46.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.520+0000 7fc72daba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc728111220 0x7fc72810ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:40516/0 (socket says 172.21.15.157:40516) 2024-05-09T09:46:46.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.520+0000 7fc72daba640 1 -- 172.21.15.157:0/3294181222 learned_addr learned my addr 172.21.15.157:0/3294181222 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:46:46.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.520+0000 7fc72daba640 1 -- 172.21.15.157:0/3294181222 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc72810f3c0 con 0x7fc728111220 2024-05-09T09:46:46.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.520+0000 7fc72daba640 1 --2- 172.21.15.157:0/3294181222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc728111220 0x7fc72810ee80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc724019fa0 tx=0x7fc72401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:46:46.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.520+0000 7fc71e7fc640 1 -- 172.21.15.157:0/3294181222 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7240b0050 con 0x7fc728111220 2024-05-09T09:46:46.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.520+0000 7fc71e7fc640 1 -- 172.21.15.157:0/3294181222 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7240b1040 con 0x7fc728111220 2024-05-09T09:46:46.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.520+0000 7fc72fd1e640 1 -- 172.21.15.157:0/3294181222 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc72810f5f0 con 0x7fc728111220 2024-05-09T09:46:46.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.520+0000 7fc71e7fc640 1 -- 172.21.15.157:0/3294181222 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7240aab40 con 0x7fc728111220 2024-05-09T09:46:46.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.520+0000 7fc72fd1e640 1 -- 172.21.15.157:0/3294181222 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc72810fa50 con 0x7fc728111220 2024-05-09T09:46:46.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.520+0000 7fc71e7fc640 1 -- 172.21.15.157:0/3294181222 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc7240be030 con 0x7fc728111220 2024-05-09T09:46:46.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.520+0000 7fc71e7fc640 1 -- 172.21.15.157:0/3294181222 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fc7240bc070 con 0x7fc728111220 2024-05-09T09:46:46.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.520+0000 7fc72fd1e640 1 -- 172.21.15.157:0/3294181222 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7280505f0 con 0x7fc728111220 2024-05-09T09:46:46.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.528+0000 7fc71e7fc640 1 -- 172.21.15.157:0/3294181222 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fc7240c5020 con 0x7fc728111220 2024-05-09T09:46:46.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.596+0000 7fc72fd1e640 1 -- 172.21.15.157:0/3294181222 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c7cc58db-ea92-4134-a9e4-01f3d21592f5", "id": 0} v 0) -- 0x7fc7281136e0 con 0x7fc728111220 2024-05-09T09:46:46.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.600+0000 7fc71e7fc640 1 -- 172.21.15.157:0/3294181222 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c7cc58db-ea92-4134-a9e4-01f3d21592f5", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fc724015ff0 con 0x7fc728111220 2024-05-09T09:46:46.601 INFO:teuthology.orchestra.run.smithi157.stdout:0 2024-05-09T09:46:46.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.600+0000 7fc72fd1e640 1 -- 172.21.15.157:0/3294181222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc728111220 msgr2=0x7fc72810ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:46:46.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.600+0000 7fc72fd1e640 1 --2- 172.21.15.157:0/3294181222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc728111220 0x7fc72810ee80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc724019fa0 tx=0x7fc72401abb0 comp rx=0 tx=0).stop 2024-05-09T09:46:46.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.600+0000 7fc72fd1e640 1 -- 172.21.15.157:0/3294181222 shutdown_connections 2024-05-09T09:46:46.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.600+0000 7fc72fd1e640 1 --2- 172.21.15.157:0/3294181222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc728111220 0x7fc72810ee80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:46:46.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.600+0000 7fc72fd1e640 1 -- 172.21.15.157:0/3294181222 >> 172.21.15.157:0/3294181222 conn(0x7fc7280701f0 msgr2=0x7fc7281176b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:46:46.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.600+0000 7fc72fd1e640 1 -- 172.21.15.157:0/3294181222 shutdown_connections 2024-05-09T09:46:46.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.600+0000 7fc72fd1e640 1 -- 172.21.15.157:0/3294181222 wait complete. 2024-05-09T09:46:46.617 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new fe2d7e0c-75c9-471d-b77b-5f94220e23bf 1 2024-05-09T09:46:46.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.728+0000 7f8afe381640 1 Processor -- start 2024-05-09T09:46:46.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.728+0000 7f8afe381640 1 -- start start 2024-05-09T09:46:46.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.728+0000 7f8afe381640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8af8117f50 0x7f8af811a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:46:46.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.728+0000 7f8afe381640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8af811a880 con 0x7f8af8110120 2024-05-09T09:46:46.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.728+0000 7f8afe381640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f8af811ba60 con 0x7f8af8117f50 2024-05-09T09:46:46.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.728+0000 7f8aeffff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8af8117f50 0x7f8af811a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:46:46.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.728+0000 7f8af7fff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f8af8110120 0x7f8af8110520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:46786/0 (socket says 172.21.15.157:46786) 2024-05-09T09:46:46.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.728+0000 7f8aeffff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8af8117f50 0x7f8af811a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:40522/0 (socket says 172.21.15.157:40522) 2024-05-09T09:46:46.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.728+0000 7f8af7fff640 1 -- 172.21.15.157:0/957030232 learned_addr learned my addr 172.21.15.157:0/957030232 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:46:46.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.728+0000 7f8aeffff640 1 -- 172.21.15.157:0/957030232 >> v1:172.21.15.110:6789/0 conn(0x7f8af8110120 legacy=0x7f8af8110520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:46:46.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.728+0000 7f8aeffff640 1 -- 172.21.15.157:0/957030232 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af811bbe0 con 0x7f8af8117f50 2024-05-09T09:46:46.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.732+0000 7f8aeffff640 1 --2- 172.21.15.157:0/957030232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8af8117f50 0x7f8af811a340 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8ae000b9e0 tx=0x7f8ae001ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4645faf59fa77a25 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:46:46.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.732+0000 7f8af77fe640 1 -- 172.21.15.157:0/957030232 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ae00b4070 con 0x7f8af8117f50 2024-05-09T09:46:46.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.732+0000 7f8af77fe640 1 -- 172.21.15.157:0/957030232 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae00a7a60 con 0x7f8af8117f50 2024-05-09T09:46:46.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.732+0000 7f8af77fe640 1 -- 172.21.15.157:0/957030232 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ae00a7d60 con 0x7f8af8117f50 2024-05-09T09:46:46.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.732+0000 7f8afe381640 1 -- 172.21.15.157:0/957030232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8af8117f50 msgr2=0x7f8af811a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:46:46.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.732+0000 7f8afe381640 1 --2- 172.21.15.157:0/957030232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8af8117f50 0x7f8af811a340 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8ae000b9e0 tx=0x7f8ae001ea40 comp rx=0 tx=0).stop 2024-05-09T09:46:46.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.732+0000 7f8afe381640 1 -- 172.21.15.157:0/957030232 shutdown_connections 2024-05-09T09:46:46.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.732+0000 7f8afe381640 1 --2- 172.21.15.157:0/957030232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8af8117f50 0x7f8af811a340 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:46:46.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.732+0000 7f8afe381640 1 -- 172.21.15.157:0/957030232 >> 172.21.15.157:0/957030232 conn(0x7f8af806fb50 msgr2=0x7f8af8071f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:46:46.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.732+0000 7f8afe381640 1 -- 172.21.15.157:0/957030232 shutdown_connections 2024-05-09T09:46:46.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.732+0000 7f8afe381640 1 -- 172.21.15.157:0/957030232 wait complete. 2024-05-09T09:46:46.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.732+0000 7f8afe381640 1 Processor -- start 2024-05-09T09:46:46.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.732+0000 7f8afe381640 1 -- start start 2024-05-09T09:46:46.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.732+0000 7f8afe381640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8af8110120 0x7f8af81af400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:46:46.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.732+0000 7f8afe381640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8af811b780 con 0x7f8af8110120 2024-05-09T09:46:46.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.736+0000 7f8af7fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8af8110120 0x7f8af81af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:46:46.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.736+0000 7f8af7fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8af8110120 0x7f8af81af400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:40528/0 (socket says 172.21.15.157:40528) 2024-05-09T09:46:46.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.736+0000 7f8af7fff640 1 -- 172.21.15.157:0/2721109744 learned_addr learned my addr 172.21.15.157:0/2721109744 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:46:46.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.736+0000 7f8af7fff640 1 -- 172.21.15.157:0/2721109744 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af81af9d0 con 0x7f8af8110120 2024-05-09T09:46:46.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.736+0000 7f8af7fff640 1 --2- 172.21.15.157:0/2721109744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8af8110120 0x7f8af81af400 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800c450 tx=0x7f8ae800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:46:46.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.736+0000 7f8af57fa640 1 -- 172.21.15.157:0/2721109744 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ae8017070 con 0x7f8af8110120 2024-05-09T09:46:46.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.736+0000 7f8af57fa640 1 -- 172.21.15.157:0/2721109744 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae8005c20 con 0x7f8af8110120 2024-05-09T09:46:46.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.736+0000 7f8afe381640 1 -- 172.21.15.157:0/2721109744 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8af81afc60 con 0x7f8af8110120 2024-05-09T09:46:46.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.736+0000 7f8af57fa640 1 -- 172.21.15.157:0/2721109744 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ae80070d0 con 0x7f8af8110120 2024-05-09T09:46:46.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.736+0000 7f8afe381640 1 -- 172.21.15.157:0/2721109744 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8af81a9670 con 0x7f8af8110120 2024-05-09T09:46:46.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.736+0000 7f8af57fa640 1 -- 172.21.15.157:0/2721109744 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8ae801a070 con 0x7f8af8110120 2024-05-09T09:46:46.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.736+0000 7f8af57fa640 1 -- 172.21.15.157:0/2721109744 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f8ae8012400 con 0x7f8af8110120 2024-05-09T09:46:46.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.736+0000 7f8afe381640 1 -- 172.21.15.157:0/2721109744 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8af80505f0 con 0x7f8af8110120 2024-05-09T09:46:46.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.744+0000 7f8af57fa640 1 -- 172.21.15.157:0/2721109744 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f8ae801c4a0 con 0x7f8af8110120 2024-05-09T09:46:46.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.812+0000 7f8afe381640 1 -- 172.21.15.157:0/2721109744 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fe2d7e0c-75c9-471d-b77b-5f94220e23bf", "id": 1} v 0) -- 0x7f8af81afe90 con 0x7f8af8110120 2024-05-09T09:46:46.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.812+0000 7f8af57fa640 1 -- 172.21.15.157:0/2721109744 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fe2d7e0c-75c9-471d-b77b-5f94220e23bf", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f8ae80072c0 con 0x7f8af8110120 2024-05-09T09:46:46.815 INFO:teuthology.orchestra.run.smithi157.stdout:1 2024-05-09T09:46:46.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.812+0000 7f8afe381640 1 -- 172.21.15.157:0/2721109744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8af8110120 msgr2=0x7f8af81af400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:46:46.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.812+0000 7f8afe381640 1 --2- 172.21.15.157:0/2721109744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8af8110120 0x7f8af81af400 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800c450 tx=0x7f8ae800c910 comp rx=0 tx=0).stop 2024-05-09T09:46:46.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.812+0000 7f8afe381640 1 -- 172.21.15.157:0/2721109744 shutdown_connections 2024-05-09T09:46:46.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.812+0000 7f8afe381640 1 --2- 172.21.15.157:0/2721109744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8af8110120 0x7f8af81af400 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:46:46.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.812+0000 7f8afe381640 1 -- 172.21.15.157:0/2721109744 >> 172.21.15.157:0/2721109744 conn(0x7f8af806fb50 msgr2=0x7f8af8071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:46:46.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.812+0000 7f8afe381640 1 -- 172.21.15.157:0/2721109744 shutdown_connections 2024-05-09T09:46:46.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.812+0000 7f8afe381640 1 -- 172.21.15.157:0/2721109744 wait complete. 2024-05-09T09:46:46.831 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 6fa89462-855a-422a-b215-d2076f0dfb2b 2 2024-05-09T09:46:46.834 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-09T09:46:46.832+0000 7f9489438180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T09:46:46.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.940+0000 7f5c6d6b6640 1 Processor -- start 2024-05-09T09:46:46.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.940+0000 7f5c6d6b6640 1 -- start start 2024-05-09T09:46:46.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.940+0000 7f5c6d6b6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5c68111220 0x7f5c68111600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:46:46.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.940+0000 7f5c6d6b6640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c681168a0 con 0x7f5c68111b70 2024-05-09T09:46:46.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.940+0000 7f5c6d6b6640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f5c68116a90 con 0x7f5c68111220 2024-05-09T09:46:46.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.940+0000 7f5c66ffd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5c68111220 0x7f5c68111600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:46:46.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.940+0000 7f5c66ffd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5c68111220 0x7f5c68111600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:40536/0 (socket says 172.21.15.157:40536) 2024-05-09T09:46:46.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.940+0000 7f5c66ffd640 1 -- 172.21.15.157:0/2923652767 learned_addr learned my addr 172.21.15.157:0/2923652767 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:46:46.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.940+0000 7f5c66ffd640 1 -- 172.21.15.157:0/2923652767 >> v1:172.21.15.110:6789/0 conn(0x7f5c68111b70 legacy=0x7f5c68116050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:46:46.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.940+0000 7f5c66ffd640 1 -- 172.21.15.157:0/2923652767 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c68116c40 con 0x7f5c68111220 2024-05-09T09:46:46.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.944+0000 7f5c66ffd640 1 --2- 172.21.15.157:0/2923652767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c68111220 0x7f5c68111600 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5c580097f0 tx=0x7f5c5801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8bddb1d6e052fe6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:46:46.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.944+0000 7f5c65ffb640 1 -- 172.21.15.157:0/2923652767 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c580b0070 con 0x7f5c68111220 2024-05-09T09:46:46.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.944+0000 7f5c65ffb640 1 -- 172.21.15.157:0/2923652767 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c580ab530 con 0x7f5c68111220 2024-05-09T09:46:46.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.944+0000 7f5c65ffb640 1 -- 172.21.15.157:0/2923652767 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c580ab830 con 0x7f5c68111220 2024-05-09T09:46:46.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.944+0000 7f5c6d6b6640 1 -- 172.21.15.157:0/2923652767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c68111220 msgr2=0x7f5c68111600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:46:46.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.944+0000 7f5c6d6b6640 1 --2- 172.21.15.157:0/2923652767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c68111220 0x7f5c68111600 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5c580097f0 tx=0x7f5c5801c430 comp rx=0 tx=0).stop 2024-05-09T09:46:46.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.944+0000 7f5c6d6b6640 1 -- 172.21.15.157:0/2923652767 shutdown_connections 2024-05-09T09:46:46.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.944+0000 7f5c6d6b6640 1 --2- 172.21.15.157:0/2923652767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c68111220 0x7f5c68111600 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:46:46.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.944+0000 7f5c6d6b6640 1 -- 172.21.15.157:0/2923652767 >> 172.21.15.157:0/2923652767 conn(0x7f5c680701f0 msgr2=0x7f5c68072610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:46:46.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.944+0000 7f5c6d6b6640 1 -- 172.21.15.157:0/2923652767 shutdown_connections 2024-05-09T09:46:46.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.944+0000 7f5c6d6b6640 1 -- 172.21.15.157:0/2923652767 wait complete. 2024-05-09T09:46:46.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.944+0000 7f5c6d6b6640 1 Processor -- start 2024-05-09T09:46:46.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.944+0000 7f5c6d6b6640 1 -- start start 2024-05-09T09:46:46.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.944+0000 7f5c6d6b6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c68111220 0x7f5c6810ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:46:46.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.944+0000 7f5c6d6b6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6811ed30 con 0x7f5c68111220 2024-05-09T09:46:46.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.944+0000 7f5c66ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c68111220 0x7f5c6810ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:46:46.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.944+0000 7f5c66ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c68111220 0x7f5c6810ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:40538/0 (socket says 172.21.15.157:40538) 2024-05-09T09:46:46.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.944+0000 7f5c66ffd640 1 -- 172.21.15.157:0/2357215074 learned_addr learned my addr 172.21.15.157:0/2357215074 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:46:46.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.948+0000 7f5c66ffd640 1 -- 172.21.15.157:0/2357215074 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c6810f3c0 con 0x7f5c68111220 2024-05-09T09:46:46.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.948+0000 7f5c66ffd640 1 --2- 172.21.15.157:0/2357215074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c68111220 0x7f5c6810ee80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5c5801a060 tx=0x7f5c580191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:46:46.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.948+0000 7f5c4f7fe640 1 -- 172.21.15.157:0/2357215074 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c580b0040 con 0x7f5c68111220 2024-05-09T09:46:46.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.948+0000 7f5c4f7fe640 1 -- 172.21.15.157:0/2357215074 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c580aa6d0 con 0x7f5c68111220 2024-05-09T09:46:46.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.948+0000 7f5c6d6b6640 1 -- 172.21.15.157:0/2357215074 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c6810f5f0 con 0x7f5c68111220 2024-05-09T09:46:46.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.948+0000 7f5c4f7fe640 1 -- 172.21.15.157:0/2357215074 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c580aa9b0 con 0x7f5c68111220 2024-05-09T09:46:46.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.948+0000 7f5c6d6b6640 1 -- 172.21.15.157:0/2357215074 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c6810fa50 con 0x7f5c68111220 2024-05-09T09:46:46.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.948+0000 7f5c4f7fe640 1 -- 172.21.15.157:0/2357215074 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5c580aab50 con 0x7f5c68111220 2024-05-09T09:46:46.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.948+0000 7f5c4f7fe640 1 -- 172.21.15.157:0/2357215074 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f5c580b4d90 con 0x7f5c68111220 2024-05-09T09:46:46.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.948+0000 7f5c6d6b6640 1 -- 172.21.15.157:0/2357215074 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c680505f0 con 0x7f5c68111220 2024-05-09T09:46:46.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:46.956+0000 7f5c4f7fe640 1 -- 172.21.15.157:0/2357215074 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f5c580160b0 con 0x7f5c68111220 2024-05-09T09:46:47.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.048+0000 7f5c6d6b6640 1 -- 172.21.15.157:0/2357215074 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6fa89462-855a-422a-b215-d2076f0dfb2b", "id": 2} v 0) -- 0x7f5c681136e0 con 0x7f5c68111220 2024-05-09T09:46:47.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.048+0000 7f5c4f7fe640 1 -- 172.21.15.157:0/2357215074 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6fa89462-855a-422a-b215-d2076f0dfb2b", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f5c580b4430 con 0x7f5c68111220 2024-05-09T09:46:47.052 INFO:teuthology.orchestra.run.smithi157.stdout:2 2024-05-09T09:46:47.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.052+0000 7f5c6d6b6640 1 -- 172.21.15.157:0/2357215074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c68111220 msgr2=0x7f5c6810ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:46:47.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.052+0000 7f5c6d6b6640 1 --2- 172.21.15.157:0/2357215074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c68111220 0x7f5c6810ee80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5c5801a060 tx=0x7f5c580191d0 comp rx=0 tx=0).stop 2024-05-09T09:46:47.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.052+0000 7f5c6d6b6640 1 -- 172.21.15.157:0/2357215074 shutdown_connections 2024-05-09T09:46:47.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.052+0000 7f5c6d6b6640 1 --2- 172.21.15.157:0/2357215074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c68111220 0x7f5c6810ee80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:46:47.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.052+0000 7f5c6d6b6640 1 -- 172.21.15.157:0/2357215074 >> 172.21.15.157:0/2357215074 conn(0x7f5c680701f0 msgr2=0x7f5c681176f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:46:47.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.052+0000 7f5c6d6b6640 1 -- 172.21.15.157:0/2357215074 shutdown_connections 2024-05-09T09:46:47.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.052+0000 7f5c6d6b6640 1 -- 172.21.15.157:0/2357215074 wait complete. 2024-05-09T09:46:47.053 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-09T09:46:47.052+0000 7f9489438180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T09:46:47.068 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new fd8da308-444c-4eaa-851d-6262904f60f4 3 2024-05-09T09:46:47.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.220+0000 7f12cd06c640 1 Processor -- start 2024-05-09T09:46:47.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.220+0000 7f12cd06c640 1 -- start start 2024-05-09T09:46:47.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.220+0000 7f12cd06c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f12c810f010 0x7f12c810f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:46:47.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.220+0000 7f12cd06c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12c811db40 con 0x7f12c810f930 2024-05-09T09:46:47.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.220+0000 7f12cd06c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f12c811ed20 con 0x7f12c810f010 2024-05-09T09:46:47.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.220+0000 7f12c6d9d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f12c810f010 0x7f12c810f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:46:47.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.220+0000 7f12c6d9d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f12c810f010 0x7f12c810f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:40554/0 (socket says 172.21.15.157:40554) 2024-05-09T09:46:47.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.220+0000 7f12c6d9d640 1 -- 172.21.15.157:0/1224640164 learned_addr learned my addr 172.21.15.157:0/1224640164 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:46:47.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.220+0000 7f12c659c640 1 --1- 172.21.15.157:0/1224640164 >> v1:172.21.15.110:6789/0 conn(0x7f12c810f930 0x7f12c811c420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:46806/0 (socket says 172.21.15.157:46806) 2024-05-09T09:46:47.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.220+0000 7f12c6d9d640 1 -- 172.21.15.157:0/1224640164 >> v1:172.21.15.110:6789/0 conn(0x7f12c810f930 legacy=0x7f12c811c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:46:47.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.220+0000 7f12c6d9d640 1 -- 172.21.15.157:0/1224640164 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12c811eed0 con 0x7f12c810f010 2024-05-09T09:46:47.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.224+0000 7f12c6d9d640 1 --2- 172.21.15.157:0/1224640164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12c810f010 0x7f12c810f3f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f12b80097f0 tx=0x7f12b801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc03ecfd9b6e7e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:46:47.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.224+0000 7f12c5d9b640 1 -- 172.21.15.157:0/1224640164 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12b80ab580 con 0x7f12c810f010 2024-05-09T09:46:47.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.224+0000 7f12c5d9b640 1 -- 172.21.15.157:0/1224640164 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12b80b0070 con 0x7f12c810f010 2024-05-09T09:46:47.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.224+0000 7f12c5d9b640 1 -- 172.21.15.157:0/1224640164 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12b80ab870 con 0x7f12c810f010 2024-05-09T09:46:47.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.224+0000 7f12cd06c640 1 -- 172.21.15.157:0/1224640164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12c810f010 msgr2=0x7f12c810f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:46:47.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.224+0000 7f12cd06c640 1 --2- 172.21.15.157:0/1224640164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12c810f010 0x7f12c810f3f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f12b80097f0 tx=0x7f12b801c430 comp rx=0 tx=0).stop 2024-05-09T09:46:47.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.224+0000 7f12cd06c640 1 -- 172.21.15.157:0/1224640164 shutdown_connections 2024-05-09T09:46:47.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.224+0000 7f12cd06c640 1 --2- 172.21.15.157:0/1224640164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12c810f010 0x7f12c810f3f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:46:47.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.224+0000 7f12cd06c640 1 -- 172.21.15.157:0/1224640164 >> 172.21.15.157:0/1224640164 conn(0x7f12c80701f0 msgr2=0x7f12c8072610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:46:47.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.224+0000 7f12cd06c640 1 -- 172.21.15.157:0/1224640164 shutdown_connections 2024-05-09T09:46:47.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.224+0000 7f12cd06c640 1 -- 172.21.15.157:0/1224640164 wait complete. 2024-05-09T09:46:47.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.224+0000 7f12cd06c640 1 Processor -- start 2024-05-09T09:46:47.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.224+0000 7f12cd06c640 1 -- start start 2024-05-09T09:46:47.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.228+0000 7f12cd06c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12c810f010 0x7f12c81af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:46:47.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.228+0000 7f12cd06c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f12c811e9e0 con 0x7f12c810f010 2024-05-09T09:46:47.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.228+0000 7f12c6d9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12c810f010 0x7f12c81af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:46:47.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.228+0000 7f12c6d9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12c810f010 0x7f12c81af330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:40570/0 (socket says 172.21.15.157:40570) 2024-05-09T09:46:47.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.228+0000 7f12c6d9d640 1 -- 172.21.15.157:0/388668100 learned_addr learned my addr 172.21.15.157:0/388668100 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:46:47.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.228+0000 7f12c6d9d640 1 -- 172.21.15.157:0/388668100 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12c81af900 con 0x7f12c810f010 2024-05-09T09:46:47.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.228+0000 7f12c6d9d640 1 --2- 172.21.15.157:0/388668100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12c810f010 0x7f12c81af330 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f12b8019040 tx=0x7f12b801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:46:47.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.228+0000 7f12af7fe640 1 -- 172.21.15.157:0/388668100 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12b80abe10 con 0x7f12c810f010 2024-05-09T09:46:47.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.228+0000 7f12af7fe640 1 -- 172.21.15.157:0/388668100 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12b80aa8f0 con 0x7f12c810f010 2024-05-09T09:46:47.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.228+0000 7f12cd06c640 1 -- 172.21.15.157:0/388668100 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12c81afb30 con 0x7f12c810f010 2024-05-09T09:46:47.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.228+0000 7f12af7fe640 1 -- 172.21.15.157:0/388668100 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12b80aac10 con 0x7f12c810f010 2024-05-09T09:46:47.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.228+0000 7f12cd06c640 1 -- 172.21.15.157:0/388668100 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12c81a9450 con 0x7f12c810f010 2024-05-09T09:46:47.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.228+0000 7f12af7fe640 1 -- 172.21.15.157:0/388668100 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f12b80be780 con 0x7f12c810f010 2024-05-09T09:46:47.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.228+0000 7f12af7fe640 1 -- 172.21.15.157:0/388668100 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f12b80aadb0 con 0x7f12c810f010 2024-05-09T09:46:47.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.228+0000 7f12cd06c640 1 -- 172.21.15.157:0/388668100 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12c80505f0 con 0x7f12c810f010 2024-05-09T09:46:47.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.236+0000 7f12af7fe640 1 -- 172.21.15.157:0/388668100 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f12b80dde50 con 0x7f12c810f010 2024-05-09T09:46:47.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.296+0000 7f12cd06c640 1 -- 172.21.15.157:0/388668100 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fd8da308-444c-4eaa-851d-6262904f60f4", "id": 3} v 0) -- 0x7f12c810f930 con 0x7f12c810f010 2024-05-09T09:46:47.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.300+0000 7f12af7fe640 1 -- 172.21.15.157:0/388668100 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fd8da308-444c-4eaa-851d-6262904f60f4", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f12b80cc070 con 0x7f12c810f010 2024-05-09T09:46:47.302 INFO:teuthology.orchestra.run.smithi157.stdout:3 2024-05-09T09:46:47.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.300+0000 7f12cd06c640 1 -- 172.21.15.157:0/388668100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12c810f010 msgr2=0x7f12c81af330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:46:47.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.300+0000 7f12cd06c640 1 --2- 172.21.15.157:0/388668100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12c810f010 0x7f12c81af330 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f12b8019040 tx=0x7f12b801ac70 comp rx=0 tx=0).stop 2024-05-09T09:46:47.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.300+0000 7f12cd06c640 1 -- 172.21.15.157:0/388668100 shutdown_connections 2024-05-09T09:46:47.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.300+0000 7f12cd06c640 1 --2- 172.21.15.157:0/388668100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12c810f010 0x7f12c81af330 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:46:47.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.300+0000 7f12cd06c640 1 -- 172.21.15.157:0/388668100 >> 172.21.15.157:0/388668100 conn(0x7f12c80701f0 msgr2=0x7f12c8119af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:46:47.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.300+0000 7f12cd06c640 1 -- 172.21.15.157:0/388668100 shutdown_connections 2024-05-09T09:46:47.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:46:47.300+0000 7f12cd06c640 1 -- 172.21.15.157:0/388668100 wait complete. 2024-05-09T09:46:47.318 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-09T09:46:47.319 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-09T09:46:47.321 INFO:tasks.ceph.osd.0:Started 2024-05-09T09:46:47.321 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-09T09:46:47.322 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-09T09:46:47.324 INFO:tasks.ceph.osd.1:Started 2024-05-09T09:46:47.324 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-09T09:46:47.324 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-09T09:46:47.326 INFO:tasks.ceph.osd.2:Started 2024-05-09T09:46:47.326 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-09T09:46:47.326 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-09T09:46:47.328 INFO:tasks.ceph.osd.3:Started 2024-05-09T09:46:47.328 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T09:46:47.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.449+0000 7f4f592a5640 1 Processor -- start 2024-05-09T09:46:47.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.449+0000 7f4f592a5640 1 -- start start 2024-05-09T09:46:47.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.453+0000 7f4f592a5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4f5409e3b0 0x7f4f5412bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:46:47.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.453+0000 7f4f592a5640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f5412b820 con 0x7f4f5412c1b0 2024-05-09T09:46:47.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.453+0000 7f4f592a5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f4f540a0fc0 con 0x7f4f5409e3b0 2024-05-09T09:46:47.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.453+0000 7f4f52ffd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4f5409e3b0 0x7f4f5412bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:46:47.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.453+0000 7f4f527fc640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f4f5412c1b0 0x7f4f5412ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:50696/0 (socket says 172.21.15.110:50696) 2024-05-09T09:46:47.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.453+0000 7f4f527fc640 1 -- 172.21.15.110:0/333057010 learned_addr learned my addr 172.21.15.110:0/333057010 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:46:47.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.453+0000 7f4f52ffd640 1 -- 172.21.15.110:0/333057010 >> v1:172.21.15.110:6789/0 conn(0x7f4f5412c1b0 legacy=0x7f4f5412ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:46:47.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.453+0000 7f4f52ffd640 1 -- 172.21.15.110:0/333057010 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f5409b5f0 con 0x7f4f5409e3b0 2024-05-09T09:46:47.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.453+0000 7f4f51ffb640 1 -- 172.21.15.110:0/333057010 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1124895981 0 0) 0x7f4f5412b820 con 0x7f4f5412c1b0 2024-05-09T09:46:47.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.453+0000 7f4f52ffd640 1 --2- 172.21.15.110:0/333057010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f5409e3b0 0x7f4f5412bc70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4f44009740 tx=0x7f4f4401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e93de42f17abc3f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:46:47.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.453+0000 7f4f51ffb640 1 -- 172.21.15.110:0/333057010 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f440b0070 con 0x7f4f5409e3b0 2024-05-09T09:46:47.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.453+0000 7f4f51ffb640 1 -- 172.21.15.110:0/333057010 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f440ab530 con 0x7f4f5409e3b0 2024-05-09T09:46:47.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.453+0000 7f4f51ffb640 1 -- 172.21.15.110:0/333057010 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f440ab830 con 0x7f4f5409e3b0 2024-05-09T09:46:47.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.453+0000 7f4f592a5640 1 -- 172.21.15.110:0/333057010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f5409e3b0 msgr2=0x7f4f5412bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:46:47.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.453+0000 7f4f592a5640 1 --2- 172.21.15.110:0/333057010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f5409e3b0 0x7f4f5412bc70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4f44009740 tx=0x7f4f4401c370 comp rx=0 tx=0).stop 2024-05-09T09:46:47.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.453+0000 7f4f592a5640 1 -- 172.21.15.110:0/333057010 shutdown_connections 2024-05-09T09:46:47.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.453+0000 7f4f592a5640 1 --2- 172.21.15.110:0/333057010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f5409e3b0 0x7f4f5412bc70 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:46:47.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.453+0000 7f4f592a5640 1 -- 172.21.15.110:0/333057010 >> 172.21.15.110:0/333057010 conn(0x7f4f540a17a0 msgr2=0x7f4f5409dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:46:47.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.453+0000 7f4f592a5640 1 -- 172.21.15.110:0/333057010 shutdown_connections 2024-05-09T09:46:47.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.453+0000 7f4f592a5640 1 -- 172.21.15.110:0/333057010 wait complete. 2024-05-09T09:46:47.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.457+0000 7f4f592a5640 1 Processor -- start 2024-05-09T09:46:47.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.457+0000 7f4f592a5640 1 -- start start 2024-05-09T09:46:47.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.457+0000 7f4f592a5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f5409e3b0 0x7f4f541c6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:46:47.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.457+0000 7f4f592a5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4f541371e0 con 0x7f4f5409e3b0 2024-05-09T09:46:47.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.457+0000 7f4f52ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f5409e3b0 0x7f4f541c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:46:47.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.457+0000 7f4f52ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f5409e3b0 0x7f4f541c6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58766/0 (socket says 172.21.15.110:58766) 2024-05-09T09:46:47.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.457+0000 7f4f52ffd640 1 -- 172.21.15.110:0/1180936704 learned_addr learned my addr 172.21.15.110:0/1180936704 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:46:47.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.457+0000 7f4f52ffd640 1 -- 172.21.15.110:0/1180936704 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f5406dbf0 con 0x7f4f5409e3b0 2024-05-09T09:46:47.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.457+0000 7f4f52ffd640 1 --2- 172.21.15.110:0/1180936704 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f5409e3b0 0x7f4f541c6610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4f44019fa0 tx=0x7f4f4401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:46:47.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.457+0000 7f4f3b7fe640 1 -- 172.21.15.110:0/1180936704 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f440b0050 con 0x7f4f5409e3b0 2024-05-09T09:46:47.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.457+0000 7f4f3b7fe640 1 -- 172.21.15.110:0/1180936704 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f440b1040 con 0x7f4f5409e3b0 2024-05-09T09:46:47.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.457+0000 7f4f592a5640 1 -- 172.21.15.110:0/1180936704 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f5406de20 con 0x7f4f5409e3b0 2024-05-09T09:46:47.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.457+0000 7f4f3b7fe640 1 -- 172.21.15.110:0/1180936704 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f440b76b0 con 0x7f4f5409e3b0 2024-05-09T09:46:47.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.457+0000 7f4f592a5640 1 -- 172.21.15.110:0/1180936704 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f541c6d20 con 0x7f4f5409e3b0 2024-05-09T09:46:47.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.457+0000 7f4f3b7fe640 1 -- 172.21.15.110:0/1180936704 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4f440be030 con 0x7f4f5409e3b0 2024-05-09T09:46:47.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.457+0000 7f4f3b7fe640 1 -- 172.21.15.110:0/1180936704 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f4f440bc070 con 0x7f4f5409e3b0 2024-05-09T09:46:47.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.457+0000 7f4f592a5640 1 -- 172.21.15.110:0/1180936704 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f54063710 con 0x7f4f5409e3b0 2024-05-09T09:46:47.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.461+0000 7f4f3b7fe640 1 -- 172.21.15.110:0/1180936704 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f4f440c5020 con 0x7f4f5409e3b0 2024-05-09T09:46:47.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.517+0000 7f4f592a5640 1 -- 172.21.15.110:0/1180936704 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f54067fd0 con 0x7f4f5409e3b0 2024-05-09T09:46:47.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.517+0000 7f4f3b7fe640 1 -- 172.21.15.110:0/1180936704 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f4f44015ff0 con 0x7f4f5409e3b0 2024-05-09T09:46:47.518 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:46:47.518 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":6,"fsid":"c05d0fe5-e814-4a03-b82b-3bb6168d5691","created":"2024-05-09T09:46:46.135865+0000","modified":"2024-05-09T09:46:47.304543+0000","last_up_change":"0.000000","last_in_change":"2024-05-09T09:46:47.304543+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c7cc58db-ea92-4134-a9e4-01f3d21592f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fe2d7e0c-75c9-471d-b77b-5f94220e23bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6fa89462-855a-422a-b215-d2076f0dfb2b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fd8da308-444c-4eaa-851d-6262904f60f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T09:46:47.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.517+0000 7f4f592a5640 1 -- 172.21.15.110:0/1180936704 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f5409e3b0 msgr2=0x7f4f541c6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:46:47.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.517+0000 7f4f592a5640 1 --2- 172.21.15.110:0/1180936704 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f5409e3b0 0x7f4f541c6610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4f44019fa0 tx=0x7f4f4401abb0 comp rx=0 tx=0).stop 2024-05-09T09:46:47.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.517+0000 7f4f592a5640 1 -- 172.21.15.110:0/1180936704 shutdown_connections 2024-05-09T09:46:47.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.517+0000 7f4f592a5640 1 --2- 172.21.15.110:0/1180936704 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f5409e3b0 0x7f4f541c6610 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:46:47.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.517+0000 7f4f592a5640 1 -- 172.21.15.110:0/1180936704 >> 172.21.15.110:0/1180936704 conn(0x7f4f540a17a0 msgr2=0x7f4f540986a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:46:47.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.521+0000 7f4f592a5640 1 -- 172.21.15.110:0/1180936704 shutdown_connections 2024-05-09T09:46:47.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:46:47.521+0000 7f4f592a5640 1 -- 172.21.15.110:0/1180936704 wait complete. 2024-05-09T09:46:47.536 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-09T09:46:47.537 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-09T09:46:47.633 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-09T09:46:47.632+0000 7f9489438180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T09:46:47.686 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-09T09:46:47.684+0000 7f9489438180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T09:46:47.738 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-09T09:46:47.736+0000 7f9489438180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T09:46:47.817 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-09T09:46:47.812+0000 7f9489438180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T09:46:47.865 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-09T09:46:47.864+0000 7f9489438180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T09:46:47.940 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-09T09:46:47.941 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-09T09:46:47.940+0000 7f9489438180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T09:46:47.942 INFO:tasks.ceph.osd.2.smithi157.stderr:2024-05-09T09:46:47.940+0000 7f4437bcd7c0 -1 Falling back to public interface 2024-05-09T09:46:47.944 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-05-09T09:46:47.945+0000 7f2d3e1bc7c0 -1 Falling back to public interface 2024-05-09T09:46:47.953 INFO:tasks.ceph.osd.1.smithi157.stderr:2024-05-09T09:46:47.952+0000 7fec139317c0 -1 Falling back to public interface 2024-05-09T09:46:47.961 INFO:tasks.ceph.osd.3.smithi157.stderr:2024-05-09T09:46:47.960+0000 7f661850d7c0 -1 Falling back to public interface 2024-05-09T09:46:47.995 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-09T09:46:47.992+0000 7f9489438180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T09:46:48.056 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.057+0000 7f38809d7640 1 Processor -- start 2024-05-09T09:46:48.056 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.057+0000 7f38809d7640 1 -- start start 2024-05-09T09:46:48.056 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.057+0000 7f38809d7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f387c12fc80 0x7f387c132070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:46:48.056 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.057+0000 7f38809d7640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f387c094680 con 0x7f387c093490 2024-05-09T09:46:48.056 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.057+0000 7f38809d7640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f387c096fe0 con 0x7f387c12fc80 2024-05-09T09:46:48.056 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.057+0000 7f3879d9b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f387c12fc80 0x7f387c132070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:46:48.057 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.057+0000 7f387a59c640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f387c093490 0x7f387c093870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:50704/0 (socket says 172.21.15.110:50704) 2024-05-09T09:46:48.057 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.057+0000 7f387a59c640 1 -- 172.21.15.110:0/1380210858 learned_addr learned my addr 172.21.15.110:0/1380210858 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:46:48.057 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.057+0000 7f3879d9b640 1 -- 172.21.15.110:0/1380210858 >> v1:172.21.15.110:6789/0 conn(0x7f387c093490 legacy=0x7f387c093870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:46:48.057 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.057+0000 7f3879d9b640 1 -- 172.21.15.110:0/1380210858 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f387c097470 con 0x7f387c12fc80 2024-05-09T09:46:48.057 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.057+0000 7f387959a640 1 -- 172.21.15.110:0/1380210858 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 633806206 0 0) 0x7f387c094680 con 0x7f387c093490 2024-05-09T09:46:48.058 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.057+0000 7f3879d9b640 1 --2- 172.21.15.110:0/1380210858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f387c12fc80 0x7f387c132070 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3870009740 tx=0x7f387001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d75e9ea7add0e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:46:48.059 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.057+0000 7f387959a640 1 -- 172.21.15.110:0/1380210858 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38700b0070 con 0x7f387c12fc80 2024-05-09T09:46:48.059 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.057+0000 7f387959a640 1 -- 172.21.15.110:0/1380210858 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38700ab530 con 0x7f387c12fc80 2024-05-09T09:46:48.059 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.057+0000 7f387959a640 1 -- 172.21.15.110:0/1380210858 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38700ab830 con 0x7f387c12fc80 2024-05-09T09:46:48.060 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.061+0000 7f38809d7640 1 -- 172.21.15.110:0/1380210858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f387c12fc80 msgr2=0x7f387c132070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:46:48.060 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.061+0000 7f38809d7640 1 --2- 172.21.15.110:0/1380210858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f387c12fc80 0x7f387c132070 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3870009740 tx=0x7f387001c370 comp rx=0 tx=0).stop 2024-05-09T09:46:48.060 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.061+0000 7f38809d7640 1 -- 172.21.15.110:0/1380210858 shutdown_connections 2024-05-09T09:46:48.060 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.061+0000 7f38809d7640 1 --2- 172.21.15.110:0/1380210858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f387c12fc80 0x7f387c132070 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:46:48.060 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.061+0000 7f38809d7640 1 -- 172.21.15.110:0/1380210858 >> 172.21.15.110:0/1380210858 conn(0x7f387c09af70 msgr2=0x7f387c09b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:46:48.060 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.061+0000 7f38809d7640 1 -- 172.21.15.110:0/1380210858 shutdown_connections 2024-05-09T09:46:48.060 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.061+0000 7f38809d7640 1 -- 172.21.15.110:0/1380210858 wait complete. 2024-05-09T09:46:48.062 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.061+0000 7f38809d7640 1 Processor -- start 2024-05-09T09:46:48.062 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.061+0000 7f38809d7640 1 -- start start 2024-05-09T09:46:48.062 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.061+0000 7f38809d7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f387c093490 0x7f387c1c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:46:48.062 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.061+0000 7f38809d7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f387c135160 con 0x7f387c093490 2024-05-09T09:46:48.062 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.061+0000 7f387a59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f387c093490 0x7f387c1c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:46:48.062 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.061+0000 7f387a59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f387c093490 0x7f387c1c63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58780/0 (socket says 172.21.15.110:58780) 2024-05-09T09:46:48.062 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.061+0000 7f387a59c640 1 -- 172.21.15.110:0/2696649673 learned_addr learned my addr 172.21.15.110:0/2696649673 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:46:48.063 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.061+0000 7f387a59c640 1 -- 172.21.15.110:0/2696649673 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f387c06edb0 con 0x7f387c093490 2024-05-09T09:46:48.063 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.061+0000 7f387a59c640 1 --2- 172.21.15.110:0/2696649673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f387c093490 0x7f387c1c63e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f386c00c420 tx=0x7f386c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:46:48.063 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.061+0000 7f386affd640 1 -- 172.21.15.110:0/2696649673 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f386c018070 con 0x7f387c093490 2024-05-09T09:46:48.063 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.061+0000 7f386affd640 1 -- 172.21.15.110:0/2696649673 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f386c0074d0 con 0x7f387c093490 2024-05-09T09:46:48.063 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.061+0000 7f38809d7640 1 -- 172.21.15.110:0/2696649673 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f387c132110 con 0x7f387c093490 2024-05-09T09:46:48.063 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.061+0000 7f386affd640 1 -- 172.21.15.110:0/2696649673 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f386c004960 con 0x7f387c093490 2024-05-09T09:46:48.063 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.061+0000 7f38809d7640 1 -- 172.21.15.110:0/2696649673 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f387c072be0 con 0x7f387c093490 2024-05-09T09:46:48.063 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.061+0000 7f386affd640 1 -- 172.21.15.110:0/2696649673 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f386c01b070 con 0x7f387c093490 2024-05-09T09:46:48.063 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.061+0000 7f386affd640 1 -- 172.21.15.110:0/2696649673 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f386c01b870 con 0x7f387c093490 2024-05-09T09:46:48.063 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.061+0000 7f38809d7640 1 -- 172.21.15.110:0/2696649673 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f387c063710 con 0x7f387c093490 2024-05-09T09:46:48.064 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.065+0000 7f386affd640 1 -- 172.21.15.110:0/2696649673 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f386c022070 con 0x7f387c093490 2024-05-09T09:46:48.121 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.121+0000 7f38809d7640 1 -- 172.21.15.110:0/2696649673 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f387c068350 con 0x7f387c093490 2024-05-09T09:46:48.122 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.121+0000 7f386affd640 1 -- 172.21.15.110:0/2696649673 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f386c004bb0 con 0x7f387c093490 2024-05-09T09:46:48.122 INFO:teuthology.misc.health.smithi110.stdout: 2024-05-09T09:46:48.122 INFO:teuthology.misc.health.smithi110.stdout:{"epoch":6,"fsid":"c05d0fe5-e814-4a03-b82b-3bb6168d5691","created":"2024-05-09T09:46:46.135865+0000","modified":"2024-05-09T09:46:47.304543+0000","last_up_change":"0.000000","last_in_change":"2024-05-09T09:46:47.304543+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c7cc58db-ea92-4134-a9e4-01f3d21592f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fe2d7e0c-75c9-471d-b77b-5f94220e23bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6fa89462-855a-422a-b215-d2076f0dfb2b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fd8da308-444c-4eaa-851d-6262904f60f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T09:46:48.123 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.125+0000 7f38809d7640 1 -- 172.21.15.110:0/2696649673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f387c093490 msgr2=0x7f387c1c63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:46:48.123 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.125+0000 7f38809d7640 1 --2- 172.21.15.110:0/2696649673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f387c093490 0x7f387c1c63e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f386c00c420 tx=0x7f386c00c8e0 comp rx=0 tx=0).stop 2024-05-09T09:46:48.123 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.125+0000 7f38809d7640 1 -- 172.21.15.110:0/2696649673 shutdown_connections 2024-05-09T09:46:48.124 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.125+0000 7f38809d7640 1 --2- 172.21.15.110:0/2696649673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f387c093490 0x7f387c1c63e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:46:48.124 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.125+0000 7f38809d7640 1 -- 172.21.15.110:0/2696649673 >> 172.21.15.110:0/2696649673 conn(0x7f387c09af70 msgr2=0x7f387c12e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:46:48.124 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.125+0000 7f38809d7640 1 -- 172.21.15.110:0/2696649673 shutdown_connections 2024-05-09T09:46:48.124 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:48.125+0000 7f38809d7640 1 -- 172.21.15.110:0/2696649673 wait complete. 2024-05-09T09:46:48.139 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-05-09T09:46:48.142 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-09T09:46:48.140+0000 7f9489438180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T09:46:48.203 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-09T09:46:48.200+0000 7f9489438180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T09:46:49.088 INFO:tasks.ceph.mgr.x.smithi157.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-09T09:46:49.088 INFO:tasks.ceph.mgr.x.smithi157.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-09T09:46:49.088 INFO:tasks.ceph.mgr.x.smithi157.stderr: from numpy import show_config as show_numpy_config 2024-05-09T09:46:49.161 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-09T09:46:49.160+0000 7f9489438180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T09:46:49.343 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-09T09:46:49.340+0000 7f9489438180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T09:46:49.525 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-09T09:46:49.524+0000 7f9489438180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T09:46:49.593 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-09T09:46:49.592+0000 7f9489438180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T09:46:49.726 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-09T09:46:49.724+0000 7f9489438180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T09:46:50.341 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-09T09:46:50.340+0000 7f9489438180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T09:46:50.415 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-09T09:46:50.412+0000 7f9489438180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T09:46:50.594 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-09T09:46:50.592+0000 7f9489438180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T09:46:50.672 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-09T09:46:50.668+0000 7f9489438180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T09:46:50.960 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-09T09:46:50.956+0000 7f9489438180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T09:46:51.034 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-09T09:46:51.032+0000 7f9489438180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T09:46:51.574 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-05-09T09:46:51.573+0000 7f2d3e1bc7c0 -1 osd.0 0 log_to_monitors true 2024-05-09T09:46:51.733 INFO:tasks.ceph.osd.3.smithi157.stderr:2024-05-09T09:46:51.732+0000 7f661850d7c0 -1 osd.3 0 log_to_monitors true 2024-05-09T09:46:51.759 INFO:tasks.ceph.osd.1.smithi157.stderr:2024-05-09T09:46:51.756+0000 7fec139317c0 -1 osd.1 0 log_to_monitors true 2024-05-09T09:46:51.796 INFO:tasks.ceph.osd.2.smithi157.stderr:2024-05-09T09:46:51.792+0000 7f4437bcd7c0 -1 osd.2 0 log_to_monitors true 2024-05-09T09:46:52.069 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-05-09T09:46:52.068+0000 7f9430881640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-05-09T09:46:54.009 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-05-09T09:46:54.009+0000 7f2d3a165640 -1 osd.0 0 waiting for initial osdmap 2024-05-09T09:46:54.028 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-05-09T09:46:54.029+0000 7f2d31f99640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T09:46:54.325 INFO:tasks.ceph.osd.1.smithi157.stderr:2024-05-09T09:46:54.324+0000 7fec0f8da640 -1 osd.1 0 waiting for initial osdmap 2024-05-09T09:46:54.325 INFO:tasks.ceph.osd.2.smithi157.stderr:2024-05-09T09:46:54.324+0000 7f4433b76640 -1 osd.2 0 waiting for initial osdmap 2024-05-09T09:46:54.341 INFO:tasks.ceph.osd.1.smithi157.stderr:2024-05-09T09:46:54.340+0000 7fec0770e640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T09:46:54.357 INFO:tasks.ceph.osd.2.smithi157.stderr:2024-05-09T09:46:54.356+0000 7f442b9aa640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T09:46:54.373 INFO:tasks.ceph.osd.3.smithi157.stderr:2024-05-09T09:46:54.372+0000 7f6614cc8640 -1 osd.3 0 waiting for initial osdmap 2024-05-09T09:46:54.397 INFO:tasks.ceph.osd.3.smithi157.stderr:2024-05-09T09:46:54.396+0000 7f660c2ea640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T09:46:54.542 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-09T09:46:54.661 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.661+0000 7fcde00bd640 1 Processor -- start 2024-05-09T09:46:54.661 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.661+0000 7fcde00bd640 1 -- start start 2024-05-09T09:46:54.661 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.661+0000 7fcde00bd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcdd812f5f0 0x7fcdd8134030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:46:54.661 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.661+0000 7fcde00bd640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdd809b240 con 0x7fcdd812eb00 2024-05-09T09:46:54.661 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.661+0000 7fcde00bd640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fcdd809b5c0 con 0x7fcdd812f5f0 2024-05-09T09:46:54.662 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.661+0000 7fcddd658640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcdd812f5f0 0x7fcdd8134030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:46:54.662 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.661+0000 7fcddde59640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fcdd812eb00 0x7fcdd812eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:60104/0 (socket says 172.21.15.110:60104) 2024-05-09T09:46:54.662 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.661+0000 7fcddde59640 1 -- 172.21.15.110:0/4055873001 learned_addr learned my addr 172.21.15.110:0/4055873001 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:46:54.662 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.661+0000 7fcddd658640 1 -- 172.21.15.110:0/4055873001 >> v1:172.21.15.110:6789/0 conn(0x7fcdd812eb00 legacy=0x7fcdd812eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:46:54.662 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.661+0000 7fcddd658640 1 -- 172.21.15.110:0/4055873001 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd809e8a0 con 0x7fcdd812f5f0 2024-05-09T09:46:54.669 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.661+0000 7fcddd658640 1 --2- 172.21.15.110:0/4055873001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdd812f5f0 0x7fcdd8134030 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0009d90 tx=0x7fcdd001c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac2edcc7c0bd37f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:46:54.669 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.661+0000 7fcddce57640 1 -- 172.21.15.110:0/4055873001 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdd00a6560 con 0x7fcdd812f5f0 2024-05-09T09:46:54.669 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.661+0000 7fcddce57640 1 -- 172.21.15.110:0/4055873001 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdd00a6700 con 0x7fcdd812f5f0 2024-05-09T09:46:54.669 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.661+0000 7fcddce57640 1 -- 172.21.15.110:0/4055873001 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdd00a6a00 con 0x7fcdd812f5f0 2024-05-09T09:46:54.669 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.665+0000 7fcde00bd640 1 -- 172.21.15.110:0/4055873001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdd812f5f0 msgr2=0x7fcdd8134030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:46:54.669 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.665+0000 7fcde00bd640 1 --2- 172.21.15.110:0/4055873001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdd812f5f0 0x7fcdd8134030 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0009d90 tx=0x7fcdd001c750 comp rx=0 tx=0).stop 2024-05-09T09:46:54.669 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.665+0000 7fcde00bd640 1 -- 172.21.15.110:0/4055873001 shutdown_connections 2024-05-09T09:46:54.670 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.665+0000 7fcde00bd640 1 --2- 172.21.15.110:0/4055873001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdd812f5f0 0x7fcdd8134030 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:46:54.670 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.665+0000 7fcde00bd640 1 -- 172.21.15.110:0/4055873001 >> 172.21.15.110:0/4055873001 conn(0x7fcdd80a1a30 msgr2=0x7fcdd809df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:46:54.670 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.665+0000 7fcde00bd640 1 -- 172.21.15.110:0/4055873001 shutdown_connections 2024-05-09T09:46:54.670 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.665+0000 7fcde00bd640 1 -- 172.21.15.110:0/4055873001 wait complete. 2024-05-09T09:46:54.670 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.665+0000 7fcde00bd640 1 Processor -- start 2024-05-09T09:46:54.670 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.665+0000 7fcde00bd640 1 -- start start 2024-05-09T09:46:54.670 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.665+0000 7fcde00bd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdd812eb00 0x7fcdd8071240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:46:54.670 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.665+0000 7fcde00bd640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd8136fa0 con 0x7fcdd812eb00 2024-05-09T09:46:54.670 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.665+0000 7fcddde59640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdd812eb00 0x7fcdd8071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:46:54.671 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.665+0000 7fcddde59640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdd812eb00 0x7fcdd8071240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57324/0 (socket says 172.21.15.110:57324) 2024-05-09T09:46:54.671 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.665+0000 7fcddde59640 1 -- 172.21.15.110:0/1448870491 learned_addr learned my addr 172.21.15.110:0/1448870491 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:46:54.671 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.665+0000 7fcddde59640 1 -- 172.21.15.110:0/1448870491 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd81279c0 con 0x7fcdd812eb00 2024-05-09T09:46:54.671 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.665+0000 7fcddde59640 1 --2- 172.21.15.110:0/1448870491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdd812eb00 0x7fcdd8071240 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcdc800c700 tx=0x7fcdc800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:46:54.671 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.665+0000 7fcdce7fc640 1 -- 172.21.15.110:0/1448870491 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc8018070 con 0x7fcdd812eb00 2024-05-09T09:46:54.671 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.665+0000 7fcdce7fc640 1 -- 172.21.15.110:0/1448870491 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc8007220 con 0x7fcdd812eb00 2024-05-09T09:46:54.671 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.665+0000 7fcde00bd640 1 -- 172.21.15.110:0/1448870491 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdd8126930 con 0x7fcdd812eb00 2024-05-09T09:46:54.671 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.665+0000 7fcdce7fc640 1 -- 172.21.15.110:0/1448870491 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc8007540 con 0x7fcdd812eb00 2024-05-09T09:46:54.672 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.665+0000 7fcde00bd640 1 -- 172.21.15.110:0/1448870491 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdd8071780 con 0x7fcdd812eb00 2024-05-09T09:46:54.672 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.665+0000 7fcde00bd640 1 -- 172.21.15.110:0/1448870491 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdd8063710 con 0x7fcdd812eb00 2024-05-09T09:46:54.672 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.665+0000 7fcdce7fc640 1 -- 172.21.15.110:0/1448870491 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) ==== 44268+0+0 (secure 0 0 0) 0x7fcdc801b070 con 0x7fcdd812eb00 2024-05-09T09:46:54.672 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.665+0000 7fcdce7fc640 1 --2- 172.21.15.110:0/1448870491 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fcdbc036280 0x7fcdbc038740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:46:54.672 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.665+0000 7fcdce7fc640 1 -- 172.21.15.110:0/1448870491 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1623+0+0 (secure 0 0 0) 0x7fcdc8047a30 con 0x7fcdd812eb00 2024-05-09T09:46:54.672 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.669+0000 7fcddd658640 1 --2- 172.21.15.110:0/1448870491 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fcdbc036280 0x7fcdbc038740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:46:54.672 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.669+0000 7fcddd658640 1 --2- 172.21.15.110:0/1448870491 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fcdbc036280 0x7fcdbc038740 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcdd00af000 tx=0x7fcdd00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:46:54.673 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.673+0000 7fcdce7fc640 1 -- 172.21.15.110:0/1448870491 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcdd81279c0 con 0x7fcdd812eb00 2024-05-09T09:46:54.835 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.833+0000 7fcde00bd640 1 -- 172.21.15.110:0/1448870491 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcdd806b600 con 0x7fcdd812eb00 2024-05-09T09:46:54.836 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.837+0000 7fcdce7fc640 1 -- 172.21.15.110:0/1448870491 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+4153 (secure 0 0 0) 0x7fcdc8010300 con 0x7fcdd812eb00 2024-05-09T09:46:54.836 INFO:teuthology.misc.health.smithi110.stdout: 2024-05-09T09:46:54.836 INFO:teuthology.misc.health.smithi110.stdout:{"epoch":8,"fsid":"c05d0fe5-e814-4a03-b82b-3bb6168d5691","created":"2024-05-09T09:46:46.135865+0000","modified":"2024-05-09T09:46:53.120657+0000","last_up_change":"0.000000","last_in_change":"2024-05-09T09:46:47.304543+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c7cc58db-ea92-4134-a9e4-01f3d21592f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fe2d7e0c-75c9-471d-b77b-5f94220e23bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6fa89462-855a-422a-b215-d2076f0dfb2b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fd8da308-444c-4eaa-851d-6262904f60f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T09:46:54.838 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.837+0000 7fcde00bd640 1 -- 172.21.15.110:0/1448870491 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fcdbc036280 msgr2=0x7fcdbc038740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:46:54.838 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.837+0000 7fcde00bd640 1 --2- 172.21.15.110:0/1448870491 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fcdbc036280 0x7fcdbc038740 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcdd00af000 tx=0x7fcdd00a7000 comp rx=0 tx=0).stop 2024-05-09T09:46:54.838 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.837+0000 7fcde00bd640 1 -- 172.21.15.110:0/1448870491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdd812eb00 msgr2=0x7fcdd8071240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:46:54.838 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.837+0000 7fcde00bd640 1 --2- 172.21.15.110:0/1448870491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdd812eb00 0x7fcdd8071240 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcdc800c700 tx=0x7fcdc800cbc0 comp rx=0 tx=0).stop 2024-05-09T09:46:54.838 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.837+0000 7fcde00bd640 1 -- 172.21.15.110:0/1448870491 shutdown_connections 2024-05-09T09:46:54.839 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.837+0000 7fcde00bd640 1 --2- 172.21.15.110:0/1448870491 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fcdbc036280 0x7fcdbc038740 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:46:54.839 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.837+0000 7fcde00bd640 1 --2- 172.21.15.110:0/1448870491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdd812eb00 0x7fcdd8071240 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:46:54.839 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.837+0000 7fcde00bd640 1 -- 172.21.15.110:0/1448870491 >> 172.21.15.110:0/1448870491 conn(0x7fcdd80a1a30 msgr2=0x7fcdd8098930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:46:54.839 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.837+0000 7fcde00bd640 1 -- 172.21.15.110:0/1448870491 shutdown_connections 2024-05-09T09:46:54.839 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:46:54.837+0000 7fcde00bd640 1 -- 172.21.15.110:0/1448870491 wait complete. 2024-05-09T09:46:54.853 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-05-09T09:47:01.258 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-09T09:47:01.378 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.377+0000 7fc8fbcbf640 1 Processor -- start 2024-05-09T09:47:01.379 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.377+0000 7fc8fbcbf640 1 -- start start 2024-05-09T09:47:01.380 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.381+0000 7fc8fbcbf640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc8f406bad0 0x7fc8f4130af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:01.380 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.381+0000 7fc8fbcbf640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8f412b880 con 0x7fc8f412baa0 2024-05-09T09:47:01.380 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.381+0000 7fc8fbcbf640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fc8f4094860 con 0x7fc8f406bad0 2024-05-09T09:47:01.380 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.381+0000 7fc8f925a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc8f406bad0 0x7fc8f4130af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:01.380 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.381+0000 7fc8f9a5b640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc8f412baa0 0x7fc8f412be80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:60106/0 (socket says 172.21.15.110:60106) 2024-05-09T09:47:01.380 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.381+0000 7fc8f9a5b640 1 -- 172.21.15.110:0/1973012985 learned_addr learned my addr 172.21.15.110:0/1973012985 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:47:01.380 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.381+0000 7fc8f925a640 1 -- 172.21.15.110:0/1973012985 >> v1:172.21.15.110:6789/0 conn(0x7fc8f412baa0 legacy=0x7fc8f412be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:01.380 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.381+0000 7fc8f925a640 1 -- 172.21.15.110:0/1973012985 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f406d9f0 con 0x7fc8f406bad0 2024-05-09T09:47:01.381 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.381+0000 7fc8f925a640 1 --2- 172.21.15.110:0/1973012985 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8f406bad0 0x7fc8f4130af0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8009740 tx=0x7fc8e801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51c8e2bd7051838 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:01.382 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.381+0000 7fc8f8a59640 1 -- 172.21.15.110:0/1973012985 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8e80b1070 con 0x7fc8f406bad0 2024-05-09T09:47:01.382 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.381+0000 7fc8f8a59640 1 -- 172.21.15.110:0/1973012985 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8e80ac520 con 0x7fc8f406bad0 2024-05-09T09:47:01.382 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.381+0000 7fc8f8a59640 1 -- 172.21.15.110:0/1973012985 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8e80ac820 con 0x7fc8f406bad0 2024-05-09T09:47:01.383 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.381+0000 7fc8fbcbf640 1 -- 172.21.15.110:0/1973012985 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8f406bad0 msgr2=0x7fc8f4130af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:01.383 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.381+0000 7fc8fbcbf640 1 --2- 172.21.15.110:0/1973012985 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8f406bad0 0x7fc8f4130af0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8009740 tx=0x7fc8e801c370 comp rx=0 tx=0).stop 2024-05-09T09:47:01.383 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.381+0000 7fc8fbcbf640 1 -- 172.21.15.110:0/1973012985 shutdown_connections 2024-05-09T09:47:01.383 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.381+0000 7fc8fbcbf640 1 --2- 172.21.15.110:0/1973012985 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8f406bad0 0x7fc8f4130af0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:01.383 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.381+0000 7fc8fbcbf640 1 -- 172.21.15.110:0/1973012985 >> 172.21.15.110:0/1973012985 conn(0x7fc8f409af70 msgr2=0x7fc8f409b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:01.383 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.381+0000 7fc8fbcbf640 1 -- 172.21.15.110:0/1973012985 shutdown_connections 2024-05-09T09:47:01.383 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.381+0000 7fc8fbcbf640 1 -- 172.21.15.110:0/1973012985 wait complete. 2024-05-09T09:47:01.383 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.385+0000 7fc8fbcbf640 1 Processor -- start 2024-05-09T09:47:01.384 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.385+0000 7fc8fbcbf640 1 -- start start 2024-05-09T09:47:01.385 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.385+0000 7fc8fbcbf640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8f406bad0 0x7fc8f4071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:01.385 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.385+0000 7fc8fbcbf640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f4133cd0 con 0x7fc8f406bad0 2024-05-09T09:47:01.385 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.385+0000 7fc8f9a5b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8f406bad0 0x7fc8f4071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:01.385 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.385+0000 7fc8f9a5b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8f406bad0 0x7fc8f4071bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57340/0 (socket says 172.21.15.110:57340) 2024-05-09T09:47:01.385 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.385+0000 7fc8f9a5b640 1 -- 172.21.15.110:0/4158971475 learned_addr learned my addr 172.21.15.110:0/4158971475 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:01.385 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.385+0000 7fc8f9a5b640 1 -- 172.21.15.110:0/4158971475 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f41308a0 con 0x7fc8f406bad0 2024-05-09T09:47:01.385 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.385+0000 7fc8f9a5b640 1 --2- 172.21.15.110:0/4158971475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8f406bad0 0x7fc8f4071bb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec00cb20 tx=0x7fc8ec00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:01.385 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.385+0000 7fc8f27fc640 1 -- 172.21.15.110:0/4158971475 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8ec017070 con 0x7fc8f406bad0 2024-05-09T09:47:01.385 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.385+0000 7fc8f27fc640 1 -- 172.21.15.110:0/4158971475 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8ec00abf0 con 0x7fc8f406bad0 2024-05-09T09:47:01.385 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.385+0000 7fc8fbcbf640 1 -- 172.21.15.110:0/4158971475 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8f4095060 con 0x7fc8f406bad0 2024-05-09T09:47:01.386 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.385+0000 7fc8f27fc640 1 -- 172.21.15.110:0/4158971475 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8ec012400 con 0x7fc8f406bad0 2024-05-09T09:47:01.386 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.385+0000 7fc8fbcbf640 1 -- 172.21.15.110:0/4158971475 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8f41253e0 con 0x7fc8f406bad0 2024-05-09T09:47:01.386 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.385+0000 7fc8fbcbf640 1 -- 172.21.15.110:0/4158971475 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8f4063710 con 0x7fc8f406bad0 2024-05-09T09:47:01.387 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.385+0000 7fc8f27fc640 1 -- 172.21.15.110:0/4158971475 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fc8ec01a070 con 0x7fc8f406bad0 2024-05-09T09:47:01.387 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.385+0000 7fc8f27fc640 1 --2- 172.21.15.110:0/4158971475 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc8e0036310 0x7fc8e00387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:01.387 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.385+0000 7fc8f27fc640 1 -- 172.21.15.110:0/4158971475 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3129+0+0 (secure 0 0 0) 0x7fc8ec0488f0 con 0x7fc8f406bad0 2024-05-09T09:47:01.387 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.389+0000 7fc8f925a640 1 --2- 172.21.15.110:0/4158971475 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc8e0036310 0x7fc8e00387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:01.387 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.389+0000 7fc8f925a640 1 --2- 172.21.15.110:0/4158971475 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc8e0036310 0x7fc8e00387d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc8e80ae000 tx=0x7fc8e8004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:01.391 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.393+0000 7fc8f27fc640 1 -- 172.21.15.110:0/4158971475 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc8ec0078c0 con 0x7fc8f406bad0 2024-05-09T09:47:01.553 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.553+0000 7fc8fbcbf640 1 -- 172.21.15.110:0/4158971475 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8f4124740 con 0x7fc8f406bad0 2024-05-09T09:47:01.554 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.553+0000 7fc8f27fc640 1 -- 172.21.15.110:0/4158971475 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7975 (secure 0 0 0) 0x7fc8ec007aa0 con 0x7fc8f406bad0 2024-05-09T09:47:01.554 INFO:teuthology.misc.health.smithi110.stdout: 2024-05-09T09:47:01.555 INFO:teuthology.misc.health.smithi110.stdout:{"epoch":12,"fsid":"c05d0fe5-e814-4a03-b82b-3bb6168d5691","created":"2024-05-09T09:46:46.135865+0000","modified":"2024-05-09T09:46:58.020867+0000","last_up_change":"2024-05-09T09:46:55.013992+0000","last_in_change":"2024-05-09T09:46:47.304543+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T09:46:55.113740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7cc58db-ea92-4134-a9e4-01f3d21592f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":231209037},{"type":"v1","addr":"172.21.15.110:6801","nonce":231209037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":231209037},{"type":"v1","addr":"172.21.15.110:6803","nonce":231209037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":231209037},{"type":"v1","addr":"172.21.15.110:6807","nonce":231209037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":231209037},{"type":"v1","addr":"172.21.15.110:6805","nonce":231209037}]},"public_addr":"172.21.15.110:6801/231209037","cluster_addr":"172.21.15.110:6803/231209037","heartbeat_back_addr":"172.21.15.110:6807/231209037","heartbeat_front_addr":"172.21.15.110:6805/231209037","state":["exists","up"]},{"osd":1,"uuid":"fe2d7e0c-75c9-471d-b77b-5f94220e23bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3930131338},{"type":"v1","addr":"172.21.15.157:6809","nonce":3930131338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3930131338},{"type":"v1","addr":"172.21.15.157:6811","nonce":3930131338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3930131338},{"type":"v1","addr":"172.21.15.157:6815","nonce":3930131338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3930131338},{"type":"v1","addr":"172.21.15.157:6813","nonce":3930131338}]},"public_addr":"172.21.15.157:6809/3930131338","cluster_addr":"172.21.15.157:6811/3930131338","heartbeat_back_addr":"172.21.15.157:6815/3930131338","heartbeat_front_addr":"172.21.15.157:6813/3930131338","state":["exists","up"]},{"osd":2,"uuid":"6fa89462-855a-422a-b215-d2076f0dfb2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":354455204},{"type":"v1","addr":"172.21.15.157:6801","nonce":354455204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":354455204},{"type":"v1","addr":"172.21.15.157:6803","nonce":354455204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":354455204},{"type":"v1","addr":"172.21.15.157:6807","nonce":354455204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":354455204},{"type":"v1","addr":"172.21.15.157:6805","nonce":354455204}]},"public_addr":"172.21.15.157:6801/354455204","cluster_addr":"172.21.15.157:6803/354455204","heartbeat_back_addr":"172.21.15.157:6807/354455204","heartbeat_front_addr":"172.21.15.157:6805/354455204","state":["exists","up"]},{"osd":3,"uuid":"fd8da308-444c-4eaa-851d-6262904f60f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":2487336710},{"type":"v1","addr":"172.21.15.157:6817","nonce":2487336710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":2487336710},{"type":"v1","addr":"172.21.15.157:6819","nonce":2487336710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":2487336710},{"type":"v1","addr":"172.21.15.157:6823","nonce":2487336710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":2487336710},{"type":"v1","addr":"172.21.15.157:6821","nonce":2487336710}]},"public_addr":"172.21.15.157:6817/2487336710","cluster_addr":"172.21.15.157:6819/2487336710","heartbeat_back_addr":"172.21.15.157:6823/2487336710","heartbeat_front_addr":"172.21.15.157:6821/2487336710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:46:52.614027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:46:52.731468+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:46:52.830714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:46:52.693601+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T09:47:01.557 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.557+0000 7fc8fbcbf640 1 -- 172.21.15.110:0/4158971475 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc8e0036310 msgr2=0x7fc8e00387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:01.557 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.557+0000 7fc8fbcbf640 1 --2- 172.21.15.110:0/4158971475 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc8e0036310 0x7fc8e00387d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc8e80ae000 tx=0x7fc8e8004740 comp rx=0 tx=0).stop 2024-05-09T09:47:01.557 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.557+0000 7fc8fbcbf640 1 -- 172.21.15.110:0/4158971475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8f406bad0 msgr2=0x7fc8f4071bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:01.557 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.557+0000 7fc8fbcbf640 1 --2- 172.21.15.110:0/4158971475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8f406bad0 0x7fc8f4071bb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec00cb20 tx=0x7fc8ec00a060 comp rx=0 tx=0).stop 2024-05-09T09:47:01.557 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.557+0000 7fc8fbcbf640 1 -- 172.21.15.110:0/4158971475 shutdown_connections 2024-05-09T09:47:01.557 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.557+0000 7fc8fbcbf640 1 --2- 172.21.15.110:0/4158971475 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc8e0036310 0x7fc8e00387d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:01.557 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.557+0000 7fc8fbcbf640 1 --2- 172.21.15.110:0/4158971475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8f406bad0 0x7fc8f4071bb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:01.557 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.557+0000 7fc8fbcbf640 1 -- 172.21.15.110:0/4158971475 >> 172.21.15.110:0/4158971475 conn(0x7fc8f409af70 msgr2=0x7fc8f412a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:01.557 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.557+0000 7fc8fbcbf640 1 -- 172.21.15.110:0/4158971475 shutdown_connections 2024-05-09T09:47:01.557 INFO:teuthology.misc.health.smithi110.stderr:2024-05-09T09:47:01.557+0000 7fc8fbcbf640 1 -- 172.21.15.110:0/4158971475 wait complete. 2024-05-09T09:47:01.573 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-05-09T09:47:01.573 INFO:tasks.ceph:Creating RBD pool 2024-05-09T09:47:01.573 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd pool create rbd 8 2024-05-09T09:47:01.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.685+0000 7f18f3870640 1 Processor -- start 2024-05-09T09:47:01.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.689+0000 7f18f3870640 1 -- start start 2024-05-09T09:47:01.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.689+0000 7f18f3870640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f18ec09a310 0x7f18ec134090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:01.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.689+0000 7f18f3870640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18ec09e780 con 0x7f18ec099820 2024-05-09T09:47:01.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.689+0000 7f18f3870640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f18ec09b230 con 0x7f18ec09a310 2024-05-09T09:47:01.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.689+0000 7f18f160c640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f18ec099820 0x7f18ec099c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:60120/0 (socket says 172.21.15.110:60120) 2024-05-09T09:47:01.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.689+0000 7f18f160c640 1 -- 172.21.15.110:0/1154607710 learned_addr learned my addr 172.21.15.110:0/1154607710 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:47:01.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.689+0000 7f18f0e0b640 1 --2- 172.21.15.110:0/1154607710 >> v2:172.21.15.110:3300/0 conn(0x7f18ec09a310 0x7f18ec134090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:01.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.689+0000 7f18e3fff640 1 -- 172.21.15.110:0/1154607710 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2674235751 0 0) 0x7f18ec09e780 con 0x7f18ec099820 2024-05-09T09:47:01.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.689+0000 7f18e3fff640 1 -- 172.21.15.110:0/1154607710 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18d8003530 con 0x7f18ec099820 2024-05-09T09:47:01.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.689+0000 7f18f0e0b640 1 -- 172.21.15.110:0/1154607710 >> v1:172.21.15.110:6789/0 conn(0x7f18ec099820 legacy=0x7f18ec099c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:01.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.689+0000 7f18f0e0b640 1 -- 172.21.15.110:0/1154607710 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18ec09a960 con 0x7f18ec09a310 2024-05-09T09:47:01.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.689+0000 7f18f0e0b640 1 --2- 172.21.15.110:0/1154607710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18ec09a310 0x7f18ec134090 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f18e8009740 tx=0x7f18e801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=169c57d38a22f67b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:01.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.689+0000 7f18e3fff640 1 -- 172.21.15.110:0/1154607710 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18e80b0070 con 0x7f18ec09a310 2024-05-09T09:47:01.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.689+0000 7f18e3fff640 1 -- 172.21.15.110:0/1154607710 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18e80ab530 con 0x7f18ec09a310 2024-05-09T09:47:01.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.689+0000 7f18e3fff640 1 -- 172.21.15.110:0/1154607710 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18e80ab810 con 0x7f18ec09a310 2024-05-09T09:47:01.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.693+0000 7f18f3870640 1 -- 172.21.15.110:0/1154607710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18ec09a310 msgr2=0x7f18ec134090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:01.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.693+0000 7f18f3870640 1 --2- 172.21.15.110:0/1154607710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18ec09a310 0x7f18ec134090 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f18e8009740 tx=0x7f18e801c370 comp rx=0 tx=0).stop 2024-05-09T09:47:01.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.693+0000 7f18f3870640 1 -- 172.21.15.110:0/1154607710 shutdown_connections 2024-05-09T09:47:01.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.693+0000 7f18f3870640 1 --2- 172.21.15.110:0/1154607710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18ec09a310 0x7f18ec134090 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:01.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.693+0000 7f18f3870640 1 -- 172.21.15.110:0/1154607710 >> 172.21.15.110:0/1154607710 conn(0x7f18ec0a1910 msgr2=0x7f18ec09de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:01.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.693+0000 7f18f3870640 1 -- 172.21.15.110:0/1154607710 shutdown_connections 2024-05-09T09:47:01.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.693+0000 7f18f3870640 1 -- 172.21.15.110:0/1154607710 wait complete. 2024-05-09T09:47:01.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.693+0000 7f18f3870640 1 Processor -- start 2024-05-09T09:47:01.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.693+0000 7f18f3870640 1 -- start start 2024-05-09T09:47:01.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.693+0000 7f18f3870640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18ec099820 0x7f18ec1c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:01.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.693+0000 7f18f3870640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f18ec137180 con 0x7f18ec099820 2024-05-09T09:47:01.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.693+0000 7f18f160c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18ec099820 0x7f18ec1c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:01.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.693+0000 7f18f160c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18ec099820 0x7f18ec1c65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57362/0 (socket says 172.21.15.110:57362) 2024-05-09T09:47:01.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.693+0000 7f18f160c640 1 -- 172.21.15.110:0/4129550050 learned_addr learned my addr 172.21.15.110:0/4129550050 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:01.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.693+0000 7f18f160c640 1 -- 172.21.15.110:0/4129550050 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18ec072d60 con 0x7f18ec099820 2024-05-09T09:47:01.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.693+0000 7f18f160c640 1 --2- 172.21.15.110:0/4129550050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18ec099820 0x7f18ec1c65b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f18dc00c3d0 tx=0x7f18dc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:01.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.693+0000 7f18e1ffb640 1 -- 172.21.15.110:0/4129550050 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18dc017070 con 0x7f18ec099820 2024-05-09T09:47:01.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.693+0000 7f18e1ffb640 1 -- 172.21.15.110:0/4129550050 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18dc005ce0 con 0x7f18ec099820 2024-05-09T09:47:01.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.693+0000 7f18f3870640 1 -- 172.21.15.110:0/4129550050 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18ec129890 con 0x7f18ec099820 2024-05-09T09:47:01.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.693+0000 7f18e1ffb640 1 -- 172.21.15.110:0/4129550050 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18dc0070d0 con 0x7f18ec099820 2024-05-09T09:47:01.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.693+0000 7f18f3870640 1 -- 172.21.15.110:0/4129550050 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18ec12a290 con 0x7f18ec099820 2024-05-09T09:47:01.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.693+0000 7f18e1ffb640 1 -- 172.21.15.110:0/4129550050 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f18dc01a070 con 0x7f18ec099820 2024-05-09T09:47:01.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.693+0000 7f18f3870640 1 -- 172.21.15.110:0/4129550050 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18ec129c40 con 0x7f18ec099820 2024-05-09T09:47:01.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.693+0000 7f18e1ffb640 1 --2- 172.21.15.110:0/4129550050 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f18d0036310 0x7f18d00387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:01.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.693+0000 7f18e1ffb640 1 -- 172.21.15.110:0/4129550050 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3129+0+0 (secure 0 0 0) 0x7f18dc047ff0 con 0x7f18ec099820 2024-05-09T09:47:01.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.697+0000 7f18f0e0b640 1 --2- 172.21.15.110:0/4129550050 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f18d0036310 0x7f18d00387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:01.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.697+0000 7f18f0e0b640 1 --2- 172.21.15.110:0/4129550050 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f18d0036310 0x7f18d00387d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f18e8009740 tx=0x7f18e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:01.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.701+0000 7f18e1ffb640 1 -- 172.21.15.110:0/4129550050 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f18dc019e10 con 0x7f18ec099820 2024-05-09T09:47:01.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:01.853+0000 7f18f3870640 1 -- 172.21.15.110:0/4129550050 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f18ec12ad70 con 0x7f18ec099820 2024-05-09T09:47:02.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.033+0000 7f18e1ffb640 1 -- 172.21.15.110:0/4129550050 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) ==== 109+0+0 (secure 0 0 0) 0x7f18dc01b8d0 con 0x7f18ec099820 2024-05-09T09:47:02.033 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'rbd' created 2024-05-09T09:47:02.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.037+0000 7f18f3870640 1 -- 172.21.15.110:0/4129550050 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f18d0036310 msgr2=0x7f18d00387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:02.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.037+0000 7f18f3870640 1 --2- 172.21.15.110:0/4129550050 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f18d0036310 0x7f18d00387d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f18e8009740 tx=0x7f18e8008040 comp rx=0 tx=0).stop 2024-05-09T09:47:02.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.037+0000 7f18f3870640 1 -- 172.21.15.110:0/4129550050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18ec099820 msgr2=0x7f18ec1c65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:02.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.037+0000 7f18f3870640 1 --2- 172.21.15.110:0/4129550050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18ec099820 0x7f18ec1c65b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f18dc00c3d0 tx=0x7f18dc00c890 comp rx=0 tx=0).stop 2024-05-09T09:47:02.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.037+0000 7f18f3870640 1 -- 172.21.15.110:0/4129550050 shutdown_connections 2024-05-09T09:47:02.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.037+0000 7f18f3870640 1 --2- 172.21.15.110:0/4129550050 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f18d0036310 0x7f18d00387d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:02.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.037+0000 7f18f3870640 1 --2- 172.21.15.110:0/4129550050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18ec099820 0x7f18ec1c65b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:02.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.037+0000 7f18f3870640 1 -- 172.21.15.110:0/4129550050 >> 172.21.15.110:0/4129550050 conn(0x7f18ec0a1910 msgr2=0x7f18ec09bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:02.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.037+0000 7f18f3870640 1 -- 172.21.15.110:0/4129550050 shutdown_connections 2024-05-09T09:47:02.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.037+0000 7f18f3870640 1 -- 172.21.15.110:0/4129550050 wait complete. 2024-05-09T09:47:02.051 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-05-09T09:47:02.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.165+0000 7fb30eb09640 1 Processor -- start 2024-05-09T09:47:02.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.165+0000 7fb30eb09640 1 -- start start 2024-05-09T09:47:02.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.165+0000 7fb30eb09640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb308094f60 0x7fb308131db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:02.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.165+0000 7fb30eb09640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb308096d00 con 0x7fb308094470 2024-05-09T09:47:02.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.165+0000 7fb30eb09640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fb308096960 con 0x7fb308094f60 2024-05-09T09:47:02.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.165+0000 7fb30c8a5640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fb308094470 0x7fb308094850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41126/0 (socket says 172.21.15.110:41126) 2024-05-09T09:47:02.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.165+0000 7fb30c8a5640 1 -- 172.21.15.110:0/3580265550 learned_addr learned my addr 172.21.15.110:0/3580265550 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:47:02.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.165+0000 7fb307fff640 1 --2- 172.21.15.110:0/3580265550 >> v2:172.21.15.110:3300/0 conn(0x7fb308094f60 0x7fb308131db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:02.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.165+0000 7fb307fff640 1 -- 172.21.15.110:0/3580265550 >> v1:172.21.15.110:6789/0 conn(0x7fb308094470 legacy=0x7fb308094850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:02.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.165+0000 7fb307fff640 1 -- 172.21.15.110:0/3580265550 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb308096f80 con 0x7fb308094f60 2024-05-09T09:47:02.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.169+0000 7fb307fff640 1 --2- 172.21.15.110:0/3580265550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb308094f60 0x7fb308131db0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8009740 tx=0x7fb2f801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13cef413a0b8de1b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:02.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.169+0000 7fb3077fe640 1 -- 172.21.15.110:0/3580265550 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2f80b1070 con 0x7fb308094f60 2024-05-09T09:47:02.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.169+0000 7fb3077fe640 1 -- 172.21.15.110:0/3580265550 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2f80ac520 con 0x7fb308094f60 2024-05-09T09:47:02.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.169+0000 7fb3077fe640 1 -- 172.21.15.110:0/3580265550 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2f80ac820 con 0x7fb308094f60 2024-05-09T09:47:02.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.169+0000 7fb30eb09640 1 -- 172.21.15.110:0/3580265550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb308094f60 msgr2=0x7fb308131db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:02.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.169+0000 7fb30eb09640 1 --2- 172.21.15.110:0/3580265550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb308094f60 0x7fb308131db0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8009740 tx=0x7fb2f801c370 comp rx=0 tx=0).stop 2024-05-09T09:47:02.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.169+0000 7fb30eb09640 1 -- 172.21.15.110:0/3580265550 shutdown_connections 2024-05-09T09:47:02.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.169+0000 7fb30eb09640 1 --2- 172.21.15.110:0/3580265550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb308094f60 0x7fb308131db0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:02.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.169+0000 7fb30eb09640 1 -- 172.21.15.110:0/3580265550 >> 172.21.15.110:0/3580265550 conn(0x7fb30809a070 msgr2=0x7fb308097970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:02.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.169+0000 7fb30eb09640 1 -- 172.21.15.110:0/3580265550 shutdown_connections 2024-05-09T09:47:02.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.169+0000 7fb30eb09640 1 -- 172.21.15.110:0/3580265550 wait complete. 2024-05-09T09:47:02.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.169+0000 7fb30eb09640 1 Processor -- start 2024-05-09T09:47:02.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.169+0000 7fb30eb09640 1 -- start start 2024-05-09T09:47:02.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.169+0000 7fb30eb09640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb308094470 0x7fb3081c4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:02.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.169+0000 7fb30eb09640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb308134c90 con 0x7fb308094470 2024-05-09T09:47:02.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.169+0000 7fb30c8a5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb308094470 0x7fb3081c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:02.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.169+0000 7fb30c8a5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb308094470 0x7fb3081c4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59392/0 (socket says 172.21.15.110:59392) 2024-05-09T09:47:02.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.169+0000 7fb30c8a5640 1 -- 172.21.15.110:0/4070500763 learned_addr learned my addr 172.21.15.110:0/4070500763 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:02.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.173+0000 7fb30c8a5640 1 -- 172.21.15.110:0/4070500763 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb308122310 con 0x7fb308094470 2024-05-09T09:47:02.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.173+0000 7fb30c8a5640 1 --2- 172.21.15.110:0/4070500763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb308094470 0x7fb3081c4770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc00c480 tx=0x7fb2fc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:02.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.173+0000 7fb3057fa640 1 -- 172.21.15.110:0/4070500763 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2fc017070 con 0x7fb308094470 2024-05-09T09:47:02.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.173+0000 7fb3057fa640 1 -- 172.21.15.110:0/4070500763 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2fc005c20 con 0x7fb308094470 2024-05-09T09:47:02.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.173+0000 7fb30eb09640 1 -- 172.21.15.110:0/4070500763 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb308122750 con 0x7fb308094470 2024-05-09T09:47:02.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.173+0000 7fb3057fa640 1 -- 172.21.15.110:0/4070500763 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2fc007070 con 0x7fb308094470 2024-05-09T09:47:02.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.173+0000 7fb30eb09640 1 -- 172.21.15.110:0/4070500763 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb308131500 con 0x7fb308094470 2024-05-09T09:47:02.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.173+0000 7fb30eb09640 1 -- 172.21.15.110:0/4070500763 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb308131790 con 0x7fb308094470 2024-05-09T09:47:02.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.173+0000 7fb3057fa640 1 -- 172.21.15.110:0/4070500763 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fb2fc01a070 con 0x7fb308094470 2024-05-09T09:47:02.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.173+0000 7fb3057fa640 1 --2- 172.21.15.110:0/4070500763 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb2f4036310 0x7fb2f40387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:02.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.173+0000 7fb3057fa640 1 -- 172.21.15.110:0/4070500763 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3471+0+0 (secure 0 0 0) 0x7fb2fc047fa0 con 0x7fb308094470 2024-05-09T09:47:02.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.173+0000 7fb307fff640 1 --2- 172.21.15.110:0/4070500763 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb2f4036310 0x7fb2f40387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:02.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.173+0000 7fb307fff640 1 --2- 172.21.15.110:0/4070500763 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb2f4036310 0x7fb2f40387d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb2f80ae000 tx=0x7fb2f80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:02.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.177+0000 7fb3057fa640 1 -- 172.21.15.110:0/4070500763 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb308131790 con 0x7fb308094470 2024-05-09T09:47:02.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:02.325+0000 7fb30eb09640 1 -- 172.21.15.110:0/4070500763 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) -- 0x7fb308063710 con 0x7fb308094470 2024-05-09T09:47:03.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.037+0000 7fb3057fa640 1 -- 172.21.15.110:0/4070500763 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v14) ==== 173+0+0 (secure 0 0 0) 0x7fb308122310 con 0x7fb308094470 2024-05-09T09:47:03.038 INFO:teuthology.orchestra.run.smithi110.stderr:enabled application 'rbd' on pool 'rbd' 2024-05-09T09:47:03.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.041+0000 7fb30eb09640 1 -- 172.21.15.110:0/4070500763 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb2f4036310 msgr2=0x7fb2f40387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:03.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.041+0000 7fb30eb09640 1 --2- 172.21.15.110:0/4070500763 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb2f4036310 0x7fb2f40387d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb2f80ae000 tx=0x7fb2f80a7000 comp rx=0 tx=0).stop 2024-05-09T09:47:03.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.041+0000 7fb30eb09640 1 -- 172.21.15.110:0/4070500763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb308094470 msgr2=0x7fb3081c4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:03.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.041+0000 7fb30eb09640 1 --2- 172.21.15.110:0/4070500763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb308094470 0x7fb3081c4770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc00c480 tx=0x7fb2fc00c940 comp rx=0 tx=0).stop 2024-05-09T09:47:03.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.041+0000 7fb30eb09640 1 -- 172.21.15.110:0/4070500763 shutdown_connections 2024-05-09T09:47:03.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.041+0000 7fb30eb09640 1 --2- 172.21.15.110:0/4070500763 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb2f4036310 0x7fb2f40387d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:03.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.041+0000 7fb30eb09640 1 --2- 172.21.15.110:0/4070500763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb308094470 0x7fb3081c4770 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:03.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.041+0000 7fb30eb09640 1 -- 172.21.15.110:0/4070500763 >> 172.21.15.110:0/4070500763 conn(0x7fb30809a070 msgr2=0x7fb30809b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:03.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.041+0000 7fb30eb09640 1 -- 172.21.15.110:0/4070500763 shutdown_connections 2024-05-09T09:47:03.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.041+0000 7fb30eb09640 1 -- 172.21.15.110:0/4070500763 wait complete. 2024-05-09T09:47:03.065 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-09T09:47:03.065 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-09T09:47:03.065 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-09T09:47:03.066 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-09T09:47:03.066 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-09T09:47:03.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.185+0000 7f63d294d640 1 Processor -- start 2024-05-09T09:47:03.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.185+0000 7f63d294d640 1 -- start start 2024-05-09T09:47:03.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.189+0000 7f63d294d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f63cc12c380 0x7f63cc134040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:03.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.189+0000 7f63d294d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63cc12b820 con 0x7f63cc09e3b0 2024-05-09T09:47:03.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.189+0000 7f63d294d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f63cc0a0fc0 con 0x7f63cc12c380 2024-05-09T09:47:03.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.189+0000 7f63cb7fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f63cc12c380 0x7f63cc134040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:03.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.189+0000 7f63cbfff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f63cc09e3b0 0x7f63cc12bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41138/0 (socket says 172.21.15.110:41138) 2024-05-09T09:47:03.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.189+0000 7f63cbfff640 1 -- 172.21.15.110:0/705090281 learned_addr learned my addr 172.21.15.110:0/705090281 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:47:03.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.189+0000 7f63cb7fe640 1 -- 172.21.15.110:0/705090281 >> v1:172.21.15.110:6789/0 conn(0x7f63cc09e3b0 legacy=0x7f63cc12bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:03.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.189+0000 7f63cb7fe640 1 -- 172.21.15.110:0/705090281 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63cc09b5f0 con 0x7f63cc12c380 2024-05-09T09:47:03.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.189+0000 7f63cb7fe640 1 --2- 172.21.15.110:0/705090281 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63cc12c380 0x7f63cc134040 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f63b4009d90 tx=0x7f63b401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484ca5b79ef61e4d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:03.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.189+0000 7f63caffd640 1 -- 172.21.15.110:0/705090281 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63b40b2070 con 0x7f63cc12c380 2024-05-09T09:47:03.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.189+0000 7f63caffd640 1 -- 172.21.15.110:0/705090281 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63b40a5740 con 0x7f63cc12c380 2024-05-09T09:47:03.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.189+0000 7f63caffd640 1 -- 172.21.15.110:0/705090281 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63b40a5a40 con 0x7f63cc12c380 2024-05-09T09:47:03.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.189+0000 7f63d294d640 1 -- 172.21.15.110:0/705090281 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63cc12c380 msgr2=0x7f63cc134040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:03.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.189+0000 7f63d294d640 1 --2- 172.21.15.110:0/705090281 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63cc12c380 0x7f63cc134040 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f63b4009d90 tx=0x7f63b401c8c0 comp rx=0 tx=0).stop 2024-05-09T09:47:03.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.189+0000 7f63d294d640 1 -- 172.21.15.110:0/705090281 shutdown_connections 2024-05-09T09:47:03.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.189+0000 7f63d294d640 1 --2- 172.21.15.110:0/705090281 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63cc12c380 0x7f63cc134040 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:03.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.189+0000 7f63d294d640 1 -- 172.21.15.110:0/705090281 >> 172.21.15.110:0/705090281 conn(0x7f63cc0a17a0 msgr2=0x7f63cc09dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:03.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.189+0000 7f63d294d640 1 -- 172.21.15.110:0/705090281 shutdown_connections 2024-05-09T09:47:03.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.189+0000 7f63d294d640 1 -- 172.21.15.110:0/705090281 wait complete. 2024-05-09T09:47:03.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.193+0000 7f63d294d640 1 Processor -- start 2024-05-09T09:47:03.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.193+0000 7f63d294d640 1 -- start start 2024-05-09T09:47:03.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.193+0000 7f63d294d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63cc09e3b0 0x7f63cc132090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:03.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.193+0000 7f63d294d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f63cc137130 con 0x7f63cc09e3b0 2024-05-09T09:47:03.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.193+0000 7f63cbfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63cc09e3b0 0x7f63cc132090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:03.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.193+0000 7f63cbfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63cc09e3b0 0x7f63cc132090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59424/0 (socket says 172.21.15.110:59424) 2024-05-09T09:47:03.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.193+0000 7f63cbfff640 1 -- 172.21.15.110:0/3093194379 learned_addr learned my addr 172.21.15.110:0/3093194379 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:03.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.193+0000 7f63cbfff640 1 -- 172.21.15.110:0/3093194379 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63cc06da20 con 0x7f63cc09e3b0 2024-05-09T09:47:03.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.193+0000 7f63cbfff640 1 --2- 172.21.15.110:0/3093194379 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63cc09e3b0 0x7f63cc132090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f63c400c380 tx=0x7f63c400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:03.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.193+0000 7f63c8ff9640 1 -- 172.21.15.110:0/3093194379 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63c4017070 con 0x7f63cc09e3b0 2024-05-09T09:47:03.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.193+0000 7f63c8ff9640 1 -- 172.21.15.110:0/3093194379 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63c4005c20 con 0x7f63cc09e3b0 2024-05-09T09:47:03.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.193+0000 7f63d294d640 1 -- 172.21.15.110:0/3093194379 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63cc1325d0 con 0x7f63cc09e3b0 2024-05-09T09:47:03.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.193+0000 7f63c8ff9640 1 -- 172.21.15.110:0/3093194379 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63c40070d0 con 0x7f63cc09e3b0 2024-05-09T09:47:03.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.193+0000 7f63d294d640 1 -- 172.21.15.110:0/3093194379 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63cc132a90 con 0x7f63cc09e3b0 2024-05-09T09:47:03.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.193+0000 7f63d294d640 1 -- 172.21.15.110:0/3093194379 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63cc133200 con 0x7f63cc09e3b0 2024-05-09T09:47:03.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.193+0000 7f63c8ff9640 1 -- 172.21.15.110:0/3093194379 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f63c401a070 con 0x7f63cc09e3b0 2024-05-09T09:47:03.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.193+0000 7f63c8ff9640 1 --2- 172.21.15.110:0/3093194379 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f63ac036310 0x7f63ac0387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:03.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.193+0000 7f63c8ff9640 1 -- 172.21.15.110:0/3093194379 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3482+0+0 (secure 0 0 0) 0x7f63c4047fd0 con 0x7f63cc09e3b0 2024-05-09T09:47:03.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.193+0000 7f63cb7fe640 1 --2- 172.21.15.110:0/3093194379 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f63ac036310 0x7f63ac0387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:03.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.193+0000 7f63cb7fe640 1 --2- 172.21.15.110:0/3093194379 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f63ac036310 0x7f63ac0387d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f63b40af000 tx=0x7f63b40a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:03.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.197+0000 7f63c8ff9640 1 -- 172.21.15.110:0/3093194379 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f63c4007270 con 0x7f63cc09e3b0 2024-05-09T09:47:03.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.401+0000 7f63d294d640 1 -- 172.21.15.110:0/3093194379 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f63cc132cc0 con 0x7f63cc09e3b0 2024-05-09T09:47:03.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.405+0000 7f63c8ff9640 1 -- 172.21.15.110:0/3093194379 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+84780 (secure 0 0 0) 0x7f63c401b3b0 con 0x7f63cc09e3b0 2024-05-09T09:47:03.404 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:47:03.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.405+0000 7f63d294d640 1 -- 172.21.15.110:0/3093194379 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f63ac036310 msgr2=0x7f63ac0387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:03.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.405+0000 7f63d294d640 1 --2- 172.21.15.110:0/3093194379 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f63ac036310 0x7f63ac0387d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f63b40af000 tx=0x7f63b40a7070 comp rx=0 tx=0).stop 2024-05-09T09:47:03.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.405+0000 7f63d294d640 1 -- 172.21.15.110:0/3093194379 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63cc09e3b0 msgr2=0x7f63cc132090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:03.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.405+0000 7f63d294d640 1 --2- 172.21.15.110:0/3093194379 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63cc09e3b0 0x7f63cc132090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f63c400c380 tx=0x7f63c400c840 comp rx=0 tx=0).stop 2024-05-09T09:47:03.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.405+0000 7f63d294d640 1 -- 172.21.15.110:0/3093194379 shutdown_connections 2024-05-09T09:47:03.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.405+0000 7f63d294d640 1 --2- 172.21.15.110:0/3093194379 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f63ac036310 0x7f63ac0387d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:03.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.405+0000 7f63d294d640 1 --2- 172.21.15.110:0/3093194379 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63cc09e3b0 0x7f63cc132090 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:03.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.405+0000 7f63d294d640 1 -- 172.21.15.110:0/3093194379 >> 172.21.15.110:0/3093194379 conn(0x7f63cc0a17a0 msgr2=0x7f63cc0986a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:03.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.405+0000 7f63d294d640 1 -- 172.21.15.110:0/3093194379 shutdown_connections 2024-05-09T09:47:03.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.405+0000 7f63d294d640 1 -- 172.21.15.110:0/3093194379 wait complete. 2024-05-09T09:47:03.421 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":2765519551},{"type":"v1","addr":"172.21.15.157:6825","nonce":2765519551}]},"active_addr":"172.21.15.157:6825/2765519551","active_change":"2024-05-09T09:46:51.058040+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":2302815412}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":3427291897}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":3847409039}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.157:0","nonce":3767492384}]}]} 2024-05-09T09:47:03.423 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-09T09:47:03.423 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-09T09:47:03.423 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T09:47:03.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.529+0000 7f40a2f58640 1 Processor -- start 2024-05-09T09:47:03.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.529+0000 7f40a2f58640 1 -- start start 2024-05-09T09:47:03.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.529+0000 7f40a2f58640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f409c1294f0 0x7f409c131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:03.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.529+0000 7f40a2f58640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f409c096570 con 0x7f409c0955b0 2024-05-09T09:47:03.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.529+0000 7f40a2f58640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f409c0971f0 con 0x7f409c1294f0 2024-05-09T09:47:03.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.529+0000 7f4093fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f409c1294f0 0x7f409c131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:03.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.529+0000 7f40a0cf4640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f409c0955b0 0x7f409c129990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41154/0 (socket says 172.21.15.110:41154) 2024-05-09T09:47:03.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.529+0000 7f40a0cf4640 1 -- 172.21.15.110:0/306554942 learned_addr learned my addr 172.21.15.110:0/306554942 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:47:03.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.533+0000 7f4093fff640 1 -- 172.21.15.110:0/306554942 >> v1:172.21.15.110:6789/0 conn(0x7f409c0955b0 legacy=0x7f409c129990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:03.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.533+0000 7f4093fff640 1 -- 172.21.15.110:0/306554942 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f409c12a0a0 con 0x7f409c1294f0 2024-05-09T09:47:03.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.533+0000 7f4093fff640 1 --2- 172.21.15.110:0/306554942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f409c1294f0 0x7f409c131be0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f408c009740 tx=0x7f408c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=860005793ed0d4f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:03.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.533+0000 7f40937fe640 1 -- 172.21.15.110:0/306554942 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f408c0b0070 con 0x7f409c1294f0 2024-05-09T09:47:03.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.533+0000 7f40937fe640 1 -- 172.21.15.110:0/306554942 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f408c0ab530 con 0x7f409c1294f0 2024-05-09T09:47:03.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.533+0000 7f40937fe640 1 -- 172.21.15.110:0/306554942 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f408c0ab830 con 0x7f409c1294f0 2024-05-09T09:47:03.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.533+0000 7f40a2f58640 1 -- 172.21.15.110:0/306554942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f409c1294f0 msgr2=0x7f409c131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:03.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.533+0000 7f40a2f58640 1 --2- 172.21.15.110:0/306554942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f409c1294f0 0x7f409c131be0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f408c009740 tx=0x7f408c01c370 comp rx=0 tx=0).stop 2024-05-09T09:47:03.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.533+0000 7f40a2f58640 1 -- 172.21.15.110:0/306554942 shutdown_connections 2024-05-09T09:47:03.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.533+0000 7f40a2f58640 1 --2- 172.21.15.110:0/306554942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f409c1294f0 0x7f409c131be0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:03.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.533+0000 7f40a2f58640 1 -- 172.21.15.110:0/306554942 >> 172.21.15.110:0/306554942 conn(0x7f409c09ad20 msgr2=0x7f409c09b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:03.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.533+0000 7f40a2f58640 1 -- 172.21.15.110:0/306554942 shutdown_connections 2024-05-09T09:47:03.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.533+0000 7f40a2f58640 1 -- 172.21.15.110:0/306554942 wait complete. 2024-05-09T09:47:03.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.537+0000 7f40a2f58640 1 Processor -- start 2024-05-09T09:47:03.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.537+0000 7f40a2f58640 1 -- start start 2024-05-09T09:47:03.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.537+0000 7f40a2f58640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f409c0955b0 0x7f409c1c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:03.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.537+0000 7f40a2f58640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f409c134cd0 con 0x7f409c0955b0 2024-05-09T09:47:03.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.537+0000 7f40a0cf4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f409c0955b0 0x7f409c1c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:03.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.537+0000 7f40a0cf4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f409c0955b0 0x7f409c1c41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59432/0 (socket says 172.21.15.110:59432) 2024-05-09T09:47:03.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.537+0000 7f40a0cf4640 1 -- 172.21.15.110:0/352909960 learned_addr learned my addr 172.21.15.110:0/352909960 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:03.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.537+0000 7f40a0cf4640 1 -- 172.21.15.110:0/352909960 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f409c12c8e0 con 0x7f409c0955b0 2024-05-09T09:47:03.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.537+0000 7f40a0cf4640 1 --2- 172.21.15.110:0/352909960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f409c0955b0 0x7f409c1c41e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f409800c380 tx=0x7f409800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:03.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.537+0000 7f40917fa640 1 -- 172.21.15.110:0/352909960 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4098017070 con 0x7f409c0955b0 2024-05-09T09:47:03.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.537+0000 7f40917fa640 1 -- 172.21.15.110:0/352909960 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4098005c20 con 0x7f409c0955b0 2024-05-09T09:47:03.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.537+0000 7f40a2f58640 1 -- 172.21.15.110:0/352909960 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f409c1263f0 con 0x7f409c0955b0 2024-05-09T09:47:03.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.537+0000 7f40917fa640 1 -- 172.21.15.110:0/352909960 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40980070d0 con 0x7f409c0955b0 2024-05-09T09:47:03.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.537+0000 7f40a2f58640 1 -- 172.21.15.110:0/352909960 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f409c126b60 con 0x7f409c0955b0 2024-05-09T09:47:03.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.537+0000 7f40917fa640 1 -- 172.21.15.110:0/352909960 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f409801a070 con 0x7f409c0955b0 2024-05-09T09:47:03.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.537+0000 7f40917fa640 1 --2- 172.21.15.110:0/352909960 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4088036310 0x7f40880387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:03.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.537+0000 7f40a2f58640 1 -- 172.21.15.110:0/352909960 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f409c063710 con 0x7f409c0955b0 2024-05-09T09:47:03.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.537+0000 7f40917fa640 1 -- 172.21.15.110:0/352909960 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3482+0+0 (secure 0 0 0) 0x7f4098047f90 con 0x7f409c0955b0 2024-05-09T09:47:03.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.537+0000 7f4093fff640 1 --2- 172.21.15.110:0/352909960 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4088036310 0x7f40880387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:03.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.537+0000 7f4093fff640 1 --2- 172.21.15.110:0/352909960 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4088036310 0x7f40880387d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f408c0ad000 tx=0x7f408c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:03.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.541+0000 7f40917fa640 1 -- 172.21.15.110:0/352909960 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f409800dd30 con 0x7f409c0955b0 2024-05-09T09:47:03.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.689+0000 7f40a2f58640 1 -- 172.21.15.110:0/352909960 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f409c067fd0 con 0x7f409c0955b0 2024-05-09T09:47:03.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.693+0000 7f40917fa640 1 -- 172.21.15.110:0/352909960 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+9756 (secure 0 0 0) 0x7f4098012400 con 0x7f409c0955b0 2024-05-09T09:47:03.693 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:47:03.693 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":14,"fsid":"c05d0fe5-e814-4a03-b82b-3bb6168d5691","created":"2024-05-09T09:46:46.135865+0000","modified":"2024-05-09T09:47:03.035997+0000","last_up_change":"2024-05-09T09:46:55.013992+0000","last_in_change":"2024-05-09T09:46:47.304543+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T09:46:55.113740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-09T09:47:01.859791+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7cc58db-ea92-4134-a9e4-01f3d21592f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":231209037},{"type":"v1","addr":"172.21.15.110:6801","nonce":231209037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":231209037},{"type":"v1","addr":"172.21.15.110:6803","nonce":231209037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":231209037},{"type":"v1","addr":"172.21.15.110:6807","nonce":231209037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":231209037},{"type":"v1","addr":"172.21.15.110:6805","nonce":231209037}]},"public_addr":"172.21.15.110:6801/231209037","cluster_addr":"172.21.15.110:6803/231209037","heartbeat_back_addr":"172.21.15.110:6807/231209037","heartbeat_front_addr":"172.21.15.110:6805/231209037","state":["exists","up"]},{"osd":1,"uuid":"fe2d7e0c-75c9-471d-b77b-5f94220e23bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3930131338},{"type":"v1","addr":"172.21.15.157:6809","nonce":3930131338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3930131338},{"type":"v1","addr":"172.21.15.157:6811","nonce":3930131338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3930131338},{"type":"v1","addr":"172.21.15.157:6815","nonce":3930131338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3930131338},{"type":"v1","addr":"172.21.15.157:6813","nonce":3930131338}]},"public_addr":"172.21.15.157:6809/3930131338","cluster_addr":"172.21.15.157:6811/3930131338","heartbeat_back_addr":"172.21.15.157:6815/3930131338","heartbeat_front_addr":"172.21.15.157:6813/3930131338","state":["exists","up"]},{"osd":2,"uuid":"6fa89462-855a-422a-b215-d2076f0dfb2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":354455204},{"type":"v1","addr":"172.21.15.157:6801","nonce":354455204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":354455204},{"type":"v1","addr":"172.21.15.157:6803","nonce":354455204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":354455204},{"type":"v1","addr":"172.21.15.157:6807","nonce":354455204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":354455204},{"type":"v1","addr":"172.21.15.157:6805","nonce":354455204}]},"public_addr":"172.21.15.157:6801/354455204","cluster_addr":"172.21.15.157:6803/354455204","heartbeat_back_addr":"172.21.15.157:6807/354455204","heartbeat_front_addr":"172.21.15.157:6805/354455204","state":["exists","up"]},{"osd":3,"uuid":"fd8da308-444c-4eaa-851d-6262904f60f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":2487336710},{"type":"v1","addr":"172.21.15.157:6817","nonce":2487336710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":2487336710},{"type":"v1","addr":"172.21.15.157:6819","nonce":2487336710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":2487336710},{"type":"v1","addr":"172.21.15.157:6823","nonce":2487336710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":2487336710},{"type":"v1","addr":"172.21.15.157:6821","nonce":2487336710}]},"public_addr":"172.21.15.157:6817/2487336710","cluster_addr":"172.21.15.157:6819/2487336710","heartbeat_back_addr":"172.21.15.157:6823/2487336710","heartbeat_front_addr":"172.21.15.157:6821/2487336710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:46:52.614027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:46:52.731468+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:46:52.830714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:46:52.693601+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T09:47:03.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.693+0000 7f40a2f58640 1 -- 172.21.15.110:0/352909960 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4088036310 msgr2=0x7f40880387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:03.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.693+0000 7f40a2f58640 1 --2- 172.21.15.110:0/352909960 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4088036310 0x7f40880387d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f408c0ad000 tx=0x7f408c008040 comp rx=0 tx=0).stop 2024-05-09T09:47:03.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.693+0000 7f40a2f58640 1 -- 172.21.15.110:0/352909960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f409c0955b0 msgr2=0x7f409c1c41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:03.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.693+0000 7f40a2f58640 1 --2- 172.21.15.110:0/352909960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f409c0955b0 0x7f409c1c41e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f409800c380 tx=0x7f409800c840 comp rx=0 tx=0).stop 2024-05-09T09:47:03.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.693+0000 7f40a2f58640 1 -- 172.21.15.110:0/352909960 shutdown_connections 2024-05-09T09:47:03.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.693+0000 7f40a2f58640 1 --2- 172.21.15.110:0/352909960 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4088036310 0x7f40880387d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:03.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.693+0000 7f40a2f58640 1 --2- 172.21.15.110:0/352909960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f409c0955b0 0x7f409c1c41e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:03.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.693+0000 7f40a2f58640 1 -- 172.21.15.110:0/352909960 >> 172.21.15.110:0/352909960 conn(0x7f409c09ad20 msgr2=0x7f409c097820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:03.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.693+0000 7f40a2f58640 1 -- 172.21.15.110:0/352909960 shutdown_connections 2024-05-09T09:47:03.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.693+0000 7f40a2f58640 1 -- 172.21.15.110:0/352909960 wait complete. 2024-05-09T09:47:03.710 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-09T09:47:03.710 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T09:47:03.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.817+0000 7fcbbe031640 1 Processor -- start 2024-05-09T09:47:03.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.817+0000 7fcbbe031640 1 -- start start 2024-05-09T09:47:03.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.817+0000 7fcbbe031640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcbb81294f0 0x7fcbb8131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:03.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.817+0000 7fcbbe031640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbb8096570 con 0x7fcbb80955b0 2024-05-09T09:47:03.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.817+0000 7fcbbe031640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fcbb80971f0 con 0x7fcbb81294f0 2024-05-09T09:47:03.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.817+0000 7fcbb6ffd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcbb81294f0 0x7fcbb8131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:03.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.817+0000 7fcbb6ffd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcbb81294f0 0x7fcbb8131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59434/0 (socket says 172.21.15.110:59434) 2024-05-09T09:47:03.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.817+0000 7fcbb6ffd640 1 -- 172.21.15.110:0/2204316505 learned_addr learned my addr 172.21.15.110:0/2204316505 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:03.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.821+0000 7fcbb6ffd640 1 -- 172.21.15.110:0/2204316505 >> v1:172.21.15.110:6789/0 conn(0x7fcbb80955b0 legacy=0x7fcbb8129990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:03.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.821+0000 7fcbb6ffd640 1 -- 172.21.15.110:0/2204316505 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb812a0a0 con 0x7fcbb81294f0 2024-05-09T09:47:03.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.821+0000 7fcbb6ffd640 1 --2- 172.21.15.110:0/2204316505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbb81294f0 0x7fcbb8131be0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0097f0 tx=0x7fcbac01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2573b00606849d73 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:03.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.821+0000 7fcbb67fc640 1 -- 172.21.15.110:0/2204316505 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbac0b0070 con 0x7fcbb81294f0 2024-05-09T09:47:03.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.821+0000 7fcbb67fc640 1 -- 172.21.15.110:0/2204316505 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbac0ab530 con 0x7fcbb81294f0 2024-05-09T09:47:03.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.821+0000 7fcbb67fc640 1 -- 172.21.15.110:0/2204316505 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbac0ab830 con 0x7fcbb81294f0 2024-05-09T09:47:03.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.821+0000 7fcbbe031640 1 -- 172.21.15.110:0/2204316505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbb81294f0 msgr2=0x7fcbb8131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:03.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.821+0000 7fcbbe031640 1 --2- 172.21.15.110:0/2204316505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbb81294f0 0x7fcbb8131be0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0097f0 tx=0x7fcbac01c430 comp rx=0 tx=0).stop 2024-05-09T09:47:03.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.821+0000 7fcbbe031640 1 -- 172.21.15.110:0/2204316505 shutdown_connections 2024-05-09T09:47:03.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.821+0000 7fcbbe031640 1 --2- 172.21.15.110:0/2204316505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbb81294f0 0x7fcbb8131be0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:03.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.821+0000 7fcbbe031640 1 -- 172.21.15.110:0/2204316505 >> 172.21.15.110:0/2204316505 conn(0x7fcbb809ad20 msgr2=0x7fcbb809b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:03.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.821+0000 7fcbbe031640 1 -- 172.21.15.110:0/2204316505 shutdown_connections 2024-05-09T09:47:03.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.821+0000 7fcbbe031640 1 -- 172.21.15.110:0/2204316505 wait complete. 2024-05-09T09:47:03.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.821+0000 7fcbbe031640 1 Processor -- start 2024-05-09T09:47:03.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.821+0000 7fcbbe031640 1 -- start start 2024-05-09T09:47:03.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.821+0000 7fcbbe031640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbb80955b0 0x7fcbb81c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:03.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.821+0000 7fcbbe031640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb8134cd0 con 0x7fcbb80955b0 2024-05-09T09:47:03.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.825+0000 7fcbb77fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbb80955b0 0x7fcbb81c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:03.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.825+0000 7fcbb77fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbb80955b0 0x7fcbb81c41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59444/0 (socket says 172.21.15.110:59444) 2024-05-09T09:47:03.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.825+0000 7fcbb77fe640 1 -- 172.21.15.110:0/1007478921 learned_addr learned my addr 172.21.15.110:0/1007478921 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:03.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.825+0000 7fcbb77fe640 1 -- 172.21.15.110:0/1007478921 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb812c8e0 con 0x7fcbb80955b0 2024-05-09T09:47:03.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.825+0000 7fcbb77fe640 1 --2- 172.21.15.110:0/1007478921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbb80955b0 0x7fcbb81c41e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcbb000c720 tx=0x7fcbb000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:03.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.825+0000 7fcb9ffff640 1 -- 172.21.15.110:0/1007478921 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbb0016020 con 0x7fcbb80955b0 2024-05-09T09:47:03.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.825+0000 7fcb9ffff640 1 -- 172.21.15.110:0/1007478921 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbb0006b60 con 0x7fcbb80955b0 2024-05-09T09:47:03.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.825+0000 7fcb9ffff640 1 -- 172.21.15.110:0/1007478921 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbb000a820 con 0x7fcbb80955b0 2024-05-09T09:47:03.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.825+0000 7fcbbe031640 1 -- 172.21.15.110:0/1007478921 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbb81263f0 con 0x7fcbb80955b0 2024-05-09T09:47:03.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.825+0000 7fcbbe031640 1 -- 172.21.15.110:0/1007478921 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbb8126b60 con 0x7fcbb80955b0 2024-05-09T09:47:03.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.825+0000 7fcbbe031640 1 -- 172.21.15.110:0/1007478921 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbb8063710 con 0x7fcbb80955b0 2024-05-09T09:47:03.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.825+0000 7fcb9ffff640 1 -- 172.21.15.110:0/1007478921 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fcbb000a9c0 con 0x7fcbb80955b0 2024-05-09T09:47:03.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.825+0000 7fcb9ffff640 1 --2- 172.21.15.110:0/1007478921 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fcba4036310 0x7fcba40387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:03.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.825+0000 7fcb9ffff640 1 -- 172.21.15.110:0/1007478921 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3482+0+0 (secure 0 0 0) 0x7fcbb0048770 con 0x7fcbb80955b0 2024-05-09T09:47:03.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.825+0000 7fcbb6ffd640 1 --2- 172.21.15.110:0/1007478921 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fcba4036310 0x7fcba40387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:03.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.825+0000 7fcbb6ffd640 1 --2- 172.21.15.110:0/1007478921 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fcba4036310 0x7fcba40387d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0ad000 tx=0x7fcbac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:03.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.829+0000 7fcb9ffff640 1 -- 172.21.15.110:0/1007478921 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcbb0020060 con 0x7fcbb80955b0 2024-05-09T09:47:03.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.989+0000 7fcbbe031640 1 -- 172.21.15.110:0/1007478921 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcbb8067fd0 con 0x7fcbb80955b0 2024-05-09T09:47:03.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.989+0000 7fcb9ffff640 1 -- 172.21.15.110:0/1007478921 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+9756 (secure 0 0 0) 0x7fcbb00078d0 con 0x7fcbb80955b0 2024-05-09T09:47:03.989 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:47:03.989 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":14,"fsid":"c05d0fe5-e814-4a03-b82b-3bb6168d5691","created":"2024-05-09T09:46:46.135865+0000","modified":"2024-05-09T09:47:03.035997+0000","last_up_change":"2024-05-09T09:46:55.013992+0000","last_in_change":"2024-05-09T09:46:47.304543+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T09:46:55.113740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-09T09:47:01.859791+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7cc58db-ea92-4134-a9e4-01f3d21592f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":231209037},{"type":"v1","addr":"172.21.15.110:6801","nonce":231209037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":231209037},{"type":"v1","addr":"172.21.15.110:6803","nonce":231209037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":231209037},{"type":"v1","addr":"172.21.15.110:6807","nonce":231209037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":231209037},{"type":"v1","addr":"172.21.15.110:6805","nonce":231209037}]},"public_addr":"172.21.15.110:6801/231209037","cluster_addr":"172.21.15.110:6803/231209037","heartbeat_back_addr":"172.21.15.110:6807/231209037","heartbeat_front_addr":"172.21.15.110:6805/231209037","state":["exists","up"]},{"osd":1,"uuid":"fe2d7e0c-75c9-471d-b77b-5f94220e23bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3930131338},{"type":"v1","addr":"172.21.15.157:6809","nonce":3930131338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3930131338},{"type":"v1","addr":"172.21.15.157:6811","nonce":3930131338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3930131338},{"type":"v1","addr":"172.21.15.157:6815","nonce":3930131338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3930131338},{"type":"v1","addr":"172.21.15.157:6813","nonce":3930131338}]},"public_addr":"172.21.15.157:6809/3930131338","cluster_addr":"172.21.15.157:6811/3930131338","heartbeat_back_addr":"172.21.15.157:6815/3930131338","heartbeat_front_addr":"172.21.15.157:6813/3930131338","state":["exists","up"]},{"osd":2,"uuid":"6fa89462-855a-422a-b215-d2076f0dfb2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":354455204},{"type":"v1","addr":"172.21.15.157:6801","nonce":354455204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":354455204},{"type":"v1","addr":"172.21.15.157:6803","nonce":354455204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":354455204},{"type":"v1","addr":"172.21.15.157:6807","nonce":354455204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":354455204},{"type":"v1","addr":"172.21.15.157:6805","nonce":354455204}]},"public_addr":"172.21.15.157:6801/354455204","cluster_addr":"172.21.15.157:6803/354455204","heartbeat_back_addr":"172.21.15.157:6807/354455204","heartbeat_front_addr":"172.21.15.157:6805/354455204","state":["exists","up"]},{"osd":3,"uuid":"fd8da308-444c-4eaa-851d-6262904f60f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":2487336710},{"type":"v1","addr":"172.21.15.157:6817","nonce":2487336710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":2487336710},{"type":"v1","addr":"172.21.15.157:6819","nonce":2487336710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":2487336710},{"type":"v1","addr":"172.21.15.157:6823","nonce":2487336710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":2487336710},{"type":"v1","addr":"172.21.15.157:6821","nonce":2487336710}]},"public_addr":"172.21.15.157:6817/2487336710","cluster_addr":"172.21.15.157:6819/2487336710","heartbeat_back_addr":"172.21.15.157:6823/2487336710","heartbeat_front_addr":"172.21.15.157:6821/2487336710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:46:52.614027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:46:52.731468+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:46:52.830714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:46:52.693601+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T09:47:03.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.993+0000 7fcbbe031640 1 -- 172.21.15.110:0/1007478921 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fcba4036310 msgr2=0x7fcba40387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:03.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.993+0000 7fcbbe031640 1 --2- 172.21.15.110:0/1007478921 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fcba4036310 0x7fcba40387d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0ad000 tx=0x7fcbac008040 comp rx=0 tx=0).stop 2024-05-09T09:47:03.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.993+0000 7fcbbe031640 1 -- 172.21.15.110:0/1007478921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbb80955b0 msgr2=0x7fcbb81c41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:03.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.993+0000 7fcbbe031640 1 --2- 172.21.15.110:0/1007478921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbb80955b0 0x7fcbb81c41e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcbb000c720 tx=0x7fcbb000cbe0 comp rx=0 tx=0).stop 2024-05-09T09:47:03.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.993+0000 7fcbbe031640 1 -- 172.21.15.110:0/1007478921 shutdown_connections 2024-05-09T09:47:03.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.993+0000 7fcbbe031640 1 --2- 172.21.15.110:0/1007478921 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fcba4036310 0x7fcba40387d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:03.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.993+0000 7fcbbe031640 1 --2- 172.21.15.110:0/1007478921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbb80955b0 0x7fcbb81c41e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:03.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.993+0000 7fcbbe031640 1 -- 172.21.15.110:0/1007478921 >> 172.21.15.110:0/1007478921 conn(0x7fcbb809ad20 msgr2=0x7fcbb8097820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:03.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.993+0000 7fcbbe031640 1 -- 172.21.15.110:0/1007478921 shutdown_connections 2024-05-09T09:47:03.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:03.993+0000 7fcbbe031640 1 -- 172.21.15.110:0/1007478921 wait complete. 2024-05-09T09:47:04.007 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-09T09:47:04.008 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-09T09:47:04.008 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-09T09:47:04.009 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-09T09:47:04.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.117+0000 7f20acd08640 1 Processor -- start 2024-05-09T09:47:04.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.117+0000 7f20acd08640 1 -- start start 2024-05-09T09:47:04.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.117+0000 7f20acd08640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f20a806da60 0x7f20a8133dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:04.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.117+0000 7f20acd08640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20a806cf20 con 0x7f20a80729f0 2024-05-09T09:47:04.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.117+0000 7f20acd08640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f20a8095f40 con 0x7f20a806da60 2024-05-09T09:47:04.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.117+0000 7f20a5d9b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f20a806da60 0x7f20a8133dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:04.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.117+0000 7f20a659c640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f20a80729f0 0x7f20a806d350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41170/0 (socket says 172.21.15.110:41170) 2024-05-09T09:47:04.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.117+0000 7f20a659c640 1 -- 172.21.15.110:0/1156646793 learned_addr learned my addr 172.21.15.110:0/1156646793 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:47:04.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.117+0000 7f20a5d9b640 1 -- 172.21.15.110:0/1156646793 >> v1:172.21.15.110:6789/0 conn(0x7f20a80729f0 legacy=0x7f20a806d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.117+0000 7f20a559a640 1 -- 172.21.15.110:0/1156646793 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3549784566 0 0) 0x7f20a806cf20 con 0x7f20a80729f0 2024-05-09T09:47:04.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.117+0000 7f20a5d9b640 1 -- 172.21.15.110:0/1156646793 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a8095a60 con 0x7f20a806da60 2024-05-09T09:47:04.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.117+0000 7f119c011640 1 Processor -- start 2024-05-09T09:47:04.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.117+0000 7f119c011640 1 -- start start 2024-05-09T09:47:04.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.117+0000 7f119c011640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1194099a60 0x7f1194099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:04.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.117+0000 7f119c011640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f119409ba30 con 0x7f119409a380 2024-05-09T09:47:04.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.117+0000 7f119c011640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f1194073040 con 0x7f1194099a60 2024-05-09T09:47:04.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.117+0000 7f1199dad640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1194099a60 0x7f1194099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:04.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.117+0000 7f1199dad640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1194099a60 0x7f1194099e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59464/0 (socket says 172.21.15.110:59464) 2024-05-09T09:47:04.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.117+0000 7f1199dad640 1 -- 172.21.15.110:0/1044753488 learned_addr learned my addr 172.21.15.110:0/1044753488 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:04.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.117+0000 7f1199dad640 1 -- 172.21.15.110:0/1044753488 >> v1:172.21.15.110:6789/0 conn(0x7f119409a380 legacy=0x7f119412ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.117+0000 7f1199dad640 1 -- 172.21.15.110:0/1044753488 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119409eb80 con 0x7f1194099a60 2024-05-09T09:47:04.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.117+0000 7f1198dab640 1 -- 172.21.15.110:0/1044753488 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2536499434 0 0) 0x7f1190001120 con 0x7f119409a380 2024-05-09T09:47:04.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f1199dad640 1 --2- 172.21.15.110:0/1044753488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1194099a60 0x7f1194099e40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f11840097f0 tx=0x7f118401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c6b677f6d02eaa1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:04.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f20a5d9b640 1 --2- 172.21.15.110:0/1156646793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20a806da60 0x7f20a8133dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f209c009740 tx=0x7f209c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5a74a23bd6a646 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:04.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f1198dab640 1 -- 172.21.15.110:0/1044753488 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11840b0070 con 0x7f1194099a60 2024-05-09T09:47:04.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f1198dab640 1 -- 172.21.15.110:0/1044753488 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11840ab530 con 0x7f1194099a60 2024-05-09T09:47:04.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f1198dab640 1 -- 172.21.15.110:0/1044753488 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11840ab830 con 0x7f1194099a60 2024-05-09T09:47:04.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f20a559a640 1 -- 172.21.15.110:0/1156646793 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c0b0070 con 0x7f20a806da60 2024-05-09T09:47:04.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f20a559a640 1 -- 172.21.15.110:0/1156646793 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209c0ab530 con 0x7f20a806da60 2024-05-09T09:47:04.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f20a559a640 1 -- 172.21.15.110:0/1156646793 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c0ab830 con 0x7f20a806da60 2024-05-09T09:47:04.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f119c011640 1 -- 172.21.15.110:0/1044753488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1194099a60 msgr2=0x7f1194099e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f119c011640 1 --2- 172.21.15.110:0/1044753488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1194099a60 0x7f1194099e40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f11840097f0 tx=0x7f118401c430 comp rx=0 tx=0).stop 2024-05-09T09:47:04.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f119c011640 1 -- 172.21.15.110:0/1044753488 shutdown_connections 2024-05-09T09:47:04.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f119c011640 1 --2- 172.21.15.110:0/1044753488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1194099a60 0x7f1194099e40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f119c011640 1 -- 172.21.15.110:0/1044753488 >> 172.21.15.110:0/1044753488 conn(0x7f119409d210 msgr2=0x7f1194072140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:04.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f119c011640 1 -- 172.21.15.110:0/1044753488 shutdown_connections 2024-05-09T09:47:04.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f119c011640 1 -- 172.21.15.110:0/1044753488 wait complete. 2024-05-09T09:47:04.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f20acd08640 1 -- 172.21.15.110:0/1156646793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20a806da60 msgr2=0x7f20a8133dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f20acd08640 1 --2- 172.21.15.110:0/1156646793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20a806da60 0x7f20a8133dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f209c009740 tx=0x7f209c01c370 comp rx=0 tx=0).stop 2024-05-09T09:47:04.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f20acd08640 1 -- 172.21.15.110:0/1156646793 shutdown_connections 2024-05-09T09:47:04.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f20acd08640 1 --2- 172.21.15.110:0/1156646793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20a806da60 0x7f20a8133dc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f20acd08640 1 -- 172.21.15.110:0/1156646793 >> 172.21.15.110:0/1156646793 conn(0x7f20a809e2a0 msgr2=0x7f20a809e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:04.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f20acd08640 1 -- 172.21.15.110:0/1156646793 shutdown_connections 2024-05-09T09:47:04.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f20acd08640 1 -- 172.21.15.110:0/1156646793 wait complete. 2024-05-09T09:47:04.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f119c011640 1 Processor -- start 2024-05-09T09:47:04.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f119c011640 1 -- start start 2024-05-09T09:47:04.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f20acd08640 1 Processor -- start 2024-05-09T09:47:04.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f20acd08640 1 -- start start 2024-05-09T09:47:04.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f119c011640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1194099a60 0x7f119406e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:04.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f119c011640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1194134ed0 con 0x7f1194099a60 2024-05-09T09:47:04.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f1199dad640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1194099a60 0x7f119406e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:04.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f5d3f5e8640 1 Processor -- start 2024-05-09T09:47:04.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f20acd08640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20a806da60 0x7f20a81c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:04.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f20acd08640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f20a8136d30 con 0x7f20a806da60 2024-05-09T09:47:04.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f5d3f5e8640 1 -- start start 2024-05-09T09:47:04.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f1199dad640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1194099a60 0x7f119406e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59476/0 (socket says 172.21.15.110:59476) 2024-05-09T09:47:04.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f1199dad640 1 -- 172.21.15.110:0/1246710790 learned_addr learned my addr 172.21.15.110:0/1246710790 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:04.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f20a659c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20a806da60 0x7f20a81c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:04.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f20a659c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20a806da60 0x7f20a81c63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59482/0 (socket says 172.21.15.110:59482) 2024-05-09T09:47:04.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f20a659c640 1 -- 172.21.15.110:0/516647583 learned_addr learned my addr 172.21.15.110:0/516647583 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:04.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f1199dad640 1 -- 172.21.15.110:0/1246710790 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119406f990 con 0x7f1194099a60 2024-05-09T09:47:04.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f20a659c640 1 -- 172.21.15.110:0/516647583 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a8132c40 con 0x7f20a806da60 2024-05-09T09:47:04.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f1199dad640 1 --2- 172.21.15.110:0/1246710790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1194099a60 0x7f119406e180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f11840ae040 tx=0x7f118401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:04.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f5d3f5e8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5d38129090 0x7f5d38130c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:04.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f5d3f5e8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d38097860 con 0x7f5d38128380 2024-05-09T09:47:04.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f5d3f5e8640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f5d38128760 con 0x7f5d38129090 2024-05-09T09:47:04.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f20a659c640 1 --2- 172.21.15.110:0/516647583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20a806da60 0x7f20a81c63f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f209800c420 tx=0x7f209800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:04.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f118a7fc640 1 -- 172.21.15.110:0/1246710790 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11840ba020 con 0x7f1194099a60 2024-05-09T09:47:04.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f5d3cb83640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5d38129090 0x7f5d38130c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:04.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f5d3cb83640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5d38129090 0x7f5d38130c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59498/0 (socket says 172.21.15.110:59498) 2024-05-09T09:47:04.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.121+0000 7f5d3cb83640 1 -- 172.21.15.110:0/2525740783 learned_addr learned my addr 172.21.15.110:0/2525740783 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:04.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f118a7fc640 1 -- 172.21.15.110:0/1246710790 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11840b6570 con 0x7f1194099a60 2024-05-09T09:47:04.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f118a7fc640 1 -- 172.21.15.110:0/1246710790 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11840b0040 con 0x7f1194099a60 2024-05-09T09:47:04.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f119c011640 1 -- 172.21.15.110:0/1246710790 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f119411e120 con 0x7f1194099a60 2024-05-09T09:47:04.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f119c011640 1 -- 172.21.15.110:0/1246710790 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f119406e890 con 0x7f1194099a60 2024-05-09T09:47:04.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f569b107640 1 Processor -- start 2024-05-09T09:47:04.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f5d3cb83640 1 -- 172.21.15.110:0/2525740783 >> v1:172.21.15.110:6789/0 conn(0x7f5d38128380 legacy=0x7f5d38128980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T09:47:04.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f5d3cb83640 1 -- 172.21.15.110:0/2525740783 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d38097c80 con 0x7f5d38129090 2024-05-09T09:47:04.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f569b107640 1 -- start start 2024-05-09T09:47:04.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f119c011640 1 -- 172.21.15.110:0/1246710790 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1194063710 con 0x7f1194099a60 2024-05-09T09:47:04.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f2096ffd640 1 -- 172.21.15.110:0/516647583 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2098018070 con 0x7f20a806da60 2024-05-09T09:47:04.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f2096ffd640 1 -- 172.21.15.110:0/516647583 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20980074d0 con 0x7f20a806da60 2024-05-09T09:47:04.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f2096ffd640 1 -- 172.21.15.110:0/516647583 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2098004960 con 0x7f20a806da60 2024-05-09T09:47:04.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f20acd08640 1 -- 172.21.15.110:0/516647583 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20a81334b0 con 0x7f20a806da60 2024-05-09T09:47:04.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f20acd08640 1 -- 172.21.15.110:0/516647583 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20a812bbc0 con 0x7f20a806da60 2024-05-09T09:47:04.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f20acd08640 1 -- 172.21.15.110:0/516647583 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f20a812b780 con 0x7f20a806da60 2024-05-09T09:47:04.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f569b107640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5694129090 0x7f5694130c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:04.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f569b107640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5694097860 con 0x7f5694128380 2024-05-09T09:47:04.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f569b107640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f5694128760 con 0x7f5694129090 2024-05-09T09:47:04.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f5693fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5694129090 0x7f5694130c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:04.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f5693fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5694129090 0x7f5694130c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59500/0 (socket says 172.21.15.110:59500) 2024-05-09T09:47:04.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f5693fff640 1 -- 172.21.15.110:0/3215103792 learned_addr learned my addr 172.21.15.110:0/3215103792 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:04.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f2096ffd640 1 -- 172.21.15.110:0/516647583 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f209801b070 con 0x7f20a806da60 2024-05-09T09:47:04.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f5693fff640 1 -- 172.21.15.110:0/3215103792 >> v1:172.21.15.110:6789/0 conn(0x7f5694128380 legacy=0x7f5694128980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f5693fff640 1 -- 172.21.15.110:0/3215103792 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5694097c80 con 0x7f5694129090 2024-05-09T09:47:04.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f118a7fc640 1 -- 172.21.15.110:0/1246710790 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f11840bd020 con 0x7f1194099a60 2024-05-09T09:47:04.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f2096ffd640 1 --2- 172.21.15.110:0/516647583 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2088036310 0x7f20880387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:04.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f2096ffd640 1 -- 172.21.15.110:0/516647583 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f2098048190 con 0x7f20a806da60 2024-05-09T09:47:04.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f2096ffd640 1 --2- 172.21.15.110:0/516647583 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x7f208803ba90 0x7f208803ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:04.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f2096ffd640 1 -- 172.21.15.110:0/516647583 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f208803e5a0 con 0x7f208803ba90 2024-05-09T09:47:04.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f2096ffd640 1 -- 172.21.15.110:0/516647583 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f209804f050 con 0x7f20a806da60 2024-05-09T09:47:04.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f20a6d9d640 1 --2- 172.21.15.110:0/516647583 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x7f208803ba90 0x7f208803ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:04.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f118a7fc640 1 --2- 172.21.15.110:0/1246710790 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1178036310 0x7f11780387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:04.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f118a7fc640 1 -- 172.21.15.110:0/1246710790 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f11840e3560 con 0x7f1194099a60 2024-05-09T09:47:04.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f118a7fc640 1 --2- 172.21.15.110:0/1246710790 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x7f117803ba90 0x7f117803ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:04.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f118a7fc640 1 -- 172.21.15.110:0/1246710790 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f11840bbec0 con 0x7f117803ba90 2024-05-09T09:47:04.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f118a7fc640 1 -- 172.21.15.110:0/1246710790 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f11840e39a0 con 0x7f1194099a60 2024-05-09T09:47:04.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f20a6d9d640 1 --2- 172.21.15.110:0/516647583 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x7f208803ba90 0x7f208803ded0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:04.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f11995ac640 1 --2- 172.21.15.110:0/1246710790 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1178036310 0x7f11780387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:04.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f119a5ae640 1 --2- 172.21.15.110:0/1246710790 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x7f117803ba90 0x7f117803ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:04.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f2096ffd640 1 -- 172.21.15.110:0/516647583 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f208803e5a0 con 0x7f208803ba90 2024-05-09T09:47:04.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f5d3cb83640 1 --2- 172.21.15.110:0/2525740783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d38129090 0x7f5d38130c00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5d280097f0 tx=0x7f5d2801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8185ef78fdaa0b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:04.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f119a5ae640 1 --2- 172.21.15.110:0/1246710790 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x7f117803ba90 0x7f117803ded0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:04.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f5d2ffff640 1 -- 172.21.15.110:0/2525740783 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d280b0070 con 0x7f5d38129090 2024-05-09T09:47:04.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f20a5d9b640 1 --2- 172.21.15.110:0/516647583 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2088036310 0x7f20880387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:04.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f5d2ffff640 1 -- 172.21.15.110:0/2525740783 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d280ab530 con 0x7f5d38129090 2024-05-09T09:47:04.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f5d2ffff640 1 -- 172.21.15.110:0/2525740783 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d280ab830 con 0x7f5d38129090 2024-05-09T09:47:04.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.125+0000 7f11995ac640 1 --2- 172.21.15.110:0/1246710790 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1178036310 0x7f11780387d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1190000f70 tx=0x7f1190001360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:04.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f5693fff640 1 --2- 172.21.15.110:0/3215103792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5694129090 0x7f5694130c00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f56800097f0 tx=0x7f568001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39dc26afe16ffd86 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:04.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f5d3f5e8640 1 -- 172.21.15.110:0/2525740783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d38129090 msgr2=0x7f5d38130c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f5d3f5e8640 1 --2- 172.21.15.110:0/2525740783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d38129090 0x7f5d38130c00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5d280097f0 tx=0x7f5d2801c3f0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f56937fe640 1 -- 172.21.15.110:0/3215103792 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56800b0070 con 0x7f5694129090 2024-05-09T09:47:04.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f20a5d9b640 1 --2- 172.21.15.110:0/516647583 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2088036310 0x7f20880387d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f209c0ad000 tx=0x7f209c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:04.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f5d3f5e8640 1 -- 172.21.15.110:0/2525740783 shutdown_connections 2024-05-09T09:47:04.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f5d3f5e8640 1 --2- 172.21.15.110:0/2525740783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d38129090 0x7f5d38130c00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f5d3f5e8640 1 -- 172.21.15.110:0/2525740783 >> 172.21.15.110:0/2525740783 conn(0x7f5d3809e230 msgr2=0x7f5d3809e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:04.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f56937fe640 1 -- 172.21.15.110:0/3215103792 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56800ab530 con 0x7f5694129090 2024-05-09T09:47:04.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f56937fe640 1 -- 172.21.15.110:0/3215103792 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56800ab830 con 0x7f5694129090 2024-05-09T09:47:04.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f5d3f5e8640 1 -- 172.21.15.110:0/2525740783 shutdown_connections 2024-05-09T09:47:04.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f5d3f5e8640 1 -- 172.21.15.110:0/2525740783 wait complete. 2024-05-09T09:47:04.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f569b107640 1 -- 172.21.15.110:0/3215103792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5694129090 msgr2=0x7f5694130c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f569b107640 1 --2- 172.21.15.110:0/3215103792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5694129090 0x7f5694130c00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f56800097f0 tx=0x7f568001c430 comp rx=0 tx=0).stop 2024-05-09T09:47:04.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f569b107640 1 -- 172.21.15.110:0/3215103792 shutdown_connections 2024-05-09T09:47:04.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f569b107640 1 --2- 172.21.15.110:0/3215103792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5694129090 0x7f5694130c00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f569b107640 1 -- 172.21.15.110:0/3215103792 >> 172.21.15.110:0/3215103792 conn(0x7f569409e230 msgr2=0x7f569409e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:04.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f569b107640 1 -- 172.21.15.110:0/3215103792 shutdown_connections 2024-05-09T09:47:04.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f569b107640 1 -- 172.21.15.110:0/3215103792 wait complete. 2024-05-09T09:47:04.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f118a7fc640 1 -- 172.21.15.110:0/1246710790 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f11840bbec0 con 0x7f117803ba90 2024-05-09T09:47:04.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f5d3f5e8640 1 Processor -- start 2024-05-09T09:47:04.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f5d3f5e8640 1 -- start start 2024-05-09T09:47:04.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f5d3f5e8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d38128380 0x7f5d38129470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:04.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f5d3f5e8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5d38131d20 con 0x7f5d38128380 2024-05-09T09:47:04.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f5d3d384640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d38128380 0x7f5d38129470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:04.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f5d3d384640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d38128380 0x7f5d38129470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59512/0 (socket says 172.21.15.110:59512) 2024-05-09T09:47:04.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f5d3d384640 1 -- 172.21.15.110:0/1783728371 learned_addr learned my addr 172.21.15.110:0/1783728371 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:04.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f569b107640 1 Processor -- start 2024-05-09T09:47:04.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f569b107640 1 -- start start 2024-05-09T09:47:04.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f5d3d384640 1 -- 172.21.15.110:0/1783728371 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3812b980 con 0x7f5d38128380 2024-05-09T09:47:04.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f5d3d384640 1 --2- 172.21.15.110:0/1783728371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d38128380 0x7f5d38129470 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400b390 tx=0x7f5d3400b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:04.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f5d2dffb640 1 -- 172.21.15.110:0/1783728371 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d34015030 con 0x7f5d38128380 2024-05-09T09:47:04.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f569b107640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5694128380 0x7f56941c2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:04.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f569b107640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f569406d1e0 con 0x7f5694128380 2024-05-09T09:47:04.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f5d2dffb640 1 -- 172.21.15.110:0/1783728371 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d34004170 con 0x7f5d38128380 2024-05-09T09:47:04.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f5d2dffb640 1 -- 172.21.15.110:0/1783728371 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d34004490 con 0x7f5d38128380 2024-05-09T09:47:04.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f5d3f5e8640 1 -- 172.21.15.110:0/1783728371 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d38072470 con 0x7f5d38128380 2024-05-09T09:47:04.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f5698ea3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5694128380 0x7f56941c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:04.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f5698ea3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5694128380 0x7f56941c2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59518/0 (socket says 172.21.15.110:59518) 2024-05-09T09:47:04.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f5698ea3640 1 -- 172.21.15.110:0/2337707472 learned_addr learned my addr 172.21.15.110:0/2337707472 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:04.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f5d3f5e8640 1 -- 172.21.15.110:0/1783728371 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d3812ad40 con 0x7f5d38128380 2024-05-09T09:47:04.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f5d3f5e8640 1 -- 172.21.15.110:0/1783728371 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5d38072c70 con 0x7f5d38128380 2024-05-09T09:47:04.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f5698ea3640 1 -- 172.21.15.110:0/2337707472 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5694072b10 con 0x7f5694128380 2024-05-09T09:47:04.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.129+0000 7f5d2dffb640 1 -- 172.21.15.110:0/1783728371 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f5d34018070 con 0x7f5d38128380 2024-05-09T09:47:04.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.133+0000 7f5698ea3640 1 --2- 172.21.15.110:0/2337707472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5694128380 0x7f56941c2070 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f568800c480 tx=0x7f568800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:04.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.133+0000 7f5d2dffb640 1 --2- 172.21.15.110:0/1783728371 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5d1c036310 0x7f5d1c0387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:04.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.133+0000 7f5d2dffb640 1 -- 172.21.15.110:0/1783728371 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f5d34016070 con 0x7f5d38128380 2024-05-09T09:47:04.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.133+0000 7f56917fa640 1 -- 172.21.15.110:0/2337707472 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5688005150 con 0x7f5694128380 2024-05-09T09:47:04.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.133+0000 7f56917fa640 1 -- 172.21.15.110:0/2337707472 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56880052f0 con 0x7f5694128380 2024-05-09T09:47:04.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.133+0000 7f569b107640 1 -- 172.21.15.110:0/2337707472 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5694073190 con 0x7f5694128380 2024-05-09T09:47:04.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.133+0000 7f5d2dffb640 1 --2- 172.21.15.110:0/1783728371 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f5d1c03ba90 0x7f5d1c03ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:04.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.133+0000 7f5d2dffb640 1 -- 172.21.15.110:0/1783728371 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5d34018e70 con 0x7f5d1c03ba90 2024-05-09T09:47:04.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.133+0000 7f5d2dffb640 1 -- 172.21.15.110:0/1783728371 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f5d3404d2a0 con 0x7f5d38128380 2024-05-09T09:47:04.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.133+0000 7f569b107640 1 -- 172.21.15.110:0/2337707472 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f569412b9a0 con 0x7f5694128380 2024-05-09T09:47:04.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.133+0000 7f5d3cb83640 1 --2- 172.21.15.110:0/1783728371 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5d1c036310 0x7f5d1c0387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:04.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.133+0000 7f56917fa640 1 -- 172.21.15.110:0/2337707472 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5688007030 con 0x7f5694128380 2024-05-09T09:47:04.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.133+0000 7f569b107640 1 -- 172.21.15.110:0/2337707472 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5674000f90 con 0x7f5694128380 2024-05-09T09:47:04.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.133+0000 7f56917fa640 1 -- 172.21.15.110:0/2337707472 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f5688019020 con 0x7f5694128380 2024-05-09T09:47:04.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.133+0000 7f5d3cb83640 1 --2- 172.21.15.110:0/1783728371 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5d1c036310 0x7f5d1c0387d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5d280ad000 tx=0x7f5d28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:04.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.133+0000 7f56917fa640 1 --2- 172.21.15.110:0/2337707472 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5678036360 0x7f5678038820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:04.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.133+0000 7f56917fa640 1 -- 172.21.15.110:0/2337707472 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f5688048090 con 0x7f5694128380 2024-05-09T09:47:04.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.133+0000 7f56917fa640 1 --2- 172.21.15.110:0/2337707472 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x7f567803bae0 0x7f567803df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:04.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.133+0000 7f56917fa640 1 -- 172.21.15.110:0/2337707472 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5688004e70 con 0x7f567803bae0 2024-05-09T09:47:04.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.133+0000 7f56917fa640 1 -- 172.21.15.110:0/2337707472 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f568804f050 con 0x7f5694128380 2024-05-09T09:47:04.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.133+0000 7f5693fff640 1 --2- 172.21.15.110:0/2337707472 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5678036360 0x7f5678038820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:04.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.133+0000 7f56996a4640 1 --2- 172.21.15.110:0/2337707472 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x7f567803bae0 0x7f567803df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:04.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.133+0000 7f56996a4640 1 --2- 172.21.15.110:0/2337707472 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x7f567803bae0 0x7f567803df20 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:04.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.133+0000 7f5693fff640 1 --2- 172.21.15.110:0/2337707472 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5678036360 0x7f5678038820 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5694069190 tx=0x7f56800a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:04.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.137+0000 7f5d3db85640 1 --2- 172.21.15.110:0/1783728371 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f5d1c03ba90 0x7f5d1c03ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:04.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.137+0000 7f56917fa640 1 -- 172.21.15.110:0/2337707472 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5688004e70 con 0x7f567803bae0 2024-05-09T09:47:04.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.137+0000 7f5d3db85640 1 --2- 172.21.15.110:0/1783728371 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f5d1c03ba90 0x7f5d1c03ded0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:04.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.141+0000 7f5d2dffb640 1 -- 172.21.15.110:0/1783728371 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5d34018e70 con 0x7f5d1c03ba90 2024-05-09T09:47:04.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.141+0000 7f20acd08640 1 -- 172.21.15.110:0/516647583 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f20a8133c20 con 0x7f208803ba90 2024-05-09T09:47:04.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.141+0000 7f2096ffd640 1 -- 172.21.15.110:0/516647583 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f20a000adb0 con 0x7f208803ba90 2024-05-09T09:47:04.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.145+0000 7f20acd08640 1 -- 172.21.15.110:0/516647583 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x7f208803ba90 msgr2=0x7f208803ded0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.145+0000 7f20acd08640 1 --2- 172.21.15.110:0/516647583 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x7f208803ba90 0x7f208803ded0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.145+0000 7f20acd08640 1 -- 172.21.15.110:0/516647583 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2088036310 msgr2=0x7f20880387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.145+0000 7f20acd08640 1 --2- 172.21.15.110:0/516647583 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2088036310 0x7f20880387d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f209c0ad000 tx=0x7f209c008040 comp rx=0 tx=0).stop 2024-05-09T09:47:04.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.145+0000 7f20acd08640 1 -- 172.21.15.110:0/516647583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20a806da60 msgr2=0x7f20a81c63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.145+0000 7f20acd08640 1 --2- 172.21.15.110:0/516647583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20a806da60 0x7f20a81c63f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f209800c420 tx=0x7f209800c8e0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.145+0000 7f20acd08640 1 -- 172.21.15.110:0/516647583 shutdown_connections 2024-05-09T09:47:04.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.145+0000 7f20acd08640 1 --2- 172.21.15.110:0/516647583 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x7f208803ba90 0x7f208803ded0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.145+0000 7f20acd08640 1 --2- 172.21.15.110:0/516647583 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2088036310 0x7f20880387d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.145+0000 7f20acd08640 1 --2- 172.21.15.110:0/516647583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20a806da60 0x7f20a81c63f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.145+0000 7f20acd08640 1 -- 172.21.15.110:0/516647583 >> 172.21.15.110:0/516647583 conn(0x7f20a809e2a0 msgr2=0x7f20a8124f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:04.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.145+0000 7f20acd08640 1 -- 172.21.15.110:0/516647583 shutdown_connections 2024-05-09T09:47:04.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.145+0000 7f20acd08640 1 -- 172.21.15.110:0/516647583 wait complete. 2024-05-09T09:47:04.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.145+0000 7f119c011640 1 -- 172.21.15.110:0/1246710790 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f119411d6e0 con 0x7f117803ba90 2024-05-09T09:47:04.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.145+0000 7f118a7fc640 1 -- 172.21.15.110:0/1246710790 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f119411d6e0 con 0x7f117803ba90 2024-05-09T09:47:04.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.145+0000 7f119c011640 1 -- 172.21.15.110:0/1246710790 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x7f117803ba90 msgr2=0x7f117803ded0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.145+0000 7f119c011640 1 --2- 172.21.15.110:0/1246710790 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x7f117803ba90 0x7f117803ded0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.149+0000 7f119c011640 1 -- 172.21.15.110:0/1246710790 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1178036310 msgr2=0x7f11780387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.149+0000 7f119c011640 1 --2- 172.21.15.110:0/1246710790 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1178036310 0x7f11780387d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1190000f70 tx=0x7f1190001360 comp rx=0 tx=0).stop 2024-05-09T09:47:04.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.149+0000 7f119c011640 1 -- 172.21.15.110:0/1246710790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1194099a60 msgr2=0x7f119406e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.149+0000 7f119c011640 1 --2- 172.21.15.110:0/1246710790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1194099a60 0x7f119406e180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f11840ae040 tx=0x7f118401ac70 comp rx=0 tx=0).stop 2024-05-09T09:47:04.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.149+0000 7f119c011640 1 -- 172.21.15.110:0/1246710790 shutdown_connections 2024-05-09T09:47:04.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.149+0000 7f119c011640 1 --2- 172.21.15.110:0/1246710790 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x7f117803ba90 0x7f117803ded0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.149+0000 7f119c011640 1 --2- 172.21.15.110:0/1246710790 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1178036310 0x7f11780387d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.149+0000 7f119c011640 1 --2- 172.21.15.110:0/1246710790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1194099a60 0x7f119406e180 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.149+0000 7f119c011640 1 -- 172.21.15.110:0/1246710790 >> 172.21.15.110:0/1246710790 conn(0x7f119409d210 msgr2=0x7f1194070fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:04.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.149+0000 7f119c011640 1 -- 172.21.15.110:0/1246710790 shutdown_connections 2024-05-09T09:47:04.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.149+0000 7f119c011640 1 -- 172.21.15.110:0/1246710790 wait complete. 2024-05-09T09:47:04.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.149+0000 7f569b107640 1 -- 172.21.15.110:0/2337707472 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5674002c80 con 0x7f567803bae0 2024-05-09T09:47:04.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.153+0000 7f56917fa640 1 -- 172.21.15.110:0/2337707472 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5674002c80 con 0x7f567803bae0 2024-05-09T09:47:04.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.153+0000 7f569b107640 1 -- 172.21.15.110:0/2337707472 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x7f567803bae0 msgr2=0x7f567803df20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.153+0000 7f569b107640 1 --2- 172.21.15.110:0/2337707472 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x7f567803bae0 0x7f567803df20 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.153+0000 7f569b107640 1 -- 172.21.15.110:0/2337707472 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5678036360 msgr2=0x7f5678038820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.153+0000 7f569b107640 1 --2- 172.21.15.110:0/2337707472 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5678036360 0x7f5678038820 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5694069190 tx=0x7f56800a6000 comp rx=0 tx=0).stop 2024-05-09T09:47:04.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.153+0000 7f569b107640 1 -- 172.21.15.110:0/2337707472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5694128380 msgr2=0x7f56941c2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.153+0000 7f569b107640 1 --2- 172.21.15.110:0/2337707472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5694128380 0x7f56941c2070 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f568800c480 tx=0x7f568800c940 comp rx=0 tx=0).stop 2024-05-09T09:47:04.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.153+0000 7f569b107640 1 -- 172.21.15.110:0/2337707472 shutdown_connections 2024-05-09T09:47:04.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.153+0000 7f569b107640 1 --2- 172.21.15.110:0/2337707472 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x7f567803bae0 0x7f567803df20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.153+0000 7f569b107640 1 --2- 172.21.15.110:0/2337707472 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5678036360 0x7f5678038820 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.153+0000 7f569b107640 1 --2- 172.21.15.110:0/2337707472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5694128380 0x7f56941c2070 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.153+0000 7f569b107640 1 -- 172.21.15.110:0/2337707472 >> 172.21.15.110:0/2337707472 conn(0x7f569409e230 msgr2=0x7f56941276d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:04.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.153+0000 7f569b107640 1 -- 172.21.15.110:0/2337707472 shutdown_connections 2024-05-09T09:47:04.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.153+0000 7f569b107640 1 -- 172.21.15.110:0/2337707472 wait complete. 2024-05-09T09:47:04.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.153+0000 7f5d3f5e8640 1 -- 172.21.15.110:0/1783728371 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5d3812a8d0 con 0x7f5d1c03ba90 2024-05-09T09:47:04.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.153+0000 7f5d2dffb640 1 -- 172.21.15.110:0/1783728371 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5d3000adb0 con 0x7f5d1c03ba90 2024-05-09T09:47:04.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.157+0000 7f5d3f5e8640 1 -- 172.21.15.110:0/1783728371 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f5d1c03ba90 msgr2=0x7f5d1c03ded0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.157+0000 7f5d3f5e8640 1 --2- 172.21.15.110:0/1783728371 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f5d1c03ba90 0x7f5d1c03ded0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.157+0000 7f5d3f5e8640 1 -- 172.21.15.110:0/1783728371 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5d1c036310 msgr2=0x7f5d1c0387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.157+0000 7f5d3f5e8640 1 --2- 172.21.15.110:0/1783728371 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5d1c036310 0x7f5d1c0387d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5d280ad000 tx=0x7f5d28008040 comp rx=0 tx=0).stop 2024-05-09T09:47:04.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.157+0000 7f5d3f5e8640 1 -- 172.21.15.110:0/1783728371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d38128380 msgr2=0x7f5d38129470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.157+0000 7f5d3f5e8640 1 --2- 172.21.15.110:0/1783728371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d38128380 0x7f5d38129470 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400b390 tx=0x7f5d3400b850 comp rx=0 tx=0).stop 2024-05-09T09:47:04.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.157+0000 7f5d3f5e8640 1 -- 172.21.15.110:0/1783728371 shutdown_connections 2024-05-09T09:47:04.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.157+0000 7f5d3f5e8640 1 --2- 172.21.15.110:0/1783728371 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f5d1c03ba90 0x7f5d1c03ded0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.157+0000 7f5d3f5e8640 1 --2- 172.21.15.110:0/1783728371 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5d1c036310 0x7f5d1c0387d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.157+0000 7f5d3f5e8640 1 --2- 172.21.15.110:0/1783728371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d38128380 0x7f5d38129470 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.157+0000 7f5d3f5e8640 1 -- 172.21.15.110:0/1783728371 >> 172.21.15.110:0/1783728371 conn(0x7f5d3809e230 msgr2=0x7f5d38122ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:04.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.157+0000 7f5d3f5e8640 1 -- 172.21.15.110:0/1783728371 shutdown_connections 2024-05-09T09:47:04.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.157+0000 7f5d3f5e8640 1 -- 172.21.15.110:0/1783728371 wait complete. 2024-05-09T09:47:04.169 INFO:teuthology.orchestra.run.smithi110.stdout:38654705668 2024-05-09T09:47:04.169 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-09T09:47:04.172 INFO:teuthology.orchestra.run.smithi110.stdout:38654705667 2024-05-09T09:47:04.172 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-09T09:47:04.173 INFO:teuthology.orchestra.run.smithi110.stdout:38654705667 2024-05-09T09:47:04.174 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-09T09:47:04.175 INFO:teuthology.orchestra.run.smithi110.stdout:38654705669 2024-05-09T09:47:04.175 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-09T09:47:04.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.273+0000 7f984b2cc640 1 Processor -- start 2024-05-09T09:47:04.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.273+0000 7f984b2cc640 1 -- start start 2024-05-09T09:47:04.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.273+0000 7f984b2cc640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f98440729f0 0x7f984406d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:04.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.273+0000 7f984b2cc640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f984406cf20 con 0x7f984406d890 2024-05-09T09:47:04.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.273+0000 7f984b2cc640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f9844095f40 con 0x7f98440729f0 2024-05-09T09:47:04.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.273+0000 7f9849068640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f98440729f0 0x7f984406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:04.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.273+0000 7f9848867640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f984406d890 0x7f984412eaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41190/0 (socket says 172.21.15.110:41190) 2024-05-09T09:47:04.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.273+0000 7f9848867640 1 -- 172.21.15.110:0/113361856 learned_addr learned my addr 172.21.15.110:0/113361856 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:47:04.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.273+0000 7f983bfff640 1 -- 172.21.15.110:0/113361856 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2480039423 0 0) 0x7f984406cf20 con 0x7f984406d890 2024-05-09T09:47:04.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.273+0000 7f983bfff640 1 -- 172.21.15.110:0/113361856 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9830003530 con 0x7f984406d890 2024-05-09T09:47:04.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.273+0000 7f9849068640 1 -- 172.21.15.110:0/113361856 >> v1:172.21.15.110:6789/0 conn(0x7f984406d890 legacy=0x7f984412eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.273+0000 7f9849068640 1 -- 172.21.15.110:0/113361856 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f984406dcc0 con 0x7f98440729f0 2024-05-09T09:47:04.275 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7fb84b441640 1 Processor -- start 2024-05-09T09:47:04.275 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7f9849068640 1 --2- 172.21.15.110:0/113361856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98440729f0 0x7f984406d350 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9840009740 tx=0x7f984001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab81641cc9a4014 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:04.275 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7fb84b441640 1 -- start start 2024-05-09T09:47:04.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7f983bfff640 1 -- 172.21.15.110:0/113361856 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98400b0070 con 0x7f98440729f0 2024-05-09T09:47:04.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7f983bfff640 1 -- 172.21.15.110:0/113361856 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98400ab530 con 0x7f98440729f0 2024-05-09T09:47:04.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7f983bfff640 1 -- 172.21.15.110:0/113361856 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98400ab830 con 0x7f98440729f0 2024-05-09T09:47:04.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7fb84b441640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb84412f030 0x7fb84412f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:04.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7fb84b441640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb84412ec00 con 0x7fb844072890 2024-05-09T09:47:04.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7fb84b441640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fb84406d490 con 0x7fb84412f030 2024-05-09T09:47:04.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7fb8491dd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb84412f030 0x7fb84412f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:04.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7fb8491dd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb84412f030 0x7fb84412f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59536/0 (socket says 172.21.15.110:59536) 2024-05-09T09:47:04.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7fb8489dc640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fb844072890 0x7fb844072cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41196/0 (socket says 172.21.15.110:41196) 2024-05-09T09:47:04.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7fb8491dd640 1 -- 172.21.15.110:0/90362823 learned_addr learned my addr 172.21.15.110:0/90362823 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:04.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7fb8491dd640 1 -- 172.21.15.110:0/90362823 >> v1:172.21.15.110:6789/0 conn(0x7fb844072890 legacy=0x7fb844072cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7fb8491dd640 1 -- 172.21.15.110:0/90362823 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb84406cfe0 con 0x7fb84412f030 2024-05-09T09:47:04.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7f984b2cc640 1 -- 172.21.15.110:0/113361856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98440729f0 msgr2=0x7f984406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7f984b2cc640 1 --2- 172.21.15.110:0/113361856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98440729f0 0x7f984406d350 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9840009740 tx=0x7f984001c400 comp rx=0 tx=0).stop 2024-05-09T09:47:04.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7f984b2cc640 1 -- 172.21.15.110:0/113361856 shutdown_connections 2024-05-09T09:47:04.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7f984b2cc640 1 --2- 172.21.15.110:0/113361856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98440729f0 0x7f984406d350 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7f984b2cc640 1 -- 172.21.15.110:0/113361856 >> 172.21.15.110:0/113361856 conn(0x7f984409e2a0 msgr2=0x7f984409e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:04.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7f984b2cc640 1 -- 172.21.15.110:0/113361856 shutdown_connections 2024-05-09T09:47:04.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7f984b2cc640 1 -- 172.21.15.110:0/113361856 wait complete. 2024-05-09T09:47:04.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7f984b2cc640 1 Processor -- start 2024-05-09T09:47:04.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7f984b2cc640 1 -- start start 2024-05-09T09:47:04.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7f984b2cc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f984406d890 0x7f984412c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:04.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7f984b2cc640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9844137800 con 0x7f984406d890 2024-05-09T09:47:04.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7f9849068640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f984406d890 0x7f984412c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:04.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7f9849068640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f984406d890 0x7f984412c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59552/0 (socket says 172.21.15.110:59552) 2024-05-09T09:47:04.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7f9849068640 1 -- 172.21.15.110:0/416343452 learned_addr learned my addr 172.21.15.110:0/416343452 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:04.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7f9849068640 1 -- 172.21.15.110:0/416343452 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f984412ea50 con 0x7f984406d890 2024-05-09T09:47:04.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7f9849068640 1 --2- 172.21.15.110:0/416343452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f984406d890 0x7f984412c880 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9840000c10 tx=0x7f98400191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:04.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7f9839ffb640 1 -- 172.21.15.110:0/416343452 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98400b9020 con 0x7f984406d890 2024-05-09T09:47:04.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7f9839ffb640 1 -- 172.21.15.110:0/416343452 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98400b5480 con 0x7f984406d890 2024-05-09T09:47:04.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.277+0000 7f984b2cc640 1 -- 172.21.15.110:0/416343452 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9844130e00 con 0x7f984406d890 2024-05-09T09:47:04.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.281+0000 7fb8491dd640 1 --2- 172.21.15.110:0/90362823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb84412f030 0x7fb84412f410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb8400097f0 tx=0x7fb84001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f4bb205e83eae server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:04.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.281+0000 7f9839ffb640 1 -- 172.21.15.110:0/416343452 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98400b0040 con 0x7f984406d890 2024-05-09T09:47:04.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.281+0000 7f984b2cc640 1 -- 172.21.15.110:0/416343452 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9844130690 con 0x7f984406d890 2024-05-09T09:47:04.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.281+0000 7fb83bfff640 1 -- 172.21.15.110:0/90362823 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8400b0070 con 0x7fb84412f030 2024-05-09T09:47:04.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.281+0000 7fb83bfff640 1 -- 172.21.15.110:0/90362823 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8400ab530 con 0x7fb84412f030 2024-05-09T09:47:04.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.281+0000 7fb83bfff640 1 -- 172.21.15.110:0/90362823 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8400ab830 con 0x7fb84412f030 2024-05-09T09:47:04.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.281+0000 7f9839ffb640 1 -- 172.21.15.110:0/416343452 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f98400bc020 con 0x7f984406d890 2024-05-09T09:47:04.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.281+0000 7f984b2cc640 1 -- 172.21.15.110:0/416343452 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9844063710 con 0x7f984406d890 2024-05-09T09:47:04.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.281+0000 7f9839ffb640 1 --2- 172.21.15.110:0/416343452 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f98280362f0 0x7f98280387b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:04.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.281+0000 7f9839ffb640 1 -- 172.21.15.110:0/416343452 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f98400e6120 con 0x7f984406d890 2024-05-09T09:47:04.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.281+0000 7fb84b441640 1 -- 172.21.15.110:0/90362823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb84412f030 msgr2=0x7fb84412f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.281+0000 7fb84b441640 1 --2- 172.21.15.110:0/90362823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb84412f030 0x7fb84412f410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb8400097f0 tx=0x7fb84001c430 comp rx=0 tx=0).stop 2024-05-09T09:47:04.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.281+0000 7fb84b441640 1 -- 172.21.15.110:0/90362823 shutdown_connections 2024-05-09T09:47:04.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.281+0000 7fb84b441640 1 --2- 172.21.15.110:0/90362823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb84412f030 0x7fb84412f410 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.281+0000 7fb84b441640 1 -- 172.21.15.110:0/90362823 >> 172.21.15.110:0/90362823 conn(0x7fb84409e230 msgr2=0x7fb84409e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:04.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.281+0000 7fb84b441640 1 -- 172.21.15.110:0/90362823 shutdown_connections 2024-05-09T09:47:04.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.281+0000 7fb84b441640 1 -- 172.21.15.110:0/90362823 wait complete. 2024-05-09T09:47:04.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.281+0000 7f9848867640 1 --2- 172.21.15.110:0/416343452 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f98280362f0 0x7f98280387b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:04.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.281+0000 7f9848867640 1 --2- 172.21.15.110:0/416343452 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f98280362f0 0x7f98280387b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9834007fd0 tx=0x7f9834007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:04.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.281+0000 7fb84b441640 1 Processor -- start 2024-05-09T09:47:04.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.281+0000 7fb84b441640 1 -- start start 2024-05-09T09:47:04.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.285+0000 7fb84b441640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb844072890 0x7fb844122ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:04.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.285+0000 7fb84b441640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb844137890 con 0x7fb844072890 2024-05-09T09:47:04.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.285+0000 7fb8491dd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb844072890 0x7fb844122ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:04.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.285+0000 7fb8491dd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb844072890 0x7fb844122ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59556/0 (socket says 172.21.15.110:59556) 2024-05-09T09:47:04.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.285+0000 7fb8491dd640 1 -- 172.21.15.110:0/530004237 learned_addr learned my addr 172.21.15.110:0/530004237 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:04.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.285+0000 7fb8491dd640 1 -- 172.21.15.110:0/530004237 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb844134030 con 0x7fb844072890 2024-05-09T09:47:04.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.285+0000 7fb8491dd640 1 --2- 172.21.15.110:0/530004237 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb844072890 0x7fb844122ef0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb8400097f0 tx=0x7fb8400191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:04.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.285+0000 7fb839ffb640 1 -- 172.21.15.110:0/530004237 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8400b0040 con 0x7fb844072890 2024-05-09T09:47:04.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.285+0000 7fb839ffb640 1 -- 172.21.15.110:0/530004237 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8400b4550 con 0x7fb844072890 2024-05-09T09:47:04.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.285+0000 7fb84b441640 1 -- 172.21.15.110:0/530004237 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb844134870 con 0x7fb844072890 2024-05-09T09:47:04.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.285+0000 7fb839ffb640 1 -- 172.21.15.110:0/530004237 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8400b4850 con 0x7fb844072890 2024-05-09T09:47:04.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.285+0000 7fb84b441640 1 -- 172.21.15.110:0/530004237 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb844125620 con 0x7fb844072890 2024-05-09T09:47:04.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.285+0000 7f9839ffb640 1 -- 172.21.15.110:0/416343452 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9840015ff0 con 0x7f984406d890 2024-05-09T09:47:04.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.285+0000 7fb839ffb640 1 -- 172.21.15.110:0/530004237 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fb8400bb030 con 0x7fb844072890 2024-05-09T09:47:04.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.285+0000 7fb84b441640 1 -- 172.21.15.110:0/530004237 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb844063710 con 0x7fb844072890 2024-05-09T09:47:04.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.285+0000 7fb839ffb640 1 --2- 172.21.15.110:0/530004237 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb828036310 0x7fb8280387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:04.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.285+0000 7fb839ffb640 1 -- 172.21.15.110:0/530004237 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7fb8400b9070 con 0x7fb844072890 2024-05-09T09:47:04.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.289+0000 7fb8489dc640 1 --2- 172.21.15.110:0/530004237 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb828036310 0x7fb8280387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:04.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.289+0000 7fb8489dc640 1 --2- 172.21.15.110:0/530004237 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb828036310 0x7fb8280387d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb834001600 tx=0x7fb834007a50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:04.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.293+0000 7fb839ffb640 1 -- 172.21.15.110:0/530004237 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb8400c2060 con 0x7fb844072890 2024-05-09T09:47:04.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.325+0000 7f924bac4640 1 Processor -- start 2024-05-09T09:47:04.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.325+0000 7f924bac4640 1 -- start start 2024-05-09T09:47:04.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.325+0000 7f924bac4640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f924412cc30 0x7f924412d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:04.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.325+0000 7f924bac4640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f924409c3d0 con 0x7f924412d550 2024-05-09T09:47:04.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.325+0000 7f924bac4640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f924409d510 con 0x7f924412cc30 2024-05-09T09:47:04.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.325+0000 7f924905f640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f924412d550 0x7f924409aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41202/0 (socket says 172.21.15.110:41202) 2024-05-09T09:47:04.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.329+0000 7f924905f640 1 -- 172.21.15.110:0/1398229223 learned_addr learned my addr 172.21.15.110:0/1398229223 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:47:04.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.329+0000 7f9249860640 1 --2- 172.21.15.110:0/1398229223 >> v2:172.21.15.110:3300/0 conn(0x7f924412cc30 0x7f924412d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:04.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.329+0000 7f6875d89640 1 Processor -- start 2024-05-09T09:47:04.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.329+0000 7f9249860640 1 -- 172.21.15.110:0/1398229223 >> v1:172.21.15.110:6789/0 conn(0x7f924412d550 legacy=0x7f924409aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.329+0000 7f6875d89640 1 -- start start 2024-05-09T09:47:04.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.329+0000 7f9249860640 1 -- 172.21.15.110:0/1398229223 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f924409e590 con 0x7f924412cc30 2024-05-09T09:47:04.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.329+0000 7f6875d89640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6870131e90 0x7f6870134280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:04.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.329+0000 7f6875d89640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f687012b790 con 0x7f687012bbc0 2024-05-09T09:47:04.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.329+0000 7f6875d89640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f68700982e0 con 0x7f6870131e90 2024-05-09T09:47:04.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.329+0000 7f686effd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6870131e90 0x7f6870134280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:04.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.329+0000 7f686effd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6870131e90 0x7f6870134280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59578/0 (socket says 172.21.15.110:59578) 2024-05-09T09:47:04.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.329+0000 7f686effd640 1 -- 172.21.15.110:0/4265511937 learned_addr learned my addr 172.21.15.110:0/4265511937 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:04.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.329+0000 7f686effd640 1 -- 172.21.15.110:0/4265511937 >> v1:172.21.15.110:6789/0 conn(0x7f687012bbc0 legacy=0x7f687012bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.329+0000 7f686effd640 1 -- 172.21.15.110:0/4265511937 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6870072b60 con 0x7f6870131e90 2024-05-09T09:47:04.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.329+0000 7f9249860640 1 --2- 172.21.15.110:0/1398229223 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f924412cc30 0x7f924412d010 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9240009740 tx=0x7f924001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818148d897a82877 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:04.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.329+0000 7f924885e640 1 -- 172.21.15.110:0/1398229223 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92400b0070 con 0x7f924412cc30 2024-05-09T09:47:04.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.329+0000 7f924885e640 1 -- 172.21.15.110:0/1398229223 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92400ab530 con 0x7f924412cc30 2024-05-09T09:47:04.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.329+0000 7f924885e640 1 -- 172.21.15.110:0/1398229223 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92400ab830 con 0x7f924412cc30 2024-05-09T09:47:04.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.329+0000 7f924bac4640 1 -- 172.21.15.110:0/1398229223 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f924412cc30 msgr2=0x7f924412d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.329+0000 7f924bac4640 1 --2- 172.21.15.110:0/1398229223 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f924412cc30 0x7f924412d010 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9240009740 tx=0x7f924001c370 comp rx=0 tx=0).stop 2024-05-09T09:47:04.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.329+0000 7f686effd640 1 --2- 172.21.15.110:0/4265511937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6870131e90 0x7f6870134280 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f68640097f0 tx=0x7f686401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73eb282cd7c1025 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:04.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.329+0000 7f924bac4640 1 -- 172.21.15.110:0/1398229223 shutdown_connections 2024-05-09T09:47:04.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.329+0000 7f924bac4640 1 --2- 172.21.15.110:0/1398229223 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f924412cc30 0x7f924412d010 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.329+0000 7f924bac4640 1 -- 172.21.15.110:0/1398229223 >> 172.21.15.110:0/1398229223 conn(0x7f9244070530 msgr2=0x7f9244072950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:04.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.329+0000 7f686e7fc640 1 -- 172.21.15.110:0/4265511937 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68640b0070 con 0x7f6870131e90 2024-05-09T09:47:04.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.329+0000 7f924bac4640 1 -- 172.21.15.110:0/1398229223 shutdown_connections 2024-05-09T09:47:04.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.329+0000 7f924bac4640 1 -- 172.21.15.110:0/1398229223 wait complete. 2024-05-09T09:47:04.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.329+0000 7f686e7fc640 1 -- 172.21.15.110:0/4265511937 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68640ab530 con 0x7f6870131e90 2024-05-09T09:47:04.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.329+0000 7f686e7fc640 1 -- 172.21.15.110:0/4265511937 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68640ab830 con 0x7f6870131e90 2024-05-09T09:47:04.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f6875d89640 1 -- 172.21.15.110:0/4265511937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6870131e90 msgr2=0x7f6870134280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f6875d89640 1 --2- 172.21.15.110:0/4265511937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6870131e90 0x7f6870134280 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f68640097f0 tx=0x7f686401c430 comp rx=0 tx=0).stop 2024-05-09T09:47:04.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f6875d89640 1 -- 172.21.15.110:0/4265511937 shutdown_connections 2024-05-09T09:47:04.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f6875d89640 1 --2- 172.21.15.110:0/4265511937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6870131e90 0x7f6870134280 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f6875d89640 1 -- 172.21.15.110:0/4265511937 >> 172.21.15.110:0/4265511937 conn(0x7f687009e2a0 msgr2=0x7f687009e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:04.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f6875d89640 1 -- 172.21.15.110:0/4265511937 shutdown_connections 2024-05-09T09:47:04.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f6875d89640 1 -- 172.21.15.110:0/4265511937 wait complete. 2024-05-09T09:47:04.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f924bac4640 1 Processor -- start 2024-05-09T09:47:04.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f924bac4640 1 -- start start 2024-05-09T09:47:04.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f924bac4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f924412cc30 0x7f924411b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:04.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f924bac4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f924409bd20 con 0x7f924412cc30 2024-05-09T09:47:04.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f9249860640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f924412cc30 0x7f924411b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:04.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f9249860640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f924412cc30 0x7f924411b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59590/0 (socket says 172.21.15.110:59590) 2024-05-09T09:47:04.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f9249860640 1 -- 172.21.15.110:0/2605640984 learned_addr learned my addr 172.21.15.110:0/2605640984 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:04.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f6875d89640 1 Processor -- start 2024-05-09T09:47:04.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f6875d89640 1 -- start start 2024-05-09T09:47:04.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f9249860640 1 -- 172.21.15.110:0/2605640984 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f924411d780 con 0x7f924412cc30 2024-05-09T09:47:04.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f9249860640 1 --2- 172.21.15.110:0/2605640984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f924412cc30 0x7f924411b840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9240019fa0 tx=0x7f924001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:04.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f923a7fc640 1 -- 172.21.15.110:0/2605640984 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92400b0050 con 0x7f924412cc30 2024-05-09T09:47:04.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f6875d89640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f687012bbc0 0x7f68701c6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:04.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f6875d89640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f68701371f0 con 0x7f687012bbc0 2024-05-09T09:47:04.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f924bac4640 1 -- 172.21.15.110:0/2605640984 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f924411e410 con 0x7f924412cc30 2024-05-09T09:47:04.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f924bac4640 1 -- 172.21.15.110:0/2605640984 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f924411bd80 con 0x7f924412cc30 2024-05-09T09:47:04.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f923a7fc640 1 -- 172.21.15.110:0/2605640984 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92400b1040 con 0x7f924412cc30 2024-05-09T09:47:04.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f923a7fc640 1 -- 172.21.15.110:0/2605640984 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92400ab530 con 0x7f924412cc30 2024-05-09T09:47:04.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f686f7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f687012bbc0 0x7f68701c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:04.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f686f7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f687012bbc0 0x7f68701c6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59604/0 (socket says 172.21.15.110:59604) 2024-05-09T09:47:04.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f686f7fe640 1 -- 172.21.15.110:0/417488043 learned_addr learned my addr 172.21.15.110:0/417488043 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:04.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f686f7fe640 1 -- 172.21.15.110:0/417488043 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f687009ad20 con 0x7f687012bbc0 2024-05-09T09:47:04.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f686f7fe640 1 --2- 172.21.15.110:0/417488043 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f687012bbc0 0x7f68701c6590 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f686000c3a0 tx=0x7f686000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:04.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f6857fff640 1 -- 172.21.15.110:0/417488043 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6860005150 con 0x7f687012bbc0 2024-05-09T09:47:04.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f6857fff640 1 -- 172.21.15.110:0/417488043 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68600052f0 con 0x7f687012bbc0 2024-05-09T09:47:04.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f6875d89640 1 -- 172.21.15.110:0/417488043 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6870125aa0 con 0x7f687012bbc0 2024-05-09T09:47:04.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f6857fff640 1 -- 172.21.15.110:0/417488043 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68600067e0 con 0x7f687012bbc0 2024-05-09T09:47:04.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f923a7fc640 1 -- 172.21.15.110:0/2605640984 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f92400be030 con 0x7f924412cc30 2024-05-09T09:47:04.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f923a7fc640 1 --2- 172.21.15.110:0/2605640984 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f92280364b0 0x7f9228038970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:04.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f923a7fc640 1 -- 172.21.15.110:0/2605640984 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f92400bc070 con 0x7f924412cc30 2024-05-09T09:47:04.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f6875d89640 1 -- 172.21.15.110:0/417488043 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6870124290 con 0x7f687012bbc0 2024-05-09T09:47:04.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.333+0000 7f924905f640 1 --2- 172.21.15.110:0/2605640984 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f92280364b0 0x7f9228038970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:04.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.337+0000 7f924bac4640 1 -- 172.21.15.110:0/2605640984 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f922c005090 con 0x7f924412cc30 2024-05-09T09:47:04.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.337+0000 7f6875d89640 1 -- 172.21.15.110:0/417488043 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6870063710 con 0x7f687012bbc0 2024-05-09T09:47:04.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.337+0000 7f6857fff640 1 -- 172.21.15.110:0/417488043 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f6860019020 con 0x7f687012bbc0 2024-05-09T09:47:04.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.337+0000 7f924905f640 1 --2- 172.21.15.110:0/2605640984 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f92280364b0 0x7f9228038970 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9234005890 tx=0x7f9234007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:04.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.337+0000 7f6857fff640 1 --2- 172.21.15.110:0/417488043 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f685c036310 0x7f685c0387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:04.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.341+0000 7f6857fff640 1 -- 172.21.15.110:0/417488043 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f6860046ef0 con 0x7f687012bbc0 2024-05-09T09:47:04.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.341+0000 7f686effd640 1 --2- 172.21.15.110:0/417488043 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f685c036310 0x7f685c0387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:04.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.341+0000 7f686effd640 1 --2- 172.21.15.110:0/417488043 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f685c036310 0x7f685c0387d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f68640ad000 tx=0x7f68640a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:04.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.345+0000 7f923a7fc640 1 -- 172.21.15.110:0/2605640984 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f92400c5020 con 0x7f924412cc30 2024-05-09T09:47:04.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.353+0000 7f6857fff640 1 -- 172.21.15.110:0/417488043 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f686001a7a0 con 0x7f687012bbc0 2024-05-09T09:47:04.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.465+0000 7fb84b441640 1 -- 172.21.15.110:0/530004237 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb844067fd0 con 0x7fb844072890 2024-05-09T09:47:04.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.465+0000 7fb839ffb640 1 -- 172.21.15.110:0/530004237 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb8400160b0 con 0x7fb844072890 2024-05-09T09:47:04.465 INFO:teuthology.orchestra.run.smithi110.stdout:38654705666 2024-05-09T09:47:04.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.469+0000 7fb84b441640 1 -- 172.21.15.110:0/530004237 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb828036310 msgr2=0x7fb8280387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.469+0000 7fb84b441640 1 --2- 172.21.15.110:0/530004237 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb828036310 0x7fb8280387d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb834001600 tx=0x7fb834007a50 comp rx=0 tx=0).stop 2024-05-09T09:47:04.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.469+0000 7fb84b441640 1 -- 172.21.15.110:0/530004237 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb844072890 msgr2=0x7fb844122ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.469+0000 7fb84b441640 1 --2- 172.21.15.110:0/530004237 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb844072890 0x7fb844122ef0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb8400097f0 tx=0x7fb8400191d0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.469+0000 7fb84b441640 1 -- 172.21.15.110:0/530004237 shutdown_connections 2024-05-09T09:47:04.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.469+0000 7fb84b441640 1 --2- 172.21.15.110:0/530004237 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb828036310 0x7fb8280387d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.469+0000 7fb84b441640 1 --2- 172.21.15.110:0/530004237 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb844072890 0x7fb844122ef0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.469+0000 7fb84b441640 1 -- 172.21.15.110:0/530004237 >> 172.21.15.110:0/530004237 conn(0x7fb84409e230 msgr2=0x7fb8440996c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:04.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.469+0000 7fb84b441640 1 -- 172.21.15.110:0/530004237 shutdown_connections 2024-05-09T09:47:04.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.469+0000 7fb84b441640 1 -- 172.21.15.110:0/530004237 wait complete. 2024-05-09T09:47:04.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.473+0000 7f984b2cc640 1 -- 172.21.15.110:0/416343452 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f9844067fd0 con 0x7f984406d890 2024-05-09T09:47:04.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.473+0000 7f9839ffb640 1 -- 172.21.15.110:0/416343452 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f98400c3090 con 0x7f984406d890 2024-05-09T09:47:04.471 INFO:teuthology.orchestra.run.smithi110.stdout:38654705667 2024-05-09T09:47:04.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.473+0000 7f984b2cc640 1 -- 172.21.15.110:0/416343452 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f98280362f0 msgr2=0x7f98280387b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.473+0000 7f984b2cc640 1 --2- 172.21.15.110:0/416343452 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f98280362f0 0x7f98280387b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9834007fd0 tx=0x7f9834007980 comp rx=0 tx=0).stop 2024-05-09T09:47:04.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.473+0000 7f984b2cc640 1 -- 172.21.15.110:0/416343452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f984406d890 msgr2=0x7f984412c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.473+0000 7f984b2cc640 1 --2- 172.21.15.110:0/416343452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f984406d890 0x7f984412c880 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9840000c10 tx=0x7f98400191a0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.473+0000 7f984b2cc640 1 -- 172.21.15.110:0/416343452 shutdown_connections 2024-05-09T09:47:04.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.473+0000 7f984b2cc640 1 --2- 172.21.15.110:0/416343452 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f98280362f0 0x7f98280387b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.473+0000 7f984b2cc640 1 --2- 172.21.15.110:0/416343452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f984406d890 0x7f984412c880 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9840000c10 tx=0x7f98400191a0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.473+0000 7f984b2cc640 1 -- 172.21.15.110:0/416343452 >> 172.21.15.110:0/416343452 conn(0x7f984409e2a0 msgr2=0x7f9844124f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:04.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.473+0000 7f984b2cc640 1 -- 172.21.15.110:0/416343452 shutdown_connections 2024-05-09T09:47:04.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.473+0000 7f984b2cc640 1 -- 172.21.15.110:0/416343452 wait complete. 2024-05-09T09:47:04.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.0 2024-05-09T09:47:04.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.3 2024-05-09T09:47:04.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.505+0000 7f924bac4640 1 -- 172.21.15.110:0/2605640984 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f922c005380 con 0x7f924412cc30 2024-05-09T09:47:04.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.505+0000 7f923a7fc640 1 -- 172.21.15.110:0/2605640984 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9240015ff0 con 0x7f924412cc30 2024-05-09T09:47:04.504 INFO:teuthology.orchestra.run.smithi110.stdout:38654705668 2024-05-09T09:47:04.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.505+0000 7f924bac4640 1 -- 172.21.15.110:0/2605640984 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f92280364b0 msgr2=0x7f9228038970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.505+0000 7f924bac4640 1 --2- 172.21.15.110:0/2605640984 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f92280364b0 0x7f9228038970 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9234005890 tx=0x7f9234007a90 comp rx=0 tx=0).stop 2024-05-09T09:47:04.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.505+0000 7f924bac4640 1 -- 172.21.15.110:0/2605640984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f924412cc30 msgr2=0x7f924411b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.505+0000 7f924bac4640 1 --2- 172.21.15.110:0/2605640984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f924412cc30 0x7f924411b840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9240019fa0 tx=0x7f924001abb0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.505+0000 7f924bac4640 1 -- 172.21.15.110:0/2605640984 shutdown_connections 2024-05-09T09:47:04.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.505+0000 7f924bac4640 1 --2- 172.21.15.110:0/2605640984 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f92280364b0 0x7f9228038970 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.505+0000 7f924bac4640 1 --2- 172.21.15.110:0/2605640984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f924412cc30 0x7f924411b840 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.505+0000 7f924bac4640 1 -- 172.21.15.110:0/2605640984 >> 172.21.15.110:0/2605640984 conn(0x7f9244070530 msgr2=0x7f9244131230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:04.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.505+0000 7f924bac4640 1 -- 172.21.15.110:0/2605640984 shutdown_connections 2024-05-09T09:47:04.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.505+0000 7f924bac4640 1 -- 172.21.15.110:0/2605640984 wait complete. 2024-05-09T09:47:04.520 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.2 2024-05-09T09:47:04.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.525+0000 7f6875d89640 1 -- 172.21.15.110:0/417488043 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6870067fd0 con 0x7f687012bbc0 2024-05-09T09:47:04.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.525+0000 7f6857fff640 1 -- 172.21.15.110:0/417488043 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6860007550 con 0x7f687012bbc0 2024-05-09T09:47:04.524 INFO:teuthology.orchestra.run.smithi110.stdout:38654705666 2024-05-09T09:47:04.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.525+0000 7f6875d89640 1 -- 172.21.15.110:0/417488043 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f685c036310 msgr2=0x7f685c0387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.525+0000 7f6875d89640 1 --2- 172.21.15.110:0/417488043 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f685c036310 0x7f685c0387d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f68640ad000 tx=0x7f68640a6000 comp rx=0 tx=0).stop 2024-05-09T09:47:04.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.525+0000 7f6875d89640 1 -- 172.21.15.110:0/417488043 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f687012bbc0 msgr2=0x7f68701c6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:04.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.525+0000 7f6875d89640 1 --2- 172.21.15.110:0/417488043 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f687012bbc0 0x7f68701c6590 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f686000c3a0 tx=0x7f686000c860 comp rx=0 tx=0).stop 2024-05-09T09:47:04.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.525+0000 7f6875d89640 1 -- 172.21.15.110:0/417488043 shutdown_connections 2024-05-09T09:47:04.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.525+0000 7f6875d89640 1 --2- 172.21.15.110:0/417488043 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f685c036310 0x7f685c0387d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.525+0000 7f6875d89640 1 --2- 172.21.15.110:0/417488043 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f687012bbc0 0x7f68701c6590 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:04.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.525+0000 7f6875d89640 1 -- 172.21.15.110:0/417488043 >> 172.21.15.110:0/417488043 conn(0x7f687009e2a0 msgr2=0x7f687012fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:04.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.525+0000 7f6875d89640 1 -- 172.21.15.110:0/417488043 shutdown_connections 2024-05-09T09:47:04.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:04.525+0000 7f6875d89640 1 -- 172.21.15.110:0/417488043 wait complete. 2024-05-09T09:47:04.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.1 2024-05-09T09:47:05.491 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-09T09:47:05.491 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-09T09:47:05.521 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-09T09:47:05.540 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-09T09:47:05.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.613+0000 7f4fc620a640 1 Processor -- start 2024-05-09T09:47:05.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.613+0000 7f4fc620a640 1 -- start start 2024-05-09T09:47:05.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.613+0000 7f4fc620a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4fc012fc70 0x7f4fc0132060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:05.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.613+0000 7f4fc620a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fc009dd90 con 0x7f4fc009c180 2024-05-09T09:47:05.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.613+0000 7f4fc620a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f4fc009d650 con 0x7f4fc012fc70 2024-05-09T09:47:05.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.613+0000 7f4fbeffd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4fc012fc70 0x7f4fc0132060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:05.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.613+0000 7f4fbf7fe640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f4fc009c180 0x7f4fc009c560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41214/0 (socket says 172.21.15.110:41214) 2024-05-09T09:47:05.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.613+0000 7f4fbf7fe640 1 -- 172.21.15.110:0/3102380337 learned_addr learned my addr 172.21.15.110:0/3102380337 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:47:05.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.613+0000 7f4fbeffd640 1 -- 172.21.15.110:0/3102380337 >> v1:172.21.15.110:6789/0 conn(0x7f4fc009c180 legacy=0x7f4fc009c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:05.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.613+0000 7f4fbeffd640 1 -- 172.21.15.110:0/3102380337 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc009f2c0 con 0x7f4fc012fc70 2024-05-09T09:47:05.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.617+0000 7f4fbeffd640 1 --2- 172.21.15.110:0/3102380337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fc012fc70 0x7f4fc0132060 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4fc009f490 tx=0x7f4fb401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7626e63012a4c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:05.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.617+0000 7f4fbe7fc640 1 -- 172.21.15.110:0/3102380337 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fb40b1070 con 0x7f4fc012fc70 2024-05-09T09:47:05.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.617+0000 7f4fbe7fc640 1 -- 172.21.15.110:0/3102380337 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fb40ac520 con 0x7f4fc012fc70 2024-05-09T09:47:05.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.617+0000 7f4fbe7fc640 1 -- 172.21.15.110:0/3102380337 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fb40ac820 con 0x7f4fc012fc70 2024-05-09T09:47:05.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.617+0000 7f4fc620a640 1 -- 172.21.15.110:0/3102380337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fc012fc70 msgr2=0x7f4fc0132060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:05.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.617+0000 7f4fc620a640 1 --2- 172.21.15.110:0/3102380337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fc012fc70 0x7f4fc0132060 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4fc009f490 tx=0x7f4fb401c370 comp rx=0 tx=0).stop 2024-05-09T09:47:05.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.617+0000 7f4fc620a640 1 -- 172.21.15.110:0/3102380337 shutdown_connections 2024-05-09T09:47:05.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.617+0000 7f4fc620a640 1 --2- 172.21.15.110:0/3102380337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fc012fc70 0x7f4fc0132060 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:05.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.617+0000 7f4fc620a640 1 -- 172.21.15.110:0/3102380337 >> 172.21.15.110:0/3102380337 conn(0x7f4fc0071620 msgr2=0x7f4fc0071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:05.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.617+0000 7f4fc620a640 1 -- 172.21.15.110:0/3102380337 shutdown_connections 2024-05-09T09:47:05.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.617+0000 7f4fc620a640 1 -- 172.21.15.110:0/3102380337 wait complete. 2024-05-09T09:47:05.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.617+0000 7ff266538640 1 Processor -- start 2024-05-09T09:47:05.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.617+0000 7ff266538640 1 -- start start 2024-05-09T09:47:05.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.617+0000 7f4fc620a640 1 Processor -- start 2024-05-09T09:47:05.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.617+0000 7f4fc620a640 1 -- start start 2024-05-09T09:47:05.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.621+0000 7ff266538640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff26012f030 0x7ff26012f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:05.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.621+0000 7f4fc620a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fc009c180 0x7f4fc006df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:05.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.621+0000 7f4fc620a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc0134f40 con 0x7f4fc009c180 2024-05-09T09:47:05.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.621+0000 7ff266538640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff26012ec00 con 0x7ff260072890 2024-05-09T09:47:05.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.621+0000 7ff266538640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7ff26006d490 con 0x7ff26012f030 2024-05-09T09:47:05.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.621+0000 7ff25f7fe640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ff260072890 0x7ff260072cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41220/0 (socket says 172.21.15.110:41220) 2024-05-09T09:47:05.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.621+0000 7ff25ffff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff26012f030 0x7ff26012f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:05.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.621+0000 7ff25f7fe640 1 -- 172.21.15.110:0/2670684369 learned_addr learned my addr 172.21.15.110:0/2670684369 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:47:05.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.621+0000 7f4fbf7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fc009c180 0x7f4fc006df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:05.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.621+0000 7f4fbf7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fc009c180 0x7f4fc006df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59630/0 (socket says 172.21.15.110:59630) 2024-05-09T09:47:05.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.621+0000 7f4fbf7fe640 1 -- 172.21.15.110:0/1763478159 learned_addr learned my addr 172.21.15.110:0/1763478159 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:05.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.621+0000 7ff25effd640 1 -- 172.21.15.110:0/2670684369 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2689396714 0 0) 0x7ff26012ec00 con 0x7ff260072890 2024-05-09T09:47:05.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.621+0000 7ff25effd640 1 -- 172.21.15.110:0/2670684369 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff248003530 con 0x7ff260072890 2024-05-09T09:47:05.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.621+0000 7f4fbf7fe640 1 -- 172.21.15.110:0/1763478159 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc0121330 con 0x7f4fc009c180 2024-05-09T09:47:05.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.621+0000 7ff25ffff640 1 -- 172.21.15.110:0/2670684369 >> v1:172.21.15.110:6789/0 conn(0x7ff260072890 legacy=0x7ff260072cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:05.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.621+0000 7ff25effd640 1 -- 172.21.15.110:0/2670684369 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3467931888 0 0) 0x7ff248003530 con 0x7ff260072890 2024-05-09T09:47:05.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.621+0000 7ff25ffff640 1 -- 172.21.15.110:0/2670684369 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff26006cfe0 con 0x7ff26012f030 2024-05-09T09:47:05.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.621+0000 7f4fbf7fe640 1 --2- 172.21.15.110:0/1763478159 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fc009c180 0x7f4fc006df50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4fb000c480 tx=0x7f4fb000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:05.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.621+0000 7f4fa7fff640 1 -- 172.21.15.110:0/1763478159 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fb0017070 con 0x7f4fc009c180 2024-05-09T09:47:05.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.621+0000 7f4fa7fff640 1 -- 172.21.15.110:0/1763478159 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fb0005c20 con 0x7f4fc009c180 2024-05-09T09:47:05.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.621+0000 7f4fc620a640 1 -- 172.21.15.110:0/1763478159 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc0120fe0 con 0x7f4fc009c180 2024-05-09T09:47:05.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.621+0000 7f4fa7fff640 1 -- 172.21.15.110:0/1763478159 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fb0007070 con 0x7f4fc009c180 2024-05-09T09:47:05.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.621+0000 7f4fc620a640 1 -- 172.21.15.110:0/1763478159 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc011fea0 con 0x7f4fc009c180 2024-05-09T09:47:05.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.621+0000 7f4fc620a640 1 -- 172.21.15.110:0/1763478159 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fc0063710 con 0x7f4fc009c180 2024-05-09T09:47:05.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.621+0000 7f4fa7fff640 1 -- 172.21.15.110:0/1763478159 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f4fb001a070 con 0x7f4fc009c180 2024-05-09T09:47:05.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.621+0000 7f4fa7fff640 1 --2- 172.21.15.110:0/1763478159 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4fac036310 0x7f4fac0387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:05.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.621+0000 7f4fa7fff640 1 -- 172.21.15.110:0/1763478159 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f4fb0047fa0 con 0x7f4fc009c180 2024-05-09T09:47:05.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.621+0000 7f4fbeffd640 1 --2- 172.21.15.110:0/1763478159 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4fac036310 0x7f4fac0387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:05.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.621+0000 7ff25ffff640 1 --2- 172.21.15.110:0/2670684369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff26012f030 0x7ff26012f410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff250009740 tx=0x7ff25001c290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f498c9ece39bd5c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:05.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.625+0000 7f4fbeffd640 1 --2- 172.21.15.110:0/1763478159 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4fac036310 0x7f4fac0387d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40ae000 tx=0x7f4fb40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:05.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.625+0000 7ff25effd640 1 -- 172.21.15.110:0/2670684369 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2500b0070 con 0x7ff26012f030 2024-05-09T09:47:05.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.625+0000 7ff25effd640 1 -- 172.21.15.110:0/2670684369 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2500ab400 con 0x7ff26012f030 2024-05-09T09:47:05.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.625+0000 7ff25effd640 1 -- 172.21.15.110:0/2670684369 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2540015b0 con 0x7ff26012f030 2024-05-09T09:47:05.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.625+0000 7f4fa7fff640 1 -- 172.21.15.110:0/1763478159 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4fc0121330 con 0x7f4fc009c180 2024-05-09T09:47:05.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.629+0000 7ff266538640 1 -- 172.21.15.110:0/2670684369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff26012f030 msgr2=0x7ff26012f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:05.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.629+0000 7ff266538640 1 --2- 172.21.15.110:0/2670684369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff26012f030 0x7ff26012f410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff250009740 tx=0x7ff25001c290 comp rx=0 tx=0).stop 2024-05-09T09:47:05.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.629+0000 7ff266538640 1 -- 172.21.15.110:0/2670684369 shutdown_connections 2024-05-09T09:47:05.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.629+0000 7ff266538640 1 --2- 172.21.15.110:0/2670684369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff26012f030 0x7ff26012f410 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:05.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.629+0000 7ff266538640 1 -- 172.21.15.110:0/2670684369 >> 172.21.15.110:0/2670684369 conn(0x7ff26009e230 msgr2=0x7ff26009e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:05.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.629+0000 7ff266538640 1 -- 172.21.15.110:0/2670684369 shutdown_connections 2024-05-09T09:47:05.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.629+0000 7ff266538640 1 -- 172.21.15.110:0/2670684369 wait complete. 2024-05-09T09:47:05.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.629+0000 7ff266538640 1 Processor -- start 2024-05-09T09:47:05.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.629+0000 7ff266538640 1 -- start start 2024-05-09T09:47:05.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.629+0000 7ff266538640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff260072890 0x7ff260122ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:05.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.629+0000 7ff266538640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff260137890 con 0x7ff260072890 2024-05-09T09:47:05.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.629+0000 7ff25ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff260072890 0x7ff260122ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:05.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.629+0000 7ff25ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff260072890 0x7ff260122ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59632/0 (socket says 172.21.15.110:59632) 2024-05-09T09:47:05.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.629+0000 7ff25ffff640 1 -- 172.21.15.110:0/3978574333 learned_addr learned my addr 172.21.15.110:0/3978574333 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:05.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.629+0000 7ff25ffff640 1 -- 172.21.15.110:0/3978574333 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff260097960 con 0x7ff260072890 2024-05-09T09:47:05.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.629+0000 7ff25ffff640 1 --2- 172.21.15.110:0/3978574333 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff260072890 0x7ff260122ef0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff2500ae040 tx=0x7ff25001aad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:05.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.629+0000 7ff25cff9640 1 -- 172.21.15.110:0/3978574333 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2500b0050 con 0x7ff260072890 2024-05-09T09:47:05.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.629+0000 7ff25cff9640 1 -- 172.21.15.110:0/3978574333 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2500b1040 con 0x7ff260072890 2024-05-09T09:47:05.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.629+0000 7ff25cff9640 1 -- 172.21.15.110:0/3978574333 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2500b75c0 con 0x7ff260072890 2024-05-09T09:47:05.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.629+0000 7ff266538640 1 -- 172.21.15.110:0/3978574333 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff260124470 con 0x7ff260072890 2024-05-09T09:47:05.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.629+0000 7ff266538640 1 -- 172.21.15.110:0/3978574333 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff260133f00 con 0x7ff260072890 2024-05-09T09:47:05.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.633+0000 7ff266538640 1 -- 172.21.15.110:0/3978574333 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff260063710 con 0x7ff260072890 2024-05-09T09:47:05.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.633+0000 7ff25cff9640 1 -- 172.21.15.110:0/3978574333 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7ff2500be030 con 0x7ff260072890 2024-05-09T09:47:05.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.633+0000 7ff25cff9640 1 --2- 172.21.15.110:0/3978574333 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff24c036310 0x7ff24c0387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:05.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.633+0000 7ff25cff9640 1 -- 172.21.15.110:0/3978574333 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7ff2500bc070 con 0x7ff260072890 2024-05-09T09:47:05.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.641+0000 7ff25cff9640 1 -- 172.21.15.110:0/3978574333 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff2500c5060 con 0x7ff260072890 2024-05-09T09:47:05.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.641+0000 7ff25f7fe640 1 --2- 172.21.15.110:0/3978574333 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff24c036310 0x7ff24c0387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:05.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.641+0000 7ff25f7fe640 1 --2- 172.21.15.110:0/3978574333 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff24c036310 0x7ff24c0387d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff254001390 tx=0x7ff2540015d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:05.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.665+0000 7ff5bfa45640 1 Processor -- start 2024-05-09T09:47:05.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.665+0000 7ff5bfa45640 1 -- start start 2024-05-09T09:47:05.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.665+0000 7ff5bfa45640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff5b812c380 0x7ff5b8134040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:05.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.665+0000 7ff5bfa45640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5b812b820 con 0x7ff5b809e3b0 2024-05-09T09:47:05.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.665+0000 7ff5bfa45640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7ff5b80a0fc0 con 0x7ff5b812c380 2024-05-09T09:47:05.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.665+0000 7ff5bcfe0640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff5b812c380 0x7ff5b8134040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:05.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.665+0000 7ff5bd7e1640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ff5b809e3b0 0x7ff5b812bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41228/0 (socket says 172.21.15.110:41228) 2024-05-09T09:47:05.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.665+0000 7ff5bd7e1640 1 -- 172.21.15.110:0/2498664312 learned_addr learned my addr 172.21.15.110:0/2498664312 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:47:05.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.665+0000 7ff5bcfe0640 1 -- 172.21.15.110:0/2498664312 >> v1:172.21.15.110:6789/0 conn(0x7ff5b809e3b0 legacy=0x7ff5b812bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:05.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.665+0000 7ff5bcfe0640 1 -- 172.21.15.110:0/2498664312 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b809b5f0 con 0x7ff5b812c380 2024-05-09T09:47:05.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.665+0000 7ff5bcfe0640 1 --2- 172.21.15.110:0/2498664312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5b812c380 0x7ff5b8134040 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8009740 tx=0x7ff5a801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa4eab0efc48db38 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:05.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.665+0000 7ff5affff640 1 -- 172.21.15.110:0/2498664312 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5a80b0070 con 0x7ff5b812c380 2024-05-09T09:47:05.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.665+0000 7ff5affff640 1 -- 172.21.15.110:0/2498664312 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5a80ab530 con 0x7ff5b812c380 2024-05-09T09:47:05.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.665+0000 7ff5affff640 1 -- 172.21.15.110:0/2498664312 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5a80ab870 con 0x7ff5b812c380 2024-05-09T09:47:05.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.669+0000 7ff5bfa45640 1 -- 172.21.15.110:0/2498664312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5b812c380 msgr2=0x7ff5b8134040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:05.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.669+0000 7ff5bfa45640 1 --2- 172.21.15.110:0/2498664312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5b812c380 0x7ff5b8134040 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8009740 tx=0x7ff5a801c390 comp rx=0 tx=0).stop 2024-05-09T09:47:05.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.669+0000 7ff5bfa45640 1 -- 172.21.15.110:0/2498664312 shutdown_connections 2024-05-09T09:47:05.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.669+0000 7ff5bfa45640 1 --2- 172.21.15.110:0/2498664312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5b812c380 0x7ff5b8134040 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:05.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.669+0000 7ff5bfa45640 1 -- 172.21.15.110:0/2498664312 >> 172.21.15.110:0/2498664312 conn(0x7ff5b80a17a0 msgr2=0x7ff5b809dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:05.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.669+0000 7ff5bfa45640 1 -- 172.21.15.110:0/2498664312 shutdown_connections 2024-05-09T09:47:05.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.669+0000 7ff5bfa45640 1 -- 172.21.15.110:0/2498664312 wait complete. 2024-05-09T09:47:05.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.669+0000 7ff5bfa45640 1 Processor -- start 2024-05-09T09:47:05.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.669+0000 7ff5bfa45640 1 -- start start 2024-05-09T09:47:05.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.669+0000 7ff5bfa45640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5b809e3b0 0x7ff5b8131db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:05.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.669+0000 7ff5bfa45640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b8137130 con 0x7ff5b809e3b0 2024-05-09T09:47:05.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.669+0000 7ff5bd7e1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5b809e3b0 0x7ff5b8131db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:05.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.669+0000 7ff5bd7e1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5b809e3b0 0x7ff5b8131db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59644/0 (socket says 172.21.15.110:59644) 2024-05-09T09:47:05.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.669+0000 7ff5bd7e1640 1 -- 172.21.15.110:0/412126167 learned_addr learned my addr 172.21.15.110:0/412126167 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:05.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.669+0000 7ff5bd7e1640 1 -- 172.21.15.110:0/412126167 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b806eb70 con 0x7ff5b809e3b0 2024-05-09T09:47:05.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.669+0000 7ff5bd7e1640 1 --2- 172.21.15.110:0/412126167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5b809e3b0 0x7ff5b8131db0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff5b400c380 tx=0x7ff5b400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:05.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.669+0000 7ff5adffb640 1 -- 172.21.15.110:0/412126167 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5b4017070 con 0x7ff5b809e3b0 2024-05-09T09:47:05.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.669+0000 7ff5adffb640 1 -- 172.21.15.110:0/412126167 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5b4005c20 con 0x7ff5b809e3b0 2024-05-09T09:47:05.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.669+0000 7ff5adffb640 1 -- 172.21.15.110:0/412126167 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5b40070d0 con 0x7ff5b809e3b0 2024-05-09T09:47:05.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.669+0000 7ff5bfa45640 1 -- 172.21.15.110:0/412126167 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5b81338a0 con 0x7ff5b809e3b0 2024-05-09T09:47:05.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.669+0000 7ff5bfa45640 1 -- 172.21.15.110:0/412126167 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5b806d700 con 0x7ff5b809e3b0 2024-05-09T09:47:05.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.673+0000 7ff5bfa45640 1 -- 172.21.15.110:0/412126167 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5b8063710 con 0x7ff5b809e3b0 2024-05-09T09:47:05.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.673+0000 7ff5adffb640 1 -- 172.21.15.110:0/412126167 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7ff5b401a070 con 0x7ff5b809e3b0 2024-05-09T09:47:05.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.673+0000 7ff5adffb640 1 --2- 172.21.15.110:0/412126167 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff59c036310 0x7ff59c0387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:05.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.673+0000 7ff5adffb640 1 -- 172.21.15.110:0/412126167 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7ff5b4047f90 con 0x7ff5b809e3b0 2024-05-09T09:47:05.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.677+0000 7ff5bcfe0640 1 --2- 172.21.15.110:0/412126167 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff59c036310 0x7ff59c0387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:05.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.677+0000 7ff5bcfe0640 1 --2- 172.21.15.110:0/412126167 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff59c036310 0x7ff59c0387d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff5a80ad000 tx=0x7ff5a80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:05.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.677+0000 7ff5adffb640 1 -- 172.21.15.110:0/412126167 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff5b4012400 con 0x7ff5b809e3b0 2024-05-09T09:47:05.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.733+0000 7fb93093b640 1 Processor -- start 2024-05-09T09:47:05.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.733+0000 7fb93093b640 1 -- start start 2024-05-09T09:47:05.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.733+0000 7fb93093b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb92c09e3b0 0x7fb92c12bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:05.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.733+0000 7fb93093b640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb92c12b820 con 0x7fb92c12c1b0 2024-05-09T09:47:05.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.733+0000 7fb93093b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fb92c0a0fc0 con 0x7fb92c09e3b0 2024-05-09T09:47:05.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.733+0000 7fb92a59c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb92c09e3b0 0x7fb92c12bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:05.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.733+0000 7fb929d9b640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fb92c12c1b0 0x7fb92c12ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41240/0 (socket says 172.21.15.110:41240) 2024-05-09T09:47:05.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.733+0000 7fb92a59c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb92c09e3b0 0x7fb92c12bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59660/0 (socket says 172.21.15.110:59660) 2024-05-09T09:47:05.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.733+0000 7fb929d9b640 1 -- 172.21.15.110:0/2123393972 learned_addr learned my addr 172.21.15.110:0/2123393972 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:47:05.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.733+0000 7fb92959a640 1 -- 172.21.15.110:0/2123393972 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2181659667 0 0) 0x7fb92c12b820 con 0x7fb92c12c1b0 2024-05-09T09:47:05.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.733+0000 7fb92959a640 1 -- 172.21.15.110:0/2123393972 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb914003530 con 0x7fb92c12c1b0 2024-05-09T09:47:05.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.733+0000 7fb92a59c640 1 -- 172.21.15.110:0/2123393972 >> v1:172.21.15.110:6789/0 conn(0x7fb92c12c1b0 legacy=0x7fb92c12ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:05.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.733+0000 7fb92a59c640 1 -- 172.21.15.110:0/2123393972 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb92c09b5f0 con 0x7fb92c09e3b0 2024-05-09T09:47:05.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.737+0000 7fb92a59c640 1 --2- 172.21.15.110:0/2123393972 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb92c09e3b0 0x7fb92c12bc70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb91c009740 tx=0x7fb91c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6422670f8cb067f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:05.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.737+0000 7fb92959a640 1 -- 172.21.15.110:0/2123393972 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb91c0b0070 con 0x7fb92c09e3b0 2024-05-09T09:47:05.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.737+0000 7fb92959a640 1 -- 172.21.15.110:0/2123393972 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb91c0ab530 con 0x7fb92c09e3b0 2024-05-09T09:47:05.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.737+0000 7fb92959a640 1 -- 172.21.15.110:0/2123393972 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb91c0ab810 con 0x7fb92c09e3b0 2024-05-09T09:47:05.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.737+0000 7fb93093b640 1 -- 172.21.15.110:0/2123393972 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb92c09e3b0 msgr2=0x7fb92c12bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:05.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.737+0000 7fb93093b640 1 --2- 172.21.15.110:0/2123393972 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb92c09e3b0 0x7fb92c12bc70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb91c009740 tx=0x7fb91c01c370 comp rx=0 tx=0).stop 2024-05-09T09:47:05.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.737+0000 7fb93093b640 1 -- 172.21.15.110:0/2123393972 shutdown_connections 2024-05-09T09:47:05.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.737+0000 7fb93093b640 1 --2- 172.21.15.110:0/2123393972 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb92c09e3b0 0x7fb92c12bc70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:05.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.737+0000 7fb93093b640 1 -- 172.21.15.110:0/2123393972 >> 172.21.15.110:0/2123393972 conn(0x7fb92c0a17a0 msgr2=0x7fb92c09dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:05.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.737+0000 7fb93093b640 1 -- 172.21.15.110:0/2123393972 shutdown_connections 2024-05-09T09:47:05.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.737+0000 7fb93093b640 1 -- 172.21.15.110:0/2123393972 wait complete. 2024-05-09T09:47:05.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.737+0000 7fb93093b640 1 Processor -- start 2024-05-09T09:47:05.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.737+0000 7fb93093b640 1 -- start start 2024-05-09T09:47:05.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.737+0000 7fb93093b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb92c09e3b0 0x7fb92c132c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:05.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.737+0000 7fb93093b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb92c1371e0 con 0x7fb92c09e3b0 2024-05-09T09:47:05.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.737+0000 7fb92a59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb92c09e3b0 0x7fb92c132c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:05.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.737+0000 7fb92a59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb92c09e3b0 0x7fb92c132c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59662/0 (socket says 172.21.15.110:59662) 2024-05-09T09:47:05.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.737+0000 7fb92a59c640 1 -- 172.21.15.110:0/1774722217 learned_addr learned my addr 172.21.15.110:0/1774722217 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:05.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.737+0000 7fb92a59c640 1 -- 172.21.15.110:0/1774722217 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb92c06e930 con 0x7fb92c09e3b0 2024-05-09T09:47:05.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.737+0000 7fb92a59c640 1 --2- 172.21.15.110:0/1774722217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb92c09e3b0 0x7fb92c132c30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb91c018f80 tx=0x7fb91c019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:05.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.741+0000 7fb91affd640 1 -- 172.21.15.110:0/1774722217 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb91c0b8020 con 0x7fb92c09e3b0 2024-05-09T09:47:05.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.741+0000 7fb91affd640 1 -- 172.21.15.110:0/1774722217 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb91c0ab6e0 con 0x7fb92c09e3b0 2024-05-09T09:47:05.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.741+0000 7fb91affd640 1 -- 172.21.15.110:0/1774722217 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb91c0b0040 con 0x7fb92c09e3b0 2024-05-09T09:47:05.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.741+0000 7fb93093b640 1 -- 172.21.15.110:0/1774722217 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb92c06e600 con 0x7fb92c09e3b0 2024-05-09T09:47:05.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.741+0000 7fb93093b640 1 -- 172.21.15.110:0/1774722217 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb92c06dcf0 con 0x7fb92c09e3b0 2024-05-09T09:47:05.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.741+0000 7fb91affd640 1 -- 172.21.15.110:0/1774722217 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fb91c0bb020 con 0x7fb92c09e3b0 2024-05-09T09:47:05.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.741+0000 7fb93093b640 1 -- 172.21.15.110:0/1774722217 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb92c063710 con 0x7fb92c09e3b0 2024-05-09T09:47:05.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.741+0000 7fb91affd640 1 --2- 172.21.15.110:0/1774722217 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb90c036310 0x7fb90c0387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:05.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.741+0000 7fb91affd640 1 -- 172.21.15.110:0/1774722217 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7fb91c0e27a0 con 0x7fb92c09e3b0 2024-05-09T09:47:05.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.741+0000 7fb929d9b640 1 --2- 172.21.15.110:0/1774722217 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb90c036310 0x7fb90c0387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:05.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.741+0000 7fb929d9b640 1 --2- 172.21.15.110:0/1774722217 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb90c036310 0x7fb90c0387d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb920000f70 tx=0x7fb9200010b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:05.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.749+0000 7fb91affd640 1 -- 172.21.15.110:0/1774722217 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb91c0c2030 con 0x7fb92c09e3b0 2024-05-09T09:47:05.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.801+0000 7ff266538640 1 -- 172.21.15.110:0/3978574333 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7ff260067fd0 con 0x7ff260072890 2024-05-09T09:47:05.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.801+0000 7ff25cff9640 1 -- 172.21.15.110:0/3978574333 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff250015f10 con 0x7ff260072890 2024-05-09T09:47:05.801 INFO:teuthology.orchestra.run.smithi110.stdout:38654705667 2024-05-09T09:47:05.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.805+0000 7ff266538640 1 -- 172.21.15.110:0/3978574333 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff24c036310 msgr2=0x7ff24c0387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:05.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.805+0000 7ff266538640 1 --2- 172.21.15.110:0/3978574333 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff24c036310 0x7ff24c0387d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff254001390 tx=0x7ff2540015d0 comp rx=0 tx=0).stop 2024-05-09T09:47:05.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.805+0000 7ff266538640 1 -- 172.21.15.110:0/3978574333 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff260072890 msgr2=0x7ff260122ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:05.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.805+0000 7ff266538640 1 --2- 172.21.15.110:0/3978574333 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff260072890 0x7ff260122ef0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff2500ae040 tx=0x7ff25001aad0 comp rx=0 tx=0).stop 2024-05-09T09:47:05.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.805+0000 7ff266538640 1 -- 172.21.15.110:0/3978574333 shutdown_connections 2024-05-09T09:47:05.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.805+0000 7ff266538640 1 --2- 172.21.15.110:0/3978574333 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff24c036310 0x7ff24c0387d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:05.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.805+0000 7ff266538640 1 --2- 172.21.15.110:0/3978574333 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff260072890 0x7ff260122ef0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:05.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.805+0000 7ff266538640 1 -- 172.21.15.110:0/3978574333 >> 172.21.15.110:0/3978574333 conn(0x7ff26009e230 msgr2=0x7ff2600996c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:05.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.805+0000 7ff266538640 1 -- 172.21.15.110:0/3978574333 shutdown_connections 2024-05-09T09:47:05.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.805+0000 7ff266538640 1 -- 172.21.15.110:0/3978574333 wait complete. 2024-05-09T09:47:05.824 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.0 2024-05-09T09:47:05.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.837+0000 7f4fc620a640 1 -- 172.21.15.110:0/1763478159 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f4fc0067fd0 con 0x7f4fc009c180 2024-05-09T09:47:05.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.841+0000 7f4fa7fff640 1 -- 172.21.15.110:0/1763478159 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4fb0007210 con 0x7f4fc009c180 2024-05-09T09:47:05.839 INFO:teuthology.orchestra.run.smithi110.stdout:38654705666 2024-05-09T09:47:05.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.841+0000 7f4fc620a640 1 -- 172.21.15.110:0/1763478159 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4fac036310 msgr2=0x7f4fac0387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:05.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.841+0000 7f4fc620a640 1 --2- 172.21.15.110:0/1763478159 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4fac036310 0x7f4fac0387d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40ae000 tx=0x7f4fb40a7000 comp rx=0 tx=0).stop 2024-05-09T09:47:05.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.841+0000 7f4fc620a640 1 -- 172.21.15.110:0/1763478159 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fc009c180 msgr2=0x7f4fc006df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:05.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.841+0000 7f4fc620a640 1 --2- 172.21.15.110:0/1763478159 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fc009c180 0x7f4fc006df50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4fb000c480 tx=0x7f4fb000c940 comp rx=0 tx=0).stop 2024-05-09T09:47:05.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.841+0000 7f4fc620a640 1 -- 172.21.15.110:0/1763478159 shutdown_connections 2024-05-09T09:47:05.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.841+0000 7f4fc620a640 1 --2- 172.21.15.110:0/1763478159 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4fac036310 0x7f4fac0387d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:05.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.841+0000 7f4fc620a640 1 --2- 172.21.15.110:0/1763478159 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4fc009c180 0x7f4fc006df50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:05.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.841+0000 7f4fc620a640 1 -- 172.21.15.110:0/1763478159 >> 172.21.15.110:0/1763478159 conn(0x7f4fc0071620 msgr2=0x7f4fc012e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:05.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.841+0000 7f4fc620a640 1 -- 172.21.15.110:0/1763478159 shutdown_connections 2024-05-09T09:47:05.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.841+0000 7f4fc620a640 1 -- 172.21.15.110:0/1763478159 wait complete. 2024-05-09T09:47:05.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.849+0000 7ff5bfa45640 1 -- 172.21.15.110:0/412126167 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff5b8067fd0 con 0x7ff5b809e3b0 2024-05-09T09:47:05.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.849+0000 7ff5adffb640 1 -- 172.21.15.110:0/412126167 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff5b4010c00 con 0x7ff5b809e3b0 2024-05-09T09:47:05.848 INFO:teuthology.orchestra.run.smithi110.stdout:38654705668 2024-05-09T09:47:05.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.849+0000 7ff5bfa45640 1 -- 172.21.15.110:0/412126167 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff59c036310 msgr2=0x7ff59c0387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:05.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.849+0000 7ff5bfa45640 1 --2- 172.21.15.110:0/412126167 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff59c036310 0x7ff59c0387d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff5a80ad000 tx=0x7ff5a80a6000 comp rx=0 tx=0).stop 2024-05-09T09:47:05.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.849+0000 7ff5bfa45640 1 -- 172.21.15.110:0/412126167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5b809e3b0 msgr2=0x7ff5b8131db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:05.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.849+0000 7ff5bfa45640 1 --2- 172.21.15.110:0/412126167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5b809e3b0 0x7ff5b8131db0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff5b400c380 tx=0x7ff5b400c840 comp rx=0 tx=0).stop 2024-05-09T09:47:05.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.849+0000 7ff5bfa45640 1 -- 172.21.15.110:0/412126167 shutdown_connections 2024-05-09T09:47:05.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.849+0000 7ff5bfa45640 1 --2- 172.21.15.110:0/412126167 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff59c036310 0x7ff59c0387d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:05.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.849+0000 7ff5bfa45640 1 --2- 172.21.15.110:0/412126167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5b809e3b0 0x7ff5b8131db0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:05.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.849+0000 7ff5bfa45640 1 -- 172.21.15.110:0/412126167 >> 172.21.15.110:0/412126167 conn(0x7ff5b80a17a0 msgr2=0x7ff5b80986a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:05.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.849+0000 7ff5bfa45640 1 -- 172.21.15.110:0/412126167 shutdown_connections 2024-05-09T09:47:05.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.849+0000 7ff5bfa45640 1 -- 172.21.15.110:0/412126167 wait complete. 2024-05-09T09:47:05.857 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.3 2024-05-09T09:47:05.865 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.2 2024-05-09T09:47:05.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.905+0000 7fb93093b640 1 -- 172.21.15.110:0/1774722217 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb92c067fd0 con 0x7fb92c09e3b0 2024-05-09T09:47:05.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.905+0000 7fb91affd640 1 -- 172.21.15.110:0/1774722217 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb92c06e930 con 0x7fb92c09e3b0 2024-05-09T09:47:05.907 INFO:teuthology.orchestra.run.smithi110.stdout:38654705666 2024-05-09T09:47:05.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.909+0000 7fb93093b640 1 -- 172.21.15.110:0/1774722217 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb90c036310 msgr2=0x7fb90c0387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:05.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.909+0000 7fb93093b640 1 --2- 172.21.15.110:0/1774722217 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb90c036310 0x7fb90c0387d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb920000f70 tx=0x7fb9200010b0 comp rx=0 tx=0).stop 2024-05-09T09:47:05.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.909+0000 7fb93093b640 1 -- 172.21.15.110:0/1774722217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb92c09e3b0 msgr2=0x7fb92c132c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:05.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.909+0000 7fb93093b640 1 --2- 172.21.15.110:0/1774722217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb92c09e3b0 0x7fb92c132c30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb91c018f80 tx=0x7fb91c019110 comp rx=0 tx=0).stop 2024-05-09T09:47:05.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.909+0000 7fb93093b640 1 -- 172.21.15.110:0/1774722217 shutdown_connections 2024-05-09T09:47:05.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.909+0000 7fb93093b640 1 --2- 172.21.15.110:0/1774722217 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb90c036310 0x7fb90c0387d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:05.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.909+0000 7fb93093b640 1 --2- 172.21.15.110:0/1774722217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb92c09e3b0 0x7fb92c132c30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:05.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.909+0000 7fb93093b640 1 -- 172.21.15.110:0/1774722217 >> 172.21.15.110:0/1774722217 conn(0x7fb92c0a17a0 msgr2=0x7fb92c09d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:05.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.909+0000 7fb93093b640 1 -- 172.21.15.110:0/1774722217 shutdown_connections 2024-05-09T09:47:05.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:05.909+0000 7fb93093b640 1 -- 172.21.15.110:0/1774722217 wait complete. 2024-05-09T09:47:05.922 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.1 2024-05-09T09:47:06.825 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-09T09:47:06.858 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-09T09:47:06.866 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-09T09:47:06.923 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-09T09:47:06.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.953+0000 7f062adf4640 1 Processor -- start 2024-05-09T09:47:06.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.957+0000 7f062adf4640 1 -- start start 2024-05-09T09:47:06.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.957+0000 7f062adf4640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f062412f670 0x7f0624133dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:06.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.957+0000 7f062adf4640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0624115d80 con 0x7f062412ea40 2024-05-09T09:47:06.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.957+0000 7f062adf4640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f06241163b0 con 0x7f062412f670 2024-05-09T09:47:06.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.957+0000 7f0623fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f062412f670 0x7f0624133dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:06.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.957+0000 7f0623fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f062412f670 0x7f0624133dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59672/0 (socket says 172.21.15.110:59672) 2024-05-09T09:47:06.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.957+0000 7f0623fff640 1 -- 172.21.15.110:0/2844443581 learned_addr learned my addr 172.21.15.110:0/2844443581 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:06.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.957+0000 7f0623fff640 1 -- 172.21.15.110:0/2844443581 >> v1:172.21.15.110:6789/0 conn(0x7f062412ea40 legacy=0x7f062412ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:06.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.957+0000 7f0623fff640 1 -- 172.21.15.110:0/2844443581 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f062406fde0 con 0x7f062412f670 2024-05-09T09:47:06.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.957+0000 7f0623fff640 1 --2- 172.21.15.110:0/2844443581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f062412f670 0x7f0624133dc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f06100097f0 tx=0x7f061001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0af260ff331913 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:06.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.957+0000 7f06237fe640 1 -- 172.21.15.110:0/2844443581 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06100b0070 con 0x7f062412f670 2024-05-09T09:47:06.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.957+0000 7f06237fe640 1 -- 172.21.15.110:0/2844443581 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06100ab530 con 0x7f062412f670 2024-05-09T09:47:06.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.957+0000 7f06237fe640 1 -- 172.21.15.110:0/2844443581 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06100ab830 con 0x7f062412f670 2024-05-09T09:47:06.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.961+0000 7f062adf4640 1 -- 172.21.15.110:0/2844443581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f062412f670 msgr2=0x7f0624133dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:06.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.961+0000 7f062adf4640 1 --2- 172.21.15.110:0/2844443581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f062412f670 0x7f0624133dc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f06100097f0 tx=0x7f061001c430 comp rx=0 tx=0).stop 2024-05-09T09:47:06.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.961+0000 7f062adf4640 1 -- 172.21.15.110:0/2844443581 shutdown_connections 2024-05-09T09:47:06.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.961+0000 7f062adf4640 1 --2- 172.21.15.110:0/2844443581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f062412f670 0x7f0624133dc0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:06.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.961+0000 7f062adf4640 1 -- 172.21.15.110:0/2844443581 >> 172.21.15.110:0/2844443581 conn(0x7f06240711f0 msgr2=0x7f0624071600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:06.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.961+0000 7f062adf4640 1 -- 172.21.15.110:0/2844443581 shutdown_connections 2024-05-09T09:47:06.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.961+0000 7f062adf4640 1 -- 172.21.15.110:0/2844443581 wait complete. 2024-05-09T09:47:06.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.961+0000 7f062adf4640 1 Processor -- start 2024-05-09T09:47:06.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.961+0000 7f062adf4640 1 -- start start 2024-05-09T09:47:06.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.961+0000 7f062adf4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f062412ea40 0x7f06241c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:06.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.961+0000 7f062adf4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0624136d30 con 0x7f062412ea40 2024-05-09T09:47:06.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.961+0000 7f0628b90640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f062412ea40 0x7f06241c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:06.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.961+0000 7f0628b90640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f062412ea40 0x7f06241c67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59684/0 (socket says 172.21.15.110:59684) 2024-05-09T09:47:06.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.961+0000 7f0628b90640 1 -- 172.21.15.110:0/3049072945 learned_addr learned my addr 172.21.15.110:0/3049072945 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:06.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.961+0000 7f0628b90640 1 -- 172.21.15.110:0/3049072945 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0624133df0 con 0x7f062412ea40 2024-05-09T09:47:06.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.961+0000 7f0628b90640 1 --2- 172.21.15.110:0/3049072945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f062412ea40 0x7f06241c67a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f061800c340 tx=0x7f061800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:06.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.961+0000 7f06217fa640 1 -- 172.21.15.110:0/3049072945 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0618005150 con 0x7f062412ea40 2024-05-09T09:47:06.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.961+0000 7f06217fa640 1 -- 172.21.15.110:0/3049072945 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06180052f0 con 0x7f062412ea40 2024-05-09T09:47:06.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.961+0000 7f062adf4640 1 -- 172.21.15.110:0/3049072945 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0624117fc0 con 0x7f062412ea40 2024-05-09T09:47:06.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.961+0000 7f06217fa640 1 -- 172.21.15.110:0/3049072945 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0618007030 con 0x7f062412ea40 2024-05-09T09:47:06.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.961+0000 7f062adf4640 1 -- 172.21.15.110:0/3049072945 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06241182d0 con 0x7f062412ea40 2024-05-09T09:47:06.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.965+0000 7f060effd640 1 -- 172.21.15.110:0/3049072945 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0624063710 con 0x7f062412ea40 2024-05-09T09:47:06.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.965+0000 7f06217fa640 1 -- 172.21.15.110:0/3049072945 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f0618019020 con 0x7f062412ea40 2024-05-09T09:47:06.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.965+0000 7f06217fa640 1 --2- 172.21.15.110:0/3049072945 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0608036310 0x7f06080387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:06.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.965+0000 7f06217fa640 1 -- 172.21.15.110:0/3049072945 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f0618047ff0 con 0x7f062412ea40 2024-05-09T09:47:06.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.965+0000 7f0623fff640 1 --2- 172.21.15.110:0/3049072945 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0608036310 0x7f06080387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:06.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.965+0000 7f0623fff640 1 --2- 172.21.15.110:0/3049072945 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0608036310 0x7f06080387d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f062406fa90 tx=0x7f06100a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:06.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.973+0000 7f06217fa640 1 -- 172.21.15.110:0/3049072945 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0618006d00 con 0x7f062412ea40 2024-05-09T09:47:06.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.985+0000 7fd0855ba640 1 Processor -- start 2024-05-09T09:47:06.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.985+0000 7fd0855ba640 1 -- start start 2024-05-09T09:47:06.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.985+0000 7fd0855ba640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd08009e3b0 0x7fd08012bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:06.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.985+0000 7fd0855ba640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd08012b820 con 0x7fd08012c1b0 2024-05-09T09:47:06.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.985+0000 7fd0855ba640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fd0800a0fc0 con 0x7fd08009e3b0 2024-05-09T09:47:06.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.989+0000 7fd07e7fc640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fd08012c1b0 0x7fd08012ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41262/0 (socket says 172.21.15.110:41262) 2024-05-09T09:47:06.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.989+0000 7fd07effd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd08009e3b0 0x7fd08012bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:06.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.989+0000 7fd07e7fc640 1 -- 172.21.15.110:0/653772785 learned_addr learned my addr 172.21.15.110:0/653772785 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:47:06.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.989+0000 7fd07effd640 1 -- 172.21.15.110:0/653772785 >> v1:172.21.15.110:6789/0 conn(0x7fd08012c1b0 legacy=0x7fd08012ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:06.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.989+0000 7fd07dffb640 1 -- 172.21.15.110:0/653772785 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3267069832 0 0) 0x7fd08012b820 con 0x7fd08012c1b0 2024-05-09T09:47:06.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.989+0000 7fd07effd640 1 -- 172.21.15.110:0/653772785 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd08009b5f0 con 0x7fd08009e3b0 2024-05-09T09:47:06.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.989+0000 7fd07effd640 1 --2- 172.21.15.110:0/653772785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd08009e3b0 0x7fd08012bc70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd070009740 tx=0x7fd07001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b3ed7fd88b7eea server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:06.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.989+0000 7fd07dffb640 1 -- 172.21.15.110:0/653772785 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0700b0070 con 0x7fd08009e3b0 2024-05-09T09:47:06.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.989+0000 7fd07dffb640 1 -- 172.21.15.110:0/653772785 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0700ab530 con 0x7fd08009e3b0 2024-05-09T09:47:06.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.989+0000 7fd07dffb640 1 -- 172.21.15.110:0/653772785 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0700ab830 con 0x7fd08009e3b0 2024-05-09T09:47:06.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.989+0000 7fd0855ba640 1 -- 172.21.15.110:0/653772785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd08009e3b0 msgr2=0x7fd08012bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:06.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.989+0000 7fd0855ba640 1 --2- 172.21.15.110:0/653772785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd08009e3b0 0x7fd08012bc70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd070009740 tx=0x7fd07001c370 comp rx=0 tx=0).stop 2024-05-09T09:47:06.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.989+0000 7fd0855ba640 1 -- 172.21.15.110:0/653772785 shutdown_connections 2024-05-09T09:47:06.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.989+0000 7fd0855ba640 1 --2- 172.21.15.110:0/653772785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd08009e3b0 0x7fd08012bc70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:06.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.989+0000 7fd0855ba640 1 -- 172.21.15.110:0/653772785 >> 172.21.15.110:0/653772785 conn(0x7fd0800a17a0 msgr2=0x7fd08009dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:06.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.989+0000 7fd0855ba640 1 -- 172.21.15.110:0/653772785 shutdown_connections 2024-05-09T09:47:06.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.989+0000 7fd0855ba640 1 -- 172.21.15.110:0/653772785 wait complete. 2024-05-09T09:47:06.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.993+0000 7fd0855ba640 1 Processor -- start 2024-05-09T09:47:06.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.993+0000 7fd0855ba640 1 -- start start 2024-05-09T09:47:06.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.993+0000 7fd0855ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd08009e3b0 0x7fd080132e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:06.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.993+0000 7fd0855ba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd0801371e0 con 0x7fd08009e3b0 2024-05-09T09:47:06.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.993+0000 7fd07effd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd08009e3b0 0x7fd080132e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:06.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.993+0000 7fd07effd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd08009e3b0 0x7fd080132e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59690/0 (socket says 172.21.15.110:59690) 2024-05-09T09:47:06.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.993+0000 7fd07effd640 1 -- 172.21.15.110:0/2927249234 learned_addr learned my addr 172.21.15.110:0/2927249234 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:06.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.993+0000 7fd07effd640 1 -- 172.21.15.110:0/2927249234 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd08006d950 con 0x7fd08009e3b0 2024-05-09T09:47:06.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.993+0000 7fd07effd640 1 --2- 172.21.15.110:0/2927249234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd08009e3b0 0x7fd080132e10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd070019fa0 tx=0x7fd07001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:06.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.993+0000 7fd0677fe640 1 -- 172.21.15.110:0/2927249234 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0700b0050 con 0x7fd08009e3b0 2024-05-09T09:47:06.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.993+0000 7fd0677fe640 1 -- 172.21.15.110:0/2927249234 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0700b1040 con 0x7fd08009e3b0 2024-05-09T09:47:06.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.993+0000 7fd0855ba640 1 -- 172.21.15.110:0/2927249234 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd08006d5a0 con 0x7fd08009e3b0 2024-05-09T09:47:06.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.993+0000 7fd0677fe640 1 -- 172.21.15.110:0/2927249234 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0700b76b0 con 0x7fd08009e3b0 2024-05-09T09:47:06.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.993+0000 7fd0855ba640 1 -- 172.21.15.110:0/2927249234 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd08006e560 con 0x7fd08009e3b0 2024-05-09T09:47:06.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.993+0000 7fd0855ba640 1 -- 172.21.15.110:0/2927249234 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd080063710 con 0x7fd08009e3b0 2024-05-09T09:47:06.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.997+0000 7fd0677fe640 1 -- 172.21.15.110:0/2927249234 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fd0700be030 con 0x7fd08009e3b0 2024-05-09T09:47:06.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.997+0000 7fd0677fe640 1 --2- 172.21.15.110:0/2927249234 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fd06c036310 0x7fd06c0387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:06.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.997+0000 7fd0677fe640 1 -- 172.21.15.110:0/2927249234 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7fd0700bc070 con 0x7fd08009e3b0 2024-05-09T09:47:06.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.997+0000 7fd07e7fc640 1 --2- 172.21.15.110:0/2927249234 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fd06c036310 0x7fd06c0387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:06.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:06.997+0000 7fd07e7fc640 1 --2- 172.21.15.110:0/2927249234 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fd06c036310 0x7fd06c0387d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd074007fd0 tx=0x7fd074007920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:07.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.001+0000 7fd0677fe640 1 -- 172.21.15.110:0/2927249234 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd0700c5020 con 0x7fd08009e3b0 2024-05-09T09:47:07.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.001+0000 7f915a20f640 1 Processor -- start 2024-05-09T09:47:07.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.001+0000 7f915a20f640 1 -- start start 2024-05-09T09:47:07.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.001+0000 7f915a20f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9154072e90 0x7f915406dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:07.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.001+0000 7f915a20f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f915406ff30 con 0x7f915406bc30 2024-05-09T09:47:07.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.001+0000 7f915a20f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f9154073270 con 0x7f9154072e90 2024-05-09T09:47:07.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.001+0000 7f914bfff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f915406bc30 0x7f915406e320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41272/0 (socket says 172.21.15.110:41272) 2024-05-09T09:47:07.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.001+0000 7f914bfff640 1 -- 172.21.15.110:0/1663706583 learned_addr learned my addr 172.21.15.110:0/1663706583 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:47:07.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.001+0000 7f91537fe640 1 --2- 172.21.15.110:0/1663706583 >> v2:172.21.15.110:3300/0 conn(0x7f9154072e90 0x7f915406dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:07.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.001+0000 7f9152ffd640 1 -- 172.21.15.110:0/1663706583 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4094713163 0 0) 0x7f915406ff30 con 0x7f915406bc30 2024-05-09T09:47:07.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.001+0000 7f9152ffd640 1 -- 172.21.15.110:0/1663706583 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9140003530 con 0x7f915406bc30 2024-05-09T09:47:07.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.001+0000 7f91537fe640 1 -- 172.21.15.110:0/1663706583 >> v1:172.21.15.110:6789/0 conn(0x7f915406bc30 legacy=0x7f915406e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:07.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.001+0000 7f91537fe640 1 -- 172.21.15.110:0/1663706583 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f915406f510 con 0x7f9154072e90 2024-05-09T09:47:07.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.005+0000 7f91537fe640 1 --2- 172.21.15.110:0/1663706583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9154072e90 0x7f915406dde0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9144009740 tx=0x7f914401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c1a4c7994bfb9f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:07.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.005+0000 7f9152ffd640 1 -- 172.21.15.110:0/1663706583 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91440b0070 con 0x7f9154072e90 2024-05-09T09:47:07.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.005+0000 7f9152ffd640 1 -- 172.21.15.110:0/1663706583 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91440ab530 con 0x7f9154072e90 2024-05-09T09:47:07.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.005+0000 7f9152ffd640 1 -- 172.21.15.110:0/1663706583 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91440ab830 con 0x7f9154072e90 2024-05-09T09:47:07.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.005+0000 7f915a20f640 1 -- 172.21.15.110:0/1663706583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9154072e90 msgr2=0x7f915406dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:07.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.005+0000 7f915a20f640 1 --2- 172.21.15.110:0/1663706583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9154072e90 0x7f915406dde0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9144009740 tx=0x7f914401c370 comp rx=0 tx=0).stop 2024-05-09T09:47:07.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.005+0000 7f915a20f640 1 -- 172.21.15.110:0/1663706583 shutdown_connections 2024-05-09T09:47:07.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.005+0000 7f915a20f640 1 --2- 172.21.15.110:0/1663706583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9154072e90 0x7f915406dde0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:07.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.005+0000 7f915a20f640 1 -- 172.21.15.110:0/1663706583 >> 172.21.15.110:0/1663706583 conn(0x7f915409a490 msgr2=0x7f915409a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:07.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.005+0000 7f915a20f640 1 -- 172.21.15.110:0/1663706583 shutdown_connections 2024-05-09T09:47:07.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.005+0000 7f915a20f640 1 -- 172.21.15.110:0/1663706583 wait complete. 2024-05-09T09:47:07.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.005+0000 7f915a20f640 1 Processor -- start 2024-05-09T09:47:07.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.005+0000 7f915a20f640 1 -- start start 2024-05-09T09:47:07.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.005+0000 7f915a20f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f915406bc30 0x7f91541336e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:07.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.005+0000 7f915a20f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f915406ec40 con 0x7f915406bc30 2024-05-09T09:47:07.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.005+0000 7f91537fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f915406bc30 0x7f91541336e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:07.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.005+0000 7f91537fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f915406bc30 0x7f91541336e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59706/0 (socket says 172.21.15.110:59706) 2024-05-09T09:47:07.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.005+0000 7f91537fe640 1 -- 172.21.15.110:0/2522224162 learned_addr learned my addr 172.21.15.110:0/2522224162 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:07.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.005+0000 7f91537fe640 1 -- 172.21.15.110:0/2522224162 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9154099a50 con 0x7f915406bc30 2024-05-09T09:47:07.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.005+0000 7f91537fe640 1 --2- 172.21.15.110:0/2522224162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f915406bc30 0x7f91541336e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f91440ae040 tx=0x7f914401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:07.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.005+0000 7f9150ff9640 1 -- 172.21.15.110:0/2522224162 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91440b0050 con 0x7f915406bc30 2024-05-09T09:47:07.008 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.005+0000 7f9150ff9640 1 -- 172.21.15.110:0/2522224162 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91440b1040 con 0x7f915406bc30 2024-05-09T09:47:07.008 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.005+0000 7f915a20f640 1 -- 172.21.15.110:0/2522224162 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9154125580 con 0x7f915406bc30 2024-05-09T09:47:07.008 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.005+0000 7f9150ff9640 1 -- 172.21.15.110:0/2522224162 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91440b5780 con 0x7f915406bc30 2024-05-09T09:47:07.008 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.005+0000 7f915a20f640 1 -- 172.21.15.110:0/2522224162 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9154133c20 con 0x7f915406bc30 2024-05-09T09:47:07.008 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.009+0000 7f9150ff9640 1 -- 172.21.15.110:0/2522224162 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f91440be030 con 0x7f915406bc30 2024-05-09T09:47:07.008 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.009+0000 7f915a20f640 1 -- 172.21.15.110:0/2522224162 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9154063710 con 0x7f915406bc30 2024-05-09T09:47:07.008 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.009+0000 7f9150ff9640 1 --2- 172.21.15.110:0/2522224162 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9134036360 0x7f9134038820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:07.008 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.009+0000 7f9150ff9640 1 -- 172.21.15.110:0/2522224162 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f91440bc070 con 0x7f915406bc30 2024-05-09T09:47:07.008 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.009+0000 7f914bfff640 1 --2- 172.21.15.110:0/2522224162 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9134036360 0x7f9134038820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:07.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.009+0000 7f914bfff640 1 --2- 172.21.15.110:0/2522224162 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9134036360 0x7f9134038820 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f913c007fd0 tx=0x7f913c007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:07.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.013+0000 7f9150ff9640 1 -- 172.21.15.110:0/2522224162 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f91440c5060 con 0x7f915406bc30 2024-05-09T09:47:07.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.041+0000 7efc9b026640 1 Processor -- start 2024-05-09T09:47:07.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.041+0000 7efc9b026640 1 -- start start 2024-05-09T09:47:07.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.041+0000 7efc9b026640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efc9412c380 0x7efc94134040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:07.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.041+0000 7efc9b026640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc9412b820 con 0x7efc9409e3b0 2024-05-09T09:47:07.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.041+0000 7efc9b026640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7efc940a0fc0 con 0x7efc9412c380 2024-05-09T09:47:07.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.041+0000 7efc93fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efc9412c380 0x7efc94134040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:07.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.041+0000 7efc98dc2640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7efc9409e3b0 0x7efc9412bc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41282/0 (socket says 172.21.15.110:41282) 2024-05-09T09:47:07.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.041+0000 7efc98dc2640 1 -- 172.21.15.110:0/155152467 learned_addr learned my addr 172.21.15.110:0/155152467 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:47:07.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.041+0000 7efc93fff640 1 -- 172.21.15.110:0/155152467 >> v1:172.21.15.110:6789/0 conn(0x7efc9409e3b0 legacy=0x7efc9412bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:07.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.041+0000 7efc93fff640 1 -- 172.21.15.110:0/155152467 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc9409b5f0 con 0x7efc9412c380 2024-05-09T09:47:07.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.041+0000 7efc93fff640 1 --2- 172.21.15.110:0/155152467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc9412c380 0x7efc94134040 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efc80009740 tx=0x7efc8001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14829540c05a780 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:07.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.041+0000 7efc937fe640 1 -- 172.21.15.110:0/155152467 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc800b0070 con 0x7efc9412c380 2024-05-09T09:47:07.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.041+0000 7efc937fe640 1 -- 172.21.15.110:0/155152467 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc800ab530 con 0x7efc9412c380 2024-05-09T09:47:07.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.041+0000 7efc937fe640 1 -- 172.21.15.110:0/155152467 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc800ab830 con 0x7efc9412c380 2024-05-09T09:47:07.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.045+0000 7efc9b026640 1 -- 172.21.15.110:0/155152467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc9412c380 msgr2=0x7efc94134040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:07.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.045+0000 7efc9b026640 1 --2- 172.21.15.110:0/155152467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc9412c380 0x7efc94134040 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efc80009740 tx=0x7efc8001c370 comp rx=0 tx=0).stop 2024-05-09T09:47:07.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.045+0000 7efc9b026640 1 -- 172.21.15.110:0/155152467 shutdown_connections 2024-05-09T09:47:07.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.045+0000 7efc9b026640 1 --2- 172.21.15.110:0/155152467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc9412c380 0x7efc94134040 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:07.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.045+0000 7efc9b026640 1 -- 172.21.15.110:0/155152467 >> 172.21.15.110:0/155152467 conn(0x7efc940a17a0 msgr2=0x7efc9409dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:07.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.045+0000 7efc9b026640 1 -- 172.21.15.110:0/155152467 shutdown_connections 2024-05-09T09:47:07.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.045+0000 7efc9b026640 1 -- 172.21.15.110:0/155152467 wait complete. 2024-05-09T09:47:07.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.045+0000 7efc9b026640 1 Processor -- start 2024-05-09T09:47:07.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.045+0000 7efc9b026640 1 -- start start 2024-05-09T09:47:07.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.045+0000 7efc9b026640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc9409e3b0 0x7efc94132310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:07.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.045+0000 7efc9b026640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7efc94137130 con 0x7efc9409e3b0 2024-05-09T09:47:07.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.045+0000 7efc98dc2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc9409e3b0 0x7efc94132310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:07.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.045+0000 7efc98dc2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc9409e3b0 0x7efc94132310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59722/0 (socket says 172.21.15.110:59722) 2024-05-09T09:47:07.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.045+0000 7efc98dc2640 1 -- 172.21.15.110:0/2755774133 learned_addr learned my addr 172.21.15.110:0/2755774133 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:07.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.045+0000 7efc98dc2640 1 -- 172.21.15.110:0/2755774133 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc94133b70 con 0x7efc9409e3b0 2024-05-09T09:47:07.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.045+0000 7efc98dc2640 1 --2- 172.21.15.110:0/2755774133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc9409e3b0 0x7efc94132310 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efc8800c380 tx=0x7efc8800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:07.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.045+0000 7efc917fa640 1 -- 172.21.15.110:0/2755774133 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc88017070 con 0x7efc9409e3b0 2024-05-09T09:47:07.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.045+0000 7efc917fa640 1 -- 172.21.15.110:0/2755774133 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc88005c20 con 0x7efc9409e3b0 2024-05-09T09:47:07.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.045+0000 7efc917fa640 1 -- 172.21.15.110:0/2755774133 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc880070d0 con 0x7efc9409e3b0 2024-05-09T09:47:07.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.045+0000 7efc9b026640 1 -- 172.21.15.110:0/2755774133 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc9406e930 con 0x7efc9409e3b0 2024-05-09T09:47:07.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.045+0000 7efc9b026640 1 -- 172.21.15.110:0/2755774133 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc94132850 con 0x7efc9409e3b0 2024-05-09T09:47:07.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.045+0000 7efc917fa640 1 -- 172.21.15.110:0/2755774133 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7efc8801a070 con 0x7efc9409e3b0 2024-05-09T09:47:07.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.045+0000 7efc917fa640 1 --2- 172.21.15.110:0/2755774133 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efc78036310 0x7efc780387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:07.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.045+0000 7efc917fa640 1 -- 172.21.15.110:0/2755774133 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7efc88047fd0 con 0x7efc9409e3b0 2024-05-09T09:47:07.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.045+0000 7efc9b026640 1 -- 172.21.15.110:0/2755774133 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc94063710 con 0x7efc9409e3b0 2024-05-09T09:47:07.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.049+0000 7efc93fff640 1 --2- 172.21.15.110:0/2755774133 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efc78036310 0x7efc780387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:07.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.049+0000 7efc93fff640 1 --2- 172.21.15.110:0/2755774133 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efc78036310 0x7efc780387d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efc800ad000 tx=0x7efc800a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:07.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.053+0000 7efc917fa640 1 -- 172.21.15.110:0/2755774133 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efc88046f20 con 0x7efc9409e3b0 2024-05-09T09:47:07.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.145+0000 7f060effd640 1 -- 172.21.15.110:0/3049072945 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f0624117680 con 0x7f062412ea40 2024-05-09T09:47:07.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.145+0000 7f06217fa640 1 -- 172.21.15.110:0/3049072945 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f06180067e0 con 0x7f062412ea40 2024-05-09T09:47:07.146 INFO:teuthology.orchestra.run.smithi110.stdout:38654705669 2024-05-09T09:47:07.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.149+0000 7f060effd640 1 -- 172.21.15.110:0/3049072945 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0608036310 msgr2=0x7f06080387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:07.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.149+0000 7f060effd640 1 --2- 172.21.15.110:0/3049072945 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0608036310 0x7f06080387d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f062406fa90 tx=0x7f06100a6000 comp rx=0 tx=0).stop 2024-05-09T09:47:07.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.149+0000 7f060effd640 1 -- 172.21.15.110:0/3049072945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f062412ea40 msgr2=0x7f06241c67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:07.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.149+0000 7f060effd640 1 --2- 172.21.15.110:0/3049072945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f062412ea40 0x7f06241c67a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f061800c340 tx=0x7f061800c800 comp rx=0 tx=0).stop 2024-05-09T09:47:07.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.149+0000 7f060effd640 1 -- 172.21.15.110:0/3049072945 shutdown_connections 2024-05-09T09:47:07.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.149+0000 7f060effd640 1 --2- 172.21.15.110:0/3049072945 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0608036310 0x7f06080387d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:07.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.149+0000 7f060effd640 1 --2- 172.21.15.110:0/3049072945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f062412ea40 0x7f06241c67a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:07.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.149+0000 7f060effd640 1 -- 172.21.15.110:0/3049072945 >> 172.21.15.110:0/3049072945 conn(0x7f06240711f0 msgr2=0x7f0624099ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:07.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.149+0000 7f060effd640 1 -- 172.21.15.110:0/3049072945 shutdown_connections 2024-05-09T09:47:07.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.149+0000 7f060effd640 1 -- 172.21.15.110:0/3049072945 wait complete. 2024-05-09T09:47:07.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705669 for osd.0 2024-05-09T09:47:07.169 DEBUG:teuthology.parallel:result is None 2024-05-09T09:47:07.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.181+0000 7fd0855ba640 1 -- 172.21.15.110:0/2927249234 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd080067fd0 con 0x7fd08009e3b0 2024-05-09T09:47:07.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.181+0000 7fd0677fe640 1 -- 172.21.15.110:0/2927249234 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd070015ff0 con 0x7fd08009e3b0 2024-05-09T09:47:07.179 INFO:teuthology.orchestra.run.smithi110.stdout:38654705668 2024-05-09T09:47:07.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.181+0000 7fd0855ba640 1 -- 172.21.15.110:0/2927249234 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fd06c036310 msgr2=0x7fd06c0387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:07.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.181+0000 7fd0855ba640 1 --2- 172.21.15.110:0/2927249234 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fd06c036310 0x7fd06c0387d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd074007fd0 tx=0x7fd074007920 comp rx=0 tx=0).stop 2024-05-09T09:47:07.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.181+0000 7fd0855ba640 1 -- 172.21.15.110:0/2927249234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd08009e3b0 msgr2=0x7fd080132e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:07.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.181+0000 7fd0855ba640 1 --2- 172.21.15.110:0/2927249234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd08009e3b0 0x7fd080132e10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd070019fa0 tx=0x7fd07001abb0 comp rx=0 tx=0).stop 2024-05-09T09:47:07.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.181+0000 7fd0855ba640 1 -- 172.21.15.110:0/2927249234 shutdown_connections 2024-05-09T09:47:07.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.181+0000 7fd0855ba640 1 --2- 172.21.15.110:0/2927249234 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fd06c036310 0x7fd06c0387d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:07.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.181+0000 7fd0855ba640 1 --2- 172.21.15.110:0/2927249234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd08009e3b0 0x7fd080132e10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:07.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.181+0000 7fd0855ba640 1 -- 172.21.15.110:0/2927249234 >> 172.21.15.110:0/2927249234 conn(0x7fd0800a17a0 msgr2=0x7fd0800986a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:07.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.181+0000 7fd0855ba640 1 -- 172.21.15.110:0/2927249234 shutdown_connections 2024-05-09T09:47:07.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.181+0000 7fd0855ba640 1 -- 172.21.15.110:0/2927249234 wait complete. 2024-05-09T09:47:07.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705668 for osd.3 2024-05-09T09:47:07.196 DEBUG:teuthology.parallel:result is None 2024-05-09T09:47:07.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.205+0000 7f915a20f640 1 -- 172.21.15.110:0/2522224162 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f9154133f60 con 0x7f915406bc30 2024-05-09T09:47:07.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.205+0000 7f9150ff9640 1 -- 172.21.15.110:0/2522224162 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9144015ff0 con 0x7f915406bc30 2024-05-09T09:47:07.205 INFO:teuthology.orchestra.run.smithi110.stdout:38654705670 2024-05-09T09:47:07.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.209+0000 7f915a20f640 1 -- 172.21.15.110:0/2522224162 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9134036360 msgr2=0x7f9134038820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:07.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.209+0000 7f915a20f640 1 --2- 172.21.15.110:0/2522224162 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9134036360 0x7f9134038820 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f913c007fd0 tx=0x7f913c007980 comp rx=0 tx=0).stop 2024-05-09T09:47:07.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.209+0000 7f915a20f640 1 -- 172.21.15.110:0/2522224162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f915406bc30 msgr2=0x7f91541336e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:07.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.209+0000 7f915a20f640 1 --2- 172.21.15.110:0/2522224162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f915406bc30 0x7f91541336e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f91440ae040 tx=0x7f914401abb0 comp rx=0 tx=0).stop 2024-05-09T09:47:07.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.209+0000 7f915a20f640 1 -- 172.21.15.110:0/2522224162 shutdown_connections 2024-05-09T09:47:07.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.209+0000 7f915a20f640 1 --2- 172.21.15.110:0/2522224162 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9134036360 0x7f9134038820 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:07.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.209+0000 7f915a20f640 1 --2- 172.21.15.110:0/2522224162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f915406bc30 0x7f91541336e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:07.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.209+0000 7f915a20f640 1 -- 172.21.15.110:0/2522224162 >> 172.21.15.110:0/2522224162 conn(0x7f915409a490 msgr2=0x7f9154091410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:07.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.209+0000 7f915a20f640 1 -- 172.21.15.110:0/2522224162 shutdown_connections 2024-05-09T09:47:07.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.209+0000 7f915a20f640 1 -- 172.21.15.110:0/2522224162 wait complete. 2024-05-09T09:47:07.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.213+0000 7efc9b026640 1 -- 172.21.15.110:0/2755774133 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7efc94067fd0 con 0x7efc9409e3b0 2024-05-09T09:47:07.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.213+0000 7efc917fa640 1 -- 172.21.15.110:0/2755774133 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efc88012400 con 0x7efc9409e3b0 2024-05-09T09:47:07.212 INFO:teuthology.orchestra.run.smithi110.stdout:38654705668 2024-05-09T09:47:07.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.213+0000 7efc9b026640 1 -- 172.21.15.110:0/2755774133 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efc78036310 msgr2=0x7efc780387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:07.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.213+0000 7efc9b026640 1 --2- 172.21.15.110:0/2755774133 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efc78036310 0x7efc780387d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efc800ad000 tx=0x7efc800a6000 comp rx=0 tx=0).stop 2024-05-09T09:47:07.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.213+0000 7efc9b026640 1 -- 172.21.15.110:0/2755774133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc9409e3b0 msgr2=0x7efc94132310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:07.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.213+0000 7efc9b026640 1 --2- 172.21.15.110:0/2755774133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc9409e3b0 0x7efc94132310 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efc8800c380 tx=0x7efc8800c840 comp rx=0 tx=0).stop 2024-05-09T09:47:07.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.213+0000 7efc9b026640 1 -- 172.21.15.110:0/2755774133 shutdown_connections 2024-05-09T09:47:07.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.213+0000 7efc9b026640 1 --2- 172.21.15.110:0/2755774133 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efc78036310 0x7efc780387d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:07.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.213+0000 7efc9b026640 1 --2- 172.21.15.110:0/2755774133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc9409e3b0 0x7efc94132310 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:07.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.213+0000 7efc9b026640 1 -- 172.21.15.110:0/2755774133 >> 172.21.15.110:0/2755774133 conn(0x7efc940a17a0 msgr2=0x7efc940986a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:07.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.213+0000 7efc9b026640 1 -- 172.21.15.110:0/2755774133 shutdown_connections 2024-05-09T09:47:07.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.213+0000 7efc9b026640 1 -- 172.21.15.110:0/2755774133 wait complete. 2024-05-09T09:47:07.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705670 for osd.2 2024-05-09T09:47:07.223 DEBUG:teuthology.parallel:result is None 2024-05-09T09:47:07.230 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705668 for osd.1 2024-05-09T09:47:07.231 DEBUG:teuthology.parallel:result is None 2024-05-09T09:47:07.231 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T09:47:07.231 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T09:47:07.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.377+0000 7f86e8f02640 1 Processor -- start 2024-05-09T09:47:07.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.377+0000 7f86e8f02640 1 -- start start 2024-05-09T09:47:07.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.377+0000 7f86e8f02640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f86e409e3b0 0x7f86e412bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:07.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.377+0000 7f86e8f02640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86e412b820 con 0x7f86e412c1b0 2024-05-09T09:47:07.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.377+0000 7f86e8f02640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f86e40a0fc0 con 0x7f86e409e3b0 2024-05-09T09:47:07.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.377+0000 7f86e1d9b640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f86e412c1b0 0x7f86e412ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41286/0 (socket says 172.21.15.110:41286) 2024-05-09T09:47:07.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.377+0000 7f86e259c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f86e409e3b0 0x7f86e412bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:07.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.377+0000 7f86e1d9b640 1 -- 172.21.15.110:0/2301998753 learned_addr learned my addr 172.21.15.110:0/2301998753 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:47:07.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.377+0000 7f86e259c640 1 -- 172.21.15.110:0/2301998753 >> v1:172.21.15.110:6789/0 conn(0x7f86e412c1b0 legacy=0x7f86e412ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:07.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.377+0000 7f86e259c640 1 -- 172.21.15.110:0/2301998753 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e409b5f0 con 0x7f86e409e3b0 2024-05-09T09:47:07.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.377+0000 7f86e159a640 1 -- 172.21.15.110:0/2301998753 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 532396237 0 0) 0x7f86e412b820 con 0x7f86e412c1b0 2024-05-09T09:47:07.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.381+0000 7f86e259c640 1 --2- 172.21.15.110:0/2301998753 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e409e3b0 0x7f86e412bc70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009740 tx=0x7f86d401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd0f70c2cd6538b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:07.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.381+0000 7f86e159a640 1 -- 172.21.15.110:0/2301998753 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86d40b0070 con 0x7f86e409e3b0 2024-05-09T09:47:07.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.381+0000 7f86e159a640 1 -- 172.21.15.110:0/2301998753 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d40ab530 con 0x7f86e409e3b0 2024-05-09T09:47:07.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.381+0000 7f86e159a640 1 -- 172.21.15.110:0/2301998753 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86d40ab830 con 0x7f86e409e3b0 2024-05-09T09:47:07.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.381+0000 7f86e8f02640 1 -- 172.21.15.110:0/2301998753 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e409e3b0 msgr2=0x7f86e412bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:07.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.381+0000 7f86e8f02640 1 --2- 172.21.15.110:0/2301998753 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e409e3b0 0x7f86e412bc70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009740 tx=0x7f86d401c370 comp rx=0 tx=0).stop 2024-05-09T09:47:07.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.381+0000 7f86e8f02640 1 -- 172.21.15.110:0/2301998753 shutdown_connections 2024-05-09T09:47:07.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.381+0000 7f86e8f02640 1 --2- 172.21.15.110:0/2301998753 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e409e3b0 0x7f86e412bc70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:07.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.381+0000 7f86e8f02640 1 -- 172.21.15.110:0/2301998753 >> 172.21.15.110:0/2301998753 conn(0x7f86e40a17a0 msgr2=0x7f86e409dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:07.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.381+0000 7f86e8f02640 1 -- 172.21.15.110:0/2301998753 shutdown_connections 2024-05-09T09:47:07.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.381+0000 7f86e8f02640 1 -- 172.21.15.110:0/2301998753 wait complete. 2024-05-09T09:47:07.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.381+0000 7f86e8f02640 1 Processor -- start 2024-05-09T09:47:07.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.381+0000 7f86e8f02640 1 -- start start 2024-05-09T09:47:07.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.381+0000 7f86e8f02640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e409e3b0 0x7f86e41c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:07.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.381+0000 7f86e8f02640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f86e41371e0 con 0x7f86e409e3b0 2024-05-09T09:47:07.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.381+0000 7f86e259c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e409e3b0 0x7f86e41c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:07.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.381+0000 7f86e259c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e409e3b0 0x7f86e41c69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59730/0 (socket says 172.21.15.110:59730) 2024-05-09T09:47:07.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.381+0000 7f86e259c640 1 -- 172.21.15.110:0/2073320460 learned_addr learned my addr 172.21.15.110:0/2073320460 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:07.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.381+0000 7f86e259c640 1 -- 172.21.15.110:0/2073320460 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e406d490 con 0x7f86e409e3b0 2024-05-09T09:47:07.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.385+0000 7f86e259c640 1 --2- 172.21.15.110:0/2073320460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e409e3b0 0x7f86e41c69f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f86d4019fa0 tx=0x7f86d401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:07.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.385+0000 7f86daffd640 1 -- 172.21.15.110:0/2073320460 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86d40bb070 con 0x7f86e409e3b0 2024-05-09T09:47:07.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.385+0000 7f86daffd640 1 -- 172.21.15.110:0/2073320460 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d40abd90 con 0x7f86e409e3b0 2024-05-09T09:47:07.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.385+0000 7f86e8f02640 1 -- 172.21.15.110:0/2073320460 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86e4134720 con 0x7f86e409e3b0 2024-05-09T09:47:07.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.385+0000 7f86daffd640 1 -- 172.21.15.110:0/2073320460 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86d40b0040 con 0x7f86e409e3b0 2024-05-09T09:47:07.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.385+0000 7f86e8f02640 1 -- 172.21.15.110:0/2073320460 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86e406e8c0 con 0x7f86e409e3b0 2024-05-09T09:47:07.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.385+0000 7f86daffd640 1 -- 172.21.15.110:0/2073320460 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f86d4004150 con 0x7f86e409e3b0 2024-05-09T09:47:07.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.385+0000 7f86e8f02640 1 -- 172.21.15.110:0/2073320460 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86e4063710 con 0x7f86e409e3b0 2024-05-09T09:47:07.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.385+0000 7f86daffd640 1 --2- 172.21.15.110:0/2073320460 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f86c4036310 0x7f86c40387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:07.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.385+0000 7f86daffd640 1 -- 172.21.15.110:0/2073320460 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f86d40e33c0 con 0x7f86e409e3b0 2024-05-09T09:47:07.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.385+0000 7f86e1d9b640 1 --2- 172.21.15.110:0/2073320460 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f86c4036310 0x7f86c40387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:07.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.385+0000 7f86e1d9b640 1 --2- 172.21.15.110:0/2073320460 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f86c4036310 0x7f86c40387d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f86cc007fd0 tx=0x7f86cc007920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:07.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.389+0000 7f86daffd640 1 -- 172.21.15.110:0/2073320460 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f86d4015ff0 con 0x7f86e409e3b0 2024-05-09T09:47:07.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.533+0000 7f86e8f02640 1 -- 172.21.15.110:0/2073320460 --> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f86e4067fd0 con 0x7f86c4036310 2024-05-09T09:47:07.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.537+0000 7f86daffd640 1 -- 172.21.15.110:0/2073320460 <== mgr.4100 v2:172.21.15.157:6824/2765519551 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31813 (secure 0 0 0) 0x7f86e4067fd0 con 0x7f86c4036310 2024-05-09T09:47:07.538 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:47:07.538 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-05-09T09:47:07.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.541+0000 7f86e8f02640 1 -- 172.21.15.110:0/2073320460 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f86c4036310 msgr2=0x7f86c40387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:07.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.541+0000 7f86e8f02640 1 --2- 172.21.15.110:0/2073320460 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f86c4036310 0x7f86c40387d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f86cc007fd0 tx=0x7f86cc007920 comp rx=0 tx=0).stop 2024-05-09T09:47:07.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.541+0000 7f86e8f02640 1 -- 172.21.15.110:0/2073320460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e409e3b0 msgr2=0x7f86e41c69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:07.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.541+0000 7f86e8f02640 1 --2- 172.21.15.110:0/2073320460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e409e3b0 0x7f86e41c69f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f86d4019fa0 tx=0x7f86d401abb0 comp rx=0 tx=0).stop 2024-05-09T09:47:07.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.541+0000 7f86e8f02640 1 -- 172.21.15.110:0/2073320460 shutdown_connections 2024-05-09T09:47:07.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.541+0000 7f86e8f02640 1 --2- 172.21.15.110:0/2073320460 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f86c4036310 0x7f86c40387d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:07.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.541+0000 7f86e8f02640 1 --2- 172.21.15.110:0/2073320460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e409e3b0 0x7f86e41c69f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:07.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.541+0000 7f86e8f02640 1 -- 172.21.15.110:0/2073320460 >> 172.21.15.110:0/2073320460 conn(0x7f86e40a17a0 msgr2=0x7f86e409d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:07.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.541+0000 7f86e8f02640 1 -- 172.21.15.110:0/2073320460 shutdown_connections 2024-05-09T09:47:07.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.541+0000 7f86e8f02640 1 -- 172.21.15.110:0/2073320460 wait complete. 2024-05-09T09:47:07.554 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-05-09T09:47:07.068977+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":126380,"kb_used_data":1648,"kb_used_omap":6,"kb_used_meta":124665,"kb_avail":377360980,"statfs":{"total":386547056640,"available":386417643520,"internally_reserved":0,"allocated":1687552,"data_stored":1332828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":127657750},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001597"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-09T09:47:03.188318+0000","last_change":"2024-05-09T09:47:03.187330+0000","last_active":"2024-05-09T09:47:03.188318+0000","last_peered":"2024-05-09T09:47:03.188318+0000","last_clean":"2024-05-09T09:47:03.188318+0000","last_became_active":"2024-05-09T09:47:03.186434+0000","last_became_peered":"2024-05-09T09:47:03.186434+0000","last_unstale":"2024-05-09T09:47:03.188318+0000","last_undegraded":"2024-05-09T09:47:03.188318+0000","last_fullsized":"2024-05-09T09:47:03.188318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:12.598885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-09T09:47:03.053854+0000","last_change":"2024-05-09T09:47:03.053083+0000","last_active":"2024-05-09T09:47:03.053854+0000","last_peered":"2024-05-09T09:47:03.053854+0000","last_clean":"2024-05-09T09:47:03.053854+0000","last_became_active":"2024-05-09T09:47:03.052728+0000","last_became_peered":"2024-05-09T09:47:03.052728+0000","last_unstale":"2024-05-09T09:47:03.053854+0000","last_undegraded":"2024-05-09T09:47:03.053854+0000","last_fullsized":"2024-05-09T09:47:03.053854+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:13:12.520786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-09T09:47:03.053418+0000","last_change":"2024-05-09T09:47:03.051225+0000","last_active":"2024-05-09T09:47:03.053418+0000","last_peered":"2024-05-09T09:47:03.053418+0000","last_clean":"2024-05-09T09:47:03.053418+0000","last_became_active":"2024-05-09T09:47:03.050600+0000","last_became_peered":"2024-05-09T09:47:03.050600+0000","last_unstale":"2024-05-09T09:47:03.053418+0000","last_undegraded":"2024-05-09T09:47:03.053418+0000","last_fullsized":"2024-05-09T09:47:03.053418+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:03.759477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-09T09:47:03.052566+0000","last_change":"2024-05-09T09:47:03.051513+0000","last_active":"2024-05-09T09:47:03.052566+0000","last_peered":"2024-05-09T09:47:03.052566+0000","last_clean":"2024-05-09T09:47:03.052566+0000","last_became_active":"2024-05-09T09:47:03.051159+0000","last_became_peered":"2024-05-09T09:47:03.051159+0000","last_unstale":"2024-05-09T09:47:03.052566+0000","last_undegraded":"2024-05-09T09:47:03.052566+0000","last_fullsized":"2024-05-09T09:47:03.052566+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:03.759477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-09T09:47:03.054097+0000","last_change":"2024-05-09T09:47:03.051760+0000","last_active":"2024-05-09T09:47:03.054097+0000","last_peered":"2024-05-09T09:47:03.054097+0000","last_clean":"2024-05-09T09:47:03.054097+0000","last_became_active":"2024-05-09T09:47:03.050832+0000","last_became_peered":"2024-05-09T09:47:03.050832+0000","last_unstale":"2024-05-09T09:47:03.054097+0000","last_undegraded":"2024-05-09T09:47:03.054097+0000","last_fullsized":"2024-05-09T09:47:03.054097+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:48:39.354125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-09T09:47:04.047660+0000","last_change":"2024-05-09T09:47:03.052957+0000","last_active":"2024-05-09T09:47:04.047660+0000","last_peered":"2024-05-09T09:47:04.047660+0000","last_clean":"2024-05-09T09:47:04.047660+0000","last_became_active":"2024-05-09T09:47:03.052185+0000","last_became_peered":"2024-05-09T09:47:03.052185+0000","last_unstale":"2024-05-09T09:47:04.047660+0000","last_undegraded":"2024-05-09T09:47:04.047660+0000","last_fullsized":"2024-05-09T09:47:04.047660+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:48:39.354125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-09T09:47:03.054202+0000","last_change":"2024-05-09T09:47:03.051628+0000","last_active":"2024-05-09T09:47:03.054202+0000","last_peered":"2024-05-09T09:47:03.054202+0000","last_clean":"2024-05-09T09:47:03.054202+0000","last_became_active":"2024-05-09T09:47:03.050535+0000","last_became_peered":"2024-05-09T09:47:03.050535+0000","last_unstale":"2024-05-09T09:47:03.054202+0000","last_undegraded":"2024-05-09T09:47:03.054202+0000","last_fullsized":"2024-05-09T09:47:03.054202+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:13:12.520786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-09T09:47:03.055655+0000","last_change":"2024-05-09T09:47:03.054623+0000","last_active":"2024-05-09T09:47:03.055655+0000","last_peered":"2024-05-09T09:47:03.055655+0000","last_clean":"2024-05-09T09:47:03.055655+0000","last_became_active":"2024-05-09T09:47:03.053783+0000","last_became_peered":"2024-05-09T09:47:03.053783+0000","last_unstale":"2024-05-09T09:47:03.055655+0000","last_undegraded":"2024-05-09T09:47:03.055655+0000","last_fullsized":"2024-05-09T09:47:03.055655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:37:13.421296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":166,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-09T09:47:03.183553+0000","last_change":"2024-05-09T09:46:57.510904+0000","last_active":"2024-05-09T09:47:03.183553+0000","last_peered":"2024-05-09T09:47:03.183553+0000","last_clean":"2024-05-09T09:47:03.183553+0000","last_became_active":"2024-05-09T09:46:57.508178+0000","last_became_peered":"2024-05-09T09:46:57.508178+0000","last_unstale":"2024-05-09T09:47:03.183553+0000","last_undegraded":"2024-05-09T09:47:03.183553+0000","last_fullsized":"2024-05-09T09:47:03.183553+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:46:56.015260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:46:56.015260+0000","last_clean_scrub_stamp":"2024-05-09T09:46:56.015260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:04:32.521129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31300,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340540,"statfs":{"total":96636764160,"available":96604712960,"internally_reserved":0,"allocated":122880,"data_stored":37018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":724992,"data_stored":631406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31884,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":716800,"data_stored":627386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31300,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340540,"statfs":{"total":96636764160,"available":96604712960,"internally_reserved":0,"allocated":122880,"data_stored":37018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T09:47:07.555 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T09:47:07.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.669+0000 7f2171258640 1 Processor -- start 2024-05-09T09:47:07.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.669+0000 7f2171258640 1 -- start start 2024-05-09T09:47:07.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.669+0000 7f2171258640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f216c09e3b0 0x7f216c12bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:07.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.669+0000 7f2171258640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f216c12b820 con 0x7f216c12c1b0 2024-05-09T09:47:07.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.669+0000 7f2171258640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f216c0a0fc0 con 0x7f216c09e3b0 2024-05-09T09:47:07.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.669+0000 7f216ad9d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f216c09e3b0 0x7f216c12bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:07.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.669+0000 7f216a59c640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f216c12c1b0 0x7f216c12ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41292/0 (socket says 172.21.15.110:41292) 2024-05-09T09:47:07.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.669+0000 7f216a59c640 1 -- 172.21.15.110:0/244239406 learned_addr learned my addr 172.21.15.110:0/244239406 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:47:07.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.669+0000 7f216ad9d640 1 -- 172.21.15.110:0/244239406 >> v1:172.21.15.110:6789/0 conn(0x7f216c12c1b0 legacy=0x7f216c12ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:07.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.669+0000 7f2169d9b640 1 -- 172.21.15.110:0/244239406 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4184410615 0 0) 0x7f216c12b820 con 0x7f216c12c1b0 2024-05-09T09:47:07.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.669+0000 7f216ad9d640 1 -- 172.21.15.110:0/244239406 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f216c09b5f0 con 0x7f216c09e3b0 2024-05-09T09:47:07.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.669+0000 7f216ad9d640 1 --2- 172.21.15.110:0/244239406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f216c09e3b0 0x7f216c12bc70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f215c009740 tx=0x7f215c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41c3909715865ab4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:07.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.669+0000 7f2169d9b640 1 -- 172.21.15.110:0/244239406 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f215c0b0070 con 0x7f216c09e3b0 2024-05-09T09:47:07.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.669+0000 7f2169d9b640 1 -- 172.21.15.110:0/244239406 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f215c0ab530 con 0x7f216c09e3b0 2024-05-09T09:47:07.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.669+0000 7f2169d9b640 1 -- 172.21.15.110:0/244239406 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f215c0ab830 con 0x7f216c09e3b0 2024-05-09T09:47:07.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.669+0000 7f2171258640 1 -- 172.21.15.110:0/244239406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f216c09e3b0 msgr2=0x7f216c12bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:07.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.669+0000 7f2171258640 1 --2- 172.21.15.110:0/244239406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f216c09e3b0 0x7f216c12bc70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f215c009740 tx=0x7f215c01c370 comp rx=0 tx=0).stop 2024-05-09T09:47:07.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.669+0000 7f2171258640 1 -- 172.21.15.110:0/244239406 shutdown_connections 2024-05-09T09:47:07.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.669+0000 7f2171258640 1 --2- 172.21.15.110:0/244239406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f216c09e3b0 0x7f216c12bc70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:07.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.669+0000 7f2171258640 1 -- 172.21.15.110:0/244239406 >> 172.21.15.110:0/244239406 conn(0x7f216c0a17a0 msgr2=0x7f216c09dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:07.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.669+0000 7f2171258640 1 -- 172.21.15.110:0/244239406 shutdown_connections 2024-05-09T09:47:07.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.669+0000 7f2171258640 1 -- 172.21.15.110:0/244239406 wait complete. 2024-05-09T09:47:07.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.673+0000 7f2171258640 1 Processor -- start 2024-05-09T09:47:07.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.673+0000 7f2171258640 1 -- start start 2024-05-09T09:47:07.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.673+0000 7f2171258640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f216c09e3b0 0x7f216c1c6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:07.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.673+0000 7f2171258640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f216c1371e0 con 0x7f216c09e3b0 2024-05-09T09:47:07.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.673+0000 7f216ad9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f216c09e3b0 0x7f216c1c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:07.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.673+0000 7f216ad9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f216c09e3b0 0x7f216c1c6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59748/0 (socket says 172.21.15.110:59748) 2024-05-09T09:47:07.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.673+0000 7f216ad9d640 1 -- 172.21.15.110:0/1185717835 learned_addr learned my addr 172.21.15.110:0/1185717835 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:07.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.673+0000 7f216ad9d640 1 -- 172.21.15.110:0/1185717835 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f216c06dbf0 con 0x7f216c09e3b0 2024-05-09T09:47:07.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.673+0000 7f216ad9d640 1 --2- 172.21.15.110:0/1185717835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f216c09e3b0 0x7f216c1c6610 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f215c019fa0 tx=0x7f215c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:07.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.673+0000 7f21537fe640 1 -- 172.21.15.110:0/1185717835 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f215c0b0050 con 0x7f216c09e3b0 2024-05-09T09:47:07.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.673+0000 7f21537fe640 1 -- 172.21.15.110:0/1185717835 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f215c0b1040 con 0x7f216c09e3b0 2024-05-09T09:47:07.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.673+0000 7f2171258640 1 -- 172.21.15.110:0/1185717835 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f216c06de20 con 0x7f216c09e3b0 2024-05-09T09:47:07.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.673+0000 7f21537fe640 1 -- 172.21.15.110:0/1185717835 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f215c0b76b0 con 0x7f216c09e3b0 2024-05-09T09:47:07.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.673+0000 7f2171258640 1 -- 172.21.15.110:0/1185717835 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f216c1c6d20 con 0x7f216c09e3b0 2024-05-09T09:47:07.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.673+0000 7f21537fe640 1 -- 172.21.15.110:0/1185717835 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f215c0be030 con 0x7f216c09e3b0 2024-05-09T09:47:07.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.673+0000 7f2171258640 1 -- 172.21.15.110:0/1185717835 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f216c063710 con 0x7f216c09e3b0 2024-05-09T09:47:07.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.673+0000 7f21537fe640 1 --2- 172.21.15.110:0/1185717835 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2158036310 0x7f21580387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:07.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.673+0000 7f21537fe640 1 -- 172.21.15.110:0/1185717835 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f215c0bc070 con 0x7f216c09e3b0 2024-05-09T09:47:07.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.673+0000 7f216a59c640 1 --2- 172.21.15.110:0/1185717835 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2158036310 0x7f21580387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:07.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.673+0000 7f216a59c640 1 --2- 172.21.15.110:0/1185717835 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2158036310 0x7f21580387d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2160007fd0 tx=0x7f2160007920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:07.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.677+0000 7f21537fe640 1 -- 172.21.15.110:0/1185717835 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f215c0c5020 con 0x7f216c09e3b0 2024-05-09T09:47:07.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.821+0000 7f2171258640 1 -- 172.21.15.110:0/1185717835 --> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f216c12ec60 con 0x7f2158036310 2024-05-09T09:47:07.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.825+0000 7f21537fe640 1 -- 172.21.15.110:0/1185717835 <== mgr.4100 v2:172.21.15.157:6824/2765519551 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31813 (secure 0 0 0) 0x7f21600070d0 con 0x7f2158036310 2024-05-09T09:47:07.825 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:47:07.825 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-05-09T09:47:07.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.825+0000 7f2171258640 1 -- 172.21.15.110:0/1185717835 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2158036310 msgr2=0x7f21580387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:07.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.825+0000 7f2171258640 1 --2- 172.21.15.110:0/1185717835 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2158036310 0x7f21580387d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2160007fd0 tx=0x7f2160007920 comp rx=0 tx=0).stop 2024-05-09T09:47:07.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.829+0000 7f2171258640 1 -- 172.21.15.110:0/1185717835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f216c09e3b0 msgr2=0x7f216c1c6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:07.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.829+0000 7f2171258640 1 --2- 172.21.15.110:0/1185717835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f216c09e3b0 0x7f216c1c6610 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f215c019fa0 tx=0x7f215c01abb0 comp rx=0 tx=0).stop 2024-05-09T09:47:07.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.829+0000 7f2171258640 1 -- 172.21.15.110:0/1185717835 shutdown_connections 2024-05-09T09:47:07.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.829+0000 7f2171258640 1 --2- 172.21.15.110:0/1185717835 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2158036310 0x7f21580387d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:07.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.829+0000 7f2171258640 1 --2- 172.21.15.110:0/1185717835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f216c09e3b0 0x7f216c1c6610 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:07.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.829+0000 7f2171258640 1 -- 172.21.15.110:0/1185717835 >> 172.21.15.110:0/1185717835 conn(0x7f216c0a17a0 msgr2=0x7f216c0986a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:07.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.829+0000 7f2171258640 1 -- 172.21.15.110:0/1185717835 shutdown_connections 2024-05-09T09:47:07.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.829+0000 7f2171258640 1 -- 172.21.15.110:0/1185717835 wait complete. 2024-05-09T09:47:07.842 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-05-09T09:47:07.068977+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":126380,"kb_used_data":1648,"kb_used_omap":6,"kb_used_meta":124665,"kb_avail":377360980,"statfs":{"total":386547056640,"available":386417643520,"internally_reserved":0,"allocated":1687552,"data_stored":1332828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":127657750},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001597"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-09T09:47:03.188318+0000","last_change":"2024-05-09T09:47:03.187330+0000","last_active":"2024-05-09T09:47:03.188318+0000","last_peered":"2024-05-09T09:47:03.188318+0000","last_clean":"2024-05-09T09:47:03.188318+0000","last_became_active":"2024-05-09T09:47:03.186434+0000","last_became_peered":"2024-05-09T09:47:03.186434+0000","last_unstale":"2024-05-09T09:47:03.188318+0000","last_undegraded":"2024-05-09T09:47:03.188318+0000","last_fullsized":"2024-05-09T09:47:03.188318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:12.598885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-09T09:47:03.053854+0000","last_change":"2024-05-09T09:47:03.053083+0000","last_active":"2024-05-09T09:47:03.053854+0000","last_peered":"2024-05-09T09:47:03.053854+0000","last_clean":"2024-05-09T09:47:03.053854+0000","last_became_active":"2024-05-09T09:47:03.052728+0000","last_became_peered":"2024-05-09T09:47:03.052728+0000","last_unstale":"2024-05-09T09:47:03.053854+0000","last_undegraded":"2024-05-09T09:47:03.053854+0000","last_fullsized":"2024-05-09T09:47:03.053854+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:13:12.520786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-09T09:47:03.053418+0000","last_change":"2024-05-09T09:47:03.051225+0000","last_active":"2024-05-09T09:47:03.053418+0000","last_peered":"2024-05-09T09:47:03.053418+0000","last_clean":"2024-05-09T09:47:03.053418+0000","last_became_active":"2024-05-09T09:47:03.050600+0000","last_became_peered":"2024-05-09T09:47:03.050600+0000","last_unstale":"2024-05-09T09:47:03.053418+0000","last_undegraded":"2024-05-09T09:47:03.053418+0000","last_fullsized":"2024-05-09T09:47:03.053418+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:03.759477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-09T09:47:03.052566+0000","last_change":"2024-05-09T09:47:03.051513+0000","last_active":"2024-05-09T09:47:03.052566+0000","last_peered":"2024-05-09T09:47:03.052566+0000","last_clean":"2024-05-09T09:47:03.052566+0000","last_became_active":"2024-05-09T09:47:03.051159+0000","last_became_peered":"2024-05-09T09:47:03.051159+0000","last_unstale":"2024-05-09T09:47:03.052566+0000","last_undegraded":"2024-05-09T09:47:03.052566+0000","last_fullsized":"2024-05-09T09:47:03.052566+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:32:03.759477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-09T09:47:03.054097+0000","last_change":"2024-05-09T09:47:03.051760+0000","last_active":"2024-05-09T09:47:03.054097+0000","last_peered":"2024-05-09T09:47:03.054097+0000","last_clean":"2024-05-09T09:47:03.054097+0000","last_became_active":"2024-05-09T09:47:03.050832+0000","last_became_peered":"2024-05-09T09:47:03.050832+0000","last_unstale":"2024-05-09T09:47:03.054097+0000","last_undegraded":"2024-05-09T09:47:03.054097+0000","last_fullsized":"2024-05-09T09:47:03.054097+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:48:39.354125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-09T09:47:04.047660+0000","last_change":"2024-05-09T09:47:03.052957+0000","last_active":"2024-05-09T09:47:04.047660+0000","last_peered":"2024-05-09T09:47:04.047660+0000","last_clean":"2024-05-09T09:47:04.047660+0000","last_became_active":"2024-05-09T09:47:03.052185+0000","last_became_peered":"2024-05-09T09:47:03.052185+0000","last_unstale":"2024-05-09T09:47:04.047660+0000","last_undegraded":"2024-05-09T09:47:04.047660+0000","last_fullsized":"2024-05-09T09:47:04.047660+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:48:39.354125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-09T09:47:03.054202+0000","last_change":"2024-05-09T09:47:03.051628+0000","last_active":"2024-05-09T09:47:03.054202+0000","last_peered":"2024-05-09T09:47:03.054202+0000","last_clean":"2024-05-09T09:47:03.054202+0000","last_became_active":"2024-05-09T09:47:03.050535+0000","last_became_peered":"2024-05-09T09:47:03.050535+0000","last_unstale":"2024-05-09T09:47:03.054202+0000","last_undegraded":"2024-05-09T09:47:03.054202+0000","last_fullsized":"2024-05-09T09:47:03.054202+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:13:12.520786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-09T09:47:03.055655+0000","last_change":"2024-05-09T09:47:03.054623+0000","last_active":"2024-05-09T09:47:03.055655+0000","last_peered":"2024-05-09T09:47:03.055655+0000","last_clean":"2024-05-09T09:47:03.055655+0000","last_became_active":"2024-05-09T09:47:03.053783+0000","last_became_peered":"2024-05-09T09:47:03.053783+0000","last_unstale":"2024-05-09T09:47:03.055655+0000","last_undegraded":"2024-05-09T09:47:03.055655+0000","last_fullsized":"2024-05-09T09:47:03.055655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:37:13.421296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":166,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-09T09:47:03.183553+0000","last_change":"2024-05-09T09:46:57.510904+0000","last_active":"2024-05-09T09:47:03.183553+0000","last_peered":"2024-05-09T09:47:03.183553+0000","last_clean":"2024-05-09T09:47:03.183553+0000","last_became_active":"2024-05-09T09:46:57.508178+0000","last_became_peered":"2024-05-09T09:46:57.508178+0000","last_unstale":"2024-05-09T09:47:03.183553+0000","last_undegraded":"2024-05-09T09:47:03.183553+0000","last_fullsized":"2024-05-09T09:47:03.183553+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:46:56.015260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:46:56.015260+0000","last_clean_scrub_stamp":"2024-05-09T09:46:56.015260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:04:32.521129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31300,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340540,"statfs":{"total":96636764160,"available":96604712960,"internally_reserved":0,"allocated":122880,"data_stored":37018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":724992,"data_stored":631406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31884,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":716800,"data_stored":627386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31300,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340540,"statfs":{"total":96636764160,"available":96604712960,"internally_reserved":0,"allocated":122880,"data_stored":37018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T09:47:07.842 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T09:47:07.842 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-09T09:47:07.843 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-09T09:47:07.843 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-09T09:47:07.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.957+0000 7f330c3c1640 1 Processor -- start 2024-05-09T09:47:07.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.957+0000 7f330c3c1640 1 -- start start 2024-05-09T09:47:07.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.957+0000 7f330c3c1640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f330412fce0 0x7f33041320d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:07.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.957+0000 7f330c3c1640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f330406ee70 con 0x7f33041299d0 2024-05-09T09:47:07.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.957+0000 7f330c3c1640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f33041297d0 con 0x7f330412fce0 2024-05-09T09:47:07.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.957+0000 7f330a15d640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f33041299d0 0x7f3304129db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41296/0 (socket says 172.21.15.110:41296) 2024-05-09T09:47:07.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.957+0000 7f330a15d640 1 -- 172.21.15.110:0/1427563019 learned_addr learned my addr 172.21.15.110:0/1427563019 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:47:07.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.957+0000 7f330995c640 1 --2- 172.21.15.110:0/1427563019 >> v2:172.21.15.110:3300/0 conn(0x7f330412fce0 0x7f33041320d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:07.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.957+0000 7f330915b640 1 -- 172.21.15.110:0/1427563019 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3343244618 0 0) 0x7f330406ee70 con 0x7f33041299d0 2024-05-09T09:47:07.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.957+0000 7f330915b640 1 -- 172.21.15.110:0/1427563019 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32f0003530 con 0x7f33041299d0 2024-05-09T09:47:07.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.957+0000 7f330995c640 1 -- 172.21.15.110:0/1427563019 >> v1:172.21.15.110:6789/0 conn(0x7f33041299d0 legacy=0x7f3304129db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:07.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.957+0000 7f330995c640 1 -- 172.21.15.110:0/1427563019 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33040979f0 con 0x7f330412fce0 2024-05-09T09:47:07.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.961+0000 7f330995c640 1 --2- 172.21.15.110:0/1427563019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f330412fce0 0x7f33041320d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f32f4009740 tx=0x7f32f401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ce8073c16cea11 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:07.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.961+0000 7f330915b640 1 -- 172.21.15.110:0/1427563019 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f40b0070 con 0x7f330412fce0 2024-05-09T09:47:07.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.961+0000 7f330915b640 1 -- 172.21.15.110:0/1427563019 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f40ab530 con 0x7f330412fce0 2024-05-09T09:47:07.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.961+0000 7f330915b640 1 -- 172.21.15.110:0/1427563019 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f40ab830 con 0x7f330412fce0 2024-05-09T09:47:07.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.961+0000 7f330c3c1640 1 -- 172.21.15.110:0/1427563019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f330412fce0 msgr2=0x7f33041320d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:07.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.961+0000 7f330c3c1640 1 --2- 172.21.15.110:0/1427563019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f330412fce0 0x7f33041320d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f32f4009740 tx=0x7f32f401c370 comp rx=0 tx=0).stop 2024-05-09T09:47:07.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.961+0000 7f330c3c1640 1 -- 172.21.15.110:0/1427563019 shutdown_connections 2024-05-09T09:47:07.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.961+0000 7f330c3c1640 1 --2- 172.21.15.110:0/1427563019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f330412fce0 0x7f33041320d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:07.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.961+0000 7f330c3c1640 1 -- 172.21.15.110:0/1427563019 >> 172.21.15.110:0/1427563019 conn(0x7f330409e230 msgr2=0x7f330409e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:07.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.961+0000 7f330c3c1640 1 -- 172.21.15.110:0/1427563019 shutdown_connections 2024-05-09T09:47:07.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.961+0000 7f330c3c1640 1 -- 172.21.15.110:0/1427563019 wait complete. 2024-05-09T09:47:07.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.961+0000 7f330c3c1640 1 Processor -- start 2024-05-09T09:47:07.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.961+0000 7f330c3c1640 1 -- start start 2024-05-09T09:47:07.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.961+0000 7f330c3c1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33041299d0 0x7f33041241f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:07.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.961+0000 7f330c3c1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f33041351c0 con 0x7f33041299d0 2024-05-09T09:47:07.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.961+0000 7f330a15d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33041299d0 0x7f33041241f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:07.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.961+0000 7f330a15d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33041299d0 0x7f33041241f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59752/0 (socket says 172.21.15.110:59752) 2024-05-09T09:47:07.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.961+0000 7f330a15d640 1 -- 172.21.15.110:0/889055435 learned_addr learned my addr 172.21.15.110:0/889055435 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:47:07.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.961+0000 7f330a15d640 1 -- 172.21.15.110:0/889055435 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3304125b10 con 0x7f33041299d0 2024-05-09T09:47:07.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.961+0000 7f330a15d640 1 --2- 172.21.15.110:0/889055435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33041299d0 0x7f33041241f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f330000c450 tx=0x7f330000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:07.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.961+0000 7f32faffd640 1 -- 172.21.15.110:0/889055435 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3300017070 con 0x7f33041299d0 2024-05-09T09:47:07.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.961+0000 7f32faffd640 1 -- 172.21.15.110:0/889055435 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3300005c20 con 0x7f33041299d0 2024-05-09T09:47:07.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.961+0000 7f32faffd640 1 -- 172.21.15.110:0/889055435 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3300007070 con 0x7f33041299d0 2024-05-09T09:47:07.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.961+0000 7f330c3c1640 1 -- 172.21.15.110:0/889055435 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3304126780 con 0x7f33041299d0 2024-05-09T09:47:07.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.961+0000 7f330c3c1640 1 -- 172.21.15.110:0/889055435 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3304124730 con 0x7f33041299d0 2024-05-09T09:47:07.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.961+0000 7f32faffd640 1 -- 172.21.15.110:0/889055435 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f330001a070 con 0x7f33041299d0 2024-05-09T09:47:07.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.961+0000 7f330c3c1640 1 -- 172.21.15.110:0/889055435 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3304063710 con 0x7f33041299d0 2024-05-09T09:47:07.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.961+0000 7f32faffd640 1 --2- 172.21.15.110:0/889055435 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f32e8036310 0x7f32e80387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:07.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.965+0000 7f32faffd640 1 -- 172.21.15.110:0/889055435 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f3300047f80 con 0x7f33041299d0 2024-05-09T09:47:07.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.965+0000 7f330995c640 1 --2- 172.21.15.110:0/889055435 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f32e8036310 0x7f32e80387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:07.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.965+0000 7f330995c640 1 --2- 172.21.15.110:0/889055435 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f32e8036310 0x7f32e80387d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f32f40ad000 tx=0x7f32f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:07.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:07.969+0000 7f32faffd640 1 -- 172.21.15.110:0/889055435 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3300007210 con 0x7f33041299d0 2024-05-09T09:47:08.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:08.149+0000 7f330c3c1640 1 -- 172.21.15.110:0/889055435 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f330409a6a0 con 0x7f33041299d0 2024-05-09T09:47:08.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:08.149+0000 7f32faffd640 1 -- 172.21.15.110:0/889055435 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f3300012400 con 0x7f33041299d0 2024-05-09T09:47:08.150 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:47:08.150 INFO:teuthology.orchestra.run.smithi110.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-09T09:47:08.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:08.153+0000 7f330c3c1640 1 -- 172.21.15.110:0/889055435 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f32e8036310 msgr2=0x7f32e80387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:08.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:08.153+0000 7f330c3c1640 1 --2- 172.21.15.110:0/889055435 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f32e8036310 0x7f32e80387d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f32f40ad000 tx=0x7f32f4008040 comp rx=0 tx=0).stop 2024-05-09T09:47:08.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:08.153+0000 7f330c3c1640 1 -- 172.21.15.110:0/889055435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33041299d0 msgr2=0x7f33041241f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:08.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:08.153+0000 7f330c3c1640 1 --2- 172.21.15.110:0/889055435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33041299d0 0x7f33041241f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f330000c450 tx=0x7f330000c910 comp rx=0 tx=0).stop 2024-05-09T09:47:08.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:08.153+0000 7f330c3c1640 1 -- 172.21.15.110:0/889055435 shutdown_connections 2024-05-09T09:47:08.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:08.153+0000 7f330c3c1640 1 --2- 172.21.15.110:0/889055435 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f32e8036310 0x7f32e80387d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:08.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:08.153+0000 7f330c3c1640 1 --2- 172.21.15.110:0/889055435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33041299d0 0x7f33041241f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:08.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:08.153+0000 7f330c3c1640 1 -- 172.21.15.110:0/889055435 >> 172.21.15.110:0/889055435 conn(0x7f330409e230 msgr2=0x7f3304127350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:08.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:08.153+0000 7f330c3c1640 1 -- 172.21.15.110:0/889055435 shutdown_connections 2024-05-09T09:47:08.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:47:08.153+0000 7f330c3c1640 1 -- 172.21.15.110:0/889055435 wait complete. 2024-05-09T09:47:08.167 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-09T09:47:08.168 INFO:teuthology.run_tasks:Running task rgw... 2024-05-09T09:47:08.182 DEBUG:tasks.rgw:config is {'client.0': None} 2024-05-09T09:47:08.182 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-05-09T09:47:08.182 INFO:tasks.rgw:Creating data pools 2024-05-09T09:47:08.182 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-05-09T09:47:08.182 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-05-09T09:47:08.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.312+0000 7fc3d86e6640 1 Processor -- start 2024-05-09T09:47:08.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.312+0000 7fc3d86e6640 1 -- start start 2024-05-09T09:47:08.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.316+0000 7fc3d86e6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc3d010f010 0x7fc3d010f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:08.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.316+0000 7fc3d86e6640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3d010fab0 con 0x7fc3d0118120 2024-05-09T09:47:08.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.316+0000 7fc3d86e6640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fc3d011cc40 con 0x7fc3d010f010 2024-05-09T09:47:08.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.316+0000 7fc3d6482640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc3d010f010 0x7fc3d010f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:08.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.316+0000 7fc3d6482640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc3d010f010 0x7fc3d010f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:36598/0 (socket says 172.21.15.157:36598) 2024-05-09T09:47:08.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.316+0000 7fc3d5c81640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc3d0118120 0x7fc3d011a510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:47684/0 (socket says 172.21.15.157:47684) 2024-05-09T09:47:08.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.316+0000 7fc3d6482640 1 -- 172.21.15.157:0/2457074362 learned_addr learned my addr 172.21.15.157:0/2457074362 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:08.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.316+0000 7fc3d6482640 1 -- 172.21.15.157:0/2457074362 >> v1:172.21.15.110:6789/0 conn(0x7fc3d0118120 legacy=0x7fc3d011a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:08.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.316+0000 7fc3d5480640 1 -- 172.21.15.157:0/2457074362 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2200100102 0 0) 0x7fc3d010fab0 con 0x7fc3d0118120 2024-05-09T09:47:08.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.316+0000 7fc3d6482640 1 -- 172.21.15.157:0/2457074362 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d011cdc0 con 0x7fc3d010f010 2024-05-09T09:47:08.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.320+0000 7fc3d6482640 1 --2- 172.21.15.157:0/2457074362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d010f010 0x7fc3d010f3f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0097f0 tx=0x7fc3cc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f556b49a498f7b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:08.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.320+0000 7fc3d5480640 1 -- 172.21.15.157:0/2457074362 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3cc0ab580 con 0x7fc3d010f010 2024-05-09T09:47:08.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.320+0000 7fc3d5480640 1 -- 172.21.15.157:0/2457074362 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3cc0b0070 con 0x7fc3d010f010 2024-05-09T09:47:08.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.320+0000 7fc3d5480640 1 -- 172.21.15.157:0/2457074362 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3cc0ab870 con 0x7fc3d010f010 2024-05-09T09:47:08.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.320+0000 7fc3d86e6640 1 -- 172.21.15.157:0/2457074362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d010f010 msgr2=0x7fc3d010f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:08.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.320+0000 7fc3d86e6640 1 --2- 172.21.15.157:0/2457074362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d010f010 0x7fc3d010f3f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0097f0 tx=0x7fc3cc01c430 comp rx=0 tx=0).stop 2024-05-09T09:47:08.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.324+0000 7fc3d86e6640 1 -- 172.21.15.157:0/2457074362 shutdown_connections 2024-05-09T09:47:08.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.324+0000 7fc3d86e6640 1 --2- 172.21.15.157:0/2457074362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d010f010 0x7fc3d010f3f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:08.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.324+0000 7fc3d86e6640 1 -- 172.21.15.157:0/2457074362 >> 172.21.15.157:0/2457074362 conn(0x7fc3d006f560 msgr2=0x7fc3d0071980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:08.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.324+0000 7fc3d86e6640 1 -- 172.21.15.157:0/2457074362 shutdown_connections 2024-05-09T09:47:08.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.324+0000 7fc3d86e6640 1 -- 172.21.15.157:0/2457074362 wait complete. 2024-05-09T09:47:08.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.324+0000 7fc3d86e6640 1 Processor -- start 2024-05-09T09:47:08.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.324+0000 7fc3d86e6640 1 -- start start 2024-05-09T09:47:08.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.324+0000 7fc3d86e6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d010f010 0x7fc3d01acf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:08.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.324+0000 7fc3d86e6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d011c920 con 0x7fc3d010f010 2024-05-09T09:47:08.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.324+0000 7fc3d6482640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d010f010 0x7fc3d01acf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:08.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.324+0000 7fc3d6482640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d010f010 0x7fc3d01acf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:36614/0 (socket says 172.21.15.157:36614) 2024-05-09T09:47:08.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.324+0000 7fc3d6482640 1 -- 172.21.15.157:0/1432217953 learned_addr learned my addr 172.21.15.157:0/1432217953 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:08.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.324+0000 7fc3d6482640 1 -- 172.21.15.157:0/1432217953 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d01ad520 con 0x7fc3d010f010 2024-05-09T09:47:08.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.324+0000 7fc3d6482640 1 --2- 172.21.15.157:0/1432217953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d010f010 0x7fc3d01acf50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc019040 tx=0x7fc3cc01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:08.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.324+0000 7fc3c6ffd640 1 -- 172.21.15.157:0/1432217953 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3cc0ba070 con 0x7fc3d010f010 2024-05-09T09:47:08.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.324+0000 7fc3d86e6640 1 -- 172.21.15.157:0/1432217953 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3d01ad750 con 0x7fc3d010f010 2024-05-09T09:47:08.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.324+0000 7fc3c6ffd640 1 -- 172.21.15.157:0/1432217953 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3cc004020 con 0x7fc3d010f010 2024-05-09T09:47:08.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.324+0000 7fc3c6ffd640 1 -- 172.21.15.157:0/1432217953 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3cc004340 con 0x7fc3d010f010 2024-05-09T09:47:08.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.324+0000 7fc3d86e6640 1 -- 172.21.15.157:0/1432217953 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3d01a7070 con 0x7fc3d010f010 2024-05-09T09:47:08.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.324+0000 7fc3d86e6640 1 -- 172.21.15.157:0/1432217953 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3d00505f0 con 0x7fc3d010f010 2024-05-09T09:47:08.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.324+0000 7fc3c6ffd640 1 -- 172.21.15.157:0/1432217953 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fc3cc003620 con 0x7fc3d010f010 2024-05-09T09:47:08.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.324+0000 7fc3c6ffd640 1 --2- 172.21.15.157:0/1432217953 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc3b40362c0 0x7fc3b4038780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:08.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.324+0000 7fc3c6ffd640 1 -- 172.21.15.157:0/1432217953 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7fc3cc0e3610 con 0x7fc3d010f010 2024-05-09T09:47:08.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.324+0000 7fc3d5c81640 1 --2- 172.21.15.157:0/1432217953 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc3b40362c0 0x7fc3b4038780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:08.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.328+0000 7fc3d5c81640 1 --2- 172.21.15.157:0/1432217953 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc3b40362c0 0x7fc3b4038780 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0007fd0 tx=0x7fc3c0007940 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:08.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.344+0000 7fc3c6ffd640 1 -- 172.21.15.157:0/1432217953 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc3cc0160b0 con 0x7fc3d010f010 2024-05-09T09:47:08.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:08.512+0000 7fc3d86e6640 1 -- 172.21.15.157:0/1432217953 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]} v 0) -- 0x7fc3d0118120 con 0x7fc3d010f010 2024-05-09T09:47:09.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.124+0000 7fc3c6ffd640 1 -- 172.21.15.157:0/1432217953 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]}]=0 v16) ==== 171+0+0 (secure 0 0 0) 0x7fc3cc0039c0 con 0x7fc3d010f010 2024-05-09T09:47:09.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.124+0000 7fc3d86e6640 1 -- 172.21.15.157:0/1432217953 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc3b40362c0 msgr2=0x7fc3b4038780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:09.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.124+0000 7fc3d86e6640 1 --2- 172.21.15.157:0/1432217953 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc3b40362c0 0x7fc3b4038780 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0007fd0 tx=0x7fc3c0007940 comp rx=0 tx=0).stop 2024-05-09T09:47:09.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.124+0000 7fc3d86e6640 1 -- 172.21.15.157:0/1432217953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d010f010 msgr2=0x7fc3d01acf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:09.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.124+0000 7fc3d86e6640 1 --2- 172.21.15.157:0/1432217953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d010f010 0x7fc3d01acf50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc019040 tx=0x7fc3cc01ac70 comp rx=0 tx=0).stop 2024-05-09T09:47:09.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.124+0000 7fc3d86e6640 1 -- 172.21.15.157:0/1432217953 shutdown_connections 2024-05-09T09:47:09.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.124+0000 7fc3d86e6640 1 --2- 172.21.15.157:0/1432217953 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc3b40362c0 0x7fc3b4038780 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:09.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.124+0000 7fc3d86e6640 1 --2- 172.21.15.157:0/1432217953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3d010f010 0x7fc3d01acf50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:09.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.124+0000 7fc3d86e6640 1 -- 172.21.15.157:0/1432217953 >> 172.21.15.157:0/1432217953 conn(0x7fc3d006f560 msgr2=0x7fc3d01120d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:09.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.124+0000 7fc3d86e6640 1 -- 172.21.15.157:0/1432217953 shutdown_connections 2024-05-09T09:47:09.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.124+0000 7fc3d86e6640 1 -- 172.21.15.157:0/1432217953 wait complete. 2024-05-09T09:47:09.145 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-05-09T09:47:09.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.276+0000 7fa22fc1c640 1 Processor -- start 2024-05-09T09:47:09.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.276+0000 7fa22fc1c640 1 -- start start 2024-05-09T09:47:09.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.276+0000 7fa22fc1c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa228119130 0x7fa22811b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:09.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.276+0000 7fa22fc1c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa22811ba60 con 0x7fa22810f010 2024-05-09T09:47:09.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.276+0000 7fa22fc1c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fa22811cc40 con 0x7fa228119130 2024-05-09T09:47:09.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.276+0000 7fa22d1b7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa228119130 0x7fa22811b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:09.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.276+0000 7fa22d1b7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa228119130 0x7fa22811b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:36630/0 (socket says 172.21.15.157:36630) 2024-05-09T09:47:09.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.276+0000 7fa22d1b7640 1 -- 172.21.15.157:0/3663466542 learned_addr learned my addr 172.21.15.157:0/3663466542 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:09.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.276+0000 7fa22d1b7640 1 -- 172.21.15.157:0/3663466542 >> v1:172.21.15.110:6789/0 conn(0x7fa22810f010 legacy=0x7fa22810f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:09.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.276+0000 7fa22d1b7640 1 -- 172.21.15.157:0/3663466542 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa22811cdc0 con 0x7fa228119130 2024-05-09T09:47:09.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.276+0000 7fa22d1b7640 1 --2- 172.21.15.157:0/3663466542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa228119130 0x7fa22811b520 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa2240097f0 tx=0x7fa22401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6831b4f30df85a5d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:09.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.276+0000 7fa22c9b6640 1 -- 172.21.15.157:0/3663466542 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2240ab580 con 0x7fa228119130 2024-05-09T09:47:09.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.276+0000 7fa22c9b6640 1 -- 172.21.15.157:0/3663466542 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2240b0070 con 0x7fa228119130 2024-05-09T09:47:09.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.276+0000 7fa22c9b6640 1 -- 172.21.15.157:0/3663466542 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2240ab870 con 0x7fa228119130 2024-05-09T09:47:09.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.280+0000 7fa22fc1c640 1 -- 172.21.15.157:0/3663466542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa228119130 msgr2=0x7fa22811b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:09.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.280+0000 7fa22fc1c640 1 --2- 172.21.15.157:0/3663466542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa228119130 0x7fa22811b520 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa2240097f0 tx=0x7fa22401c430 comp rx=0 tx=0).stop 2024-05-09T09:47:09.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.280+0000 7fa22fc1c640 1 -- 172.21.15.157:0/3663466542 shutdown_connections 2024-05-09T09:47:09.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.280+0000 7fa22fc1c640 1 --2- 172.21.15.157:0/3663466542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa228119130 0x7fa22811b520 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:09.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.280+0000 7fa22fc1c640 1 -- 172.21.15.157:0/3663466542 >> 172.21.15.157:0/3663466542 conn(0x7fa22806f560 msgr2=0x7fa228071980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:09.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.280+0000 7fa22fc1c640 1 -- 172.21.15.157:0/3663466542 shutdown_connections 2024-05-09T09:47:09.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.280+0000 7fa22fc1c640 1 -- 172.21.15.157:0/3663466542 wait complete. 2024-05-09T09:47:09.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.280+0000 7fa22fc1c640 1 Processor -- start 2024-05-09T09:47:09.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.280+0000 7fa22fc1c640 1 -- start start 2024-05-09T09:47:09.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.280+0000 7fa22fc1c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa22810f010 0x7fa2281ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:09.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.280+0000 7fa22fc1c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa22811c960 con 0x7fa22810f010 2024-05-09T09:47:09.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.280+0000 7fa22d9b8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa22810f010 0x7fa2281ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:09.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.280+0000 7fa22d9b8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa22810f010 0x7fa2281ad1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:36642/0 (socket says 172.21.15.157:36642) 2024-05-09T09:47:09.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.280+0000 7fa22d9b8640 1 -- 172.21.15.157:0/3857337926 learned_addr learned my addr 172.21.15.157:0/3857337926 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:09.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.280+0000 7fa22d9b8640 1 -- 172.21.15.157:0/3857337926 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2281ad790 con 0x7fa22810f010 2024-05-09T09:47:09.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.280+0000 7fa22d9b8640 1 --2- 172.21.15.157:0/3857337926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa22810f010 0x7fa2281ad1c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa21800c480 tx=0x7fa21800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:09.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.280+0000 7fa21e7fc640 1 -- 172.21.15.157:0/3857337926 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa218005150 con 0x7fa22810f010 2024-05-09T09:47:09.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.280+0000 7fa22fc1c640 1 -- 172.21.15.157:0/3857337926 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2281ada20 con 0x7fa22810f010 2024-05-09T09:47:09.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.280+0000 7fa21e7fc640 1 -- 172.21.15.157:0/3857337926 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2180052f0 con 0x7fa22810f010 2024-05-09T09:47:09.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.280+0000 7fa21e7fc640 1 -- 172.21.15.157:0/3857337926 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa218007030 con 0x7fa22810f010 2024-05-09T09:47:09.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.280+0000 7fa22fc1c640 1 -- 172.21.15.157:0/3857337926 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2281a7430 con 0x7fa22810f010 2024-05-09T09:47:09.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.280+0000 7fa22fc1c640 1 -- 172.21.15.157:0/3857337926 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2280505f0 con 0x7fa22810f010 2024-05-09T09:47:09.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.284+0000 7fa21e7fc640 1 -- 172.21.15.157:0/3857337926 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fa218019020 con 0x7fa22810f010 2024-05-09T09:47:09.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.284+0000 7fa21e7fc640 1 --2- 172.21.15.157:0/3857337926 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa20c0362c0 0x7fa20c038780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:09.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.284+0000 7fa21e7fc640 1 -- 172.21.15.157:0/3857337926 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3797+0+0 (secure 0 0 0) 0x7fa218048a40 con 0x7fa22810f010 2024-05-09T09:47:09.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.284+0000 7fa22d1b7640 1 --2- 172.21.15.157:0/3857337926 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa20c0362c0 0x7fa20c038780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:09.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.284+0000 7fa22d1b7640 1 --2- 172.21.15.157:0/3857337926 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa20c0362c0 0x7fa20c038780 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa2240af000 tx=0x7fa2240a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:09.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.300+0000 7fa21e7fc640 1 -- 172.21.15.157:0/3857337926 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa218020070 con 0x7fa22810f010 2024-05-09T09:47:09.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:09.460+0000 7fa22fc1c640 1 -- 172.21.15.157:0/3857337926 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) -- 0x7fa2281adbf0 con 0x7fa22810f010 2024-05-09T09:47:11.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.128+0000 7fa21e7fc640 1 -- 172.21.15.157:0/3857337926 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v18) ==== 227+0+0 (secure 0 0 0) 0x7fa21801a7a0 con 0x7fa22810f010 2024-05-09T09:47:11.127 INFO:teuthology.orchestra.run.smithi157.stderr:pool 'default.rgw.buckets.data' created 2024-05-09T09:47:11.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.132+0000 7fa22fc1c640 1 -- 172.21.15.157:0/3857337926 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa20c0362c0 msgr2=0x7fa20c038780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:11.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.132+0000 7fa22fc1c640 1 --2- 172.21.15.157:0/3857337926 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa20c0362c0 0x7fa20c038780 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa2240af000 tx=0x7fa2240a7000 comp rx=0 tx=0).stop 2024-05-09T09:47:11.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.132+0000 7fa22fc1c640 1 -- 172.21.15.157:0/3857337926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa22810f010 msgr2=0x7fa2281ad1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:11.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.132+0000 7fa22fc1c640 1 --2- 172.21.15.157:0/3857337926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa22810f010 0x7fa2281ad1c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa21800c480 tx=0x7fa21800c940 comp rx=0 tx=0).stop 2024-05-09T09:47:11.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.132+0000 7fa22fc1c640 1 -- 172.21.15.157:0/3857337926 shutdown_connections 2024-05-09T09:47:11.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.132+0000 7fa22fc1c640 1 --2- 172.21.15.157:0/3857337926 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa20c0362c0 0x7fa20c038780 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:11.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.132+0000 7fa22fc1c640 1 --2- 172.21.15.157:0/3857337926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa22810f010 0x7fa2281ad1c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:11.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.132+0000 7fa22fc1c640 1 -- 172.21.15.157:0/3857337926 >> 172.21.15.157:0/3857337926 conn(0x7fa22806f560 msgr2=0x7fa228070470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:11.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.132+0000 7fa22fc1c640 1 -- 172.21.15.157:0/3857337926 shutdown_connections 2024-05-09T09:47:11.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.132+0000 7fa22fc1c640 1 -- 172.21.15.157:0/3857337926 wait complete. 2024-05-09T09:47:11.158 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-05-09T09:47:11.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.292+0000 7fc10cb75640 1 Processor -- start 2024-05-09T09:47:11.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.292+0000 7fc10cb75640 1 -- start start 2024-05-09T09:47:11.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.292+0000 7fc10cb75640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc10810f010 0x7fc10810f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:11.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.292+0000 7fc10cb75640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc10810fab0 con 0x7fc108118120 2024-05-09T09:47:11.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.292+0000 7fc10cb75640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fc10811cc40 con 0x7fc10810f010 2024-05-09T09:47:11.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.292+0000 7fc10659c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc10810f010 0x7fc10810f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:11.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.292+0000 7fc10659c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc10810f010 0x7fc10810f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:36658/0 (socket says 172.21.15.157:36658) 2024-05-09T09:47:11.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.292+0000 7fc10659c640 1 -- 172.21.15.157:0/1673807424 learned_addr learned my addr 172.21.15.157:0/1673807424 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:11.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.292+0000 7fc10659c640 1 -- 172.21.15.157:0/1673807424 >> v1:172.21.15.110:6789/0 conn(0x7fc108118120 legacy=0x7fc10811a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:11.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.292+0000 7fc10659c640 1 -- 172.21.15.157:0/1673807424 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc10811cdc0 con 0x7fc10810f010 2024-05-09T09:47:11.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.296+0000 7fc10659c640 1 --2- 172.21.15.157:0/1673807424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc10810f010 0x7fc10810f3f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80097f0 tx=0x7fc0f801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d8fc6983e2fe1f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:11.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.296+0000 7fc10559a640 1 -- 172.21.15.157:0/1673807424 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0f80ab580 con 0x7fc10810f010 2024-05-09T09:47:11.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.296+0000 7fc10559a640 1 -- 172.21.15.157:0/1673807424 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f80b0070 con 0x7fc10810f010 2024-05-09T09:47:11.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.296+0000 7fc10559a640 1 -- 172.21.15.157:0/1673807424 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0f80ab870 con 0x7fc10810f010 2024-05-09T09:47:11.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.296+0000 7fc10cb75640 1 -- 172.21.15.157:0/1673807424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc10810f010 msgr2=0x7fc10810f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:11.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.296+0000 7fc10cb75640 1 --2- 172.21.15.157:0/1673807424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc10810f010 0x7fc10810f3f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80097f0 tx=0x7fc0f801c430 comp rx=0 tx=0).stop 2024-05-09T09:47:11.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.296+0000 7fc10cb75640 1 -- 172.21.15.157:0/1673807424 shutdown_connections 2024-05-09T09:47:11.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.296+0000 7fc10cb75640 1 --2- 172.21.15.157:0/1673807424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc10810f010 0x7fc10810f3f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:11.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.296+0000 7fc10cb75640 1 -- 172.21.15.157:0/1673807424 >> 172.21.15.157:0/1673807424 conn(0x7fc10806f560 msgr2=0x7fc108071980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:11.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.296+0000 7fc10cb75640 1 -- 172.21.15.157:0/1673807424 shutdown_connections 2024-05-09T09:47:11.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.296+0000 7fc10cb75640 1 -- 172.21.15.157:0/1673807424 wait complete. 2024-05-09T09:47:11.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.296+0000 7fc10cb75640 1 Processor -- start 2024-05-09T09:47:11.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.296+0000 7fc10cb75640 1 -- start start 2024-05-09T09:47:11.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.296+0000 7fc10cb75640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc10810f010 0x7fc10810ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:11.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.296+0000 7fc10cb75640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc10811c8d0 con 0x7fc10810f010 2024-05-09T09:47:11.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.296+0000 7fc10659c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc10810f010 0x7fc10810ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:11.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.296+0000 7fc10659c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc10810f010 0x7fc10810ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:36664/0 (socket says 172.21.15.157:36664) 2024-05-09T09:47:11.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.296+0000 7fc10659c640 1 -- 172.21.15.157:0/2894604742 learned_addr learned my addr 172.21.15.157:0/2894604742 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:11.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.296+0000 7fc10659c640 1 -- 172.21.15.157:0/2894604742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1081104d0 con 0x7fc10810f010 2024-05-09T09:47:11.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.296+0000 7fc10659c640 1 --2- 172.21.15.157:0/2894604742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc10810f010 0x7fc10810ff90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8019040 tx=0x7fc0f801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:11.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.300+0000 7fc0f6ffd640 1 -- 172.21.15.157:0/2894604742 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0f80abe10 con 0x7fc10810f010 2024-05-09T09:47:11.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.300+0000 7fc0f6ffd640 1 -- 172.21.15.157:0/2894604742 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f80aa8f0 con 0x7fc10810f010 2024-05-09T09:47:11.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.300+0000 7fc10cb75640 1 -- 172.21.15.157:0/2894604742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc108110700 con 0x7fc10810f010 2024-05-09T09:47:11.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.300+0000 7fc0f6ffd640 1 -- 172.21.15.157:0/2894604742 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0f80aac10 con 0x7fc10810f010 2024-05-09T09:47:11.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.300+0000 7fc10cb75640 1 -- 172.21.15.157:0/2894604742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc108110c40 con 0x7fc10810f010 2024-05-09T09:47:11.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.300+0000 7fc10cb75640 1 -- 172.21.15.157:0/2894604742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1080505f0 con 0x7fc10810f010 2024-05-09T09:47:11.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.300+0000 7fc0f6ffd640 1 -- 172.21.15.157:0/2894604742 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fc0f80c7440 con 0x7fc10810f010 2024-05-09T09:47:11.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.300+0000 7fc0f6ffd640 1 --2- 172.21.15.157:0/2894604742 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc0e80362c0 0x7fc0e8038780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:11.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.300+0000 7fc0f6ffd640 1 -- 172.21.15.157:0/2894604742 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4272+0+0 (secure 0 0 0) 0x7fc0f80e4100 con 0x7fc10810f010 2024-05-09T09:47:11.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.300+0000 7fc105d9b640 1 --2- 172.21.15.157:0/2894604742 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc0e80362c0 0x7fc0e8038780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:11.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.300+0000 7fc105d9b640 1 --2- 172.21.15.157:0/2894604742 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc0e80362c0 0x7fc0e8038780 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc001610 tx=0x7fc0fc0079e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:11.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.312+0000 7fc0f6ffd640 1 -- 172.21.15.157:0/2894604742 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc0f80160b0 con 0x7fc10810f010 2024-05-09T09:47:11.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:11.476+0000 7fc10cb75640 1 -- 172.21.15.157:0/2894604742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7fc108118120 con 0x7fc10810f010 2024-05-09T09:47:12.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.139+0000 7fc0f6ffd640 1 -- 172.21.15.157:0/2894604742 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v19) ==== 185+0+0 (secure 0 0 0) 0x7fc0f80bd550 con 0x7fc10810f010 2024-05-09T09:47:12.138 INFO:teuthology.orchestra.run.smithi157.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-05-09T09:47:12.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.143+0000 7fc10cb75640 1 -- 172.21.15.157:0/2894604742 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc0e80362c0 msgr2=0x7fc0e8038780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:12.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.143+0000 7fc10cb75640 1 --2- 172.21.15.157:0/2894604742 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc0e80362c0 0x7fc0e8038780 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc001610 tx=0x7fc0fc0079e0 comp rx=0 tx=0).stop 2024-05-09T09:47:12.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.143+0000 7fc10cb75640 1 -- 172.21.15.157:0/2894604742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc10810f010 msgr2=0x7fc10810ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:12.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.143+0000 7fc10cb75640 1 --2- 172.21.15.157:0/2894604742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc10810f010 0x7fc10810ff90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8019040 tx=0x7fc0f801ac70 comp rx=0 tx=0).stop 2024-05-09T09:47:12.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.143+0000 7fc10cb75640 1 -- 172.21.15.157:0/2894604742 shutdown_connections 2024-05-09T09:47:12.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.143+0000 7fc10cb75640 1 --2- 172.21.15.157:0/2894604742 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc0e80362c0 0x7fc0e8038780 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:12.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.143+0000 7fc10cb75640 1 --2- 172.21.15.157:0/2894604742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc10810f010 0x7fc10810ff90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:12.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.143+0000 7fc10cb75640 1 -- 172.21.15.157:0/2894604742 >> 172.21.15.157:0/2894604742 conn(0x7fc10806f560 msgr2=0x7fc108070de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:12.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.147+0000 7fc10cb75640 1 -- 172.21.15.157:0/2894604742 shutdown_connections 2024-05-09T09:47:12.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.151+0000 7fc10cb75640 1 -- 172.21.15.157:0/2894604742 wait complete. 2024-05-09T09:47:12.198 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-05-09T09:47:12.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.327+0000 7f077dac0640 1 Processor -- start 2024-05-09T09:47:12.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.327+0000 7f077dac0640 1 -- start start 2024-05-09T09:47:12.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.327+0000 7f077dac0640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f077810f010 0x7f077810f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:12.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.327+0000 7f077dac0640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f077811dc40 con 0x7f077810f930 2024-05-09T09:47:12.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.327+0000 7f077dac0640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f077811ee20 con 0x7f077810f010 2024-05-09T09:47:12.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.327+0000 7f0776ffd640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f077810f930 0x7f077811c520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:47702/0 (socket says 172.21.15.157:47702) 2024-05-09T09:47:12.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.327+0000 7f0776ffd640 1 -- 172.21.15.157:0/3418529905 learned_addr learned my addr 172.21.15.157:0/3418529905 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:47:12.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.327+0000 7f07777fe640 1 --2- 172.21.15.157:0/3418529905 >> v2:172.21.15.110:3300/0 conn(0x7f077810f010 0x7f077810f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:12.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.327+0000 7f07767fc640 1 -- 172.21.15.157:0/3418529905 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3266309438 0 0) 0x7f077811dc40 con 0x7f077810f930 2024-05-09T09:47:12.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.327+0000 7f07767fc640 1 -- 172.21.15.157:0/3418529905 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0764003530 con 0x7f077810f930 2024-05-09T09:47:12.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.327+0000 7f07777fe640 1 -- 172.21.15.157:0/3418529905 >> v1:172.21.15.110:6789/0 conn(0x7f077810f930 legacy=0x7f077811c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:12.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.327+0000 7f07777fe640 1 -- 172.21.15.157:0/3418529905 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f077811efa0 con 0x7f077810f010 2024-05-09T09:47:12.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.331+0000 7f07777fe640 1 --2- 172.21.15.157:0/3418529905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f077810f010 0x7f077810f3f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0770009d90 tx=0x7f077001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc3c0baa6357112e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:12.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.331+0000 7f07767fc640 1 -- 172.21.15.157:0/3418529905 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07700b2070 con 0x7f077810f010 2024-05-09T09:47:12.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.331+0000 7f07767fc640 1 -- 172.21.15.157:0/3418529905 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07700a5850 con 0x7f077810f010 2024-05-09T09:47:12.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.331+0000 7f07767fc640 1 -- 172.21.15.157:0/3418529905 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07700a5b30 con 0x7f077810f010 2024-05-09T09:47:12.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.331+0000 7f077dac0640 1 -- 172.21.15.157:0/3418529905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f077810f010 msgr2=0x7f077810f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:12.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.331+0000 7f077dac0640 1 --2- 172.21.15.157:0/3418529905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f077810f010 0x7f077810f3f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0770009d90 tx=0x7f077001c8c0 comp rx=0 tx=0).stop 2024-05-09T09:47:12.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.331+0000 7f077dac0640 1 -- 172.21.15.157:0/3418529905 shutdown_connections 2024-05-09T09:47:12.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.331+0000 7f077dac0640 1 --2- 172.21.15.157:0/3418529905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f077810f010 0x7f077810f3f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:12.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.331+0000 7f077dac0640 1 -- 172.21.15.157:0/3418529905 >> 172.21.15.157:0/3418529905 conn(0x7f077806f560 msgr2=0x7f0778071980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:12.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.331+0000 7f077dac0640 1 -- 172.21.15.157:0/3418529905 shutdown_connections 2024-05-09T09:47:12.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.331+0000 7f077dac0640 1 -- 172.21.15.157:0/3418529905 wait complete. 2024-05-09T09:47:12.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.331+0000 7f077dac0640 1 Processor -- start 2024-05-09T09:47:12.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.331+0000 7f077dac0640 1 -- start start 2024-05-09T09:47:12.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.331+0000 7f077dac0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f077810f010 0x7f07781af170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:12.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.331+0000 7f077dac0640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f077811eaa0 con 0x7f077810f010 2024-05-09T09:47:12.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.331+0000 7f07777fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f077810f010 0x7f07781af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:12.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.331+0000 7f07777fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f077810f010 0x7f07781af170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:36676/0 (socket says 172.21.15.157:36676) 2024-05-09T09:47:12.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.331+0000 7f07777fe640 1 -- 172.21.15.157:0/2172489112 learned_addr learned my addr 172.21.15.157:0/2172489112 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:12.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.335+0000 7f07777fe640 1 -- 172.21.15.157:0/2172489112 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07781af740 con 0x7f077810f010 2024-05-09T09:47:12.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.335+0000 7f07777fe640 1 --2- 172.21.15.157:0/2172489112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f077810f010 0x7f07781af170 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f07700b0040 tx=0x7f0770019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:12.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.335+0000 7f076ffff640 1 -- 172.21.15.157:0/2172489112 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07700b2040 con 0x7f077810f010 2024-05-09T09:47:12.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.335+0000 7f077dac0640 1 -- 172.21.15.157:0/2172489112 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07781af970 con 0x7f077810f010 2024-05-09T09:47:12.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.335+0000 7f076ffff640 1 -- 172.21.15.157:0/2172489112 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07700039a0 con 0x7f077810f010 2024-05-09T09:47:12.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.335+0000 7f076ffff640 1 -- 172.21.15.157:0/2172489112 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0770009450 con 0x7f077810f010 2024-05-09T09:47:12.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.335+0000 7f077dac0640 1 -- 172.21.15.157:0/2172489112 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07781a9210 con 0x7f077810f010 2024-05-09T09:47:12.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.335+0000 7f077dac0640 1 -- 172.21.15.157:0/2172489112 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07780505f0 con 0x7f077810f010 2024-05-09T09:47:12.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.335+0000 7f076ffff640 1 -- 172.21.15.157:0/2172489112 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f07700ad980 con 0x7f077810f010 2024-05-09T09:47:12.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.335+0000 7f076ffff640 1 --2- 172.21.15.157:0/2172489112 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f07580362c0 0x7f0758038780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:12.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.335+0000 7f076ffff640 1 -- 172.21.15.157:0/2172489112 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4283+0+0 (secure 0 0 0) 0x7f07700e49f0 con 0x7f077810f010 2024-05-09T09:47:12.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.335+0000 7f0776ffd640 1 --2- 172.21.15.157:0/2172489112 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f07580362c0 0x7f0758038780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:12.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.335+0000 7f0776ffd640 1 --2- 172.21.15.157:0/2172489112 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f07580362c0 0x7f0758038780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0760007fd0 tx=0x7f0760007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:12.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.347+0000 7f076ffff640 1 -- 172.21.15.157:0/2172489112 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f07700c6030 con 0x7f077810f010 2024-05-09T09:47:12.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:12.515+0000 7f077dac0640 1 -- 172.21.15.157:0/2172489112 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f077810f930 con 0x7f077810f010 2024-05-09T09:47:13.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.151+0000 7f076ffff640 1 -- 172.21.15.157:0/2172489112 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v20) ==== 169+0+0 (secure 0 0 0) 0x7f07700bd030 con 0x7f077810f010 2024-05-09T09:47:13.150 INFO:teuthology.orchestra.run.smithi157.stderr:pool 'default.rgw.buckets.index' created 2024-05-09T09:47:13.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.155+0000 7f077dac0640 1 -- 172.21.15.157:0/2172489112 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f07580362c0 msgr2=0x7f0758038780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:13.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.155+0000 7f077dac0640 1 --2- 172.21.15.157:0/2172489112 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f07580362c0 0x7f0758038780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0760007fd0 tx=0x7f0760007980 comp rx=0 tx=0).stop 2024-05-09T09:47:13.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.155+0000 7f077dac0640 1 -- 172.21.15.157:0/2172489112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f077810f010 msgr2=0x7f07781af170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:13.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.155+0000 7f077dac0640 1 --2- 172.21.15.157:0/2172489112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f077810f010 0x7f07781af170 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f07700b0040 tx=0x7f0770019660 comp rx=0 tx=0).stop 2024-05-09T09:47:13.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.155+0000 7f077dac0640 1 -- 172.21.15.157:0/2172489112 shutdown_connections 2024-05-09T09:47:13.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.155+0000 7f077dac0640 1 --2- 172.21.15.157:0/2172489112 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f07580362c0 0x7f0758038780 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:13.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.155+0000 7f077dac0640 1 --2- 172.21.15.157:0/2172489112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f077810f010 0x7f07781af170 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:13.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.155+0000 7f077dac0640 1 -- 172.21.15.157:0/2172489112 >> 172.21.15.157:0/2172489112 conn(0x7f077806f560 msgr2=0x7f0778070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:13.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.155+0000 7f077dac0640 1 -- 172.21.15.157:0/2172489112 shutdown_connections 2024-05-09T09:47:13.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.155+0000 7f077dac0640 1 -- 172.21.15.157:0/2172489112 wait complete. 2024-05-09T09:47:13.184 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-05-09T09:47:13.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.307+0000 7ff4a7dc9640 1 Processor -- start 2024-05-09T09:47:13.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.307+0000 7ff4a7dc9640 1 -- start start 2024-05-09T09:47:13.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.307+0000 7ff4a7dc9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff4a0118450 0x7ff4a0118830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:13.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.307+0000 7ff4a7dc9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4a0118ec0 con 0x7ff4a01121b0 2024-05-09T09:47:13.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.307+0000 7ff4a7dc9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7ff4a0112d70 con 0x7ff4a0118450 2024-05-09T09:47:13.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.307+0000 7ff4a5b65640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff4a0118450 0x7ff4a0118830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:13.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.307+0000 7ff4a5b65640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff4a0118450 0x7ff4a0118830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:36688/0 (socket says 172.21.15.157:36688) 2024-05-09T09:47:13.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.307+0000 7ff4a5364640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ff4a01121b0 0x7ff4a0112660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:47718/0 (socket says 172.21.15.157:47718) 2024-05-09T09:47:13.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.307+0000 7ff4a5b65640 1 -- 172.21.15.157:0/3461136240 learned_addr learned my addr 172.21.15.157:0/3461136240 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:13.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.307+0000 7ff4a5b65640 1 -- 172.21.15.157:0/3461136240 >> v1:172.21.15.110:6789/0 conn(0x7ff4a01121b0 legacy=0x7ff4a0112660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:13.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.307+0000 7ff4a5b65640 1 -- 172.21.15.157:0/3461136240 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a0112f20 con 0x7ff4a0118450 2024-05-09T09:47:13.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.311+0000 7ff4a5b65640 1 --2- 172.21.15.157:0/3461136240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4a0118450 0x7ff4a0118830 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff49c0097f0 tx=0x7ff49c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f98d25a4dd1422cf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:13.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.311+0000 7ff4a4b63640 1 -- 172.21.15.157:0/3461136240 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff49c0ab580 con 0x7ff4a0118450 2024-05-09T09:47:13.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.311+0000 7ff4a4b63640 1 -- 172.21.15.157:0/3461136240 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff49c0b0070 con 0x7ff4a0118450 2024-05-09T09:47:13.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.311+0000 7ff4a4b63640 1 -- 172.21.15.157:0/3461136240 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff49c0ab870 con 0x7ff4a0118450 2024-05-09T09:47:13.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.311+0000 7ff4a7dc9640 1 -- 172.21.15.157:0/3461136240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4a0118450 msgr2=0x7ff4a0118830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:13.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.311+0000 7ff4a7dc9640 1 --2- 172.21.15.157:0/3461136240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4a0118450 0x7ff4a0118830 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff49c0097f0 tx=0x7ff49c01c430 comp rx=0 tx=0).stop 2024-05-09T09:47:13.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.311+0000 7ff4a7dc9640 1 -- 172.21.15.157:0/3461136240 shutdown_connections 2024-05-09T09:47:13.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.311+0000 7ff4a7dc9640 1 --2- 172.21.15.157:0/3461136240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4a0118450 0x7ff4a0118830 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:13.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.311+0000 7ff4a7dc9640 1 -- 172.21.15.157:0/3461136240 >> 172.21.15.157:0/3461136240 conn(0x7ff4a006d9b0 msgr2=0x7ff4a006ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:13.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.311+0000 7ff4a7dc9640 1 -- 172.21.15.157:0/3461136240 shutdown_connections 2024-05-09T09:47:13.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.311+0000 7ff4a7dc9640 1 -- 172.21.15.157:0/3461136240 wait complete. 2024-05-09T09:47:13.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.315+0000 7ff4a7dc9640 1 Processor -- start 2024-05-09T09:47:13.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.315+0000 7ff4a7dc9640 1 -- start start 2024-05-09T09:47:13.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.315+0000 7ff4a7dc9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4a01121b0 0x7ff4a01af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:13.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.315+0000 7ff4a7dc9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a0120e20 con 0x7ff4a01121b0 2024-05-09T09:47:13.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.315+0000 7ff4a5b65640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4a01121b0 0x7ff4a01af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:13.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.315+0000 7ff4a5b65640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4a01121b0 0x7ff4a01af2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:36692/0 (socket says 172.21.15.157:36692) 2024-05-09T09:47:13.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.315+0000 7ff4a5b65640 1 -- 172.21.15.157:0/3118202132 learned_addr learned my addr 172.21.15.157:0/3118202132 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:13.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.315+0000 7ff4a5b65640 1 -- 172.21.15.157:0/3118202132 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a01af8c0 con 0x7ff4a01121b0 2024-05-09T09:47:13.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.315+0000 7ff4a5b65640 1 --2- 172.21.15.157:0/3118202132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4a01121b0 0x7ff4a01af2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff49c0ad040 tx=0x7ff49c01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:13.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.315+0000 7ff4967fc640 1 -- 172.21.15.157:0/3118202132 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff49c0aa7f0 con 0x7ff4a01121b0 2024-05-09T09:47:13.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.315+0000 7ff4a7dc9640 1 -- 172.21.15.157:0/3118202132 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4a01afaf0 con 0x7ff4a01121b0 2024-05-09T09:47:13.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.315+0000 7ff4967fc640 1 -- 172.21.15.157:0/3118202132 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff49c0aa990 con 0x7ff4a01121b0 2024-05-09T09:47:13.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.315+0000 7ff4967fc640 1 -- 172.21.15.157:0/3118202132 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff49c0aac70 con 0x7ff4a01121b0 2024-05-09T09:47:13.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.315+0000 7ff4a7dc9640 1 -- 172.21.15.157:0/3118202132 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4a01a9410 con 0x7ff4a01121b0 2024-05-09T09:47:13.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.315+0000 7ff4a7dc9640 1 -- 172.21.15.157:0/3118202132 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4a00505f0 con 0x7ff4a01121b0 2024-05-09T09:47:13.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.315+0000 7ff4967fc640 1 -- 172.21.15.157:0/3118202132 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7ff49c0be3f0 con 0x7ff4a01121b0 2024-05-09T09:47:13.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.315+0000 7ff4967fc640 1 --2- 172.21.15.157:0/3118202132 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff4840362c0 0x7ff484038780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:13.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.315+0000 7ff4967fc640 1 -- 172.21.15.157:0/3118202132 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4647+0+0 (secure 0 0 0) 0x7ff49c0e4680 con 0x7ff4a01121b0 2024-05-09T09:47:13.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.315+0000 7ff4a5364640 1 --2- 172.21.15.157:0/3118202132 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff4840362c0 0x7ff484038780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:13.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.319+0000 7ff4a5364640 1 --2- 172.21.15.157:0/3118202132 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff4840362c0 0x7ff484038780 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff490000f70 tx=0x7ff490007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:13.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.331+0000 7ff4967fc640 1 -- 172.21.15.157:0/3118202132 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff49c0160b0 con 0x7ff4a01121b0 2024-05-09T09:47:13.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:13.491+0000 7ff4a7dc9640 1 -- 172.21.15.157:0/3118202132 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7ff4a0118450 con 0x7ff4a01121b0 2024-05-09T09:47:14.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:14.151+0000 7ff4967fc640 1 -- 172.21.15.157:0/3118202132 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v21) ==== 187+0+0 (secure 0 0 0) 0x7ff49c0e43b0 con 0x7ff4a01121b0 2024-05-09T09:47:14.151 INFO:teuthology.orchestra.run.smithi157.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-05-09T09:47:14.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:14.155+0000 7ff4a7dc9640 1 -- 172.21.15.157:0/3118202132 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff4840362c0 msgr2=0x7ff484038780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:14.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:14.155+0000 7ff4a7dc9640 1 --2- 172.21.15.157:0/3118202132 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff4840362c0 0x7ff484038780 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff490000f70 tx=0x7ff490007a90 comp rx=0 tx=0).stop 2024-05-09T09:47:14.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:14.155+0000 7ff4a7dc9640 1 -- 172.21.15.157:0/3118202132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4a01121b0 msgr2=0x7ff4a01af2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:14.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:14.155+0000 7ff4a7dc9640 1 --2- 172.21.15.157:0/3118202132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4a01121b0 0x7ff4a01af2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff49c0ad040 tx=0x7ff49c01ac70 comp rx=0 tx=0).stop 2024-05-09T09:47:14.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:14.159+0000 7ff4a7dc9640 1 -- 172.21.15.157:0/3118202132 shutdown_connections 2024-05-09T09:47:14.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:14.159+0000 7ff4a7dc9640 1 --2- 172.21.15.157:0/3118202132 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff4840362c0 0x7ff484038780 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:14.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:14.159+0000 7ff4a7dc9640 1 --2- 172.21.15.157:0/3118202132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4a01121b0 0x7ff4a01af2f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:14.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:14.159+0000 7ff4a7dc9640 1 -- 172.21.15.157:0/3118202132 >> 172.21.15.157:0/3118202132 conn(0x7ff4a006d9b0 msgr2=0x7ff4a01143f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:14.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:14.159+0000 7ff4a7dc9640 1 -- 172.21.15.157:0/3118202132 shutdown_connections 2024-05-09T09:47:14.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:14.159+0000 7ff4a7dc9640 1 -- 172.21.15.157:0/3118202132 wait complete. 2024-05-09T09:47:14.199 DEBUG:tasks.rgw:Pools created 2024-05-09T09:47:14.199 INFO:tasks.rgw:Starting rgw... 2024-05-09T09:47:14.199 INFO:tasks.rgw:rgw client.0 config is {} 2024-05-09T09:47:14.199 INFO:tasks.rgw:Using beast as radosgw frontend 2024-05-09T09:47:14.199 DEBUG:teuthology.orchestra.run.smithi157:> sudo echo -n http://smithi157.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-05-09T09:47:14.210 INFO:teuthology.orchestra.run.smithi157.stdout:http://smithi157.front.sepia.ceph.com:80 2024-05-09T09:47:14.211 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-05-09T09:47:14.261 INFO:tasks.rgw.client.0:Restarting daemon 2024-05-09T09:47:14.262 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-05-09T09:47:14.309 INFO:tasks.rgw.client.0:Started 2024-05-09T09:47:14.310 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi157.front.sepia.ceph.com:80/ 2024-05-09T09:47:14.310 DEBUG:teuthology.orchestra.run.smithi157:> curl http://smithi157.front.sepia.ceph.com:80/ 2024-05-09T09:47:14.339 INFO:teuthology.orchestra.run.smithi157.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-09T09:47:14.339 INFO:teuthology.orchestra.run.smithi157.stderr: Dload Upload Total Spent Left Speed 2024-05-09T09:47:14.340 INFO:teuthology.orchestra.run.smithi157.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-09T09:47:14.341 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-09T09:47:14.341 INFO:teuthology.orchestra.run.smithi157.stderr:curl: (7) Failed to connect to smithi157.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-09T09:47:15.342 DEBUG:teuthology.orchestra.run.smithi157:> curl http://smithi157.front.sepia.ceph.com:80/ 2024-05-09T09:47:15.355 INFO:teuthology.orchestra.run.smithi157.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-09T09:47:15.355 INFO:teuthology.orchestra.run.smithi157.stderr: Dload Upload Total Spent Left Speed 2024-05-09T09:47:15.355 INFO:teuthology.orchestra.run.smithi157.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-09T09:47:15.355 INFO:teuthology.orchestra.run.smithi157.stderr:curl: (7) Failed to connect to smithi157.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-09T09:47:15.356 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-09T09:47:17.357 DEBUG:teuthology.orchestra.run.smithi157:> curl http://smithi157.front.sepia.ceph.com:80/ 2024-05-09T09:47:17.369 INFO:teuthology.orchestra.run.smithi157.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-09T09:47:17.369 INFO:teuthology.orchestra.run.smithi157.stderr: Dload Upload Total Spent Left Speed 2024-05-09T09:47:17.369 INFO:teuthology.orchestra.run.smithi157.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-09T09:47:17.369 INFO:teuthology.orchestra.run.smithi157.stderr:curl: (7) Failed to connect to smithi157.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-09T09:47:17.370 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-09T09:47:21.374 DEBUG:teuthology.orchestra.run.smithi157:> curl http://smithi157.front.sepia.ceph.com:80/ 2024-05-09T09:47:21.387 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-09T09:47:21.387 INFO:teuthology.orchestra.run.smithi157.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-09T09:47:21.387 INFO:teuthology.orchestra.run.smithi157.stderr: Dload Upload Total Spent Left Speed 2024-05-09T09:47:21.387 INFO:teuthology.orchestra.run.smithi157.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-09T09:47:21.387 INFO:teuthology.orchestra.run.smithi157.stderr:curl: (7) Failed to connect to smithi157.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-09T09:47:23.366 INFO:tasks.rgw.client.0.smithi157.stdout:2024-05-09T09:47:23.367+0000 7f31629559c0 -1 LDAP not started since no server URIs were provided in the configuration. 2024-05-09T09:47:29.388 DEBUG:teuthology.orchestra.run.smithi157:> curl http://smithi157.front.sepia.ceph.com:80/ 2024-05-09T09:47:29.400 INFO:teuthology.orchestra.run.smithi157.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-09T09:47:29.400 INFO:teuthology.orchestra.run.smithi157.stderr: Dload Upload Total Spent Left Speed 2024-05-09T09:47:29.403 INFO:teuthology.orchestra.run.smithi157.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 53812 0 --:--:-- --:--:-- --:--:-- 62333 2024-05-09T09:47:29.404 INFO:teuthology.orchestra.run.smithi157.stdout:anonymous 2024-05-09T09:47:29.404 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-05-09T09:47:29.842 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-05-09T09:47:29.842 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-05-09T09:47:29.842 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-05-09T09:47:29.842 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-05-09T09:47:29.880 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:29.880 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:29.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.883+0000 7f8101831980 1 Processor -- start 2024-05-09T09:47:29.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.883+0000 7f8101831980 1 -- start start 2024-05-09T09:47:29.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.883+0000 7f8101831980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55f3883497f0 0x55f388349bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:29.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.883+0000 7f8101831980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f388200440 con 0x55f38834a110 2024-05-09T09:47:29.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.883+0000 7f8101831980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55f3881eb5f0 con 0x55f3883497f0 2024-05-09T09:47:29.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.883+0000 7f80ff34c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55f3883497f0 0x55f388349bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:29.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.883+0000 7f80ff34c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55f3883497f0 0x55f388349bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53424/0 (socket says 172.21.15.157:53424) 2024-05-09T09:47:29.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.883+0000 7f80feb4b640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x55f38834a110 0x55f38834ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:33502/0 (socket says 172.21.15.157:33502) 2024-05-09T09:47:29.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.883+0000 7f80ff34c640 1 -- 172.21.15.157:0/3589813546 learned_addr learned my addr 172.21.15.157:0/3589813546 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:29.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.883+0000 7f80ff34c640 1 -- 172.21.15.157:0/3589813546 >> v1:172.21.15.110:6789/0 conn(0x55f38834a110 legacy=0x55f38834ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:29.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.883+0000 7f80ff34c640 1 -- 172.21.15.157:0/3589813546 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3881f6990 con 0x55f3883497f0 2024-05-09T09:47:29.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.887+0000 7f80ff34c640 1 --2- 172.21.15.157:0/3589813546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3883497f0 0x55f388349bd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f80f000a4e0 tx=0x7f80f001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e39eb4fc02e2b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:29.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.887+0000 7f80fe34a640 1 -- 172.21.15.157:0/3589813546 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80f00aa540 con 0x55f3883497f0 2024-05-09T09:47:29.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.887+0000 7f80fe34a640 1 -- 172.21.15.157:0/3589813546 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80f00aa6e0 con 0x55f3883497f0 2024-05-09T09:47:29.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.887+0000 7f80fe34a640 1 -- 172.21.15.157:0/3589813546 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80f00aaa40 con 0x55f3883497f0 2024-05-09T09:47:29.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.887+0000 7f8101831980 1 -- 172.21.15.157:0/3589813546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3883497f0 msgr2=0x55f388349bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:29.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.887+0000 7f8101831980 1 --2- 172.21.15.157:0/3589813546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3883497f0 0x55f388349bd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f80f000a4e0 tx=0x7f80f001b090 comp rx=0 tx=0).stop 2024-05-09T09:47:29.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.887+0000 7f8101831980 1 -- 172.21.15.157:0/3589813546 shutdown_connections 2024-05-09T09:47:29.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.887+0000 7f8101831980 1 --2- 172.21.15.157:0/3589813546 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3883497f0 0x55f388349bd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:29.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.887+0000 7f8101831980 1 -- 172.21.15.157:0/3589813546 >> 172.21.15.157:0/3589813546 conn(0x55f3883450c0 msgr2=0x55f3883474e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:29.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.887+0000 7f8101831980 1 -- 172.21.15.157:0/3589813546 shutdown_connections 2024-05-09T09:47:29.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.887+0000 7f8101831980 1 -- 172.21.15.157:0/3589813546 wait complete. 2024-05-09T09:47:29.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.903+0000 7f8101831980 1 Processor -- start 2024-05-09T09:47:29.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.903+0000 7f8101831980 1 -- start start 2024-05-09T09:47:29.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.903+0000 7f8101831980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3883497f0 0x55f3882be170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:29.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.903+0000 7f8101831980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f38824dfe0 con 0x55f3883497f0 2024-05-09T09:47:29.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.903+0000 7f80ff34c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3883497f0 0x55f3882be170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:29.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.903+0000 7f80ff34c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3883497f0 0x55f3882be170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53434/0 (socket says 172.21.15.157:53434) 2024-05-09T09:47:29.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.903+0000 7f80ff34c640 1 -- 172.21.15.157:0/1050917319 learned_addr learned my addr 172.21.15.157:0/1050917319 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:29.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.903+0000 7f80ff34c640 1 -- 172.21.15.157:0/1050917319 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3881d2ae0 con 0x55f3883497f0 2024-05-09T09:47:29.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.907+0000 7f80ff34c640 1 --2- 172.21.15.157:0/1050917319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3883497f0 0x55f3882be170 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f80f00ac040 tx=0x7f80f00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=606f1a633a9ff4c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:29.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.907+0000 7f7fed60a640 1 -- 172.21.15.157:0/1050917319 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80f00b9030 con 0x55f3883497f0 2024-05-09T09:47:29.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.907+0000 7f7fed60a640 1 -- 172.21.15.157:0/1050917319 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80f00aaa40 con 0x55f3883497f0 2024-05-09T09:47:29.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.907+0000 7f7fed60a640 1 -- 172.21.15.157:0/1050917319 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80f00aad20 con 0x55f3883497f0 2024-05-09T09:47:29.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.907+0000 7f8101831980 1 -- 172.21.15.157:0/1050917319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3883497f0 msgr2=0x55f3882be170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:29.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.907+0000 7f8101831980 1 --2- 172.21.15.157:0/1050917319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3883497f0 0x55f3882be170 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f80f00ac040 tx=0x7f80f00033b0 comp rx=0 tx=0).stop 2024-05-09T09:47:29.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.907+0000 7f8101831980 1 -- 172.21.15.157:0/1050917319 shutdown_connections 2024-05-09T09:47:29.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.907+0000 7f8101831980 1 --2- 172.21.15.157:0/1050917319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3883497f0 0x55f3882be170 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:29.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.907+0000 7f8101831980 1 -- 172.21.15.157:0/1050917319 >> 172.21.15.157:0/1050917319 conn(0x55f3883450c0 msgr2=0x55f388430cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:29.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.907+0000 7f8101831980 1 -- 172.21.15.157:0/1050917319 shutdown_connections 2024-05-09T09:47:29.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.907+0000 7f8101831980 1 -- 172.21.15.157:0/1050917319 wait complete. 2024-05-09T09:47:29.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.907+0000 7f8101831980 1 Processor -- start 2024-05-09T09:47:29.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.907+0000 7f8101831980 1 -- start start 2024-05-09T09:47:29.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.907+0000 7f8101831980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3883497f0 0x55f38843d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:29.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.907+0000 7f8101831980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f388353890 con 0x55f3883497f0 2024-05-09T09:47:29.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.907+0000 7f80ff34c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3883497f0 0x55f38843d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:29.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.907+0000 7f80ff34c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3883497f0 0x55f38843d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53444/0 (socket says 172.21.15.157:53444) 2024-05-09T09:47:29.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.907+0000 7f80ff34c640 1 -- 172.21.15.157:0/4106256893 learned_addr learned my addr 172.21.15.157:0/4106256893 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:29.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.911+0000 7f80ff34c640 1 -- 172.21.15.157:0/4106256893 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f38843d810 con 0x55f3883497f0 2024-05-09T09:47:29.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.911+0000 7f80ff34c640 1 --2- 172.21.15.157:0/4106256893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3883497f0 0x55f38843d2d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f80f0000f90 tx=0x7f80f0017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:29.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.911+0000 7f7febe07640 1 -- 172.21.15.157:0/4106256893 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80f00b9030 con 0x55f3883497f0 2024-05-09T09:47:29.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.911+0000 7f8101831980 1 -- 172.21.15.157:0/4106256893 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f38843daa0 con 0x55f3883497f0 2024-05-09T09:47:29.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.911+0000 7f8101831980 1 -- 172.21.15.157:0/4106256893 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f388440730 con 0x55f3883497f0 2024-05-09T09:47:29.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.911+0000 7f7febe07640 1 -- 172.21.15.157:0/4106256893 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80f00c2070 con 0x55f3883497f0 2024-05-09T09:47:29.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.911+0000 7f7febe07640 1 -- 172.21.15.157:0/4106256893 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80f00cb060 con 0x55f3883497f0 2024-05-09T09:47:29.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.911+0000 7f7febe07640 1 -- 172.21.15.157:0/4106256893 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f80f00c4030 con 0x55f3883497f0 2024-05-09T09:47:29.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.911+0000 7f7febe07640 1 --2- 172.21.15.157:0/4106256893 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f7fe4034c50 0x7f7fe4037110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:29.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.911+0000 7f7febe07640 1 -- 172.21.15.157:0/4106256893 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f80f00ba070 con 0x55f3883497f0 2024-05-09T09:47:29.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.911+0000 7f80feb4b640 1 --2- 172.21.15.157:0/4106256893 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f7fe4034c50 0x7f7fe4037110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:29.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.911+0000 7f8101831980 1 --2- 172.21.15.157:0/4106256893 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f38834a110 0x55f388444210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:29.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.911+0000 7f8101831980 1 -- 172.21.15.157:0/4106256893 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f388444830 con 0x55f38834a110 2024-05-09T09:47:29.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.911+0000 7f80ffb4d640 1 --2- 172.21.15.157:0/4106256893 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f38834a110 0x55f388444210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:29.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.911+0000 7f80feb4b640 1 --2- 172.21.15.157:0/4106256893 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f7fe4034c50 0x7f7fe4037110 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f80f4000f70 tx=0x7f80f4001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:29.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.911+0000 7f80ffb4d640 1 --2- 172.21.15.157:0/4106256893 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f38834a110 0x55f388444210 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:29.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.911+0000 7f80ffb4d640 1 -- 172.21.15.157:0/4106256893 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f80f80083f0 con 0x55f38834a110 2024-05-09T09:47:29.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.911+0000 7f8101831980 1 -- 172.21.15.157:0/4106256893 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f388441930 con 0x55f38834a110 2024-05-09T09:47:29.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.915+0000 7f80ffb4d640 1 -- 172.21.15.157:0/4106256893 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f80f80083f0 con 0x55f38834a110 2024-05-09T09:47:29.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.915+0000 7f8101831980 1 --2- 172.21.15.157:0/4106256893 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f388446b90 0x55f388448f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:29.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.915+0000 7f8101831980 1 -- 172.21.15.157:0/4106256893 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f388449650 con 0x55f388446b90 2024-05-09T09:47:29.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.915+0000 7f80ff34c640 1 --2- 172.21.15.157:0/4106256893 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f388446b90 0x55f388448f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:29.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.915+0000 7f80ff34c640 1 --2- 172.21.15.157:0/4106256893 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f388446b90 0x55f388448f80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:29.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.919+0000 7f80ff34c640 1 -- 172.21.15.157:0/4106256893 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f80f00cfc70 con 0x55f388446b90 2024-05-09T09:47:29.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.919+0000 7f8101831980 1 -- 172.21.15.157:0/4106256893 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f388445a30 con 0x55f38834a110 2024-05-09T09:47:29.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.919+0000 7f80ffb4d640 1 -- 172.21.15.157:0/4106256893 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f80f80083f0 con 0x55f38834a110 2024-05-09T09:47:29.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.919+0000 7f8101831980 1 --2- 172.21.15.157:0/4106256893 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f38844aa90 0x55f38844ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:29.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.919+0000 7f8101831980 1 -- 172.21.15.157:0/4106256893 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f38844d610 con 0x55f38844aa90 2024-05-09T09:47:29.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.919+0000 7f80feb4b640 1 --2- 172.21.15.157:0/4106256893 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f38844aa90 0x55f38844ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:29.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.919+0000 7f80feb4b640 1 --2- 172.21.15.157:0/4106256893 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f38844aa90 0x55f38844ce80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:29.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.919+0000 7f80feb4b640 1 -- 172.21.15.157:0/4106256893 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f80f400f6a0 con 0x55f38844aa90 2024-05-09T09:47:29.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.923+0000 7f8101831980 1 Processor -- start 2024-05-09T09:47:29.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.923+0000 7f8101831980 1 -- start start 2024-05-09T09:47:29.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.923+0000 7f8101831980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3884734c0 0x55f3884738e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:29.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.923+0000 7f8101831980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f388252020 con 0x55f3884734c0 2024-05-09T09:47:29.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.923+0000 7f80ff34c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3884734c0 0x55f3884738e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:29.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.923+0000 7f80ff34c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3884734c0 0x55f3884738e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53446/0 (socket says 172.21.15.157:53446) 2024-05-09T09:47:29.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.923+0000 7f80ff34c640 1 -- 172.21.15.157:0/1349521230 learned_addr learned my addr 172.21.15.157:0/1349521230 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:29.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.923+0000 7f80ff34c640 1 -- 172.21.15.157:0/1349521230 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f388473e20 con 0x55f3884734c0 2024-05-09T09:47:29.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.923+0000 7f80ff34c640 1 --2- 172.21.15.157:0/1349521230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3884734c0 0x55f3884738e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f80f00a9530 tx=0x7f80f00c8dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:29.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.923+0000 7f7fe3fff640 1 -- 172.21.15.157:0/1349521230 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80f00b4c50 con 0x55f3884734c0 2024-05-09T09:47:29.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.923+0000 7f7fe3fff640 1 -- 172.21.15.157:0/1349521230 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80f00b4df0 con 0x55f3884734c0 2024-05-09T09:47:29.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.923+0000 7f8101831980 1 -- 172.21.15.157:0/1349521230 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f3884748b0 con 0x55f3884734c0 2024-05-09T09:47:29.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.923+0000 7f7fe3fff640 1 -- 172.21.15.157:0/1349521230 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80f00b44d0 con 0x55f3884734c0 2024-05-09T09:47:29.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.923+0000 7f8101831980 1 -- 172.21.15.157:0/1349521230 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f388474d90 con 0x55f3884734c0 2024-05-09T09:47:29.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.927+0000 7f7fe3fff640 1 -- 172.21.15.157:0/1349521230 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f80f00b3040 con 0x55f3884734c0 2024-05-09T09:47:29.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.927+0000 7f7fe3fff640 1 --2- 172.21.15.157:0/1349521230 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f7fd8034c50 0x7f7fd8037110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:29.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.927+0000 7f7fe3fff640 1 -- 172.21.15.157:0/1349521230 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f80f00dad20 con 0x55f3884734c0 2024-05-09T09:47:29.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.927+0000 7f80feb4b640 1 --2- 172.21.15.157:0/1349521230 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f7fd8034c50 0x7f7fd8037110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:29.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.927+0000 7f8101831980 1 Processor -- start 2024-05-09T09:47:29.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.927+0000 7f8101831980 1 -- start start 2024-05-09T09:47:29.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.927+0000 7f8101831980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3884803f0 0x55f3884807f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:29.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.927+0000 7f8101831980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f3882be800 con 0x55f3884803f0 2024-05-09T09:47:29.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.927+0000 7f80feb4b640 1 --2- 172.21.15.157:0/1349521230 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f7fd8034c50 0x7f7fd8037110 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x55f38844da10 tx=0x7f80f400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:29.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.927+0000 7f80ff34c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3884803f0 0x55f3884807f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:29.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.927+0000 7f80ff34c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3884803f0 0x55f3884807f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53452/0 (socket says 172.21.15.157:53452) 2024-05-09T09:47:29.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.927+0000 7f80ff34c640 1 -- 172.21.15.157:0/2726349913 learned_addr learned my addr 172.21.15.157:0/2726349913 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:29.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.927+0000 7f80ff34c640 1 -- 172.21.15.157:0/2726349913 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f388480dc0 con 0x55f3884803f0 2024-05-09T09:47:29.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.927+0000 7f80ff34c640 1 --2- 172.21.15.157:0/2726349913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3884803f0 0x55f3884807f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f80f00ae000 tx=0x7f80f00e56c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=755470629feca491 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:29.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.927+0000 7f7fe1ffb640 1 -- 172.21.15.157:0/2726349913 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80f00f4070 con 0x55f3884803f0 2024-05-09T09:47:29.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.927+0000 7f7fe1ffb640 1 -- 172.21.15.157:0/2726349913 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80f00dd1c0 con 0x55f3884803f0 2024-05-09T09:47:29.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.927+0000 7f7fe1ffb640 1 -- 172.21.15.157:0/2726349913 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80f0005030 con 0x55f3884803f0 2024-05-09T09:47:29.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.931+0000 7f8101831980 1 -- 172.21.15.157:0/2726349913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3884803f0 msgr2=0x55f3884807f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:29.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.931+0000 7f8101831980 1 --2- 172.21.15.157:0/2726349913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3884803f0 0x55f3884807f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f80f00ae000 tx=0x7f80f00e56c0 comp rx=0 tx=0).stop 2024-05-09T09:47:29.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.931+0000 7f8101831980 1 -- 172.21.15.157:0/2726349913 shutdown_connections 2024-05-09T09:47:29.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.931+0000 7f8101831980 1 --2- 172.21.15.157:0/2726349913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3884803f0 0x55f3884807f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:29.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.931+0000 7f8101831980 1 -- 172.21.15.157:0/2726349913 >> 172.21.15.157:0/2726349913 conn(0x55f38847c770 msgr2=0x55f38847a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:29.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.931+0000 7f8101831980 1 -- 172.21.15.157:0/2726349913 shutdown_connections 2024-05-09T09:47:29.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.931+0000 7f8101831980 1 -- 172.21.15.157:0/2726349913 wait complete. 2024-05-09T09:47:29.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.931+0000 7f8101831980 1 Processor -- start 2024-05-09T09:47:29.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.931+0000 7f8101831980 1 -- start start 2024-05-09T09:47:29.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.931+0000 7f8101831980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3884803f0 0x55f388487690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:29.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.931+0000 7f8101831980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f3884814b0 con 0x55f3884803f0 2024-05-09T09:47:29.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.931+0000 7f80ff34c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3884803f0 0x55f388487690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:29.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.931+0000 7f80ff34c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3884803f0 0x55f388487690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53458/0 (socket says 172.21.15.157:53458) 2024-05-09T09:47:29.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.931+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 learned_addr learned my addr 172.21.15.157:0/2447118947 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:29.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.931+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f388487bd0 con 0x55f3884803f0 2024-05-09T09:47:29.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.931+0000 7f80ff34c640 1 --2- 172.21.15.157:0/2447118947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3884803f0 0x55f388487690 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f80f00b74c0 tx=0x7f80f00b7450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:29.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.931+0000 7f7fcffff640 1 -- 172.21.15.157:0/2447118947 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80f00e2380 con 0x55f3884803f0 2024-05-09T09:47:29.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.931+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f388487bd0 con 0x55f3884803f0 2024-05-09T09:47:29.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.931+0000 7f7fcffff640 1 -- 172.21.15.157:0/2447118947 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80f00e2520 con 0x55f3884803f0 2024-05-09T09:47:29.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.931+0000 7f7fcffff640 1 -- 172.21.15.157:0/2447118947 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80f00e4c50 con 0x55f3884803f0 2024-05-09T09:47:29.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.931+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f388487bd0 con 0x55f3884803f0 2024-05-09T09:47:29.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f8101831980 20 rados->read ofs=0 len=0 2024-05-09T09:47:29.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f7fcffff640 1 -- 172.21.15.157:0/2447118947 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f80f010b060 con 0x55f3884803f0 2024-05-09T09:47:29.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f7fcffff640 1 --2- 172.21.15.157:0/2447118947 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f7fc8034bb0 0x7f7fc8037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:29.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f7fcffff640 1 -- 172.21.15.157:0/2447118947 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f80f0105c50 con 0x55f3884803f0 2024-05-09T09:47:29.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f80feb4b640 1 --2- 172.21.15.157:0/2447118947 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f7fc8034bb0 0x7f7fc8037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:29.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f8101831980 1 --2- 172.21.15.157:0/2447118947 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f388494050 0x55f3884964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:29.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f388496c40 con 0x55f388494050 2024-05-09T09:47:29.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f80ffb4d640 1 --2- 172.21.15.157:0/2447118947 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f388494050 0x55f3884964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:29.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f80feb4b640 1 --2- 172.21.15.157:0/2447118947 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f7fc8034bb0 0x7f7fc8037070 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f80f400c010 tx=0x7f80f4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:29.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f80ffb4d640 1 --2- 172.21.15.157:0/2447118947 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f388494050 0x55f3884964f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:29.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f80f80083f0 con 0x55f388494050 2024-05-09T09:47:29.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f8101831980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:29.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f8101831980 20 realm 2024-05-09T09:47:29.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f8101831980 20 rados->read ofs=0 len=0 2024-05-09T09:47:29.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f388497050 con 0x55f388494050 2024-05-09T09:47:29.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f80f80083f0 con 0x55f388494050 2024-05-09T09:47:29.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f8101831980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:29.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f8101831980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:29.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f8101831980 20 rados->read ofs=0 len=0 2024-05-09T09:47:29.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f3884978f0 con 0x55f388494050 2024-05-09T09:47:29.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f80f80083f0 con 0x55f388494050 2024-05-09T09:47:29.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f8101831980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:29.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f8101831980 20 rados->read ofs=0 len=0 2024-05-09T09:47:29.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f388494050 2024-05-09T09:47:29.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f80f80083f0 con 0x55f388494050 2024-05-09T09:47:29.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f8101831980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:29.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f8101831980 20 rados->read ofs=0 len=0 2024-05-09T09:47:29.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f8101831980 1 --2- 172.21.15.157:0/2447118947 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f3884989f0 0x55f38849ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:29.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f38849b360 con 0x55f3884989f0 2024-05-09T09:47:29.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f80ff34c640 1 --2- 172.21.15.157:0/2447118947 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f3884989f0 0x55f38849ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:29.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.935+0000 7f80ff34c640 1 --2- 172.21.15.157:0/2447118947 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f3884989f0 0x55f38849ade0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:29.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.939+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:29.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.939+0000 7f8101831980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:29.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.939+0000 7f8101831980 20 searching for the correct realm 2024-05-09T09:47:29.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.939+0000 7f8101831980 1 --2- 172.21.15.157:0/2447118947 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f38849d2b0 0x55f38849f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:29.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.939+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f38849fe40 con 0x55f38849d2b0 2024-05-09T09:47:29.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.939+0000 7f80feb4b640 1 --2- 172.21.15.157:0/2447118947 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f38849d2b0 0x55f38849f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:29.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.939+0000 7f80feb4b640 1 --2- 172.21.15.157:0/2447118947 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f38849d2b0 0x55f38849f770 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:29.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.939+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f4037040 con 0x55f38849d2b0 2024-05-09T09:47:29.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.939+0000 7f80feb4b640 1 --2- 172.21.15.157:0/2447118947 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f80f401fbe0 0x7f80f403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:29.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.939+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f38849fe40 con 0x7f80f401fbe0 2024-05-09T09:47:29.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.939+0000 7f80ffb4d640 1 --2- 172.21.15.157:0/2447118947 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f80f401fbe0 0x7f80f403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:29.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.939+0000 7f80ffb4d640 1 --2- 172.21.15.157:0/2447118947 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f80f401fbe0 0x7f80f403a3c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:29.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.939+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f80083f0 con 0x7f80f401fbe0 2024-05-09T09:47:29.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.939+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f3884989f0 2024-05-09T09:47:29.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.939+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:29.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.939+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f388494050 2024-05-09T09:47:29.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.939+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f80083f0 con 0x55f388494050 2024-05-09T09:47:29.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.939+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f388494050 2024-05-09T09:47:29.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.943+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f8026040 con 0x55f388494050 2024-05-09T09:47:29.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.943+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f3884989f0 2024-05-09T09:47:29.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.943+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:29.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.943+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f3884989f0 2024-05-09T09:47:29.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.943+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:29.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.943+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x7f80f401fbe0 2024-05-09T09:47:29.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.943+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f8026040 con 0x7f80f401fbe0 2024-05-09T09:47:29.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.943+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f38849d2b0 2024-05-09T09:47:29.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.943+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f4037040 con 0x55f38849d2b0 2024-05-09T09:47:29.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.943+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f388494050 2024-05-09T09:47:29.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.943+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f8026040 con 0x55f388494050 2024-05-09T09:47:29.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.943+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f3884989f0 2024-05-09T09:47:29.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.943+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:29.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.943+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f388494050 2024-05-09T09:47:29.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.943+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f8026040 con 0x55f388494050 2024-05-09T09:47:29.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.943+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x7f80f401fbe0 2024-05-09T09:47:29.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.947+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f80f8026040 con 0x7f80f401fbe0 2024-05-09T09:47:29.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.947+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f38849d2b0 2024-05-09T09:47:29.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.947+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f4037040 con 0x55f38849d2b0 2024-05-09T09:47:29.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.947+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f38849d2b0 2024-05-09T09:47:29.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.947+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f80f4037040 con 0x55f38849d2b0 2024-05-09T09:47:29.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.947+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f3884989f0 2024-05-09T09:47:29.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.947+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:29.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.947+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f38849d2b0 2024-05-09T09:47:29.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.947+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f4037040 con 0x55f38849d2b0 2024-05-09T09:47:29.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.947+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f38849d2b0 2024-05-09T09:47:29.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.947+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f4037040 con 0x55f38849d2b0 2024-05-09T09:47:29.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.947+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f388494050 2024-05-09T09:47:29.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.947+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f8026040 con 0x55f388494050 2024-05-09T09:47:29.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.947+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f388494050 2024-05-09T09:47:29.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.947+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f80f8026040 con 0x55f388494050 2024-05-09T09:47:29.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.947+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f3884989f0 2024-05-09T09:47:29.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.947+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:29.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.947+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f38849d2b0 2024-05-09T09:47:29.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.951+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f4037040 con 0x55f38849d2b0 2024-05-09T09:47:29.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.951+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x7f80f401fbe0 2024-05-09T09:47:29.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.951+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f8026040 con 0x7f80f401fbe0 2024-05-09T09:47:29.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.951+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f388494050 2024-05-09T09:47:29.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.951+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f8026040 con 0x55f388494050 2024-05-09T09:47:29.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.951+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f3884989f0 2024-05-09T09:47:29.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.951+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:29.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.951+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f38849d2b0 2024-05-09T09:47:29.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.951+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f4037040 con 0x55f38849d2b0 2024-05-09T09:47:29.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.951+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f3884989f0 2024-05-09T09:47:29.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.951+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:29.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.951+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x7f80f401fbe0 2024-05-09T09:47:29.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.951+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f8026040 con 0x7f80f401fbe0 2024-05-09T09:47:29.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.951+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f38849d2b0 2024-05-09T09:47:29.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.951+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f4049040 con 0x55f38849d2b0 2024-05-09T09:47:29.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.951+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f3884989f0 2024-05-09T09:47:29.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:29.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f388494050 2024-05-09T09:47:29.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f80f8026040 con 0x55f388494050 2024-05-09T09:47:29.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x7f80f401fbe0 2024-05-09T09:47:29.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f8026040 con 0x7f80f401fbe0 2024-05-09T09:47:29.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:29.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:29.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:29.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:29.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:29.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:29.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 20 rados->read ofs=0 len=0 2024-05-09T09:47:29.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f38849bbb0 con 0x55f388494050 2024-05-09T09:47:29.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f80f8026040 con 0x55f388494050 2024-05-09T09:47:29.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:29.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 20 rados->read ofs=0 len=0 2024-05-09T09:47:29.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f38849bbb0 con 0x55f388494050 2024-05-09T09:47:29.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f80f8026040 con 0x55f388494050 2024-05-09T09:47:29.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:29.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 20 rados->read ofs=0 len=0 2024-05-09T09:47:29.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f38849bbb0 con 0x55f38849d2b0 2024-05-09T09:47:29.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f80f4049040 con 0x55f38849d2b0 2024-05-09T09:47:29.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:29.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 20 zone default found 2024-05-09T09:47:29.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 4 Realm: () 2024-05-09T09:47:29.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:29.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:29.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:29.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 20 zonegroup default 2024-05-09T09:47:29.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 20 rados->read ofs=0 len=0 2024-05-09T09:47:29.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f38849c450 con 0x55f3884989f0 2024-05-09T09:47:29.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:29.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:29.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 20 rados->read ofs=0 len=0 2024-05-09T09:47:29.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a1ca0 con 0x55f38849d2b0 2024-05-09T09:47:29.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f80f4049040 con 0x55f38849d2b0 2024-05-09T09:47:29.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:29.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 20 rados->read ofs=0 len=0 2024-05-09T09:47:29.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a2040 con 0x55f38849d2b0 2024-05-09T09:47:29.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f80f4049040 con 0x55f38849d2b0 2024-05-09T09:47:29.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:29.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 20 started sync module instance, tier type = 2024-05-09T09:47:29.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:29.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.955+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a1140 con 0x7f80f401fbe0 2024-05-09T09:47:29.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.959+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f8026040 con 0x7f80f401fbe0 2024-05-09T09:47:29.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.959+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94504451970656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a1140 con 0x7f80f401fbe0 2024-05-09T09:47:29.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.959+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a2b10 con 0x55f388494050 2024-05-09T09:47:29.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.959+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94504451970656] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f8036040 con 0x7f80f401fbe0 2024-05-09T09:47:29.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.959+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f8036040 con 0x55f388494050 2024-05-09T09:47:29.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.959+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94504451974656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a1140 con 0x55f388494050 2024-05-09T09:47:29.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.959+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a3520 con 0x55f38849d2b0 2024-05-09T09:47:29.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.963+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94504451974656] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f8036040 con 0x55f388494050 2024-05-09T09:47:29.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.963+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f4049040 con 0x55f38849d2b0 2024-05-09T09:47:29.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.963+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94504451968144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a10b0 con 0x55f38849d2b0 2024-05-09T09:47:29.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.963+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a4270 con 0x7f80f401fbe0 2024-05-09T09:47:29.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.963+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f8036040 con 0x7f80f401fbe0 2024-05-09T09:47:29.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.963+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94504451981040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a4b10 con 0x7f80f401fbe0 2024-05-09T09:47:29.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.963+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a54d0 con 0x55f388494050 2024-05-09T09:47:29.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.963+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94504451968144] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f4049040 con 0x55f38849d2b0 2024-05-09T09:47:29.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.967+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94504451981040] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f8036040 con 0x7f80f401fbe0 2024-05-09T09:47:29.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.967+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f8036040 con 0x55f388494050 2024-05-09T09:47:29.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.967+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94504451985440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a4a80 con 0x55f388494050 2024-05-09T09:47:29.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.967+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a5440 con 0x55f3884989f0 2024-05-09T09:47:29.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.967+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94504451985440] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f8036040 con 0x55f388494050 2024-05-09T09:47:29.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.967+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:29.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.967+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94504451983072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a5da0 con 0x55f3884989f0 2024-05-09T09:47:29.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.967+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a65f0 con 0x55f3884989f0 2024-05-09T09:47:29.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.971+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:29.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.971+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94504451991952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a7260 con 0x55f3884989f0 2024-05-09T09:47:29.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.971+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a7c60 con 0x55f3884989f0 2024-05-09T09:47:29.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.971+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94504451983072] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:29.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.971+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94504451991952] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:29.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.975+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:29.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.975+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94504451993008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a77b0 con 0x55f3884989f0 2024-05-09T09:47:29.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.975+0000 7f8101831980 20 add_watcher() i=0 2024-05-09T09:47:29.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.975+0000 7f8101831980 20 add_watcher() i=1 2024-05-09T09:47:29.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.975+0000 7f8101831980 20 add_watcher() i=2 2024-05-09T09:47:29.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.975+0000 7f8101831980 20 add_watcher() i=3 2024-05-09T09:47:29.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.975+0000 7f8101831980 20 add_watcher() i=4 2024-05-09T09:47:29.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.975+0000 7f8101831980 20 add_watcher() i=5 2024-05-09T09:47:29.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.975+0000 7f8101831980 20 add_watcher() i=6 2024-05-09T09:47:29.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.975+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94504451993008] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:29.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.975+0000 7f8101831980 20 add_watcher() i=7 2024-05-09T09:47:29.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.975+0000 7f8101831980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:29.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.975+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f3884aaea0 con 0x55f388494050 2024-05-09T09:47:29.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.975+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f80f8036040 con 0x55f388494050 2024-05-09T09:47:29.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.975+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94504451987616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a8390 con 0x55f388494050 2024-05-09T09:47:29.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.975+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94504451987616] v30'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f80f8036040 con 0x55f388494050 2024-05-09T09:47:29.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.979+0000 7f7fb4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:29.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.979+0000 7f8101831980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:29.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.979+0000 7f8101831980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:29.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.979+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b3560 con 0x55f388494050 2024-05-09T09:47:29.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.979+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f80f8036040 con 0x55f388494050 2024-05-09T09:47:29.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.979+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b3ad0 con 0x55f3884989f0 2024-05-09T09:47:29.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.983+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'10 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:29.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.983+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b3ad0 con 0x55f38849d2b0 2024-05-09T09:47:29.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.983+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f80f4049040 con 0x55f38849d2b0 2024-05-09T09:47:29.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.983+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b45b0 con 0x55f388494050 2024-05-09T09:47:29.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.983+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f80f8036040 con 0x55f388494050 2024-05-09T09:47:29.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.983+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b1600 con 0x7f80f401fbe0 2024-05-09T09:47:29.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.987+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f80f8036040 con 0x7f80f401fbe0 2024-05-09T09:47:29.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.987+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b15d0 con 0x55f38849d2b0 2024-05-09T09:47:29.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.987+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'13 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f80f4049040 con 0x55f38849d2b0 2024-05-09T09:47:29.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.987+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b52e0 con 0x55f388494050 2024-05-09T09:47:29.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.991+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f80f8036040 con 0x55f388494050 2024-05-09T09:47:29.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.991+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b52e0 con 0x55f3884989f0 2024-05-09T09:47:29.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.991+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'13 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:29.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.991+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b5370 con 0x7f80f401fbe0 2024-05-09T09:47:29.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.995+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f80f8036040 con 0x7f80f401fbe0 2024-05-09T09:47:29.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.995+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b5370 con 0x55f38849d2b0 2024-05-09T09:47:29.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.995+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f80f4049040 con 0x55f38849d2b0 2024-05-09T09:47:29.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.995+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b5820 con 0x7f80f401fbe0 2024-05-09T09:47:29.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.995+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80f8036040 con 0x7f80f401fbe0 2024-05-09T09:47:29.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.995+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b5820 con 0x55f3884989f0 2024-05-09T09:47:29.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.999+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:29.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:29.999+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b5820 con 0x7f80f401fbe0 2024-05-09T09:47:30.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.003+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80f8036040 con 0x7f80f401fbe0 2024-05-09T09:47:30.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.003+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b5820 con 0x55f3884989f0 2024-05-09T09:47:30.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.003+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:30.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.003+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b5820 con 0x55f388494050 2024-05-09T09:47:30.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.007+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'26 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80f8036040 con 0x55f388494050 2024-05-09T09:47:30.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.007+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b5820 con 0x55f38849d2b0 2024-05-09T09:47:30.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.007+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80f4049040 con 0x55f38849d2b0 2024-05-09T09:47:30.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.007+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b5820 con 0x7f80f401fbe0 2024-05-09T09:47:30.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.011+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'22 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80f8036040 con 0x7f80f401fbe0 2024-05-09T09:47:30.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.011+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b5820 con 0x55f38849d2b0 2024-05-09T09:47:30.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.011+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80f4049040 con 0x55f38849d2b0 2024-05-09T09:47:30.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.011+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b58b0 con 0x55f388494050 2024-05-09T09:47:30.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.015+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80f8036040 con 0x55f388494050 2024-05-09T09:47:30.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.015+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b58b0 con 0x55f388494050 2024-05-09T09:47:30.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.015+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'27 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80f8036040 con 0x55f388494050 2024-05-09T09:47:30.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.015+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b58b0 con 0x55f38849d2b0 2024-05-09T09:47:30.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.019+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'15 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80f4049040 con 0x55f38849d2b0 2024-05-09T09:47:30.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.019+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b5940 con 0x7f80f401fbe0 2024-05-09T09:47:30.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.019+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80f8036040 con 0x7f80f401fbe0 2024-05-09T09:47:30.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.019+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b5940 con 0x55f38849d2b0 2024-05-09T09:47:30.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.023+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80f4049040 con 0x55f38849d2b0 2024-05-09T09:47:30.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.023+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b5940 con 0x55f38849d2b0 2024-05-09T09:47:30.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.023+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80f4049040 con 0x55f38849d2b0 2024-05-09T09:47:30.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.023+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b5960 con 0x55f38849d2b0 2024-05-09T09:47:30.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.027+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80f4049040 con 0x55f38849d2b0 2024-05-09T09:47:30.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.027+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b5960 con 0x55f38849d2b0 2024-05-09T09:47:30.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.027+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'14 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80f4049040 con 0x55f38849d2b0 2024-05-09T09:47:30.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.027+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b5960 con 0x55f3884989f0 2024-05-09T09:47:30.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.031+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:30.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.031+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b5960 con 0x55f38849d2b0 2024-05-09T09:47:30.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.035+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80f4049040 con 0x55f38849d2b0 2024-05-09T09:47:30.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.035+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b5960 con 0x55f3884989f0 2024-05-09T09:47:30.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.035+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'14 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:30.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.035+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b5960 con 0x55f38849d2b0 2024-05-09T09:47:30.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.039+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'16 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80f4049040 con 0x55f38849d2b0 2024-05-09T09:47:30.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.039+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b5960 con 0x55f3884989f0 2024-05-09T09:47:30.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.043+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'20 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:30.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.043+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b5960 con 0x7f80f401fbe0 2024-05-09T09:47:30.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.043+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80f8036040 con 0x7f80f401fbe0 2024-05-09T09:47:30.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.047+0000 7f7f2f7fe640 20 reqs_thread_entry: start 2024-05-09T09:47:30.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.047+0000 7f8101831980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:30.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.047+0000 7f7f2d7fa640 20 reqs_thread_entry: start 2024-05-09T09:47:30.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.047+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:94 8.0 8:00000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f3884d0fa0 con 0x55f38849d2b0 2024-05-09T09:47:30.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.047+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(94 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f4049040 con 0x55f38849d2b0 2024-05-09T09:47:30.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.047+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:95 8.10 8:08000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b3ad0 con 0x55f38849d2b0 2024-05-09T09:47:30.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.047+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(95 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f4049040 con 0x55f38849d2b0 2024-05-09T09:47:30.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.047+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 8.8 8:10000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b3ad0 con 0x55f388494050 2024-05-09T09:47:30.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.047+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(96 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f8036040 con 0x55f388494050 2024-05-09T09:47:30.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.047+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 8.18 8:18000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f388494050 2024-05-09T09:47:30.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.047+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(97 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f8036040 con 0x55f388494050 2024-05-09T09:47:30.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.047+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:98 8.4 8:20000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x7f80f401fbe0 2024-05-09T09:47:30.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.047+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(98 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f8036040 con 0x7f80f401fbe0 2024-05-09T09:47:30.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.047+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:99 8.14 8:28000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f38849d2b0 2024-05-09T09:47:30.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.047+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== osd_op_reply(99 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f4049040 con 0x55f38849d2b0 2024-05-09T09:47:30.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.047+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 8.c 8:30000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f388494050 2024-05-09T09:47:30.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.051+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(100 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f8036040 con 0x55f388494050 2024-05-09T09:47:30.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.051+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:101 8.1c 8:38000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f38849d2b0 2024-05-09T09:47:30.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.051+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 30 ==== osd_op_reply(101 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f4049040 con 0x55f38849d2b0 2024-05-09T09:47:30.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.051+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:102 8.2 8:40000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x7f80f401fbe0 2024-05-09T09:47:30.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.051+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(102 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f8036040 con 0x7f80f401fbe0 2024-05-09T09:47:30.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.051+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:103 8.12 8:48000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f38849d2b0 2024-05-09T09:47:30.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.051+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 31 ==== osd_op_reply(103 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f4049040 con 0x55f38849d2b0 2024-05-09T09:47:30.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.051+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:104 8.a 8:50000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f388494050 2024-05-09T09:47:30.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.051+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(104 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f8036040 con 0x55f388494050 2024-05-09T09:47:30.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.051+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:105 8.1a 8:58000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f3884989f0 2024-05-09T09:47:30.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.051+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(105 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:30.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.051+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:106 8.6 8:60000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a7260 con 0x55f3884989f0 2024-05-09T09:47:30.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.051+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(106 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:30.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.051+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:107 8.16 8:68000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a7260 con 0x55f38849d2b0 2024-05-09T09:47:30.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.051+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 32 ==== osd_op_reply(107 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f4049040 con 0x55f38849d2b0 2024-05-09T09:47:30.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.051+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:108 8.e 8:70000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a7260 con 0x55f3884989f0 2024-05-09T09:47:30.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.055+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(108 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:30.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.055+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:109 8.1e 8:78000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a7260 con 0x55f3884989f0 2024-05-09T09:47:30.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.055+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(109 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:30.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.055+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:110 8.1 8:80000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a7260 con 0x55f3884989f0 2024-05-09T09:47:30.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.055+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(110 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:30.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.055+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:111 8.11 8:88000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a7260 con 0x55f38849d2b0 2024-05-09T09:47:30.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.055+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 33 ==== osd_op_reply(111 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f4049040 con 0x55f38849d2b0 2024-05-09T09:47:30.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.055+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:112 8.9 8:90000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a7260 con 0x7f80f401fbe0 2024-05-09T09:47:30.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.055+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(112 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f8036040 con 0x7f80f401fbe0 2024-05-09T09:47:30.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.055+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:113 8.19 8:98000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a7260 con 0x55f388494050 2024-05-09T09:47:30.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.055+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(113 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f8036040 con 0x55f388494050 2024-05-09T09:47:30.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.055+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:114 8.5 8:a0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a7260 con 0x55f388494050 2024-05-09T09:47:30.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.055+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(114 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f8036040 con 0x55f388494050 2024-05-09T09:47:30.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.055+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:115 8.15 8:a8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a7260 con 0x55f38849d2b0 2024-05-09T09:47:30.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.059+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 34 ==== osd_op_reply(115 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f4049040 con 0x55f38849d2b0 2024-05-09T09:47:30.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.059+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:116 8.d 8:b0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a7260 con 0x7f80f401fbe0 2024-05-09T09:47:30.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.059+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(116 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f8036040 con 0x7f80f401fbe0 2024-05-09T09:47:30.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.059+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:117 8.1d 8:b8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a7260 con 0x55f3884989f0 2024-05-09T09:47:30.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.059+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(117 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:30.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.059+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:118 8.3 8:c0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a7260 con 0x55f388494050 2024-05-09T09:47:30.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.059+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(118 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f8036040 con 0x55f388494050 2024-05-09T09:47:30.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.059+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:119 8.13 8:c8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a7260 con 0x55f3884989f0 2024-05-09T09:47:30.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.059+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(119 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:30.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.059+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:120 8.b 8:d0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a7260 con 0x55f38849d2b0 2024-05-09T09:47:30.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.059+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 35 ==== osd_op_reply(120 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f4049040 con 0x55f38849d2b0 2024-05-09T09:47:30.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.059+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:121 8.1b 8:d8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a7260 con 0x7f80f401fbe0 2024-05-09T09:47:30.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.059+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(121 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f8036040 con 0x7f80f401fbe0 2024-05-09T09:47:30.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.059+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:122 8.7 8:e0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a7260 con 0x55f3884989f0 2024-05-09T09:47:30.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.063+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 32 ==== osd_op_reply(122 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:30.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.063+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:123 8.17 8:e8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a7260 con 0x55f388494050 2024-05-09T09:47:30.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.063+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(123 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f8036040 con 0x55f388494050 2024-05-09T09:47:30.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.063+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:124 8.f 8:f0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a7260 con 0x55f38849d2b0 2024-05-09T09:47:30.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.063+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 36 ==== osd_op_reply(124 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f4049040 con 0x55f38849d2b0 2024-05-09T09:47:30.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.063+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:125 8.1f 8:f8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a7260 con 0x7f80f401fbe0 2024-05-09T09:47:30.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.063+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.2 v2:172.21.15.157:6800/354455204 23 ==== osd_op_reply(125 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80f8036040 con 0x7f80f401fbe0 2024-05-09T09:47:30.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.063+0000 7f7fb4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:30.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.063+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:126 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94504451987616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b3ad0 con 0x55f388494050 2024-05-09T09:47:30.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.067+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(126 data_loggenerations_metadata [watch unwatch cookie 94504451987616] v30'28 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f80f8036040 con 0x55f388494050 2024-05-09T09:47:30.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.067+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:127 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94504451970656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x7f80f401fbe0 2024-05-09T09:47:30.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.067+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.2 v2:172.21.15.157:6800/354455204 24 ==== osd_op_reply(127 notify.0 [watch unwatch cookie 94504451970656] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f8036040 con 0x7f80f401fbe0 2024-05-09T09:47:30.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.067+0000 7f8101831980 20 remove_watcher() i=0 2024-05-09T09:47:30.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.067+0000 7f8101831980 2 removed watcher, disabling cache 2024-05-09T09:47:30.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.067+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:128 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94504451974656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b3ad0 con 0x55f388494050 2024-05-09T09:47:30.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.071+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 36 ==== osd_op_reply(128 notify.1 [watch unwatch cookie 94504451974656] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f8036040 con 0x55f388494050 2024-05-09T09:47:30.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.071+0000 7f8101831980 20 remove_watcher() i=1 2024-05-09T09:47:30.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.071+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:129 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94504451968144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f388497c90 con 0x55f38849d2b0 2024-05-09T09:47:30.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.071+0000 7f80feb4b640 1 -- 172.21.15.157:0/2447118947 <== osd.3 v2:172.21.15.157:6816/2487336710 37 ==== osd_op_reply(129 notify.2 [watch unwatch cookie 94504451968144] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f4049040 con 0x55f38849d2b0 2024-05-09T09:47:30.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.071+0000 7f8101831980 20 remove_watcher() i=2 2024-05-09T09:47:30.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.071+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:130 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94504451981040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b3ad0 con 0x7f80f401fbe0 2024-05-09T09:47:30.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.075+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.2 v2:172.21.15.157:6800/354455204 25 ==== osd_op_reply(130 notify.3 [watch unwatch cookie 94504451981040] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f8036040 con 0x7f80f401fbe0 2024-05-09T09:47:30.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.075+0000 7f8101831980 20 remove_watcher() i=3 2024-05-09T09:47:30.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.075+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:131 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94504451985440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b3ad0 con 0x55f388494050 2024-05-09T09:47:30.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.075+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 <== osd.1 v2:172.21.15.157:6808/3930131338 37 ==== osd_op_reply(131 notify.4 [watch unwatch cookie 94504451985440] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f8036040 con 0x55f388494050 2024-05-09T09:47:30.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.075+0000 7f8101831980 20 remove_watcher() i=4 2024-05-09T09:47:30.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.075+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:132 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94504451983072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884b3ad0 con 0x55f3884989f0 2024-05-09T09:47:30.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.079+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 33 ==== osd_op_reply(132 notify.5 [watch unwatch cookie 94504451983072] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:30.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.079+0000 7f8101831980 20 remove_watcher() i=5 2024-05-09T09:47:30.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.079+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:133 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94504451991952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a2600 con 0x55f3884989f0 2024-05-09T09:47:30.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.079+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 34 ==== osd_op_reply(133 notify.6 [watch unwatch cookie 94504451991952] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:30.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.079+0000 7f8101831980 20 remove_watcher() i=6 2024-05-09T09:47:30.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.079+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:134 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94504451993008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f3884a0c90 con 0x55f3884989f0 2024-05-09T09:47:30.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f80ff34c640 1 -- 172.21.15.157:0/2447118947 <== osd.0 v2:172.21.15.110:6800/231209037 35 ==== osd_op_reply(134 notify.7 [watch unwatch cookie 94504451993008] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80f00f6030 con 0x55f3884989f0 2024-05-09T09:47:30.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f8101831980 20 remove_watcher() i=7 2024-05-09T09:47:30.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f3884989f0 msgr2=0x55f38849ade0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f8101831980 1 --2- 172.21.15.157:0/2447118947 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f3884989f0 0x55f38849ade0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f388494050 msgr2=0x55f3884964f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f8101831980 1 --2- 172.21.15.157:0/2447118947 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f388494050 0x55f3884964f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f80f401fbe0 msgr2=0x7f80f403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f8101831980 1 --2- 172.21.15.157:0/2447118947 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f80f401fbe0 0x7f80f403a3c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f38849d2b0 msgr2=0x55f38849f770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f8101831980 1 --2- 172.21.15.157:0/2447118947 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f38849d2b0 0x55f38849f770 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f7fc8034bb0 msgr2=0x7f7fc8037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f8101831980 1 --2- 172.21.15.157:0/2447118947 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f7fc8034bb0 0x7f7fc8037070 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f80f400c010 tx=0x7f80f4010000 comp rx=0 tx=0).stop 2024-05-09T09:47:30.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3884803f0 msgr2=0x55f388487690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f80ffb4d640 1 -- 172.21.15.157:0/2447118947 reap_dead start 2024-05-09T09:47:30.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f8101831980 1 --2- 172.21.15.157:0/2447118947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3884803f0 0x55f388487690 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f80f00b74c0 tx=0x7f80f00b7450 comp rx=0 tx=0).stop 2024-05-09T09:47:30.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 shutdown_connections 2024-05-09T09:47:30.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f8101831980 1 --2- 172.21.15.157:0/2447118947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3884803f0 0x55f388487690 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 >> 172.21.15.157:0/2447118947 conn(0x55f38847c770 msgr2=0x55f388479dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:30.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 shutdown_connections 2024-05-09T09:47:30.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f8101831980 1 -- 172.21.15.157:0/2447118947 wait complete. 2024-05-09T09:47:30.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f8101831980 1 -- 172.21.15.157:0/1349521230 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f7fd8034c50 msgr2=0x7f7fd8037110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f8101831980 1 --2- 172.21.15.157:0/1349521230 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f7fd8034c50 0x7f7fd8037110 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x55f38844da10 tx=0x7f80f400f000 comp rx=0 tx=0).stop 2024-05-09T09:47:30.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f8101831980 1 -- 172.21.15.157:0/1349521230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3884734c0 msgr2=0x55f3884738e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f8101831980 1 --2- 172.21.15.157:0/1349521230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3884734c0 0x55f3884738e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f80f00a9530 tx=0x7f80f00c8dd0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f8101831980 1 -- 172.21.15.157:0/1349521230 shutdown_connections 2024-05-09T09:47:30.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f8101831980 1 --2- 172.21.15.157:0/1349521230 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f7fd8034c50 0x7f7fd8037110 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f8101831980 1 --2- 172.21.15.157:0/1349521230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3884734c0 0x55f3884738e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f8101831980 1 -- 172.21.15.157:0/1349521230 >> 172.21.15.157:0/1349521230 conn(0x55f388468290 msgr2=0x55f388468da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:30.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f8101831980 1 -- 172.21.15.157:0/1349521230 shutdown_connections 2024-05-09T09:47:30.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.083+0000 7f8101831980 1 -- 172.21.15.157:0/1349521230 wait complete. 2024-05-09T09:47:30.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.087+0000 7f8101831980 1 -- 172.21.15.157:0/4106256893 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f388446b90 msgr2=0x55f388448f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.087+0000 7f8101831980 1 --2- 172.21.15.157:0/4106256893 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f388446b90 0x55f388448f80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.087+0000 7f8101831980 1 -- 172.21.15.157:0/4106256893 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f38834a110 msgr2=0x55f388444210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.087+0000 7f8101831980 1 --2- 172.21.15.157:0/4106256893 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f38834a110 0x55f388444210 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.087+0000 7f8101831980 1 -- 172.21.15.157:0/4106256893 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f38844aa90 msgr2=0x55f38844ce80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.087+0000 7f8101831980 1 --2- 172.21.15.157:0/4106256893 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f38844aa90 0x55f38844ce80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.087+0000 7f8101831980 1 -- 172.21.15.157:0/4106256893 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f7fe4034c50 msgr2=0x7f7fe4037110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.087+0000 7f8101831980 1 --2- 172.21.15.157:0/4106256893 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f7fe4034c50 0x7f7fe4037110 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f80f4000f70 tx=0x7f80f4001380 comp rx=0 tx=0).stop 2024-05-09T09:47:30.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.087+0000 7f8101831980 1 -- 172.21.15.157:0/4106256893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3883497f0 msgr2=0x55f38843d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.087+0000 7f8101831980 1 --2- 172.21.15.157:0/4106256893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f3883497f0 0x55f38843d2d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f80f0000f90 tx=0x7f80f0017e30 comp rx=0 tx=0).stop 2024-05-09T09:47:30.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.087+0000 7f80ffb4d640 1 -- 172.21.15.157:0/4106256893 reap_dead start 2024-05-09T09:47:30.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.087+0000 7f8101831980 1 -- 172.21.15.157:0/4106256893 shutdown_connections 2024-05-09T09:47:30.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.087+0000 7f8101831980 1 -- 172.21.15.157:0/4106256893 >> 172.21.15.157:0/4106256893 conn(0x55f3883450c0 msgr2=0x55f38842f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:30.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.087+0000 7f8101831980 1 -- 172.21.15.157:0/4106256893 shutdown_connections 2024-05-09T09:47:30.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.087+0000 7f8101831980 1 -- 172.21.15.157:0/4106256893 wait complete. 2024-05-09T09:47:30.096 INFO:teuthology.orchestra.run.smithi157.stdout:[] 2024-05-09T09:47:30.096 DEBUG:tasks.util.rgw: json result: [] 2024-05-09T09:47:30.097 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-05-09T09:47:30.097 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-05-09T09:47:30.097 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-05-09T09:47:30.178 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:30.178 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:30.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.179+0000 7f51addf5980 1 Processor -- start 2024-05-09T09:47:30.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.179+0000 7f51addf5980 1 -- start start 2024-05-09T09:47:30.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.179+0000 7f51addf5980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5630cfc6a380 0x5630cfc68980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.179+0000 7f51addf5980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5630cfba9440 con 0x5630cfc68ec0 2024-05-09T09:47:30.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.179+0000 7f51addf5980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5630cfb945f0 con 0x5630cfc6a380 2024-05-09T09:47:30.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.179+0000 7f51ab910640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5630cfc6a380 0x5630cfc68980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.179+0000 7f51ab910640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5630cfc6a380 0x5630cfc68980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53466/0 (socket says 172.21.15.157:53466) 2024-05-09T09:47:30.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.179+0000 7f51ab10f640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x5630cfc68ec0 0x5630cfcfb980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:33504/0 (socket says 172.21.15.157:33504) 2024-05-09T09:47:30.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.179+0000 7f51ab910640 1 -- 172.21.15.157:0/3596626628 learned_addr learned my addr 172.21.15.157:0/3596626628 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:30.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.183+0000 7f51ab910640 1 -- 172.21.15.157:0/3596626628 >> v1:172.21.15.110:6789/0 conn(0x5630cfc68ec0 legacy=0x5630cfcfb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.183+0000 7f51ab910640 1 -- 172.21.15.157:0/3596626628 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630cfb9f990 con 0x5630cfc6a380 2024-05-09T09:47:30.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.183+0000 7f51ab910640 1 --2- 172.21.15.157:0/3596626628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfc6a380 0x5630cfc68980 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f519c00a5c0 tx=0x7f519c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e2bf88b991e790 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.187+0000 7f51aa90e640 1 -- 172.21.15.157:0/3596626628 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f519c0a6070 con 0x5630cfc6a380 2024-05-09T09:47:30.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.187+0000 7f51aa90e640 1 -- 172.21.15.157:0/3596626628 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f519c0af070 con 0x5630cfc6a380 2024-05-09T09:47:30.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.187+0000 7f51aa90e640 1 -- 172.21.15.157:0/3596626628 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f519c0aa5c0 con 0x5630cfc6a380 2024-05-09T09:47:30.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.187+0000 7f51addf5980 1 -- 172.21.15.157:0/3596626628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfc6a380 msgr2=0x5630cfc68980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.187+0000 7f51addf5980 1 --2- 172.21.15.157:0/3596626628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfc6a380 0x5630cfc68980 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f519c00a5c0 tx=0x7f519c01b340 comp rx=0 tx=0).stop 2024-05-09T09:47:30.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.187+0000 7f51addf5980 1 -- 172.21.15.157:0/3596626628 shutdown_connections 2024-05-09T09:47:30.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.187+0000 7f51addf5980 1 --2- 172.21.15.157:0/3596626628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfc6a380 0x5630cfc68980 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.187+0000 7f51addf5980 1 -- 172.21.15.157:0/3596626628 >> 172.21.15.157:0/3596626628 conn(0x5630cfcef250 msgr2=0x5630cfcf1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:30.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.187+0000 7f51addf5980 1 -- 172.21.15.157:0/3596626628 shutdown_connections 2024-05-09T09:47:30.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.187+0000 7f51addf5980 1 -- 172.21.15.157:0/3596626628 wait complete. 2024-05-09T09:47:30.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.203+0000 7f51addf5980 1 Processor -- start 2024-05-09T09:47:30.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.203+0000 7f51addf5980 1 -- start start 2024-05-09T09:47:30.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.203+0000 7f51addf5980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfc68ec0 0x5630cfde1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.203+0000 7f51addf5980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5630cfbf6fe0 con 0x5630cfc68ec0 2024-05-09T09:47:30.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.203+0000 7f51ab910640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfc68ec0 0x5630cfde1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.203+0000 7f51ab910640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfc68ec0 0x5630cfde1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53476/0 (socket says 172.21.15.157:53476) 2024-05-09T09:47:30.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.203+0000 7f51ab910640 1 -- 172.21.15.157:0/2157586349 learned_addr learned my addr 172.21.15.157:0/2157586349 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:30.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.203+0000 7f51ab910640 1 -- 172.21.15.157:0/2157586349 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630cfb7bae0 con 0x5630cfc68ec0 2024-05-09T09:47:30.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.203+0000 7f51ab910640 1 --2- 172.21.15.157:0/2157586349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfc68ec0 0x5630cfde1320 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f519c018f70 tx=0x7f519c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d15ca29cec1b6b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.203+0000 7f5099e0b640 1 -- 172.21.15.157:0/2157586349 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f519c0aa9e0 con 0x5630cfc68ec0 2024-05-09T09:47:30.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.203+0000 7f5099e0b640 1 -- 172.21.15.157:0/2157586349 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f519c0aab80 con 0x5630cfc68ec0 2024-05-09T09:47:30.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.203+0000 7f5099e0b640 1 -- 172.21.15.157:0/2157586349 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f519c0aae60 con 0x5630cfc68ec0 2024-05-09T09:47:30.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.207+0000 7f51addf5980 1 -- 172.21.15.157:0/2157586349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfc68ec0 msgr2=0x5630cfde1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.207+0000 7f51addf5980 1 --2- 172.21.15.157:0/2157586349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfc68ec0 0x5630cfde1320 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f519c018f70 tx=0x7f519c003030 comp rx=0 tx=0).stop 2024-05-09T09:47:30.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.207+0000 7f51addf5980 1 -- 172.21.15.157:0/2157586349 shutdown_connections 2024-05-09T09:47:30.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.207+0000 7f51addf5980 1 --2- 172.21.15.157:0/2157586349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfc68ec0 0x5630cfde1320 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.207+0000 7f51addf5980 1 -- 172.21.15.157:0/2157586349 >> 172.21.15.157:0/2157586349 conn(0x5630cfcef250 msgr2=0x5630cfddceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:30.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.207+0000 7f51addf5980 1 -- 172.21.15.157:0/2157586349 shutdown_connections 2024-05-09T09:47:30.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.207+0000 7f51addf5980 1 -- 172.21.15.157:0/2157586349 wait complete. 2024-05-09T09:47:30.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.207+0000 7f51addf5980 1 Processor -- start 2024-05-09T09:47:30.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.207+0000 7f51addf5980 1 -- start start 2024-05-09T09:47:30.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.207+0000 7f51addf5980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfc68ec0 0x5630cfde83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.207+0000 7f51addf5980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5630cfcffb60 con 0x5630cfc68ec0 2024-05-09T09:47:30.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.207+0000 7f51ab910640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfc68ec0 0x5630cfde83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.207+0000 7f51ab910640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfc68ec0 0x5630cfde83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53484/0 (socket says 172.21.15.157:53484) 2024-05-09T09:47:30.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.207+0000 7f51ab910640 1 -- 172.21.15.157:0/1381755064 learned_addr learned my addr 172.21.15.157:0/1381755064 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:30.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.207+0000 7f51ab910640 1 -- 172.21.15.157:0/1381755064 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630cfde8920 con 0x5630cfc68ec0 2024-05-09T09:47:30.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.207+0000 7f51ab910640 1 --2- 172.21.15.157:0/1381755064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfc68ec0 0x5630cfde83e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f519c01b170 tx=0x7f519c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.207+0000 7f5093fff640 1 -- 172.21.15.157:0/1381755064 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f519c0bd7c0 con 0x5630cfc68ec0 2024-05-09T09:47:30.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.207+0000 7f51addf5980 1 -- 172.21.15.157:0/1381755064 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630cfde8bb0 con 0x5630cfc68ec0 2024-05-09T09:47:30.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.207+0000 7f5093fff640 1 -- 172.21.15.157:0/1381755064 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f519c0bd960 con 0x5630cfc68ec0 2024-05-09T09:47:30.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.207+0000 7f5093fff640 1 -- 172.21.15.157:0/1381755064 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f519c0bdc40 con 0x5630cfc68ec0 2024-05-09T09:47:30.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.207+0000 7f51addf5980 1 -- 172.21.15.157:0/1381755064 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630cfdeb840 con 0x5630cfc68ec0 2024-05-09T09:47:30.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.211+0000 7f5093fff640 1 -- 172.21.15.157:0/1381755064 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f519c0ce030 con 0x5630cfc68ec0 2024-05-09T09:47:30.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.211+0000 7f5093fff640 1 --2- 172.21.15.157:0/1381755064 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5094034bb0 0x7f5094037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.211+0000 7f5093fff640 1 -- 172.21.15.157:0/1381755064 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f519c0cc020 con 0x5630cfc68ec0 2024-05-09T09:47:30.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.211+0000 7f51ab10f640 1 --2- 172.21.15.157:0/1381755064 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5094034bb0 0x7f5094037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.211+0000 7f51addf5980 1 --2- 172.21.15.157:0/1381755064 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5630cfc6a380 0x5630cfdef360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.211+0000 7f51addf5980 1 -- 172.21.15.157:0/1381755064 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5630cfdef9d0 con 0x5630cfc6a380 2024-05-09T09:47:30.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.211+0000 7f51ac111640 1 --2- 172.21.15.157:0/1381755064 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5630cfc6a380 0x5630cfdef360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.211+0000 7f51ab10f640 1 --2- 172.21.15.157:0/1381755064 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5094034bb0 0x7f5094037070 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f51a0001e50 tx=0x7f51a00013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.211+0000 7f51ac111640 1 --2- 172.21.15.157:0/1381755064 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5630cfc6a380 0x5630cfdef360 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.211+0000 7f51ac111640 1 -- 172.21.15.157:0/1381755064 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfc6a380 2024-05-09T09:47:30.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.211+0000 7f51addf5980 1 -- 172.21.15.157:0/1381755064 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5630cfdeca40 con 0x5630cfc6a380 2024-05-09T09:47:30.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.211+0000 7f51ac111640 1 -- 172.21.15.157:0/1381755064 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfc6a380 2024-05-09T09:47:30.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.211+0000 7f51addf5980 1 --2- 172.21.15.157:0/1381755064 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5630cfdf1d00 0x5630cfdf40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.211+0000 7f51addf5980 1 -- 172.21.15.157:0/1381755064 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5630cfdf47c0 con 0x5630cfdf1d00 2024-05-09T09:47:30.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.211+0000 7f51ab910640 1 --2- 172.21.15.157:0/1381755064 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5630cfdf1d00 0x5630cfdf40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.211+0000 7f51ab910640 1 --2- 172.21.15.157:0/1381755064 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5630cfdf1d00 0x5630cfdf40f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.211+0000 7f51ab910640 1 -- 172.21.15.157:0/1381755064 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f519c0c6d20 con 0x5630cfdf1d00 2024-05-09T09:47:30.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.211+0000 7f51addf5980 1 -- 172.21.15.157:0/1381755064 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5630cfdf0ba0 con 0x5630cfc6a380 2024-05-09T09:47:30.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.211+0000 7f51ac111640 1 -- 172.21.15.157:0/1381755064 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfc6a380 2024-05-09T09:47:30.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.211+0000 7f51addf5980 1 --2- 172.21.15.157:0/1381755064 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5630cfdf5c20 0x5630cfdf8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.211+0000 7f51addf5980 1 -- 172.21.15.157:0/1381755064 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5630cfdf8710 con 0x5630cfdf5c20 2024-05-09T09:47:30.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.215+0000 7f51ab10f640 1 --2- 172.21.15.157:0/1381755064 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5630cfdf5c20 0x5630cfdf8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.215+0000 7f51ab10f640 1 --2- 172.21.15.157:0/1381755064 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5630cfdf5c20 0x5630cfdf8010 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.215+0000 7f51ab10f640 1 -- 172.21.15.157:0/1381755064 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f51a000f700 con 0x5630cfdf5c20 2024-05-09T09:47:30.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.219+0000 7f51addf5980 1 Processor -- start 2024-05-09T09:47:30.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.219+0000 7f51addf5980 1 -- start start 2024-05-09T09:47:30.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.219+0000 7f51addf5980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfe1e600 0x5630cfe1ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.219+0000 7f51addf5980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5630cfbfb020 con 0x5630cfe1e600 2024-05-09T09:47:30.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.219+0000 7f51ab910640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfe1e600 0x5630cfe1ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.219+0000 7f51ab910640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfe1e600 0x5630cfe1ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53500/0 (socket says 172.21.15.157:53500) 2024-05-09T09:47:30.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.219+0000 7f51ab910640 1 -- 172.21.15.157:0/1610321214 learned_addr learned my addr 172.21.15.157:0/1610321214 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:30.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.219+0000 7f51ab910640 1 -- 172.21.15.157:0/1610321214 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630cfe1ef60 con 0x5630cfe1e600 2024-05-09T09:47:30.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.219+0000 7f51ab910640 1 --2- 172.21.15.157:0/1610321214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfe1e600 0x5630cfe1ea20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f519c0cb040 tx=0x7f519c0bcc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.219+0000 7f508bfff640 1 -- 172.21.15.157:0/1610321214 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f519c0c6690 con 0x5630cfe1e600 2024-05-09T09:47:30.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.219+0000 7f508bfff640 1 -- 172.21.15.157:0/1610321214 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f519c0c6830 con 0x5630cfe1e600 2024-05-09T09:47:30.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.219+0000 7f51addf5980 1 -- 172.21.15.157:0/1610321214 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630cfe1f9f0 con 0x5630cfe1e600 2024-05-09T09:47:30.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.219+0000 7f508bfff640 1 -- 172.21.15.157:0/1610321214 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f519c0c5810 con 0x5630cfe1e600 2024-05-09T09:47:30.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.219+0000 7f51addf5980 1 -- 172.21.15.157:0/1610321214 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630cfe1fed0 con 0x5630cfe1e600 2024-05-09T09:47:30.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.223+0000 7f508bfff640 1 -- 172.21.15.157:0/1610321214 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f519c0c59b0 con 0x5630cfe1e600 2024-05-09T09:47:30.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.223+0000 7f508bfff640 1 --2- 172.21.15.157:0/1610321214 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5084034c00 0x7f50840370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.223+0000 7f508bfff640 1 -- 172.21.15.157:0/1610321214 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f519c0eec50 con 0x5630cfe1e600 2024-05-09T09:47:30.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.223+0000 7f51ab10f640 1 --2- 172.21.15.157:0/1610321214 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5084034c00 0x7f50840370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.223+0000 7f51addf5980 1 Processor -- start 2024-05-09T09:47:30.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.223+0000 7f51addf5980 1 -- start start 2024-05-09T09:47:30.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.223+0000 7f51ab10f640 1 --2- 172.21.15.157:0/1610321214 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5084034c00 0x7f50840370c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x5630cfdf02b0 tx=0x7f51a000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.223+0000 7f51addf5980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfe2b540 0x5630cfe2b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.223+0000 7f51addf5980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5630cfde19b0 con 0x5630cfe2b540 2024-05-09T09:47:30.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.223+0000 7f51ab910640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfe2b540 0x5630cfe2b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.223+0000 7f51ab910640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfe2b540 0x5630cfe2b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53504/0 (socket says 172.21.15.157:53504) 2024-05-09T09:47:30.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.223+0000 7f51ab910640 1 -- 172.21.15.157:0/3119713484 learned_addr learned my addr 172.21.15.157:0/3119713484 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:30.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.223+0000 7f51ab910640 1 -- 172.21.15.157:0/3119713484 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630cfe2bf30 con 0x5630cfe2b540 2024-05-09T09:47:30.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.223+0000 7f51ab910640 1 --2- 172.21.15.157:0/3119713484 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfe2b540 0x5630cfe2b960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f519c0aab50 tx=0x7f519c0bb740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b253316c1e59516 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.223+0000 7f5089ffb640 1 -- 172.21.15.157:0/3119713484 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f519c0d8820 con 0x5630cfe2b540 2024-05-09T09:47:30.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.223+0000 7f5089ffb640 1 -- 172.21.15.157:0/3119713484 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f519c0bb300 con 0x5630cfe2b540 2024-05-09T09:47:30.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.223+0000 7f5089ffb640 1 -- 172.21.15.157:0/3119713484 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f519c0d8c10 con 0x5630cfe2b540 2024-05-09T09:47:30.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.223+0000 7f51addf5980 1 -- 172.21.15.157:0/3119713484 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfe2b540 msgr2=0x5630cfe2b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.223+0000 7f51addf5980 1 --2- 172.21.15.157:0/3119713484 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfe2b540 0x5630cfe2b960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f519c0aab50 tx=0x7f519c0bb740 comp rx=0 tx=0).stop 2024-05-09T09:47:30.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.223+0000 7f51addf5980 1 -- 172.21.15.157:0/3119713484 shutdown_connections 2024-05-09T09:47:30.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.223+0000 7f51addf5980 1 --2- 172.21.15.157:0/3119713484 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfe2b540 0x5630cfe2b960 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.223+0000 7f51addf5980 1 -- 172.21.15.157:0/3119713484 >> 172.21.15.157:0/3119713484 conn(0x5630cfe27950 msgr2=0x5630cfe259b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:30.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.223+0000 7f51addf5980 1 -- 172.21.15.157:0/3119713484 shutdown_connections 2024-05-09T09:47:30.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.223+0000 7f51addf5980 1 -- 172.21.15.157:0/3119713484 wait complete. 2024-05-09T09:47:30.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.227+0000 7f51addf5980 1 Processor -- start 2024-05-09T09:47:30.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.227+0000 7f51addf5980 1 -- start start 2024-05-09T09:47:30.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.227+0000 7f51addf5980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfe2b540 0x5630cfe32900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.227+0000 7f51addf5980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5630cfe2c510 con 0x5630cfe2b540 2024-05-09T09:47:30.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.227+0000 7f51ab910640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfe2b540 0x5630cfe32900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.227+0000 7f51ab910640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfe2b540 0x5630cfe32900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53508/0 (socket says 172.21.15.157:53508) 2024-05-09T09:47:30.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.227+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 learned_addr learned my addr 172.21.15.157:0/2601866175 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:30.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.227+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630cfe32e40 con 0x5630cfe2b540 2024-05-09T09:47:30.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.227+0000 7f51ab910640 1 --2- 172.21.15.157:0/2601866175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfe2b540 0x5630cfe32900 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f519c0bbeb0 tx=0x7f519c0e4f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.227+0000 7f507bfff640 1 -- 172.21.15.157:0/2601866175 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f519c0a8460 con 0x5630cfe2b540 2024-05-09T09:47:30.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.227+0000 7f507bfff640 1 -- 172.21.15.157:0/2601866175 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f519c10c070 con 0x5630cfe2b540 2024-05-09T09:47:30.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.227+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630cfe32e40 con 0x5630cfe2b540 2024-05-09T09:47:30.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.227+0000 7f507bfff640 1 -- 172.21.15.157:0/2601866175 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f519c0a8730 con 0x5630cfe2b540 2024-05-09T09:47:30.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.227+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630cfe32e40 con 0x5630cfe2b540 2024-05-09T09:47:30.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.227+0000 7f507bfff640 1 -- 172.21.15.157:0/2601866175 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f519c100030 con 0x5630cfe2b540 2024-05-09T09:47:30.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.227+0000 7f507bfff640 1 --2- 172.21.15.157:0/2601866175 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5074034bb0 0x7f5074037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.227+0000 7f507bfff640 1 -- 172.21.15.157:0/2601866175 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f519c0fe070 con 0x5630cfe2b540 2024-05-09T09:47:30.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.227+0000 7f51ab10f640 1 --2- 172.21.15.157:0/2601866175 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5074034bb0 0x7f5074037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.227+0000 7f51addf5980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.227+0000 7f51addf5980 1 --2- 172.21.15.157:0/2601866175 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5630cfe3f350 0x5630cfe41810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.227+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe41f60 con 0x5630cfe3f350 2024-05-09T09:47:30.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.231+0000 7f51ac111640 1 --2- 172.21.15.157:0/2601866175 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5630cfe3f350 0x5630cfe41810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.231+0000 7f51ab10f640 1 --2- 172.21.15.157:0/2601866175 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5074034bb0 0x7f5074037070 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x5630cfdf8b10 tx=0x7f51a0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.231+0000 7f51ac111640 1 --2- 172.21.15.157:0/2601866175 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5630cfe3f350 0x5630cfe41810 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.231+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfe3f350 2024-05-09T09:47:30.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.231+0000 7f51addf5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:30.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.231+0000 7f51addf5980 20 realm 2024-05-09T09:47:30.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.231+0000 7f51addf5980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.231+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42370 con 0x5630cfe3f350 2024-05-09T09:47:30.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.231+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfe3f350 2024-05-09T09:47:30.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.231+0000 7f51addf5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:30.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.231+0000 7f51addf5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:30.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.231+0000 7f51addf5980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.231+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42c40 con 0x5630cfe3f350 2024-05-09T09:47:30.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.231+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfe3f350 2024-05-09T09:47:30.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.231+0000 7f51addf5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:30.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.231+0000 7f51addf5980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.231+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x5630cfe3f350 2024-05-09T09:47:30.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.231+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfe3f350 2024-05-09T09:47:30.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.231+0000 7f51addf5980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:30.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.231+0000 7f51addf5980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.231+0000 7f51addf5980 1 --2- 172.21.15.157:0/2601866175 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5630cfe43d40 0x5630cfe46130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.231+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe46740 con 0x5630cfe43d40 2024-05-09T09:47:30.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.231+0000 7f51ab910640 1 --2- 172.21.15.157:0/2601866175 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5630cfe43d40 0x5630cfe46130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.231+0000 7f51ab910640 1 --2- 172.21.15.157:0/2601866175 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5630cfe43d40 0x5630cfe46130 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.235+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f519c0f4070 con 0x5630cfe43d40 2024-05-09T09:47:30.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.235+0000 7f51addf5980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:30.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.235+0000 7f51addf5980 20 searching for the correct realm 2024-05-09T09:47:30.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.235+0000 7f51addf5980 1 --2- 172.21.15.157:0/2601866175 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5630cfe48690 0x5630cfe4aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.235+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe4b170 con 0x5630cfe48690 2024-05-09T09:47:30.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.235+0000 7f51ab10f640 1 --2- 172.21.15.157:0/2601866175 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5630cfe48690 0x5630cfe4aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.235+0000 7f51ab10f640 1 --2- 172.21.15.157:0/2601866175 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5630cfe48690 0x5630cfe4aaa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.235+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51a0037040 con 0x5630cfe48690 2024-05-09T09:47:30.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.235+0000 7f51ab10f640 1 --2- 172.21.15.157:0/2601866175 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f51a001fc60 0x7f51a003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.235+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe4b170 con 0x7f51a001fc60 2024-05-09T09:47:30.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.235+0000 7f51ac111640 1 --2- 172.21.15.157:0/2601866175 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f51a001fc60 0x7f51a003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.235+0000 7f51ac111640 1 --2- 172.21.15.157:0/2601866175 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f51a001fc60 0x7f51a003a3c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.235+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51a400a4d0 con 0x7f51a001fc60 2024-05-09T09:47:30.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.235+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x5630cfe43d40 2024-05-09T09:47:30.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.235+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f519c0f4070 con 0x5630cfe43d40 2024-05-09T09:47:30.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.235+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x5630cfe3f350 2024-05-09T09:47:30.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.235+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfe3f350 2024-05-09T09:47:30.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.235+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x5630cfe3f350 2024-05-09T09:47:30.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.235+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfe3f350 2024-05-09T09:47:30.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.235+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x5630cfe43d40 2024-05-09T09:47:30.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.239+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f519c0f4070 con 0x5630cfe43d40 2024-05-09T09:47:30.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.239+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x5630cfe43d40 2024-05-09T09:47:30.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.239+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f519c0f4070 con 0x5630cfe43d40 2024-05-09T09:47:30.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.239+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x7f51a001fc60 2024-05-09T09:47:30.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.239+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51a400a4d0 con 0x7f51a001fc60 2024-05-09T09:47:30.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.239+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x5630cfe48690 2024-05-09T09:47:30.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.239+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51a0037040 con 0x5630cfe48690 2024-05-09T09:47:30.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.239+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x5630cfe3f350 2024-05-09T09:47:30.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.239+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfe3f350 2024-05-09T09:47:30.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.239+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x5630cfe43d40 2024-05-09T09:47:30.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.239+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f519c0f4070 con 0x5630cfe43d40 2024-05-09T09:47:30.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.239+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x5630cfe3f350 2024-05-09T09:47:30.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.239+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfe3f350 2024-05-09T09:47:30.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.239+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x7f51a001fc60 2024-05-09T09:47:30.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.239+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f51a400a4d0 con 0x7f51a001fc60 2024-05-09T09:47:30.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.239+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x5630cfe48690 2024-05-09T09:47:30.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.239+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51a0037040 con 0x5630cfe48690 2024-05-09T09:47:30.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.239+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x5630cfe48690 2024-05-09T09:47:30.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.239+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f51a0037040 con 0x5630cfe48690 2024-05-09T09:47:30.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.239+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x5630cfe43d40 2024-05-09T09:47:30.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.243+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f519c0f4070 con 0x5630cfe43d40 2024-05-09T09:47:30.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.243+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x5630cfe48690 2024-05-09T09:47:30.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.243+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51a0037040 con 0x5630cfe48690 2024-05-09T09:47:30.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.243+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x5630cfe48690 2024-05-09T09:47:30.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.243+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51a0037040 con 0x5630cfe48690 2024-05-09T09:47:30.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.243+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x5630cfe3f350 2024-05-09T09:47:30.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.243+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfe3f350 2024-05-09T09:47:30.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.243+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x5630cfe3f350 2024-05-09T09:47:30.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.243+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfe3f350 2024-05-09T09:47:30.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.243+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x5630cfe43d40 2024-05-09T09:47:30.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.243+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f519c0f4070 con 0x5630cfe43d40 2024-05-09T09:47:30.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.243+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x5630cfe48690 2024-05-09T09:47:30.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.243+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51a0037040 con 0x5630cfe48690 2024-05-09T09:47:30.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.243+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x7f51a001fc60 2024-05-09T09:47:30.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.243+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51a400a4d0 con 0x7f51a001fc60 2024-05-09T09:47:30.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.243+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x5630cfe3f350 2024-05-09T09:47:30.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.243+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfe3f350 2024-05-09T09:47:30.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.243+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x5630cfe43d40 2024-05-09T09:47:30.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f519c0f4070 con 0x5630cfe43d40 2024-05-09T09:47:30.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x5630cfe48690 2024-05-09T09:47:30.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51a0037040 con 0x5630cfe48690 2024-05-09T09:47:30.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x5630cfe43d40 2024-05-09T09:47:30.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f519c0f4070 con 0x5630cfe43d40 2024-05-09T09:47:30.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x7f51a001fc60 2024-05-09T09:47:30.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51a400a4d0 con 0x7f51a001fc60 2024-05-09T09:47:30.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x5630cfe48690 2024-05-09T09:47:30.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51a004a040 con 0x5630cfe48690 2024-05-09T09:47:30.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x5630cfe43d40 2024-05-09T09:47:30.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f519c0f4070 con 0x5630cfe43d40 2024-05-09T09:47:30.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x5630cfe3f350 2024-05-09T09:47:30.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfe3f350 2024-05-09T09:47:30.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe42fe0 con 0x7f51a001fc60 2024-05-09T09:47:30.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51a400a4d0 con 0x7f51a001fc60 2024-05-09T09:47:30.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51addf5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:30.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51addf5980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:30.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51addf5980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:30.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51addf5980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:30.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51addf5980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:30.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51addf5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:30.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51addf5980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe47000 con 0x5630cfe3f350 2024-05-09T09:47:30.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfe3f350 2024-05-09T09:47:30.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51addf5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:30.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51addf5980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe47000 con 0x5630cfe3f350 2024-05-09T09:47:30.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfe3f350 2024-05-09T09:47:30.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51addf5980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:30.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51addf5980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.247+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe47000 con 0x5630cfe48690 2024-05-09T09:47:30.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.251+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f51a004a040 con 0x5630cfe48690 2024-05-09T09:47:30.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.251+0000 7f51addf5980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:30.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.251+0000 7f51addf5980 20 zone default found 2024-05-09T09:47:30.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.251+0000 7f51addf5980 4 Realm: () 2024-05-09T09:47:30.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.251+0000 7f51addf5980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:30.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.251+0000 7f51addf5980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:30.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.251+0000 7f51addf5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:30.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.251+0000 7f51addf5980 20 zonegroup default 2024-05-09T09:47:30.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.251+0000 7f51addf5980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.251+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe47a50 con 0x5630cfe43d40 2024-05-09T09:47:30.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.251+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f519c0f4070 con 0x5630cfe43d40 2024-05-09T09:47:30.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.251+0000 7f51addf5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:30.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.251+0000 7f51addf5980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.251+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe4d480 con 0x5630cfe48690 2024-05-09T09:47:30.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.251+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f51a004a040 con 0x5630cfe48690 2024-05-09T09:47:30.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.251+0000 7f51addf5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:30.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.251+0000 7f51addf5980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.251+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe4d820 con 0x5630cfe48690 2024-05-09T09:47:30.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.251+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f51a004a040 con 0x5630cfe48690 2024-05-09T09:47:30.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.251+0000 7f51addf5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:30.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.251+0000 7f51addf5980 20 started sync module instance, tier type = 2024-05-09T09:47:30.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.251+0000 7f51addf5980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:30.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.251+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe4c8c0 con 0x7f51a001fc60 2024-05-09T09:47:30.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.251+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x7f51a001fc60 2024-05-09T09:47:30.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.251+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94767646297312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe4c8c0 con 0x7f51a001fc60 2024-05-09T09:47:30.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.251+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe4e070 con 0x5630cfe3f350 2024-05-09T09:47:30.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.255+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94767646297312] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x7f51a001fc60 2024-05-09T09:47:30.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.255+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfe3f350 2024-05-09T09:47:30.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.255+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94767646301392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe4c8c0 con 0x5630cfe3f350 2024-05-09T09:47:30.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.255+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe4eab0 con 0x5630cfe48690 2024-05-09T09:47:30.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.255+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94767646301392] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfe3f350 2024-05-09T09:47:30.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.255+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51a004a040 con 0x5630cfe48690 2024-05-09T09:47:30.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.255+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94767646295056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe4c830 con 0x5630cfe48690 2024-05-09T09:47:30.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.259+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe4f7b0 con 0x7f51a001fc60 2024-05-09T09:47:30.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.259+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x7f51a001fc60 2024-05-09T09:47:30.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.259+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94767646307376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe50050 con 0x7f51a001fc60 2024-05-09T09:47:30.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.259+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe50a10 con 0x5630cfe3f350 2024-05-09T09:47:30.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.259+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94767646295056] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51a004a040 con 0x5630cfe48690 2024-05-09T09:47:30.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.259+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94767646307376] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x7f51a001fc60 2024-05-09T09:47:30.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.259+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfe3f350 2024-05-09T09:47:30.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.259+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94767646311776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe4ffc0 con 0x5630cfe3f350 2024-05-09T09:47:30.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.259+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe50980 con 0x5630cfe43d40 2024-05-09T09:47:30.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.263+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94767646311776] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfe3f350 2024-05-09T09:47:30.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.263+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f519c0f4070 con 0x5630cfe43d40 2024-05-09T09:47:30.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.263+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94767646309408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe512b0 con 0x5630cfe43d40 2024-05-09T09:47:30.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.263+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe51b00 con 0x5630cfe43d40 2024-05-09T09:47:30.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.263+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f519c0f4070 con 0x5630cfe43d40 2024-05-09T09:47:30.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.263+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94767646318240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe52770 con 0x5630cfe43d40 2024-05-09T09:47:30.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.263+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe53130 con 0x5630cfe43d40 2024-05-09T09:47:30.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.263+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94767646309408] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f519c0f4070 con 0x5630cfe43d40 2024-05-09T09:47:30.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.267+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94767646318240] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f519c0f4070 con 0x5630cfe43d40 2024-05-09T09:47:30.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.267+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f519c0f4070 con 0x5630cfe43d40 2024-05-09T09:47:30.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.267+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94767646319296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe526e0 con 0x5630cfe43d40 2024-05-09T09:47:30.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.267+0000 7f51addf5980 20 add_watcher() i=0 2024-05-09T09:47:30.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.267+0000 7f51addf5980 20 add_watcher() i=1 2024-05-09T09:47:30.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.267+0000 7f51addf5980 20 add_watcher() i=2 2024-05-09T09:47:30.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.267+0000 7f51addf5980 20 add_watcher() i=3 2024-05-09T09:47:30.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.267+0000 7f51addf5980 20 add_watcher() i=4 2024-05-09T09:47:30.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.267+0000 7f51addf5980 20 add_watcher() i=5 2024-05-09T09:47:30.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.267+0000 7f51addf5980 20 add_watcher() i=6 2024-05-09T09:47:30.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.267+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94767646319296] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f519c0f4070 con 0x5630cfe43d40 2024-05-09T09:47:30.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.267+0000 7f51addf5980 20 add_watcher() i=7 2024-05-09T09:47:30.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.267+0000 7f51addf5980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:30.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.267+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe56160 con 0x5630cfe3f350 2024-05-09T09:47:30.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.271+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfe3f350 2024-05-09T09:47:30.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.271+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94767646321792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe53620 con 0x5630cfe3f350 2024-05-09T09:47:30.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.271+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94767646321792] v30'29 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfe3f350 2024-05-09T09:47:30.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.271+0000 7f5060fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:30.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.271+0000 7f51addf5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:30.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.271+0000 7f51addf5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:30.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.271+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe5ea00 con 0x5630cfe3f350 2024-05-09T09:47:30.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.271+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfe3f350 2024-05-09T09:47:30.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.271+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe5f050 con 0x5630cfe43d40 2024-05-09T09:47:30.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.275+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'11 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f519c0f4070 con 0x5630cfe43d40 2024-05-09T09:47:30.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.275+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe5f050 con 0x5630cfe48690 2024-05-09T09:47:30.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.275+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f51a004a040 con 0x5630cfe48690 2024-05-09T09:47:30.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.275+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe5fb30 con 0x5630cfe3f350 2024-05-09T09:47:30.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.279+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'30 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfe3f350 2024-05-09T09:47:30.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.279+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe5c8f0 con 0x7f51a001fc60 2024-05-09T09:47:30.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.279+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x7f51a001fc60 2024-05-09T09:47:30.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.279+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe5c8f0 con 0x5630cfe48690 2024-05-09T09:47:30.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.279+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'15 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f51a004a040 con 0x5630cfe48690 2024-05-09T09:47:30.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.279+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe60860 con 0x5630cfe3f350 2024-05-09T09:47:30.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.283+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfe3f350 2024-05-09T09:47:30.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.283+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe608f0 con 0x5630cfe43d40 2024-05-09T09:47:30.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.283+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'15 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f519c0f4070 con 0x5630cfe43d40 2024-05-09T09:47:30.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.283+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe608f0 con 0x7f51a001fc60 2024-05-09T09:47:30.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.287+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x7f51a001fc60 2024-05-09T09:47:30.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.287+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe608f0 con 0x5630cfe48690 2024-05-09T09:47:30.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.287+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f51a004a040 con 0x5630cfe48690 2024-05-09T09:47:30.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.287+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe60ec0 con 0x7f51a001fc60 2024-05-09T09:47:30.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.287+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x7f51a001fc60 2024-05-09T09:47:30.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.287+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe60e30 con 0x5630cfe43d40 2024-05-09T09:47:30.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.291+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f519c0f4070 con 0x5630cfe43d40 2024-05-09T09:47:30.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.291+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe60e30 con 0x7f51a001fc60 2024-05-09T09:47:30.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.291+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x7f51a001fc60 2024-05-09T09:47:30.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.291+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe60e30 con 0x5630cfe43d40 2024-05-09T09:47:30.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.295+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'21 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f519c0f4070 con 0x5630cfe43d40 2024-05-09T09:47:30.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.295+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe60da0 con 0x5630cfe3f350 2024-05-09T09:47:30.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.295+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfe3f350 2024-05-09T09:47:30.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.295+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe60da0 con 0x5630cfe48690 2024-05-09T09:47:30.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.299+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51a004a040 con 0x5630cfe48690 2024-05-09T09:47:30.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.299+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe60da0 con 0x7f51a001fc60 2024-05-09T09:47:30.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.299+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x7f51a001fc60 2024-05-09T09:47:30.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.299+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe60da0 con 0x5630cfe48690 2024-05-09T09:47:30.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.299+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51a004a040 con 0x5630cfe48690 2024-05-09T09:47:30.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.299+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe61420 con 0x5630cfe3f350 2024-05-09T09:47:30.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.303+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfe3f350 2024-05-09T09:47:30.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.303+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe61420 con 0x5630cfe3f350 2024-05-09T09:47:30.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.303+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'32 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfe3f350 2024-05-09T09:47:30.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.303+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe61420 con 0x5630cfe48690 2024-05-09T09:47:30.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.307+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51a004a040 con 0x5630cfe48690 2024-05-09T09:47:30.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.307+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe61420 con 0x7f51a001fc60 2024-05-09T09:47:30.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.307+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x7f51a001fc60 2024-05-09T09:47:30.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.307+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe61420 con 0x5630cfe48690 2024-05-09T09:47:30.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.311+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51a004a040 con 0x5630cfe48690 2024-05-09T09:47:30.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.311+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe61420 con 0x5630cfe48690 2024-05-09T09:47:30.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.311+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51a004a040 con 0x5630cfe48690 2024-05-09T09:47:30.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.311+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe61420 con 0x5630cfe48690 2024-05-09T09:47:30.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.311+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51a004a040 con 0x5630cfe48690 2024-05-09T09:47:30.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.311+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe61420 con 0x5630cfe48690 2024-05-09T09:47:30.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.315+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'16 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51a004a040 con 0x5630cfe48690 2024-05-09T09:47:30.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.315+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe61420 con 0x5630cfe43d40 2024-05-09T09:47:30.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.315+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f519c0f4070 con 0x5630cfe43d40 2024-05-09T09:47:30.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.315+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe61420 con 0x5630cfe48690 2024-05-09T09:47:30.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.319+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51a004a040 con 0x5630cfe48690 2024-05-09T09:47:30.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.319+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe61420 con 0x5630cfe43d40 2024-05-09T09:47:30.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.319+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'16 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f519c0f4070 con 0x5630cfe43d40 2024-05-09T09:47:30.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.319+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe61420 con 0x5630cfe48690 2024-05-09T09:47:30.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.323+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'19 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51a004a040 con 0x5630cfe48690 2024-05-09T09:47:30.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.323+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe61420 con 0x5630cfe43d40 2024-05-09T09:47:30.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.323+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'22 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f519c0f4070 con 0x5630cfe43d40 2024-05-09T09:47:30.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.323+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe61420 con 0x7f51a001fc60 2024-05-09T09:47:30.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.327+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x7f51a001fc60 2024-05-09T09:47:30.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.327+0000 7f4fdb7fe640 20 reqs_thread_entry: start 2024-05-09T09:47:30.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.327+0000 7f51addf5980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:30.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.327+0000 7f4fd97fa640 20 reqs_thread_entry: start 2024-05-09T09:47:30.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.327+0000 7f51addf5980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-05-09T09:47:30.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.327+0000 7f51addf5980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.327+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe7cd60 con 0x7f51a001fc60 2024-05-09T09:47:30.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.327+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x7f51a001fc60 2024-05-09T09:47:30.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.327+0000 7f51addf5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:30.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.327+0000 7f51addf5980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-05-09T09:47:30.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.327+0000 7f51addf5980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-05-09T09:47:30.329 INFO:teuthology.orchestra.run.smithi157.stderr:could not remove user: unable to remove user, user does not exist 2024-05-09T09:47:30.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.331+0000 7f5060fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:30.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.331+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94767646321792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe7cd60 con 0x5630cfe3f350 2024-05-09T09:47:30.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.331+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94767646321792] v30'33 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfe3f350 2024-05-09T09:47:30.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.331+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94767646297312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe7cd60 con 0x7f51a001fc60 2024-05-09T09:47:30.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.331+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94767646297312] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x7f51a001fc60 2024-05-09T09:47:30.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.331+0000 7f51addf5980 20 remove_watcher() i=0 2024-05-09T09:47:30.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.331+0000 7f51addf5980 2 removed watcher, disabling cache 2024-05-09T09:47:30.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.331+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94767646301392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe7cd60 con 0x5630cfe3f350 2024-05-09T09:47:30.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.335+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94767646301392] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfe3f350 2024-05-09T09:47:30.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.335+0000 7f51addf5980 20 remove_watcher() i=1 2024-05-09T09:47:30.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.335+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94767646295056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe7cd60 con 0x5630cfe48690 2024-05-09T09:47:30.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.335+0000 7f51ab10f640 1 -- 172.21.15.157:0/2601866175 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94767646295056] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51a004a040 con 0x5630cfe48690 2024-05-09T09:47:30.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.335+0000 7f51addf5980 20 remove_watcher() i=2 2024-05-09T09:47:30.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.335+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94767646307376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe7cd60 con 0x7f51a001fc60 2024-05-09T09:47:30.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.339+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94767646307376] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x7f51a001fc60 2024-05-09T09:47:30.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.339+0000 7f51addf5980 20 remove_watcher() i=3 2024-05-09T09:47:30.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.339+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94767646311776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe7cd60 con 0x5630cfe3f350 2024-05-09T09:47:30.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.339+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94767646311776] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51a400a4d0 con 0x5630cfe3f350 2024-05-09T09:47:30.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.339+0000 7f51addf5980 20 remove_watcher() i=4 2024-05-09T09:47:30.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.339+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94767646309408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe7cd60 con 0x5630cfe43d40 2024-05-09T09:47:30.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.343+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94767646309408] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f519c0f4070 con 0x5630cfe43d40 2024-05-09T09:47:30.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.343+0000 7f51addf5980 20 remove_watcher() i=5 2024-05-09T09:47:30.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.343+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94767646318240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe7cd60 con 0x5630cfe43d40 2024-05-09T09:47:30.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.343+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94767646318240] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f519c0f4070 con 0x5630cfe43d40 2024-05-09T09:47:30.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 20 remove_watcher() i=6 2024-05-09T09:47:30.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94767646319296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5630cfe7cd60 con 0x5630cfe43d40 2024-05-09T09:47:30.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51ab910640 1 -- 172.21.15.157:0/2601866175 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94767646319296] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f519c0f4070 con 0x5630cfe43d40 2024-05-09T09:47:30.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 20 remove_watcher() i=7 2024-05-09T09:47:30.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5630cfe43d40 msgr2=0x5630cfe46130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 --2- 172.21.15.157:0/2601866175 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5630cfe43d40 0x5630cfe46130 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5630cfe3f350 msgr2=0x5630cfe41810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 --2- 172.21.15.157:0/2601866175 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5630cfe3f350 0x5630cfe41810 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f51a001fc60 msgr2=0x7f51a003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 --2- 172.21.15.157:0/2601866175 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f51a001fc60 0x7f51a003a3c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5630cfe48690 msgr2=0x5630cfe4aaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 --2- 172.21.15.157:0/2601866175 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5630cfe48690 0x5630cfe4aaa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5074034bb0 msgr2=0x7f5074037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 --2- 172.21.15.157:0/2601866175 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5074034bb0 0x7f5074037070 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x5630cfdf8b10 tx=0x7f51a0010000 comp rx=0 tx=0).stop 2024-05-09T09:47:30.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfe2b540 msgr2=0x5630cfe32900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 --2- 172.21.15.157:0/2601866175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfe2b540 0x5630cfe32900 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f519c0bbeb0 tx=0x7f519c0e4f60 comp rx=0 tx=0).stop 2024-05-09T09:47:30.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51ac111640 1 -- 172.21.15.157:0/2601866175 reap_dead start 2024-05-09T09:47:30.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 shutdown_connections 2024-05-09T09:47:30.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 >> 172.21.15.157:0/2601866175 conn(0x5630cfe27950 msgr2=0x5630cfe25980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:30.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 shutdown_connections 2024-05-09T09:47:30.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 -- 172.21.15.157:0/2601866175 wait complete. 2024-05-09T09:47:30.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 -- 172.21.15.157:0/1610321214 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5084034c00 msgr2=0x7f50840370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 --2- 172.21.15.157:0/1610321214 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5084034c00 0x7f50840370c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x5630cfdf02b0 tx=0x7f51a000f000 comp rx=0 tx=0).stop 2024-05-09T09:47:30.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 -- 172.21.15.157:0/1610321214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfe1e600 msgr2=0x5630cfe1ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 --2- 172.21.15.157:0/1610321214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfe1e600 0x5630cfe1ea20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f519c0cb040 tx=0x7f519c0bcc80 comp rx=0 tx=0).stop 2024-05-09T09:47:30.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 -- 172.21.15.157:0/1610321214 shutdown_connections 2024-05-09T09:47:30.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 --2- 172.21.15.157:0/1610321214 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5084034c00 0x7f50840370c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 --2- 172.21.15.157:0/1610321214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfe1e600 0x5630cfe1ea20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 -- 172.21.15.157:0/1610321214 >> 172.21.15.157:0/1610321214 conn(0x5630cfe133d0 msgr2=0x5630cfe13ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:30.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 -- 172.21.15.157:0/1610321214 shutdown_connections 2024-05-09T09:47:30.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 -- 172.21.15.157:0/1610321214 wait complete. 2024-05-09T09:47:30.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 -- 172.21.15.157:0/1381755064 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5630cfdf1d00 msgr2=0x5630cfdf40f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 --2- 172.21.15.157:0/1381755064 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5630cfdf1d00 0x5630cfdf40f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 -- 172.21.15.157:0/1381755064 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5630cfc6a380 msgr2=0x5630cfdef360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 --2- 172.21.15.157:0/1381755064 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5630cfc6a380 0x5630cfdef360 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 -- 172.21.15.157:0/1381755064 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5630cfdf5c20 msgr2=0x5630cfdf8010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 --2- 172.21.15.157:0/1381755064 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5630cfdf5c20 0x5630cfdf8010 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 -- 172.21.15.157:0/1381755064 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5094034bb0 msgr2=0x7f5094037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 --2- 172.21.15.157:0/1381755064 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5094034bb0 0x7f5094037070 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f51a0001e50 tx=0x7f51a00013b0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 -- 172.21.15.157:0/1381755064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfc68ec0 msgr2=0x5630cfde83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 --2- 172.21.15.157:0/1381755064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630cfc68ec0 0x5630cfde83e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f519c01b170 tx=0x7f519c0180e0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51ac111640 1 -- 172.21.15.157:0/1381755064 reap_dead start 2024-05-09T09:47:30.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 -- 172.21.15.157:0/1381755064 shutdown_connections 2024-05-09T09:47:30.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.347+0000 7f51addf5980 1 -- 172.21.15.157:0/1381755064 >> 172.21.15.157:0/1381755064 conn(0x5630cfcef250 msgr2=0x5630cfddb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:30.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.351+0000 7f51addf5980 1 -- 172.21.15.157:0/1381755064 shutdown_connections 2024-05-09T09:47:30.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.351+0000 7f51addf5980 1 -- 172.21.15.157:0/1381755064 wait complete. 2024-05-09T09:47:30.362 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-09T09:47:30.363 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-05-09T09:47:30.363 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-05-09T09:47:30.363 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-05-09T09:47:30.436 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:30.436 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:30.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.439+0000 7f9cd6d39980 1 Processor -- start 2024-05-09T09:47:30.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.439+0000 7f9cd6d39980 1 -- start start 2024-05-09T09:47:30.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.439+0000 7f9cd6d39980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5577c763a380 0x5577c7638980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.439+0000 7f9cd6d39980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5577c7579440 con 0x5577c7638ec0 2024-05-09T09:47:30.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.439+0000 7f9cd6d39980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5577c75645f0 con 0x5577c763a380 2024-05-09T09:47:30.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.439+0000 7f9cd4854640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5577c763a380 0x5577c7638980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.439+0000 7f9cd4053640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x5577c7638ec0 0x5577c76cb980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:33510/0 (socket says 172.21.15.157:33510) 2024-05-09T09:47:30.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.439+0000 7f9cd4854640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5577c763a380 0x5577c7638980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53510/0 (socket says 172.21.15.157:53510) 2024-05-09T09:47:30.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.439+0000 7f9cd4053640 1 -- 172.21.15.157:0/2264035778 learned_addr learned my addr 172.21.15.157:0/2264035778 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:47:30.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.439+0000 7f9cd4854640 1 -- 172.21.15.157:0/2264035778 >> v1:172.21.15.110:6789/0 conn(0x5577c7638ec0 legacy=0x5577c76cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.439+0000 7f9cd4854640 1 -- 172.21.15.157:0/2264035778 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577c756f990 con 0x5577c763a380 2024-05-09T09:47:30.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.439+0000 7f9cd3852640 1 -- 172.21.15.157:0/2264035778 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1911676349 0 0) 0x5577c7579440 con 0x5577c7638ec0 2024-05-09T09:47:30.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.443+0000 7f9cd4854640 1 --2- 172.21.15.157:0/2264035778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c763a380 0x5577c7638980 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400a420 tx=0x7f9cc401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ecb7198420a89d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.443+0000 7f9cd3852640 1 -- 172.21.15.157:0/2264035778 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cc40af070 con 0x5577c763a380 2024-05-09T09:47:30.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.443+0000 7f9cd3852640 1 -- 172.21.15.157:0/2264035778 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc40aa530 con 0x5577c763a380 2024-05-09T09:47:30.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.443+0000 7f9cd3852640 1 -- 172.21.15.157:0/2264035778 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cc40aa810 con 0x5577c763a380 2024-05-09T09:47:30.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.443+0000 7f9cd6d39980 1 -- 172.21.15.157:0/2264035778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c763a380 msgr2=0x5577c7638980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.443+0000 7f9cd6d39980 1 --2- 172.21.15.157:0/2264035778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c763a380 0x5577c7638980 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400a420 tx=0x7f9cc401afd0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.443+0000 7f9cd6d39980 1 -- 172.21.15.157:0/2264035778 shutdown_connections 2024-05-09T09:47:30.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.443+0000 7f9cd6d39980 1 --2- 172.21.15.157:0/2264035778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c763a380 0x5577c7638980 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.443+0000 7f9cd6d39980 1 -- 172.21.15.157:0/2264035778 >> 172.21.15.157:0/2264035778 conn(0x5577c76bf250 msgr2=0x5577c76c1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:30.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.443+0000 7f9cd6d39980 1 -- 172.21.15.157:0/2264035778 shutdown_connections 2024-05-09T09:47:30.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.443+0000 7f9cd6d39980 1 -- 172.21.15.157:0/2264035778 wait complete. 2024-05-09T09:47:30.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.459+0000 7f9cd6d39980 1 Processor -- start 2024-05-09T09:47:30.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.459+0000 7f9cd6d39980 1 -- start start 2024-05-09T09:47:30.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.459+0000 7f9cd6d39980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c7638ec0 0x5577c77b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.459+0000 7f9cd6d39980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5577c75c6fe0 con 0x5577c7638ec0 2024-05-09T09:47:30.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.459+0000 7f9cd4854640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c7638ec0 0x5577c77b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.459+0000 7f9cd4854640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c7638ec0 0x5577c77b11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53520/0 (socket says 172.21.15.157:53520) 2024-05-09T09:47:30.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.459+0000 7f9cd4854640 1 -- 172.21.15.157:0/2593162675 learned_addr learned my addr 172.21.15.157:0/2593162675 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:30.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.459+0000 7f9cd4854640 1 -- 172.21.15.157:0/2593162675 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577c754bae0 con 0x5577c7638ec0 2024-05-09T09:47:30.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.459+0000 7f9cd4854640 1 --2- 172.21.15.157:0/2593162675 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c7638ec0 0x5577c77b11a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4018c00 tx=0x7f9cc40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d56607cb657eceb5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.463+0000 7f9bc2e0d640 1 -- 172.21.15.157:0/2593162675 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cc40af050 con 0x5577c7638ec0 2024-05-09T09:47:30.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.463+0000 7f9bc2e0d640 1 -- 172.21.15.157:0/2593162675 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc40b0040 con 0x5577c7638ec0 2024-05-09T09:47:30.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.463+0000 7f9bc2e0d640 1 -- 172.21.15.157:0/2593162675 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cc40aabb0 con 0x5577c7638ec0 2024-05-09T09:47:30.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.463+0000 7f9cd6d39980 1 -- 172.21.15.157:0/2593162675 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c7638ec0 msgr2=0x5577c77b11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.463+0000 7f9cd6d39980 1 --2- 172.21.15.157:0/2593162675 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c7638ec0 0x5577c77b11a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4018c00 tx=0x7f9cc40033b0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.463+0000 7f9cd6d39980 1 -- 172.21.15.157:0/2593162675 shutdown_connections 2024-05-09T09:47:30.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.463+0000 7f9cd6d39980 1 --2- 172.21.15.157:0/2593162675 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c7638ec0 0x5577c77b11a0 secure :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4018c00 tx=0x7f9cc40033b0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.463+0000 7f9cd6d39980 1 -- 172.21.15.157:0/2593162675 >> 172.21.15.157:0/2593162675 conn(0x5577c76bf250 msgr2=0x5577c77acd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:30.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.463+0000 7f9cd6d39980 1 -- 172.21.15.157:0/2593162675 shutdown_connections 2024-05-09T09:47:30.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.463+0000 7f9cd6d39980 1 -- 172.21.15.157:0/2593162675 wait complete. 2024-05-09T09:47:30.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.463+0000 7f9cd6d39980 1 Processor -- start 2024-05-09T09:47:30.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.463+0000 7f9cd6d39980 1 -- start start 2024-05-09T09:47:30.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.463+0000 7f9cd6d39980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c763a380 0x5577c77b84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.463+0000 7f9cd6d39980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5577c76cfb60 con 0x5577c763a380 2024-05-09T09:47:30.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.463+0000 7f9cd4854640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c763a380 0x5577c77b84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.463+0000 7f9cd4854640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c763a380 0x5577c77b84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53526/0 (socket says 172.21.15.157:53526) 2024-05-09T09:47:30.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.463+0000 7f9cd4854640 1 -- 172.21.15.157:0/506485516 learned_addr learned my addr 172.21.15.157:0/506485516 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:30.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.463+0000 7f9cd4854640 1 -- 172.21.15.157:0/506485516 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577c77b8a00 con 0x5577c763a380 2024-05-09T09:47:30.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.463+0000 7f9cd4854640 1 --2- 172.21.15.157:0/506485516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c763a380 0x5577c77b84c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4000f90 tx=0x7f9cc4019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.463+0000 7f9bc160a640 1 -- 172.21.15.157:0/506485516 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cc40c1480 con 0x5577c763a380 2024-05-09T09:47:30.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.463+0000 7f9bc160a640 1 -- 172.21.15.157:0/506485516 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc40c1620 con 0x5577c763a380 2024-05-09T09:47:30.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.463+0000 7f9cd6d39980 1 -- 172.21.15.157:0/506485516 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5577c77b8c90 con 0x5577c763a380 2024-05-09T09:47:30.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.463+0000 7f9bc160a640 1 -- 172.21.15.157:0/506485516 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cc40c1920 con 0x5577c763a380 2024-05-09T09:47:30.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.463+0000 7f9cd6d39980 1 -- 172.21.15.157:0/506485516 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577c77bb8d0 con 0x5577c763a380 2024-05-09T09:47:30.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.467+0000 7f9bc160a640 1 -- 172.21.15.157:0/506485516 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f9cc40c1ac0 con 0x5577c763a380 2024-05-09T09:47:30.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.467+0000 7f9bc160a640 1 --2- 172.21.15.157:0/506485516 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9bbc034c00 0x7f9bbc0370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.467+0000 7f9bc160a640 1 -- 172.21.15.157:0/506485516 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f9cc40bb070 con 0x5577c763a380 2024-05-09T09:47:30.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.467+0000 7f9cd4053640 1 --2- 172.21.15.157:0/506485516 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9bbc034c00 0x7f9bbc0370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.467+0000 7f9cd6d39980 1 --2- 172.21.15.157:0/506485516 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5577c77bd510 0x5577c77bf900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.467+0000 7f9cd6d39980 1 -- 172.21.15.157:0/506485516 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c77bfe40 con 0x5577c77bd510 2024-05-09T09:47:30.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.467+0000 7f9cd5055640 1 --2- 172.21.15.157:0/506485516 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5577c77bd510 0x5577c77bf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.467+0000 7f9cd4053640 1 --2- 172.21.15.157:0/506485516 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9bbc034c00 0x7f9bbc0370c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc000c10 tx=0x7f9cbc0013c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.467+0000 7f9cd5055640 1 --2- 172.21.15.157:0/506485516 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5577c77bd510 0x5577c77bf900 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.467+0000 7f9cd5055640 1 -- 172.21.15.157:0/506485516 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ccc0083f0 con 0x5577c77bd510 2024-05-09T09:47:30.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.467+0000 7f9cd6d39980 1 -- 172.21.15.157:0/506485516 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c77bcab0 con 0x5577c77bd510 2024-05-09T09:47:30.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.467+0000 7f9cd5055640 1 -- 172.21.15.157:0/506485516 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9ccc0083f0 con 0x5577c77bd510 2024-05-09T09:47:30.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.467+0000 7f9cd6d39980 1 --2- 172.21.15.157:0/506485516 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5577c77c2160 0x5577c77c4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.467+0000 7f9cd6d39980 1 -- 172.21.15.157:0/506485516 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c77c4bf0 con 0x5577c77c2160 2024-05-09T09:47:30.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.467+0000 7f9cd4854640 1 --2- 172.21.15.157:0/506485516 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5577c77c2160 0x5577c77c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.467+0000 7f9cd4854640 1 --2- 172.21.15.157:0/506485516 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5577c77c2160 0x5577c77c4550 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.471+0000 7f9cd4854640 1 -- 172.21.15.157:0/506485516 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9cc40d0070 con 0x5577c77c2160 2024-05-09T09:47:30.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.471+0000 7f9cd6d39980 1 -- 172.21.15.157:0/506485516 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c77c0fd0 con 0x5577c77bd510 2024-05-09T09:47:30.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.471+0000 7f9cd5055640 1 -- 172.21.15.157:0/506485516 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9ccc0083f0 con 0x5577c77bd510 2024-05-09T09:47:30.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.471+0000 7f9cd6d39980 1 --2- 172.21.15.157:0/506485516 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5577c77c6030 0x5577c77c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.471+0000 7f9cd6d39980 1 -- 172.21.15.157:0/506485516 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c77c8b90 con 0x5577c77c6030 2024-05-09T09:47:30.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.471+0000 7f9cd4053640 1 --2- 172.21.15.157:0/506485516 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5577c77c6030 0x5577c77c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.471+0000 7f9cd4053640 1 --2- 172.21.15.157:0/506485516 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5577c77c6030 0x5577c77c8420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.471+0000 7f9cd4053640 1 -- 172.21.15.157:0/506485516 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9cbc00f680 con 0x5577c77c6030 2024-05-09T09:47:30.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.475+0000 7f9cd6d39980 1 Processor -- start 2024-05-09T09:47:30.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.475+0000 7f9cd6d39980 1 -- start start 2024-05-09T09:47:30.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.475+0000 7f9cd6d39980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c77eec10 0x5577c77ef030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.475+0000 7f9cd6d39980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5577c75cb020 con 0x5577c77eec10 2024-05-09T09:47:30.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.475+0000 7f9cd4854640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c77eec10 0x5577c77ef030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.475+0000 7f9cd4854640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c77eec10 0x5577c77ef030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53532/0 (socket says 172.21.15.157:53532) 2024-05-09T09:47:30.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.475+0000 7f9cd4854640 1 -- 172.21.15.157:0/1988190077 learned_addr learned my addr 172.21.15.157:0/1988190077 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:30.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.475+0000 7f9cd4854640 1 -- 172.21.15.157:0/1988190077 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577c77ef570 con 0x5577c77eec10 2024-05-09T09:47:30.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.475+0000 7f9cd4854640 1 --2- 172.21.15.157:0/1988190077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c77eec10 0x5577c77ef030 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9cc401ae00 tx=0x7f9cc40a9ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.475+0000 7f9bb939f640 1 -- 172.21.15.157:0/1988190077 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cc40a95b0 con 0x5577c77eec10 2024-05-09T09:47:30.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.475+0000 7f9cd6d39980 1 -- 172.21.15.157:0/1988190077 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5577c77ef570 con 0x5577c77eec10 2024-05-09T09:47:30.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.475+0000 7f9bb939f640 1 -- 172.21.15.157:0/1988190077 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc40a9750 con 0x5577c77eec10 2024-05-09T09:47:30.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.475+0000 7f9bb939f640 1 -- 172.21.15.157:0/1988190077 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cc40a9a50 con 0x5577c77eec10 2024-05-09T09:47:30.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.475+0000 7f9cd6d39980 1 -- 172.21.15.157:0/1988190077 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577c77f01f0 con 0x5577c77eec10 2024-05-09T09:47:30.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.479+0000 7f9bb939f640 1 -- 172.21.15.157:0/1988190077 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f9cc40e53e0 con 0x5577c77eec10 2024-05-09T09:47:30.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.479+0000 7f9bb939f640 1 --2- 172.21.15.157:0/1988190077 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9bac034bb0 0x7f9bac037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.479+0000 7f9bb939f640 1 -- 172.21.15.157:0/1988190077 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f9cc40e0070 con 0x5577c77eec10 2024-05-09T09:47:30.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.479+0000 7f9cd4053640 1 --2- 172.21.15.157:0/1988190077 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9bac034bb0 0x7f9bac037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.479+0000 7f9cd6d39980 1 Processor -- start 2024-05-09T09:47:30.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.479+0000 7f9cd6d39980 1 -- start start 2024-05-09T09:47:30.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.479+0000 7f9cd4053640 1 --2- 172.21.15.157:0/1988190077 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9bac034bb0 0x7f9bac037070 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x5577c77c0310 tx=0x7f9cbc006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.479+0000 7f9cd6d39980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c77fb860 0x5577c77fbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.479+0000 7f9cd6d39980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5577c77b1830 con 0x5577c77fb860 2024-05-09T09:47:30.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.479+0000 7f9cd4854640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c77fb860 0x5577c77fbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.479+0000 7f9cd4854640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c77fb860 0x5577c77fbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53548/0 (socket says 172.21.15.157:53548) 2024-05-09T09:47:30.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.479+0000 7f9cd4854640 1 -- 172.21.15.157:0/869504063 learned_addr learned my addr 172.21.15.157:0/869504063 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:30.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.479+0000 7f9cd4854640 1 -- 172.21.15.157:0/869504063 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577c77fc210 con 0x5577c77fb860 2024-05-09T09:47:30.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.479+0000 7f9cd4854640 1 --2- 172.21.15.157:0/869504063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c77fb860 0x5577c77fbc40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40a9fe0 tx=0x7f9cc40e5aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8b31a884a96a6a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.479+0000 7f9bb2ffd640 1 -- 172.21.15.157:0/869504063 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cc40fe070 con 0x5577c77fb860 2024-05-09T09:47:30.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.479+0000 7f9bb2ffd640 1 -- 172.21.15.157:0/869504063 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc40d3450 con 0x5577c77fb860 2024-05-09T09:47:30.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.479+0000 7f9bb2ffd640 1 -- 172.21.15.157:0/869504063 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cc40f0e30 con 0x5577c77fb860 2024-05-09T09:47:30.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.479+0000 7f9cd6d39980 1 -- 172.21.15.157:0/869504063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c77fb860 msgr2=0x5577c77fbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.479+0000 7f9cd6d39980 1 --2- 172.21.15.157:0/869504063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c77fb860 0x5577c77fbc40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40a9fe0 tx=0x7f9cc40e5aa0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.479+0000 7f9cd6d39980 1 -- 172.21.15.157:0/869504063 shutdown_connections 2024-05-09T09:47:30.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.479+0000 7f9cd6d39980 1 --2- 172.21.15.157:0/869504063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c77fb860 0x5577c77fbc40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.479+0000 7f9cd6d39980 1 -- 172.21.15.157:0/869504063 >> 172.21.15.157:0/869504063 conn(0x5577c77f7be0 msgr2=0x5577c77f5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:30.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.479+0000 7f9cd6d39980 1 -- 172.21.15.157:0/869504063 shutdown_connections 2024-05-09T09:47:30.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.479+0000 7f9cd6d39980 1 -- 172.21.15.157:0/869504063 wait complete. 2024-05-09T09:47:30.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.483+0000 7f9cd6d39980 1 Processor -- start 2024-05-09T09:47:30.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.483+0000 7f9cd6d39980 1 -- start start 2024-05-09T09:47:30.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.483+0000 7f9cd6d39980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c77fb860 0x5577c7802c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.483+0000 7f9cd6d39980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5577c77fc920 con 0x5577c77fb860 2024-05-09T09:47:30.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.483+0000 7f9cd4854640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c77fb860 0x5577c7802c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.483+0000 7f9cd4854640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c77fb860 0x5577c7802c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53554/0 (socket says 172.21.15.157:53554) 2024-05-09T09:47:30.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.483+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 learned_addr learned my addr 172.21.15.157:0/251153040 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:30.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.483+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577c7803160 con 0x5577c77fb860 2024-05-09T09:47:30.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.483+0000 7f9cd4854640 1 --2- 172.21.15.157:0/251153040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c77fb860 0x5577c7802c20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40f0db0 tx=0x7f9cc40f3000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.483+0000 7f9bb17fa640 1 -- 172.21.15.157:0/251153040 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cc4113070 con 0x5577c77fb860 2024-05-09T09:47:30.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.483+0000 7f9bb17fa640 1 -- 172.21.15.157:0/251153040 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc40f0e30 con 0x5577c77fb860 2024-05-09T09:47:30.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.483+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5577c7803160 con 0x5577c77fb860 2024-05-09T09:47:30.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.483+0000 7f9bb17fa640 1 -- 172.21.15.157:0/251153040 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cc40a4160 con 0x5577c77fb860 2024-05-09T09:47:30.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.483+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577c7803640 con 0x5577c77fb860 2024-05-09T09:47:30.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.483+0000 7f9bb17fa640 1 -- 172.21.15.157:0/251153040 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f9cc4116070 con 0x5577c77fb860 2024-05-09T09:47:30.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.483+0000 7f9cd6d39980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.483+0000 7f9bb17fa640 1 --2- 172.21.15.157:0/251153040 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b9c034bb0 0x7f9b9c037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.483+0000 7f9bb17fa640 1 -- 172.21.15.157:0/251153040 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f9cc4109030 con 0x5577c77fb860 2024-05-09T09:47:30.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.483+0000 7f9cd4053640 1 --2- 172.21.15.157:0/251153040 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b9c034bb0 0x7f9b9c037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd6d39980 1 --2- 172.21.15.157:0/251153040 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5577c780f820 0x5577c7811ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c7812430 con 0x5577c780f820 2024-05-09T09:47:30.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd5055640 1 --2- 172.21.15.157:0/251153040 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5577c780f820 0x5577c7811ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd4053640 1 --2- 172.21.15.157:0/251153040 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b9c034bb0 0x7f9b9c037070 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc00ffd0 tx=0x7f9cbc023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd5055640 1 --2- 172.21.15.157:0/251153040 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5577c780f820 0x5577c7811ce0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ccc0083f0 con 0x5577c780f820 2024-05-09T09:47:30.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd6d39980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:30.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd6d39980 20 realm 2024-05-09T09:47:30.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd6d39980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c7812840 con 0x5577c780f820 2024-05-09T09:47:30.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ccc0083f0 con 0x5577c780f820 2024-05-09T09:47:30.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd6d39980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:30.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd6d39980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:30.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd6d39980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c78130e0 con 0x5577c780f820 2024-05-09T09:47:30.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ccc0083f0 con 0x5577c780f820 2024-05-09T09:47:30.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd6d39980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:30.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd6d39980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x5577c780f820 2024-05-09T09:47:30.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9ccc0083f0 con 0x5577c780f820 2024-05-09T09:47:30.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd6d39980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:30.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd6d39980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd6d39980 1 --2- 172.21.15.157:0/251153040 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5577c78141e0 0x5577c78165d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c7816c70 con 0x5577c78141e0 2024-05-09T09:47:30.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd4854640 1 --2- 172.21.15.157:0/251153040 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5577c78141e0 0x5577c78165d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd4854640 1 --2- 172.21.15.157:0/251153040 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5577c78141e0 0x5577c78165d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9cc4115030 con 0x5577c78141e0 2024-05-09T09:47:30.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd6d39980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:30.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd6d39980 20 searching for the correct realm 2024-05-09T09:47:30.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd6d39980 1 --2- 172.21.15.157:0/251153040 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5577c7818b50 0x5577c781afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c781b640 con 0x5577c7818b50 2024-05-09T09:47:30.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.487+0000 7f9cd4053640 1 --2- 172.21.15.157:0/251153040 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5577c7818b50 0x5577c781afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.491+0000 7f9cd4053640 1 --2- 172.21.15.157:0/251153040 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5577c7818b50 0x5577c781afc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.491+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cbc037040 con 0x5577c7818b50 2024-05-09T09:47:30.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.491+0000 7f9cd4053640 1 --2- 172.21.15.157:0/251153040 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f9cbc01f940 0x7f9cbc03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.491+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c781b640 con 0x7f9cbc01f940 2024-05-09T09:47:30.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.491+0000 7f9cd5055640 1 --2- 172.21.15.157:0/251153040 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f9cbc01f940 0x7f9cbc03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.491+0000 7f9cd5055640 1 --2- 172.21.15.157:0/251153040 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f9cbc01f940 0x7f9cbc03a3c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.491+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ccc0083f0 con 0x7f9cbc01f940 2024-05-09T09:47:30.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.491+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x5577c78141e0 2024-05-09T09:47:30.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.491+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc4115030 con 0x5577c78141e0 2024-05-09T09:47:30.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.491+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x5577c780f820 2024-05-09T09:47:30.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.491+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ccc0083f0 con 0x5577c780f820 2024-05-09T09:47:30.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.491+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x5577c780f820 2024-05-09T09:47:30.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.491+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ccc026040 con 0x5577c780f820 2024-05-09T09:47:30.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.491+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x5577c78141e0 2024-05-09T09:47:30.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.491+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc4115030 con 0x5577c78141e0 2024-05-09T09:47:30.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.491+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x5577c78141e0 2024-05-09T09:47:30.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.495+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc4115030 con 0x5577c78141e0 2024-05-09T09:47:30.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.495+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x7f9cbc01f940 2024-05-09T09:47:30.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.495+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ccc026040 con 0x7f9cbc01f940 2024-05-09T09:47:30.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.495+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x5577c7818b50 2024-05-09T09:47:30.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.495+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cbc037040 con 0x5577c7818b50 2024-05-09T09:47:30.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.495+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x5577c780f820 2024-05-09T09:47:30.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.495+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ccc026040 con 0x5577c780f820 2024-05-09T09:47:30.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.495+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x5577c78141e0 2024-05-09T09:47:30.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.495+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc4115030 con 0x5577c78141e0 2024-05-09T09:47:30.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.495+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x5577c780f820 2024-05-09T09:47:30.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.495+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ccc026040 con 0x5577c780f820 2024-05-09T09:47:30.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.495+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x7f9cbc01f940 2024-05-09T09:47:30.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.495+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9ccc026040 con 0x7f9cbc01f940 2024-05-09T09:47:30.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.495+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x5577c7818b50 2024-05-09T09:47:30.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.495+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cbc037040 con 0x5577c7818b50 2024-05-09T09:47:30.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.495+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x5577c7818b50 2024-05-09T09:47:30.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.495+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9cbc037040 con 0x5577c7818b50 2024-05-09T09:47:30.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.495+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x5577c78141e0 2024-05-09T09:47:30.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.495+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc4115030 con 0x5577c78141e0 2024-05-09T09:47:30.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.495+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x5577c7818b50 2024-05-09T09:47:30.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.499+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cbc037040 con 0x5577c7818b50 2024-05-09T09:47:30.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.499+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x5577c7818b50 2024-05-09T09:47:30.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.499+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cbc037040 con 0x5577c7818b50 2024-05-09T09:47:30.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.499+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x5577c780f820 2024-05-09T09:47:30.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.499+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ccc026040 con 0x5577c780f820 2024-05-09T09:47:30.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.499+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x5577c780f820 2024-05-09T09:47:30.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.499+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9ccc026040 con 0x5577c780f820 2024-05-09T09:47:30.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.499+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x5577c78141e0 2024-05-09T09:47:30.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.499+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc4115030 con 0x5577c78141e0 2024-05-09T09:47:30.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.499+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x5577c7818b50 2024-05-09T09:47:30.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.499+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cbc037040 con 0x5577c7818b50 2024-05-09T09:47:30.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.499+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x7f9cbc01f940 2024-05-09T09:47:30.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.499+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ccc026040 con 0x7f9cbc01f940 2024-05-09T09:47:30.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.499+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x5577c780f820 2024-05-09T09:47:30.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.499+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ccc026040 con 0x5577c780f820 2024-05-09T09:47:30.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.499+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x5577c78141e0 2024-05-09T09:47:30.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.499+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9cc4115030 con 0x5577c78141e0 2024-05-09T09:47:30.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.499+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x5577c7818b50 2024-05-09T09:47:30.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.499+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cbc037040 con 0x5577c7818b50 2024-05-09T09:47:30.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.499+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x5577c78141e0 2024-05-09T09:47:30.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc4115030 con 0x5577c78141e0 2024-05-09T09:47:30.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x7f9cbc01f940 2024-05-09T09:47:30.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ccc026040 con 0x7f9cbc01f940 2024-05-09T09:47:30.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x5577c7818b50 2024-05-09T09:47:30.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cbc04a040 con 0x5577c7818b50 2024-05-09T09:47:30.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x5577c78141e0 2024-05-09T09:47:30.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cc4115030 con 0x5577c78141e0 2024-05-09T09:47:30.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x5577c780f820 2024-05-09T09:47:30.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9ccc026040 con 0x5577c780f820 2024-05-09T09:47:30.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5577c7813480 con 0x7f9cbc01f940 2024-05-09T09:47:30.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ccc026040 con 0x7f9cbc01f940 2024-05-09T09:47:30.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd6d39980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:30.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd6d39980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:30.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd6d39980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:30.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd6d39980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:30.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd6d39980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:30.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd6d39980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:30.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd6d39980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c78174c0 con 0x5577c780f820 2024-05-09T09:47:30.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ccc026040 con 0x5577c780f820 2024-05-09T09:47:30.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd6d39980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:30.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd6d39980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c78174c0 con 0x5577c780f820 2024-05-09T09:47:30.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9ccc026040 con 0x5577c780f820 2024-05-09T09:47:30.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd6d39980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:30.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd6d39980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c78174c0 con 0x5577c7818b50 2024-05-09T09:47:30.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9cbc04a040 con 0x5577c7818b50 2024-05-09T09:47:30.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd6d39980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:30.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd6d39980 20 zone default found 2024-05-09T09:47:30.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd6d39980 4 Realm: () 2024-05-09T09:47:30.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd6d39980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:30.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd6d39980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:30.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd6d39980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:30.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd6d39980 20 zonegroup default 2024-05-09T09:47:30.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd6d39980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.503+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c7817e40 con 0x5577c78141e0 2024-05-09T09:47:30.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.507+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9cc4115030 con 0x5577c78141e0 2024-05-09T09:47:30.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.507+0000 7f9cd6d39980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:30.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.507+0000 7f9cd6d39980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.507+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c781d500 con 0x5577c7818b50 2024-05-09T09:47:30.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.507+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9cbc04a040 con 0x5577c7818b50 2024-05-09T09:47:30.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.507+0000 7f9cd6d39980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:30.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.507+0000 7f9cd6d39980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.507+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c781da20 con 0x5577c7818b50 2024-05-09T09:47:30.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.507+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9cbc04a040 con 0x5577c7818b50 2024-05-09T09:47:30.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.507+0000 7f9cd6d39980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:30.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.507+0000 7f9cd6d39980 20 started sync module instance, tier type = 2024-05-09T09:47:30.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.507+0000 7f9cd6d39980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:30.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.507+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c781c940 con 0x7f9cbc01f940 2024-05-09T09:47:30.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.507+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ccc026040 con 0x7f9cbc01f940 2024-05-09T09:47:30.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.507+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93972936642112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c781c940 con 0x7f9cbc01f940 2024-05-09T09:47:30.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.507+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c781e4e0 con 0x5577c780f820 2024-05-09T09:47:30.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.507+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93972936642112] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ccc036040 con 0x7f9cbc01f940 2024-05-09T09:47:30.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.511+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ccc036040 con 0x5577c780f820 2024-05-09T09:47:30.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.511+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93972936646640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c781c940 con 0x5577c780f820 2024-05-09T09:47:30.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.511+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c781ef20 con 0x5577c7818b50 2024-05-09T09:47:30.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.511+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93972936646640] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ccc036040 con 0x5577c780f820 2024-05-09T09:47:30.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.511+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cbc04a040 con 0x5577c7818b50 2024-05-09T09:47:30.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.511+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93972936639632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c781c8b0 con 0x5577c7818b50 2024-05-09T09:47:30.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.511+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c781fc60 con 0x7f9cbc01f940 2024-05-09T09:47:30.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.515+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ccc036040 con 0x7f9cbc01f940 2024-05-09T09:47:30.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.515+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93972936652656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7820500 con 0x7f9cbc01f940 2024-05-09T09:47:30.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.515+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7820f00 con 0x5577c780f820 2024-05-09T09:47:30.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.515+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93972936639632] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cbc04a040 con 0x5577c7818b50 2024-05-09T09:47:30.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.515+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93972936652656] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ccc036040 con 0x7f9cbc01f940 2024-05-09T09:47:30.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.515+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ccc036040 con 0x5577c780f820 2024-05-09T09:47:30.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.515+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93972936651456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c781ffd0 con 0x5577c780f820 2024-05-09T09:47:30.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.515+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c78217a0 con 0x5577c78141e0 2024-05-09T09:47:30.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.519+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93972936651456] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ccc036040 con 0x5577c780f820 2024-05-09T09:47:30.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.519+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc4115030 con 0x5577c78141e0 2024-05-09T09:47:30.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.519+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93972936659696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c781ffd0 con 0x5577c78141e0 2024-05-09T09:47:30.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.519+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7821ff0 con 0x5577c78141e0 2024-05-09T09:47:30.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.519+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93972936659696] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc4115030 con 0x5577c78141e0 2024-05-09T09:47:30.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.519+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc4115030 con 0x5577c78141e0 2024-05-09T09:47:30.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.519+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93972936657424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7821ff0 con 0x5577c78141e0 2024-05-09T09:47:30.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.519+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c78229b0 con 0x5577c78141e0 2024-05-09T09:47:30.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.523+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93972936657424] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc4115030 con 0x5577c78141e0 2024-05-09T09:47:30.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.523+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc4115030 con 0x5577c78141e0 2024-05-09T09:47:30.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.523+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93972936661824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7822b90 con 0x5577c78141e0 2024-05-09T09:47:30.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.523+0000 7f9cd6d39980 20 add_watcher() i=0 2024-05-09T09:47:30.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.523+0000 7f9cd6d39980 20 add_watcher() i=1 2024-05-09T09:47:30.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.523+0000 7f9cd6d39980 20 add_watcher() i=2 2024-05-09T09:47:30.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.523+0000 7f9cd6d39980 20 add_watcher() i=3 2024-05-09T09:47:30.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.523+0000 7f9cd6d39980 20 add_watcher() i=4 2024-05-09T09:47:30.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.523+0000 7f9cd6d39980 20 add_watcher() i=5 2024-05-09T09:47:30.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.523+0000 7f9cd6d39980 20 add_watcher() i=6 2024-05-09T09:47:30.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.523+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93972936661824] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc4115030 con 0x5577c78141e0 2024-05-09T09:47:30.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.523+0000 7f9cd6d39980 20 add_watcher() i=7 2024-05-09T09:47:30.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.523+0000 7f9cd6d39980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:30.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.523+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c7825d70 con 0x5577c780f820 2024-05-09T09:47:30.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.523+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9ccc036040 con 0x5577c780f820 2024-05-09T09:47:30.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.523+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93972936677152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7822b30 con 0x5577c780f820 2024-05-09T09:47:30.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.527+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93972936677152] v30'34 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9ccc036040 con 0x5577c780f820 2024-05-09T09:47:30.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.527+0000 7f9b8a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:30.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.527+0000 7f9cd6d39980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:30.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.527+0000 7f9cd6d39980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:30.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.527+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7825030 con 0x5577c780f820 2024-05-09T09:47:30.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.527+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ccc036040 con 0x5577c780f820 2024-05-09T09:47:30.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.527+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c782ee80 con 0x5577c78141e0 2024-05-09T09:47:30.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.531+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'12 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9cc4115030 con 0x5577c78141e0 2024-05-09T09:47:30.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.531+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c782f2a0 con 0x5577c7818b50 2024-05-09T09:47:30.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.531+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9cbc04a040 con 0x5577c7818b50 2024-05-09T09:47:30.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.531+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c782faf0 con 0x5577c780f820 2024-05-09T09:47:30.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.531+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'35 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ccc036040 con 0x5577c780f820 2024-05-09T09:47:30.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.531+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c782e4a0 con 0x7f9cbc01f940 2024-05-09T09:47:30.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.535+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ccc036040 con 0x7f9cbc01f940 2024-05-09T09:47:30.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.535+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c782e4a0 con 0x5577c7818b50 2024-05-09T09:47:30.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.535+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'17 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9cbc04a040 con 0x5577c7818b50 2024-05-09T09:47:30.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.535+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7830820 con 0x5577c780f820 2024-05-09T09:47:30.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.539+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ccc036040 con 0x5577c780f820 2024-05-09T09:47:30.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.539+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7830820 con 0x5577c78141e0 2024-05-09T09:47:30.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.539+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'17 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9cc4115030 con 0x5577c78141e0 2024-05-09T09:47:30.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.539+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7830820 con 0x7f9cbc01f940 2024-05-09T09:47:30.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.543+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ccc036040 con 0x7f9cbc01f940 2024-05-09T09:47:30.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.543+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7830820 con 0x5577c7818b50 2024-05-09T09:47:30.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.543+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9cbc04a040 con 0x5577c7818b50 2024-05-09T09:47:30.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.543+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7830e90 con 0x7f9cbc01f940 2024-05-09T09:47:30.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.543+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ccc036040 con 0x7f9cbc01f940 2024-05-09T09:47:30.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.543+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7830e70 con 0x5577c78141e0 2024-05-09T09:47:30.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.547+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9cc4115030 con 0x5577c78141e0 2024-05-09T09:47:30.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.547+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7830e70 con 0x7f9cbc01f940 2024-05-09T09:47:30.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.547+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ccc036040 con 0x7f9cbc01f940 2024-05-09T09:47:30.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.547+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7830e70 con 0x5577c78141e0 2024-05-09T09:47:30.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.551+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'23 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9cc4115030 con 0x5577c78141e0 2024-05-09T09:47:30.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.551+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7830e70 con 0x5577c780f820 2024-05-09T09:47:30.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.551+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'36 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ccc036040 con 0x5577c780f820 2024-05-09T09:47:30.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.551+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7830e70 con 0x5577c7818b50 2024-05-09T09:47:30.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.555+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9cbc04a040 con 0x5577c7818b50 2024-05-09T09:47:30.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.555+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7830e70 con 0x7f9cbc01f940 2024-05-09T09:47:30.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.555+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ccc036040 con 0x7f9cbc01f940 2024-05-09T09:47:30.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.555+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7830e70 con 0x5577c7818b50 2024-05-09T09:47:30.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.555+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9cbc04a040 con 0x5577c7818b50 2024-05-09T09:47:30.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.555+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7830e70 con 0x5577c780f820 2024-05-09T09:47:30.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.559+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ccc036040 con 0x5577c780f820 2024-05-09T09:47:30.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.559+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7830f00 con 0x5577c780f820 2024-05-09T09:47:30.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.559+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'37 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ccc036040 con 0x5577c780f820 2024-05-09T09:47:30.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.559+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7830f00 con 0x5577c7818b50 2024-05-09T09:47:30.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.563+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9cbc04a040 con 0x5577c7818b50 2024-05-09T09:47:30.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.563+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7830f90 con 0x7f9cbc01f940 2024-05-09T09:47:30.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.563+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ccc036040 con 0x7f9cbc01f940 2024-05-09T09:47:30.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.563+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7830f90 con 0x5577c7818b50 2024-05-09T09:47:30.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.563+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9cbc04a040 con 0x5577c7818b50 2024-05-09T09:47:30.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.563+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7830f90 con 0x5577c7818b50 2024-05-09T09:47:30.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.567+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9cbc04a040 con 0x5577c7818b50 2024-05-09T09:47:30.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.567+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7830f90 con 0x5577c7818b50 2024-05-09T09:47:30.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.567+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9cbc04a040 con 0x5577c7818b50 2024-05-09T09:47:30.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.567+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7830f90 con 0x5577c7818b50 2024-05-09T09:47:30.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.567+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'18 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9cbc04a040 con 0x5577c7818b50 2024-05-09T09:47:30.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.567+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7830f90 con 0x5577c78141e0 2024-05-09T09:47:30.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.571+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9cc4115030 con 0x5577c78141e0 2024-05-09T09:47:30.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.571+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7830f90 con 0x5577c7818b50 2024-05-09T09:47:30.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.571+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9cbc04a040 con 0x5577c7818b50 2024-05-09T09:47:30.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.571+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7830f90 con 0x5577c78141e0 2024-05-09T09:47:30.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.575+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'18 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9cc4115030 con 0x5577c78141e0 2024-05-09T09:47:30.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.575+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7830f90 con 0x5577c7818b50 2024-05-09T09:47:30.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.575+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9cbc04a040 con 0x5577c7818b50 2024-05-09T09:47:30.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.575+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7830f90 con 0x5577c78141e0 2024-05-09T09:47:30.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.579+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'24 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9cc4115030 con 0x5577c78141e0 2024-05-09T09:47:30.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.579+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7830f90 con 0x7f9cbc01f940 2024-05-09T09:47:30.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.579+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ccc036040 con 0x7f9cbc01f940 2024-05-09T09:47:30.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.579+0000 7f9b897e2640 20 reqs_thread_entry: start 2024-05-09T09:47:30.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.579+0000 7f9cd6d39980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:30.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.579+0000 7f9b827fc640 20 reqs_thread_entry: start 2024-05-09T09:47:30.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.579+0000 7f9cd6d39980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-05-09T09:47:30.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.579+0000 7f9cd6d39980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.579+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5577c784cb20 con 0x5577c78141e0 2024-05-09T09:47:30.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.579+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f9cc4115030 con 0x5577c78141e0 2024-05-09T09:47:30.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.579+0000 7f9cd6d39980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:30.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.579+0000 7f9cd6d39980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-05-09T09:47:30.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.579+0000 7f9cd6d39980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-05-09T09:47:30.584 INFO:teuthology.orchestra.run.smithi157.stderr:could not remove user: unable to remove user, user does not exist 2024-05-09T09:47:30.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.583+0000 7f9b8a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:30.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.583+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93972936677152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c782c170 con 0x5577c780f820 2024-05-09T09:47:30.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.583+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93972936677152] v30'38 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9ccc036040 con 0x5577c780f820 2024-05-09T09:47:30.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.583+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93972936642112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c7825720 con 0x7f9cbc01f940 2024-05-09T09:47:30.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.583+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93972936642112] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ccc036040 con 0x7f9cbc01f940 2024-05-09T09:47:30.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.583+0000 7f9cd6d39980 20 remove_watcher() i=0 2024-05-09T09:47:30.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.583+0000 7f9cd6d39980 2 removed watcher, disabling cache 2024-05-09T09:47:30.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.583+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93972936646640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c781ce40 con 0x5577c780f820 2024-05-09T09:47:30.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.587+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93972936646640] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ccc036040 con 0x5577c780f820 2024-05-09T09:47:30.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.587+0000 7f9cd6d39980 20 remove_watcher() i=1 2024-05-09T09:47:30.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.587+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93972936639632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c781ce40 con 0x5577c7818b50 2024-05-09T09:47:30.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.587+0000 7f9cd4053640 1 -- 172.21.15.157:0/251153040 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93972936639632] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cbc04a040 con 0x5577c7818b50 2024-05-09T09:47:30.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.587+0000 7f9cd6d39980 20 remove_watcher() i=2 2024-05-09T09:47:30.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.587+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93972936652656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c781c490 con 0x7f9cbc01f940 2024-05-09T09:47:30.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.591+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93972936652656] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ccc036040 con 0x7f9cbc01f940 2024-05-09T09:47:30.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.591+0000 7f9cd6d39980 20 remove_watcher() i=3 2024-05-09T09:47:30.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.591+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93972936651456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c781ce40 con 0x5577c780f820 2024-05-09T09:47:30.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.591+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93972936651456] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ccc036040 con 0x5577c780f820 2024-05-09T09:47:30.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.591+0000 7f9cd6d39980 20 remove_watcher() i=4 2024-05-09T09:47:30.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.591+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93972936659696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c781c490 con 0x5577c78141e0 2024-05-09T09:47:30.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.595+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93972936659696] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc4115030 con 0x5577c78141e0 2024-05-09T09:47:30.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.595+0000 7f9cd6d39980 20 remove_watcher() i=5 2024-05-09T09:47:30.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.595+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93972936657424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c781f2c0 con 0x5577c78141e0 2024-05-09T09:47:30.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.595+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93972936657424] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc4115030 con 0x5577c78141e0 2024-05-09T09:47:30.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.595+0000 7f9cd6d39980 20 remove_watcher() i=6 2024-05-09T09:47:30.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.595+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93972936661824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5577c781ce40 con 0x5577c78141e0 2024-05-09T09:47:30.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd4854640 1 -- 172.21.15.157:0/251153040 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93972936661824] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cc4115030 con 0x5577c78141e0 2024-05-09T09:47:30.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 20 remove_watcher() i=7 2024-05-09T09:47:30.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5577c78141e0 msgr2=0x5577c78165d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 --2- 172.21.15.157:0/251153040 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5577c78141e0 0x5577c78165d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5577c780f820 msgr2=0x5577c7811ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 --2- 172.21.15.157:0/251153040 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5577c780f820 0x5577c7811ce0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f9cbc01f940 msgr2=0x7f9cbc03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 --2- 172.21.15.157:0/251153040 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f9cbc01f940 0x7f9cbc03a3c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5577c7818b50 msgr2=0x5577c781afc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 --2- 172.21.15.157:0/251153040 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5577c7818b50 0x5577c781afc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b9c034bb0 msgr2=0x7f9b9c037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 --2- 172.21.15.157:0/251153040 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b9c034bb0 0x7f9b9c037070 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc00ffd0 tx=0x7f9cbc023040 comp rx=0 tx=0).stop 2024-05-09T09:47:30.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c77fb860 msgr2=0x5577c7802c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 --2- 172.21.15.157:0/251153040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c77fb860 0x5577c7802c20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40f0db0 tx=0x7f9cc40f3000 comp rx=0 tx=0).stop 2024-05-09T09:47:30.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd5055640 1 -- 172.21.15.157:0/251153040 reap_dead start 2024-05-09T09:47:30.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 shutdown_connections 2024-05-09T09:47:30.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 --2- 172.21.15.157:0/251153040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c77fb860 0x5577c7802c20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 >> 172.21.15.157:0/251153040 conn(0x5577c77f7be0 msgr2=0x5577c77f5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:30.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 shutdown_connections 2024-05-09T09:47:30.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 -- 172.21.15.157:0/251153040 wait complete. 2024-05-09T09:47:30.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 -- 172.21.15.157:0/1988190077 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9bac034bb0 msgr2=0x7f9bac037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 --2- 172.21.15.157:0/1988190077 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9bac034bb0 0x7f9bac037070 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x5577c77c0310 tx=0x7f9cbc006000 comp rx=0 tx=0).stop 2024-05-09T09:47:30.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 -- 172.21.15.157:0/1988190077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c77eec10 msgr2=0x5577c77ef030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 --2- 172.21.15.157:0/1988190077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c77eec10 0x5577c77ef030 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9cc401ae00 tx=0x7f9cc40a9ca0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 -- 172.21.15.157:0/1988190077 shutdown_connections 2024-05-09T09:47:30.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 --2- 172.21.15.157:0/1988190077 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9bac034bb0 0x7f9bac037070 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 --2- 172.21.15.157:0/1988190077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c77eec10 0x5577c77ef030 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 -- 172.21.15.157:0/1988190077 >> 172.21.15.157:0/1988190077 conn(0x5577c77e39e0 msgr2=0x5577c77e44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:30.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 -- 172.21.15.157:0/1988190077 shutdown_connections 2024-05-09T09:47:30.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 -- 172.21.15.157:0/1988190077 wait complete. 2024-05-09T09:47:30.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 -- 172.21.15.157:0/506485516 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5577c77c2160 msgr2=0x5577c77c4550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 --2- 172.21.15.157:0/506485516 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5577c77c2160 0x5577c77c4550 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 -- 172.21.15.157:0/506485516 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5577c77bd510 msgr2=0x5577c77bf900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 --2- 172.21.15.157:0/506485516 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5577c77bd510 0x5577c77bf900 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 -- 172.21.15.157:0/506485516 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5577c77c6030 msgr2=0x5577c77c8420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 --2- 172.21.15.157:0/506485516 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5577c77c6030 0x5577c77c8420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 -- 172.21.15.157:0/506485516 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9bbc034c00 msgr2=0x7f9bbc0370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 --2- 172.21.15.157:0/506485516 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9bbc034c00 0x7f9bbc0370c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc000c10 tx=0x7f9cbc0013c0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 -- 172.21.15.157:0/506485516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c763a380 msgr2=0x5577c77b84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 --2- 172.21.15.157:0/506485516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5577c763a380 0x5577c77b84c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4000f90 tx=0x7f9cc4019810 comp rx=0 tx=0).stop 2024-05-09T09:47:30.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd5055640 1 -- 172.21.15.157:0/506485516 reap_dead start 2024-05-09T09:47:30.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 -- 172.21.15.157:0/506485516 shutdown_connections 2024-05-09T09:47:30.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 -- 172.21.15.157:0/506485516 >> 172.21.15.157:0/506485516 conn(0x5577c76bf250 msgr2=0x5577c77ab840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:30.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 -- 172.21.15.157:0/506485516 shutdown_connections 2024-05-09T09:47:30.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.599+0000 7f9cd6d39980 1 -- 172.21.15.157:0/506485516 wait complete. 2024-05-09T09:47:30.611 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-09T09:47:30.611 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-05-09T09:47:30.611 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-05-09T09:47:30.612 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-05-09T09:47:30.685 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:30.685 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:30.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.687+0000 7f6a6b968980 1 Processor -- start 2024-05-09T09:47:30.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.687+0000 7f6a6b968980 1 -- start start 2024-05-09T09:47:30.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.687+0000 7f6a6b968980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x561973a5d110 0x561973a5f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.687+0000 7f6a6b968980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56197390c440 con 0x5619739caa70 2024-05-09T09:47:30.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.687+0000 7f6a6b968980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5619738f75f0 con 0x561973a5d110 2024-05-09T09:47:30.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.687+0000 7f6a68c82640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x561973a5d110 0x561973a5f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.687+0000 7f6a68c82640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x561973a5d110 0x561973a5f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53568/0 (socket says 172.21.15.157:53568) 2024-05-09T09:47:30.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.687+0000 7f6a68c82640 1 -- 172.21.15.157:0/1178836740 learned_addr learned my addr 172.21.15.157:0/1178836740 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:30.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.687+0000 7f6a69483640 1 --1- 172.21.15.157:0/1178836740 >> v1:172.21.15.110:6789/0 conn(0x5619739caa70 0x561973a5b9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:33524/0 (socket says 172.21.15.157:33524) 2024-05-09T09:47:30.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.687+0000 7f6a68c82640 1 -- 172.21.15.157:0/1178836740 >> v1:172.21.15.110:6789/0 conn(0x5619739caa70 legacy=0x561973a5b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.687+0000 7f6a68c82640 1 -- 172.21.15.157:0/1178836740 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561973902990 con 0x561973a5d110 2024-05-09T09:47:30.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.691+0000 7f6a68c82640 1 --2- 172.21.15.157:0/1178836740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561973a5d110 0x561973a5f500 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6a6000a5c0 tx=0x7f6a6001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7455b549fc8d04f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.691+0000 7f6a5bfff640 1 -- 172.21.15.157:0/1178836740 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a600a6070 con 0x561973a5d110 2024-05-09T09:47:30.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.691+0000 7f6a5bfff640 1 -- 172.21.15.157:0/1178836740 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a600af070 con 0x561973a5d110 2024-05-09T09:47:30.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.691+0000 7f6a5bfff640 1 -- 172.21.15.157:0/1178836740 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a600aa5c0 con 0x561973a5d110 2024-05-09T09:47:30.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.691+0000 7f6a6b968980 1 -- 172.21.15.157:0/1178836740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561973a5d110 msgr2=0x561973a5f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.691+0000 7f6a6b968980 1 --2- 172.21.15.157:0/1178836740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561973a5d110 0x561973a5f500 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6a6000a5c0 tx=0x7f6a6001b340 comp rx=0 tx=0).stop 2024-05-09T09:47:30.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.691+0000 7f6a6b968980 1 -- 172.21.15.157:0/1178836740 shutdown_connections 2024-05-09T09:47:30.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.691+0000 7f6a6b968980 1 --2- 172.21.15.157:0/1178836740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561973a5d110 0x561973a5f500 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.691+0000 7f6a6b968980 1 -- 172.21.15.157:0/1178836740 >> 172.21.15.157:0/1178836740 conn(0x561973a510d0 msgr2=0x561973a534f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:30.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.691+0000 7f6a6b968980 1 -- 172.21.15.157:0/1178836740 shutdown_connections 2024-05-09T09:47:30.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.691+0000 7f6a6b968980 1 -- 172.21.15.157:0/1178836740 wait complete. 2024-05-09T09:47:30.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.707+0000 7f6a6b968980 1 Processor -- start 2024-05-09T09:47:30.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.707+0000 7f6a6b968980 1 -- start start 2024-05-09T09:47:30.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.707+0000 7f6a6b968980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619739caa70 0x561973b43d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.707+0000 7f6a6b968980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561973959fe0 con 0x5619739caa70 2024-05-09T09:47:30.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.707+0000 7f6a69483640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619739caa70 0x561973b43d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.707+0000 7f6a69483640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619739caa70 0x561973b43d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53572/0 (socket says 172.21.15.157:53572) 2024-05-09T09:47:30.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.707+0000 7f6a69483640 1 -- 172.21.15.157:0/4267989091 learned_addr learned my addr 172.21.15.157:0/4267989091 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:30.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.707+0000 7f6a69483640 1 -- 172.21.15.157:0/4267989091 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619738deae0 con 0x5619739caa70 2024-05-09T09:47:30.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.711+0000 7f6a69483640 1 --2- 172.21.15.157:0/4267989091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619739caa70 0x561973b43d30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c001e50 tx=0x7f6a5c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c46894584a9ec4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.711+0000 7f6957606640 1 -- 172.21.15.157:0/4267989091 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a5c00e5d0 con 0x5619739caa70 2024-05-09T09:47:30.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.711+0000 7f6957606640 1 -- 172.21.15.157:0/4267989091 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a5c00e770 con 0x5619739caa70 2024-05-09T09:47:30.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.711+0000 7f6957606640 1 -- 172.21.15.157:0/4267989091 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a5c00eab0 con 0x5619739caa70 2024-05-09T09:47:30.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.711+0000 7f6a6b968980 1 -- 172.21.15.157:0/4267989091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619739caa70 msgr2=0x561973b43d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.711+0000 7f6a6b968980 1 --2- 172.21.15.157:0/4267989091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619739caa70 0x561973b43d30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c001e50 tx=0x7f6a5c001e80 comp rx=0 tx=0).stop 2024-05-09T09:47:30.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.711+0000 7f6a6b968980 1 -- 172.21.15.157:0/4267989091 shutdown_connections 2024-05-09T09:47:30.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.711+0000 7f6a6b968980 1 --2- 172.21.15.157:0/4267989091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619739caa70 0x561973b43d30 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.711+0000 7f6a6b968980 1 -- 172.21.15.157:0/4267989091 >> 172.21.15.157:0/4267989091 conn(0x561973a510d0 msgr2=0x561973b3f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:30.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.711+0000 7f6a6b968980 1 -- 172.21.15.157:0/4267989091 shutdown_connections 2024-05-09T09:47:30.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.711+0000 7f6a6b968980 1 -- 172.21.15.157:0/4267989091 wait complete. 2024-05-09T09:47:30.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.711+0000 7f6a6b968980 1 Processor -- start 2024-05-09T09:47:30.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.711+0000 7f6a6b968980 1 -- start start 2024-05-09T09:47:30.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.711+0000 7f6a6b968980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619739caa70 0x561973b4af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.711+0000 7f6a6b968980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561973a624a0 con 0x5619739caa70 2024-05-09T09:47:30.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.711+0000 7f6a69483640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619739caa70 0x561973b4af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.711+0000 7f6a69483640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619739caa70 0x561973b4af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53584/0 (socket says 172.21.15.157:53584) 2024-05-09T09:47:30.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.711+0000 7f6a69483640 1 -- 172.21.15.157:0/2544981611 learned_addr learned my addr 172.21.15.157:0/2544981611 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:30.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.711+0000 7f6a69483640 1 -- 172.21.15.157:0/2544981611 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561973b4b460 con 0x5619739caa70 2024-05-09T09:47:30.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.711+0000 7f6a69483640 1 --2- 172.21.15.157:0/2544981611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619739caa70 0x561973b4af20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x561973b44bc0 tx=0x7f6a5c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.715+0000 7f6955e03640 1 -- 172.21.15.157:0/2544981611 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a5c001260 con 0x5619739caa70 2024-05-09T09:47:30.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.715+0000 7f6a6b968980 1 -- 172.21.15.157:0/2544981611 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561973b4b6f0 con 0x5619739caa70 2024-05-09T09:47:30.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.715+0000 7f6955e03640 1 -- 172.21.15.157:0/2544981611 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a5c00fa40 con 0x5619739caa70 2024-05-09T09:47:30.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.715+0000 7f6955e03640 1 -- 172.21.15.157:0/2544981611 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a5c00fd80 con 0x5619739caa70 2024-05-09T09:47:30.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.715+0000 7f6a6b968980 1 -- 172.21.15.157:0/2544981611 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561973b4e3d0 con 0x5619739caa70 2024-05-09T09:47:30.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.715+0000 7f6955e03640 1 -- 172.21.15.157:0/2544981611 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f6a5c017070 con 0x5619739caa70 2024-05-09T09:47:30.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.715+0000 7f6955e03640 1 --2- 172.21.15.157:0/2544981611 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6950034bb0 0x7f6950037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.715+0000 7f6955e03640 1 -- 172.21.15.157:0/2544981611 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f6a5c015020 con 0x5619739caa70 2024-05-09T09:47:30.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.715+0000 7f6a68c82640 1 --2- 172.21.15.157:0/2544981611 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6950034bb0 0x7f6950037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.715+0000 7f6a6b968980 1 --2- 172.21.15.157:0/2544981611 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561973a5d110 0x561973b51f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.715+0000 7f6a6b968980 1 -- 172.21.15.157:0/2544981611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561973b52580 con 0x561973a5d110 2024-05-09T09:47:30.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.715+0000 7f6a69c84640 1 --2- 172.21.15.157:0/2544981611 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561973a5d110 0x561973b51f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.715+0000 7f6a68c82640 1 --2- 172.21.15.157:0/2544981611 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6950034bb0 0x7f6950037070 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6a600ae000 tx=0x7f6a600a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.715+0000 7f6a69c84640 1 --2- 172.21.15.157:0/2544981611 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561973a5d110 0x561973b51f10 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.715+0000 7f6a69c84640 1 -- 172.21.15.157:0/2544981611 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973a5d110 2024-05-09T09:47:30.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.715+0000 7f6a6b968980 1 -- 172.21.15.157:0/2544981611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561973b4f5f0 con 0x561973a5d110 2024-05-09T09:47:30.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.719+0000 7f6a69c84640 1 -- 172.21.15.157:0/2544981611 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973a5d110 2024-05-09T09:47:30.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.719+0000 7f6a6b968980 1 --2- 172.21.15.157:0/2544981611 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561973b548b0 0x561973b56ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.719+0000 7f6a6b968980 1 -- 172.21.15.157:0/2544981611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561973b57390 con 0x561973b548b0 2024-05-09T09:47:30.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.719+0000 7f6a69483640 1 --2- 172.21.15.157:0/2544981611 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561973b548b0 0x561973b56ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.719+0000 7f6a69483640 1 --2- 172.21.15.157:0/2544981611 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561973b548b0 0x561973b56ca0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.719+0000 7f6a69483640 1 -- 172.21.15.157:0/2544981611 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6a5c02e070 con 0x561973b548b0 2024-05-09T09:47:30.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.719+0000 7f6a6b968980 1 -- 172.21.15.157:0/2544981611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561973b53750 con 0x561973a5d110 2024-05-09T09:47:30.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.723+0000 7f6a69c84640 1 -- 172.21.15.157:0/2544981611 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973a5d110 2024-05-09T09:47:30.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.723+0000 7f6a6b968980 1 --2- 172.21.15.157:0/2544981611 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561973b587f0 0x561973b5abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.723+0000 7f6a6b968980 1 -- 172.21.15.157:0/2544981611 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561973b5b320 con 0x561973b587f0 2024-05-09T09:47:30.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.723+0000 7f6a68c82640 1 --2- 172.21.15.157:0/2544981611 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561973b587f0 0x561973b5abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.723+0000 7f6a68c82640 1 --2- 172.21.15.157:0/2544981611 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561973b587f0 0x561973b5abe0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.723+0000 7f6a68c82640 1 -- 172.21.15.157:0/2544981611 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6a600aaa60 con 0x561973b587f0 2024-05-09T09:47:30.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.727+0000 7f6a6b968980 1 Processor -- start 2024-05-09T09:47:30.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.727+0000 7f6a6b968980 1 -- start start 2024-05-09T09:47:30.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.727+0000 7f6a6b968980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561973b811a0 0x561973b815c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.727+0000 7f6a6b968980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56197395e020 con 0x561973b811a0 2024-05-09T09:47:30.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.727+0000 7f6a69483640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561973b811a0 0x561973b815c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.727+0000 7f6a69483640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561973b811a0 0x561973b815c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53598/0 (socket says 172.21.15.157:53598) 2024-05-09T09:47:30.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.727+0000 7f6a69483640 1 -- 172.21.15.157:0/4017625078 learned_addr learned my addr 172.21.15.157:0/4017625078 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:30.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.727+0000 7f6a69483640 1 -- 172.21.15.157:0/4017625078 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561973b81b00 con 0x561973b811a0 2024-05-09T09:47:30.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.727+0000 7f6a69483640 1 --2- 172.21.15.157:0/4017625078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561973b811a0 0x561973b815c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c049540 tx=0x7f6a5c01b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.731+0000 7f694dba0640 1 -- 172.21.15.157:0/4017625078 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a5c01a880 con 0x561973b811a0 2024-05-09T09:47:30.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.731+0000 7f694dba0640 1 -- 172.21.15.157:0/4017625078 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a5c042ba0 con 0x561973b811a0 2024-05-09T09:47:30.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.731+0000 7f6a6b968980 1 -- 172.21.15.157:0/4017625078 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561973b82590 con 0x561973b811a0 2024-05-09T09:47:30.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.731+0000 7f694dba0640 1 -- 172.21.15.157:0/4017625078 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a5c042ec0 con 0x561973b811a0 2024-05-09T09:47:30.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.731+0000 7f6a6b968980 1 -- 172.21.15.157:0/4017625078 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561973b82590 con 0x561973b811a0 2024-05-09T09:47:30.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.731+0000 7f694dba0640 1 -- 172.21.15.157:0/4017625078 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f6a5c019860 con 0x561973b811a0 2024-05-09T09:47:30.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.731+0000 7f694dba0640 1 --2- 172.21.15.157:0/4017625078 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6940034bb0 0x7f6940037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.731+0000 7f694dba0640 1 -- 172.21.15.157:0/4017625078 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f6a5c04fc90 con 0x561973b811a0 2024-05-09T09:47:30.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.731+0000 7f6a68c82640 1 --2- 172.21.15.157:0/4017625078 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6940034bb0 0x7f6940037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.731+0000 7f6a6b968980 1 Processor -- start 2024-05-09T09:47:30.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.731+0000 7f6a6b968980 1 -- start start 2024-05-09T09:47:30.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.731+0000 7f6a68c82640 1 --2- 172.21.15.157:0/4017625078 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6940034bb0 0x7f6940037070 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x561973b52a30 tx=0x7f6a60005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.731+0000 7f6a6b968980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561973b8df60 0x561973b8e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.731+0000 7f6a6b968980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561973b44480 con 0x561973b8df60 2024-05-09T09:47:30.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.731+0000 7f6a69483640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561973b8df60 0x561973b8e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.731+0000 7f6a69483640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561973b8df60 0x561973b8e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53612/0 (socket says 172.21.15.157:53612) 2024-05-09T09:47:30.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.731+0000 7f6a69483640 1 -- 172.21.15.157:0/497782946 learned_addr learned my addr 172.21.15.157:0/497782946 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:30.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.731+0000 7f6a69483640 1 -- 172.21.15.157:0/497782946 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561973b8e950 con 0x561973b8df60 2024-05-09T09:47:30.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.731+0000 7f6a69483640 1 --2- 172.21.15.157:0/497782946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561973b8df60 0x561973b8e380 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c005f60 tx=0x7f6a5c042ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318b43c015ed8b9e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.731+0000 7f69477fe640 1 -- 172.21.15.157:0/497782946 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a5c05f030 con 0x561973b8df60 2024-05-09T09:47:30.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.731+0000 7f69477fe640 1 -- 172.21.15.157:0/497782946 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a5c023240 con 0x561973b8df60 2024-05-09T09:47:30.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.731+0000 7f69477fe640 1 -- 172.21.15.157:0/497782946 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a5c0421c0 con 0x561973b8df60 2024-05-09T09:47:30.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.735+0000 7f6a6b968980 1 -- 172.21.15.157:0/497782946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561973b8df60 msgr2=0x561973b8e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.735+0000 7f6a6b968980 1 --2- 172.21.15.157:0/497782946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561973b8df60 0x561973b8e380 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c005f60 tx=0x7f6a5c042ab0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.735+0000 7f6a6b968980 1 -- 172.21.15.157:0/497782946 shutdown_connections 2024-05-09T09:47:30.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.735+0000 7f6a6b968980 1 --2- 172.21.15.157:0/497782946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561973b8df60 0x561973b8e380 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.735+0000 7f6a6b968980 1 -- 172.21.15.157:0/497782946 >> 172.21.15.157:0/497782946 conn(0x561973b8a330 msgr2=0x561973b88390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:30.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.735+0000 7f6a6b968980 1 -- 172.21.15.157:0/497782946 shutdown_connections 2024-05-09T09:47:30.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.735+0000 7f6a6b968980 1 -- 172.21.15.157:0/497782946 wait complete. 2024-05-09T09:47:30.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.735+0000 7f6a6b968980 1 Processor -- start 2024-05-09T09:47:30.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.735+0000 7f6a6b968980 1 -- start start 2024-05-09T09:47:30.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.735+0000 7f6a6b968980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561973b8df60 0x561973b95330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.735+0000 7f6a6b968980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561973b8eef0 con 0x561973b8df60 2024-05-09T09:47:30.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.735+0000 7f6a69483640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561973b8df60 0x561973b95330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.735+0000 7f6a69483640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561973b8df60 0x561973b95330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53624/0 (socket says 172.21.15.157:53624) 2024-05-09T09:47:30.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.735+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 learned_addr learned my addr 172.21.15.157:0/3258798322 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:30.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.735+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561973b95870 con 0x561973b8df60 2024-05-09T09:47:30.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.735+0000 7f6a69483640 1 --2- 172.21.15.157:0/3258798322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561973b8df60 0x561973b95330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c048390 tx=0x7f6a5c005ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.735+0000 7f6945ffb640 1 -- 172.21.15.157:0/3258798322 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a5c05f040 con 0x561973b8df60 2024-05-09T09:47:30.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.735+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561973b95870 con 0x561973b8df60 2024-05-09T09:47:30.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.735+0000 7f6945ffb640 1 -- 172.21.15.157:0/3258798322 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a5c01d5f0 con 0x561973b8df60 2024-05-09T09:47:30.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.735+0000 7f6945ffb640 1 -- 172.21.15.157:0/3258798322 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a5c019b50 con 0x561973b8df60 2024-05-09T09:47:30.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.735+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561973b95870 con 0x561973b8df60 2024-05-09T09:47:30.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6945ffb640 1 -- 172.21.15.157:0/3258798322 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f6a5c062070 con 0x561973b8df60 2024-05-09T09:47:30.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6a6b968980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6945ffb640 1 --2- 172.21.15.157:0/3258798322 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6938034bb0 0x7f6938037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6945ffb640 1 -- 172.21.15.157:0/3258798322 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f6a5c060070 con 0x561973b8df60 2024-05-09T09:47:30.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6a68c82640 1 --2- 172.21.15.157:0/3258798322 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6938034bb0 0x7f6938037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6a6b968980 1 --2- 172.21.15.157:0/3258798322 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561973ba1d30 0x561973ba41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561973ba4910 con 0x561973ba1d30 2024-05-09T09:47:30.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6a69c84640 1 --2- 172.21.15.157:0/3258798322 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561973ba1d30 0x561973ba41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6a68c82640 1 --2- 172.21.15.157:0/3258798322 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6938034bb0 0x7f6938037070 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x561973b5b720 tx=0x7f6a600c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6a69c84640 1 --2- 172.21.15.157:0/3258798322 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561973ba1d30 0x561973ba41c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973ba1d30 2024-05-09T09:47:30.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6a6b968980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:30.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6a6b968980 20 realm 2024-05-09T09:47:30.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6a6b968980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561973ba4d20 con 0x561973ba1d30 2024-05-09T09:47:30.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973ba1d30 2024-05-09T09:47:30.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6a6b968980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:30.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6a6b968980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:30.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6a6b968980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561973ba55c0 con 0x561973ba1d30 2024-05-09T09:47:30.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973ba1d30 2024-05-09T09:47:30.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6a6b968980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:30.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6a6b968980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x561973ba1d30 2024-05-09T09:47:30.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973ba1d30 2024-05-09T09:47:30.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6a6b968980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:30.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6a6b968980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6a6b968980 1 --2- 172.21.15.157:0/3258798322 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561973ba66c0 0x561973ba8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561973ba9150 con 0x561973ba66c0 2024-05-09T09:47:30.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.739+0000 7f6a69483640 1 --2- 172.21.15.157:0/3258798322 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561973ba66c0 0x561973ba8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.743+0000 7f6a69483640 1 --2- 172.21.15.157:0/3258798322 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561973ba66c0 0x561973ba8ab0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.743+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6a5c02e070 con 0x561973ba66c0 2024-05-09T09:47:30.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.743+0000 7f6a6b968980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:30.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.743+0000 7f6a6b968980 20 searching for the correct realm 2024-05-09T09:47:30.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.743+0000 7f6a6b968980 1 --2- 172.21.15.157:0/3258798322 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561973bab030 0x561973bad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.743+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973badb20 con 0x561973bab030 2024-05-09T09:47:30.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.743+0000 7f6a68c82640 1 --2- 172.21.15.157:0/3258798322 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561973bab030 0x561973bad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.743+0000 7f6a68c82640 1 --2- 172.21.15.157:0/3258798322 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561973bab030 0x561973bad4a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.743+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a600aaa60 con 0x561973bab030 2024-05-09T09:47:30.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.743+0000 7f6a68c82640 1 --2- 172.21.15.157:0/3258798322 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f6a600e0040 0x7f6a600e0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.743+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973badb20 con 0x7f6a600e0040 2024-05-09T09:47:30.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.743+0000 7f6a69c84640 1 --2- 172.21.15.157:0/3258798322 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f6a600e0040 0x7f6a600e0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.743+0000 7f6a69c84640 1 --2- 172.21.15.157:0/3258798322 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f6a600e0040 0x7f6a600e0930 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.743+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6400a4d0 con 0x7f6a600e0040 2024-05-09T09:47:30.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.743+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x561973ba66c0 2024-05-09T09:47:30.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.743+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a5c02e070 con 0x561973ba66c0 2024-05-09T09:47:30.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.743+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x561973ba1d30 2024-05-09T09:47:30.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.747+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973ba1d30 2024-05-09T09:47:30.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.747+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x561973ba1d30 2024-05-09T09:47:30.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.747+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973ba1d30 2024-05-09T09:47:30.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.747+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x561973ba66c0 2024-05-09T09:47:30.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.747+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a5c02e070 con 0x561973ba66c0 2024-05-09T09:47:30.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.747+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x561973ba66c0 2024-05-09T09:47:30.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.747+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a5c02e070 con 0x561973ba66c0 2024-05-09T09:47:30.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.747+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x7f6a600e0040 2024-05-09T09:47:30.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.747+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6400a4d0 con 0x7f6a600e0040 2024-05-09T09:47:30.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.747+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x561973bab030 2024-05-09T09:47:30.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.747+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a600aaa60 con 0x561973bab030 2024-05-09T09:47:30.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.747+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x561973ba1d30 2024-05-09T09:47:30.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.747+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973ba1d30 2024-05-09T09:47:30.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.747+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x561973ba66c0 2024-05-09T09:47:30.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.747+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a5c02e070 con 0x561973ba66c0 2024-05-09T09:47:30.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.747+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x561973ba1d30 2024-05-09T09:47:30.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.747+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973ba1d30 2024-05-09T09:47:30.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.747+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x7f6a600e0040 2024-05-09T09:47:30.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.751+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6a6400a4d0 con 0x7f6a600e0040 2024-05-09T09:47:30.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.751+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x561973bab030 2024-05-09T09:47:30.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.751+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a600aaa60 con 0x561973bab030 2024-05-09T09:47:30.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.751+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x561973bab030 2024-05-09T09:47:30.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.751+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6a600aaa60 con 0x561973bab030 2024-05-09T09:47:30.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.751+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x561973ba66c0 2024-05-09T09:47:30.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.751+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a5c02e070 con 0x561973ba66c0 2024-05-09T09:47:30.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.751+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x561973bab030 2024-05-09T09:47:30.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.751+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a600aaa60 con 0x561973bab030 2024-05-09T09:47:30.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.751+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x561973bab030 2024-05-09T09:47:30.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.751+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a600aaa60 con 0x561973bab030 2024-05-09T09:47:30.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.751+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x561973ba1d30 2024-05-09T09:47:30.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.751+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973ba1d30 2024-05-09T09:47:30.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.751+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x561973ba1d30 2024-05-09T09:47:30.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.751+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973ba1d30 2024-05-09T09:47:30.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.751+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x561973ba66c0 2024-05-09T09:47:30.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.751+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a5c02e070 con 0x561973ba66c0 2024-05-09T09:47:30.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.751+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x561973bab030 2024-05-09T09:47:30.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.755+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a600aaa60 con 0x561973bab030 2024-05-09T09:47:30.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.755+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x7f6a600e0040 2024-05-09T09:47:30.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.755+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6400a4d0 con 0x7f6a600e0040 2024-05-09T09:47:30.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.755+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x561973ba1d30 2024-05-09T09:47:30.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.755+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973ba1d30 2024-05-09T09:47:30.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.755+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x561973ba66c0 2024-05-09T09:47:30.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.755+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6a5c02e070 con 0x561973ba66c0 2024-05-09T09:47:30.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.755+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x561973bab030 2024-05-09T09:47:30.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.755+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a600aaa60 con 0x561973bab030 2024-05-09T09:47:30.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.755+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x561973ba66c0 2024-05-09T09:47:30.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.755+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a5c02e070 con 0x561973ba66c0 2024-05-09T09:47:30.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.755+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x7f6a600e0040 2024-05-09T09:47:30.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.755+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6400a4d0 con 0x7f6a600e0040 2024-05-09T09:47:30.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.755+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x561973bab030 2024-05-09T09:47:30.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.755+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a600aaa60 con 0x561973bab030 2024-05-09T09:47:30.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.755+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x561973ba66c0 2024-05-09T09:47:30.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a5c02e070 con 0x561973ba66c0 2024-05-09T09:47:30.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x561973ba1d30 2024-05-09T09:47:30.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973ba1d30 2024-05-09T09:47:30.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561973ba5960 con 0x7f6a600e0040 2024-05-09T09:47:30.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6400a4d0 con 0x7f6a600e0040 2024-05-09T09:47:30.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a6b968980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:30.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a6b968980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:30.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a6b968980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:30.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a6b968980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:30.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a6b968980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:30.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a6b968980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:30.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a6b968980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561973ba99a0 con 0x561973ba1d30 2024-05-09T09:47:30.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973ba1d30 2024-05-09T09:47:30.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a6b968980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:30.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a6b968980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561973ba99a0 con 0x561973ba1d30 2024-05-09T09:47:30.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973ba1d30 2024-05-09T09:47:30.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a6b968980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:30.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a6b968980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561973ba99a0 con 0x561973bab030 2024-05-09T09:47:30.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6a600aaa60 con 0x561973bab030 2024-05-09T09:47:30.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a6b968980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:30.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a6b968980 20 zone default found 2024-05-09T09:47:30.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a6b968980 4 Realm: () 2024-05-09T09:47:30.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a6b968980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:30.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a6b968980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:30.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a6b968980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:30.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a6b968980 20 zonegroup default 2024-05-09T09:47:30.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a6b968980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561973baa360 con 0x561973ba66c0 2024-05-09T09:47:30.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6a5c02e070 con 0x561973ba66c0 2024-05-09T09:47:30.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a6b968980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:30.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a6b968980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561973ba9f00 con 0x561973bab030 2024-05-09T09:47:30.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.759+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6a600aaa60 con 0x561973bab030 2024-05-09T09:47:30.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.763+0000 7f6a6b968980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:30.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.763+0000 7f6a6b968980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.763+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561973bafed0 con 0x561973bab030 2024-05-09T09:47:30.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.763+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6a600aaa60 con 0x561973bab030 2024-05-09T09:47:30.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.763+0000 7f6a6b968980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:30.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.763+0000 7f6a6b968980 20 started sync module instance, tier type = 2024-05-09T09:47:30.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.763+0000 7f6a6b968980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:30.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.763+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973baf2c0 con 0x7f6a600e0040 2024-05-09T09:47:30.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.763+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x7f6a600e0040 2024-05-09T09:47:30.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.763+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94667315804096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973baf2c0 con 0x7f6a600e0040 2024-05-09T09:47:30.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.763+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bb0950 con 0x561973ba1d30 2024-05-09T09:47:30.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.763+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94667315804096] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x7f6a600e0040 2024-05-09T09:47:30.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.763+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973ba1d30 2024-05-09T09:47:30.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.763+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94667315801888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bb0950 con 0x561973ba1d30 2024-05-09T09:47:30.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.763+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bb1310 con 0x561973bab030 2024-05-09T09:47:30.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.767+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a600aaa60 con 0x561973bab030 2024-05-09T09:47:30.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.767+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94667315809888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bb1bb0 con 0x561973bab030 2024-05-09T09:47:30.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.767+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bb25d0 con 0x7f6a600e0040 2024-05-09T09:47:30.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.767+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94667315801888] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973ba1d30 2024-05-09T09:47:30.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.767+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x7f6a600e0040 2024-05-09T09:47:30.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.767+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94667315814592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bb29f0 con 0x7f6a600e0040 2024-05-09T09:47:30.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.767+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bb33b0 con 0x561973ba1d30 2024-05-09T09:47:30.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.771+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94667315809888] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a600aaa60 con 0x561973bab030 2024-05-09T09:47:30.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.771+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94667315814592] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x7f6a600e0040 2024-05-09T09:47:30.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.771+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973ba1d30 2024-05-09T09:47:30.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.771+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94667315807392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bb2f00 con 0x561973ba1d30 2024-05-09T09:47:30.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.771+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bb3750 con 0x561973ba66c0 2024-05-09T09:47:30.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.771+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94667315807392] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973ba1d30 2024-05-09T09:47:30.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.771+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a5c02e070 con 0x561973ba66c0 2024-05-09T09:47:30.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.771+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94667315818240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bb3320 con 0x561973ba66c0 2024-05-09T09:47:30.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.771+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bb44a0 con 0x561973ba66c0 2024-05-09T09:47:30.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.775+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a5c02e070 con 0x561973ba66c0 2024-05-09T09:47:30.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.775+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94667315824704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bb5110 con 0x561973ba66c0 2024-05-09T09:47:30.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.775+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bb5b10 con 0x561973ba66c0 2024-05-09T09:47:30.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.775+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94667315818240] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a5c02e070 con 0x561973ba66c0 2024-05-09T09:47:30.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.775+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94667315824704] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a5c02e070 con 0x561973ba66c0 2024-05-09T09:47:30.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.779+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a5c02e070 con 0x561973ba66c0 2024-05-09T09:47:30.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.779+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94667315825760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bb3b50 con 0x561973ba66c0 2024-05-09T09:47:30.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.779+0000 7f6a6b968980 20 add_watcher() i=0 2024-05-09T09:47:30.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.779+0000 7f6a6b968980 20 add_watcher() i=1 2024-05-09T09:47:30.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.779+0000 7f6a6b968980 20 add_watcher() i=2 2024-05-09T09:47:30.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.779+0000 7f6a6b968980 20 add_watcher() i=3 2024-05-09T09:47:30.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.779+0000 7f6a6b968980 20 add_watcher() i=4 2024-05-09T09:47:30.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.779+0000 7f6a6b968980 20 add_watcher() i=5 2024-05-09T09:47:30.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.779+0000 7f6a6b968980 20 add_watcher() i=6 2024-05-09T09:47:30.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.779+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94667315825760] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a5c02e070 con 0x561973ba66c0 2024-05-09T09:47:30.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.779+0000 7f6a6b968980 20 add_watcher() i=7 2024-05-09T09:47:30.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.779+0000 7f6a6b968980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:30.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.779+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561973bb8d80 con 0x561973ba1d30 2024-05-09T09:47:30.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.779+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973ba1d30 2024-05-09T09:47:30.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.779+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94667315828256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bb62a0 con 0x561973ba1d30 2024-05-09T09:47:30.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.779+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94667315828256] v30'39 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973ba1d30 2024-05-09T09:47:30.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.779+0000 7f691efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:30.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.779+0000 7f6a6b968980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:30.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.779+0000 7f6a6b968980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:30.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.779+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc1660 con 0x561973ba1d30 2024-05-09T09:47:30.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.783+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973ba1d30 2024-05-09T09:47:30.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.783+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc1c70 con 0x561973ba66c0 2024-05-09T09:47:30.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.787+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'13 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a5c02e070 con 0x561973ba66c0 2024-05-09T09:47:30.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.787+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc1c70 con 0x561973bab030 2024-05-09T09:47:30.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.787+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a600aaa60 con 0x561973bab030 2024-05-09T09:47:30.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.787+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc21e0 con 0x561973ba1d30 2024-05-09T09:47:30.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.787+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'40 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973ba1d30 2024-05-09T09:47:30.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.787+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc2750 con 0x7f6a600e0040 2024-05-09T09:47:30.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.787+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'29 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x7f6a600e0040 2024-05-09T09:47:30.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.787+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc2cc0 con 0x561973bab030 2024-05-09T09:47:30.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.791+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a600aaa60 con 0x561973bab030 2024-05-09T09:47:30.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.791+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc3170 con 0x561973ba1d30 2024-05-09T09:47:30.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.791+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973ba1d30 2024-05-09T09:47:30.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.791+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc3170 con 0x561973ba66c0 2024-05-09T09:47:30.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.795+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a5c02e070 con 0x561973ba66c0 2024-05-09T09:47:30.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.795+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc3170 con 0x7f6a600e0040 2024-05-09T09:47:30.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.795+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x7f6a600e0040 2024-05-09T09:47:30.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.795+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc32a0 con 0x561973bab030 2024-05-09T09:47:30.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.799+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a600aaa60 con 0x561973bab030 2024-05-09T09:47:30.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.799+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc37a0 con 0x7f6a600e0040 2024-05-09T09:47:30.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.799+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'30 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x7f6a600e0040 2024-05-09T09:47:30.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.799+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc37a0 con 0x561973ba66c0 2024-05-09T09:47:30.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.803+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a5c02e070 con 0x561973ba66c0 2024-05-09T09:47:30.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.803+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc37a0 con 0x7f6a600e0040 2024-05-09T09:47:30.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.803+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x7f6a600e0040 2024-05-09T09:47:30.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.803+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc37a0 con 0x561973ba66c0 2024-05-09T09:47:30.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.807+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a5c02e070 con 0x561973ba66c0 2024-05-09T09:47:30.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.807+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc37a0 con 0x561973ba1d30 2024-05-09T09:47:30.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.807+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'41 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973ba1d30 2024-05-09T09:47:30.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.807+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc37a0 con 0x561973bab030 2024-05-09T09:47:30.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.811+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a600aaa60 con 0x561973bab030 2024-05-09T09:47:30.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.811+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc3890 con 0x7f6a600e0040 2024-05-09T09:47:30.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.811+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x7f6a600e0040 2024-05-09T09:47:30.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.811+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc3890 con 0x561973bab030 2024-05-09T09:47:30.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.811+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a600aaa60 con 0x561973bab030 2024-05-09T09:47:30.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.811+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc2db0 con 0x561973ba1d30 2024-05-09T09:47:30.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.815+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973ba1d30 2024-05-09T09:47:30.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.815+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc2db0 con 0x561973ba1d30 2024-05-09T09:47:30.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.815+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'42 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973ba1d30 2024-05-09T09:47:30.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.815+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc3830 con 0x561973bab030 2024-05-09T09:47:30.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.819+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a600aaa60 con 0x561973bab030 2024-05-09T09:47:30.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.819+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc3830 con 0x7f6a600e0040 2024-05-09T09:47:30.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.819+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x7f6a600e0040 2024-05-09T09:47:30.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.819+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc3830 con 0x561973bab030 2024-05-09T09:47:30.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.819+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a600aaa60 con 0x561973bab030 2024-05-09T09:47:30.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.819+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc3830 con 0x561973bab030 2024-05-09T09:47:30.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.823+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a600aaa60 con 0x561973bab030 2024-05-09T09:47:30.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.823+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc3830 con 0x561973bab030 2024-05-09T09:47:30.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.823+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a600aaa60 con 0x561973bab030 2024-05-09T09:47:30.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.823+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc3830 con 0x561973bab030 2024-05-09T09:47:30.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.827+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'20 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a600aaa60 con 0x561973bab030 2024-05-09T09:47:30.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.827+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc3830 con 0x561973ba66c0 2024-05-09T09:47:30.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.827+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a5c02e070 con 0x561973ba66c0 2024-05-09T09:47:30.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.827+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc3830 con 0x561973bab030 2024-05-09T09:47:30.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.831+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a600aaa60 con 0x561973bab030 2024-05-09T09:47:30.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.831+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc3830 con 0x561973ba66c0 2024-05-09T09:47:30.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.831+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'20 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a5c02e070 con 0x561973ba66c0 2024-05-09T09:47:30.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.831+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc3830 con 0x561973bab030 2024-05-09T09:47:30.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.835+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a600aaa60 con 0x561973bab030 2024-05-09T09:47:30.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.835+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc3830 con 0x561973ba66c0 2024-05-09T09:47:30.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.839+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'26 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a5c02e070 con 0x561973ba66c0 2024-05-09T09:47:30.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.839+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bc3830 con 0x7f6a600e0040 2024-05-09T09:47:30.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.839+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x7f6a600e0040 2024-05-09T09:47:30.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.839+0000 7f691dfe3640 20 reqs_thread_entry: start 2024-05-09T09:47:30.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.839+0000 7f6a6b968980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:30.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.839+0000 7f6916ffd640 20 reqs_thread_entry: start 2024-05-09T09:47:30.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.839+0000 7f6a6b968980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-09T09:47:30.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.839+0000 7f6a6b968980 20 rados->read ofs=0 len=0 2024-05-09T09:47:30.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.839+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561973bbf420 con 0x561973ba66c0 2024-05-09T09:47:30.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.843+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f6a5c02e070 con 0x561973ba66c0 2024-05-09T09:47:30.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.843+0000 7f6a6b968980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:30.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.843+0000 7f6a6b968980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-05-09T09:47:30.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.843+0000 7f6a6b968980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-09T09:47:30.840 INFO:teuthology.orchestra.run.smithi157.stderr:could not remove user: unable to remove user, user does not exist 2024-05-09T09:47:30.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.843+0000 7f691efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:30.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.843+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94667315828256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bbe600 con 0x561973ba1d30 2024-05-09T09:47:30.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.843+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94667315828256] v30'43 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973ba1d30 2024-05-09T09:47:30.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.843+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94667315804096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bb5620 con 0x7f6a600e0040 2024-05-09T09:47:30.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.847+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94667315804096] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x7f6a600e0040 2024-05-09T09:47:30.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.847+0000 7f6a6b968980 20 remove_watcher() i=0 2024-05-09T09:47:30.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.847+0000 7f6a6b968980 2 removed watcher, disabling cache 2024-05-09T09:47:30.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.847+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94667315801888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973baf7c0 con 0x561973ba1d30 2024-05-09T09:47:30.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.847+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94667315801888] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973ba1d30 2024-05-09T09:47:30.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.847+0000 7f6a6b968980 20 remove_watcher() i=1 2024-05-09T09:47:30.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.847+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94667315809888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973baf7c0 con 0x561973bab030 2024-05-09T09:47:30.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.851+0000 7f6a68c82640 1 -- 172.21.15.157:0/3258798322 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94667315809888] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a600aaa60 con 0x561973bab030 2024-05-09T09:47:30.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.851+0000 7f6a6b968980 20 remove_watcher() i=2 2024-05-09T09:47:30.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.851+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94667315814592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973baf7c0 con 0x7f6a600e0040 2024-05-09T09:47:30.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.851+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94667315814592] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x7f6a600e0040 2024-05-09T09:47:30.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.851+0000 7f6a6b968980 20 remove_watcher() i=3 2024-05-09T09:47:30.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.851+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94667315807392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bb20c0 con 0x561973ba1d30 2024-05-09T09:47:30.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.855+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94667315807392] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6400a4d0 con 0x561973ba1d30 2024-05-09T09:47:30.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.855+0000 7f6a6b968980 20 remove_watcher() i=4 2024-05-09T09:47:30.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.855+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94667315818240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973baf7c0 con 0x561973ba66c0 2024-05-09T09:47:30.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.855+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94667315818240] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a5c02e070 con 0x561973ba66c0 2024-05-09T09:47:30.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.855+0000 7f6a6b968980 20 remove_watcher() i=5 2024-05-09T09:47:30.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.855+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94667315824704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bb04a0 con 0x561973ba66c0 2024-05-09T09:47:30.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.859+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94667315824704] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a5c02e070 con 0x561973ba66c0 2024-05-09T09:47:30.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.859+0000 7f6a6b968980 20 remove_watcher() i=6 2024-05-09T09:47:30.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.859+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94667315825760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561973bb2f00 con 0x561973ba66c0 2024-05-09T09:47:30.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.859+0000 7f6a69483640 1 -- 172.21.15.157:0/3258798322 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94667315825760] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a5c02e070 con 0x561973ba66c0 2024-05-09T09:47:30.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.859+0000 7f6a6b968980 20 remove_watcher() i=7 2024-05-09T09:47:30.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.859+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561973ba66c0 msgr2=0x561973ba8ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.859+0000 7f6a6b968980 1 --2- 172.21.15.157:0/3258798322 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561973ba66c0 0x561973ba8ab0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.859+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561973ba1d30 msgr2=0x561973ba41c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.859+0000 7f6a6b968980 1 --2- 172.21.15.157:0/3258798322 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561973ba1d30 0x561973ba41c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.859+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f6a600e0040 msgr2=0x7f6a600e0930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.859+0000 7f6a6b968980 1 --2- 172.21.15.157:0/3258798322 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f6a600e0040 0x7f6a600e0930 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.859+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561973bab030 msgr2=0x561973bad4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.859+0000 7f6a6b968980 1 --2- 172.21.15.157:0/3258798322 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561973bab030 0x561973bad4a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.859+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6938034bb0 msgr2=0x7f6938037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.859+0000 7f6a6b968980 1 --2- 172.21.15.157:0/3258798322 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6938034bb0 0x7f6938037070 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x561973b5b720 tx=0x7f6a600c1040 comp rx=0 tx=0).stop 2024-05-09T09:47:30.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.859+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561973b8df60 msgr2=0x561973b95330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.859+0000 7f6a6b968980 1 --2- 172.21.15.157:0/3258798322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561973b8df60 0x561973b95330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c048390 tx=0x7f6a5c005ec0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.859+0000 7f6a69c84640 1 -- 172.21.15.157:0/3258798322 reap_dead start 2024-05-09T09:47:30.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.859+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 shutdown_connections 2024-05-09T09:47:30.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.859+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 >> 172.21.15.157:0/3258798322 conn(0x561973b8a330 msgr2=0x561973b87990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:30.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.859+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 shutdown_connections 2024-05-09T09:47:30.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.859+0000 7f6a6b968980 1 -- 172.21.15.157:0/3258798322 wait complete. 2024-05-09T09:47:30.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.863+0000 7f6a6b968980 1 -- 172.21.15.157:0/4017625078 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6940034bb0 msgr2=0x7f6940037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.863+0000 7f6a6b968980 1 --2- 172.21.15.157:0/4017625078 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6940034bb0 0x7f6940037070 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x561973b52a30 tx=0x7f6a60005ad0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.863+0000 7f6a6b968980 1 -- 172.21.15.157:0/4017625078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561973b811a0 msgr2=0x561973b815c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.863+0000 7f6a6b968980 1 --2- 172.21.15.157:0/4017625078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561973b811a0 0x561973b815c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c049540 tx=0x7f6a5c01b960 comp rx=0 tx=0).stop 2024-05-09T09:47:30.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.863+0000 7f6a6b968980 1 -- 172.21.15.157:0/4017625078 shutdown_connections 2024-05-09T09:47:30.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.863+0000 7f6a6b968980 1 --2- 172.21.15.157:0/4017625078 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6940034bb0 0x7f6940037070 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.863+0000 7f6a6b968980 1 --2- 172.21.15.157:0/4017625078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561973b811a0 0x561973b815c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.863+0000 7f6a6b968980 1 -- 172.21.15.157:0/4017625078 >> 172.21.15.157:0/4017625078 conn(0x561973b75f70 msgr2=0x561973b76a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:30.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.863+0000 7f6a6b968980 1 -- 172.21.15.157:0/4017625078 shutdown_connections 2024-05-09T09:47:30.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.863+0000 7f6a6b968980 1 -- 172.21.15.157:0/4017625078 wait complete. 2024-05-09T09:47:30.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.863+0000 7f6a6b968980 1 -- 172.21.15.157:0/2544981611 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561973b548b0 msgr2=0x561973b56ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.863+0000 7f6a6b968980 1 --2- 172.21.15.157:0/2544981611 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561973b548b0 0x561973b56ca0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.863+0000 7f6a6b968980 1 -- 172.21.15.157:0/2544981611 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561973a5d110 msgr2=0x561973b51f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.863+0000 7f6a6b968980 1 --2- 172.21.15.157:0/2544981611 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561973a5d110 0x561973b51f10 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.863+0000 7f6a6b968980 1 -- 172.21.15.157:0/2544981611 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561973b587f0 msgr2=0x561973b5abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.863+0000 7f6a6b968980 1 --2- 172.21.15.157:0/2544981611 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561973b587f0 0x561973b5abe0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.863+0000 7f6a6b968980 1 -- 172.21.15.157:0/2544981611 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6950034bb0 msgr2=0x7f6950037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.863+0000 7f6a6b968980 1 --2- 172.21.15.157:0/2544981611 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6950034bb0 0x7f6950037070 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6a600ae000 tx=0x7f6a600a6000 comp rx=0 tx=0).stop 2024-05-09T09:47:30.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.863+0000 7f6a6b968980 1 -- 172.21.15.157:0/2544981611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619739caa70 msgr2=0x561973b4af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.863+0000 7f6a6b968980 1 --2- 172.21.15.157:0/2544981611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5619739caa70 0x561973b4af20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x561973b44bc0 tx=0x7f6a5c000bd0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.863+0000 7f6a69c84640 1 -- 172.21.15.157:0/2544981611 reap_dead start 2024-05-09T09:47:30.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.863+0000 7f6a6b968980 1 -- 172.21.15.157:0/2544981611 shutdown_connections 2024-05-09T09:47:30.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.863+0000 7f6a6b968980 1 -- 172.21.15.157:0/2544981611 >> 172.21.15.157:0/2544981611 conn(0x561973a510d0 msgr2=0x561973b3e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:30.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.863+0000 7f6a6b968980 1 -- 172.21.15.157:0/2544981611 shutdown_connections 2024-05-09T09:47:30.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.863+0000 7f6a6b968980 1 -- 172.21.15.157:0/2544981611 wait complete. 2024-05-09T09:47:30.878 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-09T09:47:30.878 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-05-09T09:47:30.879 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-05-09T09:47:30.879 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-05-09T09:47:30.957 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:30.957 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:30.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.959+0000 7fde0ca5f980 1 Processor -- start 2024-05-09T09:47:30.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.959+0000 7fde0ca5f980 1 -- start start 2024-05-09T09:47:30.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.959+0000 7fde0ca5f980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5609b2261cd0 0x5609b22640c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.959+0000 7fde0ca5f980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5609b2113440 con 0x5609b21d1ab0 2024-05-09T09:47:30.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.959+0000 7fde0ca5f980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5609b20fe5f0 con 0x5609b2261cd0 2024-05-09T09:47:30.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.959+0000 7fde0a57a640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x5609b21d1ab0 0x5609b22605b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:33534/0 (socket says 172.21.15.157:33534) 2024-05-09T09:47:30.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.959+0000 7fde0a57a640 1 -- 172.21.15.157:0/591889252 learned_addr learned my addr 172.21.15.157:0/591889252 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:47:30.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.959+0000 7fde09d79640 1 --2- 172.21.15.157:0/591889252 >> v2:172.21.15.110:3300/0 conn(0x5609b2261cd0 0x5609b22640c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.959+0000 7fde09578640 1 -- 172.21.15.157:0/591889252 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3831857362 0 0) 0x5609b2113440 con 0x5609b21d1ab0 2024-05-09T09:47:30.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.959+0000 7fde09578640 1 -- 172.21.15.157:0/591889252 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddf4001e20 con 0x5609b21d1ab0 2024-05-09T09:47:30.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.959+0000 7fde09d79640 1 -- 172.21.15.157:0/591889252 >> v1:172.21.15.110:6789/0 conn(0x5609b21d1ab0 legacy=0x5609b22605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.959+0000 7fde09d79640 1 -- 172.21.15.157:0/591889252 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609b2109990 con 0x5609b2261cd0 2024-05-09T09:47:30.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.963+0000 7fde09d79640 1 --2- 172.21.15.157:0/591889252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b2261cd0 0x5609b22640c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fde0000a480 tx=0x7fde0001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d91a145319f9efc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.963+0000 7fde09578640 1 -- 172.21.15.157:0/591889252 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde000b0070 con 0x5609b2261cd0 2024-05-09T09:47:30.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.963+0000 7fde09578640 1 -- 172.21.15.157:0/591889252 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde000ab540 con 0x5609b2261cd0 2024-05-09T09:47:30.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.963+0000 7fde09578640 1 -- 172.21.15.157:0/591889252 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde000ab840 con 0x5609b2261cd0 2024-05-09T09:47:30.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.963+0000 7fde0ca5f980 1 -- 172.21.15.157:0/591889252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b2261cd0 msgr2=0x5609b22640c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.963+0000 7fde0ca5f980 1 --2- 172.21.15.157:0/591889252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b2261cd0 0x5609b22640c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fde0000a480 tx=0x7fde0001b280 comp rx=0 tx=0).stop 2024-05-09T09:47:30.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.963+0000 7fde0ca5f980 1 -- 172.21.15.157:0/591889252 shutdown_connections 2024-05-09T09:47:30.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.963+0000 7fde0ca5f980 1 --2- 172.21.15.157:0/591889252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b2261cd0 0x5609b22640c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.963+0000 7fde0ca5f980 1 -- 172.21.15.157:0/591889252 >> 172.21.15.157:0/591889252 conn(0x5609b22580d0 msgr2=0x5609b225a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:30.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.963+0000 7fde0ca5f980 1 -- 172.21.15.157:0/591889252 shutdown_connections 2024-05-09T09:47:30.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.963+0000 7fde0ca5f980 1 -- 172.21.15.157:0/591889252 wait complete. 2024-05-09T09:47:30.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.979+0000 7fde0ca5f980 1 Processor -- start 2024-05-09T09:47:30.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.979+0000 7fde0ca5f980 1 -- start start 2024-05-09T09:47:30.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.979+0000 7fde0ca5f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b21d1ab0 0x5609b23489c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.979+0000 7fde0ca5f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5609b2160fe0 con 0x5609b21d1ab0 2024-05-09T09:47:30.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.983+0000 7fde0a57a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b21d1ab0 0x5609b23489c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.983+0000 7fde0a57a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b21d1ab0 0x5609b23489c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53628/0 (socket says 172.21.15.157:53628) 2024-05-09T09:47:30.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.983+0000 7fde0a57a640 1 -- 172.21.15.157:0/3113908352 learned_addr learned my addr 172.21.15.157:0/3113908352 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:30.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.983+0000 7fde0a57a640 1 -- 172.21.15.157:0/3113908352 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609b20e5ae0 con 0x5609b21d1ab0 2024-05-09T09:47:30.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.983+0000 7fde0a57a640 1 --2- 172.21.15.157:0/3113908352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b21d1ab0 0x5609b23489c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fddfc001dc0 tx=0x7fddfc00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f3df2383afffb5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.983+0000 7fdcf8608640 1 -- 172.21.15.157:0/3113908352 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddfc012020 con 0x5609b21d1ab0 2024-05-09T09:47:30.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.983+0000 7fdcf8608640 1 -- 172.21.15.157:0/3113908352 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddfc00e7c0 con 0x5609b21d1ab0 2024-05-09T09:47:30.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.983+0000 7fdcf8608640 1 -- 172.21.15.157:0/3113908352 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddfc00eb40 con 0x5609b21d1ab0 2024-05-09T09:47:30.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.983+0000 7fde0ca5f980 1 -- 172.21.15.157:0/3113908352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b21d1ab0 msgr2=0x5609b23489c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:30.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.983+0000 7fde0ca5f980 1 --2- 172.21.15.157:0/3113908352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b21d1ab0 0x5609b23489c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fddfc001dc0 tx=0x7fddfc00b6d0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.983+0000 7fde0ca5f980 1 -- 172.21.15.157:0/3113908352 shutdown_connections 2024-05-09T09:47:30.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.983+0000 7fde0ca5f980 1 --2- 172.21.15.157:0/3113908352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b21d1ab0 0x5609b23489c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:30.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.983+0000 7fde0ca5f980 1 -- 172.21.15.157:0/3113908352 >> 172.21.15.157:0/3113908352 conn(0x5609b22580d0 msgr2=0x5609b2344550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:30.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.983+0000 7fde0ca5f980 1 -- 172.21.15.157:0/3113908352 shutdown_connections 2024-05-09T09:47:30.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.983+0000 7fde0ca5f980 1 -- 172.21.15.157:0/3113908352 wait complete. 2024-05-09T09:47:30.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.983+0000 7fde0ca5f980 1 Processor -- start 2024-05-09T09:47:30.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.983+0000 7fde0ca5f980 1 -- start start 2024-05-09T09:47:30.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.983+0000 7fde0ca5f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b21d1ab0 0x5609b234fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.983+0000 7fde0ca5f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5609b22651a0 con 0x5609b21d1ab0 2024-05-09T09:47:30.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.983+0000 7fde0a57a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b21d1ab0 0x5609b234fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.983+0000 7fde0a57a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b21d1ab0 0x5609b234fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53634/0 (socket says 172.21.15.157:53634) 2024-05-09T09:47:30.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.983+0000 7fde0a57a640 1 -- 172.21.15.157:0/3385172225 learned_addr learned my addr 172.21.15.157:0/3385172225 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:30.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.983+0000 7fde0a57a640 1 -- 172.21.15.157:0/3385172225 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609b23500e0 con 0x5609b21d1ab0 2024-05-09T09:47:30.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.987+0000 7fde0a57a640 1 --2- 172.21.15.157:0/3385172225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b21d1ab0 0x5609b234fba0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x5609b2349850 tx=0x7fddfc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.987+0000 7fdcf6e05640 1 -- 172.21.15.157:0/3385172225 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddfc012030 con 0x5609b21d1ab0 2024-05-09T09:47:30.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.987+0000 7fdcf6e05640 1 -- 172.21.15.157:0/3385172225 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddfc001440 con 0x5609b21d1ab0 2024-05-09T09:47:30.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.987+0000 7fde0ca5f980 1 -- 172.21.15.157:0/3385172225 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609b2350370 con 0x5609b21d1ab0 2024-05-09T09:47:30.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.987+0000 7fdcf6e05640 1 -- 172.21.15.157:0/3385172225 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddfc01aaf0 con 0x5609b21d1ab0 2024-05-09T09:47:30.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.987+0000 7fde0ca5f980 1 -- 172.21.15.157:0/3385172225 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609b2353050 con 0x5609b21d1ab0 2024-05-09T09:47:30.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.987+0000 7fdcf6e05640 1 -- 172.21.15.157:0/3385172225 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fddfc015020 con 0x5609b21d1ab0 2024-05-09T09:47:30.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.987+0000 7fdcf6e05640 1 --2- 172.21.15.157:0/3385172225 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdcf0034bb0 0x7fdcf0037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.987+0000 7fdcf6e05640 1 -- 172.21.15.157:0/3385172225 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fddfc020030 con 0x5609b21d1ab0 2024-05-09T09:47:30.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.987+0000 7fde09d79640 1 --2- 172.21.15.157:0/3385172225 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdcf0034bb0 0x7fdcf0037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.987+0000 7fde0ca5f980 1 --2- 172.21.15.157:0/3385172225 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5609b2261cd0 0x5609b2356b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.987+0000 7fde0ca5f980 1 -- 172.21.15.157:0/3385172225 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609b23571d0 con 0x5609b2261cd0 2024-05-09T09:47:30.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.987+0000 7fde0ad7b640 1 --2- 172.21.15.157:0/3385172225 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5609b2261cd0 0x5609b2356b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.987+0000 7fde09d79640 1 --2- 172.21.15.157:0/3385172225 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdcf0034bb0 0x7fdcf0037070 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fde000ad000 tx=0x7fde000a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.987+0000 7fde0ad7b640 1 --2- 172.21.15.157:0/3385172225 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5609b2261cd0 0x5609b2356b90 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.987+0000 7fde0ad7b640 1 -- 172.21.15.157:0/3385172225 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b2261cd0 2024-05-09T09:47:30.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.987+0000 7fde0ca5f980 1 -- 172.21.15.157:0/3385172225 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609b2354250 con 0x5609b2261cd0 2024-05-09T09:47:30.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.987+0000 7fde0ad7b640 1 -- 172.21.15.157:0/3385172225 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b2261cd0 2024-05-09T09:47:30.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.987+0000 7fde0ca5f980 1 --2- 172.21.15.157:0/3385172225 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5609b2359500 0x5609b235b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.987+0000 7fde0ca5f980 1 -- 172.21.15.157:0/3385172225 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609b235bfc0 con 0x5609b2359500 2024-05-09T09:47:30.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.987+0000 7fde0a57a640 1 --2- 172.21.15.157:0/3385172225 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5609b2359500 0x5609b235b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.991+0000 7fde0a57a640 1 --2- 172.21.15.157:0/3385172225 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5609b2359500 0x5609b235b8f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.991+0000 7fde0a57a640 1 -- 172.21.15.157:0/3385172225 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fddfc008030 con 0x5609b2359500 2024-05-09T09:47:30.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.991+0000 7fde0ca5f980 1 -- 172.21.15.157:0/3385172225 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609b23583a0 con 0x5609b2261cd0 2024-05-09T09:47:30.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.991+0000 7fde0ad7b640 1 -- 172.21.15.157:0/3385172225 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b2261cd0 2024-05-09T09:47:30.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.991+0000 7fde0ca5f980 1 --2- 172.21.15.157:0/3385172225 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5609b235d400 0x5609b235f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.991+0000 7fde0ca5f980 1 -- 172.21.15.157:0/3385172225 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609b235ff60 con 0x5609b235d400 2024-05-09T09:47:30.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.991+0000 7fde09d79640 1 --2- 172.21.15.157:0/3385172225 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5609b235d400 0x5609b235f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.991+0000 7fde09d79640 1 --2- 172.21.15.157:0/3385172225 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5609b235d400 0x5609b235f7f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.991+0000 7fde09d79640 1 -- 172.21.15.157:0/3385172225 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fde000ac8a0 con 0x5609b235d400 2024-05-09T09:47:30.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.995+0000 7fde0ca5f980 1 Processor -- start 2024-05-09T09:47:30.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.995+0000 7fde0ca5f980 1 -- start start 2024-05-09T09:47:30.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.995+0000 7fde0ca5f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b2387f90 0x5609b23883b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.995+0000 7fde0ca5f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5609b2165020 con 0x5609b2387f90 2024-05-09T09:47:30.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.995+0000 7fde0a57a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b2387f90 0x5609b23883b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.995+0000 7fde0a57a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b2387f90 0x5609b23883b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53650/0 (socket says 172.21.15.157:53650) 2024-05-09T09:47:30.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.995+0000 7fde0a57a640 1 -- 172.21.15.157:0/382956476 learned_addr learned my addr 172.21.15.157:0/382956476 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:30.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.995+0000 7fde0a57a640 1 -- 172.21.15.157:0/382956476 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609b23888f0 con 0x5609b2387f90 2024-05-09T09:47:30.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.999+0000 7fde0a57a640 1 --2- 172.21.15.157:0/382956476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b2387f90 0x5609b23883b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fddfc048b30 tx=0x7fddfc016ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:30.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.999+0000 7fdceeba2640 1 -- 172.21.15.157:0/382956476 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddfc018560 con 0x5609b2387f90 2024-05-09T09:47:30.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.999+0000 7fdceeba2640 1 -- 172.21.15.157:0/382956476 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddfc018700 con 0x5609b2387f90 2024-05-09T09:47:30.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.999+0000 7fdceeba2640 1 -- 172.21.15.157:0/382956476 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddfc00c960 con 0x5609b2387f90 2024-05-09T09:47:30.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.999+0000 7fde0ca5f980 1 -- 172.21.15.157:0/382956476 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609b2389380 con 0x5609b2387f90 2024-05-09T09:47:30.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.999+0000 7fde0ca5f980 1 -- 172.21.15.157:0/382956476 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609b2389860 con 0x5609b2387f90 2024-05-09T09:47:30.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.999+0000 7fdceeba2640 1 -- 172.21.15.157:0/382956476 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fddfc040060 con 0x5609b2387f90 2024-05-09T09:47:30.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.999+0000 7fdceeba2640 1 --2- 172.21.15.157:0/382956476 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdce4034bb0 0x7fdce4037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:30.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.999+0000 7fdceeba2640 1 -- 172.21.15.157:0/382956476 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fddfc02de00 con 0x5609b2387f90 2024-05-09T09:47:30.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.999+0000 7fde09d79640 1 --2- 172.21.15.157:0/382956476 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdce4034bb0 0x7fdce4037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:30.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.999+0000 7fde0ca5f980 1 Processor -- start 2024-05-09T09:47:31.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.999+0000 7fde0ca5f980 1 -- start start 2024-05-09T09:47:31.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.999+0000 7fde09d79640 1 --2- 172.21.15.157:0/382956476 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdce4034bb0 0x7fdce4037070 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fde0001b2c0 tx=0x7fde00005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.999+0000 7fde0ca5f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b2394f10 0x5609b2395330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.999+0000 7fde0ca5f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5609b2349110 con 0x5609b2394f10 2024-05-09T09:47:31.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.999+0000 7fde0a57a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b2394f10 0x5609b2395330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.999+0000 7fde0a57a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b2394f10 0x5609b2395330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53664/0 (socket says 172.21.15.157:53664) 2024-05-09T09:47:31.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:30.999+0000 7fde0a57a640 1 -- 172.21.15.157:0/1934931262 learned_addr learned my addr 172.21.15.157:0/1934931262 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:31.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.003+0000 7fde0a57a640 1 -- 172.21.15.157:0/1934931262 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609b2395900 con 0x5609b2394f10 2024-05-09T09:47:31.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.003+0000 7fde0a57a640 1 --2- 172.21.15.157:0/1934931262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b2394f10 0x5609b2395330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fddfc02ddb0 tx=0x7fddfc0386d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6646e844595ba0cf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.003+0000 7fdcecb9e640 1 -- 172.21.15.157:0/1934931262 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddfc05b070 con 0x5609b2394f10 2024-05-09T09:47:31.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.003+0000 7fdcecb9e640 1 -- 172.21.15.157:0/1934931262 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddfc02d5b0 con 0x5609b2394f10 2024-05-09T09:47:31.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.003+0000 7fdcecb9e640 1 -- 172.21.15.157:0/1934931262 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddfc050040 con 0x5609b2394f10 2024-05-09T09:47:31.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.003+0000 7fde0ca5f980 1 -- 172.21.15.157:0/1934931262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b2394f10 msgr2=0x5609b2395330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.003+0000 7fde0ca5f980 1 --2- 172.21.15.157:0/1934931262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b2394f10 0x5609b2395330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fddfc02ddb0 tx=0x7fddfc0386d0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.003+0000 7fde0ca5f980 1 -- 172.21.15.157:0/1934931262 shutdown_connections 2024-05-09T09:47:31.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.003+0000 7fde0ca5f980 1 --2- 172.21.15.157:0/1934931262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b2394f10 0x5609b2395330 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.003+0000 7fde0ca5f980 1 -- 172.21.15.157:0/1934931262 >> 172.21.15.157:0/1934931262 conn(0x5609b2391320 msgr2=0x5609b238f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:31.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.003+0000 7fde0ca5f980 1 -- 172.21.15.157:0/1934931262 shutdown_connections 2024-05-09T09:47:31.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.003+0000 7fde0ca5f980 1 -- 172.21.15.157:0/1934931262 wait complete. 2024-05-09T09:47:31.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.003+0000 7fde0ca5f980 1 Processor -- start 2024-05-09T09:47:31.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.003+0000 7fde0ca5f980 1 -- start start 2024-05-09T09:47:31.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.003+0000 7fde0ca5f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b2394f10 0x5609b239c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.003+0000 7fde0ca5f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5609b2395ee0 con 0x5609b2394f10 2024-05-09T09:47:31.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.003+0000 7fde0a57a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b2394f10 0x5609b239c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.003+0000 7fde0a57a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b2394f10 0x5609b239c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53678/0 (socket says 172.21.15.157:53678) 2024-05-09T09:47:31.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.003+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 learned_addr learned my addr 172.21.15.157:0/2298403959 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:31.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.003+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609b239c7c0 con 0x5609b2394f10 2024-05-09T09:47:31.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.003+0000 7fde0a57a640 1 --2- 172.21.15.157:0/2298403959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b2394f10 0x5609b239c280 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fddfc0385a0 tx=0x7fddfc04a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.003+0000 7fdcdaffd640 1 -- 172.21.15.157:0/2298403959 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddfc064070 con 0x5609b2394f10 2024-05-09T09:47:31.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.003+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609b239c7c0 con 0x5609b2394f10 2024-05-09T09:47:31.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.003+0000 7fdcdaffd640 1 -- 172.21.15.157:0/2298403959 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddfc042260 con 0x5609b2394f10 2024-05-09T09:47:31.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.003+0000 7fdcdaffd640 1 -- 172.21.15.157:0/2298403959 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddfc05b040 con 0x5609b2394f10 2024-05-09T09:47:31.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.003+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609b239c7c0 con 0x5609b2394f10 2024-05-09T09:47:31.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fdcdaffd640 1 -- 172.21.15.157:0/2298403959 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fddfc067070 con 0x5609b2394f10 2024-05-09T09:47:31.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fdcdaffd640 1 --2- 172.21.15.157:0/2298403959 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdcd4034bb0 0x7fdcd4037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fdcdaffd640 1 -- 172.21.15.157:0/2298403959 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fddfc005050 con 0x5609b2394f10 2024-05-09T09:47:31.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fde09d79640 1 --2- 172.21.15.157:0/2298403959 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdcd4034bb0 0x7fdcd4037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fde0ca5f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fde0ca5f980 1 --2- 172.21.15.157:0/2298403959 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5609b23a8df0 0x5609b23ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aba00 con 0x5609b23a8df0 2024-05-09T09:47:31.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fde0ad7b640 1 --2- 172.21.15.157:0/2298403959 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5609b23a8df0 0x5609b23ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fde09d79640 1 --2- 172.21.15.157:0/2298403959 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdcd4034bb0 0x7fdcd4037070 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fde0000a480 tx=0x7fde000a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fde0ad7b640 1 --2- 172.21.15.157:0/2298403959 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5609b23a8df0 0x5609b23ab2b0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fde0ca5f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fde0ca5f980 20 realm 2024-05-09T09:47:31.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fde0ca5f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609b23abe10 con 0x5609b23a8df0 2024-05-09T09:47:31.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fde0ca5f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fde0ca5f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:31.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fde0ca5f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609b23ac6e0 con 0x5609b23a8df0 2024-05-09T09:47:31.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fde0ca5f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fde0ca5f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x5609b23a8df0 2024-05-09T09:47:31.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fde0ca5f980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:31.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fde0ca5f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fde0ca5f980 1 --2- 172.21.15.157:0/2298403959 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5609b23ad7e0 0x5609b23afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609b23b01a0 con 0x5609b23ad7e0 2024-05-09T09:47:31.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.007+0000 7fde0a57a640 1 --2- 172.21.15.157:0/2298403959 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5609b23ad7e0 0x5609b23afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.011+0000 7fde0a57a640 1 --2- 172.21.15.157:0/2298403959 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5609b23ad7e0 0x5609b23afbd0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.011+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fddfc070070 con 0x5609b23ad7e0 2024-05-09T09:47:31.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.011+0000 7fde0ca5f980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:31.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.011+0000 7fde0ca5f980 20 searching for the correct realm 2024-05-09T09:47:31.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.011+0000 7fde0ca5f980 1 --2- 172.21.15.157:0/2298403959 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5609b23b20f0 0x5609b23b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.011+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23b4bf0 con 0x5609b23b20f0 2024-05-09T09:47:31.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.011+0000 7fde09d79640 1 --2- 172.21.15.157:0/2298403959 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5609b23b20f0 0x5609b23b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.011+0000 7fde09d79640 1 --2- 172.21.15.157:0/2298403959 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5609b23b20f0 0x5609b23b4520 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.011+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde000da070 con 0x5609b23b20f0 2024-05-09T09:47:31.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.011+0000 7fde09d79640 1 --2- 172.21.15.157:0/2298403959 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fde000cf040 0x7fde000b8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.011+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23b4bf0 con 0x7fde000cf040 2024-05-09T09:47:31.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.011+0000 7fde0ad7b640 1 --2- 172.21.15.157:0/2298403959 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fde000cf040 0x7fde000b8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.011+0000 7fde0ad7b640 1 --2- 172.21.15.157:0/2298403959 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fde000cf040 0x7fde000b8430 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.011+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde0400a4d0 con 0x7fde000cf040 2024-05-09T09:47:31.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.011+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x5609b23ad7e0 2024-05-09T09:47:31.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.011+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddfc070070 con 0x5609b23ad7e0 2024-05-09T09:47:31.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.011+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x5609b23a8df0 2024-05-09T09:47:31.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.015+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.015+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x5609b23a8df0 2024-05-09T09:47:31.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.015+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.015+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x5609b23ad7e0 2024-05-09T09:47:31.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.015+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddfc070070 con 0x5609b23ad7e0 2024-05-09T09:47:31.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.015+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x5609b23ad7e0 2024-05-09T09:47:31.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.015+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddfc070070 con 0x5609b23ad7e0 2024-05-09T09:47:31.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.015+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x7fde000cf040 2024-05-09T09:47:31.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.015+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde0400a4d0 con 0x7fde000cf040 2024-05-09T09:47:31.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.015+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x5609b23b20f0 2024-05-09T09:47:31.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.015+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde000da070 con 0x5609b23b20f0 2024-05-09T09:47:31.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.015+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x5609b23a8df0 2024-05-09T09:47:31.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.015+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.015+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x5609b23ad7e0 2024-05-09T09:47:31.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.019+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddfc070070 con 0x5609b23ad7e0 2024-05-09T09:47:31.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.019+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x5609b23a8df0 2024-05-09T09:47:31.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.019+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.019+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x7fde000cf040 2024-05-09T09:47:31.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.019+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fde0400a4d0 con 0x7fde000cf040 2024-05-09T09:47:31.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.019+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x5609b23b20f0 2024-05-09T09:47:31.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.019+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde000da070 con 0x5609b23b20f0 2024-05-09T09:47:31.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.019+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x5609b23b20f0 2024-05-09T09:47:31.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.019+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fde000da070 con 0x5609b23b20f0 2024-05-09T09:47:31.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.019+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x5609b23ad7e0 2024-05-09T09:47:31.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.019+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddfc070070 con 0x5609b23ad7e0 2024-05-09T09:47:31.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.019+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x5609b23b20f0 2024-05-09T09:47:31.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.019+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde000da070 con 0x5609b23b20f0 2024-05-09T09:47:31.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.019+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x5609b23b20f0 2024-05-09T09:47:31.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.019+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde000da070 con 0x5609b23b20f0 2024-05-09T09:47:31.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.019+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x5609b23a8df0 2024-05-09T09:47:31.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.019+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.019+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x5609b23a8df0 2024-05-09T09:47:31.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.019+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.019+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x5609b23ad7e0 2024-05-09T09:47:31.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.023+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddfc070070 con 0x5609b23ad7e0 2024-05-09T09:47:31.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.023+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x5609b23b20f0 2024-05-09T09:47:31.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.023+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde000da070 con 0x5609b23b20f0 2024-05-09T09:47:31.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.023+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x7fde000cf040 2024-05-09T09:47:31.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.023+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde0400a4d0 con 0x7fde000cf040 2024-05-09T09:47:31.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.023+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x5609b23a8df0 2024-05-09T09:47:31.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.023+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.023+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x5609b23ad7e0 2024-05-09T09:47:31.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.023+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fddfc070070 con 0x5609b23ad7e0 2024-05-09T09:47:31.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.023+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x5609b23b20f0 2024-05-09T09:47:31.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.023+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde000da070 con 0x5609b23b20f0 2024-05-09T09:47:31.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.023+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x5609b23ad7e0 2024-05-09T09:47:31.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.023+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddfc070070 con 0x5609b23ad7e0 2024-05-09T09:47:31.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.023+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x7fde000cf040 2024-05-09T09:47:31.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.023+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde0400a4d0 con 0x7fde000cf040 2024-05-09T09:47:31.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.023+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x5609b23b20f0 2024-05-09T09:47:31.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.023+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde000da070 con 0x5609b23b20f0 2024-05-09T09:47:31.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.023+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x5609b23ad7e0 2024-05-09T09:47:31.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddfc070070 con 0x5609b23ad7e0 2024-05-09T09:47:31.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x5609b23a8df0 2024-05-09T09:47:31.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5609b23aca80 con 0x7fde000cf040 2024-05-09T09:47:31.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde0400a4d0 con 0x7fde000cf040 2024-05-09T09:47:31.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:31.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:31.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:31.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:31.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:31.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:31.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609b23b0a60 con 0x5609b23a8df0 2024-05-09T09:47:31.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609b23b0a60 con 0x5609b23a8df0 2024-05-09T09:47:31.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:31.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609b23b0a60 con 0x5609b23b20f0 2024-05-09T09:47:31.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fde000da070 con 0x5609b23b20f0 2024-05-09T09:47:31.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:31.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 20 zone default found 2024-05-09T09:47:31.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 4 Realm: () 2024-05-09T09:47:31.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:31.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:31.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:31.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 20 zonegroup default 2024-05-09T09:47:31.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609b23b13f0 con 0x5609b23ad7e0 2024-05-09T09:47:31.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fddfc070070 con 0x5609b23ad7e0 2024-05-09T09:47:31.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609b23b6ae0 con 0x5609b23b20f0 2024-05-09T09:47:31.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fde000da070 con 0x5609b23b20f0 2024-05-09T09:47:31.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609b23b6ff0 con 0x5609b23b20f0 2024-05-09T09:47:31.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fde000da070 con 0x5609b23b20f0 2024-05-09T09:47:31.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 20 started sync module instance, tier type = 2024-05-09T09:47:31.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:31.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.027+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23b5ef0 con 0x7fde000cf040 2024-05-09T09:47:31.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.031+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x7fde000cf040 2024-05-09T09:47:31.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.031+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94599644931056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23b5ef0 con 0x7fde000cf040 2024-05-09T09:47:31.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.031+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23b7a70 con 0x5609b23a8df0 2024-05-09T09:47:31.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.031+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94599644931056] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x7fde000cf040 2024-05-09T09:47:31.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.031+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.031+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94599644935888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23b5ef0 con 0x5609b23a8df0 2024-05-09T09:47:31.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.031+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23b8480 con 0x5609b23b20f0 2024-05-09T09:47:31.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.035+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde000da070 con 0x5609b23b20f0 2024-05-09T09:47:31.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.035+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94599644938192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23b8cd0 con 0x5609b23b20f0 2024-05-09T09:47:31.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.035+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23b96d0 con 0x7fde000cf040 2024-05-09T09:47:31.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.035+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94599644935888] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.035+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x7fde000cf040 2024-05-09T09:47:31.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.035+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94599644928576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23b9ac0 con 0x7fde000cf040 2024-05-09T09:47:31.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.035+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23ba480 con 0x5609b23a8df0 2024-05-09T09:47:31.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.035+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94599644938192] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde000da070 con 0x5609b23b20f0 2024-05-09T09:47:31.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.035+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94599644928576] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x7fde000cf040 2024-05-09T09:47:31.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.039+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.039+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94599644942816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23b9fd0 con 0x5609b23a8df0 2024-05-09T09:47:31.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.039+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23ba820 con 0x5609b23ad7e0 2024-05-09T09:47:31.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.039+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94599644942816] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.039+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddfc070070 con 0x5609b23ad7e0 2024-05-09T09:47:31.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.039+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94599644946384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23ba3f0 con 0x5609b23ad7e0 2024-05-09T09:47:31.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.039+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23bb570 con 0x5609b23ad7e0 2024-05-09T09:47:31.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.043+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddfc070070 con 0x5609b23ad7e0 2024-05-09T09:47:31.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.043+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94599644950720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23bba10 con 0x5609b23ad7e0 2024-05-09T09:47:31.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.043+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23bc510 con 0x5609b23ad7e0 2024-05-09T09:47:31.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.043+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94599644946384] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddfc070070 con 0x5609b23ad7e0 2024-05-09T09:47:31.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.043+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94599644950720] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddfc070070 con 0x5609b23ad7e0 2024-05-09T09:47:31.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.043+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddfc070070 con 0x5609b23ad7e0 2024-05-09T09:47:31.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.043+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94599644951776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23babe0 con 0x5609b23ad7e0 2024-05-09T09:47:31.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.043+0000 7fde0ca5f980 20 add_watcher() i=0 2024-05-09T09:47:31.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.043+0000 7fde0ca5f980 20 add_watcher() i=1 2024-05-09T09:47:31.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.043+0000 7fde0ca5f980 20 add_watcher() i=2 2024-05-09T09:47:31.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.043+0000 7fde0ca5f980 20 add_watcher() i=3 2024-05-09T09:47:31.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.043+0000 7fde0ca5f980 20 add_watcher() i=4 2024-05-09T09:47:31.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.043+0000 7fde0ca5f980 20 add_watcher() i=5 2024-05-09T09:47:31.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.043+0000 7fde0ca5f980 20 add_watcher() i=6 2024-05-09T09:47:31.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.047+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94599644951776] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddfc070070 con 0x5609b23ad7e0 2024-05-09T09:47:31.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.047+0000 7fde0ca5f980 20 add_watcher() i=7 2024-05-09T09:47:31.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.047+0000 7fde0ca5f980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:31.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.047+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609b23bf500 con 0x5609b23a8df0 2024-05-09T09:47:31.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.047+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.047+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94599644954624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23bc980 con 0x5609b23a8df0 2024-05-09T09:47:31.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.047+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94599644954624] v30'44 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.047+0000 7fdcbf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:31.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.047+0000 7fde0ca5f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:31.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.047+0000 7fde0ca5f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:31.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.047+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23c7d40 con 0x5609b23a8df0 2024-05-09T09:47:31.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.051+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.051+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23c8390 con 0x5609b23ad7e0 2024-05-09T09:47:31.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.055+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'14 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fddfc070070 con 0x5609b23ad7e0 2024-05-09T09:47:31.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.055+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23c8390 con 0x5609b23b20f0 2024-05-09T09:47:31.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.055+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fde000da070 con 0x5609b23b20f0 2024-05-09T09:47:31.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.055+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23c7870 con 0x5609b23a8df0 2024-05-09T09:47:31.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.055+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'45 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.055+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23c9060 con 0x7fde000cf040 2024-05-09T09:47:31.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.059+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'32 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x7fde000cf040 2024-05-09T09:47:31.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.059+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23c94c0 con 0x5609b23b20f0 2024-05-09T09:47:31.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.059+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'21 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fde000da070 con 0x5609b23b20f0 2024-05-09T09:47:31.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.059+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23c9940 con 0x5609b23a8df0 2024-05-09T09:47:31.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.059+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.059+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23c9df0 con 0x5609b23ad7e0 2024-05-09T09:47:31.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.063+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'21 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fddfc070070 con 0x5609b23ad7e0 2024-05-09T09:47:31.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.063+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23c9df0 con 0x7fde000cf040 2024-05-09T09:47:31.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.067+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x7fde000cf040 2024-05-09T09:47:31.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.067+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23c9df0 con 0x5609b23b20f0 2024-05-09T09:47:31.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.067+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fde000da070 con 0x5609b23b20f0 2024-05-09T09:47:31.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.067+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23ca360 con 0x7fde000cf040 2024-05-09T09:47:31.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.067+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x7fde000cf040 2024-05-09T09:47:31.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.067+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23ca360 con 0x5609b23ad7e0 2024-05-09T09:47:31.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.071+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fddfc070070 con 0x5609b23ad7e0 2024-05-09T09:47:31.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.071+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23ca3f0 con 0x7fde000cf040 2024-05-09T09:47:31.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.071+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x7fde000cf040 2024-05-09T09:47:31.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.071+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23ca5c0 con 0x5609b23ad7e0 2024-05-09T09:47:31.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.075+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'27 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fddfc070070 con 0x5609b23ad7e0 2024-05-09T09:47:31.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.075+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23ca5c0 con 0x5609b23a8df0 2024-05-09T09:47:31.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.079+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'46 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.079+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23ca5c0 con 0x5609b23b20f0 2024-05-09T09:47:31.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.079+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde000da070 con 0x5609b23b20f0 2024-05-09T09:47:31.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.079+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23ca5c0 con 0x7fde000cf040 2024-05-09T09:47:31.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.083+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x7fde000cf040 2024-05-09T09:47:31.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.083+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23ca5c0 con 0x5609b23b20f0 2024-05-09T09:47:31.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.083+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde000da070 con 0x5609b23b20f0 2024-05-09T09:47:31.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.083+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23ca5c0 con 0x5609b23a8df0 2024-05-09T09:47:31.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.083+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.087+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23ca5c0 con 0x5609b23a8df0 2024-05-09T09:47:31.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.087+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'47 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.087+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23ca5c0 con 0x5609b23b20f0 2024-05-09T09:47:31.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.087+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde000da070 con 0x5609b23b20f0 2024-05-09T09:47:31.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.087+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23ca5c0 con 0x7fde000cf040 2024-05-09T09:47:31.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.091+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x7fde000cf040 2024-05-09T09:47:31.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.091+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23ca5c0 con 0x5609b23b20f0 2024-05-09T09:47:31.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.091+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde000da070 con 0x5609b23b20f0 2024-05-09T09:47:31.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.091+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23ca5c0 con 0x5609b23b20f0 2024-05-09T09:47:31.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.095+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde000da070 con 0x5609b23b20f0 2024-05-09T09:47:31.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.095+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23ca5c0 con 0x5609b23b20f0 2024-05-09T09:47:31.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.095+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde000da070 con 0x5609b23b20f0 2024-05-09T09:47:31.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.095+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23ca5c0 con 0x5609b23b20f0 2024-05-09T09:47:31.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.095+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'22 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde000da070 con 0x5609b23b20f0 2024-05-09T09:47:31.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.095+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23ca5c0 con 0x5609b23ad7e0 2024-05-09T09:47:31.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.099+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fddfc070070 con 0x5609b23ad7e0 2024-05-09T09:47:31.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.099+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23ca3e0 con 0x5609b23b20f0 2024-05-09T09:47:31.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.103+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde000da070 con 0x5609b23b20f0 2024-05-09T09:47:31.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.103+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23ca3e0 con 0x5609b23ad7e0 2024-05-09T09:47:31.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.103+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'22 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fddfc070070 con 0x5609b23ad7e0 2024-05-09T09:47:31.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.107+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23ca3e0 con 0x5609b23b20f0 2024-05-09T09:47:31.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.107+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'28 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde000da070 con 0x5609b23b20f0 2024-05-09T09:47:31.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.107+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23ca3e0 con 0x5609b23ad7e0 2024-05-09T09:47:31.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.111+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'28 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fddfc070070 con 0x5609b23ad7e0 2024-05-09T09:47:31.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.111+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23ca3e0 con 0x7fde000cf040 2024-05-09T09:47:31.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.111+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x7fde000cf040 2024-05-09T09:47:31.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.111+0000 7fdcbe7e4640 20 reqs_thread_entry: start 2024-05-09T09:47:31.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.111+0000 7fde0ca5f980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:31.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.115+0000 7fdc2ffff640 20 reqs_thread_entry: start 2024-05-09T09:47:31.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.115+0000 7fde0ca5f980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-09T09:47:31.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.115+0000 7fde0ca5f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.115+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5609b23c5a20 con 0x5609b23a8df0 2024-05-09T09:47:31.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.115+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.115+0000 7fde0ca5f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.115+0000 7fde0ca5f980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-05-09T09:47:31.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.115+0000 7fde0ca5f980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:31.113 INFO:teuthology.orchestra.run.smithi157.stderr:could not remove user: unable to remove user, user does not exist 2024-05-09T09:47:31.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.115+0000 7fdcbf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:31.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.115+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94599644954624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23c4c00 con 0x5609b23a8df0 2024-05-09T09:47:31.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.115+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94599644954624] v30'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.115+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94599644931056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23bc000 con 0x7fde000cf040 2024-05-09T09:47:31.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.119+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94599644931056] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x7fde000cf040 2024-05-09T09:47:31.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.119+0000 7fde0ca5f980 20 remove_watcher() i=0 2024-05-09T09:47:31.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.119+0000 7fde0ca5f980 2 removed watcher, disabling cache 2024-05-09T09:47:31.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.119+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94599644935888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23bc000 con 0x5609b23a8df0 2024-05-09T09:47:31.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.119+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94599644935888] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.119+0000 7fde0ca5f980 20 remove_watcher() i=1 2024-05-09T09:47:31.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.119+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94599644938192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23b76d0 con 0x5609b23b20f0 2024-05-09T09:47:31.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.123+0000 7fde09d79640 1 -- 172.21.15.157:0/2298403959 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94599644938192] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde000da070 con 0x5609b23b20f0 2024-05-09T09:47:31.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.123+0000 7fde0ca5f980 20 remove_watcher() i=2 2024-05-09T09:47:31.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.123+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94599644928576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23bc000 con 0x7fde000cf040 2024-05-09T09:47:31.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.123+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94599644928576] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x7fde000cf040 2024-05-09T09:47:31.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.123+0000 7fde0ca5f980 20 remove_watcher() i=3 2024-05-09T09:47:31.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.123+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94599644942816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23b7fd0 con 0x5609b23a8df0 2024-05-09T09:47:31.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.127+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94599644942816] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde0400a4d0 con 0x5609b23a8df0 2024-05-09T09:47:31.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.127+0000 7fde0ca5f980 20 remove_watcher() i=4 2024-05-09T09:47:31.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.127+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94599644946384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23b76d0 con 0x5609b23ad7e0 2024-05-09T09:47:31.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.127+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94599644946384] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddfc070070 con 0x5609b23ad7e0 2024-05-09T09:47:31.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.127+0000 7fde0ca5f980 20 remove_watcher() i=5 2024-05-09T09:47:31.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.127+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94599644950720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23b5a40 con 0x5609b23ad7e0 2024-05-09T09:47:31.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.131+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94599644950720] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddfc070070 con 0x5609b23ad7e0 2024-05-09T09:47:31.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.131+0000 7fde0ca5f980 20 remove_watcher() i=6 2024-05-09T09:47:31.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.131+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94599644951776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5609b23bc000 con 0x5609b23ad7e0 2024-05-09T09:47:31.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0a57a640 1 -- 172.21.15.157:0/2298403959 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94599644951776] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddfc070070 con 0x5609b23ad7e0 2024-05-09T09:47:31.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 20 remove_watcher() i=7 2024-05-09T09:47:31.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5609b23ad7e0 msgr2=0x5609b23afbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 --2- 172.21.15.157:0/2298403959 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5609b23ad7e0 0x5609b23afbd0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5609b23a8df0 msgr2=0x5609b23ab2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 --2- 172.21.15.157:0/2298403959 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5609b23a8df0 0x5609b23ab2b0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fde000cf040 msgr2=0x7fde000b8430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 --2- 172.21.15.157:0/2298403959 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fde000cf040 0x7fde000b8430 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5609b23b20f0 msgr2=0x5609b23b4520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 --2- 172.21.15.157:0/2298403959 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5609b23b20f0 0x5609b23b4520 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdcd4034bb0 msgr2=0x7fdcd4037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 --2- 172.21.15.157:0/2298403959 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdcd4034bb0 0x7fdcd4037070 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fde0000a480 tx=0x7fde000a6000 comp rx=0 tx=0).stop 2024-05-09T09:47:31.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ad7b640 1 -- 172.21.15.157:0/2298403959 reap_dead start 2024-05-09T09:47:31.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b2394f10 msgr2=0x5609b239c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 --2- 172.21.15.157:0/2298403959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b2394f10 0x5609b239c280 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fddfc0385a0 tx=0x7fddfc04a6f0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 shutdown_connections 2024-05-09T09:47:31.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 --2- 172.21.15.157:0/2298403959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b2394f10 0x5609b239c280 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 >> 172.21.15.157:0/2298403959 conn(0x5609b2391320 msgr2=0x5609b238e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:31.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 shutdown_connections 2024-05-09T09:47:31.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 -- 172.21.15.157:0/2298403959 wait complete. 2024-05-09T09:47:31.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 -- 172.21.15.157:0/382956476 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdce4034bb0 msgr2=0x7fdce4037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 --2- 172.21.15.157:0/382956476 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdce4034bb0 0x7fdce4037070 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fde0001b2c0 tx=0x7fde00005a10 comp rx=0 tx=0).stop 2024-05-09T09:47:31.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 -- 172.21.15.157:0/382956476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b2387f90 msgr2=0x5609b23883b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 --2- 172.21.15.157:0/382956476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b2387f90 0x5609b23883b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fddfc048b30 tx=0x7fddfc016ed0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 -- 172.21.15.157:0/382956476 shutdown_connections 2024-05-09T09:47:31.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 --2- 172.21.15.157:0/382956476 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdce4034bb0 0x7fdce4037070 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 --2- 172.21.15.157:0/382956476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b2387f90 0x5609b23883b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 -- 172.21.15.157:0/382956476 >> 172.21.15.157:0/382956476 conn(0x5609b225c930 msgr2=0x5609b225cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:31.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 -- 172.21.15.157:0/382956476 shutdown_connections 2024-05-09T09:47:31.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 -- 172.21.15.157:0/382956476 wait complete. 2024-05-09T09:47:31.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 -- 172.21.15.157:0/3385172225 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5609b2359500 msgr2=0x5609b235b8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 --2- 172.21.15.157:0/3385172225 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5609b2359500 0x5609b235b8f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 -- 172.21.15.157:0/3385172225 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5609b2261cd0 msgr2=0x5609b2356b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 --2- 172.21.15.157:0/3385172225 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5609b2261cd0 0x5609b2356b90 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 -- 172.21.15.157:0/3385172225 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5609b235d400 msgr2=0x5609b235f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 --2- 172.21.15.157:0/3385172225 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5609b235d400 0x5609b235f7f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 -- 172.21.15.157:0/3385172225 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdcf0034bb0 msgr2=0x7fdcf0037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 --2- 172.21.15.157:0/3385172225 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdcf0034bb0 0x7fdcf0037070 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fde000ad000 tx=0x7fde000a5040 comp rx=0 tx=0).stop 2024-05-09T09:47:31.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 -- 172.21.15.157:0/3385172225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b21d1ab0 msgr2=0x5609b234fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 --2- 172.21.15.157:0/3385172225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5609b21d1ab0 0x5609b234fba0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x5609b2349850 tx=0x7fddfc000bd0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ad7b640 1 -- 172.21.15.157:0/3385172225 reap_dead start 2024-05-09T09:47:31.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 -- 172.21.15.157:0/3385172225 shutdown_connections 2024-05-09T09:47:31.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 -- 172.21.15.157:0/3385172225 >> 172.21.15.157:0/3385172225 conn(0x5609b22580d0 msgr2=0x5609b2343060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:31.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 -- 172.21.15.157:0/3385172225 shutdown_connections 2024-05-09T09:47:31.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.135+0000 7fde0ca5f980 1 -- 172.21.15.157:0/3385172225 wait complete. 2024-05-09T09:47:31.146 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-09T09:47:31.146 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-05-09T09:47:31.147 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-05-09T09:47:31.147 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-05-09T09:47:31.227 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:31.227 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:31.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.227+0000 7f77afcb6980 1 Processor -- start 2024-05-09T09:47:31.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.231+0000 7f77afcb6980 1 -- start start 2024-05-09T09:47:31.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.231+0000 7f77afcb6980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55a1c7015060 0x55a1c7017450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.231+0000 7f77afcb6980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a1c6ec4440 con 0x55a1c7010b50 2024-05-09T09:47:31.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.231+0000 7f77afcb6980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55a1c6eaf5f0 con 0x55a1c7015060 2024-05-09T09:47:31.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.231+0000 7f77acfd0640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55a1c7015060 0x55a1c7017450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.231+0000 7f77acfd0640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55a1c7015060 0x55a1c7017450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53684/0 (socket says 172.21.15.157:53684) 2024-05-09T09:47:31.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.231+0000 7f77acfd0640 1 -- 172.21.15.157:0/3364346068 learned_addr learned my addr 172.21.15.157:0/3364346068 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:31.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.231+0000 7f77ad7d1640 1 --1- 172.21.15.157:0/3364346068 >> v1:172.21.15.110:6789/0 conn(0x55a1c7010b50 0x55a1c7010f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:33548/0 (socket says 172.21.15.157:33548) 2024-05-09T09:47:31.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.231+0000 7f77acfd0640 1 -- 172.21.15.157:0/3364346068 >> v1:172.21.15.110:6789/0 conn(0x55a1c7010b50 legacy=0x55a1c7010f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.231+0000 7f77acfd0640 1 -- 172.21.15.157:0/3364346068 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1c6eba990 con 0x55a1c7015060 2024-05-09T09:47:31.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.231+0000 7f77acfd0640 1 --2- 172.21.15.157:0/3364346068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7015060 0x55a1c7017450 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f77a400a5c0 tx=0x7f77a401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a283a279563395dd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.235+0000 7f779ffff640 1 -- 172.21.15.157:0/3364346068 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77a40a6070 con 0x55a1c7015060 2024-05-09T09:47:31.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.235+0000 7f779ffff640 1 -- 172.21.15.157:0/3364346068 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77a40af070 con 0x55a1c7015060 2024-05-09T09:47:31.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.235+0000 7f779ffff640 1 -- 172.21.15.157:0/3364346068 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77a40aa5c0 con 0x55a1c7015060 2024-05-09T09:47:31.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.235+0000 7f77afcb6980 1 -- 172.21.15.157:0/3364346068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7015060 msgr2=0x55a1c7017450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.235+0000 7f77afcb6980 1 --2- 172.21.15.157:0/3364346068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7015060 0x55a1c7017450 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f77a400a5c0 tx=0x7f77a401b340 comp rx=0 tx=0).stop 2024-05-09T09:47:31.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.235+0000 7f77afcb6980 1 -- 172.21.15.157:0/3364346068 shutdown_connections 2024-05-09T09:47:31.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.235+0000 7f77afcb6980 1 --2- 172.21.15.157:0/3364346068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7015060 0x55a1c7017450 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.235+0000 7f77afcb6980 1 -- 172.21.15.157:0/3364346068 >> 172.21.15.157:0/3364346068 conn(0x55a1c6f842a0 msgr2=0x55a1c6f846b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:31.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.235+0000 7f77afcb6980 1 -- 172.21.15.157:0/3364346068 shutdown_connections 2024-05-09T09:47:31.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.235+0000 7f77afcb6980 1 -- 172.21.15.157:0/3364346068 wait complete. 2024-05-09T09:47:31.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.247+0000 7f77afcb6980 1 Processor -- start 2024-05-09T09:47:31.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.251+0000 7f77afcb6980 1 -- start start 2024-05-09T09:47:31.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.251+0000 7f77afcb6980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7010b50 0x55a1c70fbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.251+0000 7f77afcb6980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55a1c6f11fe0 con 0x55a1c7010b50 2024-05-09T09:47:31.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.251+0000 7f77ad7d1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7010b50 0x55a1c70fbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.251+0000 7f77ad7d1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7010b50 0x55a1c70fbd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53690/0 (socket says 172.21.15.157:53690) 2024-05-09T09:47:31.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.251+0000 7f77ad7d1640 1 -- 172.21.15.157:0/280633046 learned_addr learned my addr 172.21.15.157:0/280633046 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:31.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.251+0000 7f77ad7d1640 1 -- 172.21.15.157:0/280633046 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1c6e96ae0 con 0x55a1c7010b50 2024-05-09T09:47:31.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.251+0000 7f77ad7d1640 1 --2- 172.21.15.157:0/280633046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7010b50 0x55a1c70fbd80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f77a80015f0 tx=0x7f77a8001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb4aa9a9f86aed8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.251+0000 7f769b606640 1 -- 172.21.15.157:0/280633046 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77a8013420 con 0x55a1c7010b50 2024-05-09T09:47:31.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.251+0000 7f769b606640 1 -- 172.21.15.157:0/280633046 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77a80135e0 con 0x55a1c7010b50 2024-05-09T09:47:31.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.251+0000 7f769b606640 1 -- 172.21.15.157:0/280633046 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77a8013940 con 0x55a1c7010b50 2024-05-09T09:47:31.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.251+0000 7f77afcb6980 1 -- 172.21.15.157:0/280633046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7010b50 msgr2=0x55a1c70fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.251+0000 7f77afcb6980 1 --2- 172.21.15.157:0/280633046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7010b50 0x55a1c70fbd80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f77a80015f0 tx=0x7f77a8001ab0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.251+0000 7f77afcb6980 1 -- 172.21.15.157:0/280633046 shutdown_connections 2024-05-09T09:47:31.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.251+0000 7f77afcb6980 1 --2- 172.21.15.157:0/280633046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7010b50 0x55a1c70fbd80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.251+0000 7f77afcb6980 1 -- 172.21.15.157:0/280633046 >> 172.21.15.157:0/280633046 conn(0x55a1c6f842a0 msgr2=0x55a1c70f7910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:31.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.251+0000 7f77afcb6980 1 -- 172.21.15.157:0/280633046 shutdown_connections 2024-05-09T09:47:31.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.251+0000 7f77afcb6980 1 -- 172.21.15.157:0/280633046 wait complete. 2024-05-09T09:47:31.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.251+0000 7f77afcb6980 1 Processor -- start 2024-05-09T09:47:31.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.251+0000 7f77afcb6980 1 -- start start 2024-05-09T09:47:31.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.251+0000 7f77afcb6980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7010b50 0x55a1c7102f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.251+0000 7f77afcb6980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55a1c701a480 con 0x55a1c7010b50 2024-05-09T09:47:31.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.251+0000 7f77ad7d1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7010b50 0x55a1c7102f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.251+0000 7f77ad7d1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7010b50 0x55a1c7102f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53692/0 (socket says 172.21.15.157:53692) 2024-05-09T09:47:31.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.251+0000 7f77ad7d1640 1 -- 172.21.15.157:0/828495452 learned_addr learned my addr 172.21.15.157:0/828495452 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:31.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.255+0000 7f77ad7d1640 1 -- 172.21.15.157:0/828495452 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1c7103490 con 0x55a1c7010b50 2024-05-09T09:47:31.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.255+0000 7f77ad7d1640 1 --2- 172.21.15.157:0/828495452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7010b50 0x55a1c7102f50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f77a8006640 tx=0x7f77a8000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.255+0000 7f7699e03640 1 -- 172.21.15.157:0/828495452 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77a8022020 con 0x55a1c7010b50 2024-05-09T09:47:31.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.255+0000 7f7699e03640 1 -- 172.21.15.157:0/828495452 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77a8006320 con 0x55a1c7010b50 2024-05-09T09:47:31.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.255+0000 7f7699e03640 1 -- 172.21.15.157:0/828495452 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77a8004af0 con 0x55a1c7010b50 2024-05-09T09:47:31.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.255+0000 7f77afcb6980 1 -- 172.21.15.157:0/828495452 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a1c7103720 con 0x55a1c7010b50 2024-05-09T09:47:31.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.255+0000 7f77afcb6980 1 -- 172.21.15.157:0/828495452 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1c7106400 con 0x55a1c7010b50 2024-05-09T09:47:31.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.255+0000 7f7699e03640 1 -- 172.21.15.157:0/828495452 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f77a8025020 con 0x55a1c7010b50 2024-05-09T09:47:31.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.255+0000 7f7699e03640 1 --2- 172.21.15.157:0/828495452 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f7694034bb0 0x7f7694037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.255+0000 7f7699e03640 1 -- 172.21.15.157:0/828495452 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f77a8018030 con 0x55a1c7010b50 2024-05-09T09:47:31.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.255+0000 7f77acfd0640 1 --2- 172.21.15.157:0/828495452 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f7694034bb0 0x7f7694037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.255+0000 7f77acfd0640 1 --2- 172.21.15.157:0/828495452 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f7694034bb0 0x7f7694037070 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f77a40ae000 tx=0x7f77a40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.259+0000 7f77afcb6980 1 Processor -- start 2024-05-09T09:47:31.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.259+0000 7f77afcb6980 1 -- start start 2024-05-09T09:47:31.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.259+0000 7f77afcb6980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7128150 0x55a1c7128570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.259+0000 7f77afcb6980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55a1c6f16020 con 0x55a1c7128150 2024-05-09T09:47:31.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.259+0000 7f77ad7d1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7128150 0x55a1c7128570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.259+0000 7f77ad7d1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7128150 0x55a1c7128570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53704/0 (socket says 172.21.15.157:53704) 2024-05-09T09:47:31.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.259+0000 7f77ad7d1640 1 -- 172.21.15.157:0/407966852 learned_addr learned my addr 172.21.15.157:0/407966852 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:31.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.259+0000 7f77ad7d1640 1 -- 172.21.15.157:0/407966852 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1c7128ab0 con 0x55a1c7128150 2024-05-09T09:47:31.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.259+0000 7f77ad7d1640 1 --2- 172.21.15.157:0/407966852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7128150 0x55a1c7128570 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f77a8048bc0 tx=0x7f77a8048dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c2bb893841febc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.259+0000 7f76923a1640 1 -- 172.21.15.157:0/407966852 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77a8046070 con 0x55a1c7128150 2024-05-09T09:47:31.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.259+0000 7f76923a1640 1 -- 172.21.15.157:0/407966852 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77a801d480 con 0x55a1c7128150 2024-05-09T09:47:31.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.259+0000 7f76923a1640 1 -- 172.21.15.157:0/407966852 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77a801ede0 con 0x55a1c7128150 2024-05-09T09:47:31.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.259+0000 7f77afcb6980 1 -- 172.21.15.157:0/407966852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7128150 msgr2=0x55a1c7128570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.259+0000 7f77afcb6980 1 --2- 172.21.15.157:0/407966852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7128150 0x55a1c7128570 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f77a8048bc0 tx=0x7f77a8048dc0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.259+0000 7f77afcb6980 1 -- 172.21.15.157:0/407966852 shutdown_connections 2024-05-09T09:47:31.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.259+0000 7f77afcb6980 1 --2- 172.21.15.157:0/407966852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7128150 0x55a1c7128570 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.259+0000 7f77afcb6980 1 -- 172.21.15.157:0/407966852 >> 172.21.15.157:0/407966852 conn(0x55a1c7015060 msgr2=0x55a1c7123590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:31.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.259+0000 7f77afcb6980 1 -- 172.21.15.157:0/407966852 shutdown_connections 2024-05-09T09:47:31.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.259+0000 7f77afcb6980 1 -- 172.21.15.157:0/407966852 wait complete. 2024-05-09T09:47:31.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.263+0000 7f77afcb6980 1 Processor -- start 2024-05-09T09:47:31.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.263+0000 7f77afcb6980 1 -- start start 2024-05-09T09:47:31.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.263+0000 7f77afcb6980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7128150 0x55a1c712f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.263+0000 7f77afcb6980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55a1c7129460 con 0x55a1c7128150 2024-05-09T09:47:31.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.263+0000 7f77ad7d1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7128150 0x55a1c712f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.263+0000 7f77ad7d1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7128150 0x55a1c712f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53706/0 (socket says 172.21.15.157:53706) 2024-05-09T09:47:31.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.263+0000 7f77ad7d1640 1 -- 172.21.15.157:0/3800627773 learned_addr learned my addr 172.21.15.157:0/3800627773 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:31.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.263+0000 7f77ad7d1640 1 -- 172.21.15.157:0/3800627773 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1c712fbe0 con 0x55a1c7128150 2024-05-09T09:47:31.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.263+0000 7f77ad7d1640 1 --2- 172.21.15.157:0/3800627773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7128150 0x55a1c712f6a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f77a8010f50 tx=0x7f77a8048b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.263+0000 7f7690b9e640 1 -- 172.21.15.157:0/3800627773 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77a8050070 con 0x55a1c7128150 2024-05-09T09:47:31.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.263+0000 7f77afcb6980 1 -- 172.21.15.157:0/3800627773 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a1c712fbe0 con 0x55a1c7128150 2024-05-09T09:47:31.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.263+0000 7f77afcb6980 1 -- 172.21.15.157:0/3800627773 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1c712fbe0 con 0x55a1c7128150 2024-05-09T09:47:31.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.263+0000 7f7690b9e640 1 -- 172.21.15.157:0/3800627773 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77a801dd90 con 0x55a1c7128150 2024-05-09T09:47:31.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.263+0000 7f7690b9e640 1 -- 172.21.15.157:0/3800627773 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77a801e520 con 0x55a1c7128150 2024-05-09T09:47:31.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.263+0000 7f7690b9e640 1 -- 172.21.15.157:0/3800627773 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f77a8010070 con 0x55a1c7128150 2024-05-09T09:47:31.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.263+0000 7f7690b9e640 1 --2- 172.21.15.157:0/3800627773 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f7688034bb0 0x7f7688037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.263+0000 7f7690b9e640 1 -- 172.21.15.157:0/3800627773 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f77a8055c50 con 0x55a1c7128150 2024-05-09T09:47:31.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.263+0000 7f77afcb6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:31.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.263+0000 7f77afcb6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:31.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.263+0000 7f77acfd0640 1 --2- 172.21.15.157:0/3800627773 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f7688034bb0 0x7f7688037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.263+0000 7f77afcb6980 1 Processor -- start 2024-05-09T09:47:31.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.267+0000 7f77afcb6980 1 -- start start 2024-05-09T09:47:31.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.267+0000 7f77acfd0640 1 --2- 172.21.15.157:0/3800627773 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f7688034bb0 0x7f7688037070 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f77a4018f70 tx=0x7f77a4005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.267+0000 7f77afcb6980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c714aad0 0x55a1c714aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.267+0000 7f77afcb6980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55a1c70fc4d0 con 0x55a1c714aad0 2024-05-09T09:47:31.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.267+0000 7f77ad7d1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c714aad0 0x55a1c714aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.267+0000 7f77ad7d1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c714aad0 0x55a1c714aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53708/0 (socket says 172.21.15.157:53708) 2024-05-09T09:47:31.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.267+0000 7f77ad7d1640 1 -- 172.21.15.157:0/3542055368 learned_addr learned my addr 172.21.15.157:0/3542055368 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:31.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.267+0000 7f77ad7d1640 1 -- 172.21.15.157:0/3542055368 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1c714b430 con 0x55a1c714aad0 2024-05-09T09:47:31.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.267+0000 7f77ad7d1640 1 --2- 172.21.15.157:0/3542055368 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c714aad0 0x55a1c714aef0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f77a8004fd0 tx=0x7f77a804a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.267+0000 7f7670fe1640 1 -- 172.21.15.157:0/3542055368 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77a8069070 con 0x55a1c714aad0 2024-05-09T09:47:31.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.267+0000 7f77afcb6980 1 -- 172.21.15.157:0/3542055368 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a1c714b430 con 0x55a1c714aad0 2024-05-09T09:47:31.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.267+0000 7f7670fe1640 1 -- 172.21.15.157:0/3542055368 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77a804a070 con 0x55a1c714aad0 2024-05-09T09:47:31.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.267+0000 7f7670fe1640 1 -- 172.21.15.157:0/3542055368 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77a805c070 con 0x55a1c714aad0 2024-05-09T09:47:31.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.267+0000 7f77afcb6980 1 -- 172.21.15.157:0/3542055368 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1c714c0b0 con 0x55a1c714aad0 2024-05-09T09:47:31.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.267+0000 7f7670fe1640 1 -- 172.21.15.157:0/3542055368 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f77a806c070 con 0x55a1c714aad0 2024-05-09T09:47:31.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.267+0000 7f7670fe1640 1 --2- 172.21.15.157:0/3542055368 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f75e4034bb0 0x7f75e4037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.267+0000 7f7670fe1640 1 -- 172.21.15.157:0/3542055368 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f77a806fca0 con 0x55a1c714aad0 2024-05-09T09:47:31.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.267+0000 7f77acfd0640 1 --2- 172.21.15.157:0/3542055368 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f75e4034bb0 0x7f75e4037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.267+0000 7f76027fc640 20 reqs_thread_entry: start 2024-05-09T09:47:31.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.267+0000 7f77afcb6980 1 --2- 172.21.15.157:0/828495452 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55a1c71505d0 0x55a1c7152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.267+0000 7f77afcb6980 1 -- 172.21.15.157:0/828495452 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a1c7153110 con 0x55a1c71505d0 2024-05-09T09:47:31.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.267+0000 7f77acfd0640 1 --2- 172.21.15.157:0/3542055368 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f75e4034bb0 0x7f75e4037070 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x55a1c70107d0 tx=0x7f77a40b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.267+0000 7f77adfd2640 1 --2- 172.21.15.157:0/828495452 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55a1c71505d0 0x55a1c7152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.271+0000 7f77adfd2640 1 --2- 172.21.15.157:0/828495452 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55a1c71505d0 0x55a1c7152a40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.271+0000 7f77adfd2640 1 -- 172.21.15.157:0/828495452 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f77a000a4f0 con 0x55a1c71505d0 2024-05-09T09:47:31.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.271+0000 7f77afcb6980 1 --2- 172.21.15.157:0/828495452 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55a1c7154f30 0x55a1c7157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.271+0000 7f77afcb6980 1 -- 172.21.15.157:0/828495452 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:2 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a1c71579f0 con 0x55a1c7154f30 2024-05-09T09:47:31.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.271+0000 7f77ad7d1640 1 --2- 172.21.15.157:0/828495452 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55a1c7154f30 0x55a1c7157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.271+0000 7f77ad7d1640 1 --2- 172.21.15.157:0/828495452 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55a1c7154f30 0x55a1c7157320 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.271+0000 7f77ad7d1640 1 -- 172.21.15.157:0/828495452 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(2 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f77a806b030 con 0x55a1c7154f30 2024-05-09T09:47:31.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.271+0000 7f77afcb6980 1 -- 172.21.15.157:0/828495452 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a1c715c780 con 0x55a1c7154f30 2024-05-09T09:47:31.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77ad7d1640 1 -- 172.21.15.157:0/828495452 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [stat,call,call,writefull 0~993] v30'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f77a806b030 con 0x55a1c7154f30 2024-05-09T09:47:31.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 -- 172.21.15.157:0/3800627773 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f7688034bb0 msgr2=0x7f7688037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 --2- 172.21.15.157:0/3800627773 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f7688034bb0 0x7f7688037070 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f77a4018f70 tx=0x7f77a4005ad0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 -- 172.21.15.157:0/3800627773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7128150 msgr2=0x55a1c712f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 --2- 172.21.15.157:0/3800627773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7128150 0x55a1c712f6a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f77a8010f50 tx=0x7f77a8048b50 comp rx=0 tx=0).stop 2024-05-09T09:47:31.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 -- 172.21.15.157:0/3800627773 shutdown_connections 2024-05-09T09:47:31.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 --2- 172.21.15.157:0/3800627773 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f7688034bb0 0x7f7688037070 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 --2- 172.21.15.157:0/3800627773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7128150 0x55a1c712f6a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 -- 172.21.15.157:0/3800627773 >> 172.21.15.157:0/3800627773 conn(0x55a1c7015060 msgr2=0x55a1c7122390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:31.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 -- 172.21.15.157:0/3800627773 shutdown_connections 2024-05-09T09:47:31.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 -- 172.21.15.157:0/3800627773 wait complete. 2024-05-09T09:47:31.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 -- 172.21.15.157:0/3542055368 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f75e4034bb0 msgr2=0x7f75e4037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 --2- 172.21.15.157:0/3542055368 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f75e4034bb0 0x7f75e4037070 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x55a1c70107d0 tx=0x7f77a40b5040 comp rx=0 tx=0).stop 2024-05-09T09:47:31.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 -- 172.21.15.157:0/3542055368 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c714aad0 msgr2=0x55a1c714aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 --2- 172.21.15.157:0/3542055368 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c714aad0 0x55a1c714aef0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f77a8004fd0 tx=0x7f77a804a7c0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 -- 172.21.15.157:0/3542055368 shutdown_connections 2024-05-09T09:47:31.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 --2- 172.21.15.157:0/3542055368 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f75e4034bb0 0x7f75e4037070 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 --2- 172.21.15.157:0/3542055368 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c714aad0 0x55a1c714aef0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 -- 172.21.15.157:0/3542055368 >> 172.21.15.157:0/3542055368 conn(0x55a1c713f5e0 msgr2=0x55a1c7140000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:31.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 -- 172.21.15.157:0/3542055368 shutdown_connections 2024-05-09T09:47:31.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 -- 172.21.15.157:0/3542055368 wait complete. 2024-05-09T09:47:31.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 -- 172.21.15.157:0/828495452 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55a1c7154f30 msgr2=0x55a1c7157320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 --2- 172.21.15.157:0/828495452 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55a1c7154f30 0x55a1c7157320 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 -- 172.21.15.157:0/828495452 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55a1c71505d0 msgr2=0x55a1c7152a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 --2- 172.21.15.157:0/828495452 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55a1c71505d0 0x55a1c7152a40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 -- 172.21.15.157:0/828495452 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f7694034bb0 msgr2=0x7f7694037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 --2- 172.21.15.157:0/828495452 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f7694034bb0 0x7f7694037070 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f77a40ae000 tx=0x7f77a40a6000 comp rx=0 tx=0).stop 2024-05-09T09:47:31.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 -- 172.21.15.157:0/828495452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7010b50 msgr2=0x55a1c7102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 --2- 172.21.15.157:0/828495452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7010b50 0x55a1c7102f50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f77a8006640 tx=0x7f77a8000f50 comp rx=0 tx=0).stop 2024-05-09T09:47:31.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 -- 172.21.15.157:0/828495452 shutdown_connections 2024-05-09T09:47:31.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 --2- 172.21.15.157:0/828495452 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55a1c7154f30 0x55a1c7157320 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 --2- 172.21.15.157:0/828495452 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55a1c71505d0 0x55a1c7152a40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 --2- 172.21.15.157:0/828495452 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f7694034bb0 0x7f7694037070 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 --2- 172.21.15.157:0/828495452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a1c7010b50 0x55a1c7102f50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 -- 172.21.15.157:0/828495452 >> 172.21.15.157:0/828495452 conn(0x55a1c6f842a0 msgr2=0x55a1c70f6420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:31.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 -- 172.21.15.157:0/828495452 shutdown_connections 2024-05-09T09:47:31.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.275+0000 7f77afcb6980 1 -- 172.21.15.157:0/828495452 wait complete. 2024-05-09T09:47:31.286 INFO:teuthology.orchestra.run.smithi157.stdout:{"id":"b73385e6-4d12-4d8e-98d6-6f8ed75f5b82","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-05-09T09:47:31.286 DEBUG:tasks.util.rgw: json result: {'id': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-05-09T09:47:31.287 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-05-09T09:47:31.288 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-05-09T09:47:31.288 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-05-09T09:47:31.361 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:31.361 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:31.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.363+0000 7f96af82c980 1 Processor -- start 2024-05-09T09:47:31.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.363+0000 7f96af82c980 1 -- start start 2024-05-09T09:47:31.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.363+0000 7f96af82c980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x560392082e30 0x560392085220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.363+0000 7f96af82c980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560391f34440 con 0x56039207e970 2024-05-09T09:47:31.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.363+0000 7f96af82c980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x560391f1f5f0 con 0x560392082e30 2024-05-09T09:47:31.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.363+0000 7f96ad347640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x56039207e970 0x56039207ed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:33554/0 (socket says 172.21.15.157:33554) 2024-05-09T09:47:31.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.363+0000 7f96ad347640 1 -- 172.21.15.157:0/3124859736 learned_addr learned my addr 172.21.15.157:0/3124859736 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:47:31.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.363+0000 7f96acb46640 1 --2- 172.21.15.157:0/3124859736 >> v2:172.21.15.110:3300/0 conn(0x560392082e30 0x560392085220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.363+0000 7f969ffff640 1 -- 172.21.15.157:0/3124859736 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2082863148 0 0) 0x560391f34440 con 0x56039207e970 2024-05-09T09:47:31.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.363+0000 7f969ffff640 1 -- 172.21.15.157:0/3124859736 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9698001e20 con 0x56039207e970 2024-05-09T09:47:31.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.363+0000 7f96acb46640 1 -- 172.21.15.157:0/3124859736 >> v1:172.21.15.110:6789/0 conn(0x56039207e970 legacy=0x56039207ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.363+0000 7f96acb46640 1 -- 172.21.15.157:0/3124859736 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560391f2a990 con 0x560392082e30 2024-05-09T09:47:31.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.367+0000 7f96acb46640 1 --2- 172.21.15.157:0/3124859736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560392082e30 0x560392085220 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f96a400a480 tx=0x7f96a401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c29e025f1ce6a494 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.367+0000 7f969ffff640 1 -- 172.21.15.157:0/3124859736 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96a40b0070 con 0x560392082e30 2024-05-09T09:47:31.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.367+0000 7f969ffff640 1 -- 172.21.15.157:0/3124859736 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96a40ab540 con 0x560392082e30 2024-05-09T09:47:31.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.367+0000 7f969ffff640 1 -- 172.21.15.157:0/3124859736 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96a40ab820 con 0x560392082e30 2024-05-09T09:47:31.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.367+0000 7f96af82c980 1 -- 172.21.15.157:0/3124859736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560392082e30 msgr2=0x560392085220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.367+0000 7f96af82c980 1 --2- 172.21.15.157:0/3124859736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560392082e30 0x560392085220 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f96a400a480 tx=0x7f96a401b280 comp rx=0 tx=0).stop 2024-05-09T09:47:31.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.367+0000 7f96af82c980 1 -- 172.21.15.157:0/3124859736 shutdown_connections 2024-05-09T09:47:31.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.367+0000 7f96af82c980 1 --2- 172.21.15.157:0/3124859736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560392082e30 0x560392085220 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.367+0000 7f96af82c980 1 -- 172.21.15.157:0/3124859736 >> 172.21.15.157:0/3124859736 conn(0x56039207a240 msgr2=0x56039207c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:31.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.367+0000 7f96af82c980 1 -- 172.21.15.157:0/3124859736 shutdown_connections 2024-05-09T09:47:31.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.367+0000 7f96af82c980 1 -- 172.21.15.157:0/3124859736 wait complete. 2024-05-09T09:47:31.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.383+0000 7f96af82c980 1 Processor -- start 2024-05-09T09:47:31.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.383+0000 7f96af82c980 1 -- start start 2024-05-09T09:47:31.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.383+0000 7f96af82c980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56039207e970 0x5603921698b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.383+0000 7f96af82c980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560391f81fe0 con 0x56039207e970 2024-05-09T09:47:31.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.383+0000 7f96ad347640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56039207e970 0x5603921698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.383+0000 7f96ad347640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56039207e970 0x5603921698b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53732/0 (socket says 172.21.15.157:53732) 2024-05-09T09:47:31.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.383+0000 7f96ad347640 1 -- 172.21.15.157:0/2412388283 learned_addr learned my addr 172.21.15.157:0/2412388283 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:31.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.383+0000 7f96ad347640 1 -- 172.21.15.157:0/2412388283 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560391f06ae0 con 0x56039207e970 2024-05-09T09:47:31.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.383+0000 7f96ad347640 1 --2- 172.21.15.157:0/2412388283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56039207e970 0x5603921698b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f96a8006fc0 tx=0x7f96a8001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe136f29639b49a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.387+0000 7f959b606640 1 -- 172.21.15.157:0/2412388283 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96a8004530 con 0x56039207e970 2024-05-09T09:47:31.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.387+0000 7f959b606640 1 -- 172.21.15.157:0/2412388283 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96a80046d0 con 0x56039207e970 2024-05-09T09:47:31.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.387+0000 7f959b606640 1 -- 172.21.15.157:0/2412388283 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96a8004a70 con 0x56039207e970 2024-05-09T09:47:31.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.387+0000 7f96af82c980 1 -- 172.21.15.157:0/2412388283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56039207e970 msgr2=0x5603921698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.387+0000 7f96af82c980 1 --2- 172.21.15.157:0/2412388283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56039207e970 0x5603921698b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f96a8006fc0 tx=0x7f96a8001af0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.387+0000 7f96af82c980 1 -- 172.21.15.157:0/2412388283 shutdown_connections 2024-05-09T09:47:31.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.387+0000 7f96af82c980 1 --2- 172.21.15.157:0/2412388283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56039207e970 0x5603921698b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.387+0000 7f96af82c980 1 -- 172.21.15.157:0/2412388283 >> 172.21.15.157:0/2412388283 conn(0x56039207a240 msgr2=0x560392165440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:31.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.387+0000 7f96af82c980 1 -- 172.21.15.157:0/2412388283 shutdown_connections 2024-05-09T09:47:31.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.387+0000 7f96af82c980 1 -- 172.21.15.157:0/2412388283 wait complete. 2024-05-09T09:47:31.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.387+0000 7f96af82c980 1 Processor -- start 2024-05-09T09:47:31.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.387+0000 7f96af82c980 1 -- start start 2024-05-09T09:47:31.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.387+0000 7f96af82c980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56039207e970 0x560392170b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.387+0000 7f96af82c980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560392088250 con 0x56039207e970 2024-05-09T09:47:31.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.387+0000 7f96ad347640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56039207e970 0x560392170b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.387+0000 7f96ad347640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56039207e970 0x560392170b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53738/0 (socket says 172.21.15.157:53738) 2024-05-09T09:47:31.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.387+0000 7f96ad347640 1 -- 172.21.15.157:0/1602136286 learned_addr learned my addr 172.21.15.157:0/1602136286 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:31.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.387+0000 7f96ad347640 1 -- 172.21.15.157:0/1602136286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560392171090 con 0x56039207e970 2024-05-09T09:47:31.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.387+0000 7f96ad347640 1 --2- 172.21.15.157:0/1602136286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56039207e970 0x560392170b50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f96a8002260 tx=0x7f96a8000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.387+0000 7f9599e03640 1 -- 172.21.15.157:0/1602136286 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96a8013760 con 0x56039207e970 2024-05-09T09:47:31.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.387+0000 7f96af82c980 1 -- 172.21.15.157:0/1602136286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560392171320 con 0x56039207e970 2024-05-09T09:47:31.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.387+0000 7f9599e03640 1 -- 172.21.15.157:0/1602136286 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96a8013900 con 0x56039207e970 2024-05-09T09:47:31.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.387+0000 7f9599e03640 1 -- 172.21.15.157:0/1602136286 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96a8013c00 con 0x56039207e970 2024-05-09T09:47:31.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.387+0000 7f96af82c980 1 -- 172.21.15.157:0/1602136286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560392174000 con 0x56039207e970 2024-05-09T09:47:31.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.391+0000 7f9599e03640 1 -- 172.21.15.157:0/1602136286 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f96a8010070 con 0x56039207e970 2024-05-09T09:47:31.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.391+0000 7f9599e03640 1 --2- 172.21.15.157:0/1602136286 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9594034bb0 0x7f9594037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.391+0000 7f9599e03640 1 -- 172.21.15.157:0/1602136286 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f96a8018070 con 0x56039207e970 2024-05-09T09:47:31.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.391+0000 7f96acb46640 1 --2- 172.21.15.157:0/1602136286 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9594034bb0 0x7f9594037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.391+0000 7f96af82c980 1 --2- 172.21.15.157:0/1602136286 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560392082e30 0x560392177ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.391+0000 7f96af82c980 1 -- 172.21.15.157:0/1602136286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560392178130 con 0x560392082e30 2024-05-09T09:47:31.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.391+0000 7f96adb48640 1 --2- 172.21.15.157:0/1602136286 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560392082e30 0x560392177ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.391+0000 7f96acb46640 1 --2- 172.21.15.157:0/1602136286 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9594034bb0 0x7f9594037070 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f96a40ad000 tx=0x7f96a40a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.391+0000 7f96adb48640 1 --2- 172.21.15.157:0/1602136286 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560392082e30 0x560392177ae0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.391+0000 7f96adb48640 1 -- 172.21.15.157:0/1602136286 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f96a00083f0 con 0x560392082e30 2024-05-09T09:47:31.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.391+0000 7f96af82c980 1 -- 172.21.15.157:0/1602136286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560392175200 con 0x560392082e30 2024-05-09T09:47:31.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.391+0000 7f96adb48640 1 -- 172.21.15.157:0/1602136286 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f96a00083f0 con 0x560392082e30 2024-05-09T09:47:31.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.391+0000 7f96af82c980 1 --2- 172.21.15.157:0/1602136286 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56039217a460 0x56039217c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.391+0000 7f96af82c980 1 -- 172.21.15.157:0/1602136286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56039217cf20 con 0x56039217a460 2024-05-09T09:47:31.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.391+0000 7f96ad347640 1 --2- 172.21.15.157:0/1602136286 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56039217a460 0x56039217c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.391+0000 7f96ad347640 1 --2- 172.21.15.157:0/1602136286 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56039217a460 0x56039217c850 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.391+0000 7f96ad347640 1 -- 172.21.15.157:0/1602136286 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f96a801b030 con 0x56039217a460 2024-05-09T09:47:31.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.391+0000 7f96af82c980 1 -- 172.21.15.157:0/1602136286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921792d0 con 0x560392082e30 2024-05-09T09:47:31.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.395+0000 7f96adb48640 1 -- 172.21.15.157:0/1602136286 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f96a00083f0 con 0x560392082e30 2024-05-09T09:47:31.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.395+0000 7f96af82c980 1 --2- 172.21.15.157:0/1602136286 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56039217e380 0x560392180770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.395+0000 7f96af82c980 1 -- 172.21.15.157:0/1602136286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560392180e60 con 0x56039217e380 2024-05-09T09:47:31.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.395+0000 7f96acb46640 1 --2- 172.21.15.157:0/1602136286 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56039217e380 0x560392180770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.395+0000 7f96acb46640 1 --2- 172.21.15.157:0/1602136286 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56039217e380 0x560392180770 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.395+0000 7f96acb46640 1 -- 172.21.15.157:0/1602136286 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f96a40b3040 con 0x56039217e380 2024-05-09T09:47:31.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.399+0000 7f96af82c980 1 Processor -- start 2024-05-09T09:47:31.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.399+0000 7f96af82c980 1 -- start start 2024-05-09T09:47:31.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.399+0000 7f96af82c980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5603921a6cb0 0x5603921a70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.399+0000 7f96af82c980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560391f86020 con 0x5603921a6cb0 2024-05-09T09:47:31.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.399+0000 7f96ad347640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5603921a6cb0 0x5603921a70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.399+0000 7f96ad347640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5603921a6cb0 0x5603921a70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53742/0 (socket says 172.21.15.157:53742) 2024-05-09T09:47:31.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.399+0000 7f96ad347640 1 -- 172.21.15.157:0/2254325198 learned_addr learned my addr 172.21.15.157:0/2254325198 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:31.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.399+0000 7f96ad347640 1 -- 172.21.15.157:0/2254325198 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603921a7610 con 0x5603921a6cb0 2024-05-09T09:47:31.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.399+0000 7f96ad347640 1 --2- 172.21.15.157:0/2254325198 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5603921a6cb0 0x5603921a70d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f96a80106e0 tx=0x7f96a804a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.399+0000 7f9591ba0640 1 -- 172.21.15.157:0/2254325198 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96a8013e10 con 0x5603921a6cb0 2024-05-09T09:47:31.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.399+0000 7f96af82c980 1 -- 172.21.15.157:0/2254325198 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5603921a80a0 con 0x5603921a6cb0 2024-05-09T09:47:31.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.399+0000 7f9591ba0640 1 -- 172.21.15.157:0/2254325198 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96a8029470 con 0x5603921a6cb0 2024-05-09T09:47:31.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.399+0000 7f96af82c980 1 -- 172.21.15.157:0/2254325198 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603921a8580 con 0x5603921a6cb0 2024-05-09T09:47:31.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.399+0000 7f9591ba0640 1 -- 172.21.15.157:0/2254325198 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96a8029750 con 0x5603921a6cb0 2024-05-09T09:47:31.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.399+0000 7f9591ba0640 1 -- 172.21.15.157:0/2254325198 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f96a8042110 con 0x5603921a6cb0 2024-05-09T09:47:31.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.399+0000 7f9591ba0640 1 --2- 172.21.15.157:0/2254325198 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9584034bb0 0x7f9584037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.399+0000 7f9591ba0640 1 -- 172.21.15.157:0/2254325198 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f96a8039070 con 0x5603921a6cb0 2024-05-09T09:47:31.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.403+0000 7f96acb46640 1 --2- 172.21.15.157:0/2254325198 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9584034bb0 0x7f9584037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.403+0000 7f96af82c980 1 Processor -- start 2024-05-09T09:47:31.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.403+0000 7f96af82c980 1 -- start start 2024-05-09T09:47:31.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.403+0000 7f96af82c980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5603921b3c20 0x5603921b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.403+0000 7f96af82c980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56039216a000 con 0x5603921b3c20 2024-05-09T09:47:31.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.403+0000 7f96acb46640 1 --2- 172.21.15.157:0/2254325198 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9584034bb0 0x7f9584037070 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x560392178a10 tx=0x7f96a4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.403+0000 7f96ad347640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5603921b3c20 0x5603921b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.403+0000 7f96ad347640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5603921b3c20 0x5603921b4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53756/0 (socket says 172.21.15.157:53756) 2024-05-09T09:47:31.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.403+0000 7f96ad347640 1 -- 172.21.15.157:0/548711134 learned_addr learned my addr 172.21.15.157:0/548711134 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:31.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.403+0000 7f96ad347640 1 -- 172.21.15.157:0/548711134 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603921b4610 con 0x5603921b3c20 2024-05-09T09:47:31.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.403+0000 7f96ad347640 1 --2- 172.21.15.157:0/548711134 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5603921b3c20 0x5603921b4040 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f96a80104d0 tx=0x7f96a803b360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1716291503abc5b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.403+0000 7f958b7fe640 1 -- 172.21.15.157:0/548711134 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96a8058070 con 0x5603921b3c20 2024-05-09T09:47:31.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.403+0000 7f958b7fe640 1 -- 172.21.15.157:0/548711134 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96a803dd60 con 0x5603921b3c20 2024-05-09T09:47:31.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.403+0000 7f958b7fe640 1 -- 172.21.15.157:0/548711134 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96a802c100 con 0x5603921b3c20 2024-05-09T09:47:31.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.403+0000 7f96af82c980 1 -- 172.21.15.157:0/548711134 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5603921b3c20 msgr2=0x5603921b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.403+0000 7f96af82c980 1 --2- 172.21.15.157:0/548711134 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5603921b3c20 0x5603921b4040 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f96a80104d0 tx=0x7f96a803b360 comp rx=0 tx=0).stop 2024-05-09T09:47:31.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.403+0000 7f96af82c980 1 -- 172.21.15.157:0/548711134 shutdown_connections 2024-05-09T09:47:31.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.403+0000 7f96af82c980 1 --2- 172.21.15.157:0/548711134 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5603921b3c20 0x5603921b4040 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.403+0000 7f96af82c980 1 -- 172.21.15.157:0/548711134 >> 172.21.15.157:0/548711134 conn(0x5603921affa0 msgr2=0x5603921ae000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:31.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.403+0000 7f96af82c980 1 -- 172.21.15.157:0/548711134 shutdown_connections 2024-05-09T09:47:31.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.403+0000 7f96af82c980 1 -- 172.21.15.157:0/548711134 wait complete. 2024-05-09T09:47:31.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.403+0000 7f96af82c980 1 Processor -- start 2024-05-09T09:47:31.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.403+0000 7f96af82c980 1 -- start start 2024-05-09T09:47:31.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.403+0000 7f96af82c980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5603921b3c20 0x5603921baf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.403+0000 7f96af82c980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5603921b4ce0 con 0x5603921b3c20 2024-05-09T09:47:31.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.403+0000 7f96ad347640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5603921b3c20 0x5603921baf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.403+0000 7f96ad347640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5603921b3c20 0x5603921baf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53762/0 (socket says 172.21.15.157:53762) 2024-05-09T09:47:31.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.403+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 learned_addr learned my addr 172.21.15.157:0/1426874290 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:31.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.407+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603921bb450 con 0x5603921b3c20 2024-05-09T09:47:31.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.407+0000 7f96ad347640 1 --2- 172.21.15.157:0/1426874290 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5603921b3c20 0x5603921baf10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f96a80478b0 tx=0x7f96a804ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.407+0000 7f9589ffb640 1 -- 172.21.15.157:0/1426874290 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96a806d070 con 0x5603921b3c20 2024-05-09T09:47:31.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.407+0000 7f9589ffb640 1 -- 172.21.15.157:0/1426874290 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96a80369d0 con 0x5603921b3c20 2024-05-09T09:47:31.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.407+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5603921bb450 con 0x5603921b3c20 2024-05-09T09:47:31.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.407+0000 7f9589ffb640 1 -- 172.21.15.157:0/1426874290 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96a8036cb0 con 0x5603921b3c20 2024-05-09T09:47:31.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.407+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603921bb8d0 con 0x5603921b3c20 2024-05-09T09:47:31.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.407+0000 7f9589ffb640 1 -- 172.21.15.157:0/1426874290 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f96a8070070 con 0x5603921b3c20 2024-05-09T09:47:31.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.407+0000 7f96af82c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.407+0000 7f9589ffb640 1 --2- 172.21.15.157:0/1426874290 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f957c034b60 0x7f957c037020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.407+0000 7f9589ffb640 1 -- 172.21.15.157:0/1426874290 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f96a8063030 con 0x5603921b3c20 2024-05-09T09:47:31.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.407+0000 7f96acb46640 1 --2- 172.21.15.157:0/1426874290 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f957c034b60 0x7f957c037020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.407+0000 7f96af82c980 1 --2- 172.21.15.157:0/1426874290 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5603921c79e0 0x5603921c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.407+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921ca5f0 con 0x5603921c79e0 2024-05-09T09:47:31.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.407+0000 7f96adb48640 1 --2- 172.21.15.157:0/1426874290 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5603921c79e0 0x5603921c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.407+0000 7f96acb46640 1 --2- 172.21.15.157:0/1426874290 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f957c034b60 0x7f957c037020 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f96a40ab510 tx=0x7f96a40b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.407+0000 7f96adb48640 1 --2- 172.21.15.157:0/1426874290 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5603921c79e0 0x5603921c9ea0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.407+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f96a00083f0 con 0x5603921c79e0 2024-05-09T09:47:31.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.407+0000 7f96af82c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.407+0000 7f96af82c980 20 realm 2024-05-09T09:47:31.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.407+0000 7f96af82c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.407+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921caa00 con 0x5603921c79e0 2024-05-09T09:47:31.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.407+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f96a00083f0 con 0x5603921c79e0 2024-05-09T09:47:31.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.407+0000 7f96af82c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.407+0000 7f96af82c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:31.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.407+0000 7f96af82c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.407+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb2a0 con 0x5603921c79e0 2024-05-09T09:47:31.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.411+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f96a00083f0 con 0x5603921c79e0 2024-05-09T09:47:31.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.411+0000 7f96af82c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.411+0000 7f96af82c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.411+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x5603921c79e0 2024-05-09T09:47:31.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.411+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f96a00083f0 con 0x5603921c79e0 2024-05-09T09:47:31.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.411+0000 7f96af82c980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:31.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.411+0000 7f96af82c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.411+0000 7f96af82c980 1 --2- 172.21.15.157:0/1426874290 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5603921cc3a0 0x5603921ce790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.411+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921ced10 con 0x5603921cc3a0 2024-05-09T09:47:31.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.411+0000 7f96ad347640 1 --2- 172.21.15.157:0/1426874290 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5603921cc3a0 0x5603921ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.411+0000 7f96ad347640 1 --2- 172.21.15.157:0/1426874290 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5603921cc3a0 0x5603921ce790 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.411+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.411+0000 7f96af82c980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:31.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.411+0000 7f96af82c980 20 searching for the correct realm 2024-05-09T09:47:31.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.411+0000 7f96af82c980 1 --2- 172.21.15.157:0/1426874290 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5603921d0c60 0x5603921d3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.411+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921d37f0 con 0x5603921d0c60 2024-05-09T09:47:31.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.411+0000 7f96acb46640 1 --2- 172.21.15.157:0/1426874290 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5603921d0c60 0x5603921d3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.411+0000 7f96acb46640 1 --2- 172.21.15.157:0/1426874290 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5603921d0c60 0x5603921d3120 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.411+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.411+0000 7f96acb46640 1 --2- 172.21.15.157:0/1426874290 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f96a40dc040 0x7f96a40ce940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.411+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921d37f0 con 0x7f96a40dc040 2024-05-09T09:47:31.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.411+0000 7f96adb48640 1 --2- 172.21.15.157:0/1426874290 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f96a40dc040 0x7f96a40ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.411+0000 7f96adb48640 1 --2- 172.21.15.157:0/1426874290 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f96a40dc040 0x7f96a40ce940 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.415+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a00083f0 con 0x7f96a40dc040 2024-05-09T09:47:31.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.415+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x5603921cc3a0 2024-05-09T09:47:31.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.415+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.415+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x5603921c79e0 2024-05-09T09:47:31.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.415+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a00083f0 con 0x5603921c79e0 2024-05-09T09:47:31.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.415+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x5603921c79e0 2024-05-09T09:47:31.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.415+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a0026040 con 0x5603921c79e0 2024-05-09T09:47:31.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.415+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x5603921cc3a0 2024-05-09T09:47:31.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.415+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.415+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x5603921cc3a0 2024-05-09T09:47:31.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.415+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.415+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x7f96a40dc040 2024-05-09T09:47:31.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.415+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a0026040 con 0x7f96a40dc040 2024-05-09T09:47:31.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.415+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x5603921d0c60 2024-05-09T09:47:31.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.415+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.415+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x5603921c79e0 2024-05-09T09:47:31.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.415+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a0026040 con 0x5603921c79e0 2024-05-09T09:47:31.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.415+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x5603921cc3a0 2024-05-09T09:47:31.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.419+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.419+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x5603921c79e0 2024-05-09T09:47:31.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.419+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a0026040 con 0x5603921c79e0 2024-05-09T09:47:31.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.419+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x7f96a40dc040 2024-05-09T09:47:31.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.419+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f96a0026040 con 0x7f96a40dc040 2024-05-09T09:47:31.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.419+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x5603921d0c60 2024-05-09T09:47:31.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.419+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.419+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x5603921d0c60 2024-05-09T09:47:31.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.419+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.419+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x5603921cc3a0 2024-05-09T09:47:31.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.419+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.419+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x5603921d0c60 2024-05-09T09:47:31.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.419+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.419+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x5603921d0c60 2024-05-09T09:47:31.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.419+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.419+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x5603921c79e0 2024-05-09T09:47:31.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.419+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a0026040 con 0x5603921c79e0 2024-05-09T09:47:31.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.419+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x5603921c79e0 2024-05-09T09:47:31.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.419+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f96a0026040 con 0x5603921c79e0 2024-05-09T09:47:31.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.419+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x5603921cc3a0 2024-05-09T09:47:31.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.423+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.423+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x5603921d0c60 2024-05-09T09:47:31.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.423+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.423+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x7f96a40dc040 2024-05-09T09:47:31.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.423+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a0026040 con 0x7f96a40dc040 2024-05-09T09:47:31.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.423+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x5603921c79e0 2024-05-09T09:47:31.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.423+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a0026040 con 0x5603921c79e0 2024-05-09T09:47:31.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.423+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x5603921cc3a0 2024-05-09T09:47:31.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.423+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.423+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x5603921d0c60 2024-05-09T09:47:31.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.423+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.423+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x5603921cc3a0 2024-05-09T09:47:31.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.423+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.423+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x7f96a40dc040 2024-05-09T09:47:31.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.423+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a0026040 con 0x7f96a40dc040 2024-05-09T09:47:31.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.423+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x5603921d0c60 2024-05-09T09:47:31.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.423+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.423+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x5603921cc3a0 2024-05-09T09:47:31.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x5603921c79e0 2024-05-09T09:47:31.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f96a0026040 con 0x5603921c79e0 2024-05-09T09:47:31.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5603921cb640 con 0x7f96a40dc040 2024-05-09T09:47:31.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f96a0026040 con 0x7f96a40dc040 2024-05-09T09:47:31.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:31.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:31.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:31.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:31.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:31.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:31.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921cf560 con 0x5603921c79e0 2024-05-09T09:47:31.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f96a0026040 con 0x5603921c79e0 2024-05-09T09:47:31.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921cf560 con 0x5603921c79e0 2024-05-09T09:47:31.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f96a0026040 con 0x5603921c79e0 2024-05-09T09:47:31.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:31.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921cf560 con 0x5603921d0c60 2024-05-09T09:47:31.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:31.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 20 zone default found 2024-05-09T09:47:31.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 4 Realm: () 2024-05-09T09:47:31.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:31.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:31.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:31.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 20 zonegroup default 2024-05-09T09:47:31.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921cfe00 con 0x5603921cc3a0 2024-05-09T09:47:31.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921d5650 con 0x5603921d0c60 2024-05-09T09:47:31.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921d59f0 con 0x5603921d0c60 2024-05-09T09:47:31.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 20 started sync module instance, tier type = 2024-05-09T09:47:31.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:31.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.427+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921d4af0 con 0x7f96a40dc040 2024-05-09T09:47:31.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.431+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a0026040 con 0x7f96a40dc040 2024-05-09T09:47:31.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.431+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94573336285168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921d4af0 con 0x7f96a40dc040 2024-05-09T09:47:31.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.431+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921d63b0 con 0x5603921c79e0 2024-05-09T09:47:31.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.431+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94573336285168] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x7f96a40dc040 2024-05-09T09:47:31.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.431+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x5603921c79e0 2024-05-09T09:47:31.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.431+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94573336289296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921d4af0 con 0x5603921c79e0 2024-05-09T09:47:31.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.431+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921d6dc0 con 0x5603921d0c60 2024-05-09T09:47:31.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.435+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.435+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94573336291600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921d7660 con 0x5603921d0c60 2024-05-09T09:47:31.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.435+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921d80a0 con 0x7f96a40dc040 2024-05-09T09:47:31.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.435+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94573336289296] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x5603921c79e0 2024-05-09T09:47:31.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.435+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x7f96a40dc040 2024-05-09T09:47:31.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.435+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94573336296304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921d8490 con 0x7f96a40dc040 2024-05-09T09:47:31.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.435+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921d8e50 con 0x5603921c79e0 2024-05-09T09:47:31.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.435+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94573336291600] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.435+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94573336296304] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x7f96a40dc040 2024-05-09T09:47:31.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.439+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x5603921c79e0 2024-05-09T09:47:31.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.439+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94573336282688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921d89a0 con 0x5603921c79e0 2024-05-09T09:47:31.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.439+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921d91f0 con 0x5603921cc3a0 2024-05-09T09:47:31.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.439+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94573336282688] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x5603921c79e0 2024-05-09T09:47:31.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.439+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.439+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94573336299936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921d8dc0 con 0x5603921cc3a0 2024-05-09T09:47:31.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.439+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921d9ef0 con 0x5603921cc3a0 2024-05-09T09:47:31.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.443+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94573336299936] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.443+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.443+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94573336303264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921da0d0 con 0x5603921cc3a0 2024-05-09T09:47:31.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.443+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921dabc0 con 0x5603921cc3a0 2024-05-09T09:47:31.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.443+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94573336303264] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.443+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.443+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94573336307344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921dab80 con 0x5603921cc3a0 2024-05-09T09:47:31.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.443+0000 7f96af82c980 20 add_watcher() i=0 2024-05-09T09:47:31.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.443+0000 7f96af82c980 20 add_watcher() i=1 2024-05-09T09:47:31.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.443+0000 7f96af82c980 20 add_watcher() i=2 2024-05-09T09:47:31.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.443+0000 7f96af82c980 20 add_watcher() i=3 2024-05-09T09:47:31.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.443+0000 7f96af82c980 20 add_watcher() i=4 2024-05-09T09:47:31.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.443+0000 7f96af82c980 20 add_watcher() i=5 2024-05-09T09:47:31.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.443+0000 7f96af82c980 20 add_watcher() i=6 2024-05-09T09:47:31.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.447+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94573336307344] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.447+0000 7f96af82c980 20 add_watcher() i=7 2024-05-09T09:47:31.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.447+0000 7f96af82c980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:31.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.447+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921de010 con 0x5603921c79e0 2024-05-09T09:47:31.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.447+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f96a0036040 con 0x5603921c79e0 2024-05-09T09:47:31.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.447+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94573336304416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921db4c0 con 0x5603921c79e0 2024-05-09T09:47:31.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.447+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94573336304416] v30'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x5603921c79e0 2024-05-09T09:47:31.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.447+0000 7f95627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:31.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.447+0000 7f96af82c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:31.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.447+0000 7f96af82c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:31.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.447+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e6710 con 0x5603921c79e0 2024-05-09T09:47:31.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.451+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x5603921c79e0 2024-05-09T09:47:31.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.451+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e6c80 con 0x5603921cc3a0 2024-05-09T09:47:31.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.451+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'15 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.451+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e6c80 con 0x5603921d0c60 2024-05-09T09:47:31.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.451+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.451+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e7210 con 0x5603921c79e0 2024-05-09T09:47:31.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.455+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'50 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x5603921c79e0 2024-05-09T09:47:31.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.455+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e76c0 con 0x7f96a40dc040 2024-05-09T09:47:31.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.455+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'35 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x7f96a40dc040 2024-05-09T09:47:31.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.455+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e7a80 con 0x5603921d0c60 2024-05-09T09:47:31.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.455+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.455+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e7ff0 con 0x5603921c79e0 2024-05-09T09:47:31.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.459+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x5603921c79e0 2024-05-09T09:47:31.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.459+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e83f0 con 0x5603921cc3a0 2024-05-09T09:47:31.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.459+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.459+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e83f0 con 0x7f96a40dc040 2024-05-09T09:47:31.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.463+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x7f96a40dc040 2024-05-09T09:47:31.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.463+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e83f0 con 0x5603921d0c60 2024-05-09T09:47:31.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.463+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.463+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e83f0 con 0x7f96a40dc040 2024-05-09T09:47:31.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.467+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'36 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x7f96a40dc040 2024-05-09T09:47:31.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.467+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e83f0 con 0x5603921cc3a0 2024-05-09T09:47:31.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.467+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.467+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e8480 con 0x7f96a40dc040 2024-05-09T09:47:31.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.471+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x7f96a40dc040 2024-05-09T09:47:31.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.471+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e8480 con 0x5603921cc3a0 2024-05-09T09:47:31.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.471+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'29 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.471+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e8570 con 0x5603921c79e0 2024-05-09T09:47:31.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.475+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'51 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x5603921c79e0 2024-05-09T09:47:31.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.475+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e8570 con 0x5603921d0c60 2024-05-09T09:47:31.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.475+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.475+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e8510 con 0x7f96a40dc040 2024-05-09T09:47:31.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.475+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x7f96a40dc040 2024-05-09T09:47:31.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.475+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e8a30 con 0x5603921d0c60 2024-05-09T09:47:31.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.479+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.479+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e8a30 con 0x5603921c79e0 2024-05-09T09:47:31.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.479+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x5603921c79e0 2024-05-09T09:47:31.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.479+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e8a30 con 0x5603921c79e0 2024-05-09T09:47:31.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.479+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'52 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x5603921c79e0 2024-05-09T09:47:31.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.479+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e8a30 con 0x5603921d0c60 2024-05-09T09:47:31.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.483+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'30 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.483+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e8a30 con 0x7f96a40dc040 2024-05-09T09:47:31.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.483+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x7f96a40dc040 2024-05-09T09:47:31.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.483+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e8a30 con 0x5603921d0c60 2024-05-09T09:47:31.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.487+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.487+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e8a30 con 0x5603921d0c60 2024-05-09T09:47:31.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.487+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.487+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e8a30 con 0x5603921d0c60 2024-05-09T09:47:31.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.487+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.487+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e8a30 con 0x5603921d0c60 2024-05-09T09:47:31.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.491+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'24 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.491+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e8a30 con 0x5603921cc3a0 2024-05-09T09:47:31.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.491+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.491+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e8a30 con 0x5603921d0c60 2024-05-09T09:47:31.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.495+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.495+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e8a30 con 0x5603921cc3a0 2024-05-09T09:47:31.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.495+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'24 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.495+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e8a30 con 0x5603921d0c60 2024-05-09T09:47:31.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.499+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'31 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.499+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e8a30 con 0x5603921cc3a0 2024-05-09T09:47:31.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.499+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'30 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.499+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e8a30 con 0x7f96a40dc040 2024-05-09T09:47:31.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.503+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x7f96a40dc040 2024-05-09T09:47:31.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.503+0000 7f95617e2640 20 reqs_thread_entry: start 2024-05-09T09:47:31.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.503+0000 7f96af82c980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:31.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.503+0000 7f94d2ffd640 20 reqs_thread_entry: start 2024-05-09T09:47:31.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.503+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921c79e0 2024-05-09T09:47:31.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.503+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x5603921c79e0 2024-05-09T09:47:31.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.503+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:95 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x7f96a40dc040 2024-05-09T09:47:31.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.503+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(95 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x7f96a40dc040 2024-05-09T09:47:31.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.503+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921c79e0 2024-05-09T09:47:31.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.503+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(96 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x5603921c79e0 2024-05-09T09:47:31.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.503+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:97 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921d0c60 2024-05-09T09:47:31.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.503+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(97 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.503+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:98 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921d0c60 2024-05-09T09:47:31.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.503+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(98 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.507+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:99 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921d0c60 2024-05-09T09:47:31.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.507+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== osd_op_reply(99 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.507+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921c79e0 2024-05-09T09:47:31.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.507+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(100 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x5603921c79e0 2024-05-09T09:47:31.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.507+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:101 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921c79e0 2024-05-09T09:47:31.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.507+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(101 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x5603921c79e0 2024-05-09T09:47:31.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.507+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:102 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921d0c60 2024-05-09T09:47:31.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.507+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 30 ==== osd_op_reply(102 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.507+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:103 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921d0c60 2024-05-09T09:47:31.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.507+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 31 ==== osd_op_reply(103 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.507+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921cc3a0 2024-05-09T09:47:31.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.507+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(104 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.507+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:105 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921c79e0 2024-05-09T09:47:31.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.507+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(105 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x5603921c79e0 2024-05-09T09:47:31.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.507+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:106 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x7f96a40dc040 2024-05-09T09:47:31.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.507+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(106 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x7f96a40dc040 2024-05-09T09:47:31.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.507+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:107 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921d0c60 2024-05-09T09:47:31.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.507+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 32 ==== osd_op_reply(107 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.507+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:108 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921cc3a0 2024-05-09T09:47:31.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.507+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(108 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.507+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:109 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921cc3a0 2024-05-09T09:47:31.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.511+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(109 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.511+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:110 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921d0c60 2024-05-09T09:47:31.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.511+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 33 ==== osd_op_reply(110 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.511+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:111 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921cc3a0 2024-05-09T09:47:31.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.511+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(111 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.511+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:112 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921c79e0 2024-05-09T09:47:31.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.511+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(112 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x5603921c79e0 2024-05-09T09:47:31.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.511+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:113 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921d0c60 2024-05-09T09:47:31.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.511+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 34 ==== osd_op_reply(113 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.511+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:114 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921cc3a0 2024-05-09T09:47:31.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.511+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(114 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.511+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:115 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x7f96a40dc040 2024-05-09T09:47:31.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.511+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(115 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x7f96a40dc040 2024-05-09T09:47:31.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.511+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:116 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921cc3a0 2024-05-09T09:47:31.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.511+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(116 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.511+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:117 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921c79e0 2024-05-09T09:47:31.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.515+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(117 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x5603921c79e0 2024-05-09T09:47:31.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.515+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:118 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921c79e0 2024-05-09T09:47:31.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.515+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(118 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x5603921c79e0 2024-05-09T09:47:31.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.515+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:119 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921d0c60 2024-05-09T09:47:31.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.515+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 35 ==== osd_op_reply(119 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.515+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:120 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921c79e0 2024-05-09T09:47:31.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.515+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(120 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x5603921c79e0 2024-05-09T09:47:31.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.515+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:121 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921c79e0 2024-05-09T09:47:31.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.515+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 36 ==== osd_op_reply(121 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x5603921c79e0 2024-05-09T09:47:31.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.515+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:122 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921d0c60 2024-05-09T09:47:31.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.515+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 36 ==== osd_op_reply(122 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.515+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:123 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921d0c60 2024-05-09T09:47:31.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.515+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 37 ==== osd_op_reply(123 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.515+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:124 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921d0c60 2024-05-09T09:47:31.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.515+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 38 ==== osd_op_reply(124 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.515+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:125 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921cc3a0 2024-05-09T09:47:31.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.515+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(125 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.519+0000 7f95627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:31.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.519+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:126 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94573336304416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921c79e0 2024-05-09T09:47:31.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.519+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 37 ==== osd_op_reply(126 data_loggenerations_metadata [watch unwatch cookie 94573336304416] v30'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x5603921c79e0 2024-05-09T09:47:31.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.519+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:127 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94573336285168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x7f96a40dc040 2024-05-09T09:47:31.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.519+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(127 notify.0 [watch unwatch cookie 94573336285168] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x7f96a40dc040 2024-05-09T09:47:31.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.519+0000 7f96af82c980 20 remove_watcher() i=0 2024-05-09T09:47:31.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.519+0000 7f96af82c980 2 removed watcher, disabling cache 2024-05-09T09:47:31.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.519+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:128 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94573336289296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921c79e0 2024-05-09T09:47:31.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.523+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 38 ==== osd_op_reply(128 notify.1 [watch unwatch cookie 94573336289296] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x5603921c79e0 2024-05-09T09:47:31.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.523+0000 7f96af82c980 20 remove_watcher() i=1 2024-05-09T09:47:31.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.523+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:129 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94573336291600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921d0c60 2024-05-09T09:47:31.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.523+0000 7f96acb46640 1 -- 172.21.15.157:0/1426874290 <== osd.3 v2:172.21.15.157:6816/2487336710 39 ==== osd_op_reply(129 notify.2 [watch unwatch cookie 94573336291600] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a40c9030 con 0x5603921d0c60 2024-05-09T09:47:31.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.523+0000 7f96af82c980 20 remove_watcher() i=2 2024-05-09T09:47:31.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.523+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:130 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94573336296304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x7f96a40dc040 2024-05-09T09:47:31.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.527+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(130 notify.3 [watch unwatch cookie 94573336296304] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x7f96a40dc040 2024-05-09T09:47:31.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.527+0000 7f96af82c980 20 remove_watcher() i=3 2024-05-09T09:47:31.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.527+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:131 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94573336282688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921c79e0 2024-05-09T09:47:31.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.527+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 <== osd.1 v2:172.21.15.157:6808/3930131338 39 ==== osd_op_reply(131 notify.4 [watch unwatch cookie 94573336282688] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a0036040 con 0x5603921c79e0 2024-05-09T09:47:31.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.527+0000 7f96af82c980 20 remove_watcher() i=4 2024-05-09T09:47:31.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.527+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:132 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94573336299936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921cc3a0 2024-05-09T09:47:31.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.531+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 32 ==== osd_op_reply(132 notify.5 [watch unwatch cookie 94573336299936] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.531+0000 7f96af82c980 20 remove_watcher() i=5 2024-05-09T09:47:31.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.531+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:133 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94573336303264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921cc3a0 2024-05-09T09:47:31.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.531+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 33 ==== osd_op_reply(133 notify.6 [watch unwatch cookie 94573336303264] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.531+0000 7f96af82c980 20 remove_watcher() i=6 2024-05-09T09:47:31.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.531+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:134 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94573336307344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5603921e4bf0 con 0x5603921cc3a0 2024-05-09T09:47:31.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96ad347640 1 -- 172.21.15.157:0/1426874290 <== osd.0 v2:172.21.15.110:6800/231209037 34 ==== osd_op_reply(134 notify.7 [watch unwatch cookie 94573336307344] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f96a806f030 con 0x5603921cc3a0 2024-05-09T09:47:31.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 20 remove_watcher() i=7 2024-05-09T09:47:31.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5603921cc3a0 msgr2=0x5603921ce790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 --2- 172.21.15.157:0/1426874290 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5603921cc3a0 0x5603921ce790 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5603921c79e0 msgr2=0x5603921c9ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 --2- 172.21.15.157:0/1426874290 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5603921c79e0 0x5603921c9ea0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f96a40dc040 msgr2=0x7f96a40ce940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 --2- 172.21.15.157:0/1426874290 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f96a40dc040 0x7f96a40ce940 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5603921d0c60 msgr2=0x5603921d3120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 --2- 172.21.15.157:0/1426874290 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5603921d0c60 0x5603921d3120 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f957c034b60 msgr2=0x7f957c037020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 --2- 172.21.15.157:0/1426874290 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f957c034b60 0x7f957c037020 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f96a40ab510 tx=0x7f96a40b9040 comp rx=0 tx=0).stop 2024-05-09T09:47:31.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5603921b3c20 msgr2=0x5603921baf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 --2- 172.21.15.157:0/1426874290 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5603921b3c20 0x5603921baf10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f96a80478b0 tx=0x7f96a804ef60 comp rx=0 tx=0).stop 2024-05-09T09:47:31.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 reap_dead start 2024-05-09T09:47:31.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96adb48640 1 -- 172.21.15.157:0/1426874290 reap_dead start 2024-05-09T09:47:31.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 shutdown_connections 2024-05-09T09:47:31.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 >> 172.21.15.157:0/1426874290 conn(0x5603921affa0 msgr2=0x5603921adfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:31.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 shutdown_connections 2024-05-09T09:47:31.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 -- 172.21.15.157:0/1426874290 wait complete. 2024-05-09T09:47:31.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 -- 172.21.15.157:0/2254325198 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9584034bb0 msgr2=0x7f9584037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 --2- 172.21.15.157:0/2254325198 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9584034bb0 0x7f9584037070 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x560392178a10 tx=0x7f96a4005a10 comp rx=0 tx=0).stop 2024-05-09T09:47:31.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 -- 172.21.15.157:0/2254325198 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5603921a6cb0 msgr2=0x5603921a70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 --2- 172.21.15.157:0/2254325198 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5603921a6cb0 0x5603921a70d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f96a80106e0 tx=0x7f96a804a420 comp rx=0 tx=0).stop 2024-05-09T09:47:31.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 -- 172.21.15.157:0/2254325198 shutdown_connections 2024-05-09T09:47:31.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 --2- 172.21.15.157:0/2254325198 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9584034bb0 0x7f9584037070 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 --2- 172.21.15.157:0/2254325198 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5603921a6cb0 0x5603921a70d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 -- 172.21.15.157:0/2254325198 >> 172.21.15.157:0/2254325198 conn(0x56039219ba80 msgr2=0x56039219c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:31.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 -- 172.21.15.157:0/2254325198 shutdown_connections 2024-05-09T09:47:31.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 -- 172.21.15.157:0/2254325198 wait complete. 2024-05-09T09:47:31.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 -- 172.21.15.157:0/1602136286 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56039217a460 msgr2=0x56039217c850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 --2- 172.21.15.157:0/1602136286 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56039217a460 0x56039217c850 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 -- 172.21.15.157:0/1602136286 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560392082e30 msgr2=0x560392177ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 --2- 172.21.15.157:0/1602136286 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560392082e30 0x560392177ae0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 -- 172.21.15.157:0/1602136286 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56039217e380 msgr2=0x560392180770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 --2- 172.21.15.157:0/1602136286 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56039217e380 0x560392180770 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 -- 172.21.15.157:0/1602136286 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9594034bb0 msgr2=0x7f9594037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 --2- 172.21.15.157:0/1602136286 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9594034bb0 0x7f9594037070 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f96a40ad000 tx=0x7f96a40a5040 comp rx=0 tx=0).stop 2024-05-09T09:47:31.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 -- 172.21.15.157:0/1602136286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56039207e970 msgr2=0x560392170b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 --2- 172.21.15.157:0/1602136286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56039207e970 0x560392170b50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f96a8002260 tx=0x7f96a8000f50 comp rx=0 tx=0).stop 2024-05-09T09:47:31.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96adb48640 1 -- 172.21.15.157:0/1602136286 reap_dead start 2024-05-09T09:47:31.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 -- 172.21.15.157:0/1602136286 shutdown_connections 2024-05-09T09:47:31.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 -- 172.21.15.157:0/1602136286 >> 172.21.15.157:0/1602136286 conn(0x56039207a240 msgr2=0x560392163f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:31.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 -- 172.21.15.157:0/1602136286 shutdown_connections 2024-05-09T09:47:31.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.535+0000 7f96af82c980 1 -- 172.21.15.157:0/1602136286 wait complete. 2024-05-09T09:47:31.546 INFO:teuthology.orchestra.run.smithi157.stdout:{"entries":[],"summary":[]} 2024-05-09T09:47:31.546 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-05-09T09:47:31.546 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-09T09:47:31.546 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-09T09:47:31.547 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-09T09:47:31.624 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:31.624 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:31.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.627+0000 7fce1558a980 1 Processor -- start 2024-05-09T09:47:31.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.627+0000 7fce1558a980 1 -- start start 2024-05-09T09:47:31.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.627+0000 7fce1558a980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55aba07a1980 0x55aba07a1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.627+0000 7fce1558a980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55aba0657440 con 0x55aba07a22a0 2024-05-09T09:47:31.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.627+0000 7fce1558a980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55aba06425f0 con 0x55aba07a1980 2024-05-09T09:47:31.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.627+0000 7fce130a5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55aba07a1980 0x55aba07a1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.627+0000 7fce130a5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55aba07a1980 0x55aba07a1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53768/0 (socket says 172.21.15.157:53768) 2024-05-09T09:47:31.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.627+0000 7fce128a4640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x55aba07a22a0 0x55aba07a2c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:33558/0 (socket says 172.21.15.157:33558) 2024-05-09T09:47:31.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.627+0000 7fce130a5640 1 -- 172.21.15.157:0/793398919 learned_addr learned my addr 172.21.15.157:0/793398919 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:31.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.627+0000 7fce130a5640 1 -- 172.21.15.157:0/793398919 >> v1:172.21.15.110:6789/0 conn(0x55aba07a22a0 legacy=0x55aba07a2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.627+0000 7fce130a5640 1 -- 172.21.15.157:0/793398919 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aba064d990 con 0x55aba07a1980 2024-05-09T09:47:31.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.631+0000 7fce130a5640 1 --2- 172.21.15.157:0/793398919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba07a1980 0x55aba07a1d60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fce0400a4e0 tx=0x7fce0401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5828c6e459cf169 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.631+0000 7fce120a3640 1 -- 172.21.15.157:0/793398919 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce040aa540 con 0x55aba07a1980 2024-05-09T09:47:31.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.631+0000 7fce120a3640 1 -- 172.21.15.157:0/793398919 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce040aa6e0 con 0x55aba07a1980 2024-05-09T09:47:31.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.631+0000 7fce120a3640 1 -- 172.21.15.157:0/793398919 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce040aaa40 con 0x55aba07a1980 2024-05-09T09:47:31.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.631+0000 7fce1558a980 1 -- 172.21.15.157:0/793398919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba07a1980 msgr2=0x55aba07a1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.631+0000 7fce1558a980 1 --2- 172.21.15.157:0/793398919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba07a1980 0x55aba07a1d60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fce0400a4e0 tx=0x7fce0401b090 comp rx=0 tx=0).stop 2024-05-09T09:47:31.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.631+0000 7fce1558a980 1 -- 172.21.15.157:0/793398919 shutdown_connections 2024-05-09T09:47:31.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.631+0000 7fce1558a980 1 --2- 172.21.15.157:0/793398919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba07a1980 0x55aba07a1d60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.631+0000 7fce1558a980 1 -- 172.21.15.157:0/793398919 >> 172.21.15.157:0/793398919 conn(0x55aba079d250 msgr2=0x55aba079f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:31.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.631+0000 7fce1558a980 1 -- 172.21.15.157:0/793398919 shutdown_connections 2024-05-09T09:47:31.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.631+0000 7fce1558a980 1 -- 172.21.15.157:0/793398919 wait complete. 2024-05-09T09:47:31.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.647+0000 7fce1558a980 1 Processor -- start 2024-05-09T09:47:31.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.647+0000 7fce1558a980 1 -- start start 2024-05-09T09:47:31.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.647+0000 7fce1558a980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba07a1980 0x55aba088d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.647+0000 7fce1558a980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55aba06a4fe0 con 0x55aba07a1980 2024-05-09T09:47:31.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.647+0000 7fce130a5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba07a1980 0x55aba088d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.647+0000 7fce130a5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba07a1980 0x55aba088d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53784/0 (socket says 172.21.15.157:53784) 2024-05-09T09:47:31.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.647+0000 7fce130a5640 1 -- 172.21.15.157:0/3191388851 learned_addr learned my addr 172.21.15.157:0/3191388851 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:31.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.647+0000 7fce130a5640 1 -- 172.21.15.157:0/3191388851 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aba0629ae0 con 0x55aba07a1980 2024-05-09T09:47:31.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.647+0000 7fce130a5640 1 --2- 172.21.15.157:0/3191388851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba07a1980 0x55aba088d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fce04018cc0 tx=0x7fce040033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e6742d901299b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.647+0000 7fcd0160a640 1 -- 172.21.15.157:0/3191388851 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce040b9070 con 0x55aba07a1980 2024-05-09T09:47:31.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.647+0000 7fcd0160a640 1 -- 172.21.15.157:0/3191388851 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce040aaa80 con 0x55aba07a1980 2024-05-09T09:47:31.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.647+0000 7fcd0160a640 1 -- 172.21.15.157:0/3191388851 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce040aad60 con 0x55aba07a1980 2024-05-09T09:47:31.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.651+0000 7fce1558a980 1 -- 172.21.15.157:0/3191388851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba07a1980 msgr2=0x55aba088d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.651+0000 7fce1558a980 1 --2- 172.21.15.157:0/3191388851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba07a1980 0x55aba088d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fce04018cc0 tx=0x7fce040033b0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.651+0000 7fce1558a980 1 -- 172.21.15.157:0/3191388851 shutdown_connections 2024-05-09T09:47:31.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.651+0000 7fce1558a980 1 --2- 172.21.15.157:0/3191388851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba07a1980 0x55aba088d190 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.651+0000 7fce1558a980 1 -- 172.21.15.157:0/3191388851 >> 172.21.15.157:0/3191388851 conn(0x55aba079d250 msgr2=0x55aba0888d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:31.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.651+0000 7fce1558a980 1 -- 172.21.15.157:0/3191388851 shutdown_connections 2024-05-09T09:47:31.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.651+0000 7fce1558a980 1 -- 172.21.15.157:0/3191388851 wait complete. 2024-05-09T09:47:31.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.651+0000 7fce1558a980 1 Processor -- start 2024-05-09T09:47:31.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.651+0000 7fce1558a980 1 -- start start 2024-05-09T09:47:31.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.651+0000 7fce1558a980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba07a1980 0x55aba0894220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.651+0000 7fce1558a980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55aba07ab980 con 0x55aba07a1980 2024-05-09T09:47:31.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.651+0000 7fce130a5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba07a1980 0x55aba0894220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.651+0000 7fce130a5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba07a1980 0x55aba0894220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53796/0 (socket says 172.21.15.157:53796) 2024-05-09T09:47:31.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.651+0000 7fce130a5640 1 -- 172.21.15.157:0/463939556 learned_addr learned my addr 172.21.15.157:0/463939556 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:31.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.651+0000 7fce130a5640 1 -- 172.21.15.157:0/463939556 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aba0894760 con 0x55aba07a1980 2024-05-09T09:47:31.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.651+0000 7fce130a5640 1 --2- 172.21.15.157:0/463939556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba07a1980 0x55aba0894220 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fce0401aec0 tx=0x7fce04017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.651+0000 7fccffe07640 1 -- 172.21.15.157:0/463939556 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce040b9070 con 0x55aba07a1980 2024-05-09T09:47:31.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.651+0000 7fce1558a980 1 -- 172.21.15.157:0/463939556 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aba08949f0 con 0x55aba07a1980 2024-05-09T09:47:31.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.651+0000 7fccffe07640 1 -- 172.21.15.157:0/463939556 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce040c7410 con 0x55aba07a1980 2024-05-09T09:47:31.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.651+0000 7fccffe07640 1 -- 172.21.15.157:0/463939556 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce040c76f0 con 0x55aba07a1980 2024-05-09T09:47:31.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.651+0000 7fce1558a980 1 -- 172.21.15.157:0/463939556 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aba0897680 con 0x55aba07a1980 2024-05-09T09:47:31.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.651+0000 7fccffe07640 1 -- 172.21.15.157:0/463939556 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fce040b3040 con 0x55aba07a1980 2024-05-09T09:47:31.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.655+0000 7fccffe07640 1 --2- 172.21.15.157:0/463939556 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fccf8034bb0 0x7fccf8037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.655+0000 7fccffe07640 1 -- 172.21.15.157:0/463939556 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fce040c4070 con 0x55aba07a1980 2024-05-09T09:47:31.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.655+0000 7fce128a4640 1 --2- 172.21.15.157:0/463939556 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fccf8034bb0 0x7fccf8037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.655+0000 7fce1558a980 1 --2- 172.21.15.157:0/463939556 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55aba07a22a0 0x55aba089b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.655+0000 7fce1558a980 1 -- 172.21.15.157:0/463939556 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55aba089b850 con 0x55aba07a22a0 2024-05-09T09:47:31.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.655+0000 7fce138a6640 1 --2- 172.21.15.157:0/463939556 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55aba07a22a0 0x55aba089b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.655+0000 7fce128a4640 1 --2- 172.21.15.157:0/463939556 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fccf8034bb0 0x7fccf8037070 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fce08001e50 tx=0x7fce080013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.655+0000 7fce138a6640 1 --2- 172.21.15.157:0/463939556 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55aba07a22a0 0x55aba089b2d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.655+0000 7fce138a6640 1 -- 172.21.15.157:0/463939556 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce0c0083f0 con 0x55aba07a22a0 2024-05-09T09:47:31.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.655+0000 7fce1558a980 1 -- 172.21.15.157:0/463939556 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55aba089c0d0 con 0x55aba07a22a0 2024-05-09T09:47:31.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.655+0000 7fce138a6640 1 -- 172.21.15.157:0/463939556 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fce0c0083f0 con 0x55aba07a22a0 2024-05-09T09:47:31.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.655+0000 7fce1558a980 1 --2- 172.21.15.157:0/463939556 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55aba089da20 0x55aba089feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.655+0000 7fce1558a980 1 -- 172.21.15.157:0/463939556 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55aba08a0640 con 0x55aba089da20 2024-05-09T09:47:31.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.655+0000 7fce130a5640 1 --2- 172.21.15.157:0/463939556 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55aba089da20 0x55aba089feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.655+0000 7fce130a5640 1 --2- 172.21.15.157:0/463939556 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55aba089da20 0x55aba089feb0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.655+0000 7fce130a5640 1 -- 172.21.15.157:0/463939556 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fce040cd060 con 0x55aba089da20 2024-05-09T09:47:31.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.655+0000 7fce1558a980 1 -- 172.21.15.157:0/463939556 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55aba089c920 con 0x55aba07a22a0 2024-05-09T09:47:31.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.655+0000 7fce138a6640 1 -- 172.21.15.157:0/463939556 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fce0c0083f0 con 0x55aba07a22a0 2024-05-09T09:47:31.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.655+0000 7fce1558a980 1 --2- 172.21.15.157:0/463939556 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55aba08a1aa0 0x55aba08a3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.655+0000 7fce1558a980 1 -- 172.21.15.157:0/463939556 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55aba08a45d0 con 0x55aba08a1aa0 2024-05-09T09:47:31.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.659+0000 7fce128a4640 1 --2- 172.21.15.157:0/463939556 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55aba08a1aa0 0x55aba08a3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.659+0000 7fce128a4640 1 --2- 172.21.15.157:0/463939556 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55aba08a1aa0 0x55aba08a3e90 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.659+0000 7fce128a4640 1 -- 172.21.15.157:0/463939556 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fce0800f700 con 0x55aba08a1aa0 2024-05-09T09:47:31.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.663+0000 7fce1558a980 1 Processor -- start 2024-05-09T09:47:31.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.663+0000 7fce1558a980 1 -- start start 2024-05-09T09:47:31.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.663+0000 7fce1558a980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba08ca640 0x55aba08caa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.663+0000 7fce1558a980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55aba06a9020 con 0x55aba08ca640 2024-05-09T09:47:31.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.663+0000 7fce130a5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba08ca640 0x55aba08caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.663+0000 7fce130a5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba08ca640 0x55aba08caa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53804/0 (socket says 172.21.15.157:53804) 2024-05-09T09:47:31.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.663+0000 7fce130a5640 1 -- 172.21.15.157:0/4010493304 learned_addr learned my addr 172.21.15.157:0/4010493304 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:31.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.663+0000 7fce130a5640 1 -- 172.21.15.157:0/4010493304 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aba08cafa0 con 0x55aba08ca640 2024-05-09T09:47:31.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.663+0000 7fce130a5640 1 --2- 172.21.15.157:0/4010493304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba08ca640 0x55aba08caa60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fce040e3750 tx=0x7fce040c6db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.663+0000 7fccf7fff640 1 -- 172.21.15.157:0/4010493304 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce040db020 con 0x55aba08ca640 2024-05-09T09:47:31.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.663+0000 7fce1558a980 1 -- 172.21.15.157:0/4010493304 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aba08cba30 con 0x55aba08ca640 2024-05-09T09:47:31.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.663+0000 7fce1558a980 1 -- 172.21.15.157:0/4010493304 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aba08cbf10 con 0x55aba08ca640 2024-05-09T09:47:31.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.663+0000 7fccf7fff640 1 -- 172.21.15.157:0/4010493304 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce040c6720 con 0x55aba08ca640 2024-05-09T09:47:31.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.663+0000 7fccf7fff640 1 -- 172.21.15.157:0/4010493304 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce040b2970 con 0x55aba08ca640 2024-05-09T09:47:31.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.667+0000 7fccf7fff640 1 -- 172.21.15.157:0/4010493304 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fce040ec060 con 0x55aba08ca640 2024-05-09T09:47:31.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.667+0000 7fccf7fff640 1 --2- 172.21.15.157:0/4010493304 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fccec034bb0 0x7fccec037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.667+0000 7fccf7fff640 1 -- 172.21.15.157:0/4010493304 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fce040df030 con 0x55aba08ca640 2024-05-09T09:47:31.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.667+0000 7fce128a4640 1 --2- 172.21.15.157:0/4010493304 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fccec034bb0 0x7fccec037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.667+0000 7fce1558a980 1 Processor -- start 2024-05-09T09:47:31.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.667+0000 7fce1558a980 1 -- start start 2024-05-09T09:47:31.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.667+0000 7fce128a4640 1 --2- 172.21.15.157:0/4010493304 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fccec034bb0 0x7fccec037070 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55aba08a0a10 tx=0x7fce0800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.667+0000 7fce1558a980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba08d75d0 0x55aba08d79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.667+0000 7fce1558a980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55aba088d820 con 0x55aba08d75d0 2024-05-09T09:47:31.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.667+0000 7fce130a5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba08d75d0 0x55aba08d79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.667+0000 7fce130a5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba08d75d0 0x55aba08d79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53816/0 (socket says 172.21.15.157:53816) 2024-05-09T09:47:31.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.667+0000 7fce130a5640 1 -- 172.21.15.157:0/3952886229 learned_addr learned my addr 172.21.15.157:0/3952886229 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:31.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.667+0000 7fce130a5640 1 -- 172.21.15.157:0/3952886229 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aba08d7fc0 con 0x55aba08d75d0 2024-05-09T09:47:31.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.667+0000 7fce130a5640 1 --2- 172.21.15.157:0/3952886229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba08d75d0 0x55aba08d79f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fce040a9510 tx=0x7fce040e5500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=291e2bf853394b29 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.667+0000 7fccf5ffb640 1 -- 172.21.15.157:0/3952886229 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce040fe020 con 0x55aba08d75d0 2024-05-09T09:47:31.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.667+0000 7fccf5ffb640 1 -- 172.21.15.157:0/3952886229 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce040e5a10 con 0x55aba08d75d0 2024-05-09T09:47:31.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.667+0000 7fccf5ffb640 1 -- 172.21.15.157:0/3952886229 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce040bcc80 con 0x55aba08d75d0 2024-05-09T09:47:31.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.671+0000 7fce1558a980 1 -- 172.21.15.157:0/3952886229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba08d75d0 msgr2=0x55aba08d79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.671+0000 7fce1558a980 1 --2- 172.21.15.157:0/3952886229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba08d75d0 0x55aba08d79f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fce040a9510 tx=0x7fce040e5500 comp rx=0 tx=0).stop 2024-05-09T09:47:31.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.671+0000 7fce1558a980 1 -- 172.21.15.157:0/3952886229 shutdown_connections 2024-05-09T09:47:31.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.671+0000 7fce1558a980 1 --2- 172.21.15.157:0/3952886229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba08d75d0 0x55aba08d79f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.671+0000 7fce1558a980 1 -- 172.21.15.157:0/3952886229 >> 172.21.15.157:0/3952886229 conn(0x55aba08d39a0 msgr2=0x55aba08d1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:31.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.671+0000 7fce1558a980 1 -- 172.21.15.157:0/3952886229 shutdown_connections 2024-05-09T09:47:31.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.671+0000 7fce1558a980 1 -- 172.21.15.157:0/3952886229 wait complete. 2024-05-09T09:47:31.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.671+0000 7fce1558a980 1 Processor -- start 2024-05-09T09:47:31.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.671+0000 7fce1558a980 1 -- start start 2024-05-09T09:47:31.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.671+0000 7fce1558a980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba08d75d0 0x55aba08de960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.671+0000 7fce1558a980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55aba08d8560 con 0x55aba08d75d0 2024-05-09T09:47:31.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.671+0000 7fce130a5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba08d75d0 0x55aba08de960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.671+0000 7fce130a5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba08d75d0 0x55aba08de960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53822/0 (socket says 172.21.15.157:53822) 2024-05-09T09:47:31.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.671+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 learned_addr learned my addr 172.21.15.157:0/183352990 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:31.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.671+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aba08deea0 con 0x55aba08d75d0 2024-05-09T09:47:31.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.671+0000 7fce130a5640 1 --2- 172.21.15.157:0/183352990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba08d75d0 0x55aba08de960 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fce040cf4c0 tx=0x7fce040bfd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.671+0000 7fcce3fff640 1 -- 172.21.15.157:0/183352990 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce04113070 con 0x55aba08d75d0 2024-05-09T09:47:31.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.671+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aba08deea0 con 0x55aba08d75d0 2024-05-09T09:47:31.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.671+0000 7fcce3fff640 1 -- 172.21.15.157:0/183352990 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce040bd400 con 0x55aba08d75d0 2024-05-09T09:47:31.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.671+0000 7fcce3fff640 1 -- 172.21.15.157:0/183352990 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce040bc360 con 0x55aba08d75d0 2024-05-09T09:47:31.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.671+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aba08df380 con 0x55aba08d75d0 2024-05-09T09:47:31.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.671+0000 7fce1558a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.671+0000 7fcce3fff640 1 -- 172.21.15.157:0/183352990 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fce04116070 con 0x55aba08d75d0 2024-05-09T09:47:31.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fcce3fff640 1 --2- 172.21.15.157:0/183352990 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fccdc034bb0 0x7fccdc037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fcce3fff640 1 -- 172.21.15.157:0/183352990 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fce0410a030 con 0x55aba08d75d0 2024-05-09T09:47:31.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce128a4640 1 --2- 172.21.15.157:0/183352990 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fccdc034bb0 0x7fccdc037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce1558a980 1 --2- 172.21.15.157:0/183352990 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55aba08eb4e0 0x55aba08ed970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ee0c0 con 0x55aba08eb4e0 2024-05-09T09:47:31.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce138a6640 1 --2- 172.21.15.157:0/183352990 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55aba08eb4e0 0x55aba08ed970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce128a4640 1 --2- 172.21.15.157:0/183352990 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fccdc034bb0 0x7fccdc037070 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55aba089c0a0 tx=0x7fce08010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce138a6640 1 --2- 172.21.15.157:0/183352990 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55aba08eb4e0 0x55aba08ed970 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce0c0083f0 con 0x55aba08eb4e0 2024-05-09T09:47:31.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce1558a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce1558a980 20 realm 2024-05-09T09:47:31.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce1558a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ee4d0 con 0x55aba08eb4e0 2024-05-09T09:47:31.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce0c0083f0 con 0x55aba08eb4e0 2024-05-09T09:47:31.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce1558a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce1558a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:31.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce1558a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55aba08eed70 con 0x55aba08eb4e0 2024-05-09T09:47:31.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce0c0083f0 con 0x55aba08eb4e0 2024-05-09T09:47:31.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce1558a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce1558a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x55aba08eb4e0 2024-05-09T09:47:31.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fce0c0083f0 con 0x55aba08eb4e0 2024-05-09T09:47:31.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce1558a980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:31.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce1558a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce1558a980 1 --2- 172.21.15.157:0/183352990 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55aba08efe70 0x55aba08f2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55aba08f27e0 con 0x55aba08efe70 2024-05-09T09:47:31.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce130a5640 1 --2- 172.21.15.157:0/183352990 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55aba08efe70 0x55aba08f2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce130a5640 1 --2- 172.21.15.157:0/183352990 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55aba08efe70 0x55aba08f2260 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fce04115030 con 0x55aba08efe70 2024-05-09T09:47:31.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce1558a980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:31.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce1558a980 20 searching for the correct realm 2024-05-09T09:47:31.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce1558a980 1 --2- 172.21.15.157:0/183352990 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55aba08f4710 0x55aba08f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.675+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08f7270 con 0x55aba08f4710 2024-05-09T09:47:31.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.679+0000 7fce128a4640 1 --2- 172.21.15.157:0/183352990 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55aba08f4710 0x55aba08f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.679+0000 7fce128a4640 1 --2- 172.21.15.157:0/183352990 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55aba08f4710 0x55aba08f6ba0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.679+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce08037040 con 0x55aba08f4710 2024-05-09T09:47:31.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.679+0000 7fce128a4640 1 --2- 172.21.15.157:0/183352990 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fce0801fc60 0x7fce0803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.679+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08f7270 con 0x7fce0801fc60 2024-05-09T09:47:31.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.679+0000 7fce138a6640 1 --2- 172.21.15.157:0/183352990 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fce0801fc60 0x7fce0803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.679+0000 7fce138a6640 1 --2- 172.21.15.157:0/183352990 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fce0801fc60 0x7fce0803a3c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.679+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce0c0083f0 con 0x7fce0801fc60 2024-05-09T09:47:31.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.679+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x55aba08efe70 2024-05-09T09:47:31.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.679+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce04115030 con 0x55aba08efe70 2024-05-09T09:47:31.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.679+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x55aba08eb4e0 2024-05-09T09:47:31.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.679+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce0c0083f0 con 0x55aba08eb4e0 2024-05-09T09:47:31.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.679+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x55aba08eb4e0 2024-05-09T09:47:31.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.679+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce0c026040 con 0x55aba08eb4e0 2024-05-09T09:47:31.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.679+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x55aba08efe70 2024-05-09T09:47:31.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.679+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce04115030 con 0x55aba08efe70 2024-05-09T09:47:31.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.679+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x55aba08efe70 2024-05-09T09:47:31.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.683+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce04115030 con 0x55aba08efe70 2024-05-09T09:47:31.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.683+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x7fce0801fc60 2024-05-09T09:47:31.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.683+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce0c026040 con 0x7fce0801fc60 2024-05-09T09:47:31.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.683+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x55aba08f4710 2024-05-09T09:47:31.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.683+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce08037040 con 0x55aba08f4710 2024-05-09T09:47:31.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.683+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x55aba08eb4e0 2024-05-09T09:47:31.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.683+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce0c026040 con 0x55aba08eb4e0 2024-05-09T09:47:31.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.683+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x55aba08efe70 2024-05-09T09:47:31.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.683+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce04115030 con 0x55aba08efe70 2024-05-09T09:47:31.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.683+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x55aba08eb4e0 2024-05-09T09:47:31.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.683+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce0c026040 con 0x55aba08eb4e0 2024-05-09T09:47:31.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.683+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x7fce0801fc60 2024-05-09T09:47:31.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.683+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fce0c026040 con 0x7fce0801fc60 2024-05-09T09:47:31.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.683+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x55aba08f4710 2024-05-09T09:47:31.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.683+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce08037040 con 0x55aba08f4710 2024-05-09T09:47:31.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.683+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x55aba08f4710 2024-05-09T09:47:31.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.683+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fce08037040 con 0x55aba08f4710 2024-05-09T09:47:31.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.683+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x55aba08efe70 2024-05-09T09:47:31.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.687+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce04115030 con 0x55aba08efe70 2024-05-09T09:47:31.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.687+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x55aba08f4710 2024-05-09T09:47:31.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.687+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce08037040 con 0x55aba08f4710 2024-05-09T09:47:31.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.687+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x55aba08f4710 2024-05-09T09:47:31.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.687+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce08037040 con 0x55aba08f4710 2024-05-09T09:47:31.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.687+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x55aba08eb4e0 2024-05-09T09:47:31.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.687+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce0c026040 con 0x55aba08eb4e0 2024-05-09T09:47:31.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.687+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x55aba08eb4e0 2024-05-09T09:47:31.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.687+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fce0c026040 con 0x55aba08eb4e0 2024-05-09T09:47:31.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.687+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x55aba08efe70 2024-05-09T09:47:31.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.687+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce04115030 con 0x55aba08efe70 2024-05-09T09:47:31.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.687+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x55aba08f4710 2024-05-09T09:47:31.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.687+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce08037040 con 0x55aba08f4710 2024-05-09T09:47:31.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.687+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x7fce0801fc60 2024-05-09T09:47:31.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.687+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce0c026040 con 0x7fce0801fc60 2024-05-09T09:47:31.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.687+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x55aba08eb4e0 2024-05-09T09:47:31.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.687+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce0c026040 con 0x55aba08eb4e0 2024-05-09T09:47:31.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.687+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x55aba08efe70 2024-05-09T09:47:31.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.687+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fce04115030 con 0x55aba08efe70 2024-05-09T09:47:31.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.687+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x55aba08f4710 2024-05-09T09:47:31.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce08037040 con 0x55aba08f4710 2024-05-09T09:47:31.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x55aba08efe70 2024-05-09T09:47:31.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce04115030 con 0x55aba08efe70 2024-05-09T09:47:31.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x7fce0801fc60 2024-05-09T09:47:31.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce0c026040 con 0x7fce0801fc60 2024-05-09T09:47:31.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x55aba08f4710 2024-05-09T09:47:31.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce0804a040 con 0x55aba08f4710 2024-05-09T09:47:31.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x55aba08efe70 2024-05-09T09:47:31.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce04115030 con 0x55aba08efe70 2024-05-09T09:47:31.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x55aba08eb4e0 2024-05-09T09:47:31.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fce0c026040 con 0x55aba08eb4e0 2024-05-09T09:47:31.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ef110 con 0x7fce0801fc60 2024-05-09T09:47:31.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce0c026040 con 0x7fce0801fc60 2024-05-09T09:47:31.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce1558a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:31.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce1558a980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:31.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce1558a980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:31.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce1558a980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:31.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce1558a980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:31.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce1558a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:31.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce1558a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55aba08f3030 con 0x55aba08eb4e0 2024-05-09T09:47:31.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce0c026040 con 0x55aba08eb4e0 2024-05-09T09:47:31.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce1558a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce1558a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55aba08f3030 con 0x55aba08eb4e0 2024-05-09T09:47:31.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fce0c026040 con 0x55aba08eb4e0 2024-05-09T09:47:31.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce1558a980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:31.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce1558a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55aba08f3030 con 0x55aba08f4710 2024-05-09T09:47:31.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.691+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fce0804a040 con 0x55aba08f4710 2024-05-09T09:47:31.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.695+0000 7fce1558a980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:31.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.695+0000 7fce1558a980 20 zone default found 2024-05-09T09:47:31.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.695+0000 7fce1558a980 4 Realm: () 2024-05-09T09:47:31.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.695+0000 7fce1558a980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:31.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.695+0000 7fce1558a980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:31.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.695+0000 7fce1558a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:31.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.695+0000 7fce1558a980 20 zonegroup default 2024-05-09T09:47:31.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.695+0000 7fce1558a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.695+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55aba08f38d0 con 0x55aba08efe70 2024-05-09T09:47:31.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.695+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fce04115030 con 0x55aba08efe70 2024-05-09T09:47:31.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.695+0000 7fce1558a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.695+0000 7fce1558a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.695+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55aba08f90d0 con 0x55aba08f4710 2024-05-09T09:47:31.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.695+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fce0804a040 con 0x55aba08f4710 2024-05-09T09:47:31.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.695+0000 7fce1558a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.695+0000 7fce1558a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.695+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55aba08f9470 con 0x55aba08f4710 2024-05-09T09:47:31.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.695+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fce0804a040 con 0x55aba08f4710 2024-05-09T09:47:31.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.695+0000 7fce1558a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.695+0000 7fce1558a980 20 started sync module instance, tier type = 2024-05-09T09:47:31.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.695+0000 7fce1558a980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:31.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.695+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba08f8570 con 0x7fce0801fc60 2024-05-09T09:47:31.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.695+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce0c026040 con 0x7fce0801fc60 2024-05-09T09:47:31.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.695+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94195621530224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba08f8570 con 0x7fce0801fc60 2024-05-09T09:47:31.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.695+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba08f9e70 con 0x55aba08eb4e0 2024-05-09T09:47:31.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.695+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94195621530224] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce0c036040 con 0x7fce0801fc60 2024-05-09T09:47:31.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.699+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce0c036040 con 0x55aba08eb4e0 2024-05-09T09:47:31.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.699+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94195621534080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba08f8570 con 0x55aba08eb4e0 2024-05-09T09:47:31.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.699+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba08fa8b0 con 0x55aba08f4710 2024-05-09T09:47:31.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.699+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce0804a040 con 0x55aba08f4710 2024-05-09T09:47:31.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.699+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94195621534080] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce0c036040 con 0x55aba08eb4e0 2024-05-09T09:47:31.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.699+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94195621536768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba08fb150 con 0x55aba08f4710 2024-05-09T09:47:31.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.699+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba08f80e0 con 0x7fce0801fc60 2024-05-09T09:47:31.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.703+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce0c036040 con 0x7fce0801fc60 2024-05-09T09:47:31.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.703+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94195621541472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba08fbf30 con 0x7fce0801fc60 2024-05-09T09:47:31.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.703+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba08fc8f0 con 0x55aba08eb4e0 2024-05-09T09:47:31.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.703+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94195621536768] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce0804a040 con 0x55aba08f4710 2024-05-09T09:47:31.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.703+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94195621541472] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce0c036040 con 0x7fce0801fc60 2024-05-09T09:47:31.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.703+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce0c036040 con 0x55aba08eb4e0 2024-05-09T09:47:31.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.703+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94195621545024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba08fadb0 con 0x55aba08eb4e0 2024-05-09T09:47:31.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.703+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba08fbf30 con 0x55aba08efe70 2024-05-09T09:47:31.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.707+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94195621545024] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce0c036040 con 0x55aba08eb4e0 2024-05-09T09:47:31.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.707+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce04115030 con 0x55aba08efe70 2024-05-09T09:47:31.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.707+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94195621542528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba08fadb0 con 0x55aba08efe70 2024-05-09T09:47:31.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.707+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba08fd8c0 con 0x55aba08efe70 2024-05-09T09:47:31.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.707+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce04115030 con 0x55aba08efe70 2024-05-09T09:47:31.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.707+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94195621542528] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce04115030 con 0x55aba08efe70 2024-05-09T09:47:31.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.707+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94195621548976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba08fe190 con 0x55aba08efe70 2024-05-09T09:47:31.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.707+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba08fcd00 con 0x55aba08efe70 2024-05-09T09:47:31.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.711+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94195621548976] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce04115030 con 0x55aba08efe70 2024-05-09T09:47:31.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.711+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce04115030 con 0x55aba08efe70 2024-05-09T09:47:31.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.711+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94195621551328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba08fe100 con 0x55aba08efe70 2024-05-09T09:47:31.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.711+0000 7fce1558a980 20 add_watcher() i=0 2024-05-09T09:47:31.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.711+0000 7fce1558a980 20 add_watcher() i=1 2024-05-09T09:47:31.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.711+0000 7fce1558a980 20 add_watcher() i=2 2024-05-09T09:47:31.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.711+0000 7fce1558a980 20 add_watcher() i=3 2024-05-09T09:47:31.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.711+0000 7fce1558a980 20 add_watcher() i=4 2024-05-09T09:47:31.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.711+0000 7fce1558a980 20 add_watcher() i=5 2024-05-09T09:47:31.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.711+0000 7fce1558a980 20 add_watcher() i=6 2024-05-09T09:47:31.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.711+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94195621551328] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce04115030 con 0x55aba08efe70 2024-05-09T09:47:31.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.711+0000 7fce1558a980 20 add_watcher() i=7 2024-05-09T09:47:31.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.711+0000 7fce1558a980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:31.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.711+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55aba0901c00 con 0x55aba08eb4e0 2024-05-09T09:47:31.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.711+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fce0c036040 con 0x55aba08eb4e0 2024-05-09T09:47:31.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.711+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94195621553952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba08ff140 con 0x55aba08eb4e0 2024-05-09T09:47:31.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.715+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94195621553952] v30'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fce0c036040 con 0x55aba08eb4e0 2024-05-09T09:47:31.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.715+0000 7fccc8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:31.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.715+0000 7fce1558a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:31.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.715+0000 7fce1558a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:31.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.715+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090a1c0 con 0x55aba08eb4e0 2024-05-09T09:47:31.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.715+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce0c036040 con 0x55aba08eb4e0 2024-05-09T09:47:31.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.715+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090a810 con 0x55aba08efe70 2024-05-09T09:47:31.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.719+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce04115030 con 0x55aba08efe70 2024-05-09T09:47:31.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.719+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090a810 con 0x55aba08f4710 2024-05-09T09:47:31.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.719+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce0804a040 con 0x55aba08f4710 2024-05-09T09:47:31.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.719+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090b140 con 0x55aba08eb4e0 2024-05-09T09:47:31.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.719+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'55 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce0c036040 con 0x55aba08eb4e0 2024-05-09T09:47:31.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.719+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba09081c0 con 0x7fce0801fc60 2024-05-09T09:47:31.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.723+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'38 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce0c036040 con 0x7fce0801fc60 2024-05-09T09:47:31.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.723+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba09081c0 con 0x55aba08f4710 2024-05-09T09:47:31.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.723+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce0804a040 con 0x55aba08f4710 2024-05-09T09:47:31.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.723+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090be80 con 0x55aba08eb4e0 2024-05-09T09:47:31.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.727+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce0c036040 con 0x55aba08eb4e0 2024-05-09T09:47:31.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.727+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090bf10 con 0x55aba08efe70 2024-05-09T09:47:31.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.727+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce04115030 con 0x55aba08efe70 2024-05-09T09:47:31.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.727+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090bfa0 con 0x7fce0801fc60 2024-05-09T09:47:31.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.731+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce0c036040 con 0x7fce0801fc60 2024-05-09T09:47:31.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.731+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090bfa0 con 0x55aba08f4710 2024-05-09T09:47:31.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.731+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fce0804a040 con 0x55aba08f4710 2024-05-09T09:47:31.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.731+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090c570 con 0x7fce0801fc60 2024-05-09T09:47:31.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.731+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'39 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce0c036040 con 0x7fce0801fc60 2024-05-09T09:47:31.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.731+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090c550 con 0x55aba08efe70 2024-05-09T09:47:31.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.735+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce04115030 con 0x55aba08efe70 2024-05-09T09:47:31.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.735+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090c550 con 0x7fce0801fc60 2024-05-09T09:47:31.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.735+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce0c036040 con 0x7fce0801fc60 2024-05-09T09:47:31.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.739+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090c550 con 0x55aba08efe70 2024-05-09T09:47:31.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.739+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'31 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce04115030 con 0x55aba08efe70 2024-05-09T09:47:31.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.739+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090c550 con 0x55aba08eb4e0 2024-05-09T09:47:31.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.739+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'56 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce0c036040 con 0x55aba08eb4e0 2024-05-09T09:47:31.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.739+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090c550 con 0x55aba08f4710 2024-05-09T09:47:31.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.743+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'32 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce0804a040 con 0x55aba08f4710 2024-05-09T09:47:31.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.743+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090c550 con 0x7fce0801fc60 2024-05-09T09:47:31.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.743+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'40 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce0c036040 con 0x7fce0801fc60 2024-05-09T09:47:31.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.743+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090c550 con 0x55aba08f4710 2024-05-09T09:47:31.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.747+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce0804a040 con 0x55aba08f4710 2024-05-09T09:47:31.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.747+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090c550 con 0x55aba08eb4e0 2024-05-09T09:47:31.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.747+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce0c036040 con 0x55aba08eb4e0 2024-05-09T09:47:31.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.747+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090c550 con 0x55aba08eb4e0 2024-05-09T09:47:31.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.751+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'57 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce0c036040 con 0x55aba08eb4e0 2024-05-09T09:47:31.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.751+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090c550 con 0x55aba08f4710 2024-05-09T09:47:31.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.751+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce0804a040 con 0x55aba08f4710 2024-05-09T09:47:31.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.751+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090c5e0 con 0x7fce0801fc60 2024-05-09T09:47:31.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.751+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce0c036040 con 0x7fce0801fc60 2024-05-09T09:47:31.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.751+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090c5e0 con 0x55aba08f4710 2024-05-09T09:47:31.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.755+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce0804a040 con 0x55aba08f4710 2024-05-09T09:47:31.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.755+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090c5e0 con 0x55aba08f4710 2024-05-09T09:47:31.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.755+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce0804a040 con 0x55aba08f4710 2024-05-09T09:47:31.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.755+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090c600 con 0x55aba08f4710 2024-05-09T09:47:31.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.755+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce0804a040 con 0x55aba08f4710 2024-05-09T09:47:31.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.755+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090c600 con 0x55aba08f4710 2024-05-09T09:47:31.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.759+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'26 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce0804a040 con 0x55aba08f4710 2024-05-09T09:47:31.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.759+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090c600 con 0x55aba08efe70 2024-05-09T09:47:31.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.759+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce04115030 con 0x55aba08efe70 2024-05-09T09:47:31.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.759+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090c600 con 0x55aba08f4710 2024-05-09T09:47:31.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.763+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce0804a040 con 0x55aba08f4710 2024-05-09T09:47:31.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.763+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090c600 con 0x55aba08efe70 2024-05-09T09:47:31.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.767+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'26 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce04115030 con 0x55aba08efe70 2024-05-09T09:47:31.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.767+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090c600 con 0x55aba08f4710 2024-05-09T09:47:31.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.767+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'34 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce0804a040 con 0x55aba08f4710 2024-05-09T09:47:31.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.767+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090c600 con 0x55aba08efe70 2024-05-09T09:47:31.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.771+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'32 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce04115030 con 0x55aba08efe70 2024-05-09T09:47:31.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.771+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba090c600 con 0x7fce0801fc60 2024-05-09T09:47:31.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.771+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fce0c036040 con 0x7fce0801fc60 2024-05-09T09:47:31.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.771+0000 7fcc437fe640 20 reqs_thread_entry: start 2024-05-09T09:47:31.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.771+0000 7fce1558a980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:31.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.771+0000 7fcc417fa640 20 reqs_thread_entry: start 2024-05-09T09:47:31.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.771+0000 7fce1558a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.771+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55aba09281f0 con 0x55aba08eb4e0 2024-05-09T09:47:31.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.771+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fce0c036040 con 0x55aba08eb4e0 2024-05-09T09:47:31.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.771+0000 7fce1558a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.772 INFO:teuthology.orchestra.run.smithi157.stderr:could not fetch user info: no user info saved 2024-05-09T09:47:31.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.775+0000 7fccc8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:31.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.775+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94195621553952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba09068b0 con 0x55aba08eb4e0 2024-05-09T09:47:31.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.775+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94195621553952] v30'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fce0c036040 con 0x55aba08eb4e0 2024-05-09T09:47:31.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.775+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94195621530224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba08fe720 con 0x7fce0801fc60 2024-05-09T09:47:31.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.775+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94195621530224] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce0c036040 con 0x7fce0801fc60 2024-05-09T09:47:31.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.775+0000 7fce1558a980 20 remove_watcher() i=0 2024-05-09T09:47:31.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.775+0000 7fce1558a980 2 removed watcher, disabling cache 2024-05-09T09:47:31.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.775+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94195621534080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba08f8a70 con 0x55aba08eb4e0 2024-05-09T09:47:31.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.779+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94195621534080] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce0c036040 con 0x55aba08eb4e0 2024-05-09T09:47:31.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.779+0000 7fce1558a980 20 remove_watcher() i=1 2024-05-09T09:47:31.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.779+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94195621536768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba08f8a70 con 0x55aba08f4710 2024-05-09T09:47:31.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.779+0000 7fce128a4640 1 -- 172.21.15.157:0/183352990 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94195621536768] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce0804a040 con 0x55aba08f4710 2024-05-09T09:47:31.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.779+0000 7fce1558a980 20 remove_watcher() i=2 2024-05-09T09:47:31.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.779+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94195621541472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba08f8a70 con 0x7fce0801fc60 2024-05-09T09:47:31.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.783+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94195621541472] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce0c036040 con 0x7fce0801fc60 2024-05-09T09:47:31.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.783+0000 7fce1558a980 20 remove_watcher() i=3 2024-05-09T09:47:31.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.783+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94195621545024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba08fb660 con 0x55aba08eb4e0 2024-05-09T09:47:31.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.783+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94195621545024] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce0c036040 con 0x55aba08eb4e0 2024-05-09T09:47:31.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.783+0000 7fce1558a980 20 remove_watcher() i=4 2024-05-09T09:47:31.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.783+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94195621542528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba08f8a70 con 0x55aba08efe70 2024-05-09T09:47:31.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.787+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94195621542528] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce04115030 con 0x55aba08efe70 2024-05-09T09:47:31.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.787+0000 7fce1558a980 20 remove_watcher() i=5 2024-05-09T09:47:31.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.787+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94195621548976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba08fc440 con 0x55aba08efe70 2024-05-09T09:47:31.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.787+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94195621548976] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce04115030 con 0x55aba08efe70 2024-05-09T09:47:31.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.787+0000 7fce1558a980 20 remove_watcher() i=6 2024-05-09T09:47:31.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.787+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94195621551328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55aba08fbb10 con 0x55aba08efe70 2024-05-09T09:47:31.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce130a5640 1 -- 172.21.15.157:0/183352990 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94195621551328] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce04115030 con 0x55aba08efe70 2024-05-09T09:47:31.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 20 remove_watcher() i=7 2024-05-09T09:47:31.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55aba08efe70 msgr2=0x55aba08f2260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 --2- 172.21.15.157:0/183352990 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55aba08efe70 0x55aba08f2260 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55aba08eb4e0 msgr2=0x55aba08ed970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 --2- 172.21.15.157:0/183352990 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55aba08eb4e0 0x55aba08ed970 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fce0801fc60 msgr2=0x7fce0803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 --2- 172.21.15.157:0/183352990 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fce0801fc60 0x7fce0803a3c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55aba08f4710 msgr2=0x55aba08f6ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 --2- 172.21.15.157:0/183352990 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55aba08f4710 0x55aba08f6ba0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fccdc034bb0 msgr2=0x7fccdc037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 --2- 172.21.15.157:0/183352990 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fccdc034bb0 0x7fccdc037070 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55aba089c0a0 tx=0x7fce08010000 comp rx=0 tx=0).stop 2024-05-09T09:47:31.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba08d75d0 msgr2=0x55aba08de960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce138a6640 1 -- 172.21.15.157:0/183352990 reap_dead start 2024-05-09T09:47:31.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 --2- 172.21.15.157:0/183352990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba08d75d0 0x55aba08de960 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fce040cf4c0 tx=0x7fce040bfd90 comp rx=0 tx=0).stop 2024-05-09T09:47:31.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 shutdown_connections 2024-05-09T09:47:31.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 --2- 172.21.15.157:0/183352990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba08d75d0 0x55aba08de960 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 >> 172.21.15.157:0/183352990 conn(0x55aba08d39a0 msgr2=0x55aba08d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:31.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 shutdown_connections 2024-05-09T09:47:31.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 -- 172.21.15.157:0/183352990 wait complete. 2024-05-09T09:47:31.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 -- 172.21.15.157:0/4010493304 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fccec034bb0 msgr2=0x7fccec037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 --2- 172.21.15.157:0/4010493304 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fccec034bb0 0x7fccec037070 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55aba08a0a10 tx=0x7fce0800f000 comp rx=0 tx=0).stop 2024-05-09T09:47:31.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 -- 172.21.15.157:0/4010493304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba08ca640 msgr2=0x55aba08caa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 --2- 172.21.15.157:0/4010493304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba08ca640 0x55aba08caa60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fce040e3750 tx=0x7fce040c6db0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 -- 172.21.15.157:0/4010493304 shutdown_connections 2024-05-09T09:47:31.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 --2- 172.21.15.157:0/4010493304 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fccec034bb0 0x7fccec037070 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 --2- 172.21.15.157:0/4010493304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba08ca640 0x55aba08caa60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 -- 172.21.15.157:0/4010493304 >> 172.21.15.157:0/4010493304 conn(0x55aba08bf410 msgr2=0x55aba08bff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:31.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 -- 172.21.15.157:0/4010493304 shutdown_connections 2024-05-09T09:47:31.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 -- 172.21.15.157:0/4010493304 wait complete. 2024-05-09T09:47:31.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 -- 172.21.15.157:0/463939556 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55aba089da20 msgr2=0x55aba089feb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 --2- 172.21.15.157:0/463939556 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55aba089da20 0x55aba089feb0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 -- 172.21.15.157:0/463939556 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55aba07a22a0 msgr2=0x55aba089b2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 --2- 172.21.15.157:0/463939556 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55aba07a22a0 0x55aba089b2d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 -- 172.21.15.157:0/463939556 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55aba08a1aa0 msgr2=0x55aba08a3e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 --2- 172.21.15.157:0/463939556 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55aba08a1aa0 0x55aba08a3e90 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 -- 172.21.15.157:0/463939556 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fccf8034bb0 msgr2=0x7fccf8037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 --2- 172.21.15.157:0/463939556 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fccf8034bb0 0x7fccf8037070 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fce08001e50 tx=0x7fce080013b0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 -- 172.21.15.157:0/463939556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba07a1980 msgr2=0x55aba0894220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 --2- 172.21.15.157:0/463939556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55aba07a1980 0x55aba0894220 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fce0401aec0 tx=0x7fce04017e30 comp rx=0 tx=0).stop 2024-05-09T09:47:31.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce138a6640 1 -- 172.21.15.157:0/463939556 reap_dead start 2024-05-09T09:47:31.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 -- 172.21.15.157:0/463939556 shutdown_connections 2024-05-09T09:47:31.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 -- 172.21.15.157:0/463939556 >> 172.21.15.157:0/463939556 conn(0x55aba079d250 msgr2=0x55aba0887830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:31.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 -- 172.21.15.157:0/463939556 shutdown_connections 2024-05-09T09:47:31.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.791+0000 7fce1558a980 1 -- 172.21.15.157:0/463939556 wait complete. 2024-05-09T09:47:31.803 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-09T09:47:31.804 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-05-09T09:47:31.804 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-05-09T09:47:31.804 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-05-09T09:47:31.891 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:31.891 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:31.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.895+0000 7f2cd877c980 1 Processor -- start 2024-05-09T09:47:31.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.895+0000 7f2cd877c980 1 -- start start 2024-05-09T09:47:31.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.895+0000 7f2cd877c980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x563aa56c9ad0 0x563aa56c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.895+0000 7f2cd877c980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563aa557d440 con 0x563aa56ca3f0 2024-05-09T09:47:31.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.895+0000 7f2cd877c980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x563aa55685f0 con 0x563aa56c9ad0 2024-05-09T09:47:31.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.895+0000 7f2cd6297640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x563aa56c9ad0 0x563aa56c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.895+0000 7f2ccda96640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x563aa56ca3f0 0x563aa56cada0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:33564/0 (socket says 172.21.15.157:33564) 2024-05-09T09:47:31.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.895+0000 7f2cd6297640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x563aa56c9ad0 0x563aa56c9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53828/0 (socket says 172.21.15.157:53828) 2024-05-09T09:47:31.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.895+0000 7f2ccda96640 1 -- 172.21.15.157:0/238960419 learned_addr learned my addr 172.21.15.157:0/238960419 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:47:31.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.895+0000 7f2cd6297640 1 -- 172.21.15.157:0/238960419 >> v1:172.21.15.110:6789/0 conn(0x563aa56ca3f0 legacy=0x563aa56cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.895+0000 7f2cd6297640 1 -- 172.21.15.157:0/238960419 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563aa5573990 con 0x563aa56c9ad0 2024-05-09T09:47:31.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.899+0000 7f2cd6297640 1 --2- 172.21.15.157:0/238960419 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa56c9ad0 0x563aa56c9eb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800a480 tx=0x7f2cc801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=107ef4e2bc03038b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.899+0000 7f2cd5a96640 1 -- 172.21.15.157:0/238960419 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cc80b0070 con 0x563aa56c9ad0 2024-05-09T09:47:31.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.899+0000 7f2cd5a96640 1 -- 172.21.15.157:0/238960419 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc80ab540 con 0x563aa56c9ad0 2024-05-09T09:47:31.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.899+0000 7f2cd5a96640 1 -- 172.21.15.157:0/238960419 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cc80ab840 con 0x563aa56c9ad0 2024-05-09T09:47:31.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.899+0000 7f2cd877c980 1 -- 172.21.15.157:0/238960419 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa56c9ad0 msgr2=0x563aa56c9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.899+0000 7f2cd877c980 1 --2- 172.21.15.157:0/238960419 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa56c9ad0 0x563aa56c9eb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800a480 tx=0x7f2cc801b280 comp rx=0 tx=0).stop 2024-05-09T09:47:31.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.899+0000 7f2cd877c980 1 -- 172.21.15.157:0/238960419 shutdown_connections 2024-05-09T09:47:31.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.899+0000 7f2cd877c980 1 --2- 172.21.15.157:0/238960419 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa56c9ad0 0x563aa56c9eb0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.899+0000 7f2cd877c980 1 -- 172.21.15.157:0/238960419 >> 172.21.15.157:0/238960419 conn(0x563aa563d1f0 msgr2=0x563aa563d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:31.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.899+0000 7f2cd877c980 1 -- 172.21.15.157:0/238960419 shutdown_connections 2024-05-09T09:47:31.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.899+0000 7f2cd877c980 1 -- 172.21.15.157:0/238960419 wait complete. 2024-05-09T09:47:31.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.915+0000 7f2cd877c980 1 Processor -- start 2024-05-09T09:47:31.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.915+0000 7f2cd877c980 1 -- start start 2024-05-09T09:47:31.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.915+0000 7f2cd877c980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa56c9ad0 0x563aa57b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.915+0000 7f2cd877c980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563aa55cafe0 con 0x563aa56c9ad0 2024-05-09T09:47:31.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.915+0000 7f2cd6297640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa56c9ad0 0x563aa57b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.915+0000 7f2cd6297640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa56c9ad0 0x563aa57b54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53834/0 (socket says 172.21.15.157:53834) 2024-05-09T09:47:31.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.915+0000 7f2cd6297640 1 -- 172.21.15.157:0/1791649739 learned_addr learned my addr 172.21.15.157:0/1791649739 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:31.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.915+0000 7f2cd6297640 1 -- 172.21.15.157:0/1791649739 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563aa554fae0 con 0x563aa56c9ad0 2024-05-09T09:47:31.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.915+0000 7f2cd6297640 1 --2- 172.21.15.157:0/1791649739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa56c9ad0 0x563aa57b54b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8018eb0 tx=0x7f2cc8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a7470c91b74c8b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.915+0000 7f2bc4608640 1 -- 172.21.15.157:0/1791649739 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cc80b0040 con 0x563aa56c9ad0 2024-05-09T09:47:31.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.915+0000 7f2bc4608640 1 -- 172.21.15.157:0/1791649739 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc80bb070 con 0x563aa56c9ad0 2024-05-09T09:47:31.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.915+0000 7f2bc4608640 1 -- 172.21.15.157:0/1791649739 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cc80ab6f0 con 0x563aa56c9ad0 2024-05-09T09:47:31.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.915+0000 7f2cd877c980 1 -- 172.21.15.157:0/1791649739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa56c9ad0 msgr2=0x563aa57b54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.915+0000 7f2cd877c980 1 --2- 172.21.15.157:0/1791649739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa56c9ad0 0x563aa57b54b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8018eb0 tx=0x7f2cc8003030 comp rx=0 tx=0).stop 2024-05-09T09:47:31.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.915+0000 7f2cd877c980 1 -- 172.21.15.157:0/1791649739 shutdown_connections 2024-05-09T09:47:31.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.915+0000 7f2cd877c980 1 --2- 172.21.15.157:0/1791649739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa56c9ad0 0x563aa57b54b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.915+0000 7f2cd877c980 1 -- 172.21.15.157:0/1791649739 >> 172.21.15.157:0/1791649739 conn(0x563aa563d1f0 msgr2=0x563aa57b1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:31.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.915+0000 7f2cd877c980 1 -- 172.21.15.157:0/1791649739 shutdown_connections 2024-05-09T09:47:31.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.915+0000 7f2cd877c980 1 -- 172.21.15.157:0/1791649739 wait complete. 2024-05-09T09:47:31.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.915+0000 7f2cd877c980 1 Processor -- start 2024-05-09T09:47:31.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.915+0000 7f2cd877c980 1 -- start start 2024-05-09T09:47:31.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.915+0000 7f2cd877c980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa56c9ad0 0x563aa57bc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.915+0000 7f2cd877c980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563aa56d3b10 con 0x563aa56c9ad0 2024-05-09T09:47:31.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.919+0000 7f2cd6297640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa56c9ad0 0x563aa57bc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.919+0000 7f2cd6297640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa56c9ad0 0x563aa57bc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53838/0 (socket says 172.21.15.157:53838) 2024-05-09T09:47:31.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.919+0000 7f2cd6297640 1 -- 172.21.15.157:0/3692099233 learned_addr learned my addr 172.21.15.157:0/3692099233 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:31.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.919+0000 7f2cd6297640 1 -- 172.21.15.157:0/3692099233 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563aa57bca30 con 0x563aa56c9ad0 2024-05-09T09:47:31.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.919+0000 7f2cd6297640 1 --2- 172.21.15.157:0/3692099233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa56c9ad0 0x563aa57bc4f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80b8040 tx=0x7f2cc8018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.923+0000 7f2bc2e05640 1 -- 172.21.15.157:0/3692099233 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cc80b0070 con 0x563aa56c9ad0 2024-05-09T09:47:31.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.923+0000 7f2cd877c980 1 -- 172.21.15.157:0/3692099233 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563aa57bccc0 con 0x563aa56c9ad0 2024-05-09T09:47:31.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.923+0000 7f2bc2e05640 1 -- 172.21.15.157:0/3692099233 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc80c4070 con 0x563aa56c9ad0 2024-05-09T09:47:31.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.923+0000 7f2bc2e05640 1 -- 172.21.15.157:0/3692099233 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cc80b6900 con 0x563aa56c9ad0 2024-05-09T09:47:31.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.923+0000 7f2cd877c980 1 -- 172.21.15.157:0/3692099233 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563aa57bf950 con 0x563aa56c9ad0 2024-05-09T09:47:31.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.923+0000 7f2bc2e05640 1 -- 172.21.15.157:0/3692099233 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f2cc80c6020 con 0x563aa56c9ad0 2024-05-09T09:47:31.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.923+0000 7f2bc2e05640 1 --2- 172.21.15.157:0/3692099233 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2bbc034c00 0x7f2bbc0370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.923+0000 7f2bc2e05640 1 -- 172.21.15.157:0/3692099233 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f2cc80a8070 con 0x563aa56c9ad0 2024-05-09T09:47:31.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.923+0000 7f2ccda96640 1 --2- 172.21.15.157:0/3692099233 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2bbc034c00 0x7f2bbc0370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.923+0000 7f2cd877c980 1 --2- 172.21.15.157:0/3692099233 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563aa56ca3f0 0x563aa57c3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.923+0000 7f2cd877c980 1 -- 172.21.15.157:0/3692099233 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563aa57c3a80 con 0x563aa56ca3f0 2024-05-09T09:47:31.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.923+0000 7f2cd6a98640 1 --2- 172.21.15.157:0/3692099233 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563aa56ca3f0 0x563aa57c3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.923+0000 7f2ccda96640 1 --2- 172.21.15.157:0/3692099233 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2bbc034c00 0x7f2bbc0370c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0000f70 tx=0x7f2cc00012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.923+0000 7f2cd6a98640 1 --2- 172.21.15.157:0/3692099233 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563aa56ca3f0 0x563aa57c3430 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.923+0000 7f2cd6a98640 1 -- 172.21.15.157:0/3692099233 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa56ca3f0 2024-05-09T09:47:31.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.923+0000 7f2cd877c980 1 -- 172.21.15.157:0/3692099233 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563aa57c0b70 con 0x563aa56ca3f0 2024-05-09T09:47:31.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.923+0000 7f2cd6a98640 1 -- 172.21.15.157:0/3692099233 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa56ca3f0 2024-05-09T09:47:31.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.923+0000 7f2cd877c980 1 --2- 172.21.15.157:0/3692099233 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563aa57c5e20 0x563aa57c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.923+0000 7f2cd877c980 1 -- 172.21.15.157:0/3692099233 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563aa57c88e0 con 0x563aa57c5e20 2024-05-09T09:47:31.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.927+0000 7f2cd6297640 1 --2- 172.21.15.157:0/3692099233 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563aa57c5e20 0x563aa57c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.927+0000 7f2cd6297640 1 --2- 172.21.15.157:0/3692099233 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563aa57c5e20 0x563aa57c8210 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.927+0000 7f2cd6297640 1 -- 172.21.15.157:0/3692099233 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2cc80b3040 con 0x563aa57c5e20 2024-05-09T09:47:31.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.927+0000 7f2cd877c980 1 -- 172.21.15.157:0/3692099233 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563aa57c4cc0 con 0x563aa56ca3f0 2024-05-09T09:47:31.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.927+0000 7f2cd6a98640 1 -- 172.21.15.157:0/3692099233 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa56ca3f0 2024-05-09T09:47:31.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.927+0000 7f2cd877c980 1 --2- 172.21.15.157:0/3692099233 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563aa57c9d40 0x563aa57cc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.927+0000 7f2cd877c980 1 -- 172.21.15.157:0/3692099233 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563aa57cc830 con 0x563aa57c9d40 2024-05-09T09:47:31.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.927+0000 7f2ccda96640 1 --2- 172.21.15.157:0/3692099233 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563aa57c9d40 0x563aa57cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.927+0000 7f2ccda96640 1 --2- 172.21.15.157:0/3692099233 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563aa57c9d40 0x563aa57cc130 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.927+0000 7f2ccda96640 1 -- 172.21.15.157:0/3692099233 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2cc000e620 con 0x563aa57c9d40 2024-05-09T09:47:31.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.931+0000 7f2cd877c980 1 Processor -- start 2024-05-09T09:47:31.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.931+0000 7f2cd877c980 1 -- start start 2024-05-09T09:47:31.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.931+0000 7f2cd877c980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa57f28b0 0x563aa57f2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.931+0000 7f2cd877c980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563aa55cf020 con 0x563aa57f28b0 2024-05-09T09:47:31.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.931+0000 7f2cd6297640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa57f28b0 0x563aa57f2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.931+0000 7f2cd6297640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa57f28b0 0x563aa57f2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53840/0 (socket says 172.21.15.157:53840) 2024-05-09T09:47:31.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.931+0000 7f2cd6297640 1 -- 172.21.15.157:0/2085092460 learned_addr learned my addr 172.21.15.157:0/2085092460 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:31.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.935+0000 7f2cd6297640 1 -- 172.21.15.157:0/2085092460 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563aa57f3210 con 0x563aa57f28b0 2024-05-09T09:47:31.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.935+0000 7f2cd6297640 1 --2- 172.21.15.157:0/2085092460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa57f28b0 0x563aa57f2cd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2cc801b0b0 tx=0x7f2cc80bead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.935+0000 7f2bbaba2640 1 -- 172.21.15.157:0/2085092460 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cc80d1d90 con 0x563aa57f28b0 2024-05-09T09:47:31.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.935+0000 7f2cd877c980 1 -- 172.21.15.157:0/2085092460 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563aa57f3ca0 con 0x563aa57f28b0 2024-05-09T09:47:31.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.935+0000 7f2bbaba2640 1 -- 172.21.15.157:0/2085092460 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc80b6aa0 con 0x563aa57f28b0 2024-05-09T09:47:31.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.935+0000 7f2cd877c980 1 -- 172.21.15.157:0/2085092460 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563aa57f4180 con 0x563aa57f28b0 2024-05-09T09:47:31.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.935+0000 7f2bbaba2640 1 -- 172.21.15.157:0/2085092460 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cc80b6d80 con 0x563aa57f28b0 2024-05-09T09:47:31.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.935+0000 7f2bbaba2640 1 -- 172.21.15.157:0/2085092460 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f2cc8009420 con 0x563aa57f28b0 2024-05-09T09:47:31.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.935+0000 7f2bbaba2640 1 --2- 172.21.15.157:0/2085092460 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2bb0034bb0 0x7f2bb0037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.935+0000 7f2bbaba2640 1 -- 172.21.15.157:0/2085092460 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f2cc80e1030 con 0x563aa57f28b0 2024-05-09T09:47:31.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.935+0000 7f2ccda96640 1 --2- 172.21.15.157:0/2085092460 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2bb0034bb0 0x7f2bb0037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.935+0000 7f2cd877c980 1 Processor -- start 2024-05-09T09:47:31.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.935+0000 7f2cd877c980 1 -- start start 2024-05-09T09:47:31.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.935+0000 7f2ccda96640 1 --2- 172.21.15.157:0/2085092460 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2bb0034bb0 0x7f2bb0037070 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2cc000bf60 tx=0x7f2cc000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.935+0000 7f2cd877c980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa57ff860 0x563aa57ffc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.935+0000 7f2cd877c980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563aa57b5b40 con 0x563aa57ff860 2024-05-09T09:47:31.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.935+0000 7f2cd6297640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa57ff860 0x563aa57ffc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.935+0000 7f2cd6297640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa57ff860 0x563aa57ffc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53850/0 (socket says 172.21.15.157:53850) 2024-05-09T09:47:31.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.935+0000 7f2cd6297640 1 -- 172.21.15.157:0/3589809677 learned_addr learned my addr 172.21.15.157:0/3589809677 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:31.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.939+0000 7f2cd6297640 1 -- 172.21.15.157:0/3589809677 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563aa5800230 con 0x563aa57ff860 2024-05-09T09:47:31.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.939+0000 7f2cd6297640 1 --2- 172.21.15.157:0/3589809677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa57ff860 0x563aa57ffc60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800a1f0 tx=0x7f2cc80e86f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64306864bb6b4990 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.939+0000 7f2bb8b9e640 1 -- 172.21.15.157:0/3589809677 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cc8100020 con 0x563aa57ff860 2024-05-09T09:47:31.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.939+0000 7f2bb8b9e640 1 -- 172.21.15.157:0/3589809677 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc80e46f0 con 0x563aa57ff860 2024-05-09T09:47:31.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.939+0000 7f2bb8b9e640 1 -- 172.21.15.157:0/3589809677 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cc8009710 con 0x563aa57ff860 2024-05-09T09:47:31.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.939+0000 7f2cd877c980 1 -- 172.21.15.157:0/3589809677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa57ff860 msgr2=0x563aa57ffc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:31.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.939+0000 7f2cd877c980 1 --2- 172.21.15.157:0/3589809677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa57ff860 0x563aa57ffc60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800a1f0 tx=0x7f2cc80e86f0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.939+0000 7f2cd877c980 1 -- 172.21.15.157:0/3589809677 shutdown_connections 2024-05-09T09:47:31.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.939+0000 7f2cd877c980 1 --2- 172.21.15.157:0/3589809677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa57ff860 0x563aa57ffc60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:31.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.939+0000 7f2cd877c980 1 -- 172.21.15.157:0/3589809677 >> 172.21.15.157:0/3589809677 conn(0x563aa57fbbe0 msgr2=0x563aa57f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:31.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.939+0000 7f2cd877c980 1 -- 172.21.15.157:0/3589809677 shutdown_connections 2024-05-09T09:47:31.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.939+0000 7f2cd877c980 1 -- 172.21.15.157:0/3589809677 wait complete. 2024-05-09T09:47:31.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.939+0000 7f2cd877c980 1 Processor -- start 2024-05-09T09:47:31.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.939+0000 7f2cd877c980 1 -- start start 2024-05-09T09:47:31.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.939+0000 7f2cd877c980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa57ff860 0x563aa5806bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.939+0000 7f2cd877c980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563aa5800920 con 0x563aa57ff860 2024-05-09T09:47:31.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.939+0000 7f2cd6297640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa57ff860 0x563aa5806bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.939+0000 7f2cd6297640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa57ff860 0x563aa5806bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53856/0 (socket says 172.21.15.157:53856) 2024-05-09T09:47:31.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.939+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 learned_addr learned my addr 172.21.15.157:0/685467992 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:31.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.939+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563aa58070f0 con 0x563aa57ff860 2024-05-09T09:47:31.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.939+0000 7f2cd6297640 1 --2- 172.21.15.157:0/685467992 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa57ff860 0x563aa5806bb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80e8c00 tx=0x7f2cc80f1ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.939+0000 7f2ba6ffd640 1 -- 172.21.15.157:0/685467992 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cc8113070 con 0x563aa57ff860 2024-05-09T09:47:31.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.939+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563aa58070f0 con 0x563aa57ff860 2024-05-09T09:47:31.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.939+0000 7f2ba6ffd640 1 -- 172.21.15.157:0/685467992 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc80c98e0 con 0x563aa57ff860 2024-05-09T09:47:31.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.939+0000 7f2ba6ffd640 1 -- 172.21.15.157:0/685467992 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cc80e8c70 con 0x563aa57ff860 2024-05-09T09:47:31.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563aa5807570 con 0x563aa57ff860 2024-05-09T09:47:31.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2ba6ffd640 1 -- 172.21.15.157:0/685467992 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f2cc8116070 con 0x563aa57ff860 2024-05-09T09:47:31.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2ba6ffd640 1 --2- 172.21.15.157:0/685467992 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2ba0034bb0 0x7f2ba0037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2ba6ffd640 1 -- 172.21.15.157:0/685467992 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f2cc8119ca0 con 0x563aa57ff860 2024-05-09T09:47:31.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2cd877c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2ccda96640 1 --2- 172.21.15.157:0/685467992 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2ba0034bb0 0x7f2ba0037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2cd877c980 1 --2- 172.21.15.157:0/685467992 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563aa58135b0 0x563aa5815a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563aa58161c0 con 0x563aa58135b0 2024-05-09T09:47:31.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2cd6a98640 1 --2- 172.21.15.157:0/685467992 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563aa58135b0 0x563aa5815a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2ccda96640 1 --2- 172.21.15.157:0/685467992 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2ba0034bb0 0x7f2ba0037070 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x563aa57c43d0 tx=0x7f2cc0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2cd6a98640 1 --2- 172.21.15.157:0/685467992 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563aa58135b0 0x563aa5815a70 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:31.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2cd877c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2cd877c980 20 realm 2024-05-09T09:47:31.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2cd877c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563aa58165d0 con 0x563aa58135b0 2024-05-09T09:47:31.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:31.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2cd877c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2cd877c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:31.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2cd877c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563aa5816ea0 con 0x563aa58135b0 2024-05-09T09:47:31.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:31.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2cd877c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2cd877c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x563aa58135b0 2024-05-09T09:47:31.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:31.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2cd877c980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:31.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2cd877c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2cd877c980 1 --2- 172.21.15.157:0/685467992 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563aa5817fa0 0x563aa581a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563aa581a9a0 con 0x563aa5817fa0 2024-05-09T09:47:31.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.943+0000 7f2cd6297640 1 --2- 172.21.15.157:0/685467992 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563aa5817fa0 0x563aa581a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.947+0000 7f2cd6297640 1 --2- 172.21.15.157:0/685467992 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563aa5817fa0 0x563aa581a390 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.947+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2cc8115030 con 0x563aa5817fa0 2024-05-09T09:47:31.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.947+0000 7f2cd877c980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:31.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.947+0000 7f2cd877c980 20 searching for the correct realm 2024-05-09T09:47:31.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.947+0000 7f2cd877c980 1 --2- 172.21.15.157:0/685467992 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563aa581c8f0 0x563aa581ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.947+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa581f3d0 con 0x563aa581c8f0 2024-05-09T09:47:31.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.947+0000 7f2ccda96640 1 --2- 172.21.15.157:0/685467992 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563aa581c8f0 0x563aa581ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.947+0000 7f2ccda96640 1 --2- 172.21.15.157:0/685467992 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563aa581c8f0 0x563aa581ed00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.947+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cc000e620 con 0x563aa581c8f0 2024-05-09T09:47:31.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.947+0000 7f2ccda96640 1 --2- 172.21.15.157:0/685467992 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2cc0037040 0x7f2cc0036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:31.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.947+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa581f3d0 con 0x7f2cc0037040 2024-05-09T09:47:31.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.947+0000 7f2cd6a98640 1 --2- 172.21.15.157:0/685467992 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2cc0037040 0x7f2cc0036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:31.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.947+0000 7f2cd6a98640 1 --2- 172.21.15.157:0/685467992 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2cc0037040 0x7f2cc0036410 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:31.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.947+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cd000a4d0 con 0x7f2cc0037040 2024-05-09T09:47:31.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.947+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x563aa5817fa0 2024-05-09T09:47:31.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.947+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cc8115030 con 0x563aa5817fa0 2024-05-09T09:47:31.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.947+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x563aa58135b0 2024-05-09T09:47:31.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.951+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:31.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.951+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x563aa58135b0 2024-05-09T09:47:31.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.951+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:31.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.951+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x563aa5817fa0 2024-05-09T09:47:31.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.951+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cc8115030 con 0x563aa5817fa0 2024-05-09T09:47:31.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.951+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x563aa5817fa0 2024-05-09T09:47:31.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.951+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cc8115030 con 0x563aa5817fa0 2024-05-09T09:47:31.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.951+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x7f2cc0037040 2024-05-09T09:47:31.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.951+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cd000a4d0 con 0x7f2cc0037040 2024-05-09T09:47:31.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.951+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x563aa581c8f0 2024-05-09T09:47:31.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.951+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cc000e620 con 0x563aa581c8f0 2024-05-09T09:47:31.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.951+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x563aa58135b0 2024-05-09T09:47:31.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.951+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:31.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.951+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x563aa5817fa0 2024-05-09T09:47:31.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.951+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cc8115030 con 0x563aa5817fa0 2024-05-09T09:47:31.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.951+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x563aa58135b0 2024-05-09T09:47:31.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.951+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:31.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.951+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x7f2cc0037040 2024-05-09T09:47:31.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.951+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2cd000a4d0 con 0x7f2cc0037040 2024-05-09T09:47:31.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.951+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x563aa581c8f0 2024-05-09T09:47:31.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.955+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cc000e620 con 0x563aa581c8f0 2024-05-09T09:47:31.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.955+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x563aa581c8f0 2024-05-09T09:47:31.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.955+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2cc000e620 con 0x563aa581c8f0 2024-05-09T09:47:31.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.955+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x563aa5817fa0 2024-05-09T09:47:31.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.955+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cc8115030 con 0x563aa5817fa0 2024-05-09T09:47:31.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.955+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x563aa581c8f0 2024-05-09T09:47:31.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.955+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cc000e620 con 0x563aa581c8f0 2024-05-09T09:47:31.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.955+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x563aa581c8f0 2024-05-09T09:47:31.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.955+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cc000e620 con 0x563aa581c8f0 2024-05-09T09:47:31.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.955+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x563aa58135b0 2024-05-09T09:47:31.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.955+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:31.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.955+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x563aa58135b0 2024-05-09T09:47:31.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.955+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:31.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.955+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x563aa5817fa0 2024-05-09T09:47:31.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.955+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cc8115030 con 0x563aa5817fa0 2024-05-09T09:47:31.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.955+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x563aa581c8f0 2024-05-09T09:47:31.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.955+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cc000e620 con 0x563aa581c8f0 2024-05-09T09:47:31.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.955+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x7f2cc0037040 2024-05-09T09:47:31.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.955+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cd000a4d0 con 0x7f2cc0037040 2024-05-09T09:47:31.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.955+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x563aa58135b0 2024-05-09T09:47:31.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.959+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:31.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.959+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x563aa5817fa0 2024-05-09T09:47:31.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.959+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2cc8115030 con 0x563aa5817fa0 2024-05-09T09:47:31.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.959+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x563aa581c8f0 2024-05-09T09:47:31.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.959+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cc000e620 con 0x563aa581c8f0 2024-05-09T09:47:31.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.959+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x563aa5817fa0 2024-05-09T09:47:31.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.959+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cc8115030 con 0x563aa5817fa0 2024-05-09T09:47:31.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.959+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x7f2cc0037040 2024-05-09T09:47:31.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.959+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cd000a4d0 con 0x7f2cc0037040 2024-05-09T09:47:31.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.959+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x563aa581c8f0 2024-05-09T09:47:31.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.959+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cc000e620 con 0x563aa581c8f0 2024-05-09T09:47:31.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.959+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x563aa5817fa0 2024-05-09T09:47:31.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.959+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cc8115030 con 0x563aa5817fa0 2024-05-09T09:47:31.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.959+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x563aa58135b0 2024-05-09T09:47:31.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.959+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:31.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.959+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563aa5817240 con 0x7f2cc0037040 2024-05-09T09:47:31.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.959+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cd000a4d0 con 0x7f2cc0037040 2024-05-09T09:47:31.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.959+0000 7f2cd877c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:31.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.959+0000 7f2cd877c980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:31.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.959+0000 7f2cd877c980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:31.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.959+0000 7f2cd877c980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:31.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.959+0000 7f2cd877c980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:31.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.959+0000 7f2cd877c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:31.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.959+0000 7f2cd877c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.959+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563aa581b260 con 0x563aa58135b0 2024-05-09T09:47:31.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:31.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd877c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd877c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563aa581b260 con 0x563aa58135b0 2024-05-09T09:47:31.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:31.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd877c980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:31.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd877c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563aa581b260 con 0x563aa581c8f0 2024-05-09T09:47:31.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2cc000e620 con 0x563aa581c8f0 2024-05-09T09:47:31.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd877c980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:31.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd877c980 20 zone default found 2024-05-09T09:47:31.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd877c980 4 Realm: () 2024-05-09T09:47:31.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd877c980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:31.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd877c980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:31.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd877c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:31.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd877c980 20 zonegroup default 2024-05-09T09:47:31.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd877c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563aa581bc60 con 0x563aa5817fa0 2024-05-09T09:47:31.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2cc8115030 con 0x563aa5817fa0 2024-05-09T09:47:31.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd877c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd877c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563aa581b7f0 con 0x563aa581c8f0 2024-05-09T09:47:31.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2cc000e620 con 0x563aa581c8f0 2024-05-09T09:47:31.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd877c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd877c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:31.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563aa58217d0 con 0x563aa581c8f0 2024-05-09T09:47:31.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2cc000e620 con 0x563aa581c8f0 2024-05-09T09:47:31.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd877c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:31.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd877c980 20 started sync module instance, tier type = 2024-05-09T09:47:31.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd877c980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:31.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5820b70 con 0x7f2cc0037040 2024-05-09T09:47:31.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x7f2cc0037040 2024-05-09T09:47:31.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94809884856432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5820b70 con 0x7f2cc0037040 2024-05-09T09:47:31.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.963+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5822250 con 0x563aa58135b0 2024-05-09T09:47:31.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.967+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94809884856432] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x7f2cc0037040 2024-05-09T09:47:31.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.967+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:31.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.967+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94809884860080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5820b70 con 0x563aa58135b0 2024-05-09T09:47:31.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.967+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5822c60 con 0x563aa581c8f0 2024-05-09T09:47:31.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.967+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94809884860080] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:31.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.971+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cc000e620 con 0x563aa581c8f0 2024-05-09T09:47:31.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.971+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94809884853952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5820ae0 con 0x563aa581c8f0 2024-05-09T09:47:31.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.971+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5823960 con 0x7f2cc0037040 2024-05-09T09:47:31.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.971+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x7f2cc0037040 2024-05-09T09:47:31.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.971+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94809884866016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5824200 con 0x7f2cc0037040 2024-05-09T09:47:31.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.971+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5824bc0 con 0x563aa58135b0 2024-05-09T09:47:31.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.971+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94809884853952] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cc000e620 con 0x563aa581c8f0 2024-05-09T09:47:31.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.971+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94809884866016] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x7f2cc0037040 2024-05-09T09:47:31.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.971+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:31.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.971+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94809884870416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5824170 con 0x563aa58135b0 2024-05-09T09:47:31.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.971+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5824b30 con 0x563aa5817fa0 2024-05-09T09:47:31.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.975+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94809884870416] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:31.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.975+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cc8115030 con 0x563aa5817fa0 2024-05-09T09:47:31.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.975+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94809884868080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5825460 con 0x563aa5817fa0 2024-05-09T09:47:31.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.975+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5825cb0 con 0x563aa5817fa0 2024-05-09T09:47:31.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.979+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cc8115030 con 0x563aa5817fa0 2024-05-09T09:47:31.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.979+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94809884875024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5826440 con 0x563aa5817fa0 2024-05-09T09:47:31.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.979+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5826f60 con 0x563aa5817fa0 2024-05-09T09:47:31.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.979+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94809884868080] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cc8115030 con 0x563aa5817fa0 2024-05-09T09:47:31.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.979+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94809884875024] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cc8115030 con 0x563aa5817fa0 2024-05-09T09:47:31.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.979+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cc8115030 con 0x563aa5817fa0 2024-05-09T09:47:31.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.979+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94809884879408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5825e90 con 0x563aa5817fa0 2024-05-09T09:47:31.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.979+0000 7f2cd877c980 20 add_watcher() i=0 2024-05-09T09:47:31.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.979+0000 7f2cd877c980 20 add_watcher() i=1 2024-05-09T09:47:31.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.979+0000 7f2cd877c980 20 add_watcher() i=2 2024-05-09T09:47:31.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.979+0000 7f2cd877c980 20 add_watcher() i=3 2024-05-09T09:47:31.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.979+0000 7f2cd877c980 20 add_watcher() i=4 2024-05-09T09:47:31.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.979+0000 7f2cd877c980 20 add_watcher() i=5 2024-05-09T09:47:31.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.979+0000 7f2cd877c980 20 add_watcher() i=6 2024-05-09T09:47:31.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.983+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94809884879408] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cc8115030 con 0x563aa5817fa0 2024-05-09T09:47:31.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.983+0000 7f2cd877c980 20 add_watcher() i=7 2024-05-09T09:47:31.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.983+0000 7f2cd877c980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:31.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.983+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563aa5829f50 con 0x563aa58135b0 2024-05-09T09:47:31.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.983+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:31.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.983+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94809884872544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa58273d0 con 0x563aa58135b0 2024-05-09T09:47:31.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.983+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94809884872544] v30'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:31.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.983+0000 7f2b8bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:31.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.983+0000 7f2cd877c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:31.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.983+0000 7f2cd877c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:31.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.983+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa58327a0 con 0x563aa58135b0 2024-05-09T09:47:31.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.987+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:31.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.987+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5832df0 con 0x563aa5817fa0 2024-05-09T09:47:31.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.987+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cc8115030 con 0x563aa5817fa0 2024-05-09T09:47:31.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.987+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5832df0 con 0x563aa581c8f0 2024-05-09T09:47:31.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.987+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cc000e620 con 0x563aa581c8f0 2024-05-09T09:47:31.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.987+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5833420 con 0x563aa58135b0 2024-05-09T09:47:31.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.991+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'60 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:31.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.991+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa58338d0 con 0x7f2cc0037040 2024-05-09T09:47:31.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.991+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'41 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x7f2cc0037040 2024-05-09T09:47:31.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.991+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5830600 con 0x563aa581c8f0 2024-05-09T09:47:31.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.991+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cc000e620 con 0x563aa581c8f0 2024-05-09T09:47:31.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.991+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5830600 con 0x563aa58135b0 2024-05-09T09:47:31.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.995+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:31.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.995+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5834430 con 0x563aa5817fa0 2024-05-09T09:47:31.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.995+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cc8115030 con 0x563aa5817fa0 2024-05-09T09:47:31.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.995+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5834430 con 0x7f2cc0037040 2024-05-09T09:47:31.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.999+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x7f2cc0037040 2024-05-09T09:47:31.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.999+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5834430 con 0x563aa581c8f0 2024-05-09T09:47:31.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.999+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cc000e620 con 0x563aa581c8f0 2024-05-09T09:47:31.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:31.999+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa58348e0 con 0x7f2cc0037040 2024-05-09T09:47:32.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.003+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'42 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x7f2cc0037040 2024-05-09T09:47:32.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.003+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa58348e0 con 0x563aa5817fa0 2024-05-09T09:47:32.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.003+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cc8115030 con 0x563aa5817fa0 2024-05-09T09:47:32.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.003+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa58348e0 con 0x7f2cc0037040 2024-05-09T09:47:32.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.003+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x7f2cc0037040 2024-05-09T09:47:32.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.003+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa58348e0 con 0x563aa5817fa0 2024-05-09T09:47:32.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.007+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'33 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cc8115030 con 0x563aa5817fa0 2024-05-09T09:47:32.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.007+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa58348e0 con 0x563aa58135b0 2024-05-09T09:47:32.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.007+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'61 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:32.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.007+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa58348e0 con 0x563aa581c8f0 2024-05-09T09:47:32.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.011+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'35 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cc000e620 con 0x563aa581c8f0 2024-05-09T09:47:32.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.011+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5834ce0 con 0x7f2cc0037040 2024-05-09T09:47:32.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.011+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x7f2cc0037040 2024-05-09T09:47:32.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.011+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5834ce0 con 0x563aa581c8f0 2024-05-09T09:47:32.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.011+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cc000e620 con 0x563aa581c8f0 2024-05-09T09:47:32.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.011+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5834ce0 con 0x563aa58135b0 2024-05-09T09:47:32.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.015+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:32.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.015+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5834ce0 con 0x563aa58135b0 2024-05-09T09:47:32.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.015+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'62 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:32.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.015+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5834ce0 con 0x563aa581c8f0 2024-05-09T09:47:32.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.019+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'36 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cc000e620 con 0x563aa581c8f0 2024-05-09T09:47:32.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.019+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5834d70 con 0x7f2cc0037040 2024-05-09T09:47:32.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.019+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x7f2cc0037040 2024-05-09T09:47:32.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.019+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5834d70 con 0x563aa581c8f0 2024-05-09T09:47:32.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.023+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cc000e620 con 0x563aa581c8f0 2024-05-09T09:47:32.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.023+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5834d70 con 0x563aa581c8f0 2024-05-09T09:47:32.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.023+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cc000e620 con 0x563aa581c8f0 2024-05-09T09:47:32.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.023+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5834d90 con 0x563aa581c8f0 2024-05-09T09:47:32.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.023+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cc000e620 con 0x563aa581c8f0 2024-05-09T09:47:32.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.023+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5834d90 con 0x563aa581c8f0 2024-05-09T09:47:32.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.023+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'28 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cc000e620 con 0x563aa581c8f0 2024-05-09T09:47:32.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.023+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5834d90 con 0x563aa5817fa0 2024-05-09T09:47:32.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.027+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cc8115030 con 0x563aa5817fa0 2024-05-09T09:47:32.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.027+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5834d90 con 0x563aa581c8f0 2024-05-09T09:47:32.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.031+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cc000e620 con 0x563aa581c8f0 2024-05-09T09:47:32.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.031+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5834d90 con 0x563aa5817fa0 2024-05-09T09:47:32.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.031+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'28 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cc8115030 con 0x563aa5817fa0 2024-05-09T09:47:32.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.031+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5834d90 con 0x563aa581c8f0 2024-05-09T09:47:32.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.035+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cc000e620 con 0x563aa581c8f0 2024-05-09T09:47:32.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.035+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5834d90 con 0x563aa5817fa0 2024-05-09T09:47:32.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.035+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'34 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cc8115030 con 0x563aa5817fa0 2024-05-09T09:47:32.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.035+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5834d90 con 0x7f2cc0037040 2024-05-09T09:47:32.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.039+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x7f2cc0037040 2024-05-09T09:47:32.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.039+0000 7f2b8afe5640 20 reqs_thread_entry: start 2024-05-09T09:47:32.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.039+0000 7f2cd877c980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:32.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.039+0000 7f2cd877c980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-09T09:47:32.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.039+0000 7f2b88fe1640 20 reqs_thread_entry: start 2024-05-09T09:47:32.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.039+0000 7f2cd877c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.039+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563aa58508a0 con 0x563aa58135b0 2024-05-09T09:47:32.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.039+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:32.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.039+0000 7f2cd877c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:32.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.039+0000 7f2cd877c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-05-09T09:47:32.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.039+0000 7f2cd877c980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:32.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.039+0000 7f2cd877c980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-05-09T09:47:32.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.039+0000 7f2cd877c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.039+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563aa58508a0 con 0x563aa58135b0 2024-05-09T09:47:32.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.039+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(95 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:32.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.039+0000 7f2cd877c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:32.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.039+0000 7f2cd877c980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-05-09T09:47:32.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.039+0000 7f2cd877c980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-05-09T09:47:32.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.039+0000 7f2cd877c980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-05-09T09:47:32.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.039+0000 7f2cd877c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.039+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:96 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563aa582ec70 con 0x563aa5817fa0 2024-05-09T09:47:32.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.039+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(96 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f2cc8115030 con 0x563aa5817fa0 2024-05-09T09:47:32.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.039+0000 7f2cd877c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:32.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.043+0000 7f2cd877c980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-05-09T09:47:32.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.043+0000 7f2cd877c980 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-05-09T09:47:32.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.043+0000 7f2cd877c980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-05-09T09:47:32.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.043+0000 7f2cd877c980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-05-09T09:47:32.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.043+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa582f560 con 0x563aa58135b0 2024-05-09T09:47:32.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.043+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(97 foo [delete,create,call,writefull 0~391] v30'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:32.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.043+0000 7f2cd877c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:47:32.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.043+0000 7f2cd877c980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:32.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.043+0000 7f2cd877c980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-09T09:47:32.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.043+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 7.d 7:b4812045:::notify.4:head [notify cookie 94809884913840 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563aa5853e20 con 0x563aa58135b0 2024-05-09T09:47:32.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.043+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== watch-notify(notify (1) cookie 94809884870416 notify 128849018880 ret 0) ==== 609+0+0 (crc 0 0 0) 0x563aa58503b0 con 0x563aa58135b0 2024-05-09T09:47:32.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.043+0000 7f2bb8b9e640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94809884870416 notifier 4301 bl.length()=567 2024-05-09T09:47:32.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.043+0000 7f2bb8b9e640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:47:32.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.043+0000 7f2bb8b9e640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:32.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.043+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(98 notify.4 [notify cookie 94809884913840 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:32.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.043+0000 7f2bb8b9e640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f2b980056c0 con 0x563aa58135b0 2024-05-09T09:47:32.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.043+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(99 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:32.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.043+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== watch-notify(notify_complete (2) cookie 94809884913840 notify 128849018880 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563aa5832370 con 0x563aa58135b0 2024-05-09T09:47:32.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.043+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa582f0b0 con 0x563aa58135b0 2024-05-09T09:47:32.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.047+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(100 foo@foo.com [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:32.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.047+0000 7f2cd877c980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-05-09T09:47:32.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.047+0000 7f2cd877c980 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-05-09T09:47:32.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.047+0000 7f2cd877c980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-05-09T09:47:32.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.047+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:101 7.e 7:7759931f:::notify.3:head [notify cookie 94809884913840 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563aa5854250 con 0x7f2cc0037040 2024-05-09T09:47:32.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.047+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== watch-notify(notify (1) cookie 94809884866016 notify 128849018880 ret 0) ==== 211+0+0 (crc 0 0 0) 0x563aa5832370 con 0x7f2cc0037040 2024-05-09T09:47:32.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.047+0000 7f2bb8b9e640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94809884866016 notifier 4301 bl.length()=169 2024-05-09T09:47:32.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.047+0000 7f2bb8b9e640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-05-09T09:47:32.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.047+0000 7f2bb8b9e640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-05-09T09:47:32.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.047+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(101 notify.3 [notify cookie 94809884913840 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2cd000a4d0 con 0x7f2cc0037040 2024-05-09T09:47:32.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.047+0000 7f2bb8b9e640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:102 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f2b980056c0 con 0x7f2cc0037040 2024-05-09T09:47:32.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.047+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(102 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x7f2cc0037040 2024-05-09T09:47:32.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.047+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== watch-notify(notify_complete (2) cookie 94809884913840 notify 128849018880 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563aa5832170 con 0x7f2cc0037040 2024-05-09T09:47:32.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.047+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5851f60 con 0x563aa5817fa0 2024-05-09T09:47:32.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.051+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(103 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f2cc8115030 con 0x563aa5817fa0 2024-05-09T09:47:32.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.051+0000 7f2cd877c980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-05-09T09:47:32.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.051+0000 7f2cd877c980 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-05-09T09:47:32.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.051+0000 7f2cd877c980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-05-09T09:47:32.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.051+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify cookie 94809884914192 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563aa5851f60 con 0x7f2cc0037040 2024-05-09T09:47:32.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.051+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== watch-notify(notify (1) cookie 94809884866016 notify 128849018881 ret 0) ==== 219+0+0 (crc 0 0 0) 0x563aa5832170 con 0x7f2cc0037040 2024-05-09T09:47:32.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.051+0000 7f2ba7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94809884866016 notifier 4301 bl.length()=177 2024-05-09T09:47:32.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.051+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.2 v2:172.21.15.157:6800/354455204 23 ==== osd_op_reply(104 notify.3 [notify cookie 94809884914192 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2cd000a4d0 con 0x7f2cc0037040 2024-05-09T09:47:32.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.051+0000 7f2ba7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-05-09T09:47:32.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.051+0000 7f2ba7fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-05-09T09:47:32.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.051+0000 7f2ba7fff640 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f2afc003a70 con 0x7f2cc0037040 2024-05-09T09:47:32.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.051+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.2 v2:172.21.15.157:6800/354455204 24 ==== osd_op_reply(105 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x7f2cc0037040 2024-05-09T09:47:32.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.051+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.2 v2:172.21.15.157:6800/354455204 25 ==== watch-notify(notify_complete (2) cookie 94809884914192 notify 128849018881 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563aa5832fc0 con 0x7f2cc0037040 2024-05-09T09:47:32.050 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-09T09:47:32.044078Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:47:32.044055Z","tags":[],"group_ids":[]} 2024-05-09T09:47:32.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.051+0000 7f2b8bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:32.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.051+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:106 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94809884872544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa582e2a0 con 0x563aa58135b0 2024-05-09T09:47:32.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.051+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(106 data_loggenerations_metadata [watch unwatch cookie 94809884872544] v30'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:32.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.051+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:107 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94809884856432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa582e2a0 con 0x7f2cc0037040 2024-05-09T09:47:32.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.055+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.2 v2:172.21.15.157:6800/354455204 26 ==== osd_op_reply(107 notify.0 [watch unwatch cookie 94809884856432] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x7f2cc0037040 2024-05-09T09:47:32.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.055+0000 7f2cd877c980 20 remove_watcher() i=0 2024-05-09T09:47:32.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.055+0000 7f2cd877c980 2 removed watcher, disabling cache 2024-05-09T09:47:32.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.055+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:108 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94809884860080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5821070 con 0x563aa58135b0 2024-05-09T09:47:32.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.055+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 36 ==== osd_op_reply(108 notify.1 [watch unwatch cookie 94809884860080] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:32.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.055+0000 7f2cd877c980 20 remove_watcher() i=1 2024-05-09T09:47:32.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.055+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:109 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94809884853952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5821070 con 0x563aa581c8f0 2024-05-09T09:47:32.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.059+0000 7f2ccda96640 1 -- 172.21.15.157:0/685467992 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(109 notify.2 [watch unwatch cookie 94809884853952] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cc000e620 con 0x563aa581c8f0 2024-05-09T09:47:32.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.059+0000 7f2cd877c980 20 remove_watcher() i=2 2024-05-09T09:47:32.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.059+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:110 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94809884866016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5821070 con 0x7f2cc0037040 2024-05-09T09:47:32.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.059+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.2 v2:172.21.15.157:6800/354455204 27 ==== osd_op_reply(110 notify.3 [watch unwatch cookie 94809884866016] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x7f2cc0037040 2024-05-09T09:47:32.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.059+0000 7f2cd877c980 20 remove_watcher() i=3 2024-05-09T09:47:32.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.059+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:111 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94809884870416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa58235e0 con 0x563aa58135b0 2024-05-09T09:47:32.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.063+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 <== osd.1 v2:172.21.15.157:6808/3930131338 37 ==== osd_op_reply(111 notify.4 [watch unwatch cookie 94809884870416] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cd000a4d0 con 0x563aa58135b0 2024-05-09T09:47:32.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.063+0000 7f2cd877c980 20 remove_watcher() i=4 2024-05-09T09:47:32.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.063+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:112 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94809884868080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5821070 con 0x563aa5817fa0 2024-05-09T09:47:32.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.063+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(112 notify.5 [watch unwatch cookie 94809884868080] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cc8115030 con 0x563aa5817fa0 2024-05-09T09:47:32.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.063+0000 7f2cd877c980 20 remove_watcher() i=5 2024-05-09T09:47:32.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.063+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:113 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94809884875024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa5824710 con 0x563aa5817fa0 2024-05-09T09:47:32.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.067+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(113 notify.6 [watch unwatch cookie 94809884875024] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cc8115030 con 0x563aa5817fa0 2024-05-09T09:47:32.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.067+0000 7f2cd877c980 20 remove_watcher() i=6 2024-05-09T09:47:32.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.067+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:114 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94809884879408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563aa58235e0 con 0x563aa5817fa0 2024-05-09T09:47:32.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.067+0000 7f2cd6297640 1 -- 172.21.15.157:0/685467992 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(114 notify.7 [watch unwatch cookie 94809884879408] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cc8115030 con 0x563aa5817fa0 2024-05-09T09:47:32.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.067+0000 7f2cd877c980 20 remove_watcher() i=7 2024-05-09T09:47:32.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.067+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563aa5817fa0 msgr2=0x563aa581a390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.067+0000 7f2cd877c980 1 --2- 172.21.15.157:0/685467992 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563aa5817fa0 0x563aa581a390 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.067+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563aa58135b0 msgr2=0x563aa5815a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.067+0000 7f2cd877c980 1 --2- 172.21.15.157:0/685467992 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563aa58135b0 0x563aa5815a70 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.067+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2cc0037040 msgr2=0x7f2cc0036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.067+0000 7f2cd877c980 1 --2- 172.21.15.157:0/685467992 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2cc0037040 0x7f2cc0036410 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.067+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563aa581c8f0 msgr2=0x563aa581ed00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.067+0000 7f2cd877c980 1 --2- 172.21.15.157:0/685467992 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563aa581c8f0 0x563aa581ed00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.067+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2ba0034bb0 msgr2=0x7f2ba0037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.067+0000 7f2cd877c980 1 --2- 172.21.15.157:0/685467992 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2ba0034bb0 0x7f2ba0037070 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x563aa57c43d0 tx=0x7f2cc0010000 comp rx=0 tx=0).stop 2024-05-09T09:47:32.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.067+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa57ff860 msgr2=0x563aa5806bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.067+0000 7f2cd6a98640 1 -- 172.21.15.157:0/685467992 reap_dead start 2024-05-09T09:47:32.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.067+0000 7f2cd877c980 1 --2- 172.21.15.157:0/685467992 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa57ff860 0x563aa5806bb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80e8c00 tx=0x7f2cc80f1ea0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 shutdown_connections 2024-05-09T09:47:32.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd877c980 1 --2- 172.21.15.157:0/685467992 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa57ff860 0x563aa5806bb0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 >> 172.21.15.157:0/685467992 conn(0x563aa57fbbe0 msgr2=0x563aa57f9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:32.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 shutdown_connections 2024-05-09T09:47:32.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd877c980 1 -- 172.21.15.157:0/685467992 wait complete. 2024-05-09T09:47:32.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd877c980 1 -- 172.21.15.157:0/2085092460 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2bb0034bb0 msgr2=0x7f2bb0037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd877c980 1 --2- 172.21.15.157:0/2085092460 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2bb0034bb0 0x7f2bb0037070 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2cc000bf60 tx=0x7f2cc000f000 comp rx=0 tx=0).stop 2024-05-09T09:47:32.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd877c980 1 -- 172.21.15.157:0/2085092460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa57f28b0 msgr2=0x563aa57f2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd877c980 1 --2- 172.21.15.157:0/2085092460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa57f28b0 0x563aa57f2cd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2cc801b0b0 tx=0x7f2cc80bead0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd877c980 1 -- 172.21.15.157:0/2085092460 shutdown_connections 2024-05-09T09:47:32.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd877c980 1 --2- 172.21.15.157:0/2085092460 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2bb0034bb0 0x7f2bb0037070 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd877c980 1 --2- 172.21.15.157:0/2085092460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa57f28b0 0x563aa57f2cd0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd877c980 1 -- 172.21.15.157:0/2085092460 >> 172.21.15.157:0/2085092460 conn(0x563aa57e7680 msgr2=0x563aa57e8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:32.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd877c980 1 -- 172.21.15.157:0/2085092460 shutdown_connections 2024-05-09T09:47:32.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd877c980 1 -- 172.21.15.157:0/2085092460 wait complete. 2024-05-09T09:47:32.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd877c980 1 -- 172.21.15.157:0/3692099233 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563aa57c5e20 msgr2=0x563aa57c8210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd877c980 1 --2- 172.21.15.157:0/3692099233 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563aa57c5e20 0x563aa57c8210 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd877c980 1 -- 172.21.15.157:0/3692099233 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563aa56ca3f0 msgr2=0x563aa57c3430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd877c980 1 --2- 172.21.15.157:0/3692099233 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563aa56ca3f0 0x563aa57c3430 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd877c980 1 -- 172.21.15.157:0/3692099233 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563aa57c9d40 msgr2=0x563aa57cc130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd877c980 1 --2- 172.21.15.157:0/3692099233 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563aa57c9d40 0x563aa57cc130 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd877c980 1 -- 172.21.15.157:0/3692099233 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2bbc034c00 msgr2=0x7f2bbc0370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd877c980 1 --2- 172.21.15.157:0/3692099233 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2bbc034c00 0x7f2bbc0370c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0000f70 tx=0x7f2cc00012c0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd877c980 1 -- 172.21.15.157:0/3692099233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa56c9ad0 msgr2=0x563aa57bc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd877c980 1 --2- 172.21.15.157:0/3692099233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563aa56c9ad0 0x563aa57bc4f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80b8040 tx=0x7f2cc8018020 comp rx=0 tx=0).stop 2024-05-09T09:47:32.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd6a98640 1 -- 172.21.15.157:0/3692099233 reap_dead start 2024-05-09T09:47:32.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd877c980 1 -- 172.21.15.157:0/3692099233 shutdown_connections 2024-05-09T09:47:32.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd877c980 1 -- 172.21.15.157:0/3692099233 >> 172.21.15.157:0/3692099233 conn(0x563aa563d1f0 msgr2=0x563aa57afb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:32.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd877c980 1 -- 172.21.15.157:0/3692099233 shutdown_connections 2024-05-09T09:47:32.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.071+0000 7f2cd877c980 1 -- 172.21.15.157:0/3692099233 wait complete. 2024-05-09T09:47:32.081 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-09T09:47:32.044078Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:47:32.044055Z', 'tags': [], 'group_ids': []} 2024-05-09T09:47:32.081 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-05-09T09:47:32.081 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-05-09T09:47:32.081 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-05-09T09:47:32.163 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:32.163 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:32.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.167+0000 7fa97abc2980 1 Processor -- start 2024-05-09T09:47:32.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.167+0000 7fa97abc2980 1 -- start start 2024-05-09T09:47:32.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.167+0000 7fa97abc2980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x561e20da9a10 0x561e20e38590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.167+0000 7fa97abc2980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561e20ceb440 con 0x561e20e38ad0 2024-05-09T09:47:32.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.167+0000 7fa97abc2980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x561e20cd65f0 con 0x561e20da9a10 2024-05-09T09:47:32.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.167+0000 7fa9786dd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x561e20da9a10 0x561e20e38590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.167+0000 7fa9786dd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x561e20da9a10 0x561e20e38590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53872/0 (socket says 172.21.15.157:53872) 2024-05-09T09:47:32.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.167+0000 7fa9786dd640 1 -- 172.21.15.157:0/1117581534 learned_addr learned my addr 172.21.15.157:0/1117581534 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:32.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.167+0000 7fa9786dd640 1 -- 172.21.15.157:0/1117581534 >> v1:172.21.15.110:6789/0 conn(0x561e20e38ad0 legacy=0x561e20e3aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.167+0000 7fa9786dd640 1 -- 172.21.15.157:0/1117581534 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e20ce1990 con 0x561e20da9a10 2024-05-09T09:47:32.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.167+0000 7fa9786dd640 1 --2- 172.21.15.157:0/1117581534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20da9a10 0x561e20e38590 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa96800a5c0 tx=0x7fa96801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d06454f99495f25 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.171+0000 7fa9776db640 1 -- 172.21.15.157:0/1117581534 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9680a6070 con 0x561e20da9a10 2024-05-09T09:47:32.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.171+0000 7fa9776db640 1 -- 172.21.15.157:0/1117581534 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9680af070 con 0x561e20da9a10 2024-05-09T09:47:32.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.171+0000 7fa9776db640 1 -- 172.21.15.157:0/1117581534 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9680aa5c0 con 0x561e20da9a10 2024-05-09T09:47:32.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.171+0000 7fa97abc2980 1 -- 172.21.15.157:0/1117581534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20da9a10 msgr2=0x561e20e38590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.171+0000 7fa97abc2980 1 --2- 172.21.15.157:0/1117581534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20da9a10 0x561e20e38590 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa96800a5c0 tx=0x7fa96801b340 comp rx=0 tx=0).stop 2024-05-09T09:47:32.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.171+0000 7fa97abc2980 1 -- 172.21.15.157:0/1117581534 shutdown_connections 2024-05-09T09:47:32.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.171+0000 7fa97abc2980 1 --2- 172.21.15.157:0/1117581534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20da9a10 0x561e20e38590 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.171+0000 7fa97abc2980 1 -- 172.21.15.157:0/1117581534 >> 172.21.15.157:0/1117581534 conn(0x561e20e30070 msgr2=0x561e20e32490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:32.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.171+0000 7fa97abc2980 1 -- 172.21.15.157:0/1117581534 shutdown_connections 2024-05-09T09:47:32.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.171+0000 7fa97abc2980 1 -- 172.21.15.157:0/1117581534 wait complete. 2024-05-09T09:47:32.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.187+0000 7fa97abc2980 1 Processor -- start 2024-05-09T09:47:32.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.187+0000 7fa97abc2980 1 -- start start 2024-05-09T09:47:32.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.187+0000 7fa97abc2980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20e38ad0 0x561e20f20c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.187+0000 7fa97abc2980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561e20d38fe0 con 0x561e20e38ad0 2024-05-09T09:47:32.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.187+0000 7fa9786dd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20e38ad0 0x561e20f20c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.187+0000 7fa9786dd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20e38ad0 0x561e20f20c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53876/0 (socket says 172.21.15.157:53876) 2024-05-09T09:47:32.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.187+0000 7fa9786dd640 1 -- 172.21.15.157:0/1596030572 learned_addr learned my addr 172.21.15.157:0/1596030572 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:32.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.187+0000 7fa9786dd640 1 -- 172.21.15.157:0/1596030572 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e20cbdae0 con 0x561e20e38ad0 2024-05-09T09:47:32.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.187+0000 7fa9786dd640 1 --2- 172.21.15.157:0/1596030572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20e38ad0 0x561e20f20c50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa968018f70 tx=0x7fa968003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12295469e624f8ec server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.187+0000 7fa86660c640 1 -- 172.21.15.157:0/1596030572 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9680aa840 con 0x561e20e38ad0 2024-05-09T09:47:32.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.187+0000 7fa86660c640 1 -- 172.21.15.157:0/1596030572 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9680aaa00 con 0x561e20e38ad0 2024-05-09T09:47:32.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.187+0000 7fa86660c640 1 -- 172.21.15.157:0/1596030572 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9680aad20 con 0x561e20e38ad0 2024-05-09T09:47:32.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.187+0000 7fa97abc2980 1 -- 172.21.15.157:0/1596030572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20e38ad0 msgr2=0x561e20f20c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.187+0000 7fa97abc2980 1 --2- 172.21.15.157:0/1596030572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20e38ad0 0x561e20f20c50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa968018f70 tx=0x7fa968003030 comp rx=0 tx=0).stop 2024-05-09T09:47:32.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.187+0000 7fa97abc2980 1 -- 172.21.15.157:0/1596030572 shutdown_connections 2024-05-09T09:47:32.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.187+0000 7fa97abc2980 1 --2- 172.21.15.157:0/1596030572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20e38ad0 0x561e20f20c50 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.187+0000 7fa97abc2980 1 -- 172.21.15.157:0/1596030572 >> 172.21.15.157:0/1596030572 conn(0x561e20e30070 msgr2=0x561e20f1c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:32.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.187+0000 7fa97abc2980 1 -- 172.21.15.157:0/1596030572 shutdown_connections 2024-05-09T09:47:32.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.187+0000 7fa97abc2980 1 -- 172.21.15.157:0/1596030572 wait complete. 2024-05-09T09:47:32.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.187+0000 7fa97abc2980 1 Processor -- start 2024-05-09T09:47:32.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.187+0000 7fa97abc2980 1 -- start start 2024-05-09T09:47:32.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.191+0000 7fa97abc2980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20e38ad0 0x561e20f29f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.191+0000 7fa97abc2980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561e20e3d0f0 con 0x561e20e38ad0 2024-05-09T09:47:32.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.191+0000 7fa9786dd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20e38ad0 0x561e20f29f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.191+0000 7fa9786dd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20e38ad0 0x561e20f29f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53892/0 (socket says 172.21.15.157:53892) 2024-05-09T09:47:32.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.191+0000 7fa9786dd640 1 -- 172.21.15.157:0/2266779050 learned_addr learned my addr 172.21.15.157:0/2266779050 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:32.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.191+0000 7fa9786dd640 1 -- 172.21.15.157:0/2266779050 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e20f2a460 con 0x561e20e38ad0 2024-05-09T09:47:32.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.191+0000 7fa9786dd640 1 --2- 172.21.15.157:0/2266779050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20e38ad0 0x561e20f29f20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa968018f70 tx=0x7fa9680180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.191+0000 7fa864e09640 1 -- 172.21.15.157:0/2266779050 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9680cb030 con 0x561e20e38ad0 2024-05-09T09:47:32.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.191+0000 7fa864e09640 1 -- 172.21.15.157:0/2266779050 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9680abec0 con 0x561e20e38ad0 2024-05-09T09:47:32.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.191+0000 7fa97abc2980 1 -- 172.21.15.157:0/2266779050 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561e20f2a6f0 con 0x561e20e38ad0 2024-05-09T09:47:32.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.191+0000 7fa864e09640 1 -- 172.21.15.157:0/2266779050 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9680bda50 con 0x561e20e38ad0 2024-05-09T09:47:32.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.191+0000 7fa97abc2980 1 -- 172.21.15.157:0/2266779050 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e20f2d380 con 0x561e20e38ad0 2024-05-09T09:47:32.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.191+0000 7fa864e09640 1 -- 172.21.15.157:0/2266779050 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fa9680ce070 con 0x561e20e38ad0 2024-05-09T09:47:32.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.191+0000 7fa864e09640 1 --2- 172.21.15.157:0/2266779050 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa860034bb0 0x7fa860037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.191+0000 7fa864e09640 1 -- 172.21.15.157:0/2266779050 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fa9680cc070 con 0x561e20e38ad0 2024-05-09T09:47:32.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.191+0000 7fa977edc640 1 --2- 172.21.15.157:0/2266779050 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa860034bb0 0x7fa860037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.191+0000 7fa97abc2980 1 --2- 172.21.15.157:0/2266779050 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561e20f2ee50 0x561e20f31280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.191+0000 7fa97abc2980 1 -- 172.21.15.157:0/2266779050 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e20f318f0 con 0x561e20f2ee50 2024-05-09T09:47:32.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.191+0000 7fa978ede640 1 --2- 172.21.15.157:0/2266779050 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561e20f2ee50 0x561e20f31280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.191+0000 7fa977edc640 1 --2- 172.21.15.157:0/2266779050 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa860034bb0 0x7fa860037070 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa960001570 tx=0x7fa9600066d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.191+0000 7fa978ede640 1 --2- 172.21.15.157:0/2266779050 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561e20f2ee50 0x561e20f31280 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.195+0000 7fa978ede640 1 -- 172.21.15.157:0/2266779050 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9700083f0 con 0x561e20f2ee50 2024-05-09T09:47:32.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.195+0000 7fa97abc2980 1 -- 172.21.15.157:0/2266779050 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e20f2e5a0 con 0x561e20f2ee50 2024-05-09T09:47:32.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.195+0000 7fa978ede640 1 -- 172.21.15.157:0/2266779050 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa9700083f0 con 0x561e20f2ee50 2024-05-09T09:47:32.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.195+0000 7fa97abc2980 1 --2- 172.21.15.157:0/2266779050 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561e20f33c40 0x561e20f36030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.195+0000 7fa97abc2980 1 -- 172.21.15.157:0/2266779050 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e20f36700 con 0x561e20f33c40 2024-05-09T09:47:32.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.195+0000 7fa9786dd640 1 --2- 172.21.15.157:0/2266779050 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561e20f33c40 0x561e20f36030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.195+0000 7fa9786dd640 1 --2- 172.21.15.157:0/2266779050 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561e20f33c40 0x561e20f36030 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.195+0000 7fa9786dd640 1 -- 172.21.15.157:0/2266779050 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa968008090 con 0x561e20f33c40 2024-05-09T09:47:32.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.195+0000 7fa97abc2980 1 -- 172.21.15.157:0/2266779050 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e20f32ae0 con 0x561e20f2ee50 2024-05-09T09:47:32.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.195+0000 7fa978ede640 1 -- 172.21.15.157:0/2266779050 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa9700083f0 con 0x561e20f2ee50 2024-05-09T09:47:32.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.195+0000 7fa97abc2980 1 --2- 172.21.15.157:0/2266779050 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561e20f37b60 0x561e20f39f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.195+0000 7fa97abc2980 1 -- 172.21.15.157:0/2266779050 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e20f3a650 con 0x561e20f37b60 2024-05-09T09:47:32.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.195+0000 7fa977edc640 1 --2- 172.21.15.157:0/2266779050 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561e20f37b60 0x561e20f39f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.195+0000 7fa977edc640 1 --2- 172.21.15.157:0/2266779050 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561e20f37b60 0x561e20f39f50 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.195+0000 7fa977edc640 1 -- 172.21.15.157:0/2266779050 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa96000f030 con 0x561e20f37b60 2024-05-09T09:47:32.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.199+0000 7fa97abc2980 1 Processor -- start 2024-05-09T09:47:32.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.199+0000 7fa97abc2980 1 -- start start 2024-05-09T09:47:32.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.199+0000 7fa97abc2980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20f60530 0x561e20f60950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.199+0000 7fa97abc2980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561e20d3d020 con 0x561e20f60530 2024-05-09T09:47:32.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.203+0000 7fa9786dd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20f60530 0x561e20f60950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.203+0000 7fa9786dd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20f60530 0x561e20f60950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53902/0 (socket says 172.21.15.157:53902) 2024-05-09T09:47:32.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.203+0000 7fa9786dd640 1 -- 172.21.15.157:0/2332428167 learned_addr learned my addr 172.21.15.157:0/2332428167 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:32.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.203+0000 7fa9786dd640 1 -- 172.21.15.157:0/2332428167 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e20f60e90 con 0x561e20f60530 2024-05-09T09:47:32.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.203+0000 7fa9786dd640 1 --2- 172.21.15.157:0/2332428167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20f60530 0x561e20f60950 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa9680bdeb0 tx=0x7fa9680bdee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.203+0000 7fa85cb9e640 1 -- 172.21.15.157:0/2332428167 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9680d2d40 con 0x561e20f60530 2024-05-09T09:47:32.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.203+0000 7fa85cb9e640 1 -- 172.21.15.157:0/2332428167 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9680be050 con 0x561e20f60530 2024-05-09T09:47:32.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.203+0000 7fa97abc2980 1 -- 172.21.15.157:0/2332428167 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561e20f61920 con 0x561e20f60530 2024-05-09T09:47:32.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.203+0000 7fa85cb9e640 1 -- 172.21.15.157:0/2332428167 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9680be350 con 0x561e20f60530 2024-05-09T09:47:32.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.203+0000 7fa97abc2980 1 -- 172.21.15.157:0/2332428167 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e20f61920 con 0x561e20f60530 2024-05-09T09:47:32.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.203+0000 7fa85cb9e640 1 -- 172.21.15.157:0/2332428167 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fa9680cf5e0 con 0x561e20f60530 2024-05-09T09:47:32.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.203+0000 7fa85cb9e640 1 --2- 172.21.15.157:0/2332428167 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa850034bb0 0x7fa850037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.203+0000 7fa85cb9e640 1 -- 172.21.15.157:0/2332428167 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fa9680edc50 con 0x561e20f60530 2024-05-09T09:47:32.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.207+0000 7fa977edc640 1 --2- 172.21.15.157:0/2332428167 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa850034bb0 0x7fa850037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.207+0000 7fa97abc2980 1 Processor -- start 2024-05-09T09:47:32.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.207+0000 7fa97abc2980 1 -- start start 2024-05-09T09:47:32.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.207+0000 7fa977edc640 1 --2- 172.21.15.157:0/2332428167 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa850034bb0 0x7fa850037070 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x561e20f321f0 tx=0x7fa960011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.207+0000 7fa97abc2980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20f6d3c0 0x561e20f6d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.207+0000 7fa97abc2980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561e20f212e0 con 0x561e20f6d3c0 2024-05-09T09:47:32.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.207+0000 7fa9786dd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20f6d3c0 0x561e20f6d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.207+0000 7fa9786dd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20f6d3c0 0x561e20f6d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53910/0 (socket says 172.21.15.157:53910) 2024-05-09T09:47:32.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.207+0000 7fa9786dd640 1 -- 172.21.15.157:0/191499351 learned_addr learned my addr 172.21.15.157:0/191499351 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:32.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.207+0000 7fa9786dd640 1 -- 172.21.15.157:0/191499351 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e20f6dd70 con 0x561e20f6d3c0 2024-05-09T09:47:32.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.207+0000 7fa9786dd640 1 --2- 172.21.15.157:0/191499351 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20f6d3c0 0x561e20f6d7a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa9680bdc50 tx=0x7fa9680c73f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb425e32f7671732 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.207+0000 7fa8567fc640 1 -- 172.21.15.157:0/191499351 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9680c53a0 con 0x561e20f6d3c0 2024-05-09T09:47:32.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.207+0000 7fa8567fc640 1 -- 172.21.15.157:0/191499351 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9680a8330 con 0x561e20f6d3c0 2024-05-09T09:47:32.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.207+0000 7fa8567fc640 1 -- 172.21.15.157:0/191499351 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9680c5540 con 0x561e20f6d3c0 2024-05-09T09:47:32.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.207+0000 7fa97abc2980 1 -- 172.21.15.157:0/191499351 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20f6d3c0 msgr2=0x561e20f6d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.207+0000 7fa97abc2980 1 --2- 172.21.15.157:0/191499351 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20f6d3c0 0x561e20f6d7a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa9680bdc50 tx=0x7fa9680c73f0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.207+0000 7fa97abc2980 1 -- 172.21.15.157:0/191499351 shutdown_connections 2024-05-09T09:47:32.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.207+0000 7fa97abc2980 1 --2- 172.21.15.157:0/191499351 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20f6d3c0 0x561e20f6d7a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.207+0000 7fa97abc2980 1 -- 172.21.15.157:0/191499351 >> 172.21.15.157:0/191499351 conn(0x561e20f69740 msgr2=0x561e20f677a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:32.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.207+0000 7fa97abc2980 1 -- 172.21.15.157:0/191499351 shutdown_connections 2024-05-09T09:47:32.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.207+0000 7fa97abc2980 1 -- 172.21.15.157:0/191499351 wait complete. 2024-05-09T09:47:32.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.207+0000 7fa97abc2980 1 Processor -- start 2024-05-09T09:47:32.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.207+0000 7fa97abc2980 1 -- start start 2024-05-09T09:47:32.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.207+0000 7fa97abc2980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20f6d3c0 0x561e20f745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.207+0000 7fa97abc2980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561e20f6e300 con 0x561e20f6d3c0 2024-05-09T09:47:32.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.207+0000 7fa9786dd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20f6d3c0 0x561e20f745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.207+0000 7fa9786dd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20f6d3c0 0x561e20f745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53912/0 (socket says 172.21.15.157:53912) 2024-05-09T09:47:32.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.207+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 learned_addr learned my addr 172.21.15.157:0/2794486361 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:32.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.211+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e20f74b20 con 0x561e20f6d3c0 2024-05-09T09:47:32.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.211+0000 7fa9786dd640 1 --2- 172.21.15.157:0/2794486361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20f6d3c0 0x561e20f745e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa9680bf020 tx=0x7fa9680c5ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.211+0000 7fa854ff9640 1 -- 172.21.15.157:0/2794486361 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa968110070 con 0x561e20f6d3c0 2024-05-09T09:47:32.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.211+0000 7fa854ff9640 1 -- 172.21.15.157:0/2794486361 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9680a88c0 con 0x561e20f6d3c0 2024-05-09T09:47:32.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.211+0000 7fa854ff9640 1 -- 172.21.15.157:0/2794486361 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9680d41a0 con 0x561e20f6d3c0 2024-05-09T09:47:32.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.211+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561e20f74b20 con 0x561e20f6d3c0 2024-05-09T09:47:32.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.211+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e20f74b20 con 0x561e20f6d3c0 2024-05-09T09:47:32.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.211+0000 7fa854ff9640 1 -- 172.21.15.157:0/2794486361 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fa96810a040 con 0x561e20f6d3c0 2024-05-09T09:47:32.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.211+0000 7fa854ff9640 1 --2- 172.21.15.157:0/2794486361 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa840034bb0 0x7fa840037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.211+0000 7fa854ff9640 1 -- 172.21.15.157:0/2794486361 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fa968115c60 con 0x561e20f6d3c0 2024-05-09T09:47:32.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.211+0000 7fa977edc640 1 --2- 172.21.15.157:0/2794486361 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa840034bb0 0x7fa840037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.211+0000 7fa97abc2980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.211+0000 7fa97abc2980 1 --2- 172.21.15.157:0/2794486361 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561e20f80f70 0x561e20f83430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.211+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e20f83b80 con 0x561e20f80f70 2024-05-09T09:47:32.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.211+0000 7fa978ede640 1 --2- 172.21.15.157:0/2794486361 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561e20f80f70 0x561e20f83430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.211+0000 7fa977edc640 1 --2- 172.21.15.157:0/2794486361 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa840034bb0 0x7fa840037070 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x561e20f3aa50 tx=0x7fa960012000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.211+0000 7fa978ede640 1 --2- 172.21.15.157:0/2794486361 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561e20f80f70 0x561e20f83430 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9700083f0 con 0x561e20f80f70 2024-05-09T09:47:32.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa97abc2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:32.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa97abc2980 20 realm 2024-05-09T09:47:32.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa97abc2980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e20f83f90 con 0x561e20f80f70 2024-05-09T09:47:32.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9700083f0 con 0x561e20f80f70 2024-05-09T09:47:32.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa97abc2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:32.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa97abc2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:32.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa97abc2980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84860 con 0x561e20f80f70 2024-05-09T09:47:32.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9700083f0 con 0x561e20f80f70 2024-05-09T09:47:32.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa97abc2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:32.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa97abc2980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x561e20f80f70 2024-05-09T09:47:32.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa9700083f0 con 0x561e20f80f70 2024-05-09T09:47:32.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa97abc2980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:32.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa97abc2980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa97abc2980 1 --2- 172.21.15.157:0/2794486361 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561e20f85960 0x561e20f87d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e20f88360 con 0x561e20f85960 2024-05-09T09:47:32.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa9786dd640 1 --2- 172.21.15.157:0/2794486361 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561e20f85960 0x561e20f87d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa9786dd640 1 --2- 172.21.15.157:0/2794486361 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561e20f85960 0x561e20f87d50 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa96811b070 con 0x561e20f85960 2024-05-09T09:47:32.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa97abc2980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:32.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa97abc2980 20 searching for the correct realm 2024-05-09T09:47:32.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa97abc2980 1 --2- 172.21.15.157:0/2794486361 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561e20f8a2b0 0x561e20f8c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f8cd90 con 0x561e20f8a2b0 2024-05-09T09:47:32.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa977edc640 1 --2- 172.21.15.157:0/2794486361 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561e20f8a2b0 0x561e20f8c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa977edc640 1 --2- 172.21.15.157:0/2794486361 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561e20f8a2b0 0x561e20f8c6c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa960021040 con 0x561e20f8a2b0 2024-05-09T09:47:32.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa977edc640 1 --2- 172.21.15.157:0/2794486361 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa960013040 0x7fa9600243c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f8cd90 con 0x7fa960013040 2024-05-09T09:47:32.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.215+0000 7fa978ede640 1 --2- 172.21.15.157:0/2794486361 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa960013040 0x7fa9600243c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.219+0000 7fa978ede640 1 --2- 172.21.15.157:0/2794486361 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa960013040 0x7fa9600243c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.219+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9700083f0 con 0x7fa960013040 2024-05-09T09:47:32.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.219+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x561e20f85960 2024-05-09T09:47:32.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.219+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa96811b070 con 0x561e20f85960 2024-05-09T09:47:32.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.219+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x561e20f80f70 2024-05-09T09:47:32.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.219+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9700083f0 con 0x561e20f80f70 2024-05-09T09:47:32.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.219+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x561e20f80f70 2024-05-09T09:47:32.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.219+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa970026040 con 0x561e20f80f70 2024-05-09T09:47:32.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.219+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x561e20f85960 2024-05-09T09:47:32.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.219+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa96811b070 con 0x561e20f85960 2024-05-09T09:47:32.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.219+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x561e20f85960 2024-05-09T09:47:32.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.219+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa96811b070 con 0x561e20f85960 2024-05-09T09:47:32.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.219+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x7fa960013040 2024-05-09T09:47:32.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.219+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa970026040 con 0x7fa960013040 2024-05-09T09:47:32.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.219+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x561e20f8a2b0 2024-05-09T09:47:32.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.219+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa960021040 con 0x561e20f8a2b0 2024-05-09T09:47:32.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.219+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x561e20f80f70 2024-05-09T09:47:32.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.219+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa970026040 con 0x561e20f80f70 2024-05-09T09:47:32.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.219+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x561e20f85960 2024-05-09T09:47:32.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.223+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa96811b070 con 0x561e20f85960 2024-05-09T09:47:32.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.223+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x561e20f80f70 2024-05-09T09:47:32.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.223+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa970026040 con 0x561e20f80f70 2024-05-09T09:47:32.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.223+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x7fa960013040 2024-05-09T09:47:32.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.223+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa970026040 con 0x7fa960013040 2024-05-09T09:47:32.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.223+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x561e20f8a2b0 2024-05-09T09:47:32.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.223+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa960041040 con 0x561e20f8a2b0 2024-05-09T09:47:32.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.223+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x561e20f8a2b0 2024-05-09T09:47:32.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.223+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa960041040 con 0x561e20f8a2b0 2024-05-09T09:47:32.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.223+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x561e20f85960 2024-05-09T09:47:32.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.223+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa96811b070 con 0x561e20f85960 2024-05-09T09:47:32.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.223+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x561e20f8a2b0 2024-05-09T09:47:32.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.223+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa960041040 con 0x561e20f8a2b0 2024-05-09T09:47:32.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.223+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x561e20f8a2b0 2024-05-09T09:47:32.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.223+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa960041040 con 0x561e20f8a2b0 2024-05-09T09:47:32.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.223+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x561e20f80f70 2024-05-09T09:47:32.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.223+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa970026040 con 0x561e20f80f70 2024-05-09T09:47:32.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.223+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x561e20f80f70 2024-05-09T09:47:32.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.223+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa970026040 con 0x561e20f80f70 2024-05-09T09:47:32.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.223+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x561e20f85960 2024-05-09T09:47:32.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.227+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa96811b070 con 0x561e20f85960 2024-05-09T09:47:32.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.227+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x561e20f8a2b0 2024-05-09T09:47:32.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.227+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa960041040 con 0x561e20f8a2b0 2024-05-09T09:47:32.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.227+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x7fa960013040 2024-05-09T09:47:32.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.227+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa970026040 con 0x7fa960013040 2024-05-09T09:47:32.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.227+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x561e20f80f70 2024-05-09T09:47:32.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.227+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa970026040 con 0x561e20f80f70 2024-05-09T09:47:32.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.227+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x561e20f85960 2024-05-09T09:47:32.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.227+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa96811b070 con 0x561e20f85960 2024-05-09T09:47:32.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.227+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x561e20f8a2b0 2024-05-09T09:47:32.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.227+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa960041040 con 0x561e20f8a2b0 2024-05-09T09:47:32.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.227+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x561e20f85960 2024-05-09T09:47:32.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.227+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa96811b070 con 0x561e20f85960 2024-05-09T09:47:32.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.227+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x7fa960013040 2024-05-09T09:47:32.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.227+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa970026040 con 0x7fa960013040 2024-05-09T09:47:32.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.227+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x561e20f8a2b0 2024-05-09T09:47:32.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.227+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa960041040 con 0x561e20f8a2b0 2024-05-09T09:47:32.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.227+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x561e20f85960 2024-05-09T09:47:32.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa96811b070 con 0x561e20f85960 2024-05-09T09:47:32.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x561e20f80f70 2024-05-09T09:47:32.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa970026040 con 0x561e20f80f70 2024-05-09T09:47:32.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e20f84c00 con 0x7fa960013040 2024-05-09T09:47:32.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa970026040 con 0x7fa960013040 2024-05-09T09:47:32.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:32.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:32.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:32.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:32.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:32.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:32.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e20f88c20 con 0x561e20f80f70 2024-05-09T09:47:32.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa970026040 con 0x561e20f80f70 2024-05-09T09:47:32.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:32.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e20f88c20 con 0x561e20f80f70 2024-05-09T09:47:32.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa970026040 con 0x561e20f80f70 2024-05-09T09:47:32.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:32.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e20f88c20 con 0x561e20f8a2b0 2024-05-09T09:47:32.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa960041040 con 0x561e20f8a2b0 2024-05-09T09:47:32.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:32.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 20 zone default found 2024-05-09T09:47:32.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 4 Realm: () 2024-05-09T09:47:32.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:32.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:32.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:32.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 20 zonegroup default 2024-05-09T09:47:32.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e20f89620 con 0x561e20f85960 2024-05-09T09:47:32.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa96811b070 con 0x561e20f85960 2024-05-09T09:47:32.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:32.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e20f891f0 con 0x561e20f8a2b0 2024-05-09T09:47:32.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa960041040 con 0x561e20f8a2b0 2024-05-09T09:47:32.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:32.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e20f8f190 con 0x561e20f8a2b0 2024-05-09T09:47:32.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa960041040 con 0x561e20f8a2b0 2024-05-09T09:47:32.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:32.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 20 started sync module instance, tier type = 2024-05-09T09:47:32.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:32.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.231+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20f8e530 con 0x7fa960013040 2024-05-09T09:47:32.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.235+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa970026040 con 0x7fa960013040 2024-05-09T09:47:32.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.235+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94687402191440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20f8e530 con 0x7fa960013040 2024-05-09T09:47:32.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.235+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20f8fc70 con 0x561e20f80f70 2024-05-09T09:47:32.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.235+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94687402191440] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa970036040 con 0x7fa960013040 2024-05-09T09:47:32.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.235+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa970036040 con 0x561e20f80f70 2024-05-09T09:47:32.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.235+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94687402194784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20f8e530 con 0x561e20f80f70 2024-05-09T09:47:32.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.235+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20f90680 con 0x561e20f8a2b0 2024-05-09T09:47:32.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.239+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94687402194784] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa970036040 con 0x561e20f80f70 2024-05-09T09:47:32.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.239+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa960041040 con 0x561e20f8a2b0 2024-05-09T09:47:32.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.239+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94687402188928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20f8e4a0 con 0x561e20f8a2b0 2024-05-09T09:47:32.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.239+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20f913c0 con 0x7fa960013040 2024-05-09T09:47:32.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.239+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa970036040 con 0x7fa960013040 2024-05-09T09:47:32.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.239+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94687402200784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20f91c60 con 0x7fa960013040 2024-05-09T09:47:32.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.239+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20f92660 con 0x561e20f80f70 2024-05-09T09:47:32.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.239+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94687402188928] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa960041040 con 0x561e20f8a2b0 2024-05-09T09:47:32.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.239+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94687402200784] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa970036040 con 0x7fa960013040 2024-05-09T09:47:32.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.243+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa970036040 con 0x561e20f80f70 2024-05-09T09:47:32.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.243+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94687402199584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20f91730 con 0x561e20f80f70 2024-05-09T09:47:32.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.243+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20f92f00 con 0x561e20f85960 2024-05-09T09:47:32.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.243+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94687402199584] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa970036040 con 0x561e20f80f70 2024-05-09T09:47:32.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.243+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96811b070 con 0x561e20f85960 2024-05-09T09:47:32.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.243+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94687402207824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20f91730 con 0x561e20f85960 2024-05-09T09:47:32.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.243+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20f93750 con 0x561e20f85960 2024-05-09T09:47:32.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.247+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96811b070 con 0x561e20f85960 2024-05-09T09:47:32.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.247+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94687402212160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20f94410 con 0x561e20f85960 2024-05-09T09:47:32.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.247+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94687402207824] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96811b070 con 0x561e20f85960 2024-05-09T09:47:32.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.247+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20f94dd0 con 0x561e20f85960 2024-05-09T09:47:32.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.247+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94687402212160] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96811b070 con 0x561e20f85960 2024-05-09T09:47:32.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.247+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96811b070 con 0x561e20f85960 2024-05-09T09:47:32.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.247+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94687402205552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20f94dd0 con 0x561e20f85960 2024-05-09T09:47:32.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.247+0000 7fa97abc2980 20 add_watcher() i=0 2024-05-09T09:47:32.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.247+0000 7fa97abc2980 20 add_watcher() i=1 2024-05-09T09:47:32.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.247+0000 7fa97abc2980 20 add_watcher() i=2 2024-05-09T09:47:32.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.247+0000 7fa97abc2980 20 add_watcher() i=3 2024-05-09T09:47:32.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.247+0000 7fa97abc2980 20 add_watcher() i=4 2024-05-09T09:47:32.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.247+0000 7fa97abc2980 20 add_watcher() i=5 2024-05-09T09:47:32.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.247+0000 7fa97abc2980 20 add_watcher() i=6 2024-05-09T09:47:32.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.251+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94687402205552] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96811b070 con 0x561e20f85960 2024-05-09T09:47:32.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.251+0000 7fa97abc2980 20 add_watcher() i=7 2024-05-09T09:47:32.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.251+0000 7fa97abc2980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:32.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.251+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e20f97fb0 con 0x561e20f80f70 2024-05-09T09:47:32.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.251+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa970036040 con 0x561e20f80f70 2024-05-09T09:47:32.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.251+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94687402228160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20f94dd0 con 0x561e20f80f70 2024-05-09T09:47:32.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.251+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94687402228160] v30'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa970036040 con 0x561e20f80f70 2024-05-09T09:47:32.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.251+0000 7fa82d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:32.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.251+0000 7fa97abc2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:32.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.251+0000 7fa97abc2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:32.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.251+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20f972a0 con 0x561e20f80f70 2024-05-09T09:47:32.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.255+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa970036040 con 0x561e20f80f70 2024-05-09T09:47:32.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.255+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa10c0 con 0x561e20f85960 2024-05-09T09:47:32.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.259+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa96811b070 con 0x561e20f85960 2024-05-09T09:47:32.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.259+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa10c0 con 0x561e20f8a2b0 2024-05-09T09:47:32.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.259+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa960041040 con 0x561e20f8a2b0 2024-05-09T09:47:32.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.259+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa1b20 con 0x561e20f80f70 2024-05-09T09:47:32.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.259+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'65 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa970036040 con 0x561e20f80f70 2024-05-09T09:47:32.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.259+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa0770 con 0x7fa960013040 2024-05-09T09:47:32.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.259+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'44 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa970036040 con 0x7fa960013040 2024-05-09T09:47:32.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.259+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa0770 con 0x561e20f8a2b0 2024-05-09T09:47:32.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.263+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa960041040 con 0x561e20f8a2b0 2024-05-09T09:47:32.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.263+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa2850 con 0x561e20f80f70 2024-05-09T09:47:32.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.263+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa970036040 con 0x561e20f80f70 2024-05-09T09:47:32.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.263+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa2850 con 0x561e20f85960 2024-05-09T09:47:32.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.267+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa96811b070 con 0x561e20f85960 2024-05-09T09:47:32.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.267+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa2850 con 0x7fa960013040 2024-05-09T09:47:32.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.267+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa970036040 con 0x7fa960013040 2024-05-09T09:47:32.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.267+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa2980 con 0x561e20f8a2b0 2024-05-09T09:47:32.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.271+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa960041040 con 0x561e20f8a2b0 2024-05-09T09:47:32.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.271+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa2e00 con 0x7fa960013040 2024-05-09T09:47:32.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.271+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'45 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa970036040 con 0x7fa960013040 2024-05-09T09:47:32.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.271+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa2e00 con 0x561e20f85960 2024-05-09T09:47:32.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.275+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa96811b070 con 0x561e20f85960 2024-05-09T09:47:32.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.275+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa2e00 con 0x7fa960013040 2024-05-09T09:47:32.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.275+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa970036040 con 0x7fa960013040 2024-05-09T09:47:32.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.275+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa2e00 con 0x561e20f85960 2024-05-09T09:47:32.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.279+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'35 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa96811b070 con 0x561e20f85960 2024-05-09T09:47:32.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.279+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa2e00 con 0x561e20f80f70 2024-05-09T09:47:32.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.279+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'66 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa970036040 con 0x561e20f80f70 2024-05-09T09:47:32.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.279+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa2e00 con 0x561e20f8a2b0 2024-05-09T09:47:32.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.283+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'38 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa960041040 con 0x561e20f8a2b0 2024-05-09T09:47:32.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.283+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa2e00 con 0x7fa960013040 2024-05-09T09:47:32.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.283+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'46 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa970036040 con 0x7fa960013040 2024-05-09T09:47:32.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.283+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa2e00 con 0x561e20f8a2b0 2024-05-09T09:47:32.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.283+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa960041040 con 0x561e20f8a2b0 2024-05-09T09:47:32.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.283+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa2fd0 con 0x561e20f80f70 2024-05-09T09:47:32.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.287+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa970036040 con 0x561e20f80f70 2024-05-09T09:47:32.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.287+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa3450 con 0x561e20f80f70 2024-05-09T09:47:32.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.287+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'67 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa970036040 con 0x561e20f80f70 2024-05-09T09:47:32.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.287+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa3450 con 0x561e20f8a2b0 2024-05-09T09:47:32.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.291+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'39 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa960041040 con 0x561e20f8a2b0 2024-05-09T09:47:32.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.291+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa3450 con 0x7fa960013040 2024-05-09T09:47:32.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.291+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa970036040 con 0x7fa960013040 2024-05-09T09:47:32.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.291+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa3450 con 0x561e20f8a2b0 2024-05-09T09:47:32.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.295+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa960041040 con 0x561e20f8a2b0 2024-05-09T09:47:32.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.295+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa3450 con 0x561e20f8a2b0 2024-05-09T09:47:32.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.295+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa960041040 con 0x561e20f8a2b0 2024-05-09T09:47:32.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.295+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa3450 con 0x561e20f8a2b0 2024-05-09T09:47:32.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.299+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa960041040 con 0x561e20f8a2b0 2024-05-09T09:47:32.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.299+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa3450 con 0x561e20f8a2b0 2024-05-09T09:47:32.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.299+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'30 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa960041040 con 0x561e20f8a2b0 2024-05-09T09:47:32.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.299+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa3450 con 0x561e20f85960 2024-05-09T09:47:32.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.303+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa96811b070 con 0x561e20f85960 2024-05-09T09:47:32.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.303+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa3450 con 0x561e20f8a2b0 2024-05-09T09:47:32.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.303+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa960041040 con 0x561e20f8a2b0 2024-05-09T09:47:32.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.303+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa3450 con 0x561e20f85960 2024-05-09T09:47:32.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.307+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'30 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa96811b070 con 0x561e20f85960 2024-05-09T09:47:32.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.307+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa3450 con 0x561e20f8a2b0 2024-05-09T09:47:32.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.307+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'40 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa960041040 con 0x561e20f8a2b0 2024-05-09T09:47:32.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.307+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa3450 con 0x561e20f85960 2024-05-09T09:47:32.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.311+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'36 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa96811b070 con 0x561e20f85960 2024-05-09T09:47:32.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.311+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20fa3450 con 0x7fa960013040 2024-05-09T09:47:32.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.315+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa970036040 con 0x7fa960013040 2024-05-09T09:47:32.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.315+0000 7fa7a7fff640 20 reqs_thread_entry: start 2024-05-09T09:47:32.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.315+0000 7fa97abc2980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:32.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.315+0000 7fa7a5ffb640 20 reqs_thread_entry: start 2024-05-09T09:47:32.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.315+0000 7fa97abc2980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-09T09:47:32.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.315+0000 7fa97abc2980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.315+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e20f9f510 con 0x561e20f85960 2024-05-09T09:47:32.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.315+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fa96811b070 con 0x561e20f85960 2024-05-09T09:47:32.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.315+0000 7fa97abc2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:32.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.315+0000 7fa97abc2980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-05-09T09:47:32.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.315+0000 7fa97abc2980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-09T09:47:32.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.315+0000 7fa97abc2980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-05-09T09:47:32.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.315+0000 7fa97abc2980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.315+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e20f9f020 con 0x561e20f80f70 2024-05-09T09:47:32.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.315+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(95 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7fa970036040 con 0x561e20f80f70 2024-05-09T09:47:32.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.315+0000 7fa97abc2980 20 rados_obj.operate() r=0 bl.length=7 2024-05-09T09:47:32.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.315+0000 7fa97abc2980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-05-09T09:47:32.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.315+0000 7fa97abc2980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-05-09T09:47:32.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.315+0000 7fa97abc2980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-09T09:47:32.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.315+0000 7fa97abc2980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.315+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e20f9f410 con 0x561e20f80f70 2024-05-09T09:47:32.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.315+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(96 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa970036040 con 0x561e20f80f70 2024-05-09T09:47:32.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.315+0000 7fa97abc2980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:47:32.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.315+0000 7fa97abc2980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-09T09:47:32.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.315+0000 7fa97abc2980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:32.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.315+0000 7fa97abc2980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:32.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.315+0000 7fa97abc2980 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-05-09T09:47:32.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.315+0000 7fa97abc2980 20 get_user_info_from_index found 0 xattrs 2024-05-09T09:47:32.316 INFO:teuthology.orchestra.run.smithi157.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-05-09T09:47:32.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.319+0000 7fa82d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:32.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.319+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94687402228160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20f988b0 con 0x561e20f80f70 2024-05-09T09:47:32.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.319+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(97 data_loggenerations_metadata [watch unwatch cookie 94687402228160] v30'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa970036040 con 0x561e20f80f70 2024-05-09T09:47:32.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.319+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:98 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94687402191440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20f979c0 con 0x7fa960013040 2024-05-09T09:47:32.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.319+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(98 notify.0 [watch unwatch cookie 94687402191440] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa970036040 con 0x7fa960013040 2024-05-09T09:47:32.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.319+0000 7fa97abc2980 20 remove_watcher() i=0 2024-05-09T09:47:32.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.319+0000 7fa97abc2980 2 removed watcher, disabling cache 2024-05-09T09:47:32.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.319+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:99 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94687402194784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20f8ea50 con 0x561e20f80f70 2024-05-09T09:47:32.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.323+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(99 notify.1 [watch unwatch cookie 94687402194784] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa970036040 con 0x561e20f80f70 2024-05-09T09:47:32.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.323+0000 7fa97abc2980 20 remove_watcher() i=1 2024-05-09T09:47:32.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.323+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:100 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94687402188928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20f8ea50 con 0x561e20f8a2b0 2024-05-09T09:47:32.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.323+0000 7fa977edc640 1 -- 172.21.15.157:0/2794486361 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(100 notify.2 [watch unwatch cookie 94687402188928] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa960041040 con 0x561e20f8a2b0 2024-05-09T09:47:32.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.323+0000 7fa97abc2980 20 remove_watcher() i=2 2024-05-09T09:47:32.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.323+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:101 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94687402200784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20f8ea50 con 0x7fa960013040 2024-05-09T09:47:32.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.327+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(101 notify.3 [watch unwatch cookie 94687402200784] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa970036040 con 0x7fa960013040 2024-05-09T09:47:32.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.327+0000 7fa97abc2980 20 remove_watcher() i=3 2024-05-09T09:47:32.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.327+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94687402199584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20f8e080 con 0x561e20f80f70 2024-05-09T09:47:32.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.327+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(102 notify.4 [watch unwatch cookie 94687402199584] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa970036040 con 0x561e20f80f70 2024-05-09T09:47:32.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.327+0000 7fa97abc2980 20 remove_watcher() i=4 2024-05-09T09:47:32.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.327+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94687402207824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20f8e080 con 0x561e20f85960 2024-05-09T09:47:32.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.331+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(103 notify.5 [watch unwatch cookie 94687402207824] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96811b070 con 0x561e20f85960 2024-05-09T09:47:32.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.331+0000 7fa97abc2980 20 remove_watcher() i=5 2024-05-09T09:47:32.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.331+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94687402212160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20f92a50 con 0x561e20f85960 2024-05-09T09:47:32.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.331+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(104 notify.6 [watch unwatch cookie 94687402212160] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96811b070 con 0x561e20f85960 2024-05-09T09:47:32.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.331+0000 7fa97abc2980 20 remove_watcher() i=6 2024-05-09T09:47:32.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.331+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:105 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94687402205552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e20f8e080 con 0x561e20f85960 2024-05-09T09:47:32.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa9786dd640 1 -- 172.21.15.157:0/2794486361 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(105 notify.7 [watch unwatch cookie 94687402205552] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96811b070 con 0x561e20f85960 2024-05-09T09:47:32.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 20 remove_watcher() i=7 2024-05-09T09:47:32.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561e20f85960 msgr2=0x561e20f87d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 --2- 172.21.15.157:0/2794486361 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561e20f85960 0x561e20f87d50 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561e20f80f70 msgr2=0x561e20f83430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 --2- 172.21.15.157:0/2794486361 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561e20f80f70 0x561e20f83430 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa960013040 msgr2=0x7fa9600243c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 --2- 172.21.15.157:0/2794486361 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa960013040 0x7fa9600243c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561e20f8a2b0 msgr2=0x561e20f8c6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 --2- 172.21.15.157:0/2794486361 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561e20f8a2b0 0x561e20f8c6c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa840034bb0 msgr2=0x7fa840037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 --2- 172.21.15.157:0/2794486361 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa840034bb0 0x7fa840037070 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x561e20f3aa50 tx=0x7fa960012000 comp rx=0 tx=0).stop 2024-05-09T09:47:32.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20f6d3c0 msgr2=0x561e20f745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 --2- 172.21.15.157:0/2794486361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20f6d3c0 0x561e20f745e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa9680bf020 tx=0x7fa9680c5ac0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa978ede640 1 -- 172.21.15.157:0/2794486361 reap_dead start 2024-05-09T09:47:32.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 shutdown_connections 2024-05-09T09:47:32.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 --2- 172.21.15.157:0/2794486361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20f6d3c0 0x561e20f745e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 >> 172.21.15.157:0/2794486361 conn(0x561e20f69740 msgr2=0x561e20f66da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:32.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 shutdown_connections 2024-05-09T09:47:32.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 -- 172.21.15.157:0/2794486361 wait complete. 2024-05-09T09:47:32.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 -- 172.21.15.157:0/2332428167 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa850034bb0 msgr2=0x7fa850037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 --2- 172.21.15.157:0/2332428167 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa850034bb0 0x7fa850037070 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x561e20f321f0 tx=0x7fa960011000 comp rx=0 tx=0).stop 2024-05-09T09:47:32.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 -- 172.21.15.157:0/2332428167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20f60530 msgr2=0x561e20f60950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 --2- 172.21.15.157:0/2332428167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20f60530 0x561e20f60950 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa9680bdeb0 tx=0x7fa9680bdee0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 -- 172.21.15.157:0/2332428167 shutdown_connections 2024-05-09T09:47:32.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 --2- 172.21.15.157:0/2332428167 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa850034bb0 0x7fa850037070 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 --2- 172.21.15.157:0/2332428167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20f60530 0x561e20f60950 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 -- 172.21.15.157:0/2332428167 >> 172.21.15.157:0/2332428167 conn(0x561e20f55300 msgr2=0x561e20f55e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:32.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 -- 172.21.15.157:0/2332428167 shutdown_connections 2024-05-09T09:47:32.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 -- 172.21.15.157:0/2332428167 wait complete. 2024-05-09T09:47:32.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 -- 172.21.15.157:0/2266779050 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561e20f33c40 msgr2=0x561e20f36030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 --2- 172.21.15.157:0/2266779050 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561e20f33c40 0x561e20f36030 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 -- 172.21.15.157:0/2266779050 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561e20f2ee50 msgr2=0x561e20f31280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 --2- 172.21.15.157:0/2266779050 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561e20f2ee50 0x561e20f31280 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 -- 172.21.15.157:0/2266779050 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561e20f37b60 msgr2=0x561e20f39f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 --2- 172.21.15.157:0/2266779050 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561e20f37b60 0x561e20f39f50 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 -- 172.21.15.157:0/2266779050 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa860034bb0 msgr2=0x7fa860037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 --2- 172.21.15.157:0/2266779050 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa860034bb0 0x7fa860037070 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa960001570 tx=0x7fa9600066d0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 -- 172.21.15.157:0/2266779050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20e38ad0 msgr2=0x561e20f29f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 --2- 172.21.15.157:0/2266779050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561e20e38ad0 0x561e20f29f20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa968018f70 tx=0x7fa9680180e0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa978ede640 1 -- 172.21.15.157:0/2266779050 reap_dead start 2024-05-09T09:47:32.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 -- 172.21.15.157:0/2266779050 shutdown_connections 2024-05-09T09:47:32.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 -- 172.21.15.157:0/2266779050 >> 172.21.15.157:0/2266779050 conn(0x561e20e30070 msgr2=0x561e20f1b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:32.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 -- 172.21.15.157:0/2266779050 shutdown_connections 2024-05-09T09:47:32.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.335+0000 7fa97abc2980 1 -- 172.21.15.157:0/2266779050 wait complete. 2024-05-09T09:47:32.346 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-05-09T09:47:32.347 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-09T09:47:32.347 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-09T09:47:32.347 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-09T09:47:32.425 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:32.425 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:32.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.427+0000 7fb6a4681980 1 Processor -- start 2024-05-09T09:47:32.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.427+0000 7fb6a4681980 1 -- start start 2024-05-09T09:47:32.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.427+0000 7fb6a4681980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5595d3a43cd0 0x5595d3a460c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.427+0000 7fb6a4681980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5595d38f5440 con 0x5595d39b3ab0 2024-05-09T09:47:32.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.427+0000 7fb6a4681980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5595d38e05f0 con 0x5595d3a43cd0 2024-05-09T09:47:32.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.427+0000 7fb6a199b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5595d3a43cd0 0x5595d3a460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.427+0000 7fb6a219c640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x5595d39b3ab0 0x5595d3a425b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:33594/0 (socket says 172.21.15.157:33594) 2024-05-09T09:47:32.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.427+0000 7fb6a219c640 1 -- 172.21.15.157:0/3450834695 learned_addr learned my addr 172.21.15.157:0/3450834695 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:47:32.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.427+0000 7fb6a199b640 1 -- 172.21.15.157:0/3450834695 >> v1:172.21.15.110:6789/0 conn(0x5595d39b3ab0 legacy=0x5595d3a425b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.427+0000 7fb6a199b640 1 -- 172.21.15.157:0/3450834695 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595d38eb990 con 0x5595d3a43cd0 2024-05-09T09:47:32.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.431+0000 7fb6a199b640 1 --2- 172.21.15.157:0/3450834695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d3a43cd0 0x5595d3a460c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb69800a480 tx=0x7fb69801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af03d8118ed2459 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.431+0000 7fb6a119a640 1 -- 172.21.15.157:0/3450834695 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6980b0070 con 0x5595d3a43cd0 2024-05-09T09:47:32.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.431+0000 7fb6a119a640 1 -- 172.21.15.157:0/3450834695 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6980ab540 con 0x5595d3a43cd0 2024-05-09T09:47:32.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.431+0000 7fb6a119a640 1 -- 172.21.15.157:0/3450834695 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6980ab840 con 0x5595d3a43cd0 2024-05-09T09:47:32.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.431+0000 7fb6a4681980 1 -- 172.21.15.157:0/3450834695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d3a43cd0 msgr2=0x5595d3a460c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.431+0000 7fb6a4681980 1 --2- 172.21.15.157:0/3450834695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d3a43cd0 0x5595d3a460c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb69800a480 tx=0x7fb69801b280 comp rx=0 tx=0).stop 2024-05-09T09:47:32.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.431+0000 7fb6a4681980 1 -- 172.21.15.157:0/3450834695 shutdown_connections 2024-05-09T09:47:32.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.431+0000 7fb6a4681980 1 --2- 172.21.15.157:0/3450834695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d3a43cd0 0x5595d3a460c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.431+0000 7fb6a4681980 1 -- 172.21.15.157:0/3450834695 >> 172.21.15.157:0/3450834695 conn(0x5595d3a3a0d0 msgr2=0x5595d3a3c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:32.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.431+0000 7fb6a4681980 1 -- 172.21.15.157:0/3450834695 shutdown_connections 2024-05-09T09:47:32.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.431+0000 7fb6a4681980 1 -- 172.21.15.157:0/3450834695 wait complete. 2024-05-09T09:47:32.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.447+0000 7fb6a4681980 1 Processor -- start 2024-05-09T09:47:32.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.447+0000 7fb6a4681980 1 -- start start 2024-05-09T09:47:32.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.447+0000 7fb6a4681980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d39b3ab0 0x5595d3b2abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.447+0000 7fb6a4681980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5595d3942fe0 con 0x5595d39b3ab0 2024-05-09T09:47:32.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.447+0000 7fb6a219c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d39b3ab0 0x5595d3b2abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.447+0000 7fb6a219c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d39b3ab0 0x5595d3b2abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53930/0 (socket says 172.21.15.157:53930) 2024-05-09T09:47:32.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.447+0000 7fb6a219c640 1 -- 172.21.15.157:0/774760460 learned_addr learned my addr 172.21.15.157:0/774760460 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:32.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.447+0000 7fb6a219c640 1 -- 172.21.15.157:0/774760460 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595d38c7ae0 con 0x5595d39b3ab0 2024-05-09T09:47:32.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.451+0000 7fb6a219c640 1 --2- 172.21.15.157:0/774760460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d39b3ab0 0x5595d3b2abc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb69c001e20 tx=0x7fb69c00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb352ef9f46ce332 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.451+0000 7fb590608640 1 -- 172.21.15.157:0/774760460 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb69c012020 con 0x5595d39b3ab0 2024-05-09T09:47:32.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.451+0000 7fb590608640 1 -- 172.21.15.157:0/774760460 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb69c00e7c0 con 0x5595d39b3ab0 2024-05-09T09:47:32.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.451+0000 7fb590608640 1 -- 172.21.15.157:0/774760460 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb69c00eb00 con 0x5595d39b3ab0 2024-05-09T09:47:32.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.451+0000 7fb6a4681980 1 -- 172.21.15.157:0/774760460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d39b3ab0 msgr2=0x5595d3b2abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.451+0000 7fb6a4681980 1 --2- 172.21.15.157:0/774760460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d39b3ab0 0x5595d3b2abc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb69c001e20 tx=0x7fb69c00b790 comp rx=0 tx=0).stop 2024-05-09T09:47:32.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.451+0000 7fb6a4681980 1 -- 172.21.15.157:0/774760460 shutdown_connections 2024-05-09T09:47:32.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.451+0000 7fb6a4681980 1 --2- 172.21.15.157:0/774760460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d39b3ab0 0x5595d3b2abc0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.451+0000 7fb6a4681980 1 -- 172.21.15.157:0/774760460 >> 172.21.15.157:0/774760460 conn(0x5595d3a3a0d0 msgr2=0x5595d3b26750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:32.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.451+0000 7fb6a4681980 1 -- 172.21.15.157:0/774760460 shutdown_connections 2024-05-09T09:47:32.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.451+0000 7fb6a4681980 1 -- 172.21.15.157:0/774760460 wait complete. 2024-05-09T09:47:32.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.451+0000 7fb6a4681980 1 Processor -- start 2024-05-09T09:47:32.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.451+0000 7fb6a4681980 1 -- start start 2024-05-09T09:47:32.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.451+0000 7fb6a4681980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d39b3ab0 0x5595d3b31d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.451+0000 7fb6a4681980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5595d3a471a0 con 0x5595d39b3ab0 2024-05-09T09:47:32.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.451+0000 7fb6a219c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d39b3ab0 0x5595d3b31d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.451+0000 7fb6a219c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d39b3ab0 0x5595d3b31d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53940/0 (socket says 172.21.15.157:53940) 2024-05-09T09:47:32.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.451+0000 7fb6a219c640 1 -- 172.21.15.157:0/1531230796 learned_addr learned my addr 172.21.15.157:0/1531230796 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:32.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.451+0000 7fb6a219c640 1 -- 172.21.15.157:0/1531230796 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595d3b322d0 con 0x5595d39b3ab0 2024-05-09T09:47:32.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.451+0000 7fb6a219c640 1 --2- 172.21.15.157:0/1531230796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d39b3ab0 0x5595d3b31d90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb69c001e20 tx=0x7fb69c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.451+0000 7fb58ee05640 1 -- 172.21.15.157:0/1531230796 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb69c012030 con 0x5595d39b3ab0 2024-05-09T09:47:32.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.451+0000 7fb58ee05640 1 -- 172.21.15.157:0/1531230796 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb69c001480 con 0x5595d39b3ab0 2024-05-09T09:47:32.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.451+0000 7fb58ee05640 1 -- 172.21.15.157:0/1531230796 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb69c01a910 con 0x5595d39b3ab0 2024-05-09T09:47:32.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.451+0000 7fb6a4681980 1 -- 172.21.15.157:0/1531230796 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595d3b32560 con 0x5595d39b3ab0 2024-05-09T09:47:32.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.455+0000 7fb6a4681980 1 -- 172.21.15.157:0/1531230796 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595d3b35240 con 0x5595d39b3ab0 2024-05-09T09:47:32.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.455+0000 7fb58ee05640 1 -- 172.21.15.157:0/1531230796 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fb69c015020 con 0x5595d39b3ab0 2024-05-09T09:47:32.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.455+0000 7fb58ee05640 1 --2- 172.21.15.157:0/1531230796 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb588034bb0 0x7fb588037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.455+0000 7fb58ee05640 1 -- 172.21.15.157:0/1531230796 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fb69c020030 con 0x5595d39b3ab0 2024-05-09T09:47:32.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.455+0000 7fb6a199b640 1 --2- 172.21.15.157:0/1531230796 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb588034bb0 0x7fb588037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.455+0000 7fb6a4681980 1 --2- 172.21.15.157:0/1531230796 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5595d3a43cd0 0x5595d3b38d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.455+0000 7fb6a4681980 1 -- 172.21.15.157:0/1531230796 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b393d0 con 0x5595d3a43cd0 2024-05-09T09:47:32.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.455+0000 7fb6a299d640 1 --2- 172.21.15.157:0/1531230796 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5595d3a43cd0 0x5595d3b38d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.455+0000 7fb6a199b640 1 --2- 172.21.15.157:0/1531230796 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb588034bb0 0x7fb588037070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb6980ad000 tx=0x7fb6980a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.455+0000 7fb6a299d640 1 --2- 172.21.15.157:0/1531230796 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5595d3a43cd0 0x5595d3b38d60 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.455+0000 7fb6a299d640 1 -- 172.21.15.157:0/1531230796 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3a43cd0 2024-05-09T09:47:32.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.455+0000 7fb6a4681980 1 -- 172.21.15.157:0/1531230796 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b36460 con 0x5595d3a43cd0 2024-05-09T09:47:32.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.455+0000 7fb6a299d640 1 -- 172.21.15.157:0/1531230796 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3a43cd0 2024-05-09T09:47:32.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.455+0000 7fb6a4681980 1 --2- 172.21.15.157:0/1531230796 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5595d3b3b720 0x5595d3b3db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.455+0000 7fb6a4681980 1 -- 172.21.15.157:0/1531230796 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b3e200 con 0x5595d3b3b720 2024-05-09T09:47:32.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.455+0000 7fb6a219c640 1 --2- 172.21.15.157:0/1531230796 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5595d3b3b720 0x5595d3b3db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.459+0000 7fb6a219c640 1 --2- 172.21.15.157:0/1531230796 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5595d3b3b720 0x5595d3b3db10 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.459+0000 7fb6a219c640 1 -- 172.21.15.157:0/1531230796 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb69c008030 con 0x5595d3b3b720 2024-05-09T09:47:32.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.459+0000 7fb6a4681980 1 -- 172.21.15.157:0/1531230796 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b3a590 con 0x5595d3a43cd0 2024-05-09T09:47:32.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.459+0000 7fb6a299d640 1 -- 172.21.15.157:0/1531230796 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3a43cd0 2024-05-09T09:47:32.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.459+0000 7fb6a4681980 1 --2- 172.21.15.157:0/1531230796 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5595d3b3f660 0x5595d3b41a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.459+0000 7fb6a4681980 1 -- 172.21.15.157:0/1531230796 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b42150 con 0x5595d3b3f660 2024-05-09T09:47:32.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.459+0000 7fb6a199b640 1 --2- 172.21.15.157:0/1531230796 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5595d3b3f660 0x5595d3b41a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.459+0000 7fb6a199b640 1 --2- 172.21.15.157:0/1531230796 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5595d3b3f660 0x5595d3b41a50 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.459+0000 7fb6a199b640 1 -- 172.21.15.157:0/1531230796 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb6980b3040 con 0x5595d3b3f660 2024-05-09T09:47:32.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.463+0000 7fb6a4681980 1 Processor -- start 2024-05-09T09:47:32.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.463+0000 7fb6a4681980 1 -- start start 2024-05-09T09:47:32.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.463+0000 7fb6a4681980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d3b67fd0 0x5595d3b683f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.463+0000 7fb6a4681980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5595d3947020 con 0x5595d3b67fd0 2024-05-09T09:47:32.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.463+0000 7fb6a219c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d3b67fd0 0x5595d3b683f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.463+0000 7fb6a219c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d3b67fd0 0x5595d3b683f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53950/0 (socket says 172.21.15.157:53950) 2024-05-09T09:47:32.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.463+0000 7fb6a219c640 1 -- 172.21.15.157:0/2980841932 learned_addr learned my addr 172.21.15.157:0/2980841932 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:32.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.463+0000 7fb6a219c640 1 -- 172.21.15.157:0/2980841932 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595d3b68930 con 0x5595d3b67fd0 2024-05-09T09:47:32.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.463+0000 7fb6a219c640 1 --2- 172.21.15.157:0/2980841932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d3b67fd0 0x5595d3b683f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb69c00efb0 tx=0x7fb69c00db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.467+0000 7fb586ba2640 1 -- 172.21.15.157:0/2980841932 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb69c00d510 con 0x5595d3b67fd0 2024-05-09T09:47:32.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.467+0000 7fb6a4681980 1 -- 172.21.15.157:0/2980841932 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595d3b693c0 con 0x5595d3b67fd0 2024-05-09T09:47:32.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.467+0000 7fb586ba2640 1 -- 172.21.15.157:0/2980841932 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb69c01ac90 con 0x5595d3b67fd0 2024-05-09T09:47:32.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.467+0000 7fb586ba2640 1 -- 172.21.15.157:0/2980841932 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb69c017c50 con 0x5595d3b67fd0 2024-05-09T09:47:32.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.467+0000 7fb6a4681980 1 -- 172.21.15.157:0/2980841932 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595d3b698a0 con 0x5595d3b67fd0 2024-05-09T09:47:32.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.467+0000 7fb586ba2640 1 -- 172.21.15.157:0/2980841932 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fb69c009070 con 0x5595d3b67fd0 2024-05-09T09:47:32.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.467+0000 7fb586ba2640 1 --2- 172.21.15.157:0/2980841932 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb57c034bb0 0x7fb57c037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.467+0000 7fb586ba2640 1 -- 172.21.15.157:0/2980841932 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fb69c039070 con 0x5595d3b67fd0 2024-05-09T09:47:32.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.467+0000 7fb6a199b640 1 --2- 172.21.15.157:0/2980841932 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb57c034bb0 0x7fb57c037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.467+0000 7fb6a4681980 1 Processor -- start 2024-05-09T09:47:32.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.467+0000 7fb6a4681980 1 -- start start 2024-05-09T09:47:32.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.467+0000 7fb6a199b640 1 --2- 172.21.15.157:0/2980841932 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb57c034bb0 0x7fb57c037070 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x5595d3b398a0 tx=0x7fb698005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.467+0000 7fb6a4681980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d3a3fb70 0x5595d3a3ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.467+0000 7fb6a4681980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5595d3b2b310 con 0x5595d3a3fb70 2024-05-09T09:47:32.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.467+0000 7fb6a219c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d3a3fb70 0x5595d3a3ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.467+0000 7fb6a219c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d3a3fb70 0x5595d3a3ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53958/0 (socket says 172.21.15.157:53958) 2024-05-09T09:47:32.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.467+0000 7fb6a219c640 1 -- 172.21.15.157:0/2377791595 learned_addr learned my addr 172.21.15.157:0/2377791595 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:32.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.467+0000 7fb6a219c640 1 -- 172.21.15.157:0/2377791595 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595d3a3e390 con 0x5595d3a3fb70 2024-05-09T09:47:32.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.467+0000 7fb6a219c640 1 --2- 172.21.15.157:0/2377791595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d3a3fb70 0x5595d3a3ff90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb69c018740 tx=0x7fb69c030f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac21d81d139e0ee server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.467+0000 7fb584b9e640 1 -- 172.21.15.157:0/2377791595 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb69c04a950 con 0x5595d3a3fb70 2024-05-09T09:47:32.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.467+0000 7fb584b9e640 1 -- 172.21.15.157:0/2377791595 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb69c03dd90 con 0x5595d3a3fb70 2024-05-09T09:47:32.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.467+0000 7fb584b9e640 1 -- 172.21.15.157:0/2377791595 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb69c04a200 con 0x5595d3a3fb70 2024-05-09T09:47:32.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.471+0000 7fb6a4681980 1 -- 172.21.15.157:0/2377791595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d3a3fb70 msgr2=0x5595d3a3ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.471+0000 7fb6a4681980 1 --2- 172.21.15.157:0/2377791595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d3a3fb70 0x5595d3a3ff90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb69c018740 tx=0x7fb69c030f20 comp rx=0 tx=0).stop 2024-05-09T09:47:32.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.471+0000 7fb6a4681980 1 -- 172.21.15.157:0/2377791595 shutdown_connections 2024-05-09T09:47:32.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.471+0000 7fb6a4681980 1 --2- 172.21.15.157:0/2377791595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d3a3fb70 0x5595d3a3ff90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.471+0000 7fb6a4681980 1 -- 172.21.15.157:0/2377791595 >> 172.21.15.157:0/2377791595 conn(0x5595d3b71320 msgr2=0x5595d3b6f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:32.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.471+0000 7fb6a4681980 1 -- 172.21.15.157:0/2377791595 shutdown_connections 2024-05-09T09:47:32.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.471+0000 7fb6a4681980 1 -- 172.21.15.157:0/2377791595 wait complete. 2024-05-09T09:47:32.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.471+0000 7fb6a4681980 1 Processor -- start 2024-05-09T09:47:32.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.471+0000 7fb6a4681980 1 -- start start 2024-05-09T09:47:32.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.471+0000 7fb6a4681980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d3a3fb70 0x5595d3b7e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.471+0000 7fb6a4681980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5595d3a3e740 con 0x5595d3a3fb70 2024-05-09T09:47:32.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.471+0000 7fb6a219c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d3a3fb70 0x5595d3b7e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.471+0000 7fb6a219c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d3a3fb70 0x5595d3b7e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53968/0 (socket says 172.21.15.157:53968) 2024-05-09T09:47:32.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.471+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 learned_addr learned my addr 172.21.15.157:0/3691492234 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:32.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.471+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595d3b7ea80 con 0x5595d3a3fb70 2024-05-09T09:47:32.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.471+0000 7fb6a219c640 1 --2- 172.21.15.157:0/3691492234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d3a3fb70 0x5595d3b7e540 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb69c018740 tx=0x7fb69c033450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.471+0000 7fb572ffd640 1 -- 172.21.15.157:0/3691492234 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb69c06e070 con 0x5595d3a3fb70 2024-05-09T09:47:32.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.471+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595d3b7ea80 con 0x5595d3a3fb70 2024-05-09T09:47:32.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.471+0000 7fb572ffd640 1 -- 172.21.15.157:0/3691492234 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb69c063070 con 0x5595d3a3fb70 2024-05-09T09:47:32.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.471+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595d3b7ea80 con 0x5595d3a3fb70 2024-05-09T09:47:32.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.471+0000 7fb572ffd640 1 -- 172.21.15.157:0/3691492234 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb69c047300 con 0x5595d3a3fb70 2024-05-09T09:47:32.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb572ffd640 1 -- 172.21.15.157:0/3691492234 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fb69c071070 con 0x5595d3a3fb70 2024-05-09T09:47:32.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb6a4681980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb572ffd640 1 --2- 172.21.15.157:0/3691492234 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb56c034bb0 0x7fb56c037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb572ffd640 1 -- 172.21.15.157:0/3691492234 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fb69c005050 con 0x5595d3a3fb70 2024-05-09T09:47:32.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb6a199b640 1 --2- 172.21.15.157:0/3691492234 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb56c034bb0 0x7fb56c037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb6a4681980 1 --2- 172.21.15.157:0/3691492234 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5595d3b8b0a0 0x5595d3b8d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b8dcb0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb6a299d640 1 --2- 172.21.15.157:0/3691492234 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5595d3b8b0a0 0x5595d3b8d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb6a199b640 1 --2- 172.21.15.157:0/3691492234 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb56c034bb0 0x7fb56c037070 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb69801b2c0 tx=0x7fb6980a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb6a299d640 1 --2- 172.21.15.157:0/3691492234 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5595d3b8b0a0 0x5595d3b8d560 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb6a4681980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:32.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb6a4681980 20 realm 2024-05-09T09:47:32.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb6a4681980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b8e0c0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb6a4681980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:32.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb6a4681980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:32.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb6a4681980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b8e960 con 0x5595d3b8b0a0 2024-05-09T09:47:32.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb6a4681980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:32.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb6a4681980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b8ed00 con 0x5595d3b8b0a0 2024-05-09T09:47:32.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb6a4681980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:32.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb6a4681980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb6a4681980 1 --2- 172.21.15.157:0/3691492234 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5595d3b8fa60 0x5595d3b91e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b923d0 con 0x5595d3b8fa60 2024-05-09T09:47:32.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb6a219c640 1 --2- 172.21.15.157:0/3691492234 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5595d3b8fa60 0x5595d3b91e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.475+0000 7fb6a219c640 1 --2- 172.21.15.157:0/3691492234 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5595d3b8fa60 0x5595d3b91e50 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.479+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb69c070030 con 0x5595d3b8fa60 2024-05-09T09:47:32.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.479+0000 7fb6a4681980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:32.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.479+0000 7fb6a4681980 20 searching for the correct realm 2024-05-09T09:47:32.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.479+0000 7fb6a4681980 1 --2- 172.21.15.157:0/3691492234 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5595d3b94300 0x5595d3b967c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.479+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b96e90 con 0x5595d3b94300 2024-05-09T09:47:32.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.479+0000 7fb6a199b640 1 --2- 172.21.15.157:0/3691492234 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5595d3b94300 0x5595d3b967c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.479+0000 7fb6a199b640 1 --2- 172.21.15.157:0/3691492234 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5595d3b94300 0x5595d3b967c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.479+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6980d9070 con 0x5595d3b94300 2024-05-09T09:47:32.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.479+0000 7fb6a199b640 1 --2- 172.21.15.157:0/3691492234 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fb6980ce040 0x7fb6980db410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.479+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b96e90 con 0x7fb6980ce040 2024-05-09T09:47:32.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.479+0000 7fb6a299d640 1 --2- 172.21.15.157:0/3691492234 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fb6980ce040 0x7fb6980db410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.479+0000 7fb6a299d640 1 --2- 172.21.15.157:0/3691492234 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fb6980ce040 0x7fb6980db410 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.479+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb6980ce040 2024-05-09T09:47:32.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.479+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b8ed00 con 0x5595d3b8fa60 2024-05-09T09:47:32.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.479+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb69c070030 con 0x5595d3b8fa60 2024-05-09T09:47:32.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.479+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b8ed00 con 0x5595d3b8b0a0 2024-05-09T09:47:32.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.479+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.479+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b8ed00 con 0x5595d3b8b0a0 2024-05-09T09:47:32.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.479+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.479+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b8ed00 con 0x5595d3b8fa60 2024-05-09T09:47:32.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.483+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb69c070030 con 0x5595d3b8fa60 2024-05-09T09:47:32.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.483+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b8ed00 con 0x5595d3b8fa60 2024-05-09T09:47:32.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.483+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb69c070030 con 0x5595d3b8fa60 2024-05-09T09:47:32.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.483+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b8ed00 con 0x7fb6980ce040 2024-05-09T09:47:32.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.483+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb6980ce040 2024-05-09T09:47:32.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.483+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b8ed00 con 0x5595d3b94300 2024-05-09T09:47:32.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.483+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6980d9070 con 0x5595d3b94300 2024-05-09T09:47:32.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.483+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b8ed00 con 0x5595d3b8b0a0 2024-05-09T09:47:32.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.483+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.483+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b8ed00 con 0x5595d3b8fa60 2024-05-09T09:47:32.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.483+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb69c070030 con 0x5595d3b8fa60 2024-05-09T09:47:32.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.483+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b8ed00 con 0x5595d3b8b0a0 2024-05-09T09:47:32.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.483+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.483+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b8ed00 con 0x7fb6980ce040 2024-05-09T09:47:32.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.483+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb6980ce040 2024-05-09T09:47:32.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.483+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b8ed00 con 0x5595d3b94300 2024-05-09T09:47:32.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.483+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6980d9070 con 0x5595d3b94300 2024-05-09T09:47:32.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.483+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb6980e8040 con 0x5595d3b94300 2024-05-09T09:47:32.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.487+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb6980d9070 con 0x5595d3b94300 2024-05-09T09:47:32.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.487+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb6980e8040 con 0x5595d3b8fa60 2024-05-09T09:47:32.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.487+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb69c070030 con 0x5595d3b8fa60 2024-05-09T09:47:32.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.487+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb6980e8040 con 0x5595d3b94300 2024-05-09T09:47:32.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.487+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6980d9070 con 0x5595d3b94300 2024-05-09T09:47:32.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.487+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb6980e8040 con 0x5595d3b94300 2024-05-09T09:47:32.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.487+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6980d9070 con 0x5595d3b94300 2024-05-09T09:47:32.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.487+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb6980e8040 con 0x5595d3b8b0a0 2024-05-09T09:47:32.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.487+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.487+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb6980e8040 con 0x5595d3b8b0a0 2024-05-09T09:47:32.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.487+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.487+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb6980e8040 con 0x5595d3b8fa60 2024-05-09T09:47:32.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.487+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb69c070030 con 0x5595d3b8fa60 2024-05-09T09:47:32.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.487+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb6980e8040 con 0x5595d3b94300 2024-05-09T09:47:32.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.487+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6980d9070 con 0x5595d3b94300 2024-05-09T09:47:32.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.487+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb6980e8040 con 0x7fb6980ce040 2024-05-09T09:47:32.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.487+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb6980ce040 2024-05-09T09:47:32.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.487+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb6980e8040 con 0x5595d3b8b0a0 2024-05-09T09:47:32.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.487+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.487+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb6980e8040 con 0x5595d3b8fa60 2024-05-09T09:47:32.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.491+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb69c070030 con 0x5595d3b8fa60 2024-05-09T09:47:32.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.491+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb6980e8040 con 0x5595d3b94300 2024-05-09T09:47:32.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.491+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6980d9070 con 0x5595d3b94300 2024-05-09T09:47:32.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.491+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb6980e8040 con 0x5595d3b8fa60 2024-05-09T09:47:32.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.491+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb69c070030 con 0x5595d3b8fa60 2024-05-09T09:47:32.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.491+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb6980e8040 con 0x7fb6980ce040 2024-05-09T09:47:32.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.491+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb6980ce040 2024-05-09T09:47:32.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.491+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb6980e8040 con 0x5595d3b94300 2024-05-09T09:47:32.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.491+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6980d9070 con 0x5595d3b94300 2024-05-09T09:47:32.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.491+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb6980e8040 con 0x5595d3b8fa60 2024-05-09T09:47:32.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.491+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb69c070030 con 0x5595d3b8fa60 2024-05-09T09:47:32.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.491+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb6980e8040 con 0x5595d3b8b0a0 2024-05-09T09:47:32.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.491+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.491+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb6980e8040 con 0x7fb6980ce040 2024-05-09T09:47:32.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.491+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb6980ce040 2024-05-09T09:47:32.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.491+0000 7fb6a4681980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:32.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.491+0000 7fb6a4681980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:32.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.491+0000 7fb6a4681980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:32.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.491+0000 7fb6a4681980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:32.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.491+0000 7fb6a4681980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:32.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.491+0000 7fb6a4681980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:32.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.491+0000 7fb6a4681980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.491+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b92c20 con 0x5595d3b8b0a0 2024-05-09T09:47:32.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.491+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.491+0000 7fb6a4681980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:32.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.491+0000 7fb6a4681980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.491+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b92c20 con 0x5595d3b8b0a0 2024-05-09T09:47:32.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a4681980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:32.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a4681980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b92c20 con 0x5595d3b94300 2024-05-09T09:47:32.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb6980d9070 con 0x5595d3b94300 2024-05-09T09:47:32.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a4681980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:32.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a4681980 20 zone default found 2024-05-09T09:47:32.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a4681980 4 Realm: () 2024-05-09T09:47:32.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a4681980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:32.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a4681980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:32.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a4681980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:32.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a4681980 20 zonegroup default 2024-05-09T09:47:32.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a4681980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b934c0 con 0x5595d3b8fa60 2024-05-09T09:47:32.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb69c070030 con 0x5595d3b8fa60 2024-05-09T09:47:32.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a4681980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:32.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a4681980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b98cf0 con 0x5595d3b94300 2024-05-09T09:47:32.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb6980d9070 con 0x5595d3b94300 2024-05-09T09:47:32.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a4681980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:32.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a4681980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b99090 con 0x5595d3b94300 2024-05-09T09:47:32.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb6980d9070 con 0x5595d3b94300 2024-05-09T09:47:32.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a4681980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:32.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a4681980 20 started sync module instance, tier type = 2024-05-09T09:47:32.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a4681980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:32.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b98190 con 0x7fb6980ce040 2024-05-09T09:47:32.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb6980ce040 2024-05-09T09:47:32.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94101990639328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b98190 con 0x7fb6980ce040 2024-05-09T09:47:32.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.495+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b99a50 con 0x5595d3b8b0a0 2024-05-09T09:47:32.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.499+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94101990639328] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb6980ce040 2024-05-09T09:47:32.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.499+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.499+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94101990643376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b98190 con 0x5595d3b8b0a0 2024-05-09T09:47:32.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.499+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b9a460 con 0x5595d3b94300 2024-05-09T09:47:32.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.499+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94101990643376] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.499+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6980d9070 con 0x5595d3b94300 2024-05-09T09:47:32.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.499+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94101990636768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b98100 con 0x5595d3b94300 2024-05-09T09:47:32.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.499+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b9b160 con 0x7fb6980ce040 2024-05-09T09:47:32.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.503+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb6980ce040 2024-05-09T09:47:32.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.503+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94101990649008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b9b580 con 0x7fb6980ce040 2024-05-09T09:47:32.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.503+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b9c070 con 0x5595d3b8b0a0 2024-05-09T09:47:32.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.503+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94101990636768] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6980d9070 con 0x5595d3b94300 2024-05-09T09:47:32.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.503+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94101990649008] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb6980ce040 2024-05-09T09:47:32.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.503+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.503+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94101990652736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b9b0d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.503+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b9c910 con 0x5595d3b8fa60 2024-05-09T09:47:32.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.507+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94101990652736] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.507+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69c070030 con 0x5595d3b8fa60 2024-05-09T09:47:32.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.507+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94101990655072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b9b0d0 con 0x5595d3b8fa60 2024-05-09T09:47:32.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.507+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b9d160 con 0x5595d3b8fa60 2024-05-09T09:47:32.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.507+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94101990655072] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69c070030 con 0x5595d3b8fa60 2024-05-09T09:47:32.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.507+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69c070030 con 0x5595d3b8fa60 2024-05-09T09:47:32.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.507+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94101990657200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b9d0d0 con 0x5595d3b8fa60 2024-05-09T09:47:32.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.507+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b9e020 con 0x5595d3b8fa60 2024-05-09T09:47:32.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.511+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94101990657200] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69c070030 con 0x5595d3b8fa60 2024-05-09T09:47:32.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.511+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69c070030 con 0x5595d3b8fa60 2024-05-09T09:47:32.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.511+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94101990659328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b9e020 con 0x5595d3b8fa60 2024-05-09T09:47:32.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.511+0000 7fb6a4681980 20 add_watcher() i=0 2024-05-09T09:47:32.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.511+0000 7fb6a4681980 20 add_watcher() i=1 2024-05-09T09:47:32.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.511+0000 7fb6a4681980 20 add_watcher() i=2 2024-05-09T09:47:32.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.511+0000 7fb6a4681980 20 add_watcher() i=3 2024-05-09T09:47:32.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.511+0000 7fb6a4681980 20 add_watcher() i=4 2024-05-09T09:47:32.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.511+0000 7fb6a4681980 20 add_watcher() i=5 2024-05-09T09:47:32.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.511+0000 7fb6a4681980 20 add_watcher() i=6 2024-05-09T09:47:32.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.511+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94101990659328] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69c070030 con 0x5595d3b8fa60 2024-05-09T09:47:32.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.511+0000 7fb6a4681980 20 add_watcher() i=7 2024-05-09T09:47:32.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.511+0000 7fb6a4681980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:32.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.511+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595d3ba1350 con 0x5595d3b8b0a0 2024-05-09T09:47:32.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.515+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.515+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94101990673792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b9e190 con 0x5595d3b8b0a0 2024-05-09T09:47:32.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.515+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94101990673792] v30'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.515+0000 7fb557fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:32.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.515+0000 7fb6a4681980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:32.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.515+0000 7fb6a4681980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:32.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.515+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3ba9a80 con 0x5595d3b8b0a0 2024-05-09T09:47:32.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.515+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.515+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3baa040 con 0x5595d3b8fa60 2024-05-09T09:47:32.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.519+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb69c070030 con 0x5595d3b8fa60 2024-05-09T09:47:32.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.519+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3baa040 con 0x5595d3b94300 2024-05-09T09:47:32.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.519+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb6980d9070 con 0x5595d3b94300 2024-05-09T09:47:32.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.519+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3baa5d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.523+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'70 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.523+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3baab40 con 0x7fb6980ce040 2024-05-09T09:47:32.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.523+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'47 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb6980ce040 2024-05-09T09:47:32.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.523+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3baaff0 con 0x5595d3b94300 2024-05-09T09:47:32.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.523+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb6980d9070 con 0x5595d3b94300 2024-05-09T09:47:32.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.523+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3ba7ac0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.527+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.527+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3ba7a60 con 0x5595d3b8fa60 2024-05-09T09:47:32.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.527+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb69c070030 con 0x5595d3b8fa60 2024-05-09T09:47:32.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.527+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3ba7a60 con 0x7fb6980ce040 2024-05-09T09:47:32.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.531+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb6980ce040 2024-05-09T09:47:32.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.531+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3ba7b70 con 0x5595d3b94300 2024-05-09T09:47:32.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.531+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb6980d9070 con 0x5595d3b94300 2024-05-09T09:47:32.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.531+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3babb50 con 0x7fb6980ce040 2024-05-09T09:47:32.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.535+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'48 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb6980ce040 2024-05-09T09:47:32.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.535+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3babb50 con 0x5595d3b8fa60 2024-05-09T09:47:32.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.535+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb69c070030 con 0x5595d3b8fa60 2024-05-09T09:47:32.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.535+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3babb50 con 0x7fb6980ce040 2024-05-09T09:47:32.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.535+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb6980ce040 2024-05-09T09:47:32.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.535+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3babb50 con 0x5595d3b8fa60 2024-05-09T09:47:32.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.539+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'37 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb69c070030 con 0x5595d3b8fa60 2024-05-09T09:47:32.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.539+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3babb50 con 0x5595d3b8b0a0 2024-05-09T09:47:32.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.539+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'71 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.539+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3babb50 con 0x5595d3b94300 2024-05-09T09:47:32.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.543+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'41 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6980d9070 con 0x5595d3b94300 2024-05-09T09:47:32.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.543+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3babb50 con 0x7fb6980ce040 2024-05-09T09:47:32.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.543+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'49 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb6980ce040 2024-05-09T09:47:32.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.543+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3babb50 con 0x5595d3b94300 2024-05-09T09:47:32.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.543+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6980d9070 con 0x5595d3b94300 2024-05-09T09:47:32.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.543+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3babb50 con 0x5595d3b8b0a0 2024-05-09T09:47:32.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.547+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.547+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3babb50 con 0x5595d3b8b0a0 2024-05-09T09:47:32.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.547+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'72 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.547+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3babb50 con 0x5595d3b94300 2024-05-09T09:47:32.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.551+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'42 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6980d9070 con 0x5595d3b94300 2024-05-09T09:47:32.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.551+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3babb50 con 0x7fb6980ce040 2024-05-09T09:47:32.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.551+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb6980ce040 2024-05-09T09:47:32.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.551+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3babb50 con 0x5595d3b94300 2024-05-09T09:47:32.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.551+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6980d9070 con 0x5595d3b94300 2024-05-09T09:47:32.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.551+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3babb50 con 0x5595d3b94300 2024-05-09T09:47:32.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.555+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6980d9070 con 0x5595d3b94300 2024-05-09T09:47:32.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.555+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3babb50 con 0x5595d3b94300 2024-05-09T09:47:32.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.555+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6980d9070 con 0x5595d3b94300 2024-05-09T09:47:32.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.555+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3babb50 con 0x5595d3b94300 2024-05-09T09:47:32.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.555+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'32 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6980d9070 con 0x5595d3b94300 2024-05-09T09:47:32.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.555+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3babb50 con 0x5595d3b8fa60 2024-05-09T09:47:32.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.559+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb69c070030 con 0x5595d3b8fa60 2024-05-09T09:47:32.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.559+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3babb50 con 0x5595d3b94300 2024-05-09T09:47:32.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.559+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6980d9070 con 0x5595d3b94300 2024-05-09T09:47:32.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.559+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3babb50 con 0x5595d3b8fa60 2024-05-09T09:47:32.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.563+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'32 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb69c070030 con 0x5595d3b8fa60 2024-05-09T09:47:32.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.563+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3babb50 con 0x5595d3b94300 2024-05-09T09:47:32.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.563+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'43 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6980d9070 con 0x5595d3b94300 2024-05-09T09:47:32.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.563+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3babb50 con 0x5595d3b8fa60 2024-05-09T09:47:32.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.567+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'38 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb69c070030 con 0x5595d3b8fa60 2024-05-09T09:47:32.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.567+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3babb50 con 0x7fb6980ce040 2024-05-09T09:47:32.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.567+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb6980ce040 2024-05-09T09:47:32.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.571+0000 7fb556fe5640 20 reqs_thread_entry: start 2024-05-09T09:47:32.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.571+0000 7fb6a4681980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:32.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.571+0000 7fb554fe1640 20 reqs_thread_entry: start 2024-05-09T09:47:32.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.571+0000 7fb6a4681980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.571+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5595d3bc7500 con 0x5595d3b8b0a0 2024-05-09T09:47:32.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.571+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.571+0000 7fb6a4681980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:47:32.570 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-09T09:47:32.044078Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:47:32.044055Z","tags":[],"group_ids":[]} 2024-05-09T09:47:32.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.571+0000 7fb557fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:32.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.571+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94101990673792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3ba6840 con 0x5595d3b8b0a0 2024-05-09T09:47:32.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.571+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94101990673792] v30'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.571+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94101990639328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3ba0d80 con 0x7fb6980ce040 2024-05-09T09:47:32.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.575+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94101990639328] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb6980ce040 2024-05-09T09:47:32.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.575+0000 7fb6a4681980 20 remove_watcher() i=0 2024-05-09T09:47:32.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.575+0000 7fb6a4681980 2 removed watcher, disabling cache 2024-05-09T09:47:32.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.575+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94101990643376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b986e0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.575+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94101990643376] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.575+0000 7fb6a4681980 20 remove_watcher() i=1 2024-05-09T09:47:32.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.575+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94101990636768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b986e0 con 0x5595d3b94300 2024-05-09T09:47:32.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.579+0000 7fb6a199b640 1 -- 172.21.15.157:0/3691492234 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94101990636768] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6980d9070 con 0x5595d3b94300 2024-05-09T09:47:32.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.579+0000 7fb6a4681980 20 remove_watcher() i=2 2024-05-09T09:47:32.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.579+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94101990649008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b97ce0 con 0x7fb6980ce040 2024-05-09T09:47:32.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.579+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94101990649008] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x7fb6980ce040 2024-05-09T09:47:32.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.579+0000 7fb6a4681980 20 remove_watcher() i=3 2024-05-09T09:47:32.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.579+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94101990652736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b986e0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.583+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94101990652736] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69400a4d0 con 0x5595d3b8b0a0 2024-05-09T09:47:32.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.583+0000 7fb6a4681980 20 remove_watcher() i=4 2024-05-09T09:47:32.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.583+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94101990655072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b9acb0 con 0x5595d3b8fa60 2024-05-09T09:47:32.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.583+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94101990655072] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69c070030 con 0x5595d3b8fa60 2024-05-09T09:47:32.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.583+0000 7fb6a4681980 20 remove_watcher() i=5 2024-05-09T09:47:32.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.583+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94101990657200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b97ce0 con 0x5595d3b8fa60 2024-05-09T09:47:32.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.587+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94101990657200] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69c070030 con 0x5595d3b8fa60 2024-05-09T09:47:32.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.587+0000 7fb6a4681980 20 remove_watcher() i=6 2024-05-09T09:47:32.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.587+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94101990659328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5595d3b9bb40 con 0x5595d3b8fa60 2024-05-09T09:47:32.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.587+0000 7fb6a219c640 1 -- 172.21.15.157:0/3691492234 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94101990659328] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb69c070030 con 0x5595d3b8fa60 2024-05-09T09:47:32.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.587+0000 7fb6a4681980 20 remove_watcher() i=7 2024-05-09T09:47:32.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.587+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5595d3b8fa60 msgr2=0x5595d3b91e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.587+0000 7fb6a4681980 1 --2- 172.21.15.157:0/3691492234 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5595d3b8fa60 0x5595d3b91e50 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.587+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5595d3b8b0a0 msgr2=0x5595d3b8d560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.587+0000 7fb6a4681980 1 --2- 172.21.15.157:0/3691492234 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5595d3b8b0a0 0x5595d3b8d560 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.587+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fb6980ce040 msgr2=0x7fb6980db410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.587+0000 7fb6a4681980 1 --2- 172.21.15.157:0/3691492234 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fb6980ce040 0x7fb6980db410 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.587+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5595d3b94300 msgr2=0x5595d3b967c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.587+0000 7fb6a4681980 1 --2- 172.21.15.157:0/3691492234 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5595d3b94300 0x5595d3b967c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.587+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb56c034bb0 msgr2=0x7fb56c037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.587+0000 7fb6a4681980 1 --2- 172.21.15.157:0/3691492234 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb56c034bb0 0x7fb56c037070 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb69801b2c0 tx=0x7fb6980a6000 comp rx=0 tx=0).stop 2024-05-09T09:47:32.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.587+0000 7fb6a299d640 1 -- 172.21.15.157:0/3691492234 reap_dead start 2024-05-09T09:47:32.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.587+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d3a3fb70 msgr2=0x5595d3b7e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.587+0000 7fb6a4681980 1 --2- 172.21.15.157:0/3691492234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d3a3fb70 0x5595d3b7e540 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb69c018740 tx=0x7fb69c033450 comp rx=0 tx=0).stop 2024-05-09T09:47:32.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.587+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 shutdown_connections 2024-05-09T09:47:32.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.587+0000 7fb6a4681980 1 --2- 172.21.15.157:0/3691492234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d3a3fb70 0x5595d3b7e540 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.587+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 >> 172.21.15.157:0/3691492234 conn(0x5595d3b71320 msgr2=0x5595d3b6e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:32.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.587+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 shutdown_connections 2024-05-09T09:47:32.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.587+0000 7fb6a4681980 1 -- 172.21.15.157:0/3691492234 wait complete. 2024-05-09T09:47:32.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.591+0000 7fb6a4681980 1 -- 172.21.15.157:0/2980841932 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb57c034bb0 msgr2=0x7fb57c037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.591+0000 7fb6a4681980 1 --2- 172.21.15.157:0/2980841932 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb57c034bb0 0x7fb57c037070 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x5595d3b398a0 tx=0x7fb698005a10 comp rx=0 tx=0).stop 2024-05-09T09:47:32.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.591+0000 7fb6a4681980 1 -- 172.21.15.157:0/2980841932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d3b67fd0 msgr2=0x5595d3b683f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.591+0000 7fb6a4681980 1 --2- 172.21.15.157:0/2980841932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d3b67fd0 0x5595d3b683f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb69c00efb0 tx=0x7fb69c00db30 comp rx=0 tx=0).stop 2024-05-09T09:47:32.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.591+0000 7fb6a4681980 1 -- 172.21.15.157:0/2980841932 shutdown_connections 2024-05-09T09:47:32.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.591+0000 7fb6a4681980 1 --2- 172.21.15.157:0/2980841932 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb57c034bb0 0x7fb57c037070 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.591+0000 7fb6a4681980 1 --2- 172.21.15.157:0/2980841932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d3b67fd0 0x5595d3b683f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.591+0000 7fb6a4681980 1 -- 172.21.15.157:0/2980841932 >> 172.21.15.157:0/2980841932 conn(0x5595d3b5cda0 msgr2=0x5595d3b5d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:32.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.591+0000 7fb6a4681980 1 -- 172.21.15.157:0/2980841932 shutdown_connections 2024-05-09T09:47:32.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.591+0000 7fb6a4681980 1 -- 172.21.15.157:0/2980841932 wait complete. 2024-05-09T09:47:32.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.591+0000 7fb6a4681980 1 -- 172.21.15.157:0/1531230796 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5595d3b3b720 msgr2=0x5595d3b3db10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.591+0000 7fb6a4681980 1 --2- 172.21.15.157:0/1531230796 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5595d3b3b720 0x5595d3b3db10 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.591+0000 7fb6a4681980 1 -- 172.21.15.157:0/1531230796 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5595d3a43cd0 msgr2=0x5595d3b38d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.591+0000 7fb6a4681980 1 --2- 172.21.15.157:0/1531230796 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5595d3a43cd0 0x5595d3b38d60 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.591+0000 7fb6a4681980 1 -- 172.21.15.157:0/1531230796 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5595d3b3f660 msgr2=0x5595d3b41a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.591+0000 7fb6a4681980 1 --2- 172.21.15.157:0/1531230796 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5595d3b3f660 0x5595d3b41a50 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.591+0000 7fb6a4681980 1 -- 172.21.15.157:0/1531230796 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb588034bb0 msgr2=0x7fb588037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.591+0000 7fb6a4681980 1 --2- 172.21.15.157:0/1531230796 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb588034bb0 0x7fb588037070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb6980ad000 tx=0x7fb6980a5040 comp rx=0 tx=0).stop 2024-05-09T09:47:32.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.591+0000 7fb6a4681980 1 -- 172.21.15.157:0/1531230796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d39b3ab0 msgr2=0x5595d3b31d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.591+0000 7fb6a4681980 1 --2- 172.21.15.157:0/1531230796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5595d39b3ab0 0x5595d3b31d90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb69c001e20 tx=0x7fb69c000ee0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.591+0000 7fb6a299d640 1 -- 172.21.15.157:0/1531230796 reap_dead start 2024-05-09T09:47:32.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.591+0000 7fb6a4681980 1 -- 172.21.15.157:0/1531230796 shutdown_connections 2024-05-09T09:47:32.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.591+0000 7fb6a4681980 1 -- 172.21.15.157:0/1531230796 >> 172.21.15.157:0/1531230796 conn(0x5595d3a3a0d0 msgr2=0x5595d3b25260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:32.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.591+0000 7fb6a4681980 1 -- 172.21.15.157:0/1531230796 shutdown_connections 2024-05-09T09:47:32.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.591+0000 7fb6a4681980 1 -- 172.21.15.157:0/1531230796 wait complete. 2024-05-09T09:47:32.601 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-09T09:47:32.044078Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:47:32.044055Z', 'tags': [], 'group_ids': []} 2024-05-09T09:47:32.601 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-05-09T09:47:32.601 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-05-09T09:47:32.602 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-05-09T09:47:32.677 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:32.677 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:32.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.679+0000 7f4f1ed96980 1 Processor -- start 2024-05-09T09:47:32.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.679+0000 7f4f1ed96980 1 -- start start 2024-05-09T09:47:32.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.679+0000 7f4f1ed96980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x558ef47e6b30 0x558ef47e6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.679+0000 7f4f1ed96980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558ef469a440 con 0x558ef47e7450 2024-05-09T09:47:32.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.679+0000 7f4f1ed96980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x558ef46855f0 con 0x558ef47e6b30 2024-05-09T09:47:32.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.679+0000 7f4f1c8b1640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x558ef47e6b30 0x558ef47e6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.679+0000 7f4f1c8b1640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x558ef47e6b30 0x558ef47e6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53980/0 (socket says 172.21.15.157:53980) 2024-05-09T09:47:32.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.679+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/2554578690 learned_addr learned my addr 172.21.15.157:0/2554578690 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:32.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.679+0000 7f4f1c0b0640 1 --1- 172.21.15.157:0/2554578690 >> v1:172.21.15.110:6789/0 conn(0x558ef47e7450 0x558ef47e7e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:33606/0 (socket says 172.21.15.157:33606) 2024-05-09T09:47:32.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.679+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/2554578690 >> v1:172.21.15.110:6789/0 conn(0x558ef47e7450 legacy=0x558ef47e7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.679+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/2554578690 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ef4690990 con 0x558ef47e6b30 2024-05-09T09:47:32.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.683+0000 7f4f1c8b1640 1 --2- 172.21.15.157:0/2554578690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef47e6b30 0x558ef47e6f10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c00a5c0 tx=0x7f4f0c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e219ac0f7e7b650a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.683+0000 7f4f1b8af640 1 -- 172.21.15.157:0/2554578690 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f0c0a6070 con 0x558ef47e6b30 2024-05-09T09:47:32.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.683+0000 7f4f1b8af640 1 -- 172.21.15.157:0/2554578690 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f0c0af070 con 0x558ef47e6b30 2024-05-09T09:47:32.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.683+0000 7f4f1b8af640 1 -- 172.21.15.157:0/2554578690 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f0c0aa5c0 con 0x558ef47e6b30 2024-05-09T09:47:32.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.683+0000 7f4f1ed96980 1 -- 172.21.15.157:0/2554578690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef47e6b30 msgr2=0x558ef47e6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.683+0000 7f4f1ed96980 1 --2- 172.21.15.157:0/2554578690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef47e6b30 0x558ef47e6f10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c00a5c0 tx=0x7f4f0c01b340 comp rx=0 tx=0).stop 2024-05-09T09:47:32.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.683+0000 7f4f1ed96980 1 -- 172.21.15.157:0/2554578690 shutdown_connections 2024-05-09T09:47:32.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.683+0000 7f4f1ed96980 1 --2- 172.21.15.157:0/2554578690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef47e6b30 0x558ef47e6f10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.683+0000 7f4f1ed96980 1 -- 172.21.15.157:0/2554578690 >> 172.21.15.157:0/2554578690 conn(0x558ef475a250 msgr2=0x558ef475a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:32.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.683+0000 7f4f1ed96980 1 -- 172.21.15.157:0/2554578690 shutdown_connections 2024-05-09T09:47:32.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.683+0000 7f4f1ed96980 1 -- 172.21.15.157:0/2554578690 wait complete. 2024-05-09T09:47:32.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.703+0000 7f4f1ed96980 1 Processor -- start 2024-05-09T09:47:32.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.703+0000 7f4f1ed96980 1 -- start start 2024-05-09T09:47:32.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.703+0000 7f4f1ed96980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef47e6b30 0x558ef48d2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.703+0000 7f4f1ed96980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558ef46e7fe0 con 0x558ef47e6b30 2024-05-09T09:47:32.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.703+0000 7f4f1c8b1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef47e6b30 0x558ef48d2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.703+0000 7f4f1c8b1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef47e6b30 0x558ef48d2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:53996/0 (socket says 172.21.15.157:53996) 2024-05-09T09:47:32.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.703+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/231057687 learned_addr learned my addr 172.21.15.157:0/231057687 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:32.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.703+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/231057687 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ef466cae0 con 0x558ef47e6b30 2024-05-09T09:47:32.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.703+0000 7f4f1c8b1640 1 --2- 172.21.15.157:0/231057687 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef47e6b30 0x558ef48d2450 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0ac040 tx=0x7f4f0c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6980bafb5f18b6d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.703+0000 7f4e0ae0d640 1 -- 172.21.15.157:0/231057687 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f0c0aa970 con 0x558ef47e6b30 2024-05-09T09:47:32.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.703+0000 7f4e0ae0d640 1 -- 172.21.15.157:0/231057687 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f0c0aab10 con 0x558ef47e6b30 2024-05-09T09:47:32.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.703+0000 7f4e0ae0d640 1 -- 172.21.15.157:0/231057687 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f0c0aae30 con 0x558ef47e6b30 2024-05-09T09:47:32.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.703+0000 7f4f1ed96980 1 -- 172.21.15.157:0/231057687 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef47e6b30 msgr2=0x558ef48d2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.703+0000 7f4f1ed96980 1 --2- 172.21.15.157:0/231057687 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef47e6b30 0x558ef48d2450 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0ac040 tx=0x7f4f0c003030 comp rx=0 tx=0).stop 2024-05-09T09:47:32.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.703+0000 7f4f1ed96980 1 -- 172.21.15.157:0/231057687 shutdown_connections 2024-05-09T09:47:32.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.703+0000 7f4f1ed96980 1 --2- 172.21.15.157:0/231057687 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef47e6b30 0x558ef48d2450 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.703+0000 7f4f1ed96980 1 -- 172.21.15.157:0/231057687 >> 172.21.15.157:0/231057687 conn(0x558ef475a250 msgr2=0x558ef48cdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:32.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.703+0000 7f4f1ed96980 1 -- 172.21.15.157:0/231057687 shutdown_connections 2024-05-09T09:47:32.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.703+0000 7f4f1ed96980 1 -- 172.21.15.157:0/231057687 wait complete. 2024-05-09T09:47:32.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.703+0000 7f4f1ed96980 1 Processor -- start 2024-05-09T09:47:32.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.703+0000 7f4f1ed96980 1 -- start start 2024-05-09T09:47:32.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.703+0000 7f4f1ed96980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef47e6b30 0x558ef48d9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.703+0000 7f4f1ed96980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558ef47f0b70 con 0x558ef47e6b30 2024-05-09T09:47:32.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.707+0000 7f4f1c8b1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef47e6b30 0x558ef48d9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.707+0000 7f4f1c8b1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef47e6b30 0x558ef48d9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54004/0 (socket says 172.21.15.157:54004) 2024-05-09T09:47:32.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.707+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/1068678509 learned_addr learned my addr 172.21.15.157:0/1068678509 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:32.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.707+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/1068678509 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ef48d9960 con 0x558ef47e6b30 2024-05-09T09:47:32.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.707+0000 7f4f1c8b1640 1 --2- 172.21.15.157:0/1068678509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef47e6b30 0x558ef48d9420 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c003070 tx=0x7f4f0c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.707+0000 7f4e0960a640 1 -- 172.21.15.157:0/1068678509 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f0c0c6690 con 0x558ef47e6b30 2024-05-09T09:47:32.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.707+0000 7f4f1ed96980 1 -- 172.21.15.157:0/1068678509 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ef48d9bf0 con 0x558ef47e6b30 2024-05-09T09:47:32.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.707+0000 7f4e0960a640 1 -- 172.21.15.157:0/1068678509 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f0c0cc070 con 0x558ef47e6b30 2024-05-09T09:47:32.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.707+0000 7f4e0960a640 1 -- 172.21.15.157:0/1068678509 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f0c0c6960 con 0x558ef47e6b30 2024-05-09T09:47:32.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.707+0000 7f4f1ed96980 1 -- 172.21.15.157:0/1068678509 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ef48dc880 con 0x558ef47e6b30 2024-05-09T09:47:32.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.707+0000 7f4e0960a640 1 -- 172.21.15.157:0/1068678509 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f4f0c0c6b00 con 0x558ef47e6b30 2024-05-09T09:47:32.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.707+0000 7f4e0960a640 1 --2- 172.21.15.157:0/1068678509 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4e04034bb0 0x7f4e04037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.707+0000 7f4e0960a640 1 -- 172.21.15.157:0/1068678509 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f4f0c0e5c10 con 0x558ef47e6b30 2024-05-09T09:47:32.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.707+0000 7f4f1ed96980 1 --2- 172.21.15.157:0/1068678509 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558ef47e7450 0x558ef48e04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.707+0000 7f4f1ed96980 1 -- 172.21.15.157:0/1068678509 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ef48e0a50 con 0x558ef47e7450 2024-05-09T09:47:32.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.707+0000 7f4f1c0b0640 1 --2- 172.21.15.157:0/1068678509 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4e04034bb0 0x7f4e04037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.707+0000 7f4f1d0b2640 1 --2- 172.21.15.157:0/1068678509 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558ef47e7450 0x558ef48e04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.711+0000 7f4f1d0b2640 1 --2- 172.21.15.157:0/1068678509 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558ef47e7450 0x558ef48e04d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.711+0000 7f4f1c0b0640 1 --2- 172.21.15.157:0/1068678509 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4e04034bb0 0x7f4e04037070 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4f10001e50 tx=0x7f4f100013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.711+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/1068678509 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef47e7450 2024-05-09T09:47:32.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.711+0000 7f4f1ed96980 1 -- 172.21.15.157:0/1068678509 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ef48dda80 con 0x558ef47e7450 2024-05-09T09:47:32.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.711+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/1068678509 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef47e7450 2024-05-09T09:47:32.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.711+0000 7f4f1ed96980 1 --2- 172.21.15.157:0/1068678509 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558ef48e2d90 0x558ef48e5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.711+0000 7f4f1ed96980 1 -- 172.21.15.157:0/1068678509 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ef48e5850 con 0x558ef48e2d90 2024-05-09T09:47:32.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.711+0000 7f4f1c8b1640 1 --2- 172.21.15.157:0/1068678509 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558ef48e2d90 0x558ef48e5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.711+0000 7f4f1c8b1640 1 --2- 172.21.15.157:0/1068678509 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558ef48e2d90 0x558ef48e5180 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.711+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/1068678509 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4f0c0c0bb0 con 0x558ef48e2d90 2024-05-09T09:47:32.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.711+0000 7f4f1ed96980 1 -- 172.21.15.157:0/1068678509 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ef48e1c30 con 0x558ef47e7450 2024-05-09T09:47:32.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.711+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/1068678509 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef47e7450 2024-05-09T09:47:32.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.711+0000 7f4f1ed96980 1 --2- 172.21.15.157:0/1068678509 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558ef48e6cb0 0x558ef48e90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.711+0000 7f4f1ed96980 1 -- 172.21.15.157:0/1068678509 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ef48e97a0 con 0x558ef48e6cb0 2024-05-09T09:47:32.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.711+0000 7f4f1c0b0640 1 --2- 172.21.15.157:0/1068678509 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558ef48e6cb0 0x558ef48e90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.711+0000 7f4f1c0b0640 1 --2- 172.21.15.157:0/1068678509 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558ef48e6cb0 0x558ef48e90a0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.715+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/1068678509 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4f1000f700 con 0x558ef48e6cb0 2024-05-09T09:47:32.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.715+0000 7f4f1ed96980 1 Processor -- start 2024-05-09T09:47:32.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.715+0000 7f4f1ed96980 1 -- start start 2024-05-09T09:47:32.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.719+0000 7f4f1ed96980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef490f690 0x558ef490fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.719+0000 7f4f1ed96980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558ef46ec020 con 0x558ef490f690 2024-05-09T09:47:32.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.719+0000 7f4f1c8b1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef490f690 0x558ef490fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.719+0000 7f4f1c8b1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef490f690 0x558ef490fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54012/0 (socket says 172.21.15.157:54012) 2024-05-09T09:47:32.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.719+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3922626843 learned_addr learned my addr 172.21.15.157:0/3922626843 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:32.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.719+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3922626843 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ef490fff0 con 0x558ef490f690 2024-05-09T09:47:32.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.719+0000 7f4f1c8b1640 1 --2- 172.21.15.157:0/3922626843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef490f690 0x558ef490fab0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0e4080 tx=0x7f4f0c0c5ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.719+0000 7f4e0139f640 1 -- 172.21.15.157:0/3922626843 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f0c0ea070 con 0x558ef490f690 2024-05-09T09:47:32.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.719+0000 7f4e0139f640 1 -- 172.21.15.157:0/3922626843 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f0c0e1070 con 0x558ef490f690 2024-05-09T09:47:32.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.719+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3922626843 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ef4910a80 con 0x558ef490f690 2024-05-09T09:47:32.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.719+0000 7f4e0139f640 1 -- 172.21.15.157:0/3922626843 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f0c0bcb30 con 0x558ef490f690 2024-05-09T09:47:32.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.719+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3922626843 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ef4910f60 con 0x558ef490f690 2024-05-09T09:47:32.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.719+0000 7f4e0139f640 1 -- 172.21.15.157:0/3922626843 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f4f0c0bccd0 con 0x558ef490f690 2024-05-09T09:47:32.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.719+0000 7f4e0139f640 1 --2- 172.21.15.157:0/3922626843 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4df4034c50 0x7f4df4037110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.719+0000 7f4e0139f640 1 -- 172.21.15.157:0/3922626843 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f4f0c0efc60 con 0x558ef490f690 2024-05-09T09:47:32.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.719+0000 7f4f1c0b0640 1 --2- 172.21.15.157:0/3922626843 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4df4034c50 0x7f4df4037110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.719+0000 7f4f1ed96980 1 Processor -- start 2024-05-09T09:47:32.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.719+0000 7f4f1ed96980 1 -- start start 2024-05-09T09:47:32.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.723+0000 7f4f1ed96980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef491c600 0x558ef491c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.723+0000 7f4f1ed96980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558ef48d2ae0 con 0x558ef491c600 2024-05-09T09:47:32.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.723+0000 7f4f1c0b0640 1 --2- 172.21.15.157:0/3922626843 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4df4034c50 0x7f4df4037110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x558ef48e1340 tx=0x7f4f1000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.723+0000 7f4f1c8b1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef491c600 0x558ef491c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.723+0000 7f4f1c8b1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef491c600 0x558ef491c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54020/0 (socket says 172.21.15.157:54020) 2024-05-09T09:47:32.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.723+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/524506733 learned_addr learned my addr 172.21.15.157:0/524506733 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:32.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.723+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/524506733 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ef491cfb0 con 0x558ef491c600 2024-05-09T09:47:32.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.723+0000 7f4f1c8b1640 1 --2- 172.21.15.157:0/524506733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef491c600 0x558ef491c9e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0d4000 tx=0x7f4f0c0f7500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ecf57dda1e671d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.723+0000 7f4dfaffd640 1 -- 172.21.15.157:0/524506733 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f0c0ab230 con 0x558ef491c600 2024-05-09T09:47:32.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.723+0000 7f4dfaffd640 1 -- 172.21.15.157:0/524506733 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f0c0cb180 con 0x558ef491c600 2024-05-09T09:47:32.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.723+0000 7f4dfaffd640 1 -- 172.21.15.157:0/524506733 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f0c0d3100 con 0x558ef491c600 2024-05-09T09:47:32.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.723+0000 7f4f1ed96980 1 -- 172.21.15.157:0/524506733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef491c600 msgr2=0x558ef491c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.723+0000 7f4f1ed96980 1 --2- 172.21.15.157:0/524506733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef491c600 0x558ef491c9e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0d4000 tx=0x7f4f0c0f7500 comp rx=0 tx=0).stop 2024-05-09T09:47:32.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.723+0000 7f4f1ed96980 1 -- 172.21.15.157:0/524506733 shutdown_connections 2024-05-09T09:47:32.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.723+0000 7f4f1ed96980 1 --2- 172.21.15.157:0/524506733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef491c600 0x558ef491c9e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.723+0000 7f4f1ed96980 1 -- 172.21.15.157:0/524506733 >> 172.21.15.157:0/524506733 conn(0x558ef4918980 msgr2=0x558ef49169e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:32.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.723+0000 7f4f1ed96980 1 -- 172.21.15.157:0/524506733 shutdown_connections 2024-05-09T09:47:32.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.723+0000 7f4f1ed96980 1 -- 172.21.15.157:0/524506733 wait complete. 2024-05-09T09:47:32.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.723+0000 7f4f1ed96980 1 Processor -- start 2024-05-09T09:47:32.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.723+0000 7f4f1ed96980 1 -- start start 2024-05-09T09:47:32.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.723+0000 7f4f1ed96980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef491c600 0x558ef4923980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.723+0000 7f4f1ed96980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558ef491d6c0 con 0x558ef491c600 2024-05-09T09:47:32.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.723+0000 7f4f1c8b1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef491c600 0x558ef4923980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.723+0000 7f4f1c8b1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef491c600 0x558ef4923980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54026/0 (socket says 172.21.15.157:54026) 2024-05-09T09:47:32.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.723+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 learned_addr learned my addr 172.21.15.157:0/3013896149 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:32.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.727+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ef4923ec0 con 0x558ef491c600 2024-05-09T09:47:32.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.727+0000 7f4f1c8b1640 1 --2- 172.21.15.157:0/3013896149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef491c600 0x558ef4923980 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0f7800 tx=0x7f4f0c0b6f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.727+0000 7f4df97fa640 1 -- 172.21.15.157:0/3013896149 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f0c110070 con 0x558ef491c600 2024-05-09T09:47:32.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.727+0000 7f4df97fa640 1 -- 172.21.15.157:0/3013896149 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f0c0b3e00 con 0x558ef491c600 2024-05-09T09:47:32.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.727+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ef4923ec0 con 0x558ef491c600 2024-05-09T09:47:32.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.727+0000 7f4df97fa640 1 -- 172.21.15.157:0/3013896149 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f0c0ab6e0 con 0x558ef491c600 2024-05-09T09:47:32.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.727+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ef4923ec0 con 0x558ef491c600 2024-05-09T09:47:32.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.727+0000 7f4df97fa640 1 -- 172.21.15.157:0/3013896149 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f4f0c113070 con 0x558ef491c600 2024-05-09T09:47:32.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.727+0000 7f4df97fa640 1 --2- 172.21.15.157:0/3013896149 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4de4034b60 0x7f4de4037020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.727+0000 7f4df97fa640 1 -- 172.21.15.157:0/3013896149 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f4f0c116cb0 con 0x558ef491c600 2024-05-09T09:47:32.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.727+0000 7f4f1ed96980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.727+0000 7f4f1ed96980 1 --2- 172.21.15.157:0/3013896149 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558ef4930500 0x558ef49329c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.727+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ef4933110 con 0x558ef4930500 2024-05-09T09:47:32.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.727+0000 7f4f1c0b0640 1 --2- 172.21.15.157:0/3013896149 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4de4034b60 0x7f4de4037020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.727+0000 7f4f1d0b2640 1 --2- 172.21.15.157:0/3013896149 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558ef4930500 0x558ef49329c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.727+0000 7f4f1d0b2640 1 --2- 172.21.15.157:0/3013896149 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558ef4930500 0x558ef49329c0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.727+0000 7f4f1c0b0640 1 --2- 172.21.15.157:0/3013896149 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4de4034b60 0x7f4de4037020 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x558ef48e9ba0 tx=0x7f4f10010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.731+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.731+0000 7f4f1ed96980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:32.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.731+0000 7f4f1ed96980 20 realm 2024-05-09T09:47:32.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.731+0000 7f4f1ed96980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.731+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ef4933520 con 0x558ef4930500 2024-05-09T09:47:32.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.731+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.731+0000 7f4f1ed96980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:32.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.731+0000 7f4f1ed96980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:32.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.731+0000 7f4f1ed96980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.731+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ef4933df0 con 0x558ef4930500 2024-05-09T09:47:32.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.731+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.731+0000 7f4f1ed96980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:32.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.731+0000 7f4f1ed96980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.731+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x558ef4930500 2024-05-09T09:47:32.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.731+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.731+0000 7f4f1ed96980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:32.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.731+0000 7f4f1ed96980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.731+0000 7f4f1ed96980 1 --2- 172.21.15.157:0/3013896149 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558ef4934ef0 0x558ef49372e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.731+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ef49378f0 con 0x558ef4934ef0 2024-05-09T09:47:32.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.731+0000 7f4f1c8b1640 1 --2- 172.21.15.157:0/3013896149 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558ef4934ef0 0x558ef49372e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.731+0000 7f4f1c8b1640 1 --2- 172.21.15.157:0/3013896149 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558ef4934ef0 0x558ef49372e0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.731+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4f0c11c070 con 0x558ef4934ef0 2024-05-09T09:47:32.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.731+0000 7f4f1ed96980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:32.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.731+0000 7f4f1ed96980 20 searching for the correct realm 2024-05-09T09:47:32.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.731+0000 7f4f1ed96980 1 --2- 172.21.15.157:0/3013896149 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558ef4939840 0x558ef493bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.731+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef493c320 con 0x558ef4939840 2024-05-09T09:47:32.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.731+0000 7f4f1c0b0640 1 --2- 172.21.15.157:0/3013896149 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558ef4939840 0x558ef493bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.731+0000 7f4f1c0b0640 1 --2- 172.21.15.157:0/3013896149 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558ef4939840 0x558ef493bc50 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.735+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f10037040 con 0x558ef4939840 2024-05-09T09:47:32.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.735+0000 7f4f1c0b0640 1 --2- 172.21.15.157:0/3013896149 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f4f1001fbe0 0x7f4f1003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.735+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef493c320 con 0x7f4f1001fbe0 2024-05-09T09:47:32.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.735+0000 7f4f1d0b2640 1 --2- 172.21.15.157:0/3013896149 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f4f1001fbe0 0x7f4f1003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.735+0000 7f4f1d0b2640 1 --2- 172.21.15.157:0/3013896149 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f4f1001fbe0 0x7f4f1003a3c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.735+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f1400a4d0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.735+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x558ef4934ef0 2024-05-09T09:47:32.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.735+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f0c11c070 con 0x558ef4934ef0 2024-05-09T09:47:32.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.735+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x558ef4930500 2024-05-09T09:47:32.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.735+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.735+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x558ef4930500 2024-05-09T09:47:32.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.735+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.735+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x558ef4934ef0 2024-05-09T09:47:32.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.735+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f0c11c070 con 0x558ef4934ef0 2024-05-09T09:47:32.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.735+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x558ef4934ef0 2024-05-09T09:47:32.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.739+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f0c11c070 con 0x558ef4934ef0 2024-05-09T09:47:32.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.739+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x7f4f1001fbe0 2024-05-09T09:47:32.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.739+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f1400a4d0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.739+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x558ef4939840 2024-05-09T09:47:32.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.739+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f10037040 con 0x558ef4939840 2024-05-09T09:47:32.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.739+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x558ef4930500 2024-05-09T09:47:32.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.739+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.739+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x558ef4934ef0 2024-05-09T09:47:32.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.739+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f0c11c070 con 0x558ef4934ef0 2024-05-09T09:47:32.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.739+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x558ef4930500 2024-05-09T09:47:32.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.739+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.739+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x7f4f1001fbe0 2024-05-09T09:47:32.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.739+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4f1400a4d0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.739+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x558ef4939840 2024-05-09T09:47:32.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.739+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f10037040 con 0x558ef4939840 2024-05-09T09:47:32.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.739+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x558ef4939840 2024-05-09T09:47:32.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.739+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4f10037040 con 0x558ef4939840 2024-05-09T09:47:32.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.739+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x558ef4934ef0 2024-05-09T09:47:32.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.739+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f0c11c070 con 0x558ef4934ef0 2024-05-09T09:47:32.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.739+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x558ef4939840 2024-05-09T09:47:32.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.739+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f10037040 con 0x558ef4939840 2024-05-09T09:47:32.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.739+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x558ef4939840 2024-05-09T09:47:32.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.743+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f10037040 con 0x558ef4939840 2024-05-09T09:47:32.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.743+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x558ef4930500 2024-05-09T09:47:32.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.743+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.743+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x558ef4930500 2024-05-09T09:47:32.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.743+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.743+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x558ef4934ef0 2024-05-09T09:47:32.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.743+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f0c11c070 con 0x558ef4934ef0 2024-05-09T09:47:32.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.743+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x558ef4939840 2024-05-09T09:47:32.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.743+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f10037040 con 0x558ef4939840 2024-05-09T09:47:32.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.743+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x7f4f1001fbe0 2024-05-09T09:47:32.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.743+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f1400a4d0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.743+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x558ef4930500 2024-05-09T09:47:32.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.743+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.743+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x558ef4934ef0 2024-05-09T09:47:32.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.743+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4f0c11c070 con 0x558ef4934ef0 2024-05-09T09:47:32.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.743+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x558ef4939840 2024-05-09T09:47:32.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.743+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f10037040 con 0x558ef4939840 2024-05-09T09:47:32.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.743+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x558ef4934ef0 2024-05-09T09:47:32.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f0c11c070 con 0x558ef4934ef0 2024-05-09T09:47:32.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x7f4f1001fbe0 2024-05-09T09:47:32.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f1400a4d0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x558ef4939840 2024-05-09T09:47:32.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f10049040 con 0x558ef4939840 2024-05-09T09:47:32.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x558ef4934ef0 2024-05-09T09:47:32.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f0c11c070 con 0x558ef4934ef0 2024-05-09T09:47:32.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x558ef4930500 2024-05-09T09:47:32.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ef4934190 con 0x7f4f1001fbe0 2024-05-09T09:47:32.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f1400a4d0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1ed96980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:32.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1ed96980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:32.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1ed96980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:32.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1ed96980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:32.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1ed96980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:32.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1ed96980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:32.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1ed96980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ef49381b0 con 0x558ef4930500 2024-05-09T09:47:32.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1ed96980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:32.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1ed96980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ef49381b0 con 0x558ef4930500 2024-05-09T09:47:32.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1ed96980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:32.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1ed96980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ef49381b0 con 0x558ef4939840 2024-05-09T09:47:32.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4f10049040 con 0x558ef4939840 2024-05-09T09:47:32.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1ed96980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:32.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1ed96980 20 zone default found 2024-05-09T09:47:32.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1ed96980 4 Realm: () 2024-05-09T09:47:32.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1ed96980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:32.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1ed96980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:32.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1ed96980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:32.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1ed96980 20 zonegroup default 2024-05-09T09:47:32.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1ed96980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.747+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ef4938b90 con 0x558ef4934ef0 2024-05-09T09:47:32.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.751+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4f0c11c070 con 0x558ef4934ef0 2024-05-09T09:47:32.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.751+0000 7f4f1ed96980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:32.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.751+0000 7f4f1ed96980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.751+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ef4938720 con 0x558ef4939840 2024-05-09T09:47:32.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.751+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4f10049040 con 0x558ef4939840 2024-05-09T09:47:32.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.751+0000 7f4f1ed96980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:32.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.751+0000 7f4f1ed96980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.751+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ef493e700 con 0x558ef4939840 2024-05-09T09:47:32.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.751+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4f10049040 con 0x558ef4939840 2024-05-09T09:47:32.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.751+0000 7f4f1ed96980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:32.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.751+0000 7f4f1ed96980 20 started sync module instance, tier type = 2024-05-09T09:47:32.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.751+0000 7f4f1ed96980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:32.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.751+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef493dac0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.751+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.751+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94072477048768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef493dac0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.751+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef493f200 con 0x558ef4930500 2024-05-09T09:47:32.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.751+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94072477048768] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.755+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.755+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94072477052112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef493dac0 con 0x558ef4930500 2024-05-09T09:47:32.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.755+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef493fc10 con 0x558ef4939840 2024-05-09T09:47:32.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.755+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94072477052112] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.755+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f10049040 con 0x558ef4939840 2024-05-09T09:47:32.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.755+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94072477046288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef493da30 con 0x558ef4939840 2024-05-09T09:47:32.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.755+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef49409e0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.759+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.759+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94072477058224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef4941280 con 0x7f4f1001fbe0 2024-05-09T09:47:32.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.759+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef4941c80 con 0x558ef4930500 2024-05-09T09:47:32.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.759+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94072477046288] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f10049040 con 0x558ef4939840 2024-05-09T09:47:32.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.759+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94072477058224] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.759+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.759+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94072477057024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef4940d80 con 0x558ef4930500 2024-05-09T09:47:32.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.759+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef4942520 con 0x558ef4934ef0 2024-05-09T09:47:32.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.763+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f0c11c070 con 0x558ef4934ef0 2024-05-09T09:47:32.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.763+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94072477057024] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.763+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94072477065328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef4940d80 con 0x558ef4934ef0 2024-05-09T09:47:32.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.763+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef4942d70 con 0x558ef4934ef0 2024-05-09T09:47:32.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.763+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f0c11c070 con 0x558ef4934ef0 2024-05-09T09:47:32.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.763+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94072477067968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef4943530 con 0x558ef4934ef0 2024-05-09T09:47:32.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.763+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef4944050 con 0x558ef4934ef0 2024-05-09T09:47:32.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.763+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94072477065328] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f0c11c070 con 0x558ef4934ef0 2024-05-09T09:47:32.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.767+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94072477067968] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f0c11c070 con 0x558ef4934ef0 2024-05-09T09:47:32.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.767+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f0c11c070 con 0x558ef4934ef0 2024-05-09T09:47:32.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.767+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94072477072160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef4944010 con 0x558ef4934ef0 2024-05-09T09:47:32.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.767+0000 7f4f1ed96980 20 add_watcher() i=0 2024-05-09T09:47:32.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.767+0000 7f4f1ed96980 20 add_watcher() i=1 2024-05-09T09:47:32.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.767+0000 7f4f1ed96980 20 add_watcher() i=2 2024-05-09T09:47:32.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.767+0000 7f4f1ed96980 20 add_watcher() i=3 2024-05-09T09:47:32.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.767+0000 7f4f1ed96980 20 add_watcher() i=4 2024-05-09T09:47:32.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.767+0000 7f4f1ed96980 20 add_watcher() i=5 2024-05-09T09:47:32.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.767+0000 7f4f1ed96980 20 add_watcher() i=6 2024-05-09T09:47:32.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.767+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94072477072160] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f0c11c070 con 0x558ef4934ef0 2024-05-09T09:47:32.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.767+0000 7f4f1ed96980 20 add_watcher() i=7 2024-05-09T09:47:32.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.767+0000 7f4f1ed96980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:32.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.767+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ef4942f80 con 0x558ef4930500 2024-05-09T09:47:32.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.767+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.767+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94072477069184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef4944480 con 0x558ef4930500 2024-05-09T09:47:32.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.771+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94072477069184] v30'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.771+0000 7f4dd1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:32.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.771+0000 7f4f1ed96980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:32.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.771+0000 7f4f1ed96980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:32.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.771+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef494f920 con 0x558ef4930500 2024-05-09T09:47:32.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.771+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.771+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef494ff70 con 0x558ef4934ef0 2024-05-09T09:47:32.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.775+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4f0c11c070 con 0x558ef4934ef0 2024-05-09T09:47:32.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.775+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef494ff70 con 0x558ef4939840 2024-05-09T09:47:32.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.775+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4f10049040 con 0x558ef4939840 2024-05-09T09:47:32.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.775+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef4950a50 con 0x558ef4930500 2024-05-09T09:47:32.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.775+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'75 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.775+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef494d700 con 0x7f4f1001fbe0 2024-05-09T09:47:32.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.779+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'50 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.779+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef494d700 con 0x558ef4939840 2024-05-09T09:47:32.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.779+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'33 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4f10049040 con 0x558ef4939840 2024-05-09T09:47:32.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.779+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef4951780 con 0x558ef4930500 2024-05-09T09:47:32.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.779+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.779+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef4951810 con 0x558ef4934ef0 2024-05-09T09:47:32.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.783+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'33 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4f0c11c070 con 0x558ef4934ef0 2024-05-09T09:47:32.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.783+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef49518a0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.787+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.787+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef4951930 con 0x558ef4939840 2024-05-09T09:47:32.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.787+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4f10049040 con 0x558ef4939840 2024-05-09T09:47:32.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.787+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef4951de0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.787+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'51 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.787+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef4951de0 con 0x558ef4934ef0 2024-05-09T09:47:32.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.791+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f0c11c070 con 0x558ef4934ef0 2024-05-09T09:47:32.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.791+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef4951de0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.791+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.791+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef4951de0 con 0x558ef4934ef0 2024-05-09T09:47:32.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.795+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'39 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f0c11c070 con 0x558ef4934ef0 2024-05-09T09:47:32.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.795+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef4951de0 con 0x558ef4930500 2024-05-09T09:47:32.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.795+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'76 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.795+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef4951de0 con 0x558ef4939840 2024-05-09T09:47:32.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.799+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'44 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f10049040 con 0x558ef4939840 2024-05-09T09:47:32.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.799+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef49521c0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.799+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'52 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.799+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef49521c0 con 0x558ef4939840 2024-05-09T09:47:32.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.799+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f10049040 con 0x558ef4939840 2024-05-09T09:47:32.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.799+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef49521c0 con 0x558ef4930500 2024-05-09T09:47:32.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.803+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'28 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.803+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef49521c0 con 0x558ef4930500 2024-05-09T09:47:32.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.803+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'77 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.803+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef49521c0 con 0x558ef4939840 2024-05-09T09:47:32.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.807+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'45 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f10049040 con 0x558ef4939840 2024-05-09T09:47:32.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.807+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef49521c0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.807+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'30 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.807+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef49521c0 con 0x558ef4939840 2024-05-09T09:47:32.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.807+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f10049040 con 0x558ef4939840 2024-05-09T09:47:32.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.807+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef49521c0 con 0x558ef4939840 2024-05-09T09:47:32.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.811+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f10049040 con 0x558ef4939840 2024-05-09T09:47:32.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.811+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef49521c0 con 0x558ef4939840 2024-05-09T09:47:32.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.811+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f10049040 con 0x558ef4939840 2024-05-09T09:47:32.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.811+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef49521c0 con 0x558ef4939840 2024-05-09T09:47:32.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.815+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'34 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f10049040 con 0x558ef4939840 2024-05-09T09:47:32.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.815+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef49521c0 con 0x558ef4934ef0 2024-05-09T09:47:32.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.815+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f0c11c070 con 0x558ef4934ef0 2024-05-09T09:47:32.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.815+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef49521c0 con 0x558ef4939840 2024-05-09T09:47:32.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.815+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f10049040 con 0x558ef4939840 2024-05-09T09:47:32.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.815+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef49521c0 con 0x558ef4934ef0 2024-05-09T09:47:32.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.819+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'34 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f0c11c070 con 0x558ef4934ef0 2024-05-09T09:47:32.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.819+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef49521c0 con 0x558ef4939840 2024-05-09T09:47:32.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.823+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'46 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f10049040 con 0x558ef4939840 2024-05-09T09:47:32.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.823+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef49521c0 con 0x558ef4934ef0 2024-05-09T09:47:32.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.823+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'40 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f0c11c070 con 0x558ef4934ef0 2024-05-09T09:47:32.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.823+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef49521c0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.827+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.827+0000 7f4dd0fe1640 20 reqs_thread_entry: start 2024-05-09T09:47:32.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.827+0000 7f4f1ed96980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:32.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.827+0000 7f4d4a7fc640 20 reqs_thread_entry: start 2024-05-09T09:47:32.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.827+0000 7f4f1ed96980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-09T09:47:32.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.827+0000 7f4f1ed96980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.827+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ef494c890 con 0x558ef4930500 2024-05-09T09:47:32.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.827+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.827+0000 7f4f1ed96980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:47:32.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.827+0000 7f4f1ed96980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-09T09:47:32.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.827+0000 7f4f1ed96980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:32.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.827+0000 7f4f1ed96980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:32.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.827+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ef4970220 con 0x7f4f1001fbe0 2024-05-09T09:47:32.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.827+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(95 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.827+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef49739b0 con 0x558ef4930500 2024-05-09T09:47:32.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.831+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(96 foo [delete,create,call,call,writefull 0~391] v30'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.831+0000 7f4f1ed96980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:47:32.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.831+0000 7f4f1ed96980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:32.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.831+0000 7f4f1ed96980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-09T09:47:32.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.831+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.d 7:b4812045:::notify.4:head [notify cookie 94072477267520 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ef49706d0 con 0x558ef4930500 2024-05-09T09:47:32.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.831+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== watch-notify(notify (1) cookie 94072477057024 notify 128849018881 ret 0) ==== 609+0+0 (crc 0 0 0) 0x558ef494d640 con 0x558ef4930500 2024-05-09T09:47:32.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.831+0000 7f4dfaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94072477057024 notifier 4322 bl.length()=567 2024-05-09T09:47:32.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.831+0000 7f4dfaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:47:32.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.831+0000 7f4dfaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:32.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.831+0000 7f4dfaffd640 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f4de00056c0 con 0x558ef4930500 2024-05-09T09:47:32.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.831+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(97 notify.4 [notify cookie 94072477267520 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.831+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(98 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.831+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== watch-notify(notify_complete (2) cookie 94072477267520 notify 128849018881 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558ef494daa0 con 0x558ef4930500 2024-05-09T09:47:32.832 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-09T09:47:32.044078Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:47:32.044055Z","tags":[],"group_ids":[]} 2024-05-09T09:47:32.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.831+0000 7f4dd1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:32.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.831+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:99 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94072477069184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef4971e10 con 0x558ef4930500 2024-05-09T09:47:32.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.831+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(99 data_loggenerations_metadata [watch unwatch cookie 94072477069184] v30'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.831+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:100 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94072477048768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef4942f80 con 0x7f4f1001fbe0 2024-05-09T09:47:32.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.835+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(100 notify.0 [watch unwatch cookie 94072477048768] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.835+0000 7f4f1ed96980 20 remove_watcher() i=0 2024-05-09T09:47:32.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.835+0000 7f4f1ed96980 2 removed watcher, disabling cache 2024-05-09T09:47:32.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.835+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:101 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94072477052112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef493dfc0 con 0x558ef4930500 2024-05-09T09:47:32.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.835+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(101 notify.1 [watch unwatch cookie 94072477052112] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.835+0000 7f4f1ed96980 20 remove_watcher() i=1 2024-05-09T09:47:32.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.835+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94072477046288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef493dfc0 con 0x558ef4939840 2024-05-09T09:47:32.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.839+0000 7f4f1c0b0640 1 -- 172.21.15.157:0/3013896149 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(102 notify.2 [watch unwatch cookie 94072477046288] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f10049040 con 0x558ef4939840 2024-05-09T09:47:32.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.839+0000 7f4f1ed96980 20 remove_watcher() i=2 2024-05-09T09:47:32.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.839+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94072477058224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef493dfc0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.839+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(103 notify.3 [watch unwatch cookie 94072477058224] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x7f4f1001fbe0 2024-05-09T09:47:32.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.839+0000 7f4f1ed96980 20 remove_watcher() i=3 2024-05-09T09:47:32.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.839+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:104 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94072477057024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef493dfc0 con 0x558ef4930500 2024-05-09T09:47:32.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.843+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(104 notify.4 [watch unwatch cookie 94072477057024] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f1400a4d0 con 0x558ef4930500 2024-05-09T09:47:32.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.843+0000 7f4f1ed96980 20 remove_watcher() i=4 2024-05-09T09:47:32.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.843+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:105 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94072477065328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef4940000 con 0x558ef4934ef0 2024-05-09T09:47:32.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.843+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(105 notify.5 [watch unwatch cookie 94072477065328] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f0c11c070 con 0x558ef4934ef0 2024-05-09T09:47:32.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.843+0000 7f4f1ed96980 20 remove_watcher() i=5 2024-05-09T09:47:32.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.843+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:106 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94072477067968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef493dfc0 con 0x558ef4934ef0 2024-05-09T09:47:32.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.847+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(106 notify.6 [watch unwatch cookie 94072477067968] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f0c11c070 con 0x558ef4934ef0 2024-05-09T09:47:32.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.847+0000 7f4f1ed96980 20 remove_watcher() i=6 2024-05-09T09:47:32.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.847+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:107 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94072477072160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ef4942ac0 con 0x558ef4934ef0 2024-05-09T09:47:32.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1c8b1640 1 -- 172.21.15.157:0/3013896149 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(107 notify.7 [watch unwatch cookie 94072477072160] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f0c11c070 con 0x558ef4934ef0 2024-05-09T09:47:32.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 20 remove_watcher() i=7 2024-05-09T09:47:32.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558ef4934ef0 msgr2=0x558ef49372e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 --2- 172.21.15.157:0/3013896149 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558ef4934ef0 0x558ef49372e0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558ef4930500 msgr2=0x558ef49329c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 --2- 172.21.15.157:0/3013896149 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558ef4930500 0x558ef49329c0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f4f1001fbe0 msgr2=0x7f4f1003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 --2- 172.21.15.157:0/3013896149 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f4f1001fbe0 0x7f4f1003a3c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558ef4939840 msgr2=0x558ef493bc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 --2- 172.21.15.157:0/3013896149 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558ef4939840 0x558ef493bc50 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4de4034b60 msgr2=0x7f4de4037020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 --2- 172.21.15.157:0/3013896149 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4de4034b60 0x7f4de4037020 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x558ef48e9ba0 tx=0x7f4f10010000 comp rx=0 tx=0).stop 2024-05-09T09:47:32.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/3013896149 reap_dead start 2024-05-09T09:47:32.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef491c600 msgr2=0x558ef4923980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 --2- 172.21.15.157:0/3013896149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef491c600 0x558ef4923980 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0f7800 tx=0x7f4f0c0b6f40 comp rx=0 tx=0).stop 2024-05-09T09:47:32.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 shutdown_connections 2024-05-09T09:47:32.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 --2- 172.21.15.157:0/3013896149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef491c600 0x558ef4923980 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 >> 172.21.15.157:0/3013896149 conn(0x558ef4918980 msgr2=0x558ef491de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:32.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 shutdown_connections 2024-05-09T09:47:32.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3013896149 wait complete. 2024-05-09T09:47:32.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3922626843 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4df4034c50 msgr2=0x7f4df4037110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 --2- 172.21.15.157:0/3922626843 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4df4034c50 0x7f4df4037110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x558ef48e1340 tx=0x7f4f1000f000 comp rx=0 tx=0).stop 2024-05-09T09:47:32.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3922626843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef490f690 msgr2=0x558ef490fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 --2- 172.21.15.157:0/3922626843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef490f690 0x558ef490fab0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0e4080 tx=0x7f4f0c0c5ba0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3922626843 shutdown_connections 2024-05-09T09:47:32.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 --2- 172.21.15.157:0/3922626843 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4df4034c50 0x7f4df4037110 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 --2- 172.21.15.157:0/3922626843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef490f690 0x558ef490fab0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3922626843 >> 172.21.15.157:0/3922626843 conn(0x558ef4904460 msgr2=0x558ef4904f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:32.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3922626843 shutdown_connections 2024-05-09T09:47:32.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 -- 172.21.15.157:0/3922626843 wait complete. 2024-05-09T09:47:32.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 -- 172.21.15.157:0/1068678509 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558ef48e2d90 msgr2=0x558ef48e5180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 --2- 172.21.15.157:0/1068678509 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558ef48e2d90 0x558ef48e5180 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 -- 172.21.15.157:0/1068678509 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558ef47e7450 msgr2=0x558ef48e04d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 --2- 172.21.15.157:0/1068678509 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558ef47e7450 0x558ef48e04d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 -- 172.21.15.157:0/1068678509 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558ef48e6cb0 msgr2=0x558ef48e90a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 --2- 172.21.15.157:0/1068678509 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558ef48e6cb0 0x558ef48e90a0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 -- 172.21.15.157:0/1068678509 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4e04034bb0 msgr2=0x7f4e04037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 --2- 172.21.15.157:0/1068678509 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4e04034bb0 0x7f4e04037070 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4f10001e50 tx=0x7f4f100013b0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 -- 172.21.15.157:0/1068678509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef47e6b30 msgr2=0x558ef48d9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 --2- 172.21.15.157:0/1068678509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558ef47e6b30 0x558ef48d9420 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c003070 tx=0x7f4f0c0180e0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1d0b2640 1 -- 172.21.15.157:0/1068678509 reap_dead start 2024-05-09T09:47:32.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 -- 172.21.15.157:0/1068678509 shutdown_connections 2024-05-09T09:47:32.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 -- 172.21.15.157:0/1068678509 >> 172.21.15.157:0/1068678509 conn(0x558ef475a250 msgr2=0x558ef48ccaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:32.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 -- 172.21.15.157:0/1068678509 shutdown_connections 2024-05-09T09:47:32.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.851+0000 7f4f1ed96980 1 -- 172.21.15.157:0/1068678509 wait complete. 2024-05-09T09:47:32.862 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-09T09:47:32.044078Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:47:32.044055Z', 'tags': [], 'group_ids': []} 2024-05-09T09:47:32.863 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-09T09:47:32.863 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-09T09:47:32.863 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-09T09:47:32.937 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:32.937 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:32.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.939+0000 7f1faae19980 1 Processor -- start 2024-05-09T09:47:32.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.939+0000 7f1faae19980 1 -- start start 2024-05-09T09:47:32.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.939+0000 7f1faae19980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5572f78dff00 0x5572f78e02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.939+0000 7f1faae19980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5572f7793440 con 0x5572f78e0dc0 2024-05-09T09:47:32.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.939+0000 7f1faae19980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5572f777e5f0 con 0x5572f78dff00 2024-05-09T09:47:32.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.939+0000 7f1fa8934640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5572f78dff00 0x5572f78e02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.939+0000 7f1fa8133640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x5572f78e0dc0 0x5572f78e11d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:33620/0 (socket says 172.21.15.157:33620) 2024-05-09T09:47:32.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.939+0000 7f1fa8133640 1 -- 172.21.15.157:0/2873293842 learned_addr learned my addr 172.21.15.157:0/2873293842 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:47:32.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.939+0000 7f1fa8934640 1 -- 172.21.15.157:0/2873293842 >> v1:172.21.15.110:6789/0 conn(0x5572f78e0dc0 legacy=0x5572f78e11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.939+0000 7f1fa8934640 1 -- 172.21.15.157:0/2873293842 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572f7789990 con 0x5572f78dff00 2024-05-09T09:47:32.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.943+0000 7f1fa8934640 1 --2- 172.21.15.157:0/2873293842 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f78dff00 0x5572f78e02e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800a480 tx=0x7f1f9801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a24c210de2b2a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.943+0000 7f1fa7932640 1 -- 172.21.15.157:0/2873293842 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f980af070 con 0x5572f78dff00 2024-05-09T09:47:32.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.943+0000 7f1fa7932640 1 -- 172.21.15.157:0/2873293842 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f980aa530 con 0x5572f78dff00 2024-05-09T09:47:32.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.943+0000 7f1fa7932640 1 -- 172.21.15.157:0/2873293842 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f980aa830 con 0x5572f78dff00 2024-05-09T09:47:32.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.943+0000 7f1faae19980 1 -- 172.21.15.157:0/2873293842 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f78dff00 msgr2=0x5572f78e02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.943+0000 7f1faae19980 1 --2- 172.21.15.157:0/2873293842 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f78dff00 0x5572f78e02e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800a480 tx=0x7f1f9801b280 comp rx=0 tx=0).stop 2024-05-09T09:47:32.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.943+0000 7f1faae19980 1 -- 172.21.15.157:0/2873293842 shutdown_connections 2024-05-09T09:47:32.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.943+0000 7f1faae19980 1 --2- 172.21.15.157:0/2873293842 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f78dff00 0x5572f78e02e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.943+0000 7f1faae19980 1 -- 172.21.15.157:0/2873293842 >> 172.21.15.157:0/2873293842 conn(0x5572f78532a0 msgr2=0x5572f78536b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:32.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.943+0000 7f1faae19980 1 -- 172.21.15.157:0/2873293842 shutdown_connections 2024-05-09T09:47:32.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.943+0000 7f1faae19980 1 -- 172.21.15.157:0/2873293842 wait complete. 2024-05-09T09:47:32.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.963+0000 7f1faae19980 1 Processor -- start 2024-05-09T09:47:32.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.963+0000 7f1faae19980 1 -- start start 2024-05-09T09:47:32.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.963+0000 7f1faae19980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f78dff00 0x5572f79cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.963+0000 7f1faae19980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5572f77e0fe0 con 0x5572f78dff00 2024-05-09T09:47:32.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.963+0000 7f1fa8934640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f78dff00 0x5572f79cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.963+0000 7f1fa8934640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f78dff00 0x5572f79cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54048/0 (socket says 172.21.15.157:54048) 2024-05-09T09:47:32.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.963+0000 7f1fa8934640 1 -- 172.21.15.157:0/3734525667 learned_addr learned my addr 172.21.15.157:0/3734525667 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:32.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.963+0000 7f1fa8934640 1 -- 172.21.15.157:0/3734525667 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572f7765ae0 con 0x5572f78dff00 2024-05-09T09:47:32.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.963+0000 7f1fa8934640 1 --2- 172.21.15.157:0/3734525667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f78dff00 0x5572f79cb350 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1f980ad040 tx=0x7f1f98003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32822be53644b87 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.963+0000 7f1e96e0d640 1 -- 172.21.15.157:0/3734525667 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f980af040 con 0x5572f78dff00 2024-05-09T09:47:32.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.963+0000 7f1e96e0d640 1 -- 172.21.15.157:0/3734525667 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f9800a300 con 0x5572f78dff00 2024-05-09T09:47:32.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.963+0000 7f1e96e0d640 1 -- 172.21.15.157:0/3734525667 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f980aa810 con 0x5572f78dff00 2024-05-09T09:47:32.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.963+0000 7f1faae19980 1 -- 172.21.15.157:0/3734525667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f78dff00 msgr2=0x5572f79cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.963+0000 7f1faae19980 1 --2- 172.21.15.157:0/3734525667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f78dff00 0x5572f79cb350 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1f980ad040 tx=0x7f1f98003030 comp rx=0 tx=0).stop 2024-05-09T09:47:32.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.963+0000 7f1faae19980 1 -- 172.21.15.157:0/3734525667 shutdown_connections 2024-05-09T09:47:32.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.963+0000 7f1faae19980 1 --2- 172.21.15.157:0/3734525667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f78dff00 0x5572f79cb350 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.963+0000 7f1faae19980 1 -- 172.21.15.157:0/3734525667 >> 172.21.15.157:0/3734525667 conn(0x5572f78532a0 msgr2=0x5572f79c6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:32.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.963+0000 7f1faae19980 1 -- 172.21.15.157:0/3734525667 shutdown_connections 2024-05-09T09:47:32.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.963+0000 7f1faae19980 1 -- 172.21.15.157:0/3734525667 wait complete. 2024-05-09T09:47:32.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.963+0000 7f1faae19980 1 Processor -- start 2024-05-09T09:47:32.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.963+0000 7f1faae19980 1 -- start start 2024-05-09T09:47:32.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.967+0000 7f1faae19980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f78dff00 0x5572f79d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.967+0000 7f1faae19980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5572f78e9b30 con 0x5572f78dff00 2024-05-09T09:47:32.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.967+0000 7f1fa8934640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f78dff00 0x5572f79d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.967+0000 7f1fa8934640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f78dff00 0x5572f79d22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54058/0 (socket says 172.21.15.157:54058) 2024-05-09T09:47:32.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.967+0000 7f1fa8934640 1 -- 172.21.15.157:0/1419315003 learned_addr learned my addr 172.21.15.157:0/1419315003 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:32.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.967+0000 7f1fa8934640 1 -- 172.21.15.157:0/1419315003 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572f79d2820 con 0x5572f78dff00 2024-05-09T09:47:32.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.967+0000 7f1fa8934640 1 --2- 172.21.15.157:0/1419315003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f78dff00 0x5572f79d22e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1f98019930 tx=0x7f1f98018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.967+0000 7f1e9560a640 1 -- 172.21.15.157:0/1419315003 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f980af040 con 0x5572f78dff00 2024-05-09T09:47:32.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.967+0000 7f1e9560a640 1 -- 172.21.15.157:0/1419315003 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f980bf870 con 0x5572f78dff00 2024-05-09T09:47:32.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.967+0000 7f1e9560a640 1 -- 172.21.15.157:0/1419315003 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f980bfb50 con 0x5572f78dff00 2024-05-09T09:47:32.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.967+0000 7f1faae19980 1 -- 172.21.15.157:0/1419315003 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572f79d2ab0 con 0x5572f78dff00 2024-05-09T09:47:32.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.967+0000 7f1faae19980 1 -- 172.21.15.157:0/1419315003 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572f79d5740 con 0x5572f78dff00 2024-05-09T09:47:32.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.967+0000 7f1e9560a640 1 -- 172.21.15.157:0/1419315003 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f1f980b5470 con 0x5572f78dff00 2024-05-09T09:47:32.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.967+0000 7f1e9560a640 1 --2- 172.21.15.157:0/1419315003 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e90034bb0 0x7f1e90037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.967+0000 7f1e9560a640 1 -- 172.21.15.157:0/1419315003 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f1f980ba070 con 0x5572f78dff00 2024-05-09T09:47:32.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.967+0000 7f1fa8133640 1 --2- 172.21.15.157:0/1419315003 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e90034bb0 0x7f1e90037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.967+0000 7f1faae19980 1 --2- 172.21.15.157:0/1419315003 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5572f78e0dc0 0x5572f79d9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.967+0000 7f1faae19980 1 -- 172.21.15.157:0/1419315003 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572f79d9840 con 0x5572f78e0dc0 2024-05-09T09:47:32.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.967+0000 7f1fa9135640 1 --2- 172.21.15.157:0/1419315003 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5572f78e0dc0 0x5572f79d9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.967+0000 7f1fa8133640 1 --2- 172.21.15.157:0/1419315003 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e90034bb0 0x7f1e90037070 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c000f70 tx=0x7f1f9c0012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.971+0000 7f1fa9135640 1 --2- 172.21.15.157:0/1419315003 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5572f78e0dc0 0x5572f79d9220 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.971+0000 7f1fa9135640 1 -- 172.21.15.157:0/1419315003 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f78e0dc0 2024-05-09T09:47:32.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.971+0000 7f1faae19980 1 -- 172.21.15.157:0/1419315003 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572f79d6960 con 0x5572f78e0dc0 2024-05-09T09:47:32.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.971+0000 7f1fa9135640 1 -- 172.21.15.157:0/1419315003 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f78e0dc0 2024-05-09T09:47:32.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.971+0000 7f1faae19980 1 --2- 172.21.15.157:0/1419315003 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5572f79dbb90 0x5572f79ddf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.971+0000 7f1faae19980 1 -- 172.21.15.157:0/1419315003 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572f79de650 con 0x5572f79dbb90 2024-05-09T09:47:32.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.971+0000 7f1fa8934640 1 --2- 172.21.15.157:0/1419315003 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5572f79dbb90 0x5572f79ddf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.971+0000 7f1fa8934640 1 --2- 172.21.15.157:0/1419315003 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5572f79dbb90 0x5572f79ddf80 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.971+0000 7f1fa8934640 1 -- 172.21.15.157:0/1419315003 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1f980b2040 con 0x5572f79dbb90 2024-05-09T09:47:32.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.971+0000 7f1faae19980 1 -- 172.21.15.157:0/1419315003 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572f79daa30 con 0x5572f78e0dc0 2024-05-09T09:47:32.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.971+0000 7f1fa9135640 1 -- 172.21.15.157:0/1419315003 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f78e0dc0 2024-05-09T09:47:32.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.971+0000 7f1faae19980 1 --2- 172.21.15.157:0/1419315003 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5572f79dfa90 0x5572f79e1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.971+0000 7f1faae19980 1 -- 172.21.15.157:0/1419315003 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572f79e25f0 con 0x5572f79dfa90 2024-05-09T09:47:32.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.971+0000 7f1fa8133640 1 --2- 172.21.15.157:0/1419315003 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5572f79dfa90 0x5572f79e1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.971+0000 7f1fa8133640 1 --2- 172.21.15.157:0/1419315003 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5572f79dfa90 0x5572f79e1e80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.975+0000 7f1fa8133640 1 -- 172.21.15.157:0/1419315003 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1f9c00e620 con 0x5572f79dfa90 2024-05-09T09:47:32.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.975+0000 7f1faae19980 1 Processor -- start 2024-05-09T09:47:32.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.975+0000 7f1faae19980 1 -- start start 2024-05-09T09:47:32.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.979+0000 7f1faae19980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f7a08630 0x5572f7a08a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.979+0000 7f1faae19980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5572f77e5020 con 0x5572f7a08630 2024-05-09T09:47:32.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.979+0000 7f1fa8934640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f7a08630 0x5572f7a08a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.979+0000 7f1fa8934640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f7a08630 0x5572f7a08a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54068/0 (socket says 172.21.15.157:54068) 2024-05-09T09:47:32.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.979+0000 7f1fa8934640 1 -- 172.21.15.157:0/2968797865 learned_addr learned my addr 172.21.15.157:0/2968797865 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:32.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.979+0000 7f1fa8934640 1 -- 172.21.15.157:0/2968797865 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572f7a08f90 con 0x5572f7a08630 2024-05-09T09:47:32.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.979+0000 7f1fa8934640 1 --2- 172.21.15.157:0/2968797865 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f7a08630 0x5572f7a08a50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1f980e5010 tx=0x7f1f980a9f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.979+0000 7f1e8d39f640 1 -- 172.21.15.157:0/2968797865 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f980b6130 con 0x5572f7a08630 2024-05-09T09:47:32.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.979+0000 7f1e8d39f640 1 -- 172.21.15.157:0/2968797865 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f980b62d0 con 0x5572f7a08630 2024-05-09T09:47:32.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.979+0000 7f1e8d39f640 1 -- 172.21.15.157:0/2968797865 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f980a9860 con 0x5572f7a08630 2024-05-09T09:47:32.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.979+0000 7f1faae19980 1 -- 172.21.15.157:0/2968797865 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572f7a09a20 con 0x5572f7a08630 2024-05-09T09:47:32.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.979+0000 7f1faae19980 1 -- 172.21.15.157:0/2968797865 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572f7a09a20 con 0x5572f7a08630 2024-05-09T09:47:32.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.979+0000 7f1e8d39f640 1 -- 172.21.15.157:0/2968797865 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f1f980c6a40 con 0x5572f7a08630 2024-05-09T09:47:32.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.979+0000 7f1e8d39f640 1 --2- 172.21.15.157:0/2968797865 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e80034c00 0x7f1e800370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.979+0000 7f1e8d39f640 1 -- 172.21.15.157:0/2968797865 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f1f980e70c0 con 0x5572f7a08630 2024-05-09T09:47:32.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.979+0000 7f1fa8133640 1 --2- 172.21.15.157:0/2968797865 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e80034c00 0x7f1e800370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.979+0000 7f1faae19980 1 Processor -- start 2024-05-09T09:47:32.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.979+0000 7f1faae19980 1 -- start start 2024-05-09T09:47:32.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.979+0000 7f1faae19980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f7a15480 0x5572f7a158a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.979+0000 7f1faae19980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5572f79cb9e0 con 0x5572f7a15480 2024-05-09T09:47:32.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.979+0000 7f1fa8133640 1 --2- 172.21.15.157:0/2968797865 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e80034c00 0x7f1e800370c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c00bf60 tx=0x7f1f9c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.983+0000 7f1fa8934640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f7a15480 0x5572f7a158a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.983+0000 7f1fa8934640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f7a15480 0x5572f7a158a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54080/0 (socket says 172.21.15.157:54080) 2024-05-09T09:47:32.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.983+0000 7f1fa8934640 1 -- 172.21.15.157:0/4254534316 learned_addr learned my addr 172.21.15.157:0/4254534316 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:32.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.983+0000 7f1fa8934640 1 -- 172.21.15.157:0/4254534316 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572f7a15e70 con 0x5572f7a15480 2024-05-09T09:47:32.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.983+0000 7f1fa8934640 1 --2- 172.21.15.157:0/4254534316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f7a15480 0x5572f7a158a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1f980b5e40 tx=0x7f1f980eed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcbdb5cd22e28b4a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.983+0000 7f1e86ffd640 1 -- 172.21.15.157:0/4254534316 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f980fe070 con 0x5572f7a15480 2024-05-09T09:47:32.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.983+0000 7f1e86ffd640 1 -- 172.21.15.157:0/4254534316 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f980c6d30 con 0x5572f7a15480 2024-05-09T09:47:32.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.983+0000 7f1e86ffd640 1 -- 172.21.15.157:0/4254534316 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f980e50b0 con 0x5572f7a15480 2024-05-09T09:47:32.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.983+0000 7f1faae19980 1 -- 172.21.15.157:0/4254534316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f7a15480 msgr2=0x5572f7a158a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:32.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.983+0000 7f1faae19980 1 --2- 172.21.15.157:0/4254534316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f7a15480 0x5572f7a158a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1f980b5e40 tx=0x7f1f980eed10 comp rx=0 tx=0).stop 2024-05-09T09:47:32.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.983+0000 7f1faae19980 1 -- 172.21.15.157:0/4254534316 shutdown_connections 2024-05-09T09:47:32.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.983+0000 7f1faae19980 1 --2- 172.21.15.157:0/4254534316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f7a15480 0x5572f7a158a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:32.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.983+0000 7f1faae19980 1 -- 172.21.15.157:0/4254534316 >> 172.21.15.157:0/4254534316 conn(0x5572f7a11800 msgr2=0x5572f7a0f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:32.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.983+0000 7f1faae19980 1 -- 172.21.15.157:0/4254534316 shutdown_connections 2024-05-09T09:47:32.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.983+0000 7f1faae19980 1 -- 172.21.15.157:0/4254534316 wait complete. 2024-05-09T09:47:32.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.983+0000 7f1faae19980 1 Processor -- start 2024-05-09T09:47:32.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.983+0000 7f1faae19980 1 -- start start 2024-05-09T09:47:32.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.983+0000 7f1faae19980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f7a15480 0x5572f7a1c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.983+0000 7f1faae19980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5572f7a16540 con 0x5572f7a15480 2024-05-09T09:47:32.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.983+0000 7f1fa8934640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f7a15480 0x5572f7a1c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.983+0000 7f1fa8934640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f7a15480 0x5572f7a1c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54090/0 (socket says 172.21.15.157:54090) 2024-05-09T09:47:32.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.983+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 learned_addr learned my addr 172.21.15.157:0/1306924244 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:32.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.983+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572f7a1cd20 con 0x5572f7a15480 2024-05-09T09:47:32.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1fa8934640 1 --2- 172.21.15.157:0/1306924244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f7a15480 0x5572f7a1c7e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1f9801b0b0 tx=0x7f1f980d5ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1e857fa640 1 -- 172.21.15.157:0/1306924244 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f98109020 con 0x5572f7a15480 2024-05-09T09:47:32.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572f7a1cd20 con 0x5572f7a15480 2024-05-09T09:47:32.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1e857fa640 1 -- 172.21.15.157:0/1306924244 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f980ff040 con 0x5572f7a15480 2024-05-09T09:47:32.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1e857fa640 1 -- 172.21.15.157:0/1306924244 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f980fe070 con 0x5572f7a15480 2024-05-09T09:47:32.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572f7a1cd20 con 0x5572f7a15480 2024-05-09T09:47:32.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1e857fa640 1 -- 172.21.15.157:0/1306924244 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f1f9810c020 con 0x5572f7a15480 2024-05-09T09:47:32.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1faae19980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1e857fa640 1 --2- 172.21.15.157:0/1306924244 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e70034b60 0x7f1e70037020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1e857fa640 1 -- 172.21.15.157:0/1306924244 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f1f9810fc60 con 0x5572f7a15480 2024-05-09T09:47:32.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1fa8133640 1 --2- 172.21.15.157:0/1306924244 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e70034b60 0x7f1e70037020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1faae19980 1 --2- 172.21.15.157:0/1306924244 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5572f7a293c0 0x5572f7a2b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2bfd0 con 0x5572f7a293c0 2024-05-09T09:47:32.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1fa9135640 1 --2- 172.21.15.157:0/1306924244 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5572f7a293c0 0x5572f7a2b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1fa8133640 1 --2- 172.21.15.157:0/1306924244 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e70034b60 0x7f1e70037020 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x5572f79e29f0 tx=0x7f1f9c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1fa9135640 1 --2- 172.21.15.157:0/1306924244 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5572f7a293c0 0x5572f7a2b880 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:32.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1faae19980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:32.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1faae19980 20 realm 2024-05-09T09:47:32.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1faae19980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2c3e0 con 0x5572f7a293c0 2024-05-09T09:47:32.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:32.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1faae19980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:32.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1faae19980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:32.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1faae19980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2cc80 con 0x5572f7a293c0 2024-05-09T09:47:32.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:32.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1faae19980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:32.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1faae19980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.987+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x5572f7a293c0 2024-05-09T09:47:32.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.991+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:32.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.991+0000 7f1faae19980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:32.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.991+0000 7f1faae19980 20 rados->read ofs=0 len=0 2024-05-09T09:47:32.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.991+0000 7f1faae19980 1 --2- 172.21.15.157:0/1306924244 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5572f7a2dd80 0x5572f7a30170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.991+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a306b0 con 0x5572f7a2dd80 2024-05-09T09:47:32.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.991+0000 7f1fa8934640 1 --2- 172.21.15.157:0/1306924244 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5572f7a2dd80 0x5572f7a30170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.991+0000 7f1fa8934640 1 --2- 172.21.15.157:0/1306924244 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5572f7a2dd80 0x5572f7a30170 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.991+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1f980eb020 con 0x5572f7a2dd80 2024-05-09T09:47:32.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.991+0000 7f1faae19980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:32.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.991+0000 7f1faae19980 20 searching for the correct realm 2024-05-09T09:47:32.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.991+0000 7f1faae19980 1 --2- 172.21.15.157:0/1306924244 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5572f7a32620 0x5572f7a34ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.991+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a351b0 con 0x5572f7a32620 2024-05-09T09:47:32.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.991+0000 7f1fa8133640 1 --2- 172.21.15.157:0/1306924244 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5572f7a32620 0x5572f7a34ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.991+0000 7f1fa8133640 1 --2- 172.21.15.157:0/1306924244 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5572f7a32620 0x5572f7a34ae0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.991+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f9c00e620 con 0x5572f7a32620 2024-05-09T09:47:32.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.991+0000 7f1fa8133640 1 --2- 172.21.15.157:0/1306924244 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f1f9c037040 0x7f1f9c036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:32.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.991+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a351b0 con 0x7f1f9c037040 2024-05-09T09:47:32.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.991+0000 7f1fa9135640 1 --2- 172.21.15.157:0/1306924244 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f1f9c037040 0x7f1f9c036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:32.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.991+0000 7f1fa9135640 1 --2- 172.21.15.157:0/1306924244 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f1f9c037040 0x7f1f9c036410 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:32.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.991+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa000a4d0 con 0x7f1f9c037040 2024-05-09T09:47:32.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.991+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x5572f7a2dd80 2024-05-09T09:47:32.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.995+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f980eb020 con 0x5572f7a2dd80 2024-05-09T09:47:32.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.995+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x5572f7a293c0 2024-05-09T09:47:32.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.995+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:32.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.995+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x5572f7a293c0 2024-05-09T09:47:32.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.995+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:32.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.995+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x5572f7a2dd80 2024-05-09T09:47:32.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.995+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f980eb020 con 0x5572f7a2dd80 2024-05-09T09:47:32.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.995+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x5572f7a2dd80 2024-05-09T09:47:32.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.995+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f980eb020 con 0x5572f7a2dd80 2024-05-09T09:47:32.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.995+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x7f1f9c037040 2024-05-09T09:47:32.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.995+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa000a4d0 con 0x7f1f9c037040 2024-05-09T09:47:32.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.995+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x5572f7a32620 2024-05-09T09:47:32.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.995+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f9c00e620 con 0x5572f7a32620 2024-05-09T09:47:32.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.995+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x5572f7a293c0 2024-05-09T09:47:32.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.995+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:32.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.995+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x5572f7a2dd80 2024-05-09T09:47:32.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.999+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f980eb020 con 0x5572f7a2dd80 2024-05-09T09:47:32.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.999+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x5572f7a293c0 2024-05-09T09:47:32.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.999+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:32.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.999+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x7f1f9c037040 2024-05-09T09:47:32.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.999+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1fa000a4d0 con 0x7f1f9c037040 2024-05-09T09:47:32.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.999+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x5572f7a32620 2024-05-09T09:47:32.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.999+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f9c00e620 con 0x5572f7a32620 2024-05-09T09:47:32.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.999+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x5572f7a32620 2024-05-09T09:47:32.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.999+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1f9c00e620 con 0x5572f7a32620 2024-05-09T09:47:32.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.999+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x5572f7a2dd80 2024-05-09T09:47:32.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.999+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f980eb020 con 0x5572f7a2dd80 2024-05-09T09:47:32.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.999+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x5572f7a32620 2024-05-09T09:47:32.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.999+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f9c00e620 con 0x5572f7a32620 2024-05-09T09:47:32.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.999+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x5572f7a32620 2024-05-09T09:47:33.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.999+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f9c00e620 con 0x5572f7a32620 2024-05-09T09:47:33.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.999+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x5572f7a293c0 2024-05-09T09:47:33.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.999+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:33.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.999+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x5572f7a293c0 2024-05-09T09:47:33.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.999+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:33.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:32.999+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x5572f7a2dd80 2024-05-09T09:47:33.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.003+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f980eb020 con 0x5572f7a2dd80 2024-05-09T09:47:33.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.003+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x5572f7a32620 2024-05-09T09:47:33.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.003+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f9c00e620 con 0x5572f7a32620 2024-05-09T09:47:33.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.003+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x7f1f9c037040 2024-05-09T09:47:33.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.003+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa000a4d0 con 0x7f1f9c037040 2024-05-09T09:47:33.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.003+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x5572f7a293c0 2024-05-09T09:47:33.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.003+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:33.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.003+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x5572f7a2dd80 2024-05-09T09:47:33.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.003+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1f980eb020 con 0x5572f7a2dd80 2024-05-09T09:47:33.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.003+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x5572f7a32620 2024-05-09T09:47:33.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.003+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f9c00e620 con 0x5572f7a32620 2024-05-09T09:47:33.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.003+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x5572f7a2dd80 2024-05-09T09:47:33.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.003+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f980eb020 con 0x5572f7a2dd80 2024-05-09T09:47:33.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.003+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x7f1f9c037040 2024-05-09T09:47:33.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.003+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa000a4d0 con 0x7f1f9c037040 2024-05-09T09:47:33.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.003+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x5572f7a32620 2024-05-09T09:47:33.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.003+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f9c00e620 con 0x5572f7a32620 2024-05-09T09:47:33.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x5572f7a2dd80 2024-05-09T09:47:33.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f980eb020 con 0x5572f7a2dd80 2024-05-09T09:47:33.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x5572f7a293c0 2024-05-09T09:47:33.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:33.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a2d020 con 0x7f1f9c037040 2024-05-09T09:47:33.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fa000a4d0 con 0x7f1f9c037040 2024-05-09T09:47:33.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:33.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:33.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:33.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:33.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:33.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:33.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a30f00 con 0x5572f7a293c0 2024-05-09T09:47:33.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:33.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:33.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a30f00 con 0x5572f7a293c0 2024-05-09T09:47:33.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:33.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:33.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a30f00 con 0x5572f7a32620 2024-05-09T09:47:33.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1f9c00e620 con 0x5572f7a32620 2024-05-09T09:47:33.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:33.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 20 zone default found 2024-05-09T09:47:33.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 4 Realm: () 2024-05-09T09:47:33.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:33.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:33.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:33.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 20 zonegroup default 2024-05-09T09:47:33.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a317a0 con 0x5572f7a2dd80 2024-05-09T09:47:33.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1f980eb020 con 0x5572f7a2dd80 2024-05-09T09:47:33.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:33.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a37010 con 0x5572f7a32620 2024-05-09T09:47:33.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1f9c00e620 con 0x5572f7a32620 2024-05-09T09:47:33.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:33.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a373b0 con 0x5572f7a32620 2024-05-09T09:47:33.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1f9c00e620 con 0x5572f7a32620 2024-05-09T09:47:33.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:33.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 20 started sync module instance, tier type = 2024-05-09T09:47:33.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:33.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.007+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a364b0 con 0x7f1f9c037040 2024-05-09T09:47:33.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.011+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x7f1f9c037040 2024-05-09T09:47:33.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.011+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93952269314528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a364b0 con 0x7f1f9c037040 2024-05-09T09:47:33.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.011+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a37e80 con 0x5572f7a293c0 2024-05-09T09:47:33.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.011+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93952269314528] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x7f1f9c037040 2024-05-09T09:47:33.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.011+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:33.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.011+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93952269318496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a364b0 con 0x5572f7a293c0 2024-05-09T09:47:33.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.011+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a38890 con 0x5572f7a32620 2024-05-09T09:47:33.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.015+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93952269318496] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:33.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.015+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f9c00e620 con 0x5572f7a32620 2024-05-09T09:47:33.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.015+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93952269312000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a36420 con 0x5572f7a32620 2024-05-09T09:47:33.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.015+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a39600 con 0x7f1f9c037040 2024-05-09T09:47:33.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.015+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x7f1f9c037040 2024-05-09T09:47:33.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.015+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93952269324592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a39ea0 con 0x7f1f9c037040 2024-05-09T09:47:33.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.015+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a3a860 con 0x5572f7a293c0 2024-05-09T09:47:33.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.015+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93952269312000] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f9c00e620 con 0x5572f7a32620 2024-05-09T09:47:33.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.019+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93952269324592] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x7f1f9c037040 2024-05-09T09:47:33.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.019+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:33.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.019+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93952269329328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a3a7d0 con 0x5572f7a293c0 2024-05-09T09:47:33.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.019+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a39e00 con 0x5572f7a2dd80 2024-05-09T09:47:33.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.019+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93952269329328] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:33.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.019+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f980eb020 con 0x5572f7a2dd80 2024-05-09T09:47:33.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.019+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93952269326672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a3b100 con 0x5572f7a2dd80 2024-05-09T09:47:33.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.019+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a3b950 con 0x5572f7a2dd80 2024-05-09T09:47:33.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.023+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93952269326672] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f980eb020 con 0x5572f7a2dd80 2024-05-09T09:47:33.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.023+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f980eb020 con 0x5572f7a2dd80 2024-05-09T09:47:33.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.023+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93952269331536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a3c1a0 con 0x5572f7a2dd80 2024-05-09T09:47:33.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.023+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a3ca30 con 0x5572f7a2dd80 2024-05-09T09:47:33.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.027+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f980eb020 con 0x5572f7a2dd80 2024-05-09T09:47:33.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.027+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93952269336992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a3d0c0 con 0x5572f7a2dd80 2024-05-09T09:47:33.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.027+0000 7f1faae19980 20 add_watcher() i=0 2024-05-09T09:47:33.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.027+0000 7f1faae19980 20 add_watcher() i=1 2024-05-09T09:47:33.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.027+0000 7f1faae19980 20 add_watcher() i=2 2024-05-09T09:47:33.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.027+0000 7f1faae19980 20 add_watcher() i=3 2024-05-09T09:47:33.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.027+0000 7f1faae19980 20 add_watcher() i=4 2024-05-09T09:47:33.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.027+0000 7f1faae19980 20 add_watcher() i=5 2024-05-09T09:47:33.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.027+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93952269331536] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f980eb020 con 0x5572f7a2dd80 2024-05-09T09:47:33.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.027+0000 7f1faae19980 20 add_watcher() i=6 2024-05-09T09:47:33.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.027+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93952269336992] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f980eb020 con 0x5572f7a2dd80 2024-05-09T09:47:33.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.027+0000 7f1faae19980 20 add_watcher() i=7 2024-05-09T09:47:33.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.027+0000 7f1faae19980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:33.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.027+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a3ffe0 con 0x5572f7a293c0 2024-05-09T09:47:33.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.027+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:33.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.027+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93952269339392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a3d3d0 con 0x5572f7a293c0 2024-05-09T09:47:33.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.031+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93952269339392] v30'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:33.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.031+0000 7f1e5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:33.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.031+0000 7f1faae19980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:33.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.031+0000 7f1faae19980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:33.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.031+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a48480 con 0x5572f7a293c0 2024-05-09T09:47:33.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.031+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:33.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.031+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a48a30 con 0x5572f7a2dd80 2024-05-09T09:47:33.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.035+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f980eb020 con 0x5572f7a2dd80 2024-05-09T09:47:33.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.035+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a48a30 con 0x5572f7a32620 2024-05-09T09:47:33.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.035+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f9c00e620 con 0x5572f7a32620 2024-05-09T09:47:33.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.035+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a49020 con 0x5572f7a293c0 2024-05-09T09:47:33.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.035+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'80 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:33.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.035+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a494d0 con 0x7f1f9c037040 2024-05-09T09:47:33.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.039+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'53 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x7f1f9c037040 2024-05-09T09:47:33.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.039+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a464a0 con 0x5572f7a32620 2024-05-09T09:47:33.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.039+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'35 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f9c00e620 con 0x5572f7a32620 2024-05-09T09:47:33.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.039+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a464a0 con 0x5572f7a293c0 2024-05-09T09:47:33.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.039+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:33.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.039+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a4a030 con 0x5572f7a2dd80 2024-05-09T09:47:33.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.043+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'35 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f980eb020 con 0x5572f7a2dd80 2024-05-09T09:47:33.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.043+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a4a470 con 0x7f1f9c037040 2024-05-09T09:47:33.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.047+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x7f1f9c037040 2024-05-09T09:47:33.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.047+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a4a470 con 0x5572f7a32620 2024-05-09T09:47:33.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.047+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'27 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f9c00e620 con 0x5572f7a32620 2024-05-09T09:47:33.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.047+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a4a470 con 0x7f1f9c037040 2024-05-09T09:47:33.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.047+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'54 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x7f1f9c037040 2024-05-09T09:47:33.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.047+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a4a470 con 0x5572f7a2dd80 2024-05-09T09:47:33.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.051+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f980eb020 con 0x5572f7a2dd80 2024-05-09T09:47:33.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.051+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a4a470 con 0x7f1f9c037040 2024-05-09T09:47:33.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.051+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x7f1f9c037040 2024-05-09T09:47:33.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.051+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a4a470 con 0x5572f7a2dd80 2024-05-09T09:47:33.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.055+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'41 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f980eb020 con 0x5572f7a2dd80 2024-05-09T09:47:33.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.055+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a4a470 con 0x5572f7a293c0 2024-05-09T09:47:33.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.055+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'81 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:33.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.055+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a4a470 con 0x5572f7a32620 2024-05-09T09:47:33.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.055+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'47 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f9c00e620 con 0x5572f7a32620 2024-05-09T09:47:33.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.055+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a4a470 con 0x7f1f9c037040 2024-05-09T09:47:33.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.059+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'55 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x7f1f9c037040 2024-05-09T09:47:33.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.059+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a4a470 con 0x5572f7a32620 2024-05-09T09:47:33.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.059+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f9c00e620 con 0x5572f7a32620 2024-05-09T09:47:33.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.059+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a4a470 con 0x5572f7a293c0 2024-05-09T09:47:33.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.063+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'29 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:33.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.063+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a4a470 con 0x5572f7a293c0 2024-05-09T09:47:33.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.063+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'82 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:33.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.063+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a4a470 con 0x5572f7a32620 2024-05-09T09:47:33.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.063+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'48 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f9c00e620 con 0x5572f7a32620 2024-05-09T09:47:33.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.063+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a4a470 con 0x7f1f9c037040 2024-05-09T09:47:33.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.067+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'31 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x7f1f9c037040 2024-05-09T09:47:33.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.067+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a4a470 con 0x5572f7a32620 2024-05-09T09:47:33.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.067+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f9c00e620 con 0x5572f7a32620 2024-05-09T09:47:33.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.067+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a4a470 con 0x5572f7a32620 2024-05-09T09:47:33.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.067+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f9c00e620 con 0x5572f7a32620 2024-05-09T09:47:33.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.067+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a4a470 con 0x5572f7a32620 2024-05-09T09:47:33.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.071+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f9c00e620 con 0x5572f7a32620 2024-05-09T09:47:33.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.071+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a4a470 con 0x5572f7a32620 2024-05-09T09:47:33.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.071+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'36 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f9c00e620 con 0x5572f7a32620 2024-05-09T09:47:33.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.071+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a4a470 con 0x5572f7a2dd80 2024-05-09T09:47:33.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.075+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f980eb020 con 0x5572f7a2dd80 2024-05-09T09:47:33.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.075+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a4a470 con 0x5572f7a32620 2024-05-09T09:47:33.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.075+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f9c00e620 con 0x5572f7a32620 2024-05-09T09:47:33.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.075+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a4a470 con 0x5572f7a2dd80 2024-05-09T09:47:33.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.075+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'36 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f980eb020 con 0x5572f7a2dd80 2024-05-09T09:47:33.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.079+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a4a470 con 0x5572f7a32620 2024-05-09T09:47:33.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.079+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'49 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f9c00e620 con 0x5572f7a32620 2024-05-09T09:47:33.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.079+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a4a470 con 0x5572f7a2dd80 2024-05-09T09:47:33.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.083+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'42 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f980eb020 con 0x5572f7a2dd80 2024-05-09T09:47:33.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.083+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a4a470 con 0x7f1f9c037040 2024-05-09T09:47:33.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.083+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x7f1f9c037040 2024-05-09T09:47:33.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.083+0000 7f1e5cfe1640 20 reqs_thread_entry: start 2024-05-09T09:47:33.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.083+0000 7f1faae19980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:33.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.083+0000 7f1dd67fc640 20 reqs_thread_entry: start 2024-05-09T09:47:33.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.083+0000 7f1faae19980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.083+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a452a0 con 0x5572f7a293c0 2024-05-09T09:47:33.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.087+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:33.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.087+0000 7f1faae19980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:47:33.084 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-09T09:47:32.044078Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:47:32.044055Z","tags":[],"group_ids":[]} 2024-05-09T09:47:33.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.087+0000 7f1e5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:33.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.087+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93952269339392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a41da0 con 0x5572f7a293c0 2024-05-09T09:47:33.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.087+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93952269339392] v30'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:33.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.087+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93952269314528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a3cb00 con 0x7f1f9c037040 2024-05-09T09:47:33.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.091+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93952269314528] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x7f1f9c037040 2024-05-09T09:47:33.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.091+0000 7f1faae19980 20 remove_watcher() i=0 2024-05-09T09:47:33.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.091+0000 7f1faae19980 2 removed watcher, disabling cache 2024-05-09T09:47:33.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.091+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93952269318496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a3cb00 con 0x5572f7a293c0 2024-05-09T09:47:33.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.091+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93952269318496] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:33.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.091+0000 7f1faae19980 20 remove_watcher() i=1 2024-05-09T09:47:33.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.091+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93952269312000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a37960 con 0x5572f7a32620 2024-05-09T09:47:33.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.095+0000 7f1fa8133640 1 -- 172.21.15.157:0/1306924244 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93952269312000] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f9c00e620 con 0x5572f7a32620 2024-05-09T09:47:33.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.095+0000 7f1faae19980 20 remove_watcher() i=2 2024-05-09T09:47:33.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.095+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93952269324592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a3cb00 con 0x7f1f9c037040 2024-05-09T09:47:33.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.095+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93952269324592] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x7f1f9c037040 2024-05-09T09:47:33.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.095+0000 7f1faae19980 20 remove_watcher() i=3 2024-05-09T09:47:33.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.095+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93952269329328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a36000 con 0x5572f7a293c0 2024-05-09T09:47:33.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.099+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93952269329328] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fa000a4d0 con 0x5572f7a293c0 2024-05-09T09:47:33.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.099+0000 7f1faae19980 20 remove_watcher() i=4 2024-05-09T09:47:33.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.099+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93952269326672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a37960 con 0x5572f7a2dd80 2024-05-09T09:47:33.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.099+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93952269326672] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f980eb020 con 0x5572f7a2dd80 2024-05-09T09:47:33.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.099+0000 7f1faae19980 20 remove_watcher() i=5 2024-05-09T09:47:33.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.099+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93952269331536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a39130 con 0x5572f7a2dd80 2024-05-09T09:47:33.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.103+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93952269331536] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f980eb020 con 0x5572f7a2dd80 2024-05-09T09:47:33.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.103+0000 7f1faae19980 20 remove_watcher() i=6 2024-05-09T09:47:33.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.103+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93952269336992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572f7a3cb00 con 0x5572f7a2dd80 2024-05-09T09:47:33.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.103+0000 7f1fa8934640 1 -- 172.21.15.157:0/1306924244 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93952269336992] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f980eb020 con 0x5572f7a2dd80 2024-05-09T09:47:33.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.103+0000 7f1faae19980 20 remove_watcher() i=7 2024-05-09T09:47:33.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.103+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5572f7a2dd80 msgr2=0x5572f7a30170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 --2- 172.21.15.157:0/1306924244 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5572f7a2dd80 0x5572f7a30170 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5572f7a293c0 msgr2=0x5572f7a2b880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 --2- 172.21.15.157:0/1306924244 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5572f7a293c0 0x5572f7a2b880 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f1f9c037040 msgr2=0x7f1f9c036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 --2- 172.21.15.157:0/1306924244 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f1f9c037040 0x7f1f9c036410 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5572f7a32620 msgr2=0x5572f7a34ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 --2- 172.21.15.157:0/1306924244 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5572f7a32620 0x5572f7a34ae0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e70034b60 msgr2=0x7f1e70037020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 --2- 172.21.15.157:0/1306924244 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e70034b60 0x7f1e70037020 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x5572f79e29f0 tx=0x7f1f9c010000 comp rx=0 tx=0).stop 2024-05-09T09:47:33.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1fa9135640 1 -- 172.21.15.157:0/1306924244 reap_dead start 2024-05-09T09:47:33.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f7a15480 msgr2=0x5572f7a1c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 --2- 172.21.15.157:0/1306924244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f7a15480 0x5572f7a1c7e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1f9801b0b0 tx=0x7f1f980d5ef0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 shutdown_connections 2024-05-09T09:47:33.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 --2- 172.21.15.157:0/1306924244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f7a15480 0x5572f7a1c7e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 >> 172.21.15.157:0/1306924244 conn(0x5572f7a11800 msgr2=0x5572f7a0f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:33.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 shutdown_connections 2024-05-09T09:47:33.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 -- 172.21.15.157:0/1306924244 wait complete. 2024-05-09T09:47:33.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 -- 172.21.15.157:0/2968797865 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e80034c00 msgr2=0x7f1e800370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 --2- 172.21.15.157:0/2968797865 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e80034c00 0x7f1e800370c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c00bf60 tx=0x7f1f9c00f000 comp rx=0 tx=0).stop 2024-05-09T09:47:33.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 -- 172.21.15.157:0/2968797865 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f7a08630 msgr2=0x5572f7a08a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 --2- 172.21.15.157:0/2968797865 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f7a08630 0x5572f7a08a50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1f980e5010 tx=0x7f1f980a9f20 comp rx=0 tx=0).stop 2024-05-09T09:47:33.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 -- 172.21.15.157:0/2968797865 shutdown_connections 2024-05-09T09:47:33.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 --2- 172.21.15.157:0/2968797865 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e80034c00 0x7f1e800370c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 --2- 172.21.15.157:0/2968797865 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f7a08630 0x5572f7a08a50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 -- 172.21.15.157:0/2968797865 >> 172.21.15.157:0/2968797865 conn(0x5572f79fd400 msgr2=0x5572f79fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:33.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 -- 172.21.15.157:0/2968797865 shutdown_connections 2024-05-09T09:47:33.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 -- 172.21.15.157:0/2968797865 wait complete. 2024-05-09T09:47:33.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 -- 172.21.15.157:0/1419315003 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5572f79dbb90 msgr2=0x5572f79ddf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 --2- 172.21.15.157:0/1419315003 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5572f79dbb90 0x5572f79ddf80 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 -- 172.21.15.157:0/1419315003 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5572f78e0dc0 msgr2=0x5572f79d9220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 --2- 172.21.15.157:0/1419315003 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5572f78e0dc0 0x5572f79d9220 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 -- 172.21.15.157:0/1419315003 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5572f79dfa90 msgr2=0x5572f79e1e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 --2- 172.21.15.157:0/1419315003 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5572f79dfa90 0x5572f79e1e80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 -- 172.21.15.157:0/1419315003 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e90034bb0 msgr2=0x7f1e90037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 --2- 172.21.15.157:0/1419315003 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e90034bb0 0x7f1e90037070 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c000f70 tx=0x7f1f9c0012c0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 -- 172.21.15.157:0/1419315003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f78dff00 msgr2=0x5572f79d22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 --2- 172.21.15.157:0/1419315003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572f78dff00 0x5572f79d22e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1f98019930 tx=0x7f1f98018020 comp rx=0 tx=0).stop 2024-05-09T09:47:33.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1fa9135640 1 -- 172.21.15.157:0/1419315003 reap_dead start 2024-05-09T09:47:33.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 -- 172.21.15.157:0/1419315003 shutdown_connections 2024-05-09T09:47:33.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 -- 172.21.15.157:0/1419315003 >> 172.21.15.157:0/1419315003 conn(0x5572f78532a0 msgr2=0x5572f79c59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:33.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 -- 172.21.15.157:0/1419315003 shutdown_connections 2024-05-09T09:47:33.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.107+0000 7f1faae19980 1 -- 172.21.15.157:0/1419315003 wait complete. 2024-05-09T09:47:33.118 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-09T09:47:32.044078Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:47:32.044055Z', 'tags': [], 'group_ids': []} 2024-05-09T09:47:33.119 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-05-09T09:47:33.119 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-05-09T09:47:33.119 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-05-09T09:47:33.196 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:33.196 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:33.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.199+0000 7f0b25131980 1 Processor -- start 2024-05-09T09:47:33.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.199+0000 7f0b25131980 1 -- start start 2024-05-09T09:47:33.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.199+0000 7f0b25131980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5634dc7040d0 0x5634dc7064c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.199+0000 7f0b25131980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5634dc5b3440 con 0x5634dc671ab0 2024-05-09T09:47:33.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.199+0000 7f0b25131980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5634dc59e5f0 con 0x5634dc7040d0 2024-05-09T09:47:33.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.199+0000 7f0b2244b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5634dc7040d0 0x5634dc7064c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.199+0000 7f0b2244b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5634dc7040d0 0x5634dc7064c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54100/0 (socket says 172.21.15.157:54100) 2024-05-09T09:47:33.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.199+0000 7f0b2244b640 1 -- 172.21.15.157:0/3010101938 learned_addr learned my addr 172.21.15.157:0/3010101938 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:33.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.199+0000 7f0b2244b640 1 -- 172.21.15.157:0/3010101938 >> v1:172.21.15.110:6789/0 conn(0x5634dc671ab0 legacy=0x5634dc7029b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.199+0000 7f0b2244b640 1 -- 172.21.15.157:0/3010101938 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634dc5a9990 con 0x5634dc7040d0 2024-05-09T09:47:33.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.203+0000 7f0b2244b640 1 --2- 172.21.15.157:0/3010101938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc7040d0 0x5634dc7064c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0b1800a5c0 tx=0x7f0b1801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c063a4a29a20bf8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.203+0000 7f0b21c4a640 1 -- 172.21.15.157:0/3010101938 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b180a6070 con 0x5634dc7040d0 2024-05-09T09:47:33.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.203+0000 7f0b21c4a640 1 -- 172.21.15.157:0/3010101938 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b180af070 con 0x5634dc7040d0 2024-05-09T09:47:33.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.203+0000 7f0b21c4a640 1 -- 172.21.15.157:0/3010101938 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b180aa5c0 con 0x5634dc7040d0 2024-05-09T09:47:33.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.203+0000 7f0b25131980 1 -- 172.21.15.157:0/3010101938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc7040d0 msgr2=0x5634dc7064c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.203+0000 7f0b25131980 1 --2- 172.21.15.157:0/3010101938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc7040d0 0x5634dc7064c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0b1800a5c0 tx=0x7f0b1801b340 comp rx=0 tx=0).stop 2024-05-09T09:47:33.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.203+0000 7f0b25131980 1 -- 172.21.15.157:0/3010101938 shutdown_connections 2024-05-09T09:47:33.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.203+0000 7f0b25131980 1 --2- 172.21.15.157:0/3010101938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc7040d0 0x5634dc7064c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.203+0000 7f0b25131980 1 -- 172.21.15.157:0/3010101938 >> 172.21.15.157:0/3010101938 conn(0x5634dc6f80d0 msgr2=0x5634dc6fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:33.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.203+0000 7f0b25131980 1 -- 172.21.15.157:0/3010101938 shutdown_connections 2024-05-09T09:47:33.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.203+0000 7f0b25131980 1 -- 172.21.15.157:0/3010101938 wait complete. 2024-05-09T09:47:33.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.219+0000 7f0b25131980 1 Processor -- start 2024-05-09T09:47:33.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.219+0000 7f0b25131980 1 -- start start 2024-05-09T09:47:33.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.219+0000 7f0b25131980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc671ab0 0x5634dc7eadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.219+0000 7f0b25131980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5634dc600fe0 con 0x5634dc671ab0 2024-05-09T09:47:33.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.219+0000 7f0b22c4c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc671ab0 0x5634dc7eadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.219+0000 7f0b22c4c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc671ab0 0x5634dc7eadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54112/0 (socket says 172.21.15.157:54112) 2024-05-09T09:47:33.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.219+0000 7f0b22c4c640 1 -- 172.21.15.157:0/2413577111 learned_addr learned my addr 172.21.15.157:0/2413577111 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:33.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.219+0000 7f0b22c4c640 1 -- 172.21.15.157:0/2413577111 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634dc585ae0 con 0x5634dc671ab0 2024-05-09T09:47:33.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.219+0000 7f0b22c4c640 1 --2- 172.21.15.157:0/2413577111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc671ab0 0x5634dc7eadb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0b14001ea0 tx=0x7f0b1400b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530be4b8177ba0f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.223+0000 7f0a10e09640 1 -- 172.21.15.157:0/2413577111 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b1400a040 con 0x5634dc671ab0 2024-05-09T09:47:33.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.223+0000 7f0a10e09640 1 -- 172.21.15.157:0/2413577111 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b1400f620 con 0x5634dc671ab0 2024-05-09T09:47:33.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.223+0000 7f0a10e09640 1 -- 172.21.15.157:0/2413577111 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b1400f890 con 0x5634dc671ab0 2024-05-09T09:47:33.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.223+0000 7f0b25131980 1 -- 172.21.15.157:0/2413577111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc671ab0 msgr2=0x5634dc7eadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.223+0000 7f0b25131980 1 --2- 172.21.15.157:0/2413577111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc671ab0 0x5634dc7eadb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0b14001ea0 tx=0x7f0b1400b680 comp rx=0 tx=0).stop 2024-05-09T09:47:33.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.223+0000 7f0b25131980 1 -- 172.21.15.157:0/2413577111 shutdown_connections 2024-05-09T09:47:33.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.223+0000 7f0b25131980 1 --2- 172.21.15.157:0/2413577111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc671ab0 0x5634dc7eadb0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.223+0000 7f0b25131980 1 -- 172.21.15.157:0/2413577111 >> 172.21.15.157:0/2413577111 conn(0x5634dc6f80d0 msgr2=0x5634dc7e6940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:33.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.223+0000 7f0b25131980 1 -- 172.21.15.157:0/2413577111 shutdown_connections 2024-05-09T09:47:33.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.223+0000 7f0b25131980 1 -- 172.21.15.157:0/2413577111 wait complete. 2024-05-09T09:47:33.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.223+0000 7f0b25131980 1 Processor -- start 2024-05-09T09:47:33.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.223+0000 7f0b25131980 1 -- start start 2024-05-09T09:47:33.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.223+0000 7f0b25131980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc671ab0 0x5634dc7f1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.223+0000 7f0b25131980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5634dc7094c0 con 0x5634dc671ab0 2024-05-09T09:47:33.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.223+0000 7f0b22c4c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc671ab0 0x5634dc7f1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.223+0000 7f0b22c4c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc671ab0 0x5634dc7f1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54120/0 (socket says 172.21.15.157:54120) 2024-05-09T09:47:33.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.223+0000 7f0b22c4c640 1 -- 172.21.15.157:0/2965765391 learned_addr learned my addr 172.21.15.157:0/2965765391 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:33.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.223+0000 7f0b22c4c640 1 -- 172.21.15.157:0/2965765391 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634dc7f2490 con 0x5634dc671ab0 2024-05-09T09:47:33.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.223+0000 7f0b22c4c640 1 --2- 172.21.15.157:0/2965765391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc671ab0 0x5634dc7f1f50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0b14001fd0 tx=0x7f0b14000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.223+0000 7f0a0f606640 1 -- 172.21.15.157:0/2965765391 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b1401c8a0 con 0x5634dc671ab0 2024-05-09T09:47:33.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.223+0000 7f0a0f606640 1 -- 172.21.15.157:0/2965765391 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b1401ca40 con 0x5634dc671ab0 2024-05-09T09:47:33.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.223+0000 7f0b25131980 1 -- 172.21.15.157:0/2965765391 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634dc7f2720 con 0x5634dc671ab0 2024-05-09T09:47:33.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.227+0000 7f0a0f606640 1 -- 172.21.15.157:0/2965765391 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b1401cd60 con 0x5634dc671ab0 2024-05-09T09:47:33.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.227+0000 7f0b25131980 1 -- 172.21.15.157:0/2965765391 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634dc7f5400 con 0x5634dc671ab0 2024-05-09T09:47:33.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.227+0000 7f0a0f606640 1 -- 172.21.15.157:0/2965765391 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f0b14017050 con 0x5634dc671ab0 2024-05-09T09:47:33.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.227+0000 7f0a0f606640 1 --2- 172.21.15.157:0/2965765391 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0a08034c00 0x7f0a080370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.227+0000 7f0a0f606640 1 -- 172.21.15.157:0/2965765391 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f0b14015020 con 0x5634dc671ab0 2024-05-09T09:47:33.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.227+0000 7f0b2244b640 1 --2- 172.21.15.157:0/2965765391 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0a08034c00 0x7f0a080370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.227+0000 7f0b25131980 1 --2- 172.21.15.157:0/2965765391 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5634dc7040d0 0x5634dc7f9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.227+0000 7f0b25131980 1 -- 172.21.15.157:0/2965765391 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634dc7f9590 con 0x5634dc7040d0 2024-05-09T09:47:33.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.227+0000 7f0b2344d640 1 --2- 172.21.15.157:0/2965765391 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5634dc7040d0 0x5634dc7f9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.227+0000 7f0b2244b640 1 --2- 172.21.15.157:0/2965765391 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0a08034c00 0x7f0a080370c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0b180ae000 tx=0x7f0b180a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.227+0000 7f0b2344d640 1 --2- 172.21.15.157:0/2965765391 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5634dc7040d0 0x5634dc7f9050 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.227+0000 7f0b2344d640 1 -- 172.21.15.157:0/2965765391 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc7040d0 2024-05-09T09:47:33.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.227+0000 7f0b25131980 1 -- 172.21.15.157:0/2965765391 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634dc7f6620 con 0x5634dc7040d0 2024-05-09T09:47:33.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.227+0000 7f0b2344d640 1 -- 172.21.15.157:0/2965765391 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc7040d0 2024-05-09T09:47:33.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.227+0000 7f0b25131980 1 --2- 172.21.15.157:0/2965765391 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5634dc7fb8c0 0x5634dc7fdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.227+0000 7f0b25131980 1 -- 172.21.15.157:0/2965765391 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634dc7fe3a0 con 0x5634dc7fb8c0 2024-05-09T09:47:33.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.227+0000 7f0b22c4c640 1 --2- 172.21.15.157:0/2965765391 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5634dc7fb8c0 0x5634dc7fdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.231+0000 7f0b22c4c640 1 --2- 172.21.15.157:0/2965765391 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5634dc7fb8c0 0x5634dc7fdcb0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.231+0000 7f0b22c4c640 1 -- 172.21.15.157:0/2965765391 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0b1402e070 con 0x5634dc7fb8c0 2024-05-09T09:47:33.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.231+0000 7f0b25131980 1 -- 172.21.15.157:0/2965765391 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634dc7fa760 con 0x5634dc7040d0 2024-05-09T09:47:33.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.231+0000 7f0b2344d640 1 -- 172.21.15.157:0/2965765391 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc7040d0 2024-05-09T09:47:33.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.231+0000 7f0b25131980 1 --2- 172.21.15.157:0/2965765391 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5634dc7ff800 0x5634dc801bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.231+0000 7f0b25131980 1 -- 172.21.15.157:0/2965765391 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634dc802360 con 0x5634dc7ff800 2024-05-09T09:47:33.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.231+0000 7f0b2244b640 1 --2- 172.21.15.157:0/2965765391 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5634dc7ff800 0x5634dc801bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.231+0000 7f0b2244b640 1 --2- 172.21.15.157:0/2965765391 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5634dc7ff800 0x5634dc801bf0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.231+0000 7f0b2244b640 1 -- 172.21.15.157:0/2965765391 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0b180aaae0 con 0x5634dc7ff800 2024-05-09T09:47:33.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.235+0000 7f0b25131980 1 Processor -- start 2024-05-09T09:47:33.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.235+0000 7f0b25131980 1 -- start start 2024-05-09T09:47:33.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.235+0000 7f0b25131980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc8281d0 0x5634dc8285f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.235+0000 7f0b25131980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5634dc605020 con 0x5634dc8281d0 2024-05-09T09:47:33.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.235+0000 7f0b22c4c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc8281d0 0x5634dc8285f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.235+0000 7f0b22c4c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc8281d0 0x5634dc8285f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54124/0 (socket says 172.21.15.157:54124) 2024-05-09T09:47:33.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.235+0000 7f0b22c4c640 1 -- 172.21.15.157:0/2813682591 learned_addr learned my addr 172.21.15.157:0/2813682591 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:33.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.235+0000 7f0b22c4c640 1 -- 172.21.15.157:0/2813682591 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634dc828b30 con 0x5634dc8281d0 2024-05-09T09:47:33.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.235+0000 7f0b22c4c640 1 --2- 172.21.15.157:0/2813682591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc8281d0 0x5634dc8285f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0b140186e0 tx=0x7f0b1402f8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.235+0000 7f0a077fe640 1 -- 172.21.15.157:0/2813682591 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b1401a5b0 con 0x5634dc8281d0 2024-05-09T09:47:33.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.235+0000 7f0b25131980 1 -- 172.21.15.157:0/2813682591 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634dc8295c0 con 0x5634dc8281d0 2024-05-09T09:47:33.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.235+0000 7f0a077fe640 1 -- 172.21.15.157:0/2813682591 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b1401a750 con 0x5634dc8281d0 2024-05-09T09:47:33.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.235+0000 7f0a077fe640 1 -- 172.21.15.157:0/2813682591 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b1404a290 con 0x5634dc8281d0 2024-05-09T09:47:33.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.235+0000 7f0b25131980 1 -- 172.21.15.157:0/2813682591 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634dc829aa0 con 0x5634dc8281d0 2024-05-09T09:47:33.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.239+0000 7f0a077fe640 1 -- 172.21.15.157:0/2813682591 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f0b1404a430 con 0x5634dc8281d0 2024-05-09T09:47:33.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.239+0000 7f0a077fe640 1 --2- 172.21.15.157:0/2813682591 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f09fc034bb0 0x7f09fc037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.239+0000 7f0a077fe640 1 -- 172.21.15.157:0/2813682591 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f0b1403a040 con 0x5634dc8281d0 2024-05-09T09:47:33.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.239+0000 7f0b2244b640 1 --2- 172.21.15.157:0/2813682591 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f09fc034bb0 0x7f09fc037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.239+0000 7f0b25131980 1 Processor -- start 2024-05-09T09:47:33.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.239+0000 7f0b25131980 1 -- start start 2024-05-09T09:47:33.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.239+0000 7f0b2244b640 1 --2- 172.21.15.157:0/2813682591 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f09fc034bb0 0x7f09fc037070 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0b180ac040 tx=0x7f0b18005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.239+0000 7f0b25131980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc835120 0x5634dc835540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.239+0000 7f0b25131980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5634dc7eb500 con 0x5634dc835120 2024-05-09T09:47:33.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.239+0000 7f0b22c4c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc835120 0x5634dc835540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.239+0000 7f0b22c4c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc835120 0x5634dc835540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54136/0 (socket says 172.21.15.157:54136) 2024-05-09T09:47:33.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.239+0000 7f0b22c4c640 1 -- 172.21.15.157:0/892177143 learned_addr learned my addr 172.21.15.157:0/892177143 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:33.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.239+0000 7f0b22c4c640 1 -- 172.21.15.157:0/892177143 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634dc835b10 con 0x5634dc835120 2024-05-09T09:47:33.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.239+0000 7f0b22c4c640 1 --2- 172.21.15.157:0/892177143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc835120 0x5634dc835540 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0b1404a890 tx=0x7f0b140131f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995fc4345717fd8b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.239+0000 7f0a057fa640 1 -- 172.21.15.157:0/892177143 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b14047510 con 0x5634dc835120 2024-05-09T09:47:33.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.239+0000 7f0a057fa640 1 -- 172.21.15.157:0/892177143 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b14047730 con 0x5634dc835120 2024-05-09T09:47:33.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.239+0000 7f0a057fa640 1 -- 172.21.15.157:0/892177143 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b1403fe90 con 0x5634dc835120 2024-05-09T09:47:33.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.243+0000 7f0b25131980 1 -- 172.21.15.157:0/892177143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc835120 msgr2=0x5634dc835540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.243+0000 7f0b25131980 1 --2- 172.21.15.157:0/892177143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc835120 0x5634dc835540 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0b1404a890 tx=0x7f0b140131f0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.243+0000 7f0b25131980 1 -- 172.21.15.157:0/892177143 shutdown_connections 2024-05-09T09:47:33.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.243+0000 7f0b25131980 1 --2- 172.21.15.157:0/892177143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc835120 0x5634dc835540 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.243+0000 7f0b25131980 1 -- 172.21.15.157:0/892177143 >> 172.21.15.157:0/892177143 conn(0x5634dc8314a0 msgr2=0x5634dc82f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:33.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.243+0000 7f0b25131980 1 -- 172.21.15.157:0/892177143 shutdown_connections 2024-05-09T09:47:33.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.243+0000 7f0b25131980 1 -- 172.21.15.157:0/892177143 wait complete. 2024-05-09T09:47:33.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.243+0000 7f0b25131980 1 Processor -- start 2024-05-09T09:47:33.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.243+0000 7f0b25131980 1 -- start start 2024-05-09T09:47:33.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.243+0000 7f0b25131980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc835120 0x5634dc83c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.243+0000 7f0b25131980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5634dc8361e0 con 0x5634dc835120 2024-05-09T09:47:33.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.243+0000 7f0b22c4c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc835120 0x5634dc83c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.243+0000 7f0b22c4c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc835120 0x5634dc83c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54146/0 (socket says 172.21.15.157:54146) 2024-05-09T09:47:33.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.243+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 learned_addr learned my addr 172.21.15.157:0/649231518 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:33.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.243+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634dc83c9e0 con 0x5634dc835120 2024-05-09T09:47:33.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.243+0000 7f0b22c4c640 1 --2- 172.21.15.157:0/649231518 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc835120 0x5634dc83c4a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0b1404a890 tx=0x7f0b1403bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.243+0000 7f09f37fe640 1 -- 172.21.15.157:0/649231518 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b14047510 con 0x5634dc835120 2024-05-09T09:47:33.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.243+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634dc83c9e0 con 0x5634dc835120 2024-05-09T09:47:33.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.243+0000 7f09f37fe640 1 -- 172.21.15.157:0/649231518 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b14006c60 con 0x5634dc835120 2024-05-09T09:47:33.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.243+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634dc83c9e0 con 0x5634dc835120 2024-05-09T09:47:33.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.243+0000 7f09f37fe640 1 -- 172.21.15.157:0/649231518 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b1400e7c0 con 0x5634dc835120 2024-05-09T09:47:33.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.243+0000 7f09f37fe640 1 -- 172.21.15.157:0/649231518 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f0b1400e960 con 0x5634dc835120 2024-05-09T09:47:33.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.243+0000 7f09f37fe640 1 --2- 172.21.15.157:0/649231518 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f09ec034bb0 0x7f09ec037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.243+0000 7f09f37fe640 1 -- 172.21.15.157:0/649231518 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f0b1406c030 con 0x5634dc835120 2024-05-09T09:47:33.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b2244b640 1 --2- 172.21.15.157:0/649231518 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f09ec034bb0 0x7f09ec037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b25131980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b25131980 1 --2- 172.21.15.157:0/649231518 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5634dc848e20 0x5634dc84b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84ba30 con 0x5634dc848e20 2024-05-09T09:47:33.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b2344d640 1 --2- 172.21.15.157:0/649231518 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5634dc848e20 0x5634dc84b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b2244b640 1 --2- 172.21.15.157:0/649231518 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f09ec034bb0 0x7f09ec037070 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0b180aa910 tx=0x7f0b180c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b2344d640 1 --2- 172.21.15.157:0/649231518 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5634dc848e20 0x5634dc84b2e0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b25131980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:33.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b25131980 20 realm 2024-05-09T09:47:33.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b25131980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84be40 con 0x5634dc848e20 2024-05-09T09:47:33.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b25131980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:33.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b25131980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:33.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b25131980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84c710 con 0x5634dc848e20 2024-05-09T09:47:33.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b25131980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:33.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b25131980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x5634dc848e20 2024-05-09T09:47:33.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b25131980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:33.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b25131980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b25131980 1 --2- 172.21.15.157:0/649231518 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5634dc84d810 0x5634dc84fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634dc8501c0 con 0x5634dc84d810 2024-05-09T09:47:33.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b22c4c640 1 --2- 172.21.15.157:0/649231518 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5634dc84d810 0x5634dc84fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b22c4c640 1 --2- 172.21.15.157:0/649231518 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5634dc84d810 0x5634dc84fc00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0b1405d070 con 0x5634dc84d810 2024-05-09T09:47:33.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b25131980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:33.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.247+0000 7f0b25131980 20 searching for the correct realm 2024-05-09T09:47:33.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.251+0000 7f0b25131980 1 --2- 172.21.15.157:0/649231518 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5634dc852110 0x5634dc854520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.251+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc854bf0 con 0x5634dc852110 2024-05-09T09:47:33.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.251+0000 7f0b2244b640 1 --2- 172.21.15.157:0/649231518 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5634dc852110 0x5634dc854520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.251+0000 7f0b2244b640 1 --2- 172.21.15.157:0/649231518 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5634dc852110 0x5634dc854520 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.251+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b180aaae0 con 0x5634dc852110 2024-05-09T09:47:33.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.251+0000 7f0b2244b640 1 --2- 172.21.15.157:0/649231518 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f0b180e0040 0x7f0b180e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.251+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc854bf0 con 0x7f0b180e0040 2024-05-09T09:47:33.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.251+0000 7f0b2344d640 1 --2- 172.21.15.157:0/649231518 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f0b180e0040 0x7f0b180e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.251+0000 7f0b2344d640 1 --2- 172.21.15.157:0/649231518 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f0b180e0040 0x7f0b180e0420 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.251+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x7f0b180e0040 2024-05-09T09:47:33.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.251+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x5634dc84d810 2024-05-09T09:47:33.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.251+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1405d070 con 0x5634dc84d810 2024-05-09T09:47:33.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.251+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x5634dc848e20 2024-05-09T09:47:33.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.251+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.251+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x5634dc848e20 2024-05-09T09:47:33.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.251+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.251+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x5634dc84d810 2024-05-09T09:47:33.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.255+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1405d070 con 0x5634dc84d810 2024-05-09T09:47:33.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.255+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x5634dc84d810 2024-05-09T09:47:33.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.255+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1405d070 con 0x5634dc84d810 2024-05-09T09:47:33.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.255+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x7f0b180e0040 2024-05-09T09:47:33.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.255+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x7f0b180e0040 2024-05-09T09:47:33.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.255+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x5634dc852110 2024-05-09T09:47:33.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.255+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b180aaae0 con 0x5634dc852110 2024-05-09T09:47:33.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.255+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x5634dc848e20 2024-05-09T09:47:33.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.255+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.255+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x5634dc84d810 2024-05-09T09:47:33.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.255+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1405d070 con 0x5634dc84d810 2024-05-09T09:47:33.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.255+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x5634dc848e20 2024-05-09T09:47:33.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.255+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.255+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x7f0b180e0040 2024-05-09T09:47:33.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.255+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x7f0b180e0040 2024-05-09T09:47:33.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.255+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x5634dc852110 2024-05-09T09:47:33.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.255+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b180aaae0 con 0x5634dc852110 2024-05-09T09:47:33.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.255+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x5634dc852110 2024-05-09T09:47:33.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.259+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0b180aaae0 con 0x5634dc852110 2024-05-09T09:47:33.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.259+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x5634dc84d810 2024-05-09T09:47:33.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.259+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1405d070 con 0x5634dc84d810 2024-05-09T09:47:33.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.259+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x5634dc852110 2024-05-09T09:47:33.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.259+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b180aaae0 con 0x5634dc852110 2024-05-09T09:47:33.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.259+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x5634dc852110 2024-05-09T09:47:33.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.259+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b180aaae0 con 0x5634dc852110 2024-05-09T09:47:33.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.259+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x5634dc848e20 2024-05-09T09:47:33.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.259+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.259+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x5634dc848e20 2024-05-09T09:47:33.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.259+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.259+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x5634dc84d810 2024-05-09T09:47:33.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.259+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1405d070 con 0x5634dc84d810 2024-05-09T09:47:33.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.259+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x5634dc852110 2024-05-09T09:47:33.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.259+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b180aaae0 con 0x5634dc852110 2024-05-09T09:47:33.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.259+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x7f0b180e0040 2024-05-09T09:47:33.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.259+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x7f0b180e0040 2024-05-09T09:47:33.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.259+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x5634dc848e20 2024-05-09T09:47:33.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.259+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.259+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x5634dc84d810 2024-05-09T09:47:33.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.263+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0b1405d070 con 0x5634dc84d810 2024-05-09T09:47:33.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.263+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x5634dc852110 2024-05-09T09:47:33.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.263+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b180aaae0 con 0x5634dc852110 2024-05-09T09:47:33.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.263+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x5634dc84d810 2024-05-09T09:47:33.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.263+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1405d070 con 0x5634dc84d810 2024-05-09T09:47:33.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.263+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x7f0b180e0040 2024-05-09T09:47:33.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.263+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x7f0b180e0040 2024-05-09T09:47:33.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.263+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x5634dc852110 2024-05-09T09:47:33.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.263+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b180aaae0 con 0x5634dc852110 2024-05-09T09:47:33.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.263+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x5634dc84d810 2024-05-09T09:47:33.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.263+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1405d070 con 0x5634dc84d810 2024-05-09T09:47:33.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.263+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x5634dc848e20 2024-05-09T09:47:33.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.263+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.263+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5634dc84cab0 con 0x7f0b180e0040 2024-05-09T09:47:33.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.263+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x7f0b180e0040 2024-05-09T09:47:33.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.263+0000 7f0b25131980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:33.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.263+0000 7f0b25131980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:33.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.263+0000 7f0b25131980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:33.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.263+0000 7f0b25131980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:33.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.263+0000 7f0b25131980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:33.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.263+0000 7f0b25131980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:33.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.263+0000 7f0b25131980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.263+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634dc850a80 con 0x5634dc848e20 2024-05-09T09:47:33.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b25131980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:33.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b25131980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634dc850a80 con 0x5634dc848e20 2024-05-09T09:47:33.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b25131980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:33.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b25131980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634dc850a80 con 0x5634dc852110 2024-05-09T09:47:33.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0b180aaae0 con 0x5634dc852110 2024-05-09T09:47:33.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b25131980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:33.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b25131980 20 zone default found 2024-05-09T09:47:33.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b25131980 4 Realm: () 2024-05-09T09:47:33.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b25131980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:33.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b25131980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:33.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b25131980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:33.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b25131980 20 zonegroup default 2024-05-09T09:47:33.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b25131980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634dc851430 con 0x5634dc84d810 2024-05-09T09:47:33.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0b1405d070 con 0x5634dc84d810 2024-05-09T09:47:33.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b25131980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:33.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b25131980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634dc850f90 con 0x5634dc852110 2024-05-09T09:47:33.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0b180aaae0 con 0x5634dc852110 2024-05-09T09:47:33.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b25131980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:33.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b25131980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634dc856f50 con 0x5634dc852110 2024-05-09T09:47:33.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0b180aaae0 con 0x5634dc852110 2024-05-09T09:47:33.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b25131980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:33.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b25131980 20 started sync module instance, tier type = 2024-05-09T09:47:33.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b25131980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:33.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc856390 con 0x7f0b180e0040 2024-05-09T09:47:33.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x7f0b180e0040 2024-05-09T09:47:33.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94785038018736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc856390 con 0x7f0b180e0040 2024-05-09T09:47:33.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.267+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc857a20 con 0x5634dc848e20 2024-05-09T09:47:33.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.271+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94785038018736] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x7f0b180e0040 2024-05-09T09:47:33.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.271+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.271+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94785038021872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc856390 con 0x5634dc848e20 2024-05-09T09:47:33.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.271+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc858460 con 0x5634dc852110 2024-05-09T09:47:33.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.271+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94785038021872] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.271+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b180aaae0 con 0x5634dc852110 2024-05-09T09:47:33.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.271+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94785038016224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc856300 con 0x5634dc852110 2024-05-09T09:47:33.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.271+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc859210 con 0x7f0b180e0040 2024-05-09T09:47:33.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.275+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x7f0b180e0040 2024-05-09T09:47:33.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.275+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94785038028032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc859ae0 con 0x7f0b180e0040 2024-05-09T09:47:33.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.275+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc85a4a0 con 0x5634dc848e20 2024-05-09T09:47:33.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.275+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94785038016224] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b180aaae0 con 0x5634dc852110 2024-05-09T09:47:33.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.275+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94785038028032] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x7f0b180e0040 2024-05-09T09:47:33.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.275+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.275+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94785038032880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc859a30 con 0x5634dc848e20 2024-05-09T09:47:33.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.275+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc85a410 con 0x5634dc84d810 2024-05-09T09:47:33.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.279+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94785038032880] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.279+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1405d070 con 0x5634dc84d810 2024-05-09T09:47:33.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.279+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94785038030512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc85ad70 con 0x5634dc84d810 2024-05-09T09:47:33.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.279+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc85b5c0 con 0x5634dc84d810 2024-05-09T09:47:33.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.279+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94785038030512] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1405d070 con 0x5634dc84d810 2024-05-09T09:47:33.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.283+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1405d070 con 0x5634dc84d810 2024-05-09T09:47:33.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.283+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94785038035136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc85be10 con 0x5634dc84d810 2024-05-09T09:47:33.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.283+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc85c660 con 0x5634dc84d810 2024-05-09T09:47:33.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.283+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1405d070 con 0x5634dc84d810 2024-05-09T09:47:33.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.283+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94785038041104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc85caa0 con 0x5634dc84d810 2024-05-09T09:47:33.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.283+0000 7f0b25131980 20 add_watcher() i=0 2024-05-09T09:47:33.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.283+0000 7f0b25131980 20 add_watcher() i=1 2024-05-09T09:47:33.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.283+0000 7f0b25131980 20 add_watcher() i=2 2024-05-09T09:47:33.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.283+0000 7f0b25131980 20 add_watcher() i=3 2024-05-09T09:47:33.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.283+0000 7f0b25131980 20 add_watcher() i=4 2024-05-09T09:47:33.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.283+0000 7f0b25131980 20 add_watcher() i=5 2024-05-09T09:47:33.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.283+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94785038035136] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1405d070 con 0x5634dc84d810 2024-05-09T09:47:33.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.283+0000 7f0b25131980 20 add_watcher() i=6 2024-05-09T09:47:33.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.287+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94785038041104] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1405d070 con 0x5634dc84d810 2024-05-09T09:47:33.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.287+0000 7f0b25131980 20 add_watcher() i=7 2024-05-09T09:47:33.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.287+0000 7f0b25131980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:33.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.287+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634dc85b960 con 0x5634dc848e20 2024-05-09T09:47:33.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.287+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.287+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94785038039392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc85d020 con 0x5634dc848e20 2024-05-09T09:47:33.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.287+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94785038039392] v30'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.287+0000 7f09d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:33.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.287+0000 7f0b25131980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:33.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.287+0000 7f0b25131980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:33.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.287+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc868440 con 0x5634dc848e20 2024-05-09T09:47:33.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.291+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'28 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.291+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc868b10 con 0x5634dc84d810 2024-05-09T09:47:33.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.291+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b1405d070 con 0x5634dc84d810 2024-05-09T09:47:33.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.291+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc868b10 con 0x5634dc852110 2024-05-09T09:47:33.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.291+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b180aaae0 con 0x5634dc852110 2024-05-09T09:47:33.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.291+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc869100 con 0x5634dc848e20 2024-05-09T09:47:33.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.295+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'85 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.295+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc8695b0 con 0x7f0b180e0040 2024-05-09T09:47:33.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.295+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'56 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x7f0b180e0040 2024-05-09T09:47:33.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.295+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc8662f0 con 0x5634dc852110 2024-05-09T09:47:33.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.295+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'37 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b180aaae0 con 0x5634dc852110 2024-05-09T09:47:33.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.295+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc8662f0 con 0x5634dc848e20 2024-05-09T09:47:33.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.299+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.299+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc86a110 con 0x5634dc84d810 2024-05-09T09:47:33.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.303+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'37 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b1405d070 con 0x5634dc84d810 2024-05-09T09:47:33.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.303+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc86a110 con 0x7f0b180e0040 2024-05-09T09:47:33.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.303+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x7f0b180e0040 2024-05-09T09:47:33.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.303+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc86a1a0 con 0x5634dc852110 2024-05-09T09:47:33.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.303+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'28 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b180aaae0 con 0x5634dc852110 2024-05-09T09:47:33.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.303+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc86a650 con 0x7f0b180e0040 2024-05-09T09:47:33.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.307+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'57 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x7f0b180e0040 2024-05-09T09:47:33.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.307+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc86a650 con 0x5634dc84d810 2024-05-09T09:47:33.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.307+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b1405d070 con 0x5634dc84d810 2024-05-09T09:47:33.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.307+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc86a650 con 0x7f0b180e0040 2024-05-09T09:47:33.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.311+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x7f0b180e0040 2024-05-09T09:47:33.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.311+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc86a5c0 con 0x5634dc84d810 2024-05-09T09:47:33.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.311+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'43 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b1405d070 con 0x5634dc84d810 2024-05-09T09:47:33.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.311+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc86a5c0 con 0x5634dc848e20 2024-05-09T09:47:33.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.311+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'86 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.311+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc86a5c0 con 0x5634dc852110 2024-05-09T09:47:33.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.315+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'50 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b180aaae0 con 0x5634dc852110 2024-05-09T09:47:33.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.315+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc86a5c0 con 0x7f0b180e0040 2024-05-09T09:47:33.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.315+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'58 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x7f0b180e0040 2024-05-09T09:47:33.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.315+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc86a5c0 con 0x5634dc852110 2024-05-09T09:47:33.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.319+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b180aaae0 con 0x5634dc852110 2024-05-09T09:47:33.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.319+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc86aa10 con 0x5634dc848e20 2024-05-09T09:47:33.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.319+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'30 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.319+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc86aa10 con 0x5634dc848e20 2024-05-09T09:47:33.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.323+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'87 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.323+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc86aa10 con 0x5634dc852110 2024-05-09T09:47:33.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.323+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'51 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b180aaae0 con 0x5634dc852110 2024-05-09T09:47:33.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.323+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc86aa10 con 0x7f0b180e0040 2024-05-09T09:47:33.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.323+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'32 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x7f0b180e0040 2024-05-09T09:47:33.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.323+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc86aa10 con 0x5634dc852110 2024-05-09T09:47:33.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.327+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b180aaae0 con 0x5634dc852110 2024-05-09T09:47:33.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.327+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc86aa10 con 0x5634dc852110 2024-05-09T09:47:33.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.327+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'28 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b180aaae0 con 0x5634dc852110 2024-05-09T09:47:33.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.327+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc86aa10 con 0x5634dc852110 2024-05-09T09:47:33.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.327+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b180aaae0 con 0x5634dc852110 2024-05-09T09:47:33.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.327+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc86aa10 con 0x5634dc852110 2024-05-09T09:47:33.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.331+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'38 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b180aaae0 con 0x5634dc852110 2024-05-09T09:47:33.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.331+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc86aa10 con 0x5634dc84d810 2024-05-09T09:47:33.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.331+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b1405d070 con 0x5634dc84d810 2024-05-09T09:47:33.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.331+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc86aa10 con 0x5634dc852110 2024-05-09T09:47:33.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.335+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b180aaae0 con 0x5634dc852110 2024-05-09T09:47:33.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.335+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc86aa10 con 0x5634dc84d810 2024-05-09T09:47:33.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.335+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'38 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b1405d070 con 0x5634dc84d810 2024-05-09T09:47:33.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.335+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc86aa10 con 0x5634dc852110 2024-05-09T09:47:33.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.339+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'52 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b180aaae0 con 0x5634dc852110 2024-05-09T09:47:33.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.339+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc86aa10 con 0x5634dc84d810 2024-05-09T09:47:33.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.343+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'44 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b1405d070 con 0x5634dc84d810 2024-05-09T09:47:33.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.343+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc86aa10 con 0x7f0b180e0040 2024-05-09T09:47:33.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.343+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'28 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x7f0b180e0040 2024-05-09T09:47:33.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.343+0000 7f09d27fc640 20 reqs_thread_entry: start 2024-05-09T09:47:33.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.343+0000 7f0b25131980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:33.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.343+0000 7f0947fff640 20 reqs_thread_entry: start 2024-05-09T09:47:33.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.343+0000 7f0b25131980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-09T09:47:33.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.343+0000 7f0b25131980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.343+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634dc8862f0 con 0x5634dc848e20 2024-05-09T09:47:33.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.343+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.343+0000 7f0b25131980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:47:33.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.343+0000 7f0b25131980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-09T09:47:33.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.343+0000 7f0b25131980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:33.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.343+0000 7f0b25131980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:33.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.347+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634dc888640 con 0x7f0b180e0040 2024-05-09T09:47:33.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.347+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(95 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x7f0b180e0040 2024-05-09T09:47:33.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.347+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc88c200 con 0x5634dc848e20 2024-05-09T09:47:33.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.347+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(96 foo [delete,create,call,call,writefull 0~391] v30'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.347+0000 7f0b25131980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:47:33.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.347+0000 7f0b25131980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:33.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.347+0000 7f0b25131980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-09T09:47:33.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.347+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.d 7:b4812045:::notify.4:head [notify cookie 94785038237328 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5634dc888f20 con 0x5634dc848e20 2024-05-09T09:47:33.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.347+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== watch-notify(notify (1) cookie 94785038032880 notify 128849018882 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5634dc8662c0 con 0x5634dc848e20 2024-05-09T09:47:33.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.347+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(97 notify.4 [notify cookie 94785038237328 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.347+0000 7f0a057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94785038032880 notifier 4336 bl.length()=567 2024-05-09T09:47:33.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.347+0000 7f0a057fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:47:33.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.347+0000 7f0a057fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:33.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.347+0000 7f0a057fa640 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f09e40056c0 con 0x5634dc848e20 2024-05-09T09:47:33.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.347+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(98 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.347+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== watch-notify(notify_complete (2) cookie 94785038237328 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5634dc868060 con 0x5634dc848e20 2024-05-09T09:47:33.348 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-09T09:47:32.044078Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:47:32.044055Z","tags":[],"group_ids":[]} 2024-05-09T09:47:33.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.351+0000 7f09d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:33.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.351+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:99 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94785038039392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc888d20 con 0x5634dc848e20 2024-05-09T09:47:33.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.351+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(99 data_loggenerations_metadata [watch unwatch cookie 94785038039392] v30'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.351+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:100 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94785038018736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc85b960 con 0x7f0b180e0040 2024-05-09T09:47:33.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.351+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(100 notify.0 [watch unwatch cookie 94785038018736] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x7f0b180e0040 2024-05-09T09:47:33.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.351+0000 7f0b25131980 20 remove_watcher() i=0 2024-05-09T09:47:33.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.351+0000 7f0b25131980 2 removed watcher, disabling cache 2024-05-09T09:47:33.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.351+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:101 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94785038021872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc8568b0 con 0x5634dc848e20 2024-05-09T09:47:33.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.355+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(101 notify.1 [watch unwatch cookie 94785038021872] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.355+0000 7f0b25131980 20 remove_watcher() i=1 2024-05-09T09:47:33.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.355+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94785038016224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc8568b0 con 0x5634dc852110 2024-05-09T09:47:33.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.355+0000 7f0b2244b640 1 -- 172.21.15.157:0/649231518 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(102 notify.2 [watch unwatch cookie 94785038016224] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b180aaae0 con 0x5634dc852110 2024-05-09T09:47:33.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.355+0000 7f0b25131980 20 remove_watcher() i=2 2024-05-09T09:47:33.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.355+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94785038028032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc8568b0 con 0x7f0b180e0040 2024-05-09T09:47:33.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.359+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(103 notify.3 [watch unwatch cookie 94785038028032] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x7f0b180e0040 2024-05-09T09:47:33.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.359+0000 7f0b25131980 20 remove_watcher() i=3 2024-05-09T09:47:33.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.359+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:104 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94785038032880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc858d00 con 0x5634dc848e20 2024-05-09T09:47:33.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.359+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(104 notify.4 [watch unwatch cookie 94785038032880] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1c00a4d0 con 0x5634dc848e20 2024-05-09T09:47:33.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.359+0000 7f0b25131980 20 remove_watcher() i=4 2024-05-09T09:47:33.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.359+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:105 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94785038030512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc859ff0 con 0x5634dc84d810 2024-05-09T09:47:33.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.363+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(105 notify.5 [watch unwatch cookie 94785038030512] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1405d070 con 0x5634dc84d810 2024-05-09T09:47:33.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.363+0000 7f0b25131980 20 remove_watcher() i=5 2024-05-09T09:47:33.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.363+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:106 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94785038035136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc858d00 con 0x5634dc84d810 2024-05-09T09:47:33.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.363+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(106 notify.6 [watch unwatch cookie 94785038035136] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1405d070 con 0x5634dc84d810 2024-05-09T09:47:33.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.363+0000 7f0b25131980 20 remove_watcher() i=6 2024-05-09T09:47:33.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.363+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:107 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94785038041104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5634dc8596b0 con 0x5634dc84d810 2024-05-09T09:47:33.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b22c4c640 1 -- 172.21.15.157:0/649231518 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(107 notify.7 [watch unwatch cookie 94785038041104] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b1405d070 con 0x5634dc84d810 2024-05-09T09:47:33.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 20 remove_watcher() i=7 2024-05-09T09:47:33.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5634dc84d810 msgr2=0x5634dc84fc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 --2- 172.21.15.157:0/649231518 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5634dc84d810 0x5634dc84fc00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5634dc848e20 msgr2=0x5634dc84b2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 --2- 172.21.15.157:0/649231518 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5634dc848e20 0x5634dc84b2e0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f0b180e0040 msgr2=0x7f0b180e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 --2- 172.21.15.157:0/649231518 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f0b180e0040 0x7f0b180e0420 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5634dc852110 msgr2=0x5634dc854520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 --2- 172.21.15.157:0/649231518 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5634dc852110 0x5634dc854520 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f09ec034bb0 msgr2=0x7f09ec037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 --2- 172.21.15.157:0/649231518 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f09ec034bb0 0x7f09ec037070 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0b180aa910 tx=0x7f0b180c1040 comp rx=0 tx=0).stop 2024-05-09T09:47:33.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b2344d640 1 -- 172.21.15.157:0/649231518 reap_dead start 2024-05-09T09:47:33.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc835120 msgr2=0x5634dc83c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 --2- 172.21.15.157:0/649231518 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc835120 0x5634dc83c4a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0b1404a890 tx=0x7f0b1403bf50 comp rx=0 tx=0).stop 2024-05-09T09:47:33.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 shutdown_connections 2024-05-09T09:47:33.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 --2- 172.21.15.157:0/649231518 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc835120 0x5634dc83c4a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 >> 172.21.15.157:0/649231518 conn(0x5634dc8314a0 msgr2=0x5634dc82eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:33.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 shutdown_connections 2024-05-09T09:47:33.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 -- 172.21.15.157:0/649231518 wait complete. 2024-05-09T09:47:33.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 -- 172.21.15.157:0/2813682591 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f09fc034bb0 msgr2=0x7f09fc037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 --2- 172.21.15.157:0/2813682591 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f09fc034bb0 0x7f09fc037070 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0b180ac040 tx=0x7f0b18005ad0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 -- 172.21.15.157:0/2813682591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc8281d0 msgr2=0x5634dc8285f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 --2- 172.21.15.157:0/2813682591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc8281d0 0x5634dc8285f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0b140186e0 tx=0x7f0b1402f8e0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 -- 172.21.15.157:0/2813682591 shutdown_connections 2024-05-09T09:47:33.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 --2- 172.21.15.157:0/2813682591 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f09fc034bb0 0x7f09fc037070 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 --2- 172.21.15.157:0/2813682591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc8281d0 0x5634dc8285f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 -- 172.21.15.157:0/2813682591 >> 172.21.15.157:0/2813682591 conn(0x5634dc81cfa0 msgr2=0x5634dc81dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:33.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 -- 172.21.15.157:0/2813682591 shutdown_connections 2024-05-09T09:47:33.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 -- 172.21.15.157:0/2813682591 wait complete. 2024-05-09T09:47:33.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 -- 172.21.15.157:0/2965765391 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5634dc7fb8c0 msgr2=0x5634dc7fdcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 --2- 172.21.15.157:0/2965765391 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5634dc7fb8c0 0x5634dc7fdcb0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 -- 172.21.15.157:0/2965765391 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5634dc7040d0 msgr2=0x5634dc7f9050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 --2- 172.21.15.157:0/2965765391 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5634dc7040d0 0x5634dc7f9050 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 -- 172.21.15.157:0/2965765391 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5634dc7ff800 msgr2=0x5634dc801bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 --2- 172.21.15.157:0/2965765391 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5634dc7ff800 0x5634dc801bf0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 -- 172.21.15.157:0/2965765391 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0a08034c00 msgr2=0x7f0a080370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 --2- 172.21.15.157:0/2965765391 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0a08034c00 0x7f0a080370c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0b180ae000 tx=0x7f0b180a6000 comp rx=0 tx=0).stop 2024-05-09T09:47:33.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 -- 172.21.15.157:0/2965765391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc671ab0 msgr2=0x5634dc7f1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 --2- 172.21.15.157:0/2965765391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634dc671ab0 0x5634dc7f1f50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0b14001fd0 tx=0x7f0b14000bd0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b2344d640 1 -- 172.21.15.157:0/2965765391 reap_dead start 2024-05-09T09:47:33.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 -- 172.21.15.157:0/2965765391 shutdown_connections 2024-05-09T09:47:33.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 -- 172.21.15.157:0/2965765391 >> 172.21.15.157:0/2965765391 conn(0x5634dc6f80d0 msgr2=0x5634dc7e5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:33.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 -- 172.21.15.157:0/2965765391 shutdown_connections 2024-05-09T09:47:33.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.367+0000 7f0b25131980 1 -- 172.21.15.157:0/2965765391 wait complete. 2024-05-09T09:47:33.381 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-09T09:47:32.044078Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:47:32.044055Z', 'tags': [], 'group_ids': []} 2024-05-09T09:47:33.381 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-09T09:47:33.381 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-09T09:47:33.381 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-09T09:47:33.460 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:33.460 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:33.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.463+0000 7fa9506c2980 1 Processor -- start 2024-05-09T09:47:33.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.463+0000 7fa9506c2980 1 -- start start 2024-05-09T09:47:33.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.463+0000 7fa9506c2980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55d7c5c8a030 0x55d7c5c8c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.463+0000 7fa9506c2980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d7c5b39440 con 0x55d7c5c85b30 2024-05-09T09:47:33.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.463+0000 7fa9506c2980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55d7c5b245f0 con 0x55d7c5c8a030 2024-05-09T09:47:33.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.463+0000 7fa94d9dc640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55d7c5c8a030 0x55d7c5c8c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.463+0000 7fa94e1dd640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x55d7c5c85b30 0x55d7c5c85f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:33646/0 (socket says 172.21.15.157:33646) 2024-05-09T09:47:33.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.463+0000 7fa94e1dd640 1 -- 172.21.15.157:0/3675976309 learned_addr learned my addr 172.21.15.157:0/3675976309 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:47:33.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.463+0000 7fa94d9dc640 1 --2- 172.21.15.157:0/3675976309 >> v2:172.21.15.110:3300/0 conn(0x55d7c5c8a030 0x55d7c5c8c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54148/0 (socket says 172.21.15.157:54148) 2024-05-09T09:47:33.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.463+0000 7fa94d9dc640 1 -- 172.21.15.157:0/3675976309 >> v1:172.21.15.110:6789/0 conn(0x55d7c5c85b30 legacy=0x55d7c5c85f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.463+0000 7fa94d9dc640 1 -- 172.21.15.157:0/3675976309 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7c5b2f990 con 0x55d7c5c8a030 2024-05-09T09:47:33.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.467+0000 7fa94d9dc640 1 --2- 172.21.15.157:0/3675976309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5c8a030 0x55d7c5c8c420 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa94400a480 tx=0x7fa94401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5756fb0d419dda97 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.467+0000 7fa94d1db640 1 -- 172.21.15.157:0/3675976309 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9440b0070 con 0x55d7c5c8a030 2024-05-09T09:47:33.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.467+0000 7fa94d1db640 1 -- 172.21.15.157:0/3675976309 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9440ab540 con 0x55d7c5c8a030 2024-05-09T09:47:33.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.467+0000 7fa94d1db640 1 -- 172.21.15.157:0/3675976309 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9440ab840 con 0x55d7c5c8a030 2024-05-09T09:47:33.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.467+0000 7fa9506c2980 1 -- 172.21.15.157:0/3675976309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5c8a030 msgr2=0x55d7c5c8c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.467+0000 7fa9506c2980 1 --2- 172.21.15.157:0/3675976309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5c8a030 0x55d7c5c8c420 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa94400a480 tx=0x7fa94401b280 comp rx=0 tx=0).stop 2024-05-09T09:47:33.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.467+0000 7fa9506c2980 1 -- 172.21.15.157:0/3675976309 shutdown_connections 2024-05-09T09:47:33.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.467+0000 7fa9506c2980 1 --2- 172.21.15.157:0/3675976309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5c8a030 0x55d7c5c8c420 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.467+0000 7fa9506c2980 1 -- 172.21.15.157:0/3675976309 >> 172.21.15.157:0/3675976309 conn(0x55d7c5bf9250 msgr2=0x55d7c5bf9660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:33.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.467+0000 7fa9506c2980 1 -- 172.21.15.157:0/3675976309 shutdown_connections 2024-05-09T09:47:33.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.467+0000 7fa9506c2980 1 -- 172.21.15.157:0/3675976309 wait complete. 2024-05-09T09:47:33.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.483+0000 7fa9506c2980 1 Processor -- start 2024-05-09T09:47:33.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.483+0000 7fa9506c2980 1 -- start start 2024-05-09T09:47:33.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.483+0000 7fa9506c2980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5c85b30 0x55d7c5d70d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.483+0000 7fa9506c2980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d7c5b86fe0 con 0x55d7c5c85b30 2024-05-09T09:47:33.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.483+0000 7fa94e1dd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5c85b30 0x55d7c5d70d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.483+0000 7fa94e1dd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5c85b30 0x55d7c5d70d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54158/0 (socket says 172.21.15.157:54158) 2024-05-09T09:47:33.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.483+0000 7fa94e1dd640 1 -- 172.21.15.157:0/2167185079 learned_addr learned my addr 172.21.15.157:0/2167185079 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:33.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.483+0000 7fa94e1dd640 1 -- 172.21.15.157:0/2167185079 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7c5b0bae0 con 0x55d7c5c85b30 2024-05-09T09:47:33.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.483+0000 7fa94e1dd640 1 --2- 172.21.15.157:0/2167185079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5c85b30 0x55d7c5d70d70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa940001e20 tx=0x7fa94000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f70fc8ae823da4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.483+0000 7fa83c608640 1 -- 172.21.15.157:0/2167185079 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa940012020 con 0x55d7c5c85b30 2024-05-09T09:47:33.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.483+0000 7fa83c608640 1 -- 172.21.15.157:0/2167185079 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa94000e7c0 con 0x55d7c5c85b30 2024-05-09T09:47:33.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.483+0000 7fa83c608640 1 -- 172.21.15.157:0/2167185079 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa94000eb00 con 0x55d7c5c85b30 2024-05-09T09:47:33.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.483+0000 7fa9506c2980 1 -- 172.21.15.157:0/2167185079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5c85b30 msgr2=0x55d7c5d70d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.483+0000 7fa9506c2980 1 --2- 172.21.15.157:0/2167185079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5c85b30 0x55d7c5d70d70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa940001e20 tx=0x7fa94000b790 comp rx=0 tx=0).stop 2024-05-09T09:47:33.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.483+0000 7fa9506c2980 1 -- 172.21.15.157:0/2167185079 shutdown_connections 2024-05-09T09:47:33.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.483+0000 7fa9506c2980 1 --2- 172.21.15.157:0/2167185079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5c85b30 0x55d7c5d70d70 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.483+0000 7fa9506c2980 1 -- 172.21.15.157:0/2167185079 >> 172.21.15.157:0/2167185079 conn(0x55d7c5bf9250 msgr2=0x55d7c5d6c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:33.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.487+0000 7fa9506c2980 1 -- 172.21.15.157:0/2167185079 shutdown_connections 2024-05-09T09:47:33.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.487+0000 7fa9506c2980 1 -- 172.21.15.157:0/2167185079 wait complete. 2024-05-09T09:47:33.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.487+0000 7fa9506c2980 1 Processor -- start 2024-05-09T09:47:33.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.487+0000 7fa9506c2980 1 -- start start 2024-05-09T09:47:33.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.487+0000 7fa9506c2980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5c85b30 0x55d7c5d77fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.487+0000 7fa9506c2980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d7c5c8f450 con 0x55d7c5c85b30 2024-05-09T09:47:33.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.487+0000 7fa94e1dd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5c85b30 0x55d7c5d77fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.487+0000 7fa94e1dd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5c85b30 0x55d7c5d77fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54172/0 (socket says 172.21.15.157:54172) 2024-05-09T09:47:33.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.487+0000 7fa94e1dd640 1 -- 172.21.15.157:0/634772603 learned_addr learned my addr 172.21.15.157:0/634772603 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:33.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.487+0000 7fa94e1dd640 1 -- 172.21.15.157:0/634772603 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7c5d784f0 con 0x55d7c5c85b30 2024-05-09T09:47:33.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.487+0000 7fa94e1dd640 1 --2- 172.21.15.157:0/634772603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5c85b30 0x55d7c5d77fb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa940001e20 tx=0x7fa940000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.487+0000 7fa83ae05640 1 -- 172.21.15.157:0/634772603 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa940012030 con 0x55d7c5c85b30 2024-05-09T09:47:33.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.487+0000 7fa83ae05640 1 -- 172.21.15.157:0/634772603 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa940001480 con 0x55d7c5c85b30 2024-05-09T09:47:33.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.487+0000 7fa83ae05640 1 -- 172.21.15.157:0/634772603 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa94001a940 con 0x55d7c5c85b30 2024-05-09T09:47:33.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.487+0000 7fa9506c2980 1 -- 172.21.15.157:0/634772603 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7c5d78780 con 0x55d7c5c85b30 2024-05-09T09:47:33.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.487+0000 7fa9506c2980 1 -- 172.21.15.157:0/634772603 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7c5d7b410 con 0x55d7c5c85b30 2024-05-09T09:47:33.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.487+0000 7fa83ae05640 1 -- 172.21.15.157:0/634772603 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fa940015020 con 0x55d7c5c85b30 2024-05-09T09:47:33.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.487+0000 7fa83ae05640 1 --2- 172.21.15.157:0/634772603 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa834034c00 0x7fa8340370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.491+0000 7fa83ae05640 1 -- 172.21.15.157:0/634772603 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fa940020030 con 0x55d7c5c85b30 2024-05-09T09:47:33.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.491+0000 7fa94d9dc640 1 --2- 172.21.15.157:0/634772603 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa834034c00 0x7fa8340370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.491+0000 7fa9506c2980 1 --2- 172.21.15.157:0/634772603 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d7c5c8a030 0x55d7c5d7eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.491+0000 7fa9506c2980 1 -- 172.21.15.157:0/634772603 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5d7f540 con 0x55d7c5c8a030 2024-05-09T09:47:33.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.491+0000 7fa94e9de640 1 --2- 172.21.15.157:0/634772603 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d7c5c8a030 0x55d7c5d7eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.491+0000 7fa94d9dc640 1 --2- 172.21.15.157:0/634772603 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa834034c00 0x7fa8340370c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa9440ad000 tx=0x7fa9440a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.491+0000 7fa94e9de640 1 --2- 172.21.15.157:0/634772603 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d7c5c8a030 0x55d7c5d7eef0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.491+0000 7fa94e9de640 1 -- 172.21.15.157:0/634772603 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5c8a030 2024-05-09T09:47:33.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.491+0000 7fa9506c2980 1 -- 172.21.15.157:0/634772603 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5d7c630 con 0x55d7c5c8a030 2024-05-09T09:47:33.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.491+0000 7fa94e9de640 1 -- 172.21.15.157:0/634772603 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5c8a030 2024-05-09T09:47:33.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.491+0000 7fa9506c2980 1 --2- 172.21.15.157:0/634772603 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d7c5d81850 0x55d7c5d83c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.491+0000 7fa9506c2980 1 -- 172.21.15.157:0/634772603 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5d84310 con 0x55d7c5d81850 2024-05-09T09:47:33.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.491+0000 7fa94e1dd640 1 --2- 172.21.15.157:0/634772603 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d7c5d81850 0x55d7c5d83c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.491+0000 7fa94e1dd640 1 --2- 172.21.15.157:0/634772603 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d7c5d81850 0x55d7c5d83c40 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.491+0000 7fa94e1dd640 1 -- 172.21.15.157:0/634772603 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa940008030 con 0x55d7c5d81850 2024-05-09T09:47:33.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.491+0000 7fa9506c2980 1 -- 172.21.15.157:0/634772603 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5d806f0 con 0x55d7c5c8a030 2024-05-09T09:47:33.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.491+0000 7fa94e9de640 1 -- 172.21.15.157:0/634772603 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5c8a030 2024-05-09T09:47:33.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.491+0000 7fa9506c2980 1 --2- 172.21.15.157:0/634772603 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d7c5d85770 0x55d7c5d87b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.491+0000 7fa9506c2980 1 -- 172.21.15.157:0/634772603 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5d88260 con 0x55d7c5d85770 2024-05-09T09:47:33.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.495+0000 7fa94d9dc640 1 --2- 172.21.15.157:0/634772603 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d7c5d85770 0x55d7c5d87b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.495+0000 7fa94d9dc640 1 --2- 172.21.15.157:0/634772603 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d7c5d85770 0x55d7c5d87b60 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.495+0000 7fa94d9dc640 1 -- 172.21.15.157:0/634772603 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa9440b3040 con 0x55d7c5d85770 2024-05-09T09:47:33.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.499+0000 7fa9506c2980 1 Processor -- start 2024-05-09T09:47:33.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.499+0000 7fa9506c2980 1 -- start start 2024-05-09T09:47:33.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.499+0000 7fa9506c2980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5dae0b0 0x55d7c5dae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.499+0000 7fa9506c2980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d7c5b8b020 con 0x55d7c5dae0b0 2024-05-09T09:47:33.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.499+0000 7fa94e1dd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5dae0b0 0x55d7c5dae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.499+0000 7fa94e1dd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5dae0b0 0x55d7c5dae4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54176/0 (socket says 172.21.15.157:54176) 2024-05-09T09:47:33.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.499+0000 7fa94e1dd640 1 -- 172.21.15.157:0/976653216 learned_addr learned my addr 172.21.15.157:0/976653216 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:33.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.499+0000 7fa94e1dd640 1 -- 172.21.15.157:0/976653216 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7c5daea10 con 0x55d7c5dae0b0 2024-05-09T09:47:33.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.499+0000 7fa94e1dd640 1 --2- 172.21.15.157:0/976653216 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5dae0b0 0x55d7c5dae4d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa94001a740 tx=0x7fa940018700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.499+0000 7fa832ba2640 1 -- 172.21.15.157:0/976653216 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa940017c50 con 0x55d7c5dae0b0 2024-05-09T09:47:33.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.499+0000 7fa832ba2640 1 -- 172.21.15.157:0/976653216 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa94003e070 con 0x55d7c5dae0b0 2024-05-09T09:47:33.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.499+0000 7fa832ba2640 1 -- 172.21.15.157:0/976653216 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa94000f990 con 0x55d7c5dae0b0 2024-05-09T09:47:33.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.499+0000 7fa9506c2980 1 -- 172.21.15.157:0/976653216 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7c5daf4a0 con 0x55d7c5dae0b0 2024-05-09T09:47:33.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.499+0000 7fa9506c2980 1 -- 172.21.15.157:0/976653216 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7c5daf980 con 0x55d7c5dae0b0 2024-05-09T09:47:33.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.499+0000 7fa832ba2640 1 -- 172.21.15.157:0/976653216 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fa940009070 con 0x55d7c5dae0b0 2024-05-09T09:47:33.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.503+0000 7fa832ba2640 1 --2- 172.21.15.157:0/976653216 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa828034c00 0x7fa8280370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.503+0000 7fa832ba2640 1 -- 172.21.15.157:0/976653216 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fa940005050 con 0x55d7c5dae0b0 2024-05-09T09:47:33.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.503+0000 7fa94d9dc640 1 --2- 172.21.15.157:0/976653216 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa828034c00 0x7fa8280370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.503+0000 7fa9506c2980 1 Processor -- start 2024-05-09T09:47:33.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.503+0000 7fa9506c2980 1 -- start start 2024-05-09T09:47:33.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.503+0000 7fa94d9dc640 1 --2- 172.21.15.157:0/976653216 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa828034c00 0x7fa8280370c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa9440ae040 tx=0x7fa944005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.503+0000 7fa9506c2980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5dbb020 0x55d7c5dbb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.503+0000 7fa9506c2980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d7c5d714c0 con 0x55d7c5dbb020 2024-05-09T09:47:33.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.503+0000 7fa94e1dd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5dbb020 0x55d7c5dbb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.503+0000 7fa94e1dd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5dbb020 0x55d7c5dbb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54188/0 (socket says 172.21.15.157:54188) 2024-05-09T09:47:33.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.503+0000 7fa94e1dd640 1 -- 172.21.15.157:0/3086545470 learned_addr learned my addr 172.21.15.157:0/3086545470 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:33.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.503+0000 7fa94e1dd640 1 -- 172.21.15.157:0/3086545470 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7c5dbba10 con 0x55d7c5dbb020 2024-05-09T09:47:33.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.503+0000 7fa94e1dd640 1 --2- 172.21.15.157:0/3086545470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5dbb020 0x55d7c5dbb440 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa94003eff0 tx=0x7fa940039910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d98a6dc8b856e06 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.503+0000 7fa830b9e640 1 -- 172.21.15.157:0/3086545470 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa94003adb0 con 0x55d7c5dbb020 2024-05-09T09:47:33.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.503+0000 7fa830b9e640 1 -- 172.21.15.157:0/3086545470 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa94005a070 con 0x55d7c5dbb020 2024-05-09T09:47:33.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.503+0000 7fa830b9e640 1 -- 172.21.15.157:0/3086545470 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9400477d0 con 0x55d7c5dbb020 2024-05-09T09:47:33.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.503+0000 7fa9506c2980 1 -- 172.21.15.157:0/3086545470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5dbb020 msgr2=0x55d7c5dbb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.503+0000 7fa9506c2980 1 --2- 172.21.15.157:0/3086545470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5dbb020 0x55d7c5dbb440 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa94003eff0 tx=0x7fa940039910 comp rx=0 tx=0).stop 2024-05-09T09:47:33.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.503+0000 7fa9506c2980 1 -- 172.21.15.157:0/3086545470 shutdown_connections 2024-05-09T09:47:33.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.503+0000 7fa9506c2980 1 --2- 172.21.15.157:0/3086545470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5dbb020 0x55d7c5dbb440 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.503+0000 7fa9506c2980 1 -- 172.21.15.157:0/3086545470 >> 172.21.15.157:0/3086545470 conn(0x55d7c5db73a0 msgr2=0x55d7c5db5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:33.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.503+0000 7fa9506c2980 1 -- 172.21.15.157:0/3086545470 shutdown_connections 2024-05-09T09:47:33.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.503+0000 7fa9506c2980 1 -- 172.21.15.157:0/3086545470 wait complete. 2024-05-09T09:47:33.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.503+0000 7fa9506c2980 1 Processor -- start 2024-05-09T09:47:33.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.503+0000 7fa9506c2980 1 -- start start 2024-05-09T09:47:33.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.503+0000 7fa9506c2980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5dbb020 0x55d7c5dc2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.503+0000 7fa9506c2980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d7c5dbc110 con 0x55d7c5dbb020 2024-05-09T09:47:33.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.507+0000 7fa94e1dd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5dbb020 0x55d7c5dc2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.507+0000 7fa94e1dd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5dbb020 0x55d7c5dc2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54196/0 (socket says 172.21.15.157:54196) 2024-05-09T09:47:33.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.507+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 learned_addr learned my addr 172.21.15.157:0/133475339 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:33.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.507+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7c5dc2970 con 0x55d7c5dbb020 2024-05-09T09:47:33.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.507+0000 7fa94e1dd640 1 --2- 172.21.15.157:0/133475339 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5dbb020 0x55d7c5dc2430 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa940039950 tx=0x7fa94003cfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.507+0000 7fa81effd640 1 -- 172.21.15.157:0/133475339 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa94006f070 con 0x55d7c5dbb020 2024-05-09T09:47:33.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.507+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7c5dc2970 con 0x55d7c5dbb020 2024-05-09T09:47:33.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.507+0000 7fa81effd640 1 -- 172.21.15.157:0/133475339 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9400477d0 con 0x55d7c5dbb020 2024-05-09T09:47:33.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.507+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7c5dc2df0 con 0x55d7c5dbb020 2024-05-09T09:47:33.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.507+0000 7fa81effd640 1 -- 172.21.15.157:0/133475339 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa940042410 con 0x55d7c5dbb020 2024-05-09T09:47:33.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.507+0000 7fa9506c2980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.507+0000 7fa81effd640 1 -- 172.21.15.157:0/133475339 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fa940072070 con 0x55d7c5dbb020 2024-05-09T09:47:33.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.507+0000 7fa81effd640 1 --2- 172.21.15.157:0/133475339 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa818034b10 0x7fa818036fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.507+0000 7fa81effd640 1 -- 172.21.15.157:0/133475339 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fa940067070 con 0x55d7c5dbb020 2024-05-09T09:47:33.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.507+0000 7fa94d9dc640 1 --2- 172.21.15.157:0/133475339 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa818034b10 0x7fa818036fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.507+0000 7fa9506c2980 1 --2- 172.21.15.157:0/133475339 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d7c5dceec0 0x55d7c5dd1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.507+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5dd1ab0 con 0x55d7c5dceec0 2024-05-09T09:47:33.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.507+0000 7fa94e9de640 1 --2- 172.21.15.157:0/133475339 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d7c5dceec0 0x55d7c5dd1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.507+0000 7fa94d9dc640 1 --2- 172.21.15.157:0/133475339 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa818034b10 0x7fa818036fd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa944000c10 tx=0x7fa9440a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.507+0000 7fa94e9de640 1 --2- 172.21.15.157:0/133475339 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d7c5dceec0 0x55d7c5dd1360 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.511+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.511+0000 7fa9506c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:33.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.511+0000 7fa9506c2980 20 realm 2024-05-09T09:47:33.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.511+0000 7fa9506c2980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.511+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5dd1ec0 con 0x55d7c5dceec0 2024-05-09T09:47:33.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.511+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.511+0000 7fa9506c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:33.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.511+0000 7fa9506c2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:33.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.511+0000 7fa9506c2980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.511+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5dd2760 con 0x55d7c5dceec0 2024-05-09T09:47:33.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.511+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.511+0000 7fa9506c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:33.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.511+0000 7fa9506c2980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.511+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5dd2b00 con 0x55d7c5dceec0 2024-05-09T09:47:33.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.511+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.511+0000 7fa9506c2980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:33.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.511+0000 7fa9506c2980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.511+0000 7fa9506c2980 1 --2- 172.21.15.157:0/133475339 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d7c5dd3860 0x55d7c5dd5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.511+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5dd61d0 con 0x55d7c5dd3860 2024-05-09T09:47:33.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.511+0000 7fa94e1dd640 1 --2- 172.21.15.157:0/133475339 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d7c5dd3860 0x55d7c5dd5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.511+0000 7fa94e1dd640 1 --2- 172.21.15.157:0/133475339 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d7c5dd3860 0x55d7c5dd5c50 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.511+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa940071030 con 0x55d7c5dd3860 2024-05-09T09:47:33.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.511+0000 7fa9506c2980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:33.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.511+0000 7fa9506c2980 20 searching for the correct realm 2024-05-09T09:47:33.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.511+0000 7fa9506c2980 1 --2- 172.21.15.157:0/133475339 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d7c5dd8100 0x55d7c5dda5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.511+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5ddac90 con 0x55d7c5dd8100 2024-05-09T09:47:33.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.511+0000 7fa94d9dc640 1 --2- 172.21.15.157:0/133475339 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d7c5dd8100 0x55d7c5dda5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.511+0000 7fa94d9dc640 1 --2- 172.21.15.157:0/133475339 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d7c5dd8100 0x55d7c5dda5c0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.511+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9440d9070 con 0x55d7c5dd8100 2024-05-09T09:47:33.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.515+0000 7fa94d9dc640 1 --2- 172.21.15.157:0/133475339 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa9440ce040 0x7fa9440db410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.515+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5ddac90 con 0x7fa9440ce040 2024-05-09T09:47:33.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.515+0000 7fa94e9de640 1 --2- 172.21.15.157:0/133475339 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa9440ce040 0x7fa9440db410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.515+0000 7fa94e9de640 1 --2- 172.21.15.157:0/133475339 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa9440ce040 0x7fa9440db410 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.515+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440ce040 2024-05-09T09:47:33.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.515+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5dd2b00 con 0x55d7c5dd3860 2024-05-09T09:47:33.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.515+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa940071030 con 0x55d7c5dd3860 2024-05-09T09:47:33.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.515+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5dd2b00 con 0x55d7c5dceec0 2024-05-09T09:47:33.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.515+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.515+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5dd2b00 con 0x55d7c5dceec0 2024-05-09T09:47:33.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.515+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.515+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5dd2b00 con 0x55d7c5dd3860 2024-05-09T09:47:33.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.515+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa940071030 con 0x55d7c5dd3860 2024-05-09T09:47:33.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.515+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5dd2b00 con 0x55d7c5dd3860 2024-05-09T09:47:33.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.515+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa940071030 con 0x55d7c5dd3860 2024-05-09T09:47:33.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.515+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5dd2b00 con 0x7fa9440ce040 2024-05-09T09:47:33.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.515+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440ce040 2024-05-09T09:47:33.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.515+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5dd2b00 con 0x55d7c5dd8100 2024-05-09T09:47:33.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.515+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9440d9070 con 0x55d7c5dd8100 2024-05-09T09:47:33.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.515+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5dd2b00 con 0x55d7c5dceec0 2024-05-09T09:47:33.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.519+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.519+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5dd2b00 con 0x55d7c5dd3860 2024-05-09T09:47:33.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.519+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa940071030 con 0x55d7c5dd3860 2024-05-09T09:47:33.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.519+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5dd2b00 con 0x55d7c5dceec0 2024-05-09T09:47:33.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.519+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.519+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5dd2b00 con 0x7fa9440ce040 2024-05-09T09:47:33.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.519+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440ce040 2024-05-09T09:47:33.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.519+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5dd2b00 con 0x55d7c5dd8100 2024-05-09T09:47:33.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.519+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9440d9070 con 0x55d7c5dd8100 2024-05-09T09:47:33.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.519+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa9440e8040 con 0x55d7c5dd8100 2024-05-09T09:47:33.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.519+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa9440d9070 con 0x55d7c5dd8100 2024-05-09T09:47:33.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.519+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa9440e8040 con 0x55d7c5dd3860 2024-05-09T09:47:33.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.519+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa940071030 con 0x55d7c5dd3860 2024-05-09T09:47:33.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.519+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa9440e8040 con 0x55d7c5dd8100 2024-05-09T09:47:33.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.519+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9440d9070 con 0x55d7c5dd8100 2024-05-09T09:47:33.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.519+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa9440e8040 con 0x55d7c5dd8100 2024-05-09T09:47:33.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.519+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9440d9070 con 0x55d7c5dd8100 2024-05-09T09:47:33.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.519+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa9440e8040 con 0x55d7c5dceec0 2024-05-09T09:47:33.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.519+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.519+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa9440e8040 con 0x55d7c5dceec0 2024-05-09T09:47:33.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.523+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.523+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa9440e8040 con 0x55d7c5dd3860 2024-05-09T09:47:33.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.523+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa940071030 con 0x55d7c5dd3860 2024-05-09T09:47:33.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.523+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa9440e8040 con 0x55d7c5dd8100 2024-05-09T09:47:33.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.523+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9440d9070 con 0x55d7c5dd8100 2024-05-09T09:47:33.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.523+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa9440e8040 con 0x7fa9440ce040 2024-05-09T09:47:33.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.523+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440ce040 2024-05-09T09:47:33.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.523+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa9440e8040 con 0x55d7c5dceec0 2024-05-09T09:47:33.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.523+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.523+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa9440e8040 con 0x55d7c5dd3860 2024-05-09T09:47:33.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.523+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa940071030 con 0x55d7c5dd3860 2024-05-09T09:47:33.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.523+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa9440e8040 con 0x55d7c5dd8100 2024-05-09T09:47:33.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.523+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9440d9070 con 0x55d7c5dd8100 2024-05-09T09:47:33.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.523+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa9440e8040 con 0x55d7c5dd3860 2024-05-09T09:47:33.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.523+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa940071030 con 0x55d7c5dd3860 2024-05-09T09:47:33.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.523+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa9440e8040 con 0x7fa9440ce040 2024-05-09T09:47:33.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440ce040 2024-05-09T09:47:33.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa9440e8040 con 0x55d7c5dd8100 2024-05-09T09:47:33.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9440d9070 con 0x55d7c5dd8100 2024-05-09T09:47:33.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa9440e8040 con 0x55d7c5dd3860 2024-05-09T09:47:33.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa940071030 con 0x55d7c5dd3860 2024-05-09T09:47:33.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa9440e8040 con 0x55d7c5dceec0 2024-05-09T09:47:33.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa9440e8040 con 0x7fa9440ce040 2024-05-09T09:47:33.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440ce040 2024-05-09T09:47:33.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa9506c2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:33.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa9506c2980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:33.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa9506c2980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:33.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa9506c2980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:33.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa9506c2980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:33.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa9506c2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:33.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa9506c2980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5dd6a20 con 0x55d7c5dceec0 2024-05-09T09:47:33.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa9506c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:33.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa9506c2980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5dd6a20 con 0x55d7c5dceec0 2024-05-09T09:47:33.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa9506c2980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:33.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa9506c2980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5dd6a20 con 0x55d7c5dd8100 2024-05-09T09:47:33.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa9440d9070 con 0x55d7c5dd8100 2024-05-09T09:47:33.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa9506c2980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:33.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa9506c2980 20 zone default found 2024-05-09T09:47:33.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa9506c2980 4 Realm: () 2024-05-09T09:47:33.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa9506c2980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:33.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa9506c2980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:33.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa9506c2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:33.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa9506c2980 20 zonegroup default 2024-05-09T09:47:33.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa9506c2980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5dd72c0 con 0x55d7c5dd3860 2024-05-09T09:47:33.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa940071030 con 0x55d7c5dd3860 2024-05-09T09:47:33.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa9506c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:33.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa9506c2980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.527+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5ddcaf0 con 0x55d7c5dd8100 2024-05-09T09:47:33.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.531+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa9440d9070 con 0x55d7c5dd8100 2024-05-09T09:47:33.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.531+0000 7fa9506c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:33.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.531+0000 7fa9506c2980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.531+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5ddce90 con 0x55d7c5dd8100 2024-05-09T09:47:33.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.531+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa9440d9070 con 0x55d7c5dd8100 2024-05-09T09:47:33.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.531+0000 7fa9506c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:33.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.531+0000 7fa9506c2980 20 started sync module instance, tier type = 2024-05-09T09:47:33.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.531+0000 7fa9506c2980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:33.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.531+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5ddbf90 con 0x7fa9440ce040 2024-05-09T09:47:33.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.531+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440ce040 2024-05-09T09:47:33.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.531+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94385225974960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5ddbf90 con 0x7fa9440ce040 2024-05-09T09:47:33.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.531+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5ddd850 con 0x55d7c5dceec0 2024-05-09T09:47:33.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.531+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94385225974960] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440ce040 2024-05-09T09:47:33.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.535+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.535+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94385225979056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5ddbf90 con 0x55d7c5dceec0 2024-05-09T09:47:33.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.535+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5dde260 con 0x55d7c5dd8100 2024-05-09T09:47:33.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.535+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94385225979056] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.535+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9440d9070 con 0x55d7c5dd8100 2024-05-09T09:47:33.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.535+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94385225972448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5ddbf00 con 0x55d7c5dd8100 2024-05-09T09:47:33.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.535+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5ddefc0 con 0x7fa9440ce040 2024-05-09T09:47:33.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.539+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440ce040 2024-05-09T09:47:33.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.539+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94385225984688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5ddef80 con 0x7fa9440ce040 2024-05-09T09:47:33.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.539+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5ddfe80 con 0x55d7c5dceec0 2024-05-09T09:47:33.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.539+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94385225972448] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9440d9070 con 0x55d7c5dd8100 2024-05-09T09:47:33.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.539+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94385225984688] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440ce040 2024-05-09T09:47:33.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.539+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.539+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94385225983488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5ddf9d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.539+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5de0720 con 0x55d7c5dd3860 2024-05-09T09:47:33.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.539+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94385225983488] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.543+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa940071030 con 0x55d7c5dd3860 2024-05-09T09:47:33.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.543+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94385225990768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5ddf9d0 con 0x55d7c5dd3860 2024-05-09T09:47:33.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.543+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5de0f70 con 0x55d7c5dd3860 2024-05-09T09:47:33.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.543+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa940071030 con 0x55d7c5dd3860 2024-05-09T09:47:33.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.543+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94385225990768] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa940071030 con 0x55d7c5dd3860 2024-05-09T09:47:33.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.543+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94385225986192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5de0f70 con 0x55d7c5dd3860 2024-05-09T09:47:33.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.543+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5de1970 con 0x55d7c5dd3860 2024-05-09T09:47:33.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.547+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94385225986192] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa940071030 con 0x55d7c5dd3860 2024-05-09T09:47:33.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.547+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa940071030 con 0x55d7c5dd3860 2024-05-09T09:47:33.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.547+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94385225995392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5de1b70 con 0x55d7c5dd3860 2024-05-09T09:47:33.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.547+0000 7fa9506c2980 20 add_watcher() i=0 2024-05-09T09:47:33.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.547+0000 7fa9506c2980 20 add_watcher() i=1 2024-05-09T09:47:33.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.547+0000 7fa9506c2980 20 add_watcher() i=2 2024-05-09T09:47:33.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.547+0000 7fa9506c2980 20 add_watcher() i=3 2024-05-09T09:47:33.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.547+0000 7fa9506c2980 20 add_watcher() i=4 2024-05-09T09:47:33.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.547+0000 7fa9506c2980 20 add_watcher() i=5 2024-05-09T09:47:33.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.547+0000 7fa9506c2980 20 add_watcher() i=6 2024-05-09T09:47:33.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.547+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94385225995392] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa940071030 con 0x55d7c5dd3860 2024-05-09T09:47:33.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.547+0000 7fa9506c2980 20 add_watcher() i=7 2024-05-09T09:47:33.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.547+0000 7fa9506c2980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:33.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.547+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5de4f50 con 0x55d7c5dceec0 2024-05-09T09:47:33.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.547+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.547+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94385225996912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5de2340 con 0x55d7c5dceec0 2024-05-09T09:47:33.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.551+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94385225996912] v30'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.551+0000 7fa803fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:33.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.551+0000 7fa9506c2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:33.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.551+0000 7fa9506c2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:33.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.551+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5ded440 con 0x55d7c5dceec0 2024-05-09T09:47:33.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.551+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'29 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.551+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5deda70 con 0x55d7c5dd3860 2024-05-09T09:47:33.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.555+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa940071030 con 0x55d7c5dd3860 2024-05-09T09:47:33.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.555+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5deda70 con 0x55d7c5dd8100 2024-05-09T09:47:33.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.555+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9440d9070 con 0x55d7c5dd8100 2024-05-09T09:47:33.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.555+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5dee040 con 0x55d7c5dceec0 2024-05-09T09:47:33.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.555+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'90 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.555+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5dee4f0 con 0x7fa9440ce040 2024-05-09T09:47:33.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.559+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'59 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440ce040 2024-05-09T09:47:33.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.559+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5dee910 con 0x55d7c5dd8100 2024-05-09T09:47:33.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.559+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'39 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9440d9070 con 0x55d7c5dd8100 2024-05-09T09:47:33.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.559+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5deee80 con 0x55d7c5dceec0 2024-05-09T09:47:33.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.563+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.563+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5def330 con 0x55d7c5dd3860 2024-05-09T09:47:33.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.563+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'39 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa940071030 con 0x55d7c5dd3860 2024-05-09T09:47:33.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.563+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5def330 con 0x7fa9440ce040 2024-05-09T09:47:33.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.567+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440ce040 2024-05-09T09:47:33.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.567+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5def330 con 0x55d7c5dd8100 2024-05-09T09:47:33.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.567+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'29 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9440d9070 con 0x55d7c5dd8100 2024-05-09T09:47:33.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.567+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5deb420 con 0x7fa9440ce040 2024-05-09T09:47:33.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.567+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'60 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440ce040 2024-05-09T09:47:33.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.567+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5deb420 con 0x55d7c5dd3860 2024-05-09T09:47:33.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.571+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa940071030 con 0x55d7c5dd3860 2024-05-09T09:47:33.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.571+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5deb420 con 0x7fa9440ce040 2024-05-09T09:47:33.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.571+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440ce040 2024-05-09T09:47:33.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.571+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5deb250 con 0x55d7c5dd3860 2024-05-09T09:47:33.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.575+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'45 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa940071030 con 0x55d7c5dd3860 2024-05-09T09:47:33.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.575+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5deb250 con 0x55d7c5dceec0 2024-05-09T09:47:33.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.575+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'91 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.575+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5deb250 con 0x55d7c5dd8100 2024-05-09T09:47:33.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.579+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'53 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9440d9070 con 0x55d7c5dd8100 2024-05-09T09:47:33.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.579+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5deb250 con 0x7fa9440ce040 2024-05-09T09:47:33.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.579+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'61 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440ce040 2024-05-09T09:47:33.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.579+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5deb250 con 0x55d7c5dd8100 2024-05-09T09:47:33.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.579+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9440d9070 con 0x55d7c5dd8100 2024-05-09T09:47:33.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.579+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5deb250 con 0x55d7c5dceec0 2024-05-09T09:47:33.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.583+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'31 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.583+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5deb250 con 0x55d7c5dceec0 2024-05-09T09:47:33.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.583+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'92 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.583+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5deb250 con 0x55d7c5dd8100 2024-05-09T09:47:33.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.587+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'54 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9440d9070 con 0x55d7c5dd8100 2024-05-09T09:47:33.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.587+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5deb250 con 0x7fa9440ce040 2024-05-09T09:47:33.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.587+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'33 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440ce040 2024-05-09T09:47:33.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.587+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5deb250 con 0x55d7c5dd8100 2024-05-09T09:47:33.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.587+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9440d9070 con 0x55d7c5dd8100 2024-05-09T09:47:33.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.587+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5deb250 con 0x55d7c5dd8100 2024-05-09T09:47:33.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.591+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'29 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9440d9070 con 0x55d7c5dd8100 2024-05-09T09:47:33.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.591+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5deb250 con 0x55d7c5dd8100 2024-05-09T09:47:33.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.591+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9440d9070 con 0x55d7c5dd8100 2024-05-09T09:47:33.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.591+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5deb250 con 0x55d7c5dd8100 2024-05-09T09:47:33.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.591+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'40 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9440d9070 con 0x55d7c5dd8100 2024-05-09T09:47:33.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.591+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5deb250 con 0x55d7c5dd3860 2024-05-09T09:47:33.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.595+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa940071030 con 0x55d7c5dd3860 2024-05-09T09:47:33.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.595+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5deb250 con 0x55d7c5dd8100 2024-05-09T09:47:33.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.595+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9440d9070 con 0x55d7c5dd8100 2024-05-09T09:47:33.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.595+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5deb250 con 0x55d7c5dd3860 2024-05-09T09:47:33.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.599+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'40 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa940071030 con 0x55d7c5dd3860 2024-05-09T09:47:33.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.599+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5deb250 con 0x55d7c5dd8100 2024-05-09T09:47:33.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.603+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'55 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9440d9070 con 0x55d7c5dd8100 2024-05-09T09:47:33.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.603+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5deb250 con 0x55d7c5dd3860 2024-05-09T09:47:33.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.603+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'46 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa940071030 con 0x55d7c5dd3860 2024-05-09T09:47:33.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.603+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5deb250 con 0x7fa9440ce040 2024-05-09T09:47:33.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.607+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'29 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440ce040 2024-05-09T09:47:33.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.607+0000 7fa802fe5640 20 reqs_thread_entry: start 2024-05-09T09:47:33.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.607+0000 7fa9506c2980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:33.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.607+0000 7fa800fe1640 20 reqs_thread_entry: start 2024-05-09T09:47:33.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.607+0000 7fa9506c2980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.607+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5e0aec0 con 0x55d7c5dceec0 2024-05-09T09:47:33.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.607+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.607+0000 7fa9506c2980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:47:33.607 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-09T09:47:32.044078Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:47:32.044055Z","tags":[],"group_ids":[]} 2024-05-09T09:47:33.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.607+0000 7fa803fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:33.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.607+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94385225996912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5e0aa70 con 0x55d7c5dceec0 2024-05-09T09:47:33.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.611+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94385225996912] v30'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.611+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94385225974960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5de1a70 con 0x7fa9440ce040 2024-05-09T09:47:33.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.611+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94385225974960] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440ce040 2024-05-09T09:47:33.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.611+0000 7fa9506c2980 20 remove_watcher() i=0 2024-05-09T09:47:33.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.611+0000 7fa9506c2980 2 removed watcher, disabling cache 2024-05-09T09:47:33.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.611+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94385225979056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5de1a70 con 0x55d7c5dceec0 2024-05-09T09:47:33.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.615+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94385225979056] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.615+0000 7fa9506c2980 20 remove_watcher() i=1 2024-05-09T09:47:33.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.615+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94385225972448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5de1a70 con 0x55d7c5dd8100 2024-05-09T09:47:33.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.615+0000 7fa94d9dc640 1 -- 172.21.15.157:0/133475339 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94385225972448] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9440d9070 con 0x55d7c5dd8100 2024-05-09T09:47:33.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.615+0000 7fa9506c2980 20 remove_watcher() i=2 2024-05-09T09:47:33.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.615+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94385225984688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5de1a70 con 0x7fa9440ce040 2024-05-09T09:47:33.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.615+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94385225984688] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x7fa9440ce040 2024-05-09T09:47:33.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.615+0000 7fa9506c2980 20 remove_watcher() i=3 2024-05-09T09:47:33.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.615+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94385225983488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5ddeab0 con 0x55d7c5dceec0 2024-05-09T09:47:33.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.619+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94385225983488] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94800a4d0 con 0x55d7c5dceec0 2024-05-09T09:47:33.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.619+0000 7fa9506c2980 20 remove_watcher() i=4 2024-05-09T09:47:33.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.619+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94385225990768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5de1a70 con 0x55d7c5dd3860 2024-05-09T09:47:33.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.619+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94385225990768] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa940071030 con 0x55d7c5dd3860 2024-05-09T09:47:33.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.623+0000 7fa9506c2980 20 remove_watcher() i=5 2024-05-09T09:47:33.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.623+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94385225986192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5ddeab0 con 0x55d7c5dd3860 2024-05-09T09:47:33.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.623+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94385225986192] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa940071030 con 0x55d7c5dd3860 2024-05-09T09:47:33.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.623+0000 7fa9506c2980 20 remove_watcher() i=6 2024-05-09T09:47:33.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.623+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94385225995392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7c5de0270 con 0x55d7c5dd3860 2024-05-09T09:47:33.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa94e1dd640 1 -- 172.21.15.157:0/133475339 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94385225995392] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa940071030 con 0x55d7c5dd3860 2024-05-09T09:47:33.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 20 remove_watcher() i=7 2024-05-09T09:47:33.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d7c5dd3860 msgr2=0x55d7c5dd5c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 --2- 172.21.15.157:0/133475339 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d7c5dd3860 0x55d7c5dd5c50 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d7c5dceec0 msgr2=0x55d7c5dd1360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 --2- 172.21.15.157:0/133475339 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d7c5dceec0 0x55d7c5dd1360 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa9440ce040 msgr2=0x7fa9440db410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 --2- 172.21.15.157:0/133475339 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa9440ce040 0x7fa9440db410 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d7c5dd8100 msgr2=0x55d7c5dda5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 --2- 172.21.15.157:0/133475339 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d7c5dd8100 0x55d7c5dda5c0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa818034b10 msgr2=0x7fa818036fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 --2- 172.21.15.157:0/133475339 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa818034b10 0x7fa818036fd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa944000c10 tx=0x7fa9440a6000 comp rx=0 tx=0).stop 2024-05-09T09:47:33.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5dbb020 msgr2=0x55d7c5dc2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 --2- 172.21.15.157:0/133475339 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5dbb020 0x55d7c5dc2430 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa940039950 tx=0x7fa94003cfc0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa94e9de640 1 -- 172.21.15.157:0/133475339 reap_dead start 2024-05-09T09:47:33.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 shutdown_connections 2024-05-09T09:47:33.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 --2- 172.21.15.157:0/133475339 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5dbb020 0x55d7c5dc2430 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 >> 172.21.15.157:0/133475339 conn(0x55d7c5db73a0 msgr2=0x55d7c5db4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:33.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 shutdown_connections 2024-05-09T09:47:33.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 -- 172.21.15.157:0/133475339 wait complete. 2024-05-09T09:47:33.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 -- 172.21.15.157:0/976653216 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa828034c00 msgr2=0x7fa8280370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 --2- 172.21.15.157:0/976653216 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa828034c00 0x7fa8280370c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa9440ae040 tx=0x7fa944005a10 comp rx=0 tx=0).stop 2024-05-09T09:47:33.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 -- 172.21.15.157:0/976653216 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5dae0b0 msgr2=0x55d7c5dae4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 --2- 172.21.15.157:0/976653216 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5dae0b0 0x55d7c5dae4d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa94001a740 tx=0x7fa940018700 comp rx=0 tx=0).stop 2024-05-09T09:47:33.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 -- 172.21.15.157:0/976653216 shutdown_connections 2024-05-09T09:47:33.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 --2- 172.21.15.157:0/976653216 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa828034c00 0x7fa8280370c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 --2- 172.21.15.157:0/976653216 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5dae0b0 0x55d7c5dae4d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 -- 172.21.15.157:0/976653216 >> 172.21.15.157:0/976653216 conn(0x55d7c5da2e80 msgr2=0x55d7c5da3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:33.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 -- 172.21.15.157:0/976653216 shutdown_connections 2024-05-09T09:47:33.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 -- 172.21.15.157:0/976653216 wait complete. 2024-05-09T09:47:33.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 -- 172.21.15.157:0/634772603 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d7c5d81850 msgr2=0x55d7c5d83c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 --2- 172.21.15.157:0/634772603 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d7c5d81850 0x55d7c5d83c40 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 -- 172.21.15.157:0/634772603 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d7c5c8a030 msgr2=0x55d7c5d7eef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 --2- 172.21.15.157:0/634772603 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d7c5c8a030 0x55d7c5d7eef0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 -- 172.21.15.157:0/634772603 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d7c5d85770 msgr2=0x55d7c5d87b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 --2- 172.21.15.157:0/634772603 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d7c5d85770 0x55d7c5d87b60 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 -- 172.21.15.157:0/634772603 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa834034c00 msgr2=0x7fa8340370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 --2- 172.21.15.157:0/634772603 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa834034c00 0x7fa8340370c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa9440ad000 tx=0x7fa9440a5040 comp rx=0 tx=0).stop 2024-05-09T09:47:33.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 -- 172.21.15.157:0/634772603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5c85b30 msgr2=0x55d7c5d77fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 --2- 172.21.15.157:0/634772603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7c5c85b30 0x55d7c5d77fb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa940001e20 tx=0x7fa940000ee0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa94e9de640 1 -- 172.21.15.157:0/634772603 reap_dead start 2024-05-09T09:47:33.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 -- 172.21.15.157:0/634772603 shutdown_connections 2024-05-09T09:47:33.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 -- 172.21.15.157:0/634772603 >> 172.21.15.157:0/634772603 conn(0x55d7c5bf9250 msgr2=0x55d7c5d6b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:33.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 -- 172.21.15.157:0/634772603 shutdown_connections 2024-05-09T09:47:33.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.627+0000 7fa9506c2980 1 -- 172.21.15.157:0/634772603 wait complete. 2024-05-09T09:47:33.638 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-09T09:47:32.044078Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:47:32.044055Z', 'tags': [], 'group_ids': []} 2024-05-09T09:47:33.638 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-05-09T09:47:33.638 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-05-09T09:47:33.639 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-05-09T09:47:33.722 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:33.722 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:33.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.723+0000 7f22e1ae1980 1 Processor -- start 2024-05-09T09:47:33.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.723+0000 7f22e1ae1980 1 -- start start 2024-05-09T09:47:33.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.723+0000 7f22e1ae1980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x56138e343fd0 0x56138e3463c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.723+0000 7f22e1ae1980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56138e1f3440 con 0x56138e33fad0 2024-05-09T09:47:33.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.723+0000 7f22e1ae1980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x56138e1de5f0 con 0x56138e343fd0 2024-05-09T09:47:33.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.723+0000 7f22dedfb640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x56138e343fd0 0x56138e3463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.723+0000 7f22df5fc640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x56138e33fad0 0x56138e33feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:33652/0 (socket says 172.21.15.157:33652) 2024-05-09T09:47:33.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.723+0000 7f22dedfb640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x56138e343fd0 0x56138e3463c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54210/0 (socket says 172.21.15.157:54210) 2024-05-09T09:47:33.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.723+0000 7f22df5fc640 1 -- 172.21.15.157:0/177928495 learned_addr learned my addr 172.21.15.157:0/177928495 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:47:33.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.727+0000 7f22dedfb640 1 -- 172.21.15.157:0/177928495 >> v1:172.21.15.110:6789/0 conn(0x56138e33fad0 legacy=0x56138e33feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.727+0000 7f22dedfb640 1 -- 172.21.15.157:0/177928495 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56138e1e9990 con 0x56138e343fd0 2024-05-09T09:47:33.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.727+0000 7f22dedfb640 1 --2- 172.21.15.157:0/177928495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e343fd0 0x56138e3463c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f22d400a480 tx=0x7f22d401b110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5d2237f9715dab server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.727+0000 7f22de5fa640 1 -- 172.21.15.157:0/177928495 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22d40af070 con 0x56138e343fd0 2024-05-09T09:47:33.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.727+0000 7f22de5fa640 1 -- 172.21.15.157:0/177928495 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22d40a3e50 con 0x56138e343fd0 2024-05-09T09:47:33.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.727+0000 7f22de5fa640 1 -- 172.21.15.157:0/177928495 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22d40aa680 con 0x56138e343fd0 2024-05-09T09:47:33.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.727+0000 7f22e1ae1980 1 -- 172.21.15.157:0/177928495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e343fd0 msgr2=0x56138e3463c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.727+0000 7f22e1ae1980 1 --2- 172.21.15.157:0/177928495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e343fd0 0x56138e3463c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f22d400a480 tx=0x7f22d401b110 comp rx=0 tx=0).stop 2024-05-09T09:47:33.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.727+0000 7f22e1ae1980 1 -- 172.21.15.157:0/177928495 shutdown_connections 2024-05-09T09:47:33.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.727+0000 7f22e1ae1980 1 --2- 172.21.15.157:0/177928495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e343fd0 0x56138e3463c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.727+0000 7f22e1ae1980 1 -- 172.21.15.157:0/177928495 >> 172.21.15.157:0/177928495 conn(0x56138e2b31f0 msgr2=0x56138e2b3600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:33.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.727+0000 7f22e1ae1980 1 -- 172.21.15.157:0/177928495 shutdown_connections 2024-05-09T09:47:33.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.731+0000 7f22e1ae1980 1 -- 172.21.15.157:0/177928495 wait complete. 2024-05-09T09:47:33.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.743+0000 7f22e1ae1980 1 Processor -- start 2024-05-09T09:47:33.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.743+0000 7f22e1ae1980 1 -- start start 2024-05-09T09:47:33.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.743+0000 7f22e1ae1980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e33fad0 0x56138e42add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.743+0000 7f22e1ae1980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56138e240fe0 con 0x56138e33fad0 2024-05-09T09:47:33.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.747+0000 7f22df5fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e33fad0 0x56138e42add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.747+0000 7f22df5fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e33fad0 0x56138e42add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54222/0 (socket says 172.21.15.157:54222) 2024-05-09T09:47:33.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.747+0000 7f22df5fc640 1 -- 172.21.15.157:0/2750801394 learned_addr learned my addr 172.21.15.157:0/2750801394 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:33.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.747+0000 7f22df5fc640 1 -- 172.21.15.157:0/2750801394 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56138e1c5ae0 con 0x56138e33fad0 2024-05-09T09:47:33.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.747+0000 7f22df5fc640 1 --2- 172.21.15.157:0/2750801394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e33fad0 0x56138e42add0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f22d000b570 tx=0x7f22d000ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaeab65b032c03d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.747+0000 7f21cd60a640 1 -- 172.21.15.157:0/2750801394 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22d000d700 con 0x56138e33fad0 2024-05-09T09:47:33.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.747+0000 7f21cd60a640 1 -- 172.21.15.157:0/2750801394 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22d0008070 con 0x56138e33fad0 2024-05-09T09:47:33.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.747+0000 7f21cd60a640 1 -- 172.21.15.157:0/2750801394 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22d000da30 con 0x56138e33fad0 2024-05-09T09:47:33.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.747+0000 7f22e1ae1980 1 -- 172.21.15.157:0/2750801394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e33fad0 msgr2=0x56138e42add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.747+0000 7f22e1ae1980 1 --2- 172.21.15.157:0/2750801394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e33fad0 0x56138e42add0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f22d000b570 tx=0x7f22d000ba30 comp rx=0 tx=0).stop 2024-05-09T09:47:33.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.747+0000 7f22e1ae1980 1 -- 172.21.15.157:0/2750801394 shutdown_connections 2024-05-09T09:47:33.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.747+0000 7f22e1ae1980 1 --2- 172.21.15.157:0/2750801394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e33fad0 0x56138e42add0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.747+0000 7f22e1ae1980 1 -- 172.21.15.157:0/2750801394 >> 172.21.15.157:0/2750801394 conn(0x56138e2b31f0 msgr2=0x56138e426960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:33.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.747+0000 7f22e1ae1980 1 -- 172.21.15.157:0/2750801394 shutdown_connections 2024-05-09T09:47:33.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.747+0000 7f22e1ae1980 1 -- 172.21.15.157:0/2750801394 wait complete. 2024-05-09T09:47:33.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.747+0000 7f22e1ae1980 1 Processor -- start 2024-05-09T09:47:33.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.747+0000 7f22e1ae1980 1 -- start start 2024-05-09T09:47:33.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.747+0000 7f22e1ae1980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e33fad0 0x56138e4320a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.747+0000 7f22e1ae1980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56138e3493f0 con 0x56138e33fad0 2024-05-09T09:47:33.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.747+0000 7f22df5fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e33fad0 0x56138e4320a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.747+0000 7f22df5fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e33fad0 0x56138e4320a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54230/0 (socket says 172.21.15.157:54230) 2024-05-09T09:47:33.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.747+0000 7f22df5fc640 1 -- 172.21.15.157:0/111375640 learned_addr learned my addr 172.21.15.157:0/111375640 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:33.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.747+0000 7f22df5fc640 1 -- 172.21.15.157:0/111375640 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56138e4325e0 con 0x56138e33fad0 2024-05-09T09:47:33.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.751+0000 7f22df5fc640 1 --2- 172.21.15.157:0/111375640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e33fad0 0x56138e4320a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f22d0001ee0 tx=0x7f22d0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.751+0000 7f21cbe07640 1 -- 172.21.15.157:0/111375640 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22d0001700 con 0x56138e33fad0 2024-05-09T09:47:33.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.751+0000 7f21cbe07640 1 -- 172.21.15.157:0/111375640 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22d001da20 con 0x56138e33fad0 2024-05-09T09:47:33.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.751+0000 7f21cbe07640 1 -- 172.21.15.157:0/111375640 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22d001dd20 con 0x56138e33fad0 2024-05-09T09:47:33.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.751+0000 7f22e1ae1980 1 -- 172.21.15.157:0/111375640 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56138e432870 con 0x56138e33fad0 2024-05-09T09:47:33.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.751+0000 7f22e1ae1980 1 -- 172.21.15.157:0/111375640 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56138e435500 con 0x56138e33fad0 2024-05-09T09:47:33.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.751+0000 7f21cbe07640 1 -- 172.21.15.157:0/111375640 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f22d000f440 con 0x56138e33fad0 2024-05-09T09:47:33.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.751+0000 7f21cbe07640 1 --2- 172.21.15.157:0/111375640 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f21c4034c00 0x7f21c40370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.751+0000 7f21cbe07640 1 -- 172.21.15.157:0/111375640 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f22d004ad70 con 0x56138e33fad0 2024-05-09T09:47:33.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.751+0000 7f22e1ae1980 1 --2- 172.21.15.157:0/111375640 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56138e343fd0 0x56138e439150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.751+0000 7f22dedfb640 1 --2- 172.21.15.157:0/111375640 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f21c4034c00 0x7f21c40370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.751+0000 7f22e1ae1980 1 -- 172.21.15.157:0/111375640 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56138e439690 con 0x56138e343fd0 2024-05-09T09:47:33.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.751+0000 7f22dfdfd640 1 --2- 172.21.15.157:0/111375640 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56138e343fd0 0x56138e439150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.751+0000 7f22dedfb640 1 --2- 172.21.15.157:0/111375640 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f21c4034c00 0x7f21c40370c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f22d40ac000 tx=0x7f22d40a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.751+0000 7f22dfdfd640 1 --2- 172.21.15.157:0/111375640 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56138e343fd0 0x56138e439150 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.751+0000 7f22dfdfd640 1 -- 172.21.15.157:0/111375640 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e343fd0 2024-05-09T09:47:33.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.751+0000 7f22e1ae1980 1 -- 172.21.15.157:0/111375640 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56138e4366c0 con 0x56138e343fd0 2024-05-09T09:47:33.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.755+0000 7f22dfdfd640 1 -- 172.21.15.157:0/111375640 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e343fd0 2024-05-09T09:47:33.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.755+0000 7f22e1ae1980 1 --2- 172.21.15.157:0/111375640 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56138e43b9b0 0x56138e43dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.755+0000 7f22e1ae1980 1 -- 172.21.15.157:0/111375640 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56138e43e470 con 0x56138e43b9b0 2024-05-09T09:47:33.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.755+0000 7f22df5fc640 1 --2- 172.21.15.157:0/111375640 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56138e43b9b0 0x56138e43dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.755+0000 7f22df5fc640 1 --2- 172.21.15.157:0/111375640 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56138e43b9b0 0x56138e43dda0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.755+0000 7f22df5fc640 1 -- 172.21.15.157:0/111375640 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f22d0019cc0 con 0x56138e43b9b0 2024-05-09T09:47:33.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.755+0000 7f22e1ae1980 1 -- 172.21.15.157:0/111375640 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56138e43a850 con 0x56138e343fd0 2024-05-09T09:47:33.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.755+0000 7f22dfdfd640 1 -- 172.21.15.157:0/111375640 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e343fd0 2024-05-09T09:47:33.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.755+0000 7f22e1ae1980 1 --2- 172.21.15.157:0/111375640 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56138e43f8b0 0x56138e441ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.755+0000 7f22e1ae1980 1 -- 172.21.15.157:0/111375640 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56138e4423e0 con 0x56138e43f8b0 2024-05-09T09:47:33.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.755+0000 7f22dedfb640 1 --2- 172.21.15.157:0/111375640 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56138e43f8b0 0x56138e441ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.755+0000 7f22dedfb640 1 --2- 172.21.15.157:0/111375640 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56138e43f8b0 0x56138e441ca0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.755+0000 7f22dedfb640 1 -- 172.21.15.157:0/111375640 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f22d40b2040 con 0x56138e43f8b0 2024-05-09T09:47:33.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.759+0000 7f22e1ae1980 1 Processor -- start 2024-05-09T09:47:33.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.759+0000 7f22e1ae1980 1 -- start start 2024-05-09T09:47:33.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.759+0000 7f22e1ae1980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e468250 0x56138e468670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.759+0000 7f22e1ae1980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56138e245020 con 0x56138e468250 2024-05-09T09:47:33.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.759+0000 7f22df5fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e468250 0x56138e468670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.759+0000 7f22df5fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e468250 0x56138e468670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54238/0 (socket says 172.21.15.157:54238) 2024-05-09T09:47:33.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.759+0000 7f22df5fc640 1 -- 172.21.15.157:0/3672497511 learned_addr learned my addr 172.21.15.157:0/3672497511 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:33.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.763+0000 7f22df5fc640 1 -- 172.21.15.157:0/3672497511 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56138e468bb0 con 0x56138e468250 2024-05-09T09:47:33.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.763+0000 7f22df5fc640 1 --2- 172.21.15.157:0/3672497511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e468250 0x56138e468670 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f22d001afd0 tx=0x7f22d0035300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.763+0000 7f21c3fff640 1 -- 172.21.15.157:0/3672497511 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22d002ebc0 con 0x56138e468250 2024-05-09T09:47:33.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.763+0000 7f21c3fff640 1 -- 172.21.15.157:0/3672497511 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22d002ed60 con 0x56138e468250 2024-05-09T09:47:33.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.763+0000 7f22e1ae1980 1 -- 172.21.15.157:0/3672497511 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56138e469640 con 0x56138e468250 2024-05-09T09:47:33.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.763+0000 7f21c3fff640 1 -- 172.21.15.157:0/3672497511 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22d0019860 con 0x56138e468250 2024-05-09T09:47:33.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.763+0000 7f22e1ae1980 1 -- 172.21.15.157:0/3672497511 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56138e469b20 con 0x56138e468250 2024-05-09T09:47:33.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.763+0000 7f21c3fff640 1 -- 172.21.15.157:0/3672497511 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f22d0050020 con 0x56138e468250 2024-05-09T09:47:33.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.763+0000 7f21c3fff640 1 --2- 172.21.15.157:0/3672497511 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f21b8034c00 0x7f21b80370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.763+0000 7f21c3fff640 1 -- 172.21.15.157:0/3672497511 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f22d003d070 con 0x56138e468250 2024-05-09T09:47:33.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.763+0000 7f22dedfb640 1 --2- 172.21.15.157:0/3672497511 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f21b8034c00 0x7f21b80370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.763+0000 7f22e1ae1980 1 Processor -- start 2024-05-09T09:47:33.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.763+0000 7f22e1ae1980 1 -- start start 2024-05-09T09:47:33.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.763+0000 7f22e1ae1980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e4751c0 0x56138e4755e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.763+0000 7f22e1ae1980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56138e42b520 con 0x56138e4751c0 2024-05-09T09:47:33.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.763+0000 7f22dedfb640 1 --2- 172.21.15.157:0/3672497511 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f21b8034c00 0x7f21b80370c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x56138e439b10 tx=0x7f22d4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.767+0000 7f22df5fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e4751c0 0x56138e4755e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.767+0000 7f22df5fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e4751c0 0x56138e4755e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54252/0 (socket says 172.21.15.157:54252) 2024-05-09T09:47:33.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.767+0000 7f22df5fc640 1 -- 172.21.15.157:0/304801211 learned_addr learned my addr 172.21.15.157:0/304801211 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:33.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.767+0000 7f22df5fc640 1 -- 172.21.15.157:0/304801211 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56138e475bb0 con 0x56138e4751c0 2024-05-09T09:47:33.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.767+0000 7f22df5fc640 1 --2- 172.21.15.157:0/304801211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e4751c0 0x56138e4755e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f22d0019c10 tx=0x7f22d0019a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f34f6311f4ceda9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.767+0000 7f21c1ffb640 1 -- 172.21.15.157:0/304801211 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22d0051e40 con 0x56138e4751c0 2024-05-09T09:47:33.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.767+0000 7f21c1ffb640 1 -- 172.21.15.157:0/304801211 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22d0035c70 con 0x56138e4751c0 2024-05-09T09:47:33.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.767+0000 7f21c1ffb640 1 -- 172.21.15.157:0/304801211 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22d0042920 con 0x56138e4751c0 2024-05-09T09:47:33.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.767+0000 7f22e1ae1980 1 -- 172.21.15.157:0/304801211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e4751c0 msgr2=0x56138e4755e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.767+0000 7f22e1ae1980 1 --2- 172.21.15.157:0/304801211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e4751c0 0x56138e4755e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f22d0019c10 tx=0x7f22d0019a00 comp rx=0 tx=0).stop 2024-05-09T09:47:33.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.771+0000 7f22e1ae1980 1 -- 172.21.15.157:0/304801211 shutdown_connections 2024-05-09T09:47:33.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.771+0000 7f22e1ae1980 1 --2- 172.21.15.157:0/304801211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e4751c0 0x56138e4755e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.771+0000 7f22e1ae1980 1 -- 172.21.15.157:0/304801211 >> 172.21.15.157:0/304801211 conn(0x56138e471540 msgr2=0x56138e46f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:33.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.771+0000 7f22e1ae1980 1 -- 172.21.15.157:0/304801211 shutdown_connections 2024-05-09T09:47:33.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.771+0000 7f22e1ae1980 1 -- 172.21.15.157:0/304801211 wait complete. 2024-05-09T09:47:33.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.771+0000 7f22e1ae1980 1 Processor -- start 2024-05-09T09:47:33.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.771+0000 7f22e1ae1980 1 -- start start 2024-05-09T09:47:33.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.771+0000 7f22e1ae1980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e4751c0 0x56138e47c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.771+0000 7f22e1ae1980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56138e476280 con 0x56138e4751c0 2024-05-09T09:47:33.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.771+0000 7f22df5fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e4751c0 0x56138e47c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.771+0000 7f22df5fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e4751c0 0x56138e47c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54254/0 (socket says 172.21.15.157:54254) 2024-05-09T09:47:33.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.771+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 learned_addr learned my addr 172.21.15.157:0/4147720286 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:33.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.771+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56138e47c9b0 con 0x56138e4751c0 2024-05-09T09:47:33.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.771+0000 7f22df5fc640 1 --2- 172.21.15.157:0/4147720286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e4751c0 0x56138e47c470 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f22d0019c10 tx=0x7f22d0009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f21affff640 1 -- 172.21.15.157:0/4147720286 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22d006b070 con 0x56138e4751c0 2024-05-09T09:47:33.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f21affff640 1 -- 172.21.15.157:0/4147720286 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22d0051e40 con 0x56138e4751c0 2024-05-09T09:47:33.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56138e47c9b0 con 0x56138e4751c0 2024-05-09T09:47:33.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f21affff640 1 -- 172.21.15.157:0/4147720286 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22d002fa00 con 0x56138e4751c0 2024-05-09T09:47:33.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56138e47c9b0 con 0x56138e4751c0 2024-05-09T09:47:33.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f21affff640 1 -- 172.21.15.157:0/4147720286 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f22d006e070 con 0x56138e4751c0 2024-05-09T09:47:33.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f21affff640 1 --2- 172.21.15.157:0/4147720286 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f21a8034c00 0x7f21a80370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f21affff640 1 -- 172.21.15.157:0/4147720286 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f22d0062040 con 0x56138e4751c0 2024-05-09T09:47:33.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f22dedfb640 1 --2- 172.21.15.157:0/4147720286 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f21a8034c00 0x7f21a80370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f22e1ae1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f22e1ae1980 1 --2- 172.21.15.157:0/4147720286 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56138e488fe0 0x56138e48b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56138e48bbf0 con 0x56138e488fe0 2024-05-09T09:47:33.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f22dfdfd640 1 --2- 172.21.15.157:0/4147720286 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56138e488fe0 0x56138e48b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f22dedfb640 1 --2- 172.21.15.157:0/4147720286 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f21a8034c00 0x7f21a80370c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f22d4000c10 tx=0x7f22d40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f22dfdfd640 1 --2- 172.21.15.157:0/4147720286 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56138e488fe0 0x56138e48b4a0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f22e1ae1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f22e1ae1980 20 realm 2024-05-09T09:47:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f22e1ae1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56138e48c000 con 0x56138e488fe0 2024-05-09T09:47:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f22e1ae1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f22e1ae1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f22e1ae1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56138e48c8d0 con 0x56138e488fe0 2024-05-09T09:47:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f22e1ae1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:33.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f22e1ae1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56138e48cc70 con 0x56138e488fe0 2024-05-09T09:47:33.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.775+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.779+0000 7f22e1ae1980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:33.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.779+0000 7f22e1ae1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.779+0000 7f22e1ae1980 1 --2- 172.21.15.157:0/4147720286 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56138e48d9d0 0x56138e48fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.779+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56138e490380 con 0x56138e48d9d0 2024-05-09T09:47:33.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.779+0000 7f22df5fc640 1 --2- 172.21.15.157:0/4147720286 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56138e48d9d0 0x56138e48fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.779+0000 7f22df5fc640 1 --2- 172.21.15.157:0/4147720286 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56138e48d9d0 0x56138e48fdc0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.779+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f22d0077070 con 0x56138e48d9d0 2024-05-09T09:47:33.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.779+0000 7f22e1ae1980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:33.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.779+0000 7f22e1ae1980 20 searching for the correct realm 2024-05-09T09:47:33.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.779+0000 7f22e1ae1980 1 --2- 172.21.15.157:0/4147720286 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56138e4922d0 0x56138e4946e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.779+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56138e494db0 con 0x56138e4922d0 2024-05-09T09:47:33.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.779+0000 7f22dedfb640 1 --2- 172.21.15.157:0/4147720286 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56138e4922d0 0x56138e4946e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.779+0000 7f22dedfb640 1 --2- 172.21.15.157:0/4147720286 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56138e4922d0 0x56138e4946e0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.779+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22d40d8070 con 0x56138e4922d0 2024-05-09T09:47:33.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.779+0000 7f22dedfb640 1 --2- 172.21.15.157:0/4147720286 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f22d40cd040 0x7f22d40da920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:33.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.779+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56138e494db0 con 0x7f22d40cd040 2024-05-09T09:47:33.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.779+0000 7f22dfdfd640 1 --2- 172.21.15.157:0/4147720286 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f22d40cd040 0x7f22d40da920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:33.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.779+0000 7f22dfdfd640 1 --2- 172.21.15.157:0/4147720286 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f22d40cd040 0x7f22d40da920 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:33.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.779+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22d800a4d0 con 0x7f22d40cd040 2024-05-09T09:47:33.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.779+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56138e48cc70 con 0x56138e48d9d0 2024-05-09T09:47:33.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.783+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22d0077070 con 0x56138e48d9d0 2024-05-09T09:47:33.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.783+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56138e48cc70 con 0x56138e488fe0 2024-05-09T09:47:33.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.783+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.783+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56138e48cc70 con 0x56138e488fe0 2024-05-09T09:47:33.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.783+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.783+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56138e48cc70 con 0x56138e48d9d0 2024-05-09T09:47:33.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.783+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22d0077070 con 0x56138e48d9d0 2024-05-09T09:47:33.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.783+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56138e48cc70 con 0x56138e48d9d0 2024-05-09T09:47:33.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.783+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22d0077070 con 0x56138e48d9d0 2024-05-09T09:47:33.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.783+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56138e48cc70 con 0x7f22d40cd040 2024-05-09T09:47:33.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.783+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22d800a4d0 con 0x7f22d40cd040 2024-05-09T09:47:33.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.783+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56138e48cc70 con 0x56138e4922d0 2024-05-09T09:47:33.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.783+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22d40d8070 con 0x56138e4922d0 2024-05-09T09:47:33.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.783+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56138e48cc70 con 0x56138e488fe0 2024-05-09T09:47:33.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.783+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.783+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56138e48cc70 con 0x56138e48d9d0 2024-05-09T09:47:33.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.787+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22d0077070 con 0x56138e48d9d0 2024-05-09T09:47:33.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.787+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56138e48cc70 con 0x56138e488fe0 2024-05-09T09:47:33.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.787+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.787+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56138e48cc70 con 0x7f22d40cd040 2024-05-09T09:47:33.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.787+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f22d800a4d0 con 0x7f22d40cd040 2024-05-09T09:47:33.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.787+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56138e48cc70 con 0x56138e4922d0 2024-05-09T09:47:33.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.787+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22d40d8070 con 0x56138e4922d0 2024-05-09T09:47:33.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.787+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f22d40e7040 con 0x56138e4922d0 2024-05-09T09:47:33.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.787+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f22d40d8070 con 0x56138e4922d0 2024-05-09T09:47:33.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.787+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f22d40e7040 con 0x56138e48d9d0 2024-05-09T09:47:33.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.787+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22d0077070 con 0x56138e48d9d0 2024-05-09T09:47:33.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.787+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f22d40e7040 con 0x56138e4922d0 2024-05-09T09:47:33.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.787+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22d40d8070 con 0x56138e4922d0 2024-05-09T09:47:33.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.787+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f22d40e7040 con 0x56138e4922d0 2024-05-09T09:47:33.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.787+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22d40d8070 con 0x56138e4922d0 2024-05-09T09:47:33.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.787+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f22d40e7040 con 0x56138e488fe0 2024-05-09T09:47:33.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.787+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.787+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f22d40e7040 con 0x56138e488fe0 2024-05-09T09:47:33.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.787+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.787+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f22d40e7040 con 0x56138e48d9d0 2024-05-09T09:47:33.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.791+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22d0077070 con 0x56138e48d9d0 2024-05-09T09:47:33.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.791+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f22d40e7040 con 0x56138e4922d0 2024-05-09T09:47:33.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.791+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22d40d8070 con 0x56138e4922d0 2024-05-09T09:47:33.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.791+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f22d40e7040 con 0x7f22d40cd040 2024-05-09T09:47:33.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.791+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22d800a4d0 con 0x7f22d40cd040 2024-05-09T09:47:33.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.791+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f22d40e7040 con 0x56138e488fe0 2024-05-09T09:47:33.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.791+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.791+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f22d40e7040 con 0x56138e48d9d0 2024-05-09T09:47:33.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.791+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f22d0077070 con 0x56138e48d9d0 2024-05-09T09:47:33.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.791+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f22d40e7040 con 0x56138e4922d0 2024-05-09T09:47:33.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.791+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22d40d8070 con 0x56138e4922d0 2024-05-09T09:47:33.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.791+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f22d40e7040 con 0x56138e48d9d0 2024-05-09T09:47:33.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.791+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22d0077070 con 0x56138e48d9d0 2024-05-09T09:47:33.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.791+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f22d40e7040 con 0x7f22d40cd040 2024-05-09T09:47:33.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.791+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22d800a4d0 con 0x7f22d40cd040 2024-05-09T09:47:33.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.791+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f22d40e7040 con 0x56138e4922d0 2024-05-09T09:47:33.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.791+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22d40d8070 con 0x56138e4922d0 2024-05-09T09:47:33.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.791+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f22d40e7040 con 0x56138e48d9d0 2024-05-09T09:47:33.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22d0077070 con 0x56138e48d9d0 2024-05-09T09:47:33.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f22d40e7040 con 0x56138e488fe0 2024-05-09T09:47:33.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f22d40e7040 con 0x7f22d40cd040 2024-05-09T09:47:33.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22d800a4d0 con 0x7f22d40cd040 2024-05-09T09:47:33.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:33.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:33.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:33.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:33.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:33.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:33.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56138e490c40 con 0x56138e488fe0 2024-05-09T09:47:33.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:33.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56138e490c40 con 0x56138e488fe0 2024-05-09T09:47:33.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:33.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56138e490c40 con 0x56138e4922d0 2024-05-09T09:47:33.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f22d40d8070 con 0x56138e4922d0 2024-05-09T09:47:33.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:33.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 20 zone default found 2024-05-09T09:47:33.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 4 Realm: () 2024-05-09T09:47:33.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:33.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:33.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:33.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 20 zonegroup default 2024-05-09T09:47:33.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56138e491600 con 0x56138e48d9d0 2024-05-09T09:47:33.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f22d0077070 con 0x56138e48d9d0 2024-05-09T09:47:33.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:33.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56138e4911a0 con 0x56138e4922d0 2024-05-09T09:47:33.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f22d40d8070 con 0x56138e4922d0 2024-05-09T09:47:33.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:33.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56138e497160 con 0x56138e4922d0 2024-05-09T09:47:33.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f22d40d8070 con 0x56138e4922d0 2024-05-09T09:47:33.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:33.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 20 started sync module instance, tier type = 2024-05-09T09:47:33.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:33.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.795+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e496550 con 0x7f22d40cd040 2024-05-09T09:47:33.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.799+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x7f22d40cd040 2024-05-09T09:47:33.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.799+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94641991543408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e496550 con 0x7f22d40cd040 2024-05-09T09:47:33.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.799+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e497bc0 con 0x56138e488fe0 2024-05-09T09:47:33.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.799+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94641991543408] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x7f22d40cd040 2024-05-09T09:47:33.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.799+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.799+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94641991546912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e496550 con 0x56138e488fe0 2024-05-09T09:47:33.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.799+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4985d0 con 0x56138e4922d0 2024-05-09T09:47:33.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.803+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94641991546912] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.803+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22d40d8070 con 0x56138e4922d0 2024-05-09T09:47:33.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.803+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94641991540896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4964c0 con 0x56138e4922d0 2024-05-09T09:47:33.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.803+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e499310 con 0x7f22d40cd040 2024-05-09T09:47:33.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.803+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x7f22d40cd040 2024-05-09T09:47:33.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.803+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94641991552544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e499240 con 0x7f22d40cd040 2024-05-09T09:47:33.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.803+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e49a200 con 0x56138e488fe0 2024-05-09T09:47:33.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.803+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94641991540896] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22d40d8070 con 0x56138e4922d0 2024-05-09T09:47:33.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.807+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94641991552544] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x7f22d40cd040 2024-05-09T09:47:33.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.807+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.807+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94641991551344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e499d50 con 0x56138e488fe0 2024-05-09T09:47:33.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.807+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e49aaa0 con 0x56138e48d9d0 2024-05-09T09:47:33.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.807+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22d0077070 con 0x56138e48d9d0 2024-05-09T09:47:33.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.807+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94641991558640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e499d50 con 0x56138e48d9d0 2024-05-09T09:47:33.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.807+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e49b820 con 0x56138e48d9d0 2024-05-09T09:47:33.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.807+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94641991551344] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.811+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94641991558640] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22d0077070 con 0x56138e48d9d0 2024-05-09T09:47:33.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.811+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22d0077070 con 0x56138e48d9d0 2024-05-09T09:47:33.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.811+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94641991560768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e49bc10 con 0x56138e48d9d0 2024-05-09T09:47:33.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.811+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e49c460 con 0x56138e48d9d0 2024-05-09T09:47:33.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.811+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94641991560768] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22d0077070 con 0x56138e48d9d0 2024-05-09T09:47:33.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.811+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22d0077070 con 0x56138e48d9d0 2024-05-09T09:47:33.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.811+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94641991564224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e49c490 con 0x56138e48d9d0 2024-05-09T09:47:33.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.811+0000 7f22e1ae1980 20 add_watcher() i=0 2024-05-09T09:47:33.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.811+0000 7f22e1ae1980 20 add_watcher() i=1 2024-05-09T09:47:33.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.811+0000 7f22e1ae1980 20 add_watcher() i=2 2024-05-09T09:47:33.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.811+0000 7f22e1ae1980 20 add_watcher() i=3 2024-05-09T09:47:33.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.811+0000 7f22e1ae1980 20 add_watcher() i=4 2024-05-09T09:47:33.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.811+0000 7f22e1ae1980 20 add_watcher() i=5 2024-05-09T09:47:33.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.811+0000 7f22e1ae1980 20 add_watcher() i=6 2024-05-09T09:47:33.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.815+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94641991564224] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22d0077070 con 0x56138e48d9d0 2024-05-09T09:47:33.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.815+0000 7f22e1ae1980 20 add_watcher() i=7 2024-05-09T09:47:33.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.815+0000 7f22e1ae1980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:33.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.815+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56138e49f890 con 0x56138e488fe0 2024-05-09T09:47:33.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.815+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.815+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94641991565744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e49cde0 con 0x56138e488fe0 2024-05-09T09:47:33.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.815+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94641991565744] v30'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.815+0000 7f21957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:33.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.815+0000 7f22e1ae1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:33.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.815+0000 7f22e1ae1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:33.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.815+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e49f5e0 con 0x56138e488fe0 2024-05-09T09:47:33.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.819+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'30 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.819+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4a8900 con 0x56138e48d9d0 2024-05-09T09:47:33.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.823+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f22d0077070 con 0x56138e48d9d0 2024-05-09T09:47:33.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.823+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4a8d20 con 0x56138e4922d0 2024-05-09T09:47:33.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.823+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f22d40d8070 con 0x56138e4922d0 2024-05-09T09:47:33.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.823+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4a8f40 con 0x56138e488fe0 2024-05-09T09:47:33.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.823+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'95 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.823+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4a8070 con 0x7f22d40cd040 2024-05-09T09:47:33.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.827+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'62 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x7f22d40cd040 2024-05-09T09:47:33.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.827+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4a8070 con 0x56138e4922d0 2024-05-09T09:47:33.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.827+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'41 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f22d40d8070 con 0x56138e4922d0 2024-05-09T09:47:33.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.827+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4a9c70 con 0x56138e488fe0 2024-05-09T09:47:33.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.827+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.827+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4aa120 con 0x56138e48d9d0 2024-05-09T09:47:33.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.831+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'41 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f22d0077070 con 0x56138e48d9d0 2024-05-09T09:47:33.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.831+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4aa120 con 0x7f22d40cd040 2024-05-09T09:47:33.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.835+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x7f22d40cd040 2024-05-09T09:47:33.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.835+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4aa120 con 0x56138e4922d0 2024-05-09T09:47:33.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.835+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'30 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f22d40d8070 con 0x56138e4922d0 2024-05-09T09:47:33.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.835+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4aa1b0 con 0x7f22d40cd040 2024-05-09T09:47:33.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.835+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'63 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x7f22d40cd040 2024-05-09T09:47:33.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.835+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4aa1b0 con 0x56138e48d9d0 2024-05-09T09:47:33.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.839+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22d0077070 con 0x56138e48d9d0 2024-05-09T09:47:33.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.839+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4aa240 con 0x7f22d40cd040 2024-05-09T09:47:33.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.839+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x7f22d40cd040 2024-05-09T09:47:33.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.839+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4aa410 con 0x56138e48d9d0 2024-05-09T09:47:33.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.843+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'47 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22d0077070 con 0x56138e48d9d0 2024-05-09T09:47:33.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.843+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4aa410 con 0x56138e488fe0 2024-05-09T09:47:33.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.843+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'96 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.843+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4aa410 con 0x56138e4922d0 2024-05-09T09:47:33.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.847+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'56 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22d40d8070 con 0x56138e4922d0 2024-05-09T09:47:33.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.847+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4aa410 con 0x7f22d40cd040 2024-05-09T09:47:33.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.847+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'64 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x7f22d40cd040 2024-05-09T09:47:33.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.847+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4aa410 con 0x56138e4922d0 2024-05-09T09:47:33.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.851+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22d40d8070 con 0x56138e4922d0 2024-05-09T09:47:33.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.851+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4aa410 con 0x56138e488fe0 2024-05-09T09:47:33.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.851+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'32 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.851+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4aa410 con 0x56138e488fe0 2024-05-09T09:47:33.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.855+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'97 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.855+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4aa410 con 0x56138e4922d0 2024-05-09T09:47:33.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.855+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'57 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22d40d8070 con 0x56138e4922d0 2024-05-09T09:47:33.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.855+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4aa410 con 0x7f22d40cd040 2024-05-09T09:47:33.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.859+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'34 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x7f22d40cd040 2024-05-09T09:47:33.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.859+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4aa410 con 0x56138e4922d0 2024-05-09T09:47:33.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.859+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22d40d8070 con 0x56138e4922d0 2024-05-09T09:47:33.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.859+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4aa410 con 0x56138e4922d0 2024-05-09T09:47:33.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.863+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'30 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22d40d8070 con 0x56138e4922d0 2024-05-09T09:47:33.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.863+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4aa410 con 0x56138e4922d0 2024-05-09T09:47:33.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.863+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22d40d8070 con 0x56138e4922d0 2024-05-09T09:47:33.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.863+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4aa410 con 0x56138e4922d0 2024-05-09T09:47:33.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.863+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'42 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22d40d8070 con 0x56138e4922d0 2024-05-09T09:47:33.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.863+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4aa410 con 0x56138e48d9d0 2024-05-09T09:47:33.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.867+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22d0077070 con 0x56138e48d9d0 2024-05-09T09:47:33.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.867+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4aa9c0 con 0x56138e4922d0 2024-05-09T09:47:33.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.871+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22d40d8070 con 0x56138e4922d0 2024-05-09T09:47:33.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.871+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4aa9c0 con 0x56138e48d9d0 2024-05-09T09:47:33.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.871+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'42 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22d0077070 con 0x56138e48d9d0 2024-05-09T09:47:33.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.871+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4aa9c0 con 0x56138e4922d0 2024-05-09T09:47:33.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.875+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'58 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22d40d8070 con 0x56138e4922d0 2024-05-09T09:47:33.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.875+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4aa9c0 con 0x56138e48d9d0 2024-05-09T09:47:33.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.875+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'48 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22d0077070 con 0x56138e48d9d0 2024-05-09T09:47:33.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.875+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4aa9c0 con 0x7f22d40cd040 2024-05-09T09:47:33.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.879+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'30 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x7f22d40cd040 2024-05-09T09:47:33.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.879+0000 7f218f7fe640 20 reqs_thread_entry: start 2024-05-09T09:47:33.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.879+0000 7f22e1ae1980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:33.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.879+0000 7f218d7fa640 20 reqs_thread_entry: start 2024-05-09T09:47:33.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.879+0000 7f22e1ae1980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-09T09:47:33.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.879+0000 7f22e1ae1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.879+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56138e4c5ea0 con 0x56138e488fe0 2024-05-09T09:47:33.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.883+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.883+0000 7f22e1ae1980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:47:33.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.883+0000 7f22e1ae1980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-09T09:47:33.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.883+0000 7f22e1ae1980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:33.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.883+0000 7f22e1ae1980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:33.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.883+0000 7f22e1ae1980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-05-09T09:47:33.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.883+0000 7f22e1ae1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:33.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.883+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:95 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56138e4c63c0 con 0x56138e48d9d0 2024-05-09T09:47:33.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.883+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(95 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f22d0077070 con 0x56138e48d9d0 2024-05-09T09:47:33.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.883+0000 7f22e1ae1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:33.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.883+0000 7f22e1ae1980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-05-09T09:47:33.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.883+0000 7f22e1ae1980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-09T09:47:33.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.883+0000 7f22e1ae1980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-09T09:47:33.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.883+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4cc030 con 0x56138e488fe0 2024-05-09T09:47:33.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.883+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(96 foo [delete,create,call,call,writefull 0~502] v30'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.883+0000 7f22e1ae1980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:47:33.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.883+0000 7f22e1ae1980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:33.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.883+0000 7f22e1ae1980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-09T09:47:33.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.883+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.d 7:b4812045:::notify.4:head [notify cookie 94641991760640 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56138e4c8cd0 con 0x56138e488fe0 2024-05-09T09:47:33.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.883+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== watch-notify(notify (1) cookie 94641991551344 notify 128849018883 ret 0) ==== 720+0+0 (crc 0 0 0) 0x56138e4a8070 con 0x56138e488fe0 2024-05-09T09:47:33.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.883+0000 7f21c1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94641991551344 notifier 4350 bl.length()=678 2024-05-09T09:47:33.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.883+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(97 notify.4 [notify cookie 94641991760640 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.883+0000 7f21c1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:47:33.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.883+0000 7f21c1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:33.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.883+0000 7f21c1ffb640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f21a40056c0 con 0x56138e488fe0 2024-05-09T09:47:33.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.883+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(98 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.887+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== watch-notify(notify_complete (2) cookie 94641991760640 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56138e4a8410 con 0x56138e488fe0 2024-05-09T09:47:33.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.887+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:99 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4cbb00 con 0x56138e48d9d0 2024-05-09T09:47:33.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.887+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(99 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f22d0077070 con 0x56138e48d9d0 2024-05-09T09:47:33.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.887+0000 7f22e1ae1980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-09T09:47:33.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.887+0000 7f22e1ae1980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-09T09:47:33.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.887+0000 7f22e1ae1980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-09T09:47:33.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.887+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:100 7.15 7:a93a5511:::notify.2:head [notify cookie 94641991760640 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56138e4c6800 con 0x56138e4922d0 2024-05-09T09:47:33.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.887+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== watch-notify(notify (1) cookie 94641991540896 notify 128849018880 ret 0) ==== 219+0+0 (crc 0 0 0) 0x56138e4aa7d0 con 0x56138e4922d0 2024-05-09T09:47:33.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.887+0000 7f21c1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94641991540896 notifier 4350 bl.length()=177 2024-05-09T09:47:33.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.887+0000 7f21c1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-09T09:47:33.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.887+0000 7f21c1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-09T09:47:33.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.887+0000 7f21c1ffb640 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f21a40056c0 con 0x56138e4922d0 2024-05-09T09:47:33.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.887+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(100 notify.2 [notify cookie 94641991760640 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f22d40d8070 con 0x56138e4922d0 2024-05-09T09:47:33.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.887+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== osd_op_reply(101 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22d40d8070 con 0x56138e4922d0 2024-05-09T09:47:33.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.887+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 30 ==== watch-notify(notify_complete (2) cookie 94641991760640 notify 128849018880 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56138e4a86c0 con 0x56138e4922d0 2024-05-09T09:47:33.889 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-09T09:47:32.044078Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-09T09:47:33.885213Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:47:32.044055Z","tags":[],"group_ids":[]} 2024-05-09T09:47:33.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.891+0000 7f21957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:33.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.891+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94641991565744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4a65c0 con 0x56138e488fe0 2024-05-09T09:47:33.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.891+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(102 data_loggenerations_metadata [watch unwatch cookie 94641991565744] v30'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.891+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:103 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94641991543408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e49c180 con 0x7f22d40cd040 2024-05-09T09:47:33.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.891+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(103 notify.0 [watch unwatch cookie 94641991543408] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x7f22d40cd040 2024-05-09T09:47:33.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.891+0000 7f22e1ae1980 20 remove_watcher() i=0 2024-05-09T09:47:33.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.891+0000 7f22e1ae1980 2 removed watcher, disabling cache 2024-05-09T09:47:33.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.891+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:104 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94641991546912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e496a50 con 0x56138e488fe0 2024-05-09T09:47:33.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.895+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(104 notify.1 [watch unwatch cookie 94641991546912] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.895+0000 7f22e1ae1980 20 remove_watcher() i=1 2024-05-09T09:47:33.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.895+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:105 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94641991540896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e497820 con 0x56138e4922d0 2024-05-09T09:47:33.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.895+0000 7f22dedfb640 1 -- 172.21.15.157:0/4147720286 <== osd.3 v2:172.21.15.157:6816/2487336710 31 ==== osd_op_reply(105 notify.2 [watch unwatch cookie 94641991540896] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22d40d8070 con 0x56138e4922d0 2024-05-09T09:47:33.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.895+0000 7f22e1ae1980 20 remove_watcher() i=2 2024-05-09T09:47:33.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.895+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:106 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94641991552544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4960a0 con 0x7f22d40cd040 2024-05-09T09:47:33.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.899+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(106 notify.3 [watch unwatch cookie 94641991552544] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x7f22d40cd040 2024-05-09T09:47:33.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.899+0000 7f22e1ae1980 20 remove_watcher() i=3 2024-05-09T09:47:33.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.899+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94641991551344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4960a0 con 0x56138e488fe0 2024-05-09T09:47:33.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.899+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(107 notify.4 [watch unwatch cookie 94641991551344] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22d800a4d0 con 0x56138e488fe0 2024-05-09T09:47:33.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.899+0000 7f22e1ae1980 20 remove_watcher() i=4 2024-05-09T09:47:33.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.899+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:108 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94641991558640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e498970 con 0x56138e48d9d0 2024-05-09T09:47:33.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.903+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(108 notify.5 [watch unwatch cookie 94641991558640] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22d0077070 con 0x56138e48d9d0 2024-05-09T09:47:33.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.903+0000 7f22e1ae1980 20 remove_watcher() i=5 2024-05-09T09:47:33.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.903+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:109 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94641991560768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e4960a0 con 0x56138e48d9d0 2024-05-09T09:47:33.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.903+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(109 notify.6 [watch unwatch cookie 94641991560768] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22d0077070 con 0x56138e48d9d0 2024-05-09T09:47:33.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.903+0000 7f22e1ae1980 20 remove_watcher() i=6 2024-05-09T09:47:33.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.903+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:110 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94641991564224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56138e49ae40 con 0x56138e48d9d0 2024-05-09T09:47:33.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22df5fc640 1 -- 172.21.15.157:0/4147720286 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(110 notify.7 [watch unwatch cookie 94641991564224] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22d0077070 con 0x56138e48d9d0 2024-05-09T09:47:33.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22e1ae1980 20 remove_watcher() i=7 2024-05-09T09:47:33.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56138e48d9d0 msgr2=0x56138e48fdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22e1ae1980 1 --2- 172.21.15.157:0/4147720286 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56138e48d9d0 0x56138e48fdc0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56138e488fe0 msgr2=0x56138e48b4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22e1ae1980 1 --2- 172.21.15.157:0/4147720286 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56138e488fe0 0x56138e48b4a0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f22d40cd040 msgr2=0x7f22d40da920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22e1ae1980 1 --2- 172.21.15.157:0/4147720286 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f22d40cd040 0x7f22d40da920 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56138e4922d0 msgr2=0x56138e4946e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22e1ae1980 1 --2- 172.21.15.157:0/4147720286 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56138e4922d0 0x56138e4946e0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f21a8034c00 msgr2=0x7f21a80370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22e1ae1980 1 --2- 172.21.15.157:0/4147720286 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f21a8034c00 0x7f21a80370c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f22d4000c10 tx=0x7f22d40a7000 comp rx=0 tx=0).stop 2024-05-09T09:47:33.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22dfdfd640 1 -- 172.21.15.157:0/4147720286 reap_dead start 2024-05-09T09:47:33.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e4751c0 msgr2=0x56138e47c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22e1ae1980 1 --2- 172.21.15.157:0/4147720286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e4751c0 0x56138e47c470 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f22d0019c10 tx=0x7f22d0009060 comp rx=0 tx=0).stop 2024-05-09T09:47:33.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 shutdown_connections 2024-05-09T09:47:33.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22e1ae1980 1 --2- 172.21.15.157:0/4147720286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e4751c0 0x56138e47c470 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 >> 172.21.15.157:0/4147720286 conn(0x56138e471540 msgr2=0x56138e46f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:33.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 shutdown_connections 2024-05-09T09:47:33.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22e1ae1980 1 -- 172.21.15.157:0/4147720286 wait complete. 2024-05-09T09:47:33.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22e1ae1980 1 -- 172.21.15.157:0/3672497511 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f21b8034c00 msgr2=0x7f21b80370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22e1ae1980 1 --2- 172.21.15.157:0/3672497511 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f21b8034c00 0x7f21b80370c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x56138e439b10 tx=0x7f22d4005a10 comp rx=0 tx=0).stop 2024-05-09T09:47:33.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22e1ae1980 1 -- 172.21.15.157:0/3672497511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e468250 msgr2=0x56138e468670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22e1ae1980 1 --2- 172.21.15.157:0/3672497511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e468250 0x56138e468670 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f22d001afd0 tx=0x7f22d0035300 comp rx=0 tx=0).stop 2024-05-09T09:47:33.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22e1ae1980 1 -- 172.21.15.157:0/3672497511 shutdown_connections 2024-05-09T09:47:33.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22e1ae1980 1 --2- 172.21.15.157:0/3672497511 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f21b8034c00 0x7f21b80370c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22e1ae1980 1 --2- 172.21.15.157:0/3672497511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e468250 0x56138e468670 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22e1ae1980 1 -- 172.21.15.157:0/3672497511 >> 172.21.15.157:0/3672497511 conn(0x56138e45d020 msgr2=0x56138e45db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:33.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22e1ae1980 1 -- 172.21.15.157:0/3672497511 shutdown_connections 2024-05-09T09:47:33.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.907+0000 7f22e1ae1980 1 -- 172.21.15.157:0/3672497511 wait complete. 2024-05-09T09:47:33.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.911+0000 7f22e1ae1980 1 -- 172.21.15.157:0/111375640 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56138e43b9b0 msgr2=0x56138e43dda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.911+0000 7f22e1ae1980 1 --2- 172.21.15.157:0/111375640 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56138e43b9b0 0x56138e43dda0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.911+0000 7f22e1ae1980 1 -- 172.21.15.157:0/111375640 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56138e343fd0 msgr2=0x56138e439150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.911+0000 7f22e1ae1980 1 --2- 172.21.15.157:0/111375640 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56138e343fd0 0x56138e439150 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.911+0000 7f22e1ae1980 1 -- 172.21.15.157:0/111375640 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56138e43f8b0 msgr2=0x56138e441ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.911+0000 7f22e1ae1980 1 --2- 172.21.15.157:0/111375640 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56138e43f8b0 0x56138e441ca0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.911+0000 7f22e1ae1980 1 -- 172.21.15.157:0/111375640 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f21c4034c00 msgr2=0x7f21c40370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.911+0000 7f22e1ae1980 1 --2- 172.21.15.157:0/111375640 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f21c4034c00 0x7f21c40370c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f22d40ac000 tx=0x7f22d40a5000 comp rx=0 tx=0).stop 2024-05-09T09:47:33.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.911+0000 7f22e1ae1980 1 -- 172.21.15.157:0/111375640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e33fad0 msgr2=0x56138e4320a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:33.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.911+0000 7f22e1ae1980 1 --2- 172.21.15.157:0/111375640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56138e33fad0 0x56138e4320a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f22d0001ee0 tx=0x7f22d0000ee0 comp rx=0 tx=0).stop 2024-05-09T09:47:33.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.911+0000 7f22dfdfd640 1 -- 172.21.15.157:0/111375640 reap_dead start 2024-05-09T09:47:33.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.911+0000 7f22e1ae1980 1 -- 172.21.15.157:0/111375640 shutdown_connections 2024-05-09T09:47:33.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.911+0000 7f22e1ae1980 1 -- 172.21.15.157:0/111375640 >> 172.21.15.157:0/111375640 conn(0x56138e2b31f0 msgr2=0x56138e425470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:33.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.911+0000 7f22e1ae1980 1 -- 172.21.15.157:0/111375640 shutdown_connections 2024-05-09T09:47:33.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:33.911+0000 7f22e1ae1980 1 -- 172.21.15.157:0/111375640 wait complete. 2024-05-09T09:47:33.920 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-09T09:47:32.044078Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-09T09:47:33.885213Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:47:32.044055Z', 'tags': [], 'group_ids': []} 2024-05-09T09:47:33.921 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-09T09:47:33.921 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-09T09:47:33.921 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-09T09:47:34.000 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:34.000 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:34.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.003+0000 7fafb8fde980 1 Processor -- start 2024-05-09T09:47:34.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.003+0000 7fafb8fde980 1 -- start start 2024-05-09T09:47:34.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.003+0000 7fafb8fde980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x563cb606ca70 0x563cb60fd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.003+0000 7fafb8fde980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563cb5fae440 con 0x563cb60fdf30 2024-05-09T09:47:34.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.003+0000 7fafb8fde980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x563cb5f995f0 con 0x563cb606ca70 2024-05-09T09:47:34.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.003+0000 7fafb6af9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x563cb606ca70 0x563cb60fd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.003+0000 7fafb6af9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x563cb606ca70 0x563cb60fd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54256/0 (socket says 172.21.15.157:54256) 2024-05-09T09:47:34.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.003+0000 7fafb62f8640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x563cb60fdf30 0x563cb6100320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:33662/0 (socket says 172.21.15.157:33662) 2024-05-09T09:47:34.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.003+0000 7fafb6af9640 1 -- 172.21.15.157:0/1905964750 learned_addr learned my addr 172.21.15.157:0/1905964750 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:34.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.003+0000 7fafb6af9640 1 -- 172.21.15.157:0/1905964750 >> v1:172.21.15.110:6789/0 conn(0x563cb60fdf30 legacy=0x563cb6100320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.003+0000 7fafb6af9640 1 -- 172.21.15.157:0/1905964750 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cb5fa4990 con 0x563cb606ca70 2024-05-09T09:47:34.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.007+0000 7fafb6af9640 1 --2- 172.21.15.157:0/1905964750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb606ca70 0x563cb60fd9f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fafa800a4e0 tx=0x7fafa801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f995b3b1c0caa3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.007+0000 7fafb5af7640 1 -- 172.21.15.157:0/1905964750 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafa80aa540 con 0x563cb606ca70 2024-05-09T09:47:34.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.007+0000 7fafb5af7640 1 -- 172.21.15.157:0/1905964750 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa80aa6e0 con 0x563cb606ca70 2024-05-09T09:47:34.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.007+0000 7fafb5af7640 1 -- 172.21.15.157:0/1905964750 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafa80aaa40 con 0x563cb606ca70 2024-05-09T09:47:34.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.007+0000 7fafb8fde980 1 -- 172.21.15.157:0/1905964750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb606ca70 msgr2=0x563cb60fd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.007+0000 7fafb8fde980 1 --2- 172.21.15.157:0/1905964750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb606ca70 0x563cb60fd9f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fafa800a4e0 tx=0x7fafa801b090 comp rx=0 tx=0).stop 2024-05-09T09:47:34.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.007+0000 7fafb8fde980 1 -- 172.21.15.157:0/1905964750 shutdown_connections 2024-05-09T09:47:34.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.007+0000 7fafb8fde980 1 --2- 172.21.15.157:0/1905964750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb606ca70 0x563cb60fd9f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.007+0000 7fafb8fde980 1 -- 172.21.15.157:0/1905964750 >> 172.21.15.157:0/1905964750 conn(0x563cb60f30d0 msgr2=0x563cb60f54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:34.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.007+0000 7fafb8fde980 1 -- 172.21.15.157:0/1905964750 shutdown_connections 2024-05-09T09:47:34.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.007+0000 7fafb8fde980 1 -- 172.21.15.157:0/1905964750 wait complete. 2024-05-09T09:47:34.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.023+0000 7fafb8fde980 1 Processor -- start 2024-05-09T09:47:34.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.023+0000 7fafb8fde980 1 -- start start 2024-05-09T09:47:34.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.023+0000 7fafb8fde980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb606ca70 0x563cb61e5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.023+0000 7fafb8fde980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563cb5ffbfe0 con 0x563cb606ca70 2024-05-09T09:47:34.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.023+0000 7fafb6af9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb606ca70 0x563cb61e5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.023+0000 7fafb6af9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb606ca70 0x563cb61e5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54268/0 (socket says 172.21.15.157:54268) 2024-05-09T09:47:34.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.023+0000 7fafb6af9640 1 -- 172.21.15.157:0/987998675 learned_addr learned my addr 172.21.15.157:0/987998675 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:34.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.023+0000 7fafb6af9640 1 -- 172.21.15.157:0/987998675 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cb5f80ae0 con 0x563cb606ca70 2024-05-09T09:47:34.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.027+0000 7fafb6af9640 1 --2- 172.21.15.157:0/987998675 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb606ca70 0x563cb61e5c60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fafa80ac040 tx=0x7fafa80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ddab56d6c217bd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.027+0000 7faea4e09640 1 -- 172.21.15.157:0/987998675 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafa80b9030 con 0x563cb606ca70 2024-05-09T09:47:34.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.027+0000 7faea4e09640 1 -- 172.21.15.157:0/987998675 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa80aaa40 con 0x563cb606ca70 2024-05-09T09:47:34.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.027+0000 7faea4e09640 1 -- 172.21.15.157:0/987998675 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafa80aad20 con 0x563cb606ca70 2024-05-09T09:47:34.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.027+0000 7fafb8fde980 1 -- 172.21.15.157:0/987998675 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb606ca70 msgr2=0x563cb61e5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.027+0000 7fafb8fde980 1 --2- 172.21.15.157:0/987998675 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb606ca70 0x563cb61e5c60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fafa80ac040 tx=0x7fafa80033b0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.027+0000 7fafb8fde980 1 -- 172.21.15.157:0/987998675 shutdown_connections 2024-05-09T09:47:34.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.027+0000 7fafb8fde980 1 --2- 172.21.15.157:0/987998675 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb606ca70 0x563cb61e5c60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.027+0000 7fafb8fde980 1 -- 172.21.15.157:0/987998675 >> 172.21.15.157:0/987998675 conn(0x563cb60f30d0 msgr2=0x563cb61e17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:34.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.027+0000 7fafb8fde980 1 -- 172.21.15.157:0/987998675 shutdown_connections 2024-05-09T09:47:34.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.027+0000 7fafb8fde980 1 -- 172.21.15.157:0/987998675 wait complete. 2024-05-09T09:47:34.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.027+0000 7fafb8fde980 1 Processor -- start 2024-05-09T09:47:34.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.027+0000 7fafb8fde980 1 -- start start 2024-05-09T09:47:34.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.027+0000 7fafb8fde980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb606ca70 0x563cb61ecd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.027+0000 7fafb8fde980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563cb61044a0 con 0x563cb606ca70 2024-05-09T09:47:34.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.027+0000 7fafb6af9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb606ca70 0x563cb61ecd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.027+0000 7fafb6af9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb606ca70 0x563cb61ecd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54280/0 (socket says 172.21.15.157:54280) 2024-05-09T09:47:34.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.027+0000 7fafb6af9640 1 -- 172.21.15.157:0/3522797194 learned_addr learned my addr 172.21.15.157:0/3522797194 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:34.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.027+0000 7fafb6af9640 1 -- 172.21.15.157:0/3522797194 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cb61ed280 con 0x563cb606ca70 2024-05-09T09:47:34.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.027+0000 7fafb6af9640 1 --2- 172.21.15.157:0/3522797194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb606ca70 0x563cb61ecd40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fafa8000f90 tx=0x7fafa8017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.027+0000 7faea3606640 1 -- 172.21.15.157:0/3522797194 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafa80b9030 con 0x563cb606ca70 2024-05-09T09:47:34.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.027+0000 7fafb8fde980 1 -- 172.21.15.157:0/3522797194 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563cb61ed510 con 0x563cb606ca70 2024-05-09T09:47:34.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.027+0000 7fafb8fde980 1 -- 172.21.15.157:0/3522797194 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cb61f01a0 con 0x563cb606ca70 2024-05-09T09:47:34.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.027+0000 7faea3606640 1 -- 172.21.15.157:0/3522797194 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa80c2070 con 0x563cb606ca70 2024-05-09T09:47:34.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.027+0000 7faea3606640 1 -- 172.21.15.157:0/3522797194 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafa80cb060 con 0x563cb606ca70 2024-05-09T09:47:34.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.031+0000 7faea3606640 1 -- 172.21.15.157:0/3522797194 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fafa80c4030 con 0x563cb606ca70 2024-05-09T09:47:34.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.031+0000 7faea3606640 1 --2- 172.21.15.157:0/3522797194 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fae9c034c00 0x7fae9c0370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.031+0000 7faea3606640 1 -- 172.21.15.157:0/3522797194 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fafa80ba070 con 0x563cb606ca70 2024-05-09T09:47:34.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.031+0000 7fafb62f8640 1 --2- 172.21.15.157:0/3522797194 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fae9c034c00 0x7fae9c0370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.031+0000 7fafb8fde980 1 --2- 172.21.15.157:0/3522797194 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563cb60fdf30 0x563cb61f3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.031+0000 7fafb8fde980 1 -- 172.21.15.157:0/3522797194 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563cb61f42a0 con 0x563cb60fdf30 2024-05-09T09:47:34.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.031+0000 7fafb72fa640 1 --2- 172.21.15.157:0/3522797194 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563cb60fdf30 0x563cb61f3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.031+0000 7fafb62f8640 1 --2- 172.21.15.157:0/3522797194 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fae9c034c00 0x7fae9c0370c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fafac001e50 tx=0x7fafac0013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.031+0000 7fafb72fa640 1 --2- 172.21.15.157:0/3522797194 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563cb60fdf30 0x563cb61f3c80 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.031+0000 7fafb72fa640 1 -- 172.21.15.157:0/3522797194 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafb00083f0 con 0x563cb60fdf30 2024-05-09T09:47:34.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.031+0000 7fafb8fde980 1 -- 172.21.15.157:0/3522797194 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563cb61f4b90 con 0x563cb60fdf30 2024-05-09T09:47:34.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.031+0000 7fafb72fa640 1 -- 172.21.15.157:0/3522797194 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fafb00083f0 con 0x563cb60fdf30 2024-05-09T09:47:34.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.031+0000 7fafb8fde980 1 --2- 172.21.15.157:0/3522797194 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563cb61f64e0 0x563cb61f8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.031+0000 7fafb8fde980 1 -- 172.21.15.157:0/3522797194 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563cb61f9100 con 0x563cb61f64e0 2024-05-09T09:47:34.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.031+0000 7fafb6af9640 1 --2- 172.21.15.157:0/3522797194 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563cb61f64e0 0x563cb61f8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.031+0000 7fafb6af9640 1 --2- 172.21.15.157:0/3522797194 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563cb61f64e0 0x563cb61f8970 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.035+0000 7fafb6af9640 1 -- 172.21.15.157:0/3522797194 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fafa80cf3a0 con 0x563cb61f64e0 2024-05-09T09:47:34.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.035+0000 7fafb8fde980 1 -- 172.21.15.157:0/3522797194 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563cb61f53e0 con 0x563cb60fdf30 2024-05-09T09:47:34.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.035+0000 7fafb72fa640 1 -- 172.21.15.157:0/3522797194 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fafb00083f0 con 0x563cb60fdf30 2024-05-09T09:47:34.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.035+0000 7fafb8fde980 1 --2- 172.21.15.157:0/3522797194 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563cb61fa560 0x563cb61fc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.035+0000 7fafb8fde980 1 -- 172.21.15.157:0/3522797194 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563cb61fd090 con 0x563cb61fa560 2024-05-09T09:47:34.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.035+0000 7fafb62f8640 1 --2- 172.21.15.157:0/3522797194 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563cb61fa560 0x563cb61fc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.035+0000 7fafb62f8640 1 --2- 172.21.15.157:0/3522797194 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563cb61fa560 0x563cb61fc950 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.035+0000 7fafb62f8640 1 -- 172.21.15.157:0/3522797194 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fafac00f700 con 0x563cb61fa560 2024-05-09T09:47:34.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.039+0000 7fafb8fde980 1 Processor -- start 2024-05-09T09:47:34.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.039+0000 7fafb8fde980 1 -- start start 2024-05-09T09:47:34.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.039+0000 7fafb8fde980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb6222f50 0x563cb6223370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.039+0000 7fafb8fde980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563cb6000020 con 0x563cb6222f50 2024-05-09T09:47:34.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.039+0000 7fafb6af9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb6222f50 0x563cb6223370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.039+0000 7fafb6af9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb6222f50 0x563cb6223370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54284/0 (socket says 172.21.15.157:54284) 2024-05-09T09:47:34.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.039+0000 7fafb6af9640 1 -- 172.21.15.157:0/3292764611 learned_addr learned my addr 172.21.15.157:0/3292764611 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:34.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.039+0000 7fafb6af9640 1 -- 172.21.15.157:0/3292764611 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cb62238b0 con 0x563cb6222f50 2024-05-09T09:47:34.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.039+0000 7fafb6af9640 1 --2- 172.21.15.157:0/3292764611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb6222f50 0x563cb6223370 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fafa80e3b30 tx=0x7fafa80a9fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.039+0000 7fae9b7fe640 1 -- 172.21.15.157:0/3292764611 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafa80b4a40 con 0x563cb6222f50 2024-05-09T09:47:34.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.039+0000 7fafb8fde980 1 -- 172.21.15.157:0/3292764611 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563cb6224340 con 0x563cb6222f50 2024-05-09T09:47:34.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.039+0000 7fae9b7fe640 1 -- 172.21.15.157:0/3292764611 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa80b4be0 con 0x563cb6222f50 2024-05-09T09:47:34.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.039+0000 7fae9b7fe640 1 -- 172.21.15.157:0/3292764611 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafa80b43a0 con 0x563cb6222f50 2024-05-09T09:47:34.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.039+0000 7fafb8fde980 1 -- 172.21.15.157:0/3292764611 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cb6224820 con 0x563cb6222f50 2024-05-09T09:47:34.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.043+0000 7fae9b7fe640 1 -- 172.21.15.157:0/3292764611 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fafa80b3040 con 0x563cb6222f50 2024-05-09T09:47:34.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.043+0000 7fae9b7fe640 1 --2- 172.21.15.157:0/3292764611 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fae90034bb0 0x7fae90037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.043+0000 7fae9b7fe640 1 -- 172.21.15.157:0/3292764611 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fafa80b70d0 con 0x563cb6222f50 2024-05-09T09:47:34.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.043+0000 7fafb62f8640 1 --2- 172.21.15.157:0/3292764611 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fae90034bb0 0x7fae90037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.043+0000 7fafb8fde980 1 Processor -- start 2024-05-09T09:47:34.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.043+0000 7fafb8fde980 1 -- start start 2024-05-09T09:47:34.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.043+0000 7fafb8fde980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb622ff60 0x563cb6230340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.043+0000 7fafb8fde980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563cb61e62f0 con 0x563cb622ff60 2024-05-09T09:47:34.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.043+0000 7fafb62f8640 1 --2- 172.21.15.157:0/3292764611 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fae90034bb0 0x7fae90037070 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x563cb61f1520 tx=0x7fafac00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.043+0000 7fafb6af9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb622ff60 0x563cb6230340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.043+0000 7fafb6af9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb622ff60 0x563cb6230340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54296/0 (socket says 172.21.15.157:54296) 2024-05-09T09:47:34.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.043+0000 7fafb6af9640 1 -- 172.21.15.157:0/3307645120 learned_addr learned my addr 172.21.15.157:0/3307645120 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:34.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.043+0000 7fafb6af9640 1 -- 172.21.15.157:0/3307645120 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cb6230910 con 0x563cb622ff60 2024-05-09T09:47:34.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.043+0000 7fafb6af9640 1 --2- 172.21.15.157:0/3307645120 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb622ff60 0x563cb6230340 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fafa80c8540 tx=0x7fafa80c8260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565c5efa3b50ceb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.043+0000 7fae997fa640 1 -- 172.21.15.157:0/3307645120 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafa80df0b0 con 0x563cb622ff60 2024-05-09T09:47:34.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.043+0000 7fae997fa640 1 -- 172.21.15.157:0/3307645120 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa80be610 con 0x563cb622ff60 2024-05-09T09:47:34.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.043+0000 7fae997fa640 1 -- 172.21.15.157:0/3307645120 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafa80c87f0 con 0x563cb622ff60 2024-05-09T09:47:34.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.043+0000 7fafb8fde980 1 -- 172.21.15.157:0/3307645120 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb622ff60 msgr2=0x563cb6230340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.043+0000 7fafb8fde980 1 --2- 172.21.15.157:0/3307645120 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb622ff60 0x563cb6230340 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fafa80c8540 tx=0x7fafa80c8260 comp rx=0 tx=0).stop 2024-05-09T09:47:34.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.043+0000 7fafb8fde980 1 -- 172.21.15.157:0/3307645120 shutdown_connections 2024-05-09T09:47:34.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.043+0000 7fafb8fde980 1 --2- 172.21.15.157:0/3307645120 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb622ff60 0x563cb6230340 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.043+0000 7fafb8fde980 1 -- 172.21.15.157:0/3307645120 >> 172.21.15.157:0/3307645120 conn(0x563cb622c2e0 msgr2=0x563cb622a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:34.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.043+0000 7fafb8fde980 1 -- 172.21.15.157:0/3307645120 shutdown_connections 2024-05-09T09:47:34.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.043+0000 7fafb8fde980 1 -- 172.21.15.157:0/3307645120 wait complete. 2024-05-09T09:47:34.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.047+0000 7fafb8fde980 1 Processor -- start 2024-05-09T09:47:34.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.047+0000 7fafb8fde980 1 -- start start 2024-05-09T09:47:34.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.047+0000 7fafb8fde980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb622ff60 0x563cb6237350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.047+0000 7fafb8fde980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563cb6231020 con 0x563cb622ff60 2024-05-09T09:47:34.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.047+0000 7fafb6af9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb622ff60 0x563cb6237350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.047+0000 7fafb6af9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb622ff60 0x563cb6237350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54302/0 (socket says 172.21.15.157:54302) 2024-05-09T09:47:34.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.047+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 learned_addr learned my addr 172.21.15.157:0/3781977617 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:34.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.047+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cb6237890 con 0x563cb622ff60 2024-05-09T09:47:34.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.047+0000 7fafb6af9640 1 --2- 172.21.15.157:0/3781977617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb622ff60 0x563cb6237350 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fafa80e3600 tx=0x7fafa80e7f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.047+0000 7fae877fe640 1 -- 172.21.15.157:0/3781977617 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafa8005160 con 0x563cb622ff60 2024-05-09T09:47:34.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.047+0000 7fae877fe640 1 -- 172.21.15.157:0/3781977617 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa80e4f20 con 0x563cb622ff60 2024-05-09T09:47:34.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.047+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563cb6237890 con 0x563cb622ff60 2024-05-09T09:47:34.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.047+0000 7fae877fe640 1 -- 172.21.15.157:0/3781977617 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafa80b4540 con 0x563cb622ff60 2024-05-09T09:47:34.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.047+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cb6237890 con 0x563cb622ff60 2024-05-09T09:47:34.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.047+0000 7fae877fe640 1 -- 172.21.15.157:0/3781977617 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fafa80b46e0 con 0x563cb622ff60 2024-05-09T09:47:34.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.047+0000 7fafb8fde980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.047+0000 7fae877fe640 1 --2- 172.21.15.157:0/3781977617 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fae80034bb0 0x7fae80037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.047+0000 7fae877fe640 1 -- 172.21.15.157:0/3781977617 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fafa80ff070 con 0x563cb622ff60 2024-05-09T09:47:34.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.047+0000 7fafb62f8640 1 --2- 172.21.15.157:0/3781977617 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fae80034bb0 0x7fae80037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.047+0000 7fafb8fde980 1 --2- 172.21.15.157:0/3781977617 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563cb6243e40 0x563cb6246300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.047+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563cb6246a50 con 0x563cb6243e40 2024-05-09T09:47:34.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.047+0000 7fafb72fa640 1 --2- 172.21.15.157:0/3781977617 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563cb6243e40 0x563cb6246300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.051+0000 7fafb62f8640 1 --2- 172.21.15.157:0/3781977617 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fae80034bb0 0x7fae80037070 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x563cb61fd470 tx=0x7fafac010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.051+0000 7fafb72fa640 1 --2- 172.21.15.157:0/3781977617 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563cb6243e40 0x563cb6246300 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.051+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafb00083f0 con 0x563cb6243e40 2024-05-09T09:47:34.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.051+0000 7fafb8fde980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:34.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.051+0000 7fafb8fde980 20 realm 2024-05-09T09:47:34.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.051+0000 7fafb8fde980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.051+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563cb6246e60 con 0x563cb6243e40 2024-05-09T09:47:34.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.051+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafb00083f0 con 0x563cb6243e40 2024-05-09T09:47:34.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.051+0000 7fafb8fde980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:34.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.051+0000 7fafb8fde980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:34.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.051+0000 7fafb8fde980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.051+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247700 con 0x563cb6243e40 2024-05-09T09:47:34.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.051+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafb00083f0 con 0x563cb6243e40 2024-05-09T09:47:34.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.051+0000 7fafb8fde980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:34.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.051+0000 7fafb8fde980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.051+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x563cb6243e40 2024-05-09T09:47:34.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.051+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fafb00083f0 con 0x563cb6243e40 2024-05-09T09:47:34.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.051+0000 7fafb8fde980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:34.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.051+0000 7fafb8fde980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.051+0000 7fafb8fde980 1 --2- 172.21.15.157:0/3781977617 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563cb6248800 0x563cb624abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.051+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563cb624b130 con 0x563cb6248800 2024-05-09T09:47:34.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.051+0000 7fafb6af9640 1 --2- 172.21.15.157:0/3781977617 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563cb6248800 0x563cb624abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.051+0000 7fafb6af9640 1 --2- 172.21.15.157:0/3781977617 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563cb6248800 0x563cb624abf0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.051+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fafa80cf3a0 con 0x563cb6248800 2024-05-09T09:47:34.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.051+0000 7fafb8fde980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:34.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.051+0000 7fafb8fde980 20 searching for the correct realm 2024-05-09T09:47:34.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.051+0000 7fafb8fde980 1 --2- 172.21.15.157:0/3781977617 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563cb624d0a0 0x563cb624f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.051+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb624fc30 con 0x563cb624d0a0 2024-05-09T09:47:34.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.051+0000 7fafb62f8640 1 --2- 172.21.15.157:0/3781977617 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563cb624d0a0 0x563cb624f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.055+0000 7fafb62f8640 1 --2- 172.21.15.157:0/3781977617 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563cb624d0a0 0x563cb624f560 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.055+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafac037040 con 0x563cb624d0a0 2024-05-09T09:47:34.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.055+0000 7fafb62f8640 1 --2- 172.21.15.157:0/3781977617 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fafac01fbe0 0x7fafac03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.055+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb624fc30 con 0x7fafac01fbe0 2024-05-09T09:47:34.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.055+0000 7fafb72fa640 1 --2- 172.21.15.157:0/3781977617 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fafac01fbe0 0x7fafac03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.055+0000 7fafb72fa640 1 --2- 172.21.15.157:0/3781977617 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fafac01fbe0 0x7fafac03a3c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.055+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb00083f0 con 0x7fafac01fbe0 2024-05-09T09:47:34.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.055+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x563cb6248800 2024-05-09T09:47:34.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.055+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafa80cf3a0 con 0x563cb6248800 2024-05-09T09:47:34.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.055+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x563cb6243e40 2024-05-09T09:47:34.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.055+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb00083f0 con 0x563cb6243e40 2024-05-09T09:47:34.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.055+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x563cb6243e40 2024-05-09T09:47:34.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.055+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb0026040 con 0x563cb6243e40 2024-05-09T09:47:34.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.055+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x563cb6248800 2024-05-09T09:47:34.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.055+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafa80cf3a0 con 0x563cb6248800 2024-05-09T09:47:34.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.055+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x563cb6248800 2024-05-09T09:47:34.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.059+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafa80cf3a0 con 0x563cb6248800 2024-05-09T09:47:34.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.059+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x7fafac01fbe0 2024-05-09T09:47:34.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.059+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb0026040 con 0x7fafac01fbe0 2024-05-09T09:47:34.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.059+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x563cb624d0a0 2024-05-09T09:47:34.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.059+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafac037040 con 0x563cb624d0a0 2024-05-09T09:47:34.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.059+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x563cb6243e40 2024-05-09T09:47:34.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.059+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb0026040 con 0x563cb6243e40 2024-05-09T09:47:34.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.059+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x563cb6248800 2024-05-09T09:47:34.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.059+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafa80cf3a0 con 0x563cb6248800 2024-05-09T09:47:34.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.059+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x563cb6243e40 2024-05-09T09:47:34.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.059+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb0026040 con 0x563cb6243e40 2024-05-09T09:47:34.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.059+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x7fafac01fbe0 2024-05-09T09:47:34.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.059+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fafb0026040 con 0x7fafac01fbe0 2024-05-09T09:47:34.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.059+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x563cb624d0a0 2024-05-09T09:47:34.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.059+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafac037040 con 0x563cb624d0a0 2024-05-09T09:47:34.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.059+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x563cb624d0a0 2024-05-09T09:47:34.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.059+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fafac037040 con 0x563cb624d0a0 2024-05-09T09:47:34.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.059+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x563cb6248800 2024-05-09T09:47:34.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.059+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafa80cf3a0 con 0x563cb6248800 2024-05-09T09:47:34.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.063+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x563cb624d0a0 2024-05-09T09:47:34.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.063+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafac037040 con 0x563cb624d0a0 2024-05-09T09:47:34.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.063+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x563cb624d0a0 2024-05-09T09:47:34.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.063+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafac037040 con 0x563cb624d0a0 2024-05-09T09:47:34.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.063+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x563cb6243e40 2024-05-09T09:47:34.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.063+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb0026040 con 0x563cb6243e40 2024-05-09T09:47:34.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.063+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x563cb6243e40 2024-05-09T09:47:34.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.063+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fafb0026040 con 0x563cb6243e40 2024-05-09T09:47:34.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.063+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x563cb6248800 2024-05-09T09:47:34.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.063+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafa80cf3a0 con 0x563cb6248800 2024-05-09T09:47:34.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.063+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x563cb624d0a0 2024-05-09T09:47:34.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.063+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafac037040 con 0x563cb624d0a0 2024-05-09T09:47:34.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.063+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x7fafac01fbe0 2024-05-09T09:47:34.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.063+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb0026040 con 0x7fafac01fbe0 2024-05-09T09:47:34.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.063+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x563cb6243e40 2024-05-09T09:47:34.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.063+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb0026040 con 0x563cb6243e40 2024-05-09T09:47:34.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.063+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x563cb6248800 2024-05-09T09:47:34.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.063+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fafa80cf3a0 con 0x563cb6248800 2024-05-09T09:47:34.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.063+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x563cb624d0a0 2024-05-09T09:47:34.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.063+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafac037040 con 0x563cb624d0a0 2024-05-09T09:47:34.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.063+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x563cb6248800 2024-05-09T09:47:34.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafa80cf3a0 con 0x563cb6248800 2024-05-09T09:47:34.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x7fafac01fbe0 2024-05-09T09:47:34.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb0026040 con 0x7fafac01fbe0 2024-05-09T09:47:34.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x563cb624d0a0 2024-05-09T09:47:34.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafac037040 con 0x563cb624d0a0 2024-05-09T09:47:34.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x563cb6248800 2024-05-09T09:47:34.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafa80cf3a0 con 0x563cb6248800 2024-05-09T09:47:34.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x563cb6243e40 2024-05-09T09:47:34.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fafb0026040 con 0x563cb6243e40 2024-05-09T09:47:34.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563cb6247aa0 con 0x7fafac01fbe0 2024-05-09T09:47:34.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafb0026040 con 0x7fafac01fbe0 2024-05-09T09:47:34.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb8fde980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:34.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb8fde980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:34.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb8fde980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:34.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb8fde980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:34.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb8fde980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:34.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb8fde980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:34.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb8fde980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563cb624b980 con 0x563cb6243e40 2024-05-09T09:47:34.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafb0026040 con 0x563cb6243e40 2024-05-09T09:47:34.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb8fde980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:34.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb8fde980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563cb624b980 con 0x563cb6243e40 2024-05-09T09:47:34.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fafb0026040 con 0x563cb6243e40 2024-05-09T09:47:34.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb8fde980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:34.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb8fde980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563cb624b980 con 0x563cb624d0a0 2024-05-09T09:47:34.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fafac0491c0 con 0x563cb624d0a0 2024-05-09T09:47:34.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb8fde980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:34.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb8fde980 20 zone default found 2024-05-09T09:47:34.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb8fde980 4 Realm: () 2024-05-09T09:47:34.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb8fde980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:34.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb8fde980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:34.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb8fde980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:34.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb8fde980 20 zonegroup default 2024-05-09T09:47:34.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb8fde980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.067+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563cb624c220 con 0x563cb6248800 2024-05-09T09:47:34.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.071+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fafa80cf3a0 con 0x563cb6248800 2024-05-09T09:47:34.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.071+0000 7fafb8fde980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:34.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.071+0000 7fafb8fde980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.071+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563cb6251a90 con 0x563cb624d0a0 2024-05-09T09:47:34.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.071+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fafac0491c0 con 0x563cb624d0a0 2024-05-09T09:47:34.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.071+0000 7fafb8fde980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:34.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.071+0000 7fafb8fde980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.071+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563cb6251e30 con 0x563cb624d0a0 2024-05-09T09:47:34.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.071+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fafac0491c0 con 0x563cb624d0a0 2024-05-09T09:47:34.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.071+0000 7fafb8fde980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:34.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.071+0000 7fafb8fde980 20 started sync module instance, tier type = 2024-05-09T09:47:34.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.071+0000 7fafb8fde980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:34.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.071+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb6250f30 con 0x7fafac01fbe0 2024-05-09T09:47:34.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.071+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafb0026040 con 0x7fafac01fbe0 2024-05-09T09:47:34.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.071+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94818753909808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb6250f30 con 0x7fafac01fbe0 2024-05-09T09:47:34.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.071+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb6252880 con 0x563cb6243e40 2024-05-09T09:47:34.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.071+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94818753909808] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafb0036040 con 0x7fafac01fbe0 2024-05-09T09:47:34.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.075+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafb0036040 con 0x563cb6243e40 2024-05-09T09:47:34.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.075+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94818753913712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb6250f30 con 0x563cb6243e40 2024-05-09T09:47:34.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.075+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62532c0 con 0x563cb624d0a0 2024-05-09T09:47:34.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.075+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94818753913712] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafb0036040 con 0x563cb6243e40 2024-05-09T09:47:34.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.075+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafac0491c0 con 0x563cb624d0a0 2024-05-09T09:47:34.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.075+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94818753907328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb6250ea0 con 0x563cb624d0a0 2024-05-09T09:47:34.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.075+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb6254050 con 0x7fafac01fbe0 2024-05-09T09:47:34.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.079+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafb0036040 con 0x7fafac01fbe0 2024-05-09T09:47:34.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.079+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94818753919840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62548f0 con 0x7fafac01fbe0 2024-05-09T09:47:34.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.079+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62552f0 con 0x563cb6243e40 2024-05-09T09:47:34.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.079+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94818753907328] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafac0491c0 con 0x563cb624d0a0 2024-05-09T09:47:34.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.079+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94818753919840] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafb0036040 con 0x7fafac01fbe0 2024-05-09T09:47:34.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.079+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafb0036040 con 0x563cb6243e40 2024-05-09T09:47:34.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.079+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94818753918640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62543f0 con 0x563cb6243e40 2024-05-09T09:47:34.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.079+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb6255b90 con 0x563cb6248800 2024-05-09T09:47:34.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.079+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94818753918640] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafb0036040 con 0x563cb6243e40 2024-05-09T09:47:34.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.083+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafa80cf3a0 con 0x563cb6248800 2024-05-09T09:47:34.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.083+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94818753926880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62543f0 con 0x563cb6248800 2024-05-09T09:47:34.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.083+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62563e0 con 0x563cb6248800 2024-05-09T09:47:34.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.083+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94818753926880] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafa80cf3a0 con 0x563cb6248800 2024-05-09T09:47:34.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.083+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafa80cf3a0 con 0x563cb6248800 2024-05-09T09:47:34.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.083+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94818753924608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb6256c30 con 0x563cb6248800 2024-05-09T09:47:34.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.083+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62575f0 con 0x563cb6248800 2024-05-09T09:47:34.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.087+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94818753924608] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafa80cf3a0 con 0x563cb6248800 2024-05-09T09:47:34.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.087+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafa80cf3a0 con 0x563cb6248800 2024-05-09T09:47:34.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.087+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94818753931408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62575f0 con 0x563cb6248800 2024-05-09T09:47:34.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.087+0000 7fafb8fde980 20 add_watcher() i=0 2024-05-09T09:47:34.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.087+0000 7fafb8fde980 20 add_watcher() i=1 2024-05-09T09:47:34.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.087+0000 7fafb8fde980 20 add_watcher() i=2 2024-05-09T09:47:34.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.087+0000 7fafb8fde980 20 add_watcher() i=3 2024-05-09T09:47:34.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.087+0000 7fafb8fde980 20 add_watcher() i=4 2024-05-09T09:47:34.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.087+0000 7fafb8fde980 20 add_watcher() i=5 2024-05-09T09:47:34.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.087+0000 7fafb8fde980 20 add_watcher() i=6 2024-05-09T09:47:34.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.087+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94818753931408] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafa80cf3a0 con 0x563cb6248800 2024-05-09T09:47:34.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.087+0000 7fafb8fde980 20 add_watcher() i=7 2024-05-09T09:47:34.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.087+0000 7fafb8fde980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:34.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.087+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563cb625a910 con 0x563cb6243e40 2024-05-09T09:47:34.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.087+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fafb0036040 con 0x563cb6243e40 2024-05-09T09:47:34.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.087+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94818753934000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb6257b80 con 0x563cb6243e40 2024-05-09T09:47:34.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.091+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94818753934000] v30'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fafb0036040 con 0x563cb6243e40 2024-05-09T09:47:34.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.091+0000 7fae677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:34.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.091+0000 7fafb8fde980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:34.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.091+0000 7fafb8fde980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:34.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.091+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb6263040 con 0x563cb6243e40 2024-05-09T09:47:34.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.091+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'31 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fafb0036040 con 0x563cb6243e40 2024-05-09T09:47:34.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.091+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62635b0 con 0x563cb6248800 2024-05-09T09:47:34.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.095+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fafa80cf3a0 con 0x563cb6248800 2024-05-09T09:47:34.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.095+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62635b0 con 0x563cb624d0a0 2024-05-09T09:47:34.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.095+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fafac0491c0 con 0x563cb624d0a0 2024-05-09T09:47:34.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.095+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb6263fd0 con 0x563cb6243e40 2024-05-09T09:47:34.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.095+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'100 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fafb0036040 con 0x563cb6243e40 2024-05-09T09:47:34.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.095+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb6261140 con 0x7fafac01fbe0 2024-05-09T09:47:34.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.099+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'65 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fafb0036040 con 0x7fafac01fbe0 2024-05-09T09:47:34.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.099+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb6264b30 con 0x563cb624d0a0 2024-05-09T09:47:34.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.099+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'43 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fafac0491c0 con 0x563cb624d0a0 2024-05-09T09:47:34.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.099+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb6264fe0 con 0x563cb6243e40 2024-05-09T09:47:34.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.103+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fafb0036040 con 0x563cb6243e40 2024-05-09T09:47:34.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.103+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb6264fe0 con 0x563cb6248800 2024-05-09T09:47:34.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.103+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'43 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fafa80cf3a0 con 0x563cb6248800 2024-05-09T09:47:34.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.103+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb6264fe0 con 0x7fafac01fbe0 2024-05-09T09:47:34.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.107+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fafb0036040 con 0x7fafac01fbe0 2024-05-09T09:47:34.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.107+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb6264fe0 con 0x563cb624d0a0 2024-05-09T09:47:34.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.107+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'31 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fafac0491c0 con 0x563cb624d0a0 2024-05-09T09:47:34.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.107+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62651b0 con 0x7fafac01fbe0 2024-05-09T09:47:34.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.111+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'66 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafb0036040 con 0x7fafac01fbe0 2024-05-09T09:47:34.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.111+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62651b0 con 0x563cb6248800 2024-05-09T09:47:34.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.111+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'27 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafa80cf3a0 con 0x563cb6248800 2024-05-09T09:47:34.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.111+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb6265240 con 0x7fafac01fbe0 2024-05-09T09:47:34.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.111+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafb0036040 con 0x7fafac01fbe0 2024-05-09T09:47:34.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.111+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb6265410 con 0x563cb6248800 2024-05-09T09:47:34.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.115+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'49 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafa80cf3a0 con 0x563cb6248800 2024-05-09T09:47:34.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.115+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb6265410 con 0x563cb6243e40 2024-05-09T09:47:34.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.115+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'101 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafb0036040 con 0x563cb6243e40 2024-05-09T09:47:34.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.115+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb6265410 con 0x563cb624d0a0 2024-05-09T09:47:34.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.119+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'59 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafac0491c0 con 0x563cb624d0a0 2024-05-09T09:47:34.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.119+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb6265410 con 0x7fafac01fbe0 2024-05-09T09:47:34.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.119+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'67 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafb0036040 con 0x7fafac01fbe0 2024-05-09T09:47:34.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.119+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb6265410 con 0x563cb624d0a0 2024-05-09T09:47:34.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.123+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafac0491c0 con 0x563cb624d0a0 2024-05-09T09:47:34.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.123+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62657d0 con 0x563cb6243e40 2024-05-09T09:47:34.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.123+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'33 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafb0036040 con 0x563cb6243e40 2024-05-09T09:47:34.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.123+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62657d0 con 0x563cb6243e40 2024-05-09T09:47:34.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.127+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'102 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafb0036040 con 0x563cb6243e40 2024-05-09T09:47:34.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.127+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62657d0 con 0x563cb624d0a0 2024-05-09T09:47:34.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.127+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'60 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafac0491c0 con 0x563cb624d0a0 2024-05-09T09:47:34.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.127+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62657d0 con 0x7fafac01fbe0 2024-05-09T09:47:34.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.127+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'35 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafb0036040 con 0x7fafac01fbe0 2024-05-09T09:47:34.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.131+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62657d0 con 0x563cb624d0a0 2024-05-09T09:47:34.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.131+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'27 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafac0491c0 con 0x563cb624d0a0 2024-05-09T09:47:34.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.131+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62657d0 con 0x563cb624d0a0 2024-05-09T09:47:34.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.131+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'31 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafac0491c0 con 0x563cb624d0a0 2024-05-09T09:47:34.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.131+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62657d0 con 0x563cb624d0a0 2024-05-09T09:47:34.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.135+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafac0491c0 con 0x563cb624d0a0 2024-05-09T09:47:34.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.135+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62657d0 con 0x563cb624d0a0 2024-05-09T09:47:34.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.135+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'44 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafac0491c0 con 0x563cb624d0a0 2024-05-09T09:47:34.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.135+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62657d0 con 0x563cb6248800 2024-05-09T09:47:34.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.139+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafa80cf3a0 con 0x563cb6248800 2024-05-09T09:47:34.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.139+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62657d0 con 0x563cb624d0a0 2024-05-09T09:47:34.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.139+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafac0491c0 con 0x563cb624d0a0 2024-05-09T09:47:34.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.139+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62657d0 con 0x563cb6248800 2024-05-09T09:47:34.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.139+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'44 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafa80cf3a0 con 0x563cb6248800 2024-05-09T09:47:34.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.139+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62657d0 con 0x563cb624d0a0 2024-05-09T09:47:34.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.143+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'61 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafac0491c0 con 0x563cb624d0a0 2024-05-09T09:47:34.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.143+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62657d0 con 0x563cb6248800 2024-05-09T09:47:34.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.147+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'50 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafa80cf3a0 con 0x563cb6248800 2024-05-09T09:47:34.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.147+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62657d0 con 0x7fafac01fbe0 2024-05-09T09:47:34.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.147+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'31 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafb0036040 con 0x7fafac01fbe0 2024-05-09T09:47:34.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.147+0000 7fae667fc640 20 reqs_thread_entry: start 2024-05-09T09:47:34.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.147+0000 7fafb8fde980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:34.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.147+0000 7fadd7fff640 20 reqs_thread_entry: start 2024-05-09T09:47:34.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.147+0000 7fafb8fde980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.147+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563cb6280ec0 con 0x563cb6243e40 2024-05-09T09:47:34.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.151+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7fafb0036040 con 0x563cb6243e40 2024-05-09T09:47:34.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.151+0000 7fafb8fde980 20 rados_obj.operate() r=0 bl.length=502 2024-05-09T09:47:34.148 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-09T09:47:32.044078Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-09T09:47:33.885213Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:47:32.044055Z","tags":[],"group_ids":[]} 2024-05-09T09:47:34.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.151+0000 7fae677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:34.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.151+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94818753934000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb625fda0 con 0x563cb6243e40 2024-05-09T09:47:34.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.151+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94818753934000] v30'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fafb0036040 con 0x563cb6243e40 2024-05-09T09:47:34.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.151+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94818753909808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62572b0 con 0x7fafac01fbe0 2024-05-09T09:47:34.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.155+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94818753909808] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafb0036040 con 0x7fafac01fbe0 2024-05-09T09:47:34.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.155+0000 7fafb8fde980 20 remove_watcher() i=0 2024-05-09T09:47:34.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.155+0000 7fafb8fde980 2 removed watcher, disabling cache 2024-05-09T09:47:34.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.155+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94818753913712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62572b0 con 0x563cb6243e40 2024-05-09T09:47:34.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.155+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94818753913712] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafb0036040 con 0x563cb6243e40 2024-05-09T09:47:34.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.155+0000 7fafb8fde980 20 remove_watcher() i=1 2024-05-09T09:47:34.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.155+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94818753907328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62572b0 con 0x563cb624d0a0 2024-05-09T09:47:34.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.159+0000 7fafb62f8640 1 -- 172.21.15.157:0/3781977617 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94818753907328] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafac0491c0 con 0x563cb624d0a0 2024-05-09T09:47:34.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.159+0000 7fafb8fde980 20 remove_watcher() i=2 2024-05-09T09:47:34.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.159+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94818753919840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb6250a80 con 0x7fafac01fbe0 2024-05-09T09:47:34.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.159+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94818753919840] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafb0036040 con 0x7fafac01fbe0 2024-05-09T09:47:34.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.159+0000 7fafb8fde980 20 remove_watcher() i=3 2024-05-09T09:47:34.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.159+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94818753918640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62572b0 con 0x563cb6243e40 2024-05-09T09:47:34.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.159+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94818753918640] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafb0036040 con 0x563cb6243e40 2024-05-09T09:47:34.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.159+0000 7fafb8fde980 20 remove_watcher() i=4 2024-05-09T09:47:34.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.159+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94818753926880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb6250a80 con 0x563cb6248800 2024-05-09T09:47:34.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.163+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94818753926880] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafa80cf3a0 con 0x563cb6248800 2024-05-09T09:47:34.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.163+0000 7fafb8fde980 20 remove_watcher() i=5 2024-05-09T09:47:34.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.163+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94818753924608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62536b0 con 0x563cb6248800 2024-05-09T09:47:34.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94818753924608] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafa80cf3a0 con 0x563cb6248800 2024-05-09T09:47:34.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 20 remove_watcher() i=6 2024-05-09T09:47:34.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94818753931408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563cb62572b0 con 0x563cb6248800 2024-05-09T09:47:34.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb6af9640 1 -- 172.21.15.157:0/3781977617 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94818753931408] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafa80cf3a0 con 0x563cb6248800 2024-05-09T09:47:34.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 20 remove_watcher() i=7 2024-05-09T09:47:34.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563cb6248800 msgr2=0x563cb624abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 --2- 172.21.15.157:0/3781977617 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563cb6248800 0x563cb624abf0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563cb6243e40 msgr2=0x563cb6246300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 --2- 172.21.15.157:0/3781977617 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563cb6243e40 0x563cb6246300 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fafac01fbe0 msgr2=0x7fafac03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 --2- 172.21.15.157:0/3781977617 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fafac01fbe0 0x7fafac03a3c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563cb624d0a0 msgr2=0x563cb624f560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 --2- 172.21.15.157:0/3781977617 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563cb624d0a0 0x563cb624f560 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fae80034bb0 msgr2=0x7fae80037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 --2- 172.21.15.157:0/3781977617 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fae80034bb0 0x7fae80037070 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x563cb61fd470 tx=0x7fafac010000 comp rx=0 tx=0).stop 2024-05-09T09:47:34.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb72fa640 1 -- 172.21.15.157:0/3781977617 reap_dead start 2024-05-09T09:47:34.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb622ff60 msgr2=0x563cb6237350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 --2- 172.21.15.157:0/3781977617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb622ff60 0x563cb6237350 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fafa80e3600 tx=0x7fafa80e7f40 comp rx=0 tx=0).stop 2024-05-09T09:47:34.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 shutdown_connections 2024-05-09T09:47:34.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 --2- 172.21.15.157:0/3781977617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb622ff60 0x563cb6237350 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 >> 172.21.15.157:0/3781977617 conn(0x563cb622c2e0 msgr2=0x563cb6229940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:34.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 shutdown_connections 2024-05-09T09:47:34.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 -- 172.21.15.157:0/3781977617 wait complete. 2024-05-09T09:47:34.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 -- 172.21.15.157:0/3292764611 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fae90034bb0 msgr2=0x7fae90037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 --2- 172.21.15.157:0/3292764611 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fae90034bb0 0x7fae90037070 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x563cb61f1520 tx=0x7fafac00f000 comp rx=0 tx=0).stop 2024-05-09T09:47:34.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 -- 172.21.15.157:0/3292764611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb6222f50 msgr2=0x563cb6223370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 --2- 172.21.15.157:0/3292764611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb6222f50 0x563cb6223370 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fafa80e3b30 tx=0x7fafa80a9fb0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 -- 172.21.15.157:0/3292764611 shutdown_connections 2024-05-09T09:47:34.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 --2- 172.21.15.157:0/3292764611 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fae90034bb0 0x7fae90037070 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 --2- 172.21.15.157:0/3292764611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb6222f50 0x563cb6223370 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 -- 172.21.15.157:0/3292764611 >> 172.21.15.157:0/3292764611 conn(0x563cb6217d20 msgr2=0x563cb6218830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:34.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 -- 172.21.15.157:0/3292764611 shutdown_connections 2024-05-09T09:47:34.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 -- 172.21.15.157:0/3292764611 wait complete. 2024-05-09T09:47:34.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 -- 172.21.15.157:0/3522797194 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563cb61f64e0 msgr2=0x563cb61f8970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 --2- 172.21.15.157:0/3522797194 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563cb61f64e0 0x563cb61f8970 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 -- 172.21.15.157:0/3522797194 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563cb60fdf30 msgr2=0x563cb61f3c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 --2- 172.21.15.157:0/3522797194 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563cb60fdf30 0x563cb61f3c80 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 -- 172.21.15.157:0/3522797194 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563cb61fa560 msgr2=0x563cb61fc950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 --2- 172.21.15.157:0/3522797194 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563cb61fa560 0x563cb61fc950 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 -- 172.21.15.157:0/3522797194 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fae9c034c00 msgr2=0x7fae9c0370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 --2- 172.21.15.157:0/3522797194 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fae9c034c00 0x7fae9c0370c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fafac001e50 tx=0x7fafac0013b0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 -- 172.21.15.157:0/3522797194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb606ca70 msgr2=0x563cb61ecd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 --2- 172.21.15.157:0/3522797194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563cb606ca70 0x563cb61ecd40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fafa8000f90 tx=0x7fafa8017e30 comp rx=0 tx=0).stop 2024-05-09T09:47:34.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb72fa640 1 -- 172.21.15.157:0/3522797194 reap_dead start 2024-05-09T09:47:34.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 -- 172.21.15.157:0/3522797194 shutdown_connections 2024-05-09T09:47:34.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 -- 172.21.15.157:0/3522797194 >> 172.21.15.157:0/3522797194 conn(0x563cb60f30d0 msgr2=0x563cb61e0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:34.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 -- 172.21.15.157:0/3522797194 shutdown_connections 2024-05-09T09:47:34.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.167+0000 7fafb8fde980 1 -- 172.21.15.157:0/3522797194 wait complete. 2024-05-09T09:47:34.182 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-09T09:47:32.044078Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-09T09:47:33.885213Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:47:32.044055Z', 'tags': [], 'group_ids': []} 2024-05-09T09:47:34.182 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-05-09T09:47:34.182 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-05-09T09:47:34.182 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-05-09T09:47:34.258 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:34.258 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:34.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.259+0000 7f9c9230b980 1 Processor -- start 2024-05-09T09:47:34.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.259+0000 7f9c9230b980 1 -- start start 2024-05-09T09:47:34.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.259+0000 7f9c9230b980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55ed4c139040 0x55ed4c13b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.259+0000 7f9c9230b980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ed4bfe8440 con 0x55ed4c134b40 2024-05-09T09:47:34.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.259+0000 7f9c9230b980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55ed4bfd35f0 con 0x55ed4c139040 2024-05-09T09:47:34.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.259+0000 7f9c8f625640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55ed4c139040 0x55ed4c13b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.259+0000 7f9c8fe26640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x55ed4c134b40 0x55ed4c134f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:33666/0 (socket says 172.21.15.157:33666) 2024-05-09T09:47:34.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.259+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2824777521 learned_addr learned my addr 172.21.15.157:0/2824777521 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:47:34.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.263+0000 7f9c8f625640 1 -- 172.21.15.157:0/2824777521 >> v1:172.21.15.110:6789/0 conn(0x55ed4c134b40 legacy=0x55ed4c134f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.263+0000 7f9c8f625640 1 -- 172.21.15.157:0/2824777521 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed4bfde990 con 0x55ed4c139040 2024-05-09T09:47:34.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.263+0000 7f9c8f625640 1 --2- 172.21.15.157:0/2824777521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c139040 0x55ed4c13b430 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400a420 tx=0x7f9c8401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2e403a26400223 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.263+0000 7f9c8ee24640 1 -- 172.21.15.157:0/2824777521 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c840af070 con 0x55ed4c139040 2024-05-09T09:47:34.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.263+0000 7f9c8ee24640 1 -- 172.21.15.157:0/2824777521 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c840aa530 con 0x55ed4c139040 2024-05-09T09:47:34.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.263+0000 7f9c8ee24640 1 -- 172.21.15.157:0/2824777521 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c840aa850 con 0x55ed4c139040 2024-05-09T09:47:34.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.267+0000 7f9c9230b980 1 -- 172.21.15.157:0/2824777521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c139040 msgr2=0x55ed4c13b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.267+0000 7f9c9230b980 1 --2- 172.21.15.157:0/2824777521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c139040 0x55ed4c13b430 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400a420 tx=0x7f9c8401afd0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.267+0000 7f9c9230b980 1 -- 172.21.15.157:0/2824777521 shutdown_connections 2024-05-09T09:47:34.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.267+0000 7f9c9230b980 1 --2- 172.21.15.157:0/2824777521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c139040 0x55ed4c13b430 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.267+0000 7f9c9230b980 1 -- 172.21.15.157:0/2824777521 >> 172.21.15.157:0/2824777521 conn(0x55ed4c0a8260 msgr2=0x55ed4c0a8670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:34.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.267+0000 7f9c9230b980 1 -- 172.21.15.157:0/2824777521 shutdown_connections 2024-05-09T09:47:34.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.267+0000 7f9c9230b980 1 -- 172.21.15.157:0/2824777521 wait complete. 2024-05-09T09:47:34.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.279+0000 7f9c9230b980 1 Processor -- start 2024-05-09T09:47:34.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.283+0000 7f9c9230b980 1 -- start start 2024-05-09T09:47:34.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.283+0000 7f9c9230b980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c134b40 0x55ed4c21fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.283+0000 7f9c9230b980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ed4c035fe0 con 0x55ed4c134b40 2024-05-09T09:47:34.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.283+0000 7f9c8fe26640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c134b40 0x55ed4c21fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.283+0000 7f9c8fe26640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c134b40 0x55ed4c21fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54318/0 (socket says 172.21.15.157:54318) 2024-05-09T09:47:34.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.283+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2804651727 learned_addr learned my addr 172.21.15.157:0/2804651727 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:34.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.283+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2804651727 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed4bfbaae0 con 0x55ed4c134b40 2024-05-09T09:47:34.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.283+0000 7f9c8fe26640 1 --2- 172.21.15.157:0/2804651727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c134b40 0x55ed4c21fd70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9c80001d90 tx=0x7f9c80001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71df215418cca55 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.283+0000 7f9b7de0b640 1 -- 172.21.15.157:0/2804651727 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c80013030 con 0x55ed4c134b40 2024-05-09T09:47:34.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.283+0000 7f9b7de0b640 1 -- 172.21.15.157:0/2804651727 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c8000e690 con 0x55ed4c134b40 2024-05-09T09:47:34.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.283+0000 7f9b7de0b640 1 -- 172.21.15.157:0/2804651727 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c8000ea10 con 0x55ed4c134b40 2024-05-09T09:47:34.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.283+0000 7f9c9230b980 1 -- 172.21.15.157:0/2804651727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c134b40 msgr2=0x55ed4c21fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.283+0000 7f9c9230b980 1 --2- 172.21.15.157:0/2804651727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c134b40 0x55ed4c21fd70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9c80001d90 tx=0x7f9c80001e80 comp rx=0 tx=0).stop 2024-05-09T09:47:34.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.283+0000 7f9c9230b980 1 -- 172.21.15.157:0/2804651727 shutdown_connections 2024-05-09T09:47:34.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.283+0000 7f9c9230b980 1 --2- 172.21.15.157:0/2804651727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c134b40 0x55ed4c21fd70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.283+0000 7f9c9230b980 1 -- 172.21.15.157:0/2804651727 >> 172.21.15.157:0/2804651727 conn(0x55ed4c0a8260 msgr2=0x55ed4c21b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:34.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.283+0000 7f9c9230b980 1 -- 172.21.15.157:0/2804651727 shutdown_connections 2024-05-09T09:47:34.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.283+0000 7f9c9230b980 1 -- 172.21.15.157:0/2804651727 wait complete. 2024-05-09T09:47:34.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.283+0000 7f9c9230b980 1 Processor -- start 2024-05-09T09:47:34.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.283+0000 7f9c9230b980 1 -- start start 2024-05-09T09:47:34.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.283+0000 7f9c9230b980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c134b40 0x55ed4c226f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.283+0000 7f9c9230b980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ed4c13e460 con 0x55ed4c134b40 2024-05-09T09:47:34.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.287+0000 7f9c8fe26640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c134b40 0x55ed4c226f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.287+0000 7f9c8fe26640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c134b40 0x55ed4c226f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54324/0 (socket says 172.21.15.157:54324) 2024-05-09T09:47:34.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.287+0000 7f9c8fe26640 1 -- 172.21.15.157:0/3201063910 learned_addr learned my addr 172.21.15.157:0/3201063910 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:34.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.287+0000 7f9c8fe26640 1 -- 172.21.15.157:0/3201063910 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed4c2274d0 con 0x55ed4c134b40 2024-05-09T09:47:34.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.287+0000 7f9c8fe26640 1 --2- 172.21.15.157:0/3201063910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c134b40 0x55ed4c226f90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55ed4c220c00 tx=0x7f9c80000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.287+0000 7f9b77fff640 1 -- 172.21.15.157:0/3201063910 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c80027070 con 0x55ed4c134b40 2024-05-09T09:47:34.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.287+0000 7f9b77fff640 1 -- 172.21.15.157:0/3201063910 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c80019900 con 0x55ed4c134b40 2024-05-09T09:47:34.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.287+0000 7f9c9230b980 1 -- 172.21.15.157:0/3201063910 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed4c227760 con 0x55ed4c134b40 2024-05-09T09:47:34.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.287+0000 7f9b77fff640 1 -- 172.21.15.157:0/3201063910 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c80019c20 con 0x55ed4c134b40 2024-05-09T09:47:34.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.287+0000 7f9c9230b980 1 -- 172.21.15.157:0/3201063910 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed4c22a3f0 con 0x55ed4c134b40 2024-05-09T09:47:34.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.291+0000 7f9b77fff640 1 -- 172.21.15.157:0/3201063910 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f9c8002a070 con 0x55ed4c134b40 2024-05-09T09:47:34.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.291+0000 7f9b77fff640 1 --2- 172.21.15.157:0/3201063910 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b78034c00 0x7f9b780370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.291+0000 7f9b77fff640 1 -- 172.21.15.157:0/3201063910 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f9c8001f070 con 0x55ed4c134b40 2024-05-09T09:47:34.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.291+0000 7f9c8f625640 1 --2- 172.21.15.157:0/3201063910 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b78034c00 0x7f9b780370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.291+0000 7f9c9230b980 1 --2- 172.21.15.157:0/3201063910 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ed4c139040 0x55ed4c22df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.291+0000 7f9c9230b980 1 -- 172.21.15.157:0/3201063910 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c22e580 con 0x55ed4c139040 2024-05-09T09:47:34.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.291+0000 7f9c90627640 1 --2- 172.21.15.157:0/3201063910 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ed4c139040 0x55ed4c22df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.291+0000 7f9c8f625640 1 --2- 172.21.15.157:0/3201063910 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b78034c00 0x7f9b780370c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9c840ac000 tx=0x7f9c840a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.291+0000 7f9c90627640 1 --2- 172.21.15.157:0/3201063910 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ed4c139040 0x55ed4c22df10 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.291+0000 7f9c90627640 1 -- 172.21.15.157:0/3201063910 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c880083f0 con 0x55ed4c139040 2024-05-09T09:47:34.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.291+0000 7f9c9230b980 1 -- 172.21.15.157:0/3201063910 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c22b5f0 con 0x55ed4c139040 2024-05-09T09:47:34.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.291+0000 7f9c90627640 1 -- 172.21.15.157:0/3201063910 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9c880083f0 con 0x55ed4c139040 2024-05-09T09:47:34.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.291+0000 7f9c9230b980 1 --2- 172.21.15.157:0/3201063910 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ed4c2308b0 0x55ed4c232ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.291+0000 7f9c9230b980 1 -- 172.21.15.157:0/3201063910 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c233370 con 0x55ed4c2308b0 2024-05-09T09:47:34.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.291+0000 7f9c8fe26640 1 --2- 172.21.15.157:0/3201063910 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ed4c2308b0 0x55ed4c232ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.291+0000 7f9c8fe26640 1 --2- 172.21.15.157:0/3201063910 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ed4c2308b0 0x55ed4c232ca0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.295+0000 7f9c8fe26640 1 -- 172.21.15.157:0/3201063910 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9c80029030 con 0x55ed4c2308b0 2024-05-09T09:47:34.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.295+0000 7f9c9230b980 1 -- 172.21.15.157:0/3201063910 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c22f750 con 0x55ed4c139040 2024-05-09T09:47:34.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.295+0000 7f9c90627640 1 -- 172.21.15.157:0/3201063910 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9c880083f0 con 0x55ed4c139040 2024-05-09T09:47:34.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.295+0000 7f9c9230b980 1 --2- 172.21.15.157:0/3201063910 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ed4c2347d0 0x55ed4c236bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.295+0000 7f9c9230b980 1 -- 172.21.15.157:0/3201063910 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c2372c0 con 0x55ed4c2347d0 2024-05-09T09:47:34.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.295+0000 7f9c8f625640 1 --2- 172.21.15.157:0/3201063910 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ed4c2347d0 0x55ed4c236bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.295+0000 7f9c8f625640 1 --2- 172.21.15.157:0/3201063910 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ed4c2347d0 0x55ed4c236bc0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.295+0000 7f9c8f625640 1 -- 172.21.15.157:0/3201063910 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9c840b2070 con 0x55ed4c2347d0 2024-05-09T09:47:34.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.299+0000 7f9c9230b980 1 Processor -- start 2024-05-09T09:47:34.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.299+0000 7f9c9230b980 1 -- start start 2024-05-09T09:47:34.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.299+0000 7f9c9230b980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c25d140 0x55ed4c25d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.299+0000 7f9c9230b980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ed4c03a020 con 0x55ed4c25d140 2024-05-09T09:47:34.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.299+0000 7f9c8fe26640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c25d140 0x55ed4c25d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.299+0000 7f9c8fe26640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c25d140 0x55ed4c25d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54340/0 (socket says 172.21.15.157:54340) 2024-05-09T09:47:34.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.299+0000 7f9c8fe26640 1 -- 172.21.15.157:0/1703396043 learned_addr learned my addr 172.21.15.157:0/1703396043 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:34.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.299+0000 7f9c8fe26640 1 -- 172.21.15.157:0/1703396043 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed4c25daa0 con 0x55ed4c25d140 2024-05-09T09:47:34.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.299+0000 7f9c8fe26640 1 --2- 172.21.15.157:0/1703396043 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c25d140 0x55ed4c25d560 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9c80017fd0 tx=0x7f9c8004a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.299+0000 7f9b6ffff640 1 -- 172.21.15.157:0/1703396043 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c800169d0 con 0x55ed4c25d140 2024-05-09T09:47:34.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.299+0000 7f9c9230b980 1 -- 172.21.15.157:0/1703396043 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed4c25e530 con 0x55ed4c25d140 2024-05-09T09:47:34.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.299+0000 7f9b6ffff640 1 -- 172.21.15.157:0/1703396043 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c800473b0 con 0x55ed4c25d140 2024-05-09T09:47:34.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.299+0000 7f9b6ffff640 1 -- 172.21.15.157:0/1703396043 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c80047690 con 0x55ed4c25d140 2024-05-09T09:47:34.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.299+0000 7f9c9230b980 1 -- 172.21.15.157:0/1703396043 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed4c25ea10 con 0x55ed4c25d140 2024-05-09T09:47:34.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.303+0000 7f9b6ffff640 1 -- 172.21.15.157:0/1703396043 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f9c80036040 con 0x55ed4c25d140 2024-05-09T09:47:34.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.303+0000 7f9b6ffff640 1 --2- 172.21.15.157:0/1703396043 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b68034c00 0x7f9b680370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.303+0000 7f9b6ffff640 1 -- 172.21.15.157:0/1703396043 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f9c80014070 con 0x55ed4c25d140 2024-05-09T09:47:34.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.303+0000 7f9c8f625640 1 --2- 172.21.15.157:0/1703396043 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b68034c00 0x7f9b680370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.303+0000 7f9c9230b980 1 Processor -- start 2024-05-09T09:47:34.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.303+0000 7f9c9230b980 1 -- start start 2024-05-09T09:47:34.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.303+0000 7f9c8f625640 1 --2- 172.21.15.157:0/1703396043 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b68034c00 0x7f9b680370c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55ed4c22ee60 tx=0x7f9c84005d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.303+0000 7f9c9230b980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c26a160 0x55ed4c26a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.303+0000 7f9c9230b980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ed4c2204c0 con 0x55ed4c26a160 2024-05-09T09:47:34.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.303+0000 7f9c8fe26640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c26a160 0x55ed4c26a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.303+0000 7f9c8fe26640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c26a160 0x55ed4c26a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54356/0 (socket says 172.21.15.157:54356) 2024-05-09T09:47:34.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.303+0000 7f9c8fe26640 1 -- 172.21.15.157:0/1256495122 learned_addr learned my addr 172.21.15.157:0/1256495122 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:34.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.303+0000 7f9c8fe26640 1 -- 172.21.15.157:0/1256495122 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed4c26ab50 con 0x55ed4c26a160 2024-05-09T09:47:34.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.303+0000 7f9c8fe26640 1 --2- 172.21.15.157:0/1256495122 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c26a160 0x55ed4c26a580 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9c8002c940 tx=0x7f9c8002c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d1f0146289f8c88 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.303+0000 7f9b6dffb640 1 -- 172.21.15.157:0/1256495122 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c8000c5a0 con 0x55ed4c26a160 2024-05-09T09:47:34.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.303+0000 7f9b6dffb640 1 -- 172.21.15.157:0/1256495122 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c8005e070 con 0x55ed4c26a160 2024-05-09T09:47:34.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.303+0000 7f9b6dffb640 1 -- 172.21.15.157:0/1256495122 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c8002aa90 con 0x55ed4c26a160 2024-05-09T09:47:34.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.303+0000 7f9c9230b980 1 -- 172.21.15.157:0/1256495122 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c26a160 msgr2=0x55ed4c26a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.303+0000 7f9c9230b980 1 --2- 172.21.15.157:0/1256495122 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c26a160 0x55ed4c26a580 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9c8002c940 tx=0x7f9c8002c6e0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.303+0000 7f9c9230b980 1 -- 172.21.15.157:0/1256495122 shutdown_connections 2024-05-09T09:47:34.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.303+0000 7f9c9230b980 1 --2- 172.21.15.157:0/1256495122 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c26a160 0x55ed4c26a580 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.303+0000 7f9c9230b980 1 -- 172.21.15.157:0/1256495122 >> 172.21.15.157:0/1256495122 conn(0x55ed4c266490 msgr2=0x55ed4c2644f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:34.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.303+0000 7f9c9230b980 1 -- 172.21.15.157:0/1256495122 shutdown_connections 2024-05-09T09:47:34.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.303+0000 7f9c9230b980 1 -- 172.21.15.157:0/1256495122 wait complete. 2024-05-09T09:47:34.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.303+0000 7f9c9230b980 1 Processor -- start 2024-05-09T09:47:34.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.307+0000 7f9c9230b980 1 -- start start 2024-05-09T09:47:34.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.307+0000 7f9c9230b980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c26a160 0x55ed4c271470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.307+0000 7f9c9230b980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ed4c26b1e0 con 0x55ed4c26a160 2024-05-09T09:47:34.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.307+0000 7f9c8fe26640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c26a160 0x55ed4c271470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.307+0000 7f9c8fe26640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c26a160 0x55ed4c271470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54372/0 (socket says 172.21.15.157:54372) 2024-05-09T09:47:34.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.307+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 learned_addr learned my addr 172.21.15.157:0/2493696143 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:34.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.307+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed4c2719b0 con 0x55ed4c26a160 2024-05-09T09:47:34.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.307+0000 7f9c8fe26640 1 --2- 172.21.15.157:0/2493696143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c26a160 0x55ed4c271470 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9c800487e0 tx=0x7f9c80058000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.307+0000 7f9b5ffff640 1 -- 172.21.15.157:0/2493696143 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c8000c5a0 con 0x55ed4c26a160 2024-05-09T09:47:34.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.307+0000 7f9b5ffff640 1 -- 172.21.15.157:0/2493696143 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c8002cc60 con 0x55ed4c26a160 2024-05-09T09:47:34.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.307+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed4c2719b0 con 0x55ed4c26a160 2024-05-09T09:47:34.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.307+0000 7f9b5ffff640 1 -- 172.21.15.157:0/2493696143 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c800387a0 con 0x55ed4c26a160 2024-05-09T09:47:34.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.307+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed4c2719b0 con 0x55ed4c26a160 2024-05-09T09:47:34.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.307+0000 7f9b5ffff640 1 -- 172.21.15.157:0/2493696143 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f9c80016070 con 0x55ed4c26a160 2024-05-09T09:47:34.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.307+0000 7f9b5ffff640 1 --2- 172.21.15.157:0/2493696143 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b58034bb0 0x7f9b58037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.307+0000 7f9b5ffff640 1 -- 172.21.15.157:0/2493696143 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f9c80005050 con 0x55ed4c26a160 2024-05-09T09:47:34.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.307+0000 7f9c8f625640 1 --2- 172.21.15.157:0/2493696143 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b58034bb0 0x7f9b58037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.307+0000 7f9c9230b980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.307+0000 7f9c9230b980 1 --2- 172.21.15.157:0/2493696143 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ed4c27dfe0 0x55ed4c2804a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.307+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c280bf0 con 0x55ed4c27dfe0 2024-05-09T09:47:34.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.307+0000 7f9c90627640 1 --2- 172.21.15.157:0/2493696143 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ed4c27dfe0 0x55ed4c2804a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.311+0000 7f9c8f625640 1 --2- 172.21.15.157:0/2493696143 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b58034bb0 0x7f9b58037070 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9c840aabb0 tx=0x7f9c840b8040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.311+0000 7f9c90627640 1 --2- 172.21.15.157:0/2493696143 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ed4c27dfe0 0x55ed4c2804a0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.311+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c880083f0 con 0x55ed4c27dfe0 2024-05-09T09:47:34.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.311+0000 7f9c9230b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:34.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.311+0000 7f9c9230b980 20 realm 2024-05-09T09:47:34.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.311+0000 7f9c9230b980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.311+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c281000 con 0x55ed4c27dfe0 2024-05-09T09:47:34.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.311+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c880083f0 con 0x55ed4c27dfe0 2024-05-09T09:47:34.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.311+0000 7f9c9230b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:34.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.311+0000 7f9c9230b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:34.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.311+0000 7f9c9230b980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.311+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c2818d0 con 0x55ed4c27dfe0 2024-05-09T09:47:34.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.311+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c880083f0 con 0x55ed4c27dfe0 2024-05-09T09:47:34.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.311+0000 7f9c9230b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:34.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.311+0000 7f9c9230b980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.311+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c281c70 con 0x55ed4c27dfe0 2024-05-09T09:47:34.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.311+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9c880083f0 con 0x55ed4c27dfe0 2024-05-09T09:47:34.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.311+0000 7f9c9230b980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:34.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.311+0000 7f9c9230b980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.311+0000 7f9c9230b980 1 --2- 172.21.15.157:0/2493696143 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ed4c2829d0 0x55ed4c284dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.311+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c2853d0 con 0x55ed4c2829d0 2024-05-09T09:47:34.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.311+0000 7f9c8fe26640 1 --2- 172.21.15.157:0/2493696143 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ed4c2829d0 0x55ed4c284dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.315+0000 7f9c8fe26640 1 --2- 172.21.15.157:0/2493696143 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ed4c2829d0 0x55ed4c284dc0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.315+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9c80075070 con 0x55ed4c2829d0 2024-05-09T09:47:34.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.315+0000 7f9c9230b980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:34.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.315+0000 7f9c9230b980 20 searching for the correct realm 2024-05-09T09:47:34.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.315+0000 7f9c9230b980 1 --2- 172.21.15.157:0/2493696143 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ed4c287320 0x55ed4c289730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.315+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c289e00 con 0x55ed4c287320 2024-05-09T09:47:34.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.315+0000 7f9c8f625640 1 --2- 172.21.15.157:0/2493696143 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ed4c287320 0x55ed4c289730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.315+0000 7f9c8f625640 1 --2- 172.21.15.157:0/2493696143 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ed4c287320 0x55ed4c289730 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.315+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c840d7070 con 0x55ed4c287320 2024-05-09T09:47:34.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.315+0000 7f9c8f625640 1 --2- 172.21.15.157:0/2493696143 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f9c840cc040 0x7f9c840d9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.315+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c289e00 con 0x7f9c840cc040 2024-05-09T09:47:34.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.319+0000 7f9c90627640 1 --2- 172.21.15.157:0/2493696143 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f9c840cc040 0x7f9c840d9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.319+0000 7f9c90627640 1 --2- 172.21.15.157:0/2493696143 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f9c840cc040 0x7f9c840d9410 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.319+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c880083f0 con 0x7f9c840cc040 2024-05-09T09:47:34.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.319+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c281c70 con 0x55ed4c2829d0 2024-05-09T09:47:34.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.319+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c80075070 con 0x55ed4c2829d0 2024-05-09T09:47:34.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.319+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c281c70 con 0x55ed4c27dfe0 2024-05-09T09:47:34.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.319+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c880083f0 con 0x55ed4c27dfe0 2024-05-09T09:47:34.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.319+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c281c70 con 0x55ed4c27dfe0 2024-05-09T09:47:34.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.319+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c88026040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.319+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c281c70 con 0x55ed4c2829d0 2024-05-09T09:47:34.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.319+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c80075070 con 0x55ed4c2829d0 2024-05-09T09:47:34.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.319+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c281c70 con 0x55ed4c2829d0 2024-05-09T09:47:34.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.319+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c80075070 con 0x55ed4c2829d0 2024-05-09T09:47:34.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.319+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c281c70 con 0x7f9c840cc040 2024-05-09T09:47:34.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.319+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c88026040 con 0x7f9c840cc040 2024-05-09T09:47:34.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.319+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c281c70 con 0x55ed4c287320 2024-05-09T09:47:34.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.323+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c840d7070 con 0x55ed4c287320 2024-05-09T09:47:34.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.323+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c281c70 con 0x55ed4c27dfe0 2024-05-09T09:47:34.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.323+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c88026040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.323+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c281c70 con 0x55ed4c2829d0 2024-05-09T09:47:34.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.323+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c80075070 con 0x55ed4c2829d0 2024-05-09T09:47:34.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.323+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c281c70 con 0x55ed4c27dfe0 2024-05-09T09:47:34.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.323+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c88026040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.323+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c281c70 con 0x7f9c840cc040 2024-05-09T09:47:34.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.323+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9c88026040 con 0x7f9c840cc040 2024-05-09T09:47:34.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.323+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c281c70 con 0x55ed4c287320 2024-05-09T09:47:34.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.323+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c840d7070 con 0x55ed4c287320 2024-05-09T09:47:34.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.323+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9c840e6040 con 0x55ed4c287320 2024-05-09T09:47:34.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.323+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9c840d7070 con 0x55ed4c287320 2024-05-09T09:47:34.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.323+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9c840e6040 con 0x55ed4c2829d0 2024-05-09T09:47:34.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.323+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c80075070 con 0x55ed4c2829d0 2024-05-09T09:47:34.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.323+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9c840e6040 con 0x55ed4c287320 2024-05-09T09:47:34.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.323+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c840d7070 con 0x55ed4c287320 2024-05-09T09:47:34.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.323+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9c840e6040 con 0x55ed4c287320 2024-05-09T09:47:34.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.323+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c840d7070 con 0x55ed4c287320 2024-05-09T09:47:34.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.323+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9c840e6040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.327+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c88026040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.327+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9c840e6040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.327+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9c88026040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.327+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9c840e6040 con 0x55ed4c2829d0 2024-05-09T09:47:34.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.327+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c80075070 con 0x55ed4c2829d0 2024-05-09T09:47:34.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.327+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9c840e6040 con 0x55ed4c287320 2024-05-09T09:47:34.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.327+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c840d7070 con 0x55ed4c287320 2024-05-09T09:47:34.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.327+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9c840e6040 con 0x7f9c840cc040 2024-05-09T09:47:34.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.327+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c88026040 con 0x7f9c840cc040 2024-05-09T09:47:34.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.327+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9c840e6040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.327+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c88026040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.327+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9c840e6040 con 0x55ed4c2829d0 2024-05-09T09:47:34.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.327+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9c80075070 con 0x55ed4c2829d0 2024-05-09T09:47:34.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.327+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9c840e6040 con 0x55ed4c287320 2024-05-09T09:47:34.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.327+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c840d7070 con 0x55ed4c287320 2024-05-09T09:47:34.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9c840e6040 con 0x55ed4c2829d0 2024-05-09T09:47:34.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c80075070 con 0x55ed4c2829d0 2024-05-09T09:47:34.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9c840e6040 con 0x7f9c840cc040 2024-05-09T09:47:34.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c88026040 con 0x7f9c840cc040 2024-05-09T09:47:34.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9c840e6040 con 0x55ed4c287320 2024-05-09T09:47:34.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c840d7070 con 0x55ed4c287320 2024-05-09T09:47:34.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9c840e6040 con 0x55ed4c2829d0 2024-05-09T09:47:34.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c80075070 con 0x55ed4c2829d0 2024-05-09T09:47:34.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9c840e6040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9c88026040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9c840e6040 con 0x7f9c840cc040 2024-05-09T09:47:34.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c88026040 con 0x7f9c840cc040 2024-05-09T09:47:34.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c9230b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:34.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c9230b980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:34.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c9230b980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:34.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c9230b980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:34.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c9230b980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:34.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c9230b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:34.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c9230b980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c285c90 con 0x55ed4c27dfe0 2024-05-09T09:47:34.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c88026040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c9230b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:34.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c9230b980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c285c90 con 0x55ed4c27dfe0 2024-05-09T09:47:34.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9c88026040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c9230b980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:34.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c9230b980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c285c90 con 0x55ed4c287320 2024-05-09T09:47:34.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9c840d7070 con 0x55ed4c287320 2024-05-09T09:47:34.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c9230b980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:34.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c9230b980 20 zone default found 2024-05-09T09:47:34.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c9230b980 4 Realm: () 2024-05-09T09:47:34.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c9230b980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:34.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c9230b980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:34.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c9230b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:34.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c9230b980 20 zonegroup default 2024-05-09T09:47:34.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c9230b980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.331+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c286690 con 0x55ed4c2829d0 2024-05-09T09:47:34.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.335+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9c80075070 con 0x55ed4c2829d0 2024-05-09T09:47:34.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.335+0000 7f9c9230b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:34.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.335+0000 7f9c9230b980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.335+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c286260 con 0x55ed4c287320 2024-05-09T09:47:34.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.335+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9c840d7070 con 0x55ed4c287320 2024-05-09T09:47:34.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.335+0000 7f9c9230b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:34.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.335+0000 7f9c9230b980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.335+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c28c1b0 con 0x55ed4c287320 2024-05-09T09:47:34.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.335+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9c840d7070 con 0x55ed4c287320 2024-05-09T09:47:34.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.335+0000 7f9c9230b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:34.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.335+0000 7f9c9230b980 20 started sync module instance, tier type = 2024-05-09T09:47:34.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.335+0000 7f9c9230b980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:34.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.335+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c28b5a0 con 0x7f9c840cc040 2024-05-09T09:47:34.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.335+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c88026040 con 0x7f9c840cc040 2024-05-09T09:47:34.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.335+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94477673347776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c28b5a0 con 0x7f9c840cc040 2024-05-09T09:47:34.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.335+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c28cc80 con 0x55ed4c27dfe0 2024-05-09T09:47:34.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.335+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94477673347776] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c88036040 con 0x7f9c840cc040 2024-05-09T09:47:34.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.339+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c88036040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.339+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94477673350992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c28b5a0 con 0x55ed4c27dfe0 2024-05-09T09:47:34.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.339+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c28d690 con 0x55ed4c287320 2024-05-09T09:47:34.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.339+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c840d7070 con 0x55ed4c287320 2024-05-09T09:47:34.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.339+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94477673353696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c28df30 con 0x55ed4c287320 2024-05-09T09:47:34.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.339+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c28e930 con 0x7f9c840cc040 2024-05-09T09:47:34.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.343+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94477673350992] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c88036040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.343+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c88036040 con 0x7f9c840cc040 2024-05-09T09:47:34.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.343+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94477673345264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c28ed20 con 0x7f9c840cc040 2024-05-09T09:47:34.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.343+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c28f6e0 con 0x55ed4c27dfe0 2024-05-09T09:47:34.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.343+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94477673353696] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c840d7070 con 0x55ed4c287320 2024-05-09T09:47:34.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.343+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94477673345264] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c88036040 con 0x7f9c840cc040 2024-05-09T09:47:34.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.343+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c88036040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.343+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94477673358400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c28f230 con 0x55ed4c27dfe0 2024-05-09T09:47:34.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.343+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c28fa80 con 0x55ed4c2829d0 2024-05-09T09:47:34.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.347+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94477673358400] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c88036040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.347+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c80075070 con 0x55ed4c2829d0 2024-05-09T09:47:34.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.347+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94477673361968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c28f650 con 0x55ed4c2829d0 2024-05-09T09:47:34.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.347+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c290780 con 0x55ed4c2829d0 2024-05-09T09:47:34.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.347+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94477673361968] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c80075070 con 0x55ed4c2829d0 2024-05-09T09:47:34.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.347+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c80075070 con 0x55ed4c2829d0 2024-05-09T09:47:34.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.347+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94477673365296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c290980 con 0x55ed4c2829d0 2024-05-09T09:47:34.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.347+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c2914a0 con 0x55ed4c2829d0 2024-05-09T09:47:34.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.351+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94477673365296] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c80075070 con 0x55ed4c2829d0 2024-05-09T09:47:34.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.351+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c80075070 con 0x55ed4c2829d0 2024-05-09T09:47:34.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.351+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94477673369456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c291460 con 0x55ed4c2829d0 2024-05-09T09:47:34.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.351+0000 7f9c9230b980 20 add_watcher() i=0 2024-05-09T09:47:34.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.351+0000 7f9c9230b980 20 add_watcher() i=1 2024-05-09T09:47:34.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.351+0000 7f9c9230b980 20 add_watcher() i=2 2024-05-09T09:47:34.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.351+0000 7f9c9230b980 20 add_watcher() i=3 2024-05-09T09:47:34.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.351+0000 7f9c9230b980 20 add_watcher() i=4 2024-05-09T09:47:34.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.351+0000 7f9c9230b980 20 add_watcher() i=5 2024-05-09T09:47:34.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.351+0000 7f9c9230b980 20 add_watcher() i=6 2024-05-09T09:47:34.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.355+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94477673369456] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c80075070 con 0x55ed4c2829d0 2024-05-09T09:47:34.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.355+0000 7f9c9230b980 20 add_watcher() i=7 2024-05-09T09:47:34.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.355+0000 7f9c9230b980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:34.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.355+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c2948f0 con 0x55ed4c27dfe0 2024-05-09T09:47:34.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.355+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9c88036040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.355+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94477673366480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c291e10 con 0x55ed4c27dfe0 2024-05-09T09:47:34.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.355+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94477673366480] v30'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9c88036040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.355+0000 7f9b44fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:34.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.355+0000 7f9c9230b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:34.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.355+0000 7f9c9230b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:34.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.355+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c294690 con 0x55ed4c27dfe0 2024-05-09T09:47:34.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.359+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'32 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c88036040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.359+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29d960 con 0x55ed4c2829d0 2024-05-09T09:47:34.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.359+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c80075070 con 0x55ed4c2829d0 2024-05-09T09:47:34.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.359+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29d960 con 0x55ed4c287320 2024-05-09T09:47:34.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.359+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c840d7070 con 0x55ed4c287320 2024-05-09T09:47:34.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.359+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29d960 con 0x55ed4c27dfe0 2024-05-09T09:47:34.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.363+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'105 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c88036040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.363+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29e3e0 con 0x7f9c840cc040 2024-05-09T09:47:34.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.363+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'68 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c88036040 con 0x7f9c840cc040 2024-05-09T09:47:34.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.363+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29e950 con 0x55ed4c287320 2024-05-09T09:47:34.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.363+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'45 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c840d7070 con 0x55ed4c287320 2024-05-09T09:47:34.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.363+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29ee00 con 0x55ed4c27dfe0 2024-05-09T09:47:34.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.367+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'28 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c88036040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.367+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29ecc0 con 0x55ed4c2829d0 2024-05-09T09:47:34.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.367+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'45 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c80075070 con 0x55ed4c2829d0 2024-05-09T09:47:34.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.367+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29ed50 con 0x7f9c840cc040 2024-05-09T09:47:34.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.371+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c88036040 con 0x7f9c840cc040 2024-05-09T09:47:34.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.371+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29ed50 con 0x55ed4c287320 2024-05-09T09:47:34.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.371+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'32 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c840d7070 con 0x55ed4c287320 2024-05-09T09:47:34.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.371+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29f360 con 0x7f9c840cc040 2024-05-09T09:47:34.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.375+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'69 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c88036040 con 0x7f9c840cc040 2024-05-09T09:47:34.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.375+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29f320 con 0x55ed4c2829d0 2024-05-09T09:47:34.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.375+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'28 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c80075070 con 0x55ed4c2829d0 2024-05-09T09:47:34.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.375+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29f320 con 0x7f9c840cc040 2024-05-09T09:47:34.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.375+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c88036040 con 0x7f9c840cc040 2024-05-09T09:47:34.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.375+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29f320 con 0x55ed4c2829d0 2024-05-09T09:47:34.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.379+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'51 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c80075070 con 0x55ed4c2829d0 2024-05-09T09:47:34.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.379+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29f320 con 0x55ed4c27dfe0 2024-05-09T09:47:34.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.379+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'106 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c88036040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.379+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29f320 con 0x55ed4c287320 2024-05-09T09:47:34.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.383+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'62 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c840d7070 con 0x55ed4c287320 2024-05-09T09:47:34.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.383+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29f780 con 0x7f9c840cc040 2024-05-09T09:47:34.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.383+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'70 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c88036040 con 0x7f9c840cc040 2024-05-09T09:47:34.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.383+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29f720 con 0x55ed4c287320 2024-05-09T09:47:34.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.383+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c840d7070 con 0x55ed4c287320 2024-05-09T09:47:34.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.383+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29f720 con 0x55ed4c27dfe0 2024-05-09T09:47:34.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.387+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'34 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c88036040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.387+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29f720 con 0x55ed4c27dfe0 2024-05-09T09:47:34.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.387+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'107 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c88036040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.387+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29f720 con 0x55ed4c287320 2024-05-09T09:47:34.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.391+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'63 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c840d7070 con 0x55ed4c287320 2024-05-09T09:47:34.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.391+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29f720 con 0x7f9c840cc040 2024-05-09T09:47:34.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.391+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'36 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c88036040 con 0x7f9c840cc040 2024-05-09T09:47:34.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.391+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29f720 con 0x55ed4c287320 2024-05-09T09:47:34.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.391+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'28 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c840d7070 con 0x55ed4c287320 2024-05-09T09:47:34.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.391+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29f720 con 0x55ed4c287320 2024-05-09T09:47:34.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.395+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'32 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c840d7070 con 0x55ed4c287320 2024-05-09T09:47:34.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.395+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29f720 con 0x55ed4c287320 2024-05-09T09:47:34.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.395+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c840d7070 con 0x55ed4c287320 2024-05-09T09:47:34.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.395+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29f720 con 0x55ed4c287320 2024-05-09T09:47:34.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.395+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'46 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c840d7070 con 0x55ed4c287320 2024-05-09T09:47:34.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.395+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29f720 con 0x55ed4c2829d0 2024-05-09T09:47:34.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.399+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'28 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c80075070 con 0x55ed4c2829d0 2024-05-09T09:47:34.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.399+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29f720 con 0x55ed4c287320 2024-05-09T09:47:34.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.399+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c840d7070 con 0x55ed4c287320 2024-05-09T09:47:34.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.399+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29f720 con 0x55ed4c2829d0 2024-05-09T09:47:34.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.403+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'46 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c80075070 con 0x55ed4c2829d0 2024-05-09T09:47:34.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.403+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29f720 con 0x55ed4c287320 2024-05-09T09:47:34.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.403+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'64 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c840d7070 con 0x55ed4c287320 2024-05-09T09:47:34.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.403+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29f720 con 0x55ed4c2829d0 2024-05-09T09:47:34.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.407+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'52 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c80075070 con 0x55ed4c2829d0 2024-05-09T09:47:34.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.407+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29f720 con 0x7f9c840cc040 2024-05-09T09:47:34.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.411+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'32 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c88036040 con 0x7f9c840cc040 2024-05-09T09:47:34.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.411+0000 7f9abf7fe640 20 reqs_thread_entry: start 2024-05-09T09:47:34.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.411+0000 7f9c9230b980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:34.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.411+0000 7f9abd7fa640 20 reqs_thread_entry: start 2024-05-09T09:47:34.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.411+0000 7f9c9230b980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-09T09:47:34.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.411+0000 7f9c9230b980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.411+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c2bb010 con 0x55ed4c27dfe0 2024-05-09T09:47:34.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.411+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f9c88036040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.411+0000 7f9c9230b980 20 rados_obj.operate() r=0 bl.length=502 2024-05-09T09:47:34.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.411+0000 7f9c9230b980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-09T09:47:34.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.411+0000 7f9c9230b980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:34.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.411+0000 7f9c9230b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:34.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.411+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c2c11a0 con 0x55ed4c27dfe0 2024-05-09T09:47:34.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.415+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(95 foo [delete,create,call,call,writefull 0~391] v30'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f9c88036040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.415+0000 7f9c9230b980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:47:34.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.415+0000 7f9c9230b980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:34.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.415+0000 7f9c9230b980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-09T09:47:34.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.415+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 7.d 7:b4812045:::notify.4:head [notify cookie 94477673565328 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c2be040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.415+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== watch-notify(notify (1) cookie 94477673358400 notify 128849018884 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55ed4c29e3c0 con 0x55ed4c27dfe0 2024-05-09T09:47:34.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.415+0000 7f9b6dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94477673358400 notifier 4364 bl.length()=567 2024-05-09T09:47:34.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.415+0000 7f9b6dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:47:34.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.415+0000 7f9b6dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:34.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.415+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(96 notify.4 [notify cookie 94477673565328 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9c88036040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.415+0000 7f9b6dffb640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f9b540056c0 con 0x55ed4c27dfe0 2024-05-09T09:47:34.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.415+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== watch-notify(notify_complete (2) cookie 94477673565328 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ed4c29c950 con 0x55ed4c27dfe0 2024-05-09T09:47:34.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.415+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(97 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c88036040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.415+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:98 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c2c0c90 con 0x55ed4c2829d0 2024-05-09T09:47:34.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.419+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(98 p5YnriCv1nAtykxBrupQ [delete] v30'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9c80075070 con 0x55ed4c2829d0 2024-05-09T09:47:34.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.419+0000 7f9c9230b980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-09T09:47:34.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.419+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [notify cookie 94477673565328 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c2be040 con 0x55ed4c287320 2024-05-09T09:47:34.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.419+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== watch-notify(notify (1) cookie 94477673353696 notify 128849018881 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55ed4c29e100 con 0x55ed4c287320 2024-05-09T09:47:34.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.419+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(99 notify.2 [notify cookie 94477673565328 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9c840d7070 con 0x55ed4c287320 2024-05-09T09:47:34.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.419+0000 7f9b6d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94477673353696 notifier 4364 bl.length()=170 2024-05-09T09:47:34.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.419+0000 7f9b6d7fa640 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:100 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f9ac4003930 con 0x55ed4c287320 2024-05-09T09:47:34.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.419+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== osd_op_reply(100 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c840d7070 con 0x55ed4c287320 2024-05-09T09:47:34.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.419+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 30 ==== watch-notify(notify_complete (2) cookie 94477673565328 notify 128849018881 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ed4c29e5b0 con 0x55ed4c287320 2024-05-09T09:47:34.417 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-09T09:47:32.044078Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:47:32.044055Z","tags":[],"group_ids":[]} 2024-05-09T09:47:34.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.419+0000 7f9b44fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:34.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.419+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94477673366480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29ac60 con 0x55ed4c27dfe0 2024-05-09T09:47:34.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.419+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(101 data_loggenerations_metadata [watch unwatch cookie 94477673366480] v30'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9c88036040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.419+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94477673347776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c29ac60 con 0x7f9c840cc040 2024-05-09T09:47:34.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.423+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 94477673347776] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c88036040 con 0x7f9c840cc040 2024-05-09T09:47:34.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.423+0000 7f9c9230b980 20 remove_watcher() i=0 2024-05-09T09:47:34.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.423+0000 7f9c9230b980 2 removed watcher, disabling cache 2024-05-09T09:47:34.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.423+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94477673350992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c28bac0 con 0x55ed4c27dfe0 2024-05-09T09:47:34.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.423+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 94477673350992] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c88036040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.423+0000 7f9c9230b980 20 remove_watcher() i=1 2024-05-09T09:47:34.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.423+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94477673353696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c28c750 con 0x55ed4c287320 2024-05-09T09:47:34.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.427+0000 7f9c8f625640 1 -- 172.21.15.157:0/2493696143 <== osd.3 v2:172.21.15.157:6816/2487336710 31 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 94477673353696] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c840d7070 con 0x55ed4c287320 2024-05-09T09:47:34.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.427+0000 7f9c9230b980 20 remove_watcher() i=2 2024-05-09T09:47:34.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.427+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94477673345264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c28c750 con 0x7f9c840cc040 2024-05-09T09:47:34.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.427+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 94477673345264] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c88036040 con 0x7f9c840cc040 2024-05-09T09:47:34.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.427+0000 7f9c9230b980 20 remove_watcher() i=3 2024-05-09T09:47:34.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.427+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94477673358400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c28c750 con 0x55ed4c27dfe0 2024-05-09T09:47:34.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.431+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 94477673358400] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c88036040 con 0x55ed4c27dfe0 2024-05-09T09:47:34.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.431+0000 7f9c9230b980 20 remove_watcher() i=4 2024-05-09T09:47:34.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.431+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94477673361968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c28c750 con 0x55ed4c2829d0 2024-05-09T09:47:34.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.431+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 94477673361968] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c80075070 con 0x55ed4c2829d0 2024-05-09T09:47:34.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.431+0000 7f9c9230b980 20 remove_watcher() i=5 2024-05-09T09:47:34.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.431+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94477673365296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c28f230 con 0x55ed4c2829d0 2024-05-09T09:47:34.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.435+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 94477673365296] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c80075070 con 0x55ed4c2829d0 2024-05-09T09:47:34.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.435+0000 7f9c9230b980 20 remove_watcher() i=6 2024-05-09T09:47:34.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.435+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94477673369456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ed4c28c750 con 0x55ed4c2829d0 2024-05-09T09:47:34.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.435+0000 7f9c8fe26640 1 -- 172.21.15.157:0/2493696143 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 94477673369456] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c80075070 con 0x55ed4c2829d0 2024-05-09T09:47:34.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.435+0000 7f9c9230b980 20 remove_watcher() i=7 2024-05-09T09:47:34.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.435+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ed4c2829d0 msgr2=0x55ed4c284dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.435+0000 7f9c9230b980 1 --2- 172.21.15.157:0/2493696143 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ed4c2829d0 0x55ed4c284dc0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.435+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ed4c27dfe0 msgr2=0x55ed4c2804a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.435+0000 7f9c9230b980 1 --2- 172.21.15.157:0/2493696143 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ed4c27dfe0 0x55ed4c2804a0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.435+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f9c840cc040 msgr2=0x7f9c840d9410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.435+0000 7f9c9230b980 1 --2- 172.21.15.157:0/2493696143 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f9c840cc040 0x7f9c840d9410 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.435+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ed4c287320 msgr2=0x55ed4c289730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.435+0000 7f9c9230b980 1 --2- 172.21.15.157:0/2493696143 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ed4c287320 0x55ed4c289730 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.435+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b58034bb0 msgr2=0x7f9b58037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.435+0000 7f9c9230b980 1 --2- 172.21.15.157:0/2493696143 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b58034bb0 0x7f9b58037070 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9c840aabb0 tx=0x7f9c840b8040 comp rx=0 tx=0).stop 2024-05-09T09:47:34.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.435+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c26a160 msgr2=0x55ed4c271470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.435+0000 7f9c9230b980 1 --2- 172.21.15.157:0/2493696143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c26a160 0x55ed4c271470 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9c800487e0 tx=0x7f9c80058000 comp rx=0 tx=0).stop 2024-05-09T09:47:34.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.435+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 reap_dead start 2024-05-09T09:47:34.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.435+0000 7f9c90627640 1 -- 172.21.15.157:0/2493696143 reap_dead start 2024-05-09T09:47:34.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.439+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 shutdown_connections 2024-05-09T09:47:34.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.439+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 >> 172.21.15.157:0/2493696143 conn(0x55ed4c266490 msgr2=0x55ed4c263af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:34.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.439+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 shutdown_connections 2024-05-09T09:47:34.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.439+0000 7f9c9230b980 1 -- 172.21.15.157:0/2493696143 wait complete. 2024-05-09T09:47:34.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.439+0000 7f9c9230b980 1 -- 172.21.15.157:0/1703396043 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b68034c00 msgr2=0x7f9b680370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.439+0000 7f9c9230b980 1 --2- 172.21.15.157:0/1703396043 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b68034c00 0x7f9b680370c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55ed4c22ee60 tx=0x7f9c84005d90 comp rx=0 tx=0).stop 2024-05-09T09:47:34.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.439+0000 7f9c9230b980 1 -- 172.21.15.157:0/1703396043 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c25d140 msgr2=0x55ed4c25d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.439+0000 7f9c9230b980 1 --2- 172.21.15.157:0/1703396043 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c25d140 0x55ed4c25d560 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9c80017fd0 tx=0x7f9c8004a420 comp rx=0 tx=0).stop 2024-05-09T09:47:34.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.439+0000 7f9c9230b980 1 -- 172.21.15.157:0/1703396043 shutdown_connections 2024-05-09T09:47:34.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.439+0000 7f9c9230b980 1 --2- 172.21.15.157:0/1703396043 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b68034c00 0x7f9b680370c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.439+0000 7f9c9230b980 1 --2- 172.21.15.157:0/1703396043 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c25d140 0x55ed4c25d560 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.439+0000 7f9c9230b980 1 -- 172.21.15.157:0/1703396043 >> 172.21.15.157:0/1703396043 conn(0x55ed4c251f10 msgr2=0x55ed4c252a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.439+0000 7f9c9230b980 1 -- 172.21.15.157:0/1703396043 shutdown_connections 2024-05-09T09:47:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.439+0000 7f9c9230b980 1 -- 172.21.15.157:0/1703396043 wait complete. 2024-05-09T09:47:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.439+0000 7f9c9230b980 1 -- 172.21.15.157:0/3201063910 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ed4c2308b0 msgr2=0x55ed4c232ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.439+0000 7f9c9230b980 1 --2- 172.21.15.157:0/3201063910 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ed4c2308b0 0x55ed4c232ca0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.439+0000 7f9c9230b980 1 -- 172.21.15.157:0/3201063910 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ed4c139040 msgr2=0x55ed4c22df10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.439+0000 7f9c9230b980 1 --2- 172.21.15.157:0/3201063910 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ed4c139040 0x55ed4c22df10 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.439+0000 7f9c9230b980 1 -- 172.21.15.157:0/3201063910 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ed4c2347d0 msgr2=0x55ed4c236bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.439+0000 7f9c9230b980 1 --2- 172.21.15.157:0/3201063910 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ed4c2347d0 0x55ed4c236bc0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.439+0000 7f9c9230b980 1 -- 172.21.15.157:0/3201063910 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b78034c00 msgr2=0x7f9b780370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.439+0000 7f9c9230b980 1 --2- 172.21.15.157:0/3201063910 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b78034c00 0x7f9b780370c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9c840ac000 tx=0x7f9c840a5000 comp rx=0 tx=0).stop 2024-05-09T09:47:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.439+0000 7f9c9230b980 1 -- 172.21.15.157:0/3201063910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c134b40 msgr2=0x55ed4c226f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.439+0000 7f9c9230b980 1 --2- 172.21.15.157:0/3201063910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed4c134b40 0x55ed4c226f90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55ed4c220c00 tx=0x7f9c80000bd0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.439+0000 7f9c90627640 1 -- 172.21.15.157:0/3201063910 reap_dead start 2024-05-09T09:47:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.439+0000 7f9c9230b980 1 -- 172.21.15.157:0/3201063910 shutdown_connections 2024-05-09T09:47:34.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.439+0000 7f9c9230b980 1 -- 172.21.15.157:0/3201063910 >> 172.21.15.157:0/3201063910 conn(0x55ed4c0a8260 msgr2=0x55ed4c21a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:34.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.439+0000 7f9c9230b980 1 -- 172.21.15.157:0/3201063910 shutdown_connections 2024-05-09T09:47:34.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.439+0000 7f9c9230b980 1 -- 172.21.15.157:0/3201063910 wait complete. 2024-05-09T09:47:34.449 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-09T09:47:32.044078Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:47:32.044055Z', 'tags': [], 'group_ids': []} 2024-05-09T09:47:34.449 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-05-09T09:47:34.449 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-05-09T09:47:34.450 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-05-09T09:47:34.530 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:34.531 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:34.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.531+0000 7f3ca1307980 1 Processor -- start 2024-05-09T09:47:34.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.531+0000 7f3ca1307980 1 -- start start 2024-05-09T09:47:34.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.531+0000 7f3ca1307980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55b767357b40 0x55b767357f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.531+0000 7f3ca1307980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b76720b440 con 0x55b767358460 2024-05-09T09:47:34.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.531+0000 7f3ca1307980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55b7671f65f0 con 0x55b767357b40 2024-05-09T09:47:34.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.535+0000 7f3c9ee22640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55b767357b40 0x55b767357f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.535+0000 7f3c9e621640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x55b767358460 0x55b767358e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:33674/0 (socket says 172.21.15.157:33674) 2024-05-09T09:47:34.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.535+0000 7f3c9e621640 1 -- 172.21.15.157:0/3520478244 learned_addr learned my addr 172.21.15.157:0/3520478244 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:47:34.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.535+0000 7f3c9de20640 1 -- 172.21.15.157:0/3520478244 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1221067500 0 0) 0x55b76720b440 con 0x55b767358460 2024-05-09T09:47:34.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.535+0000 7f3c9ee22640 1 -- 172.21.15.157:0/3520478244 >> v1:172.21.15.110:6789/0 conn(0x55b767358460 legacy=0x55b767358e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.535+0000 7f3c9ee22640 1 -- 172.21.15.157:0/3520478244 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b767201990 con 0x55b767357b40 2024-05-09T09:47:34.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.535+0000 7f3c9ee22640 1 --2- 172.21.15.157:0/3520478244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b767357b40 0x55b767357f20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3c9000a480 tx=0x7f3c9001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=291021581fba58db server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.535+0000 7f3c9de20640 1 -- 172.21.15.157:0/3520478244 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c900b0070 con 0x55b767357b40 2024-05-09T09:47:34.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.535+0000 7f3c9de20640 1 -- 172.21.15.157:0/3520478244 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c900ab540 con 0x55b767357b40 2024-05-09T09:47:34.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.535+0000 7f3c9de20640 1 -- 172.21.15.157:0/3520478244 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c900ab840 con 0x55b767357b40 2024-05-09T09:47:34.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.539+0000 7f3ca1307980 1 -- 172.21.15.157:0/3520478244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b767357b40 msgr2=0x55b767357f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.539+0000 7f3ca1307980 1 --2- 172.21.15.157:0/3520478244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b767357b40 0x55b767357f20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3c9000a480 tx=0x7f3c9001b280 comp rx=0 tx=0).stop 2024-05-09T09:47:34.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.539+0000 7f3ca1307980 1 -- 172.21.15.157:0/3520478244 shutdown_connections 2024-05-09T09:47:34.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.539+0000 7f3ca1307980 1 --2- 172.21.15.157:0/3520478244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b767357b40 0x55b767357f20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.539+0000 7f3ca1307980 1 -- 172.21.15.157:0/3520478244 >> 172.21.15.157:0/3520478244 conn(0x55b7672cb260 msgr2=0x55b7672cb670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:34.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.539+0000 7f3ca1307980 1 -- 172.21.15.157:0/3520478244 shutdown_connections 2024-05-09T09:47:34.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.539+0000 7f3ca1307980 1 -- 172.21.15.157:0/3520478244 wait complete. 2024-05-09T09:47:34.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.551+0000 7f3ca1307980 1 Processor -- start 2024-05-09T09:47:34.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.555+0000 7f3ca1307980 1 -- start start 2024-05-09T09:47:34.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.555+0000 7f3ca1307980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b767357b40 0x55b767443260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.555+0000 7f3ca1307980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b767258fe0 con 0x55b767357b40 2024-05-09T09:47:34.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.555+0000 7f3c9ee22640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b767357b40 0x55b767443260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.555+0000 7f3c9ee22640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b767357b40 0x55b767443260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54400/0 (socket says 172.21.15.157:54400) 2024-05-09T09:47:34.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.555+0000 7f3c9ee22640 1 -- 172.21.15.157:0/69401859 learned_addr learned my addr 172.21.15.157:0/69401859 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:34.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.555+0000 7f3c9ee22640 1 -- 172.21.15.157:0/69401859 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7671ddae0 con 0x55b767357b40 2024-05-09T09:47:34.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.555+0000 7f3c9ee22640 1 --2- 172.21.15.157:0/69401859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b767357b40 0x55b767443260 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3c900ae040 tx=0x7f3c90003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65aa87c326c5b7e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.555+0000 7f3b8ce09640 1 -- 172.21.15.157:0/69401859 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c900b0040 con 0x55b767357b40 2024-05-09T09:47:34.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.555+0000 7f3b8ce09640 1 -- 172.21.15.157:0/69401859 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c9000a300 con 0x55b767357b40 2024-05-09T09:47:34.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.555+0000 7f3b8ce09640 1 -- 172.21.15.157:0/69401859 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c900ab820 con 0x55b767357b40 2024-05-09T09:47:34.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.555+0000 7f3ca1307980 1 -- 172.21.15.157:0/69401859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b767357b40 msgr2=0x55b767443260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.555+0000 7f3ca1307980 1 --2- 172.21.15.157:0/69401859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b767357b40 0x55b767443260 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3c900ae040 tx=0x7f3c90003030 comp rx=0 tx=0).stop 2024-05-09T09:47:34.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.555+0000 7f3ca1307980 1 -- 172.21.15.157:0/69401859 shutdown_connections 2024-05-09T09:47:34.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.555+0000 7f3ca1307980 1 --2- 172.21.15.157:0/69401859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b767357b40 0x55b767443260 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.555+0000 7f3ca1307980 1 -- 172.21.15.157:0/69401859 >> 172.21.15.157:0/69401859 conn(0x55b7672cb260 msgr2=0x55b76743edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:34.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.555+0000 7f3ca1307980 1 -- 172.21.15.157:0/69401859 shutdown_connections 2024-05-09T09:47:34.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.555+0000 7f3ca1307980 1 -- 172.21.15.157:0/69401859 wait complete. 2024-05-09T09:47:34.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.555+0000 7f3ca1307980 1 Processor -- start 2024-05-09T09:47:34.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.555+0000 7f3ca1307980 1 -- start start 2024-05-09T09:47:34.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.555+0000 7f3ca1307980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b767357b40 0x55b76744a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.555+0000 7f3ca1307980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b767361b80 con 0x55b767357b40 2024-05-09T09:47:34.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.555+0000 7f3c9ee22640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b767357b40 0x55b76744a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.555+0000 7f3c9ee22640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b767357b40 0x55b76744a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54404/0 (socket says 172.21.15.157:54404) 2024-05-09T09:47:34.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.555+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2593645027 learned_addr learned my addr 172.21.15.157:0/2593645027 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:34.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.559+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2593645027 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b76744a820 con 0x55b767357b40 2024-05-09T09:47:34.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.559+0000 7f3c9ee22640 1 --2- 172.21.15.157:0/2593645027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b767357b40 0x55b76744a2e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3c90019930 tx=0x7f3c90018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.559+0000 7f3b8b606640 1 -- 172.21.15.157:0/2593645027 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c900b0040 con 0x55b767357b40 2024-05-09T09:47:34.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.559+0000 7f3ca1307980 1 -- 172.21.15.157:0/2593645027 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b76744aab0 con 0x55b767357b40 2024-05-09T09:47:34.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.559+0000 7f3b8b606640 1 -- 172.21.15.157:0/2593645027 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c900c0870 con 0x55b767357b40 2024-05-09T09:47:34.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.559+0000 7f3b8b606640 1 -- 172.21.15.157:0/2593645027 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c900c0b50 con 0x55b767357b40 2024-05-09T09:47:34.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.559+0000 7f3ca1307980 1 -- 172.21.15.157:0/2593645027 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b76744d740 con 0x55b767357b40 2024-05-09T09:47:34.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.559+0000 7f3b8b606640 1 -- 172.21.15.157:0/2593645027 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f3c90009420 con 0x55b767357b40 2024-05-09T09:47:34.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.559+0000 7f3b8b606640 1 --2- 172.21.15.157:0/2593645027 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3b84034bb0 0x7f3b84037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.559+0000 7f3b8b606640 1 -- 172.21.15.157:0/2593645027 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f3c900bb070 con 0x55b767357b40 2024-05-09T09:47:34.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.559+0000 7f3c9e621640 1 --2- 172.21.15.157:0/2593645027 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3b84034bb0 0x7f3b84037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.559+0000 7f3ca1307980 1 --2- 172.21.15.157:0/2593645027 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b767358460 0x55b767451220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.559+0000 7f3ca1307980 1 -- 172.21.15.157:0/2593645027 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b767451840 con 0x55b767358460 2024-05-09T09:47:34.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.559+0000 7f3c9f623640 1 --2- 172.21.15.157:0/2593645027 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b767358460 0x55b767451220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.559+0000 7f3c9e621640 1 --2- 172.21.15.157:0/2593645027 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3b84034bb0 0x7f3b84037070 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3c94000c10 tx=0x7f3c940013c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.559+0000 7f3c9f623640 1 --2- 172.21.15.157:0/2593645027 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b767358460 0x55b767451220 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.563+0000 7f3c9f623640 1 -- 172.21.15.157:0/2593645027 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b767358460 2024-05-09T09:47:34.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.563+0000 7f3ca1307980 1 -- 172.21.15.157:0/2593645027 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b76744e940 con 0x55b767358460 2024-05-09T09:47:34.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.563+0000 7f3c9f623640 1 -- 172.21.15.157:0/2593645027 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b767358460 2024-05-09T09:47:34.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.563+0000 7f3ca1307980 1 --2- 172.21.15.157:0/2593645027 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b767453b50 0x55b767455f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.563+0000 7f3ca1307980 1 -- 172.21.15.157:0/2593645027 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b767456610 con 0x55b767453b50 2024-05-09T09:47:34.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.563+0000 7f3c9ee22640 1 --2- 172.21.15.157:0/2593645027 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b767453b50 0x55b767455f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.563+0000 7f3c9ee22640 1 --2- 172.21.15.157:0/2593645027 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b767453b50 0x55b767455f40 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.563+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2593645027 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3c900b3040 con 0x55b767453b50 2024-05-09T09:47:34.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.563+0000 7f3ca1307980 1 -- 172.21.15.157:0/2593645027 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7674529f0 con 0x55b767358460 2024-05-09T09:47:34.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.563+0000 7f3c9f623640 1 -- 172.21.15.157:0/2593645027 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b767358460 2024-05-09T09:47:34.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.563+0000 7f3ca1307980 1 --2- 172.21.15.157:0/2593645027 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b767457a50 0x55b767459e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.563+0000 7f3ca1307980 1 -- 172.21.15.157:0/2593645027 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b76745a5d0 con 0x55b767457a50 2024-05-09T09:47:34.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.563+0000 7f3c9e621640 1 --2- 172.21.15.157:0/2593645027 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b767457a50 0x55b767459e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.563+0000 7f3c9e621640 1 --2- 172.21.15.157:0/2593645027 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b767457a50 0x55b767459e40 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.563+0000 7f3c9e621640 1 -- 172.21.15.157:0/2593645027 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3c9400f680 con 0x55b767457a50 2024-05-09T09:47:34.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.567+0000 7f3ca1307980 1 Processor -- start 2024-05-09T09:47:34.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.567+0000 7f3ca1307980 1 -- start start 2024-05-09T09:47:34.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.567+0000 7f3ca1307980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b767480610 0x55b767480a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.567+0000 7f3ca1307980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b76725d020 con 0x55b767480610 2024-05-09T09:47:34.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.567+0000 7f3c9ee22640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b767480610 0x55b767480a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.567+0000 7f3c9ee22640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b767480610 0x55b767480a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54416/0 (socket says 172.21.15.157:54416) 2024-05-09T09:47:34.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.567+0000 7f3c9ee22640 1 -- 172.21.15.157:0/3714776124 learned_addr learned my addr 172.21.15.157:0/3714776124 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:34.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.571+0000 7f3c9ee22640 1 -- 172.21.15.157:0/3714776124 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b767480f70 con 0x55b767480610 2024-05-09T09:47:34.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.571+0000 7f3c9ee22640 1 --2- 172.21.15.157:0/3714776124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b767480610 0x55b767480a30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3c900e3a50 tx=0x7f3c900aa720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.571+0000 7f3b837fe640 1 -- 172.21.15.157:0/3714776124 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c900e5070 con 0x55b767480610 2024-05-09T09:47:34.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.571+0000 7f3ca1307980 1 -- 172.21.15.157:0/3714776124 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b767481a00 con 0x55b767480610 2024-05-09T09:47:34.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.571+0000 7f3b837fe640 1 -- 172.21.15.157:0/3714776124 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c900e5210 con 0x55b767480610 2024-05-09T09:47:34.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.571+0000 7f3b837fe640 1 -- 172.21.15.157:0/3714776124 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c900ad070 con 0x55b767480610 2024-05-09T09:47:34.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.571+0000 7f3ca1307980 1 -- 172.21.15.157:0/3714776124 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b767481a00 con 0x55b767480610 2024-05-09T09:47:34.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.571+0000 7f3b837fe640 1 -- 172.21.15.157:0/3714776124 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f3c900ad210 con 0x55b767480610 2024-05-09T09:47:34.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.571+0000 7f3b837fe640 1 --2- 172.21.15.157:0/3714776124 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3b78034c00 0x7f3b780370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.571+0000 7f3b837fe640 1 -- 172.21.15.157:0/3714776124 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f3c900a8070 con 0x55b767480610 2024-05-09T09:47:34.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.571+0000 7f3c9e621640 1 --2- 172.21.15.157:0/3714776124 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3b78034c00 0x7f3b780370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.571+0000 7f3ca1307980 1 Processor -- start 2024-05-09T09:47:34.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.571+0000 7f3ca1307980 1 -- start start 2024-05-09T09:47:34.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.571+0000 7f3ca1307980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b76748d420 0x55b76748d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.571+0000 7f3ca1307980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b7674438f0 con 0x55b76748d420 2024-05-09T09:47:34.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.571+0000 7f3c9e621640 1 --2- 172.21.15.157:0/3714776124 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3b78034c00 0x7f3b780370c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x55b76745a9d0 tx=0x7f3c94006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.571+0000 7f3c9ee22640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b76748d420 0x55b76748d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.571+0000 7f3c9ee22640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b76748d420 0x55b76748d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54424/0 (socket says 172.21.15.157:54424) 2024-05-09T09:47:34.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.571+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2410832354 learned_addr learned my addr 172.21.15.157:0/2410832354 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:34.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.571+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2410832354 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b76748ddf0 con 0x55b76748d420 2024-05-09T09:47:34.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.575+0000 7f3c9ee22640 1 --2- 172.21.15.157:0/2410832354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b76748d420 0x55b76748d820 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3c900aaa20 tx=0x7f3c900d2a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3879ba0e9d6632a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.575+0000 7f3b817fa640 1 -- 172.21.15.157:0/2410832354 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c900f2070 con 0x55b76748d420 2024-05-09T09:47:34.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.575+0000 7f3b817fa640 1 -- 172.21.15.157:0/2410832354 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c900c7d90 con 0x55b76748d420 2024-05-09T09:47:34.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.575+0000 7f3b817fa640 1 -- 172.21.15.157:0/2410832354 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c900aac70 con 0x55b76748d420 2024-05-09T09:47:34.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.575+0000 7f3ca1307980 1 -- 172.21.15.157:0/2410832354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b76748d420 msgr2=0x55b76748d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.575+0000 7f3ca1307980 1 --2- 172.21.15.157:0/2410832354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b76748d420 0x55b76748d820 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3c900aaa20 tx=0x7f3c900d2a00 comp rx=0 tx=0).stop 2024-05-09T09:47:34.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.575+0000 7f3ca1307980 1 -- 172.21.15.157:0/2410832354 shutdown_connections 2024-05-09T09:47:34.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.575+0000 7f3ca1307980 1 --2- 172.21.15.157:0/2410832354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b76748d420 0x55b76748d820 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.575+0000 7f3ca1307980 1 -- 172.21.15.157:0/2410832354 >> 172.21.15.157:0/2410832354 conn(0x55b7674897a0 msgr2=0x55b767487800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:34.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.575+0000 7f3ca1307980 1 -- 172.21.15.157:0/2410832354 shutdown_connections 2024-05-09T09:47:34.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.575+0000 7f3ca1307980 1 -- 172.21.15.157:0/2410832354 wait complete. 2024-05-09T09:47:34.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.575+0000 7f3ca1307980 1 Processor -- start 2024-05-09T09:47:34.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.575+0000 7f3ca1307980 1 -- start start 2024-05-09T09:47:34.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.575+0000 7f3ca1307980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b76748d420 0x55b767494700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.575+0000 7f3ca1307980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b76748e4e0 con 0x55b76748d420 2024-05-09T09:47:34.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.575+0000 7f3c9ee22640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b76748d420 0x55b767494700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.575+0000 7f3c9ee22640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b76748d420 0x55b767494700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54436/0 (socket says 172.21.15.157:54436) 2024-05-09T09:47:34.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.575+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 learned_addr learned my addr 172.21.15.157:0/2771804097 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:34.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.575+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b767494c40 con 0x55b76748d420 2024-05-09T09:47:34.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.575+0000 7f3c9ee22640 1 --2- 172.21.15.157:0/2771804097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b76748d420 0x55b767494700 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3c900e5590 tx=0x7f3c900dfed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.575+0000 7f3b6f7fe640 1 -- 172.21.15.157:0/2771804097 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c900d2410 con 0x55b76748d420 2024-05-09T09:47:34.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.575+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b767494c40 con 0x55b76748d420 2024-05-09T09:47:34.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.575+0000 7f3b6f7fe640 1 -- 172.21.15.157:0/2771804097 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c900c52b0 con 0x55b76748d420 2024-05-09T09:47:34.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.575+0000 7f3b6f7fe640 1 -- 172.21.15.157:0/2771804097 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c900c5590 con 0x55b76748d420 2024-05-09T09:47:34.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.575+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7674950c0 con 0x55b76748d420 2024-05-09T09:47:34.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3b6f7fe640 1 -- 172.21.15.157:0/2771804097 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f3c900b68d0 con 0x55b76748d420 2024-05-09T09:47:34.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3b6f7fe640 1 --2- 172.21.15.157:0/2771804097 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3b68034bb0 0x7f3b68037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3ca1307980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3b6f7fe640 1 -- 172.21.15.157:0/2771804097 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f3c90103030 con 0x55b76748d420 2024-05-09T09:47:34.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3c9e621640 1 --2- 172.21.15.157:0/2771804097 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3b68034bb0 0x7f3b68037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3ca1307980 1 --2- 172.21.15.157:0/2771804097 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b7674a1280 0x55b7674a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a3e90 con 0x55b7674a1280 2024-05-09T09:47:34.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3c9f623640 1 --2- 172.21.15.157:0/2771804097 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b7674a1280 0x55b7674a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3c9e621640 1 --2- 172.21.15.157:0/2771804097 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3b68034bb0 0x7f3b68037070 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3c9400ba80 tx=0x7f3c94023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3c9f623640 1 --2- 172.21.15.157:0/2771804097 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b7674a1280 0x55b7674a3740 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3ca1307980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:34.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3ca1307980 20 realm 2024-05-09T09:47:34.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3ca1307980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4260 con 0x55b7674a1280 2024-05-09T09:47:34.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3ca1307980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:34.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3ca1307980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:34.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3ca1307980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4b30 con 0x55b7674a1280 2024-05-09T09:47:34.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3ca1307980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:34.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3ca1307980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x55b7674a1280 2024-05-09T09:47:34.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3ca1307980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:34.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3ca1307980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3ca1307980 1 --2- 172.21.15.157:0/2771804097 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b7674a5c30 0x55b7674a8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a86c0 con 0x55b7674a5c30 2024-05-09T09:47:34.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.579+0000 7f3c9ee22640 1 --2- 172.21.15.157:0/2771804097 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b7674a5c30 0x55b7674a8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.583+0000 7f3c9ee22640 1 --2- 172.21.15.157:0/2771804097 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b7674a5c30 0x55b7674a8020 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.583+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3c900b3040 con 0x55b7674a5c30 2024-05-09T09:47:34.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.583+0000 7f3ca1307980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:34.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.583+0000 7f3ca1307980 20 searching for the correct realm 2024-05-09T09:47:34.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.583+0000 7f3ca1307980 1 --2- 172.21.15.157:0/2771804097 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b7674aa5a0 0x55b7674ac9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.583+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674ad030 con 0x55b7674aa5a0 2024-05-09T09:47:34.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.583+0000 7f3c9e621640 1 --2- 172.21.15.157:0/2771804097 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b7674aa5a0 0x55b7674ac9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.583+0000 7f3c9e621640 1 --2- 172.21.15.157:0/2771804097 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b7674aa5a0 0x55b7674ac9b0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.583+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c94037040 con 0x55b7674aa5a0 2024-05-09T09:47:34.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.583+0000 7f3c9e621640 1 --2- 172.21.15.157:0/2771804097 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f3c9401f940 0x7f3c9403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.583+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674ad030 con 0x7f3c9401f940 2024-05-09T09:47:34.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.583+0000 7f3c9f623640 1 --2- 172.21.15.157:0/2771804097 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f3c9401f940 0x7f3c9403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.583+0000 7f3c9f623640 1 --2- 172.21.15.157:0/2771804097 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f3c9401f940 0x7f3c9403a3c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.583+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c9800a4d0 con 0x7f3c9401f940 2024-05-09T09:47:34.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.583+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x55b7674a5c30 2024-05-09T09:47:34.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.587+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c900b3040 con 0x55b7674a5c30 2024-05-09T09:47:34.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.587+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x55b7674a1280 2024-05-09T09:47:34.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.587+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.587+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x55b7674a1280 2024-05-09T09:47:34.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.587+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.587+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x55b7674a5c30 2024-05-09T09:47:34.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.587+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c900b3040 con 0x55b7674a5c30 2024-05-09T09:47:34.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.587+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x55b7674a5c30 2024-05-09T09:47:34.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.587+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c900b3040 con 0x55b7674a5c30 2024-05-09T09:47:34.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.587+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x7f3c9401f940 2024-05-09T09:47:34.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.587+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c9800a4d0 con 0x7f3c9401f940 2024-05-09T09:47:34.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.587+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x55b7674aa5a0 2024-05-09T09:47:34.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.587+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c94037040 con 0x55b7674aa5a0 2024-05-09T09:47:34.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.587+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x55b7674a1280 2024-05-09T09:47:34.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.587+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.587+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x55b7674a5c30 2024-05-09T09:47:34.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.587+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c900b3040 con 0x55b7674a5c30 2024-05-09T09:47:34.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.587+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x55b7674a1280 2024-05-09T09:47:34.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.587+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.587+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x7f3c9401f940 2024-05-09T09:47:34.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.587+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3c9800a4d0 con 0x7f3c9401f940 2024-05-09T09:47:34.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.587+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x55b7674aa5a0 2024-05-09T09:47:34.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.591+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c94037040 con 0x55b7674aa5a0 2024-05-09T09:47:34.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.591+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x55b7674aa5a0 2024-05-09T09:47:34.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.591+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3c94037040 con 0x55b7674aa5a0 2024-05-09T09:47:34.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.591+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x55b7674a5c30 2024-05-09T09:47:34.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.591+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c900b3040 con 0x55b7674a5c30 2024-05-09T09:47:34.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.591+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x55b7674aa5a0 2024-05-09T09:47:34.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.591+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c94037040 con 0x55b7674aa5a0 2024-05-09T09:47:34.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.591+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x55b7674aa5a0 2024-05-09T09:47:34.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.591+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c94037040 con 0x55b7674aa5a0 2024-05-09T09:47:34.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.591+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x55b7674a1280 2024-05-09T09:47:34.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.591+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.591+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x55b7674a1280 2024-05-09T09:47:34.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.591+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.591+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x55b7674a5c30 2024-05-09T09:47:34.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.591+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c900b3040 con 0x55b7674a5c30 2024-05-09T09:47:34.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.591+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x55b7674aa5a0 2024-05-09T09:47:34.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.591+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c94037040 con 0x55b7674aa5a0 2024-05-09T09:47:34.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.591+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x7f3c9401f940 2024-05-09T09:47:34.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.591+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c9800a4d0 con 0x7f3c9401f940 2024-05-09T09:47:34.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.591+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x55b7674a1280 2024-05-09T09:47:34.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.591+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.591+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x55b7674a5c30 2024-05-09T09:47:34.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3c900b3040 con 0x55b7674a5c30 2024-05-09T09:47:34.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x55b7674aa5a0 2024-05-09T09:47:34.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c94037040 con 0x55b7674aa5a0 2024-05-09T09:47:34.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x55b7674a5c30 2024-05-09T09:47:34.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c900b3040 con 0x55b7674a5c30 2024-05-09T09:47:34.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x7f3c9401f940 2024-05-09T09:47:34.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c9800a4d0 con 0x7f3c9401f940 2024-05-09T09:47:34.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x55b7674aa5a0 2024-05-09T09:47:34.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c9404a040 con 0x55b7674aa5a0 2024-05-09T09:47:34.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x55b7674a5c30 2024-05-09T09:47:34.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c900b3040 con 0x55b7674a5c30 2024-05-09T09:47:34.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x55b7674a1280 2024-05-09T09:47:34.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a4ed0 con 0x7f3c9401f940 2024-05-09T09:47:34.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c9800a4d0 con 0x7f3c9401f940 2024-05-09T09:47:34.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3ca1307980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:34.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3ca1307980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:34.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3ca1307980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:34.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3ca1307980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:34.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3ca1307980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:34.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3ca1307980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:34.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3ca1307980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a8f10 con 0x55b7674a1280 2024-05-09T09:47:34.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3ca1307980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:34.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3ca1307980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a8f10 con 0x55b7674a1280 2024-05-09T09:47:34.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3ca1307980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:34.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3ca1307980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.595+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a8f10 con 0x55b7674aa5a0 2024-05-09T09:47:34.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.599+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3c9404a040 con 0x55b7674aa5a0 2024-05-09T09:47:34.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.599+0000 7f3ca1307980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:34.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.599+0000 7f3ca1307980 20 zone default found 2024-05-09T09:47:34.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.599+0000 7f3ca1307980 4 Realm: () 2024-05-09T09:47:34.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.599+0000 7f3ca1307980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:34.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.599+0000 7f3ca1307980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:34.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.599+0000 7f3ca1307980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:34.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.599+0000 7f3ca1307980 20 zonegroup default 2024-05-09T09:47:34.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.599+0000 7f3ca1307980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.599+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7674a98a0 con 0x55b7674a5c30 2024-05-09T09:47:34.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.599+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3c900b3040 con 0x55b7674a5c30 2024-05-09T09:47:34.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.599+0000 7f3ca1307980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:34.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.599+0000 7f3ca1307980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.599+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7674aef20 con 0x55b7674aa5a0 2024-05-09T09:47:34.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.599+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3c9404a040 con 0x55b7674aa5a0 2024-05-09T09:47:34.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.599+0000 7f3ca1307980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:34.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.599+0000 7f3ca1307980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.599+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7674af410 con 0x55b7674aa5a0 2024-05-09T09:47:34.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.599+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3c9404a040 con 0x55b7674aa5a0 2024-05-09T09:47:34.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.599+0000 7f3ca1307980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:34.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.599+0000 7f3ca1307980 20 started sync module instance, tier type = 2024-05-09T09:47:34.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.599+0000 7f3ca1307980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:34.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.599+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674ae330 con 0x7f3c9401f940 2024-05-09T09:47:34.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.599+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x7f3c9401f940 2024-05-09T09:47:34.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.599+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94246200338512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674ae330 con 0x7f3c9401f940 2024-05-09T09:47:34.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.599+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674afe90 con 0x55b7674a1280 2024-05-09T09:47:34.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.599+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94246200338512] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x7f3c9401f940 2024-05-09T09:47:34.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.603+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.603+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94246200343280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674ae330 con 0x55b7674a1280 2024-05-09T09:47:34.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.603+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674b08a0 con 0x55b7674aa5a0 2024-05-09T09:47:34.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.603+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c9404a040 con 0x55b7674aa5a0 2024-05-09T09:47:34.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.603+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94246200345584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674b10f0 con 0x55b7674aa5a0 2024-05-09T09:47:34.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.603+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674b1af0 con 0x7f3c9401f940 2024-05-09T09:47:34.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.603+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94246200343280] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.607+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x7f3c9401f940 2024-05-09T09:47:34.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.607+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94246200336000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674b1ee0 con 0x7f3c9401f940 2024-05-09T09:47:34.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.607+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674b28a0 con 0x55b7674a1280 2024-05-09T09:47:34.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.607+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94246200345584] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c9404a040 con 0x55b7674aa5a0 2024-05-09T09:47:34.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.607+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94246200336000] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x7f3c9401f940 2024-05-09T09:47:34.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.607+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.607+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94246200350208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674b23f0 con 0x55b7674a1280 2024-05-09T09:47:34.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.607+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674b2c40 con 0x55b7674a5c30 2024-05-09T09:47:34.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.607+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94246200350208] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.611+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c900b3040 con 0x55b7674a5c30 2024-05-09T09:47:34.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.611+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94246200353776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674b2810 con 0x55b7674a5c30 2024-05-09T09:47:34.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.611+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674b3940 con 0x55b7674a5c30 2024-05-09T09:47:34.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.611+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c900b3040 con 0x55b7674a5c30 2024-05-09T09:47:34.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.611+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94246200360160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674b45b0 con 0x55b7674a5c30 2024-05-09T09:47:34.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.611+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674b5020 con 0x55b7674a5c30 2024-05-09T09:47:34.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.611+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94246200353776] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c900b3040 con 0x55b7674a5c30 2024-05-09T09:47:34.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.615+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c900b3040 con 0x55b7674a5c30 2024-05-09T09:47:34.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.615+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94246200363760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674b4fe0 con 0x55b7674a5c30 2024-05-09T09:47:34.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.615+0000 7f3ca1307980 20 add_watcher() i=0 2024-05-09T09:47:34.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.615+0000 7f3ca1307980 20 add_watcher() i=1 2024-05-09T09:47:34.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.615+0000 7f3ca1307980 20 add_watcher() i=2 2024-05-09T09:47:34.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.615+0000 7f3ca1307980 20 add_watcher() i=3 2024-05-09T09:47:34.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.615+0000 7f3ca1307980 20 add_watcher() i=4 2024-05-09T09:47:34.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.615+0000 7f3ca1307980 20 add_watcher() i=5 2024-05-09T09:47:34.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.615+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94246200360160] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c900b3040 con 0x55b7674a5c30 2024-05-09T09:47:34.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.615+0000 7f3ca1307980 20 add_watcher() i=6 2024-05-09T09:47:34.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.615+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94246200363760] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c900b3040 con 0x55b7674a5c30 2024-05-09T09:47:34.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.615+0000 7f3ca1307980 20 add_watcher() i=7 2024-05-09T09:47:34.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.615+0000 7f3ca1307980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:34.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.615+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7674b4100 con 0x55b7674a1280 2024-05-09T09:47:34.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.615+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.615+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94246200361216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674b54e0 con 0x55b7674a1280 2024-05-09T09:47:34.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.615+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94246200361216] v30'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.615+0000 7f3b4f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:34.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.615+0000 7f3ca1307980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:34.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.615+0000 7f3ca1307980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:34.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.615+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674c0920 con 0x55b7674a1280 2024-05-09T09:47:34.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.619+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'33 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.619+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674c0f70 con 0x55b7674a5c30 2024-05-09T09:47:34.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.619+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c900b3040 con 0x55b7674a5c30 2024-05-09T09:47:34.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.619+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674c0f70 con 0x55b7674aa5a0 2024-05-09T09:47:34.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.623+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c9404a040 con 0x55b7674aa5a0 2024-05-09T09:47:34.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.623+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674c1a50 con 0x55b7674a1280 2024-05-09T09:47:34.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.623+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'110 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.623+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674be6b0 con 0x7f3c9401f940 2024-05-09T09:47:34.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.623+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'71 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x7f3c9401f940 2024-05-09T09:47:34.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.623+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674be6b0 con 0x55b7674aa5a0 2024-05-09T09:47:34.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.627+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'47 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c9404a040 con 0x55b7674aa5a0 2024-05-09T09:47:34.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.627+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674c2780 con 0x55b7674a1280 2024-05-09T09:47:34.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.627+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'29 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.627+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674c2810 con 0x55b7674a5c30 2024-05-09T09:47:34.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.631+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'47 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c900b3040 con 0x55b7674a5c30 2024-05-09T09:47:34.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.631+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674c28a0 con 0x7f3c9401f940 2024-05-09T09:47:34.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.631+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'27 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x7f3c9401f940 2024-05-09T09:47:34.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.631+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674c2980 con 0x55b7674aa5a0 2024-05-09T09:47:34.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.635+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'33 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c9404a040 con 0x55b7674aa5a0 2024-05-09T09:47:34.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.635+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674c2e30 con 0x7f3c9401f940 2024-05-09T09:47:34.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.635+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'72 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x7f3c9401f940 2024-05-09T09:47:34.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.635+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674c2e30 con 0x55b7674a5c30 2024-05-09T09:47:34.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.635+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'29 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c900b3040 con 0x55b7674a5c30 2024-05-09T09:47:34.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.635+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674c3000 con 0x7f3c9401f940 2024-05-09T09:47:34.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.639+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'27 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x7f3c9401f940 2024-05-09T09:47:34.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.639+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674c3000 con 0x55b7674a5c30 2024-05-09T09:47:34.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.639+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'53 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c900b3040 con 0x55b7674a5c30 2024-05-09T09:47:34.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.639+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674c3000 con 0x55b7674a1280 2024-05-09T09:47:34.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.643+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'111 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.643+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674c3460 con 0x55b7674aa5a0 2024-05-09T09:47:34.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.643+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'65 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c9404a040 con 0x55b7674aa5a0 2024-05-09T09:47:34.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.643+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674c3460 con 0x7f3c9401f940 2024-05-09T09:47:34.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.647+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'73 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x7f3c9401f940 2024-05-09T09:47:34.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.647+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674c3460 con 0x55b7674aa5a0 2024-05-09T09:47:34.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.647+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c9404a040 con 0x55b7674aa5a0 2024-05-09T09:47:34.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.647+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674c3460 con 0x55b7674a1280 2024-05-09T09:47:34.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.647+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'35 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.647+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674c3460 con 0x55b7674a1280 2024-05-09T09:47:34.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.651+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'112 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.651+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674c3460 con 0x55b7674aa5a0 2024-05-09T09:47:34.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.651+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'66 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c9404a040 con 0x55b7674aa5a0 2024-05-09T09:47:34.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.651+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674c3460 con 0x7f3c9401f940 2024-05-09T09:47:34.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.651+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'37 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x7f3c9401f940 2024-05-09T09:47:34.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.651+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674c3460 con 0x55b7674aa5a0 2024-05-09T09:47:34.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.655+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'29 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c9404a040 con 0x55b7674aa5a0 2024-05-09T09:47:34.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.655+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674be3d0 con 0x55b7674aa5a0 2024-05-09T09:47:34.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.655+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'33 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c9404a040 con 0x55b7674aa5a0 2024-05-09T09:47:34.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.655+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674be200 con 0x55b7674aa5a0 2024-05-09T09:47:34.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.655+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c9404a040 con 0x55b7674aa5a0 2024-05-09T09:47:34.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.655+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674be200 con 0x55b7674aa5a0 2024-05-09T09:47:34.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.659+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'48 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c9404a040 con 0x55b7674aa5a0 2024-05-09T09:47:34.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.659+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674be200 con 0x55b7674a5c30 2024-05-09T09:47:34.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.659+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'29 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c900b3040 con 0x55b7674a5c30 2024-05-09T09:47:34.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.659+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674be200 con 0x55b7674aa5a0 2024-05-09T09:47:34.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.663+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c9404a040 con 0x55b7674aa5a0 2024-05-09T09:47:34.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.663+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674be200 con 0x55b7674a5c30 2024-05-09T09:47:34.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.663+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'48 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c900b3040 con 0x55b7674a5c30 2024-05-09T09:47:34.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.663+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674be200 con 0x55b7674aa5a0 2024-05-09T09:47:34.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.667+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'67 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c9404a040 con 0x55b7674aa5a0 2024-05-09T09:47:34.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.667+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674be200 con 0x55b7674a5c30 2024-05-09T09:47:34.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.667+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'54 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c900b3040 con 0x55b7674a5c30 2024-05-09T09:47:34.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.667+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674be200 con 0x7f3c9401f940 2024-05-09T09:47:34.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.671+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'33 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x7f3c9401f940 2024-05-09T09:47:34.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.671+0000 7f3b4e7fc640 20 reqs_thread_entry: start 2024-05-09T09:47:34.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.671+0000 7f3ca1307980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:34.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.671+0000 7f3abffff640 20 reqs_thread_entry: start 2024-05-09T09:47:34.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.671+0000 7f3ca1307980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-09T09:47:34.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.671+0000 7f3ca1307980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.671+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7674dede0 con 0x55b7674a1280 2024-05-09T09:47:34.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.671+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.671+0000 7f3ca1307980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:47:34.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.671+0000 7f3ca1307980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-09T09:47:34.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.671+0000 7f3ca1307980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:34.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.671+0000 7f3ca1307980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:34.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.671+0000 7f3ca1307980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-05-09T09:47:34.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.671+0000 7f3ca1307980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.671+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7674df1c0 con 0x55b7674a1280 2024-05-09T09:47:34.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.671+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(95 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.671+0000 7f3ca1307980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:34.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.671+0000 7f3ca1307980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-05-09T09:47:34.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.671+0000 7f3ca1307980 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-05-09T09:47:34.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.671+0000 7f3ca1307980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-05-09T09:47:34.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.671+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674e4ee0 con 0x55b7674a1280 2024-05-09T09:47:34.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.675+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(96 foo [delete,create,call,call,writefull 0~556] v30'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.675+0000 7f3ca1307980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:47:34.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.675+0000 7f3ca1307980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:34.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.675+0000 7f3ca1307980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-09T09:47:34.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.675+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.d 7:b4812045:::notify.4:head [notify cookie 94246200560048 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7674e1ab0 con 0x55b7674a1280 2024-05-09T09:47:34.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.675+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== watch-notify(notify (1) cookie 94246200350208 notify 128849018885 ret 0) ==== 774+0+0 (crc 0 0 0) 0x55b7674c3460 con 0x55b7674a1280 2024-05-09T09:47:34.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.675+0000 7f3b817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94246200350208 notifier 4371 bl.length()=732 2024-05-09T09:47:34.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.675+0000 7f3b817fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:47:34.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.675+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(97 notify.4 [notify cookie 94246200560048 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.675+0000 7f3b817fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:34.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.675+0000 7f3b817fa640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3b600056c0 con 0x55b7674a1280 2024-05-09T09:47:34.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.675+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(98 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.675+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== watch-notify(notify_complete (2) cookie 94246200560048 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3c98040040 con 0x55b7674a1280 2024-05-09T09:47:34.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.675+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:99 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674e49b0 con 0x55b7674a1280 2024-05-09T09:47:34.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.675+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(99 foo:foo1 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.675+0000 7f3ca1307980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-05-09T09:47:34.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.675+0000 7f3ca1307980 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-05-09T09:47:34.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.675+0000 7f3ca1307980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-05-09T09:47:34.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.675+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:100 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94246200560048 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7674df590 con 0x7f3c9401f940 2024-05-09T09:47:34.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.675+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== watch-notify(notify (1) cookie 94246200338512 notify 128849018882 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f3c98040040 con 0x7f3c9401f940 2024-05-09T09:47:34.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.675+0000 7f3b817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94246200338512 notifier 4371 bl.length()=166 2024-05-09T09:47:34.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.675+0000 7f3b817fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-05-09T09:47:34.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.675+0000 7f3b817fa640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-05-09T09:47:34.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.675+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(100 notify.0 [notify cookie 94246200560048 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3c9800a4d0 con 0x7f3c9401f940 2024-05-09T09:47:34.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.675+0000 7f3b817fa640 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3b600056c0 con 0x7f3c9401f940 2024-05-09T09:47:34.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.675+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(101 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x7f3c9401f940 2024-05-09T09:47:34.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.679+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== watch-notify(notify_complete (2) cookie 94246200560048 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b7674bea50 con 0x7f3c9401f940 2024-05-09T09:47:34.680 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-09T09:47:32.044078Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"tUwlkgM9mAb22E1i6ZNggfk2d8onB3JclDmcvUzX","active":true,"create_date":"2024-05-09T09:47:34.675585Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:47:32.044055Z","tags":[],"group_ids":[]} 2024-05-09T09:47:34.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.679+0000 7f3b4f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:34.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.679+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94246200361216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674bc350 con 0x55b7674a1280 2024-05-09T09:47:34.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.679+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(102 data_loggenerations_metadata [watch unwatch cookie 94246200361216] v30'113 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.679+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:103 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94246200338512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674b4100 con 0x7f3c9401f940 2024-05-09T09:47:34.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.679+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(103 notify.0 [watch unwatch cookie 94246200338512] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x7f3c9401f940 2024-05-09T09:47:34.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.679+0000 7f3ca1307980 20 remove_watcher() i=0 2024-05-09T09:47:34.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.679+0000 7f3ca1307980 2 removed watcher, disabling cache 2024-05-09T09:47:34.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.679+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:104 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94246200343280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674ae850 con 0x55b7674a1280 2024-05-09T09:47:34.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.683+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 36 ==== osd_op_reply(104 notify.1 [watch unwatch cookie 94246200343280] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.683+0000 7f3ca1307980 20 remove_watcher() i=1 2024-05-09T09:47:34.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.683+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:105 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94246200345584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674afaf0 con 0x55b7674aa5a0 2024-05-09T09:47:34.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.687+0000 7f3c9e621640 1 -- 172.21.15.157:0/2771804097 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(105 notify.2 [watch unwatch cookie 94246200345584] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c9404a040 con 0x55b7674aa5a0 2024-05-09T09:47:34.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.687+0000 7f3ca1307980 20 remove_watcher() i=2 2024-05-09T09:47:34.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.687+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:106 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94246200336000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674afaf0 con 0x7f3c9401f940 2024-05-09T09:47:34.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.687+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.2 v2:172.21.15.157:6800/354455204 23 ==== osd_op_reply(106 notify.3 [watch unwatch cookie 94246200336000] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x7f3c9401f940 2024-05-09T09:47:34.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.687+0000 7f3ca1307980 20 remove_watcher() i=3 2024-05-09T09:47:34.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.687+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94246200350208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674ade80 con 0x55b7674a1280 2024-05-09T09:47:34.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.691+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 <== osd.1 v2:172.21.15.157:6808/3930131338 37 ==== osd_op_reply(107 notify.4 [watch unwatch cookie 94246200350208] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c9800a4d0 con 0x55b7674a1280 2024-05-09T09:47:34.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.691+0000 7f3ca1307980 20 remove_watcher() i=4 2024-05-09T09:47:34.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.691+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:108 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94246200353776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674afaf0 con 0x55b7674a5c30 2024-05-09T09:47:34.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.691+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(108 notify.5 [watch unwatch cookie 94246200353776] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c900b3040 con 0x55b7674a5c30 2024-05-09T09:47:34.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.691+0000 7f3ca1307980 20 remove_watcher() i=5 2024-05-09T09:47:34.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.691+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:109 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94246200360160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674b1600 con 0x55b7674a5c30 2024-05-09T09:47:34.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.695+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(109 notify.6 [watch unwatch cookie 94246200360160] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c900b3040 con 0x55b7674a5c30 2024-05-09T09:47:34.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.695+0000 7f3ca1307980 20 remove_watcher() i=6 2024-05-09T09:47:34.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.695+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:110 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94246200363760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7674ade80 con 0x55b7674a5c30 2024-05-09T09:47:34.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.695+0000 7f3c9ee22640 1 -- 172.21.15.157:0/2771804097 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(110 notify.7 [watch unwatch cookie 94246200363760] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c900b3040 con 0x55b7674a5c30 2024-05-09T09:47:34.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.695+0000 7f3ca1307980 20 remove_watcher() i=7 2024-05-09T09:47:34.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.695+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b7674a5c30 msgr2=0x55b7674a8020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.695+0000 7f3ca1307980 1 --2- 172.21.15.157:0/2771804097 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b7674a5c30 0x55b7674a8020 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.695+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b7674a1280 msgr2=0x55b7674a3740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.695+0000 7f3ca1307980 1 --2- 172.21.15.157:0/2771804097 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b7674a1280 0x55b7674a3740 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.695+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f3c9401f940 msgr2=0x7f3c9403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.695+0000 7f3ca1307980 1 --2- 172.21.15.157:0/2771804097 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f3c9401f940 0x7f3c9403a3c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.695+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b7674aa5a0 msgr2=0x55b7674ac9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.695+0000 7f3ca1307980 1 --2- 172.21.15.157:0/2771804097 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b7674aa5a0 0x55b7674ac9b0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.695+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3b68034bb0 msgr2=0x7f3b68037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.695+0000 7f3ca1307980 1 --2- 172.21.15.157:0/2771804097 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3b68034bb0 0x7f3b68037070 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3c9400ba80 tx=0x7f3c94023040 comp rx=0 tx=0).stop 2024-05-09T09:47:34.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.695+0000 7f3c9f623640 1 -- 172.21.15.157:0/2771804097 reap_dead start 2024-05-09T09:47:34.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.695+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b76748d420 msgr2=0x55b767494700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.695+0000 7f3ca1307980 1 --2- 172.21.15.157:0/2771804097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b76748d420 0x55b767494700 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3c900e5590 tx=0x7f3c900dfed0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.695+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 shutdown_connections 2024-05-09T09:47:34.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.695+0000 7f3ca1307980 1 --2- 172.21.15.157:0/2771804097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b76748d420 0x55b767494700 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.695+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 >> 172.21.15.157:0/2771804097 conn(0x55b7674897a0 msgr2=0x55b767486e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:34.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.695+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 shutdown_connections 2024-05-09T09:47:34.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.695+0000 7f3ca1307980 1 -- 172.21.15.157:0/2771804097 wait complete. 2024-05-09T09:47:34.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.695+0000 7f3ca1307980 1 -- 172.21.15.157:0/3714776124 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3b78034c00 msgr2=0x7f3b780370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.695+0000 7f3ca1307980 1 --2- 172.21.15.157:0/3714776124 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3b78034c00 0x7f3b780370c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x55b76745a9d0 tx=0x7f3c94006000 comp rx=0 tx=0).stop 2024-05-09T09:47:34.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.695+0000 7f3ca1307980 1 -- 172.21.15.157:0/3714776124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b767480610 msgr2=0x55b767480a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.695+0000 7f3ca1307980 1 --2- 172.21.15.157:0/3714776124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b767480610 0x55b767480a30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3c900e3a50 tx=0x7f3c900aa720 comp rx=0 tx=0).stop 2024-05-09T09:47:34.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.699+0000 7f3ca1307980 1 -- 172.21.15.157:0/3714776124 shutdown_connections 2024-05-09T09:47:34.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.699+0000 7f3ca1307980 1 --2- 172.21.15.157:0/3714776124 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3b78034c00 0x7f3b780370c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.699+0000 7f3ca1307980 1 --2- 172.21.15.157:0/3714776124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b767480610 0x55b767480a30 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.699+0000 7f3ca1307980 1 -- 172.21.15.157:0/3714776124 >> 172.21.15.157:0/3714776124 conn(0x55b7674753e0 msgr2=0x55b767475ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:34.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.699+0000 7f3ca1307980 1 -- 172.21.15.157:0/3714776124 shutdown_connections 2024-05-09T09:47:34.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.699+0000 7f3ca1307980 1 -- 172.21.15.157:0/3714776124 wait complete. 2024-05-09T09:47:34.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.699+0000 7f3ca1307980 1 -- 172.21.15.157:0/2593645027 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b767453b50 msgr2=0x55b767455f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.699+0000 7f3ca1307980 1 --2- 172.21.15.157:0/2593645027 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b767453b50 0x55b767455f40 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.699+0000 7f3ca1307980 1 -- 172.21.15.157:0/2593645027 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b767358460 msgr2=0x55b767451220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.699+0000 7f3ca1307980 1 --2- 172.21.15.157:0/2593645027 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b767358460 0x55b767451220 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.699+0000 7f3ca1307980 1 -- 172.21.15.157:0/2593645027 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b767457a50 msgr2=0x55b767459e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.699+0000 7f3ca1307980 1 --2- 172.21.15.157:0/2593645027 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b767457a50 0x55b767459e40 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.699+0000 7f3ca1307980 1 -- 172.21.15.157:0/2593645027 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3b84034bb0 msgr2=0x7f3b84037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.699+0000 7f3ca1307980 1 --2- 172.21.15.157:0/2593645027 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3b84034bb0 0x7f3b84037070 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3c94000c10 tx=0x7f3c940013c0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.699+0000 7f3ca1307980 1 -- 172.21.15.157:0/2593645027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b767357b40 msgr2=0x55b76744a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.699+0000 7f3ca1307980 1 --2- 172.21.15.157:0/2593645027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b767357b40 0x55b76744a2e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3c90019930 tx=0x7f3c90018020 comp rx=0 tx=0).stop 2024-05-09T09:47:34.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.699+0000 7f3c9f623640 1 -- 172.21.15.157:0/2593645027 reap_dead start 2024-05-09T09:47:34.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.699+0000 7f3ca1307980 1 -- 172.21.15.157:0/2593645027 shutdown_connections 2024-05-09T09:47:34.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.699+0000 7f3ca1307980 1 -- 172.21.15.157:0/2593645027 >> 172.21.15.157:0/2593645027 conn(0x55b7672cb260 msgr2=0x55b76743d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:34.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.699+0000 7f3ca1307980 1 -- 172.21.15.157:0/2593645027 shutdown_connections 2024-05-09T09:47:34.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.699+0000 7f3ca1307980 1 -- 172.21.15.157:0/2593645027 wait complete. 2024-05-09T09:47:34.709 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-09T09:47:32.044078Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'tUwlkgM9mAb22E1i6ZNggfk2d8onB3JclDmcvUzX', 'active': True, 'create_date': '2024-05-09T09:47:34.675585Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:47:32.044055Z', 'tags': [], 'group_ids': []} 2024-05-09T09:47:34.709 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-05-09T09:47:34.709 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-05-09T09:47:34.710 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-05-09T09:47:34.793 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:34.794 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:34.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.795+0000 7efecc02a980 1 Processor -- start 2024-05-09T09:47:34.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.795+0000 7efecc02a980 1 -- start start 2024-05-09T09:47:34.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.795+0000 7efecc02a980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55e4d8190920 0x55e4d8190d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.795+0000 7efecc02a980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e4d8046440 con 0x55e4d8191240 2024-05-09T09:47:34.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.795+0000 7efecc02a980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55e4d80315f0 con 0x55e4d8190920 2024-05-09T09:47:34.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.795+0000 7efec9b45640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55e4d8190920 0x55e4d8190d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.795+0000 7efec9b45640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55e4d8190920 0x55e4d8190d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54452/0 (socket says 172.21.15.157:54452) 2024-05-09T09:47:34.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.795+0000 7efec9b45640 1 -- 172.21.15.157:0/2218059213 learned_addr learned my addr 172.21.15.157:0/2218059213 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:34.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.795+0000 7efec9344640 1 --1- 172.21.15.157:0/2218059213 >> v1:172.21.15.110:6789/0 conn(0x55e4d8191240 0x55e4d8191bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:33684/0 (socket says 172.21.15.157:33684) 2024-05-09T09:47:34.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.795+0000 7efec9b45640 1 -- 172.21.15.157:0/2218059213 >> v1:172.21.15.110:6789/0 conn(0x55e4d8191240 legacy=0x55e4d8191bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.795+0000 7efec9b45640 1 -- 172.21.15.157:0/2218059213 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4d803c990 con 0x55e4d8190920 2024-05-09T09:47:34.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.799+0000 7efec9b45640 1 --2- 172.21.15.157:0/2218059213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d8190920 0x55e4d8190d00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7efeb400a5c0 tx=0x7efeb401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d81d9d199ffdd09 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.799+0000 7efec8b43640 1 -- 172.21.15.157:0/2218059213 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb40a6070 con 0x55e4d8190920 2024-05-09T09:47:34.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.799+0000 7efec8b43640 1 -- 172.21.15.157:0/2218059213 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb40af070 con 0x55e4d8190920 2024-05-09T09:47:34.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.799+0000 7efec8b43640 1 -- 172.21.15.157:0/2218059213 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb40aa5c0 con 0x55e4d8190920 2024-05-09T09:47:34.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.799+0000 7efecc02a980 1 -- 172.21.15.157:0/2218059213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d8190920 msgr2=0x55e4d8190d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.799+0000 7efecc02a980 1 --2- 172.21.15.157:0/2218059213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d8190920 0x55e4d8190d00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7efeb400a5c0 tx=0x7efeb401b340 comp rx=0 tx=0).stop 2024-05-09T09:47:34.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.799+0000 7efecc02a980 1 -- 172.21.15.157:0/2218059213 shutdown_connections 2024-05-09T09:47:34.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.799+0000 7efecc02a980 1 --2- 172.21.15.157:0/2218059213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d8190920 0x55e4d8190d00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.799+0000 7efecc02a980 1 -- 172.21.15.157:0/2218059213 >> 172.21.15.157:0/2218059213 conn(0x55e4d818c1f0 msgr2=0x55e4d818e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:34.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.799+0000 7efecc02a980 1 -- 172.21.15.157:0/2218059213 shutdown_connections 2024-05-09T09:47:34.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.799+0000 7efecc02a980 1 -- 172.21.15.157:0/2218059213 wait complete. 2024-05-09T09:47:34.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.815+0000 7efecc02a980 1 Processor -- start 2024-05-09T09:47:34.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.815+0000 7efecc02a980 1 -- start start 2024-05-09T09:47:34.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.815+0000 7efecc02a980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d8190920 0x55e4d8107120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.815+0000 7efecc02a980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55e4d8093fe0 con 0x55e4d8190920 2024-05-09T09:47:34.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.815+0000 7efec9b45640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d8190920 0x55e4d8107120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.815+0000 7efec9b45640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d8190920 0x55e4d8107120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54464/0 (socket says 172.21.15.157:54464) 2024-05-09T09:47:34.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.815+0000 7efec9b45640 1 -- 172.21.15.157:0/470863639 learned_addr learned my addr 172.21.15.157:0/470863639 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:34.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.815+0000 7efec9b45640 1 -- 172.21.15.157:0/470863639 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4d8018ae0 con 0x55e4d8190920 2024-05-09T09:47:34.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.819+0000 7efec9b45640 1 --2- 172.21.15.157:0/470863639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d8190920 0x55e4d8107120 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7efeb40ac040 tx=0x7efeb4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd544f40df12582 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.819+0000 7efdb7e07640 1 -- 172.21.15.157:0/470863639 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb40aa9b0 con 0x55e4d8190920 2024-05-09T09:47:34.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.819+0000 7efdb7e07640 1 -- 172.21.15.157:0/470863639 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb40aab50 con 0x55e4d8190920 2024-05-09T09:47:34.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.819+0000 7efdb7e07640 1 -- 172.21.15.157:0/470863639 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb40bd3f0 con 0x55e4d8190920 2024-05-09T09:47:34.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.819+0000 7efecc02a980 1 -- 172.21.15.157:0/470863639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d8190920 msgr2=0x55e4d8107120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.819+0000 7efecc02a980 1 --2- 172.21.15.157:0/470863639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d8190920 0x55e4d8107120 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7efeb40ac040 tx=0x7efeb4003030 comp rx=0 tx=0).stop 2024-05-09T09:47:34.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.819+0000 7efecc02a980 1 -- 172.21.15.157:0/470863639 shutdown_connections 2024-05-09T09:47:34.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.819+0000 7efecc02a980 1 --2- 172.21.15.157:0/470863639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d8190920 0x55e4d8107120 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.819+0000 7efecc02a980 1 -- 172.21.15.157:0/470863639 >> 172.21.15.157:0/470863639 conn(0x55e4d818c1f0 msgr2=0x55e4d8277df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:34.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.819+0000 7efecc02a980 1 -- 172.21.15.157:0/470863639 shutdown_connections 2024-05-09T09:47:34.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.819+0000 7efecc02a980 1 -- 172.21.15.157:0/470863639 wait complete. 2024-05-09T09:47:34.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.819+0000 7efecc02a980 1 Processor -- start 2024-05-09T09:47:34.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.819+0000 7efecc02a980 1 -- start start 2024-05-09T09:47:34.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.819+0000 7efecc02a980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d8190920 0x55e4d8285620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.819+0000 7efecc02a980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55e4d819a920 con 0x55e4d8190920 2024-05-09T09:47:34.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.819+0000 7efec9b45640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d8190920 0x55e4d8285620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.819+0000 7efec9b45640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d8190920 0x55e4d8285620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54470/0 (socket says 172.21.15.157:54470) 2024-05-09T09:47:34.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.819+0000 7efec9b45640 1 -- 172.21.15.157:0/1886551947 learned_addr learned my addr 172.21.15.157:0/1886551947 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:34.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.819+0000 7efec9b45640 1 -- 172.21.15.157:0/1886551947 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4d8285b60 con 0x55e4d8190920 2024-05-09T09:47:34.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.823+0000 7efec9b45640 1 --2- 172.21.15.157:0/1886551947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d8190920 0x55e4d8285620 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efeb401b380 tx=0x7efeb40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.823+0000 7efdb6604640 1 -- 172.21.15.157:0/1886551947 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb40c6690 con 0x55e4d8190920 2024-05-09T09:47:34.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.823+0000 7efdb6604640 1 -- 172.21.15.157:0/1886551947 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb40cc070 con 0x55e4d8190920 2024-05-09T09:47:34.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.823+0000 7efdb6604640 1 -- 172.21.15.157:0/1886551947 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb40c6960 con 0x55e4d8190920 2024-05-09T09:47:34.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.823+0000 7efecc02a980 1 -- 172.21.15.157:0/1886551947 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4d8285df0 con 0x55e4d8190920 2024-05-09T09:47:34.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.823+0000 7efecc02a980 1 -- 172.21.15.157:0/1886551947 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4d8288ad0 con 0x55e4d8190920 2024-05-09T09:47:34.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.823+0000 7efdb6604640 1 -- 172.21.15.157:0/1886551947 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7efeb40c6b00 con 0x55e4d8190920 2024-05-09T09:47:34.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.823+0000 7efdb6604640 1 --2- 172.21.15.157:0/1886551947 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efdb0034c50 0x7efdb0037110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.823+0000 7efdb6604640 1 -- 172.21.15.157:0/1886551947 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7efeb40e5c30 con 0x55e4d8190920 2024-05-09T09:47:34.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.823+0000 7efec9344640 1 --2- 172.21.15.157:0/1886551947 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efdb0034c50 0x7efdb0037110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.823+0000 7efecc02a980 1 --2- 172.21.15.157:0/1886551947 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e4d8191240 0x55e4d828c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.823+0000 7efecc02a980 1 -- 172.21.15.157:0/1886551947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e4d828cbd0 con 0x55e4d8191240 2024-05-09T09:47:34.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.823+0000 7efeca346640 1 --2- 172.21.15.157:0/1886551947 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e4d8191240 0x55e4d828c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.823+0000 7efec9344640 1 --2- 172.21.15.157:0/1886551947 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efdb0034c50 0x7efdb0037110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efebc0012f0 tx=0x7efebc006700 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.823+0000 7efeca346640 1 --2- 172.21.15.157:0/1886551947 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e4d8191240 0x55e4d828c5b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.823+0000 7efeca346640 1 -- 172.21.15.157:0/1886551947 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efec40083f0 con 0x55e4d8191240 2024-05-09T09:47:34.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.823+0000 7efecc02a980 1 -- 172.21.15.157:0/1886551947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e4d8289cf0 con 0x55e4d8191240 2024-05-09T09:47:34.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.823+0000 7efeca346640 1 -- 172.21.15.157:0/1886551947 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efec40083f0 con 0x55e4d8191240 2024-05-09T09:47:34.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.823+0000 7efecc02a980 1 --2- 172.21.15.157:0/1886551947 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e4d828ef00 0x55e4d82912f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.823+0000 7efecc02a980 1 -- 172.21.15.157:0/1886551947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82919c0 con 0x55e4d828ef00 2024-05-09T09:47:34.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.827+0000 7efec9b45640 1 --2- 172.21.15.157:0/1886551947 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e4d828ef00 0x55e4d82912f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.827+0000 7efec9b45640 1 --2- 172.21.15.157:0/1886551947 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e4d828ef00 0x55e4d82912f0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.827+0000 7efec9b45640 1 -- 172.21.15.157:0/1886551947 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efeb40b33f0 con 0x55e4d828ef00 2024-05-09T09:47:34.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.827+0000 7efecc02a980 1 -- 172.21.15.157:0/1886551947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e4d828dda0 con 0x55e4d8191240 2024-05-09T09:47:34.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.827+0000 7efeca346640 1 -- 172.21.15.157:0/1886551947 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efec40083f0 con 0x55e4d8191240 2024-05-09T09:47:34.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.827+0000 7efecc02a980 1 --2- 172.21.15.157:0/1886551947 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e4d8292e20 0x55e4d8295210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.827+0000 7efecc02a980 1 -- 172.21.15.157:0/1886551947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e4d8295910 con 0x55e4d8292e20 2024-05-09T09:47:34.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.827+0000 7efec9344640 1 --2- 172.21.15.157:0/1886551947 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e4d8292e20 0x55e4d8295210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.827+0000 7efec9344640 1 --2- 172.21.15.157:0/1886551947 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e4d8292e20 0x55e4d8295210 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.827+0000 7efec9344640 1 -- 172.21.15.157:0/1886551947 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efebc00f070 con 0x55e4d8292e20 2024-05-09T09:47:34.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.831+0000 7efecc02a980 1 Processor -- start 2024-05-09T09:47:34.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.831+0000 7efecc02a980 1 -- start start 2024-05-09T09:47:34.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.831+0000 7efecc02a980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d82bb800 0x55e4d82bbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.831+0000 7efecc02a980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55e4d8098020 con 0x55e4d82bb800 2024-05-09T09:47:34.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.831+0000 7efec9b45640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d82bb800 0x55e4d82bbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.831+0000 7efec9b45640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d82bb800 0x55e4d82bbc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54472/0 (socket says 172.21.15.157:54472) 2024-05-09T09:47:34.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.831+0000 7efec9b45640 1 -- 172.21.15.157:0/3390871877 learned_addr learned my addr 172.21.15.157:0/3390871877 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:34.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.835+0000 7efec9b45640 1 -- 172.21.15.157:0/3390871877 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4d82bc160 con 0x55e4d82bb800 2024-05-09T09:47:34.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.835+0000 7efec9b45640 1 --2- 172.21.15.157:0/3390871877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d82bb800 0x55e4d82bbc20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efeb40a5010 tx=0x7efeb40c5ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.835+0000 7efdae3a1640 1 -- 172.21.15.157:0/3390871877 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb40bcda0 con 0x55e4d82bb800 2024-05-09T09:47:34.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.835+0000 7efdae3a1640 1 -- 172.21.15.157:0/3390871877 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb40d0410 con 0x55e4d82bb800 2024-05-09T09:47:34.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.835+0000 7efecc02a980 1 -- 172.21.15.157:0/3390871877 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4d82bcbf0 con 0x55e4d82bb800 2024-05-09T09:47:34.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.835+0000 7efdae3a1640 1 -- 172.21.15.157:0/3390871877 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb40d06f0 con 0x55e4d82bb800 2024-05-09T09:47:34.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.835+0000 7efecc02a980 1 -- 172.21.15.157:0/3390871877 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4d82bd0d0 con 0x55e4d82bb800 2024-05-09T09:47:34.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.835+0000 7efdae3a1640 1 -- 172.21.15.157:0/3390871877 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7efeb40b3850 con 0x55e4d82bb800 2024-05-09T09:47:34.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.835+0000 7efdae3a1640 1 --2- 172.21.15.157:0/3390871877 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efda4034c00 0x7efda40370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.835+0000 7efdae3a1640 1 -- 172.21.15.157:0/3390871877 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7efeb40f0ca0 con 0x55e4d82bb800 2024-05-09T09:47:34.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.835+0000 7efec9344640 1 --2- 172.21.15.157:0/3390871877 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efda4034c00 0x7efda40370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.835+0000 7efecc02a980 1 Processor -- start 2024-05-09T09:47:34.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.835+0000 7efecc02a980 1 -- start start 2024-05-09T09:47:34.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.835+0000 7efec9344640 1 --2- 172.21.15.157:0/3390871877 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efda4034c00 0x7efda40370c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efebc006300 tx=0x7efebc00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.835+0000 7efecc02a980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d82c8790 0x55e4d82c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.835+0000 7efecc02a980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55e4d81077b0 con 0x55e4d82c8790 2024-05-09T09:47:34.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.835+0000 7efec9b45640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d82c8790 0x55e4d82c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.835+0000 7efec9b45640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d82c8790 0x55e4d82c8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54488/0 (socket says 172.21.15.157:54488) 2024-05-09T09:47:34.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.835+0000 7efec9b45640 1 -- 172.21.15.157:0/1285346716 learned_addr learned my addr 172.21.15.157:0/1285346716 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:34.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.839+0000 7efec9b45640 1 -- 172.21.15.157:0/1285346716 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4d82c9160 con 0x55e4d82c8790 2024-05-09T09:47:34.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.839+0000 7efec9b45640 1 --2- 172.21.15.157:0/1285346716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d82c8790 0x55e4d82c8b90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efeb40ee7d0 tx=0x7efeb40ee8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97d983a43377067 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.839+0000 7efd9bfff640 1 -- 172.21.15.157:0/1285346716 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb4106020 con 0x55e4d82c8790 2024-05-09T09:47:34.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.839+0000 7efd9bfff640 1 -- 172.21.15.157:0/1285346716 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb40e8e30 con 0x55e4d82c8790 2024-05-09T09:47:34.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.839+0000 7efd9bfff640 1 -- 172.21.15.157:0/1285346716 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb40c7d10 con 0x55e4d82c8790 2024-05-09T09:47:34.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.839+0000 7efecc02a980 1 -- 172.21.15.157:0/1285346716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d82c8790 msgr2=0x55e4d82c8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.839+0000 7efecc02a980 1 --2- 172.21.15.157:0/1285346716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d82c8790 0x55e4d82c8b90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efeb40ee7d0 tx=0x7efeb40ee8c0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.839+0000 7efecc02a980 1 -- 172.21.15.157:0/1285346716 shutdown_connections 2024-05-09T09:47:34.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.839+0000 7efecc02a980 1 --2- 172.21.15.157:0/1285346716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d82c8790 0x55e4d82c8b90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.839+0000 7efecc02a980 1 -- 172.21.15.157:0/1285346716 >> 172.21.15.157:0/1285346716 conn(0x55e4d82c4b60 msgr2=0x55e4d82c2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:34.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.839+0000 7efecc02a980 1 -- 172.21.15.157:0/1285346716 shutdown_connections 2024-05-09T09:47:34.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.839+0000 7efecc02a980 1 -- 172.21.15.157:0/1285346716 wait complete. 2024-05-09T09:47:34.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.839+0000 7efecc02a980 1 Processor -- start 2024-05-09T09:47:34.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.839+0000 7efecc02a980 1 -- start start 2024-05-09T09:47:34.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.839+0000 7efecc02a980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d82c8790 0x55e4d82cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.839+0000 7efecc02a980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55e4d82c9160 con 0x55e4d82c8790 2024-05-09T09:47:34.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.839+0000 7efec9b45640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d82c8790 0x55e4d82cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.839+0000 7efec9b45640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d82c8790 0x55e4d82cf9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54494/0 (socket says 172.21.15.157:54494) 2024-05-09T09:47:34.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.839+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 learned_addr learned my addr 172.21.15.157:0/4154499476 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:34.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.839+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4d82cff20 con 0x55e4d82c8790 2024-05-09T09:47:34.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.839+0000 7efec9b45640 1 --2- 172.21.15.157:0/4154499476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d82c8790 0x55e4d82cf9e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efeb40ee7d0 tx=0x7efeb4100000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.839+0000 7efd9a7fc640 1 -- 172.21.15.157:0/4154499476 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb40dc3f0 con 0x55e4d82c8790 2024-05-09T09:47:34.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.839+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4d82cff20 con 0x55e4d82c8790 2024-05-09T09:47:34.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.839+0000 7efd9a7fc640 1 -- 172.21.15.157:0/4154499476 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb40dc5b0 con 0x55e4d82c8790 2024-05-09T09:47:34.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.839+0000 7efd9a7fc640 1 -- 172.21.15.157:0/4154499476 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb40c73f0 con 0x55e4d82c8790 2024-05-09T09:47:34.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.839+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4d82d03a0 con 0x55e4d82c8790 2024-05-09T09:47:34.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efd9a7fc640 1 -- 172.21.15.157:0/4154499476 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7efeb411d060 con 0x55e4d82c8790 2024-05-09T09:47:34.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efd9a7fc640 1 --2- 172.21.15.157:0/4154499476 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efd94034bb0 0x7efd94037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efd9a7fc640 1 -- 172.21.15.157:0/4154499476 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7efeb40fe040 con 0x55e4d82c8790 2024-05-09T09:47:34.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efec9344640 1 --2- 172.21.15.157:0/4154499476 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efd94034bb0 0x7efd94037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efecc02a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efecc02a980 1 --2- 172.21.15.157:0/4154499476 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e4d82dc3f0 0x55e4d82de8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82df000 con 0x55e4d82dc3f0 2024-05-09T09:47:34.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efeca346640 1 --2- 172.21.15.157:0/4154499476 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e4d82dc3f0 0x55e4d82de8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efec9344640 1 --2- 172.21.15.157:0/4154499476 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efd94034bb0 0x7efd94037070 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55e4d828d4b0 tx=0x7efebc010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efeca346640 1 --2- 172.21.15.157:0/4154499476 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e4d82dc3f0 0x55e4d82de8b0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efec40083f0 con 0x55e4d82dc3f0 2024-05-09T09:47:34.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efecc02a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:34.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efecc02a980 20 realm 2024-05-09T09:47:34.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efecc02a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82df410 con 0x55e4d82dc3f0 2024-05-09T09:47:34.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efec40083f0 con 0x55e4d82dc3f0 2024-05-09T09:47:34.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efecc02a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:34.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efecc02a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:34.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efecc02a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82dfce0 con 0x55e4d82dc3f0 2024-05-09T09:47:34.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efec40083f0 con 0x55e4d82dc3f0 2024-05-09T09:47:34.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efecc02a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:34.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efecc02a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x55e4d82dc3f0 2024-05-09T09:47:34.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efec40083f0 con 0x55e4d82dc3f0 2024-05-09T09:47:34.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efecc02a980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:34.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efecc02a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efecc02a980 1 --2- 172.21.15.157:0/4154499476 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e4d82e0de0 0x55e4d82e31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e37e0 con 0x55e4d82e0de0 2024-05-09T09:47:34.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efec9b45640 1 --2- 172.21.15.157:0/4154499476 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e4d82e0de0 0x55e4d82e31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.843+0000 7efec9b45640 1 --2- 172.21.15.157:0/4154499476 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e4d82e0de0 0x55e4d82e31d0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.847+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efeb40f5020 con 0x55e4d82e0de0 2024-05-09T09:47:34.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.847+0000 7efecc02a980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:34.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.847+0000 7efecc02a980 20 searching for the correct realm 2024-05-09T09:47:34.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.847+0000 7efecc02a980 1 --2- 172.21.15.157:0/4154499476 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e4d82e5730 0x55e4d82e7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.847+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e8250 con 0x55e4d82e5730 2024-05-09T09:47:34.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.847+0000 7efec9344640 1 --2- 172.21.15.157:0/4154499476 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e4d82e5730 0x55e4d82e7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.847+0000 7efec9344640 1 --2- 172.21.15.157:0/4154499476 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e4d82e5730 0x55e4d82e7b80 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.847+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efebc00f070 con 0x55e4d82e5730 2024-05-09T09:47:34.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.847+0000 7efec9344640 1 --2- 172.21.15.157:0/4154499476 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7efebc024070 0x7efebc031460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:34.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.847+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e8250 con 0x7efebc024070 2024-05-09T09:47:34.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.847+0000 7efeca346640 1 --2- 172.21.15.157:0/4154499476 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7efebc024070 0x7efebc031460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:34.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.847+0000 7efeca346640 1 --2- 172.21.15.157:0/4154499476 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7efebc024070 0x7efebc031460 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:34.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.847+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efec40083f0 con 0x7efebc024070 2024-05-09T09:47:34.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.847+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x55e4d82e0de0 2024-05-09T09:47:34.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.847+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeb40f5020 con 0x55e4d82e0de0 2024-05-09T09:47:34.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.847+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x55e4d82dc3f0 2024-05-09T09:47:34.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.847+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efec40083f0 con 0x55e4d82dc3f0 2024-05-09T09:47:34.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.847+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x55e4d82dc3f0 2024-05-09T09:47:34.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.851+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efec4026040 con 0x55e4d82dc3f0 2024-05-09T09:47:34.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.851+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x55e4d82e0de0 2024-05-09T09:47:34.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.851+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeb40f5020 con 0x55e4d82e0de0 2024-05-09T09:47:34.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.851+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x55e4d82e0de0 2024-05-09T09:47:34.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.851+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeb40f5020 con 0x55e4d82e0de0 2024-05-09T09:47:34.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.851+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x7efebc024070 2024-05-09T09:47:34.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.851+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efec4026040 con 0x7efebc024070 2024-05-09T09:47:34.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.851+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x55e4d82e5730 2024-05-09T09:47:34.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.851+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efebc00f070 con 0x55e4d82e5730 2024-05-09T09:47:34.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.851+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x55e4d82dc3f0 2024-05-09T09:47:34.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.851+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efec4026040 con 0x55e4d82dc3f0 2024-05-09T09:47:34.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.851+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x55e4d82e0de0 2024-05-09T09:47:34.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.851+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeb40f5020 con 0x55e4d82e0de0 2024-05-09T09:47:34.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.851+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x55e4d82dc3f0 2024-05-09T09:47:34.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.851+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efec4026040 con 0x55e4d82dc3f0 2024-05-09T09:47:34.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.851+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x7efebc024070 2024-05-09T09:47:34.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.851+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efec4026040 con 0x7efebc024070 2024-05-09T09:47:34.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.851+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x55e4d82e5730 2024-05-09T09:47:34.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.851+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efebc040040 con 0x55e4d82e5730 2024-05-09T09:47:34.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.851+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x55e4d82e5730 2024-05-09T09:47:34.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.855+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7efebc040040 con 0x55e4d82e5730 2024-05-09T09:47:34.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.855+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x55e4d82e0de0 2024-05-09T09:47:34.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.855+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeb40f5020 con 0x55e4d82e0de0 2024-05-09T09:47:34.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.855+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x55e4d82e5730 2024-05-09T09:47:34.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.855+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efebc040040 con 0x55e4d82e5730 2024-05-09T09:47:34.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.855+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x55e4d82e5730 2024-05-09T09:47:34.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.855+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efebc040040 con 0x55e4d82e5730 2024-05-09T09:47:34.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.855+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x55e4d82dc3f0 2024-05-09T09:47:34.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.855+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efec4026040 con 0x55e4d82dc3f0 2024-05-09T09:47:34.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.855+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x55e4d82dc3f0 2024-05-09T09:47:34.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.855+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efec4026040 con 0x55e4d82dc3f0 2024-05-09T09:47:34.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.855+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x55e4d82e0de0 2024-05-09T09:47:34.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.855+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeb40f5020 con 0x55e4d82e0de0 2024-05-09T09:47:34.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.855+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x55e4d82e5730 2024-05-09T09:47:34.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.855+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efebc040040 con 0x55e4d82e5730 2024-05-09T09:47:34.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.855+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x7efebc024070 2024-05-09T09:47:34.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.855+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efec4026040 con 0x7efebc024070 2024-05-09T09:47:34.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.855+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x55e4d82dc3f0 2024-05-09T09:47:34.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.855+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efec4026040 con 0x55e4d82dc3f0 2024-05-09T09:47:34.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.855+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x55e4d82e0de0 2024-05-09T09:47:34.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.859+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efeb40f5020 con 0x55e4d82e0de0 2024-05-09T09:47:34.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.859+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x55e4d82e5730 2024-05-09T09:47:34.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.859+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efebc040040 con 0x55e4d82e5730 2024-05-09T09:47:34.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.859+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x55e4d82e0de0 2024-05-09T09:47:34.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.859+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeb40f5020 con 0x55e4d82e0de0 2024-05-09T09:47:34.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.859+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x7efebc024070 2024-05-09T09:47:34.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.859+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efec4026040 con 0x7efebc024070 2024-05-09T09:47:34.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.859+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x55e4d82e5730 2024-05-09T09:47:34.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.859+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efebc040040 con 0x55e4d82e5730 2024-05-09T09:47:34.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.859+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x55e4d82e0de0 2024-05-09T09:47:34.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.859+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeb40f5020 con 0x55e4d82e0de0 2024-05-09T09:47:34.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.859+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x55e4d82dc3f0 2024-05-09T09:47:34.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.859+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efec4026040 con 0x55e4d82dc3f0 2024-05-09T09:47:34.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.859+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e0080 con 0x7efebc024070 2024-05-09T09:47:34.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.859+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efec4026040 con 0x7efebc024070 2024-05-09T09:47:34.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.859+0000 7efecc02a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:34.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.859+0000 7efecc02a980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:34.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.859+0000 7efecc02a980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:34.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.859+0000 7efecc02a980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:34.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.859+0000 7efecc02a980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:34.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.859+0000 7efecc02a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:34.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.859+0000 7efecc02a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.859+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e40a0 con 0x55e4d82dc3f0 2024-05-09T09:47:34.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.859+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efec4026040 con 0x55e4d82dc3f0 2024-05-09T09:47:34.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.859+0000 7efecc02a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:34.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.859+0000 7efecc02a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.859+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e40a0 con 0x55e4d82dc3f0 2024-05-09T09:47:34.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efec4026040 con 0x55e4d82dc3f0 2024-05-09T09:47:34.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efecc02a980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:34.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efecc02a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e40a0 con 0x55e4d82e5730 2024-05-09T09:47:34.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efebc040040 con 0x55e4d82e5730 2024-05-09T09:47:34.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efecc02a980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:34.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efecc02a980 20 zone default found 2024-05-09T09:47:34.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efecc02a980 4 Realm: () 2024-05-09T09:47:34.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efecc02a980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:34.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efecc02a980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:34.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efecc02a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:34.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efecc02a980 20 zonegroup default 2024-05-09T09:47:34.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efecc02a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e4ac0 con 0x55e4d82e0de0 2024-05-09T09:47:34.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efeb40f5020 con 0x55e4d82e0de0 2024-05-09T09:47:34.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efecc02a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:34.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efecc02a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82ea560 con 0x55e4d82e5730 2024-05-09T09:47:34.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efebc040040 con 0x55e4d82e5730 2024-05-09T09:47:34.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efecc02a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:34.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efecc02a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82ea900 con 0x55e4d82e5730 2024-05-09T09:47:34.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efebc040040 con 0x55e4d82e5730 2024-05-09T09:47:34.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efecc02a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:34.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efecc02a980 20 started sync module instance, tier type = 2024-05-09T09:47:34.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efecc02a980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:34.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e99a0 con 0x7efebc024070 2024-05-09T09:47:34.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efec4026040 con 0x7efebc024070 2024-05-09T09:47:34.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94441367838096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e99a0 con 0x7efebc024070 2024-05-09T09:47:34.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.863+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82eb150 con 0x55e4d82dc3f0 2024-05-09T09:47:34.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.867+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94441367838096] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efec4036040 con 0x7efebc024070 2024-05-09T09:47:34.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.867+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efec4036040 con 0x55e4d82dc3f0 2024-05-09T09:47:34.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.867+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94441367842224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e99a0 con 0x55e4d82dc3f0 2024-05-09T09:47:34.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.867+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82ebb60 con 0x55e4d82e5730 2024-05-09T09:47:34.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.867+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94441367842224] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efec4036040 con 0x55e4d82dc3f0 2024-05-09T09:47:34.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.867+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efebc040040 con 0x55e4d82e5730 2024-05-09T09:47:34.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.867+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94441367835888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82e9910 con 0x55e4d82e5730 2024-05-09T09:47:34.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.867+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82ec860 con 0x7efebc024070 2024-05-09T09:47:34.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.871+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efec4036040 con 0x7efebc024070 2024-05-09T09:47:34.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.871+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94441367848160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82ed100 con 0x7efebc024070 2024-05-09T09:47:34.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.871+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82edb00 con 0x55e4d82dc3f0 2024-05-09T09:47:34.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.871+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94441367835888] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efebc040040 con 0x55e4d82e5730 2024-05-09T09:47:34.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.871+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94441367848160] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efec4036040 con 0x7efebc024070 2024-05-09T09:47:34.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.871+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efec4036040 con 0x55e4d82dc3f0 2024-05-09T09:47:34.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.871+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94441367846656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82ecbe0 con 0x55e4d82dc3f0 2024-05-09T09:47:34.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.871+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82ee3a0 con 0x55e4d82e0de0 2024-05-09T09:47:34.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.875+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94441367846656] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efec4036040 con 0x55e4d82dc3f0 2024-05-09T09:47:34.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.875+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeb40f5020 con 0x55e4d82e0de0 2024-05-09T09:47:34.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.875+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94441367854832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82ecbe0 con 0x55e4d82e0de0 2024-05-09T09:47:34.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.875+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82eebf0 con 0x55e4d82e0de0 2024-05-09T09:47:34.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.875+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeb40f5020 con 0x55e4d82e0de0 2024-05-09T09:47:34.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.875+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94441367859088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82ef860 con 0x55e4d82e0de0 2024-05-09T09:47:34.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.875+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82f0220 con 0x55e4d82e0de0 2024-05-09T09:47:34.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.875+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94441367854832] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeb40f5020 con 0x55e4d82e0de0 2024-05-09T09:47:34.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.879+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeb40f5020 con 0x55e4d82e0de0 2024-05-09T09:47:34.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.879+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94441367852560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82f0220 con 0x55e4d82e0de0 2024-05-09T09:47:34.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.879+0000 7efecc02a980 20 add_watcher() i=0 2024-05-09T09:47:34.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.879+0000 7efecc02a980 20 add_watcher() i=1 2024-05-09T09:47:34.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.879+0000 7efecc02a980 20 add_watcher() i=2 2024-05-09T09:47:34.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.879+0000 7efecc02a980 20 add_watcher() i=3 2024-05-09T09:47:34.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.879+0000 7efecc02a980 20 add_watcher() i=4 2024-05-09T09:47:34.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.879+0000 7efecc02a980 20 add_watcher() i=5 2024-05-09T09:47:34.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.879+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94441367859088] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeb40f5020 con 0x55e4d82e0de0 2024-05-09T09:47:34.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.879+0000 7efecc02a980 20 add_watcher() i=6 2024-05-09T09:47:34.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.879+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94441367852560] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeb40f5020 con 0x55e4d82e0de0 2024-05-09T09:47:34.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.879+0000 7efecc02a980 20 add_watcher() i=7 2024-05-09T09:47:34.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.879+0000 7efecc02a980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:34.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.879+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82f3250 con 0x55e4d82dc3f0 2024-05-09T09:47:34.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.879+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efec4036040 con 0x55e4d82dc3f0 2024-05-09T09:47:34.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.879+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94441367862640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82f0640 con 0x55e4d82dc3f0 2024-05-09T09:47:34.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.883+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94441367862640] v30'114 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efec4036040 con 0x55e4d82dc3f0 2024-05-09T09:47:34.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.883+0000 7efd7f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:34.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.883+0000 7efecc02a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:34.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.883+0000 7efecc02a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:34.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.883+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82fba40 con 0x55e4d82dc3f0 2024-05-09T09:47:34.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.883+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'34 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efec4036040 con 0x55e4d82dc3f0 2024-05-09T09:47:34.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.883+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82fc090 con 0x55e4d82e0de0 2024-05-09T09:47:34.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.887+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'28 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efeb40f5020 con 0x55e4d82e0de0 2024-05-09T09:47:34.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.887+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82fc090 con 0x55e4d82e5730 2024-05-09T09:47:34.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.887+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'28 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efebc040040 con 0x55e4d82e5730 2024-05-09T09:47:34.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.887+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82fcb70 con 0x55e4d82dc3f0 2024-05-09T09:47:34.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.891+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'115 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efec4036040 con 0x55e4d82dc3f0 2024-05-09T09:47:34.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.891+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82f9890 con 0x7efebc024070 2024-05-09T09:47:34.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.891+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'74 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efec4036040 con 0x7efebc024070 2024-05-09T09:47:34.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.891+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82f9890 con 0x55e4d82e5730 2024-05-09T09:47:34.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.891+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'49 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efebc040040 con 0x55e4d82e5730 2024-05-09T09:47:34.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.891+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82fd8a0 con 0x55e4d82dc3f0 2024-05-09T09:47:34.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.895+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'30 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efec4036040 con 0x55e4d82dc3f0 2024-05-09T09:47:34.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.895+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82fd8a0 con 0x55e4d82e0de0 2024-05-09T09:47:34.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.899+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'49 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efeb40f5020 con 0x55e4d82e0de0 2024-05-09T09:47:34.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.899+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82fd8a0 con 0x7efebc024070 2024-05-09T09:47:34.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.899+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'28 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efec4036040 con 0x7efebc024070 2024-05-09T09:47:34.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.899+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82fd8a0 con 0x55e4d82e5730 2024-05-09T09:47:34.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.903+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'34 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efebc040040 con 0x55e4d82e5730 2024-05-09T09:47:34.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.903+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82fdb80 con 0x7efebc024070 2024-05-09T09:47:34.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.903+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'75 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efec4036040 con 0x7efebc024070 2024-05-09T09:47:34.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.903+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82fdb80 con 0x55e4d82e0de0 2024-05-09T09:47:34.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.903+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'30 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efeb40f5020 con 0x55e4d82e0de0 2024-05-09T09:47:34.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.903+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82fdb80 con 0x7efebc024070 2024-05-09T09:47:34.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.907+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'28 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efec4036040 con 0x7efebc024070 2024-05-09T09:47:34.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.907+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82fdb80 con 0x55e4d82e0de0 2024-05-09T09:47:34.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.907+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'55 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efeb40f5020 con 0x55e4d82e0de0 2024-05-09T09:47:34.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.907+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82fdb80 con 0x55e4d82dc3f0 2024-05-09T09:47:34.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.911+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'116 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efec4036040 con 0x55e4d82dc3f0 2024-05-09T09:47:34.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.911+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82fdb80 con 0x55e4d82e5730 2024-05-09T09:47:34.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.911+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'68 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efebc040040 con 0x55e4d82e5730 2024-05-09T09:47:34.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.911+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82fdb80 con 0x7efebc024070 2024-05-09T09:47:34.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.915+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'76 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efec4036040 con 0x7efebc024070 2024-05-09T09:47:34.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.915+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82fdb80 con 0x55e4d82e5730 2024-05-09T09:47:34.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.915+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efebc040040 con 0x55e4d82e5730 2024-05-09T09:47:34.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.915+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82fdc30 con 0x55e4d82dc3f0 2024-05-09T09:47:34.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.919+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'36 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efec4036040 con 0x55e4d82dc3f0 2024-05-09T09:47:34.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.919+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82fdc30 con 0x55e4d82dc3f0 2024-05-09T09:47:34.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.919+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'117 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efec4036040 con 0x55e4d82dc3f0 2024-05-09T09:47:34.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.919+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82fdc30 con 0x55e4d82e5730 2024-05-09T09:47:34.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.923+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'69 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efebc040040 con 0x55e4d82e5730 2024-05-09T09:47:34.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.923+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82fdc30 con 0x7efebc024070 2024-05-09T09:47:34.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.923+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'38 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efec4036040 con 0x7efebc024070 2024-05-09T09:47:34.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.923+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82fdc30 con 0x55e4d82e5730 2024-05-09T09:47:34.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.923+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'30 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efebc040040 con 0x55e4d82e5730 2024-05-09T09:47:34.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.927+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82fdc30 con 0x55e4d82e5730 2024-05-09T09:47:34.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.927+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'34 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efebc040040 con 0x55e4d82e5730 2024-05-09T09:47:34.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.927+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82fdc30 con 0x55e4d82e5730 2024-05-09T09:47:34.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.927+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efebc040040 con 0x55e4d82e5730 2024-05-09T09:47:34.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.927+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82fdc30 con 0x55e4d82e5730 2024-05-09T09:47:34.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.931+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'50 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efebc040040 con 0x55e4d82e5730 2024-05-09T09:47:34.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.931+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82fdc30 con 0x55e4d82e0de0 2024-05-09T09:47:34.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.931+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'30 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efeb40f5020 con 0x55e4d82e0de0 2024-05-09T09:47:34.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.931+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82fdc30 con 0x55e4d82e5730 2024-05-09T09:47:34.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.935+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efebc040040 con 0x55e4d82e5730 2024-05-09T09:47:34.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.935+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82fdc30 con 0x55e4d82e0de0 2024-05-09T09:47:34.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.939+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'50 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efeb40f5020 con 0x55e4d82e0de0 2024-05-09T09:47:34.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.939+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82fdc30 con 0x55e4d82e5730 2024-05-09T09:47:34.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.939+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'70 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efebc040040 con 0x55e4d82e5730 2024-05-09T09:47:34.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.939+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82fdc30 con 0x55e4d82e0de0 2024-05-09T09:47:34.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.943+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'56 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efeb40f5020 con 0x55e4d82e0de0 2024-05-09T09:47:34.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.943+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82f93e0 con 0x7efebc024070 2024-05-09T09:47:34.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.943+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'34 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efec4036040 con 0x7efebc024070 2024-05-09T09:47:34.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.947+0000 7efd7e7e4640 20 reqs_thread_entry: start 2024-05-09T09:47:34.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.947+0000 7efecc02a980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:34.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.947+0000 7efecc02a980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-09T09:47:34.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.947+0000 7efd777fe640 20 reqs_thread_entry: start 2024-05-09T09:47:34.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.947+0000 7efecc02a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:34.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.947+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e4d8319840 con 0x55e4d82dc3f0 2024-05-09T09:47:34.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.947+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7efec4036040 con 0x55e4d82dc3f0 2024-05-09T09:47:34.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.947+0000 7efecc02a980 20 rados_obj.operate() r=0 bl.length=556 2024-05-09T09:47:34.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.947+0000 7efecc02a980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-09T09:47:34.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.947+0000 7efecc02a980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:34.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.947+0000 7efecc02a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:34.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.947+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d831faa0 con 0x55e4d82dc3f0 2024-05-09T09:47:34.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.947+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(95 foo [delete,create,call,call,writefull 0~556] v30'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7efec4036040 con 0x55e4d82dc3f0 2024-05-09T09:47:34.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.947+0000 7efecc02a980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:47:34.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.947+0000 7efecc02a980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:34.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.947+0000 7efecc02a980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-09T09:47:34.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.947+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 7.d 7:b4812045:::notify.4:head [notify cookie 94441368057104 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e4d831b200 con 0x55e4d82dc3f0 2024-05-09T09:47:34.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.947+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== watch-notify(notify (1) cookie 94441367846656 notify 128849018886 ret 0) ==== 774+0+0 (crc 0 0 0) 0x55e4d82fdc30 con 0x55e4d82dc3f0 2024-05-09T09:47:34.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.947+0000 7efd9bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018886 cookie 94441367846656 notifier 4378 bl.length()=732 2024-05-09T09:47:34.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.947+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(96 notify.4 [notify cookie 94441368057104 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efec4036040 con 0x55e4d82dc3f0 2024-05-09T09:47:34.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.947+0000 7efd9bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:47:34.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.947+0000 7efd9bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:34.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.947+0000 7efd9bfff640 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7efd8c0056c0 con 0x55e4d82dc3f0 2024-05-09T09:47:34.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.947+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(97 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efec4036040 con 0x55e4d82dc3f0 2024-05-09T09:47:34.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.951+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== watch-notify(notify_complete (2) cookie 94441368057104 notify 128849018886 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e4d82f9210 con 0x55e4d82dc3f0 2024-05-09T09:47:34.949 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-09T09:47:32.044078Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:47:32.044055Z","tags":[],"group_ids":[]} 2024-05-09T09:47:34.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.951+0000 7efd7f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:34.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.951+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94441367862640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d831e550 con 0x55e4d82dc3f0 2024-05-09T09:47:34.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.951+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(98 data_loggenerations_metadata [watch unwatch cookie 94441367862640] v30'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efec4036040 con 0x55e4d82dc3f0 2024-05-09T09:47:34.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.951+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94441367838096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82efd70 con 0x7efebc024070 2024-05-09T09:47:34.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.951+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(99 notify.0 [watch unwatch cookie 94441367838096] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efec4036040 con 0x7efebc024070 2024-05-09T09:47:34.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.951+0000 7efecc02a980 20 remove_watcher() i=0 2024-05-09T09:47:34.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.951+0000 7efecc02a980 2 removed watcher, disabling cache 2024-05-09T09:47:34.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.951+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94441367842224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82efd70 con 0x55e4d82dc3f0 2024-05-09T09:47:34.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.955+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(100 notify.1 [watch unwatch cookie 94441367842224] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efec4036040 con 0x55e4d82dc3f0 2024-05-09T09:47:34.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.955+0000 7efecc02a980 20 remove_watcher() i=1 2024-05-09T09:47:34.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.955+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94441367835888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82efd70 con 0x55e4d82e5730 2024-05-09T09:47:34.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.959+0000 7efec9344640 1 -- 172.21.15.157:0/4154499476 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(101 notify.2 [watch unwatch cookie 94441367835888] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efebc040040 con 0x55e4d82e5730 2024-05-09T09:47:34.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.959+0000 7efecc02a980 20 remove_watcher() i=2 2024-05-09T09:47:34.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.959+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:102 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94441367848160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82efd70 con 0x7efebc024070 2024-05-09T09:47:34.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.959+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(102 notify.3 [watch unwatch cookie 94441367848160] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efec4036040 con 0x7efebc024070 2024-05-09T09:47:34.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.959+0000 7efecc02a980 20 remove_watcher() i=3 2024-05-09T09:47:34.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.959+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94441367846656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82ec4e0 con 0x55e4d82dc3f0 2024-05-09T09:47:34.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.959+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(103 notify.4 [watch unwatch cookie 94441367846656] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efec4036040 con 0x55e4d82dc3f0 2024-05-09T09:47:34.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.959+0000 7efecc02a980 20 remove_watcher() i=4 2024-05-09T09:47:34.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.959+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94441367854832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82efd70 con 0x55e4d82e0de0 2024-05-09T09:47:34.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.963+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(104 notify.5 [watch unwatch cookie 94441367854832] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeb40f5020 con 0x55e4d82e0de0 2024-05-09T09:47:34.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.963+0000 7efecc02a980 20 remove_watcher() i=5 2024-05-09T09:47:34.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.963+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:105 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94441367859088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82ec4e0 con 0x55e4d82e0de0 2024-05-09T09:47:34.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.967+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(105 notify.6 [watch unwatch cookie 94441367859088] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeb40f5020 con 0x55e4d82e0de0 2024-05-09T09:47:34.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.967+0000 7efecc02a980 20 remove_watcher() i=6 2024-05-09T09:47:34.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.967+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:106 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94441367852560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e4d82efd70 con 0x55e4d82e0de0 2024-05-09T09:47:34.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.967+0000 7efec9b45640 1 -- 172.21.15.157:0/4154499476 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(106 notify.7 [watch unwatch cookie 94441367852560] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeb40f5020 con 0x55e4d82e0de0 2024-05-09T09:47:34.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.967+0000 7efecc02a980 20 remove_watcher() i=7 2024-05-09T09:47:34.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.967+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e4d82e0de0 msgr2=0x55e4d82e31d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.967+0000 7efecc02a980 1 --2- 172.21.15.157:0/4154499476 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e4d82e0de0 0x55e4d82e31d0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.967+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e4d82dc3f0 msgr2=0x55e4d82de8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.967+0000 7efecc02a980 1 --2- 172.21.15.157:0/4154499476 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e4d82dc3f0 0x55e4d82de8b0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.967+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7efebc024070 msgr2=0x7efebc031460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.967+0000 7efecc02a980 1 --2- 172.21.15.157:0/4154499476 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7efebc024070 0x7efebc031460 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.967+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e4d82e5730 msgr2=0x55e4d82e7b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.967+0000 7efecc02a980 1 --2- 172.21.15.157:0/4154499476 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e4d82e5730 0x55e4d82e7b80 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.967+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efd94034bb0 msgr2=0x7efd94037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.967+0000 7efecc02a980 1 --2- 172.21.15.157:0/4154499476 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efd94034bb0 0x7efd94037070 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55e4d828d4b0 tx=0x7efebc010000 comp rx=0 tx=0).stop 2024-05-09T09:47:34.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.967+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d82c8790 msgr2=0x55e4d82cf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.967+0000 7efeca346640 1 -- 172.21.15.157:0/4154499476 reap_dead start 2024-05-09T09:47:34.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.967+0000 7efecc02a980 1 --2- 172.21.15.157:0/4154499476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d82c8790 0x55e4d82cf9e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efeb40ee7d0 tx=0x7efeb4100000 comp rx=0 tx=0).stop 2024-05-09T09:47:34.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.967+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 shutdown_connections 2024-05-09T09:47:34.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.967+0000 7efecc02a980 1 --2- 172.21.15.157:0/4154499476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d82c8790 0x55e4d82cf9e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.967+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 >> 172.21.15.157:0/4154499476 conn(0x55e4d82c4b60 msgr2=0x55e4d82c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:34.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.967+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 shutdown_connections 2024-05-09T09:47:34.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.967+0000 7efecc02a980 1 -- 172.21.15.157:0/4154499476 wait complete. 2024-05-09T09:47:34.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.971+0000 7efecc02a980 1 -- 172.21.15.157:0/3390871877 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efda4034c00 msgr2=0x7efda40370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.971+0000 7efecc02a980 1 --2- 172.21.15.157:0/3390871877 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efda4034c00 0x7efda40370c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efebc006300 tx=0x7efebc00f000 comp rx=0 tx=0).stop 2024-05-09T09:47:34.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.971+0000 7efecc02a980 1 -- 172.21.15.157:0/3390871877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d82bb800 msgr2=0x55e4d82bbc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.971+0000 7efecc02a980 1 --2- 172.21.15.157:0/3390871877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d82bb800 0x55e4d82bbc20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efeb40a5010 tx=0x7efeb40c5ea0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.971+0000 7efecc02a980 1 -- 172.21.15.157:0/3390871877 shutdown_connections 2024-05-09T09:47:34.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.971+0000 7efecc02a980 1 --2- 172.21.15.157:0/3390871877 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efda4034c00 0x7efda40370c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.971+0000 7efecc02a980 1 --2- 172.21.15.157:0/3390871877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d82bb800 0x55e4d82bbc20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.971+0000 7efecc02a980 1 -- 172.21.15.157:0/3390871877 >> 172.21.15.157:0/3390871877 conn(0x55e4d82b05d0 msgr2=0x55e4d82b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:34.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.971+0000 7efecc02a980 1 -- 172.21.15.157:0/3390871877 shutdown_connections 2024-05-09T09:47:34.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.971+0000 7efecc02a980 1 -- 172.21.15.157:0/3390871877 wait complete. 2024-05-09T09:47:34.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.971+0000 7efecc02a980 1 -- 172.21.15.157:0/1886551947 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e4d828ef00 msgr2=0x55e4d82912f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.971+0000 7efecc02a980 1 --2- 172.21.15.157:0/1886551947 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e4d828ef00 0x55e4d82912f0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.971+0000 7efecc02a980 1 -- 172.21.15.157:0/1886551947 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e4d8191240 msgr2=0x55e4d828c5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.971+0000 7efecc02a980 1 --2- 172.21.15.157:0/1886551947 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e4d8191240 0x55e4d828c5b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.971+0000 7efecc02a980 1 -- 172.21.15.157:0/1886551947 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e4d8292e20 msgr2=0x55e4d8295210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.971+0000 7efecc02a980 1 --2- 172.21.15.157:0/1886551947 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e4d8292e20 0x55e4d8295210 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.971+0000 7efecc02a980 1 -- 172.21.15.157:0/1886551947 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efdb0034c50 msgr2=0x7efdb0037110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.971+0000 7efecc02a980 1 --2- 172.21.15.157:0/1886551947 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efdb0034c50 0x7efdb0037110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efebc0012f0 tx=0x7efebc006700 comp rx=0 tx=0).stop 2024-05-09T09:47:34.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.971+0000 7efecc02a980 1 -- 172.21.15.157:0/1886551947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d8190920 msgr2=0x55e4d8285620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:34.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.971+0000 7efecc02a980 1 --2- 172.21.15.157:0/1886551947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e4d8190920 0x55e4d8285620 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efeb401b380 tx=0x7efeb40180e0 comp rx=0 tx=0).stop 2024-05-09T09:47:34.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.971+0000 7efeca346640 1 -- 172.21.15.157:0/1886551947 reap_dead start 2024-05-09T09:47:34.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.971+0000 7efecc02a980 1 -- 172.21.15.157:0/1886551947 shutdown_connections 2024-05-09T09:47:34.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.971+0000 7efecc02a980 1 -- 172.21.15.157:0/1886551947 >> 172.21.15.157:0/1886551947 conn(0x55e4d818c1f0 msgr2=0x55e4d8105c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:34.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.971+0000 7efecc02a980 1 -- 172.21.15.157:0/1886551947 shutdown_connections 2024-05-09T09:47:34.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:34.971+0000 7efecc02a980 1 -- 172.21.15.157:0/1886551947 wait complete. 2024-05-09T09:47:34.982 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-09T09:47:32.044078Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:47:32.044055Z', 'tags': [], 'group_ids': []} 2024-05-09T09:47:34.982 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-09T09:47:34.982 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-09T09:47:34.983 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-09T09:47:35.061 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:35.062 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:35.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.063+0000 7f4a93eec980 1 Processor -- start 2024-05-09T09:47:35.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.063+0000 7f4a93eec980 1 -- start start 2024-05-09T09:47:35.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.063+0000 7f4a93eec980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5571f0309d10 0x5571f030c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.063+0000 7f4a93eec980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5571f01bb440 con 0x5571f0279a70 2024-05-09T09:47:35.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.063+0000 7f4a93eec980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5571f01a65f0 con 0x5571f0309d10 2024-05-09T09:47:35.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.063+0000 7f4a91206640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5571f0309d10 0x5571f030c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.063+0000 7f4a91206640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5571f0309d10 0x5571f030c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54504/0 (socket says 172.21.15.157:54504) 2024-05-09T09:47:35.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.063+0000 7f4a91a07640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x5571f0279a70 0x5571f03085f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:33696/0 (socket says 172.21.15.157:33696) 2024-05-09T09:47:35.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.063+0000 7f4a91206640 1 -- 172.21.15.157:0/3033237528 learned_addr learned my addr 172.21.15.157:0/3033237528 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:35.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.067+0000 7f4a91206640 1 -- 172.21.15.157:0/3033237528 >> v1:172.21.15.110:6789/0 conn(0x5571f0279a70 legacy=0x5571f03085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.067+0000 7f4a91206640 1 -- 172.21.15.157:0/3033237528 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571f01b1990 con 0x5571f0309d10 2024-05-09T09:47:35.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.067+0000 7f4a90a05640 1 -- 172.21.15.157:0/3033237528 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3012681898 0 0) 0x5571f01bb440 con 0x5571f0279a70 2024-05-09T09:47:35.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.067+0000 7f4a91206640 1 --2- 172.21.15.157:0/3033237528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f0309d10 0x5571f030c100 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4a8800a5c0 tx=0x7f4a8801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3273054d713431f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.067+0000 7f4a90a05640 1 -- 172.21.15.157:0/3033237528 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a880a6070 con 0x5571f0309d10 2024-05-09T09:47:35.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.067+0000 7f4a90a05640 1 -- 172.21.15.157:0/3033237528 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a880af070 con 0x5571f0309d10 2024-05-09T09:47:35.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.067+0000 7f4a90a05640 1 -- 172.21.15.157:0/3033237528 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a880aa5c0 con 0x5571f0309d10 2024-05-09T09:47:35.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.067+0000 7f4a93eec980 1 -- 172.21.15.157:0/3033237528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f0309d10 msgr2=0x5571f030c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.067+0000 7f4a93eec980 1 --2- 172.21.15.157:0/3033237528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f0309d10 0x5571f030c100 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4a8800a5c0 tx=0x7f4a8801b340 comp rx=0 tx=0).stop 2024-05-09T09:47:35.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.067+0000 7f4a93eec980 1 -- 172.21.15.157:0/3033237528 shutdown_connections 2024-05-09T09:47:35.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.067+0000 7f4a93eec980 1 --2- 172.21.15.157:0/3033237528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f0309d10 0x5571f030c100 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.067+0000 7f4a93eec980 1 -- 172.21.15.157:0/3033237528 >> 172.21.15.157:0/3033237528 conn(0x5571f03000d0 msgr2=0x5571f03024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:35.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.071+0000 7f4a93eec980 1 -- 172.21.15.157:0/3033237528 shutdown_connections 2024-05-09T09:47:35.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.071+0000 7f4a93eec980 1 -- 172.21.15.157:0/3033237528 wait complete. 2024-05-09T09:47:35.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.083+0000 7f4a93eec980 1 Processor -- start 2024-05-09T09:47:35.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.087+0000 7f4a93eec980 1 -- start start 2024-05-09T09:47:35.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.087+0000 7f4a93eec980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f0279a70 0x5571f03f08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.087+0000 7f4a93eec980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5571f0208fe0 con 0x5571f0279a70 2024-05-09T09:47:35.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.087+0000 7f4a91a07640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f0279a70 0x5571f03f08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.087+0000 7f4a91a07640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f0279a70 0x5571f03f08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54512/0 (socket says 172.21.15.157:54512) 2024-05-09T09:47:35.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.087+0000 7f4a91a07640 1 -- 172.21.15.157:0/3470515754 learned_addr learned my addr 172.21.15.157:0/3470515754 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:35.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.087+0000 7f4a91a07640 1 -- 172.21.15.157:0/3470515754 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571f018dae0 con 0x5571f0279a70 2024-05-09T09:47:35.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.087+0000 7f4a91a07640 1 --2- 172.21.15.157:0/3470515754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f0279a70 0x5571f03f08e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4a8400b250 tx=0x7f4a8400b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee4d9bb699212cd4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.087+0000 7f497fe07640 1 -- 172.21.15.157:0/3470515754 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a8400d640 con 0x5571f0279a70 2024-05-09T09:47:35.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.087+0000 7f497fe07640 1 -- 172.21.15.157:0/3470515754 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a84008070 con 0x5571f0279a70 2024-05-09T09:47:35.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.087+0000 7f497fe07640 1 -- 172.21.15.157:0/3470515754 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a8400d990 con 0x5571f0279a70 2024-05-09T09:47:35.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.087+0000 7f4a93eec980 1 -- 172.21.15.157:0/3470515754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f0279a70 msgr2=0x5571f03f08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.087+0000 7f4a93eec980 1 --2- 172.21.15.157:0/3470515754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f0279a70 0x5571f03f08e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4a8400b250 tx=0x7f4a8400b710 comp rx=0 tx=0).stop 2024-05-09T09:47:35.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.087+0000 7f4a93eec980 1 -- 172.21.15.157:0/3470515754 shutdown_connections 2024-05-09T09:47:35.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.087+0000 7f4a93eec980 1 --2- 172.21.15.157:0/3470515754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f0279a70 0x5571f03f08e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.087+0000 7f4a93eec980 1 -- 172.21.15.157:0/3470515754 >> 172.21.15.157:0/3470515754 conn(0x5571f03000d0 msgr2=0x5571f03ec470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:35.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.087+0000 7f4a93eec980 1 -- 172.21.15.157:0/3470515754 shutdown_connections 2024-05-09T09:47:35.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.087+0000 7f4a93eec980 1 -- 172.21.15.157:0/3470515754 wait complete. 2024-05-09T09:47:35.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.087+0000 7f4a93eec980 1 Processor -- start 2024-05-09T09:47:35.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.087+0000 7f4a93eec980 1 -- start start 2024-05-09T09:47:35.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.087+0000 7f4a93eec980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f0279a70 0x5571f03f7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.087+0000 7f4a93eec980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5571f030d1e0 con 0x5571f0279a70 2024-05-09T09:47:35.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.087+0000 7f4a91a07640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f0279a70 0x5571f03f7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.091+0000 7f4a91a07640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f0279a70 0x5571f03f7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54518/0 (socket says 172.21.15.157:54518) 2024-05-09T09:47:35.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.091+0000 7f4a91a07640 1 -- 172.21.15.157:0/418483194 learned_addr learned my addr 172.21.15.157:0/418483194 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:35.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.091+0000 7f4a91a07640 1 -- 172.21.15.157:0/418483194 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571f03f8070 con 0x5571f0279a70 2024-05-09T09:47:35.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.091+0000 7f4a91a07640 1 --2- 172.21.15.157:0/418483194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f0279a70 0x5571f03f7b30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4a84000c10 tx=0x7f4a84000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.091+0000 7f497e604640 1 -- 172.21.15.157:0/418483194 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a8401a7c0 con 0x5571f0279a70 2024-05-09T09:47:35.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.091+0000 7f4a93eec980 1 -- 172.21.15.157:0/418483194 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5571f03f8300 con 0x5571f0279a70 2024-05-09T09:47:35.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.091+0000 7f497e604640 1 -- 172.21.15.157:0/418483194 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a8401a960 con 0x5571f0279a70 2024-05-09T09:47:35.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.091+0000 7f497e604640 1 -- 172.21.15.157:0/418483194 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a8401ac60 con 0x5571f0279a70 2024-05-09T09:47:35.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.091+0000 7f4a93eec980 1 -- 172.21.15.157:0/418483194 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571f03fafe0 con 0x5571f0279a70 2024-05-09T09:47:35.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.091+0000 7f497e604640 1 -- 172.21.15.157:0/418483194 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f4a84017070 con 0x5571f0279a70 2024-05-09T09:47:35.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.091+0000 7f497e604640 1 --2- 172.21.15.157:0/418483194 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4978034c00 0x7f49780370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.091+0000 7f497e604640 1 -- 172.21.15.157:0/418483194 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f4a84015020 con 0x5571f0279a70 2024-05-09T09:47:35.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.091+0000 7f4a93eec980 1 --2- 172.21.15.157:0/418483194 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5571f0309d10 0x5571f03feb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.091+0000 7f4a93eec980 1 -- 172.21.15.157:0/418483194 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5571f03ff160 con 0x5571f0309d10 2024-05-09T09:47:35.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.091+0000 7f4a92208640 1 --2- 172.21.15.157:0/418483194 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5571f0309d10 0x5571f03feb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.091+0000 7f4a91206640 1 --2- 172.21.15.157:0/418483194 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4978034c00 0x7f49780370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.091+0000 7f4a92208640 1 --2- 172.21.15.157:0/418483194 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5571f0309d10 0x5571f03feb20 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.091+0000 7f4a91206640 1 --2- 172.21.15.157:0/418483194 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4978034c00 0x7f49780370c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4a880ae000 tx=0x7f4a880a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.095+0000 7f4a92208640 1 -- 172.21.15.157:0/418483194 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0309d10 2024-05-09T09:47:35.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.095+0000 7f4a93eec980 1 -- 172.21.15.157:0/418483194 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5571f03fc1e0 con 0x5571f0309d10 2024-05-09T09:47:35.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.095+0000 7f4a92208640 1 -- 172.21.15.157:0/418483194 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0309d10 2024-05-09T09:47:35.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.095+0000 7f4a93eec980 1 --2- 172.21.15.157:0/418483194 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5571f0401490 0x5571f0403880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.095+0000 7f4a93eec980 1 -- 172.21.15.157:0/418483194 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5571f0403f50 con 0x5571f0401490 2024-05-09T09:47:35.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.095+0000 7f4a91a07640 1 --2- 172.21.15.157:0/418483194 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5571f0401490 0x5571f0403880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.095+0000 7f4a91a07640 1 --2- 172.21.15.157:0/418483194 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5571f0401490 0x5571f0403880 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.095+0000 7f4a91a07640 1 -- 172.21.15.157:0/418483194 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4a8402e070 con 0x5571f0401490 2024-05-09T09:47:35.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.095+0000 7f4a93eec980 1 -- 172.21.15.157:0/418483194 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5571f0400330 con 0x5571f0309d10 2024-05-09T09:47:35.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.095+0000 7f4a92208640 1 -- 172.21.15.157:0/418483194 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0309d10 2024-05-09T09:47:35.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.095+0000 7f4a93eec980 1 --2- 172.21.15.157:0/418483194 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5571f0405390 0x5571f0407780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.095+0000 7f4a93eec980 1 -- 172.21.15.157:0/418483194 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5571f0407f10 con 0x5571f0405390 2024-05-09T09:47:35.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.095+0000 7f4a91206640 1 --2- 172.21.15.157:0/418483194 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5571f0405390 0x5571f0407780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.095+0000 7f4a91206640 1 --2- 172.21.15.157:0/418483194 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5571f0405390 0x5571f0407780 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.095+0000 7f4a91206640 1 -- 172.21.15.157:0/418483194 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4a880aa9a0 con 0x5571f0405390 2024-05-09T09:47:35.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.099+0000 7f4a93eec980 1 Processor -- start 2024-05-09T09:47:35.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.099+0000 7f4a93eec980 1 -- start start 2024-05-09T09:47:35.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.099+0000 7f4a93eec980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f0306160 0x5571f03045f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.099+0000 7f4a93eec980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5571f020d020 con 0x5571f0306160 2024-05-09T09:47:35.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.099+0000 7f4a91a07640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f0306160 0x5571f03045f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.103+0000 7f4a91a07640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f0306160 0x5571f03045f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54526/0 (socket says 172.21.15.157:54526) 2024-05-09T09:47:35.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.103+0000 7f4a91a07640 1 -- 172.21.15.157:0/2092073093 learned_addr learned my addr 172.21.15.157:0/2092073093 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:35.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.103+0000 7f4a91a07640 1 -- 172.21.15.157:0/2092073093 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571f0304b30 con 0x5571f0306160 2024-05-09T09:47:35.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.103+0000 7f4a91a07640 1 --2- 172.21.15.157:0/2092073093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f0306160 0x5571f03045f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4a8400b750 tx=0x7f4a84019e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.103+0000 7f49763a1640 1 -- 172.21.15.157:0/2092073093 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a84044070 con 0x5571f0306160 2024-05-09T09:47:35.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.103+0000 7f4a93eec980 1 -- 172.21.15.157:0/2092073093 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5571f0304d60 con 0x5571f0306160 2024-05-09T09:47:35.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.103+0000 7f49763a1640 1 -- 172.21.15.157:0/2092073093 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a84045040 con 0x5571f0306160 2024-05-09T09:47:35.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.103+0000 7f4a93eec980 1 -- 172.21.15.157:0/2092073093 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571f0305240 con 0x5571f0306160 2024-05-09T09:47:35.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.103+0000 7f49763a1640 1 -- 172.21.15.157:0/2092073093 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a84042d50 con 0x5571f0306160 2024-05-09T09:47:35.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.103+0000 7f49763a1640 1 -- 172.21.15.157:0/2092073093 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f4a84042160 con 0x5571f0306160 2024-05-09T09:47:35.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.103+0000 7f49763a1640 1 --2- 172.21.15.157:0/2092073093 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f496c034bb0 0x7f496c037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.103+0000 7f49763a1640 1 -- 172.21.15.157:0/2092073093 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f4a84040c90 con 0x5571f0306160 2024-05-09T09:47:35.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.103+0000 7f4a91206640 1 --2- 172.21.15.157:0/2092073093 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f496c034bb0 0x7f496c037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.103+0000 7f4a93eec980 1 Processor -- start 2024-05-09T09:47:35.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.103+0000 7f4a93eec980 1 -- start start 2024-05-09T09:47:35.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.103+0000 7f4a91206640 1 --2- 172.21.15.157:0/2092073093 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f496c034bb0 0x7f496c037070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4a88000c10 tx=0x7f4a88005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.103+0000 7f4a93eec980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f043cfa0 0x5571f043d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.103+0000 7f4a93eec980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5571f03f1030 con 0x5571f043cfa0 2024-05-09T09:47:35.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.103+0000 7f4a91a07640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f043cfa0 0x5571f043d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.103+0000 7f4a91a07640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f043cfa0 0x5571f043d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54542/0 (socket says 172.21.15.157:54542) 2024-05-09T09:47:35.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.107+0000 7f4a91a07640 1 -- 172.21.15.157:0/4157037624 learned_addr learned my addr 172.21.15.157:0/4157037624 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:35.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.107+0000 7f4a91a07640 1 -- 172.21.15.157:0/4157037624 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571f043d970 con 0x5571f043cfa0 2024-05-09T09:47:35.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.107+0000 7f4a91a07640 1 --2- 172.21.15.157:0/4157037624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f043cfa0 0x5571f043d3a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4a8400fed0 tx=0x7f4a840236c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc243d90ee26519 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.107+0000 7f4963fff640 1 -- 172.21.15.157:0/4157037624 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a84063070 con 0x5571f043cfa0 2024-05-09T09:47:35.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.107+0000 7f4963fff640 1 -- 172.21.15.157:0/4157037624 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a84011e00 con 0x5571f043cfa0 2024-05-09T09:47:35.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.107+0000 7f4963fff640 1 -- 172.21.15.157:0/4157037624 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a84032620 con 0x5571f043cfa0 2024-05-09T09:47:35.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.107+0000 7f4a93eec980 1 -- 172.21.15.157:0/4157037624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f043cfa0 msgr2=0x5571f043d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.107+0000 7f4a93eec980 1 --2- 172.21.15.157:0/4157037624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f043cfa0 0x5571f043d3a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4a8400fed0 tx=0x7f4a840236c0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.107+0000 7f4a93eec980 1 -- 172.21.15.157:0/4157037624 shutdown_connections 2024-05-09T09:47:35.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.107+0000 7f4a93eec980 1 --2- 172.21.15.157:0/4157037624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f043cfa0 0x5571f043d3a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.107+0000 7f4a93eec980 1 -- 172.21.15.157:0/4157037624 >> 172.21.15.157:0/4157037624 conn(0x5571f0439370 msgr2=0x5571f04373d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:35.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.107+0000 7f4a93eec980 1 -- 172.21.15.157:0/4157037624 shutdown_connections 2024-05-09T09:47:35.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.107+0000 7f4a93eec980 1 -- 172.21.15.157:0/4157037624 wait complete. 2024-05-09T09:47:35.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.107+0000 7f4a93eec980 1 Processor -- start 2024-05-09T09:47:35.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.107+0000 7f4a93eec980 1 -- start start 2024-05-09T09:47:35.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.107+0000 7f4a93eec980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f043cfa0 0x5571f0444230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.107+0000 7f4a93eec980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5571f043d970 con 0x5571f043cfa0 2024-05-09T09:47:35.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.107+0000 7f4a91a07640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f043cfa0 0x5571f0444230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.107+0000 7f4a91a07640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f043cfa0 0x5571f0444230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54558/0 (socket says 172.21.15.157:54558) 2024-05-09T09:47:35.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.107+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 learned_addr learned my addr 172.21.15.157:0/2131548097 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:35.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.107+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571f0444770 con 0x5571f043cfa0 2024-05-09T09:47:35.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.107+0000 7f4a91a07640 1 --2- 172.21.15.157:0/2131548097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f043cfa0 0x5571f0444230 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4a8401c760 tx=0x7f4a840480a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.107+0000 7f49627fc640 1 -- 172.21.15.157:0/2131548097 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a84063040 con 0x5571f043cfa0 2024-05-09T09:47:35.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.107+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5571f0444770 con 0x5571f043cfa0 2024-05-09T09:47:35.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.107+0000 7f49627fc640 1 -- 172.21.15.157:0/2131548097 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a8406e020 con 0x5571f043cfa0 2024-05-09T09:47:35.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.107+0000 7f49627fc640 1 -- 172.21.15.157:0/2131548097 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a840381a0 con 0x5571f043cfa0 2024-05-09T09:47:35.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.107+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571f0444bf0 con 0x5571f043cfa0 2024-05-09T09:47:35.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f49627fc640 1 -- 172.21.15.157:0/2131548097 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f4a84052b40 con 0x5571f043cfa0 2024-05-09T09:47:35.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f4a93eec980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f49627fc640 1 --2- 172.21.15.157:0/2131548097 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f495c034bb0 0x7f495c037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f49627fc640 1 -- 172.21.15.157:0/2131548097 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f4a8406f030 con 0x5571f043cfa0 2024-05-09T09:47:35.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f4a91206640 1 --2- 172.21.15.157:0/2131548097 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f495c034bb0 0x7f495c037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f4a93eec980 1 --2- 172.21.15.157:0/2131548097 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5571f0450b20 0x5571f0452fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5571f0453730 con 0x5571f0450b20 2024-05-09T09:47:35.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f4a92208640 1 --2- 172.21.15.157:0/2131548097 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5571f0450b20 0x5571f0452fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f4a91206640 1 --2- 172.21.15.157:0/2131548097 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f495c034bb0 0x7f495c037070 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4a880c8fd0 tx=0x7f4a880c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f4a92208640 1 --2- 172.21.15.157:0/2131548097 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5571f0450b20 0x5571f0452fe0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f4a93eec980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:35.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f4a93eec980 20 realm 2024-05-09T09:47:35.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f4a93eec980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5571f0453b40 con 0x5571f0450b20 2024-05-09T09:47:35.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f4a93eec980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:35.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f4a93eec980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:35.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f4a93eec980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5571f04543e0 con 0x5571f0450b20 2024-05-09T09:47:35.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f4a93eec980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:35.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f4a93eec980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x5571f0450b20 2024-05-09T09:47:35.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f4a93eec980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:35.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f4a93eec980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f4a93eec980 1 --2- 172.21.15.157:0/2131548097 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5571f04554e0 0x5571f04578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5571f0457e50 con 0x5571f04554e0 2024-05-09T09:47:35.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.111+0000 7f4a91a07640 1 --2- 172.21.15.157:0/2131548097 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5571f04554e0 0x5571f04578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.115+0000 7f4a91a07640 1 --2- 172.21.15.157:0/2131548097 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5571f04554e0 0x5571f04578d0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.115+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4a84066070 con 0x5571f04554e0 2024-05-09T09:47:35.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.115+0000 7f4a93eec980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:35.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.115+0000 7f4a93eec980 20 searching for the correct realm 2024-05-09T09:47:35.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.115+0000 7f4a93eec980 1 --2- 172.21.15.157:0/2131548097 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5571f0459d80 0x5571f045c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.115+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f045c910 con 0x5571f0459d80 2024-05-09T09:47:35.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.115+0000 7f4a91206640 1 --2- 172.21.15.157:0/2131548097 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5571f0459d80 0x5571f045c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.115+0000 7f4a91206640 1 --2- 172.21.15.157:0/2131548097 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5571f0459d80 0x5571f045c240 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.115+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a880df040 con 0x5571f0459d80 2024-05-09T09:47:35.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.115+0000 7f4a91206640 1 --2- 172.21.15.157:0/2131548097 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f4a880e2040 0x7f4a880e2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.115+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f045c910 con 0x7f4a880e2040 2024-05-09T09:47:35.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.115+0000 7f4a92208640 1 --2- 172.21.15.157:0/2131548097 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f4a880e2040 0x7f4a880e2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.115+0000 7f4a92208640 1 --2- 172.21.15.157:0/2131548097 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f4a880e2040 0x7f4a880e2930 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.115+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x7f4a880e2040 2024-05-09T09:47:35.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.115+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x5571f04554e0 2024-05-09T09:47:35.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.119+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a84066070 con 0x5571f04554e0 2024-05-09T09:47:35.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.119+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x5571f0450b20 2024-05-09T09:47:35.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.119+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.119+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x5571f0450b20 2024-05-09T09:47:35.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.119+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.119+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x5571f04554e0 2024-05-09T09:47:35.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.119+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a84066070 con 0x5571f04554e0 2024-05-09T09:47:35.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.119+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x5571f04554e0 2024-05-09T09:47:35.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.119+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a84066070 con 0x5571f04554e0 2024-05-09T09:47:35.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.119+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x7f4a880e2040 2024-05-09T09:47:35.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.119+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x7f4a880e2040 2024-05-09T09:47:35.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.119+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x5571f0459d80 2024-05-09T09:47:35.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.119+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a880df040 con 0x5571f0459d80 2024-05-09T09:47:35.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.119+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x5571f0450b20 2024-05-09T09:47:35.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.119+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.119+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x5571f04554e0 2024-05-09T09:47:35.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.119+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a84066070 con 0x5571f04554e0 2024-05-09T09:47:35.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.119+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x5571f0450b20 2024-05-09T09:47:35.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.119+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.119+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x7f4a880e2040 2024-05-09T09:47:35.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.123+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x7f4a880e2040 2024-05-09T09:47:35.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.123+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x5571f0459d80 2024-05-09T09:47:35.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.123+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a880df040 con 0x5571f0459d80 2024-05-09T09:47:35.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.123+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x5571f0459d80 2024-05-09T09:47:35.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.123+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4a880df040 con 0x5571f0459d80 2024-05-09T09:47:35.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.123+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x5571f04554e0 2024-05-09T09:47:35.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.123+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a84066070 con 0x5571f04554e0 2024-05-09T09:47:35.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.123+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x5571f0459d80 2024-05-09T09:47:35.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.123+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a880df040 con 0x5571f0459d80 2024-05-09T09:47:35.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.123+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x5571f0459d80 2024-05-09T09:47:35.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.123+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a880df040 con 0x5571f0459d80 2024-05-09T09:47:35.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.123+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x5571f0450b20 2024-05-09T09:47:35.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.123+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.123+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x5571f0450b20 2024-05-09T09:47:35.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.123+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.123+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x5571f04554e0 2024-05-09T09:47:35.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.123+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a84066070 con 0x5571f04554e0 2024-05-09T09:47:35.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.123+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x5571f0459d80 2024-05-09T09:47:35.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.123+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a880df040 con 0x5571f0459d80 2024-05-09T09:47:35.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.123+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x7f4a880e2040 2024-05-09T09:47:35.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.123+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x7f4a880e2040 2024-05-09T09:47:35.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.123+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x5571f0450b20 2024-05-09T09:47:35.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.127+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.127+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x5571f04554e0 2024-05-09T09:47:35.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.127+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4a84066070 con 0x5571f04554e0 2024-05-09T09:47:35.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.127+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x5571f0459d80 2024-05-09T09:47:35.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.127+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a880df040 con 0x5571f0459d80 2024-05-09T09:47:35.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.127+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x5571f04554e0 2024-05-09T09:47:35.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.127+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a84066070 con 0x5571f04554e0 2024-05-09T09:47:35.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.127+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x7f4a880e2040 2024-05-09T09:47:35.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.127+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x7f4a880e2040 2024-05-09T09:47:35.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.127+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x5571f0459d80 2024-05-09T09:47:35.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.127+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a880df040 con 0x5571f0459d80 2024-05-09T09:47:35.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.127+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x5571f04554e0 2024-05-09T09:47:35.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.127+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a84066070 con 0x5571f04554e0 2024-05-09T09:47:35.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.127+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x5571f0450b20 2024-05-09T09:47:35.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.127+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.127+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5571f0454780 con 0x7f4a880e2040 2024-05-09T09:47:35.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x7f4a880e2040 2024-05-09T09:47:35.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:35.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:35.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:35.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:35.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:35.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:35.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5571f04586a0 con 0x5571f0450b20 2024-05-09T09:47:35.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:35.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5571f04586a0 con 0x5571f0450b20 2024-05-09T09:47:35.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:35.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5571f04586a0 con 0x5571f0459d80 2024-05-09T09:47:35.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4a880df040 con 0x5571f0459d80 2024-05-09T09:47:35.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:35.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 20 zone default found 2024-05-09T09:47:35.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 4 Realm: () 2024-05-09T09:47:35.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:35.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:35.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:35.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 20 zonegroup default 2024-05-09T09:47:35.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5571f0458f40 con 0x5571f04554e0 2024-05-09T09:47:35.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4a84066070 con 0x5571f04554e0 2024-05-09T09:47:35.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:35.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5571f045e770 con 0x5571f0459d80 2024-05-09T09:47:35.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4a880df040 con 0x5571f0459d80 2024-05-09T09:47:35.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:35.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5571f045eb10 con 0x5571f0459d80 2024-05-09T09:47:35.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4a880df040 con 0x5571f0459d80 2024-05-09T09:47:35.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:35.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 20 started sync module instance, tier type = 2024-05-09T09:47:35.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:35.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f045dc10 con 0x7f4a880e2040 2024-05-09T09:47:35.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x7f4a880e2040 2024-05-09T09:47:35.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93947850776896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f045dc10 con 0x7f4a880e2040 2024-05-09T09:47:35.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.131+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f045f4d0 con 0x5571f0450b20 2024-05-09T09:47:35.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.135+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93947850776896] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x7f4a880e2040 2024-05-09T09:47:35.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.135+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.135+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93947850780976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f045dc10 con 0x5571f0450b20 2024-05-09T09:47:35.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.135+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f045ff10 con 0x5571f0459d80 2024-05-09T09:47:35.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.139+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93947850780976] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.139+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a880df040 con 0x5571f0459d80 2024-05-09T09:47:35.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.139+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93947850774368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f045db80 con 0x5571f0459d80 2024-05-09T09:47:35.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.139+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f0460c10 con 0x7f4a880e2040 2024-05-09T09:47:35.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.139+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x7f4a880e2040 2024-05-09T09:47:35.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.139+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93947850786928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f0461300 con 0x7f4a880e2040 2024-05-09T09:47:35.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.139+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f0461e00 con 0x5571f0450b20 2024-05-09T09:47:35.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.139+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93947850774368] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a880df040 con 0x5571f0459d80 2024-05-09T09:47:35.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.139+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93947850786928] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x7f4a880e2040 2024-05-09T09:47:35.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.139+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.139+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93947850791152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f0461dc0 con 0x5571f0450b20 2024-05-09T09:47:35.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.139+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f0462220 con 0x5571f04554e0 2024-05-09T09:47:35.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.143+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a84066070 con 0x5571f04554e0 2024-05-09T09:47:35.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.143+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93947850788176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f0462ac0 con 0x5571f04554e0 2024-05-09T09:47:35.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.143+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f0463480 con 0x5571f04554e0 2024-05-09T09:47:35.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.143+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93947850791152] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.143+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93947850788176] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a84066070 con 0x5571f04554e0 2024-05-09T09:47:35.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.147+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a84066070 con 0x5571f04554e0 2024-05-09T09:47:35.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.147+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93947850797008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f0463820 con 0x5571f04554e0 2024-05-09T09:47:35.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.147+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f0464070 con 0x5571f04554e0 2024-05-09T09:47:35.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.147+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93947850797008] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a84066070 con 0x5571f04554e0 2024-05-09T09:47:35.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.147+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a84066070 con 0x5571f04554e0 2024-05-09T09:47:35.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.147+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93947850799136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f0464460 con 0x5571f04554e0 2024-05-09T09:47:35.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.147+0000 7f4a93eec980 20 add_watcher() i=0 2024-05-09T09:47:35.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.147+0000 7f4a93eec980 20 add_watcher() i=1 2024-05-09T09:47:35.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.147+0000 7f4a93eec980 20 add_watcher() i=2 2024-05-09T09:47:35.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.147+0000 7f4a93eec980 20 add_watcher() i=3 2024-05-09T09:47:35.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.147+0000 7f4a93eec980 20 add_watcher() i=4 2024-05-09T09:47:35.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.147+0000 7f4a93eec980 20 add_watcher() i=5 2024-05-09T09:47:35.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.147+0000 7f4a93eec980 20 add_watcher() i=6 2024-05-09T09:47:35.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.151+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93947850799136] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a84066070 con 0x5571f04554e0 2024-05-09T09:47:35.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.151+0000 7f4a93eec980 20 add_watcher() i=7 2024-05-09T09:47:35.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.151+0000 7f4a93eec980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:35.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.151+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5571f0467490 con 0x5571f0450b20 2024-05-09T09:47:35.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.151+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.151+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93947850800656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f04649b0 con 0x5571f0450b20 2024-05-09T09:47:35.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.151+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93947850800656] v30'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.151+0000 7f49477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:35.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.151+0000 7f4a93eec980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:35.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.151+0000 7f4a93eec980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:35.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.151+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f046fb30 con 0x5571f0450b20 2024-05-09T09:47:35.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.155+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'35 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.155+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f0470140 con 0x5571f04554e0 2024-05-09T09:47:35.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.155+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4a84066070 con 0x5571f04554e0 2024-05-09T09:47:35.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.155+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f0470140 con 0x5571f0459d80 2024-05-09T09:47:35.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.159+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'29 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4a880df040 con 0x5571f0459d80 2024-05-09T09:47:35.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.159+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f0470b60 con 0x5571f0450b20 2024-05-09T09:47:35.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.159+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'120 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.159+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f046db10 con 0x7f4a880e2040 2024-05-09T09:47:35.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.159+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'77 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x7f4a880e2040 2024-05-09T09:47:35.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.159+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f046db10 con 0x5571f0459d80 2024-05-09T09:47:35.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.159+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'51 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4a880df040 con 0x5571f0459d80 2024-05-09T09:47:35.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.163+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f0471890 con 0x5571f0450b20 2024-05-09T09:47:35.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.163+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'31 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.163+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f0471d40 con 0x5571f04554e0 2024-05-09T09:47:35.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.167+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'51 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4a84066070 con 0x5571f04554e0 2024-05-09T09:47:35.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.167+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f0471d40 con 0x7f4a880e2040 2024-05-09T09:47:35.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.167+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'29 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x7f4a880e2040 2024-05-09T09:47:35.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.167+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f0471d40 con 0x5571f0459d80 2024-05-09T09:47:35.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.171+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'35 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4a880df040 con 0x5571f0459d80 2024-05-09T09:47:35.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.171+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f04722b0 con 0x7f4a880e2040 2024-05-09T09:47:35.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.171+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'78 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x7f4a880e2040 2024-05-09T09:47:35.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.171+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f04722b0 con 0x5571f04554e0 2024-05-09T09:47:35.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.171+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'31 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a84066070 con 0x5571f04554e0 2024-05-09T09:47:35.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.171+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f04722b0 con 0x7f4a880e2040 2024-05-09T09:47:35.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.175+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'29 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x7f4a880e2040 2024-05-09T09:47:35.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.175+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f0471d40 con 0x5571f04554e0 2024-05-09T09:47:35.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.175+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'57 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a84066070 con 0x5571f04554e0 2024-05-09T09:47:35.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.175+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f0471d40 con 0x5571f0450b20 2024-05-09T09:47:35.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.175+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'121 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.175+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f0471d40 con 0x5571f0459d80 2024-05-09T09:47:35.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.179+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'71 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a880df040 con 0x5571f0459d80 2024-05-09T09:47:35.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.179+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f0471dd0 con 0x7f4a880e2040 2024-05-09T09:47:35.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.179+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'79 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x7f4a880e2040 2024-05-09T09:47:35.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.179+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f0471dd0 con 0x5571f0459d80 2024-05-09T09:47:35.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.183+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a880df040 con 0x5571f0459d80 2024-05-09T09:47:35.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.183+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f0471f00 con 0x5571f0450b20 2024-05-09T09:47:35.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.183+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'37 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.183+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f0472710 con 0x5571f0450b20 2024-05-09T09:47:35.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.183+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'122 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.183+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f0472710 con 0x5571f0459d80 2024-05-09T09:47:35.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.187+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'72 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a880df040 con 0x5571f0459d80 2024-05-09T09:47:35.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.187+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f04727a0 con 0x7f4a880e2040 2024-05-09T09:47:35.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.187+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'39 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x7f4a880e2040 2024-05-09T09:47:35.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.187+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f04727a0 con 0x5571f0459d80 2024-05-09T09:47:35.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.187+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'31 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a880df040 con 0x5571f0459d80 2024-05-09T09:47:35.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.187+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f04727a0 con 0x5571f0459d80 2024-05-09T09:47:35.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.191+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'35 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a880df040 con 0x5571f0459d80 2024-05-09T09:47:35.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.191+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f04727a0 con 0x5571f0459d80 2024-05-09T09:47:35.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.191+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a880df040 con 0x5571f0459d80 2024-05-09T09:47:35.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.191+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f04727a0 con 0x5571f0459d80 2024-05-09T09:47:35.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.191+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'52 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a880df040 con 0x5571f0459d80 2024-05-09T09:47:35.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.191+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f04727a0 con 0x5571f04554e0 2024-05-09T09:47:35.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.195+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'31 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a84066070 con 0x5571f04554e0 2024-05-09T09:47:35.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.195+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f04727a0 con 0x5571f0459d80 2024-05-09T09:47:35.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.195+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a880df040 con 0x5571f0459d80 2024-05-09T09:47:35.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.195+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f04727a0 con 0x5571f04554e0 2024-05-09T09:47:35.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.199+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'52 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a84066070 con 0x5571f04554e0 2024-05-09T09:47:35.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.199+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f04727a0 con 0x5571f0459d80 2024-05-09T09:47:35.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.199+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'73 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a880df040 con 0x5571f0459d80 2024-05-09T09:47:35.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.199+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f04727a0 con 0x5571f04554e0 2024-05-09T09:47:35.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.203+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'58 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a84066070 con 0x5571f04554e0 2024-05-09T09:47:35.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.203+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f04727a0 con 0x7f4a880e2040 2024-05-09T09:47:35.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.203+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'35 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x7f4a880e2040 2024-05-09T09:47:35.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.203+0000 7f49467e4640 20 reqs_thread_entry: start 2024-05-09T09:47:35.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.203+0000 7f4a93eec980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:35.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.207+0000 7f493f7fe640 20 reqs_thread_entry: start 2024-05-09T09:47:35.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.207+0000 7f4a93eec980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.207+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5571f048e330 con 0x5571f0450b20 2024-05-09T09:47:35.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.207+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.207+0000 7f4a93eec980 20 rados_obj.operate() r=0 bl.length=556 2024-05-09T09:47:35.205 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-09T09:47:32.044078Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:47:32.044055Z","tags":[],"group_ids":[]} 2024-05-09T09:47:35.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.207+0000 7f49477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:35.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.207+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93947850800656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f046c8b0 con 0x5571f0450b20 2024-05-09T09:47:35.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.207+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93947850800656] v30'123 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.207+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93947850776896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f0463de0 con 0x7f4a880e2040 2024-05-09T09:47:35.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.211+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93947850776896] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x7f4a880e2040 2024-05-09T09:47:35.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.211+0000 7f4a93eec980 20 remove_watcher() i=0 2024-05-09T09:47:35.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.211+0000 7f4a93eec980 2 removed watcher, disabling cache 2024-05-09T09:47:35.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.211+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93947850780976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f045e140 con 0x5571f0450b20 2024-05-09T09:47:35.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.211+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93947850780976] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.211+0000 7f4a93eec980 20 remove_watcher() i=1 2024-05-09T09:47:35.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.211+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93947850774368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f045f130 con 0x5571f0459d80 2024-05-09T09:47:35.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.215+0000 7f4a91206640 1 -- 172.21.15.157:0/2131548097 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93947850774368] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a880df040 con 0x5571f0459d80 2024-05-09T09:47:35.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.215+0000 7f4a93eec980 20 remove_watcher() i=2 2024-05-09T09:47:35.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.215+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93947850786928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f045f130 con 0x7f4a880e2040 2024-05-09T09:47:35.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.215+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93947850786928] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x7f4a880e2040 2024-05-09T09:47:35.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.215+0000 7f4a93eec980 20 remove_watcher() i=3 2024-05-09T09:47:35.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.215+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93947850791152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f0460870 con 0x5571f0450b20 2024-05-09T09:47:35.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.215+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93947850791152] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a8c00a4d0 con 0x5571f0450b20 2024-05-09T09:47:35.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.219+0000 7f4a93eec980 20 remove_watcher() i=4 2024-05-09T09:47:35.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.219+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93947850788176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f045f130 con 0x5571f04554e0 2024-05-09T09:47:35.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.219+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93947850788176] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a84066070 con 0x5571f04554e0 2024-05-09T09:47:35.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.219+0000 7f4a93eec980 20 remove_watcher() i=5 2024-05-09T09:47:35.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.219+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93947850797008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f04618f0 con 0x5571f04554e0 2024-05-09T09:47:35.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93947850797008] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a84066070 con 0x5571f04554e0 2024-05-09T09:47:35.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 20 remove_watcher() i=6 2024-05-09T09:47:35.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93947850799136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5571f0460870 con 0x5571f04554e0 2024-05-09T09:47:35.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a91a07640 1 -- 172.21.15.157:0/2131548097 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93947850799136] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a84066070 con 0x5571f04554e0 2024-05-09T09:47:35.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 20 remove_watcher() i=7 2024-05-09T09:47:35.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5571f04554e0 msgr2=0x5571f04578d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 --2- 172.21.15.157:0/2131548097 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5571f04554e0 0x5571f04578d0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5571f0450b20 msgr2=0x5571f0452fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 --2- 172.21.15.157:0/2131548097 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5571f0450b20 0x5571f0452fe0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f4a880e2040 msgr2=0x7f4a880e2930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 --2- 172.21.15.157:0/2131548097 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f4a880e2040 0x7f4a880e2930 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5571f0459d80 msgr2=0x5571f045c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 --2- 172.21.15.157:0/2131548097 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5571f0459d80 0x5571f045c240 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f495c034bb0 msgr2=0x7f495c037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 --2- 172.21.15.157:0/2131548097 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f495c034bb0 0x7f495c037070 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4a880c8fd0 tx=0x7f4a880c1040 comp rx=0 tx=0).stop 2024-05-09T09:47:35.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f043cfa0 msgr2=0x5571f0444230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 --2- 172.21.15.157:0/2131548097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f043cfa0 0x5571f0444230 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4a8401c760 tx=0x7f4a840480a0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 reap_dead start 2024-05-09T09:47:35.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a92208640 1 -- 172.21.15.157:0/2131548097 reap_dead start 2024-05-09T09:47:35.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 shutdown_connections 2024-05-09T09:47:35.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 >> 172.21.15.157:0/2131548097 conn(0x5571f0439370 msgr2=0x5571f04369d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:35.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 shutdown_connections 2024-05-09T09:47:35.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 -- 172.21.15.157:0/2131548097 wait complete. 2024-05-09T09:47:35.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 -- 172.21.15.157:0/2092073093 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f496c034bb0 msgr2=0x7f496c037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 --2- 172.21.15.157:0/2092073093 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f496c034bb0 0x7f496c037070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4a88000c10 tx=0x7f4a88005ad0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 -- 172.21.15.157:0/2092073093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f0306160 msgr2=0x5571f03045f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 --2- 172.21.15.157:0/2092073093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f0306160 0x5571f03045f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4a8400b750 tx=0x7f4a84019e20 comp rx=0 tx=0).stop 2024-05-09T09:47:35.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 -- 172.21.15.157:0/2092073093 shutdown_connections 2024-05-09T09:47:35.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 --2- 172.21.15.157:0/2092073093 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f496c034bb0 0x7f496c037070 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 --2- 172.21.15.157:0/2092073093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f0306160 0x5571f03045f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 -- 172.21.15.157:0/2092073093 >> 172.21.15.157:0/2092073093 conn(0x5571f0422b20 msgr2=0x5571f0423630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:35.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 -- 172.21.15.157:0/2092073093 shutdown_connections 2024-05-09T09:47:35.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 -- 172.21.15.157:0/2092073093 wait complete. 2024-05-09T09:47:35.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 -- 172.21.15.157:0/418483194 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5571f0401490 msgr2=0x5571f0403880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 --2- 172.21.15.157:0/418483194 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5571f0401490 0x5571f0403880 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 -- 172.21.15.157:0/418483194 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5571f0309d10 msgr2=0x5571f03feb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 --2- 172.21.15.157:0/418483194 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5571f0309d10 0x5571f03feb20 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 -- 172.21.15.157:0/418483194 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5571f0405390 msgr2=0x5571f0407780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 --2- 172.21.15.157:0/418483194 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5571f0405390 0x5571f0407780 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 -- 172.21.15.157:0/418483194 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4978034c00 msgr2=0x7f49780370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 --2- 172.21.15.157:0/418483194 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4978034c00 0x7f49780370c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4a880ae000 tx=0x7f4a880a6000 comp rx=0 tx=0).stop 2024-05-09T09:47:35.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 -- 172.21.15.157:0/418483194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f0279a70 msgr2=0x5571f03f7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 --2- 172.21.15.157:0/418483194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5571f0279a70 0x5571f03f7b30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4a84000c10 tx=0x7f4a84000ee0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a92208640 1 -- 172.21.15.157:0/418483194 reap_dead start 2024-05-09T09:47:35.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 -- 172.21.15.157:0/418483194 shutdown_connections 2024-05-09T09:47:35.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 -- 172.21.15.157:0/418483194 >> 172.21.15.157:0/418483194 conn(0x5571f03000d0 msgr2=0x5571f03eaf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:35.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 -- 172.21.15.157:0/418483194 shutdown_connections 2024-05-09T09:47:35.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.223+0000 7f4a93eec980 1 -- 172.21.15.157:0/418483194 wait complete. 2024-05-09T09:47:35.235 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-09T09:47:32.044078Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:47:32.044055Z', 'tags': [], 'group_ids': []} 2024-05-09T09:47:35.235 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-09T09:47:35.236 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-09T09:47:35.236 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-09T09:47:35.317 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:35.317 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:35.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.319+0000 7f88906bd980 1 Processor -- start 2024-05-09T09:47:35.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.319+0000 7f88906bd980 1 -- start start 2024-05-09T09:47:35.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.319+0000 7f88906bd980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x561f53dd5030 0x561f53dd7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.319+0000 7f88906bd980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561f53c84440 con 0x561f53dd0b30 2024-05-09T09:47:35.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.319+0000 7f88906bd980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x561f53c6f5f0 con 0x561f53dd5030 2024-05-09T09:47:35.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.319+0000 7f888d9d7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x561f53dd5030 0x561f53dd7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.319+0000 7f888e1d8640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x561f53dd0b30 0x561f53dd0f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:33706/0 (socket says 172.21.15.157:33706) 2024-05-09T09:47:35.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.319+0000 7f888d9d7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x561f53dd5030 0x561f53dd7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54574/0 (socket says 172.21.15.157:54574) 2024-05-09T09:47:35.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.319+0000 7f888e1d8640 1 -- 172.21.15.157:0/2550560398 learned_addr learned my addr 172.21.15.157:0/2550560398 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:47:35.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.319+0000 7f888d9d7640 1 -- 172.21.15.157:0/2550560398 >> v1:172.21.15.110:6789/0 conn(0x561f53dd0b30 legacy=0x561f53dd0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.319+0000 7f888d9d7640 1 -- 172.21.15.157:0/2550560398 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f53c7a990 con 0x561f53dd5030 2024-05-09T09:47:35.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.323+0000 7f888d9d7640 1 --2- 172.21.15.157:0/2550560398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53dd5030 0x561f53dd7420 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f888400a480 tx=0x7f888401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6518ffd1045720c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.323+0000 7f888d1d6640 1 -- 172.21.15.157:0/2550560398 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88840b0070 con 0x561f53dd5030 2024-05-09T09:47:35.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.323+0000 7f888d1d6640 1 -- 172.21.15.157:0/2550560398 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88840ab540 con 0x561f53dd5030 2024-05-09T09:47:35.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.323+0000 7f888d1d6640 1 -- 172.21.15.157:0/2550560398 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88840ab840 con 0x561f53dd5030 2024-05-09T09:47:35.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.323+0000 7f88906bd980 1 -- 172.21.15.157:0/2550560398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53dd5030 msgr2=0x561f53dd7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.323+0000 7f88906bd980 1 --2- 172.21.15.157:0/2550560398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53dd5030 0x561f53dd7420 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f888400a480 tx=0x7f888401b280 comp rx=0 tx=0).stop 2024-05-09T09:47:35.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.323+0000 7f88906bd980 1 -- 172.21.15.157:0/2550560398 shutdown_connections 2024-05-09T09:47:35.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.323+0000 7f88906bd980 1 --2- 172.21.15.157:0/2550560398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53dd5030 0x561f53dd7420 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.323+0000 7f88906bd980 1 -- 172.21.15.157:0/2550560398 >> 172.21.15.157:0/2550560398 conn(0x561f53d44250 msgr2=0x561f53d44660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:35.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.323+0000 7f88906bd980 1 -- 172.21.15.157:0/2550560398 shutdown_connections 2024-05-09T09:47:35.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.323+0000 7f88906bd980 1 -- 172.21.15.157:0/2550560398 wait complete. 2024-05-09T09:47:35.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.339+0000 7f88906bd980 1 Processor -- start 2024-05-09T09:47:35.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.339+0000 7f88906bd980 1 -- start start 2024-05-09T09:47:35.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.339+0000 7f88906bd980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53dd0b30 0x561f53ebbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.339+0000 7f88906bd980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561f53cd1fe0 con 0x561f53dd0b30 2024-05-09T09:47:35.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.339+0000 7f888e1d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53dd0b30 0x561f53ebbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.339+0000 7f888e1d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53dd0b30 0x561f53ebbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54578/0 (socket says 172.21.15.157:54578) 2024-05-09T09:47:35.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.339+0000 7f888e1d8640 1 -- 172.21.15.157:0/2141091967 learned_addr learned my addr 172.21.15.157:0/2141091967 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:35.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.343+0000 7f888e1d8640 1 -- 172.21.15.157:0/2141091967 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f53c56ae0 con 0x561f53dd0b30 2024-05-09T09:47:35.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.343+0000 7f888e1d8640 1 --2- 172.21.15.157:0/2141091967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53dd0b30 0x561f53ebbd30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f88800015f0 tx=0x7f8880001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e89b63c6c115c9e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.343+0000 7f877c608640 1 -- 172.21.15.157:0/2141091967 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8880004530 con 0x561f53dd0b30 2024-05-09T09:47:35.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.343+0000 7f877c608640 1 -- 172.21.15.157:0/2141091967 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88800046f0 con 0x561f53dd0b30 2024-05-09T09:47:35.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.343+0000 7f877c608640 1 -- 172.21.15.157:0/2141091967 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8880004a90 con 0x561f53dd0b30 2024-05-09T09:47:35.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.343+0000 7f88906bd980 1 -- 172.21.15.157:0/2141091967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53dd0b30 msgr2=0x561f53ebbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.343+0000 7f88906bd980 1 --2- 172.21.15.157:0/2141091967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53dd0b30 0x561f53ebbd30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f88800015f0 tx=0x7f8880001ab0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.343+0000 7f88906bd980 1 -- 172.21.15.157:0/2141091967 shutdown_connections 2024-05-09T09:47:35.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.343+0000 7f88906bd980 1 --2- 172.21.15.157:0/2141091967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53dd0b30 0x561f53ebbd30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.343+0000 7f88906bd980 1 -- 172.21.15.157:0/2141091967 >> 172.21.15.157:0/2141091967 conn(0x561f53d44250 msgr2=0x561f53eb78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:35.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.343+0000 7f88906bd980 1 -- 172.21.15.157:0/2141091967 shutdown_connections 2024-05-09T09:47:35.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.343+0000 7f88906bd980 1 -- 172.21.15.157:0/2141091967 wait complete. 2024-05-09T09:47:35.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.343+0000 7f88906bd980 1 Processor -- start 2024-05-09T09:47:35.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.343+0000 7f88906bd980 1 -- start start 2024-05-09T09:47:35.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.343+0000 7f88906bd980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53dd0b30 0x561f53ec2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.343+0000 7f88906bd980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561f53dda450 con 0x561f53dd0b30 2024-05-09T09:47:35.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.343+0000 7f888e1d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53dd0b30 0x561f53ec2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.343+0000 7f888e1d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53dd0b30 0x561f53ec2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54584/0 (socket says 172.21.15.157:54584) 2024-05-09T09:47:35.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.343+0000 7f888e1d8640 1 -- 172.21.15.157:0/39039596 learned_addr learned my addr 172.21.15.157:0/39039596 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:35.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.343+0000 7f888e1d8640 1 -- 172.21.15.157:0/39039596 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f53ec3490 con 0x561f53dd0b30 2024-05-09T09:47:35.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.343+0000 7f888e1d8640 1 --2- 172.21.15.157:0/39039596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53dd0b30 0x561f53ec2f50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x561f53ebcbc0 tx=0x7f8880000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.347+0000 7f877ae05640 1 -- 172.21.15.157:0/39039596 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8880013760 con 0x561f53dd0b30 2024-05-09T09:47:35.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.347+0000 7f877ae05640 1 -- 172.21.15.157:0/39039596 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8880013900 con 0x561f53dd0b30 2024-05-09T09:47:35.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.347+0000 7f877ae05640 1 -- 172.21.15.157:0/39039596 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8880013be0 con 0x561f53dd0b30 2024-05-09T09:47:35.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.347+0000 7f88906bd980 1 -- 172.21.15.157:0/39039596 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f53ec3720 con 0x561f53dd0b30 2024-05-09T09:47:35.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.347+0000 7f88906bd980 1 -- 172.21.15.157:0/39039596 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f53ec63b0 con 0x561f53dd0b30 2024-05-09T09:47:35.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.347+0000 7f877ae05640 1 -- 172.21.15.157:0/39039596 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f8880010070 con 0x561f53dd0b30 2024-05-09T09:47:35.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.347+0000 7f877ae05640 1 --2- 172.21.15.157:0/39039596 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8774034bb0 0x7f8774037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.347+0000 7f877ae05640 1 -- 172.21.15.157:0/39039596 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f8880018070 con 0x561f53dd0b30 2024-05-09T09:47:35.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.347+0000 7f88906bd980 1 --2- 172.21.15.157:0/39039596 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561f53dd5030 0x561f53ec9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.347+0000 7f888d9d7640 1 --2- 172.21.15.157:0/39039596 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8774034bb0 0x7f8774037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.347+0000 7f88906bd980 1 -- 172.21.15.157:0/39039596 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561f53eca520 con 0x561f53dd5030 2024-05-09T09:47:35.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.347+0000 7f888e9d9640 1 --2- 172.21.15.157:0/39039596 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561f53dd5030 0x561f53ec9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.347+0000 7f888e9d9640 1 --2- 172.21.15.157:0/39039596 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561f53dd5030 0x561f53ec9eb0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.347+0000 7f888d9d7640 1 --2- 172.21.15.157:0/39039596 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8774034bb0 0x7f8774037070 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f88840ad000 tx=0x7f88840a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.347+0000 7f888e9d9640 1 -- 172.21.15.157:0/39039596 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88880083f0 con 0x561f53dd5030 2024-05-09T09:47:35.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.347+0000 7f88906bd980 1 -- 172.21.15.157:0/39039596 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561f53ec75b0 con 0x561f53dd5030 2024-05-09T09:47:35.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.347+0000 7f888e9d9640 1 -- 172.21.15.157:0/39039596 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f88880083f0 con 0x561f53dd5030 2024-05-09T09:47:35.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.347+0000 7f88906bd980 1 --2- 172.21.15.157:0/39039596 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561f53ecc8a0 0x561f53ecec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.347+0000 7f88906bd980 1 -- 172.21.15.157:0/39039596 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561f53ecf380 con 0x561f53ecc8a0 2024-05-09T09:47:35.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.347+0000 7f888e1d8640 1 --2- 172.21.15.157:0/39039596 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561f53ecc8a0 0x561f53ecec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.351+0000 7f888e1d8640 1 --2- 172.21.15.157:0/39039596 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561f53ecc8a0 0x561f53ecec90 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.351+0000 7f888e1d8640 1 -- 172.21.15.157:0/39039596 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f888001b030 con 0x561f53ecc8a0 2024-05-09T09:47:35.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.351+0000 7f88906bd980 1 -- 172.21.15.157:0/39039596 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561f53ecb740 con 0x561f53dd5030 2024-05-09T09:47:35.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.351+0000 7f888e9d9640 1 -- 172.21.15.157:0/39039596 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f88880083f0 con 0x561f53dd5030 2024-05-09T09:47:35.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.351+0000 7f88906bd980 1 --2- 172.21.15.157:0/39039596 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561f53ed07e0 0x561f53ed2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.351+0000 7f88906bd980 1 -- 172.21.15.157:0/39039596 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561f53ed3310 con 0x561f53ed07e0 2024-05-09T09:47:35.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.351+0000 7f888d9d7640 1 --2- 172.21.15.157:0/39039596 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561f53ed07e0 0x561f53ed2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.351+0000 7f888d9d7640 1 --2- 172.21.15.157:0/39039596 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561f53ed07e0 0x561f53ed2bd0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.351+0000 7f888d9d7640 1 -- 172.21.15.157:0/39039596 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f88840b3040 con 0x561f53ed07e0 2024-05-09T09:47:35.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.355+0000 7f88906bd980 1 Processor -- start 2024-05-09T09:47:35.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.355+0000 7f88906bd980 1 -- start start 2024-05-09T09:47:35.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.355+0000 7f88906bd980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53ef9130 0x561f53ef9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.355+0000 7f88906bd980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561f53cd6020 con 0x561f53ef9130 2024-05-09T09:47:35.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.355+0000 7f888e1d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53ef9130 0x561f53ef9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.355+0000 7f888e1d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53ef9130 0x561f53ef9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54588/0 (socket says 172.21.15.157:54588) 2024-05-09T09:47:35.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.355+0000 7f888e1d8640 1 -- 172.21.15.157:0/2529392001 learned_addr learned my addr 172.21.15.157:0/2529392001 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:35.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.355+0000 7f888e1d8640 1 -- 172.21.15.157:0/2529392001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f53ef9a90 con 0x561f53ef9130 2024-05-09T09:47:35.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.355+0000 7f888e1d8640 1 --2- 172.21.15.157:0/2529392001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53ef9130 0x561f53ef9550 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8880048a20 tx=0x7f8880010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.355+0000 7f8772ba2640 1 -- 172.21.15.157:0/2529392001 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8880038070 con 0x561f53ef9130 2024-05-09T09:47:35.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.355+0000 7f88906bd980 1 -- 172.21.15.157:0/2529392001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f53efa520 con 0x561f53ef9130 2024-05-09T09:47:35.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.355+0000 7f8772ba2640 1 -- 172.21.15.157:0/2529392001 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88800298a0 con 0x561f53ef9130 2024-05-09T09:47:35.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.355+0000 7f88906bd980 1 -- 172.21.15.157:0/2529392001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f53efaa00 con 0x561f53ef9130 2024-05-09T09:47:35.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.359+0000 7f8772ba2640 1 -- 172.21.15.157:0/2529392001 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f888004a1a0 con 0x561f53ef9130 2024-05-09T09:47:35.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.359+0000 7f8772ba2640 1 -- 172.21.15.157:0/2529392001 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f8880048b00 con 0x561f53ef9130 2024-05-09T09:47:35.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.359+0000 7f8772ba2640 1 --2- 172.21.15.157:0/2529392001 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8768034bb0 0x7f8768037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.359+0000 7f8772ba2640 1 -- 172.21.15.157:0/2529392001 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f888003c020 con 0x561f53ef9130 2024-05-09T09:47:35.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.359+0000 7f888d9d7640 1 --2- 172.21.15.157:0/2529392001 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8768034bb0 0x7f8768037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.359+0000 7f88906bd980 1 Processor -- start 2024-05-09T09:47:35.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.359+0000 7f88906bd980 1 -- start start 2024-05-09T09:47:35.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.359+0000 7f888d9d7640 1 --2- 172.21.15.157:0/2529392001 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8768034bb0 0x7f8768037070 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x561f53ecaa40 tx=0x7f8884005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.359+0000 7f88906bd980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53f060d0 0x561f53f064b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.359+0000 7f88906bd980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561f53ebc480 con 0x561f53f060d0 2024-05-09T09:47:35.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.359+0000 7f888e1d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53f060d0 0x561f53f064b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.359+0000 7f888e1d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53f060d0 0x561f53f064b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54592/0 (socket says 172.21.15.157:54592) 2024-05-09T09:47:35.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.359+0000 7f888e1d8640 1 -- 172.21.15.157:0/3449564923 learned_addr learned my addr 172.21.15.157:0/3449564923 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:35.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.359+0000 7f888e1d8640 1 -- 172.21.15.157:0/3449564923 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f53f06a80 con 0x561f53f060d0 2024-05-09T09:47:35.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.363+0000 7f888e1d8640 1 --2- 172.21.15.157:0/3449564923 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53f060d0 0x561f53f064b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8880028fd0 tx=0x7f8880034b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e118642c8c819d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.363+0000 7f8770b9e640 1 -- 172.21.15.157:0/3449564923 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8880057070 con 0x561f53f060d0 2024-05-09T09:47:35.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.363+0000 7f8770b9e640 1 -- 172.21.15.157:0/3449564923 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8880047600 con 0x561f53f060d0 2024-05-09T09:47:35.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.363+0000 7f8770b9e640 1 -- 172.21.15.157:0/3449564923 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f888000b150 con 0x561f53f060d0 2024-05-09T09:47:35.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.363+0000 7f88906bd980 1 -- 172.21.15.157:0/3449564923 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53f060d0 msgr2=0x561f53f064b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.363+0000 7f88906bd980 1 --2- 172.21.15.157:0/3449564923 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53f060d0 0x561f53f064b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8880028fd0 tx=0x7f8880034b90 comp rx=0 tx=0).stop 2024-05-09T09:47:35.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.363+0000 7f88906bd980 1 -- 172.21.15.157:0/3449564923 shutdown_connections 2024-05-09T09:47:35.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.363+0000 7f88906bd980 1 --2- 172.21.15.157:0/3449564923 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53f060d0 0x561f53f064b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.363+0000 7f88906bd980 1 -- 172.21.15.157:0/3449564923 >> 172.21.15.157:0/3449564923 conn(0x561f53f024a0 msgr2=0x561f53f00500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:35.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.363+0000 7f88906bd980 1 -- 172.21.15.157:0/3449564923 shutdown_connections 2024-05-09T09:47:35.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.363+0000 7f88906bd980 1 -- 172.21.15.157:0/3449564923 wait complete. 2024-05-09T09:47:35.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.363+0000 7f88906bd980 1 Processor -- start 2024-05-09T09:47:35.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.363+0000 7f88906bd980 1 -- start start 2024-05-09T09:47:35.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.363+0000 7f88906bd980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53f060d0 0x561f53f0d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.363+0000 7f88906bd980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561f53f07060 con 0x561f53f060d0 2024-05-09T09:47:35.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.363+0000 7f888e1d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53f060d0 0x561f53f0d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.363+0000 7f888e1d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53f060d0 0x561f53f0d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:54604/0 (socket says 172.21.15.157:54604) 2024-05-09T09:47:35.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.363+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 learned_addr learned my addr 172.21.15.157:0/1689774855 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:35.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.367+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f53f0da40 con 0x561f53f060d0 2024-05-09T09:47:35.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.367+0000 7f888e1d8640 1 --2- 172.21.15.157:0/1689774855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53f060d0 0x561f53f0d500 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8880048fd0 tx=0x7f888001f0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.367+0000 7f875effd640 1 -- 172.21.15.157:0/1689774855 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f888001d5e0 con 0x561f53f060d0 2024-05-09T09:47:35.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.367+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f53f0da40 con 0x561f53f060d0 2024-05-09T09:47:35.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.367+0000 7f875effd640 1 -- 172.21.15.157:0/1689774855 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8880040410 con 0x561f53f060d0 2024-05-09T09:47:35.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.367+0000 7f875effd640 1 -- 172.21.15.157:0/1689774855 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8880011ce0 con 0x561f53f060d0 2024-05-09T09:47:35.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.367+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f53f0da40 con 0x561f53f060d0 2024-05-09T09:47:35.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.367+0000 7f875effd640 1 -- 172.21.15.157:0/1689774855 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f88800470e0 con 0x561f53f060d0 2024-05-09T09:47:35.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.367+0000 7f875effd640 1 --2- 172.21.15.157:0/1689774855 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8758034bb0 0x7f8758037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.367+0000 7f875effd640 1 -- 172.21.15.157:0/1689774855 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f8880068030 con 0x561f53f060d0 2024-05-09T09:47:35.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.367+0000 7f88906bd980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.367+0000 7f888d9d7640 1 --2- 172.21.15.157:0/1689774855 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8758034bb0 0x7f8758037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.367+0000 7f88906bd980 1 --2- 172.21.15.157:0/1689774855 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561f53f19f50 0x561f53f1c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.367+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561f53f1cb60 con 0x561f53f19f50 2024-05-09T09:47:35.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.367+0000 7f888e9d9640 1 --2- 172.21.15.157:0/1689774855 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561f53f19f50 0x561f53f1c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.367+0000 7f888d9d7640 1 --2- 172.21.15.157:0/1689774855 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8758034bb0 0x7f8758037070 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f88840abfd0 tx=0x7f88840a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.367+0000 7f888e9d9640 1 --2- 172.21.15.157:0/1689774855 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561f53f19f50 0x561f53f1c410 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.367+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88880083f0 con 0x561f53f19f50 2024-05-09T09:47:35.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.367+0000 7f88906bd980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:35.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.367+0000 7f88906bd980 20 realm 2024-05-09T09:47:35.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.367+0000 7f88906bd980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.367+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561f53f1cf70 con 0x561f53f19f50 2024-05-09T09:47:35.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.371+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88880083f0 con 0x561f53f19f50 2024-05-09T09:47:35.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.371+0000 7f88906bd980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:35.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.371+0000 7f88906bd980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:35.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.371+0000 7f88906bd980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.371+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561f53f1d840 con 0x561f53f19f50 2024-05-09T09:47:35.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.371+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88880083f0 con 0x561f53f19f50 2024-05-09T09:47:35.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.371+0000 7f88906bd980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:35.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.371+0000 7f88906bd980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.371+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561f53f1dbe0 con 0x561f53f19f50 2024-05-09T09:47:35.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.371+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f88880083f0 con 0x561f53f19f50 2024-05-09T09:47:35.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.371+0000 7f88906bd980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:35.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.371+0000 7f88906bd980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.371+0000 7f88906bd980 1 --2- 172.21.15.157:0/1689774855 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561f53f1e710 0x561f53f20b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.371+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561f53f21240 con 0x561f53f1e710 2024-05-09T09:47:35.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.371+0000 7f888e1d8640 1 --2- 172.21.15.157:0/1689774855 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561f53f1e710 0x561f53f20b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.371+0000 7f888e1d8640 1 --2- 172.21.15.157:0/1689774855 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561f53f1e710 0x561f53f20b00 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.371+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f888001b030 con 0x561f53f1e710 2024-05-09T09:47:35.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.371+0000 7f88906bd980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:35.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.371+0000 7f88906bd980 20 searching for the correct realm 2024-05-09T09:47:35.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.371+0000 7f88906bd980 1 --2- 172.21.15.157:0/1689774855 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561f53f231e0 0x561f53f25670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.371+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561f53f25d40 con 0x561f53f231e0 2024-05-09T09:47:35.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.371+0000 7f888d9d7640 1 --2- 172.21.15.157:0/1689774855 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561f53f231e0 0x561f53f25670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.371+0000 7f888d9d7640 1 --2- 172.21.15.157:0/1689774855 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561f53f231e0 0x561f53f25670 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.371+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88840d9070 con 0x561f53f231e0 2024-05-09T09:47:35.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.371+0000 7f888d9d7640 1 --2- 172.21.15.157:0/1689774855 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f88840ce040 0x7f88840db410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.371+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561f53f25d40 con 0x7f88840ce040 2024-05-09T09:47:35.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.375+0000 7f888e9d9640 1 --2- 172.21.15.157:0/1689774855 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f88840ce040 0x7f88840db410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.375+0000 7f888e9d9640 1 --2- 172.21.15.157:0/1689774855 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f88840ce040 0x7f88840db410 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.375+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88880083f0 con 0x7f88840ce040 2024-05-09T09:47:35.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.375+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561f53f1dbe0 con 0x561f53f1e710 2024-05-09T09:47:35.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.375+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f888001b030 con 0x561f53f1e710 2024-05-09T09:47:35.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.375+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561f53f1dbe0 con 0x561f53f19f50 2024-05-09T09:47:35.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.375+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88880083f0 con 0x561f53f19f50 2024-05-09T09:47:35.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.375+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561f53f1dbe0 con 0x561f53f19f50 2024-05-09T09:47:35.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.375+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8888026040 con 0x561f53f19f50 2024-05-09T09:47:35.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.375+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561f53f1dbe0 con 0x561f53f1e710 2024-05-09T09:47:35.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.375+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f888001b030 con 0x561f53f1e710 2024-05-09T09:47:35.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.375+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561f53f1dbe0 con 0x561f53f1e710 2024-05-09T09:47:35.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.375+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f888001b030 con 0x561f53f1e710 2024-05-09T09:47:35.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.375+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561f53f1dbe0 con 0x7f88840ce040 2024-05-09T09:47:35.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.375+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8888026040 con 0x7f88840ce040 2024-05-09T09:47:35.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.375+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561f53f1dbe0 con 0x561f53f231e0 2024-05-09T09:47:35.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.379+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88840d9070 con 0x561f53f231e0 2024-05-09T09:47:35.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.379+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561f53f1dbe0 con 0x561f53f19f50 2024-05-09T09:47:35.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.379+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8888026040 con 0x561f53f19f50 2024-05-09T09:47:35.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.379+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561f53f1dbe0 con 0x561f53f1e710 2024-05-09T09:47:35.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.379+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f888001b030 con 0x561f53f1e710 2024-05-09T09:47:35.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.379+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561f53f1dbe0 con 0x561f53f19f50 2024-05-09T09:47:35.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.379+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8888026040 con 0x561f53f19f50 2024-05-09T09:47:35.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.379+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561f53f1dbe0 con 0x7f88840ce040 2024-05-09T09:47:35.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.379+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8888026040 con 0x7f88840ce040 2024-05-09T09:47:35.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.379+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561f53f1dbe0 con 0x561f53f231e0 2024-05-09T09:47:35.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.379+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88840d9070 con 0x561f53f231e0 2024-05-09T09:47:35.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.379+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f88840e8040 con 0x561f53f231e0 2024-05-09T09:47:35.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.379+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f88840d9070 con 0x561f53f231e0 2024-05-09T09:47:35.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.379+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f88840e8040 con 0x561f53f1e710 2024-05-09T09:47:35.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.379+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f888001b030 con 0x561f53f1e710 2024-05-09T09:47:35.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.379+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f88840e8040 con 0x561f53f231e0 2024-05-09T09:47:35.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.379+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88840d9070 con 0x561f53f231e0 2024-05-09T09:47:35.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.379+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f88840e8040 con 0x561f53f231e0 2024-05-09T09:47:35.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.379+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88840d9070 con 0x561f53f231e0 2024-05-09T09:47:35.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.379+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f88840e8040 con 0x561f53f19f50 2024-05-09T09:47:35.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.383+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8888026040 con 0x561f53f19f50 2024-05-09T09:47:35.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.383+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f88840e8040 con 0x561f53f19f50 2024-05-09T09:47:35.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.383+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8888026040 con 0x561f53f19f50 2024-05-09T09:47:35.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.383+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f88840e8040 con 0x561f53f1e710 2024-05-09T09:47:35.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.383+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f888001b030 con 0x561f53f1e710 2024-05-09T09:47:35.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.383+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f88840e8040 con 0x561f53f231e0 2024-05-09T09:47:35.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.383+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88840d9070 con 0x561f53f231e0 2024-05-09T09:47:35.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.383+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f88840e8040 con 0x7f88840ce040 2024-05-09T09:47:35.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.383+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8888026040 con 0x7f88840ce040 2024-05-09T09:47:35.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.383+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f88840e8040 con 0x561f53f19f50 2024-05-09T09:47:35.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.383+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8888026040 con 0x561f53f19f50 2024-05-09T09:47:35.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.383+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f88840e8040 con 0x561f53f1e710 2024-05-09T09:47:35.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.383+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f888001b030 con 0x561f53f1e710 2024-05-09T09:47:35.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.383+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f88840e8040 con 0x561f53f231e0 2024-05-09T09:47:35.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.383+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88840d9070 con 0x561f53f231e0 2024-05-09T09:47:35.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.383+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f88840e8040 con 0x561f53f1e710 2024-05-09T09:47:35.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.383+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f888001b030 con 0x561f53f1e710 2024-05-09T09:47:35.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.383+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f88840e8040 con 0x7f88840ce040 2024-05-09T09:47:35.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8888026040 con 0x7f88840ce040 2024-05-09T09:47:35.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f88840e8040 con 0x561f53f231e0 2024-05-09T09:47:35.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88840d9070 con 0x561f53f231e0 2024-05-09T09:47:35.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f88840e8040 con 0x561f53f1e710 2024-05-09T09:47:35.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f888001b030 con 0x561f53f1e710 2024-05-09T09:47:35.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f88840e8040 con 0x561f53f19f50 2024-05-09T09:47:35.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8888026040 con 0x561f53f19f50 2024-05-09T09:47:35.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f88840e8040 con 0x7f88840ce040 2024-05-09T09:47:35.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8888026040 con 0x7f88840ce040 2024-05-09T09:47:35.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f88906bd980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:35.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f88906bd980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:35.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f88906bd980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:35.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f88906bd980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:35.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f88906bd980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:35.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f88906bd980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:35.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f88906bd980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561f53f21b00 con 0x561f53f19f50 2024-05-09T09:47:35.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8888026040 con 0x561f53f19f50 2024-05-09T09:47:35.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f88906bd980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:35.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f88906bd980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561f53f21b00 con 0x561f53f19f50 2024-05-09T09:47:35.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8888026040 con 0x561f53f19f50 2024-05-09T09:47:35.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f88906bd980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:35.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f88906bd980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561f53f21b00 con 0x561f53f231e0 2024-05-09T09:47:35.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f88840d9070 con 0x561f53f231e0 2024-05-09T09:47:35.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f88906bd980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:35.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f88906bd980 20 zone default found 2024-05-09T09:47:35.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f88906bd980 4 Realm: () 2024-05-09T09:47:35.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f88906bd980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:35.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f88906bd980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:35.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f88906bd980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:35.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f88906bd980 20 zonegroup default 2024-05-09T09:47:35.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f88906bd980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561f53f223a0 con 0x561f53f1e710 2024-05-09T09:47:35.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f888001b030 con 0x561f53f1e710 2024-05-09T09:47:35.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f88906bd980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:35.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f88906bd980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561f53f27ba0 con 0x561f53f231e0 2024-05-09T09:47:35.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.387+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f88840d9070 con 0x561f53f231e0 2024-05-09T09:47:35.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.391+0000 7f88906bd980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:35.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.391+0000 7f88906bd980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.391+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561f53f27f40 con 0x561f53f231e0 2024-05-09T09:47:35.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.391+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f88840d9070 con 0x561f53f231e0 2024-05-09T09:47:35.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.391+0000 7f88906bd980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:35.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.391+0000 7f88906bd980 20 started sync module instance, tier type = 2024-05-09T09:47:35.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.391+0000 7f88906bd980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:35.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.391+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f27040 con 0x7f88840ce040 2024-05-09T09:47:35.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.391+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8888026040 con 0x7f88840ce040 2024-05-09T09:47:35.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.391+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94692552373648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f27040 con 0x7f88840ce040 2024-05-09T09:47:35.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.391+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f28900 con 0x561f53f19f50 2024-05-09T09:47:35.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.391+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94692552373648] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8888036040 con 0x7f88840ce040 2024-05-09T09:47:35.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.391+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8888036040 con 0x561f53f19f50 2024-05-09T09:47:35.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.391+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94692552377696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f27040 con 0x561f53f19f50 2024-05-09T09:47:35.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.391+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f29340 con 0x561f53f231e0 2024-05-09T09:47:35.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.395+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94692552377696] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8888036040 con 0x561f53f19f50 2024-05-09T09:47:35.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.395+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88840d9070 con 0x561f53f231e0 2024-05-09T09:47:35.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.395+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94692552371088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f26fb0 con 0x561f53f231e0 2024-05-09T09:47:35.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.395+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f2a040 con 0x7f88840ce040 2024-05-09T09:47:35.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.395+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8888036040 con 0x7f88840ce040 2024-05-09T09:47:35.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.395+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94692552383376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f2a460 con 0x7f88840ce040 2024-05-09T09:47:35.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.395+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f2aed0 con 0x561f53f19f50 2024-05-09T09:47:35.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.399+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94692552383376] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8888036040 con 0x7f88840ce040 2024-05-09T09:47:35.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.399+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94692552371088] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88840d9070 con 0x561f53f231e0 2024-05-09T09:47:35.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.399+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8888036040 con 0x561f53f19f50 2024-05-09T09:47:35.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.399+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94692552386976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f29fb0 con 0x561f53f19f50 2024-05-09T09:47:35.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.399+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f2b770 con 0x561f53f1e710 2024-05-09T09:47:35.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.399+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94692552386976] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8888036040 con 0x561f53f19f50 2024-05-09T09:47:35.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.403+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888001b030 con 0x561f53f1e710 2024-05-09T09:47:35.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.403+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94692552389312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f29fb0 con 0x561f53f1e710 2024-05-09T09:47:35.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.403+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f2bfc0 con 0x561f53f1e710 2024-05-09T09:47:35.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.403+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94692552389312] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888001b030 con 0x561f53f1e710 2024-05-09T09:47:35.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.403+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888001b030 con 0x561f53f1e710 2024-05-09T09:47:35.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.403+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94692552382176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f2bfc0 con 0x561f53f1e710 2024-05-09T09:47:35.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.403+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f2c9c0 con 0x561f53f1e710 2024-05-09T09:47:35.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.407+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94692552382176] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888001b030 con 0x561f53f1e710 2024-05-09T09:47:35.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.407+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888001b030 con 0x561f53f1e710 2024-05-09T09:47:35.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.407+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94692552393936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f2cba0 con 0x561f53f1e710 2024-05-09T09:47:35.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.407+0000 7f88906bd980 20 add_watcher() i=0 2024-05-09T09:47:35.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.407+0000 7f88906bd980 20 add_watcher() i=1 2024-05-09T09:47:35.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.407+0000 7f88906bd980 20 add_watcher() i=2 2024-05-09T09:47:35.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.407+0000 7f88906bd980 20 add_watcher() i=3 2024-05-09T09:47:35.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.407+0000 7f88906bd980 20 add_watcher() i=4 2024-05-09T09:47:35.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.407+0000 7f88906bd980 20 add_watcher() i=5 2024-05-09T09:47:35.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.407+0000 7f88906bd980 20 add_watcher() i=6 2024-05-09T09:47:35.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.407+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94692552393936] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888001b030 con 0x561f53f1e710 2024-05-09T09:47:35.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.407+0000 7f88906bd980 20 add_watcher() i=7 2024-05-09T09:47:35.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.407+0000 7f88906bd980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:35.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.407+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561f53f2ff70 con 0x561f53f19f50 2024-05-09T09:47:35.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.407+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8888036040 con 0x561f53f19f50 2024-05-09T09:47:35.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.407+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94692552395408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f2d360 con 0x561f53f19f50 2024-05-09T09:47:35.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.411+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94692552395408] v30'124 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8888036040 con 0x561f53f19f50 2024-05-09T09:47:35.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.411+0000 7f87437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:35.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.411+0000 7f88906bd980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:35.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.411+0000 7f88906bd980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:35.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.411+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f384b0 con 0x561f53f19f50 2024-05-09T09:47:35.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.411+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'36 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8888036040 con 0x561f53f19f50 2024-05-09T09:47:35.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.411+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f38aa0 con 0x561f53f1e710 2024-05-09T09:47:35.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.415+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'30 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f888001b030 con 0x561f53f1e710 2024-05-09T09:47:35.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.415+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f38aa0 con 0x561f53f231e0 2024-05-09T09:47:35.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.415+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'30 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88840d9070 con 0x561f53f231e0 2024-05-09T09:47:35.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.415+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f39050 con 0x561f53f19f50 2024-05-09T09:47:35.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.415+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'125 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8888036040 con 0x561f53f19f50 2024-05-09T09:47:35.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.415+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f39500 con 0x7f88840ce040 2024-05-09T09:47:35.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.419+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'80 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8888036040 con 0x7f88840ce040 2024-05-09T09:47:35.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.419+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f39a70 con 0x561f53f231e0 2024-05-09T09:47:35.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.419+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'53 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88840d9070 con 0x561f53f231e0 2024-05-09T09:47:35.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.419+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f39f20 con 0x561f53f19f50 2024-05-09T09:47:35.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.423+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'32 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8888036040 con 0x561f53f19f50 2024-05-09T09:47:35.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.423+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f39de0 con 0x561f53f1e710 2024-05-09T09:47:35.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.423+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'53 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f888001b030 con 0x561f53f1e710 2024-05-09T09:47:35.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.423+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f39de0 con 0x7f88840ce040 2024-05-09T09:47:35.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.427+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'30 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8888036040 con 0x7f88840ce040 2024-05-09T09:47:35.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.427+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f39de0 con 0x561f53f231e0 2024-05-09T09:47:35.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.427+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'36 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88840d9070 con 0x561f53f231e0 2024-05-09T09:47:35.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.427+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f3a3d0 con 0x7f88840ce040 2024-05-09T09:47:35.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.427+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'81 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8888036040 con 0x7f88840ce040 2024-05-09T09:47:35.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.431+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f3a3b0 con 0x561f53f1e710 2024-05-09T09:47:35.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.431+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'32 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f888001b030 con 0x561f53f1e710 2024-05-09T09:47:35.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.431+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f3a370 con 0x7f88840ce040 2024-05-09T09:47:35.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.431+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'30 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8888036040 con 0x7f88840ce040 2024-05-09T09:47:35.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.431+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f3a370 con 0x561f53f1e710 2024-05-09T09:47:35.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.435+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'59 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f888001b030 con 0x561f53f1e710 2024-05-09T09:47:35.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.435+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f3a370 con 0x561f53f19f50 2024-05-09T09:47:35.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.439+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'126 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8888036040 con 0x561f53f19f50 2024-05-09T09:47:35.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.439+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f3a370 con 0x561f53f231e0 2024-05-09T09:47:35.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.439+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'74 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88840d9070 con 0x561f53f231e0 2024-05-09T09:47:35.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.439+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f3a400 con 0x7f88840ce040 2024-05-09T09:47:35.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.443+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'82 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8888036040 con 0x7f88840ce040 2024-05-09T09:47:35.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.443+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f3a400 con 0x561f53f231e0 2024-05-09T09:47:35.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.443+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'30 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88840d9070 con 0x561f53f231e0 2024-05-09T09:47:35.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.443+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f3a400 con 0x561f53f19f50 2024-05-09T09:47:35.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.447+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'38 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8888036040 con 0x561f53f19f50 2024-05-09T09:47:35.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.447+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f3a400 con 0x561f53f19f50 2024-05-09T09:47:35.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.447+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'127 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8888036040 con 0x561f53f19f50 2024-05-09T09:47:35.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.447+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f3a400 con 0x561f53f231e0 2024-05-09T09:47:35.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.447+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'75 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88840d9070 con 0x561f53f231e0 2024-05-09T09:47:35.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.447+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f3a4a0 con 0x7f88840ce040 2024-05-09T09:47:35.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.451+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'40 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8888036040 con 0x7f88840ce040 2024-05-09T09:47:35.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.451+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f39cb0 con 0x561f53f231e0 2024-05-09T09:47:35.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.451+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'32 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88840d9070 con 0x561f53f231e0 2024-05-09T09:47:35.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.451+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f39cb0 con 0x561f53f231e0 2024-05-09T09:47:35.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.455+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'36 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88840d9070 con 0x561f53f231e0 2024-05-09T09:47:35.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.455+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f39cb0 con 0x561f53f231e0 2024-05-09T09:47:35.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.455+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88840d9070 con 0x561f53f231e0 2024-05-09T09:47:35.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.455+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f39cb0 con 0x561f53f231e0 2024-05-09T09:47:35.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.455+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'54 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88840d9070 con 0x561f53f231e0 2024-05-09T09:47:35.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.455+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f39cb0 con 0x561f53f1e710 2024-05-09T09:47:35.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.459+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'32 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f888001b030 con 0x561f53f1e710 2024-05-09T09:47:35.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.459+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f39cb0 con 0x561f53f231e0 2024-05-09T09:47:35.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.463+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'30 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88840d9070 con 0x561f53f231e0 2024-05-09T09:47:35.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.463+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f39cb0 con 0x561f53f1e710 2024-05-09T09:47:35.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.463+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'54 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f888001b030 con 0x561f53f1e710 2024-05-09T09:47:35.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.463+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f39cb0 con 0x561f53f231e0 2024-05-09T09:47:35.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.467+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'76 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88840d9070 con 0x561f53f231e0 2024-05-09T09:47:35.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.467+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f39cb0 con 0x561f53f1e710 2024-05-09T09:47:35.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.471+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'60 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f888001b030 con 0x561f53f1e710 2024-05-09T09:47:35.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.471+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f39cb0 con 0x7f88840ce040 2024-05-09T09:47:35.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.471+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'36 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8888036040 con 0x7f88840ce040 2024-05-09T09:47:35.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.475+0000 7f87427e4640 20 reqs_thread_entry: start 2024-05-09T09:47:35.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.475+0000 7f88906bd980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:35.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.475+0000 7f86b3fff640 20 reqs_thread_entry: start 2024-05-09T09:47:35.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.475+0000 7f88906bd980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.475+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561f53f560d0 con 0x561f53f19f50 2024-05-09T09:47:35.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.475+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f8888036040 con 0x561f53f19f50 2024-05-09T09:47:35.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.475+0000 7f88906bd980 20 rados_obj.operate() r=0 bl.length=556 2024-05-09T09:47:35.474 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-09T09:47:32.044078Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:47:32.044055Z","tags":[],"group_ids":[]} 2024-05-09T09:47:35.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.475+0000 7f87437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:35.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.475+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94692552395408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f36380 con 0x561f53f19f50 2024-05-09T09:47:35.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.479+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94692552395408] v30'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8888036040 con 0x561f53f19f50 2024-05-09T09:47:35.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.479+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94692552373648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f2ca90 con 0x7f88840ce040 2024-05-09T09:47:35.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.479+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94692552373648] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8888036040 con 0x7f88840ce040 2024-05-09T09:47:35.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.479+0000 7f88906bd980 20 remove_watcher() i=0 2024-05-09T09:47:35.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.479+0000 7f88906bd980 2 removed watcher, disabling cache 2024-05-09T09:47:35.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.479+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94692552377696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f2ca90 con 0x561f53f19f50 2024-05-09T09:47:35.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.483+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94692552377696] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8888036040 con 0x561f53f19f50 2024-05-09T09:47:35.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.483+0000 7f88906bd980 20 remove_watcher() i=1 2024-05-09T09:47:35.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.483+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94692552371088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f28560 con 0x561f53f231e0 2024-05-09T09:47:35.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.483+0000 7f888d9d7640 1 -- 172.21.15.157:0/1689774855 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94692552371088] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88840d9070 con 0x561f53f231e0 2024-05-09T09:47:35.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.483+0000 7f88906bd980 20 remove_watcher() i=2 2024-05-09T09:47:35.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.483+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94692552383376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f2ca90 con 0x7f88840ce040 2024-05-09T09:47:35.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.487+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94692552383376] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8888036040 con 0x7f88840ce040 2024-05-09T09:47:35.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.487+0000 7f88906bd980 20 remove_watcher() i=3 2024-05-09T09:47:35.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.487+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94692552386976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f26b90 con 0x561f53f19f50 2024-05-09T09:47:35.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.487+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94692552386976] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8888036040 con 0x561f53f19f50 2024-05-09T09:47:35.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.487+0000 7f88906bd980 20 remove_watcher() i=4 2024-05-09T09:47:35.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.487+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94692552389312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f28560 con 0x561f53f1e710 2024-05-09T09:47:35.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.491+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94692552389312] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888001b030 con 0x561f53f1e710 2024-05-09T09:47:35.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.491+0000 7f88906bd980 20 remove_watcher() i=5 2024-05-09T09:47:35.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.491+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94692552382176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f29b90 con 0x561f53f1e710 2024-05-09T09:47:35.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.491+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94692552382176] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888001b030 con 0x561f53f1e710 2024-05-09T09:47:35.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.491+0000 7f88906bd980 20 remove_watcher() i=6 2024-05-09T09:47:35.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.491+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94692552393936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561f53f2ca90 con 0x561f53f1e710 2024-05-09T09:47:35.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f888e1d8640 1 -- 172.21.15.157:0/1689774855 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94692552393936] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888001b030 con 0x561f53f1e710 2024-05-09T09:47:35.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 20 remove_watcher() i=7 2024-05-09T09:47:35.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561f53f1e710 msgr2=0x561f53f20b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 --2- 172.21.15.157:0/1689774855 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561f53f1e710 0x561f53f20b00 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561f53f19f50 msgr2=0x561f53f1c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 --2- 172.21.15.157:0/1689774855 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561f53f19f50 0x561f53f1c410 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f88840ce040 msgr2=0x7f88840db410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 --2- 172.21.15.157:0/1689774855 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f88840ce040 0x7f88840db410 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561f53f231e0 msgr2=0x561f53f25670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 --2- 172.21.15.157:0/1689774855 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561f53f231e0 0x561f53f25670 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8758034bb0 msgr2=0x7f8758037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 --2- 172.21.15.157:0/1689774855 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8758034bb0 0x7f8758037070 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f88840abfd0 tx=0x7f88840a6000 comp rx=0 tx=0).stop 2024-05-09T09:47:35.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53f060d0 msgr2=0x561f53f0d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 --2- 172.21.15.157:0/1689774855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53f060d0 0x561f53f0d500 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8880048fd0 tx=0x7f888001f0e0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f888e9d9640 1 -- 172.21.15.157:0/1689774855 reap_dead start 2024-05-09T09:47:35.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 shutdown_connections 2024-05-09T09:47:35.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 --2- 172.21.15.157:0/1689774855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53f060d0 0x561f53f0d500 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 >> 172.21.15.157:0/1689774855 conn(0x561f53f024a0 msgr2=0x561f53effb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:35.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 shutdown_connections 2024-05-09T09:47:35.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 -- 172.21.15.157:0/1689774855 wait complete. 2024-05-09T09:47:35.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 -- 172.21.15.157:0/2529392001 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8768034bb0 msgr2=0x7f8768037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 --2- 172.21.15.157:0/2529392001 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8768034bb0 0x7f8768037070 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x561f53ecaa40 tx=0x7f8884005a10 comp rx=0 tx=0).stop 2024-05-09T09:47:35.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 -- 172.21.15.157:0/2529392001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53ef9130 msgr2=0x561f53ef9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 --2- 172.21.15.157:0/2529392001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53ef9130 0x561f53ef9550 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8880048a20 tx=0x7f8880010d50 comp rx=0 tx=0).stop 2024-05-09T09:47:35.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 -- 172.21.15.157:0/2529392001 shutdown_connections 2024-05-09T09:47:35.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 --2- 172.21.15.157:0/2529392001 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8768034bb0 0x7f8768037070 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 --2- 172.21.15.157:0/2529392001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53ef9130 0x561f53ef9550 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 -- 172.21.15.157:0/2529392001 >> 172.21.15.157:0/2529392001 conn(0x561f53eedf00 msgr2=0x561f53eeea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:35.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 -- 172.21.15.157:0/2529392001 shutdown_connections 2024-05-09T09:47:35.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 -- 172.21.15.157:0/2529392001 wait complete. 2024-05-09T09:47:35.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 -- 172.21.15.157:0/39039596 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561f53ecc8a0 msgr2=0x561f53ecec90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 --2- 172.21.15.157:0/39039596 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561f53ecc8a0 0x561f53ecec90 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 -- 172.21.15.157:0/39039596 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561f53dd5030 msgr2=0x561f53ec9eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 --2- 172.21.15.157:0/39039596 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561f53dd5030 0x561f53ec9eb0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 -- 172.21.15.157:0/39039596 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561f53ed07e0 msgr2=0x561f53ed2bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 --2- 172.21.15.157:0/39039596 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561f53ed07e0 0x561f53ed2bd0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 -- 172.21.15.157:0/39039596 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8774034bb0 msgr2=0x7f8774037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 --2- 172.21.15.157:0/39039596 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8774034bb0 0x7f8774037070 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f88840ad000 tx=0x7f88840a5040 comp rx=0 tx=0).stop 2024-05-09T09:47:35.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 -- 172.21.15.157:0/39039596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53dd0b30 msgr2=0x561f53ec2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 --2- 172.21.15.157:0/39039596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561f53dd0b30 0x561f53ec2f50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x561f53ebcbc0 tx=0x7f8880000f50 comp rx=0 tx=0).stop 2024-05-09T09:47:35.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f888e9d9640 1 -- 172.21.15.157:0/39039596 reap_dead start 2024-05-09T09:47:35.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 -- 172.21.15.157:0/39039596 shutdown_connections 2024-05-09T09:47:35.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 -- 172.21.15.157:0/39039596 >> 172.21.15.157:0/39039596 conn(0x561f53d44250 msgr2=0x561f53eb63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:35.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 -- 172.21.15.157:0/39039596 shutdown_connections 2024-05-09T09:47:35.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.495+0000 7f88906bd980 1 -- 172.21.15.157:0/39039596 wait complete. 2024-05-09T09:47:35.508 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-09T09:47:32.044078Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:47:32.044055Z', 'tags': [], 'group_ids': []} 2024-05-09T09:47:35.508 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-05-09T09:47:35.508 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-05-09T09:47:35.508 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-05-09T09:47:35.593 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:35.593 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:35.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.595+0000 7f33b78ad980 1 Processor -- start 2024-05-09T09:47:35.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.595+0000 7f33b78ad980 1 -- start start 2024-05-09T09:47:35.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.595+0000 7f33b78ad980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x56314346fa50 0x5631434fe550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.595+0000 7f33b78ad980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5631433b1440 con 0x5631434fea90 2024-05-09T09:47:35.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.595+0000 7f33b78ad980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x56314339c5f0 con 0x56314346fa50 2024-05-09T09:47:35.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.595+0000 7f33b4bc7640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x5631434fea90 0x563143500e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:51562/0 (socket says 172.21.15.157:51562) 2024-05-09T09:47:35.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.595+0000 7f33b53c8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x56314346fa50 0x5631434fe550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.595+0000 7f33b4bc7640 1 -- 172.21.15.157:0/3783064600 learned_addr learned my addr 172.21.15.157:0/3783064600 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:47:35.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.595+0000 7f33a7fff640 1 -- 172.21.15.157:0/3783064600 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3697061304 0 0) 0x5631433b1440 con 0x5631434fea90 2024-05-09T09:47:35.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.595+0000 7f33a7fff640 1 -- 172.21.15.157:0/3783064600 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33a0001e20 con 0x5631434fea90 2024-05-09T09:47:35.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.595+0000 7f33b53c8640 1 -- 172.21.15.157:0/3783064600 >> v1:172.21.15.110:6789/0 conn(0x5631434fea90 legacy=0x563143500e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.595+0000 7f33b53c8640 1 -- 172.21.15.157:0/3783064600 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631433a7990 con 0x56314346fa50 2024-05-09T09:47:35.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.599+0000 7f33b53c8640 1 --2- 172.21.15.157:0/3783064600 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56314346fa50 0x5631434fe550 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f33a800a480 tx=0x7f33a801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b53983bcd112370 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.599+0000 7f33a7fff640 1 -- 172.21.15.157:0/3783064600 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33a80b0070 con 0x56314346fa50 2024-05-09T09:47:35.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.599+0000 7f33a7fff640 1 -- 172.21.15.157:0/3783064600 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a80ab540 con 0x56314346fa50 2024-05-09T09:47:35.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.599+0000 7f33a7fff640 1 -- 172.21.15.157:0/3783064600 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33a80ab840 con 0x56314346fa50 2024-05-09T09:47:35.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.599+0000 7f33b78ad980 1 -- 172.21.15.157:0/3783064600 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56314346fa50 msgr2=0x5631434fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.599+0000 7f33b78ad980 1 --2- 172.21.15.157:0/3783064600 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56314346fa50 0x5631434fe550 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f33a800a480 tx=0x7f33a801b280 comp rx=0 tx=0).stop 2024-05-09T09:47:35.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.599+0000 7f33b78ad980 1 -- 172.21.15.157:0/3783064600 shutdown_connections 2024-05-09T09:47:35.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.599+0000 7f33b78ad980 1 --2- 172.21.15.157:0/3783064600 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56314346fa50 0x5631434fe550 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.599+0000 7f33b78ad980 1 -- 172.21.15.157:0/3783064600 >> 172.21.15.157:0/3783064600 conn(0x5631434f6070 msgr2=0x5631434f8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:35.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.599+0000 7f33b78ad980 1 -- 172.21.15.157:0/3783064600 shutdown_connections 2024-05-09T09:47:35.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.599+0000 7f33b78ad980 1 -- 172.21.15.157:0/3783064600 wait complete. 2024-05-09T09:47:35.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.615+0000 7f33b78ad980 1 Processor -- start 2024-05-09T09:47:35.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.615+0000 7f33b78ad980 1 -- start start 2024-05-09T09:47:35.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.615+0000 7f33b78ad980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56314346fa50 0x5631434fbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.615+0000 7f33b78ad980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5631433fefe0 con 0x56314346fa50 2024-05-09T09:47:35.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.615+0000 7f33b53c8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56314346fa50 0x5631434fbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.615+0000 7f33b53c8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56314346fa50 0x5631434fbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58108/0 (socket says 172.21.15.157:58108) 2024-05-09T09:47:35.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.615+0000 7f33b53c8640 1 -- 172.21.15.157:0/1885360387 learned_addr learned my addr 172.21.15.157:0/1885360387 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:35.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.615+0000 7f33b53c8640 1 -- 172.21.15.157:0/1885360387 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563143383ae0 con 0x56314346fa50 2024-05-09T09:47:35.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.619+0000 7f33b53c8640 1 --2- 172.21.15.157:0/1885360387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56314346fa50 0x5631434fbcb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f33a80ae040 tx=0x7f33a8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41da0f881efc5f75 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.619+0000 7f32a3606640 1 -- 172.21.15.157:0/1885360387 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33a80b0040 con 0x56314346fa50 2024-05-09T09:47:35.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.619+0000 7f32a3606640 1 -- 172.21.15.157:0/1885360387 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a800a300 con 0x56314346fa50 2024-05-09T09:47:35.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.619+0000 7f32a3606640 1 -- 172.21.15.157:0/1885360387 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33a80ab840 con 0x56314346fa50 2024-05-09T09:47:35.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.619+0000 7f33b78ad980 1 -- 172.21.15.157:0/1885360387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56314346fa50 msgr2=0x5631434fbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.619+0000 7f33b78ad980 1 --2- 172.21.15.157:0/1885360387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56314346fa50 0x5631434fbcb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f33a80ae040 tx=0x7f33a8003030 comp rx=0 tx=0).stop 2024-05-09T09:47:35.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.619+0000 7f33b78ad980 1 -- 172.21.15.157:0/1885360387 shutdown_connections 2024-05-09T09:47:35.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.619+0000 7f33b78ad980 1 --2- 172.21.15.157:0/1885360387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56314346fa50 0x5631434fbcb0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.619+0000 7f33b78ad980 1 -- 172.21.15.157:0/1885360387 >> 172.21.15.157:0/1885360387 conn(0x5631434f6070 msgr2=0x5631435e2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:35.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.619+0000 7f33b78ad980 1 -- 172.21.15.157:0/1885360387 shutdown_connections 2024-05-09T09:47:35.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.619+0000 7f33b78ad980 1 -- 172.21.15.157:0/1885360387 wait complete. 2024-05-09T09:47:35.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.619+0000 7f33b78ad980 1 Processor -- start 2024-05-09T09:47:35.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.619+0000 7f33b78ad980 1 -- start start 2024-05-09T09:47:35.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.619+0000 7f33b78ad980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631434fea90 0x5631435efe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.619+0000 7f33b78ad980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5631435030b0 con 0x5631434fea90 2024-05-09T09:47:35.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.619+0000 7f33b53c8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631434fea90 0x5631435efe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.619+0000 7f33b53c8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631434fea90 0x5631435efe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58116/0 (socket says 172.21.15.157:58116) 2024-05-09T09:47:35.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.619+0000 7f33b53c8640 1 -- 172.21.15.157:0/2446532780 learned_addr learned my addr 172.21.15.157:0/2446532780 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:35.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.619+0000 7f33b53c8640 1 -- 172.21.15.157:0/2446532780 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631435f03d0 con 0x5631434fea90 2024-05-09T09:47:35.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.619+0000 7f33b53c8640 1 --2- 172.21.15.157:0/2446532780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631434fea90 0x5631435efe90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f33a80b8040 tx=0x7f33a8018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.619+0000 7f32a1e03640 1 -- 172.21.15.157:0/2446532780 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33a80c4020 con 0x5631434fea90 2024-05-09T09:47:35.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.619+0000 7f33b78ad980 1 -- 172.21.15.157:0/2446532780 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5631435f0660 con 0x5631434fea90 2024-05-09T09:47:35.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.619+0000 7f32a1e03640 1 -- 172.21.15.157:0/2446532780 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a80b6680 con 0x5631434fea90 2024-05-09T09:47:35.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.619+0000 7f32a1e03640 1 -- 172.21.15.157:0/2446532780 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33a80b0040 con 0x5631434fea90 2024-05-09T09:47:35.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.619+0000 7f33b78ad980 1 -- 172.21.15.157:0/2446532780 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631435f3340 con 0x5631434fea90 2024-05-09T09:47:35.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.623+0000 7f32a1e03640 1 -- 172.21.15.157:0/2446532780 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f33a80c7020 con 0x5631434fea90 2024-05-09T09:47:35.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.623+0000 7f32a1e03640 1 --2- 172.21.15.157:0/2446532780 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f329c034bb0 0x7f329c037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.623+0000 7f32a1e03640 1 -- 172.21.15.157:0/2446532780 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f33a80bb070 con 0x5631434fea90 2024-05-09T09:47:35.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.623+0000 7f33b4bc7640 1 --2- 172.21.15.157:0/2446532780 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f329c034bb0 0x7f329c037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.623+0000 7f33b78ad980 1 --2- 172.21.15.157:0/2446532780 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5631435f4e10 0x5631435f7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.623+0000 7f33b78ad980 1 -- 172.21.15.157:0/2446532780 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5631435f7850 con 0x5631435f4e10 2024-05-09T09:47:35.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.623+0000 7f33b5bc9640 1 --2- 172.21.15.157:0/2446532780 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5631435f4e10 0x5631435f7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.623+0000 7f33b4bc7640 1 --2- 172.21.15.157:0/2446532780 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f329c034bb0 0x7f329c037070 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0012f0 tx=0x7f33ac001430 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.623+0000 7f33b5bc9640 1 --2- 172.21.15.157:0/2446532780 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5631435f4e10 0x5631435f7200 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.623+0000 7f33b5bc9640 1 -- 172.21.15.157:0/2446532780 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33b00083f0 con 0x5631435f4e10 2024-05-09T09:47:35.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.623+0000 7f33b78ad980 1 -- 172.21.15.157:0/2446532780 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5631435f4540 con 0x5631435f4e10 2024-05-09T09:47:35.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.623+0000 7f33b5bc9640 1 -- 172.21.15.157:0/2446532780 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f33b00083f0 con 0x5631435f4e10 2024-05-09T09:47:35.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.623+0000 7f33b78ad980 1 --2- 172.21.15.157:0/2446532780 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5631435f9b80 0x5631435fbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.623+0000 7f33b78ad980 1 -- 172.21.15.157:0/2446532780 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5631435fc640 con 0x5631435f9b80 2024-05-09T09:47:35.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.623+0000 7f33b53c8640 1 --2- 172.21.15.157:0/2446532780 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5631435f9b80 0x5631435fbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.623+0000 7f33b53c8640 1 --2- 172.21.15.157:0/2446532780 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5631435f9b80 0x5631435fbf70 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.627+0000 7f33b53c8640 1 -- 172.21.15.157:0/2446532780 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f33a80b3040 con 0x5631435f9b80 2024-05-09T09:47:35.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.627+0000 7f33b78ad980 1 -- 172.21.15.157:0/2446532780 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5631435f8a20 con 0x5631435f4e10 2024-05-09T09:47:35.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.627+0000 7f33b5bc9640 1 -- 172.21.15.157:0/2446532780 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f33b00083f0 con 0x5631435f4e10 2024-05-09T09:47:35.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.627+0000 7f33b78ad980 1 --2- 172.21.15.157:0/2446532780 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5631435fdaa0 0x5631435ffe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.627+0000 7f33b78ad980 1 -- 172.21.15.157:0/2446532780 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563143600590 con 0x5631435fdaa0 2024-05-09T09:47:35.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.627+0000 7f33b4bc7640 1 --2- 172.21.15.157:0/2446532780 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5631435fdaa0 0x5631435ffe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.627+0000 7f33b4bc7640 1 --2- 172.21.15.157:0/2446532780 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5631435fdaa0 0x5631435ffe90 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.627+0000 7f33b4bc7640 1 -- 172.21.15.157:0/2446532780 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f33ac00f070 con 0x5631435fdaa0 2024-05-09T09:47:35.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.631+0000 7f33b78ad980 1 Processor -- start 2024-05-09T09:47:35.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.631+0000 7f33b78ad980 1 -- start start 2024-05-09T09:47:35.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.631+0000 7f33b78ad980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563143626610 0x563143626a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.631+0000 7f33b78ad980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563143403020 con 0x563143626610 2024-05-09T09:47:35.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.631+0000 7f33b53c8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563143626610 0x563143626a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.631+0000 7f33b53c8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563143626610 0x563143626a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58118/0 (socket says 172.21.15.157:58118) 2024-05-09T09:47:35.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.631+0000 7f33b53c8640 1 -- 172.21.15.157:0/2059390460 learned_addr learned my addr 172.21.15.157:0/2059390460 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:35.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.631+0000 7f33b53c8640 1 -- 172.21.15.157:0/2059390460 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563143626f70 con 0x563143626610 2024-05-09T09:47:35.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.631+0000 7f33b53c8640 1 --2- 172.21.15.157:0/2059390460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563143626610 0x563143626a30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f33a80ab4f0 tx=0x7f33a80b6d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.631+0000 7f3299ba0640 1 -- 172.21.15.157:0/2059390460 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33a80e6020 con 0x563143626610 2024-05-09T09:47:35.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.631+0000 7f33b78ad980 1 -- 172.21.15.157:0/2059390460 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563143627a00 con 0x563143626610 2024-05-09T09:47:35.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.631+0000 7f33b78ad980 1 -- 172.21.15.157:0/2059390460 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563143627ee0 con 0x563143626610 2024-05-09T09:47:35.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.631+0000 7f3299ba0640 1 -- 172.21.15.157:0/2059390460 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a80aa3b0 con 0x563143626610 2024-05-09T09:47:35.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.631+0000 7f3299ba0640 1 -- 172.21.15.157:0/2059390460 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33a80b5c30 con 0x563143626610 2024-05-09T09:47:35.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.635+0000 7f3299ba0640 1 -- 172.21.15.157:0/2059390460 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f33a80de070 con 0x563143626610 2024-05-09T09:47:35.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.635+0000 7f3299ba0640 1 --2- 172.21.15.157:0/2059390460 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f328c034bb0 0x7f328c037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.635+0000 7f3299ba0640 1 -- 172.21.15.157:0/2059390460 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f33a80a8070 con 0x563143626610 2024-05-09T09:47:35.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.635+0000 7f33b4bc7640 1 --2- 172.21.15.157:0/2059390460 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f328c034bb0 0x7f328c037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.635+0000 7f33b78ad980 1 Processor -- start 2024-05-09T09:47:35.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.635+0000 7f33b78ad980 1 -- start start 2024-05-09T09:47:35.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.635+0000 7f33b78ad980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631436348c0 0x563143634ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.635+0000 7f33b78ad980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5631434fc340 con 0x5631436348c0 2024-05-09T09:47:35.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.635+0000 7f33b4bc7640 1 --2- 172.21.15.157:0/2059390460 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f328c034bb0 0x7f328c037070 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f33ac006300 tx=0x7f33ac00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.635+0000 7f33b53c8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631436348c0 0x563143634ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.635+0000 7f33b53c8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631436348c0 0x563143634ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58132/0 (socket says 172.21.15.157:58132) 2024-05-09T09:47:35.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.635+0000 7f33b53c8640 1 -- 172.21.15.157:0/3264273407 learned_addr learned my addr 172.21.15.157:0/3264273407 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:35.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.635+0000 7f33b53c8640 1 -- 172.21.15.157:0/3264273407 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631436352b0 con 0x5631436348c0 2024-05-09T09:47:35.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.635+0000 7f33b53c8640 1 --2- 172.21.15.157:0/3264273407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631436348c0 0x563143634ce0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f33a80eb4b0 tx=0x7f33a80c86f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f617db16d805e837 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.635+0000 7f32937fe640 1 -- 172.21.15.157:0/3264273407 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33a80d3b60 con 0x5631436348c0 2024-05-09T09:47:35.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.635+0000 7f32937fe640 1 -- 172.21.15.157:0/3264273407 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a80fb030 con 0x5631436348c0 2024-05-09T09:47:35.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.635+0000 7f32937fe640 1 -- 172.21.15.157:0/3264273407 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33a80c8950 con 0x5631436348c0 2024-05-09T09:47:35.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.635+0000 7f33b78ad980 1 -- 172.21.15.157:0/3264273407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631436348c0 msgr2=0x563143634ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.635+0000 7f33b78ad980 1 --2- 172.21.15.157:0/3264273407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631436348c0 0x563143634ce0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f33a80eb4b0 tx=0x7f33a80c86f0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.635+0000 7f33b78ad980 1 -- 172.21.15.157:0/3264273407 shutdown_connections 2024-05-09T09:47:35.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.635+0000 7f33b78ad980 1 --2- 172.21.15.157:0/3264273407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631436348c0 0x563143634ce0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.635+0000 7f33b78ad980 1 -- 172.21.15.157:0/3264273407 >> 172.21.15.157:0/3264273407 conn(0x56314362f960 msgr2=0x56314362da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:35.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.635+0000 7f33b78ad980 1 -- 172.21.15.157:0/3264273407 shutdown_connections 2024-05-09T09:47:35.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.635+0000 7f33b78ad980 1 -- 172.21.15.157:0/3264273407 wait complete. 2024-05-09T09:47:35.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.635+0000 7f33b78ad980 1 Processor -- start 2024-05-09T09:47:35.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.635+0000 7f33b78ad980 1 -- start start 2024-05-09T09:47:35.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.639+0000 7f33b78ad980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631436348c0 0x56314363a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.639+0000 7f33b78ad980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563143633430 con 0x5631436348c0 2024-05-09T09:47:35.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.639+0000 7f33b53c8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631436348c0 0x56314363a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.639+0000 7f33b53c8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631436348c0 0x56314363a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58140/0 (socket says 172.21.15.157:58140) 2024-05-09T09:47:35.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.639+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 learned_addr learned my addr 172.21.15.157:0/299953163 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:35.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.639+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56314363aef0 con 0x5631436348c0 2024-05-09T09:47:35.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.639+0000 7f33b53c8640 1 --2- 172.21.15.157:0/299953163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631436348c0 0x56314363a9b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f33a80eb4b0 tx=0x7f33a80bfa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.639+0000 7f3291ffb640 1 -- 172.21.15.157:0/299953163 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33a80eba20 con 0x5631436348c0 2024-05-09T09:47:35.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.639+0000 7f3291ffb640 1 -- 172.21.15.157:0/299953163 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a80ebbc0 con 0x5631436348c0 2024-05-09T09:47:35.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.639+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56314363aef0 con 0x5631436348c0 2024-05-09T09:47:35.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.639+0000 7f3291ffb640 1 -- 172.21.15.157:0/299953163 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33a80d3750 con 0x5631436348c0 2024-05-09T09:47:35.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.639+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56314363aef0 con 0x5631436348c0 2024-05-09T09:47:35.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.639+0000 7f3291ffb640 1 -- 172.21.15.157:0/299953163 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f33a80bf3d0 con 0x5631436348c0 2024-05-09T09:47:35.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.639+0000 7f3291ffb640 1 --2- 172.21.15.157:0/299953163 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3284034bb0 0x7f3284037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.639+0000 7f3291ffb640 1 -- 172.21.15.157:0/299953163 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f33a8108030 con 0x5631436348c0 2024-05-09T09:47:35.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.639+0000 7f33b4bc7640 1 --2- 172.21.15.157:0/299953163 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3284034bb0 0x7f3284037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.639+0000 7f33b78ad980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.639+0000 7f33b78ad980 1 --2- 172.21.15.157:0/299953163 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563143647550 0x563143649a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.639+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56314364a160 con 0x563143647550 2024-05-09T09:47:35.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.639+0000 7f33b4bc7640 1 --2- 172.21.15.157:0/299953163 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3284034bb0 0x7f3284037070 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x5631435f8130 tx=0x7f33ac010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.639+0000 7f33b5bc9640 1 --2- 172.21.15.157:0/299953163 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563143647550 0x563143649a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.643+0000 7f33b5bc9640 1 --2- 172.21.15.157:0/299953163 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563143647550 0x563143649a10 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.643+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33b00083f0 con 0x563143647550 2024-05-09T09:47:35.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.643+0000 7f33b78ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:35.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.643+0000 7f33b78ad980 20 realm 2024-05-09T09:47:35.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.643+0000 7f33b78ad980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.643+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56314364a570 con 0x563143647550 2024-05-09T09:47:35.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.643+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33b00083f0 con 0x563143647550 2024-05-09T09:47:35.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.643+0000 7f33b78ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:35.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.643+0000 7f33b78ad980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:35.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.643+0000 7f33b78ad980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.643+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56314364ae40 con 0x563143647550 2024-05-09T09:47:35.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.643+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33b00083f0 con 0x563143647550 2024-05-09T09:47:35.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.643+0000 7f33b78ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:35.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.643+0000 7f33b78ad980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.643+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x563143647550 2024-05-09T09:47:35.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.643+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f33b00083f0 con 0x563143647550 2024-05-09T09:47:35.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.643+0000 7f33b78ad980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:35.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.643+0000 7f33b78ad980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.643+0000 7f33b78ad980 1 --2- 172.21.15.157:0/299953163 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56314364bf40 0x56314364e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.643+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56314364e940 con 0x56314364bf40 2024-05-09T09:47:35.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.643+0000 7f33b53c8640 1 --2- 172.21.15.157:0/299953163 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56314364bf40 0x56314364e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.643+0000 7f33b53c8640 1 --2- 172.21.15.157:0/299953163 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56314364bf40 0x56314364e330 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.643+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f33a80e8020 con 0x56314364bf40 2024-05-09T09:47:35.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.643+0000 7f33b78ad980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:35.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.643+0000 7f33b78ad980 20 searching for the correct realm 2024-05-09T09:47:35.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.643+0000 7f33b78ad980 1 --2- 172.21.15.157:0/299953163 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563143650890 0x563143652c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.643+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563143653350 con 0x563143650890 2024-05-09T09:47:35.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.643+0000 7f33b4bc7640 1 --2- 172.21.15.157:0/299953163 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563143650890 0x563143652c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.643+0000 7f33b4bc7640 1 --2- 172.21.15.157:0/299953163 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563143650890 0x563143652c80 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.647+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33ac00f070 con 0x563143650890 2024-05-09T09:47:35.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.647+0000 7f33b4bc7640 1 --2- 172.21.15.157:0/299953163 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f33ac024070 0x7f33ac031460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.647+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563143653350 con 0x7f33ac024070 2024-05-09T09:47:35.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.647+0000 7f33b5bc9640 1 --2- 172.21.15.157:0/299953163 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f33ac024070 0x7f33ac031460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.647+0000 7f33b5bc9640 1 --2- 172.21.15.157:0/299953163 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f33ac024070 0x7f33ac031460 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.647+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b00083f0 con 0x7f33ac024070 2024-05-09T09:47:35.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.647+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x56314364bf40 2024-05-09T09:47:35.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.647+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33a80e8020 con 0x56314364bf40 2024-05-09T09:47:35.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.647+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x563143647550 2024-05-09T09:47:35.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.647+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b00083f0 con 0x563143647550 2024-05-09T09:47:35.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.647+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x563143647550 2024-05-09T09:47:35.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.647+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b0026040 con 0x563143647550 2024-05-09T09:47:35.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.647+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x56314364bf40 2024-05-09T09:47:35.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.647+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33a80e8020 con 0x56314364bf40 2024-05-09T09:47:35.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.647+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x56314364bf40 2024-05-09T09:47:35.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.651+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33a80e8020 con 0x56314364bf40 2024-05-09T09:47:35.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.651+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x7f33ac024070 2024-05-09T09:47:35.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.651+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b0026040 con 0x7f33ac024070 2024-05-09T09:47:35.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.651+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x563143650890 2024-05-09T09:47:35.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.651+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33ac00f070 con 0x563143650890 2024-05-09T09:47:35.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.651+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x563143647550 2024-05-09T09:47:35.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.651+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b0026040 con 0x563143647550 2024-05-09T09:47:35.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.651+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x56314364bf40 2024-05-09T09:47:35.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.651+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33a80e8020 con 0x56314364bf40 2024-05-09T09:47:35.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.651+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x563143647550 2024-05-09T09:47:35.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.651+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b0026040 con 0x563143647550 2024-05-09T09:47:35.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.651+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x7f33ac024070 2024-05-09T09:47:35.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.651+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f33b0026040 con 0x7f33ac024070 2024-05-09T09:47:35.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.651+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x563143650890 2024-05-09T09:47:35.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.651+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33ac040040 con 0x563143650890 2024-05-09T09:47:35.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.651+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x563143650890 2024-05-09T09:47:35.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.651+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f33ac040040 con 0x563143650890 2024-05-09T09:47:35.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.651+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x56314364bf40 2024-05-09T09:47:35.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.651+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33a80e8020 con 0x56314364bf40 2024-05-09T09:47:35.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.651+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x563143650890 2024-05-09T09:47:35.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.655+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33ac040040 con 0x563143650890 2024-05-09T09:47:35.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.655+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x563143650890 2024-05-09T09:47:35.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.655+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33ac040040 con 0x563143650890 2024-05-09T09:47:35.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.655+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x563143647550 2024-05-09T09:47:35.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.655+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b0026040 con 0x563143647550 2024-05-09T09:47:35.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.655+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x563143647550 2024-05-09T09:47:35.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.655+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f33b0026040 con 0x563143647550 2024-05-09T09:47:35.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.655+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x56314364bf40 2024-05-09T09:47:35.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.655+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33a80e8020 con 0x56314364bf40 2024-05-09T09:47:35.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.655+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x563143650890 2024-05-09T09:47:35.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.655+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33ac040040 con 0x563143650890 2024-05-09T09:47:35.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.655+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x7f33ac024070 2024-05-09T09:47:35.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.655+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b0026040 con 0x7f33ac024070 2024-05-09T09:47:35.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.655+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x563143647550 2024-05-09T09:47:35.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.655+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b0026040 con 0x563143647550 2024-05-09T09:47:35.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.655+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x56314364bf40 2024-05-09T09:47:35.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.655+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f33a80e8020 con 0x56314364bf40 2024-05-09T09:47:35.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.655+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x563143650890 2024-05-09T09:47:35.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.655+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33ac040040 con 0x563143650890 2024-05-09T09:47:35.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.655+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x56314364bf40 2024-05-09T09:47:35.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33a80e8020 con 0x56314364bf40 2024-05-09T09:47:35.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x7f33ac024070 2024-05-09T09:47:35.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b0026040 con 0x7f33ac024070 2024-05-09T09:47:35.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x563143650890 2024-05-09T09:47:35.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33ac040040 con 0x563143650890 2024-05-09T09:47:35.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x56314364bf40 2024-05-09T09:47:35.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33a80e8020 con 0x56314364bf40 2024-05-09T09:47:35.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x563143647550 2024-05-09T09:47:35.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f33b0026040 con 0x563143647550 2024-05-09T09:47:35.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56314364b1e0 con 0x7f33ac024070 2024-05-09T09:47:35.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f33b0026040 con 0x7f33ac024070 2024-05-09T09:47:35.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b78ad980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:35.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b78ad980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:35.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b78ad980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:35.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b78ad980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:35.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b78ad980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:35.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b78ad980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:35.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b78ad980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56314364f200 con 0x563143647550 2024-05-09T09:47:35.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f33b0026040 con 0x563143647550 2024-05-09T09:47:35.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b78ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:35.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b78ad980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56314364f200 con 0x563143647550 2024-05-09T09:47:35.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f33b0026040 con 0x563143647550 2024-05-09T09:47:35.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b78ad980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:35.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b78ad980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56314364f200 con 0x563143650890 2024-05-09T09:47:35.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f33ac040040 con 0x563143650890 2024-05-09T09:47:35.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b78ad980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:35.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b78ad980 20 zone default found 2024-05-09T09:47:35.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b78ad980 4 Realm: () 2024-05-09T09:47:35.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b78ad980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:35.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b78ad980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:35.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b78ad980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:35.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b78ad980 20 zonegroup default 2024-05-09T09:47:35.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b78ad980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.659+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56314364fc20 con 0x56314364bf40 2024-05-09T09:47:35.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.663+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f33a80e8020 con 0x56314364bf40 2024-05-09T09:47:35.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.663+0000 7f33b78ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:35.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.663+0000 7f33b78ad980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.663+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563143655660 con 0x563143650890 2024-05-09T09:47:35.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.663+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f33ac040040 con 0x563143650890 2024-05-09T09:47:35.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.663+0000 7f33b78ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:35.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.663+0000 7f33b78ad980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.663+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563143655a00 con 0x563143650890 2024-05-09T09:47:35.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.663+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f33ac040040 con 0x563143650890 2024-05-09T09:47:35.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.663+0000 7f33b78ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:35.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.663+0000 7f33b78ad980 20 started sync module instance, tier type = 2024-05-09T09:47:35.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.663+0000 7f33b78ad980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:35.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.663+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143654aa0 con 0x7f33ac024070 2024-05-09T09:47:35.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.663+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b0026040 con 0x7f33ac024070 2024-05-09T09:47:35.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.663+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94769584099264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143654aa0 con 0x7f33ac024070 2024-05-09T09:47:35.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.663+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143656290 con 0x563143647550 2024-05-09T09:47:35.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.663+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94769584099264] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x7f33ac024070 2024-05-09T09:47:35.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.667+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x563143647550 2024-05-09T09:47:35.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.667+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94769584102816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143654aa0 con 0x563143647550 2024-05-09T09:47:35.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.667+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143656ca0 con 0x563143650890 2024-05-09T09:47:35.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.667+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33ac040040 con 0x563143650890 2024-05-09T09:47:35.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.667+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94769584105456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631436574f0 con 0x563143650890 2024-05-09T09:47:35.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.667+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143657f30 con 0x7f33ac024070 2024-05-09T09:47:35.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.667+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94769584102816] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x563143647550 2024-05-09T09:47:35.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.667+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x7f33ac024070 2024-05-09T09:47:35.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.667+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94769584110080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143658320 con 0x7f33ac024070 2024-05-09T09:47:35.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.667+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143658ce0 con 0x563143647550 2024-05-09T09:47:35.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.671+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94769584105456] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33ac040040 con 0x563143650890 2024-05-09T09:47:35.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.671+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94769584110080] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x7f33ac024070 2024-05-09T09:47:35.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.671+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x563143647550 2024-05-09T09:47:35.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.671+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94769584096752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143658830 con 0x563143647550 2024-05-09T09:47:35.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.671+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143659080 con 0x56314364bf40 2024-05-09T09:47:35.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.671+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33a80e8020 con 0x56314364bf40 2024-05-09T09:47:35.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.671+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94769584114016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631436598d0 con 0x56314364bf40 2024-05-09T09:47:35.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.671+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56314365a290 con 0x56314364bf40 2024-05-09T09:47:35.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.675+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94769584096752] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x563143647550 2024-05-09T09:47:35.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.675+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94769584114016] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33a80e8020 con 0x56314364bf40 2024-05-09T09:47:35.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.675+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33a80e8020 con 0x56314364bf40 2024-05-09T09:47:35.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.675+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94769584119264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56314365a630 con 0x56314364bf40 2024-05-09T09:47:35.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.675+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56314365ae80 con 0x56314364bf40 2024-05-09T09:47:35.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.675+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94769584119264] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33a80e8020 con 0x56314364bf40 2024-05-09T09:47:35.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.675+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33a80e8020 con 0x56314364bf40 2024-05-09T09:47:35.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.675+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94769584121392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56314365af00 con 0x56314364bf40 2024-05-09T09:47:35.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.675+0000 7f33b78ad980 20 add_watcher() i=0 2024-05-09T09:47:35.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.675+0000 7f33b78ad980 20 add_watcher() i=1 2024-05-09T09:47:35.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.675+0000 7f33b78ad980 20 add_watcher() i=2 2024-05-09T09:47:35.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.675+0000 7f33b78ad980 20 add_watcher() i=3 2024-05-09T09:47:35.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.675+0000 7f33b78ad980 20 add_watcher() i=4 2024-05-09T09:47:35.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.675+0000 7f33b78ad980 20 add_watcher() i=5 2024-05-09T09:47:35.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.675+0000 7f33b78ad980 20 add_watcher() i=6 2024-05-09T09:47:35.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.679+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94769584121392] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33a80e8020 con 0x56314364bf40 2024-05-09T09:47:35.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.679+0000 7f33b78ad980 20 add_watcher() i=7 2024-05-09T09:47:35.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.679+0000 7f33b78ad980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:35.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.679+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56314365e1e0 con 0x563143647550 2024-05-09T09:47:35.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.679+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f33b0036040 con 0x563143647550 2024-05-09T09:47:35.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.679+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94769584122816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56314365b490 con 0x563143647550 2024-05-09T09:47:35.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.679+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94769584122816] v30'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x563143647550 2024-05-09T09:47:35.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.679+0000 7f326a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:35.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.679+0000 7f33b78ad980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:35.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.679+0000 7f33b78ad980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:35.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.679+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56314365da30 con 0x563143647550 2024-05-09T09:47:35.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.683+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'37 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x563143647550 2024-05-09T09:47:35.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.683+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631436672a0 con 0x56314364bf40 2024-05-09T09:47:35.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.687+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'31 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f33a80e8020 con 0x56314364bf40 2024-05-09T09:47:35.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.687+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631436672a0 con 0x563143650890 2024-05-09T09:47:35.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.687+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'31 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f33ac040040 con 0x563143650890 2024-05-09T09:47:35.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.687+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143667b90 con 0x563143647550 2024-05-09T09:47:35.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.687+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'130 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x563143647550 2024-05-09T09:47:35.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.687+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143668100 con 0x7f33ac024070 2024-05-09T09:47:35.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.691+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'83 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x7f33ac024070 2024-05-09T09:47:35.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.691+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631436685b0 con 0x563143650890 2024-05-09T09:47:35.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.691+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'55 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f33ac040040 con 0x563143650890 2024-05-09T09:47:35.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.691+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143666910 con 0x563143647550 2024-05-09T09:47:35.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.691+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'33 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x563143647550 2024-05-09T09:47:35.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.691+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143666910 con 0x56314364bf40 2024-05-09T09:47:35.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.695+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'55 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f33a80e8020 con 0x56314364bf40 2024-05-09T09:47:35.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.695+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143666910 con 0x7f33ac024070 2024-05-09T09:47:35.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.699+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'31 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x7f33ac024070 2024-05-09T09:47:35.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.699+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143666910 con 0x563143650890 2024-05-09T09:47:35.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.699+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'37 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f33ac040040 con 0x563143650890 2024-05-09T09:47:35.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.699+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143666ae0 con 0x7f33ac024070 2024-05-09T09:47:35.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.699+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'84 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x7f33ac024070 2024-05-09T09:47:35.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.699+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143666ae0 con 0x56314364bf40 2024-05-09T09:47:35.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.703+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'33 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33a80e8020 con 0x56314364bf40 2024-05-09T09:47:35.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.703+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143666ae0 con 0x7f33ac024070 2024-05-09T09:47:35.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.703+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'31 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x7f33ac024070 2024-05-09T09:47:35.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.703+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143666ae0 con 0x56314364bf40 2024-05-09T09:47:35.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.707+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'61 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33a80e8020 con 0x56314364bf40 2024-05-09T09:47:35.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.707+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143666ae0 con 0x563143647550 2024-05-09T09:47:35.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.707+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'131 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x563143647550 2024-05-09T09:47:35.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.707+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143666ae0 con 0x563143650890 2024-05-09T09:47:35.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.711+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'77 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33ac040040 con 0x563143650890 2024-05-09T09:47:35.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.711+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143666ae0 con 0x7f33ac024070 2024-05-09T09:47:35.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.711+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'85 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x7f33ac024070 2024-05-09T09:47:35.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.711+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143666ae0 con 0x563143650890 2024-05-09T09:47:35.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.711+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'31 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33ac040040 con 0x563143650890 2024-05-09T09:47:35.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.711+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143666ae0 con 0x563143647550 2024-05-09T09:47:35.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.715+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'39 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x563143647550 2024-05-09T09:47:35.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.715+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143666ae0 con 0x563143647550 2024-05-09T09:47:35.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.715+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'132 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x563143647550 2024-05-09T09:47:35.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.715+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143666ae0 con 0x563143650890 2024-05-09T09:47:35.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.719+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'78 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33ac040040 con 0x563143650890 2024-05-09T09:47:35.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.719+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143666ae0 con 0x7f33ac024070 2024-05-09T09:47:35.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.719+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'41 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x7f33ac024070 2024-05-09T09:47:35.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.719+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143666ae0 con 0x563143650890 2024-05-09T09:47:35.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.723+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'33 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33ac040040 con 0x563143650890 2024-05-09T09:47:35.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.723+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143666ae0 con 0x563143650890 2024-05-09T09:47:35.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.723+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'37 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33ac040040 con 0x563143650890 2024-05-09T09:47:35.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.723+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143666ae0 con 0x563143650890 2024-05-09T09:47:35.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.723+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'27 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33ac040040 con 0x563143650890 2024-05-09T09:47:35.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.723+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143666ae0 con 0x563143650890 2024-05-09T09:47:35.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.727+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'56 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33ac040040 con 0x563143650890 2024-05-09T09:47:35.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.727+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143666ae0 con 0x56314364bf40 2024-05-09T09:47:35.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.727+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'33 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33a80e8020 con 0x56314364bf40 2024-05-09T09:47:35.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.727+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143666910 con 0x563143650890 2024-05-09T09:47:35.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.731+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'31 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33ac040040 con 0x563143650890 2024-05-09T09:47:35.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.731+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143666910 con 0x56314364bf40 2024-05-09T09:47:35.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.731+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'56 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33a80e8020 con 0x56314364bf40 2024-05-09T09:47:35.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.731+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143666910 con 0x563143650890 2024-05-09T09:47:35.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.735+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'79 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33ac040040 con 0x563143650890 2024-05-09T09:47:35.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.735+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143666910 con 0x56314364bf40 2024-05-09T09:47:35.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.735+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'62 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33a80e8020 con 0x56314364bf40 2024-05-09T09:47:35.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.735+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143666910 con 0x7f33ac024070 2024-05-09T09:47:35.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.739+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'37 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x7f33ac024070 2024-05-09T09:47:35.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.739+0000 7f32697e2640 20 reqs_thread_entry: start 2024-05-09T09:47:35.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.739+0000 7f33b78ad980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:35.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.739+0000 7f31daffd640 20 reqs_thread_entry: start 2024-05-09T09:47:35.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.739+0000 7f33b78ad980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-09T09:47:35.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.739+0000 7f33b78ad980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.739+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563143684b50 con 0x563143647550 2024-05-09T09:47:35.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.739+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f33b0036040 con 0x563143647550 2024-05-09T09:47:35.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.739+0000 7f33b78ad980 20 rados_obj.operate() r=0 bl.length=556 2024-05-09T09:47:35.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.739+0000 7f33b78ad980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-09T09:47:35.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.739+0000 7f33b78ad980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:35.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.739+0000 7f33b78ad980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:35.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.739+0000 7f33b78ad980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-05-09T09:47:35.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.739+0000 7f33b78ad980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.739+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:95 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563143685500 con 0x7f33ac024070 2024-05-09T09:47:35.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.739+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(95 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x7f33ac024070 2024-05-09T09:47:35.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.739+0000 7f33b78ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:35.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.739+0000 7f33b78ad980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-05-09T09:47:35.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.739+0000 7f33b78ad980 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-05-09T09:47:35.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.739+0000 7f33b78ad980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-05-09T09:47:35.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.739+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56314368b010 con 0x563143647550 2024-05-09T09:47:35.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.743+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(96 foo [delete,create,call,call,writefull 0~673] v30'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x563143647550 2024-05-09T09:47:35.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.743+0000 7f33b78ad980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:47:35.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.743+0000 7f33b78ad980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:35.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.743+0000 7f33b78ad980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-09T09:47:35.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.743+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.d 7:b4812045:::notify.4:head [notify cookie 94769584319104 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563143686690 con 0x563143647550 2024-05-09T09:47:35.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.743+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== watch-notify(notify (1) cookie 94769584096752 notify 128849018887 ret 0) ==== 891+0+0 (crc 0 0 0) 0x563143669300 con 0x563143647550 2024-05-09T09:47:35.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.743+0000 7f32937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018887 cookie 94769584096752 notifier 4399 bl.length()=849 2024-05-09T09:47:35.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.743+0000 7f32937fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:47:35.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.743+0000 7f32937fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:35.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.743+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(97 notify.4 [notify cookie 94769584319104 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f33b0036040 con 0x563143647550 2024-05-09T09:47:35.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.743+0000 7f32937fe640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f32780056c0 con 0x563143647550 2024-05-09T09:47:35.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.743+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== watch-notify(notify_complete (2) cookie 94769584319104 notify 128849018887 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56314365d700 con 0x563143647550 2024-05-09T09:47:35.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.743+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(98 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x563143647550 2024-05-09T09:47:35.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.743+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56314368aa80 con 0x7f33ac024070 2024-05-09T09:47:35.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.747+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(99 foo:foo2 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x7f33ac024070 2024-05-09T09:47:35.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.747+0000 7f33b78ad980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-05-09T09:47:35.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.747+0000 7f33b78ad980 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-05-09T09:47:35.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.747+0000 7f33b78ad980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-05-09T09:47:35.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.747+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:100 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94769584319104 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5631436861e0 con 0x7f33ac024070 2024-05-09T09:47:35.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.747+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== watch-notify(notify (1) cookie 94769584099264 notify 128849018883 ret 0) ==== 208+0+0 (crc 0 0 0) 0x56314365d700 con 0x7f33ac024070 2024-05-09T09:47:35.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.747+0000 7f32937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94769584099264 notifier 4399 bl.length()=166 2024-05-09T09:47:35.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.747+0000 7f32937fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-05-09T09:47:35.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.747+0000 7f32937fe640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-05-09T09:47:35.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.747+0000 7f32937fe640 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f32780056c0 con 0x7f33ac024070 2024-05-09T09:47:35.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.747+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(100 notify.0 [notify cookie 94769584319104 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f33b0036040 con 0x7f33ac024070 2024-05-09T09:47:35.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.747+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(101 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x7f33ac024070 2024-05-09T09:47:35.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.747+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.2 v2:172.21.15.157:6800/354455204 23 ==== watch-notify(notify_complete (2) cookie 94769584319104 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563143667f30 con 0x7f33ac024070 2024-05-09T09:47:35.746 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-09T09:47:32.044078Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-05-09T09:47:35.743410Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:47:32.044055Z","tags":[],"group_ids":[]} 2024-05-09T09:47:35.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.747+0000 7f326a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:35.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.747+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94769584122816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143664580 con 0x563143647550 2024-05-09T09:47:35.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.747+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(102 data_loggenerations_metadata [watch unwatch cookie 94769584122816] v30'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x563143647550 2024-05-09T09:47:35.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.747+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:103 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94769584099264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56314365abc0 con 0x7f33ac024070 2024-05-09T09:47:35.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.751+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.2 v2:172.21.15.157:6800/354455204 24 ==== osd_op_reply(103 notify.0 [watch unwatch cookie 94769584099264] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x7f33ac024070 2024-05-09T09:47:35.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.751+0000 7f33b78ad980 20 remove_watcher() i=0 2024-05-09T09:47:35.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.751+0000 7f33b78ad980 2 removed watcher, disabling cache 2024-05-09T09:47:35.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.751+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:104 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94769584102816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56314365abc0 con 0x563143647550 2024-05-09T09:47:35.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.751+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(104 notify.1 [watch unwatch cookie 94769584102816] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x563143647550 2024-05-09T09:47:35.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.751+0000 7f33b78ad980 20 remove_watcher() i=1 2024-05-09T09:47:35.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.751+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:105 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94769584105456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143655da0 con 0x563143650890 2024-05-09T09:47:35.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.755+0000 7f33b4bc7640 1 -- 172.21.15.157:0/299953163 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(105 notify.2 [watch unwatch cookie 94769584105456] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33ac040040 con 0x563143650890 2024-05-09T09:47:35.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.755+0000 7f33b78ad980 20 remove_watcher() i=2 2024-05-09T09:47:35.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.755+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:106 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94769584110080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56314365abc0 con 0x7f33ac024070 2024-05-09T09:47:35.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.755+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.2 v2:172.21.15.157:6800/354455204 25 ==== osd_op_reply(106 notify.3 [watch unwatch cookie 94769584110080] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x7f33ac024070 2024-05-09T09:47:35.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.755+0000 7f33b78ad980 20 remove_watcher() i=3 2024-05-09T09:47:35.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.755+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94769584096752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143655da0 con 0x563143647550 2024-05-09T09:47:35.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.759+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(107 notify.4 [watch unwatch cookie 94769584096752] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33b0036040 con 0x563143647550 2024-05-09T09:47:35.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.759+0000 7f33b78ad980 20 remove_watcher() i=4 2024-05-09T09:47:35.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.759+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:108 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94769584114016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56314365abc0 con 0x56314364bf40 2024-05-09T09:47:35.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.759+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(108 notify.5 [watch unwatch cookie 94769584114016] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33a80e8020 con 0x56314364bf40 2024-05-09T09:47:35.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.759+0000 7f33b78ad980 20 remove_watcher() i=5 2024-05-09T09:47:35.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.759+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:109 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94769584119264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5631436545f0 con 0x56314364bf40 2024-05-09T09:47:35.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(109 notify.6 [watch unwatch cookie 94769584119264] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33a80e8020 con 0x56314364bf40 2024-05-09T09:47:35.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b78ad980 20 remove_watcher() i=6 2024-05-09T09:47:35.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:110 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94769584121392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563143655da0 con 0x56314364bf40 2024-05-09T09:47:35.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b53c8640 1 -- 172.21.15.157:0/299953163 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(110 notify.7 [watch unwatch cookie 94769584121392] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33a80e8020 con 0x56314364bf40 2024-05-09T09:47:35.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b78ad980 20 remove_watcher() i=7 2024-05-09T09:47:35.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56314364bf40 msgr2=0x56314364e330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b78ad980 1 --2- 172.21.15.157:0/299953163 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56314364bf40 0x56314364e330 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563143647550 msgr2=0x563143649a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b78ad980 1 --2- 172.21.15.157:0/299953163 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563143647550 0x563143649a10 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f33ac024070 msgr2=0x7f33ac031460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b78ad980 1 --2- 172.21.15.157:0/299953163 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f33ac024070 0x7f33ac031460 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563143650890 msgr2=0x563143652c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b78ad980 1 --2- 172.21.15.157:0/299953163 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563143650890 0x563143652c80 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3284034bb0 msgr2=0x7f3284037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b78ad980 1 --2- 172.21.15.157:0/299953163 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3284034bb0 0x7f3284037070 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x5631435f8130 tx=0x7f33ac010000 comp rx=0 tx=0).stop 2024-05-09T09:47:35.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631436348c0 msgr2=0x56314363a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b78ad980 1 --2- 172.21.15.157:0/299953163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631436348c0 0x56314363a9b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f33a80eb4b0 tx=0x7f33a80bfa90 comp rx=0 tx=0).stop 2024-05-09T09:47:35.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b5bc9640 1 -- 172.21.15.157:0/299953163 reap_dead start 2024-05-09T09:47:35.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 shutdown_connections 2024-05-09T09:47:35.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b78ad980 1 --2- 172.21.15.157:0/299953163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631436348c0 0x56314363a9b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 >> 172.21.15.157:0/299953163 conn(0x56314362f960 msgr2=0x56314362da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:35.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 shutdown_connections 2024-05-09T09:47:35.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b78ad980 1 -- 172.21.15.157:0/299953163 wait complete. 2024-05-09T09:47:35.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b78ad980 1 -- 172.21.15.157:0/2059390460 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f328c034bb0 msgr2=0x7f328c037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b78ad980 1 --2- 172.21.15.157:0/2059390460 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f328c034bb0 0x7f328c037070 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f33ac006300 tx=0x7f33ac00f000 comp rx=0 tx=0).stop 2024-05-09T09:47:35.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b78ad980 1 -- 172.21.15.157:0/2059390460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563143626610 msgr2=0x563143626a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b78ad980 1 --2- 172.21.15.157:0/2059390460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563143626610 0x563143626a30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f33a80ab4f0 tx=0x7f33a80b6d30 comp rx=0 tx=0).stop 2024-05-09T09:47:35.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b78ad980 1 -- 172.21.15.157:0/2059390460 shutdown_connections 2024-05-09T09:47:35.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b78ad980 1 --2- 172.21.15.157:0/2059390460 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f328c034bb0 0x7f328c037070 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b78ad980 1 --2- 172.21.15.157:0/2059390460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563143626610 0x563143626a30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.763+0000 7f33b78ad980 1 -- 172.21.15.157:0/2059390460 >> 172.21.15.157:0/2059390460 conn(0x56314361b3e0 msgr2=0x56314361bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:35.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.767+0000 7f33b78ad980 1 -- 172.21.15.157:0/2059390460 shutdown_connections 2024-05-09T09:47:35.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.767+0000 7f33b78ad980 1 -- 172.21.15.157:0/2059390460 wait complete. 2024-05-09T09:47:35.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.767+0000 7f33b78ad980 1 -- 172.21.15.157:0/2446532780 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5631435f9b80 msgr2=0x5631435fbf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.767+0000 7f33b78ad980 1 --2- 172.21.15.157:0/2446532780 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5631435f9b80 0x5631435fbf70 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.767+0000 7f33b78ad980 1 -- 172.21.15.157:0/2446532780 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5631435f4e10 msgr2=0x5631435f7200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.767+0000 7f33b78ad980 1 --2- 172.21.15.157:0/2446532780 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5631435f4e10 0x5631435f7200 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.767+0000 7f33b78ad980 1 -- 172.21.15.157:0/2446532780 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5631435fdaa0 msgr2=0x5631435ffe90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.767+0000 7f33b78ad980 1 --2- 172.21.15.157:0/2446532780 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5631435fdaa0 0x5631435ffe90 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.767+0000 7f33b78ad980 1 -- 172.21.15.157:0/2446532780 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f329c034bb0 msgr2=0x7f329c037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.767+0000 7f33b78ad980 1 --2- 172.21.15.157:0/2446532780 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f329c034bb0 0x7f329c037070 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0012f0 tx=0x7f33ac001430 comp rx=0 tx=0).stop 2024-05-09T09:47:35.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.767+0000 7f33b78ad980 1 -- 172.21.15.157:0/2446532780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631434fea90 msgr2=0x5631435efe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.767+0000 7f33b78ad980 1 --2- 172.21.15.157:0/2446532780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5631434fea90 0x5631435efe90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f33a80b8040 tx=0x7f33a8018020 comp rx=0 tx=0).stop 2024-05-09T09:47:35.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.767+0000 7f33b5bc9640 1 -- 172.21.15.157:0/2446532780 reap_dead start 2024-05-09T09:47:35.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.767+0000 7f33b78ad980 1 -- 172.21.15.157:0/2446532780 shutdown_connections 2024-05-09T09:47:35.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.767+0000 7f33b78ad980 1 -- 172.21.15.157:0/2446532780 >> 172.21.15.157:0/2446532780 conn(0x5631434f6070 msgr2=0x5631434fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:35.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.767+0000 7f33b78ad980 1 -- 172.21.15.157:0/2446532780 shutdown_connections 2024-05-09T09:47:35.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.767+0000 7f33b78ad980 1 -- 172.21.15.157:0/2446532780 wait complete. 2024-05-09T09:47:35.776 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-09T09:47:32.044078Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-05-09T09:47:35.743410Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:47:32.044055Z', 'tags': [], 'group_ids': []} 2024-05-09T09:47:35.777 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-09T09:47:35.777 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-09T09:47:35.777 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-09T09:47:35.856 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:35.857 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:35.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.859+0000 7fa4dc827980 1 Processor -- start 2024-05-09T09:47:35.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.859+0000 7fa4dc827980 1 -- start start 2024-05-09T09:47:35.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.859+0000 7fa4dc827980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x558226ca4090 0x558226d37990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.859+0000 7fa4dc827980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558226be4440 con 0x558226ca5380 2024-05-09T09:47:35.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.859+0000 7fa4dc827980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x558226bcf5f0 con 0x558226ca4090 2024-05-09T09:47:35.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.859+0000 7fa4d9b41640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x558226ca4090 0x558226d37990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.859+0000 7fa4da342640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x558226ca5380 0x558226ca3980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:51570/0 (socket says 172.21.15.157:51570) 2024-05-09T09:47:35.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.859+0000 7fa4d9b41640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x558226ca4090 0x558226d37990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58148/0 (socket says 172.21.15.157:58148) 2024-05-09T09:47:35.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.859+0000 7fa4da342640 1 -- 172.21.15.157:0/2161498356 learned_addr learned my addr 172.21.15.157:0/2161498356 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:47:35.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.863+0000 7fa4d9b41640 1 -- 172.21.15.157:0/2161498356 >> v1:172.21.15.110:6789/0 conn(0x558226ca5380 legacy=0x558226ca3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.863+0000 7fa4d9b41640 1 -- 172.21.15.157:0/2161498356 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558226bda990 con 0x558226ca4090 2024-05-09T09:47:35.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.863+0000 7fa4d9b41640 1 --2- 172.21.15.157:0/2161498356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226ca4090 0x558226d37990 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000a480 tx=0x7fa4d001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c6e4addc869118 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.867+0000 7fa4d9340640 1 -- 172.21.15.157:0/2161498356 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4d00b0070 con 0x558226ca4090 2024-05-09T09:47:35.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.867+0000 7fa4d9340640 1 -- 172.21.15.157:0/2161498356 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4d00ab540 con 0x558226ca4090 2024-05-09T09:47:35.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.867+0000 7fa4d9340640 1 -- 172.21.15.157:0/2161498356 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4d00ab840 con 0x558226ca4090 2024-05-09T09:47:35.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.867+0000 7fa4dc827980 1 -- 172.21.15.157:0/2161498356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226ca4090 msgr2=0x558226d37990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.867+0000 7fa4dc827980 1 --2- 172.21.15.157:0/2161498356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226ca4090 0x558226d37990 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000a480 tx=0x7fa4d001b280 comp rx=0 tx=0).stop 2024-05-09T09:47:35.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.867+0000 7fa4dc827980 1 -- 172.21.15.157:0/2161498356 shutdown_connections 2024-05-09T09:47:35.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.867+0000 7fa4dc827980 1 --2- 172.21.15.157:0/2161498356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226ca4090 0x558226d37990 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.867+0000 7fa4dc827980 1 -- 172.21.15.157:0/2161498356 >> 172.21.15.157:0/2161498356 conn(0x558226d2a250 msgr2=0x558226d2c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:35.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.867+0000 7fa4dc827980 1 -- 172.21.15.157:0/2161498356 shutdown_connections 2024-05-09T09:47:35.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.867+0000 7fa4dc827980 1 -- 172.21.15.157:0/2161498356 wait complete. 2024-05-09T09:47:35.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.883+0000 7fa4dc827980 1 Processor -- start 2024-05-09T09:47:35.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.883+0000 7fa4dc827980 1 -- start start 2024-05-09T09:47:35.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.883+0000 7fa4dc827980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226ca4090 0x558226e1c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.883+0000 7fa4dc827980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558226c31fe0 con 0x558226ca4090 2024-05-09T09:47:35.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.883+0000 7fa4da342640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226ca4090 0x558226e1c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.883+0000 7fa4da342640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226ca4090 0x558226e1c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58152/0 (socket says 172.21.15.157:58152) 2024-05-09T09:47:35.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.883+0000 7fa4da342640 1 -- 172.21.15.157:0/3097957059 learned_addr learned my addr 172.21.15.157:0/3097957059 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:35.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.883+0000 7fa4da342640 1 -- 172.21.15.157:0/3097957059 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558226bb6ae0 con 0x558226ca4090 2024-05-09T09:47:35.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.883+0000 7fa4da342640 1 --2- 172.21.15.157:0/3097957059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226ca4090 0x558226e1c250 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc001d90 tx=0x7fa4cc001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81d914a31e51b0da server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.883+0000 7fa3c8608640 1 -- 172.21.15.157:0/3097957059 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4cc013030 con 0x558226ca4090 2024-05-09T09:47:35.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.883+0000 7fa3c8608640 1 -- 172.21.15.157:0/3097957059 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4cc00e690 con 0x558226ca4090 2024-05-09T09:47:35.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.883+0000 7fa3c8608640 1 -- 172.21.15.157:0/3097957059 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4cc00ea10 con 0x558226ca4090 2024-05-09T09:47:35.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.883+0000 7fa4dc827980 1 -- 172.21.15.157:0/3097957059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226ca4090 msgr2=0x558226e1c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.883+0000 7fa4dc827980 1 --2- 172.21.15.157:0/3097957059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226ca4090 0x558226e1c250 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc001d90 tx=0x7fa4cc001e80 comp rx=0 tx=0).stop 2024-05-09T09:47:35.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.883+0000 7fa4dc827980 1 -- 172.21.15.157:0/3097957059 shutdown_connections 2024-05-09T09:47:35.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.887+0000 7fa4dc827980 1 --2- 172.21.15.157:0/3097957059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226ca4090 0x558226e1c250 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.887+0000 7fa4dc827980 1 -- 172.21.15.157:0/3097957059 >> 172.21.15.157:0/3097957059 conn(0x558226d2a250 msgr2=0x558226e17de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:35.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.887+0000 7fa4dc827980 1 -- 172.21.15.157:0/3097957059 shutdown_connections 2024-05-09T09:47:35.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.887+0000 7fa4dc827980 1 -- 172.21.15.157:0/3097957059 wait complete. 2024-05-09T09:47:35.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.887+0000 7fa4dc827980 1 Processor -- start 2024-05-09T09:47:35.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.887+0000 7fa4dc827980 1 -- start start 2024-05-09T09:47:35.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.887+0000 7fa4dc827980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226ca4090 0x558226e234d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.887+0000 7fa4dc827980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558226d3a990 con 0x558226ca4090 2024-05-09T09:47:35.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.887+0000 7fa4da342640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226ca4090 0x558226e234d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.887+0000 7fa4da342640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226ca4090 0x558226e234d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58168/0 (socket says 172.21.15.157:58168) 2024-05-09T09:47:35.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.887+0000 7fa4da342640 1 -- 172.21.15.157:0/3484050434 learned_addr learned my addr 172.21.15.157:0/3484050434 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:35.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.887+0000 7fa4da342640 1 -- 172.21.15.157:0/3484050434 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558226e23a10 con 0x558226ca4090 2024-05-09T09:47:35.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.887+0000 7fa4da342640 1 --2- 172.21.15.157:0/3484050434 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226ca4090 0x558226e234d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x558226e1d0e0 tx=0x7fa4cc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.887+0000 7fa3c6e05640 1 -- 172.21.15.157:0/3484050434 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4cc027070 con 0x558226ca4090 2024-05-09T09:47:35.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.887+0000 7fa3c6e05640 1 -- 172.21.15.157:0/3484050434 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4cc019900 con 0x558226ca4090 2024-05-09T09:47:35.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.887+0000 7fa4dc827980 1 -- 172.21.15.157:0/3484050434 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558226e23ca0 con 0x558226ca4090 2024-05-09T09:47:35.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.887+0000 7fa3c6e05640 1 -- 172.21.15.157:0/3484050434 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4cc019c20 con 0x558226ca4090 2024-05-09T09:47:35.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.887+0000 7fa4dc827980 1 -- 172.21.15.157:0/3484050434 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558226e26930 con 0x558226ca4090 2024-05-09T09:47:35.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.891+0000 7fa3c6e05640 1 -- 172.21.15.157:0/3484050434 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fa4cc02a070 con 0x558226ca4090 2024-05-09T09:47:35.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.891+0000 7fa3c6e05640 1 --2- 172.21.15.157:0/3484050434 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa3c0034c00 0x7fa3c00370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.891+0000 7fa3c6e05640 1 -- 172.21.15.157:0/3484050434 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fa4cc01f070 con 0x558226ca4090 2024-05-09T09:47:35.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.891+0000 7fa4d9b41640 1 --2- 172.21.15.157:0/3484050434 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa3c0034c00 0x7fa3c00370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.891+0000 7fa4dc827980 1 --2- 172.21.15.157:0/3484050434 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558226ca5380 0x558226e2a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.891+0000 7fa4dc827980 1 -- 172.21.15.157:0/3484050434 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558226e2aa60 con 0x558226ca5380 2024-05-09T09:47:35.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.891+0000 7fa4dab43640 1 --2- 172.21.15.157:0/3484050434 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558226ca5380 0x558226e2a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.891+0000 7fa4d9b41640 1 --2- 172.21.15.157:0/3484050434 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa3c0034c00 0x7fa3c00370c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00ad000 tx=0x7fa4d00a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.891+0000 7fa4dab43640 1 --2- 172.21.15.157:0/3484050434 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558226ca5380 0x558226e2a410 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.891+0000 7fa4dab43640 1 -- 172.21.15.157:0/3484050434 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226ca5380 2024-05-09T09:47:35.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.891+0000 7fa4dc827980 1 -- 172.21.15.157:0/3484050434 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558226e27b50 con 0x558226ca5380 2024-05-09T09:47:35.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.891+0000 7fa4dab43640 1 -- 172.21.15.157:0/3484050434 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226ca5380 2024-05-09T09:47:35.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.891+0000 7fa4dc827980 1 --2- 172.21.15.157:0/3484050434 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558226e2cd90 0x558226e2f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.891+0000 7fa4dc827980 1 -- 172.21.15.157:0/3484050434 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558226e2f870 con 0x558226e2cd90 2024-05-09T09:47:35.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.891+0000 7fa4da342640 1 --2- 172.21.15.157:0/3484050434 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558226e2cd90 0x558226e2f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.891+0000 7fa4da342640 1 --2- 172.21.15.157:0/3484050434 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558226e2cd90 0x558226e2f180 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.891+0000 7fa4da342640 1 -- 172.21.15.157:0/3484050434 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa4cc029030 con 0x558226e2cd90 2024-05-09T09:47:35.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.891+0000 7fa4dc827980 1 -- 172.21.15.157:0/3484050434 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558226e2bc30 con 0x558226ca5380 2024-05-09T09:47:35.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.891+0000 7fa4dab43640 1 -- 172.21.15.157:0/3484050434 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226ca5380 2024-05-09T09:47:35.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.895+0000 7fa4dc827980 1 --2- 172.21.15.157:0/3484050434 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558226e30cd0 0x558226e330c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.895+0000 7fa4dc827980 1 -- 172.21.15.157:0/3484050434 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558226e337b0 con 0x558226e30cd0 2024-05-09T09:47:35.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.895+0000 7fa4d9b41640 1 --2- 172.21.15.157:0/3484050434 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558226e30cd0 0x558226e330c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.895+0000 7fa4d9b41640 1 --2- 172.21.15.157:0/3484050434 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558226e30cd0 0x558226e330c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.895+0000 7fa4d9b41640 1 -- 172.21.15.157:0/3484050434 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa4d00ac8a0 con 0x558226e30cd0 2024-05-09T09:47:35.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.899+0000 7fa4dc827980 1 Processor -- start 2024-05-09T09:47:35.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.899+0000 7fa4dc827980 1 -- start start 2024-05-09T09:47:35.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.899+0000 7fa4dc827980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226e59600 0x558226e59a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.899+0000 7fa4dc827980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558226c36020 con 0x558226e59600 2024-05-09T09:47:35.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.899+0000 7fa4da342640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226e59600 0x558226e59a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.899+0000 7fa4da342640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226e59600 0x558226e59a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58180/0 (socket says 172.21.15.157:58180) 2024-05-09T09:47:35.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.899+0000 7fa4da342640 1 -- 172.21.15.157:0/3037952355 learned_addr learned my addr 172.21.15.157:0/3037952355 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:35.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.899+0000 7fa4da342640 1 -- 172.21.15.157:0/3037952355 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558226e59f60 con 0x558226e59600 2024-05-09T09:47:35.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.899+0000 7fa4da342640 1 --2- 172.21.15.157:0/3037952355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226e59600 0x558226e59a20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00c530 tx=0x7fa4cc04a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.903+0000 7fa3beba2640 1 -- 172.21.15.157:0/3037952355 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4cc042200 con 0x558226e59600 2024-05-09T09:47:35.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.903+0000 7fa3beba2640 1 -- 172.21.15.157:0/3037952355 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4cc0423a0 con 0x558226e59600 2024-05-09T09:47:35.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.903+0000 7fa4dc827980 1 -- 172.21.15.157:0/3037952355 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558226e5a9f0 con 0x558226e59600 2024-05-09T09:47:35.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.903+0000 7fa3beba2640 1 -- 172.21.15.157:0/3037952355 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4cc042680 con 0x558226e59600 2024-05-09T09:47:35.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.903+0000 7fa4dc827980 1 -- 172.21.15.157:0/3037952355 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558226e5aed0 con 0x558226e59600 2024-05-09T09:47:35.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.903+0000 7fa3beba2640 1 -- 172.21.15.157:0/3037952355 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fa4cc036040 con 0x558226e59600 2024-05-09T09:47:35.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.903+0000 7fa3beba2640 1 --2- 172.21.15.157:0/3037952355 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa3b4034c00 0x7fa3b40370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.903+0000 7fa3beba2640 1 -- 172.21.15.157:0/3037952355 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fa4cc014070 con 0x558226e59600 2024-05-09T09:47:35.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.903+0000 7fa4d9b41640 1 --2- 172.21.15.157:0/3037952355 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa3b4034c00 0x7fa3b40370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.903+0000 7fa4dc827980 1 Processor -- start 2024-05-09T09:47:35.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.903+0000 7fa4dc827980 1 -- start start 2024-05-09T09:47:35.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.903+0000 7fa4dc827980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226e66650 0x558226e66a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.903+0000 7fa4dc827980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558226e1c9a0 con 0x558226e66650 2024-05-09T09:47:35.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.903+0000 7fa4d9b41640 1 --2- 172.21.15.157:0/3037952355 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa3b4034c00 0x7fa3b40370c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x558226e2bc00 tx=0x7fa4d0005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.903+0000 7fa4da342640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226e66650 0x558226e66a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.903+0000 7fa4da342640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226e66650 0x558226e66a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58194/0 (socket says 172.21.15.157:58194) 2024-05-09T09:47:35.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.903+0000 7fa4da342640 1 -- 172.21.15.157:0/3749761995 learned_addr learned my addr 172.21.15.157:0/3749761995 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:35.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.903+0000 7fa4da342640 1 -- 172.21.15.157:0/3749761995 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558226e67020 con 0x558226e66650 2024-05-09T09:47:35.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.903+0000 7fa4da342640 1 --2- 172.21.15.157:0/3749761995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226e66650 0x558226e66a50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc048ad0 tx=0x7fa4cc038440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab09e154ff2c5e34 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.907+0000 7fa3bcb9e640 1 -- 172.21.15.157:0/3749761995 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4cc02cd60 con 0x558226e66650 2024-05-09T09:47:35.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.907+0000 7fa3bcb9e640 1 -- 172.21.15.157:0/3749761995 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4cc05e070 con 0x558226e66650 2024-05-09T09:47:35.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.907+0000 7fa3bcb9e640 1 -- 172.21.15.157:0/3749761995 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4cc02c440 con 0x558226e66650 2024-05-09T09:47:35.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.907+0000 7fa4dc827980 1 -- 172.21.15.157:0/3749761995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226e66650 msgr2=0x558226e66a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:35.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.907+0000 7fa4dc827980 1 --2- 172.21.15.157:0/3749761995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226e66650 0x558226e66a50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc048ad0 tx=0x7fa4cc038440 comp rx=0 tx=0).stop 2024-05-09T09:47:35.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.907+0000 7fa4dc827980 1 -- 172.21.15.157:0/3749761995 shutdown_connections 2024-05-09T09:47:35.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.907+0000 7fa4dc827980 1 --2- 172.21.15.157:0/3749761995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226e66650 0x558226e66a50 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:35.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.907+0000 7fa4dc827980 1 -- 172.21.15.157:0/3749761995 >> 172.21.15.157:0/3749761995 conn(0x558226e629d0 msgr2=0x558226e60a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:35.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.907+0000 7fa4dc827980 1 -- 172.21.15.157:0/3749761995 shutdown_connections 2024-05-09T09:47:35.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.907+0000 7fa4dc827980 1 -- 172.21.15.157:0/3749761995 wait complete. 2024-05-09T09:47:35.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.907+0000 7fa4dc827980 1 Processor -- start 2024-05-09T09:47:35.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.907+0000 7fa4dc827980 1 -- start start 2024-05-09T09:47:35.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.907+0000 7fa4dc827980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226e66650 0x558226e6d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.907+0000 7fa4dc827980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558226e67590 con 0x558226e66650 2024-05-09T09:47:35.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.907+0000 7fa4da342640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226e66650 0x558226e6d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.907+0000 7fa4da342640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226e66650 0x558226e6d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58202/0 (socket says 172.21.15.157:58202) 2024-05-09T09:47:35.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.907+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 learned_addr learned my addr 172.21.15.157:0/209225722 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:35.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.907+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558226e6deb0 con 0x558226e66650 2024-05-09T09:47:35.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.907+0000 7fa4da342640 1 --2- 172.21.15.157:0/209225722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226e66650 0x558226e6d970 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc0218d0 tx=0x7fa4cc01dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.907+0000 7fa3aaffd640 1 -- 172.21.15.157:0/209225722 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4cc047520 con 0x558226e66650 2024-05-09T09:47:35.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.907+0000 7fa3aaffd640 1 -- 172.21.15.157:0/209225722 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4cc0476c0 con 0x558226e66650 2024-05-09T09:47:35.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.907+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558226e6deb0 con 0x558226e66650 2024-05-09T09:47:35.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.907+0000 7fa3aaffd640 1 -- 172.21.15.157:0/209225722 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4cc038c50 con 0x558226e66650 2024-05-09T09:47:35.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.907+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558226e6e390 con 0x558226e66650 2024-05-09T09:47:35.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa3aaffd640 1 -- 172.21.15.157:0/209225722 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fa4cc016070 con 0x558226e66650 2024-05-09T09:47:35.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa4dc827980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa3aaffd640 1 --2- 172.21.15.157:0/209225722 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa3a4034bb0 0x7fa3a4037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa3aaffd640 1 -- 172.21.15.157:0/209225722 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fa4cc005050 con 0x558226e66650 2024-05-09T09:47:35.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa4d9b41640 1 --2- 172.21.15.157:0/209225722 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa3a4034bb0 0x7fa3a4037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa4dc827980 1 --2- 172.21.15.157:0/209225722 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558226e7a500 0x558226e7c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558226e7d0f0 con 0x558226e7a500 2024-05-09T09:47:35.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa4dab43640 1 --2- 172.21.15.157:0/209225722 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558226e7a500 0x558226e7c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa4d9b41640 1 --2- 172.21.15.157:0/209225722 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa3a4034bb0 0x7fa3a4037070 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00acfd0 tx=0x7fa4d00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa4dab43640 1 --2- 172.21.15.157:0/209225722 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558226e7a500 0x558226e7c9a0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:35.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa4dc827980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:35.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa4dc827980 20 realm 2024-05-09T09:47:35.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa4dc827980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558226e7d500 con 0x558226e7a500 2024-05-09T09:47:35.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:35.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa4dc827980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:35.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa4dc827980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:35.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa4dc827980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558226e7dda0 con 0x558226e7a500 2024-05-09T09:47:35.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:35.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa4dc827980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:35.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa4dc827980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558226e7e140 con 0x558226e7a500 2024-05-09T09:47:35.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:35.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa4dc827980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:35.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa4dc827980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa4dc827980 1 --2- 172.21.15.157:0/209225722 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558226e7eea0 0x558226e81290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558226e81810 con 0x558226e7eea0 2024-05-09T09:47:35.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa4da342640 1 --2- 172.21.15.157:0/209225722 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558226e7eea0 0x558226e81290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.911+0000 7fa4da342640 1 --2- 172.21.15.157:0/209225722 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558226e7eea0 0x558226e81290 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.915+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa4cc080040 con 0x558226e7eea0 2024-05-09T09:47:35.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.915+0000 7fa4dc827980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:35.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.915+0000 7fa4dc827980 20 searching for the correct realm 2024-05-09T09:47:35.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.915+0000 7fa4dc827980 1 --2- 172.21.15.157:0/209225722 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558226e83740 0x558226e85bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.915+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558226e862a0 con 0x558226e83740 2024-05-09T09:47:35.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.915+0000 7fa4d9b41640 1 --2- 172.21.15.157:0/209225722 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558226e83740 0x558226e85bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.915+0000 7fa4d9b41640 1 --2- 172.21.15.157:0/209225722 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558226e83740 0x558226e85bd0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.915+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4d00da070 con 0x558226e83740 2024-05-09T09:47:35.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.915+0000 7fa4d9b41640 1 --2- 172.21.15.157:0/209225722 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa4d00cf040 0x7fa4d00dc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:35.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.915+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558226e862a0 con 0x7fa4d00cf040 2024-05-09T09:47:35.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.915+0000 7fa4dab43640 1 --2- 172.21.15.157:0/209225722 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa4d00cf040 0x7fa4d00dc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:35.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.915+0000 7fa4dab43640 1 --2- 172.21.15.157:0/209225722 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa4d00cf040 0x7fa4d00dc920 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:35.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.915+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4d400a4d0 con 0x7fa4d00cf040 2024-05-09T09:47:35.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.915+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558226e7e140 con 0x558226e7eea0 2024-05-09T09:47:35.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.915+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4cc080040 con 0x558226e7eea0 2024-05-09T09:47:35.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.915+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558226e7e140 con 0x558226e7a500 2024-05-09T09:47:35.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.915+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:35.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.915+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558226e7e140 con 0x558226e7a500 2024-05-09T09:47:35.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.915+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:35.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.915+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558226e7e140 con 0x558226e7eea0 2024-05-09T09:47:35.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.919+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4cc080040 con 0x558226e7eea0 2024-05-09T09:47:35.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.919+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558226e7e140 con 0x558226e7eea0 2024-05-09T09:47:35.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.919+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4cc080040 con 0x558226e7eea0 2024-05-09T09:47:35.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.919+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558226e7e140 con 0x7fa4d00cf040 2024-05-09T09:47:35.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.919+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4d400a4d0 con 0x7fa4d00cf040 2024-05-09T09:47:35.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.919+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558226e7e140 con 0x558226e83740 2024-05-09T09:47:35.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.919+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4d00da070 con 0x558226e83740 2024-05-09T09:47:35.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.919+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558226e7e140 con 0x558226e7a500 2024-05-09T09:47:35.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.919+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:35.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.919+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558226e7e140 con 0x558226e7eea0 2024-05-09T09:47:35.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.919+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4cc080040 con 0x558226e7eea0 2024-05-09T09:47:35.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.919+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558226e7e140 con 0x558226e7a500 2024-05-09T09:47:35.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.919+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:35.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.919+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558226e7e140 con 0x7fa4d00cf040 2024-05-09T09:47:35.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.919+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa4d400a4d0 con 0x7fa4d00cf040 2024-05-09T09:47:35.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.919+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558226e7e140 con 0x558226e83740 2024-05-09T09:47:35.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.919+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4d00da070 con 0x558226e83740 2024-05-09T09:47:35.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.919+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa4d00e9040 con 0x558226e83740 2024-05-09T09:47:35.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.919+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa4d00da070 con 0x558226e83740 2024-05-09T09:47:35.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.919+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa4d00e9040 con 0x558226e7eea0 2024-05-09T09:47:35.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.923+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4cc080040 con 0x558226e7eea0 2024-05-09T09:47:35.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.923+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa4d00e9040 con 0x558226e83740 2024-05-09T09:47:35.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.923+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4d00da070 con 0x558226e83740 2024-05-09T09:47:35.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.923+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa4d00e9040 con 0x558226e83740 2024-05-09T09:47:35.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.923+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4d00da070 con 0x558226e83740 2024-05-09T09:47:35.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.923+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa4d00e9040 con 0x558226e7a500 2024-05-09T09:47:35.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.923+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:35.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.923+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa4d00e9040 con 0x558226e7a500 2024-05-09T09:47:35.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.923+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:35.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.923+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa4d00e9040 con 0x558226e7eea0 2024-05-09T09:47:35.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.923+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4cc080040 con 0x558226e7eea0 2024-05-09T09:47:35.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.923+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa4d00e9040 con 0x558226e83740 2024-05-09T09:47:35.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.923+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4d00da070 con 0x558226e83740 2024-05-09T09:47:35.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.923+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa4d00e9040 con 0x7fa4d00cf040 2024-05-09T09:47:35.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.923+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4d400a4d0 con 0x7fa4d00cf040 2024-05-09T09:47:35.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.923+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa4d00e9040 con 0x558226e7a500 2024-05-09T09:47:35.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.923+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:35.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.923+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa4d00e9040 con 0x558226e7eea0 2024-05-09T09:47:35.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa4cc080040 con 0x558226e7eea0 2024-05-09T09:47:35.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa4d00e9040 con 0x558226e83740 2024-05-09T09:47:35.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4d00da070 con 0x558226e83740 2024-05-09T09:47:35.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa4d00e9040 con 0x558226e7eea0 2024-05-09T09:47:35.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4cc080040 con 0x558226e7eea0 2024-05-09T09:47:35.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa4d00e9040 con 0x7fa4d00cf040 2024-05-09T09:47:35.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4d400a4d0 con 0x7fa4d00cf040 2024-05-09T09:47:35.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa4d00e9040 con 0x558226e83740 2024-05-09T09:47:35.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4d00da070 con 0x558226e83740 2024-05-09T09:47:35.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa4d00e9040 con 0x558226e7eea0 2024-05-09T09:47:35.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4cc080040 con 0x558226e7eea0 2024-05-09T09:47:35.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa4d00e9040 con 0x558226e7a500 2024-05-09T09:47:35.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:35.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa4d00e9040 con 0x7fa4d00cf040 2024-05-09T09:47:35.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4d400a4d0 con 0x7fa4d00cf040 2024-05-09T09:47:35.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4dc827980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:35.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4dc827980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:35.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4dc827980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:35.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4dc827980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:35.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4dc827980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:35.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4dc827980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:35.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4dc827980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558226e82060 con 0x558226e7a500 2024-05-09T09:47:35.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:35.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4dc827980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:35.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4dc827980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558226e82060 con 0x558226e7a500 2024-05-09T09:47:35.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:35.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4dc827980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:35.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4dc827980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.927+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558226e82060 con 0x558226e83740 2024-05-09T09:47:35.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.931+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa4d00da070 con 0x558226e83740 2024-05-09T09:47:35.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.931+0000 7fa4dc827980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:35.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.931+0000 7fa4dc827980 20 zone default found 2024-05-09T09:47:35.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.931+0000 7fa4dc827980 4 Realm: () 2024-05-09T09:47:35.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.931+0000 7fa4dc827980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:35.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.931+0000 7fa4dc827980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:35.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.931+0000 7fa4dc827980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:35.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.931+0000 7fa4dc827980 20 zonegroup default 2024-05-09T09:47:35.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.931+0000 7fa4dc827980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.931+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558226e82900 con 0x558226e7eea0 2024-05-09T09:47:35.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.931+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa4cc080040 con 0x558226e7eea0 2024-05-09T09:47:35.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.931+0000 7fa4dc827980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:35.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.931+0000 7fa4dc827980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.931+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558226e88100 con 0x558226e83740 2024-05-09T09:47:35.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.931+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa4d00da070 con 0x558226e83740 2024-05-09T09:47:35.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.931+0000 7fa4dc827980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:35.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.931+0000 7fa4dc827980 20 rados->read ofs=0 len=0 2024-05-09T09:47:35.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.931+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558226e884a0 con 0x558226e83740 2024-05-09T09:47:35.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.931+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa4d00da070 con 0x558226e83740 2024-05-09T09:47:35.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.931+0000 7fa4dc827980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:35.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.931+0000 7fa4dc827980 20 started sync module instance, tier type = 2024-05-09T09:47:35.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.931+0000 7fa4dc827980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:35.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.931+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e875a0 con 0x7fa4d00cf040 2024-05-09T09:47:35.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.931+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x7fa4d00cf040 2024-05-09T09:47:35.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.931+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94017486879440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e875a0 con 0x7fa4d00cf040 2024-05-09T09:47:35.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.931+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e88e60 con 0x558226e7a500 2024-05-09T09:47:35.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.935+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94017486879440] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x7fa4d00cf040 2024-05-09T09:47:35.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.935+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:35.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.935+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94017486883520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e875a0 con 0x558226e7a500 2024-05-09T09:47:35.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.935+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e89870 con 0x558226e83740 2024-05-09T09:47:35.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.935+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4d00da070 con 0x558226e83740 2024-05-09T09:47:35.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.935+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94017486885824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e8a0c0 con 0x558226e83740 2024-05-09T09:47:35.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.935+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e8aae0 con 0x7fa4d00cf040 2024-05-09T09:47:35.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.935+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94017486883520] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:35.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.939+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x7fa4d00cf040 2024-05-09T09:47:35.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.939+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94017486890448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e8aed0 con 0x7fa4d00cf040 2024-05-09T09:47:35.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.939+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e8b890 con 0x558226e7a500 2024-05-09T09:47:35.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.939+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94017486885824] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4d00da070 con 0x558226e83740 2024-05-09T09:47:35.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.939+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94017486890448] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x7fa4d00cf040 2024-05-09T09:47:35.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.939+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:35.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.939+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94017486876912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e8b3e0 con 0x558226e7a500 2024-05-09T09:47:35.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.939+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e8bc30 con 0x558226e7eea0 2024-05-09T09:47:35.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.943+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94017486876912] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:35.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.943+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4cc080040 con 0x558226e7eea0 2024-05-09T09:47:35.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.943+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94017486894048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e8b800 con 0x558226e7eea0 2024-05-09T09:47:35.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.943+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e8c930 con 0x558226e7eea0 2024-05-09T09:47:35.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.943+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4cc080040 con 0x558226e7eea0 2024-05-09T09:47:35.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.943+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94017486894048] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4cc080040 con 0x558226e7eea0 2024-05-09T09:47:35.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.943+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94017486898576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e8d020 con 0x558226e7eea0 2024-05-09T09:47:35.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.943+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e8c010 con 0x558226e7eea0 2024-05-09T09:47:35.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.947+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94017486898576] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4cc080040 con 0x558226e7eea0 2024-05-09T09:47:35.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.947+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4cc080040 con 0x558226e7eea0 2024-05-09T09:47:35.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.947+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94017486897168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e8d610 con 0x558226e7eea0 2024-05-09T09:47:35.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.947+0000 7fa4dc827980 20 add_watcher() i=0 2024-05-09T09:47:35.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.947+0000 7fa4dc827980 20 add_watcher() i=1 2024-05-09T09:47:35.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.947+0000 7fa4dc827980 20 add_watcher() i=2 2024-05-09T09:47:35.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.947+0000 7fa4dc827980 20 add_watcher() i=3 2024-05-09T09:47:35.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.947+0000 7fa4dc827980 20 add_watcher() i=4 2024-05-09T09:47:35.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.947+0000 7fa4dc827980 20 add_watcher() i=5 2024-05-09T09:47:35.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.947+0000 7fa4dc827980 20 add_watcher() i=6 2024-05-09T09:47:35.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.947+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94017486897168] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4cc080040 con 0x558226e7eea0 2024-05-09T09:47:35.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.947+0000 7fa4dc827980 20 add_watcher() i=7 2024-05-09T09:47:35.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.947+0000 7fa4dc827980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:35.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.947+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558226e90a10 con 0x558226e7a500 2024-05-09T09:47:35.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.947+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:35.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.947+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94017486899824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e8df30 con 0x558226e7a500 2024-05-09T09:47:35.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.951+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94017486899824] v30'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:35.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.951+0000 7fa38f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:35.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.951+0000 7fa4dc827980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:35.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.951+0000 7fa4dc827980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:35.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.951+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e90530 con 0x558226e7a500 2024-05-09T09:47:35.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.951+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'38 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:35.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.951+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e904a0 con 0x558226e7eea0 2024-05-09T09:47:35.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.955+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'32 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa4cc080040 con 0x558226e7eea0 2024-05-09T09:47:35.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.955+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e904a0 con 0x558226e83740 2024-05-09T09:47:35.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.955+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'32 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa4d00da070 con 0x558226e83740 2024-05-09T09:47:35.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.955+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e99c50 con 0x558226e7a500 2024-05-09T09:47:35.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.955+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'135 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:35.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.955+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e9a1c0 con 0x7fa4d00cf040 2024-05-09T09:47:35.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.959+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'86 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x7fa4d00cf040 2024-05-09T09:47:35.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.959+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e9a670 con 0x558226e83740 2024-05-09T09:47:35.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.959+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'57 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa4d00da070 con 0x558226e83740 2024-05-09T09:47:35.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.959+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e99200 con 0x558226e7a500 2024-05-09T09:47:35.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.959+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'34 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:35.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.959+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e99310 con 0x558226e7eea0 2024-05-09T09:47:35.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.963+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'57 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa4cc080040 con 0x558226e7eea0 2024-05-09T09:47:35.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.963+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e99420 con 0x7fa4d00cf040 2024-05-09T09:47:35.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.963+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'32 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x7fa4d00cf040 2024-05-09T09:47:35.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.967+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e9b220 con 0x558226e83740 2024-05-09T09:47:35.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.967+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'38 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa4d00da070 con 0x558226e83740 2024-05-09T09:47:35.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.967+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e9b220 con 0x7fa4d00cf040 2024-05-09T09:47:35.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.967+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'87 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x7fa4d00cf040 2024-05-09T09:47:35.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.967+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e9b220 con 0x558226e7eea0 2024-05-09T09:47:35.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.971+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'34 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4cc080040 con 0x558226e7eea0 2024-05-09T09:47:35.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.971+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e9b2b0 con 0x7fa4d00cf040 2024-05-09T09:47:35.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.971+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'32 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x7fa4d00cf040 2024-05-09T09:47:35.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.971+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e9b2b0 con 0x558226e7eea0 2024-05-09T09:47:35.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.971+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'63 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4cc080040 con 0x558226e7eea0 2024-05-09T09:47:35.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.975+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e9b340 con 0x558226e7a500 2024-05-09T09:47:35.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.975+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'136 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:35.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.975+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e9b340 con 0x558226e83740 2024-05-09T09:47:35.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.975+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'80 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4d00da070 con 0x558226e83740 2024-05-09T09:47:35.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.975+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e9b3d0 con 0x7fa4d00cf040 2024-05-09T09:47:35.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.979+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'88 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x7fa4d00cf040 2024-05-09T09:47:35.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.979+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e9b3d0 con 0x558226e83740 2024-05-09T09:47:35.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.979+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'32 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4d00da070 con 0x558226e83740 2024-05-09T09:47:35.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.979+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e9b460 con 0x558226e7a500 2024-05-09T09:47:35.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.979+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'40 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:35.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.979+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e9b460 con 0x558226e7a500 2024-05-09T09:47:35.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.983+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'137 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:35.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.983+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e9b460 con 0x558226e83740 2024-05-09T09:47:35.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.983+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'81 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4d00da070 con 0x558226e83740 2024-05-09T09:47:35.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.983+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e9b460 con 0x7fa4d00cf040 2024-05-09T09:47:35.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.987+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'42 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x7fa4d00cf040 2024-05-09T09:47:35.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.987+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e9b460 con 0x558226e83740 2024-05-09T09:47:35.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.987+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'34 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4d00da070 con 0x558226e83740 2024-05-09T09:47:35.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.987+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e9b460 con 0x558226e83740 2024-05-09T09:47:35.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.987+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'38 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4d00da070 con 0x558226e83740 2024-05-09T09:47:35.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.987+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e9b460 con 0x558226e83740 2024-05-09T09:47:35.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.991+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'28 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4d00da070 con 0x558226e83740 2024-05-09T09:47:35.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.991+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e9b490 con 0x558226e83740 2024-05-09T09:47:35.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.991+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'58 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4d00da070 con 0x558226e83740 2024-05-09T09:47:35.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.991+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e9b490 con 0x558226e7eea0 2024-05-09T09:47:35.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.995+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'34 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4cc080040 con 0x558226e7eea0 2024-05-09T09:47:35.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.995+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e9b460 con 0x558226e83740 2024-05-09T09:47:35.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.995+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'32 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4d00da070 con 0x558226e83740 2024-05-09T09:47:35.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.995+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e9b460 con 0x558226e7eea0 2024-05-09T09:47:35.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.995+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'58 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4cc080040 con 0x558226e7eea0 2024-05-09T09:47:35.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.995+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e9b3d0 con 0x558226e83740 2024-05-09T09:47:35.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.999+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'82 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4d00da070 con 0x558226e83740 2024-05-09T09:47:35.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:35.999+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e9b3d0 con 0x558226e7eea0 2024-05-09T09:47:36.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.003+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'64 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4cc080040 con 0x558226e7eea0 2024-05-09T09:47:36.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.003+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e9b3d0 con 0x7fa4d00cf040 2024-05-09T09:47:36.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.003+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'38 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x7fa4d00cf040 2024-05-09T09:47:36.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.003+0000 7fa38e7e4640 20 reqs_thread_entry: start 2024-05-09T09:47:36.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.003+0000 7fa4dc827980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:36.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.007+0000 7fa2fffff640 20 reqs_thread_entry: start 2024-05-09T09:47:36.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.007+0000 7fa4dc827980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.007+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558226eb7160 con 0x558226e7a500 2024-05-09T09:47:36.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.007+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:36.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.007+0000 7fa4dc827980 20 rados_obj.operate() r=0 bl.length=673 2024-05-09T09:47:36.005 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-09T09:47:32.044078Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-05-09T09:47:35.743410Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:47:32.044055Z","tags":[],"group_ids":[]} 2024-05-09T09:47:36.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.007+0000 7fa38f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:36.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.007+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94017486899824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226eb74c0 con 0x558226e7a500 2024-05-09T09:47:36.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.011+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94017486899824] v30'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:36.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.011+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94017486879440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226eb74c0 con 0x7fa4d00cf040 2024-05-09T09:47:36.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.011+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94017486879440] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x7fa4d00cf040 2024-05-09T09:47:36.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.011+0000 7fa4dc827980 20 remove_watcher() i=0 2024-05-09T09:47:36.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.011+0000 7fa4dc827980 2 removed watcher, disabling cache 2024-05-09T09:47:36.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.011+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94017486883520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e87ad0 con 0x558226e7a500 2024-05-09T09:47:36.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.011+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94017486883520] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:36.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.011+0000 7fa4dc827980 20 remove_watcher() i=1 2024-05-09T09:47:36.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.011+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94017486885824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e87ad0 con 0x558226e83740 2024-05-09T09:47:36.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.015+0000 7fa4d9b41640 1 -- 172.21.15.157:0/209225722 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94017486885824] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4d00da070 con 0x558226e83740 2024-05-09T09:47:36.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.015+0000 7fa4dc827980 20 remove_watcher() i=2 2024-05-09T09:47:36.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.015+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94017486890448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e893c0 con 0x7fa4d00cf040 2024-05-09T09:47:36.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.015+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94017486890448] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x7fa4d00cf040 2024-05-09T09:47:36.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.015+0000 7fa4dc827980 20 remove_watcher() i=3 2024-05-09T09:47:36.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.015+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94017486876912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e87ad0 con 0x558226e7a500 2024-05-09T09:47:36.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.019+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94017486876912] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4d400a4d0 con 0x558226e7a500 2024-05-09T09:47:36.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.019+0000 7fa4dc827980 20 remove_watcher() i=4 2024-05-09T09:47:36.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.019+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94017486894048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e893c0 con 0x558226e7eea0 2024-05-09T09:47:36.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.019+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94017486894048] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4cc080040 con 0x558226e7eea0 2024-05-09T09:47:36.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.019+0000 7fa4dc827980 20 remove_watcher() i=5 2024-05-09T09:47:36.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.019+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94017486898576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e870f0 con 0x558226e7eea0 2024-05-09T09:47:36.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.023+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94017486898576] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4cc080040 con 0x558226e7eea0 2024-05-09T09:47:36.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.023+0000 7fa4dc827980 20 remove_watcher() i=6 2024-05-09T09:47:36.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.023+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94017486897168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558226e87ad0 con 0x558226e7eea0 2024-05-09T09:47:36.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.023+0000 7fa4da342640 1 -- 172.21.15.157:0/209225722 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94017486897168] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4cc080040 con 0x558226e7eea0 2024-05-09T09:47:36.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.023+0000 7fa4dc827980 20 remove_watcher() i=7 2024-05-09T09:47:36.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.023+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558226e7eea0 msgr2=0x558226e81290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.023+0000 7fa4dc827980 1 --2- 172.21.15.157:0/209225722 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558226e7eea0 0x558226e81290 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.023+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558226e7a500 msgr2=0x558226e7c9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.023+0000 7fa4dc827980 1 --2- 172.21.15.157:0/209225722 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558226e7a500 0x558226e7c9a0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.023+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa4d00cf040 msgr2=0x7fa4d00dc920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.023+0000 7fa4dc827980 1 --2- 172.21.15.157:0/209225722 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa4d00cf040 0x7fa4d00dc920 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558226e83740 msgr2=0x558226e85bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 --2- 172.21.15.157:0/209225722 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558226e83740 0x558226e85bd0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa3a4034bb0 msgr2=0x7fa3a4037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 --2- 172.21.15.157:0/209225722 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa3a4034bb0 0x7fa3a4037070 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00acfd0 tx=0x7fa4d00a6000 comp rx=0 tx=0).stop 2024-05-09T09:47:36.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226e66650 msgr2=0x558226e6d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dab43640 1 -- 172.21.15.157:0/209225722 reap_dead start 2024-05-09T09:47:36.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 --2- 172.21.15.157:0/209225722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226e66650 0x558226e6d970 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc0218d0 tx=0x7fa4cc01dd90 comp rx=0 tx=0).stop 2024-05-09T09:47:36.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 shutdown_connections 2024-05-09T09:47:36.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 --2- 172.21.15.157:0/209225722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226e66650 0x558226e6d970 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 >> 172.21.15.157:0/209225722 conn(0x558226e629d0 msgr2=0x558226e60a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:36.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 shutdown_connections 2024-05-09T09:47:36.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 -- 172.21.15.157:0/209225722 wait complete. 2024-05-09T09:47:36.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 -- 172.21.15.157:0/3037952355 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa3b4034c00 msgr2=0x7fa3b40370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 --2- 172.21.15.157:0/3037952355 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa3b4034c00 0x7fa3b40370c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x558226e2bc00 tx=0x7fa4d0005a10 comp rx=0 tx=0).stop 2024-05-09T09:47:36.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 -- 172.21.15.157:0/3037952355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226e59600 msgr2=0x558226e59a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 --2- 172.21.15.157:0/3037952355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226e59600 0x558226e59a20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00c530 tx=0x7fa4cc04a420 comp rx=0 tx=0).stop 2024-05-09T09:47:36.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 -- 172.21.15.157:0/3037952355 shutdown_connections 2024-05-09T09:47:36.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 --2- 172.21.15.157:0/3037952355 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa3b4034c00 0x7fa3b40370c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 --2- 172.21.15.157:0/3037952355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226e59600 0x558226e59a20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 -- 172.21.15.157:0/3037952355 >> 172.21.15.157:0/3037952355 conn(0x558226e4e3d0 msgr2=0x558226e4eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:36.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 -- 172.21.15.157:0/3037952355 shutdown_connections 2024-05-09T09:47:36.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 -- 172.21.15.157:0/3037952355 wait complete. 2024-05-09T09:47:36.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 -- 172.21.15.157:0/3484050434 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558226e2cd90 msgr2=0x558226e2f180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 --2- 172.21.15.157:0/3484050434 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558226e2cd90 0x558226e2f180 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 -- 172.21.15.157:0/3484050434 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558226ca5380 msgr2=0x558226e2a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 --2- 172.21.15.157:0/3484050434 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558226ca5380 0x558226e2a410 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 -- 172.21.15.157:0/3484050434 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558226e30cd0 msgr2=0x558226e330c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 --2- 172.21.15.157:0/3484050434 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558226e30cd0 0x558226e330c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 -- 172.21.15.157:0/3484050434 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa3c0034c00 msgr2=0x7fa3c00370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 --2- 172.21.15.157:0/3484050434 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa3c0034c00 0x7fa3c00370c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00ad000 tx=0x7fa4d00a5040 comp rx=0 tx=0).stop 2024-05-09T09:47:36.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 -- 172.21.15.157:0/3484050434 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226ca4090 msgr2=0x558226e234d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 --2- 172.21.15.157:0/3484050434 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558226ca4090 0x558226e234d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x558226e1d0e0 tx=0x7fa4cc000bd0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dab43640 1 -- 172.21.15.157:0/3484050434 reap_dead start 2024-05-09T09:47:36.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 -- 172.21.15.157:0/3484050434 shutdown_connections 2024-05-09T09:47:36.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 -- 172.21.15.157:0/3484050434 >> 172.21.15.157:0/3484050434 conn(0x558226d2a250 msgr2=0x558226e168f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:36.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 -- 172.21.15.157:0/3484050434 shutdown_connections 2024-05-09T09:47:36.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.027+0000 7fa4dc827980 1 -- 172.21.15.157:0/3484050434 wait complete. 2024-05-09T09:47:36.038 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-09T09:47:32.044078Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-05-09T09:47:35.743410Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:47:32.044055Z', 'tags': [], 'group_ids': []} 2024-05-09T09:47:36.038 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-05-09T09:47:36.038 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-05-09T09:47:36.038 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-05-09T09:47:36.118 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:36.119 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:36.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.119+0000 7fbf4ccb1980 1 Processor -- start 2024-05-09T09:47:36.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.119+0000 7fbf4ccb1980 1 -- start start 2024-05-09T09:47:36.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.119+0000 7fbf4ccb1980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5602bfc0eb40 0x5602bfc0ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.119+0000 7fbf4ccb1980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5602bfac2440 con 0x5602bfc0f460 2024-05-09T09:47:36.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.119+0000 7fbf4ccb1980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5602bfaad5f0 con 0x5602bfc0eb40 2024-05-09T09:47:36.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.119+0000 7fbf4a7cc640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5602bfc0eb40 0x5602bfc0ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.119+0000 7fbf4a7cc640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5602bfc0eb40 0x5602bfc0ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58214/0 (socket says 172.21.15.157:58214) 2024-05-09T09:47:36.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.123+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/1577387986 learned_addr learned my addr 172.21.15.157:0/1577387986 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:36.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.119+0000 7fbf49fcb640 1 --1- 172.21.15.157:0/1577387986 >> v1:172.21.15.110:6789/0 conn(0x5602bfc0f460 0x5602bfc0fe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:51586/0 (socket says 172.21.15.157:51586) 2024-05-09T09:47:36.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.123+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/1577387986 >> v1:172.21.15.110:6789/0 conn(0x5602bfc0f460 legacy=0x5602bfc0fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.123+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/1577387986 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602bfab8990 con 0x5602bfc0eb40 2024-05-09T09:47:36.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.127+0000 7fbf4a7cc640 1 --2- 172.21.15.157:0/1577387986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfc0eb40 0x5602bfc0ef20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00a5c0 tx=0x7fbf3c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b925d228df7c85f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.127+0000 7fbf497ca640 1 -- 172.21.15.157:0/1577387986 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf3c0a6070 con 0x5602bfc0eb40 2024-05-09T09:47:36.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.127+0000 7fbf497ca640 1 -- 172.21.15.157:0/1577387986 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf3c0af070 con 0x5602bfc0eb40 2024-05-09T09:47:36.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.127+0000 7fbf497ca640 1 -- 172.21.15.157:0/1577387986 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf3c0aa5c0 con 0x5602bfc0eb40 2024-05-09T09:47:36.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.127+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/1577387986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfc0eb40 msgr2=0x5602bfc0ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.127+0000 7fbf4ccb1980 1 --2- 172.21.15.157:0/1577387986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfc0eb40 0x5602bfc0ef20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00a5c0 tx=0x7fbf3c01b340 comp rx=0 tx=0).stop 2024-05-09T09:47:36.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.127+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/1577387986 shutdown_connections 2024-05-09T09:47:36.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.127+0000 7fbf4ccb1980 1 --2- 172.21.15.157:0/1577387986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfc0eb40 0x5602bfc0ef20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.127+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/1577387986 >> 172.21.15.157:0/1577387986 conn(0x5602bfb82260 msgr2=0x5602bfb82670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:36.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.127+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/1577387986 shutdown_connections 2024-05-09T09:47:36.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.127+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/1577387986 wait complete. 2024-05-09T09:47:36.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.143+0000 7fbf4ccb1980 1 Processor -- start 2024-05-09T09:47:36.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.143+0000 7fbf4ccb1980 1 -- start start 2024-05-09T09:47:36.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.143+0000 7fbf4ccb1980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfc0f460 0x5602bfcfa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.143+0000 7fbf4ccb1980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5602bfb0ffe0 con 0x5602bfc0f460 2024-05-09T09:47:36.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.143+0000 7fbf4a7cc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfc0f460 0x5602bfcfa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.143+0000 7fbf4a7cc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfc0f460 0x5602bfcfa5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58228/0 (socket says 172.21.15.157:58228) 2024-05-09T09:47:36.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.143+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/1738667305 learned_addr learned my addr 172.21.15.157:0/1738667305 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:36.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.143+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/1738667305 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602bfa94ae0 con 0x5602bfc0f460 2024-05-09T09:47:36.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.143+0000 7fbf4a7cc640 1 --2- 172.21.15.157:0/1738667305 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfc0f460 0x5602bfcfa5c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c01b380 tx=0x7fbf3c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5dbd2f5ee81946e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.143+0000 7fbe38608640 1 -- 172.21.15.157:0/1738667305 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf3c0aa8f0 con 0x5602bfc0f460 2024-05-09T09:47:36.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.143+0000 7fbe38608640 1 -- 172.21.15.157:0/1738667305 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf3c0aaa90 con 0x5602bfc0f460 2024-05-09T09:47:36.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.143+0000 7fbe38608640 1 -- 172.21.15.157:0/1738667305 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf3c0aad70 con 0x5602bfc0f460 2024-05-09T09:47:36.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.147+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/1738667305 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfc0f460 msgr2=0x5602bfcfa5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.147+0000 7fbf4ccb1980 1 --2- 172.21.15.157:0/1738667305 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfc0f460 0x5602bfcfa5c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c01b380 tx=0x7fbf3c003030 comp rx=0 tx=0).stop 2024-05-09T09:47:36.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.147+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/1738667305 shutdown_connections 2024-05-09T09:47:36.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.147+0000 7fbf4ccb1980 1 --2- 172.21.15.157:0/1738667305 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfc0f460 0x5602bfcfa5c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.147+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/1738667305 >> 172.21.15.157:0/1738667305 conn(0x5602bfb82260 msgr2=0x5602bfcf60b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:36.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.147+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/1738667305 shutdown_connections 2024-05-09T09:47:36.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.147+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/1738667305 wait complete. 2024-05-09T09:47:36.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.147+0000 7fbf4ccb1980 1 Processor -- start 2024-05-09T09:47:36.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.147+0000 7fbf4ccb1980 1 -- start start 2024-05-09T09:47:36.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.147+0000 7fbf4ccb1980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfc0f460 0x5602bfd016c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.147+0000 7fbf4ccb1980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5602bfc18b80 con 0x5602bfc0f460 2024-05-09T09:47:36.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.147+0000 7fbf4a7cc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfc0f460 0x5602bfd016c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.147+0000 7fbf4a7cc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfc0f460 0x5602bfd016c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58234/0 (socket says 172.21.15.157:58234) 2024-05-09T09:47:36.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.147+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/1874402251 learned_addr learned my addr 172.21.15.157:0/1874402251 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:36.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.147+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/1874402251 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602bfd01c00 con 0x5602bfc0f460 2024-05-09T09:47:36.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.147+0000 7fbf4a7cc640 1 --2- 172.21.15.157:0/1874402251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfc0f460 0x5602bfd016c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c096f40 tx=0x7fbf3c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.147+0000 7fbe36e05640 1 -- 172.21.15.157:0/1874402251 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf3c0c67c0 con 0x5602bfc0f460 2024-05-09T09:47:36.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.147+0000 7fbe36e05640 1 -- 172.21.15.157:0/1874402251 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf3c0cc070 con 0x5602bfc0f460 2024-05-09T09:47:36.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.147+0000 7fbe36e05640 1 -- 172.21.15.157:0/1874402251 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf3c0c6ad0 con 0x5602bfc0f460 2024-05-09T09:47:36.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.147+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/1874402251 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5602bfd01e90 con 0x5602bfc0f460 2024-05-09T09:47:36.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.147+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/1874402251 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602bfd04b20 con 0x5602bfc0f460 2024-05-09T09:47:36.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.151+0000 7fbe36e05640 1 -- 172.21.15.157:0/1874402251 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fbf3c0c6c70 con 0x5602bfc0f460 2024-05-09T09:47:36.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.151+0000 7fbe36e05640 1 --2- 172.21.15.157:0/1874402251 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbe30034bb0 0x7fbe30037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.151+0000 7fbe36e05640 1 -- 172.21.15.157:0/1874402251 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fbf3c0e5cd0 con 0x5602bfc0f460 2024-05-09T09:47:36.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.151+0000 7fbf49fcb640 1 --2- 172.21.15.157:0/1874402251 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbe30034bb0 0x7fbe30037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.151+0000 7fbf4ccb1980 1 --2- 172.21.15.157:0/1874402251 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5602bfd065f0 0x5602bfd08a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.151+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/1874402251 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd09090 con 0x5602bfd065f0 2024-05-09T09:47:36.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.151+0000 7fbf4afcd640 1 --2- 172.21.15.157:0/1874402251 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5602bfd065f0 0x5602bfd08a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.151+0000 7fbf49fcb640 1 --2- 172.21.15.157:0/1874402251 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbe30034bb0 0x7fbe30037070 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbf40001e50 tx=0x7fbf400013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.151+0000 7fbf4afcd640 1 --2- 172.21.15.157:0/1874402251 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5602bfd065f0 0x5602bfd08a20 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.151+0000 7fbf4afcd640 1 -- 172.21.15.157:0/1874402251 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd065f0 2024-05-09T09:47:36.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.151+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/1874402251 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd05d20 con 0x5602bfd065f0 2024-05-09T09:47:36.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.151+0000 7fbf4afcd640 1 -- 172.21.15.157:0/1874402251 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd065f0 2024-05-09T09:47:36.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.151+0000 7fbf4ccb1980 1 --2- 172.21.15.157:0/1874402251 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602bfd0b3c0 0x5602bfd0d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.151+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/1874402251 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd0de80 con 0x5602bfd0b3c0 2024-05-09T09:47:36.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.151+0000 7fbf4a7cc640 1 --2- 172.21.15.157:0/1874402251 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602bfd0b3c0 0x5602bfd0d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.151+0000 7fbf4a7cc640 1 --2- 172.21.15.157:0/1874402251 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602bfd0b3c0 0x5602bfd0d7b0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.155+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/1874402251 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbf3c0e5040 con 0x5602bfd0b3c0 2024-05-09T09:47:36.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.155+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/1874402251 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd0a260 con 0x5602bfd065f0 2024-05-09T09:47:36.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.155+0000 7fbf4afcd640 1 -- 172.21.15.157:0/1874402251 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd065f0 2024-05-09T09:47:36.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.155+0000 7fbf4ccb1980 1 --2- 172.21.15.157:0/1874402251 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5602bfd0f2e0 0x5602bfd116d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.155+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/1874402251 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd11dd0 con 0x5602bfd0f2e0 2024-05-09T09:47:36.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.155+0000 7fbf49fcb640 1 --2- 172.21.15.157:0/1874402251 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5602bfd0f2e0 0x5602bfd116d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.155+0000 7fbf49fcb640 1 --2- 172.21.15.157:0/1874402251 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5602bfd0f2e0 0x5602bfd116d0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.155+0000 7fbf49fcb640 1 -- 172.21.15.157:0/1874402251 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbf4000f700 con 0x5602bfd0f2e0 2024-05-09T09:47:36.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.159+0000 7fbf4ccb1980 1 Processor -- start 2024-05-09T09:47:36.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.159+0000 7fbf4ccb1980 1 -- start start 2024-05-09T09:47:36.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.159+0000 7fbf4ccb1980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfd37cc0 0x5602bfd380e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.159+0000 7fbf4ccb1980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5602bfb14020 con 0x5602bfd37cc0 2024-05-09T09:47:36.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.159+0000 7fbf4a7cc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfd37cc0 0x5602bfd380e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.159+0000 7fbf4a7cc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfd37cc0 0x5602bfd380e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58236/0 (socket says 172.21.15.157:58236) 2024-05-09T09:47:36.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.159+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/2124940757 learned_addr learned my addr 172.21.15.157:0/2124940757 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:36.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.159+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/2124940757 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602bfd38620 con 0x5602bfd37cc0 2024-05-09T09:47:36.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.159+0000 7fbf4a7cc640 1 --2- 172.21.15.157:0/2124940757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfd37cc0 0x5602bfd380e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c01b820 tx=0x7fbf3c0c5e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.159+0000 7fbe2eba2640 1 -- 172.21.15.157:0/2124940757 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf3c0bca50 con 0x5602bfd37cc0 2024-05-09T09:47:36.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.159+0000 7fbe2eba2640 1 -- 172.21.15.157:0/2124940757 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf3c000e50 con 0x5602bfd37cc0 2024-05-09T09:47:36.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.159+0000 7fbe2eba2640 1 -- 172.21.15.157:0/2124940757 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf3c0bcd20 con 0x5602bfd37cc0 2024-05-09T09:47:36.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.159+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/2124940757 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5602bfd390b0 con 0x5602bfd37cc0 2024-05-09T09:47:36.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.159+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/2124940757 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602bfd39590 con 0x5602bfd37cc0 2024-05-09T09:47:36.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.163+0000 7fbe2eba2640 1 -- 172.21.15.157:0/2124940757 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fbf3c0c53e0 con 0x5602bfd37cc0 2024-05-09T09:47:36.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.163+0000 7fbe2eba2640 1 --2- 172.21.15.157:0/2124940757 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbe24034bb0 0x7fbe24037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.163+0000 7fbe2eba2640 1 -- 172.21.15.157:0/2124940757 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fbf3c0efc90 con 0x5602bfd37cc0 2024-05-09T09:47:36.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.163+0000 7fbf49fcb640 1 --2- 172.21.15.157:0/2124940757 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbe24034bb0 0x7fbe24037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.163+0000 7fbf4ccb1980 1 Processor -- start 2024-05-09T09:47:36.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.163+0000 7fbf4ccb1980 1 -- start start 2024-05-09T09:47:36.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.163+0000 7fbf49fcb640 1 --2- 172.21.15.157:0/2124940757 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbe24034bb0 0x7fbe24037070 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x5602bfd09970 tx=0x7fbf4000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.163+0000 7fbf4ccb1980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfd44ba0 0x5602bfd44fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.163+0000 7fbf4ccb1980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5602bfcfac50 con 0x5602bfd44ba0 2024-05-09T09:47:36.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.163+0000 7fbf4a7cc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfd44ba0 0x5602bfd44fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.163+0000 7fbf4a7cc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfd44ba0 0x5602bfd44fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58252/0 (socket says 172.21.15.157:58252) 2024-05-09T09:47:36.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.163+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/3779288396 learned_addr learned my addr 172.21.15.157:0/3779288396 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:36.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.163+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/3779288396 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602bfd45590 con 0x5602bfd44ba0 2024-05-09T09:47:36.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.163+0000 7fbf4a7cc640 1 --2- 172.21.15.157:0/3779288396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfd44ba0 0x5602bfd44fc0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0e0b30 tx=0x7fbf3c0e0b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8c00bab8d7edc5c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.163+0000 7fbe2cb9e640 1 -- 172.21.15.157:0/3779288396 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf3c0c95f0 con 0x5602bfd44ba0 2024-05-09T09:47:36.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.163+0000 7fbe2cb9e640 1 -- 172.21.15.157:0/3779288396 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf3c0c7590 con 0x5602bfd44ba0 2024-05-09T09:47:36.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.163+0000 7fbe2cb9e640 1 -- 172.21.15.157:0/3779288396 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf3c0e5ad0 con 0x5602bfd44ba0 2024-05-09T09:47:36.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.163+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/3779288396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfd44ba0 msgr2=0x5602bfd44fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.163+0000 7fbf4ccb1980 1 --2- 172.21.15.157:0/3779288396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfd44ba0 0x5602bfd44fc0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0e0b30 tx=0x7fbf3c0e0b60 comp rx=0 tx=0).stop 2024-05-09T09:47:36.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.163+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/3779288396 shutdown_connections 2024-05-09T09:47:36.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.163+0000 7fbf4ccb1980 1 --2- 172.21.15.157:0/3779288396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfd44ba0 0x5602bfd44fc0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.163+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/3779288396 >> 172.21.15.157:0/3779288396 conn(0x5602bfd40fb0 msgr2=0x5602bfd3f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:36.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.163+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/3779288396 shutdown_connections 2024-05-09T09:47:36.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.163+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/3779288396 wait complete. 2024-05-09T09:47:36.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.163+0000 7fbf4ccb1980 1 Processor -- start 2024-05-09T09:47:36.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.163+0000 7fbf4ccb1980 1 -- start start 2024-05-09T09:47:36.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.163+0000 7fbf4ccb1980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfd44ba0 0x5602bfd4bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.163+0000 7fbf4ccb1980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5602bfd45b70 con 0x5602bfd44ba0 2024-05-09T09:47:36.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.167+0000 7fbf4a7cc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfd44ba0 0x5602bfd4bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.167+0000 7fbf4a7cc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfd44ba0 0x5602bfd4bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58262/0 (socket says 172.21.15.157:58262) 2024-05-09T09:47:36.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.167+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 learned_addr learned my addr 172.21.15.157:0/177570598 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:36.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.167+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602bfd4c530 con 0x5602bfd44ba0 2024-05-09T09:47:36.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.167+0000 7fbf4a7cc640 1 --2- 172.21.15.157:0/177570598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfd44ba0 0x5602bfd4bff0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0c9cd0 tx=0x7fbf3c0bcec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.167+0000 7fbe1affd640 1 -- 172.21.15.157:0/177570598 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf3c110070 con 0x5602bfd44ba0 2024-05-09T09:47:36.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.167+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5602bfd4c530 con 0x5602bfd44ba0 2024-05-09T09:47:36.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.167+0000 7fbe1affd640 1 -- 172.21.15.157:0/177570598 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf3c0e0d60 con 0x5602bfd44ba0 2024-05-09T09:47:36.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.167+0000 7fbe1affd640 1 -- 172.21.15.157:0/177570598 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf3c0e5ad0 con 0x5602bfd44ba0 2024-05-09T09:47:36.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.167+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602bfd4c530 con 0x5602bfd44ba0 2024-05-09T09:47:36.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.167+0000 7fbe1affd640 1 -- 172.21.15.157:0/177570598 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fbf3c109040 con 0x5602bfd44ba0 2024-05-09T09:47:36.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.167+0000 7fbe1affd640 1 --2- 172.21.15.157:0/177570598 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbe14034b60 0x7fbe14037020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.167+0000 7fbe1affd640 1 -- 172.21.15.157:0/177570598 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fbf3c116cc0 con 0x5602bfd44ba0 2024-05-09T09:47:36.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.167+0000 7fbf49fcb640 1 --2- 172.21.15.157:0/177570598 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbe14034b60 0x7fbe14037020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.167+0000 7fbf4ccb1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.167+0000 7fbf4ccb1980 1 --2- 172.21.15.157:0/177570598 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5602bfd58a40 0x5602bfd5af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.167+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5b650 con 0x5602bfd58a40 2024-05-09T09:47:36.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.167+0000 7fbf4afcd640 1 --2- 172.21.15.157:0/177570598 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5602bfd58a40 0x5602bfd5af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.167+0000 7fbf49fcb640 1 --2- 172.21.15.157:0/177570598 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbe14034b60 0x7fbe14037020 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x5602bfd121d0 tx=0x7fbf40010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.167+0000 7fbf4afcd640 1 --2- 172.21.15.157:0/177570598 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5602bfd58a40 0x5602bfd5af00 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.171+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.171+0000 7fbf4ccb1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:36.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.171+0000 7fbf4ccb1980 20 realm 2024-05-09T09:47:36.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.171+0000 7fbf4ccb1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.171+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5ba60 con 0x5602bfd58a40 2024-05-09T09:47:36.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.171+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.171+0000 7fbf4ccb1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:36.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.171+0000 7fbf4ccb1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:36.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.171+0000 7fbf4ccb1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.171+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c330 con 0x5602bfd58a40 2024-05-09T09:47:36.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.171+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.171+0000 7fbf4ccb1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:36.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.171+0000 7fbf4ccb1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.171+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x5602bfd58a40 2024-05-09T09:47:36.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.171+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.171+0000 7fbf4ccb1980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:36.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.171+0000 7fbf4ccb1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.171+0000 7fbf4ccb1980 1 --2- 172.21.15.157:0/177570598 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602bfd5d430 0x5602bfd5f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.171+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5fe30 con 0x5602bfd5d430 2024-05-09T09:47:36.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.171+0000 7fbf4a7cc640 1 --2- 172.21.15.157:0/177570598 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602bfd5d430 0x5602bfd5f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.171+0000 7fbf4a7cc640 1 --2- 172.21.15.157:0/177570598 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602bfd5d430 0x5602bfd5f820 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.171+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbf3c0f4020 con 0x5602bfd5d430 2024-05-09T09:47:36.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.171+0000 7fbf4ccb1980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:36.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.171+0000 7fbf4ccb1980 20 searching for the correct realm 2024-05-09T09:47:36.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.171+0000 7fbf4ccb1980 1 --2- 172.21.15.157:0/177570598 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5602bfd61d80 0x5602bfd64190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.171+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd64860 con 0x5602bfd61d80 2024-05-09T09:47:36.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.171+0000 7fbf49fcb640 1 --2- 172.21.15.157:0/177570598 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5602bfd61d80 0x5602bfd64190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.171+0000 7fbf49fcb640 1 --2- 172.21.15.157:0/177570598 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5602bfd61d80 0x5602bfd64190 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.175+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf40037040 con 0x5602bfd61d80 2024-05-09T09:47:36.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.175+0000 7fbf49fcb640 1 --2- 172.21.15.157:0/177570598 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fbf4001fc60 0x7fbf4003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.175+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd64860 con 0x7fbf4001fc60 2024-05-09T09:47:36.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.175+0000 7fbf4afcd640 1 --2- 172.21.15.157:0/177570598 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fbf4001fc60 0x7fbf4003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.175+0000 7fbf4afcd640 1 --2- 172.21.15.157:0/177570598 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fbf4001fc60 0x7fbf4003a3c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.175+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf4400a4d0 con 0x7fbf4001fc60 2024-05-09T09:47:36.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.175+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x5602bfd5d430 2024-05-09T09:47:36.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.175+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3c0f4020 con 0x5602bfd5d430 2024-05-09T09:47:36.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.175+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x5602bfd58a40 2024-05-09T09:47:36.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.175+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.175+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x5602bfd58a40 2024-05-09T09:47:36.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.175+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.175+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x5602bfd5d430 2024-05-09T09:47:36.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.175+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3c0f4020 con 0x5602bfd5d430 2024-05-09T09:47:36.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.175+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x5602bfd5d430 2024-05-09T09:47:36.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.175+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3c0f4020 con 0x5602bfd5d430 2024-05-09T09:47:36.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.175+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x7fbf4001fc60 2024-05-09T09:47:36.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.175+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf4400a4d0 con 0x7fbf4001fc60 2024-05-09T09:47:36.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.175+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x5602bfd61d80 2024-05-09T09:47:36.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.179+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf40037040 con 0x5602bfd61d80 2024-05-09T09:47:36.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.179+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x5602bfd58a40 2024-05-09T09:47:36.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.179+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.179+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x5602bfd5d430 2024-05-09T09:47:36.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.179+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3c0f4020 con 0x5602bfd5d430 2024-05-09T09:47:36.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.179+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x5602bfd58a40 2024-05-09T09:47:36.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.179+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.179+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x7fbf4001fc60 2024-05-09T09:47:36.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.179+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbf4400a4d0 con 0x7fbf4001fc60 2024-05-09T09:47:36.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.179+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x5602bfd61d80 2024-05-09T09:47:36.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.179+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf40037040 con 0x5602bfd61d80 2024-05-09T09:47:36.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.179+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x5602bfd61d80 2024-05-09T09:47:36.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.179+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbf40037040 con 0x5602bfd61d80 2024-05-09T09:47:36.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.179+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x5602bfd5d430 2024-05-09T09:47:36.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.179+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3c0f4020 con 0x5602bfd5d430 2024-05-09T09:47:36.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.179+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x5602bfd61d80 2024-05-09T09:47:36.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.179+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf40037040 con 0x5602bfd61d80 2024-05-09T09:47:36.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.179+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x5602bfd61d80 2024-05-09T09:47:36.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.179+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf40037040 con 0x5602bfd61d80 2024-05-09T09:47:36.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.179+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x5602bfd58a40 2024-05-09T09:47:36.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.183+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.183+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x5602bfd58a40 2024-05-09T09:47:36.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.183+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.183+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x5602bfd5d430 2024-05-09T09:47:36.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.183+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3c0f4020 con 0x5602bfd5d430 2024-05-09T09:47:36.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.183+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x5602bfd61d80 2024-05-09T09:47:36.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.183+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf40037040 con 0x5602bfd61d80 2024-05-09T09:47:36.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.183+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x7fbf4001fc60 2024-05-09T09:47:36.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.183+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf4400a4d0 con 0x7fbf4001fc60 2024-05-09T09:47:36.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.183+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x5602bfd58a40 2024-05-09T09:47:36.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.183+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.183+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x5602bfd5d430 2024-05-09T09:47:36.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.183+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbf3c0f4020 con 0x5602bfd5d430 2024-05-09T09:47:36.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.183+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x5602bfd61d80 2024-05-09T09:47:36.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.183+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf40037040 con 0x5602bfd61d80 2024-05-09T09:47:36.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.183+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x5602bfd5d430 2024-05-09T09:47:36.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3c0f4020 con 0x5602bfd5d430 2024-05-09T09:47:36.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x7fbf4001fc60 2024-05-09T09:47:36.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf4400a4d0 con 0x7fbf4001fc60 2024-05-09T09:47:36.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x5602bfd61d80 2024-05-09T09:47:36.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf4004a040 con 0x5602bfd61d80 2024-05-09T09:47:36.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x5602bfd5d430 2024-05-09T09:47:36.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf3c0f4020 con 0x5602bfd5d430 2024-05-09T09:47:36.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x5602bfd58a40 2024-05-09T09:47:36.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd5c6d0 con 0x7fbf4001fc60 2024-05-09T09:47:36.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbf4400a4d0 con 0x7fbf4001fc60 2024-05-09T09:47:36.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4ccb1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:36.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4ccb1980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:36.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4ccb1980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:36.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4ccb1980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:36.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4ccb1980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:36.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4ccb1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:36.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4ccb1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd606f0 con 0x5602bfd58a40 2024-05-09T09:47:36.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4ccb1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:36.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4ccb1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd606f0 con 0x5602bfd58a40 2024-05-09T09:47:36.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4ccb1980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:36.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4ccb1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd606f0 con 0x5602bfd61d80 2024-05-09T09:47:36.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbf4004a040 con 0x5602bfd61d80 2024-05-09T09:47:36.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4ccb1980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:36.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4ccb1980 20 zone default found 2024-05-09T09:47:36.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4ccb1980 4 Realm: () 2024-05-09T09:47:36.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4ccb1980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:36.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4ccb1980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:36.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4ccb1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:36.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4ccb1980 20 zonegroup default 2024-05-09T09:47:36.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4ccb1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.187+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd61160 con 0x5602bfd5d430 2024-05-09T09:47:36.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.191+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbf3c0f4020 con 0x5602bfd5d430 2024-05-09T09:47:36.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.191+0000 7fbf4ccb1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:36.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.191+0000 7fbf4ccb1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.191+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd66b70 con 0x5602bfd61d80 2024-05-09T09:47:36.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.191+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbf4004a040 con 0x5602bfd61d80 2024-05-09T09:47:36.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.191+0000 7fbf4ccb1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:36.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.191+0000 7fbf4ccb1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.191+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd66f10 con 0x5602bfd61d80 2024-05-09T09:47:36.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.191+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbf4004a040 con 0x5602bfd61d80 2024-05-09T09:47:36.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.191+0000 7fbf4ccb1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:36.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.191+0000 7fbf4ccb1980 20 started sync module instance, tier type = 2024-05-09T09:47:36.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.191+0000 7fbf4ccb1980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:36.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.191+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd65fb0 con 0x7fbf4001fc60 2024-05-09T09:47:36.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.191+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x7fbf4001fc60 2024-05-09T09:47:36.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.191+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94569808421840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd65fb0 con 0x7fbf4001fc60 2024-05-09T09:47:36.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.191+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd677a0 con 0x5602bfd58a40 2024-05-09T09:47:36.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.195+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94569808421840] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x7fbf4001fc60 2024-05-09T09:47:36.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.195+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.195+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94569808425648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd65fb0 con 0x5602bfd58a40 2024-05-09T09:47:36.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.195+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd681b0 con 0x5602bfd61d80 2024-05-09T09:47:36.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.195+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94569808425648] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.195+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf4004a040 con 0x5602bfd61d80 2024-05-09T09:47:36.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.195+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94569808419584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd65f20 con 0x5602bfd61d80 2024-05-09T09:47:36.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.195+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd68f00 con 0x7fbf4001fc60 2024-05-09T09:47:36.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.199+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x7fbf4001fc60 2024-05-09T09:47:36.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.199+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94569808431968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd69610 con 0x7fbf4001fc60 2024-05-09T09:47:36.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.199+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd6a130 con 0x5602bfd58a40 2024-05-09T09:47:36.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.199+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94569808419584] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf4004a040 con 0x5602bfd61d80 2024-05-09T09:47:36.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.199+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94569808431968] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x7fbf4001fc60 2024-05-09T09:47:36.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.199+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.199+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94569808436224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd6a0f0 con 0x5602bfd58a40 2024-05-09T09:47:36.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.199+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd6a520 con 0x5602bfd5d430 2024-05-09T09:47:36.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.203+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94569808436224] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.203+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3c0f4020 con 0x5602bfd5d430 2024-05-09T09:47:36.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.203+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94569808430496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd6a910 con 0x5602bfd5d430 2024-05-09T09:47:36.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.203+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd6b1e0 con 0x5602bfd5d430 2024-05-09T09:47:36.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.203+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94569808430496] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3c0f4020 con 0x5602bfd5d430 2024-05-09T09:47:36.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.207+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3c0f4020 con 0x5602bfd5d430 2024-05-09T09:47:36.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.207+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94569808433248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd6ba30 con 0x5602bfd5d430 2024-05-09T09:47:36.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.207+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd6c050 con 0x5602bfd5d430 2024-05-09T09:47:36.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.207+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94569808433248] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3c0f4020 con 0x5602bfd5d430 2024-05-09T09:47:36.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.207+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3c0f4020 con 0x5602bfd5d430 2024-05-09T09:47:36.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.207+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94569808444320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd6c470 con 0x5602bfd5d430 2024-05-09T09:47:36.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.207+0000 7fbf4ccb1980 20 add_watcher() i=0 2024-05-09T09:47:36.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.207+0000 7fbf4ccb1980 20 add_watcher() i=1 2024-05-09T09:47:36.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.207+0000 7fbf4ccb1980 20 add_watcher() i=2 2024-05-09T09:47:36.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.207+0000 7fbf4ccb1980 20 add_watcher() i=3 2024-05-09T09:47:36.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.207+0000 7fbf4ccb1980 20 add_watcher() i=4 2024-05-09T09:47:36.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.207+0000 7fbf4ccb1980 20 add_watcher() i=5 2024-05-09T09:47:36.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.207+0000 7fbf4ccb1980 20 add_watcher() i=6 2024-05-09T09:47:36.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.211+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94569808444320] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3c0f4020 con 0x5602bfd5d430 2024-05-09T09:47:36.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.211+0000 7fbf4ccb1980 20 add_watcher() i=7 2024-05-09T09:47:36.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.211+0000 7fbf4ccb1980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:36.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.211+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd6f730 con 0x5602bfd58a40 2024-05-09T09:47:36.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.211+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.211+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94569808445744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd6ca00 con 0x5602bfd58a40 2024-05-09T09:47:36.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.211+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94569808445744] v30'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.211+0000 7fbdff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:36.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.211+0000 7fbf4ccb1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:36.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.211+0000 7fbf4ccb1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:36.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.211+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd6efe0 con 0x5602bfd58a40 2024-05-09T09:47:36.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.215+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'39 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.215+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd787f0 con 0x5602bfd5d430 2024-05-09T09:47:36.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.215+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf3c0f4020 con 0x5602bfd5d430 2024-05-09T09:47:36.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.215+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd787f0 con 0x5602bfd61d80 2024-05-09T09:47:36.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.215+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'33 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf4004a040 con 0x5602bfd61d80 2024-05-09T09:47:36.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.215+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd790c0 con 0x5602bfd58a40 2024-05-09T09:47:36.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.219+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'140 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.219+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd79630 con 0x7fbf4001fc60 2024-05-09T09:47:36.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.219+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'89 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x7fbf4001fc60 2024-05-09T09:47:36.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.219+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd79ae0 con 0x5602bfd61d80 2024-05-09T09:47:36.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.219+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'59 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf4004a040 con 0x5602bfd61d80 2024-05-09T09:47:36.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.219+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd77f40 con 0x5602bfd58a40 2024-05-09T09:47:36.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.223+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'35 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.223+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd77f40 con 0x5602bfd5d430 2024-05-09T09:47:36.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.223+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'59 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf3c0f4020 con 0x5602bfd5d430 2024-05-09T09:47:36.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.223+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd77fd0 con 0x7fbf4001fc60 2024-05-09T09:47:36.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.227+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'33 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x7fbf4001fc60 2024-05-09T09:47:36.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.227+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7a640 con 0x5602bfd61d80 2024-05-09T09:47:36.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.227+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'39 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbf4004a040 con 0x5602bfd61d80 2024-05-09T09:47:36.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.227+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7aaf0 con 0x7fbf4001fc60 2024-05-09T09:47:36.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.231+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'90 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x7fbf4001fc60 2024-05-09T09:47:36.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.231+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7aaf0 con 0x5602bfd5d430 2024-05-09T09:47:36.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.231+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'35 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf3c0f4020 con 0x5602bfd5d430 2024-05-09T09:47:36.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.231+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7aaf0 con 0x7fbf4001fc60 2024-05-09T09:47:36.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.231+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'33 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x7fbf4001fc60 2024-05-09T09:47:36.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.231+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7aaf0 con 0x5602bfd5d430 2024-05-09T09:47:36.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.235+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'65 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf3c0f4020 con 0x5602bfd5d430 2024-05-09T09:47:36.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.235+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7ab80 con 0x5602bfd58a40 2024-05-09T09:47:36.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.235+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'141 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.235+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7ab80 con 0x5602bfd61d80 2024-05-09T09:47:36.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.239+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'83 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf4004a040 con 0x5602bfd61d80 2024-05-09T09:47:36.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.239+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7ac10 con 0x7fbf4001fc60 2024-05-09T09:47:36.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.239+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'91 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x7fbf4001fc60 2024-05-09T09:47:36.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.239+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7ac10 con 0x5602bfd61d80 2024-05-09T09:47:36.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.243+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'33 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf4004a040 con 0x5602bfd61d80 2024-05-09T09:47:36.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.243+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7ac10 con 0x5602bfd58a40 2024-05-09T09:47:36.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.243+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'41 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.243+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7ac10 con 0x5602bfd58a40 2024-05-09T09:47:36.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.243+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'142 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.243+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7ac10 con 0x5602bfd61d80 2024-05-09T09:47:36.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.247+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'84 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf4004a040 con 0x5602bfd61d80 2024-05-09T09:47:36.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.247+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7ac10 con 0x7fbf4001fc60 2024-05-09T09:47:36.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.247+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'43 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x7fbf4001fc60 2024-05-09T09:47:36.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.247+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7ac10 con 0x5602bfd61d80 2024-05-09T09:47:36.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.251+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'35 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf4004a040 con 0x5602bfd61d80 2024-05-09T09:47:36.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.251+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7ac10 con 0x5602bfd61d80 2024-05-09T09:47:36.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.251+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'39 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf4004a040 con 0x5602bfd61d80 2024-05-09T09:47:36.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.251+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7ac10 con 0x5602bfd61d80 2024-05-09T09:47:36.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.251+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'29 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf4004a040 con 0x5602bfd61d80 2024-05-09T09:47:36.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.251+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7ac10 con 0x5602bfd61d80 2024-05-09T09:47:36.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.255+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'60 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf4004a040 con 0x5602bfd61d80 2024-05-09T09:47:36.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.255+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7ac10 con 0x5602bfd5d430 2024-05-09T09:47:36.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.255+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'35 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf3c0f4020 con 0x5602bfd5d430 2024-05-09T09:47:36.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.255+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7b430 con 0x5602bfd61d80 2024-05-09T09:47:36.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.255+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'33 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf4004a040 con 0x5602bfd61d80 2024-05-09T09:47:36.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.255+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7b430 con 0x5602bfd5d430 2024-05-09T09:47:36.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.259+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'60 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf3c0f4020 con 0x5602bfd5d430 2024-05-09T09:47:36.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.259+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7b430 con 0x5602bfd61d80 2024-05-09T09:47:36.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.259+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'85 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf4004a040 con 0x5602bfd61d80 2024-05-09T09:47:36.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.259+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7b430 con 0x5602bfd5d430 2024-05-09T09:47:36.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.263+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'66 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf3c0f4020 con 0x5602bfd5d430 2024-05-09T09:47:36.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.263+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7b430 con 0x7fbf4001fc60 2024-05-09T09:47:36.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.267+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'39 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x7fbf4001fc60 2024-05-09T09:47:36.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.267+0000 7fbdfe7e4640 20 reqs_thread_entry: start 2024-05-09T09:47:36.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.267+0000 7fbf4ccb1980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:36.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.267+0000 7fbd6ffff640 20 reqs_thread_entry: start 2024-05-09T09:47:36.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.267+0000 7fbf4ccb1980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-09T09:47:36.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.267+0000 7fbf4ccb1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.267+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd96910 con 0x5602bfd58a40 2024-05-09T09:47:36.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.267+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.267+0000 7fbf4ccb1980 20 rados_obj.operate() r=0 bl.length=673 2024-05-09T09:47:36.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.267+0000 7fbf4ccb1980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-09T09:47:36.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.267+0000 7fbf4ccb1980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:36.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.267+0000 7fbf4ccb1980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:36.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.267+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd9d1c0 con 0x5602bfd58a40 2024-05-09T09:47:36.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.267+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(95 foo [delete,create,call,call,writefull 0~582] v30'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.267+0000 7fbf4ccb1980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:47:36.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.267+0000 7fbf4ccb1980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:36.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.267+0000 7fbf4ccb1980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-09T09:47:36.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.267+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 7.d 7:b4812045:::notify.4:head [notify cookie 94569808645232 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd989e0 con 0x5602bfd58a40 2024-05-09T09:47:36.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.267+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== watch-notify(notify (1) cookie 94569808436224 notify 128849018888 ret 0) ==== 800+0+0 (crc 0 0 0) 0x5602bfd7ade0 con 0x5602bfd58a40 2024-05-09T09:47:36.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.267+0000 7fbe2cb9e640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018888 cookie 94569808436224 notifier 4413 bl.length()=758 2024-05-09T09:47:36.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.267+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(96 notify.4 [notify cookie 94569808645232 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.267+0000 7fbe2cb9e640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:47:36.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.267+0000 7fbe2cb9e640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:36.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.267+0000 7fbe2cb9e640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fbe0c0056c0 con 0x5602bfd58a40 2024-05-09T09:47:36.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.267+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(97 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.267+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== watch-notify(notify_complete (2) cookie 94569808645232 notify 128849018888 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5602bfd79210 con 0x5602bfd58a40 2024-05-09T09:47:36.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.267+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd9cc70 con 0x5602bfd58a40 2024-05-09T09:47:36.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.271+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(98 foo:foo1 [delete] v30'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.271+0000 7fbf4ccb1980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-05-09T09:47:36.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.271+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94569808629264 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd9cc70 con 0x7fbf4001fc60 2024-05-09T09:47:36.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.271+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== watch-notify(notify (1) cookie 94569808421840 notify 128849018884 ret 0) ==== 201+0+0 (crc 0 0 0) 0x5602bfd79210 con 0x7fbf4001fc60 2024-05-09T09:47:36.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.271+0000 7fbe2cb9e640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94569808421840 notifier 4413 bl.length()=159 2024-05-09T09:47:36.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.271+0000 7fbe2cb9e640 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:100 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fbe0c0056c0 con 0x7fbf4001fc60 2024-05-09T09:47:36.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.271+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(99 notify.0 [notify cookie 94569808629264 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbf4400a4d0 con 0x7fbf4001fc60 2024-05-09T09:47:36.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.271+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== watch-notify(notify_complete (2) cookie 94569808629264 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbf44040020 con 0x7fbf4001fc60 2024-05-09T09:47:36.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.271+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(100 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x7fbf4001fc60 2024-05-09T09:47:36.270 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-09T09:47:32.044078Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-05-09T09:47:35.743410Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:47:32.044055Z","tags":[],"group_ids":[]} 2024-05-09T09:47:36.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.271+0000 7fbdff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:36.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.271+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94569808445744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd75ef0 con 0x5602bfd58a40 2024-05-09T09:47:36.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.271+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(101 data_loggenerations_metadata [watch unwatch cookie 94569808445744] v30'143 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.271+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94569808421840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7a480 con 0x7fbf4001fc60 2024-05-09T09:47:36.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.275+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 94569808421840] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x7fbf4001fc60 2024-05-09T09:47:36.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.275+0000 7fbf4ccb1980 20 remove_watcher() i=0 2024-05-09T09:47:36.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.275+0000 7fbf4ccb1980 2 removed watcher, disabling cache 2024-05-09T09:47:36.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.275+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94569808425648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7a480 con 0x5602bfd58a40 2024-05-09T09:47:36.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.275+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 94569808425648] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.275+0000 7fbf4ccb1980 20 remove_watcher() i=1 2024-05-09T09:47:36.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.275+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94569808419584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7a480 con 0x5602bfd61d80 2024-05-09T09:47:36.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.279+0000 7fbf49fcb640 1 -- 172.21.15.157:0/177570598 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 94569808419584] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf4004a040 con 0x5602bfd61d80 2024-05-09T09:47:36.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.279+0000 7fbf4ccb1980 20 remove_watcher() i=2 2024-05-09T09:47:36.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.279+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94569808431968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7a480 con 0x7fbf4001fc60 2024-05-09T09:47:36.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.279+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.2 v2:172.21.15.157:6800/354455204 23 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 94569808431968] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x7fbf4001fc60 2024-05-09T09:47:36.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.279+0000 7fbf4ccb1980 20 remove_watcher() i=3 2024-05-09T09:47:36.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.279+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94569808436224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7a480 con 0x5602bfd58a40 2024-05-09T09:47:36.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.283+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 <== osd.1 v2:172.21.15.157:6808/3930131338 36 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 94569808436224] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf4400a4d0 con 0x5602bfd58a40 2024-05-09T09:47:36.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.283+0000 7fbf4ccb1980 20 remove_watcher() i=4 2024-05-09T09:47:36.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.283+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94569808430496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7a480 con 0x5602bfd5d430 2024-05-09T09:47:36.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.283+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 94569808430496] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3c0f4020 con 0x5602bfd5d430 2024-05-09T09:47:36.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.283+0000 7fbf4ccb1980 20 remove_watcher() i=5 2024-05-09T09:47:36.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.283+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94569808433248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7a480 con 0x5602bfd5d430 2024-05-09T09:47:36.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 94569808433248] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3c0f4020 con 0x5602bfd5d430 2024-05-09T09:47:36.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 20 remove_watcher() i=6 2024-05-09T09:47:36.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94569808444320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602bfd7a480 con 0x5602bfd5d430 2024-05-09T09:47:36.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4a7cc640 1 -- 172.21.15.157:0/177570598 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 94569808444320] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbf3c0f4020 con 0x5602bfd5d430 2024-05-09T09:47:36.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 20 remove_watcher() i=7 2024-05-09T09:47:36.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602bfd5d430 msgr2=0x5602bfd5f820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 1 --2- 172.21.15.157:0/177570598 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602bfd5d430 0x5602bfd5f820 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5602bfd58a40 msgr2=0x5602bfd5af00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 1 --2- 172.21.15.157:0/177570598 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5602bfd58a40 0x5602bfd5af00 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fbf4001fc60 msgr2=0x7fbf4003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 1 --2- 172.21.15.157:0/177570598 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fbf4001fc60 0x7fbf4003a3c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5602bfd61d80 msgr2=0x5602bfd64190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 1 --2- 172.21.15.157:0/177570598 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5602bfd61d80 0x5602bfd64190 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbe14034b60 msgr2=0x7fbe14037020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 1 --2- 172.21.15.157:0/177570598 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbe14034b60 0x7fbe14037020 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x5602bfd121d0 tx=0x7fbf40010000 comp rx=0 tx=0).stop 2024-05-09T09:47:36.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfd44ba0 msgr2=0x5602bfd4bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4afcd640 1 -- 172.21.15.157:0/177570598 reap_dead start 2024-05-09T09:47:36.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 1 --2- 172.21.15.157:0/177570598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfd44ba0 0x5602bfd4bff0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0c9cd0 tx=0x7fbf3c0bcec0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 shutdown_connections 2024-05-09T09:47:36.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 1 --2- 172.21.15.157:0/177570598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfd44ba0 0x5602bfd4bff0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 >> 172.21.15.157:0/177570598 conn(0x5602bfd40fb0 msgr2=0x5602bfd3e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:36.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 shutdown_connections 2024-05-09T09:47:36.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/177570598 wait complete. 2024-05-09T09:47:36.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/2124940757 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbe24034bb0 msgr2=0x7fbe24037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 1 --2- 172.21.15.157:0/2124940757 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbe24034bb0 0x7fbe24037070 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x5602bfd09970 tx=0x7fbf4000f000 comp rx=0 tx=0).stop 2024-05-09T09:47:36.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/2124940757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfd37cc0 msgr2=0x5602bfd380e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 1 --2- 172.21.15.157:0/2124940757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfd37cc0 0x5602bfd380e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c01b820 tx=0x7fbf3c0c5e00 comp rx=0 tx=0).stop 2024-05-09T09:47:36.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/2124940757 shutdown_connections 2024-05-09T09:47:36.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 1 --2- 172.21.15.157:0/2124940757 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbe24034bb0 0x7fbe24037070 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 1 --2- 172.21.15.157:0/2124940757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfd37cc0 0x5602bfd380e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/2124940757 >> 172.21.15.157:0/2124940757 conn(0x5602bfd2ca90 msgr2=0x5602bfd2d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:36.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/2124940757 shutdown_connections 2024-05-09T09:47:36.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.287+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/2124940757 wait complete. 2024-05-09T09:47:36.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.291+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/1874402251 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602bfd0b3c0 msgr2=0x5602bfd0d7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.291+0000 7fbf4ccb1980 1 --2- 172.21.15.157:0/1874402251 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602bfd0b3c0 0x5602bfd0d7b0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.291+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/1874402251 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5602bfd065f0 msgr2=0x5602bfd08a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.291+0000 7fbf4ccb1980 1 --2- 172.21.15.157:0/1874402251 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5602bfd065f0 0x5602bfd08a20 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.291+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/1874402251 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5602bfd0f2e0 msgr2=0x5602bfd116d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.291+0000 7fbf4ccb1980 1 --2- 172.21.15.157:0/1874402251 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5602bfd0f2e0 0x5602bfd116d0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.291+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/1874402251 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbe30034bb0 msgr2=0x7fbe30037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.291+0000 7fbf4ccb1980 1 --2- 172.21.15.157:0/1874402251 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbe30034bb0 0x7fbe30037070 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbf40001e50 tx=0x7fbf400013b0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.291+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/1874402251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfc0f460 msgr2=0x5602bfd016c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.291+0000 7fbf4ccb1980 1 --2- 172.21.15.157:0/1874402251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602bfc0f460 0x5602bfd016c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c096f40 tx=0x7fbf3c0180e0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.291+0000 7fbf4afcd640 1 -- 172.21.15.157:0/1874402251 reap_dead start 2024-05-09T09:47:36.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.291+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/1874402251 shutdown_connections 2024-05-09T09:47:36.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.291+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/1874402251 >> 172.21.15.157:0/1874402251 conn(0x5602bfb82260 msgr2=0x5602bfcf4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:36.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.291+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/1874402251 shutdown_connections 2024-05-09T09:47:36.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.291+0000 7fbf4ccb1980 1 -- 172.21.15.157:0/1874402251 wait complete. 2024-05-09T09:47:36.300 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-09T09:47:32.044078Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-05-09T09:47:35.743410Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:47:32.044055Z', 'tags': [], 'group_ids': []} 2024-05-09T09:47:36.300 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-05-09T09:47:36.300 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-05-09T09:47:36.300 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-05-09T09:47:36.377 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:36.377 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:36.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.379+0000 7f2f08d26980 1 Processor -- start 2024-05-09T09:47:36.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.379+0000 7f2f08d26980 1 -- start start 2024-05-09T09:47:36.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.379+0000 7f2f08d26980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55e138fb9980 0x55e138fb9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.379+0000 7f2f08d26980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e138e6f440 con 0x55e138fba2a0 2024-05-09T09:47:36.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.379+0000 7f2f08d26980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55e138e5a5f0 con 0x55e138fb9980 2024-05-09T09:47:36.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.379+0000 7f2f06841640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55e138fb9980 0x55e138fb9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.379+0000 7f2f06841640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55e138fb9980 0x55e138fb9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58276/0 (socket says 172.21.15.157:58276) 2024-05-09T09:47:36.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.379+0000 7f2f06841640 1 -- 172.21.15.157:0/4003816259 learned_addr learned my addr 172.21.15.157:0/4003816259 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:36.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.379+0000 7f2f06841640 1 -- 172.21.15.157:0/4003816259 >> v1:172.21.15.110:6789/0 conn(0x55e138fba2a0 legacy=0x55e138fbac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.379+0000 7f2f06841640 1 -- 172.21.15.157:0/4003816259 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e138e65990 con 0x55e138fb9980 2024-05-09T09:47:36.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.383+0000 7f2f06841640 1 --2- 172.21.15.157:0/4003816259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e138fb9980 0x55e138fb9d60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2ef800a4e0 tx=0x7f2ef801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3ed4d85b1618cc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.383+0000 7f2f0583f640 1 -- 172.21.15.157:0/4003816259 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ef80aa540 con 0x55e138fb9980 2024-05-09T09:47:36.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.383+0000 7f2f0583f640 1 -- 172.21.15.157:0/4003816259 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef80aa6e0 con 0x55e138fb9980 2024-05-09T09:47:36.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.383+0000 7f2f0583f640 1 -- 172.21.15.157:0/4003816259 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ef80aaa40 con 0x55e138fb9980 2024-05-09T09:47:36.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.383+0000 7f2f08d26980 1 -- 172.21.15.157:0/4003816259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e138fb9980 msgr2=0x55e138fb9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.383+0000 7f2f08d26980 1 --2- 172.21.15.157:0/4003816259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e138fb9980 0x55e138fb9d60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2ef800a4e0 tx=0x7f2ef801b090 comp rx=0 tx=0).stop 2024-05-09T09:47:36.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.383+0000 7f2f08d26980 1 -- 172.21.15.157:0/4003816259 shutdown_connections 2024-05-09T09:47:36.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.383+0000 7f2f08d26980 1 --2- 172.21.15.157:0/4003816259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e138fb9980 0x55e138fb9d60 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.383+0000 7f2f08d26980 1 -- 172.21.15.157:0/4003816259 >> 172.21.15.157:0/4003816259 conn(0x55e138fb5250 msgr2=0x55e138fb7670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:36.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.383+0000 7f2f08d26980 1 -- 172.21.15.157:0/4003816259 shutdown_connections 2024-05-09T09:47:36.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.383+0000 7f2f08d26980 1 -- 172.21.15.157:0/4003816259 wait complete. 2024-05-09T09:47:36.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.399+0000 7f2f08d26980 1 Processor -- start 2024-05-09T09:47:36.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.399+0000 7f2f08d26980 1 -- start start 2024-05-09T09:47:36.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.403+0000 7f2f08d26980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e138fb9980 0x55e1390a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.403+0000 7f2f08d26980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55e138ebcfe0 con 0x55e138fb9980 2024-05-09T09:47:36.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.403+0000 7f2f06841640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e138fb9980 0x55e1390a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.403+0000 7f2f06841640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e138fb9980 0x55e1390a51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58278/0 (socket says 172.21.15.157:58278) 2024-05-09T09:47:36.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.403+0000 7f2f06841640 1 -- 172.21.15.157:0/1468847794 learned_addr learned my addr 172.21.15.157:0/1468847794 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:36.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.403+0000 7f2f06841640 1 -- 172.21.15.157:0/1468847794 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e138e41ae0 con 0x55e138fb9980 2024-05-09T09:47:36.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.403+0000 7f2f06841640 1 --2- 172.21.15.157:0/1468847794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e138fb9980 0x55e1390a51c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8018cc0 tx=0x7f2ef80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e73ca592e3f753 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.403+0000 7f2df4e09640 1 -- 172.21.15.157:0/1468847794 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ef80b9070 con 0x55e138fb9980 2024-05-09T09:47:36.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.403+0000 7f2df4e09640 1 -- 172.21.15.157:0/1468847794 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef80aaa80 con 0x55e138fb9980 2024-05-09T09:47:36.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.403+0000 7f2df4e09640 1 -- 172.21.15.157:0/1468847794 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ef80aad60 con 0x55e138fb9980 2024-05-09T09:47:36.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.403+0000 7f2f08d26980 1 -- 172.21.15.157:0/1468847794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e138fb9980 msgr2=0x55e1390a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.403+0000 7f2f08d26980 1 --2- 172.21.15.157:0/1468847794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e138fb9980 0x55e1390a51c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8018cc0 tx=0x7f2ef80033b0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.403+0000 7f2f08d26980 1 -- 172.21.15.157:0/1468847794 shutdown_connections 2024-05-09T09:47:36.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.403+0000 7f2f08d26980 1 --2- 172.21.15.157:0/1468847794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e138fb9980 0x55e1390a51c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.403+0000 7f2f08d26980 1 -- 172.21.15.157:0/1468847794 >> 172.21.15.157:0/1468847794 conn(0x55e138fb5250 msgr2=0x55e1390a0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:36.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.403+0000 7f2f08d26980 1 -- 172.21.15.157:0/1468847794 shutdown_connections 2024-05-09T09:47:36.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.403+0000 7f2f08d26980 1 -- 172.21.15.157:0/1468847794 wait complete. 2024-05-09T09:47:36.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.403+0000 7f2f08d26980 1 Processor -- start 2024-05-09T09:47:36.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.403+0000 7f2f08d26980 1 -- start start 2024-05-09T09:47:36.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.403+0000 7f2f08d26980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e138fb9980 0x55e1390ac310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.403+0000 7f2f08d26980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55e138fc3980 con 0x55e138fb9980 2024-05-09T09:47:36.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.407+0000 7f2f06841640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e138fb9980 0x55e1390ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.407+0000 7f2f06841640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e138fb9980 0x55e1390ac310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58286/0 (socket says 172.21.15.157:58286) 2024-05-09T09:47:36.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.407+0000 7f2f06841640 1 -- 172.21.15.157:0/658749115 learned_addr learned my addr 172.21.15.157:0/658749115 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:36.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.407+0000 7f2f06841640 1 -- 172.21.15.157:0/658749115 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1390ac850 con 0x55e138fb9980 2024-05-09T09:47:36.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.407+0000 7f2f06841640 1 --2- 172.21.15.157:0/658749115 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e138fb9980 0x55e1390ac310 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2ef801b0d0 tx=0x7f2ef8017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.407+0000 7f2df3606640 1 -- 172.21.15.157:0/658749115 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ef80b9070 con 0x55e138fb9980 2024-05-09T09:47:36.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.407+0000 7f2df3606640 1 -- 172.21.15.157:0/658749115 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef80c7410 con 0x55e138fb9980 2024-05-09T09:47:36.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.407+0000 7f2df3606640 1 -- 172.21.15.157:0/658749115 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ef80c76f0 con 0x55e138fb9980 2024-05-09T09:47:36.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.407+0000 7f2f08d26980 1 -- 172.21.15.157:0/658749115 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e1390acae0 con 0x55e138fb9980 2024-05-09T09:47:36.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.407+0000 7f2f08d26980 1 -- 172.21.15.157:0/658749115 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1390af770 con 0x55e138fb9980 2024-05-09T09:47:36.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.407+0000 7f2df3606640 1 -- 172.21.15.157:0/658749115 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f2ef80b3040 con 0x55e138fb9980 2024-05-09T09:47:36.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.407+0000 7f2df3606640 1 --2- 172.21.15.157:0/658749115 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2dec034c50 0x7f2dec037110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.407+0000 7f2df3606640 1 -- 172.21.15.157:0/658749115 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f2ef80c4070 con 0x55e138fb9980 2024-05-09T09:47:36.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.407+0000 7f2f08d26980 1 --2- 172.21.15.157:0/658749115 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e138fba2a0 0x55e1390b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.407+0000 7f2f06040640 1 --2- 172.21.15.157:0/658749115 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2dec034c50 0x7f2dec037110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.407+0000 7f2f08d26980 1 -- 172.21.15.157:0/658749115 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e1390b3940 con 0x55e138fba2a0 2024-05-09T09:47:36.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.411+0000 7f2f07042640 1 --2- 172.21.15.157:0/658749115 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e138fba2a0 0x55e1390b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.411+0000 7f2f06040640 1 --2- 172.21.15.157:0/658749115 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2dec034c50 0x7f2dec037110 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2efc000f70 tx=0x7f2efc001420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.411+0000 7f2f07042640 1 --2- 172.21.15.157:0/658749115 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e138fba2a0 0x55e1390b33c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.411+0000 7f2f07042640 1 -- 172.21.15.157:0/658749115 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f000083f0 con 0x55e138fba2a0 2024-05-09T09:47:36.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.411+0000 7f2f08d26980 1 -- 172.21.15.157:0/658749115 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e1390b0990 con 0x55e138fba2a0 2024-05-09T09:47:36.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.411+0000 7f2f07042640 1 -- 172.21.15.157:0/658749115 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f000083f0 con 0x55e138fba2a0 2024-05-09T09:47:36.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.411+0000 7f2f08d26980 1 --2- 172.21.15.157:0/658749115 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e1390b5c70 0x55e1390b8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.411+0000 7f2f08d26980 1 -- 172.21.15.157:0/658749115 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e1390b8750 con 0x55e1390b5c70 2024-05-09T09:47:36.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.411+0000 7f2f06841640 1 --2- 172.21.15.157:0/658749115 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e1390b5c70 0x55e1390b8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.411+0000 7f2f06841640 1 --2- 172.21.15.157:0/658749115 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e1390b5c70 0x55e1390b8060 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.411+0000 7f2f06841640 1 -- 172.21.15.157:0/658749115 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2ef80cd060 con 0x55e1390b5c70 2024-05-09T09:47:36.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.411+0000 7f2f08d26980 1 -- 172.21.15.157:0/658749115 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e1390b4ae0 con 0x55e138fba2a0 2024-05-09T09:47:36.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.411+0000 7f2f07042640 1 -- 172.21.15.157:0/658749115 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f000083f0 con 0x55e138fba2a0 2024-05-09T09:47:36.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.411+0000 7f2f08d26980 1 --2- 172.21.15.157:0/658749115 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e1390b9bb0 0x55e1390bbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.411+0000 7f2f08d26980 1 -- 172.21.15.157:0/658749115 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e1390bc6a0 con 0x55e1390b9bb0 2024-05-09T09:47:36.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.411+0000 7f2f06040640 1 --2- 172.21.15.157:0/658749115 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e1390b9bb0 0x55e1390bbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.411+0000 7f2f06040640 1 --2- 172.21.15.157:0/658749115 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e1390b9bb0 0x55e1390bbfa0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.415+0000 7f2f06040640 1 -- 172.21.15.157:0/658749115 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2efc00d040 con 0x55e1390b9bb0 2024-05-09T09:47:36.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.415+0000 7f2f08d26980 1 Processor -- start 2024-05-09T09:47:36.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.415+0000 7f2f08d26980 1 -- start start 2024-05-09T09:47:36.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.419+0000 7f2f08d26980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e1390e2720 0x55e1390e2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.419+0000 7f2f08d26980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55e138ec1020 con 0x55e1390e2720 2024-05-09T09:47:36.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.419+0000 7f2f06841640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e1390e2720 0x55e1390e2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.419+0000 7f2f06841640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e1390e2720 0x55e1390e2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58300/0 (socket says 172.21.15.157:58300) 2024-05-09T09:47:36.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.419+0000 7f2f06841640 1 -- 172.21.15.157:0/3284925580 learned_addr learned my addr 172.21.15.157:0/3284925580 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:36.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.419+0000 7f2f06841640 1 -- 172.21.15.157:0/3284925580 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1390e3080 con 0x55e1390e2720 2024-05-09T09:47:36.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.419+0000 7f2f06841640 1 --2- 172.21.15.157:0/3284925580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e1390e2720 0x55e1390e2b40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80e32e0 tx=0x7f2ef80b2970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.419+0000 7f2deb7fe640 1 -- 172.21.15.157:0/3284925580 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ef80c6580 con 0x55e1390e2720 2024-05-09T09:47:36.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.419+0000 7f2deb7fe640 1 -- 172.21.15.157:0/3284925580 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef80c6720 con 0x55e1390e2720 2024-05-09T09:47:36.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.419+0000 7f2f08d26980 1 -- 172.21.15.157:0/3284925580 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e1390e3b10 con 0x55e1390e2720 2024-05-09T09:47:36.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.419+0000 7f2deb7fe640 1 -- 172.21.15.157:0/3284925580 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ef80c7890 con 0x55e1390e2720 2024-05-09T09:47:36.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.419+0000 7f2f08d26980 1 -- 172.21.15.157:0/3284925580 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1390e3b10 con 0x55e1390e2720 2024-05-09T09:47:36.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.419+0000 7f2deb7fe640 1 -- 172.21.15.157:0/3284925580 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f2ef80ed030 con 0x55e1390e2720 2024-05-09T09:47:36.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.419+0000 7f2deb7fe640 1 --2- 172.21.15.157:0/3284925580 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2de0034bb0 0x7f2de0037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.419+0000 7f2deb7fe640 1 -- 172.21.15.157:0/3284925580 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f2ef80e7120 con 0x55e1390e2720 2024-05-09T09:47:36.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.419+0000 7f2f06040640 1 --2- 172.21.15.157:0/3284925580 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2de0034bb0 0x7f2de0037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.419+0000 7f2f08d26980 1 Processor -- start 2024-05-09T09:47:36.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.419+0000 7f2f08d26980 1 -- start start 2024-05-09T09:47:36.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.419+0000 7f2f08d26980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e1390ef5d0 0x55e1390ef9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.419+0000 7f2f08d26980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55e1390a5850 con 0x55e1390ef5d0 2024-05-09T09:47:36.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.423+0000 7f2f06040640 1 --2- 172.21.15.157:0/3284925580 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2de0034bb0 0x7f2de0037070 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55e1390b3df0 tx=0x7f2efc006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.423+0000 7f2f06841640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e1390ef5d0 0x55e1390ef9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.423+0000 7f2f06841640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e1390ef5d0 0x55e1390ef9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58302/0 (socket says 172.21.15.157:58302) 2024-05-09T09:47:36.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.423+0000 7f2f06841640 1 -- 172.21.15.157:0/3785725832 learned_addr learned my addr 172.21.15.157:0/3785725832 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:36.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.423+0000 7f2f06841640 1 -- 172.21.15.157:0/3785725832 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1390eff80 con 0x55e1390ef5d0 2024-05-09T09:47:36.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.423+0000 7f2f06841640 1 --2- 172.21.15.157:0/3785725832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e1390ef5d0 0x55e1390ef9b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80e70f0 tx=0x7f2ef80dc8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc290e20a64eae0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.423+0000 7f2de97fa640 1 -- 172.21.15.157:0/3785725832 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ef80d1e80 con 0x55e1390ef5d0 2024-05-09T09:47:36.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.423+0000 7f2de97fa640 1 -- 172.21.15.157:0/3785725832 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef80ff070 con 0x55e1390ef5d0 2024-05-09T09:47:36.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.423+0000 7f2de97fa640 1 -- 172.21.15.157:0/3785725832 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ef80cec70 con 0x55e1390ef5d0 2024-05-09T09:47:36.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.423+0000 7f2f08d26980 1 -- 172.21.15.157:0/3785725832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e1390ef5d0 msgr2=0x55e1390ef9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.423+0000 7f2f08d26980 1 --2- 172.21.15.157:0/3785725832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e1390ef5d0 0x55e1390ef9b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80e70f0 tx=0x7f2ef80dc8a0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.423+0000 7f2f08d26980 1 -- 172.21.15.157:0/3785725832 shutdown_connections 2024-05-09T09:47:36.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.423+0000 7f2f08d26980 1 --2- 172.21.15.157:0/3785725832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e1390ef5d0 0x55e1390ef9b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.423+0000 7f2f08d26980 1 -- 172.21.15.157:0/3785725832 >> 172.21.15.157:0/3785725832 conn(0x55e1390eb950 msgr2=0x55e1390e99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:36.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.423+0000 7f2f08d26980 1 -- 172.21.15.157:0/3785725832 shutdown_connections 2024-05-09T09:47:36.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.423+0000 7f2f08d26980 1 -- 172.21.15.157:0/3785725832 wait complete. 2024-05-09T09:47:36.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.423+0000 7f2f08d26980 1 Processor -- start 2024-05-09T09:47:36.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.423+0000 7f2f08d26980 1 -- start start 2024-05-09T09:47:36.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.423+0000 7f2f08d26980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e1390ef5d0 0x55e1390f6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.423+0000 7f2f08d26980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55e1390f0690 con 0x55e1390ef5d0 2024-05-09T09:47:36.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.423+0000 7f2f06841640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e1390ef5d0 0x55e1390f6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.423+0000 7f2f06841640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e1390ef5d0 0x55e1390f6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58314/0 (socket says 172.21.15.157:58314) 2024-05-09T09:47:36.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.423+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 learned_addr learned my addr 172.21.15.157:0/1639827683 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:36.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.423+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1390f6ed0 con 0x55e1390ef5d0 2024-05-09T09:47:36.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.423+0000 7f2f06841640 1 --2- 172.21.15.157:0/1639827683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e1390ef5d0 0x55e1390f6990 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80b5fd0 tx=0x7f2ef80daed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.427+0000 7f2dd77fe640 1 -- 172.21.15.157:0/1639827683 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ef80a9d40 con 0x55e1390ef5d0 2024-05-09T09:47:36.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.427+0000 7f2dd77fe640 1 -- 172.21.15.157:0/1639827683 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef80e3d10 con 0x55e1390ef5d0 2024-05-09T09:47:36.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.427+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e1390f6ed0 con 0x55e1390ef5d0 2024-05-09T09:47:36.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.427+0000 7f2dd77fe640 1 -- 172.21.15.157:0/1639827683 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ef80a9820 con 0x55e1390ef5d0 2024-05-09T09:47:36.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.427+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1390f6ed0 con 0x55e1390ef5d0 2024-05-09T09:47:36.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.427+0000 7f2dd77fe640 1 -- 172.21.15.157:0/1639827683 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f2ef80ce350 con 0x55e1390ef5d0 2024-05-09T09:47:36.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.427+0000 7f2dd77fe640 1 --2- 172.21.15.157:0/1639827683 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2dd0034bb0 0x7f2dd0037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.427+0000 7f2dd77fe640 1 -- 172.21.15.157:0/1639827683 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f2ef80f6040 con 0x55e1390ef5d0 2024-05-09T09:47:36.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.427+0000 7f2f06040640 1 --2- 172.21.15.157:0/1639827683 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2dd0034bb0 0x7f2dd0037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.427+0000 7f2f08d26980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.427+0000 7f2f08d26980 1 --2- 172.21.15.157:0/1639827683 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e1391034c0 0x55e139105980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.427+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e1391060d0 con 0x55e1391034c0 2024-05-09T09:47:36.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.427+0000 7f2f07042640 1 --2- 172.21.15.157:0/1639827683 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e1391034c0 0x55e139105980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.427+0000 7f2f06040640 1 --2- 172.21.15.157:0/1639827683 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2dd0034bb0 0x7f2dd0037070 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2efc010fd0 tx=0x7f2efc011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.427+0000 7f2f07042640 1 --2- 172.21.15.157:0/1639827683 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e1391034c0 0x55e139105980 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.427+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f000083f0 con 0x55e1391034c0 2024-05-09T09:47:36.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.427+0000 7f2f08d26980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:36.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.427+0000 7f2f08d26980 20 realm 2024-05-09T09:47:36.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.427+0000 7f2f08d26980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.427+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e1391064e0 con 0x55e1391034c0 2024-05-09T09:47:36.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.427+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f000083f0 con 0x55e1391034c0 2024-05-09T09:47:36.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.427+0000 7f2f08d26980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:36.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.427+0000 7f2f08d26980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:36.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.427+0000 7f2f08d26980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.427+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e139106db0 con 0x55e1391034c0 2024-05-09T09:47:36.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.427+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f000083f0 con 0x55e1391034c0 2024-05-09T09:47:36.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.427+0000 7f2f08d26980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:36.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.427+0000 7f2f08d26980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.427+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x55e1391034c0 2024-05-09T09:47:36.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.431+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f000083f0 con 0x55e1391034c0 2024-05-09T09:47:36.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.431+0000 7f2f08d26980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:36.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.431+0000 7f2f08d26980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.431+0000 7f2f08d26980 1 --2- 172.21.15.157:0/1639827683 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e139107eb0 0x55e13910a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.431+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e13910a8b0 con 0x55e139107eb0 2024-05-09T09:47:36.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.431+0000 7f2f06841640 1 --2- 172.21.15.157:0/1639827683 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e139107eb0 0x55e13910a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.431+0000 7f2f06841640 1 --2- 172.21.15.157:0/1639827683 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e139107eb0 0x55e13910a2a0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.431+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2ef8114020 con 0x55e139107eb0 2024-05-09T09:47:36.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.431+0000 7f2f08d26980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:36.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.431+0000 7f2f08d26980 20 searching for the correct realm 2024-05-09T09:47:36.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.431+0000 7f2f08d26980 1 --2- 172.21.15.157:0/1639827683 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e13910c800 0x55e13910ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.431+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e13910f2c0 con 0x55e13910c800 2024-05-09T09:47:36.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.431+0000 7f2f06040640 1 --2- 172.21.15.157:0/1639827683 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e13910c800 0x55e13910ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.431+0000 7f2f06040640 1 --2- 172.21.15.157:0/1639827683 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e13910c800 0x55e13910ebf0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.431+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2efc036040 con 0x55e13910c800 2024-05-09T09:47:36.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.431+0000 7f2f06040640 1 --2- 172.21.15.157:0/1639827683 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2efc00f3d0 0x7f2efc00f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.431+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e13910f2c0 con 0x7f2efc00f3d0 2024-05-09T09:47:36.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.431+0000 7f2f07042640 1 --2- 172.21.15.157:0/1639827683 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2efc00f3d0 0x7f2efc00f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.431+0000 7f2f07042640 1 --2- 172.21.15.157:0/1639827683 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2efc00f3d0 0x7f2efc00f7f0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.431+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f000083f0 con 0x7f2efc00f3d0 2024-05-09T09:47:36.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.431+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x55e139107eb0 2024-05-09T09:47:36.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.435+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ef8114020 con 0x55e139107eb0 2024-05-09T09:47:36.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.435+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x55e1391034c0 2024-05-09T09:47:36.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.435+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f000083f0 con 0x55e1391034c0 2024-05-09T09:47:36.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.435+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x55e1391034c0 2024-05-09T09:47:36.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.435+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f000083f0 con 0x55e1391034c0 2024-05-09T09:47:36.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.435+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x55e139107eb0 2024-05-09T09:47:36.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.435+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ef8114020 con 0x55e139107eb0 2024-05-09T09:47:36.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.435+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x55e139107eb0 2024-05-09T09:47:36.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.435+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ef8114020 con 0x55e139107eb0 2024-05-09T09:47:36.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.435+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x7f2efc00f3d0 2024-05-09T09:47:36.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.435+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f000083f0 con 0x7f2efc00f3d0 2024-05-09T09:47:36.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.435+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x55e13910c800 2024-05-09T09:47:36.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.435+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2efc036040 con 0x55e13910c800 2024-05-09T09:47:36.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.435+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x55e1391034c0 2024-05-09T09:47:36.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.435+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f000083f0 con 0x55e1391034c0 2024-05-09T09:47:36.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.435+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x55e139107eb0 2024-05-09T09:47:36.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.439+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ef8114020 con 0x55e139107eb0 2024-05-09T09:47:36.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.439+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x55e1391034c0 2024-05-09T09:47:36.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.439+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f000083f0 con 0x55e1391034c0 2024-05-09T09:47:36.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.439+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x7f2efc00f3d0 2024-05-09T09:47:36.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.439+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2f000083f0 con 0x7f2efc00f3d0 2024-05-09T09:47:36.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.439+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x55e13910c800 2024-05-09T09:47:36.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.439+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2efc036040 con 0x55e13910c800 2024-05-09T09:47:36.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.439+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x55e13910c800 2024-05-09T09:47:36.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.439+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2efc036040 con 0x55e13910c800 2024-05-09T09:47:36.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.439+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x55e139107eb0 2024-05-09T09:47:36.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.439+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ef8114020 con 0x55e139107eb0 2024-05-09T09:47:36.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.439+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x55e13910c800 2024-05-09T09:47:36.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.439+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2efc036040 con 0x55e13910c800 2024-05-09T09:47:36.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.439+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x55e13910c800 2024-05-09T09:47:36.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.439+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2efc036040 con 0x55e13910c800 2024-05-09T09:47:36.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.439+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x55e1391034c0 2024-05-09T09:47:36.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.439+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f000083f0 con 0x55e1391034c0 2024-05-09T09:47:36.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.439+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x55e1391034c0 2024-05-09T09:47:36.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.439+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2f000083f0 con 0x55e1391034c0 2024-05-09T09:47:36.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.439+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x55e139107eb0 2024-05-09T09:47:36.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.443+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ef8114020 con 0x55e139107eb0 2024-05-09T09:47:36.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.443+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x55e13910c800 2024-05-09T09:47:36.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.443+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2efc036040 con 0x55e13910c800 2024-05-09T09:47:36.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.443+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x7f2efc00f3d0 2024-05-09T09:47:36.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.443+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f000083f0 con 0x7f2efc00f3d0 2024-05-09T09:47:36.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.443+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x55e1391034c0 2024-05-09T09:47:36.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.443+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f000083f0 con 0x55e1391034c0 2024-05-09T09:47:36.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.443+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x55e139107eb0 2024-05-09T09:47:36.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.443+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2ef8114020 con 0x55e139107eb0 2024-05-09T09:47:36.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.443+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x55e13910c800 2024-05-09T09:47:36.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.443+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2efc036040 con 0x55e13910c800 2024-05-09T09:47:36.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.443+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x55e139107eb0 2024-05-09T09:47:36.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.443+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ef8114020 con 0x55e139107eb0 2024-05-09T09:47:36.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.443+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x7f2efc00f3d0 2024-05-09T09:47:36.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.443+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f000083f0 con 0x7f2efc00f3d0 2024-05-09T09:47:36.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.443+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x55e13910c800 2024-05-09T09:47:36.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2efc048040 con 0x55e13910c800 2024-05-09T09:47:36.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x55e139107eb0 2024-05-09T09:47:36.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ef8114020 con 0x55e139107eb0 2024-05-09T09:47:36.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x55e1391034c0 2024-05-09T09:47:36.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2f000083f0 con 0x55e1391034c0 2024-05-09T09:47:36.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e139107150 con 0x7f2efc00f3d0 2024-05-09T09:47:36.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f000083f0 con 0x7f2efc00f3d0 2024-05-09T09:47:36.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f08d26980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:36.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f08d26980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:36.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f08d26980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:36.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f08d26980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:36.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f08d26980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:36.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f08d26980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:36.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f08d26980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e13910b170 con 0x55e1391034c0 2024-05-09T09:47:36.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f000083f0 con 0x55e1391034c0 2024-05-09T09:47:36.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f08d26980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:36.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f08d26980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e13910b170 con 0x55e1391034c0 2024-05-09T09:47:36.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f000083f0 con 0x55e1391034c0 2024-05-09T09:47:36.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f08d26980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:36.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f08d26980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e13910b140 con 0x55e13910c800 2024-05-09T09:47:36.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2efc048040 con 0x55e13910c800 2024-05-09T09:47:36.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f08d26980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:36.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f08d26980 20 zone default found 2024-05-09T09:47:36.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f08d26980 4 Realm: () 2024-05-09T09:47:36.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f08d26980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:36.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f08d26980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:36.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f08d26980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:36.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f08d26980 20 zonegroup default 2024-05-09T09:47:36.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f08d26980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e13910bbe0 con 0x55e139107eb0 2024-05-09T09:47:36.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2ef8114020 con 0x55e139107eb0 2024-05-09T09:47:36.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f08d26980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:36.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f08d26980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.447+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e1391115d0 con 0x55e13910c800 2024-05-09T09:47:36.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.451+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2efc048040 con 0x55e13910c800 2024-05-09T09:47:36.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.451+0000 7f2f08d26980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:36.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.451+0000 7f2f08d26980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.451+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e139111970 con 0x55e13910c800 2024-05-09T09:47:36.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.451+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2efc048040 con 0x55e13910c800 2024-05-09T09:47:36.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.451+0000 7f2f08d26980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:36.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.451+0000 7f2f08d26980 20 started sync module instance, tier type = 2024-05-09T09:47:36.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.451+0000 7f2f08d26980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:36.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.451+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139110a10 con 0x7f2efc00f3d0 2024-05-09T09:47:36.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.451+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f000083f0 con 0x7f2efc00f3d0 2024-05-09T09:47:36.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.451+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94425813421616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139110a10 con 0x7f2efc00f3d0 2024-05-09T09:47:36.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.451+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139112200 con 0x55e1391034c0 2024-05-09T09:47:36.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.451+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94425813421616] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f00035040 con 0x7f2efc00f3d0 2024-05-09T09:47:36.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.451+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f00035040 con 0x55e1391034c0 2024-05-09T09:47:36.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.451+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94425813425424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139110a10 con 0x55e1391034c0 2024-05-09T09:47:36.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.451+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139112c10 con 0x55e13910c800 2024-05-09T09:47:36.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.455+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94425813425424] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f00035040 con 0x55e1391034c0 2024-05-09T09:47:36.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.455+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2efc048040 con 0x55e13910c800 2024-05-09T09:47:36.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.455+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94425813419360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139110980 con 0x55e13910c800 2024-05-09T09:47:36.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.455+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139113910 con 0x7f2efc00f3d0 2024-05-09T09:47:36.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.455+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f00035040 con 0x7f2efc00f3d0 2024-05-09T09:47:36.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.455+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94425813431392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139113880 con 0x7f2efc00f3d0 2024-05-09T09:47:36.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.455+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139114830 con 0x55e1391034c0 2024-05-09T09:47:36.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.459+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94425813419360] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2efc048040 con 0x55e13910c800 2024-05-09T09:47:36.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.459+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94425813431392] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f00035040 con 0x7f2efc00f3d0 2024-05-09T09:47:36.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.459+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f00035040 con 0x55e1391034c0 2024-05-09T09:47:36.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.459+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94425813435168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e1391147f0 con 0x55e1391034c0 2024-05-09T09:47:36.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.459+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139114c20 con 0x55e139107eb0 2024-05-09T09:47:36.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.459+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94425813435168] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f00035040 con 0x55e1391034c0 2024-05-09T09:47:36.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.459+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ef8114020 con 0x55e139107eb0 2024-05-09T09:47:36.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.459+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94425813433520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139115010 con 0x55e139107eb0 2024-05-09T09:47:36.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.459+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e1391158c0 con 0x55e139107eb0 2024-05-09T09:47:36.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.463+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94425813433520] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ef8114020 con 0x55e139107eb0 2024-05-09T09:47:36.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.463+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ef8114020 con 0x55e139107eb0 2024-05-09T09:47:36.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.463+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94425813439408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139115b60 con 0x55e139107eb0 2024-05-09T09:47:36.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.463+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139116660 con 0x55e139107eb0 2024-05-09T09:47:36.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.463+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94425813439408] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ef8114020 con 0x55e139107eb0 2024-05-09T09:47:36.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.467+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ef8114020 con 0x55e139107eb0 2024-05-09T09:47:36.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.467+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94425813442896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139116620 con 0x55e139107eb0 2024-05-09T09:47:36.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.467+0000 7f2f08d26980 20 add_watcher() i=0 2024-05-09T09:47:36.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.467+0000 7f2f08d26980 20 add_watcher() i=1 2024-05-09T09:47:36.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.467+0000 7f2f08d26980 20 add_watcher() i=2 2024-05-09T09:47:36.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.467+0000 7f2f08d26980 20 add_watcher() i=3 2024-05-09T09:47:36.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.467+0000 7f2f08d26980 20 add_watcher() i=4 2024-05-09T09:47:36.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.467+0000 7f2f08d26980 20 add_watcher() i=5 2024-05-09T09:47:36.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.467+0000 7f2f08d26980 20 add_watcher() i=6 2024-05-09T09:47:36.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.467+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94425813442896] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ef8114020 con 0x55e139107eb0 2024-05-09T09:47:36.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.467+0000 7f2f08d26980 20 add_watcher() i=7 2024-05-09T09:47:36.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.467+0000 7f2f08d26980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:36.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.467+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e139119ae0 con 0x55e1391034c0 2024-05-09T09:47:36.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.467+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2f00035040 con 0x55e1391034c0 2024-05-09T09:47:36.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.467+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94425813430192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139117000 con 0x55e1391034c0 2024-05-09T09:47:36.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.467+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94425813430192] v30'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f00035040 con 0x55e1391034c0 2024-05-09T09:47:36.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.467+0000 7f2db77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:36.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.467+0000 7f2f08d26980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:36.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.467+0000 7f2f08d26980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:36.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.467+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e1391198b0 con 0x55e1391034c0 2024-05-09T09:47:36.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.471+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'40 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2f00035040 con 0x55e1391034c0 2024-05-09T09:47:36.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.471+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139122bb0 con 0x55e139107eb0 2024-05-09T09:47:36.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.471+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'34 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ef8114020 con 0x55e139107eb0 2024-05-09T09:47:36.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.471+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139122bb0 con 0x55e13910c800 2024-05-09T09:47:36.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.475+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'34 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2efc048040 con 0x55e13910c800 2024-05-09T09:47:36.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.475+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e1391231c0 con 0x55e1391034c0 2024-05-09T09:47:36.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.475+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'145 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2f00035040 con 0x55e1391034c0 2024-05-09T09:47:36.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.475+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139123730 con 0x7f2efc00f3d0 2024-05-09T09:47:36.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.475+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'92 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2f00035040 con 0x7f2efc00f3d0 2024-05-09T09:47:36.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.475+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139123be0 con 0x55e13910c800 2024-05-09T09:47:36.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.479+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'61 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2efc048040 con 0x55e13910c800 2024-05-09T09:47:36.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.479+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139122320 con 0x55e1391034c0 2024-05-09T09:47:36.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.479+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'36 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2f00035040 con 0x55e1391034c0 2024-05-09T09:47:36.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.479+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139122320 con 0x55e139107eb0 2024-05-09T09:47:36.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.483+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'61 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ef8114020 con 0x55e139107eb0 2024-05-09T09:47:36.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.483+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139122320 con 0x7f2efc00f3d0 2024-05-09T09:47:36.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.487+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'34 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2f00035040 con 0x7f2efc00f3d0 2024-05-09T09:47:36.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.487+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139122520 con 0x55e13910c800 2024-05-09T09:47:36.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.487+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'40 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2efc048040 con 0x55e13910c800 2024-05-09T09:47:36.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.487+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139124740 con 0x7f2efc00f3d0 2024-05-09T09:47:36.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.487+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'93 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f00035040 con 0x7f2efc00f3d0 2024-05-09T09:47:36.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.487+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139124740 con 0x55e139107eb0 2024-05-09T09:47:36.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.491+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'36 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ef8114020 con 0x55e139107eb0 2024-05-09T09:47:36.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.491+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139124740 con 0x7f2efc00f3d0 2024-05-09T09:47:36.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.491+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'34 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f00035040 con 0x7f2efc00f3d0 2024-05-09T09:47:36.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.491+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139124740 con 0x55e139107eb0 2024-05-09T09:47:36.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.495+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'67 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ef8114020 con 0x55e139107eb0 2024-05-09T09:47:36.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.495+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139124800 con 0x55e1391034c0 2024-05-09T09:47:36.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.495+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'146 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f00035040 con 0x55e1391034c0 2024-05-09T09:47:36.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.495+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139124800 con 0x55e13910c800 2024-05-09T09:47:36.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.499+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'86 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2efc048040 con 0x55e13910c800 2024-05-09T09:47:36.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.499+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139124cd0 con 0x7f2efc00f3d0 2024-05-09T09:47:36.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.499+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'94 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f00035040 con 0x7f2efc00f3d0 2024-05-09T09:47:36.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.499+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139124cd0 con 0x55e13910c800 2024-05-09T09:47:36.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.503+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'34 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2efc048040 con 0x55e13910c800 2024-05-09T09:47:36.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.503+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139124cd0 con 0x55e1391034c0 2024-05-09T09:47:36.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.503+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'42 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f00035040 con 0x55e1391034c0 2024-05-09T09:47:36.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.503+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139124cd0 con 0x55e1391034c0 2024-05-09T09:47:36.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.503+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'147 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f00035040 con 0x55e1391034c0 2024-05-09T09:47:36.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.503+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139124cd0 con 0x55e13910c800 2024-05-09T09:47:36.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.507+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'87 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2efc048040 con 0x55e13910c800 2024-05-09T09:47:36.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.507+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139124cd0 con 0x7f2efc00f3d0 2024-05-09T09:47:36.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.511+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'44 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f00035040 con 0x7f2efc00f3d0 2024-05-09T09:47:36.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.511+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139124cd0 con 0x55e13910c800 2024-05-09T09:47:36.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.511+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'36 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2efc048040 con 0x55e13910c800 2024-05-09T09:47:36.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.511+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139124cd0 con 0x55e13910c800 2024-05-09T09:47:36.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.511+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'40 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2efc048040 con 0x55e13910c800 2024-05-09T09:47:36.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.511+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139124cd0 con 0x55e13910c800 2024-05-09T09:47:36.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.515+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'30 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2efc048040 con 0x55e13910c800 2024-05-09T09:47:36.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.515+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139124cd0 con 0x55e13910c800 2024-05-09T09:47:36.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.515+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'62 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2efc048040 con 0x55e13910c800 2024-05-09T09:47:36.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.515+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139124cd0 con 0x55e139107eb0 2024-05-09T09:47:36.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.519+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'36 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ef8114020 con 0x55e139107eb0 2024-05-09T09:47:36.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.519+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139124cd0 con 0x55e13910c800 2024-05-09T09:47:36.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.519+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'34 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2efc048040 con 0x55e13910c800 2024-05-09T09:47:36.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.519+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139124cd0 con 0x55e139107eb0 2024-05-09T09:47:36.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.523+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'62 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ef8114020 con 0x55e139107eb0 2024-05-09T09:47:36.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.523+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139124cd0 con 0x55e13910c800 2024-05-09T09:47:36.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.527+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'88 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2efc048040 con 0x55e13910c800 2024-05-09T09:47:36.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.527+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139124cd0 con 0x55e139107eb0 2024-05-09T09:47:36.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.527+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'68 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ef8114020 con 0x55e139107eb0 2024-05-09T09:47:36.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.527+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139124cd0 con 0x7f2efc00f3d0 2024-05-09T09:47:36.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.531+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'40 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2f00035040 con 0x7f2efc00f3d0 2024-05-09T09:47:36.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.531+0000 7f2db67fc640 20 reqs_thread_entry: start 2024-05-09T09:47:36.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.531+0000 7f2f08d26980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:36.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.531+0000 7f2d27fff640 20 reqs_thread_entry: start 2024-05-09T09:47:36.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.531+0000 7f2f08d26980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-09T09:47:36.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.531+0000 7f2f08d26980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.531+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e139140690 con 0x55e1391034c0 2024-05-09T09:47:36.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.531+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7f2f00035040 con 0x55e1391034c0 2024-05-09T09:47:36.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.531+0000 7f2f08d26980 20 rados_obj.operate() r=0 bl.length=582 2024-05-09T09:47:36.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.531+0000 7f2f08d26980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-09T09:47:36.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.531+0000 7f2f08d26980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:36.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.531+0000 7f2f08d26980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:36.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.531+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e1391468d0 con 0x55e1391034c0 2024-05-09T09:47:36.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.535+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(95 foo [delete,create,call,call,writefull 0~556] v30'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f2f00035040 con 0x55e1391034c0 2024-05-09T09:47:36.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.535+0000 7f2f08d26980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:47:36.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.535+0000 7f2f08d26980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:36.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.535+0000 7f2f08d26980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-09T09:47:36.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.535+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 7.d 7:b4812045:::notify.4:head [notify cookie 94425813640016 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e1391436c0 con 0x55e1391034c0 2024-05-09T09:47:36.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.535+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== watch-notify(notify (1) cookie 94425813435168 notify 128849018889 ret 0) ==== 774+0+0 (crc 0 0 0) 0x55e139123390 con 0x55e1391034c0 2024-05-09T09:47:36.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.535+0000 7f2de97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 94425813435168 notifier 4420 bl.length()=732 2024-05-09T09:47:36.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.535+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(96 notify.4 [notify cookie 94425813640016 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2f00035040 con 0x55e1391034c0 2024-05-09T09:47:36.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.535+0000 7f2de97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:47:36.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.535+0000 7f2de97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:36.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.535+0000 7f2de97fa640 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f2dc80056c0 con 0x55e1391034c0 2024-05-09T09:47:36.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.535+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(97 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f00035040 con 0x55e1391034c0 2024-05-09T09:47:36.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.535+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== watch-notify(notify_complete (2) cookie 94425813640016 notify 128849018889 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e1391231c0 con 0x55e1391034c0 2024-05-09T09:47:36.535 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-09T09:47:32.044078Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-05-09T09:47:35.743410Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:47:32.044055Z","tags":[],"group_ids":[]} 2024-05-09T09:47:36.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.535+0000 7f2db77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:36.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.535+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94425813430192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e1391202b0 con 0x55e1391034c0 2024-05-09T09:47:36.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.539+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(98 data_loggenerations_metadata [watch unwatch cookie 94425813430192] v30'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f00035040 con 0x55e1391034c0 2024-05-09T09:47:36.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.539+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94425813421616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139112fb0 con 0x7f2efc00f3d0 2024-05-09T09:47:36.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.539+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(99 notify.0 [watch unwatch cookie 94425813421616] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f00035040 con 0x7f2efc00f3d0 2024-05-09T09:47:36.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.539+0000 7f2f08d26980 20 remove_watcher() i=0 2024-05-09T09:47:36.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.539+0000 7f2f08d26980 2 removed watcher, disabling cache 2024-05-09T09:47:36.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.539+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94425813425424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139110e30 con 0x55e1391034c0 2024-05-09T09:47:36.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.539+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(100 notify.1 [watch unwatch cookie 94425813425424] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f00035040 con 0x55e1391034c0 2024-05-09T09:47:36.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.543+0000 7f2f08d26980 20 remove_watcher() i=1 2024-05-09T09:47:36.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.543+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94425813419360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139111d10 con 0x55e13910c800 2024-05-09T09:47:36.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.543+0000 7f2f06040640 1 -- 172.21.15.157:0/1639827683 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(101 notify.2 [watch unwatch cookie 94425813419360] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2efc048040 con 0x55e13910c800 2024-05-09T09:47:36.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.543+0000 7f2f08d26980 20 remove_watcher() i=2 2024-05-09T09:47:36.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.543+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:102 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94425813431392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139111d10 con 0x7f2efc00f3d0 2024-05-09T09:47:36.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.543+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(102 notify.3 [watch unwatch cookie 94425813431392] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f00035040 con 0x7f2efc00f3d0 2024-05-09T09:47:36.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.543+0000 7f2f08d26980 20 remove_watcher() i=3 2024-05-09T09:47:36.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.543+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94425813435168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139113460 con 0x55e1391034c0 2024-05-09T09:47:36.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.547+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(103 notify.4 [watch unwatch cookie 94425813435168] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f00035040 con 0x55e1391034c0 2024-05-09T09:47:36.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.547+0000 7f2f08d26980 20 remove_watcher() i=4 2024-05-09T09:47:36.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.547+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94425813433520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139111d10 con 0x55e139107eb0 2024-05-09T09:47:36.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.547+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(104 notify.5 [watch unwatch cookie 94425813433520] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ef8114020 con 0x55e139107eb0 2024-05-09T09:47:36.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.547+0000 7f2f08d26980 20 remove_watcher() i=5 2024-05-09T09:47:36.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.551+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:105 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94425813439408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139114320 con 0x55e139107eb0 2024-05-09T09:47:36.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.551+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(105 notify.6 [watch unwatch cookie 94425813439408] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ef8114020 con 0x55e139107eb0 2024-05-09T09:47:36.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.551+0000 7f2f08d26980 20 remove_watcher() i=6 2024-05-09T09:47:36.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.551+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:106 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94425813442896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e139113460 con 0x55e139107eb0 2024-05-09T09:47:36.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.551+0000 7f2f06841640 1 -- 172.21.15.157:0/1639827683 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(106 notify.7 [watch unwatch cookie 94425813442896] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ef8114020 con 0x55e139107eb0 2024-05-09T09:47:36.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.551+0000 7f2f08d26980 20 remove_watcher() i=7 2024-05-09T09:47:36.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.551+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e139107eb0 msgr2=0x55e13910a2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 --2- 172.21.15.157:0/1639827683 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e139107eb0 0x55e13910a2a0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e1391034c0 msgr2=0x55e139105980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 --2- 172.21.15.157:0/1639827683 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e1391034c0 0x55e139105980 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2efc00f3d0 msgr2=0x7f2efc00f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 --2- 172.21.15.157:0/1639827683 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2efc00f3d0 0x7f2efc00f7f0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e13910c800 msgr2=0x55e13910ebf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 --2- 172.21.15.157:0/1639827683 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e13910c800 0x55e13910ebf0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2dd0034bb0 msgr2=0x7f2dd0037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 --2- 172.21.15.157:0/1639827683 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2dd0034bb0 0x7f2dd0037070 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2efc010fd0 tx=0x7f2efc011000 comp rx=0 tx=0).stop 2024-05-09T09:47:36.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e1390ef5d0 msgr2=0x55e1390f6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f07042640 1 -- 172.21.15.157:0/1639827683 reap_dead start 2024-05-09T09:47:36.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 --2- 172.21.15.157:0/1639827683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e1390ef5d0 0x55e1390f6990 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80b5fd0 tx=0x7f2ef80daed0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 shutdown_connections 2024-05-09T09:47:36.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 --2- 172.21.15.157:0/1639827683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e1390ef5d0 0x55e1390f6990 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 >> 172.21.15.157:0/1639827683 conn(0x55e1390eb950 msgr2=0x55e1390e8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:36.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 shutdown_connections 2024-05-09T09:47:36.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 -- 172.21.15.157:0/1639827683 wait complete. 2024-05-09T09:47:36.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 -- 172.21.15.157:0/3284925580 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2de0034bb0 msgr2=0x7f2de0037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 --2- 172.21.15.157:0/3284925580 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2de0034bb0 0x7f2de0037070 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55e1390b3df0 tx=0x7f2efc006000 comp rx=0 tx=0).stop 2024-05-09T09:47:36.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 -- 172.21.15.157:0/3284925580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e1390e2720 msgr2=0x55e1390e2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 --2- 172.21.15.157:0/3284925580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e1390e2720 0x55e1390e2b40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80e32e0 tx=0x7f2ef80b2970 comp rx=0 tx=0).stop 2024-05-09T09:47:36.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 -- 172.21.15.157:0/3284925580 shutdown_connections 2024-05-09T09:47:36.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 --2- 172.21.15.157:0/3284925580 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2de0034bb0 0x7f2de0037070 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 --2- 172.21.15.157:0/3284925580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e1390e2720 0x55e1390e2b40 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 -- 172.21.15.157:0/3284925580 >> 172.21.15.157:0/3284925580 conn(0x55e1390d74f0 msgr2=0x55e1390d8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:36.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 -- 172.21.15.157:0/3284925580 shutdown_connections 2024-05-09T09:47:36.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 -- 172.21.15.157:0/3284925580 wait complete. 2024-05-09T09:47:36.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 -- 172.21.15.157:0/658749115 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e1390b5c70 msgr2=0x55e1390b8060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 --2- 172.21.15.157:0/658749115 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e1390b5c70 0x55e1390b8060 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 -- 172.21.15.157:0/658749115 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e138fba2a0 msgr2=0x55e1390b33c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 --2- 172.21.15.157:0/658749115 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e138fba2a0 0x55e1390b33c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 -- 172.21.15.157:0/658749115 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e1390b9bb0 msgr2=0x55e1390bbfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 --2- 172.21.15.157:0/658749115 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e1390b9bb0 0x55e1390bbfa0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 -- 172.21.15.157:0/658749115 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2dec034c50 msgr2=0x7f2dec037110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 --2- 172.21.15.157:0/658749115 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2dec034c50 0x7f2dec037110 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2efc000f70 tx=0x7f2efc001420 comp rx=0 tx=0).stop 2024-05-09T09:47:36.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 -- 172.21.15.157:0/658749115 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e138fb9980 msgr2=0x55e1390ac310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 --2- 172.21.15.157:0/658749115 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e138fb9980 0x55e1390ac310 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2ef801b0d0 tx=0x7f2ef8017e30 comp rx=0 tx=0).stop 2024-05-09T09:47:36.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f07042640 1 -- 172.21.15.157:0/658749115 reap_dead start 2024-05-09T09:47:36.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 -- 172.21.15.157:0/658749115 shutdown_connections 2024-05-09T09:47:36.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 -- 172.21.15.157:0/658749115 >> 172.21.15.157:0/658749115 conn(0x55e138fb5250 msgr2=0x55e13909f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:36.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 -- 172.21.15.157:0/658749115 shutdown_connections 2024-05-09T09:47:36.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.555+0000 7f2f08d26980 1 -- 172.21.15.157:0/658749115 wait complete. 2024-05-09T09:47:36.566 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-09T09:47:32.044078Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-05-09T09:47:35.743410Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:47:32.044055Z', 'tags': [], 'group_ids': []} 2024-05-09T09:47:36.566 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-05-09T09:47:36.566 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-05-09T09:47:36.566 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-05-09T09:47:36.644 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:36.644 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:36.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.647+0000 7f403f9be980 1 Processor -- start 2024-05-09T09:47:36.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.647+0000 7f403f9be980 1 -- start start 2024-05-09T09:47:36.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.647+0000 7f403f9be980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55d7a1af8d00 0x55d7a1afb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.647+0000 7f403f9be980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d7a19ab440 con 0x55d7a1af47a0 2024-05-09T09:47:36.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.647+0000 7f403f9be980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55d7a19965f0 con 0x55d7a1af8d00 2024-05-09T09:47:36.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.647+0000 7f403ccd8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55d7a1af8d00 0x55d7a1afb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.647+0000 7f403d4d9640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x55d7a1af47a0 0x55d7a1af4b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:51606/0 (socket says 172.21.15.157:51606) 2024-05-09T09:47:36.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.647+0000 7f403d4d9640 1 -- 172.21.15.157:0/1102876914 learned_addr learned my addr 172.21.15.157:0/1102876914 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:47:36.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.647+0000 7f403ccd8640 1 -- 172.21.15.157:0/1102876914 >> v1:172.21.15.110:6789/0 conn(0x55d7a1af47a0 legacy=0x55d7a1af4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.647+0000 7f403ccd8640 1 -- 172.21.15.157:0/1102876914 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7a19a1990 con 0x55d7a1af8d00 2024-05-09T09:47:36.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.651+0000 7f403ccd8640 1 --2- 172.21.15.157:0/1102876914 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1af8d00 0x55d7a1afb0f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f403400a480 tx=0x7f403401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4369823b7a256372 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.651+0000 7f402ffff640 1 -- 172.21.15.157:0/1102876914 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40340b0070 con 0x55d7a1af8d00 2024-05-09T09:47:36.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.651+0000 7f402ffff640 1 -- 172.21.15.157:0/1102876914 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40340ab540 con 0x55d7a1af8d00 2024-05-09T09:47:36.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.651+0000 7f402ffff640 1 -- 172.21.15.157:0/1102876914 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40340ab840 con 0x55d7a1af8d00 2024-05-09T09:47:36.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.651+0000 7f403f9be980 1 -- 172.21.15.157:0/1102876914 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1af8d00 msgr2=0x55d7a1afb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.651+0000 7f403f9be980 1 --2- 172.21.15.157:0/1102876914 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1af8d00 0x55d7a1afb0f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f403400a480 tx=0x7f403401b280 comp rx=0 tx=0).stop 2024-05-09T09:47:36.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.651+0000 7f403f9be980 1 -- 172.21.15.157:0/1102876914 shutdown_connections 2024-05-09T09:47:36.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.651+0000 7f403f9be980 1 --2- 172.21.15.157:0/1102876914 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1af8d00 0x55d7a1afb0f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.651+0000 7f403f9be980 1 -- 172.21.15.157:0/1102876914 >> 172.21.15.157:0/1102876914 conn(0x55d7a1af0070 msgr2=0x55d7a1af2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:36.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.651+0000 7f403f9be980 1 -- 172.21.15.157:0/1102876914 shutdown_connections 2024-05-09T09:47:36.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.651+0000 7f403f9be980 1 -- 172.21.15.157:0/1102876914 wait complete. 2024-05-09T09:47:36.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.667+0000 7f403f9be980 1 Processor -- start 2024-05-09T09:47:36.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.667+0000 7f403f9be980 1 -- start start 2024-05-09T09:47:36.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.667+0000 7f403f9be980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1af47a0 0x55d7a1a69120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.667+0000 7f403f9be980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d7a19f8fe0 con 0x55d7a1af47a0 2024-05-09T09:47:36.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.667+0000 7f403d4d9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1af47a0 0x55d7a1a69120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.667+0000 7f403d4d9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1af47a0 0x55d7a1a69120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58322/0 (socket says 172.21.15.157:58322) 2024-05-09T09:47:36.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.667+0000 7f403d4d9640 1 -- 172.21.15.157:0/2981524928 learned_addr learned my addr 172.21.15.157:0/2981524928 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:36.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.667+0000 7f403d4d9640 1 -- 172.21.15.157:0/2981524928 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7a197dae0 con 0x55d7a1af47a0 2024-05-09T09:47:36.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.667+0000 7f403d4d9640 1 --2- 172.21.15.157:0/2981524928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1af47a0 0x55d7a1a69120 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f40380017b0 tx=0x7f4038001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=effda2a6298fbe4a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.667+0000 7f3f2b606640 1 -- 172.21.15.157:0/2981524928 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4038016070 con 0x55d7a1af47a0 2024-05-09T09:47:36.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.667+0000 7f3f2b606640 1 -- 172.21.15.157:0/2981524928 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4038004530 con 0x55d7a1af47a0 2024-05-09T09:47:36.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.667+0000 7f3f2b606640 1 -- 172.21.15.157:0/2981524928 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4038004870 con 0x55d7a1af47a0 2024-05-09T09:47:36.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.671+0000 7f403f9be980 1 -- 172.21.15.157:0/2981524928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1af47a0 msgr2=0x55d7a1a69120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.671+0000 7f403f9be980 1 --2- 172.21.15.157:0/2981524928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1af47a0 0x55d7a1a69120 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f40380017b0 tx=0x7f4038001c70 comp rx=0 tx=0).stop 2024-05-09T09:47:36.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.671+0000 7f403f9be980 1 -- 172.21.15.157:0/2981524928 shutdown_connections 2024-05-09T09:47:36.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.671+0000 7f403f9be980 1 --2- 172.21.15.157:0/2981524928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1af47a0 0x55d7a1a69120 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.671+0000 7f403f9be980 1 -- 172.21.15.157:0/2981524928 >> 172.21.15.157:0/2981524928 conn(0x55d7a1af0070 msgr2=0x55d7a1bdb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:36.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.671+0000 7f403f9be980 1 -- 172.21.15.157:0/2981524928 shutdown_connections 2024-05-09T09:47:36.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.671+0000 7f403f9be980 1 -- 172.21.15.157:0/2981524928 wait complete. 2024-05-09T09:47:36.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.671+0000 7f403f9be980 1 Processor -- start 2024-05-09T09:47:36.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.671+0000 7f403f9be980 1 -- start start 2024-05-09T09:47:36.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.671+0000 7f403f9be980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1af47a0 0x55d7a1be7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.671+0000 7f403f9be980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d7a1afe120 con 0x55d7a1af47a0 2024-05-09T09:47:36.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.671+0000 7f403d4d9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1af47a0 0x55d7a1be7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.671+0000 7f403d4d9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1af47a0 0x55d7a1be7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58326/0 (socket says 172.21.15.157:58326) 2024-05-09T09:47:36.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.671+0000 7f403d4d9640 1 -- 172.21.15.157:0/1116441132 learned_addr learned my addr 172.21.15.157:0/1116441132 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:36.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.671+0000 7f403d4d9640 1 -- 172.21.15.157:0/1116441132 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7a1be8340 con 0x55d7a1af47a0 2024-05-09T09:47:36.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.671+0000 7f403d4d9640 1 --2- 172.21.15.157:0/1116441132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1af47a0 0x55d7a1be7e00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4038014040 tx=0x7f4038001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.671+0000 7f3f29e03640 1 -- 172.21.15.157:0/1116441132 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4038020070 con 0x55d7a1af47a0 2024-05-09T09:47:36.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.671+0000 7f3f29e03640 1 -- 172.21.15.157:0/1116441132 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4038011400 con 0x55d7a1af47a0 2024-05-09T09:47:36.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.671+0000 7f403f9be980 1 -- 172.21.15.157:0/1116441132 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7a1be85d0 con 0x55d7a1af47a0 2024-05-09T09:47:36.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.671+0000 7f3f29e03640 1 -- 172.21.15.157:0/1116441132 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4038016040 con 0x55d7a1af47a0 2024-05-09T09:47:36.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.671+0000 7f403f9be980 1 -- 172.21.15.157:0/1116441132 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7a1beb260 con 0x55d7a1af47a0 2024-05-09T09:47:36.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.675+0000 7f3f29e03640 1 -- 172.21.15.157:0/1116441132 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f4038023070 con 0x55d7a1af47a0 2024-05-09T09:47:36.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.675+0000 7f3f29e03640 1 --2- 172.21.15.157:0/1116441132 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3f24034c00 0x7f3f240370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.675+0000 7f3f29e03640 1 -- 172.21.15.157:0/1116441132 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f4038049680 con 0x55d7a1af47a0 2024-05-09T09:47:36.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.675+0000 7f403ccd8640 1 --2- 172.21.15.157:0/1116441132 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3f24034c00 0x7f3f240370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.675+0000 7f403f9be980 1 --2- 172.21.15.157:0/1116441132 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d7a1af8d00 0x55d7a1beeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.675+0000 7f403f9be980 1 -- 172.21.15.157:0/1116441132 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1bef430 con 0x55d7a1af8d00 2024-05-09T09:47:36.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.675+0000 7f403dcda640 1 --2- 172.21.15.157:0/1116441132 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d7a1af8d00 0x55d7a1beeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.675+0000 7f403ccd8640 1 --2- 172.21.15.157:0/1116441132 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3f24034c00 0x7f3f240370c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f40340ad000 tx=0x7f40340a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.675+0000 7f403dcda640 1 --2- 172.21.15.157:0/1116441132 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d7a1af8d00 0x55d7a1beeeb0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.675+0000 7f403dcda640 1 -- 172.21.15.157:0/1116441132 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40300083f0 con 0x55d7a1af8d00 2024-05-09T09:47:36.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.675+0000 7f403f9be980 1 -- 172.21.15.157:0/1116441132 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1bec480 con 0x55d7a1af8d00 2024-05-09T09:47:36.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.675+0000 7f403dcda640 1 -- 172.21.15.157:0/1116441132 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f40300083f0 con 0x55d7a1af8d00 2024-05-09T09:47:36.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.675+0000 7f403f9be980 1 --2- 172.21.15.157:0/1116441132 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d7a1bf1790 0x55d7a1bf3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.675+0000 7f403f9be980 1 -- 172.21.15.157:0/1116441132 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1bf4250 con 0x55d7a1bf1790 2024-05-09T09:47:36.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.675+0000 7f403d4d9640 1 --2- 172.21.15.157:0/1116441132 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d7a1bf1790 0x55d7a1bf3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.675+0000 7f403d4d9640 1 --2- 172.21.15.157:0/1116441132 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d7a1bf1790 0x55d7a1bf3b80 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.675+0000 7f403d4d9640 1 -- 172.21.15.157:0/1116441132 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f403802c070 con 0x55d7a1bf1790 2024-05-09T09:47:36.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.679+0000 7f403f9be980 1 -- 172.21.15.157:0/1116441132 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1bf0630 con 0x55d7a1af8d00 2024-05-09T09:47:36.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.679+0000 7f403dcda640 1 -- 172.21.15.157:0/1116441132 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f40300083f0 con 0x55d7a1af8d00 2024-05-09T09:47:36.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.679+0000 7f403f9be980 1 --2- 172.21.15.157:0/1116441132 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d7a1bf56b0 0x55d7a1bf7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.679+0000 7f403f9be980 1 -- 172.21.15.157:0/1116441132 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1bf81a0 con 0x55d7a1bf56b0 2024-05-09T09:47:36.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.679+0000 7f403ccd8640 1 --2- 172.21.15.157:0/1116441132 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d7a1bf56b0 0x55d7a1bf7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.679+0000 7f403ccd8640 1 --2- 172.21.15.157:0/1116441132 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d7a1bf56b0 0x55d7a1bf7aa0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.679+0000 7f403ccd8640 1 -- 172.21.15.157:0/1116441132 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f40340b3040 con 0x55d7a1bf56b0 2024-05-09T09:47:36.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.683+0000 7f403f9be980 1 Processor -- start 2024-05-09T09:47:36.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.683+0000 7f403f9be980 1 -- start start 2024-05-09T09:47:36.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.683+0000 7f403f9be980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1c20220 0x55d7a1c20640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.683+0000 7f403f9be980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d7a19fd020 con 0x55d7a1c20220 2024-05-09T09:47:36.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.683+0000 7f403d4d9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1c20220 0x55d7a1c20640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.683+0000 7f403d4d9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1c20220 0x55d7a1c20640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58332/0 (socket says 172.21.15.157:58332) 2024-05-09T09:47:36.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.683+0000 7f403d4d9640 1 -- 172.21.15.157:0/2077497947 learned_addr learned my addr 172.21.15.157:0/2077497947 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:36.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.683+0000 7f403d4d9640 1 -- 172.21.15.157:0/2077497947 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7a1c20b80 con 0x55d7a1c20220 2024-05-09T09:47:36.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.683+0000 7f403d4d9640 1 --2- 172.21.15.157:0/2077497947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1c20220 0x55d7a1c20640 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4038047ad0 tx=0x7f4038047f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.683+0000 7f3f21ba0640 1 -- 172.21.15.157:0/2077497947 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40380490c0 con 0x55d7a1c20220 2024-05-09T09:47:36.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.683+0000 7f403f9be980 1 -- 172.21.15.157:0/2077497947 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7a1c21610 con 0x55d7a1c20220 2024-05-09T09:47:36.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.683+0000 7f3f21ba0640 1 -- 172.21.15.157:0/2077497947 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4038049260 con 0x55d7a1c20220 2024-05-09T09:47:36.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.683+0000 7f403f9be980 1 -- 172.21.15.157:0/2077497947 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7a1c21af0 con 0x55d7a1c20220 2024-05-09T09:47:36.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.683+0000 7f3f21ba0640 1 -- 172.21.15.157:0/2077497947 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f403803e060 con 0x55d7a1c20220 2024-05-09T09:47:36.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.687+0000 7f3f21ba0640 1 -- 172.21.15.157:0/2077497947 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f403801ba10 con 0x55d7a1c20220 2024-05-09T09:47:36.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.687+0000 7f3f21ba0640 1 --2- 172.21.15.157:0/2077497947 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3f14034bb0 0x7f3f14037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.687+0000 7f3f21ba0640 1 -- 172.21.15.157:0/2077497947 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f403803b1a0 con 0x55d7a1c20220 2024-05-09T09:47:36.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.687+0000 7f403ccd8640 1 --2- 172.21.15.157:0/2077497947 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3f14034bb0 0x7f3f14037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.687+0000 7f403f9be980 1 Processor -- start 2024-05-09T09:47:36.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.687+0000 7f403f9be980 1 -- start start 2024-05-09T09:47:36.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.687+0000 7f403f9be980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1c2d1e0 0x55d7a1c2d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.687+0000 7f403ccd8640 1 --2- 172.21.15.157:0/2077497947 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3f14034bb0 0x7f3f14037070 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55d7a1befd40 tx=0x7f4034005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.687+0000 7f403f9be980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d7a1a69870 con 0x55d7a1c2d1e0 2024-05-09T09:47:36.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.687+0000 7f403d4d9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1c2d1e0 0x55d7a1c2d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.687+0000 7f403d4d9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1c2d1e0 0x55d7a1c2d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58338/0 (socket says 172.21.15.157:58338) 2024-05-09T09:47:36.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.687+0000 7f403d4d9640 1 -- 172.21.15.157:0/2735218851 learned_addr learned my addr 172.21.15.157:0/2735218851 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:36.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.687+0000 7f403d4d9640 1 -- 172.21.15.157:0/2735218851 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7a1c2dbb0 con 0x55d7a1c2d1e0 2024-05-09T09:47:36.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.687+0000 7f403d4d9640 1 --2- 172.21.15.157:0/2735218851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1c2d1e0 0x55d7a1c2d5e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4038025040 tx=0x7f40380053d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323ffd1044ff4f1d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.687+0000 7f3f1b7fe640 1 -- 172.21.15.157:0/2735218851 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4038058070 con 0x55d7a1c2d1e0 2024-05-09T09:47:36.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.687+0000 7f3f1b7fe640 1 -- 172.21.15.157:0/2735218851 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f403802d690 con 0x55d7a1c2d1e0 2024-05-09T09:47:36.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.687+0000 7f3f1b7fe640 1 -- 172.21.15.157:0/2735218851 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40380499e0 con 0x55d7a1c2d1e0 2024-05-09T09:47:36.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.687+0000 7f403f9be980 1 -- 172.21.15.157:0/2735218851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1c2d1e0 msgr2=0x55d7a1c2d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.687+0000 7f403f9be980 1 --2- 172.21.15.157:0/2735218851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1c2d1e0 0x55d7a1c2d5e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4038025040 tx=0x7f40380053d0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.687+0000 7f403f9be980 1 -- 172.21.15.157:0/2735218851 shutdown_connections 2024-05-09T09:47:36.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.687+0000 7f403f9be980 1 --2- 172.21.15.157:0/2735218851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1c2d1e0 0x55d7a1c2d5e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.687+0000 7f403f9be980 1 -- 172.21.15.157:0/2735218851 >> 172.21.15.157:0/2735218851 conn(0x55d7a1c29560 msgr2=0x55d7a1c275c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:36.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.687+0000 7f403f9be980 1 -- 172.21.15.157:0/2735218851 shutdown_connections 2024-05-09T09:47:36.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.687+0000 7f403f9be980 1 -- 172.21.15.157:0/2735218851 wait complete. 2024-05-09T09:47:36.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.687+0000 7f403f9be980 1 Processor -- start 2024-05-09T09:47:36.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.687+0000 7f403f9be980 1 -- start start 2024-05-09T09:47:36.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.687+0000 7f403f9be980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1c2d1e0 0x55d7a1c34530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.687+0000 7f403f9be980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d7a1c2e2a0 con 0x55d7a1c2d1e0 2024-05-09T09:47:36.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.691+0000 7f403d4d9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1c2d1e0 0x55d7a1c34530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.691+0000 7f403d4d9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1c2d1e0 0x55d7a1c34530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58354/0 (socket says 172.21.15.157:58354) 2024-05-09T09:47:36.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.691+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 learned_addr learned my addr 172.21.15.157:0/4237949788 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:36.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.691+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7a1c34a70 con 0x55d7a1c2d1e0 2024-05-09T09:47:36.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.691+0000 7f403d4d9640 1 --2- 172.21.15.157:0/4237949788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1c2d1e0 0x55d7a1c34530 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4038034040 tx=0x7f4038012e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.691+0000 7f3f19ffb640 1 -- 172.21.15.157:0/4237949788 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f403806c070 con 0x55d7a1c2d1e0 2024-05-09T09:47:36.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.691+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7a1c34a70 con 0x55d7a1c2d1e0 2024-05-09T09:47:36.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.691+0000 7f3f19ffb640 1 -- 172.21.15.157:0/4237949788 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40380116e0 con 0x55d7a1c2d1e0 2024-05-09T09:47:36.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.691+0000 7f3f19ffb640 1 -- 172.21.15.157:0/4237949788 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4038058050 con 0x55d7a1c2d1e0 2024-05-09T09:47:36.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.691+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7a1c34ef0 con 0x55d7a1c2d1e0 2024-05-09T09:47:36.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.691+0000 7f3f19ffb640 1 -- 172.21.15.157:0/4237949788 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f403806f070 con 0x55d7a1c2d1e0 2024-05-09T09:47:36.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.691+0000 7f3f19ffb640 1 --2- 172.21.15.157:0/4237949788 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3f0c034b10 0x7f3f0c036fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.691+0000 7f3f19ffb640 1 -- 172.21.15.157:0/4237949788 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f4038063030 con 0x55d7a1c2d1e0 2024-05-09T09:47:36.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.691+0000 7f403ccd8640 1 --2- 172.21.15.157:0/4237949788 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3f0c034b10 0x7f3f0c036fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.691+0000 7f403f9be980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.691+0000 7f403f9be980 1 --2- 172.21.15.157:0/4237949788 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d7a1c40f10 0x55d7a1c433d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.691+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c43b20 con 0x55d7a1c40f10 2024-05-09T09:47:36.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.691+0000 7f403dcda640 1 --2- 172.21.15.157:0/4237949788 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d7a1c40f10 0x55d7a1c433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.691+0000 7f403ccd8640 1 --2- 172.21.15.157:0/4237949788 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3f0c034b10 0x7f3f0c036fd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f403401b2c0 tx=0x7f40340a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.691+0000 7f403dcda640 1 --2- 172.21.15.157:0/4237949788 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d7a1c40f10 0x55d7a1c433d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40300083f0 con 0x55d7a1c40f10 2024-05-09T09:47:36.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403f9be980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:36.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403f9be980 20 realm 2024-05-09T09:47:36.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403f9be980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c43f30 con 0x55d7a1c40f10 2024-05-09T09:47:36.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40300083f0 con 0x55d7a1c40f10 2024-05-09T09:47:36.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403f9be980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:36.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403f9be980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:36.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403f9be980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c44800 con 0x55d7a1c40f10 2024-05-09T09:47:36.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40300083f0 con 0x55d7a1c40f10 2024-05-09T09:47:36.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403f9be980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:36.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403f9be980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c44ba0 con 0x55d7a1c40f10 2024-05-09T09:47:36.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f40300083f0 con 0x55d7a1c40f10 2024-05-09T09:47:36.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403f9be980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:36.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403f9be980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403f9be980 1 --2- 172.21.15.157:0/4237949788 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d7a1c45900 0x55d7a1c47cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c48300 con 0x55d7a1c45900 2024-05-09T09:47:36.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403d4d9640 1 --2- 172.21.15.157:0/4237949788 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d7a1c45900 0x55d7a1c47cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403d4d9640 1 --2- 172.21.15.157:0/4237949788 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d7a1c45900 0x55d7a1c47cf0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f403806e030 con 0x55d7a1c45900 2024-05-09T09:47:36.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403f9be980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:36.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403f9be980 20 searching for the correct realm 2024-05-09T09:47:36.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403f9be980 1 --2- 172.21.15.157:0/4237949788 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d7a1c4a250 0x55d7a1c4c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c4cd30 con 0x55d7a1c4a250 2024-05-09T09:47:36.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403ccd8640 1 --2- 172.21.15.157:0/4237949788 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d7a1c4a250 0x55d7a1c4c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403ccd8640 1 --2- 172.21.15.157:0/4237949788 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d7a1c4a250 0x55d7a1c4c660 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40340d9070 con 0x55d7a1c4a250 2024-05-09T09:47:36.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.695+0000 7f403ccd8640 1 --2- 172.21.15.157:0/4237949788 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f40340ce040 0x7f40340db410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.699+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c4cd30 con 0x7f40340ce040 2024-05-09T09:47:36.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.699+0000 7f403dcda640 1 --2- 172.21.15.157:0/4237949788 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f40340ce040 0x7f40340db410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.699+0000 7f403dcda640 1 --2- 172.21.15.157:0/4237949788 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f40340ce040 0x7f40340db410 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.699+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40300083f0 con 0x7f40340ce040 2024-05-09T09:47:36.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.699+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c44ba0 con 0x55d7a1c45900 2024-05-09T09:47:36.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.699+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f403806e030 con 0x55d7a1c45900 2024-05-09T09:47:36.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.699+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c44ba0 con 0x55d7a1c40f10 2024-05-09T09:47:36.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.699+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40300083f0 con 0x55d7a1c40f10 2024-05-09T09:47:36.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.699+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c44ba0 con 0x55d7a1c40f10 2024-05-09T09:47:36.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.699+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4030026040 con 0x55d7a1c40f10 2024-05-09T09:47:36.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.699+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c44ba0 con 0x55d7a1c45900 2024-05-09T09:47:36.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.699+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f403806e030 con 0x55d7a1c45900 2024-05-09T09:47:36.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.699+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c44ba0 con 0x55d7a1c45900 2024-05-09T09:47:36.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.699+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f403806e030 con 0x55d7a1c45900 2024-05-09T09:47:36.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.699+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c44ba0 con 0x7f40340ce040 2024-05-09T09:47:36.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.699+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4030026040 con 0x7f40340ce040 2024-05-09T09:47:36.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.699+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c44ba0 con 0x55d7a1c4a250 2024-05-09T09:47:36.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.703+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40340d9070 con 0x55d7a1c4a250 2024-05-09T09:47:36.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.703+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c44ba0 con 0x55d7a1c40f10 2024-05-09T09:47:36.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.703+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4030026040 con 0x55d7a1c40f10 2024-05-09T09:47:36.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.703+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c44ba0 con 0x55d7a1c45900 2024-05-09T09:47:36.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.703+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f403806e030 con 0x55d7a1c45900 2024-05-09T09:47:36.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.703+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c44ba0 con 0x55d7a1c40f10 2024-05-09T09:47:36.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.703+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4030026040 con 0x55d7a1c40f10 2024-05-09T09:47:36.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.703+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c44ba0 con 0x7f40340ce040 2024-05-09T09:47:36.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.703+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4030026040 con 0x7f40340ce040 2024-05-09T09:47:36.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.703+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c44ba0 con 0x55d7a1c4a250 2024-05-09T09:47:36.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.703+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40340d9070 con 0x55d7a1c4a250 2024-05-09T09:47:36.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.703+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f40340e8040 con 0x55d7a1c4a250 2024-05-09T09:47:36.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.703+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f40340d9070 con 0x55d7a1c4a250 2024-05-09T09:47:36.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.703+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f40340e8040 con 0x55d7a1c45900 2024-05-09T09:47:36.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.703+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f403806e030 con 0x55d7a1c45900 2024-05-09T09:47:36.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.703+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f40340e8040 con 0x55d7a1c4a250 2024-05-09T09:47:36.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.703+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40340d9070 con 0x55d7a1c4a250 2024-05-09T09:47:36.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.703+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f40340e8040 con 0x55d7a1c4a250 2024-05-09T09:47:36.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.703+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40340d9070 con 0x55d7a1c4a250 2024-05-09T09:47:36.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.703+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f40340e8040 con 0x55d7a1c40f10 2024-05-09T09:47:36.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.707+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4030026040 con 0x55d7a1c40f10 2024-05-09T09:47:36.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.707+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f40340e8040 con 0x55d7a1c40f10 2024-05-09T09:47:36.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.707+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4030026040 con 0x55d7a1c40f10 2024-05-09T09:47:36.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.707+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f40340e8040 con 0x55d7a1c45900 2024-05-09T09:47:36.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.707+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f403806e030 con 0x55d7a1c45900 2024-05-09T09:47:36.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.707+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f40340e8040 con 0x55d7a1c4a250 2024-05-09T09:47:36.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.707+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40340d9070 con 0x55d7a1c4a250 2024-05-09T09:47:36.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.707+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f40340e8040 con 0x7f40340ce040 2024-05-09T09:47:36.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.707+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4030026040 con 0x7f40340ce040 2024-05-09T09:47:36.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.707+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f40340e8040 con 0x55d7a1c40f10 2024-05-09T09:47:36.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.707+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4030026040 con 0x55d7a1c40f10 2024-05-09T09:47:36.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.707+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f40340e8040 con 0x55d7a1c45900 2024-05-09T09:47:36.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.707+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f403806e030 con 0x55d7a1c45900 2024-05-09T09:47:36.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.707+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f40340e8040 con 0x55d7a1c4a250 2024-05-09T09:47:36.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.707+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40340d9070 con 0x55d7a1c4a250 2024-05-09T09:47:36.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.707+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f40340e8040 con 0x55d7a1c45900 2024-05-09T09:47:36.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f403806e030 con 0x55d7a1c45900 2024-05-09T09:47:36.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f40340e8040 con 0x7f40340ce040 2024-05-09T09:47:36.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4030026040 con 0x7f40340ce040 2024-05-09T09:47:36.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f40340e8040 con 0x55d7a1c4a250 2024-05-09T09:47:36.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40340d9070 con 0x55d7a1c4a250 2024-05-09T09:47:36.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f40340e8040 con 0x55d7a1c45900 2024-05-09T09:47:36.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f403806e030 con 0x55d7a1c45900 2024-05-09T09:47:36.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f40340e8040 con 0x55d7a1c40f10 2024-05-09T09:47:36.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4030026040 con 0x55d7a1c40f10 2024-05-09T09:47:36.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f40340e8040 con 0x7f40340ce040 2024-05-09T09:47:36.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4030026040 con 0x7f40340ce040 2024-05-09T09:47:36.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403f9be980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:36.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403f9be980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:36.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403f9be980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:36.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403f9be980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:36.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403f9be980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:36.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403f9be980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:36.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403f9be980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c48bc0 con 0x55d7a1c40f10 2024-05-09T09:47:36.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4030026040 con 0x55d7a1c40f10 2024-05-09T09:47:36.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403f9be980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:36.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403f9be980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c48bc0 con 0x55d7a1c40f10 2024-05-09T09:47:36.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4030026040 con 0x55d7a1c40f10 2024-05-09T09:47:36.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403f9be980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:36.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403f9be980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c48bc0 con 0x55d7a1c4a250 2024-05-09T09:47:36.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f40340d9070 con 0x55d7a1c4a250 2024-05-09T09:47:36.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403f9be980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:36.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403f9be980 20 zone default found 2024-05-09T09:47:36.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403f9be980 4 Realm: () 2024-05-09T09:47:36.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403f9be980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:36.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403f9be980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:36.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403f9be980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:36.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403f9be980 20 zonegroup default 2024-05-09T09:47:36.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403f9be980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.711+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c49530 con 0x55d7a1c45900 2024-05-09T09:47:36.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.715+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f403806e030 con 0x55d7a1c45900 2024-05-09T09:47:36.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.715+0000 7f403f9be980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:36.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.715+0000 7f403f9be980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.715+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c4ebf0 con 0x55d7a1c4a250 2024-05-09T09:47:36.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.715+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40340d9070 con 0x55d7a1c4a250 2024-05-09T09:47:36.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.715+0000 7f403f9be980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:36.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.715+0000 7f403f9be980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.715+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c4f050 con 0x55d7a1c4a250 2024-05-09T09:47:36.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.715+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40340d9070 con 0x55d7a1c4a250 2024-05-09T09:47:36.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.715+0000 7f403f9be980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:36.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.715+0000 7f403f9be980 20 started sync module instance, tier type = 2024-05-09T09:47:36.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.715+0000 7f403f9be980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:36.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.715+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c4e030 con 0x7f40340ce040 2024-05-09T09:47:36.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.715+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4030026040 con 0x7f40340ce040 2024-05-09T09:47:36.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.715+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94384620365104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c4e030 con 0x7f40340ce040 2024-05-09T09:47:36.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.715+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c4fb20 con 0x55d7a1c40f10 2024-05-09T09:47:36.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.715+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94384620365104] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4030036040 con 0x7f40340ce040 2024-05-09T09:47:36.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.719+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4030036040 con 0x55d7a1c40f10 2024-05-09T09:47:36.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.719+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94384620369456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c4e030 con 0x55d7a1c40f10 2024-05-09T09:47:36.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.719+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c50560 con 0x55d7a1c4a250 2024-05-09T09:47:36.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.719+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94384620369456] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4030036040 con 0x55d7a1c40f10 2024-05-09T09:47:36.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.719+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40340d9070 con 0x55d7a1c4a250 2024-05-09T09:47:36.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.719+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94384620362624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c4dfa0 con 0x55d7a1c4a250 2024-05-09T09:47:36.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.719+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c512a0 con 0x7f40340ce040 2024-05-09T09:47:36.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.723+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4030036040 con 0x7f40340ce040 2024-05-09T09:47:36.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.723+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94384620375472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c511d0 con 0x7f40340ce040 2024-05-09T09:47:36.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.723+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c521d0 con 0x55d7a1c40f10 2024-05-09T09:47:36.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.723+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94384620362624] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40340d9070 con 0x55d7a1c4a250 2024-05-09T09:47:36.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.723+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94384620375472] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4030036040 con 0x7f40340ce040 2024-05-09T09:47:36.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.723+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4030036040 con 0x55d7a1c40f10 2024-05-09T09:47:36.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.723+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94384620374272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c51ce0 con 0x55d7a1c40f10 2024-05-09T09:47:36.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.723+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c52a70 con 0x55d7a1c45900 2024-05-09T09:47:36.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.727+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f403806e030 con 0x55d7a1c45900 2024-05-09T09:47:36.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.727+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94384620381632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c51ce0 con 0x55d7a1c45900 2024-05-09T09:47:36.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.727+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c537d0 con 0x55d7a1c45900 2024-05-09T09:47:36.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.727+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94384620374272] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4030036040 con 0x55d7a1c40f10 2024-05-09T09:47:36.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.727+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94384620381632] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f403806e030 con 0x55d7a1c45900 2024-05-09T09:47:36.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.727+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f403806e030 con 0x55d7a1c45900 2024-05-09T09:47:36.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.727+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94384620383760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c53bc0 con 0x55d7a1c45900 2024-05-09T09:47:36.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.727+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c54410 con 0x55d7a1c45900 2024-05-09T09:47:36.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.731+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f403806e030 con 0x55d7a1c45900 2024-05-09T09:47:36.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.731+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94384620387744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c547f0 con 0x55d7a1c45900 2024-05-09T09:47:36.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.731+0000 7f403f9be980 20 add_watcher() i=0 2024-05-09T09:47:36.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.731+0000 7f403f9be980 20 add_watcher() i=1 2024-05-09T09:47:36.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.731+0000 7f403f9be980 20 add_watcher() i=2 2024-05-09T09:47:36.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.731+0000 7f403f9be980 20 add_watcher() i=3 2024-05-09T09:47:36.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.731+0000 7f403f9be980 20 add_watcher() i=4 2024-05-09T09:47:36.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.731+0000 7f403f9be980 20 add_watcher() i=5 2024-05-09T09:47:36.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.731+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94384620383760] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f403806e030 con 0x55d7a1c45900 2024-05-09T09:47:36.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.731+0000 7f403f9be980 20 add_watcher() i=6 2024-05-09T09:47:36.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.731+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94384620387744] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f403806e030 con 0x55d7a1c45900 2024-05-09T09:47:36.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.731+0000 7f403f9be980 20 add_watcher() i=7 2024-05-09T09:47:36.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.731+0000 7f403f9be980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:36.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.731+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c53230 con 0x55d7a1c40f10 2024-05-09T09:47:36.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.731+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4030036040 con 0x55d7a1c40f10 2024-05-09T09:47:36.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.731+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94384620384816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c54d70 con 0x55d7a1c40f10 2024-05-09T09:47:36.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.735+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94384620384816] v30'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4030036040 con 0x55d7a1c40f10 2024-05-09T09:47:36.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.735+0000 7f3ef27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:36.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.735+0000 7f403f9be980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:36.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.735+0000 7f403f9be980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:36.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.735+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c60150 con 0x55d7a1c40f10 2024-05-09T09:47:36.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.735+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'41 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4030036040 con 0x55d7a1c40f10 2024-05-09T09:47:36.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.735+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c607a0 con 0x55d7a1c45900 2024-05-09T09:47:36.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.739+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'35 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f403806e030 con 0x55d7a1c45900 2024-05-09T09:47:36.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.739+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c607a0 con 0x55d7a1c4a250 2024-05-09T09:47:36.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.739+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'35 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f40340d9070 con 0x55d7a1c4a250 2024-05-09T09:47:36.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.739+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c60dd0 con 0x55d7a1c40f10 2024-05-09T09:47:36.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.739+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'150 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4030036040 con 0x55d7a1c40f10 2024-05-09T09:47:36.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.739+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c61280 con 0x7f40340ce040 2024-05-09T09:47:36.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.743+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'95 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4030036040 con 0x7f40340ce040 2024-05-09T09:47:36.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.743+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c61280 con 0x55d7a1c4a250 2024-05-09T09:47:36.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.743+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'63 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f40340d9070 con 0x55d7a1c4a250 2024-05-09T09:47:36.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.743+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c61a00 con 0x55d7a1c40f10 2024-05-09T09:47:36.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.743+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'37 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4030036040 con 0x55d7a1c40f10 2024-05-09T09:47:36.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.743+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c61a00 con 0x55d7a1c45900 2024-05-09T09:47:36.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.747+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'63 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f403806e030 con 0x55d7a1c45900 2024-05-09T09:47:36.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.747+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c61af0 con 0x7f40340ce040 2024-05-09T09:47:36.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.751+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'35 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4030036040 con 0x7f40340ce040 2024-05-09T09:47:36.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.751+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c61f90 con 0x55d7a1c4a250 2024-05-09T09:47:36.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.751+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'41 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f40340d9070 con 0x55d7a1c4a250 2024-05-09T09:47:36.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.751+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c62020 con 0x7f40340ce040 2024-05-09T09:47:36.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.751+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'96 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4030036040 con 0x7f40340ce040 2024-05-09T09:47:36.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.751+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c62020 con 0x55d7a1c45900 2024-05-09T09:47:36.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.755+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'37 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f403806e030 con 0x55d7a1c45900 2024-05-09T09:47:36.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.755+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c62150 con 0x7f40340ce040 2024-05-09T09:47:36.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.755+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'35 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4030036040 con 0x7f40340ce040 2024-05-09T09:47:36.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.755+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c62150 con 0x55d7a1c45900 2024-05-09T09:47:36.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.759+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'69 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f403806e030 con 0x55d7a1c45900 2024-05-09T09:47:36.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.759+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c625d0 con 0x55d7a1c40f10 2024-05-09T09:47:36.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.759+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'151 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4030036040 con 0x55d7a1c40f10 2024-05-09T09:47:36.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.759+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c625d0 con 0x55d7a1c4a250 2024-05-09T09:47:36.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.763+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'89 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40340d9070 con 0x55d7a1c4a250 2024-05-09T09:47:36.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.763+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c625d0 con 0x7f40340ce040 2024-05-09T09:47:36.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.763+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'97 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4030036040 con 0x7f40340ce040 2024-05-09T09:47:36.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.763+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c625d0 con 0x55d7a1c4a250 2024-05-09T09:47:36.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.767+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'35 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40340d9070 con 0x55d7a1c4a250 2024-05-09T09:47:36.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.767+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c625d0 con 0x55d7a1c40f10 2024-05-09T09:47:36.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.767+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'43 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4030036040 con 0x55d7a1c40f10 2024-05-09T09:47:36.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.767+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c625d0 con 0x55d7a1c40f10 2024-05-09T09:47:36.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.767+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'152 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4030036040 con 0x55d7a1c40f10 2024-05-09T09:47:36.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.767+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c625d0 con 0x55d7a1c4a250 2024-05-09T09:47:36.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.771+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'90 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40340d9070 con 0x55d7a1c4a250 2024-05-09T09:47:36.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.771+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c625d0 con 0x7f40340ce040 2024-05-09T09:47:36.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.771+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'45 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4030036040 con 0x7f40340ce040 2024-05-09T09:47:36.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.771+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c625d0 con 0x55d7a1c4a250 2024-05-09T09:47:36.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.775+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'37 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40340d9070 con 0x55d7a1c4a250 2024-05-09T09:47:36.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.775+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c625d0 con 0x55d7a1c4a250 2024-05-09T09:47:36.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.775+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'41 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40340d9070 con 0x55d7a1c4a250 2024-05-09T09:47:36.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.775+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c625d0 con 0x55d7a1c4a250 2024-05-09T09:47:36.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.775+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'31 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40340d9070 con 0x55d7a1c4a250 2024-05-09T09:47:36.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.775+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c625d0 con 0x55d7a1c4a250 2024-05-09T09:47:36.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.775+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'64 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40340d9070 con 0x55d7a1c4a250 2024-05-09T09:47:36.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.775+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c625d0 con 0x55d7a1c45900 2024-05-09T09:47:36.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.779+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'37 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f403806e030 con 0x55d7a1c45900 2024-05-09T09:47:36.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.779+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c625d0 con 0x55d7a1c4a250 2024-05-09T09:47:36.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.779+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'35 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40340d9070 con 0x55d7a1c4a250 2024-05-09T09:47:36.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.779+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c625d0 con 0x55d7a1c45900 2024-05-09T09:47:36.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.783+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'64 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f403806e030 con 0x55d7a1c45900 2024-05-09T09:47:36.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.783+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c625d0 con 0x55d7a1c4a250 2024-05-09T09:47:36.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.787+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'91 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f40340d9070 con 0x55d7a1c4a250 2024-05-09T09:47:36.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.787+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c625d0 con 0x55d7a1c45900 2024-05-09T09:47:36.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.787+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'70 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f403806e030 con 0x55d7a1c45900 2024-05-09T09:47:36.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.787+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c625d0 con 0x7f40340ce040 2024-05-09T09:47:36.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.791+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'41 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4030036040 con 0x7f40340ce040 2024-05-09T09:47:36.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.791+0000 7f3ef17e2640 20 reqs_thread_entry: start 2024-05-09T09:47:36.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.791+0000 7f403f9be980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:36.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.791+0000 7f3e62ffd640 20 reqs_thread_entry: start 2024-05-09T09:47:36.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.791+0000 7f403f9be980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-09T09:47:36.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.791+0000 7f403f9be980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.791+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c7e080 con 0x55d7a1c40f10 2024-05-09T09:47:36.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.791+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f4030036040 con 0x55d7a1c40f10 2024-05-09T09:47:36.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.791+0000 7f403f9be980 20 rados_obj.operate() r=0 bl.length=556 2024-05-09T09:47:36.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.791+0000 7f403f9be980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-09T09:47:36.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.791+0000 7f403f9be980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:36.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.791+0000 7f403f9be980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:36.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.791+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c840c0 con 0x55d7a1c40f10 2024-05-09T09:47:36.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.795+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(95 foo [delete,create,call,call,writefull 0~391] v30'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f4030036040 con 0x55d7a1c40f10 2024-05-09T09:47:36.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.795+0000 7f403f9be980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:47:36.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.795+0000 7f403f9be980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:36.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.795+0000 7f403f9be980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-09T09:47:36.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.795+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 7.d 7:b4812045:::notify.4:head [notify cookie 94384620583728 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c7f770 con 0x55d7a1c40f10 2024-05-09T09:47:36.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.795+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== watch-notify(notify (1) cookie 94384620374272 notify 128849018890 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55d7a1c61590 con 0x55d7a1c40f10 2024-05-09T09:47:36.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.795+0000 7f3f1b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 94384620374272 notifier 4427 bl.length()=567 2024-05-09T09:47:36.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.795+0000 7f3f1b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:47:36.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.795+0000 7f3f1b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:36.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.795+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(96 notify.4 [notify cookie 94384620583728 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4030036040 con 0x55d7a1c40f10 2024-05-09T09:47:36.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.795+0000 7f3f1b7fe640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3f000056c0 con 0x55d7a1c40f10 2024-05-09T09:47:36.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.795+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(97 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4030036040 con 0x55d7a1c40f10 2024-05-09T09:47:36.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.795+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== watch-notify(notify_complete (2) cookie 94384620583728 notify 128849018890 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d7a1c5fb10 con 0x55d7a1c40f10 2024-05-09T09:47:36.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.795+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:98 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c83b30 con 0x7f40340ce040 2024-05-09T09:47:36.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.799+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(98 foo:foo2 [delete] v30'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4030036040 con 0x7f40340ce040 2024-05-09T09:47:36.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.799+0000 7f403f9be980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-05-09T09:47:36.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.799+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94384620583728 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c7e5e0 con 0x7f40340ce040 2024-05-09T09:47:36.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.799+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== watch-notify(notify (1) cookie 94384620365104 notify 128849018885 ret 0) ==== 201+0+0 (crc 0 0 0) 0x55d7a1c5fb10 con 0x7f40340ce040 2024-05-09T09:47:36.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.799+0000 7f3f1affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94384620365104 notifier 4427 bl.length()=159 2024-05-09T09:47:36.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.799+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(99 notify.0 [notify cookie 94384620583728 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4030036040 con 0x7f40340ce040 2024-05-09T09:47:36.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.799+0000 7f3f1affd640 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:100 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3e70003930 con 0x7f40340ce040 2024-05-09T09:47:36.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.799+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(100 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4030036040 con 0x7f40340ce040 2024-05-09T09:47:36.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.799+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== watch-notify(notify_complete (2) cookie 94384620583728 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d7a1c60970 con 0x7f40340ce040 2024-05-09T09:47:36.797 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-09T09:47:32.044078Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:47:32.044055Z","tags":[],"group_ids":[]} 2024-05-09T09:47:36.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.799+0000 7f3ef27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:36.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.799+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94384620384816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c5cbd0 con 0x55d7a1c40f10 2024-05-09T09:47:36.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.799+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(101 data_loggenerations_metadata [watch unwatch cookie 94384620384816] v30'153 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4030036040 con 0x55d7a1c40f10 2024-05-09T09:47:36.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.799+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94384620365104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c53230 con 0x7f40340ce040 2024-05-09T09:47:36.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.803+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.2 v2:172.21.15.157:6800/354455204 23 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 94384620365104] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4030036040 con 0x7f40340ce040 2024-05-09T09:47:36.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.803+0000 7f403f9be980 20 remove_watcher() i=0 2024-05-09T09:47:36.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.803+0000 7f403f9be980 2 removed watcher, disabling cache 2024-05-09T09:47:36.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.803+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94384620369456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c4e530 con 0x55d7a1c40f10 2024-05-09T09:47:36.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.803+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 94384620369456] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4030036040 con 0x55d7a1c40f10 2024-05-09T09:47:36.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.803+0000 7f403f9be980 20 remove_watcher() i=1 2024-05-09T09:47:36.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.803+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94384620362624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c4e530 con 0x55d7a1c4a250 2024-05-09T09:47:36.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.807+0000 7f403ccd8640 1 -- 172.21.15.157:0/4237949788 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 94384620362624] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40340d9070 con 0x55d7a1c4a250 2024-05-09T09:47:36.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.807+0000 7f403f9be980 20 remove_watcher() i=2 2024-05-09T09:47:36.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.807+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94384620375472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c4db80 con 0x7f40340ce040 2024-05-09T09:47:36.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.807+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.2 v2:172.21.15.157:6800/354455204 24 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 94384620375472] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4030036040 con 0x7f40340ce040 2024-05-09T09:47:36.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.807+0000 7f403f9be980 20 remove_watcher() i=3 2024-05-09T09:47:36.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.807+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94384620374272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c4e530 con 0x55d7a1c40f10 2024-05-09T09:47:36.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.811+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 94384620374272] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4030036040 con 0x55d7a1c40f10 2024-05-09T09:47:36.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.811+0000 7f403f9be980 20 remove_watcher() i=4 2024-05-09T09:47:36.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.811+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94384620381632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c50db0 con 0x55d7a1c45900 2024-05-09T09:47:36.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.811+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 94384620381632] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f403806e030 con 0x55d7a1c45900 2024-05-09T09:47:36.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.811+0000 7f403f9be980 20 remove_watcher() i=5 2024-05-09T09:47:36.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.811+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94384620383760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c4db80 con 0x55d7a1c45900 2024-05-09T09:47:36.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 94384620383760] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f403806e030 con 0x55d7a1c45900 2024-05-09T09:47:36.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 20 remove_watcher() i=6 2024-05-09T09:47:36.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94384620387744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7a1c4e530 con 0x55d7a1c45900 2024-05-09T09:47:36.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403d4d9640 1 -- 172.21.15.157:0/4237949788 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 94384620387744] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f403806e030 con 0x55d7a1c45900 2024-05-09T09:47:36.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 20 remove_watcher() i=7 2024-05-09T09:47:36.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d7a1c45900 msgr2=0x55d7a1c47cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 1 --2- 172.21.15.157:0/4237949788 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d7a1c45900 0x55d7a1c47cf0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d7a1c40f10 msgr2=0x55d7a1c433d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 1 --2- 172.21.15.157:0/4237949788 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d7a1c40f10 0x55d7a1c433d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f40340ce040 msgr2=0x7f40340db410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 1 --2- 172.21.15.157:0/4237949788 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f40340ce040 0x7f40340db410 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d7a1c4a250 msgr2=0x55d7a1c4c660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 1 --2- 172.21.15.157:0/4237949788 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d7a1c4a250 0x55d7a1c4c660 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3f0c034b10 msgr2=0x7f3f0c036fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 1 --2- 172.21.15.157:0/4237949788 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3f0c034b10 0x7f3f0c036fd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f403401b2c0 tx=0x7f40340a6000 comp rx=0 tx=0).stop 2024-05-09T09:47:36.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1c2d1e0 msgr2=0x55d7a1c34530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403dcda640 1 -- 172.21.15.157:0/4237949788 reap_dead start 2024-05-09T09:47:36.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 1 --2- 172.21.15.157:0/4237949788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1c2d1e0 0x55d7a1c34530 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4038034040 tx=0x7f4038012e80 comp rx=0 tx=0).stop 2024-05-09T09:47:36.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 shutdown_connections 2024-05-09T09:47:36.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 1 --2- 172.21.15.157:0/4237949788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1c2d1e0 0x55d7a1c34530 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 >> 172.21.15.157:0/4237949788 conn(0x55d7a1c29560 msgr2=0x55d7a1c2ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:36.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 shutdown_connections 2024-05-09T09:47:36.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 1 -- 172.21.15.157:0/4237949788 wait complete. 2024-05-09T09:47:36.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 1 -- 172.21.15.157:0/2077497947 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3f14034bb0 msgr2=0x7f3f14037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 1 --2- 172.21.15.157:0/2077497947 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3f14034bb0 0x7f3f14037070 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55d7a1befd40 tx=0x7f4034005a10 comp rx=0 tx=0).stop 2024-05-09T09:47:36.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 1 -- 172.21.15.157:0/2077497947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1c20220 msgr2=0x55d7a1c20640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 1 --2- 172.21.15.157:0/2077497947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1c20220 0x55d7a1c20640 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4038047ad0 tx=0x7f4038047f80 comp rx=0 tx=0).stop 2024-05-09T09:47:36.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 1 -- 172.21.15.157:0/2077497947 shutdown_connections 2024-05-09T09:47:36.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 1 --2- 172.21.15.157:0/2077497947 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3f14034bb0 0x7f3f14037070 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 1 --2- 172.21.15.157:0/2077497947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1c20220 0x55d7a1c20640 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 1 -- 172.21.15.157:0/2077497947 >> 172.21.15.157:0/2077497947 conn(0x55d7a1bdfb80 msgr2=0x55d7a1bdff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:36.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 1 -- 172.21.15.157:0/2077497947 shutdown_connections 2024-05-09T09:47:36.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.815+0000 7f403f9be980 1 -- 172.21.15.157:0/2077497947 wait complete. 2024-05-09T09:47:36.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.819+0000 7f403f9be980 1 -- 172.21.15.157:0/1116441132 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d7a1bf1790 msgr2=0x55d7a1bf3b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.819+0000 7f403f9be980 1 --2- 172.21.15.157:0/1116441132 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d7a1bf1790 0x55d7a1bf3b80 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.819+0000 7f403f9be980 1 -- 172.21.15.157:0/1116441132 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d7a1af8d00 msgr2=0x55d7a1beeeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.819+0000 7f403f9be980 1 --2- 172.21.15.157:0/1116441132 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d7a1af8d00 0x55d7a1beeeb0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.819+0000 7f403f9be980 1 -- 172.21.15.157:0/1116441132 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d7a1bf56b0 msgr2=0x55d7a1bf7aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.819+0000 7f403f9be980 1 --2- 172.21.15.157:0/1116441132 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d7a1bf56b0 0x55d7a1bf7aa0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.819+0000 7f403f9be980 1 -- 172.21.15.157:0/1116441132 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3f24034c00 msgr2=0x7f3f240370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.819+0000 7f403f9be980 1 --2- 172.21.15.157:0/1116441132 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3f24034c00 0x7f3f240370c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f40340ad000 tx=0x7f40340a5040 comp rx=0 tx=0).stop 2024-05-09T09:47:36.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.819+0000 7f403f9be980 1 -- 172.21.15.157:0/1116441132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1af47a0 msgr2=0x55d7a1be7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.819+0000 7f403f9be980 1 --2- 172.21.15.157:0/1116441132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d7a1af47a0 0x55d7a1be7e00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4038014040 tx=0x7f4038001260 comp rx=0 tx=0).stop 2024-05-09T09:47:36.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.819+0000 7f403dcda640 1 -- 172.21.15.157:0/1116441132 reap_dead start 2024-05-09T09:47:36.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.819+0000 7f403f9be980 1 -- 172.21.15.157:0/1116441132 shutdown_connections 2024-05-09T09:47:36.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.819+0000 7f403f9be980 1 -- 172.21.15.157:0/1116441132 >> 172.21.15.157:0/1116441132 conn(0x55d7a1af0070 msgr2=0x55d7a1bda0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:36.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.819+0000 7f403f9be980 1 -- 172.21.15.157:0/1116441132 shutdown_connections 2024-05-09T09:47:36.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.819+0000 7f403f9be980 1 -- 172.21.15.157:0/1116441132 wait complete. 2024-05-09T09:47:36.828 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-09T09:47:32.044078Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:47:32.044055Z', 'tags': [], 'group_ids': []} 2024-05-09T09:47:36.828 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-05-09T09:47:36.828 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-05-09T09:47:36.829 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-05-09T09:47:36.907 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:36.907 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:36.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.911+0000 7feb963f1980 1 Processor -- start 2024-05-09T09:47:36.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.911+0000 7feb963f1980 1 -- start start 2024-05-09T09:47:36.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.911+0000 7feb963f1980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55b89a300030 0x55b89a302420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.911+0000 7feb963f1980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b89a1af440 con 0x55b89a2fbb30 2024-05-09T09:47:36.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.911+0000 7feb963f1980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55b89a19a5f0 con 0x55b89a300030 2024-05-09T09:47:36.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.911+0000 7feb9370b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55b89a300030 0x55b89a302420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.911+0000 7feb9370b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55b89a300030 0x55b89a302420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58370/0 (socket says 172.21.15.157:58370) 2024-05-09T09:47:36.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.911+0000 7feb9370b640 1 -- 172.21.15.157:0/416638046 learned_addr learned my addr 172.21.15.157:0/416638046 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:36.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.911+0000 7feb9370b640 1 -- 172.21.15.157:0/416638046 >> v1:172.21.15.110:6789/0 conn(0x55b89a2fbb30 legacy=0x55b89a2fbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.911+0000 7feb9370b640 1 -- 172.21.15.157:0/416638046 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b89a1a5990 con 0x55b89a300030 2024-05-09T09:47:36.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.915+0000 7feb9370b640 1 --2- 172.21.15.157:0/416638046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a300030 0x55b89a302420 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7feb8800a5c0 tx=0x7feb8801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a731fd4ae919fc4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.915+0000 7feb92f0a640 1 -- 172.21.15.157:0/416638046 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb880a6070 con 0x55b89a300030 2024-05-09T09:47:36.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.915+0000 7feb92f0a640 1 -- 172.21.15.157:0/416638046 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb880af070 con 0x55b89a300030 2024-05-09T09:47:36.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.915+0000 7feb92f0a640 1 -- 172.21.15.157:0/416638046 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb880aa5c0 con 0x55b89a300030 2024-05-09T09:47:36.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.915+0000 7feb963f1980 1 -- 172.21.15.157:0/416638046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a300030 msgr2=0x55b89a302420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.915+0000 7feb963f1980 1 --2- 172.21.15.157:0/416638046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a300030 0x55b89a302420 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7feb8800a5c0 tx=0x7feb8801b340 comp rx=0 tx=0).stop 2024-05-09T09:47:36.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.915+0000 7feb963f1980 1 -- 172.21.15.157:0/416638046 shutdown_connections 2024-05-09T09:47:36.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.915+0000 7feb963f1980 1 --2- 172.21.15.157:0/416638046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a300030 0x55b89a302420 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.915+0000 7feb963f1980 1 -- 172.21.15.157:0/416638046 >> 172.21.15.157:0/416638046 conn(0x55b89a26f250 msgr2=0x55b89a26f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:36.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.915+0000 7feb963f1980 1 -- 172.21.15.157:0/416638046 shutdown_connections 2024-05-09T09:47:36.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.915+0000 7feb963f1980 1 -- 172.21.15.157:0/416638046 wait complete. 2024-05-09T09:47:36.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.931+0000 7feb963f1980 1 Processor -- start 2024-05-09T09:47:36.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.931+0000 7feb963f1980 1 -- start start 2024-05-09T09:47:36.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.931+0000 7feb963f1980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a2fbb30 0x55b89a3e6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.931+0000 7feb963f1980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b89a1fcfe0 con 0x55b89a2fbb30 2024-05-09T09:47:36.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.931+0000 7feb93f0c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a2fbb30 0x55b89a3e6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.931+0000 7feb93f0c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a2fbb30 0x55b89a3e6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58384/0 (socket says 172.21.15.157:58384) 2024-05-09T09:47:36.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.931+0000 7feb93f0c640 1 -- 172.21.15.157:0/1667984308 learned_addr learned my addr 172.21.15.157:0/1667984308 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:36.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.931+0000 7feb93f0c640 1 -- 172.21.15.157:0/1667984308 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b89a181ae0 con 0x55b89a2fbb30 2024-05-09T09:47:36.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.931+0000 7feb93f0c640 1 --2- 172.21.15.157:0/1667984308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a2fbb30 0x55b89a3e6d30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7feb840016c0 tx=0x7feb84001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64192f435278a149 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.931+0000 7fea81e0b640 1 -- 172.21.15.157:0/1667984308 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb84016070 con 0x55b89a2fbb30 2024-05-09T09:47:36.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.935+0000 7fea81e0b640 1 -- 172.21.15.157:0/1667984308 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb8400f640 con 0x55b89a2fbb30 2024-05-09T09:47:36.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.935+0000 7fea81e0b640 1 -- 172.21.15.157:0/1667984308 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb8400f9a0 con 0x55b89a2fbb30 2024-05-09T09:47:36.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.935+0000 7feb963f1980 1 -- 172.21.15.157:0/1667984308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a2fbb30 msgr2=0x55b89a3e6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.935+0000 7feb963f1980 1 --2- 172.21.15.157:0/1667984308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a2fbb30 0x55b89a3e6d30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7feb840016c0 tx=0x7feb84001b80 comp rx=0 tx=0).stop 2024-05-09T09:47:36.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.935+0000 7feb963f1980 1 -- 172.21.15.157:0/1667984308 shutdown_connections 2024-05-09T09:47:36.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.935+0000 7feb963f1980 1 --2- 172.21.15.157:0/1667984308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a2fbb30 0x55b89a3e6d30 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.935+0000 7feb963f1980 1 -- 172.21.15.157:0/1667984308 >> 172.21.15.157:0/1667984308 conn(0x55b89a26f250 msgr2=0x55b89a3e28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:36.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.935+0000 7feb963f1980 1 -- 172.21.15.157:0/1667984308 shutdown_connections 2024-05-09T09:47:36.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.935+0000 7feb963f1980 1 -- 172.21.15.157:0/1667984308 wait complete. 2024-05-09T09:47:36.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.935+0000 7feb963f1980 1 Processor -- start 2024-05-09T09:47:36.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.935+0000 7feb963f1980 1 -- start start 2024-05-09T09:47:36.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.935+0000 7feb963f1980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a2fbb30 0x55b89a3edf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.935+0000 7feb963f1980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b89a305450 con 0x55b89a2fbb30 2024-05-09T09:47:36.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.935+0000 7feb93f0c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a2fbb30 0x55b89a3edf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.935+0000 7feb93f0c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a2fbb30 0x55b89a3edf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58390/0 (socket says 172.21.15.157:58390) 2024-05-09T09:47:36.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.935+0000 7feb93f0c640 1 -- 172.21.15.157:0/2043092107 learned_addr learned my addr 172.21.15.157:0/2043092107 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:36.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.935+0000 7feb93f0c640 1 -- 172.21.15.157:0/2043092107 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b89a3ee440 con 0x55b89a2fbb30 2024-05-09T09:47:36.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.935+0000 7feb93f0c640 1 --2- 172.21.15.157:0/2043092107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a2fbb30 0x55b89a3edf00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7feb8400f610 tx=0x7feb84001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.935+0000 7fea7bfff640 1 -- 172.21.15.157:0/2043092107 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb84016040 con 0x55b89a2fbb30 2024-05-09T09:47:36.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.935+0000 7feb963f1980 1 -- 172.21.15.157:0/2043092107 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b89a3ee6d0 con 0x55b89a2fbb30 2024-05-09T09:47:36.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.935+0000 7fea7bfff640 1 -- 172.21.15.157:0/2043092107 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb84006030 con 0x55b89a2fbb30 2024-05-09T09:47:36.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.935+0000 7fea7bfff640 1 -- 172.21.15.157:0/2043092107 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb840117c0 con 0x55b89a2fbb30 2024-05-09T09:47:36.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.935+0000 7feb963f1980 1 -- 172.21.15.157:0/2043092107 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b89a3f13b0 con 0x55b89a2fbb30 2024-05-09T09:47:36.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.939+0000 7fea7bfff640 1 -- 172.21.15.157:0/2043092107 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7feb84011a70 con 0x55b89a2fbb30 2024-05-09T09:47:36.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.939+0000 7fea7bfff640 1 --2- 172.21.15.157:0/2043092107 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fea7c034bb0 0x7fea7c037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.939+0000 7fea7bfff640 1 -- 172.21.15.157:0/2043092107 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7feb8404a250 con 0x55b89a2fbb30 2024-05-09T09:47:36.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.939+0000 7feb9370b640 1 --2- 172.21.15.157:0/2043092107 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fea7c034bb0 0x7fea7c037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.939+0000 7feb963f1980 1 --2- 172.21.15.157:0/2043092107 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b89a300030 0x55b89a3f4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.939+0000 7feb963f1980 1 -- 172.21.15.157:0/2043092107 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b89a3f5540 con 0x55b89a300030 2024-05-09T09:47:36.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.939+0000 7feb9470d640 1 --2- 172.21.15.157:0/2043092107 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b89a300030 0x55b89a3f4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.939+0000 7feb9370b640 1 --2- 172.21.15.157:0/2043092107 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fea7c034bb0 0x7fea7c037070 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feb880ae000 tx=0x7feb880a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.939+0000 7feb9470d640 1 --2- 172.21.15.157:0/2043092107 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b89a300030 0x55b89a3f4ed0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.939+0000 7feb9470d640 1 -- 172.21.15.157:0/2043092107 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb8c0083f0 con 0x55b89a300030 2024-05-09T09:47:36.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.939+0000 7feb963f1980 1 -- 172.21.15.157:0/2043092107 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b89a3f25b0 con 0x55b89a300030 2024-05-09T09:47:36.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.939+0000 7feb9470d640 1 -- 172.21.15.157:0/2043092107 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feb8c0083f0 con 0x55b89a300030 2024-05-09T09:47:36.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.939+0000 7feb963f1980 1 --2- 172.21.15.157:0/2043092107 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b89a3f7870 0x55b89a3f9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.939+0000 7feb963f1980 1 -- 172.21.15.157:0/2043092107 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b89a3fa330 con 0x55b89a3f7870 2024-05-09T09:47:36.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.939+0000 7feb93f0c640 1 --2- 172.21.15.157:0/2043092107 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b89a3f7870 0x55b89a3f9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.939+0000 7feb93f0c640 1 --2- 172.21.15.157:0/2043092107 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b89a3f7870 0x55b89a3f9c60 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.943+0000 7feb93f0c640 1 -- 172.21.15.157:0/2043092107 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7feb84023020 con 0x55b89a3f7870 2024-05-09T09:47:36.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.943+0000 7feb963f1980 1 -- 172.21.15.157:0/2043092107 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b89a3f6710 con 0x55b89a300030 2024-05-09T09:47:36.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.943+0000 7feb9470d640 1 -- 172.21.15.157:0/2043092107 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feb8c0083f0 con 0x55b89a300030 2024-05-09T09:47:36.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.943+0000 7feb963f1980 1 --2- 172.21.15.157:0/2043092107 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b89a3fb790 0x55b89a3fdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.943+0000 7feb963f1980 1 -- 172.21.15.157:0/2043092107 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b89a3fe280 con 0x55b89a3fb790 2024-05-09T09:47:36.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.943+0000 7feb9370b640 1 --2- 172.21.15.157:0/2043092107 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b89a3fb790 0x55b89a3fdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.943+0000 7feb9370b640 1 --2- 172.21.15.157:0/2043092107 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b89a3fb790 0x55b89a3fdb80 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.943+0000 7feb9370b640 1 -- 172.21.15.157:0/2043092107 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7feb880aaad0 con 0x55b89a3fb790 2024-05-09T09:47:36.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.947+0000 7feb963f1980 1 Processor -- start 2024-05-09T09:47:36.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.947+0000 7feb963f1980 1 -- start start 2024-05-09T09:47:36.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.947+0000 7feb963f1980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a424170 0x55b89a424590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.947+0000 7feb963f1980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b89a201020 con 0x55b89a424170 2024-05-09T09:47:36.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.947+0000 7feb93f0c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a424170 0x55b89a424590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.947+0000 7feb93f0c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a424170 0x55b89a424590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58406/0 (socket says 172.21.15.157:58406) 2024-05-09T09:47:36.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.947+0000 7feb93f0c640 1 -- 172.21.15.157:0/3113388444 learned_addr learned my addr 172.21.15.157:0/3113388444 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:36.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.947+0000 7feb93f0c640 1 -- 172.21.15.157:0/3113388444 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b89a424ad0 con 0x55b89a424170 2024-05-09T09:47:36.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.947+0000 7feb93f0c640 1 --2- 172.21.15.157:0/3113388444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a424170 0x55b89a424590 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7feb840486a0 tx=0x7feb84024620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.947+0000 7fea73fff640 1 -- 172.21.15.157:0/3113388444 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb84045260 con 0x55b89a424170 2024-05-09T09:47:36.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.947+0000 7fea73fff640 1 -- 172.21.15.157:0/3113388444 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb8401cab0 con 0x55b89a424170 2024-05-09T09:47:36.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.947+0000 7feb963f1980 1 -- 172.21.15.157:0/3113388444 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b89a425560 con 0x55b89a424170 2024-05-09T09:47:36.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.947+0000 7fea73fff640 1 -- 172.21.15.157:0/3113388444 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb8401cd90 con 0x55b89a424170 2024-05-09T09:47:36.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.947+0000 7feb963f1980 1 -- 172.21.15.157:0/3113388444 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b89a425560 con 0x55b89a424170 2024-05-09T09:47:36.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.951+0000 7fea73fff640 1 -- 172.21.15.157:0/3113388444 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7feb84041060 con 0x55b89a424170 2024-05-09T09:47:36.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.951+0000 7fea73fff640 1 --2- 172.21.15.157:0/3113388444 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fea6c034bb0 0x7fea6c037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.951+0000 7fea73fff640 1 -- 172.21.15.157:0/3113388444 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7feb84007000 con 0x55b89a424170 2024-05-09T09:47:36.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.951+0000 7feb9370b640 1 --2- 172.21.15.157:0/3113388444 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fea6c034bb0 0x7fea6c037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.951+0000 7feb963f1980 1 Processor -- start 2024-05-09T09:47:36.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.951+0000 7feb963f1980 1 -- start start 2024-05-09T09:47:36.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.951+0000 7feb963f1980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a430f40 0x55b89a431340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.951+0000 7feb963f1980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b89a3e7480 con 0x55b89a430f40 2024-05-09T09:47:36.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.951+0000 7feb9370b640 1 --2- 172.21.15.157:0/3113388444 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fea6c034bb0 0x7fea6c037070 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x55b89a3f5e20 tx=0x7feb88005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.951+0000 7feb93f0c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a430f40 0x55b89a431340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.951+0000 7feb93f0c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a430f40 0x55b89a431340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58422/0 (socket says 172.21.15.157:58422) 2024-05-09T09:47:36.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.951+0000 7feb93f0c640 1 -- 172.21.15.157:0/2271341723 learned_addr learned my addr 172.21.15.157:0/2271341723 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:36.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.951+0000 7feb93f0c640 1 -- 172.21.15.157:0/2271341723 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b89a431910 con 0x55b89a430f40 2024-05-09T09:47:36.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.951+0000 7feb93f0c640 1 --2- 172.21.15.157:0/2271341723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a430f40 0x55b89a431340 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7feb8403cfd0 tx=0x7feb84041350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e819200072a741db server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.951+0000 7fea71ffb640 1 -- 172.21.15.157:0/2271341723 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb8401eb10 con 0x55b89a430f40 2024-05-09T09:47:36.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.951+0000 7fea71ffb640 1 -- 172.21.15.157:0/2271341723 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb84059070 con 0x55b89a430f40 2024-05-09T09:47:36.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.951+0000 7fea71ffb640 1 -- 172.21.15.157:0/2271341723 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb84042010 con 0x55b89a430f40 2024-05-09T09:47:36.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.951+0000 7feb963f1980 1 -- 172.21.15.157:0/2271341723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a430f40 msgr2=0x55b89a431340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:36.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.951+0000 7feb963f1980 1 --2- 172.21.15.157:0/2271341723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a430f40 0x55b89a431340 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7feb8403cfd0 tx=0x7feb84041350 comp rx=0 tx=0).stop 2024-05-09T09:47:36.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.951+0000 7feb963f1980 1 -- 172.21.15.157:0/2271341723 shutdown_connections 2024-05-09T09:47:36.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.951+0000 7feb963f1980 1 --2- 172.21.15.157:0/2271341723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a430f40 0x55b89a431340 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:36.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.951+0000 7feb963f1980 1 -- 172.21.15.157:0/2271341723 >> 172.21.15.157:0/2271341723 conn(0x55b89a42d2c0 msgr2=0x55b89a42b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:36.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.951+0000 7feb963f1980 1 -- 172.21.15.157:0/2271341723 shutdown_connections 2024-05-09T09:47:36.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.951+0000 7feb963f1980 1 -- 172.21.15.157:0/2271341723 wait complete. 2024-05-09T09:47:36.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.951+0000 7feb963f1980 1 Processor -- start 2024-05-09T09:47:36.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.955+0000 7feb963f1980 1 -- start start 2024-05-09T09:47:36.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.955+0000 7feb963f1980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a430f40 0x55b89a438260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.955+0000 7feb963f1980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b89a432000 con 0x55b89a430f40 2024-05-09T09:47:36.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.955+0000 7feb93f0c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a430f40 0x55b89a438260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.955+0000 7feb93f0c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a430f40 0x55b89a438260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58438/0 (socket says 172.21.15.157:58438) 2024-05-09T09:47:36.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.955+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 learned_addr learned my addr 172.21.15.157:0/4056177816 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:36.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.955+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b89a4387a0 con 0x55b89a430f40 2024-05-09T09:47:36.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.955+0000 7feb93f0c640 1 --2- 172.21.15.157:0/4056177816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a430f40 0x55b89a438260 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7feb84025bd0 tx=0x7feb8404cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.955+0000 7fea63fff640 1 -- 172.21.15.157:0/4056177816 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb8401c520 con 0x55b89a430f40 2024-05-09T09:47:36.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.955+0000 7fea63fff640 1 -- 172.21.15.157:0/4056177816 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb8401c6c0 con 0x55b89a430f40 2024-05-09T09:47:36.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.955+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b89a4387a0 con 0x55b89a430f40 2024-05-09T09:47:36.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.955+0000 7fea63fff640 1 -- 172.21.15.157:0/4056177816 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb8401c8b0 con 0x55b89a430f40 2024-05-09T09:47:36.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.955+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b89a4387a0 con 0x55b89a430f40 2024-05-09T09:47:36.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.955+0000 7fea63fff640 1 -- 172.21.15.157:0/4056177816 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7feb84032a80 con 0x55b89a430f40 2024-05-09T09:47:36.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.955+0000 7feb963f1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.955+0000 7fea63fff640 1 --2- 172.21.15.157:0/4056177816 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fea5c034b60 0x7fea5c037020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.955+0000 7fea63fff640 1 -- 172.21.15.157:0/4056177816 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7feb84069c90 con 0x55b89a430f40 2024-05-09T09:47:36.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.955+0000 7feb9370b640 1 --2- 172.21.15.157:0/4056177816 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fea5c034b60 0x7fea5c037020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.955+0000 7feb963f1980 1 --2- 172.21.15.157:0/4056177816 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b89a444c20 0x55b89a4470b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.955+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b89a447800 con 0x55b89a444c20 2024-05-09T09:47:36.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.955+0000 7feb9470d640 1 --2- 172.21.15.157:0/4056177816 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b89a444c20 0x55b89a4470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.955+0000 7feb9370b640 1 --2- 172.21.15.157:0/4056177816 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fea5c034b60 0x7fea5c037020 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feb8801b380 tx=0x7feb880c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.959+0000 7feb9470d640 1 --2- 172.21.15.157:0/4056177816 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b89a444c20 0x55b89a4470b0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.959+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb8c0083f0 con 0x55b89a444c20 2024-05-09T09:47:36.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.959+0000 7feb963f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:36.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.959+0000 7feb963f1980 20 realm 2024-05-09T09:47:36.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.959+0000 7feb963f1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.959+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b89a447c10 con 0x55b89a444c20 2024-05-09T09:47:36.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.959+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb8c0083f0 con 0x55b89a444c20 2024-05-09T09:47:36.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.959+0000 7feb963f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:36.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.959+0000 7feb963f1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:36.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.959+0000 7feb963f1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.959+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b89a4484b0 con 0x55b89a444c20 2024-05-09T09:47:36.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.959+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb8c0083f0 con 0x55b89a444c20 2024-05-09T09:47:36.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.959+0000 7feb963f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:36.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.959+0000 7feb963f1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.959+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x55b89a444c20 2024-05-09T09:47:36.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.959+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feb8c0083f0 con 0x55b89a444c20 2024-05-09T09:47:36.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.959+0000 7feb963f1980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:36.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.959+0000 7feb963f1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.959+0000 7feb963f1980 1 --2- 172.21.15.157:0/4056177816 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b89a4495b0 0x55b89a44b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.959+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b89a44bee0 con 0x55b89a4495b0 2024-05-09T09:47:36.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.959+0000 7feb93f0c640 1 --2- 172.21.15.157:0/4056177816 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b89a4495b0 0x55b89a44b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.959+0000 7feb93f0c640 1 --2- 172.21.15.157:0/4056177816 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b89a4495b0 0x55b89a44b9a0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.959+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7feb8406e020 con 0x55b89a4495b0 2024-05-09T09:47:36.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.959+0000 7feb963f1980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:36.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.959+0000 7feb963f1980 20 searching for the correct realm 2024-05-09T09:47:36.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.959+0000 7feb963f1980 1 --2- 172.21.15.157:0/4056177816 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b89a44de50 0x55b89a450310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.959+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a4509e0 con 0x55b89a44de50 2024-05-09T09:47:36.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.959+0000 7feb9370b640 1 --2- 172.21.15.157:0/4056177816 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b89a44de50 0x55b89a450310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.959+0000 7feb9370b640 1 --2- 172.21.15.157:0/4056177816 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b89a44de50 0x55b89a450310 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.963+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb880aaad0 con 0x55b89a44de50 2024-05-09T09:47:36.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.963+0000 7feb9370b640 1 --2- 172.21.15.157:0/4056177816 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7feb880e0040 0x7feb880e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:36.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.963+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a4509e0 con 0x7feb880e0040 2024-05-09T09:47:36.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.963+0000 7feb9470d640 1 --2- 172.21.15.157:0/4056177816 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7feb880e0040 0x7feb880e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:36.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.963+0000 7feb9470d640 1 --2- 172.21.15.157:0/4056177816 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7feb880e0040 0x7feb880e0420 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:36.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.963+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb8c0083f0 con 0x7feb880e0040 2024-05-09T09:47:36.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.963+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x55b89a4495b0 2024-05-09T09:47:36.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.963+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb8406e020 con 0x55b89a4495b0 2024-05-09T09:47:36.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.963+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x55b89a444c20 2024-05-09T09:47:36.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.963+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb8c0083f0 con 0x55b89a444c20 2024-05-09T09:47:36.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.963+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x55b89a444c20 2024-05-09T09:47:36.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.963+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb8c026040 con 0x55b89a444c20 2024-05-09T09:47:36.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.963+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x55b89a4495b0 2024-05-09T09:47:36.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.963+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb8406e020 con 0x55b89a4495b0 2024-05-09T09:47:36.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.963+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x55b89a4495b0 2024-05-09T09:47:36.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.963+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb8406e020 con 0x55b89a4495b0 2024-05-09T09:47:36.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.963+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x7feb880e0040 2024-05-09T09:47:36.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.967+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb8c026040 con 0x7feb880e0040 2024-05-09T09:47:36.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.967+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x55b89a44de50 2024-05-09T09:47:36.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.967+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb880aaad0 con 0x55b89a44de50 2024-05-09T09:47:36.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.967+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x55b89a444c20 2024-05-09T09:47:36.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.967+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb8c026040 con 0x55b89a444c20 2024-05-09T09:47:36.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.967+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x55b89a4495b0 2024-05-09T09:47:36.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.967+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb8406e020 con 0x55b89a4495b0 2024-05-09T09:47:36.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.967+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x55b89a444c20 2024-05-09T09:47:36.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.967+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb8c026040 con 0x55b89a444c20 2024-05-09T09:47:36.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.967+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x7feb880e0040 2024-05-09T09:47:36.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.967+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7feb8c026040 con 0x7feb880e0040 2024-05-09T09:47:36.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.967+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x55b89a44de50 2024-05-09T09:47:36.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.967+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb880aaad0 con 0x55b89a44de50 2024-05-09T09:47:36.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.967+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x55b89a44de50 2024-05-09T09:47:36.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.967+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7feb880aaad0 con 0x55b89a44de50 2024-05-09T09:47:36.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.967+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x55b89a4495b0 2024-05-09T09:47:36.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.967+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb8406e020 con 0x55b89a4495b0 2024-05-09T09:47:36.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.967+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x55b89a44de50 2024-05-09T09:47:36.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.967+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb880aaad0 con 0x55b89a44de50 2024-05-09T09:47:36.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.967+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x55b89a44de50 2024-05-09T09:47:36.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.967+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb880aaad0 con 0x55b89a44de50 2024-05-09T09:47:36.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.967+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x55b89a444c20 2024-05-09T09:47:36.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.971+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb8c026040 con 0x55b89a444c20 2024-05-09T09:47:36.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.971+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x55b89a444c20 2024-05-09T09:47:36.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.971+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7feb8c026040 con 0x55b89a444c20 2024-05-09T09:47:36.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.971+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x55b89a4495b0 2024-05-09T09:47:36.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.971+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb8406e020 con 0x55b89a4495b0 2024-05-09T09:47:36.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.971+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x55b89a44de50 2024-05-09T09:47:36.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.971+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb880aaad0 con 0x55b89a44de50 2024-05-09T09:47:36.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.971+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x7feb880e0040 2024-05-09T09:47:36.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.971+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb8c026040 con 0x7feb880e0040 2024-05-09T09:47:36.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.971+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x55b89a444c20 2024-05-09T09:47:36.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.971+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb8c026040 con 0x55b89a444c20 2024-05-09T09:47:36.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.971+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x55b89a4495b0 2024-05-09T09:47:36.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.971+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7feb8406e020 con 0x55b89a4495b0 2024-05-09T09:47:36.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.971+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x55b89a44de50 2024-05-09T09:47:36.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.971+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb880aaad0 con 0x55b89a44de50 2024-05-09T09:47:36.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.971+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x55b89a4495b0 2024-05-09T09:47:36.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb8406e020 con 0x55b89a4495b0 2024-05-09T09:47:36.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x7feb880e0040 2024-05-09T09:47:36.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb8c026040 con 0x7feb880e0040 2024-05-09T09:47:36.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x55b89a44de50 2024-05-09T09:47:36.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb880aaad0 con 0x55b89a44de50 2024-05-09T09:47:36.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x55b89a4495b0 2024-05-09T09:47:36.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb8406e020 con 0x55b89a4495b0 2024-05-09T09:47:36.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x55b89a444c20 2024-05-09T09:47:36.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7feb8c026040 con 0x55b89a444c20 2024-05-09T09:47:36.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b89a448850 con 0x7feb880e0040 2024-05-09T09:47:36.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb8c026040 con 0x7feb880e0040 2024-05-09T09:47:36.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb963f1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:36.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb963f1980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:36.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb963f1980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:36.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb963f1980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:36.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb963f1980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:36.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb963f1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:36.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb963f1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b89a44c730 con 0x55b89a444c20 2024-05-09T09:47:36.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb8c026040 con 0x55b89a444c20 2024-05-09T09:47:36.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb963f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:36.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb963f1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b89a44c730 con 0x55b89a444c20 2024-05-09T09:47:36.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feb8c026040 con 0x55b89a444c20 2024-05-09T09:47:36.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb963f1980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:36.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb963f1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b89a44c730 con 0x55b89a44de50 2024-05-09T09:47:36.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7feb880aaad0 con 0x55b89a44de50 2024-05-09T09:47:36.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb963f1980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:36.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb963f1980 20 zone default found 2024-05-09T09:47:36.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb963f1980 4 Realm: () 2024-05-09T09:47:36.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb963f1980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:36.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb963f1980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:36.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb963f1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:36.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb963f1980 20 zonegroup default 2024-05-09T09:47:36.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb963f1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.975+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b89a44cfd0 con 0x55b89a4495b0 2024-05-09T09:47:36.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.979+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7feb8406e020 con 0x55b89a4495b0 2024-05-09T09:47:36.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.979+0000 7feb963f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:36.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.979+0000 7feb963f1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.979+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b89a452840 con 0x55b89a44de50 2024-05-09T09:47:36.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.979+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feb880aaad0 con 0x55b89a44de50 2024-05-09T09:47:36.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.979+0000 7feb963f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:36.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.979+0000 7feb963f1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:36.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.979+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b89a452be0 con 0x55b89a44de50 2024-05-09T09:47:36.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.979+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feb880aaad0 con 0x55b89a44de50 2024-05-09T09:47:36.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.979+0000 7feb963f1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:36.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.979+0000 7feb963f1980 20 started sync module instance, tier type = 2024-05-09T09:47:36.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.979+0000 7feb963f1980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:36.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.979+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a451ce0 con 0x7feb880e0040 2024-05-09T09:47:36.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.979+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb8c026040 con 0x7feb880e0040 2024-05-09T09:47:36.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.979+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94251350565344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a451ce0 con 0x7feb880e0040 2024-05-09T09:47:36.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.979+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a4535a0 con 0x55b89a444c20 2024-05-09T09:47:36.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.979+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94251350565344] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb8c036040 con 0x7feb880e0040 2024-05-09T09:47:36.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.983+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb8c036040 con 0x55b89a444c20 2024-05-09T09:47:36.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.983+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94251350569472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a451ce0 con 0x55b89a444c20 2024-05-09T09:47:36.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.983+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a453fb0 con 0x55b89a44de50 2024-05-09T09:47:36.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.983+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94251350569472] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb8c036040 con 0x55b89a444c20 2024-05-09T09:47:36.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.983+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb880aaad0 con 0x55b89a44de50 2024-05-09T09:47:36.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.983+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94251350562864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a451c50 con 0x55b89a44de50 2024-05-09T09:47:36.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.983+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a454cb0 con 0x7feb880e0040 2024-05-09T09:47:36.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.983+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb8c036040 con 0x7feb880e0040 2024-05-09T09:47:36.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.987+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94251350575408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a455550 con 0x7feb880e0040 2024-05-09T09:47:36.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.987+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a455f10 con 0x55b89a444c20 2024-05-09T09:47:36.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.987+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94251350562864] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb880aaad0 con 0x55b89a44de50 2024-05-09T09:47:36.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.987+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94251350575408] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb8c036040 con 0x7feb880e0040 2024-05-09T09:47:36.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.987+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb8c036040 con 0x55b89a444c20 2024-05-09T09:47:36.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.987+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94251350579808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a4554c0 con 0x55b89a444c20 2024-05-09T09:47:36.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.987+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a455e80 con 0x55b89a4495b0 2024-05-09T09:47:36.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.987+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94251350579808] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb8c036040 con 0x55b89a444c20 2024-05-09T09:47:36.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.991+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb8406e020 con 0x55b89a4495b0 2024-05-09T09:47:36.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.991+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94251350577440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a4567b0 con 0x55b89a4495b0 2024-05-09T09:47:36.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.991+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a457000 con 0x55b89a4495b0 2024-05-09T09:47:36.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.991+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94251350577440] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb8406e020 con 0x55b89a4495b0 2024-05-09T09:47:36.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.991+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb8406e020 con 0x55b89a4495b0 2024-05-09T09:47:36.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.991+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94251350582016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a4578a0 con 0x55b89a4495b0 2024-05-09T09:47:36.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.991+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a458260 con 0x55b89a4495b0 2024-05-09T09:47:36.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.995+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94251350582016] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb8406e020 con 0x55b89a4495b0 2024-05-09T09:47:36.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.995+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb8406e020 con 0x55b89a4495b0 2024-05-09T09:47:36.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.995+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94251350586544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a458260 con 0x55b89a4495b0 2024-05-09T09:47:36.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.995+0000 7feb963f1980 20 add_watcher() i=0 2024-05-09T09:47:36.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.995+0000 7feb963f1980 20 add_watcher() i=1 2024-05-09T09:47:36.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.995+0000 7feb963f1980 20 add_watcher() i=2 2024-05-09T09:47:36.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.995+0000 7feb963f1980 20 add_watcher() i=3 2024-05-09T09:47:36.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.995+0000 7feb963f1980 20 add_watcher() i=4 2024-05-09T09:47:36.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.995+0000 7feb963f1980 20 add_watcher() i=5 2024-05-09T09:47:36.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.995+0000 7feb963f1980 20 add_watcher() i=6 2024-05-09T09:47:36.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.995+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94251350586544] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb8406e020 con 0x55b89a4495b0 2024-05-09T09:47:36.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.995+0000 7feb963f1980 20 add_watcher() i=7 2024-05-09T09:47:36.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.995+0000 7feb963f1980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:36.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.995+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b89a45b590 con 0x55b89a444c20 2024-05-09T09:47:36.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.995+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7feb8c036040 con 0x55b89a444c20 2024-05-09T09:47:36.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.995+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94251350589216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a4587f0 con 0x55b89a444c20 2024-05-09T09:47:36.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.999+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94251350589216] v30'154 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feb8c036040 con 0x55b89a444c20 2024-05-09T09:47:36.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.999+0000 7fea48fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:36.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.999+0000 7feb963f1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:36.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.999+0000 7feb963f1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:36.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.999+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a463cc0 con 0x55b89a444c20 2024-05-09T09:47:36.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.999+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'42 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feb8c036040 con 0x55b89a444c20 2024-05-09T09:47:36.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:36.999+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a464230 con 0x55b89a4495b0 2024-05-09T09:47:37.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.003+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'36 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feb8406e020 con 0x55b89a4495b0 2024-05-09T09:47:37.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.003+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a464230 con 0x55b89a44de50 2024-05-09T09:47:37.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.003+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'36 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feb880aaad0 con 0x55b89a44de50 2024-05-09T09:47:37.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.003+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a4647a0 con 0x55b89a444c20 2024-05-09T09:47:37.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.007+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'155 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feb8c036040 con 0x55b89a444c20 2024-05-09T09:47:37.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.007+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a464c50 con 0x7feb880e0040 2024-05-09T09:47:37.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.007+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'98 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feb8c036040 con 0x7feb880e0040 2024-05-09T09:47:37.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.007+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a461d30 con 0x55b89a44de50 2024-05-09T09:47:37.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.007+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'65 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feb880aaad0 con 0x55b89a44de50 2024-05-09T09:47:37.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.007+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a461d30 con 0x55b89a444c20 2024-05-09T09:47:37.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.011+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'38 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feb8c036040 con 0x55b89a444c20 2024-05-09T09:47:37.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.011+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a461d30 con 0x55b89a4495b0 2024-05-09T09:47:37.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.011+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'65 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feb8406e020 con 0x55b89a4495b0 2024-05-09T09:47:37.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.015+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a465a40 con 0x7feb880e0040 2024-05-09T09:47:37.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.015+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'36 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feb8c036040 con 0x7feb880e0040 2024-05-09T09:47:37.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.015+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a465a40 con 0x55b89a44de50 2024-05-09T09:47:37.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.015+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'42 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feb880aaad0 con 0x55b89a44de50 2024-05-09T09:47:37.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.015+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a465ef0 con 0x7feb880e0040 2024-05-09T09:47:37.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.019+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'99 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb8c036040 con 0x7feb880e0040 2024-05-09T09:47:37.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.019+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a465ef0 con 0x55b89a4495b0 2024-05-09T09:47:37.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.019+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'38 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb8406e020 con 0x55b89a4495b0 2024-05-09T09:47:37.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.019+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a465ef0 con 0x7feb880e0040 2024-05-09T09:47:37.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.023+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'36 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb8c036040 con 0x7feb880e0040 2024-05-09T09:47:37.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.023+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a465ef0 con 0x55b89a4495b0 2024-05-09T09:47:37.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.023+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'71 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb8406e020 con 0x55b89a4495b0 2024-05-09T09:47:37.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.023+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a465f80 con 0x55b89a444c20 2024-05-09T09:47:37.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.027+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'156 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb8c036040 con 0x55b89a444c20 2024-05-09T09:47:37.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.027+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a465f80 con 0x55b89a44de50 2024-05-09T09:47:37.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.027+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'92 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb880aaad0 con 0x55b89a44de50 2024-05-09T09:47:37.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.027+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a466010 con 0x7feb880e0040 2024-05-09T09:47:37.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.031+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'100 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb8c036040 con 0x7feb880e0040 2024-05-09T09:47:37.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.031+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a466010 con 0x55b89a44de50 2024-05-09T09:47:37.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.031+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'36 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb880aaad0 con 0x55b89a44de50 2024-05-09T09:47:37.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.031+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a4660c0 con 0x55b89a444c20 2024-05-09T09:47:37.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.035+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'44 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb8c036040 con 0x55b89a444c20 2024-05-09T09:47:37.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.035+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a4660c0 con 0x55b89a444c20 2024-05-09T09:47:37.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.035+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'157 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb8c036040 con 0x55b89a444c20 2024-05-09T09:47:37.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.035+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a4660c0 con 0x55b89a44de50 2024-05-09T09:47:37.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.039+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'93 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb880aaad0 con 0x55b89a44de50 2024-05-09T09:47:37.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.039+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a466150 con 0x7feb880e0040 2024-05-09T09:47:37.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.039+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'46 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb8c036040 con 0x7feb880e0040 2024-05-09T09:47:37.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.039+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a466150 con 0x55b89a44de50 2024-05-09T09:47:37.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.039+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'38 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb880aaad0 con 0x55b89a44de50 2024-05-09T09:47:37.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.039+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a466150 con 0x55b89a44de50 2024-05-09T09:47:37.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.043+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'42 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb880aaad0 con 0x55b89a44de50 2024-05-09T09:47:37.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.043+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a466150 con 0x55b89a44de50 2024-05-09T09:47:37.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.043+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'32 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb880aaad0 con 0x55b89a44de50 2024-05-09T09:47:37.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.043+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a466150 con 0x55b89a44de50 2024-05-09T09:47:37.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.043+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'66 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb880aaad0 con 0x55b89a44de50 2024-05-09T09:47:37.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.047+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a466150 con 0x55b89a4495b0 2024-05-09T09:47:37.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.047+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'38 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb8406e020 con 0x55b89a4495b0 2024-05-09T09:47:37.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.047+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a466150 con 0x55b89a44de50 2024-05-09T09:47:37.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.051+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'36 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb880aaad0 con 0x55b89a44de50 2024-05-09T09:47:37.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.051+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a4660c0 con 0x55b89a4495b0 2024-05-09T09:47:37.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.051+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'66 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb8406e020 con 0x55b89a4495b0 2024-05-09T09:47:37.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.051+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a4660c0 con 0x55b89a44de50 2024-05-09T09:47:37.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.055+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'94 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb880aaad0 con 0x55b89a44de50 2024-05-09T09:47:37.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.055+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a4660c0 con 0x55b89a4495b0 2024-05-09T09:47:37.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.055+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'72 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb8406e020 con 0x55b89a4495b0 2024-05-09T09:47:37.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.055+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a4660c0 con 0x7feb880e0040 2024-05-09T09:47:37.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.059+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'42 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb8c036040 con 0x7feb880e0040 2024-05-09T09:47:37.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.059+0000 7fe9c37fe640 20 reqs_thread_entry: start 2024-05-09T09:47:37.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.059+0000 7feb963f1980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:37.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.059+0000 7fe9c17fa640 20 reqs_thread_entry: start 2024-05-09T09:47:37.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.059+0000 7feb963f1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.059+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b89a481cd0 con 0x55b89a444c20 2024-05-09T09:47:37.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.063+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7feb8c036040 con 0x55b89a444c20 2024-05-09T09:47:37.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.063+0000 7feb963f1980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:47:37.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.063+0000 7feb963f1980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.063+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b89a460780 con 0x55b89a444c20 2024-05-09T09:47:37.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.063+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(95 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7feb8c036040 con 0x55b89a444c20 2024-05-09T09:47:37.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.063+0000 7feb963f1980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:47:37.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.063+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:96 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b89a460750 con 0x7feb880e0040 2024-05-09T09:47:37.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.063+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(96 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7feb8c036040 con 0x7feb880e0040 2024-05-09T09:47:37.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.063+0000 7fea48fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:37.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.063+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94251350589216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a460750 con 0x55b89a444c20 2024-05-09T09:47:37.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.067+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(97 data_loggenerations_metadata [watch unwatch cookie 94251350589216] v30'158 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feb8c036040 con 0x55b89a444c20 2024-05-09T09:47:37.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.067+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:98 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94251350565344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a460750 con 0x7feb880e0040 2024-05-09T09:47:37.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.067+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(98 notify.0 [watch unwatch cookie 94251350565344] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb8c036040 con 0x7feb880e0040 2024-05-09T09:47:37.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.067+0000 7feb963f1980 20 remove_watcher() i=0 2024-05-09T09:47:37.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.067+0000 7feb963f1980 2 removed watcher, disabling cache 2024-05-09T09:47:37.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.067+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:99 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94251350569472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a460750 con 0x55b89a444c20 2024-05-09T09:47:37.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.067+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(99 notify.1 [watch unwatch cookie 94251350569472] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb8c036040 con 0x55b89a444c20 2024-05-09T09:47:37.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.071+0000 7feb963f1980 20 remove_watcher() i=1 2024-05-09T09:47:37.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.071+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:100 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94251350562864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a460750 con 0x55b89a44de50 2024-05-09T09:47:37.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.071+0000 7feb9370b640 1 -- 172.21.15.157:0/4056177816 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(100 notify.2 [watch unwatch cookie 94251350562864] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb880aaad0 con 0x55b89a44de50 2024-05-09T09:47:37.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.071+0000 7feb963f1980 20 remove_watcher() i=2 2024-05-09T09:47:37.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.071+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:101 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94251350575408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a460750 con 0x7feb880e0040 2024-05-09T09:47:37.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.071+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(101 notify.3 [watch unwatch cookie 94251350575408] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb8c036040 con 0x7feb880e0040 2024-05-09T09:47:37.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.071+0000 7feb963f1980 20 remove_watcher() i=3 2024-05-09T09:47:37.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.071+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94251350579808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a460750 con 0x55b89a444c20 2024-05-09T09:47:37.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.075+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(102 notify.4 [watch unwatch cookie 94251350579808] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb8c036040 con 0x55b89a444c20 2024-05-09T09:47:37.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.075+0000 7feb963f1980 20 remove_watcher() i=4 2024-05-09T09:47:37.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.075+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94251350577440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a460750 con 0x55b89a4495b0 2024-05-09T09:47:37.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.079+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(103 notify.5 [watch unwatch cookie 94251350577440] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb8406e020 con 0x55b89a4495b0 2024-05-09T09:47:37.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.079+0000 7feb963f1980 20 remove_watcher() i=5 2024-05-09T09:47:37.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.079+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94251350582016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a460750 con 0x55b89a4495b0 2024-05-09T09:47:37.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.079+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(104 notify.6 [watch unwatch cookie 94251350582016] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb8406e020 con 0x55b89a4495b0 2024-05-09T09:47:37.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.079+0000 7feb963f1980 20 remove_watcher() i=6 2024-05-09T09:47:37.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.079+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:105 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94251350586544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b89a460750 con 0x55b89a4495b0 2024-05-09T09:47:37.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb93f0c640 1 -- 172.21.15.157:0/4056177816 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(105 notify.7 [watch unwatch cookie 94251350586544] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb8406e020 con 0x55b89a4495b0 2024-05-09T09:47:37.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 20 remove_watcher() i=7 2024-05-09T09:47:37.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b89a4495b0 msgr2=0x55b89a44b9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 --2- 172.21.15.157:0/4056177816 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b89a4495b0 0x55b89a44b9a0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b89a444c20 msgr2=0x55b89a4470b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 --2- 172.21.15.157:0/4056177816 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b89a444c20 0x55b89a4470b0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7feb880e0040 msgr2=0x7feb880e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 --2- 172.21.15.157:0/4056177816 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7feb880e0040 0x7feb880e0420 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b89a44de50 msgr2=0x55b89a450310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 --2- 172.21.15.157:0/4056177816 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b89a44de50 0x55b89a450310 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fea5c034b60 msgr2=0x7fea5c037020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 --2- 172.21.15.157:0/4056177816 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fea5c034b60 0x7fea5c037020 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feb8801b380 tx=0x7feb880c1040 comp rx=0 tx=0).stop 2024-05-09T09:47:37.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a430f40 msgr2=0x55b89a438260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 --2- 172.21.15.157:0/4056177816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a430f40 0x55b89a438260 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7feb84025bd0 tx=0x7feb8404cea0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 reap_dead start 2024-05-09T09:47:37.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb9470d640 1 -- 172.21.15.157:0/4056177816 reap_dead start 2024-05-09T09:47:37.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 shutdown_connections 2024-05-09T09:47:37.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 >> 172.21.15.157:0/4056177816 conn(0x55b89a42d2c0 msgr2=0x55b89a42a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:37.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 shutdown_connections 2024-05-09T09:47:37.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 -- 172.21.15.157:0/4056177816 wait complete. 2024-05-09T09:47:37.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 -- 172.21.15.157:0/3113388444 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fea6c034bb0 msgr2=0x7fea6c037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 --2- 172.21.15.157:0/3113388444 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fea6c034bb0 0x7fea6c037070 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x55b89a3f5e20 tx=0x7feb88005ad0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 -- 172.21.15.157:0/3113388444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a424170 msgr2=0x55b89a424590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 --2- 172.21.15.157:0/3113388444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a424170 0x55b89a424590 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7feb840486a0 tx=0x7feb84024620 comp rx=0 tx=0).stop 2024-05-09T09:47:37.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 -- 172.21.15.157:0/3113388444 shutdown_connections 2024-05-09T09:47:37.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 --2- 172.21.15.157:0/3113388444 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fea6c034bb0 0x7fea6c037070 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 --2- 172.21.15.157:0/3113388444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a424170 0x55b89a424590 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 -- 172.21.15.157:0/3113388444 >> 172.21.15.157:0/3113388444 conn(0x55b89a418f40 msgr2=0x55b89a419a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:37.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 -- 172.21.15.157:0/3113388444 shutdown_connections 2024-05-09T09:47:37.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 -- 172.21.15.157:0/3113388444 wait complete. 2024-05-09T09:47:37.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 -- 172.21.15.157:0/2043092107 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b89a3f7870 msgr2=0x55b89a3f9c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 --2- 172.21.15.157:0/2043092107 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b89a3f7870 0x55b89a3f9c60 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 -- 172.21.15.157:0/2043092107 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b89a300030 msgr2=0x55b89a3f4ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 --2- 172.21.15.157:0/2043092107 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b89a300030 0x55b89a3f4ed0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 -- 172.21.15.157:0/2043092107 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b89a3fb790 msgr2=0x55b89a3fdb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 --2- 172.21.15.157:0/2043092107 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b89a3fb790 0x55b89a3fdb80 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 -- 172.21.15.157:0/2043092107 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fea7c034bb0 msgr2=0x7fea7c037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 --2- 172.21.15.157:0/2043092107 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fea7c034bb0 0x7fea7c037070 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feb880ae000 tx=0x7feb880a6000 comp rx=0 tx=0).stop 2024-05-09T09:47:37.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 -- 172.21.15.157:0/2043092107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a2fbb30 msgr2=0x55b89a3edf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 --2- 172.21.15.157:0/2043092107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b89a2fbb30 0x55b89a3edf00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7feb8400f610 tx=0x7feb84001260 comp rx=0 tx=0).stop 2024-05-09T09:47:37.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb9470d640 1 -- 172.21.15.157:0/2043092107 reap_dead start 2024-05-09T09:47:37.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 -- 172.21.15.157:0/2043092107 shutdown_connections 2024-05-09T09:47:37.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 -- 172.21.15.157:0/2043092107 >> 172.21.15.157:0/2043092107 conn(0x55b89a26f250 msgr2=0x55b89a3e13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:37.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 -- 172.21.15.157:0/2043092107 shutdown_connections 2024-05-09T09:47:37.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.083+0000 7feb963f1980 1 -- 172.21.15.157:0/2043092107 wait complete. 2024-05-09T09:47:37.095 INFO:teuthology.orchestra.run.smithi157.stdout:[] 2024-05-09T09:47:37.096 DEBUG:tasks.util.rgw: json result: [] 2024-05-09T09:47:37.096 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-05-09T09:47:37.096 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-05-09T09:47:37.096 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-05-09T09:47:37.178 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:37.178 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:37.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.179+0000 7ff029504980 1 Processor -- start 2024-05-09T09:47:37.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.179+0000 7ff029504980 1 -- start start 2024-05-09T09:47:37.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.179+0000 7ff029504980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55d0851d3030 0x55d0851d5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.179+0000 7ff029504980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d085082440 con 0x55d0851ceb30 2024-05-09T09:47:37.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.179+0000 7ff029504980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55d08506d5f0 con 0x55d0851d3030 2024-05-09T09:47:37.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.179+0000 7ff02681e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55d0851d3030 0x55d0851d5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.179+0000 7ff02681e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55d0851d3030 0x55d0851d5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58450/0 (socket says 172.21.15.157:58450) 2024-05-09T09:47:37.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.179+0000 7ff02701f640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x55d0851ceb30 0x55d0851cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:51636/0 (socket says 172.21.15.157:51636) 2024-05-09T09:47:37.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.179+0000 7ff02681e640 1 -- 172.21.15.157:0/878785835 learned_addr learned my addr 172.21.15.157:0/878785835 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:37.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.183+0000 7ff02681e640 1 -- 172.21.15.157:0/878785835 >> v1:172.21.15.110:6789/0 conn(0x55d0851ceb30 legacy=0x55d0851cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.183+0000 7ff02681e640 1 -- 172.21.15.157:0/878785835 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d085078990 con 0x55d0851d3030 2024-05-09T09:47:37.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.187+0000 7ff02681e640 1 --2- 172.21.15.157:0/878785835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0851d3030 0x55d0851d5420 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff01c00a5c0 tx=0x7ff01c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8024c947ddd7e13 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.187+0000 7ff02601d640 1 -- 172.21.15.157:0/878785835 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff01c0a6070 con 0x55d0851d3030 2024-05-09T09:47:37.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.187+0000 7ff02601d640 1 -- 172.21.15.157:0/878785835 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff01c0af070 con 0x55d0851d3030 2024-05-09T09:47:37.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.187+0000 7ff02601d640 1 -- 172.21.15.157:0/878785835 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff01c0aa5c0 con 0x55d0851d3030 2024-05-09T09:47:37.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.187+0000 7ff029504980 1 -- 172.21.15.157:0/878785835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0851d3030 msgr2=0x55d0851d5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.187+0000 7ff029504980 1 --2- 172.21.15.157:0/878785835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0851d3030 0x55d0851d5420 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff01c00a5c0 tx=0x7ff01c01b340 comp rx=0 tx=0).stop 2024-05-09T09:47:37.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.187+0000 7ff029504980 1 -- 172.21.15.157:0/878785835 shutdown_connections 2024-05-09T09:47:37.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.187+0000 7ff029504980 1 --2- 172.21.15.157:0/878785835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0851d3030 0x55d0851d5420 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.187+0000 7ff029504980 1 -- 172.21.15.157:0/878785835 >> 172.21.15.157:0/878785835 conn(0x55d085142250 msgr2=0x55d085142660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:37.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.187+0000 7ff029504980 1 -- 172.21.15.157:0/878785835 shutdown_connections 2024-05-09T09:47:37.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.187+0000 7ff029504980 1 -- 172.21.15.157:0/878785835 wait complete. 2024-05-09T09:47:37.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.203+0000 7ff029504980 1 Processor -- start 2024-05-09T09:47:37.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.203+0000 7ff029504980 1 -- start start 2024-05-09T09:47:37.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.203+0000 7ff029504980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0851ceb30 0x55d0852b9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.203+0000 7ff029504980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d0850cffe0 con 0x55d0851ceb30 2024-05-09T09:47:37.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.203+0000 7ff02701f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0851ceb30 0x55d0852b9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.203+0000 7ff02701f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0851ceb30 0x55d0852b9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58460/0 (socket says 172.21.15.157:58460) 2024-05-09T09:47:37.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.203+0000 7ff02701f640 1 -- 172.21.15.157:0/3091416721 learned_addr learned my addr 172.21.15.157:0/3091416721 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:37.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.203+0000 7ff02701f640 1 -- 172.21.15.157:0/3091416721 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d085054ae0 con 0x55d0851ceb30 2024-05-09T09:47:37.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.203+0000 7ff02701f640 1 --2- 172.21.15.157:0/3091416721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0851ceb30 0x55d0852b9d30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff0200015f0 tx=0x7ff020001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9dfdc7c688cd10d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.203+0000 7fef1560a640 1 -- 172.21.15.157:0/3091416721 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff020013420 con 0x55d0851ceb30 2024-05-09T09:47:37.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.203+0000 7fef1560a640 1 -- 172.21.15.157:0/3091416721 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0200135e0 con 0x55d0851ceb30 2024-05-09T09:47:37.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.203+0000 7fef1560a640 1 -- 172.21.15.157:0/3091416721 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff020013940 con 0x55d0851ceb30 2024-05-09T09:47:37.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.203+0000 7ff029504980 1 -- 172.21.15.157:0/3091416721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0851ceb30 msgr2=0x55d0852b9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.203+0000 7ff029504980 1 --2- 172.21.15.157:0/3091416721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0851ceb30 0x55d0852b9d30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff0200015f0 tx=0x7ff020001ab0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.203+0000 7ff029504980 1 -- 172.21.15.157:0/3091416721 shutdown_connections 2024-05-09T09:47:37.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.203+0000 7ff029504980 1 --2- 172.21.15.157:0/3091416721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0851ceb30 0x55d0852b9d30 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.203+0000 7ff029504980 1 -- 172.21.15.157:0/3091416721 >> 172.21.15.157:0/3091416721 conn(0x55d085142250 msgr2=0x55d0852b58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:37.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.203+0000 7ff029504980 1 -- 172.21.15.157:0/3091416721 shutdown_connections 2024-05-09T09:47:37.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.203+0000 7ff029504980 1 -- 172.21.15.157:0/3091416721 wait complete. 2024-05-09T09:47:37.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.207+0000 7ff029504980 1 Processor -- start 2024-05-09T09:47:37.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.207+0000 7ff029504980 1 -- start start 2024-05-09T09:47:37.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.207+0000 7ff029504980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0851ceb30 0x55d0852c0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.207+0000 7ff029504980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d0851d8450 con 0x55d0851ceb30 2024-05-09T09:47:37.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.207+0000 7ff02701f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0851ceb30 0x55d0852c0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.207+0000 7ff02701f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0851ceb30 0x55d0852c0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58476/0 (socket says 172.21.15.157:58476) 2024-05-09T09:47:37.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.207+0000 7ff02701f640 1 -- 172.21.15.157:0/593815929 learned_addr learned my addr 172.21.15.157:0/593815929 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:37.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.207+0000 7ff02701f640 1 -- 172.21.15.157:0/593815929 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0852c1490 con 0x55d0851ceb30 2024-05-09T09:47:37.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.207+0000 7ff02701f640 1 --2- 172.21.15.157:0/593815929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0851ceb30 0x55d0852c0f50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x55d0852babc0 tx=0x7ff020000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.207+0000 7fef13e07640 1 -- 172.21.15.157:0/593815929 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff020022020 con 0x55d0851ceb30 2024-05-09T09:47:37.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.207+0000 7fef13e07640 1 -- 172.21.15.157:0/593815929 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff020006320 con 0x55d0851ceb30 2024-05-09T09:47:37.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.207+0000 7ff029504980 1 -- 172.21.15.157:0/593815929 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d0852c1720 con 0x55d0851ceb30 2024-05-09T09:47:37.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.207+0000 7fef13e07640 1 -- 172.21.15.157:0/593815929 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff020004b30 con 0x55d0851ceb30 2024-05-09T09:47:37.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.207+0000 7ff029504980 1 -- 172.21.15.157:0/593815929 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0852c43b0 con 0x55d0851ceb30 2024-05-09T09:47:37.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.207+0000 7fef13e07640 1 -- 172.21.15.157:0/593815929 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7ff020025020 con 0x55d0851ceb30 2024-05-09T09:47:37.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.207+0000 7fef13e07640 1 --2- 172.21.15.157:0/593815929 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fef0c034bb0 0x7fef0c037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.207+0000 7fef13e07640 1 -- 172.21.15.157:0/593815929 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7ff020018030 con 0x55d0851ceb30 2024-05-09T09:47:37.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.207+0000 7ff02681e640 1 --2- 172.21.15.157:0/593815929 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fef0c034bb0 0x7fef0c037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.207+0000 7ff029504980 1 --2- 172.21.15.157:0/593815929 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d0851d3030 0x55d0852c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.207+0000 7ff029504980 1 -- 172.21.15.157:0/593815929 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d0852c8560 con 0x55d0851d3030 2024-05-09T09:47:37.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.211+0000 7ff027820640 1 --2- 172.21.15.157:0/593815929 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d0851d3030 0x55d0852c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.211+0000 7ff02681e640 1 --2- 172.21.15.157:0/593815929 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fef0c034bb0 0x7fef0c037070 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff01c0ae000 tx=0x7ff01c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.211+0000 7ff027820640 1 --2- 172.21.15.157:0/593815929 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d0851d3030 0x55d0852c7ef0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.211+0000 7ff027820640 1 -- 172.21.15.157:0/593815929 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0180083f0 con 0x55d0851d3030 2024-05-09T09:47:37.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.211+0000 7ff029504980 1 -- 172.21.15.157:0/593815929 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d0852c55b0 con 0x55d0851d3030 2024-05-09T09:47:37.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.211+0000 7ff027820640 1 -- 172.21.15.157:0/593815929 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff0180083f0 con 0x55d0851d3030 2024-05-09T09:47:37.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.211+0000 7ff029504980 1 --2- 172.21.15.157:0/593815929 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d0852ca890 0x55d0852ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.211+0000 7ff029504980 1 -- 172.21.15.157:0/593815929 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d0852cd350 con 0x55d0852ca890 2024-05-09T09:47:37.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.211+0000 7ff02701f640 1 --2- 172.21.15.157:0/593815929 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d0852ca890 0x55d0852ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.211+0000 7ff02701f640 1 --2- 172.21.15.157:0/593815929 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d0852ca890 0x55d0852ccc80 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.211+0000 7ff02701f640 1 -- 172.21.15.157:0/593815929 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff02001b070 con 0x55d0852ca890 2024-05-09T09:47:37.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.211+0000 7ff029504980 1 -- 172.21.15.157:0/593815929 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d0852c9730 con 0x55d0851d3030 2024-05-09T09:47:37.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.211+0000 7ff027820640 1 -- 172.21.15.157:0/593815929 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff0180083f0 con 0x55d0851d3030 2024-05-09T09:47:37.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.211+0000 7ff029504980 1 --2- 172.21.15.157:0/593815929 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d0852ce790 0x55d0852d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.211+0000 7ff029504980 1 -- 172.21.15.157:0/593815929 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d0852d1310 con 0x55d0852ce790 2024-05-09T09:47:37.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.211+0000 7ff02681e640 1 --2- 172.21.15.157:0/593815929 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d0852ce790 0x55d0852d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.215+0000 7ff02681e640 1 --2- 172.21.15.157:0/593815929 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d0852ce790 0x55d0852d0b80 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.215+0000 7ff02681e640 1 -- 172.21.15.157:0/593815929 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff01c0aaae0 con 0x55d0852ce790 2024-05-09T09:47:37.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.219+0000 7ff029504980 1 Processor -- start 2024-05-09T09:47:37.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.219+0000 7ff029504980 1 -- start start 2024-05-09T09:47:37.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.219+0000 7ff029504980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0852f7130 0x55d0852f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.219+0000 7ff029504980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d0850d4020 con 0x55d0852f7130 2024-05-09T09:47:37.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.219+0000 7ff02701f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0852f7130 0x55d0852f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.219+0000 7ff02701f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0852f7130 0x55d0852f7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58488/0 (socket says 172.21.15.157:58488) 2024-05-09T09:47:37.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.219+0000 7ff02701f640 1 -- 172.21.15.157:0/3341785368 learned_addr learned my addr 172.21.15.157:0/3341785368 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:37.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.219+0000 7ff02701f640 1 -- 172.21.15.157:0/3341785368 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0852f7a90 con 0x55d0852f7130 2024-05-09T09:47:37.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.219+0000 7ff02701f640 1 --2- 172.21.15.157:0/3341785368 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0852f7130 0x55d0852f7550 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff020012fd0 tx=0x7ff02000f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.219+0000 7fef0bfff640 1 -- 172.21.15.157:0/3341785368 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff020010520 con 0x55d0852f7130 2024-05-09T09:47:37.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.219+0000 7ff029504980 1 -- 172.21.15.157:0/3341785368 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d0852f8520 con 0x55d0852f7130 2024-05-09T09:47:37.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.219+0000 7ff029504980 1 -- 172.21.15.157:0/3341785368 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0852f8520 con 0x55d0852f7130 2024-05-09T09:47:37.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.219+0000 7fef0bfff640 1 -- 172.21.15.157:0/3341785368 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0200106c0 con 0x55d0852f7130 2024-05-09T09:47:37.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.219+0000 7fef0bfff640 1 -- 172.21.15.157:0/3341785368 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff02001d950 con 0x55d0852f7130 2024-05-09T09:47:37.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.223+0000 7fef0bfff640 1 -- 172.21.15.157:0/3341785368 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7ff020010070 con 0x55d0852f7130 2024-05-09T09:47:37.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.223+0000 7fef0bfff640 1 --2- 172.21.15.157:0/3341785368 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fef00034c00 0x7fef000370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.223+0000 7fef0bfff640 1 -- 172.21.15.157:0/3341785368 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7ff020046020 con 0x55d0852f7130 2024-05-09T09:47:37.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.223+0000 7ff02681e640 1 --2- 172.21.15.157:0/3341785368 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fef00034c00 0x7fef000370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.223+0000 7ff029504980 1 Processor -- start 2024-05-09T09:47:37.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.223+0000 7ff029504980 1 -- start start 2024-05-09T09:47:37.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.223+0000 7ff02681e640 1 --2- 172.21.15.157:0/3341785368 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fef00034c00 0x7fef000370c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff01c0ac040 tx=0x7ff01c005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.223+0000 7ff029504980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d085303ee0 0x55d085304300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.223+0000 7ff029504980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d0852ba480 con 0x55d085303ee0 2024-05-09T09:47:37.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.223+0000 7ff02701f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d085303ee0 0x55d085304300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.223+0000 7ff02701f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d085303ee0 0x55d085304300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58502/0 (socket says 172.21.15.157:58502) 2024-05-09T09:47:37.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.223+0000 7ff02701f640 1 -- 172.21.15.157:0/3012276037 learned_addr learned my addr 172.21.15.157:0/3012276037 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:37.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.223+0000 7ff02701f640 1 -- 172.21.15.157:0/3012276037 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0853048d0 con 0x55d085303ee0 2024-05-09T09:47:37.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.223+0000 7ff02701f640 1 --2- 172.21.15.157:0/3012276037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d085303ee0 0x55d085304300 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff02001ffd0 tx=0x7ff02000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce02161e9df1b30 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.223+0000 7fef09ffb640 1 -- 172.21.15.157:0/3012276037 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff020040420 con 0x55d085303ee0 2024-05-09T09:47:37.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.223+0000 7fef09ffb640 1 -- 172.21.15.157:0/3012276037 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff02001fdf0 con 0x55d085303ee0 2024-05-09T09:47:37.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.223+0000 7fef09ffb640 1 -- 172.21.15.157:0/3012276037 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff02001dcd0 con 0x55d085303ee0 2024-05-09T09:47:37.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.223+0000 7ff029504980 1 -- 172.21.15.157:0/3012276037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d085303ee0 msgr2=0x55d085304300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.223+0000 7ff029504980 1 --2- 172.21.15.157:0/3012276037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d085303ee0 0x55d085304300 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff02001ffd0 tx=0x7ff02000cde0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.223+0000 7ff029504980 1 -- 172.21.15.157:0/3012276037 shutdown_connections 2024-05-09T09:47:37.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.223+0000 7ff029504980 1 --2- 172.21.15.157:0/3012276037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d085303ee0 0x55d085304300 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.223+0000 7ff029504980 1 -- 172.21.15.157:0/3012276037 >> 172.21.15.157:0/3012276037 conn(0x55d085300260 msgr2=0x55d0852fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:37.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.223+0000 7ff029504980 1 -- 172.21.15.157:0/3012276037 shutdown_connections 2024-05-09T09:47:37.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.223+0000 7ff029504980 1 -- 172.21.15.157:0/3012276037 wait complete. 2024-05-09T09:47:37.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.223+0000 7ff029504980 1 Processor -- start 2024-05-09T09:47:37.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.223+0000 7ff029504980 1 -- start start 2024-05-09T09:47:37.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.223+0000 7ff029504980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d085303ee0 0x55d08530b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.223+0000 7ff029504980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d085304fa0 con 0x55d085303ee0 2024-05-09T09:47:37.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.227+0000 7ff02701f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d085303ee0 0x55d08530b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.227+0000 7ff02701f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d085303ee0 0x55d08530b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58518/0 (socket says 172.21.15.157:58518) 2024-05-09T09:47:37.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.227+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 learned_addr learned my addr 172.21.15.157:0/4223138673 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:37.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.227+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d08530b740 con 0x55d085303ee0 2024-05-09T09:47:37.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.227+0000 7ff02701f640 1 --2- 172.21.15.157:0/4223138673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d085303ee0 0x55d08530b200 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff020004f10 tx=0x7ff020028150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.227+0000 7feef7fff640 1 -- 172.21.15.157:0/4223138673 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff020070070 con 0x55d085303ee0 2024-05-09T09:47:37.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.227+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d08530b740 con 0x55d085303ee0 2024-05-09T09:47:37.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.227+0000 7feef7fff640 1 -- 172.21.15.157:0/4223138673 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff020040420 con 0x55d085303ee0 2024-05-09T09:47:37.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.227+0000 7feef7fff640 1 -- 172.21.15.157:0/4223138673 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff020032420 con 0x55d085303ee0 2024-05-09T09:47:37.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.227+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d08530b740 con 0x55d085303ee0 2024-05-09T09:47:37.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.227+0000 7feef7fff640 1 -- 172.21.15.157:0/4223138673 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7ff020073070 con 0x55d085303ee0 2024-05-09T09:47:37.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.227+0000 7ff029504980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.227+0000 7feef7fff640 1 --2- 172.21.15.157:0/4223138673 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7feef0034bb0 0x7feef0037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.227+0000 7feef7fff640 1 -- 172.21.15.157:0/4223138673 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7ff020076ca0 con 0x55d085303ee0 2024-05-09T09:47:37.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.227+0000 7ff02681e640 1 --2- 172.21.15.157:0/4223138673 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7feef0034bb0 0x7feef0037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.227+0000 7ff029504980 1 --2- 172.21.15.157:0/4223138673 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d085317b00 0x55d085319f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.227+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d08531a6e0 con 0x55d085317b00 2024-05-09T09:47:37.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.227+0000 7ff027820640 1 --2- 172.21.15.157:0/4223138673 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d085317b00 0x55d085319f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.227+0000 7ff02681e640 1 --2- 172.21.15.157:0/4223138673 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7feef0034bb0 0x7feef0037070 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff01c0aa910 tx=0x7ff01c0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.227+0000 7ff027820640 1 --2- 172.21.15.157:0/4223138673 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d085317b00 0x55d085319f90 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0180083f0 con 0x55d085317b00 2024-05-09T09:47:37.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff029504980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:37.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff029504980 20 realm 2024-05-09T09:47:37.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff029504980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d08531aaf0 con 0x55d085317b00 2024-05-09T09:47:37.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0180083f0 con 0x55d085317b00 2024-05-09T09:47:37.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff029504980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:37.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff029504980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:37.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff029504980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b390 con 0x55d085317b00 2024-05-09T09:47:37.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0180083f0 con 0x55d085317b00 2024-05-09T09:47:37.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff029504980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:37.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff029504980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x55d085317b00 2024-05-09T09:47:37.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff0180083f0 con 0x55d085317b00 2024-05-09T09:47:37.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff029504980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:37.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff029504980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff029504980 1 --2- 172.21.15.157:0/4223138673 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d08531c490 0x55d08531e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d08531ee00 con 0x55d08531c490 2024-05-09T09:47:37.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff02701f640 1 --2- 172.21.15.157:0/4223138673 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d08531c490 0x55d08531e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff02701f640 1 --2- 172.21.15.157:0/4223138673 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d08531c490 0x55d08531e880 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff020072030 con 0x55d08531c490 2024-05-09T09:47:37.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff029504980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:37.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff029504980 20 searching for the correct realm 2024-05-09T09:47:37.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff029504980 1 --2- 172.21.15.157:0/4223138673 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d085320d70 0x55d085323230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d085323900 con 0x55d085320d70 2024-05-09T09:47:37.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff02681e640 1 --2- 172.21.15.157:0/4223138673 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d085320d70 0x55d085323230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff02681e640 1 --2- 172.21.15.157:0/4223138673 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d085320d70 0x55d085323230 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff01c0aaae0 con 0x55d085320d70 2024-05-09T09:47:37.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff02681e640 1 --2- 172.21.15.157:0/4223138673 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7ff01c0e0040 0x7ff01c0e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d085323900 con 0x7ff01c0e0040 2024-05-09T09:47:37.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.231+0000 7ff027820640 1 --2- 172.21.15.157:0/4223138673 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7ff01c0e0040 0x7ff01c0e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.235+0000 7ff027820640 1 --2- 172.21.15.157:0/4223138673 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7ff01c0e0040 0x7ff01c0e0420 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.235+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0180083f0 con 0x7ff01c0e0040 2024-05-09T09:47:37.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.235+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x55d08531c490 2024-05-09T09:47:37.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.235+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff020072030 con 0x55d08531c490 2024-05-09T09:47:37.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.235+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x55d085317b00 2024-05-09T09:47:37.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.235+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0180083f0 con 0x55d085317b00 2024-05-09T09:47:37.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.235+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x55d085317b00 2024-05-09T09:47:37.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.235+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff018026040 con 0x55d085317b00 2024-05-09T09:47:37.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.235+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x55d08531c490 2024-05-09T09:47:37.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.235+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff020072030 con 0x55d08531c490 2024-05-09T09:47:37.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.235+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x55d08531c490 2024-05-09T09:47:37.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.235+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff020072030 con 0x55d08531c490 2024-05-09T09:47:37.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.235+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x7ff01c0e0040 2024-05-09T09:47:37.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.235+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff018026040 con 0x7ff01c0e0040 2024-05-09T09:47:37.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.235+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x55d085320d70 2024-05-09T09:47:37.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.235+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff01c0aaae0 con 0x55d085320d70 2024-05-09T09:47:37.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.235+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x55d085317b00 2024-05-09T09:47:37.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.239+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff018026040 con 0x55d085317b00 2024-05-09T09:47:37.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.239+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x55d08531c490 2024-05-09T09:47:37.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.239+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff020072030 con 0x55d08531c490 2024-05-09T09:47:37.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.239+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x55d085317b00 2024-05-09T09:47:37.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.239+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff018026040 con 0x55d085317b00 2024-05-09T09:47:37.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.239+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x7ff01c0e0040 2024-05-09T09:47:37.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.239+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff018026040 con 0x7ff01c0e0040 2024-05-09T09:47:37.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.239+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x55d085320d70 2024-05-09T09:47:37.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.239+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff01c0aaae0 con 0x55d085320d70 2024-05-09T09:47:37.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.239+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x55d085320d70 2024-05-09T09:47:37.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.239+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff01c0aaae0 con 0x55d085320d70 2024-05-09T09:47:37.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.239+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x55d08531c490 2024-05-09T09:47:37.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.239+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff020072030 con 0x55d08531c490 2024-05-09T09:47:37.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.239+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x55d085320d70 2024-05-09T09:47:37.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.239+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff01c0aaae0 con 0x55d085320d70 2024-05-09T09:47:37.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.239+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x55d085320d70 2024-05-09T09:47:37.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.239+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff01c0aaae0 con 0x55d085320d70 2024-05-09T09:47:37.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.239+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x55d085317b00 2024-05-09T09:47:37.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.243+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff018026040 con 0x55d085317b00 2024-05-09T09:47:37.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.243+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x55d085317b00 2024-05-09T09:47:37.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.243+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff018026040 con 0x55d085317b00 2024-05-09T09:47:37.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.243+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x55d08531c490 2024-05-09T09:47:37.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.243+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff020072030 con 0x55d08531c490 2024-05-09T09:47:37.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.243+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x55d085320d70 2024-05-09T09:47:37.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.243+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff01c0aaae0 con 0x55d085320d70 2024-05-09T09:47:37.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.243+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x7ff01c0e0040 2024-05-09T09:47:37.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.243+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff018026040 con 0x7ff01c0e0040 2024-05-09T09:47:37.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.243+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x55d085317b00 2024-05-09T09:47:37.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.243+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff018026040 con 0x55d085317b00 2024-05-09T09:47:37.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.243+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x55d08531c490 2024-05-09T09:47:37.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.243+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff020072030 con 0x55d08531c490 2024-05-09T09:47:37.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.243+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x55d085320d70 2024-05-09T09:47:37.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.243+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff01c0aaae0 con 0x55d085320d70 2024-05-09T09:47:37.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.243+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x55d08531c490 2024-05-09T09:47:37.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff020072030 con 0x55d08531c490 2024-05-09T09:47:37.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x7ff01c0e0040 2024-05-09T09:47:37.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff018026040 con 0x7ff01c0e0040 2024-05-09T09:47:37.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x55d085320d70 2024-05-09T09:47:37.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff01c0aaae0 con 0x55d085320d70 2024-05-09T09:47:37.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x55d08531c490 2024-05-09T09:47:37.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff020072030 con 0x55d08531c490 2024-05-09T09:47:37.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x55d085317b00 2024-05-09T09:47:37.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff018026040 con 0x55d085317b00 2024-05-09T09:47:37.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d08531b730 con 0x7ff01c0e0040 2024-05-09T09:47:37.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff018026040 con 0x7ff01c0e0040 2024-05-09T09:47:37.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff029504980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:37.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff029504980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:37.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff029504980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:37.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff029504980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:37.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff029504980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:37.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff029504980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:37.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff029504980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d08531f650 con 0x55d085317b00 2024-05-09T09:47:37.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff018026040 con 0x55d085317b00 2024-05-09T09:47:37.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff029504980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:37.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff029504980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d08531f650 con 0x55d085317b00 2024-05-09T09:47:37.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff018026040 con 0x55d085317b00 2024-05-09T09:47:37.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff029504980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:37.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff029504980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d08531f650 con 0x55d085320d70 2024-05-09T09:47:37.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff01c0aaae0 con 0x55d085320d70 2024-05-09T09:47:37.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff029504980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:37.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff029504980 20 zone default found 2024-05-09T09:47:37.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff029504980 4 Realm: () 2024-05-09T09:47:37.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff029504980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:37.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff029504980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:37.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff029504980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:37.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff029504980 20 zonegroup default 2024-05-09T09:47:37.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff029504980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.247+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d08531fef0 con 0x55d08531c490 2024-05-09T09:47:37.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.251+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff020072030 con 0x55d08531c490 2024-05-09T09:47:37.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.251+0000 7ff029504980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:37.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.251+0000 7ff029504980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.251+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d085325760 con 0x55d085320d70 2024-05-09T09:47:37.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.251+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff01c0aaae0 con 0x55d085320d70 2024-05-09T09:47:37.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.251+0000 7ff029504980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:37.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.251+0000 7ff029504980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.251+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d085325b00 con 0x55d085320d70 2024-05-09T09:47:37.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.251+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff01c0aaae0 con 0x55d085320d70 2024-05-09T09:47:37.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.251+0000 7ff029504980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:37.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.251+0000 7ff029504980 20 started sync module instance, tier type = 2024-05-09T09:47:37.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.251+0000 7ff029504980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:37.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.251+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085324c00 con 0x7ff01c0e0040 2024-05-09T09:47:37.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.251+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff018026040 con 0x7ff01c0e0040 2024-05-09T09:47:37.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.251+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94354076225792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085324c00 con 0x7ff01c0e0040 2024-05-09T09:47:37.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.251+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085326500 con 0x55d085317b00 2024-05-09T09:47:37.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.251+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94354076225792] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff018036040 con 0x7ff01c0e0040 2024-05-09T09:47:37.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.255+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff018036040 con 0x55d085317b00 2024-05-09T09:47:37.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.255+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94354076229648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085324c00 con 0x55d085317b00 2024-05-09T09:47:37.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.255+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085326f40 con 0x55d085320d70 2024-05-09T09:47:37.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.255+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94354076229648] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff018036040 con 0x55d085317b00 2024-05-09T09:47:37.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.255+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff01c0aaae0 con 0x55d085320d70 2024-05-09T09:47:37.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.255+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94354076223312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085324b70 con 0x55d085320d70 2024-05-09T09:47:37.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.255+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085327c40 con 0x7ff01c0e0040 2024-05-09T09:47:37.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.259+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff018036040 con 0x7ff01c0e0040 2024-05-09T09:47:37.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.259+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94354076235936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085328330 con 0x7ff01c0e0040 2024-05-09T09:47:37.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.259+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085328e50 con 0x55d085317b00 2024-05-09T09:47:37.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.259+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94354076223312] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff01c0aaae0 con 0x55d085320d70 2024-05-09T09:47:37.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.259+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94354076235936] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff018036040 con 0x7ff01c0e0040 2024-05-09T09:47:37.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.259+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff018036040 con 0x55d085317b00 2024-05-09T09:47:37.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.259+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94354076240160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085328e10 con 0x55d085317b00 2024-05-09T09:47:37.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.259+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085329240 con 0x55d08531c490 2024-05-09T09:47:37.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.263+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94354076240160] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff018036040 con 0x55d085317b00 2024-05-09T09:47:37.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.263+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff020072030 con 0x55d08531c490 2024-05-09T09:47:37.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.263+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94354076234464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085329630 con 0x55d08531c490 2024-05-09T09:47:37.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.263+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085329f00 con 0x55d08531c490 2024-05-09T09:47:37.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.263+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff020072030 con 0x55d08531c490 2024-05-09T09:47:37.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.263+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94354076246688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d08532ab70 con 0x55d08531c490 2024-05-09T09:47:37.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.263+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d08532b5a0 con 0x55d08531c490 2024-05-09T09:47:37.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.263+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94354076234464] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff020072030 con 0x55d08531c490 2024-05-09T09:47:37.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.267+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94354076246688] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff020072030 con 0x55d08531c490 2024-05-09T09:47:37.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.267+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff020072030 con 0x55d08531c490 2024-05-09T09:47:37.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.267+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94354076237184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d08532a700 con 0x55d08531c490 2024-05-09T09:47:37.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.267+0000 7ff029504980 20 add_watcher() i=0 2024-05-09T09:47:37.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.267+0000 7ff029504980 20 add_watcher() i=1 2024-05-09T09:47:37.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.267+0000 7ff029504980 20 add_watcher() i=2 2024-05-09T09:47:37.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.267+0000 7ff029504980 20 add_watcher() i=3 2024-05-09T09:47:37.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.267+0000 7ff029504980 20 add_watcher() i=4 2024-05-09T09:47:37.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.267+0000 7ff029504980 20 add_watcher() i=5 2024-05-09T09:47:37.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.267+0000 7ff029504980 20 add_watcher() i=6 2024-05-09T09:47:37.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.267+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94354076237184] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff020072030 con 0x55d08531c490 2024-05-09T09:47:37.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.267+0000 7ff029504980 20 add_watcher() i=7 2024-05-09T09:47:37.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.267+0000 7ff029504980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:37.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.267+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d08532e6a0 con 0x55d085317b00 2024-05-09T09:47:37.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.267+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff018036040 con 0x55d085317b00 2024-05-09T09:47:37.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.267+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94354076250288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d08532bb20 con 0x55d085317b00 2024-05-09T09:47:37.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.271+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94354076250288] v30'159 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff018036040 con 0x55d085317b00 2024-05-09T09:47:37.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.271+0000 7feedcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:37.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.271+0000 7ff029504980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:37.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.271+0000 7ff029504980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:37.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.271+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085336ae0 con 0x55d085317b00 2024-05-09T09:47:37.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.271+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'43 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff018036040 con 0x55d085317b00 2024-05-09T09:47:37.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.271+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085337130 con 0x55d08531c490 2024-05-09T09:47:37.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.275+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'37 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff020072030 con 0x55d08531c490 2024-05-09T09:47:37.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.275+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085337130 con 0x55d085320d70 2024-05-09T09:47:37.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.275+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'37 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff01c0aaae0 con 0x55d085320d70 2024-05-09T09:47:37.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.275+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085337740 con 0x55d085317b00 2024-05-09T09:47:37.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.279+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'160 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff018036040 con 0x55d085317b00 2024-05-09T09:47:37.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.279+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085337bf0 con 0x7ff01c0e0040 2024-05-09T09:47:37.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.279+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'101 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff018036040 con 0x7ff01c0e0040 2024-05-09T09:47:37.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.279+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085338160 con 0x55d085320d70 2024-05-09T09:47:37.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.279+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'67 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff01c0aaae0 con 0x55d085320d70 2024-05-09T09:47:37.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.279+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085338610 con 0x55d085317b00 2024-05-09T09:47:37.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.283+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'39 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff018036040 con 0x55d085317b00 2024-05-09T09:47:37.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.283+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085334a90 con 0x55d08531c490 2024-05-09T09:47:37.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.287+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'67 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff020072030 con 0x55d08531c490 2024-05-09T09:47:37.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.287+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085334a90 con 0x7ff01c0e0040 2024-05-09T09:47:37.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.287+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'37 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff018036040 con 0x7ff01c0e0040 2024-05-09T09:47:37.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.287+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085334a90 con 0x55d085320d70 2024-05-09T09:47:37.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.287+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'43 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff01c0aaae0 con 0x55d085320d70 2024-05-09T09:47:37.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.287+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085334a90 con 0x7ff01c0e0040 2024-05-09T09:47:37.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.291+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'102 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff018036040 con 0x7ff01c0e0040 2024-05-09T09:47:37.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.291+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085334a90 con 0x55d08531c490 2024-05-09T09:47:37.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.291+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'39 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff020072030 con 0x55d08531c490 2024-05-09T09:47:37.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.291+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085334b80 con 0x7ff01c0e0040 2024-05-09T09:47:37.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.295+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'37 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff018036040 con 0x7ff01c0e0040 2024-05-09T09:47:37.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.295+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085334b80 con 0x55d08531c490 2024-05-09T09:47:37.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.295+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'73 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff020072030 con 0x55d08531c490 2024-05-09T09:47:37.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.295+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085334b20 con 0x55d085317b00 2024-05-09T09:47:37.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.299+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'161 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff018036040 con 0x55d085317b00 2024-05-09T09:47:37.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.299+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085334b20 con 0x55d085320d70 2024-05-09T09:47:37.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.299+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'95 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff01c0aaae0 con 0x55d085320d70 2024-05-09T09:47:37.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.299+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085334b20 con 0x7ff01c0e0040 2024-05-09T09:47:37.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.303+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'103 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff018036040 con 0x7ff01c0e0040 2024-05-09T09:47:37.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.303+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085334b20 con 0x55d085320d70 2024-05-09T09:47:37.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.303+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'37 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff01c0aaae0 con 0x55d085320d70 2024-05-09T09:47:37.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.303+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085334b20 con 0x55d085317b00 2024-05-09T09:47:37.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.307+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'45 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff018036040 con 0x55d085317b00 2024-05-09T09:47:37.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.307+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085334b20 con 0x55d085317b00 2024-05-09T09:47:37.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.307+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'162 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff018036040 con 0x55d085317b00 2024-05-09T09:47:37.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.307+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085334b20 con 0x55d085320d70 2024-05-09T09:47:37.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.307+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'96 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff01c0aaae0 con 0x55d085320d70 2024-05-09T09:47:37.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.307+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085334b20 con 0x7ff01c0e0040 2024-05-09T09:47:37.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.311+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'47 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff018036040 con 0x7ff01c0e0040 2024-05-09T09:47:37.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.311+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085334b20 con 0x55d085320d70 2024-05-09T09:47:37.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.311+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'39 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff01c0aaae0 con 0x55d085320d70 2024-05-09T09:47:37.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.311+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085334b20 con 0x55d085320d70 2024-05-09T09:47:37.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.315+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'43 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff01c0aaae0 con 0x55d085320d70 2024-05-09T09:47:37.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.315+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085334b20 con 0x55d085320d70 2024-05-09T09:47:37.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.315+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'33 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff01c0aaae0 con 0x55d085320d70 2024-05-09T09:47:37.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.315+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085334b20 con 0x55d085320d70 2024-05-09T09:47:37.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.315+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'68 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff01c0aaae0 con 0x55d085320d70 2024-05-09T09:47:37.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.315+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0853394f0 con 0x55d08531c490 2024-05-09T09:47:37.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.319+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'39 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff020072030 con 0x55d08531c490 2024-05-09T09:47:37.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.319+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0853394f0 con 0x55d085320d70 2024-05-09T09:47:37.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.319+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'37 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff01c0aaae0 con 0x55d085320d70 2024-05-09T09:47:37.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.319+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0853394f0 con 0x55d08531c490 2024-05-09T09:47:37.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.323+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'68 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff020072030 con 0x55d08531c490 2024-05-09T09:47:37.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.323+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0853394f0 con 0x55d085320d70 2024-05-09T09:47:37.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.327+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'97 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff01c0aaae0 con 0x55d085320d70 2024-05-09T09:47:37.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.327+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0853394f0 con 0x55d08531c490 2024-05-09T09:47:37.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.327+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'74 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff020072030 con 0x55d08531c490 2024-05-09T09:47:37.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.331+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d0853394f0 con 0x7ff01c0e0040 2024-05-09T09:47:37.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.331+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'43 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff018036040 con 0x7ff01c0e0040 2024-05-09T09:47:37.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.331+0000 7fee577fe640 20 reqs_thread_entry: start 2024-05-09T09:47:37.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.331+0000 7ff029504980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:37.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.335+0000 7fee557fa640 20 reqs_thread_entry: start 2024-05-09T09:47:37.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.335+0000 7ff029504980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.335+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d0853549d0 con 0x55d085317b00 2024-05-09T09:47:37.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.335+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff018036040 con 0x55d085317b00 2024-05-09T09:47:37.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.335+0000 7ff029504980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:47:37.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.335+0000 7ff029504980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.335+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d085333860 con 0x55d085317b00 2024-05-09T09:47:37.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.335+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(95 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff018036040 con 0x55d085317b00 2024-05-09T09:47:37.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.335+0000 7ff029504980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:47:37.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.335+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:96 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d085333830 con 0x7ff01c0e0040 2024-05-09T09:47:37.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.335+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(96 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7ff018036040 con 0x7ff01c0e0040 2024-05-09T09:47:37.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.335+0000 7feedcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:37.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.335+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94354076250288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085333800 con 0x55d085317b00 2024-05-09T09:47:37.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.339+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(97 data_loggenerations_metadata [watch unwatch cookie 94354076250288] v30'163 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff018036040 con 0x55d085317b00 2024-05-09T09:47:37.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.339+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:98 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94354076225792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085333800 con 0x7ff01c0e0040 2024-05-09T09:47:37.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.339+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(98 notify.0 [watch unwatch cookie 94354076225792] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff018036040 con 0x7ff01c0e0040 2024-05-09T09:47:37.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.339+0000 7ff029504980 20 remove_watcher() i=0 2024-05-09T09:47:37.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.339+0000 7ff029504980 2 removed watcher, disabling cache 2024-05-09T09:47:37.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.339+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:99 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94354076229648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085333800 con 0x55d085317b00 2024-05-09T09:47:37.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.343+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(99 notify.1 [watch unwatch cookie 94354076229648] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff018036040 con 0x55d085317b00 2024-05-09T09:47:37.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.343+0000 7ff029504980 20 remove_watcher() i=1 2024-05-09T09:47:37.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.343+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:100 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94354076223312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085333800 con 0x55d085320d70 2024-05-09T09:47:37.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.343+0000 7ff02681e640 1 -- 172.21.15.157:0/4223138673 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(100 notify.2 [watch unwatch cookie 94354076223312] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff01c0aaae0 con 0x55d085320d70 2024-05-09T09:47:37.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.343+0000 7ff029504980 20 remove_watcher() i=2 2024-05-09T09:47:37.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.343+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:101 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94354076235936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085333800 con 0x7ff01c0e0040 2024-05-09T09:47:37.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.347+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(101 notify.3 [watch unwatch cookie 94354076235936] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff018036040 con 0x7ff01c0e0040 2024-05-09T09:47:37.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.347+0000 7ff029504980 20 remove_watcher() i=3 2024-05-09T09:47:37.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.347+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94354076240160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085333800 con 0x55d085317b00 2024-05-09T09:47:37.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.347+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(102 notify.4 [watch unwatch cookie 94354076240160] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff018036040 con 0x55d085317b00 2024-05-09T09:47:37.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.347+0000 7ff029504980 20 remove_watcher() i=4 2024-05-09T09:47:37.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.347+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94354076234464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085333800 con 0x55d08531c490 2024-05-09T09:47:37.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.351+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(103 notify.5 [watch unwatch cookie 94354076234464] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff020072030 con 0x55d08531c490 2024-05-09T09:47:37.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.351+0000 7ff029504980 20 remove_watcher() i=5 2024-05-09T09:47:37.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.351+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94354076246688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085333800 con 0x55d08531c490 2024-05-09T09:47:37.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.351+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(104 notify.6 [watch unwatch cookie 94354076246688] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff020072030 con 0x55d08531c490 2024-05-09T09:47:37.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.351+0000 7ff029504980 20 remove_watcher() i=6 2024-05-09T09:47:37.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.351+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:105 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94354076237184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d085333800 con 0x55d08531c490 2024-05-09T09:47:37.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff02701f640 1 -- 172.21.15.157:0/4223138673 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(105 notify.7 [watch unwatch cookie 94354076237184] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff020072030 con 0x55d08531c490 2024-05-09T09:47:37.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 20 remove_watcher() i=7 2024-05-09T09:47:37.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d08531c490 msgr2=0x55d08531e880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 --2- 172.21.15.157:0/4223138673 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d08531c490 0x55d08531e880 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d085317b00 msgr2=0x55d085319f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 --2- 172.21.15.157:0/4223138673 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d085317b00 0x55d085319f90 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7ff01c0e0040 msgr2=0x7ff01c0e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 --2- 172.21.15.157:0/4223138673 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7ff01c0e0040 0x7ff01c0e0420 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d085320d70 msgr2=0x55d085323230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 --2- 172.21.15.157:0/4223138673 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d085320d70 0x55d085323230 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7feef0034bb0 msgr2=0x7feef0037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 --2- 172.21.15.157:0/4223138673 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7feef0034bb0 0x7feef0037070 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff01c0aa910 tx=0x7ff01c0c1040 comp rx=0 tx=0).stop 2024-05-09T09:47:37.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff027820640 1 -- 172.21.15.157:0/4223138673 reap_dead start 2024-05-09T09:47:37.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d085303ee0 msgr2=0x55d08530b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 --2- 172.21.15.157:0/4223138673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d085303ee0 0x55d08530b200 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff020004f10 tx=0x7ff020028150 comp rx=0 tx=0).stop 2024-05-09T09:47:37.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 shutdown_connections 2024-05-09T09:47:37.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 --2- 172.21.15.157:0/4223138673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d085303ee0 0x55d08530b200 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 >> 172.21.15.157:0/4223138673 conn(0x55d085300260 msgr2=0x55d0852fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:37.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 shutdown_connections 2024-05-09T09:47:37.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 -- 172.21.15.157:0/4223138673 wait complete. 2024-05-09T09:47:37.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 -- 172.21.15.157:0/3341785368 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fef00034c00 msgr2=0x7fef000370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 --2- 172.21.15.157:0/3341785368 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fef00034c00 0x7fef000370c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff01c0ac040 tx=0x7ff01c005ad0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 -- 172.21.15.157:0/3341785368 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0852f7130 msgr2=0x55d0852f7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 --2- 172.21.15.157:0/3341785368 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0852f7130 0x55d0852f7550 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff020012fd0 tx=0x7ff02000f380 comp rx=0 tx=0).stop 2024-05-09T09:47:37.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 -- 172.21.15.157:0/3341785368 shutdown_connections 2024-05-09T09:47:37.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 --2- 172.21.15.157:0/3341785368 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fef00034c00 0x7fef000370c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 --2- 172.21.15.157:0/3341785368 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0852f7130 0x55d0852f7550 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 -- 172.21.15.157:0/3341785368 >> 172.21.15.157:0/3341785368 conn(0x55d0852ebf00 msgr2=0x55d0852eca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:37.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 -- 172.21.15.157:0/3341785368 shutdown_connections 2024-05-09T09:47:37.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 -- 172.21.15.157:0/3341785368 wait complete. 2024-05-09T09:47:37.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 -- 172.21.15.157:0/593815929 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d0852ca890 msgr2=0x55d0852ccc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 --2- 172.21.15.157:0/593815929 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d0852ca890 0x55d0852ccc80 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 -- 172.21.15.157:0/593815929 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d0851d3030 msgr2=0x55d0852c7ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 --2- 172.21.15.157:0/593815929 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d0851d3030 0x55d0852c7ef0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 -- 172.21.15.157:0/593815929 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d0852ce790 msgr2=0x55d0852d0b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 --2- 172.21.15.157:0/593815929 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d0852ce790 0x55d0852d0b80 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 -- 172.21.15.157:0/593815929 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fef0c034bb0 msgr2=0x7fef0c037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 --2- 172.21.15.157:0/593815929 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fef0c034bb0 0x7fef0c037070 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff01c0ae000 tx=0x7ff01c0a6000 comp rx=0 tx=0).stop 2024-05-09T09:47:37.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 -- 172.21.15.157:0/593815929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0851ceb30 msgr2=0x55d0852c0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 --2- 172.21.15.157:0/593815929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d0851ceb30 0x55d0852c0f50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x55d0852babc0 tx=0x7ff020000f50 comp rx=0 tx=0).stop 2024-05-09T09:47:37.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff027820640 1 -- 172.21.15.157:0/593815929 reap_dead start 2024-05-09T09:47:37.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 -- 172.21.15.157:0/593815929 shutdown_connections 2024-05-09T09:47:37.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 -- 172.21.15.157:0/593815929 >> 172.21.15.157:0/593815929 conn(0x55d085142250 msgr2=0x55d0852b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:37.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 -- 172.21.15.157:0/593815929 shutdown_connections 2024-05-09T09:47:37.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.355+0000 7ff029504980 1 -- 172.21.15.157:0/593815929 wait complete. 2024-05-09T09:47:37.370 INFO:teuthology.orchestra.run.smithi157.stdout:[] 2024-05-09T09:47:37.370 DEBUG:tasks.util.rgw: json result: [] 2024-05-09T09:47:37.464 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-09T09:47:37.465 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-05-09T09:47:37.465 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-05-09T09:47:37.465 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-05-09T09:47:37.503 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:37.503 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:37.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.503+0000 7f039dc61980 1 Processor -- start 2024-05-09T09:47:37.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.503+0000 7f039dc61980 1 -- start start 2024-05-09T09:47:37.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.507+0000 7f039dc61980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5607ef620b30 0x5607ef620f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.507+0000 7f039dc61980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5607ef4d4440 con 0x5607ef621450 2024-05-09T09:47:37.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.507+0000 7f039dc61980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5607ef4bf5f0 con 0x5607ef620b30 2024-05-09T09:47:37.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.507+0000 7f039b77c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5607ef620b30 0x5607ef620f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.507+0000 7f039b77c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5607ef620b30 0x5607ef620f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58520/0 (socket says 172.21.15.157:58520) 2024-05-09T09:47:37.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.507+0000 7f039af7b640 1 --1- 172.21.15.157:0/2734639327 >> v1:172.21.15.110:6789/0 conn(0x5607ef621450 0x5607ef621e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:51642/0 (socket says 172.21.15.157:51642) 2024-05-09T09:47:37.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.507+0000 7f039b77c640 1 -- 172.21.15.157:0/2734639327 learned_addr learned my addr 172.21.15.157:0/2734639327 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:37.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.507+0000 7f039b77c640 1 -- 172.21.15.157:0/2734639327 >> v1:172.21.15.110:6789/0 conn(0x5607ef621450 legacy=0x5607ef621e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.507+0000 7f039b77c640 1 -- 172.21.15.157:0/2734639327 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607ef4ca990 con 0x5607ef620b30 2024-05-09T09:47:37.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.511+0000 7f039b77c640 1 --2- 172.21.15.157:0/2734639327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef620b30 0x5607ef620f10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f039400a4e0 tx=0x7f039401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ace11ebbabcf9338 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.511+0000 7f039a77a640 1 -- 172.21.15.157:0/2734639327 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03940aa540 con 0x5607ef620b30 2024-05-09T09:47:37.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.511+0000 7f039a77a640 1 -- 172.21.15.157:0/2734639327 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03940aa6e0 con 0x5607ef620b30 2024-05-09T09:47:37.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.511+0000 7f039a77a640 1 -- 172.21.15.157:0/2734639327 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03940aaa40 con 0x5607ef620b30 2024-05-09T09:47:37.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.511+0000 7f039dc61980 1 -- 172.21.15.157:0/2734639327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef620b30 msgr2=0x5607ef620f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.511+0000 7f039dc61980 1 --2- 172.21.15.157:0/2734639327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef620b30 0x5607ef620f10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f039400a4e0 tx=0x7f039401b090 comp rx=0 tx=0).stop 2024-05-09T09:47:37.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.511+0000 7f039dc61980 1 -- 172.21.15.157:0/2734639327 shutdown_connections 2024-05-09T09:47:37.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.511+0000 7f039dc61980 1 --2- 172.21.15.157:0/2734639327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef620b30 0x5607ef620f10 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.511+0000 7f039dc61980 1 -- 172.21.15.157:0/2734639327 >> 172.21.15.157:0/2734639327 conn(0x5607ef594250 msgr2=0x5607ef594660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:37.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.511+0000 7f039dc61980 1 -- 172.21.15.157:0/2734639327 shutdown_connections 2024-05-09T09:47:37.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.511+0000 7f039dc61980 1 -- 172.21.15.157:0/2734639327 wait complete. 2024-05-09T09:47:37.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.527+0000 7f039dc61980 1 Processor -- start 2024-05-09T09:47:37.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.527+0000 7f039dc61980 1 -- start start 2024-05-09T09:47:37.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.527+0000 7f039dc61980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef620b30 0x5607ef70c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.527+0000 7f039dc61980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5607ef521fe0 con 0x5607ef620b30 2024-05-09T09:47:37.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.527+0000 7f039b77c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef620b30 0x5607ef70c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.527+0000 7f039b77c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef620b30 0x5607ef70c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58528/0 (socket says 172.21.15.157:58528) 2024-05-09T09:47:37.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.527+0000 7f039b77c640 1 -- 172.21.15.157:0/2548138206 learned_addr learned my addr 172.21.15.157:0/2548138206 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:37.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.527+0000 7f039b77c640 1 -- 172.21.15.157:0/2548138206 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607ef4a6ae0 con 0x5607ef620b30 2024-05-09T09:47:37.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.527+0000 7f039b77c640 1 --2- 172.21.15.157:0/2548138206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef620b30 0x5607ef70c450 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0394018cc0 tx=0x7f03940033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5466995e66250dfd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.527+0000 7f028960a640 1 -- 172.21.15.157:0/2548138206 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03940b9070 con 0x5607ef620b30 2024-05-09T09:47:37.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.527+0000 7f028960a640 1 -- 172.21.15.157:0/2548138206 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03940aaa80 con 0x5607ef620b30 2024-05-09T09:47:37.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.527+0000 7f028960a640 1 -- 172.21.15.157:0/2548138206 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03940aad60 con 0x5607ef620b30 2024-05-09T09:47:37.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.531+0000 7f039dc61980 1 -- 172.21.15.157:0/2548138206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef620b30 msgr2=0x5607ef70c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.531+0000 7f039dc61980 1 --2- 172.21.15.157:0/2548138206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef620b30 0x5607ef70c450 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0394018cc0 tx=0x7f03940033b0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.531+0000 7f039dc61980 1 -- 172.21.15.157:0/2548138206 shutdown_connections 2024-05-09T09:47:37.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.531+0000 7f039dc61980 1 --2- 172.21.15.157:0/2548138206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef620b30 0x5607ef70c450 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.531+0000 7f039dc61980 1 -- 172.21.15.157:0/2548138206 >> 172.21.15.157:0/2548138206 conn(0x5607ef594250 msgr2=0x5607ef707fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:37.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.531+0000 7f039dc61980 1 -- 172.21.15.157:0/2548138206 shutdown_connections 2024-05-09T09:47:37.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.531+0000 7f039dc61980 1 -- 172.21.15.157:0/2548138206 wait complete. 2024-05-09T09:47:37.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.531+0000 7f039dc61980 1 Processor -- start 2024-05-09T09:47:37.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.531+0000 7f039dc61980 1 -- start start 2024-05-09T09:47:37.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.531+0000 7f039dc61980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef620b30 0x5607ef713470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.531+0000 7f039dc61980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5607ef62ab70 con 0x5607ef620b30 2024-05-09T09:47:37.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.531+0000 7f039b77c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef620b30 0x5607ef713470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.531+0000 7f039b77c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef620b30 0x5607ef713470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58544/0 (socket says 172.21.15.157:58544) 2024-05-09T09:47:37.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.531+0000 7f039b77c640 1 -- 172.21.15.157:0/4027150288 learned_addr learned my addr 172.21.15.157:0/4027150288 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:37.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.531+0000 7f039b77c640 1 -- 172.21.15.157:0/4027150288 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607ef7139b0 con 0x5607ef620b30 2024-05-09T09:47:37.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.531+0000 7f039b77c640 1 --2- 172.21.15.157:0/4027150288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef620b30 0x5607ef713470 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f039401aec0 tx=0x7f0394017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.531+0000 7f0287e07640 1 -- 172.21.15.157:0/4027150288 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03940b9070 con 0x5607ef620b30 2024-05-09T09:47:37.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.531+0000 7f0287e07640 1 -- 172.21.15.157:0/4027150288 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03940c7410 con 0x5607ef620b30 2024-05-09T09:47:37.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.531+0000 7f039dc61980 1 -- 172.21.15.157:0/4027150288 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5607ef713c40 con 0x5607ef620b30 2024-05-09T09:47:37.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.531+0000 7f0287e07640 1 -- 172.21.15.157:0/4027150288 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03940c76f0 con 0x5607ef620b30 2024-05-09T09:47:37.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.531+0000 7f039dc61980 1 -- 172.21.15.157:0/4027150288 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607ef7168d0 con 0x5607ef620b30 2024-05-09T09:47:37.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.535+0000 7f0287e07640 1 -- 172.21.15.157:0/4027150288 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f03940b3040 con 0x5607ef620b30 2024-05-09T09:47:37.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.535+0000 7f0287e07640 1 --2- 172.21.15.157:0/4027150288 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0280034bb0 0x7f0280037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.535+0000 7f0287e07640 1 -- 172.21.15.157:0/4027150288 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f03940c4070 con 0x5607ef620b30 2024-05-09T09:47:37.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.535+0000 7f039af7b640 1 --2- 172.21.15.157:0/4027150288 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0280034bb0 0x7f0280037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.535+0000 7f039dc61980 1 --2- 172.21.15.157:0/4027150288 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5607ef621450 0x5607ef71a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.535+0000 7f039dc61980 1 -- 172.21.15.157:0/4027150288 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607ef71aa60 con 0x5607ef621450 2024-05-09T09:47:37.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.535+0000 7f039bf7d640 1 --2- 172.21.15.157:0/4027150288 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5607ef621450 0x5607ef71a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.535+0000 7f039af7b640 1 --2- 172.21.15.157:0/4027150288 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0280034bb0 0x7f0280037070 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0390000f70 tx=0x7f0390001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.535+0000 7f039bf7d640 1 --2- 172.21.15.157:0/4027150288 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5607ef621450 0x5607ef71a520 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.535+0000 7f039bf7d640 1 -- 172.21.15.157:0/4027150288 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f038c0083f0 con 0x5607ef621450 2024-05-09T09:47:37.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.535+0000 7f039dc61980 1 -- 172.21.15.157:0/4027150288 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607ef717af0 con 0x5607ef621450 2024-05-09T09:47:37.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.535+0000 7f039bf7d640 1 -- 172.21.15.157:0/4027150288 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f038c0083f0 con 0x5607ef621450 2024-05-09T09:47:37.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.535+0000 7f039dc61980 1 --2- 172.21.15.157:0/4027150288 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5607ef71cdb0 0x5607ef71f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.535+0000 7f039dc61980 1 -- 172.21.15.157:0/4027150288 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607ef71f890 con 0x5607ef71cdb0 2024-05-09T09:47:37.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.535+0000 7f039b77c640 1 --2- 172.21.15.157:0/4027150288 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5607ef71cdb0 0x5607ef71f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.535+0000 7f039b77c640 1 --2- 172.21.15.157:0/4027150288 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5607ef71cdb0 0x5607ef71f1a0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.539+0000 7f039b77c640 1 -- 172.21.15.157:0/4027150288 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f03940cd060 con 0x5607ef71cdb0 2024-05-09T09:47:37.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.539+0000 7f039dc61980 1 -- 172.21.15.157:0/4027150288 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607ef71bc50 con 0x5607ef621450 2024-05-09T09:47:37.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.539+0000 7f039bf7d640 1 -- 172.21.15.157:0/4027150288 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f038c0083f0 con 0x5607ef621450 2024-05-09T09:47:37.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.539+0000 7f039dc61980 1 --2- 172.21.15.157:0/4027150288 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5607ef720cf0 0x5607ef7230e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.539+0000 7f039dc61980 1 -- 172.21.15.157:0/4027150288 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607ef723820 con 0x5607ef720cf0 2024-05-09T09:47:37.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.539+0000 7f039af7b640 1 --2- 172.21.15.157:0/4027150288 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5607ef720cf0 0x5607ef7230e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.539+0000 7f039af7b640 1 --2- 172.21.15.157:0/4027150288 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5607ef720cf0 0x5607ef7230e0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.539+0000 7f039af7b640 1 -- 172.21.15.157:0/4027150288 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f039000f6a0 con 0x5607ef720cf0 2024-05-09T09:47:37.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.543+0000 7f039dc61980 1 Processor -- start 2024-05-09T09:47:37.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.543+0000 7f039dc61980 1 -- start start 2024-05-09T09:47:37.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.543+0000 7f039dc61980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef7498a0 0x5607ef749cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.543+0000 7f039dc61980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5607ef526020 con 0x5607ef7498a0 2024-05-09T09:47:37.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.543+0000 7f039b77c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef7498a0 0x5607ef749cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.543+0000 7f039b77c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef7498a0 0x5607ef749cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58546/0 (socket says 172.21.15.157:58546) 2024-05-09T09:47:37.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.543+0000 7f039b77c640 1 -- 172.21.15.157:0/1246404478 learned_addr learned my addr 172.21.15.157:0/1246404478 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:37.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.543+0000 7f039b77c640 1 -- 172.21.15.157:0/1246404478 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607ef74a200 con 0x5607ef7498a0 2024-05-09T09:47:37.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.543+0000 7f039b77c640 1 --2- 172.21.15.157:0/1246404478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef7498a0 0x5607ef749cc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f03940ac010 tx=0x7f03940c64a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.543+0000 7f027ffff640 1 -- 172.21.15.157:0/1246404478 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03940df030 con 0x5607ef7498a0 2024-05-09T09:47:37.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.543+0000 7f039dc61980 1 -- 172.21.15.157:0/1246404478 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5607ef74ac90 con 0x5607ef7498a0 2024-05-09T09:47:37.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.543+0000 7f027ffff640 1 -- 172.21.15.157:0/1246404478 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03940c6530 con 0x5607ef7498a0 2024-05-09T09:47:37.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.543+0000 7f039dc61980 1 -- 172.21.15.157:0/1246404478 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607ef74ac90 con 0x5607ef7498a0 2024-05-09T09:47:37.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.543+0000 7f027ffff640 1 -- 172.21.15.157:0/1246404478 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03940c66e0 con 0x5607ef7498a0 2024-05-09T09:47:37.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.547+0000 7f027ffff640 1 -- 172.21.15.157:0/1246404478 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f03940e2030 con 0x5607ef7498a0 2024-05-09T09:47:37.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.547+0000 7f027ffff640 1 --2- 172.21.15.157:0/1246404478 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0274034c00 0x7f02740370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.547+0000 7f027ffff640 1 -- 172.21.15.157:0/1246404478 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f03940e0070 con 0x5607ef7498a0 2024-05-09T09:47:37.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.547+0000 7f039af7b640 1 --2- 172.21.15.157:0/1246404478 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0274034c00 0x7f02740370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.547+0000 7f039dc61980 1 Processor -- start 2024-05-09T09:47:37.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.547+0000 7f039dc61980 1 -- start start 2024-05-09T09:47:37.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.547+0000 7f039af7b640 1 --2- 172.21.15.157:0/1246404478 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0274034c00 0x7f02740370c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x5607ef71af30 tx=0x7f039000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.547+0000 7f039dc61980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef756740 0x5607ef756b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.547+0000 7f039dc61980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5607ef70cae0 con 0x5607ef756740 2024-05-09T09:47:37.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.547+0000 7f039b77c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef756740 0x5607ef756b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.547+0000 7f039b77c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef756740 0x5607ef756b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58554/0 (socket says 172.21.15.157:58554) 2024-05-09T09:47:37.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.547+0000 7f039b77c640 1 -- 172.21.15.157:0/4021944097 learned_addr learned my addr 172.21.15.157:0/4021944097 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:37.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.547+0000 7f039b77c640 1 -- 172.21.15.157:0/4021944097 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607ef757110 con 0x5607ef756740 2024-05-09T09:47:37.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.547+0000 7f039b77c640 1 --2- 172.21.15.157:0/4021944097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef756740 0x5607ef756b40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f03940ed7b0 tx=0x7f03940ed8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4169f1079ef7cc5d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.547+0000 7f027dffb640 1 -- 172.21.15.157:0/4021944097 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03940fb020 con 0x5607ef756740 2024-05-09T09:47:37.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.547+0000 7f027dffb640 1 -- 172.21.15.157:0/4021944097 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03940b2cf0 con 0x5607ef756740 2024-05-09T09:47:37.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.547+0000 7f027dffb640 1 -- 172.21.15.157:0/4021944097 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03940a6310 con 0x5607ef756740 2024-05-09T09:47:37.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.547+0000 7f039dc61980 1 -- 172.21.15.157:0/4021944097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef756740 msgr2=0x5607ef756b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.547+0000 7f039dc61980 1 --2- 172.21.15.157:0/4021944097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef756740 0x5607ef756b40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f03940ed7b0 tx=0x7f03940ed8a0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.547+0000 7f039dc61980 1 -- 172.21.15.157:0/4021944097 shutdown_connections 2024-05-09T09:47:37.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.547+0000 7f039dc61980 1 --2- 172.21.15.157:0/4021944097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef756740 0x5607ef756b40 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.547+0000 7f039dc61980 1 -- 172.21.15.157:0/4021944097 >> 172.21.15.157:0/4021944097 conn(0x5607ef752a70 msgr2=0x5607ef750ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:37.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.547+0000 7f039dc61980 1 -- 172.21.15.157:0/4021944097 shutdown_connections 2024-05-09T09:47:37.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.547+0000 7f039dc61980 1 -- 172.21.15.157:0/4021944097 wait complete. 2024-05-09T09:47:37.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.551+0000 7f039dc61980 1 Processor -- start 2024-05-09T09:47:37.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.551+0000 7f039dc61980 1 -- start start 2024-05-09T09:47:37.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.551+0000 7f039dc61980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef756740 0x5607ef75da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.551+0000 7f039dc61980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5607ef7577e0 con 0x5607ef756740 2024-05-09T09:47:37.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.551+0000 7f039b77c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef756740 0x5607ef75da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.551+0000 7f039b77c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef756740 0x5607ef75da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58556/0 (socket says 172.21.15.157:58556) 2024-05-09T09:47:37.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.551+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 learned_addr learned my addr 172.21.15.157:0/1274237334 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:37.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.551+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607ef75df70 con 0x5607ef756740 2024-05-09T09:47:37.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.551+0000 7f039b77c640 1 --2- 172.21.15.157:0/1274237334 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef756740 0x5607ef75da30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f03940ed7b0 tx=0x7f03940c4ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.551+0000 7f026bfff640 1 -- 172.21.15.157:0/1274237334 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f039410f070 con 0x5607ef756740 2024-05-09T09:47:37.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.551+0000 7f026bfff640 1 -- 172.21.15.157:0/1274237334 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03940da540 con 0x5607ef756740 2024-05-09T09:47:37.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.551+0000 7f026bfff640 1 -- 172.21.15.157:0/1274237334 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03940da820 con 0x5607ef756740 2024-05-09T09:47:37.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.551+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5607ef75df70 con 0x5607ef756740 2024-05-09T09:47:37.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.551+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607ef75df70 con 0x5607ef756740 2024-05-09T09:47:37.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.551+0000 7f039dc61980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.551+0000 7f026bfff640 1 -- 172.21.15.157:0/1274237334 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f0394112070 con 0x5607ef756740 2024-05-09T09:47:37.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.551+0000 7f026bfff640 1 --2- 172.21.15.157:0/1274237334 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0264034bb0 0x7f0264037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.551+0000 7f026bfff640 1 -- 172.21.15.157:0/1274237334 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f0394107070 con 0x5607ef756740 2024-05-09T09:47:37.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.551+0000 7f039af7b640 1 --2- 172.21.15.157:0/1274237334 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0264034bb0 0x7f0264037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.551+0000 7f039dc61980 1 --2- 172.21.15.157:0/1274237334 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5607ef76a560 0x5607ef76ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.551+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76d150 con 0x5607ef76a560 2024-05-09T09:47:37.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039bf7d640 1 --2- 172.21.15.157:0/1274237334 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5607ef76a560 0x5607ef76ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039af7b640 1 --2- 172.21.15.157:0/1274237334 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0264034bb0 0x7f0264037070 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f039000c010 tx=0x7f0390010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039bf7d640 1 --2- 172.21.15.157:0/1274237334 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5607ef76a560 0x5607ef76ca00 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f038c0083f0 con 0x5607ef76a560 2024-05-09T09:47:37.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039dc61980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:37.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039dc61980 20 realm 2024-05-09T09:47:37.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039dc61980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76d560 con 0x5607ef76a560 2024-05-09T09:47:37.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f038c0083f0 con 0x5607ef76a560 2024-05-09T09:47:37.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039dc61980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:37.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039dc61980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:37.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039dc61980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76de00 con 0x5607ef76a560 2024-05-09T09:47:37.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f038c0083f0 con 0x5607ef76a560 2024-05-09T09:47:37.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039dc61980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:37.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039dc61980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x5607ef76a560 2024-05-09T09:47:37.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f038c0083f0 con 0x5607ef76a560 2024-05-09T09:47:37.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039dc61980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:37.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039dc61980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039dc61980 1 --2- 172.21.15.157:0/1274237334 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5607ef76ef00 0x5607ef7712f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607ef771830 con 0x5607ef76ef00 2024-05-09T09:47:37.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039b77c640 1 --2- 172.21.15.157:0/1274237334 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5607ef76ef00 0x5607ef7712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039b77c640 1 --2- 172.21.15.157:0/1274237334 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5607ef76ef00 0x5607ef7712f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0394111030 con 0x5607ef76ef00 2024-05-09T09:47:37.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039dc61980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:37.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039dc61980 20 searching for the correct realm 2024-05-09T09:47:37.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039dc61980 1 --2- 172.21.15.157:0/1274237334 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5607ef7737a0 0x5607ef775c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef776330 con 0x5607ef7737a0 2024-05-09T09:47:37.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039af7b640 1 --2- 172.21.15.157:0/1274237334 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5607ef7737a0 0x5607ef775c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.555+0000 7f039af7b640 1 --2- 172.21.15.157:0/1274237334 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5607ef7737a0 0x5607ef775c60 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.559+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0390037040 con 0x5607ef7737a0 2024-05-09T09:47:37.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.559+0000 7f039af7b640 1 --2- 172.21.15.157:0/1274237334 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f039001fbe0 0x7f039003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.559+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef776330 con 0x7f039001fbe0 2024-05-09T09:47:37.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.559+0000 7f039bf7d640 1 --2- 172.21.15.157:0/1274237334 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f039001fbe0 0x7f039003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.559+0000 7f039bf7d640 1 --2- 172.21.15.157:0/1274237334 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f039001fbe0 0x7f039003a3c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.559+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f038c0083f0 con 0x7f039001fbe0 2024-05-09T09:47:37.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.559+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x5607ef76ef00 2024-05-09T09:47:37.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.559+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0394111030 con 0x5607ef76ef00 2024-05-09T09:47:37.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.559+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x5607ef76a560 2024-05-09T09:47:37.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.559+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f038c0083f0 con 0x5607ef76a560 2024-05-09T09:47:37.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.559+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x5607ef76a560 2024-05-09T09:47:37.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.559+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f038c026040 con 0x5607ef76a560 2024-05-09T09:47:37.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.559+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x5607ef76ef00 2024-05-09T09:47:37.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.559+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0394111030 con 0x5607ef76ef00 2024-05-09T09:47:37.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.559+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x5607ef76ef00 2024-05-09T09:47:37.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.563+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0394111030 con 0x5607ef76ef00 2024-05-09T09:47:37.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.563+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x7f039001fbe0 2024-05-09T09:47:37.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.563+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f038c026040 con 0x7f039001fbe0 2024-05-09T09:47:37.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.563+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x5607ef7737a0 2024-05-09T09:47:37.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.563+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0390037040 con 0x5607ef7737a0 2024-05-09T09:47:37.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.563+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x5607ef76a560 2024-05-09T09:47:37.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.563+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f038c026040 con 0x5607ef76a560 2024-05-09T09:47:37.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.563+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x5607ef76ef00 2024-05-09T09:47:37.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.563+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0394111030 con 0x5607ef76ef00 2024-05-09T09:47:37.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.563+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x5607ef76a560 2024-05-09T09:47:37.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.563+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f038c026040 con 0x5607ef76a560 2024-05-09T09:47:37.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.563+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x7f039001fbe0 2024-05-09T09:47:37.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.563+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f038c026040 con 0x7f039001fbe0 2024-05-09T09:47:37.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.563+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x5607ef7737a0 2024-05-09T09:47:37.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.563+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0390037040 con 0x5607ef7737a0 2024-05-09T09:47:37.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.563+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x5607ef7737a0 2024-05-09T09:47:37.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.563+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0390037040 con 0x5607ef7737a0 2024-05-09T09:47:37.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.563+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x5607ef76ef00 2024-05-09T09:47:37.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.567+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0394111030 con 0x5607ef76ef00 2024-05-09T09:47:37.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.567+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x5607ef7737a0 2024-05-09T09:47:37.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.567+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0390037040 con 0x5607ef7737a0 2024-05-09T09:47:37.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.567+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x5607ef7737a0 2024-05-09T09:47:37.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.567+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0390037040 con 0x5607ef7737a0 2024-05-09T09:47:37.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.567+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x5607ef76a560 2024-05-09T09:47:37.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.567+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f038c026040 con 0x5607ef76a560 2024-05-09T09:47:37.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.567+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x5607ef76a560 2024-05-09T09:47:37.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.567+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f038c026040 con 0x5607ef76a560 2024-05-09T09:47:37.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.567+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x5607ef76ef00 2024-05-09T09:47:37.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.567+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0394111030 con 0x5607ef76ef00 2024-05-09T09:47:37.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.567+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x5607ef7737a0 2024-05-09T09:47:37.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.567+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0390037040 con 0x5607ef7737a0 2024-05-09T09:47:37.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.567+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x7f039001fbe0 2024-05-09T09:47:37.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.567+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f038c026040 con 0x7f039001fbe0 2024-05-09T09:47:37.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.567+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x5607ef76a560 2024-05-09T09:47:37.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.567+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f038c026040 con 0x5607ef76a560 2024-05-09T09:47:37.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.567+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x5607ef76ef00 2024-05-09T09:47:37.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.571+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0394111030 con 0x5607ef76ef00 2024-05-09T09:47:37.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.571+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x5607ef7737a0 2024-05-09T09:47:37.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.571+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0390037040 con 0x5607ef7737a0 2024-05-09T09:47:37.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.571+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x5607ef76ef00 2024-05-09T09:47:37.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.571+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0394111030 con 0x5607ef76ef00 2024-05-09T09:47:37.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.571+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x7f039001fbe0 2024-05-09T09:47:37.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.571+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f038c026040 con 0x7f039001fbe0 2024-05-09T09:47:37.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.571+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x5607ef7737a0 2024-05-09T09:47:37.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.571+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0390037040 con 0x5607ef7737a0 2024-05-09T09:47:37.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.571+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x5607ef76ef00 2024-05-09T09:47:37.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.571+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0394111030 con 0x5607ef76ef00 2024-05-09T09:47:37.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.571+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x5607ef76a560 2024-05-09T09:47:37.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.571+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f038c026040 con 0x5607ef76a560 2024-05-09T09:47:37.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.571+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5607ef76e1a0 con 0x7f039001fbe0 2024-05-09T09:47:37.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.571+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f038c026040 con 0x7f039001fbe0 2024-05-09T09:47:37.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.571+0000 7f039dc61980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:37.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.571+0000 7f039dc61980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:37.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.571+0000 7f039dc61980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:37.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.571+0000 7f039dc61980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:37.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.571+0000 7f039dc61980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:37.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.571+0000 7f039dc61980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:37.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.571+0000 7f039dc61980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.571+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607ef772080 con 0x5607ef76a560 2024-05-09T09:47:37.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f038c026040 con 0x5607ef76a560 2024-05-09T09:47:37.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039dc61980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:37.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039dc61980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607ef772080 con 0x5607ef76a560 2024-05-09T09:47:37.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f038c026040 con 0x5607ef76a560 2024-05-09T09:47:37.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039dc61980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:37.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039dc61980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607ef772080 con 0x5607ef7737a0 2024-05-09T09:47:37.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f03900491c0 con 0x5607ef7737a0 2024-05-09T09:47:37.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039dc61980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:37.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039dc61980 20 zone default found 2024-05-09T09:47:37.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039dc61980 4 Realm: () 2024-05-09T09:47:37.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039dc61980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:37.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039dc61980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:37.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039dc61980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:37.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039dc61980 20 zonegroup default 2024-05-09T09:47:37.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039dc61980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607ef772920 con 0x5607ef76ef00 2024-05-09T09:47:37.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0394111030 con 0x5607ef76ef00 2024-05-09T09:47:37.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039dc61980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:37.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039dc61980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607ef778190 con 0x5607ef7737a0 2024-05-09T09:47:37.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f03900491c0 con 0x5607ef7737a0 2024-05-09T09:47:37.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039dc61980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:37.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039dc61980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607ef778530 con 0x5607ef7737a0 2024-05-09T09:47:37.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f03900491c0 con 0x5607ef7737a0 2024-05-09T09:47:37.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039dc61980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:37.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039dc61980 20 started sync module instance, tier type = 2024-05-09T09:47:37.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039dc61980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:37.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.575+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef777630 con 0x7f039001fbe0 2024-05-09T09:47:37.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.579+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f038c026040 con 0x7f039001fbe0 2024-05-09T09:47:37.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.579+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94592082344784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef777630 con 0x7f039001fbe0 2024-05-09T09:47:37.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.579+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef778f30 con 0x5607ef76a560 2024-05-09T09:47:37.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.579+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94592082344784] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f038c036040 con 0x7f039001fbe0 2024-05-09T09:47:37.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.579+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f038c036040 con 0x5607ef76a560 2024-05-09T09:47:37.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.579+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94592082348608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef777630 con 0x5607ef76a560 2024-05-09T09:47:37.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.579+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef779970 con 0x5607ef7737a0 2024-05-09T09:47:37.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.583+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94592082348608] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f038c036040 con 0x5607ef76a560 2024-05-09T09:47:37.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.583+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03900491c0 con 0x5607ef7737a0 2024-05-09T09:47:37.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.583+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94592082342272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef7775a0 con 0x5607ef7737a0 2024-05-09T09:47:37.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.583+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef77a700 con 0x7f039001fbe0 2024-05-09T09:47:37.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.583+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f038c036040 con 0x7f039001fbe0 2024-05-09T09:47:37.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.583+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94592082354704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef77afa0 con 0x7f039001fbe0 2024-05-09T09:47:37.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.583+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef77b960 con 0x5607ef76a560 2024-05-09T09:47:37.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.583+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94592082342272] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03900491c0 con 0x5607ef7737a0 2024-05-09T09:47:37.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.583+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94592082354704] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f038c036040 con 0x7f039001fbe0 2024-05-09T09:47:37.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.583+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f038c036040 con 0x5607ef76a560 2024-05-09T09:47:37.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.583+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94592082359472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef77b8d0 con 0x5607ef76a560 2024-05-09T09:47:37.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.583+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef77aef0 con 0x5607ef76ef00 2024-05-09T09:47:37.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.587+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94592082359472] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f038c036040 con 0x5607ef76a560 2024-05-09T09:47:37.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.587+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0394111030 con 0x5607ef76ef00 2024-05-09T09:47:37.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.587+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94592082356800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef77c200 con 0x5607ef76ef00 2024-05-09T09:47:37.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.587+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef77ca50 con 0x5607ef76ef00 2024-05-09T09:47:37.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.591+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94592082356800] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0394111030 con 0x5607ef76ef00 2024-05-09T09:47:37.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.591+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0394111030 con 0x5607ef76ef00 2024-05-09T09:47:37.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.591+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94592082363808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef77ce70 con 0x5607ef76ef00 2024-05-09T09:47:37.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.591+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef77d830 con 0x5607ef76ef00 2024-05-09T09:47:37.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.591+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94592082363808] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0394111030 con 0x5607ef76ef00 2024-05-09T09:47:37.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.591+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0394111030 con 0x5607ef76ef00 2024-05-09T09:47:37.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.591+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94592082365344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef77d830 con 0x5607ef76ef00 2024-05-09T09:47:37.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.591+0000 7f039dc61980 20 add_watcher() i=0 2024-05-09T09:47:37.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.591+0000 7f039dc61980 20 add_watcher() i=1 2024-05-09T09:47:37.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.591+0000 7f039dc61980 20 add_watcher() i=2 2024-05-09T09:47:37.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.591+0000 7f039dc61980 20 add_watcher() i=3 2024-05-09T09:47:37.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.591+0000 7f039dc61980 20 add_watcher() i=4 2024-05-09T09:47:37.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.591+0000 7f039dc61980 20 add_watcher() i=5 2024-05-09T09:47:37.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.591+0000 7f039dc61980 20 add_watcher() i=6 2024-05-09T09:47:37.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.595+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94592082365344] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0394111030 con 0x5607ef76ef00 2024-05-09T09:47:37.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.595+0000 7f039dc61980 20 add_watcher() i=7 2024-05-09T09:47:37.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.595+0000 7f039dc61980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:37.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.595+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607ef780ba0 con 0x5607ef76a560 2024-05-09T09:47:37.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.595+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f038c036040 con 0x5607ef76a560 2024-05-09T09:47:37.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.595+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94592082380176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef77d9a0 con 0x5607ef76a560 2024-05-09T09:47:37.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.595+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94592082380176] v30'164 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f038c036040 con 0x5607ef76a560 2024-05-09T09:47:37.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.595+0000 7f0250fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:37.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.595+0000 7f039dc61980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:37.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.595+0000 7f039dc61980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:37.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.599+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef7892d0 con 0x5607ef76a560 2024-05-09T09:47:37.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.599+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'44 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f038c036040 con 0x5607ef76a560 2024-05-09T09:47:37.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.599+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef7898c0 con 0x5607ef76ef00 2024-05-09T09:47:37.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.603+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'38 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0394111030 con 0x5607ef76ef00 2024-05-09T09:47:37.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.603+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef7898c0 con 0x5607ef7737a0 2024-05-09T09:47:37.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.603+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'38 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f03900491c0 con 0x5607ef7737a0 2024-05-09T09:47:37.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.603+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef78a2e0 con 0x5607ef76a560 2024-05-09T09:47:37.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.603+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'165 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f038c036040 con 0x5607ef76a560 2024-05-09T09:47:37.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.603+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef7872b0 con 0x7f039001fbe0 2024-05-09T09:47:37.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.607+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'104 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f038c036040 con 0x7f039001fbe0 2024-05-09T09:47:37.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.607+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef7872b0 con 0x5607ef7737a0 2024-05-09T09:47:37.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.607+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'69 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f03900491c0 con 0x5607ef7737a0 2024-05-09T09:47:37.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.607+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef78b010 con 0x5607ef76a560 2024-05-09T09:47:37.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.611+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'40 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f038c036040 con 0x5607ef76a560 2024-05-09T09:47:37.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.611+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef78b010 con 0x5607ef76ef00 2024-05-09T09:47:37.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.611+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'69 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0394111030 con 0x5607ef76ef00 2024-05-09T09:47:37.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.611+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef78b010 con 0x7f039001fbe0 2024-05-09T09:47:37.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.615+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'38 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f038c036040 con 0x7f039001fbe0 2024-05-09T09:47:37.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.615+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef78b010 con 0x5607ef7737a0 2024-05-09T09:47:37.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.615+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'44 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f03900491c0 con 0x5607ef7737a0 2024-05-09T09:47:37.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.615+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef78b4c0 con 0x7f039001fbe0 2024-05-09T09:47:37.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.615+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'105 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f038c036040 con 0x7f039001fbe0 2024-05-09T09:47:37.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.615+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef78b4c0 con 0x5607ef76ef00 2024-05-09T09:47:37.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.619+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'40 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0394111030 con 0x5607ef76ef00 2024-05-09T09:47:37.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.619+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef78b4c0 con 0x7f039001fbe0 2024-05-09T09:47:37.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.619+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'38 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f038c036040 con 0x7f039001fbe0 2024-05-09T09:47:37.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.619+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef78b4c0 con 0x5607ef76ef00 2024-05-09T09:47:37.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.623+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'75 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0394111030 con 0x5607ef76ef00 2024-05-09T09:47:37.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.623+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef78b4c0 con 0x5607ef76a560 2024-05-09T09:47:37.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.623+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'166 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f038c036040 con 0x5607ef76a560 2024-05-09T09:47:37.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.623+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef78b4c0 con 0x5607ef7737a0 2024-05-09T09:47:37.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.627+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'98 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f03900491c0 con 0x5607ef7737a0 2024-05-09T09:47:37.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.627+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef78b4c0 con 0x7f039001fbe0 2024-05-09T09:47:37.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.627+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'106 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f038c036040 con 0x7f039001fbe0 2024-05-09T09:47:37.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.627+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef78b4c0 con 0x5607ef7737a0 2024-05-09T09:47:37.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.631+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'38 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f03900491c0 con 0x5607ef7737a0 2024-05-09T09:47:37.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.631+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef78b5d0 con 0x5607ef76a560 2024-05-09T09:47:37.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.631+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'46 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f038c036040 con 0x5607ef76a560 2024-05-09T09:47:37.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.631+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef78b5d0 con 0x5607ef76a560 2024-05-09T09:47:37.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.635+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'167 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f038c036040 con 0x5607ef76a560 2024-05-09T09:47:37.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.635+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef78b5d0 con 0x5607ef7737a0 2024-05-09T09:47:37.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.635+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'99 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f03900491c0 con 0x5607ef7737a0 2024-05-09T09:47:37.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.635+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef78b5d0 con 0x7f039001fbe0 2024-05-09T09:47:37.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.639+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'48 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f038c036040 con 0x7f039001fbe0 2024-05-09T09:47:37.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.639+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef78b5d0 con 0x5607ef7737a0 2024-05-09T09:47:37.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.639+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'40 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f03900491c0 con 0x5607ef7737a0 2024-05-09T09:47:37.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.639+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef78b5d0 con 0x5607ef7737a0 2024-05-09T09:47:37.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.639+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'44 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f03900491c0 con 0x5607ef7737a0 2024-05-09T09:47:37.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.639+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef78b5d0 con 0x5607ef7737a0 2024-05-09T09:47:37.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.643+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'34 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f03900491c0 con 0x5607ef7737a0 2024-05-09T09:47:37.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.643+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef78b5d0 con 0x5607ef7737a0 2024-05-09T09:47:37.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.643+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'70 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f03900491c0 con 0x5607ef7737a0 2024-05-09T09:47:37.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.643+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef78b5d0 con 0x5607ef76ef00 2024-05-09T09:47:37.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.647+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'40 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0394111030 con 0x5607ef76ef00 2024-05-09T09:47:37.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.647+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef78b5d0 con 0x5607ef7737a0 2024-05-09T09:47:37.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.647+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'38 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f03900491c0 con 0x5607ef7737a0 2024-05-09T09:47:37.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.647+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef78b5d0 con 0x5607ef76ef00 2024-05-09T09:47:37.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.651+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'70 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0394111030 con 0x5607ef76ef00 2024-05-09T09:47:37.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.651+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef78b5d0 con 0x5607ef7737a0 2024-05-09T09:47:37.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.655+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'100 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f03900491c0 con 0x5607ef7737a0 2024-05-09T09:47:37.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.655+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef78b5d0 con 0x5607ef76ef00 2024-05-09T09:47:37.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.655+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'76 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0394111030 con 0x5607ef76ef00 2024-05-09T09:47:37.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.655+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef78b5d0 con 0x7f039001fbe0 2024-05-09T09:47:37.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.659+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'44 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f038c036040 con 0x7f039001fbe0 2024-05-09T09:47:37.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.659+0000 7f01cb7fe640 20 reqs_thread_entry: start 2024-05-09T09:47:37.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.659+0000 7f039dc61980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:37.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.659+0000 7f01c97fa640 20 reqs_thread_entry: start 2024-05-09T09:47:37.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.659+0000 7f039dc61980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.659+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607ef7a72e0 con 0x5607ef76a560 2024-05-09T09:47:37.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.659+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f038c036040 con 0x5607ef76a560 2024-05-09T09:47:37.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.659+0000 7f039dc61980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:47:37.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.659+0000 7f039dc61980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.659+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607ef785df0 con 0x5607ef76a560 2024-05-09T09:47:37.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.659+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(95 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f038c036040 con 0x5607ef76a560 2024-05-09T09:47:37.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.659+0000 7f039dc61980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:47:37.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.659+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:96 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5607ef785dc0 con 0x7f039001fbe0 2024-05-09T09:47:37.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.663+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(96 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f038c036040 con 0x7f039001fbe0 2024-05-09T09:47:37.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.663+0000 7f0250fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:37.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.663+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94592082380176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef785dc0 con 0x5607ef76a560 2024-05-09T09:47:37.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.663+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(97 data_loggenerations_metadata [watch unwatch cookie 94592082380176] v30'168 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f038c036040 con 0x5607ef76a560 2024-05-09T09:47:37.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.663+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:98 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94592082344784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef785d90 con 0x7f039001fbe0 2024-05-09T09:47:37.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.667+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(98 notify.0 [watch unwatch cookie 94592082344784] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f038c036040 con 0x7f039001fbe0 2024-05-09T09:47:37.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.667+0000 7f039dc61980 20 remove_watcher() i=0 2024-05-09T09:47:37.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.667+0000 7f039dc61980 2 removed watcher, disabling cache 2024-05-09T09:47:37.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.667+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:99 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94592082348608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef785d90 con 0x5607ef76a560 2024-05-09T09:47:37.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.667+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(99 notify.1 [watch unwatch cookie 94592082348608] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f038c036040 con 0x5607ef76a560 2024-05-09T09:47:37.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.667+0000 7f039dc61980 20 remove_watcher() i=1 2024-05-09T09:47:37.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.667+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:100 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94592082342272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef785d90 con 0x5607ef7737a0 2024-05-09T09:47:37.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.671+0000 7f039af7b640 1 -- 172.21.15.157:0/1274237334 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(100 notify.2 [watch unwatch cookie 94592082342272] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03900491c0 con 0x5607ef7737a0 2024-05-09T09:47:37.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.671+0000 7f039dc61980 20 remove_watcher() i=2 2024-05-09T09:47:37.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.671+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:101 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94592082354704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef785d90 con 0x7f039001fbe0 2024-05-09T09:47:37.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.671+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(101 notify.3 [watch unwatch cookie 94592082354704] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f038c036040 con 0x7f039001fbe0 2024-05-09T09:47:37.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.671+0000 7f039dc61980 20 remove_watcher() i=3 2024-05-09T09:47:37.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.671+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94592082359472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef785d90 con 0x5607ef76a560 2024-05-09T09:47:37.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.675+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(102 notify.4 [watch unwatch cookie 94592082359472] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f038c036040 con 0x5607ef76a560 2024-05-09T09:47:37.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.675+0000 7f039dc61980 20 remove_watcher() i=4 2024-05-09T09:47:37.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.675+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94592082356800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef777180 con 0x5607ef76ef00 2024-05-09T09:47:37.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.675+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(103 notify.5 [watch unwatch cookie 94592082356800] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0394111030 con 0x5607ef76ef00 2024-05-09T09:47:37.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.675+0000 7f039dc61980 20 remove_watcher() i=5 2024-05-09T09:47:37.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.675+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94592082363808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef77b4b0 con 0x5607ef76ef00 2024-05-09T09:47:37.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.679+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(104 notify.6 [watch unwatch cookie 94592082363808] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0394111030 con 0x5607ef76ef00 2024-05-09T09:47:37.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.679+0000 7f039dc61980 20 remove_watcher() i=6 2024-05-09T09:47:37.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.679+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:105 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94592082365344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5607ef77aa40 con 0x5607ef76ef00 2024-05-09T09:47:37.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.679+0000 7f039b77c640 1 -- 172.21.15.157:0/1274237334 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(105 notify.7 [watch unwatch cookie 94592082365344] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0394111030 con 0x5607ef76ef00 2024-05-09T09:47:37.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.679+0000 7f039dc61980 20 remove_watcher() i=7 2024-05-09T09:47:37.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5607ef76ef00 msgr2=0x5607ef7712f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 --2- 172.21.15.157:0/1274237334 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5607ef76ef00 0x5607ef7712f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5607ef76a560 msgr2=0x5607ef76ca00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 --2- 172.21.15.157:0/1274237334 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5607ef76a560 0x5607ef76ca00 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f039001fbe0 msgr2=0x7f039003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 --2- 172.21.15.157:0/1274237334 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f039001fbe0 0x7f039003a3c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5607ef7737a0 msgr2=0x5607ef775c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 --2- 172.21.15.157:0/1274237334 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5607ef7737a0 0x5607ef775c60 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0264034bb0 msgr2=0x7f0264037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 --2- 172.21.15.157:0/1274237334 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0264034bb0 0x7f0264037070 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f039000c010 tx=0x7f0390010000 comp rx=0 tx=0).stop 2024-05-09T09:47:37.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef756740 msgr2=0x5607ef75da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 --2- 172.21.15.157:0/1274237334 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef756740 0x5607ef75da30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f03940ed7b0 tx=0x7f03940c4ee0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 reap_dead start 2024-05-09T09:47:37.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039bf7d640 1 -- 172.21.15.157:0/1274237334 reap_dead start 2024-05-09T09:47:37.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 shutdown_connections 2024-05-09T09:47:37.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 >> 172.21.15.157:0/1274237334 conn(0x5607ef752a70 msgr2=0x5607ef7500d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:37.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 shutdown_connections 2024-05-09T09:47:37.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 -- 172.21.15.157:0/1274237334 wait complete. 2024-05-09T09:47:37.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 -- 172.21.15.157:0/1246404478 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0274034c00 msgr2=0x7f02740370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 --2- 172.21.15.157:0/1246404478 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0274034c00 0x7f02740370c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x5607ef71af30 tx=0x7f039000f000 comp rx=0 tx=0).stop 2024-05-09T09:47:37.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 -- 172.21.15.157:0/1246404478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef7498a0 msgr2=0x5607ef749cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 --2- 172.21.15.157:0/1246404478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef7498a0 0x5607ef749cc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f03940ac010 tx=0x7f03940c64a0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 -- 172.21.15.157:0/1246404478 shutdown_connections 2024-05-09T09:47:37.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 --2- 172.21.15.157:0/1246404478 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0274034c00 0x7f02740370c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 --2- 172.21.15.157:0/1246404478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef7498a0 0x5607ef749cc0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 -- 172.21.15.157:0/1246404478 >> 172.21.15.157:0/1246404478 conn(0x5607ef73e670 msgr2=0x5607ef73f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:37.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 -- 172.21.15.157:0/1246404478 shutdown_connections 2024-05-09T09:47:37.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 -- 172.21.15.157:0/1246404478 wait complete. 2024-05-09T09:47:37.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 -- 172.21.15.157:0/4027150288 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5607ef71cdb0 msgr2=0x5607ef71f1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 --2- 172.21.15.157:0/4027150288 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5607ef71cdb0 0x5607ef71f1a0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 -- 172.21.15.157:0/4027150288 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5607ef621450 msgr2=0x5607ef71a520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 --2- 172.21.15.157:0/4027150288 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5607ef621450 0x5607ef71a520 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 -- 172.21.15.157:0/4027150288 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5607ef720cf0 msgr2=0x5607ef7230e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 --2- 172.21.15.157:0/4027150288 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5607ef720cf0 0x5607ef7230e0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 -- 172.21.15.157:0/4027150288 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0280034bb0 msgr2=0x7f0280037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 --2- 172.21.15.157:0/4027150288 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0280034bb0 0x7f0280037070 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0390000f70 tx=0x7f0390001380 comp rx=0 tx=0).stop 2024-05-09T09:47:37.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 -- 172.21.15.157:0/4027150288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef620b30 msgr2=0x5607ef713470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 --2- 172.21.15.157:0/4027150288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5607ef620b30 0x5607ef713470 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f039401aec0 tx=0x7f0394017e30 comp rx=0 tx=0).stop 2024-05-09T09:47:37.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039bf7d640 1 -- 172.21.15.157:0/4027150288 reap_dead start 2024-05-09T09:47:37.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 -- 172.21.15.157:0/4027150288 shutdown_connections 2024-05-09T09:47:37.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 -- 172.21.15.157:0/4027150288 >> 172.21.15.157:0/4027150288 conn(0x5607ef594250 msgr2=0x5607ef706af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:37.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 -- 172.21.15.157:0/4027150288 shutdown_connections 2024-05-09T09:47:37.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.683+0000 7f039dc61980 1 -- 172.21.15.157:0/4027150288 wait complete. 2024-05-09T09:47:37.694 INFO:teuthology.orchestra.run.smithi157.stdout:["myfoo"] 2024-05-09T09:47:37.694 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-05-09T09:47:37.741 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-05-09T09:47:37.741 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-05-09T09:47:37.741 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-05-09T09:47:37.741 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-05-09T09:47:37.778 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:37.778 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:37.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.779+0000 7f9eb8910980 1 Processor -- start 2024-05-09T09:47:37.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.779+0000 7f9eb8910980 1 -- start start 2024-05-09T09:47:37.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.779+0000 7f9eb8910980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x561229782100 0x5612297844f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.779+0000 7f9eb8910980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561229631440 con 0x5612296efa60 2024-05-09T09:47:37.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.779+0000 7f9eb8910980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x56122961c5f0 con 0x561229782100 2024-05-09T09:47:37.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.779+0000 7f9eb5c2a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x561229782100 0x5612297844f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.779+0000 7f9eb642b640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x5612296efa60 0x5612297809e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:51648/0 (socket says 172.21.15.157:51648) 2024-05-09T09:47:37.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.779+0000 7f9eb642b640 1 -- 172.21.15.157:0/2261686615 learned_addr learned my addr 172.21.15.157:0/2261686615 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:47:37.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.783+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/2261686615 >> v1:172.21.15.110:6789/0 conn(0x5612296efa60 legacy=0x5612297809e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.783+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/2261686615 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561229627990 con 0x561229782100 2024-05-09T09:47:37.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.783+0000 7f9eb5c2a640 1 --2- 172.21.15.157:0/2261686615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561229782100 0x5612297844f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9eac00a480 tx=0x7f9eac01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da7e4ff9cb7a27c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.783+0000 7f9eb5429640 1 -- 172.21.15.157:0/2261686615 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9eac0b0070 con 0x561229782100 2024-05-09T09:47:37.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.783+0000 7f9eb5429640 1 -- 172.21.15.157:0/2261686615 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eac0ab540 con 0x561229782100 2024-05-09T09:47:37.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.783+0000 7f9eb5429640 1 -- 172.21.15.157:0/2261686615 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9eac0ab840 con 0x561229782100 2024-05-09T09:47:37.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.783+0000 7f9eb8910980 1 -- 172.21.15.157:0/2261686615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561229782100 msgr2=0x5612297844f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.783+0000 7f9eb8910980 1 --2- 172.21.15.157:0/2261686615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561229782100 0x5612297844f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9eac00a480 tx=0x7f9eac01b280 comp rx=0 tx=0).stop 2024-05-09T09:47:37.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.787+0000 7f9eb8910980 1 -- 172.21.15.157:0/2261686615 shutdown_connections 2024-05-09T09:47:37.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.787+0000 7f9eb8910980 1 --2- 172.21.15.157:0/2261686615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561229782100 0x5612297844f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.787+0000 7f9eb8910980 1 -- 172.21.15.157:0/2261686615 >> 172.21.15.157:0/2261686615 conn(0x5612297760c0 msgr2=0x5612297784e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:37.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.787+0000 7f9eb8910980 1 -- 172.21.15.157:0/2261686615 shutdown_connections 2024-05-09T09:47:37.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.787+0000 7f9eb8910980 1 -- 172.21.15.157:0/2261686615 wait complete. 2024-05-09T09:47:37.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.803+0000 7f9eb8910980 1 Processor -- start 2024-05-09T09:47:37.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.803+0000 7f9eb8910980 1 -- start start 2024-05-09T09:47:37.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.803+0000 7f9eb8910980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612296efa60 0x561229868d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.803+0000 7f9eb8910980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56122967efe0 con 0x5612296efa60 2024-05-09T09:47:37.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.803+0000 7f9eb642b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612296efa60 0x561229868d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.803+0000 7f9eb642b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612296efa60 0x561229868d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58580/0 (socket says 172.21.15.157:58580) 2024-05-09T09:47:37.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.803+0000 7f9eb642b640 1 -- 172.21.15.157:0/305011011 learned_addr learned my addr 172.21.15.157:0/305011011 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:37.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.803+0000 7f9eb642b640 1 -- 172.21.15.157:0/305011011 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561229603ae0 con 0x5612296efa60 2024-05-09T09:47:37.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.803+0000 7f9eb642b640 1 --2- 172.21.15.157:0/305011011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612296efa60 0x561229868d60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9ea80017b0 tx=0x7f9ea8001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc86630543c2fec server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.803+0000 7f9da4608640 1 -- 172.21.15.157:0/305011011 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ea8016070 con 0x5612296efa60 2024-05-09T09:47:37.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.803+0000 7f9da4608640 1 -- 172.21.15.157:0/305011011 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ea8004530 con 0x5612296efa60 2024-05-09T09:47:37.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.803+0000 7f9da4608640 1 -- 172.21.15.157:0/305011011 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ea8004870 con 0x5612296efa60 2024-05-09T09:47:37.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.803+0000 7f9eb8910980 1 -- 172.21.15.157:0/305011011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612296efa60 msgr2=0x561229868d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.803+0000 7f9eb8910980 1 --2- 172.21.15.157:0/305011011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612296efa60 0x561229868d60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9ea80017b0 tx=0x7f9ea8001c70 comp rx=0 tx=0).stop 2024-05-09T09:47:37.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.803+0000 7f9eb8910980 1 -- 172.21.15.157:0/305011011 shutdown_connections 2024-05-09T09:47:37.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.803+0000 7f9eb8910980 1 --2- 172.21.15.157:0/305011011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612296efa60 0x561229868d60 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.803+0000 7f9eb8910980 1 -- 172.21.15.157:0/305011011 >> 172.21.15.157:0/305011011 conn(0x5612297760c0 msgr2=0x5612298648f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:37.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.803+0000 7f9eb8910980 1 -- 172.21.15.157:0/305011011 shutdown_connections 2024-05-09T09:47:37.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.803+0000 7f9eb8910980 1 -- 172.21.15.157:0/305011011 wait complete. 2024-05-09T09:47:37.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.803+0000 7f9eb8910980 1 Processor -- start 2024-05-09T09:47:37.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.803+0000 7f9eb8910980 1 -- start start 2024-05-09T09:47:37.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.803+0000 7f9eb8910980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612296efa60 0x56122986ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.803+0000 7f9eb8910980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561229787490 con 0x5612296efa60 2024-05-09T09:47:37.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.803+0000 7f9eb642b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612296efa60 0x56122986ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.803+0000 7f9eb642b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612296efa60 0x56122986ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58590/0 (socket says 172.21.15.157:58590) 2024-05-09T09:47:37.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.803+0000 7f9eb642b640 1 -- 172.21.15.157:0/1685320840 learned_addr learned my addr 172.21.15.157:0/1685320840 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:37.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.807+0000 7f9eb642b640 1 -- 172.21.15.157:0/1685320840 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612298704b0 con 0x5612296efa60 2024-05-09T09:47:37.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.807+0000 7f9eb642b640 1 --2- 172.21.15.157:0/1685320840 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612296efa60 0x56122986ff70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8000f90 tx=0x7f9ea8001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.807+0000 7f9da2e05640 1 -- 172.21.15.157:0/1685320840 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ea8020070 con 0x5612296efa60 2024-05-09T09:47:37.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.807+0000 7f9da2e05640 1 -- 172.21.15.157:0/1685320840 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ea8011400 con 0x5612296efa60 2024-05-09T09:47:37.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.807+0000 7f9eb8910980 1 -- 172.21.15.157:0/1685320840 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561229870740 con 0x5612296efa60 2024-05-09T09:47:37.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.807+0000 7f9da2e05640 1 -- 172.21.15.157:0/1685320840 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ea8016040 con 0x5612296efa60 2024-05-09T09:47:37.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.807+0000 7f9eb8910980 1 -- 172.21.15.157:0/1685320840 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561229873420 con 0x5612296efa60 2024-05-09T09:47:37.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.807+0000 7f9da2e05640 1 -- 172.21.15.157:0/1685320840 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f9ea8023070 con 0x5612296efa60 2024-05-09T09:47:37.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.807+0000 7f9da2e05640 1 --2- 172.21.15.157:0/1685320840 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9d9c034c00 0x7f9d9c0370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.807+0000 7f9da2e05640 1 -- 172.21.15.157:0/1685320840 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f9ea8049890 con 0x5612296efa60 2024-05-09T09:47:37.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.807+0000 7f9eb5c2a640 1 --2- 172.21.15.157:0/1685320840 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9d9c034c00 0x7f9d9c0370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.807+0000 7f9eb8910980 1 --2- 172.21.15.157:0/1685320840 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561229782100 0x561229877070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.807+0000 7f9eb8910980 1 -- 172.21.15.157:0/1685320840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5612298775b0 con 0x561229782100 2024-05-09T09:47:37.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.807+0000 7f9eb6c2c640 1 --2- 172.21.15.157:0/1685320840 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561229782100 0x561229877070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.807+0000 7f9eb5c2a640 1 --2- 172.21.15.157:0/1685320840 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9d9c034c00 0x7f9d9c0370c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9eac0ad000 tx=0x7f9eac0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.807+0000 7f9eb6c2c640 1 --2- 172.21.15.157:0/1685320840 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561229782100 0x561229877070 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.807+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/1685320840 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9eb00083f0 con 0x561229782100 2024-05-09T09:47:37.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.807+0000 7f9eb8910980 1 -- 172.21.15.157:0/1685320840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561229874610 con 0x561229782100 2024-05-09T09:47:37.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.811+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/1685320840 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9eb00083f0 con 0x561229782100 2024-05-09T09:47:37.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.811+0000 7f9eb8910980 1 --2- 172.21.15.157:0/1685320840 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561229879850 0x56122987bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.811+0000 7f9eb8910980 1 -- 172.21.15.157:0/1685320840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56122987c330 con 0x561229879850 2024-05-09T09:47:37.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.811+0000 7f9eb642b640 1 --2- 172.21.15.157:0/1685320840 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561229879850 0x56122987bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.811+0000 7f9eb642b640 1 --2- 172.21.15.157:0/1685320840 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561229879850 0x56122987bc40 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.811+0000 7f9eb642b640 1 -- 172.21.15.157:0/1685320840 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9ea802c070 con 0x561229879850 2024-05-09T09:47:37.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.811+0000 7f9eb8910980 1 -- 172.21.15.157:0/1685320840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561229878720 con 0x561229782100 2024-05-09T09:47:37.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.811+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/1685320840 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9eb00083f0 con 0x561229782100 2024-05-09T09:47:37.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.811+0000 7f9eb8910980 1 --2- 172.21.15.157:0/1685320840 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56122987d790 0x56122987fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.811+0000 7f9eb8910980 1 -- 172.21.15.157:0/1685320840 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561229880270 con 0x56122987d790 2024-05-09T09:47:37.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.811+0000 7f9eb5c2a640 1 --2- 172.21.15.157:0/1685320840 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56122987d790 0x56122987fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.811+0000 7f9eb5c2a640 1 --2- 172.21.15.157:0/1685320840 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56122987d790 0x56122987fb80 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.811+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/1685320840 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9eac0b3040 con 0x56122987d790 2024-05-09T09:47:37.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.815+0000 7f9eb8910980 1 Processor -- start 2024-05-09T09:47:37.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.815+0000 7f9eb8910980 1 -- start start 2024-05-09T09:47:37.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.815+0000 7f9eb8910980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612298a6060 0x5612298a6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.815+0000 7f9eb8910980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561229683020 con 0x5612298a6060 2024-05-09T09:47:37.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.815+0000 7f9eb642b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612298a6060 0x5612298a6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.815+0000 7f9eb642b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612298a6060 0x5612298a6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58594/0 (socket says 172.21.15.157:58594) 2024-05-09T09:47:37.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.815+0000 7f9eb642b640 1 -- 172.21.15.157:0/3863308919 learned_addr learned my addr 172.21.15.157:0/3863308919 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:37.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.815+0000 7f9eb642b640 1 -- 172.21.15.157:0/3863308919 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612298a69c0 con 0x5612298a6060 2024-05-09T09:47:37.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.819+0000 7f9eb642b640 1 --2- 172.21.15.157:0/3863308919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612298a6060 0x5612298a6480 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8024b10 tx=0x7f9ea8023ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.819+0000 7f9d9aba2640 1 -- 172.21.15.157:0/3863308919 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ea8041ae0 con 0x5612298a6060 2024-05-09T09:47:37.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.819+0000 7f9eb8910980 1 -- 172.21.15.157:0/3863308919 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612298a7450 con 0x5612298a6060 2024-05-09T09:47:37.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.819+0000 7f9d9aba2640 1 -- 172.21.15.157:0/3863308919 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ea8041c80 con 0x5612298a6060 2024-05-09T09:47:37.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.819+0000 7f9eb8910980 1 -- 172.21.15.157:0/3863308919 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612298a7930 con 0x5612298a6060 2024-05-09T09:47:37.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.819+0000 7f9d9aba2640 1 -- 172.21.15.157:0/3863308919 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ea803c060 con 0x5612298a6060 2024-05-09T09:47:37.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.819+0000 7f9d9aba2640 1 -- 172.21.15.157:0/3863308919 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f9ea8049b30 con 0x5612298a6060 2024-05-09T09:47:37.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.819+0000 7f9d9aba2640 1 --2- 172.21.15.157:0/3863308919 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9d90034b60 0x7f9d90037020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.819+0000 7f9d9aba2640 1 -- 172.21.15.157:0/3863308919 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f9ea8038020 con 0x5612298a6060 2024-05-09T09:47:37.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.819+0000 7f9eb5c2a640 1 --2- 172.21.15.157:0/3863308919 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9d90034b60 0x7f9d90037020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.819+0000 7f9eb8910980 1 Processor -- start 2024-05-09T09:47:37.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.819+0000 7f9eb8910980 1 -- start start 2024-05-09T09:47:37.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.819+0000 7f9eb8910980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612298b2fe0 0x5612298b3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.819+0000 7f9eb8910980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5612298694b0 con 0x5612298b2fe0 2024-05-09T09:47:37.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.819+0000 7f9eb5c2a640 1 --2- 172.21.15.157:0/3863308919 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9d90034b60 0x7f9d90037020 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9eac0ae040 tx=0x7f9eac005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.819+0000 7f9eb642b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612298b2fe0 0x5612298b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.819+0000 7f9eb642b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612298b2fe0 0x5612298b3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58596/0 (socket says 172.21.15.157:58596) 2024-05-09T09:47:37.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.819+0000 7f9eb642b640 1 -- 172.21.15.157:0/838067037 learned_addr learned my addr 172.21.15.157:0/838067037 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:37.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.819+0000 7f9eb642b640 1 -- 172.21.15.157:0/838067037 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612298b39d0 con 0x5612298b2fe0 2024-05-09T09:47:37.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.819+0000 7f9eb642b640 1 --2- 172.21.15.157:0/838067037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612298b2fe0 0x5612298b3400 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8049800 tx=0x7f9ea8049ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d6d275fdccf93a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.823+0000 7f9d98b9e640 1 -- 172.21.15.157:0/838067037 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ea8050040 con 0x5612298b2fe0 2024-05-09T09:47:37.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.823+0000 7f9d98b9e640 1 -- 172.21.15.157:0/838067037 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ea802dc90 con 0x5612298b2fe0 2024-05-09T09:47:37.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.823+0000 7f9d98b9e640 1 -- 172.21.15.157:0/838067037 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ea80116e0 con 0x5612298b2fe0 2024-05-09T09:47:37.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.823+0000 7f9eb8910980 1 -- 172.21.15.157:0/838067037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612298b2fe0 msgr2=0x5612298b3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.823+0000 7f9eb8910980 1 --2- 172.21.15.157:0/838067037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612298b2fe0 0x5612298b3400 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8049800 tx=0x7f9ea8049ee0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.823+0000 7f9eb8910980 1 -- 172.21.15.157:0/838067037 shutdown_connections 2024-05-09T09:47:37.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.823+0000 7f9eb8910980 1 --2- 172.21.15.157:0/838067037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612298b2fe0 0x5612298b3400 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.823+0000 7f9eb8910980 1 -- 172.21.15.157:0/838067037 >> 172.21.15.157:0/838067037 conn(0x5612298af3b0 msgr2=0x5612298ad410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:37.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.823+0000 7f9eb8910980 1 -- 172.21.15.157:0/838067037 shutdown_connections 2024-05-09T09:47:37.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.823+0000 7f9eb8910980 1 -- 172.21.15.157:0/838067037 wait complete. 2024-05-09T09:47:37.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.823+0000 7f9eb8910980 1 Processor -- start 2024-05-09T09:47:37.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.823+0000 7f9eb8910980 1 -- start start 2024-05-09T09:47:37.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.823+0000 7f9eb8910980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612298b2fe0 0x5612298ba430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.823+0000 7f9eb8910980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5612298b3f70 con 0x5612298b2fe0 2024-05-09T09:47:37.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.823+0000 7f9eb642b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612298b2fe0 0x5612298ba430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.823+0000 7f9eb642b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612298b2fe0 0x5612298ba430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58610/0 (socket says 172.21.15.157:58610) 2024-05-09T09:47:37.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.823+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 learned_addr learned my addr 172.21.15.157:0/4155267747 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:37.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.823+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612298ba970 con 0x5612298b2fe0 2024-05-09T09:47:37.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.823+0000 7f9eb642b640 1 --2- 172.21.15.157:0/4155267747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612298b2fe0 0x5612298ba430 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8049b00 tx=0x7f9ea801af60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.823+0000 7f9d86ffd640 1 -- 172.21.15.157:0/4155267747 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ea8063070 con 0x5612298b2fe0 2024-05-09T09:47:37.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.823+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612298ba970 con 0x5612298b2fe0 2024-05-09T09:47:37.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.823+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612298badf0 con 0x5612298b2fe0 2024-05-09T09:47:37.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.823+0000 7f9d86ffd640 1 -- 172.21.15.157:0/4155267747 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ea8041380 con 0x5612298b2fe0 2024-05-09T09:47:37.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.823+0000 7f9d86ffd640 1 -- 172.21.15.157:0/4155267747 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ea806c060 con 0x5612298b2fe0 2024-05-09T09:47:37.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9eb8910980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9d86ffd640 1 -- 172.21.15.157:0/4155267747 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f9ea802d690 con 0x5612298b2fe0 2024-05-09T09:47:37.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9d86ffd640 1 --2- 172.21.15.157:0/4155267747 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9d80034b60 0x7f9d80037020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9d86ffd640 1 -- 172.21.15.157:0/4155267747 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f9ea8059070 con 0x5612298b2fe0 2024-05-09T09:47:37.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9eb5c2a640 1 --2- 172.21.15.157:0/4155267747 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9d80034b60 0x7f9d80037020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9eb8910980 1 --2- 172.21.15.157:0/4155267747 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5612298c6f00 0x5612298c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5612298c9b10 con 0x5612298c6f00 2024-05-09T09:47:37.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9eb6c2c640 1 --2- 172.21.15.157:0/4155267747 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5612298c6f00 0x5612298c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9eb5c2a640 1 --2- 172.21.15.157:0/4155267747 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9d80034b60 0x7f9d80037020 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9eac000c10 tx=0x7f9eac0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9eb6c2c640 1 --2- 172.21.15.157:0/4155267747 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5612298c6f00 0x5612298c93c0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9eb00083f0 con 0x5612298c6f00 2024-05-09T09:47:37.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9eb8910980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:37.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9eb8910980 20 realm 2024-05-09T09:47:37.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9eb8910980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5612298c9f20 con 0x5612298c6f00 2024-05-09T09:47:37.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9eb00083f0 con 0x5612298c6f00 2024-05-09T09:47:37.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9eb8910980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:37.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9eb8910980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:37.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9eb8910980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5612298ca7c0 con 0x5612298c6f00 2024-05-09T09:47:37.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9eb00083f0 con 0x5612298c6f00 2024-05-09T09:47:37.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9eb8910980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:37.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9eb8910980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5612298cab60 con 0x5612298c6f00 2024-05-09T09:47:37.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9eb00083f0 con 0x5612298c6f00 2024-05-09T09:47:37.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9eb8910980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:37.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9eb8910980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9eb8910980 1 --2- 172.21.15.157:0/4155267747 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5612298cb8c0 0x5612298cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5612298ce230 con 0x5612298cb8c0 2024-05-09T09:47:37.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9eb642b640 1 --2- 172.21.15.157:0/4155267747 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5612298cb8c0 0x5612298cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.827+0000 7f9eb642b640 1 --2- 172.21.15.157:0/4155267747 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5612298cb8c0 0x5612298cdcb0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.831+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.831+0000 7f9eb8910980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:37.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.831+0000 7f9eb8910980 20 searching for the correct realm 2024-05-09T09:47:37.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.831+0000 7f9eb8910980 1 --2- 172.21.15.157:0/4155267747 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5612298d01a0 0x5612298d2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.831+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5612298d2d30 con 0x5612298d01a0 2024-05-09T09:47:37.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.831+0000 7f9eb5c2a640 1 --2- 172.21.15.157:0/4155267747 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5612298d01a0 0x5612298d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.831+0000 7f9eb5c2a640 1 --2- 172.21.15.157:0/4155267747 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5612298d01a0 0x5612298d2660 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.831+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.831+0000 7f9eb5c2a640 1 --2- 172.21.15.157:0/4155267747 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f9eac0ce040 0x7f9eac0db410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:37.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.831+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5612298d2d30 con 0x7f9eac0ce040 2024-05-09T09:47:37.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.831+0000 7f9eb6c2c640 1 --2- 172.21.15.157:0/4155267747 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f9eac0ce040 0x7f9eac0db410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:37.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.831+0000 7f9eb6c2c640 1 --2- 172.21.15.157:0/4155267747 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f9eac0ce040 0x7f9eac0db410 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:37.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.831+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eb00083f0 con 0x7f9eac0ce040 2024-05-09T09:47:37.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.831+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5612298cab60 con 0x5612298cb8c0 2024-05-09T09:47:37.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.831+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.831+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5612298cab60 con 0x5612298c6f00 2024-05-09T09:47:37.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.831+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eb00083f0 con 0x5612298c6f00 2024-05-09T09:47:37.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.831+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5612298cab60 con 0x5612298c6f00 2024-05-09T09:47:37.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.831+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eb0027040 con 0x5612298c6f00 2024-05-09T09:47:37.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.831+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5612298cab60 con 0x5612298cb8c0 2024-05-09T09:47:37.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.835+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.835+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5612298cab60 con 0x5612298cb8c0 2024-05-09T09:47:37.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.835+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.835+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5612298cab60 con 0x7f9eac0ce040 2024-05-09T09:47:37.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.835+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eb0027040 con 0x7f9eac0ce040 2024-05-09T09:47:37.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.835+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5612298cab60 con 0x5612298d01a0 2024-05-09T09:47:37.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.835+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.835+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5612298cab60 con 0x5612298c6f00 2024-05-09T09:47:37.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.835+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eb0027040 con 0x5612298c6f00 2024-05-09T09:47:37.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.835+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5612298cab60 con 0x5612298cb8c0 2024-05-09T09:47:37.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.835+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.835+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5612298cab60 con 0x5612298c6f00 2024-05-09T09:47:37.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.835+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eb0027040 con 0x5612298c6f00 2024-05-09T09:47:37.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.835+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5612298cab60 con 0x7f9eac0ce040 2024-05-09T09:47:37.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.835+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9eb0027040 con 0x7f9eac0ce040 2024-05-09T09:47:37.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.835+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5612298cab60 con 0x5612298d01a0 2024-05-09T09:47:37.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.835+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.835+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298d01a0 2024-05-09T09:47:37.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.839+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.839+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298cb8c0 2024-05-09T09:47:37.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.839+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.839+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298d01a0 2024-05-09T09:47:37.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.839+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.839+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298d01a0 2024-05-09T09:47:37.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.839+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.839+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298c6f00 2024-05-09T09:47:37.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.839+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eb0027040 con 0x5612298c6f00 2024-05-09T09:47:37.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.839+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298c6f00 2024-05-09T09:47:37.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.839+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9eb0027040 con 0x5612298c6f00 2024-05-09T09:47:37.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.839+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298cb8c0 2024-05-09T09:47:37.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.839+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.839+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298d01a0 2024-05-09T09:47:37.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.839+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.839+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x7f9eac0ce040 2024-05-09T09:47:37.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.839+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eb0027040 con 0x7f9eac0ce040 2024-05-09T09:47:37.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.839+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298c6f00 2024-05-09T09:47:37.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.839+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eb0027040 con 0x5612298c6f00 2024-05-09T09:47:37.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.839+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298cb8c0 2024-05-09T09:47:37.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298d01a0 2024-05-09T09:47:37.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298cb8c0 2024-05-09T09:47:37.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x7f9eac0ce040 2024-05-09T09:47:37.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eb0027040 con 0x7f9eac0ce040 2024-05-09T09:47:37.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298d01a0 2024-05-09T09:47:37.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298cb8c0 2024-05-09T09:47:37.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298c6f00 2024-05-09T09:47:37.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9eb0027040 con 0x5612298c6f00 2024-05-09T09:47:37.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x7f9eac0ce040 2024-05-09T09:47:37.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eb0027040 con 0x7f9eac0ce040 2024-05-09T09:47:37.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb8910980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:37.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb8910980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:37.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb8910980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:37.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb8910980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:37.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb8910980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:37.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb8910980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:37.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb8910980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5612298cea80 con 0x5612298c6f00 2024-05-09T09:47:37.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9eb0027040 con 0x5612298c6f00 2024-05-09T09:47:37.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb8910980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:37.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb8910980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5612298cea80 con 0x5612298c6f00 2024-05-09T09:47:37.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9eb0027040 con 0x5612298c6f00 2024-05-09T09:47:37.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb8910980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:37.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb8910980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.843+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5612298cea80 con 0x5612298d01a0 2024-05-09T09:47:37.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.847+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.847+0000 7f9eb8910980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:37.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.847+0000 7f9eb8910980 20 zone default found 2024-05-09T09:47:37.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.847+0000 7f9eb8910980 4 Realm: () 2024-05-09T09:47:37.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.847+0000 7f9eb8910980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:37.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.847+0000 7f9eb8910980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:37.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.847+0000 7f9eb8910980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:37.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.847+0000 7f9eb8910980 20 zonegroup default 2024-05-09T09:47:37.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.847+0000 7f9eb8910980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.847+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5612298cf320 con 0x5612298cb8c0 2024-05-09T09:47:37.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.847+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.847+0000 7f9eb8910980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:37.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.847+0000 7f9eb8910980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.847+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5612298d4b90 con 0x5612298d01a0 2024-05-09T09:47:37.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.847+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.847+0000 7f9eb8910980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:37.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.847+0000 7f9eb8910980 20 rados->read ofs=0 len=0 2024-05-09T09:47:37.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.847+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5612298d4f30 con 0x5612298d01a0 2024-05-09T09:47:37.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.847+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.847+0000 7f9eb8910980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:37.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.847+0000 7f9eb8910980 20 started sync module instance, tier type = 2024-05-09T09:47:37.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.847+0000 7f9eb8910980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:37.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.847+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298d4030 con 0x7f9eac0ce040 2024-05-09T09:47:37.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.847+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9eb0027040 con 0x7f9eac0ce040 2024-05-09T09:47:37.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.847+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94636006524208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298d4030 con 0x7f9eac0ce040 2024-05-09T09:47:37.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.847+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298d58f0 con 0x5612298c6f00 2024-05-09T09:47:37.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.851+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94636006524208] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9eb0037040 con 0x7f9eac0ce040 2024-05-09T09:47:37.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.851+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9eb0037040 con 0x5612298c6f00 2024-05-09T09:47:37.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.851+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94636006528336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298d4030 con 0x5612298c6f00 2024-05-09T09:47:37.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.851+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298d6300 con 0x5612298d01a0 2024-05-09T09:47:37.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.851+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94636006528336] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9eb0037040 con 0x5612298c6f00 2024-05-09T09:47:37.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.851+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.851+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94636006521728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298d3fa0 con 0x5612298d01a0 2024-05-09T09:47:37.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.851+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298d7040 con 0x7f9eac0ce040 2024-05-09T09:47:37.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.855+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9eb0037040 con 0x7f9eac0ce040 2024-05-09T09:47:37.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.855+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94636006533968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298d6f70 con 0x7f9eac0ce040 2024-05-09T09:47:37.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.855+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298d7f00 con 0x5612298c6f00 2024-05-09T09:47:37.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.855+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94636006521728] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.855+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94636006533968] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9eb0037040 con 0x7f9eac0ce040 2024-05-09T09:47:37.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.855+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9eb0037040 con 0x5612298c6f00 2024-05-09T09:47:37.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.855+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94636006532768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298d7a50 con 0x5612298c6f00 2024-05-09T09:47:37.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.855+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298d87a0 con 0x5612298cb8c0 2024-05-09T09:47:37.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.859+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94636006532768] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9eb0037040 con 0x5612298c6f00 2024-05-09T09:47:37.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.859+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.859+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94636006540016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298d7a50 con 0x5612298cb8c0 2024-05-09T09:47:37.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.859+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298d8ff0 con 0x5612298cb8c0 2024-05-09T09:47:37.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.859+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94636006540016] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.859+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.859+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94636006536160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298d9840 con 0x5612298cb8c0 2024-05-09T09:47:37.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.859+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298da0f0 con 0x5612298cb8c0 2024-05-09T09:47:37.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.863+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94636006536160] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.863+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.863+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94636006544272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298da2d0 con 0x5612298cb8c0 2024-05-09T09:47:37.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.863+0000 7f9eb8910980 20 add_watcher() i=0 2024-05-09T09:47:37.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.863+0000 7f9eb8910980 20 add_watcher() i=1 2024-05-09T09:47:37.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.863+0000 7f9eb8910980 20 add_watcher() i=2 2024-05-09T09:47:37.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.863+0000 7f9eb8910980 20 add_watcher() i=3 2024-05-09T09:47:37.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.863+0000 7f9eb8910980 20 add_watcher() i=4 2024-05-09T09:47:37.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.863+0000 7f9eb8910980 20 add_watcher() i=5 2024-05-09T09:47:37.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.863+0000 7f9eb8910980 20 add_watcher() i=6 2024-05-09T09:47:37.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.863+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94636006544272] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.863+0000 7f9eb8910980 20 add_watcher() i=7 2024-05-09T09:47:37.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.863+0000 7f9eb8910980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:37.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.867+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5612298dd6a0 con 0x5612298c6f00 2024-05-09T09:47:37.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.867+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9eb0037040 con 0x5612298c6f00 2024-05-09T09:47:37.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.867+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94636006547904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298daac0 con 0x5612298c6f00 2024-05-09T09:47:37.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.867+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94636006547904] v30'169 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9eb0037040 con 0x5612298c6f00 2024-05-09T09:47:37.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.867+0000 7f9d6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:37.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.867+0000 7f9eb8910980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:37.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.867+0000 7f9eb8910980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:37.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.867+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e5c30 con 0x5612298c6f00 2024-05-09T09:47:37.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.867+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'45 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9eb0037040 con 0x5612298c6f00 2024-05-09T09:47:37.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.867+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e61c0 con 0x5612298cb8c0 2024-05-09T09:47:37.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.871+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'39 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.871+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e61c0 con 0x5612298d01a0 2024-05-09T09:47:37.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.871+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'39 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.871+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e6620 con 0x5612298c6f00 2024-05-09T09:47:37.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.875+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'170 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9eb0037040 con 0x5612298c6f00 2024-05-09T09:47:37.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.875+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e6b90 con 0x7f9eac0ce040 2024-05-09T09:47:37.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.875+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'107 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9eb0037040 con 0x7f9eac0ce040 2024-05-09T09:47:37.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.875+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e6fb0 con 0x5612298d01a0 2024-05-09T09:47:37.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.875+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'71 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.875+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e7520 con 0x5612298c6f00 2024-05-09T09:47:37.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.879+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'41 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9eb0037040 con 0x5612298c6f00 2024-05-09T09:47:37.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.879+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e7520 con 0x5612298cb8c0 2024-05-09T09:47:37.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.879+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'71 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.879+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e7af0 con 0x7f9eac0ce040 2024-05-09T09:47:37.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.883+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'39 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9eb0037040 con 0x7f9eac0ce040 2024-05-09T09:47:37.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.883+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e7af0 con 0x5612298d01a0 2024-05-09T09:47:37.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.883+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'45 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.883+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e7af0 con 0x7f9eac0ce040 2024-05-09T09:47:37.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.887+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'108 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9eb0037040 con 0x7f9eac0ce040 2024-05-09T09:47:37.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.887+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e7af0 con 0x5612298cb8c0 2024-05-09T09:47:37.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.887+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'41 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.887+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e7af0 con 0x7f9eac0ce040 2024-05-09T09:47:37.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.891+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'39 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9eb0037040 con 0x7f9eac0ce040 2024-05-09T09:47:37.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.891+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e7c00 con 0x5612298cb8c0 2024-05-09T09:47:37.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.891+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'77 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.891+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e7c00 con 0x5612298c6f00 2024-05-09T09:47:37.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.891+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'171 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9eb0037040 con 0x5612298c6f00 2024-05-09T09:47:37.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.891+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e7c00 con 0x5612298d01a0 2024-05-09T09:47:37.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.895+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'101 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.895+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e7c00 con 0x7f9eac0ce040 2024-05-09T09:47:37.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.895+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'109 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9eb0037040 con 0x7f9eac0ce040 2024-05-09T09:47:37.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.895+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e7c00 con 0x5612298d01a0 2024-05-09T09:47:37.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.899+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'39 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.899+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e7c00 con 0x5612298c6f00 2024-05-09T09:47:37.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.899+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'47 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9eb0037040 con 0x5612298c6f00 2024-05-09T09:47:37.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.899+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e7c00 con 0x5612298c6f00 2024-05-09T09:47:37.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.903+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'172 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9eb0037040 con 0x5612298c6f00 2024-05-09T09:47:37.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.903+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e7c00 con 0x5612298d01a0 2024-05-09T09:47:37.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.903+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'102 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.903+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e82b0 con 0x7f9eac0ce040 2024-05-09T09:47:37.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.907+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'49 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9eb0037040 con 0x7f9eac0ce040 2024-05-09T09:47:37.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.907+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e7ce0 con 0x5612298d01a0 2024-05-09T09:47:37.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.907+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'41 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.907+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e7ce0 con 0x5612298d01a0 2024-05-09T09:47:37.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.907+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'45 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.907+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e7ce0 con 0x5612298d01a0 2024-05-09T09:47:37.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.911+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'35 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.911+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e7ce0 con 0x5612298d01a0 2024-05-09T09:47:37.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.911+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'72 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.911+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e7ce0 con 0x5612298cb8c0 2024-05-09T09:47:37.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.915+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'41 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.915+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e7ce0 con 0x5612298d01a0 2024-05-09T09:47:37.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.915+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'39 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.915+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e7ce0 con 0x5612298cb8c0 2024-05-09T09:47:37.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.919+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'72 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.919+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e7ce0 con 0x5612298d01a0 2024-05-09T09:47:37.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.919+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'103 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.923+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e7ce0 con 0x5612298cb8c0 2024-05-09T09:47:37.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.923+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'78 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.923+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298e7ce0 con 0x7f9eac0ce040 2024-05-09T09:47:37.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.927+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'45 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9eb0037040 con 0x7f9eac0ce040 2024-05-09T09:47:37.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.927+0000 7f9d6a7e4640 20 reqs_thread_entry: start 2024-05-09T09:47:37.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.927+0000 7f9eb8910980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:37.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.927+0000 7f9cdbfff640 20 reqs_thread_entry: start 2024-05-09T09:47:37.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.927+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:94 8.0 8:00000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561229903980 con 0x5612298d01a0 2024-05-09T09:47:37.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.927+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(94 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.927+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:95 8.10 8:08000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5612298d6300 con 0x5612298d01a0 2024-05-09T09:47:37.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.927+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(95 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.927+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 8.8 8:10000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5612298d6300 con 0x5612298c6f00 2024-05-09T09:47:37.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.927+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(96 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eb0037040 con 0x5612298c6f00 2024-05-09T09:47:37.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.927+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 8.18 8:18000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298c6f00 2024-05-09T09:47:37.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.931+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(97 [pgnls start_epoch 30 out=49b] v30'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eb0037040 con 0x5612298c6f00 2024-05-09T09:47:37.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.931+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:98 8.4 8:20000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x7f9eac0ce040 2024-05-09T09:47:37.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.931+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(98 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eb0037040 con 0x7f9eac0ce040 2024-05-09T09:47:37.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.931+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:99 8.14 8:28000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298d01a0 2024-05-09T09:47:37.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.931+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== osd_op_reply(99 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.931+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 8.c 8:30000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298c6f00 2024-05-09T09:47:37.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.931+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(100 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eb0037040 con 0x5612298c6f00 2024-05-09T09:47:37.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.931+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:101 8.1c 8:38000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298d01a0 2024-05-09T09:47:37.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.931+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 30 ==== osd_op_reply(101 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.931+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:102 8.2 8:40000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x7f9eac0ce040 2024-05-09T09:47:37.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.931+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(102 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eb0037040 con 0x7f9eac0ce040 2024-05-09T09:47:37.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.931+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:103 8.12 8:48000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298d01a0 2024-05-09T09:47:37.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.931+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 31 ==== osd_op_reply(103 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.931+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:104 8.a 8:50000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298c6f00 2024-05-09T09:47:37.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.931+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(104 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eb0037040 con 0x5612298c6f00 2024-05-09T09:47:37.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.931+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:105 8.1a 8:58000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298cb8c0 2024-05-09T09:47:37.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.931+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(105 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.931+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:106 8.6 8:60000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5612298d8ff0 con 0x5612298cb8c0 2024-05-09T09:47:37.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.935+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(106 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.935+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:107 8.16 8:68000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5612298d8ff0 con 0x5612298d01a0 2024-05-09T09:47:37.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.935+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 32 ==== osd_op_reply(107 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.935+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:108 8.e 8:70000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5612298d8ff0 con 0x5612298cb8c0 2024-05-09T09:47:37.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.935+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(108 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.935+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:109 8.1e 8:78000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5612298d8ff0 con 0x5612298cb8c0 2024-05-09T09:47:37.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.935+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(109 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.935+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:110 8.1 8:80000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5612298d8ff0 con 0x5612298cb8c0 2024-05-09T09:47:37.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.935+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(110 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.935+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:111 8.11 8:88000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5612298d8ff0 con 0x5612298d01a0 2024-05-09T09:47:37.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.935+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 33 ==== osd_op_reply(111 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.935+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:112 8.9 8:90000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x7f9eac0ce040 2024-05-09T09:47:37.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.935+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(112 [pgnls start_epoch 30 out=70b] v30'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7f9eb0037040 con 0x7f9eac0ce040 2024-05-09T09:47:37.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.935+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:113 8.19 8:98000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298c6f00 2024-05-09T09:47:37.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.939+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(113 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eb0037040 con 0x5612298c6f00 2024-05-09T09:47:37.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.939+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:114 8.5 8:a0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298c6f00 2024-05-09T09:47:37.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.939+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(114 [pgnls start_epoch 30 out=127b] v30'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f9eb0037040 con 0x5612298c6f00 2024-05-09T09:47:37.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.939+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:115 8.15 8:a8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298d01a0 2024-05-09T09:47:37.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.939+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 34 ==== osd_op_reply(115 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.939+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:116 8.d 8:b0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x7f9eac0ce040 2024-05-09T09:47:37.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.939+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(116 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eb0037040 con 0x7f9eac0ce040 2024-05-09T09:47:37.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.939+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:117 8.1d 8:b8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298cb8c0 2024-05-09T09:47:37.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.939+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(117 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.939+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:118 8.3 8:c0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298c6f00 2024-05-09T09:47:37.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.939+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(118 [pgnls start_epoch 30 out=49b] v30'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eb0037040 con 0x5612298c6f00 2024-05-09T09:47:37.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.939+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:119 8.13 8:c8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298cb8c0 2024-05-09T09:47:37.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.939+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(119 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.939+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:120 8.b 8:d0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298d01a0 2024-05-09T09:47:37.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.939+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 35 ==== osd_op_reply(120 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.939+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:121 8.1b 8:d8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x7f9eac0ce040 2024-05-09T09:47:37.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.943+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(121 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eb0037040 con 0x7f9eac0ce040 2024-05-09T09:47:37.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.943+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:122 8.7 8:e0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298cb8c0 2024-05-09T09:47:37.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.943+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 32 ==== osd_op_reply(122 [pgnls start_epoch 30 out=49b] v30'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.943+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:123 8.17 8:e8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298c6f00 2024-05-09T09:47:37.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.943+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(123 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eb0037040 con 0x5612298c6f00 2024-05-09T09:47:37.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.943+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:124 8.f 8:f0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x5612298d01a0 2024-05-09T09:47:37.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.943+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 36 ==== osd_op_reply(124 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.943+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:125 8.1f 8:f8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f9eac0e8040 con 0x7f9eac0ce040 2024-05-09T09:47:37.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.943+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.2 v2:172.21.15.157:6800/354455204 23 ==== osd_op_reply(125 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9eb0037040 con 0x7f9eac0ce040 2024-05-09T09:47:37.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.943+0000 7f9eb8910980 20 RGWRados::pool_iterate: got myfoo 2024-05-09T09:47:37.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.943+0000 7f9eb8910980 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 2024-05-09T09:47:37.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.943+0000 7f9d6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:37.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.943+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:126 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94636006547904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298d6300 con 0x5612298c6f00 2024-05-09T09:47:37.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.947+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(126 data_loggenerations_metadata [watch unwatch cookie 94636006547904] v30'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9eb0037040 con 0x5612298c6f00 2024-05-09T09:47:37.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.947+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:127 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94636006524208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298d8ff0 con 0x7f9eac0ce040 2024-05-09T09:47:37.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.947+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.2 v2:172.21.15.157:6800/354455204 24 ==== osd_op_reply(127 notify.0 [watch unwatch cookie 94636006524208] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9eb0037040 con 0x7f9eac0ce040 2024-05-09T09:47:37.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.947+0000 7f9eb8910980 20 remove_watcher() i=0 2024-05-09T09:47:37.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.947+0000 7f9eb8910980 2 removed watcher, disabling cache 2024-05-09T09:47:37.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.947+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:128 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94636006528336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298d6300 con 0x5612298c6f00 2024-05-09T09:47:37.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.951+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 36 ==== osd_op_reply(128 notify.1 [watch unwatch cookie 94636006528336] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9eb0037040 con 0x5612298c6f00 2024-05-09T09:47:37.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.951+0000 7f9eb8910980 20 remove_watcher() i=1 2024-05-09T09:47:37.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.951+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:129 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94636006521728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298d8ff0 con 0x5612298d01a0 2024-05-09T09:47:37.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.951+0000 7f9eb5c2a640 1 -- 172.21.15.157:0/4155267747 <== osd.3 v2:172.21.15.157:6816/2487336710 37 ==== osd_op_reply(129 notify.2 [watch unwatch cookie 94636006521728] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9eac0d9070 con 0x5612298d01a0 2024-05-09T09:47:37.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.951+0000 7f9eb8910980 20 remove_watcher() i=2 2024-05-09T09:47:37.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.951+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:130 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94636006533968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298d6300 con 0x7f9eac0ce040 2024-05-09T09:47:37.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.955+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.2 v2:172.21.15.157:6800/354455204 25 ==== osd_op_reply(130 notify.3 [watch unwatch cookie 94636006533968] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9eb0037040 con 0x7f9eac0ce040 2024-05-09T09:47:37.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.955+0000 7f9eb8910980 20 remove_watcher() i=3 2024-05-09T09:47:37.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.955+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:131 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94636006532768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298d6300 con 0x5612298c6f00 2024-05-09T09:47:37.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.955+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 <== osd.1 v2:172.21.15.157:6808/3930131338 37 ==== osd_op_reply(131 notify.4 [watch unwatch cookie 94636006532768] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9eb0037040 con 0x5612298c6f00 2024-05-09T09:47:37.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.955+0000 7f9eb8910980 20 remove_watcher() i=4 2024-05-09T09:47:37.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.955+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:132 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94636006540016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298d5550 con 0x5612298cb8c0 2024-05-09T09:47:37.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.959+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 33 ==== osd_op_reply(132 notify.5 [watch unwatch cookie 94636006540016] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.959+0000 7f9eb8910980 20 remove_watcher() i=5 2024-05-09T09:47:37.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.959+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:133 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94636006536160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298d3b80 con 0x5612298cb8c0 2024-05-09T09:47:37.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.959+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 34 ==== osd_op_reply(133 notify.6 [watch unwatch cookie 94636006536160] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.959+0000 7f9eb8910980 20 remove_watcher() i=6 2024-05-09T09:47:37.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.959+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:134 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94636006544272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5612298d6b50 con 0x5612298cb8c0 2024-05-09T09:47:37.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb642b640 1 -- 172.21.15.157:0/4155267747 <== osd.0 v2:172.21.15.110:6800/231209037 35 ==== osd_op_reply(134 notify.7 [watch unwatch cookie 94636006544272] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ea802c070 con 0x5612298cb8c0 2024-05-09T09:47:37.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 20 remove_watcher() i=7 2024-05-09T09:47:37.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5612298cb8c0 msgr2=0x5612298cdcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 --2- 172.21.15.157:0/4155267747 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5612298cb8c0 0x5612298cdcb0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5612298c6f00 msgr2=0x5612298c93c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 --2- 172.21.15.157:0/4155267747 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5612298c6f00 0x5612298c93c0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f9eac0ce040 msgr2=0x7f9eac0db410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 --2- 172.21.15.157:0/4155267747 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f9eac0ce040 0x7f9eac0db410 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5612298d01a0 msgr2=0x5612298d2660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 --2- 172.21.15.157:0/4155267747 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5612298d01a0 0x5612298d2660 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9d80034b60 msgr2=0x7f9d80037020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 --2- 172.21.15.157:0/4155267747 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9d80034b60 0x7f9d80037020 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9eac000c10 tx=0x7f9eac0a6000 comp rx=0 tx=0).stop 2024-05-09T09:47:37.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612298b2fe0 msgr2=0x5612298ba430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/4155267747 reap_dead start 2024-05-09T09:47:37.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 --2- 172.21.15.157:0/4155267747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612298b2fe0 0x5612298ba430 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8049b00 tx=0x7f9ea801af60 comp rx=0 tx=0).stop 2024-05-09T09:47:37.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 shutdown_connections 2024-05-09T09:47:37.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 --2- 172.21.15.157:0/4155267747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612298b2fe0 0x5612298ba430 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 >> 172.21.15.157:0/4155267747 conn(0x5612298af3b0 msgr2=0x5612298aca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:37.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 shutdown_connections 2024-05-09T09:47:37.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 -- 172.21.15.157:0/4155267747 wait complete. 2024-05-09T09:47:37.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 -- 172.21.15.157:0/3863308919 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9d90034b60 msgr2=0x7f9d90037020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 --2- 172.21.15.157:0/3863308919 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9d90034b60 0x7f9d90037020 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9eac0ae040 tx=0x7f9eac005a10 comp rx=0 tx=0).stop 2024-05-09T09:47:37.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 -- 172.21.15.157:0/3863308919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612298a6060 msgr2=0x5612298a6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 --2- 172.21.15.157:0/3863308919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612298a6060 0x5612298a6480 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8024b10 tx=0x7f9ea8023ac0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 -- 172.21.15.157:0/3863308919 shutdown_connections 2024-05-09T09:47:37.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 --2- 172.21.15.157:0/3863308919 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9d90034b60 0x7f9d90037020 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 --2- 172.21.15.157:0/3863308919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612298a6060 0x5612298a6480 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 -- 172.21.15.157:0/3863308919 >> 172.21.15.157:0/3863308919 conn(0x56122989ae30 msgr2=0x56122989b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:37.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 -- 172.21.15.157:0/3863308919 shutdown_connections 2024-05-09T09:47:37.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 -- 172.21.15.157:0/3863308919 wait complete. 2024-05-09T09:47:37.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 -- 172.21.15.157:0/1685320840 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561229879850 msgr2=0x56122987bc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 --2- 172.21.15.157:0/1685320840 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561229879850 0x56122987bc40 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 -- 172.21.15.157:0/1685320840 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561229782100 msgr2=0x561229877070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 --2- 172.21.15.157:0/1685320840 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561229782100 0x561229877070 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 -- 172.21.15.157:0/1685320840 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56122987d790 msgr2=0x56122987fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 --2- 172.21.15.157:0/1685320840 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56122987d790 0x56122987fb80 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:37.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 -- 172.21.15.157:0/1685320840 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9d9c034c00 msgr2=0x7f9d9c0370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 --2- 172.21.15.157:0/1685320840 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9d9c034c00 0x7f9d9c0370c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9eac0ad000 tx=0x7f9eac0a5040 comp rx=0 tx=0).stop 2024-05-09T09:47:37.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 -- 172.21.15.157:0/1685320840 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612296efa60 msgr2=0x56122986ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:37.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 --2- 172.21.15.157:0/1685320840 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5612296efa60 0x56122986ff70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8000f90 tx=0x7f9ea8001260 comp rx=0 tx=0).stop 2024-05-09T09:47:37.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb6c2c640 1 -- 172.21.15.157:0/1685320840 reap_dead start 2024-05-09T09:47:37.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 -- 172.21.15.157:0/1685320840 shutdown_connections 2024-05-09T09:47:37.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 -- 172.21.15.157:0/1685320840 >> 172.21.15.157:0/1685320840 conn(0x5612297760c0 msgr2=0x561229863400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:37.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 -- 172.21.15.157:0/1685320840 shutdown_connections 2024-05-09T09:47:37.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:37.963+0000 7f9eb8910980 1 -- 172.21.15.157:0/1685320840 wait complete. 2024-05-09T09:47:37.980 INFO:teuthology.orchestra.run.smithi157.stdout:["myfoo"] 2024-05-09T09:47:37.980 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-05-09T09:47:37.997 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-05-09T09:47:38.013 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-05-09T09:47:38.027 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-05-09T09:47:38.075 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-05-09T09:47:38.151 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-05-09T09:47:38.229 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-05-09T09:47:38.306 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-05-09T09:47:38.306 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-05-09T09:47:38.306 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-05-09T09:47:38.306 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-05-09T09:47:38.343 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:38.344 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:38.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.347+0000 7f2e1f2f7980 1 Processor -- start 2024-05-09T09:47:38.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.347+0000 7f2e1f2f7980 1 -- start start 2024-05-09T09:47:38.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.347+0000 7f2e1f2f7980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x557214f7d0a0 0x557214f7d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.347+0000 7f2e1f2f7980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557214e31440 con 0x557214f7d9c0 2024-05-09T09:47:38.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.347+0000 7f2e1f2f7980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x557214e1c5f0 con 0x557214f7d0a0 2024-05-09T09:47:38.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.347+0000 7f2e1ce12640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x557214f7d0a0 0x557214f7d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.347+0000 7f2e1ce12640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x557214f7d0a0 0x557214f7d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58622/0 (socket says 172.21.15.157:58622) 2024-05-09T09:47:38.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.347+0000 7f2e1ce12640 1 -- 172.21.15.157:0/3957343947 learned_addr learned my addr 172.21.15.157:0/3957343947 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:38.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.347+0000 7f2e1ce12640 1 -- 172.21.15.157:0/3957343947 >> v1:172.21.15.110:6789/0 conn(0x557214f7d9c0 legacy=0x557214f79b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.347+0000 7f2e1ce12640 1 -- 172.21.15.157:0/3957343947 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557214e27990 con 0x557214f7d0a0 2024-05-09T09:47:38.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.351+0000 7f2e1ce12640 1 --2- 172.21.15.157:0/3957343947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7d0a0 0x557214f7d480 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00a5c0 tx=0x7f2e0c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17992a4db2ec7e68 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.351+0000 7f2e1be10640 1 -- 172.21.15.157:0/3957343947 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e0c0b0070 con 0x557214f7d0a0 2024-05-09T09:47:38.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.351+0000 7f2e1be10640 1 -- 172.21.15.157:0/3957343947 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e0c0ab520 con 0x557214f7d0a0 2024-05-09T09:47:38.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.351+0000 7f2e1be10640 1 -- 172.21.15.157:0/3957343947 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e0c0ab820 con 0x557214f7d0a0 2024-05-09T09:47:38.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.351+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/3957343947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7d0a0 msgr2=0x557214f7d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.351+0000 7f2e1f2f7980 1 --2- 172.21.15.157:0/3957343947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7d0a0 0x557214f7d480 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00a5c0 tx=0x7f2e0c01b340 comp rx=0 tx=0).stop 2024-05-09T09:47:38.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.351+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/3957343947 shutdown_connections 2024-05-09T09:47:38.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.351+0000 7f2e1f2f7980 1 --2- 172.21.15.157:0/3957343947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7d0a0 0x557214f7d480 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.351+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/3957343947 >> 172.21.15.157:0/3957343947 conn(0x557214f75850 msgr2=0x557214f77c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:38.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.351+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/3957343947 shutdown_connections 2024-05-09T09:47:38.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.351+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/3957343947 wait complete. 2024-05-09T09:47:38.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.367+0000 7f2e1f2f7980 1 Processor -- start 2024-05-09T09:47:38.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.367+0000 7f2e1f2f7980 1 -- start start 2024-05-09T09:47:38.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.367+0000 7f2e1f2f7980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7d0a0 0x557215067420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.367+0000 7f2e1f2f7980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557214e7efe0 con 0x557214f7d0a0 2024-05-09T09:47:38.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.367+0000 7f2e1ce12640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7d0a0 0x557215067420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.367+0000 7f2e1ce12640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7d0a0 0x557215067420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58628/0 (socket says 172.21.15.157:58628) 2024-05-09T09:47:38.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.367+0000 7f2e1ce12640 1 -- 172.21.15.157:0/3432299181 learned_addr learned my addr 172.21.15.157:0/3432299181 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:38.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.367+0000 7f2e1ce12640 1 -- 172.21.15.157:0/3432299181 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557214e03ae0 con 0x557214f7d0a0 2024-05-09T09:47:38.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.367+0000 7f2e1ce12640 1 --2- 172.21.15.157:0/3432299181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7d0a0 0x557215067420 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c018f70 tx=0x7f2e0c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b25eac7801f938 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.367+0000 7f2d0ae0d640 1 -- 172.21.15.157:0/3432299181 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e0c0b0040 con 0x557214f7d0a0 2024-05-09T09:47:38.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.367+0000 7f2d0ae0d640 1 -- 172.21.15.157:0/3432299181 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e0c0ab9c0 con 0x557214f7d0a0 2024-05-09T09:47:38.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.367+0000 7f2d0ae0d640 1 -- 172.21.15.157:0/3432299181 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e0c0abce0 con 0x557214f7d0a0 2024-05-09T09:47:38.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.371+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/3432299181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7d0a0 msgr2=0x557215067420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.371+0000 7f2e1f2f7980 1 --2- 172.21.15.157:0/3432299181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7d0a0 0x557215067420 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c018f70 tx=0x7f2e0c003030 comp rx=0 tx=0).stop 2024-05-09T09:47:38.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.371+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/3432299181 shutdown_connections 2024-05-09T09:47:38.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.371+0000 7f2e1f2f7980 1 --2- 172.21.15.157:0/3432299181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7d0a0 0x557215067420 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.371+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/3432299181 >> 172.21.15.157:0/3432299181 conn(0x557214f75850 msgr2=0x557215062fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:38.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.371+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/3432299181 shutdown_connections 2024-05-09T09:47:38.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.371+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/3432299181 wait complete. 2024-05-09T09:47:38.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.371+0000 7f2e1f2f7980 1 Processor -- start 2024-05-09T09:47:38.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.371+0000 7f2e1f2f7980 1 -- start start 2024-05-09T09:47:38.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.371+0000 7f2e1f2f7980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7d0a0 0x55721506e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.371+0000 7f2e1f2f7980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557214f85ba0 con 0x557214f7d0a0 2024-05-09T09:47:38.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.371+0000 7f2e1ce12640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7d0a0 0x55721506e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.371+0000 7f2e1ce12640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7d0a0 0x55721506e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58632/0 (socket says 172.21.15.157:58632) 2024-05-09T09:47:38.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.371+0000 7f2e1ce12640 1 -- 172.21.15.157:0/467281984 learned_addr learned my addr 172.21.15.157:0/467281984 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:38.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.371+0000 7f2e1ce12640 1 -- 172.21.15.157:0/467281984 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55721506ea10 con 0x557214f7d0a0 2024-05-09T09:47:38.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.371+0000 7f2e1ce12640 1 --2- 172.21.15.157:0/467281984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7d0a0 0x55721506e4d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0b9040 tx=0x7f2e0c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.371+0000 7f2d0960a640 1 -- 172.21.15.157:0/467281984 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e0c0b0050 con 0x557214f7d0a0 2024-05-09T09:47:38.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.371+0000 7f2d0960a640 1 -- 172.21.15.157:0/467281984 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e0c0c4070 con 0x557214f7d0a0 2024-05-09T09:47:38.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.371+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/467281984 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55721506eca0 con 0x557214f7d0a0 2024-05-09T09:47:38.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.371+0000 7f2d0960a640 1 -- 172.21.15.157:0/467281984 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e0c0b69a0 con 0x557214f7d0a0 2024-05-09T09:47:38.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.371+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/467281984 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557215071980 con 0x557214f7d0a0 2024-05-09T09:47:38.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.375+0000 7f2d0960a640 1 -- 172.21.15.157:0/467281984 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f2e0c0b6b40 con 0x557214f7d0a0 2024-05-09T09:47:38.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.375+0000 7f2d0960a640 1 --2- 172.21.15.157:0/467281984 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2d04034c00 0x7f2d040370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.375+0000 7f2d0960a640 1 -- 172.21.15.157:0/467281984 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f2e0c0bc070 con 0x557214f7d0a0 2024-05-09T09:47:38.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.375+0000 7f2e1f2f7980 1 --2- 172.21.15.157:0/467281984 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557214f7d9c0 0x557215075460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.375+0000 7f2e1c611640 1 --2- 172.21.15.157:0/467281984 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2d04034c00 0x7f2d040370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.375+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/467281984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557215075ab0 con 0x557214f7d9c0 2024-05-09T09:47:38.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.375+0000 7f2e1d613640 1 --2- 172.21.15.157:0/467281984 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557214f7d9c0 0x557215075460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.375+0000 7f2e1c611640 1 --2- 172.21.15.157:0/467281984 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2d04034c00 0x7f2d040370c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2e10001e20 tx=0x7f2e100013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.375+0000 7f2e1d613640 1 --2- 172.21.15.157:0/467281984 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557214f7d9c0 0x557215075460 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.375+0000 7f2e1d613640 1 -- 172.21.15.157:0/467281984 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x557214f7d9c0 2024-05-09T09:47:38.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.375+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/467281984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557215072ba0 con 0x557214f7d9c0 2024-05-09T09:47:38.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.375+0000 7f2e1d613640 1 -- 172.21.15.157:0/467281984 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2e1400a4d0 con 0x557214f7d9c0 2024-05-09T09:47:38.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.375+0000 7f2e1f2f7980 1 --2- 172.21.15.157:0/467281984 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557215077e30 0x55721507a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.375+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/467281984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55721507a8f0 con 0x557215077e30 2024-05-09T09:47:38.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.375+0000 7f2e1ce12640 1 --2- 172.21.15.157:0/467281984 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557215077e30 0x55721507a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.379+0000 7f2e1ce12640 1 --2- 172.21.15.157:0/467281984 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557215077e30 0x55721507a220 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.379+0000 7f2e1ce12640 1 -- 172.21.15.157:0/467281984 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2e0c0b3040 con 0x557215077e30 2024-05-09T09:47:38.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.379+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/467281984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557215076cd0 con 0x557214f7d9c0 2024-05-09T09:47:38.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.379+0000 7f2e1d613640 1 -- 172.21.15.157:0/467281984 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2e1400a4d0 con 0x557214f7d9c0 2024-05-09T09:47:38.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.379+0000 7f2e1f2f7980 1 --2- 172.21.15.157:0/467281984 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55721507bd50 0x55721507e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.379+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/467281984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55721507e840 con 0x55721507bd50 2024-05-09T09:47:38.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.379+0000 7f2e1c611640 1 --2- 172.21.15.157:0/467281984 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55721507bd50 0x55721507e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.379+0000 7f2e1c611640 1 --2- 172.21.15.157:0/467281984 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55721507bd50 0x55721507e140 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.379+0000 7f2e1c611640 1 -- 172.21.15.157:0/467281984 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2e1000d040 con 0x55721507bd50 2024-05-09T09:47:38.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.383+0000 7f2e1f2f7980 1 Processor -- start 2024-05-09T09:47:38.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.383+0000 7f2e1f2f7980 1 -- start start 2024-05-09T09:47:38.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.383+0000 7f2e1f2f7980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572150a48c0 0x5572150a4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.383+0000 7f2e1f2f7980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557214e83020 con 0x5572150a48c0 2024-05-09T09:47:38.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.387+0000 7f2e1ce12640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572150a48c0 0x5572150a4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.387+0000 7f2e1ce12640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572150a48c0 0x5572150a4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58648/0 (socket says 172.21.15.157:58648) 2024-05-09T09:47:38.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.387+0000 7f2e1ce12640 1 -- 172.21.15.157:0/3216457747 learned_addr learned my addr 172.21.15.157:0/3216457747 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:38.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.387+0000 7f2e1ce12640 1 -- 172.21.15.157:0/3216457747 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572150a5220 con 0x5572150a48c0 2024-05-09T09:47:38.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.387+0000 7f2e1ce12640 1 --2- 172.21.15.157:0/3216457747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572150a48c0 0x5572150a4ce0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0e2fc0 tx=0x7f2e0c0b4900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.387+0000 7f2d0139f640 1 -- 172.21.15.157:0/3216457747 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e0c0e9070 con 0x5572150a48c0 2024-05-09T09:47:38.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.387+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/3216457747 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572150a5cb0 con 0x5572150a48c0 2024-05-09T09:47:38.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.387+0000 7f2d0139f640 1 -- 172.21.15.157:0/3216457747 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e0c0b5e90 con 0x5572150a48c0 2024-05-09T09:47:38.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.387+0000 7f2d0139f640 1 -- 172.21.15.157:0/3216457747 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e0c0c97a0 con 0x5572150a48c0 2024-05-09T09:47:38.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.387+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/3216457747 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572150a6190 con 0x5572150a48c0 2024-05-09T09:47:38.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.387+0000 7f2d0139f640 1 -- 172.21.15.157:0/3216457747 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f2e0c0ec070 con 0x5572150a48c0 2024-05-09T09:47:38.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.387+0000 7f2d0139f640 1 --2- 172.21.15.157:0/3216457747 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2cf4034c00 0x7f2cf40370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.387+0000 7f2d0139f640 1 -- 172.21.15.157:0/3216457747 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f2e0c0e0030 con 0x5572150a48c0 2024-05-09T09:47:38.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.387+0000 7f2e1c611640 1 --2- 172.21.15.157:0/3216457747 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2cf4034c00 0x7f2cf40370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.387+0000 7f2e1f2f7980 1 Processor -- start 2024-05-09T09:47:38.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.391+0000 7f2e1f2f7980 1 -- start start 2024-05-09T09:47:38.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.391+0000 7f2e1f2f7980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7c400 0x557214f7c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.391+0000 7f2e1c611640 1 --2- 172.21.15.157:0/3216457747 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2cf4034c00 0x7f2cf40370c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x5572150763e0 tx=0x7f2e10006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.391+0000 7f2e1f2f7980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557215067b10 con 0x557214f7c400 2024-05-09T09:47:38.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.391+0000 7f2e1ce12640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7c400 0x557214f7c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.391+0000 7f2e1ce12640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7c400 0x557214f7c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58656/0 (socket says 172.21.15.157:58656) 2024-05-09T09:47:38.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.391+0000 7f2e1ce12640 1 -- 172.21.15.157:0/4159648185 learned_addr learned my addr 172.21.15.157:0/4159648185 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:38.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.391+0000 7f2e1ce12640 1 -- 172.21.15.157:0/4159648185 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557214f7ac20 con 0x557214f7c400 2024-05-09T09:47:38.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.391+0000 7f2e1ce12640 1 --2- 172.21.15.157:0/4159648185 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7c400 0x557214f7c7e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0b4a50 tx=0x7f2e0c0d5b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98711251ed11a99d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.391+0000 7f2cfaffd640 1 -- 172.21.15.157:0/4159648185 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e0c0c9940 con 0x557214f7c400 2024-05-09T09:47:38.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.391+0000 7f2cfaffd640 1 -- 172.21.15.157:0/4159648185 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e0c0c8d40 con 0x557214f7c400 2024-05-09T09:47:38.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.391+0000 7f2cfaffd640 1 -- 172.21.15.157:0/4159648185 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e0c0c8950 con 0x557214f7c400 2024-05-09T09:47:38.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.391+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/4159648185 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7c400 msgr2=0x557214f7c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.391+0000 7f2e1f2f7980 1 --2- 172.21.15.157:0/4159648185 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7c400 0x557214f7c7e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0b4a50 tx=0x7f2e0c0d5b40 comp rx=0 tx=0).stop 2024-05-09T09:47:38.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.391+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/4159648185 shutdown_connections 2024-05-09T09:47:38.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.391+0000 7f2e1f2f7980 1 --2- 172.21.15.157:0/4159648185 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7c400 0x557214f7c7e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.391+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/4159648185 >> 172.21.15.157:0/4159648185 conn(0x5572150adc10 msgr2=0x5572150abc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:38.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.391+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/4159648185 shutdown_connections 2024-05-09T09:47:38.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.391+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/4159648185 wait complete. 2024-05-09T09:47:38.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.391+0000 7f2e1f2f7980 1 Processor -- start 2024-05-09T09:47:38.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.391+0000 7f2e1f2f7980 1 -- start start 2024-05-09T09:47:38.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.391+0000 7f2e1f2f7980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7c400 0x5572150badc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.391+0000 7f2e1f2f7980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557214f7b030 con 0x557214f7c400 2024-05-09T09:47:38.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.391+0000 7f2e1ce12640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7c400 0x5572150badc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.391+0000 7f2e1ce12640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7c400 0x5572150badc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58666/0 (socket says 172.21.15.157:58666) 2024-05-09T09:47:38.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.391+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 learned_addr learned my addr 172.21.15.157:0/1574645898 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:38.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.395+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572150bb300 con 0x557214f7c400 2024-05-09T09:47:38.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.395+0000 7f2e1ce12640 1 --2- 172.21.15.157:0/1574645898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7c400 0x5572150badc0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0d8fb0 tx=0x7f2e0c0cff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.395+0000 7f2cf97fa640 1 -- 172.21.15.157:0/1574645898 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e0c10b070 con 0x557214f7c400 2024-05-09T09:47:38.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.395+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572150bb300 con 0x557214f7c400 2024-05-09T09:47:38.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.395+0000 7f2cf97fa640 1 -- 172.21.15.157:0/1574645898 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e0c0ed3b0 con 0x557214f7c400 2024-05-09T09:47:38.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.395+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572150bb300 con 0x557214f7c400 2024-05-09T09:47:38.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.395+0000 7f2cf97fa640 1 -- 172.21.15.157:0/1574645898 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e0c0e12d0 con 0x557214f7c400 2024-05-09T09:47:38.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.395+0000 7f2cf97fa640 1 -- 172.21.15.157:0/1574645898 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f2e0c104040 con 0x557214f7c400 2024-05-09T09:47:38.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.395+0000 7f2e1f2f7980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.395+0000 7f2cf97fa640 1 --2- 172.21.15.157:0/1574645898 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2ce4034bb0 0x7f2ce4037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.395+0000 7f2cf97fa640 1 -- 172.21.15.157:0/1574645898 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f2e0c0f9070 con 0x557214f7c400 2024-05-09T09:47:38.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.395+0000 7f2e1c611640 1 --2- 172.21.15.157:0/1574645898 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2ce4034bb0 0x7f2ce4037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.395+0000 7f2e1f2f7980 1 --2- 172.21.15.157:0/1574645898 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5572150c78b0 0x5572150c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.395+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572150ca4c0 con 0x5572150c78b0 2024-05-09T09:47:38.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.395+0000 7f2e1d613640 1 --2- 172.21.15.157:0/1574645898 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5572150c78b0 0x5572150c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.395+0000 7f2e1c611640 1 --2- 172.21.15.157:0/1574645898 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2ce4034bb0 0x7f2ce4037070 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55721507ec40 tx=0x7f2e10011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.395+0000 7f2e1d613640 1 --2- 172.21.15.157:0/1574645898 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5572150c78b0 0x5572150c9d70 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.395+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.395+0000 7f2e1f2f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:38.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.395+0000 7f2e1f2f7980 20 realm 2024-05-09T09:47:38.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.395+0000 7f2e1f2f7980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.395+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572150ca920 con 0x5572150c78b0 2024-05-09T09:47:38.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.395+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.395+0000 7f2e1f2f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:38.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.395+0000 7f2e1f2f7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:38.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.395+0000 7f2e1f2f7980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.395+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb1c0 con 0x5572150c78b0 2024-05-09T09:47:38.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.399+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.399+0000 7f2e1f2f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:38.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.399+0000 7f2e1f2f7980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.399+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x5572150c78b0 2024-05-09T09:47:38.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.399+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.399+0000 7f2e1f2f7980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:38.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.399+0000 7f2e1f2f7980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.399+0000 7f2e1f2f7980 1 --2- 172.21.15.157:0/1574645898 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5572150cc2c0 0x5572150ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.399+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572150cec30 con 0x5572150cc2c0 2024-05-09T09:47:38.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.399+0000 7f2e1ce12640 1 --2- 172.21.15.157:0/1574645898 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5572150cc2c0 0x5572150ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.399+0000 7f2e1ce12640 1 --2- 172.21.15.157:0/1574645898 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5572150cc2c0 0x5572150ce6b0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.399+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.399+0000 7f2e1f2f7980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:38.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.399+0000 7f2e1f2f7980 20 searching for the correct realm 2024-05-09T09:47:38.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.399+0000 7f2e1f2f7980 1 --2- 172.21.15.157:0/1574645898 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5572150d0b60 0x5572150d2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.399+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150d36c0 con 0x5572150d0b60 2024-05-09T09:47:38.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.399+0000 7f2e1c611640 1 --2- 172.21.15.157:0/1574645898 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5572150d0b60 0x5572150d2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.399+0000 7f2e1c611640 1 --2- 172.21.15.157:0/1574645898 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5572150d0b60 0x5572150d2ff0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.399+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e10036040 con 0x5572150d0b60 2024-05-09T09:47:38.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.399+0000 7f2e1c611640 1 --2- 172.21.15.157:0/1574645898 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2e1000f3d0 0x7f2e1000f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.399+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150d36c0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.399+0000 7f2e1d613640 1 --2- 172.21.15.157:0/1574645898 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2e1000f3d0 0x7f2e1000f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.403+0000 7f2e1d613640 1 --2- 172.21.15.157:0/1574645898 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2e1000f3d0 0x7f2e1000f7f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.403+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1400a4d0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.403+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x5572150cc2c0 2024-05-09T09:47:38.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.403+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.403+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x5572150c78b0 2024-05-09T09:47:38.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.403+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.403+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x5572150c78b0 2024-05-09T09:47:38.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.403+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.403+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x5572150cc2c0 2024-05-09T09:47:38.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.403+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.403+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x5572150cc2c0 2024-05-09T09:47:38.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.403+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.403+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x7f2e1000f3d0 2024-05-09T09:47:38.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.403+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1400a4d0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.403+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x5572150d0b60 2024-05-09T09:47:38.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.407+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e10036040 con 0x5572150d0b60 2024-05-09T09:47:38.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.407+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x5572150c78b0 2024-05-09T09:47:38.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.407+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.407+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x5572150cc2c0 2024-05-09T09:47:38.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.407+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.407+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x5572150c78b0 2024-05-09T09:47:38.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.407+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.407+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x7f2e1000f3d0 2024-05-09T09:47:38.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.407+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2e1400a4d0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.407+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x5572150d0b60 2024-05-09T09:47:38.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.407+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e10036040 con 0x5572150d0b60 2024-05-09T09:47:38.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.407+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x5572150d0b60 2024-05-09T09:47:38.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.407+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2e10036040 con 0x5572150d0b60 2024-05-09T09:47:38.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.407+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x5572150cc2c0 2024-05-09T09:47:38.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.407+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.407+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x5572150d0b60 2024-05-09T09:47:38.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.407+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e10036040 con 0x5572150d0b60 2024-05-09T09:47:38.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.407+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x5572150d0b60 2024-05-09T09:47:38.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.407+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e10036040 con 0x5572150d0b60 2024-05-09T09:47:38.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.407+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x5572150c78b0 2024-05-09T09:47:38.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.411+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.411+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x5572150c78b0 2024-05-09T09:47:38.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.411+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.411+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x5572150cc2c0 2024-05-09T09:47:38.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.411+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.411+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x5572150d0b60 2024-05-09T09:47:38.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.411+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e10036040 con 0x5572150d0b60 2024-05-09T09:47:38.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.411+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x7f2e1000f3d0 2024-05-09T09:47:38.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.411+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1400a4d0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.411+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x5572150c78b0 2024-05-09T09:47:38.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.411+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.411+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x5572150cc2c0 2024-05-09T09:47:38.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.411+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.411+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x5572150d0b60 2024-05-09T09:47:38.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.411+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e10036040 con 0x5572150d0b60 2024-05-09T09:47:38.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.411+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x5572150cc2c0 2024-05-09T09:47:38.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x7f2e1000f3d0 2024-05-09T09:47:38.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1400a4d0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x5572150d0b60 2024-05-09T09:47:38.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e10049040 con 0x5572150d0b60 2024-05-09T09:47:38.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x5572150cc2c0 2024-05-09T09:47:38.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x5572150c78b0 2024-05-09T09:47:38.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5572150cb560 con 0x7f2e1000f3d0 2024-05-09T09:47:38.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e1400a4d0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1f2f7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:38.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1f2f7980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:38.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1f2f7980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:38.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1f2f7980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:38.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1f2f7980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:38.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1f2f7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:38.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1f2f7980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572150cf480 con 0x5572150c78b0 2024-05-09T09:47:38.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1f2f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:38.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1f2f7980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572150cf480 con 0x5572150c78b0 2024-05-09T09:47:38.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1f2f7980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:38.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1f2f7980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572150cf480 con 0x5572150d0b60 2024-05-09T09:47:38.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2e10049040 con 0x5572150d0b60 2024-05-09T09:47:38.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1f2f7980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:38.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1f2f7980 20 zone default found 2024-05-09T09:47:38.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1f2f7980 4 Realm: () 2024-05-09T09:47:38.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1f2f7980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:38.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1f2f7980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:38.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1f2f7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:38.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1f2f7980 20 zonegroup default 2024-05-09T09:47:38.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1f2f7980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.415+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572150cfd20 con 0x5572150cc2c0 2024-05-09T09:47:38.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.419+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.419+0000 7f2e1f2f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:38.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.419+0000 7f2e1f2f7980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.419+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572150d5520 con 0x5572150d0b60 2024-05-09T09:47:38.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.419+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2e10049040 con 0x5572150d0b60 2024-05-09T09:47:38.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.419+0000 7f2e1f2f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:38.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.419+0000 7f2e1f2f7980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.419+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572150d58c0 con 0x5572150d0b60 2024-05-09T09:47:38.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.419+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2e10049040 con 0x5572150d0b60 2024-05-09T09:47:38.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.419+0000 7f2e1f2f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:38.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.419+0000 7f2e1f2f7980 20 started sync module instance, tier type = 2024-05-09T09:47:38.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.419+0000 7f2e1f2f7980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:38.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.419+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150d49c0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.419+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.419+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93948467826400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150d49c0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.419+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150d62e0 con 0x5572150c78b0 2024-05-09T09:47:38.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.419+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93948467826400] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.423+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.423+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93948467830224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150d49c0 con 0x5572150c78b0 2024-05-09T09:47:38.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.423+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150d6d20 con 0x5572150d0b60 2024-05-09T09:47:38.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.423+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e10049040 con 0x5572150d0b60 2024-05-09T09:47:38.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.423+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93948467832944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150d75c0 con 0x5572150d0b60 2024-05-09T09:47:38.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.423+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150d8000 con 0x7f2e1000f3d0 2024-05-09T09:47:38.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.423+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93948467830224] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.427+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.427+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93948467837648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150d7fc0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.427+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150d8a10 con 0x5572150c78b0 2024-05-09T09:47:38.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.427+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93948467832944] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e10049040 con 0x5572150d0b60 2024-05-09T09:47:38.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.427+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93948467837648] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.427+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.427+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93948467823888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150d8560 con 0x5572150c78b0 2024-05-09T09:47:38.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.427+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150d8db0 con 0x5572150cc2c0 2024-05-09T09:47:38.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.427+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93948467823888] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.431+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.431+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93948467840352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150d8980 con 0x5572150cc2c0 2024-05-09T09:47:38.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.431+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150d9ab0 con 0x5572150cc2c0 2024-05-09T09:47:38.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.431+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93948467840352] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.431+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.431+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93948467843920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150d9d20 con 0x5572150cc2c0 2024-05-09T09:47:38.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.431+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150da840 con 0x5572150cc2c0 2024-05-09T09:47:38.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.435+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.435+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93948467847952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150dacb0 con 0x5572150cc2c0 2024-05-09T09:47:38.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.435+0000 7f2e1f2f7980 20 add_watcher() i=0 2024-05-09T09:47:38.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.435+0000 7f2e1f2f7980 20 add_watcher() i=1 2024-05-09T09:47:38.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.435+0000 7f2e1f2f7980 20 add_watcher() i=2 2024-05-09T09:47:38.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.435+0000 7f2e1f2f7980 20 add_watcher() i=3 2024-05-09T09:47:38.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.435+0000 7f2e1f2f7980 20 add_watcher() i=4 2024-05-09T09:47:38.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.435+0000 7f2e1f2f7980 20 add_watcher() i=5 2024-05-09T09:47:38.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.435+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93948467843920] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.435+0000 7f2e1f2f7980 20 add_watcher() i=6 2024-05-09T09:47:38.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.435+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93948467847952] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.435+0000 7f2e1f2f7980 20 add_watcher() i=7 2024-05-09T09:47:38.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.435+0000 7f2e1f2f7980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:38.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.435+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572150d97b0 con 0x5572150c78b0 2024-05-09T09:47:38.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.435+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.435+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93948467844976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150db1c0 con 0x5572150c78b0 2024-05-09T09:47:38.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.435+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93948467844976] v30'174 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.439+0000 7f2cd1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:38.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.439+0000 7f2e1f2f7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:38.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.439+0000 7f2e1f2f7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:38.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.439+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e62c0 con 0x5572150c78b0 2024-05-09T09:47:38.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.439+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'46 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.439+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e6880 con 0x5572150cc2c0 2024-05-09T09:47:38.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.443+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'41 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.443+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e6880 con 0x5572150d0b60 2024-05-09T09:47:38.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.443+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'40 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e10049040 con 0x5572150d0b60 2024-05-09T09:47:38.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.443+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e6df0 con 0x5572150c78b0 2024-05-09T09:47:38.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.443+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'175 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.443+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e7360 con 0x7f2e1000f3d0 2024-05-09T09:47:38.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.447+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'110 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.447+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e78d0 con 0x5572150d0b60 2024-05-09T09:47:38.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.447+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'74 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e10049040 con 0x5572150d0b60 2024-05-09T09:47:38.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.447+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e7e40 con 0x5572150c78b0 2024-05-09T09:47:38.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.451+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'42 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.451+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e7e40 con 0x5572150cc2c0 2024-05-09T09:47:38.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.451+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'73 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.451+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e8010 con 0x7f2e1000f3d0 2024-05-09T09:47:38.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.455+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'40 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.455+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e8010 con 0x5572150d0b60 2024-05-09T09:47:38.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.455+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'46 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e10049040 con 0x5572150d0b60 2024-05-09T09:47:38.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.455+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e85c0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.455+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'111 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.455+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e85c0 con 0x5572150cc2c0 2024-05-09T09:47:38.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.459+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'42 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.459+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e85c0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.459+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'40 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.459+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e85c0 con 0x5572150cc2c0 2024-05-09T09:47:38.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.463+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'79 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.463+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e85c0 con 0x5572150c78b0 2024-05-09T09:47:38.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.463+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'176 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.463+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e85c0 con 0x5572150d0b60 2024-05-09T09:47:38.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.467+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'104 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e10049040 con 0x5572150d0b60 2024-05-09T09:47:38.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.467+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e8bb0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.467+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'112 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.467+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e88a0 con 0x5572150d0b60 2024-05-09T09:47:38.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.471+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'40 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e10049040 con 0x5572150d0b60 2024-05-09T09:47:38.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.471+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e88a0 con 0x5572150c78b0 2024-05-09T09:47:38.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.471+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'48 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.471+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e88a0 con 0x5572150c78b0 2024-05-09T09:47:38.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.471+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'177 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.471+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e88a0 con 0x5572150d0b60 2024-05-09T09:47:38.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.475+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'105 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e10049040 con 0x5572150d0b60 2024-05-09T09:47:38.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.475+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e88a0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.475+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'50 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.475+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e88a0 con 0x5572150d0b60 2024-05-09T09:47:38.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.479+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'42 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e10049040 con 0x5572150d0b60 2024-05-09T09:47:38.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.479+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e88a0 con 0x5572150d0b60 2024-05-09T09:47:38.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.479+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'46 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e10049040 con 0x5572150d0b60 2024-05-09T09:47:38.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.479+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e88a0 con 0x5572150d0b60 2024-05-09T09:47:38.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.479+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'36 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e10049040 con 0x5572150d0b60 2024-05-09T09:47:38.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.479+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e88a0 con 0x5572150d0b60 2024-05-09T09:47:38.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.479+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'75 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e10049040 con 0x5572150d0b60 2024-05-09T09:47:38.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.483+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e88a0 con 0x5572150cc2c0 2024-05-09T09:47:38.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.483+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'42 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.483+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e88a0 con 0x5572150d0b60 2024-05-09T09:47:38.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.483+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'40 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e10049040 con 0x5572150d0b60 2024-05-09T09:47:38.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.483+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e88a0 con 0x5572150cc2c0 2024-05-09T09:47:38.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.487+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'74 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.487+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e88a0 con 0x5572150d0b60 2024-05-09T09:47:38.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.487+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'106 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e10049040 con 0x5572150d0b60 2024-05-09T09:47:38.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.487+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e88a0 con 0x5572150cc2c0 2024-05-09T09:47:38.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.491+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'80 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.491+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5572150e88a0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.491+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'46 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2cd0fe1640 20 reqs_thread_entry: start 2024-05-09T09:47:38.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1f2f7980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:38.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2c4a7fc640 20 reqs_thread_entry: start 2024-05-09T09:47:38.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1f2f7980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572151044e0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f2e1400a4d0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1f2f7980 20 rados_obj.operate() r=0 bl.length=165 2024-05-09T09:47:38.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1f2f7980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 8.5 8:a7233c95:root::.bucket.meta.myfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557215104d70 con 0x5572150c78b0 2024-05-09T09:47:38.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(95 .bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1f2f7980 20 rados_obj.operate() r=0 bl.length=379 2024-05-09T09:47:38.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1f2f7980 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-09T09:47:38.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1f2f7980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:96 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557215104f20 con 0x7f2e1000f3d0 2024-05-09T09:47:38.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(96 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f2e1400a4d0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1f2f7980 20 rados_obj.operate() r=0 bl.length=165 2024-05-09T09:47:38.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1f2f7980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 8.5 8:a7233c95:root::.bucket.meta.myfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572150e44e0 con 0x5572150c78b0 2024-05-09T09:47:38.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(97 .bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1f2f7980 20 rados_obj.operate() r=0 bl.length=379 2024-05-09T09:47:38.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1f2f7980 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-09T09:47:38.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:98 4.b 4:d25ceb2d:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572151077d0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:99 4.3 4:c0b28912:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55721510a180 con 0x5572150c78b0 2024-05-09T09:47:38.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:100 4.4 4:20a0679d:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55721510cc20 con 0x5572150cc2c0 2024-05-09T09:47:38.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:101 4.26 4:6777fe5e:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55721510f530 con 0x5572150cc2c0 2024-05-09T09:47:38.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 4.3 4:c063be13:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572151120c0 con 0x5572150c78b0 2024-05-09T09:47:38.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 4.31 4:8f008dfd:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55721510f530 con 0x5572150c78b0 2024-05-09T09:47:38.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 4.33 4:ccd4db27:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557215116fb0 con 0x5572150cc2c0 2024-05-09T09:47:38.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:105 4.1d 4:bb2bb3ce:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5572151199e0 con 0x5572150d0b60 2024-05-09T09:47:38.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:106 4.36 4:6fb2fa4a:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55721511c3c0 con 0x5572150c78b0 2024-05-09T09:47:38.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:107 4.17 4:ea8823bf:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55721511edd0 con 0x5572150cc2c0 2024-05-09T09:47:38.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:108 4.3a 4:5f6cb505:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557215121c70 con 0x5572150d0b60 2024-05-09T09:47:38.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(98 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2e1400a4d0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(99 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(103 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(102 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.4 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(105 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2e10049040 con 0x5572150d0b60 2024-05-09T09:47:38.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.495+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(108 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f2e10049040 con 0x5572150d0b60 2024-05-09T09:47:38.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.499+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(100 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.499+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(106 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.499+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(101 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.499+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(107 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.499+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(104 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.499+0000 7f2cd1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:38.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.499+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:109 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93948467844976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557215121c70 con 0x5572150c78b0 2024-05-09T09:47:38.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.499+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(109 data_loggenerations_metadata [watch unwatch cookie 93948467844976] v30'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.499+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:110 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93948467826400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557215121c70 con 0x7f2e1000f3d0 2024-05-09T09:47:38.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.503+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(110 notify.0 [watch unwatch cookie 93948467826400] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.503+0000 7f2e1f2f7980 20 remove_watcher() i=0 2024-05-09T09:47:38.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.503+0000 7f2e1f2f7980 2 removed watcher, disabling cache 2024-05-09T09:47:38.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.503+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:111 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93948467830224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557215121c70 con 0x5572150c78b0 2024-05-09T09:47:38.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.503+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(111 notify.1 [watch unwatch cookie 93948467830224] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.503+0000 7f2e1f2f7980 20 remove_watcher() i=1 2024-05-09T09:47:38.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.503+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:112 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93948467832944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557215121c70 con 0x5572150d0b60 2024-05-09T09:47:38.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.507+0000 7f2e1c611640 1 -- 172.21.15.157:0/1574645898 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== osd_op_reply(112 notify.2 [watch unwatch cookie 93948467832944] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e10049040 con 0x5572150d0b60 2024-05-09T09:47:38.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.507+0000 7f2e1f2f7980 20 remove_watcher() i=2 2024-05-09T09:47:38.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.507+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:113 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93948467837648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557215121c70 con 0x7f2e1000f3d0 2024-05-09T09:47:38.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.507+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(113 notify.3 [watch unwatch cookie 93948467837648] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x7f2e1000f3d0 2024-05-09T09:47:38.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.507+0000 7f2e1f2f7980 20 remove_watcher() i=3 2024-05-09T09:47:38.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.507+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:114 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93948467823888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557215121c70 con 0x5572150c78b0 2024-05-09T09:47:38.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.511+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(114 notify.4 [watch unwatch cookie 93948467823888] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e1400a4d0 con 0x5572150c78b0 2024-05-09T09:47:38.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.511+0000 7f2e1f2f7980 20 remove_watcher() i=4 2024-05-09T09:47:38.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.511+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:115 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93948467840352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557215121c70 con 0x5572150cc2c0 2024-05-09T09:47:38.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.511+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(115 notify.5 [watch unwatch cookie 93948467840352] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.511+0000 7f2e1f2f7980 20 remove_watcher() i=5 2024-05-09T09:47:38.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.511+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:116 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93948467843920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557215121c70 con 0x5572150cc2c0 2024-05-09T09:47:38.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.515+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(116 notify.6 [watch unwatch cookie 93948467843920] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.515+0000 7f2e1f2f7980 20 remove_watcher() i=6 2024-05-09T09:47:38.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.515+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:117 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93948467847952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557215121c70 con 0x5572150cc2c0 2024-05-09T09:47:38.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.515+0000 7f2e1ce12640 1 -- 172.21.15.157:0/1574645898 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(117 notify.7 [watch unwatch cookie 93948467847952] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0c0eb030 con 0x5572150cc2c0 2024-05-09T09:47:38.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.515+0000 7f2e1f2f7980 20 remove_watcher() i=7 2024-05-09T09:47:38.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.515+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5572150cc2c0 msgr2=0x5572150ce6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.515+0000 7f2e1f2f7980 1 --2- 172.21.15.157:0/1574645898 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5572150cc2c0 0x5572150ce6b0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.515+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5572150c78b0 msgr2=0x5572150c9d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.515+0000 7f2e1f2f7980 1 --2- 172.21.15.157:0/1574645898 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5572150c78b0 0x5572150c9d70 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.515+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2e1000f3d0 msgr2=0x7f2e1000f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.515+0000 7f2e1f2f7980 1 --2- 172.21.15.157:0/1574645898 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2e1000f3d0 0x7f2e1000f7f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.515+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5572150d0b60 msgr2=0x5572150d2ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.515+0000 7f2e1f2f7980 1 --2- 172.21.15.157:0/1574645898 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5572150d0b60 0x5572150d2ff0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.515+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2ce4034bb0 msgr2=0x7f2ce4037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.515+0000 7f2e1f2f7980 1 --2- 172.21.15.157:0/1574645898 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2ce4034bb0 0x7f2ce4037070 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55721507ec40 tx=0x7f2e10011000 comp rx=0 tx=0).stop 2024-05-09T09:47:38.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.515+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7c400 msgr2=0x5572150badc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.515+0000 7f2e1f2f7980 1 --2- 172.21.15.157:0/1574645898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7c400 0x5572150badc0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0d8fb0 tx=0x7f2e0c0cff00 comp rx=0 tx=0).stop 2024-05-09T09:47:38.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.515+0000 7f2e1d613640 1 -- 172.21.15.157:0/1574645898 reap_dead start 2024-05-09T09:47:38.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.515+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 shutdown_connections 2024-05-09T09:47:38.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.515+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 >> 172.21.15.157:0/1574645898 conn(0x5572150adc10 msgr2=0x5572150ab270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:38.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.515+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 shutdown_connections 2024-05-09T09:47:38.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.515+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/1574645898 wait complete. 2024-05-09T09:47:38.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.519+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/3216457747 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2cf4034c00 msgr2=0x7f2cf40370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.519+0000 7f2e1f2f7980 1 --2- 172.21.15.157:0/3216457747 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2cf4034c00 0x7f2cf40370c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x5572150763e0 tx=0x7f2e10006000 comp rx=0 tx=0).stop 2024-05-09T09:47:38.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.519+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/3216457747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572150a48c0 msgr2=0x5572150a4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.519+0000 7f2e1f2f7980 1 --2- 172.21.15.157:0/3216457747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572150a48c0 0x5572150a4ce0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0e2fc0 tx=0x7f2e0c0b4900 comp rx=0 tx=0).stop 2024-05-09T09:47:38.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.519+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/3216457747 shutdown_connections 2024-05-09T09:47:38.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.519+0000 7f2e1f2f7980 1 --2- 172.21.15.157:0/3216457747 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2cf4034c00 0x7f2cf40370c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.519+0000 7f2e1f2f7980 1 --2- 172.21.15.157:0/3216457747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5572150a48c0 0x5572150a4ce0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.519+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/3216457747 >> 172.21.15.157:0/3216457747 conn(0x557215099690 msgr2=0x55721509a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:38.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.519+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/3216457747 shutdown_connections 2024-05-09T09:47:38.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.519+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/3216457747 wait complete. 2024-05-09T09:47:38.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.519+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/467281984 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557215077e30 msgr2=0x55721507a220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.519+0000 7f2e1f2f7980 1 --2- 172.21.15.157:0/467281984 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557215077e30 0x55721507a220 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.519+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/467281984 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557214f7d9c0 msgr2=0x557215075460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.519+0000 7f2e1f2f7980 1 --2- 172.21.15.157:0/467281984 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557214f7d9c0 0x557215075460 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.519+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/467281984 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55721507bd50 msgr2=0x55721507e140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.519+0000 7f2e1f2f7980 1 --2- 172.21.15.157:0/467281984 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55721507bd50 0x55721507e140 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.519+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/467281984 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2d04034c00 msgr2=0x7f2d040370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.519+0000 7f2e1f2f7980 1 --2- 172.21.15.157:0/467281984 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2d04034c00 0x7f2d040370c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2e10001e20 tx=0x7f2e100013a0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.519+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/467281984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7d0a0 msgr2=0x55721506e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.519+0000 7f2e1f2f7980 1 --2- 172.21.15.157:0/467281984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557214f7d0a0 0x55721506e4d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0b9040 tx=0x7f2e0c0180e0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.519+0000 7f2e1d613640 1 -- 172.21.15.157:0/467281984 reap_dead start 2024-05-09T09:47:38.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.519+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/467281984 shutdown_connections 2024-05-09T09:47:38.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.519+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/467281984 >> 172.21.15.157:0/467281984 conn(0x557214f75850 msgr2=0x557215061ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:38.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.519+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/467281984 shutdown_connections 2024-05-09T09:47:38.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.519+0000 7f2e1f2f7980 1 -- 172.21.15.157:0/467281984 wait complete. 2024-05-09T09:47:38.528 INFO:teuthology.orchestra.run.smithi157.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"69d0cd00-5979-46bf-b012-5813947e658a","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1","marker":"b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-05-09T09:47:37.457331Z","creation_time":"2024-05-09T09:47:37.451022Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-05-09T09:47:38.529 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '69d0cd00-5979-46bf-b012-5813947e658a', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1', 'marker': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-09T09:47:37.457331Z', 'creation_time': '2024-05-09T09:47:37.451022Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-09T09:47:38.529 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-05-09T09:47:38.529 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-05-09T09:47:38.529 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-05-09T09:47:38.608 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:38.608 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:38.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.611+0000 7fc4905dc980 1 Processor -- start 2024-05-09T09:47:38.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.611+0000 7fc4905dc980 1 -- start start 2024-05-09T09:47:38.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.611+0000 7fc4905dc980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55997066ff00 0x5599706702e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.611+0000 7fc4905dc980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559970523440 con 0x559970670dc0 2024-05-09T09:47:38.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.611+0000 7fc4905dc980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55997050e5f0 con 0x55997066ff00 2024-05-09T09:47:38.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.611+0000 7fc48e0f7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55997066ff00 0x5599706702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.611+0000 7fc48e0f7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55997066ff00 0x5599706702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58678/0 (socket says 172.21.15.157:58678) 2024-05-09T09:47:38.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.611+0000 7fc48d8f6640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x559970670dc0 0x5599706711d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:51654/0 (socket says 172.21.15.157:51654) 2024-05-09T09:47:38.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.611+0000 7fc48e0f7640 1 -- 172.21.15.157:0/656605988 learned_addr learned my addr 172.21.15.157:0/656605988 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:38.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.611+0000 7fc48e0f7640 1 -- 172.21.15.157:0/656605988 >> v1:172.21.15.110:6789/0 conn(0x559970670dc0 legacy=0x5599706711d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.611+0000 7fc48e0f7640 1 -- 172.21.15.157:0/656605988 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559970519990 con 0x55997066ff00 2024-05-09T09:47:38.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.615+0000 7fc48e0f7640 1 --2- 172.21.15.157:0/656605988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55997066ff00 0x5599706702e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc48800a4e0 tx=0x7fc48801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3376bd3c23291f6e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.615+0000 7fc48d0f5640 1 -- 172.21.15.157:0/656605988 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4880aa540 con 0x55997066ff00 2024-05-09T09:47:38.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.615+0000 7fc48d0f5640 1 -- 172.21.15.157:0/656605988 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4880aa6e0 con 0x55997066ff00 2024-05-09T09:47:38.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.615+0000 7fc48d0f5640 1 -- 172.21.15.157:0/656605988 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4880aaa40 con 0x55997066ff00 2024-05-09T09:47:38.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.615+0000 7fc4905dc980 1 -- 172.21.15.157:0/656605988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55997066ff00 msgr2=0x5599706702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.615+0000 7fc4905dc980 1 --2- 172.21.15.157:0/656605988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55997066ff00 0x5599706702e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc48800a4e0 tx=0x7fc48801b090 comp rx=0 tx=0).stop 2024-05-09T09:47:38.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.615+0000 7fc4905dc980 1 -- 172.21.15.157:0/656605988 shutdown_connections 2024-05-09T09:47:38.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.615+0000 7fc4905dc980 1 --2- 172.21.15.157:0/656605988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55997066ff00 0x5599706702e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.615+0000 7fc4905dc980 1 -- 172.21.15.157:0/656605988 >> 172.21.15.157:0/656605988 conn(0x5599705e32a0 msgr2=0x5599705e36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:38.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.615+0000 7fc4905dc980 1 -- 172.21.15.157:0/656605988 shutdown_connections 2024-05-09T09:47:38.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.615+0000 7fc4905dc980 1 -- 172.21.15.157:0/656605988 wait complete. 2024-05-09T09:47:38.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.631+0000 7fc4905dc980 1 Processor -- start 2024-05-09T09:47:38.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.631+0000 7fc4905dc980 1 -- start start 2024-05-09T09:47:38.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.631+0000 7fc4905dc980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55997066ff00 0x55997075b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.631+0000 7fc4905dc980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x559970570fe0 con 0x55997066ff00 2024-05-09T09:47:38.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.631+0000 7fc48e0f7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55997066ff00 0x55997075b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.631+0000 7fc48e0f7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55997066ff00 0x55997075b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58688/0 (socket says 172.21.15.157:58688) 2024-05-09T09:47:38.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.631+0000 7fc48e0f7640 1 -- 172.21.15.157:0/3305951469 learned_addr learned my addr 172.21.15.157:0/3305951469 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:38.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.631+0000 7fc48e0f7640 1 -- 172.21.15.157:0/3305951469 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599704f5ae0 con 0x55997066ff00 2024-05-09T09:47:38.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.631+0000 7fc48e0f7640 1 --2- 172.21.15.157:0/3305951469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55997066ff00 0x55997075b2d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc488018cc0 tx=0x7fc4880033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389c849375168a81 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.631+0000 7fc37c608640 1 -- 172.21.15.157:0/3305951469 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4880b9070 con 0x55997066ff00 2024-05-09T09:47:38.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.631+0000 7fc37c608640 1 -- 172.21.15.157:0/3305951469 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4880aa9c0 con 0x55997066ff00 2024-05-09T09:47:38.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.631+0000 7fc37c608640 1 -- 172.21.15.157:0/3305951469 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4880aaca0 con 0x55997066ff00 2024-05-09T09:47:38.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.635+0000 7fc4905dc980 1 -- 172.21.15.157:0/3305951469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55997066ff00 msgr2=0x55997075b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.635+0000 7fc4905dc980 1 --2- 172.21.15.157:0/3305951469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55997066ff00 0x55997075b2d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc488018cc0 tx=0x7fc4880033b0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.635+0000 7fc4905dc980 1 -- 172.21.15.157:0/3305951469 shutdown_connections 2024-05-09T09:47:38.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.635+0000 7fc4905dc980 1 --2- 172.21.15.157:0/3305951469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55997066ff00 0x55997075b2d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.635+0000 7fc4905dc980 1 -- 172.21.15.157:0/3305951469 >> 172.21.15.157:0/3305951469 conn(0x5599705e32a0 msgr2=0x559970756e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:38.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.635+0000 7fc4905dc980 1 -- 172.21.15.157:0/3305951469 shutdown_connections 2024-05-09T09:47:38.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.635+0000 7fc4905dc980 1 -- 172.21.15.157:0/3305951469 wait complete. 2024-05-09T09:47:38.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.635+0000 7fc4905dc980 1 Processor -- start 2024-05-09T09:47:38.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.635+0000 7fc4905dc980 1 -- start start 2024-05-09T09:47:38.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.635+0000 7fc4905dc980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55997066ff00 0x559970762290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.635+0000 7fc4905dc980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x559970679b30 con 0x55997066ff00 2024-05-09T09:47:38.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.635+0000 7fc48e0f7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55997066ff00 0x559970762290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.635+0000 7fc48e0f7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55997066ff00 0x559970762290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58700/0 (socket says 172.21.15.157:58700) 2024-05-09T09:47:38.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.635+0000 7fc48e0f7640 1 -- 172.21.15.157:0/1729160816 learned_addr learned my addr 172.21.15.157:0/1729160816 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:38.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.635+0000 7fc48e0f7640 1 -- 172.21.15.157:0/1729160816 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599707627d0 con 0x55997066ff00 2024-05-09T09:47:38.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.635+0000 7fc48e0f7640 1 --2- 172.21.15.157:0/1729160816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55997066ff00 0x559970762290 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc48801b0d0 tx=0x7fc488017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.635+0000 7fc37ae05640 1 -- 172.21.15.157:0/1729160816 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4880b9070 con 0x55997066ff00 2024-05-09T09:47:38.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.635+0000 7fc37ae05640 1 -- 172.21.15.157:0/1729160816 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4880b5be0 con 0x55997066ff00 2024-05-09T09:47:38.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.635+0000 7fc4905dc980 1 -- 172.21.15.157:0/1729160816 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559970762a60 con 0x55997066ff00 2024-05-09T09:47:38.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.635+0000 7fc37ae05640 1 -- 172.21.15.157:0/1729160816 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4880c7400 con 0x55997066ff00 2024-05-09T09:47:38.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.635+0000 7fc4905dc980 1 -- 172.21.15.157:0/1729160816 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559970765650 con 0x55997066ff00 2024-05-09T09:47:38.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.639+0000 7fc37ae05640 1 -- 172.21.15.157:0/1729160816 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fc4880b3040 con 0x55997066ff00 2024-05-09T09:47:38.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.639+0000 7fc37ae05640 1 --2- 172.21.15.157:0/1729160816 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc374034c50 0x7fc374037110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.639+0000 7fc37ae05640 1 -- 172.21.15.157:0/1729160816 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fc4880c4070 con 0x55997066ff00 2024-05-09T09:47:38.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.639+0000 7fc48d8f6640 1 --2- 172.21.15.157:0/1729160816 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc374034c50 0x7fc374037110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.639+0000 7fc4905dc980 1 --2- 172.21.15.157:0/1729160816 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x559970670dc0 0x559970769170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.639+0000 7fc4905dc980 1 -- 172.21.15.157:0/1729160816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599707697e0 con 0x559970670dc0 2024-05-09T09:47:38.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.639+0000 7fc48e8f8640 1 --2- 172.21.15.157:0/1729160816 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x559970670dc0 0x559970769170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.639+0000 7fc48d8f6640 1 --2- 172.21.15.157:0/1729160816 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc374034c50 0x7fc374037110 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc484001e50 tx=0x7fc4840013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.639+0000 7fc48e8f8640 1 --2- 172.21.15.157:0/1729160816 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x559970670dc0 0x559970769170 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.639+0000 7fc48e8f8640 1 -- 172.21.15.157:0/1729160816 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4800083f0 con 0x559970670dc0 2024-05-09T09:47:38.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.639+0000 7fc4905dc980 1 -- 172.21.15.157:0/1729160816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559970766850 con 0x559970670dc0 2024-05-09T09:47:38.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.639+0000 7fc48e8f8640 1 -- 172.21.15.157:0/1729160816 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc4800083f0 con 0x559970670dc0 2024-05-09T09:47:38.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.639+0000 7fc4905dc980 1 --2- 172.21.15.157:0/1729160816 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55997076bb10 0x55997076df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.639+0000 7fc4905dc980 1 -- 172.21.15.157:0/1729160816 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55997076e5d0 con 0x55997076bb10 2024-05-09T09:47:38.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.639+0000 7fc48e0f7640 1 --2- 172.21.15.157:0/1729160816 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55997076bb10 0x55997076df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.639+0000 7fc48e0f7640 1 --2- 172.21.15.157:0/1729160816 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55997076bb10 0x55997076df00 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.643+0000 7fc48e0f7640 1 -- 172.21.15.157:0/1729160816 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc4880b3a80 con 0x55997076bb10 2024-05-09T09:47:38.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.643+0000 7fc4905dc980 1 -- 172.21.15.157:0/1729160816 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55997076a9b0 con 0x559970670dc0 2024-05-09T09:47:38.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.643+0000 7fc48e8f8640 1 -- 172.21.15.157:0/1729160816 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc4800083f0 con 0x559970670dc0 2024-05-09T09:47:38.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.643+0000 7fc4905dc980 1 --2- 172.21.15.157:0/1729160816 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55997076fa10 0x559970771e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.643+0000 7fc4905dc980 1 -- 172.21.15.157:0/1729160816 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559970772590 con 0x55997076fa10 2024-05-09T09:47:38.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.643+0000 7fc48d8f6640 1 --2- 172.21.15.157:0/1729160816 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55997076fa10 0x559970771e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.643+0000 7fc48d8f6640 1 --2- 172.21.15.157:0/1729160816 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55997076fa10 0x559970771e00 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.643+0000 7fc48d8f6640 1 -- 172.21.15.157:0/1729160816 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc48400f700 con 0x55997076fa10 2024-05-09T09:47:38.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.647+0000 7fc4905dc980 1 Processor -- start 2024-05-09T09:47:38.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.647+0000 7fc4905dc980 1 -- start start 2024-05-09T09:47:38.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.647+0000 7fc4905dc980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5599707985d0 0x5599707989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.647+0000 7fc4905dc980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x559970575020 con 0x5599707985d0 2024-05-09T09:47:38.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.647+0000 7fc48e0f7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5599707985d0 0x5599707989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.647+0000 7fc48e0f7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5599707985d0 0x5599707989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58702/0 (socket says 172.21.15.157:58702) 2024-05-09T09:47:38.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.647+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2553461197 learned_addr learned my addr 172.21.15.157:0/2553461197 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:38.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.647+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2553461197 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559970798f30 con 0x5599707985d0 2024-05-09T09:47:38.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.647+0000 7fc48e0f7640 1 --2- 172.21.15.157:0/2553461197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5599707985d0 0x5599707989f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc4880bc930 tx=0x7fc4880e2e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.647+0000 7fc372ba2640 1 -- 172.21.15.157:0/2553461197 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4880e40c0 con 0x5599707985d0 2024-05-09T09:47:38.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.647+0000 7fc372ba2640 1 -- 172.21.15.157:0/2553461197 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4880e4260 con 0x5599707985d0 2024-05-09T09:47:38.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.647+0000 7fc4905dc980 1 -- 172.21.15.157:0/2553461197 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599707999c0 con 0x5599707985d0 2024-05-09T09:47:38.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.647+0000 7fc372ba2640 1 -- 172.21.15.157:0/2553461197 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4880bc9a0 con 0x5599707985d0 2024-05-09T09:47:38.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.647+0000 7fc4905dc980 1 -- 172.21.15.157:0/2553461197 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559970799ea0 con 0x5599707985d0 2024-05-09T09:47:38.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.651+0000 7fc372ba2640 1 -- 172.21.15.157:0/2553461197 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fc4880bcb40 con 0x5599707985d0 2024-05-09T09:47:38.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.651+0000 7fc372ba2640 1 --2- 172.21.15.157:0/2553461197 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc368034bb0 0x7fc368037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.651+0000 7fc372ba2640 1 -- 172.21.15.157:0/2553461197 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fc4880c0a40 con 0x5599707985d0 2024-05-09T09:47:38.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.651+0000 7fc48d8f6640 1 --2- 172.21.15.157:0/2553461197 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc368034bb0 0x7fc368037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.651+0000 7fc4905dc980 1 Processor -- start 2024-05-09T09:47:38.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.651+0000 7fc4905dc980 1 -- start start 2024-05-09T09:47:38.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.651+0000 7fc4905dc980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5599707a5520 0x5599707a5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.651+0000 7fc4905dc980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55997075b960 con 0x5599707a5520 2024-05-09T09:47:38.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.651+0000 7fc48d8f6640 1 --2- 172.21.15.157:0/2553461197 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc368034bb0 0x7fc368037070 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x559970772990 tx=0x7fc48400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.651+0000 7fc48e0f7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5599707a5520 0x5599707a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.651+0000 7fc48e0f7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5599707a5520 0x5599707a5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58714/0 (socket says 172.21.15.157:58714) 2024-05-09T09:47:38.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.651+0000 7fc48e0f7640 1 -- 172.21.15.157:0/4065671249 learned_addr learned my addr 172.21.15.157:0/4065671249 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:38.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.651+0000 7fc48e0f7640 1 -- 172.21.15.157:0/4065671249 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599707a5ed0 con 0x5599707a5520 2024-05-09T09:47:38.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.651+0000 7fc48e0f7640 1 --2- 172.21.15.157:0/4065671249 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5599707a5520 0x5599707a5900 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc4880d4fd0 tx=0x7fc4880c08f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d96079f3b44e8bff server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.651+0000 7fc370b9e640 1 -- 172.21.15.157:0/4065671249 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4880e0040 con 0x5599707a5520 2024-05-09T09:47:38.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.651+0000 7fc370b9e640 1 -- 172.21.15.157:0/4065671249 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4880f3070 con 0x5599707a5520 2024-05-09T09:47:38.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.651+0000 7fc370b9e640 1 -- 172.21.15.157:0/4065671249 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4880bdcd0 con 0x5599707a5520 2024-05-09T09:47:38.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.651+0000 7fc4905dc980 1 -- 172.21.15.157:0/4065671249 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5599707a5520 msgr2=0x5599707a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.651+0000 7fc4905dc980 1 --2- 172.21.15.157:0/4065671249 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5599707a5520 0x5599707a5900 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc4880d4fd0 tx=0x7fc4880c08f0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.651+0000 7fc4905dc980 1 -- 172.21.15.157:0/4065671249 shutdown_connections 2024-05-09T09:47:38.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.651+0000 7fc4905dc980 1 --2- 172.21.15.157:0/4065671249 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5599707a5520 0x5599707a5900 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.651+0000 7fc4905dc980 1 -- 172.21.15.157:0/4065671249 >> 172.21.15.157:0/4065671249 conn(0x5599707a18a0 msgr2=0x55997079f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:38.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.651+0000 7fc4905dc980 1 -- 172.21.15.157:0/4065671249 shutdown_connections 2024-05-09T09:47:38.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.651+0000 7fc4905dc980 1 -- 172.21.15.157:0/4065671249 wait complete. 2024-05-09T09:47:38.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.655+0000 7fc4905dc980 1 Processor -- start 2024-05-09T09:47:38.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.655+0000 7fc4905dc980 1 -- start start 2024-05-09T09:47:38.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.655+0000 7fc4905dc980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5599707a5520 0x5599707ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.655+0000 7fc4905dc980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5599707a65e0 con 0x5599707a5520 2024-05-09T09:47:38.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.655+0000 7fc48e0f7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5599707a5520 0x5599707ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.655+0000 7fc48e0f7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5599707a5520 0x5599707ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58730/0 (socket says 172.21.15.157:58730) 2024-05-09T09:47:38.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.655+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 learned_addr learned my addr 172.21.15.157:0/2040201824 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:38.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.655+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599707ace20 con 0x5599707a5520 2024-05-09T09:47:38.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.655+0000 7fc48e0f7640 1 --2- 172.21.15.157:0/2040201824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5599707a5520 0x5599707ac8e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc4880d1560 tx=0x7fc4880c06b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.655+0000 7fc35effd640 1 -- 172.21.15.157:0/2040201824 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4880e0040 con 0x5599707a5520 2024-05-09T09:47:38.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.655+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599707ace20 con 0x5599707a5520 2024-05-09T09:47:38.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.655+0000 7fc35effd640 1 -- 172.21.15.157:0/2040201824 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4880d1c10 con 0x5599707a5520 2024-05-09T09:47:38.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.655+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599707ad2a0 con 0x5599707a5520 2024-05-09T09:47:38.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.655+0000 7fc35effd640 1 -- 172.21.15.157:0/2040201824 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4880e1250 con 0x5599707a5520 2024-05-09T09:47:38.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.655+0000 7fc4905dc980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.655+0000 7fc35effd640 1 -- 172.21.15.157:0/2040201824 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fc4880e13f0 con 0x5599707a5520 2024-05-09T09:47:38.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.655+0000 7fc35effd640 1 --2- 172.21.15.157:0/2040201824 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc358034bb0 0x7fc358037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.655+0000 7fc35effd640 1 -- 172.21.15.157:0/2040201824 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fc4880c2130 con 0x5599707a5520 2024-05-09T09:47:38.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.655+0000 7fc48d8f6640 1 --2- 172.21.15.157:0/2040201824 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc358034bb0 0x7fc358037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.655+0000 7fc4905dc980 1 --2- 172.21.15.157:0/2040201824 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5599707b93d0 0x5599707bb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.655+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599707bbfe0 con 0x5599707b93d0 2024-05-09T09:47:38.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc48e8f8640 1 --2- 172.21.15.157:0/2040201824 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5599707b93d0 0x5599707bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc48d8f6640 1 --2- 172.21.15.157:0/2040201824 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc358034bb0 0x7fc358037070 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc48400baa0 tx=0x7fc484010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc48e8f8640 1 --2- 172.21.15.157:0/2040201824 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5599707b93d0 0x5599707bb890 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4800083f0 con 0x5599707b93d0 2024-05-09T09:47:38.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc4905dc980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:38.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc4905dc980 20 realm 2024-05-09T09:47:38.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc4905dc980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599707bc3f0 con 0x5599707b93d0 2024-05-09T09:47:38.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4800083f0 con 0x5599707b93d0 2024-05-09T09:47:38.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc4905dc980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:38.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc4905dc980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:38.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc4905dc980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599707bcc90 con 0x5599707b93d0 2024-05-09T09:47:38.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4800083f0 con 0x5599707b93d0 2024-05-09T09:47:38.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc4905dc980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:38.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc4905dc980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x5599707b93d0 2024-05-09T09:47:38.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc4800083f0 con 0x5599707b93d0 2024-05-09T09:47:38.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc4905dc980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:38.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc4905dc980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc4905dc980 1 --2- 172.21.15.157:0/2040201824 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5599707bdd90 0x5599707c0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599707c0700 con 0x5599707bdd90 2024-05-09T09:47:38.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc48e0f7640 1 --2- 172.21.15.157:0/2040201824 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5599707bdd90 0x5599707c0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc48e0f7640 1 --2- 172.21.15.157:0/2040201824 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5599707bdd90 0x5599707c0180 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc4905dc980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:38.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc4905dc980 20 searching for the correct realm 2024-05-09T09:47:38.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc4905dc980 1 --2- 172.21.15.157:0/2040201824 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5599707c2670 0x5599707c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707c5200 con 0x5599707c2670 2024-05-09T09:47:38.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc48d8f6640 1 --2- 172.21.15.157:0/2040201824 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5599707c2670 0x5599707c4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.659+0000 7fc48d8f6640 1 --2- 172.21.15.157:0/2040201824 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5599707c2670 0x5599707c4b30 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.663+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc484037040 con 0x5599707c2670 2024-05-09T09:47:38.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.663+0000 7fc48d8f6640 1 --2- 172.21.15.157:0/2040201824 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fc48403a3c0 0x7fc48403a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.663+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707c5200 con 0x7fc48403a3c0 2024-05-09T09:47:38.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.663+0000 7fc48e8f8640 1 --2- 172.21.15.157:0/2040201824 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fc48403a3c0 0x7fc48403a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.663+0000 7fc48e8f8640 1 --2- 172.21.15.157:0/2040201824 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fc48403a3c0 0x7fc48403a820 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.663+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4800083f0 con 0x7fc48403a3c0 2024-05-09T09:47:38.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.663+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x5599707bdd90 2024-05-09T09:47:38.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.663+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.663+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x5599707b93d0 2024-05-09T09:47:38.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.663+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4800083f0 con 0x5599707b93d0 2024-05-09T09:47:38.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.663+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x5599707b93d0 2024-05-09T09:47:38.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.663+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc480026040 con 0x5599707b93d0 2024-05-09T09:47:38.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.663+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x5599707bdd90 2024-05-09T09:47:38.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.663+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.663+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x5599707bdd90 2024-05-09T09:47:38.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.667+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.667+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x7fc48403a3c0 2024-05-09T09:47:38.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.667+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc480026040 con 0x7fc48403a3c0 2024-05-09T09:47:38.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.667+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x5599707c2670 2024-05-09T09:47:38.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.667+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc484037040 con 0x5599707c2670 2024-05-09T09:47:38.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.667+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x5599707b93d0 2024-05-09T09:47:38.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.667+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc480026040 con 0x5599707b93d0 2024-05-09T09:47:38.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.667+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x5599707bdd90 2024-05-09T09:47:38.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.667+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.667+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x5599707b93d0 2024-05-09T09:47:38.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.667+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc480026040 con 0x5599707b93d0 2024-05-09T09:47:38.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.667+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x7fc48403a3c0 2024-05-09T09:47:38.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.667+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc480026040 con 0x7fc48403a3c0 2024-05-09T09:47:38.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.667+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x5599707c2670 2024-05-09T09:47:38.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.667+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc484037040 con 0x5599707c2670 2024-05-09T09:47:38.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.667+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x5599707c2670 2024-05-09T09:47:38.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.667+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc484037040 con 0x5599707c2670 2024-05-09T09:47:38.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.667+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x5599707bdd90 2024-05-09T09:47:38.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.671+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.671+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x5599707c2670 2024-05-09T09:47:38.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.671+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc484037040 con 0x5599707c2670 2024-05-09T09:47:38.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.671+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x5599707c2670 2024-05-09T09:47:38.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.671+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc484037040 con 0x5599707c2670 2024-05-09T09:47:38.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.671+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x5599707b93d0 2024-05-09T09:47:38.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.671+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc480026040 con 0x5599707b93d0 2024-05-09T09:47:38.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.671+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x5599707b93d0 2024-05-09T09:47:38.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.671+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc480026040 con 0x5599707b93d0 2024-05-09T09:47:38.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.671+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x5599707bdd90 2024-05-09T09:47:38.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.671+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.671+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x5599707c2670 2024-05-09T09:47:38.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.671+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc484037040 con 0x5599707c2670 2024-05-09T09:47:38.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.671+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x7fc48403a3c0 2024-05-09T09:47:38.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.671+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc480026040 con 0x7fc48403a3c0 2024-05-09T09:47:38.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.671+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x5599707b93d0 2024-05-09T09:47:38.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.671+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc480026040 con 0x5599707b93d0 2024-05-09T09:47:38.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.671+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x5599707bdd90 2024-05-09T09:47:38.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.671+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.671+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x5599707c2670 2024-05-09T09:47:38.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc484037040 con 0x5599707c2670 2024-05-09T09:47:38.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x5599707bdd90 2024-05-09T09:47:38.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x7fc48403a3c0 2024-05-09T09:47:38.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc480026040 con 0x7fc48403a3c0 2024-05-09T09:47:38.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x5599707c2670 2024-05-09T09:47:38.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc48404a040 con 0x5599707c2670 2024-05-09T09:47:38.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x5599707bdd90 2024-05-09T09:47:38.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x5599707b93d0 2024-05-09T09:47:38.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc480026040 con 0x5599707b93d0 2024-05-09T09:47:38.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5599707bd030 con 0x7fc48403a3c0 2024-05-09T09:47:38.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc480026040 con 0x7fc48403a3c0 2024-05-09T09:47:38.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc4905dc980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:38.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc4905dc980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:38.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc4905dc980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:38.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc4905dc980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:38.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc4905dc980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:38.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc4905dc980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:38.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc4905dc980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599707c0f50 con 0x5599707b93d0 2024-05-09T09:47:38.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc480026040 con 0x5599707b93d0 2024-05-09T09:47:38.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc4905dc980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:38.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc4905dc980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599707c0f50 con 0x5599707b93d0 2024-05-09T09:47:38.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc480026040 con 0x5599707b93d0 2024-05-09T09:47:38.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc4905dc980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:38.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc4905dc980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599707c0f50 con 0x5599707c2670 2024-05-09T09:47:38.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc48404a040 con 0x5599707c2670 2024-05-09T09:47:38.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc4905dc980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:38.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc4905dc980 20 zone default found 2024-05-09T09:47:38.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc4905dc980 4 Realm: () 2024-05-09T09:47:38.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc4905dc980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:38.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc4905dc980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:38.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc4905dc980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:38.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc4905dc980 20 zonegroup default 2024-05-09T09:47:38.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc4905dc980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.675+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599707c17f0 con 0x5599707bdd90 2024-05-09T09:47:38.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.679+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.679+0000 7fc4905dc980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:38.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.679+0000 7fc4905dc980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.679+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599707c7060 con 0x5599707c2670 2024-05-09T09:47:38.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.679+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc48404a040 con 0x5599707c2670 2024-05-09T09:47:38.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.679+0000 7fc4905dc980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:38.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.679+0000 7fc4905dc980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.679+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599707c7400 con 0x5599707c2670 2024-05-09T09:47:38.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.679+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc48404a040 con 0x5599707c2670 2024-05-09T09:47:38.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.679+0000 7fc4905dc980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:38.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.679+0000 7fc4905dc980 20 started sync module instance, tier type = 2024-05-09T09:47:38.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.679+0000 7fc4905dc980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:38.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.679+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707c6500 con 0x7fc48403a3c0 2024-05-09T09:47:38.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.679+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc480026040 con 0x7fc48403a3c0 2024-05-09T09:47:38.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.679+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94117505559088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707c6500 con 0x7fc48403a3c0 2024-05-09T09:47:38.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.679+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707c7e20 con 0x5599707b93d0 2024-05-09T09:47:38.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.679+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94117505559088] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc480036040 con 0x7fc48403a3c0 2024-05-09T09:47:38.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.683+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc480036040 con 0x5599707b93d0 2024-05-09T09:47:38.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.683+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94117505562896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707c6500 con 0x5599707b93d0 2024-05-09T09:47:38.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.683+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707c8860 con 0x5599707c2670 2024-05-09T09:47:38.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.683+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc48404a040 con 0x5599707c2670 2024-05-09T09:47:38.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.683+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94117505565616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707c90b0 con 0x5599707c2670 2024-05-09T09:47:38.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.683+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707c9a70 con 0x7fc48403a3c0 2024-05-09T09:47:38.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.683+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94117505562896] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc480036040 con 0x5599707b93d0 2024-05-09T09:47:38.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.687+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc480036040 con 0x7fc48403a3c0 2024-05-09T09:47:38.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.687+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94117505570240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707c99e0 con 0x7fc48403a3c0 2024-05-09T09:47:38.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.687+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707ca7f0 con 0x5599707b93d0 2024-05-09T09:47:38.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.687+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94117505565616] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc48404a040 con 0x5599707c2670 2024-05-09T09:47:38.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.687+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94117505570240] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc480036040 con 0x7fc48403a3c0 2024-05-09T09:47:38.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.687+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc480036040 con 0x5599707b93d0 2024-05-09T09:47:38.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.687+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94117505567744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707ca2b0 con 0x5599707b93d0 2024-05-09T09:47:38.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.687+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707cab00 con 0x5599707bdd90 2024-05-09T09:47:38.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.687+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94117505567744] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc480036040 con 0x5599707b93d0 2024-05-09T09:47:38.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.687+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.691+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94117505572624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707caef0 con 0x5599707bdd90 2024-05-09T09:47:38.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.691+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707cb8b0 con 0x5599707bdd90 2024-05-09T09:47:38.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.691+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94117505572624] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.691+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.691+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94117505573680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707cc100 con 0x5599707bdd90 2024-05-09T09:47:38.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.691+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707cc990 con 0x5599707bdd90 2024-05-09T09:47:38.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.695+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.695+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94117505582240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707cd160 con 0x5599707bdd90 2024-05-09T09:47:38.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.695+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94117505573680] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.695+0000 7fc4905dc980 20 add_watcher() i=0 2024-05-09T09:47:38.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.695+0000 7fc4905dc980 20 add_watcher() i=1 2024-05-09T09:47:38.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.695+0000 7fc4905dc980 20 add_watcher() i=2 2024-05-09T09:47:38.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.695+0000 7fc4905dc980 20 add_watcher() i=3 2024-05-09T09:47:38.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.695+0000 7fc4905dc980 20 add_watcher() i=4 2024-05-09T09:47:38.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.695+0000 7fc4905dc980 20 add_watcher() i=5 2024-05-09T09:47:38.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.695+0000 7fc4905dc980 20 add_watcher() i=6 2024-05-09T09:47:38.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.695+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94117505582240] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.695+0000 7fc4905dc980 20 add_watcher() i=7 2024-05-09T09:47:38.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.695+0000 7fc4905dc980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:38.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.695+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599707cbd40 con 0x5599707b93d0 2024-05-09T09:47:38.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.695+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc480036040 con 0x5599707b93d0 2024-05-09T09:47:38.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.695+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94117505584112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707cda60 con 0x5599707b93d0 2024-05-09T09:47:38.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.699+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94117505584112] v30'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc480036040 con 0x5599707b93d0 2024-05-09T09:47:38.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.699+0000 7fc343fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:38.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.699+0000 7fc4905dc980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:38.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.699+0000 7fc4905dc980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:38.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.699+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707d8840 con 0x5599707b93d0 2024-05-09T09:47:38.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.699+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'47 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc480036040 con 0x5599707b93d0 2024-05-09T09:47:38.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.699+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707d8e00 con 0x5599707bdd90 2024-05-09T09:47:38.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.703+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'42 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.703+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707d8e00 con 0x5599707c2670 2024-05-09T09:47:38.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.703+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'41 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc48404a040 con 0x5599707c2670 2024-05-09T09:47:38.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.703+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707d9820 con 0x5599707b93d0 2024-05-09T09:47:38.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.703+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'180 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc480036040 con 0x5599707b93d0 2024-05-09T09:47:38.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.703+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707d69b0 con 0x7fc48403a3c0 2024-05-09T09:47:38.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.707+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'113 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc480036040 con 0x7fc48403a3c0 2024-05-09T09:47:38.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.707+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707da380 con 0x5599707c2670 2024-05-09T09:47:38.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.707+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'76 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc48404a040 con 0x5599707c2670 2024-05-09T09:47:38.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.707+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707da380 con 0x5599707b93d0 2024-05-09T09:47:38.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.707+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'43 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc480036040 con 0x5599707b93d0 2024-05-09T09:47:38.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.711+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707da380 con 0x5599707bdd90 2024-05-09T09:47:38.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.711+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'75 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.711+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707da8f0 con 0x7fc48403a3c0 2024-05-09T09:47:38.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.715+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'41 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc480036040 con 0x7fc48403a3c0 2024-05-09T09:47:38.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.715+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707da8f0 con 0x5599707c2670 2024-05-09T09:47:38.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.715+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'47 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc48404a040 con 0x5599707c2670 2024-05-09T09:47:38.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.715+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707da980 con 0x7fc48403a3c0 2024-05-09T09:47:38.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.715+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'114 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc480036040 con 0x7fc48403a3c0 2024-05-09T09:47:38.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.715+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707da980 con 0x5599707bdd90 2024-05-09T09:47:38.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.719+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'43 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.719+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707daa10 con 0x7fc48403a3c0 2024-05-09T09:47:38.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.719+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'41 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc480036040 con 0x7fc48403a3c0 2024-05-09T09:47:38.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.719+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707daa10 con 0x5599707bdd90 2024-05-09T09:47:38.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.723+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'81 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.723+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707daa10 con 0x5599707b93d0 2024-05-09T09:47:38.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.723+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'181 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc480036040 con 0x5599707b93d0 2024-05-09T09:47:38.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.723+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707daa10 con 0x5599707c2670 2024-05-09T09:47:38.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.727+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'107 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc48404a040 con 0x5599707c2670 2024-05-09T09:47:38.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.727+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707dab00 con 0x7fc48403a3c0 2024-05-09T09:47:38.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.727+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'115 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc480036040 con 0x7fc48403a3c0 2024-05-09T09:47:38.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.727+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707dab00 con 0x5599707c2670 2024-05-09T09:47:38.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.727+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'41 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc48404a040 con 0x5599707c2670 2024-05-09T09:47:38.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.727+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707dabb0 con 0x5599707b93d0 2024-05-09T09:47:38.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.731+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'49 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc480036040 con 0x5599707b93d0 2024-05-09T09:47:38.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.731+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707dabb0 con 0x5599707b93d0 2024-05-09T09:47:38.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.731+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'182 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc480036040 con 0x5599707b93d0 2024-05-09T09:47:38.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.731+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707dabb0 con 0x5599707c2670 2024-05-09T09:47:38.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.735+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'108 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc48404a040 con 0x5599707c2670 2024-05-09T09:47:38.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.735+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707dabb0 con 0x7fc48403a3c0 2024-05-09T09:47:38.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.735+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'51 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc480036040 con 0x7fc48403a3c0 2024-05-09T09:47:38.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.735+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707dabb0 con 0x5599707c2670 2024-05-09T09:47:38.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.735+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'43 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc48404a040 con 0x5599707c2670 2024-05-09T09:47:38.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.735+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707dabb0 con 0x5599707c2670 2024-05-09T09:47:38.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.739+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'47 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc48404a040 con 0x5599707c2670 2024-05-09T09:47:38.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.739+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707dabb0 con 0x5599707c2670 2024-05-09T09:47:38.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.739+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'37 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc48404a040 con 0x5599707c2670 2024-05-09T09:47:38.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.739+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707dabb0 con 0x5599707c2670 2024-05-09T09:47:38.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.743+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'77 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc48404a040 con 0x5599707c2670 2024-05-09T09:47:38.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.743+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707dabb0 con 0x5599707bdd90 2024-05-09T09:47:38.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.743+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'43 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.743+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707dabb0 con 0x5599707c2670 2024-05-09T09:47:38.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.743+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'41 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc48404a040 con 0x5599707c2670 2024-05-09T09:47:38.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.743+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707dabb0 con 0x5599707bdd90 2024-05-09T09:47:38.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.747+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'76 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.747+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707dabb0 con 0x5599707c2670 2024-05-09T09:47:38.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.751+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'109 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc48404a040 con 0x5599707c2670 2024-05-09T09:47:38.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.751+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707dabb0 con 0x5599707bdd90 2024-05-09T09:47:38.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.751+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'82 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.751+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707dabb0 con 0x7fc48403a3c0 2024-05-09T09:47:38.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.755+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'47 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc480036040 con 0x7fc48403a3c0 2024-05-09T09:47:38.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.755+0000 7fc342fe5640 20 reqs_thread_entry: start 2024-05-09T09:47:38.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.755+0000 7fc4905dc980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:38.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.755+0000 7fc340fe1640 20 reqs_thread_entry: start 2024-05-09T09:47:38.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.755+0000 7fc4905dc980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.755+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599707f6500 con 0x5599707b93d0 2024-05-09T09:47:38.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.755+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc480036040 con 0x5599707b93d0 2024-05-09T09:47:38.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.755+0000 7fc4905dc980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:47:38.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.755+0000 7fc4905dc980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.755+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599707f6ef0 con 0x5599707b93d0 2024-05-09T09:47:38.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(95 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc480036040 con 0x5599707b93d0 2024-05-09T09:47:38.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc4905dc980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:47:38.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:96 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599707f7f00 con 0x7fc48403a3c0 2024-05-09T09:47:38.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(96 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fc480036040 con 0x7fc48403a3c0 2024-05-09T09:47:38.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc4905dc980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:97 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599707d54b0 con 0x7fc48403a3c0 2024-05-09T09:47:38.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(97 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc480036040 con 0x7fc48403a3c0 2024-05-09T09:47:38.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc4905dc980 20 rados_obj.operate() r=0 bl.length=165 2024-05-09T09:47:38.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc4905dc980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 8.5 8:a7233c95:root::.bucket.meta.myfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599707f7c00 con 0x5599707b93d0 2024-05-09T09:47:38.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(98 .bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fc480036040 con 0x5599707b93d0 2024-05-09T09:47:38.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc4905dc980 20 rados_obj.operate() r=0 bl.length=379 2024-05-09T09:47:38.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc4905dc980 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-09T09:47:38.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 4.b 4:d25ceb2d:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599707f9780 con 0x7fc48403a3c0 2024-05-09T09:47:38.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 4.3 4:c0b28912:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599707fc110 con 0x5599707b93d0 2024-05-09T09:47:38.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:101 4.4 4:20a0679d:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599707fecd0 con 0x5599707bdd90 2024-05-09T09:47:38.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:102 4.26 4:6777fe5e:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559970801630 con 0x5599707bdd90 2024-05-09T09:47:38.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 4.3 4:c063be13:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559970804220 con 0x5599707b93d0 2024-05-09T09:47:38.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:104 4.31 4:8f008dfd:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5599707fecd0 con 0x5599707b93d0 2024-05-09T09:47:38.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:105 4.33 4:ccd4db27:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559970808f60 con 0x5599707bdd90 2024-05-09T09:47:38.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:106 4.1d 4:bb2bb3ce:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55997080b850 con 0x5599707c2670 2024-05-09T09:47:38.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:107 4.36 4:6fb2fa4a:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55997080e280 con 0x5599707b93d0 2024-05-09T09:47:38.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:108 4.17 4:ea8823bf:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559970810c90 con 0x5599707bdd90 2024-05-09T09:47:38.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:109 4.3a 4:5f6cb505:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559970813b00 con 0x5599707c2670 2024-05-09T09:47:38.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(99 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc480036040 con 0x7fc48403a3c0 2024-05-09T09:47:38.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(104 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc480036040 con 0x5599707b93d0 2024-05-09T09:47:38.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(107 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc480036040 con 0x5599707b93d0 2024-05-09T09:47:38.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(100 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc480036040 con 0x5599707b93d0 2024-05-09T09:47:38.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(102 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(109 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc48404a040 con 0x5599707c2670 2024-05-09T09:47:38.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(106 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc48404a040 con 0x5599707c2670 2024-05-09T09:47:38.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(101 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(105 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(108 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.759+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(103 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.4 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc480036040 con 0x5599707b93d0 2024-05-09T09:47:38.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.763+0000 7fc343fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:38.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.763+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:110 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94117505584112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559970810c90 con 0x5599707b93d0 2024-05-09T09:47:38.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.763+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(110 data_loggenerations_metadata [watch unwatch cookie 94117505584112] v30'183 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc480036040 con 0x5599707b93d0 2024-05-09T09:47:38.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.763+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:111 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94117505559088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559970810c90 con 0x7fc48403a3c0 2024-05-09T09:47:38.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.763+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(111 notify.0 [watch unwatch cookie 94117505559088] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc480036040 con 0x7fc48403a3c0 2024-05-09T09:47:38.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.763+0000 7fc4905dc980 20 remove_watcher() i=0 2024-05-09T09:47:38.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.763+0000 7fc4905dc980 2 removed watcher, disabling cache 2024-05-09T09:47:38.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.763+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:112 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94117505562896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559970810c90 con 0x5599707b93d0 2024-05-09T09:47:38.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.767+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(112 notify.1 [watch unwatch cookie 94117505562896] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc480036040 con 0x5599707b93d0 2024-05-09T09:47:38.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.767+0000 7fc4905dc980 20 remove_watcher() i=1 2024-05-09T09:47:38.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.767+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:113 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94117505565616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707c7910 con 0x5599707c2670 2024-05-09T09:47:38.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.767+0000 7fc48d8f6640 1 -- 172.21.15.157:0/2040201824 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== osd_op_reply(113 notify.2 [watch unwatch cookie 94117505565616] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc48404a040 con 0x5599707c2670 2024-05-09T09:47:38.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.767+0000 7fc4905dc980 20 remove_watcher() i=2 2024-05-09T09:47:38.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.767+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:114 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94117505570240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707c7910 con 0x7fc48403a3c0 2024-05-09T09:47:38.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.771+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(114 notify.3 [watch unwatch cookie 94117505570240] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc480036040 con 0x7fc48403a3c0 2024-05-09T09:47:38.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.771+0000 7fc4905dc980 20 remove_watcher() i=3 2024-05-09T09:47:38.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.771+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:115 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94117505567744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707c7910 con 0x5599707b93d0 2024-05-09T09:47:38.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.771+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 <== osd.1 v2:172.21.15.157:6808/3930131338 36 ==== osd_op_reply(115 notify.4 [watch unwatch cookie 94117505567744] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc480036040 con 0x5599707b93d0 2024-05-09T09:47:38.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.771+0000 7fc4905dc980 20 remove_watcher() i=4 2024-05-09T09:47:38.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.771+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:116 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94117505572624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707c7910 con 0x5599707bdd90 2024-05-09T09:47:38.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.775+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(116 notify.5 [watch unwatch cookie 94117505572624] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.775+0000 7fc4905dc980 20 remove_watcher() i=5 2024-05-09T09:47:38.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.775+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:117 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94117505573680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707c7910 con 0x5599707bdd90 2024-05-09T09:47:38.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(117 notify.6 [watch unwatch cookie 94117505573680] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc4905dc980 20 remove_watcher() i=6 2024-05-09T09:47:38.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:118 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94117505582240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5599707c7910 con 0x5599707bdd90 2024-05-09T09:47:38.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc48e0f7640 1 -- 172.21.15.157:0/2040201824 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(118 notify.7 [watch unwatch cookie 94117505582240] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc488108020 con 0x5599707bdd90 2024-05-09T09:47:38.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc4905dc980 20 remove_watcher() i=7 2024-05-09T09:47:38.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5599707bdd90 msgr2=0x5599707c0180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc4905dc980 1 --2- 172.21.15.157:0/2040201824 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5599707bdd90 0x5599707c0180 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5599707b93d0 msgr2=0x5599707bb890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc4905dc980 1 --2- 172.21.15.157:0/2040201824 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5599707b93d0 0x5599707bb890 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fc48403a3c0 msgr2=0x7fc48403a820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc4905dc980 1 --2- 172.21.15.157:0/2040201824 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fc48403a3c0 0x7fc48403a820 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5599707c2670 msgr2=0x5599707c4b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc4905dc980 1 --2- 172.21.15.157:0/2040201824 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5599707c2670 0x5599707c4b30 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc358034bb0 msgr2=0x7fc358037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc4905dc980 1 --2- 172.21.15.157:0/2040201824 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc358034bb0 0x7fc358037070 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc48400baa0 tx=0x7fc484010000 comp rx=0 tx=0).stop 2024-05-09T09:47:38.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5599707a5520 msgr2=0x5599707ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc4905dc980 1 --2- 172.21.15.157:0/2040201824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5599707a5520 0x5599707ac8e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc4880d1560 tx=0x7fc4880c06b0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc48e8f8640 1 -- 172.21.15.157:0/2040201824 reap_dead start 2024-05-09T09:47:38.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 shutdown_connections 2024-05-09T09:47:38.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 >> 172.21.15.157:0/2040201824 conn(0x5599707a18a0 msgr2=0x5599707a6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:38.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 shutdown_connections 2024-05-09T09:47:38.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc4905dc980 1 -- 172.21.15.157:0/2040201824 wait complete. 2024-05-09T09:47:38.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc4905dc980 1 -- 172.21.15.157:0/2553461197 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc368034bb0 msgr2=0x7fc368037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc4905dc980 1 --2- 172.21.15.157:0/2553461197 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc368034bb0 0x7fc368037070 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x559970772990 tx=0x7fc48400f000 comp rx=0 tx=0).stop 2024-05-09T09:47:38.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc4905dc980 1 -- 172.21.15.157:0/2553461197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5599707985d0 msgr2=0x5599707989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc4905dc980 1 --2- 172.21.15.157:0/2553461197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5599707985d0 0x5599707989f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc4880bc930 tx=0x7fc4880e2e50 comp rx=0 tx=0).stop 2024-05-09T09:47:38.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc4905dc980 1 -- 172.21.15.157:0/2553461197 shutdown_connections 2024-05-09T09:47:38.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc4905dc980 1 --2- 172.21.15.157:0/2553461197 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc368034bb0 0x7fc368037070 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc4905dc980 1 --2- 172.21.15.157:0/2553461197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5599707985d0 0x5599707989f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc4905dc980 1 -- 172.21.15.157:0/2553461197 >> 172.21.15.157:0/2553461197 conn(0x55997078d3a0 msgr2=0x55997078deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:38.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc4905dc980 1 -- 172.21.15.157:0/2553461197 shutdown_connections 2024-05-09T09:47:38.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.779+0000 7fc4905dc980 1 -- 172.21.15.157:0/2553461197 wait complete. 2024-05-09T09:47:38.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.783+0000 7fc4905dc980 1 -- 172.21.15.157:0/1729160816 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55997076bb10 msgr2=0x55997076df00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.783+0000 7fc4905dc980 1 --2- 172.21.15.157:0/1729160816 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55997076bb10 0x55997076df00 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.783+0000 7fc4905dc980 1 -- 172.21.15.157:0/1729160816 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x559970670dc0 msgr2=0x559970769170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.783+0000 7fc4905dc980 1 --2- 172.21.15.157:0/1729160816 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x559970670dc0 0x559970769170 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.783+0000 7fc4905dc980 1 -- 172.21.15.157:0/1729160816 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55997076fa10 msgr2=0x559970771e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.783+0000 7fc4905dc980 1 --2- 172.21.15.157:0/1729160816 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55997076fa10 0x559970771e00 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.783+0000 7fc4905dc980 1 -- 172.21.15.157:0/1729160816 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc374034c50 msgr2=0x7fc374037110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.783+0000 7fc4905dc980 1 --2- 172.21.15.157:0/1729160816 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc374034c50 0x7fc374037110 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc484001e50 tx=0x7fc4840013b0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.783+0000 7fc4905dc980 1 -- 172.21.15.157:0/1729160816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55997066ff00 msgr2=0x559970762290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.783+0000 7fc4905dc980 1 --2- 172.21.15.157:0/1729160816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55997066ff00 0x559970762290 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc48801b0d0 tx=0x7fc488017e30 comp rx=0 tx=0).stop 2024-05-09T09:47:38.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.783+0000 7fc48e8f8640 1 -- 172.21.15.157:0/1729160816 reap_dead start 2024-05-09T09:47:38.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.783+0000 7fc4905dc980 1 -- 172.21.15.157:0/1729160816 shutdown_connections 2024-05-09T09:47:38.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.783+0000 7fc4905dc980 1 -- 172.21.15.157:0/1729160816 >> 172.21.15.157:0/1729160816 conn(0x5599705e32a0 msgr2=0x559970755970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:38.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.783+0000 7fc4905dc980 1 -- 172.21.15.157:0/1729160816 shutdown_connections 2024-05-09T09:47:38.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.783+0000 7fc4905dc980 1 -- 172.21.15.157:0/1729160816 wait complete. 2024-05-09T09:47:38.792 INFO:teuthology.orchestra.run.smithi157.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"69d0cd00-5979-46bf-b012-5813947e658a","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1","marker":"b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-05-09T09:47:37.457331Z","creation_time":"2024-05-09T09:47:37.451022Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}}] 2024-05-09T09:47:38.793 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '69d0cd00-5979-46bf-b012-5813947e658a', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1', 'marker': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-09T09:47:37.457331Z', 'creation_time': '2024-05-09T09:47:37.451022Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-05-09T09:47:38.801 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-05-09T09:47:38.801 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-05-09T09:47:38.801 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-05-09T09:47:38.802 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-05-09T09:47:38.872 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:38.872 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:38.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.875+0000 7f2c123ee980 1 Processor -- start 2024-05-09T09:47:38.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.875+0000 7f2c123ee980 1 -- start start 2024-05-09T09:47:38.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.875+0000 7f2c123ee980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x564f4d3cfa70 0x564f4d45e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.875+0000 7f2c123ee980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564f4d311440 con 0x564f4d45eb30 2024-05-09T09:47:38.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.875+0000 7f2c123ee980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x564f4d2fc5f0 con 0x564f4d3cfa70 2024-05-09T09:47:38.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.875+0000 7f2c0ff09640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x564f4d3cfa70 0x564f4d45e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.875+0000 7f2c0ff09640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x564f4d3cfa70 0x564f4d45e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58746/0 (socket says 172.21.15.157:58746) 2024-05-09T09:47:38.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.875+0000 7f2c0ff09640 1 -- 172.21.15.157:0/3836149282 learned_addr learned my addr 172.21.15.157:0/3836149282 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:38.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.875+0000 7f2c0f708640 1 --1- 172.21.15.157:0/3836149282 >> v1:172.21.15.110:6789/0 conn(0x564f4d45eb30 0x564f4d460f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:51660/0 (socket says 172.21.15.157:51660) 2024-05-09T09:47:38.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.875+0000 7f2c0ff09640 1 -- 172.21.15.157:0/3836149282 >> v1:172.21.15.110:6789/0 conn(0x564f4d45eb30 legacy=0x564f4d460f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.875+0000 7f2c0ff09640 1 -- 172.21.15.157:0/3836149282 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f4d307990 con 0x564f4d3cfa70 2024-05-09T09:47:38.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.879+0000 7f2c0ff09640 1 --2- 172.21.15.157:0/3836149282 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d3cfa70 0x564f4d45e5f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2c0800a4e0 tx=0x7f2c0801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa3f5972c12fd68 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.879+0000 7f2c0ef07640 1 -- 172.21.15.157:0/3836149282 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c080aa540 con 0x564f4d3cfa70 2024-05-09T09:47:38.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.879+0000 7f2c0ef07640 1 -- 172.21.15.157:0/3836149282 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c080aa6e0 con 0x564f4d3cfa70 2024-05-09T09:47:38.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.879+0000 7f2c0ef07640 1 -- 172.21.15.157:0/3836149282 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c080aaa40 con 0x564f4d3cfa70 2024-05-09T09:47:38.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.879+0000 7f2c123ee980 1 -- 172.21.15.157:0/3836149282 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d3cfa70 msgr2=0x564f4d45e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.879+0000 7f2c123ee980 1 --2- 172.21.15.157:0/3836149282 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d3cfa70 0x564f4d45e5f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2c0800a4e0 tx=0x7f2c0801b090 comp rx=0 tx=0).stop 2024-05-09T09:47:38.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.879+0000 7f2c123ee980 1 -- 172.21.15.157:0/3836149282 shutdown_connections 2024-05-09T09:47:38.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.879+0000 7f2c123ee980 1 --2- 172.21.15.157:0/3836149282 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d3cfa70 0x564f4d45e5f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.879+0000 7f2c123ee980 1 -- 172.21.15.157:0/3836149282 >> 172.21.15.157:0/3836149282 conn(0x564f4d4560d0 msgr2=0x564f4d4584f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:38.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.879+0000 7f2c123ee980 1 -- 172.21.15.157:0/3836149282 shutdown_connections 2024-05-09T09:47:38.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.879+0000 7f2c123ee980 1 -- 172.21.15.157:0/3836149282 wait complete. 2024-05-09T09:47:38.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.895+0000 7f2c123ee980 1 Processor -- start 2024-05-09T09:47:38.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.895+0000 7f2c123ee980 1 -- start start 2024-05-09T09:47:38.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.895+0000 7f2c123ee980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d3cfa70 0x564f4d546b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.895+0000 7f2c123ee980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x564f4d35efe0 con 0x564f4d3cfa70 2024-05-09T09:47:38.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.895+0000 7f2c0ff09640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d3cfa70 0x564f4d546b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.895+0000 7f2c0ff09640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d3cfa70 0x564f4d546b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58750/0 (socket says 172.21.15.157:58750) 2024-05-09T09:47:38.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.895+0000 7f2c0ff09640 1 -- 172.21.15.157:0/2033751652 learned_addr learned my addr 172.21.15.157:0/2033751652 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:38.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.895+0000 7f2c0ff09640 1 -- 172.21.15.157:0/2033751652 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f4d2e3ae0 con 0x564f4d3cfa70 2024-05-09T09:47:38.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.895+0000 7f2c0ff09640 1 --2- 172.21.15.157:0/2033751652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d3cfa70 0x564f4d546b50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2c080ac040 tx=0x7f2c080033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576980da41706eec server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.895+0000 7f2afde0b640 1 -- 172.21.15.157:0/2033751652 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c080b9030 con 0x564f4d3cfa70 2024-05-09T09:47:38.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.895+0000 7f2afde0b640 1 -- 172.21.15.157:0/2033751652 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c080aaa40 con 0x564f4d3cfa70 2024-05-09T09:47:38.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.899+0000 7f2afde0b640 1 -- 172.21.15.157:0/2033751652 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c080aad20 con 0x564f4d3cfa70 2024-05-09T09:47:38.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.899+0000 7f2c123ee980 1 -- 172.21.15.157:0/2033751652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d3cfa70 msgr2=0x564f4d546b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.899+0000 7f2c123ee980 1 --2- 172.21.15.157:0/2033751652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d3cfa70 0x564f4d546b50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2c080ac040 tx=0x7f2c080033b0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.899+0000 7f2c123ee980 1 -- 172.21.15.157:0/2033751652 shutdown_connections 2024-05-09T09:47:38.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.899+0000 7f2c123ee980 1 --2- 172.21.15.157:0/2033751652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d3cfa70 0x564f4d546b50 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.899+0000 7f2c123ee980 1 -- 172.21.15.157:0/2033751652 >> 172.21.15.157:0/2033751652 conn(0x564f4d4560d0 msgr2=0x564f4d5426e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:38.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.899+0000 7f2c123ee980 1 -- 172.21.15.157:0/2033751652 shutdown_connections 2024-05-09T09:47:38.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.899+0000 7f2c123ee980 1 -- 172.21.15.157:0/2033751652 wait complete. 2024-05-09T09:47:38.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.899+0000 7f2c123ee980 1 Processor -- start 2024-05-09T09:47:38.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.899+0000 7f2c123ee980 1 -- start start 2024-05-09T09:47:38.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.899+0000 7f2c123ee980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d3cfa70 0x564f4d54dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.899+0000 7f2c123ee980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x564f4d463150 con 0x564f4d3cfa70 2024-05-09T09:47:38.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.899+0000 7f2c0ff09640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d3cfa70 0x564f4d54dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.899+0000 7f2c0ff09640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d3cfa70 0x564f4d54dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58758/0 (socket says 172.21.15.157:58758) 2024-05-09T09:47:38.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.899+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1638380670 learned_addr learned my addr 172.21.15.157:0/1638380670 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:38.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.899+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1638380670 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f4d54e1a0 con 0x564f4d3cfa70 2024-05-09T09:47:38.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.899+0000 7f2c0ff09640 1 --2- 172.21.15.157:0/1638380670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d3cfa70 0x564f4d54dc60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2c080033f0 tx=0x7f2c08017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.899+0000 7f2af7fff640 1 -- 172.21.15.157:0/1638380670 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c080b9030 con 0x564f4d3cfa70 2024-05-09T09:47:38.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.899+0000 7f2af7fff640 1 -- 172.21.15.157:0/1638380670 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c080c2070 con 0x564f4d3cfa70 2024-05-09T09:47:38.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.899+0000 7f2c123ee980 1 -- 172.21.15.157:0/1638380670 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f4d54e430 con 0x564f4d3cfa70 2024-05-09T09:47:38.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.899+0000 7f2af7fff640 1 -- 172.21.15.157:0/1638380670 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c080be400 con 0x564f4d3cfa70 2024-05-09T09:47:38.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.899+0000 7f2c123ee980 1 -- 172.21.15.157:0/1638380670 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f4d5510c0 con 0x564f4d3cfa70 2024-05-09T09:47:38.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.903+0000 7f2af7fff640 1 -- 172.21.15.157:0/1638380670 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f2c080c4070 con 0x564f4d3cfa70 2024-05-09T09:47:38.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.903+0000 7f2af7fff640 1 --2- 172.21.15.157:0/1638380670 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2af8034c00 0x7f2af80370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.903+0000 7f2af7fff640 1 -- 172.21.15.157:0/1638380670 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f2c080ba070 con 0x564f4d3cfa70 2024-05-09T09:47:38.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.903+0000 7f2c0f708640 1 --2- 172.21.15.157:0/1638380670 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2af8034c00 0x7f2af80370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.903+0000 7f2c123ee980 1 --2- 172.21.15.157:0/1638380670 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x564f4d45eb30 0x564f4d554ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.903+0000 7f2c123ee980 1 -- 172.21.15.157:0/1638380670 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5551f0 con 0x564f4d45eb30 2024-05-09T09:47:38.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.903+0000 7f2c1070a640 1 --2- 172.21.15.157:0/1638380670 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x564f4d45eb30 0x564f4d554ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.903+0000 7f2c0f708640 1 --2- 172.21.15.157:0/1638380670 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2af8034c00 0x7f2af80370c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2c04000f70 tx=0x7f2c04001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.903+0000 7f2c1070a640 1 --2- 172.21.15.157:0/1638380670 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x564f4d45eb30 0x564f4d554ba0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.903+0000 7f2c1070a640 1 -- 172.21.15.157:0/1638380670 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c000083f0 con 0x564f4d45eb30 2024-05-09T09:47:38.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.903+0000 7f2c123ee980 1 -- 172.21.15.157:0/1638380670 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5522e0 con 0x564f4d45eb30 2024-05-09T09:47:38.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.903+0000 7f2c1070a640 1 -- 172.21.15.157:0/1638380670 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2c000083f0 con 0x564f4d45eb30 2024-05-09T09:47:38.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.903+0000 7f2c123ee980 1 --2- 172.21.15.157:0/1638380670 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x564f4d557520 0x564f4d559910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.903+0000 7f2c123ee980 1 -- 172.21.15.157:0/1638380670 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d55a000 con 0x564f4d557520 2024-05-09T09:47:38.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.903+0000 7f2c0ff09640 1 --2- 172.21.15.157:0/1638380670 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x564f4d557520 0x564f4d559910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.903+0000 7f2c0ff09640 1 --2- 172.21.15.157:0/1638380670 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x564f4d557520 0x564f4d559910 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.907+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1638380670 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2c080cc020 con 0x564f4d557520 2024-05-09T09:47:38.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.907+0000 7f2c123ee980 1 -- 172.21.15.157:0/1638380670 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5563c0 con 0x564f4d45eb30 2024-05-09T09:47:38.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.907+0000 7f2c1070a640 1 -- 172.21.15.157:0/1638380670 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2c000083f0 con 0x564f4d45eb30 2024-05-09T09:47:38.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.907+0000 7f2c123ee980 1 --2- 172.21.15.157:0/1638380670 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x564f4d55b460 0x564f4d55d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.907+0000 7f2c123ee980 1 -- 172.21.15.157:0/1638380670 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d55df90 con 0x564f4d55b460 2024-05-09T09:47:38.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.907+0000 7f2c0f708640 1 --2- 172.21.15.157:0/1638380670 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x564f4d55b460 0x564f4d55d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.907+0000 7f2c0f708640 1 --2- 172.21.15.157:0/1638380670 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x564f4d55b460 0x564f4d55d850 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.907+0000 7f2c0f708640 1 -- 172.21.15.157:0/1638380670 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2c0400f6a0 con 0x564f4d55b460 2024-05-09T09:47:38.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.911+0000 7f2c123ee980 1 Processor -- start 2024-05-09T09:47:38.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.911+0000 7f2c123ee980 1 -- start start 2024-05-09T09:47:38.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.911+0000 7f2c123ee980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d58a480 0x564f4d58a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.911+0000 7f2c123ee980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x564f4d363020 con 0x564f4d58a480 2024-05-09T09:47:38.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.911+0000 7f2c0ff09640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d58a480 0x564f4d58a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.911+0000 7f2c0ff09640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d58a480 0x564f4d58a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58774/0 (socket says 172.21.15.157:58774) 2024-05-09T09:47:38.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.911+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1025232727 learned_addr learned my addr 172.21.15.157:0/1025232727 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:38.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.911+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1025232727 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f4d58ade0 con 0x564f4d58a480 2024-05-09T09:47:38.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.911+0000 7f2c0ff09640 1 --2- 172.21.15.157:0/1025232727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d58a480 0x564f4d58a8a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2c080e3780 tx=0x7f2c080a9da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.911+0000 7f2aeffff640 1 -- 172.21.15.157:0/1025232727 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c080c5b70 con 0x564f4d58a480 2024-05-09T09:47:38.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.911+0000 7f2aeffff640 1 -- 172.21.15.157:0/1025232727 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c080d5070 con 0x564f4d58a480 2024-05-09T09:47:38.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.911+0000 7f2c123ee980 1 -- 172.21.15.157:0/1025232727 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f4d58b870 con 0x564f4d58a480 2024-05-09T09:47:38.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.911+0000 7f2aeffff640 1 -- 172.21.15.157:0/1025232727 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c080c4360 con 0x564f4d58a480 2024-05-09T09:47:38.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.911+0000 7f2c123ee980 1 -- 172.21.15.157:0/1025232727 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f4d58bd50 con 0x564f4d58a480 2024-05-09T09:47:38.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.915+0000 7f2aeffff640 1 -- 172.21.15.157:0/1025232727 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f2c080d7020 con 0x564f4d58a480 2024-05-09T09:47:38.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.915+0000 7f2aeffff640 1 --2- 172.21.15.157:0/1025232727 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2ae8034bb0 0x7f2ae8037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.915+0000 7f2aeffff640 1 -- 172.21.15.157:0/1025232727 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f2c080eaa00 con 0x564f4d58a480 2024-05-09T09:47:38.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.915+0000 7f2c0f708640 1 --2- 172.21.15.157:0/1025232727 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2ae8034bb0 0x7f2ae8037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.915+0000 7f2c123ee980 1 Processor -- start 2024-05-09T09:47:38.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.915+0000 7f2c123ee980 1 -- start start 2024-05-09T09:47:38.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.915+0000 7f2c0f708640 1 --2- 172.21.15.157:0/1025232727 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2ae8034bb0 0x7f2ae8037070 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x564f4d5556a0 tx=0x7f2c0400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.915+0000 7f2c123ee980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d597460 0x564f4d597840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.915+0000 7f2c123ee980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x564f4d5471e0 con 0x564f4d597460 2024-05-09T09:47:38.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.915+0000 7f2c0ff09640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d597460 0x564f4d597840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.915+0000 7f2c0ff09640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d597460 0x564f4d597840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58788/0 (socket says 172.21.15.157:58788) 2024-05-09T09:47:38.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.915+0000 7f2c0ff09640 1 -- 172.21.15.157:0/449424621 learned_addr learned my addr 172.21.15.157:0/449424621 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:38.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.915+0000 7f2c0ff09640 1 -- 172.21.15.157:0/449424621 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f4d597e10 con 0x564f4d597460 2024-05-09T09:47:38.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.915+0000 7f2c0ff09640 1 --2- 172.21.15.157:0/449424621 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d597460 0x564f4d597840 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2c080e5bd0 tx=0x7f2c080e5920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd51facdad0cb8ef server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.915+0000 7f2aedffb640 1 -- 172.21.15.157:0/449424621 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c080f8020 con 0x564f4d597460 2024-05-09T09:47:38.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.915+0000 7f2aedffb640 1 -- 172.21.15.157:0/449424621 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c080bfdd0 con 0x564f4d597460 2024-05-09T09:47:38.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.915+0000 7f2aedffb640 1 -- 172.21.15.157:0/449424621 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c08004d60 con 0x564f4d597460 2024-05-09T09:47:38.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.915+0000 7f2c123ee980 1 -- 172.21.15.157:0/449424621 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d597460 msgr2=0x564f4d597840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:38.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.915+0000 7f2c123ee980 1 --2- 172.21.15.157:0/449424621 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d597460 0x564f4d597840 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2c080e5bd0 tx=0x7f2c080e5920 comp rx=0 tx=0).stop 2024-05-09T09:47:38.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.915+0000 7f2c123ee980 1 -- 172.21.15.157:0/449424621 shutdown_connections 2024-05-09T09:47:38.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.915+0000 7f2c123ee980 1 --2- 172.21.15.157:0/449424621 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d597460 0x564f4d597840 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:38.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.915+0000 7f2c123ee980 1 -- 172.21.15.157:0/449424621 >> 172.21.15.157:0/449424621 conn(0x564f4d593830 msgr2=0x564f4d591890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:38.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.915+0000 7f2c123ee980 1 -- 172.21.15.157:0/449424621 shutdown_connections 2024-05-09T09:47:38.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.915+0000 7f2c123ee980 1 -- 172.21.15.157:0/449424621 wait complete. 2024-05-09T09:47:38.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.915+0000 7f2c123ee980 1 Processor -- start 2024-05-09T09:47:38.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.915+0000 7f2c123ee980 1 -- start start 2024-05-09T09:47:38.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.919+0000 7f2c123ee980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d597460 0x564f4d59e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.919+0000 7f2c123ee980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x564f4d5983f0 con 0x564f4d597460 2024-05-09T09:47:38.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.919+0000 7f2c0ff09640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d597460 0x564f4d59e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.919+0000 7f2c0ff09640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d597460 0x564f4d59e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58798/0 (socket says 172.21.15.157:58798) 2024-05-09T09:47:38.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.919+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 learned_addr learned my addr 172.21.15.157:0/1951908754 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:38.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.919+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f4d59ed90 con 0x564f4d597460 2024-05-09T09:47:38.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.919+0000 7f2c0ff09640 1 --2- 172.21.15.157:0/1951908754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d597460 0x564f4d59e850 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2c080e24f0 tx=0x7f2c080d5f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.919+0000 7f2adffff640 1 -- 172.21.15.157:0/1951908754 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c0810d070 con 0x564f4d597460 2024-05-09T09:47:38.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.919+0000 7f2adffff640 1 -- 172.21.15.157:0/1951908754 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c080dd880 con 0x564f4d597460 2024-05-09T09:47:38.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.919+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f4d59ed90 con 0x564f4d597460 2024-05-09T09:47:38.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.919+0000 7f2adffff640 1 -- 172.21.15.157:0/1951908754 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c080c54e0 con 0x564f4d597460 2024-05-09T09:47:38.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.919+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f4d59ed90 con 0x564f4d597460 2024-05-09T09:47:38.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.919+0000 7f2c123ee980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.919+0000 7f2adffff640 1 -- 172.21.15.157:0/1951908754 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f2c08110070 con 0x564f4d597460 2024-05-09T09:47:38.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.919+0000 7f2adffff640 1 --2- 172.21.15.157:0/1951908754 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2ad8034b10 0x7f2ad8036fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.919+0000 7f2adffff640 1 -- 172.21.15.157:0/1951908754 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f2c08103030 con 0x564f4d597460 2024-05-09T09:47:38.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.919+0000 7f2c0f708640 1 --2- 172.21.15.157:0/1951908754 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2ad8034b10 0x7f2ad8036fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.919+0000 7f2c123ee980 1 --2- 172.21.15.157:0/1951908754 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x564f4d5ab240 0x564f4d5ad6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.919+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5ade30 con 0x564f4d5ab240 2024-05-09T09:47:38.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.919+0000 7f2c1070a640 1 --2- 172.21.15.157:0/1951908754 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x564f4d5ab240 0x564f4d5ad6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c0f708640 1 --2- 172.21.15.157:0/1951908754 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2ad8034b10 0x7f2ad8036fd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400c010 tx=0x7f2c04010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c1070a640 1 --2- 172.21.15.157:0/1951908754 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x564f4d5ab240 0x564f4d5ad6e0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c000083f0 con 0x564f4d5ab240 2024-05-09T09:47:38.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c123ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:38.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c123ee980 20 realm 2024-05-09T09:47:38.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c123ee980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5ae240 con 0x564f4d5ab240 2024-05-09T09:47:38.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c000083f0 con 0x564f4d5ab240 2024-05-09T09:47:38.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c123ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:38.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c123ee980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:38.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c123ee980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aeae0 con 0x564f4d5ab240 2024-05-09T09:47:38.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c000083f0 con 0x564f4d5ab240 2024-05-09T09:47:38.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c123ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:38.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c123ee980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x564f4d5ab240 2024-05-09T09:47:38.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2c000083f0 con 0x564f4d5ab240 2024-05-09T09:47:38.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c123ee980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:38.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c123ee980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c123ee980 1 --2- 172.21.15.157:0/1951908754 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x564f4d5afbe0 0x564f4d5b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5b2510 con 0x564f4d5afbe0 2024-05-09T09:47:38.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c0ff09640 1 --2- 172.21.15.157:0/1951908754 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x564f4d5afbe0 0x564f4d5b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c0ff09640 1 --2- 172.21.15.157:0/1951908754 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x564f4d5afbe0 0x564f4d5b1fd0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:38.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c123ee980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:38.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c123ee980 20 searching for the correct realm 2024-05-09T09:47:38.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c123ee980 1 --2- 172.21.15.157:0/1951908754 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x564f4d5b4480 0x564f4d5b6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5b7010 con 0x564f4d5b4480 2024-05-09T09:47:38.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c0f708640 1 --2- 172.21.15.157:0/1951908754 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x564f4d5b4480 0x564f4d5b6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.923+0000 7f2c0f708640 1 --2- 172.21.15.157:0/1951908754 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x564f4d5b4480 0x564f4d5b6940 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.927+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04037040 con 0x564f4d5b4480 2024-05-09T09:47:38.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.927+0000 7f2c0f708640 1 --2- 172.21.15.157:0/1951908754 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2c0401fbe0 0x7f2c0403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:38.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.927+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5b7010 con 0x7f2c0401fbe0 2024-05-09T09:47:38.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.927+0000 7f2c1070a640 1 --2- 172.21.15.157:0/1951908754 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2c0401fbe0 0x7f2c0403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:38.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.927+0000 7f2c1070a640 1 --2- 172.21.15.157:0/1951908754 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2c0401fbe0 0x7f2c0403a3c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:38.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.927+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c000083f0 con 0x7f2c0401fbe0 2024-05-09T09:47:38.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.927+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x564f4d5afbe0 2024-05-09T09:47:38.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.927+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:38.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.927+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x564f4d5ab240 2024-05-09T09:47:38.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.927+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c000083f0 con 0x564f4d5ab240 2024-05-09T09:47:38.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.927+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x564f4d5ab240 2024-05-09T09:47:38.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.927+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c00026040 con 0x564f4d5ab240 2024-05-09T09:47:38.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.927+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x564f4d5afbe0 2024-05-09T09:47:38.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.927+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:38.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.927+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x564f4d5afbe0 2024-05-09T09:47:38.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.931+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:38.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.931+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x7f2c0401fbe0 2024-05-09T09:47:38.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.931+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c00026040 con 0x7f2c0401fbe0 2024-05-09T09:47:38.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.931+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x564f4d5b4480 2024-05-09T09:47:38.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.931+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04037040 con 0x564f4d5b4480 2024-05-09T09:47:38.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.931+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x564f4d5ab240 2024-05-09T09:47:38.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.931+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c00026040 con 0x564f4d5ab240 2024-05-09T09:47:38.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.931+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x564f4d5afbe0 2024-05-09T09:47:38.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.931+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:38.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.931+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x564f4d5ab240 2024-05-09T09:47:38.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.931+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c00026040 con 0x564f4d5ab240 2024-05-09T09:47:38.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.931+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x7f2c0401fbe0 2024-05-09T09:47:38.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.931+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2c00026040 con 0x7f2c0401fbe0 2024-05-09T09:47:38.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.931+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x564f4d5b4480 2024-05-09T09:47:38.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.931+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04037040 con 0x564f4d5b4480 2024-05-09T09:47:38.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.931+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x564f4d5b4480 2024-05-09T09:47:38.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.931+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2c04037040 con 0x564f4d5b4480 2024-05-09T09:47:38.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.931+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x564f4d5afbe0 2024-05-09T09:47:38.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.931+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:38.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.931+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x564f4d5b4480 2024-05-09T09:47:38.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.935+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04037040 con 0x564f4d5b4480 2024-05-09T09:47:38.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.935+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x564f4d5b4480 2024-05-09T09:47:38.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.935+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04037040 con 0x564f4d5b4480 2024-05-09T09:47:38.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.935+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x564f4d5ab240 2024-05-09T09:47:38.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.935+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c00026040 con 0x564f4d5ab240 2024-05-09T09:47:38.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.935+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x564f4d5ab240 2024-05-09T09:47:38.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.935+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2c00026040 con 0x564f4d5ab240 2024-05-09T09:47:38.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.935+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x564f4d5afbe0 2024-05-09T09:47:38.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.935+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:38.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.935+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x564f4d5b4480 2024-05-09T09:47:38.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.935+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04037040 con 0x564f4d5b4480 2024-05-09T09:47:38.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.935+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x7f2c0401fbe0 2024-05-09T09:47:38.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.935+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c00026040 con 0x7f2c0401fbe0 2024-05-09T09:47:38.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.935+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x564f4d5ab240 2024-05-09T09:47:38.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.935+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c00026040 con 0x564f4d5ab240 2024-05-09T09:47:38.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.935+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x564f4d5afbe0 2024-05-09T09:47:38.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.935+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:38.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.935+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x564f4d5b4480 2024-05-09T09:47:38.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.935+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04037040 con 0x564f4d5b4480 2024-05-09T09:47:38.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.935+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x564f4d5afbe0 2024-05-09T09:47:38.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:38.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x7f2c0401fbe0 2024-05-09T09:47:38.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c00026040 con 0x7f2c0401fbe0 2024-05-09T09:47:38.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x564f4d5b4480 2024-05-09T09:47:38.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c04037040 con 0x564f4d5b4480 2024-05-09T09:47:38.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x564f4d5afbe0 2024-05-09T09:47:38.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:38.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x564f4d5ab240 2024-05-09T09:47:38.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2c00026040 con 0x564f4d5ab240 2024-05-09T09:47:38.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5aee80 con 0x7f2c0401fbe0 2024-05-09T09:47:38.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c00026040 con 0x7f2c0401fbe0 2024-05-09T09:47:38.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c123ee980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:38.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c123ee980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:38.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c123ee980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:38.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c123ee980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:38.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c123ee980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:38.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c123ee980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:38.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c123ee980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5b2d60 con 0x564f4d5ab240 2024-05-09T09:47:38.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c00026040 con 0x564f4d5ab240 2024-05-09T09:47:38.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c123ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:38.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c123ee980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5b2d60 con 0x564f4d5ab240 2024-05-09T09:47:38.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2c00026040 con 0x564f4d5ab240 2024-05-09T09:47:38.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c123ee980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:38.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c123ee980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5b2d60 con 0x564f4d5b4480 2024-05-09T09:47:38.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2c040491c0 con 0x564f4d5b4480 2024-05-09T09:47:38.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c123ee980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:38.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c123ee980 20 zone default found 2024-05-09T09:47:38.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c123ee980 4 Realm: () 2024-05-09T09:47:38.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c123ee980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:38.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c123ee980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:38.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c123ee980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:38.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c123ee980 20 zonegroup default 2024-05-09T09:47:38.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c123ee980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.939+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5b3600 con 0x564f4d5afbe0 2024-05-09T09:47:38.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.943+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:38.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.943+0000 7f2c123ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:38.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.943+0000 7f2c123ee980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.943+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5b8e70 con 0x564f4d5b4480 2024-05-09T09:47:38.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.943+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2c040491c0 con 0x564f4d5b4480 2024-05-09T09:47:38.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.943+0000 7f2c123ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:38.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.943+0000 7f2c123ee980 20 rados->read ofs=0 len=0 2024-05-09T09:47:38.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.943+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5b9210 con 0x564f4d5b4480 2024-05-09T09:47:38.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.943+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2c040491c0 con 0x564f4d5b4480 2024-05-09T09:47:38.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.943+0000 7f2c123ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:38.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.943+0000 7f2c123ee980 20 started sync module instance, tier type = 2024-05-09T09:47:38.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.943+0000 7f2c123ee980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:38.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.943+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5b8310 con 0x7f2c0401fbe0 2024-05-09T09:47:38.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.943+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c00026040 con 0x7f2c0401fbe0 2024-05-09T09:47:38.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.943+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94898600249392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5b8310 con 0x7f2c0401fbe0 2024-05-09T09:47:38.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.943+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5b9bd0 con 0x564f4d5ab240 2024-05-09T09:47:38.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.943+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94898600249392] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c00036040 con 0x7f2c0401fbe0 2024-05-09T09:47:38.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.947+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c00036040 con 0x564f4d5ab240 2024-05-09T09:47:38.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.947+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94898600253488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5b8310 con 0x564f4d5ab240 2024-05-09T09:47:38.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.947+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5ba5e0 con 0x564f4d5b4480 2024-05-09T09:47:38.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.947+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94898600253488] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c00036040 con 0x564f4d5ab240 2024-05-09T09:47:38.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.947+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c040491c0 con 0x564f4d5b4480 2024-05-09T09:47:38.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.947+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94898600246880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5b8280 con 0x564f4d5b4480 2024-05-09T09:47:38.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.947+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5bb330 con 0x7f2c0401fbe0 2024-05-09T09:47:38.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.951+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c00036040 con 0x7f2c0401fbe0 2024-05-09T09:47:38.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.951+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94898600259504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5bbc00 con 0x7f2c0401fbe0 2024-05-09T09:47:38.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.951+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5bc5c0 con 0x564f4d5ab240 2024-05-09T09:47:38.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.951+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94898600246880] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c040491c0 con 0x564f4d5b4480 2024-05-09T09:47:38.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.951+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94898600259504] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c00036040 con 0x7f2c0401fbe0 2024-05-09T09:47:38.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.951+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c00036040 con 0x564f4d5ab240 2024-05-09T09:47:38.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.951+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94898600263952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5bc530 con 0x564f4d5ab240 2024-05-09T09:47:38.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.951+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5bbb40 con 0x564f4d5afbe0 2024-05-09T09:47:38.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.955+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:38.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.955+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94898600266160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5bd280 con 0x564f4d5afbe0 2024-05-09T09:47:38.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.955+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5bdc40 con 0x564f4d5afbe0 2024-05-09T09:47:38.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.955+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94898600263952] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c00036040 con 0x564f4d5ab240 2024-05-09T09:47:38.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.955+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94898600266160] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:38.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.955+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:38.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.955+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94898600269712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5be030 con 0x564f4d5afbe0 2024-05-09T09:47:38.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.955+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5be880 con 0x564f4d5afbe0 2024-05-09T09:47:38.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.959+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94898600269712] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:38.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.959+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:38.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.959+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94898600271840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5bec70 con 0x564f4d5afbe0 2024-05-09T09:47:38.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.959+0000 7f2c123ee980 20 add_watcher() i=0 2024-05-09T09:47:38.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.959+0000 7f2c123ee980 20 add_watcher() i=1 2024-05-09T09:47:38.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.959+0000 7f2c123ee980 20 add_watcher() i=2 2024-05-09T09:47:38.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.959+0000 7f2c123ee980 20 add_watcher() i=3 2024-05-09T09:47:38.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.959+0000 7f2c123ee980 20 add_watcher() i=4 2024-05-09T09:47:38.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.959+0000 7f2c123ee980 20 add_watcher() i=5 2024-05-09T09:47:38.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.959+0000 7f2c123ee980 20 add_watcher() i=6 2024-05-09T09:47:38.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.959+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94898600271840] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:38.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.959+0000 7f2c123ee980 20 add_watcher() i=7 2024-05-09T09:47:38.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.959+0000 7f2c123ee980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:38.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.959+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5c1ca0 con 0x564f4d5ab240 2024-05-09T09:47:38.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.959+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2c00036040 con 0x564f4d5ab240 2024-05-09T09:47:38.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.959+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94898600273360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5bf160 con 0x564f4d5ab240 2024-05-09T09:47:38.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.963+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94898600273360] v30'184 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2c00036040 con 0x564f4d5ab240 2024-05-09T09:47:38.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.963+0000 7f2ac4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:38.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.963+0000 7f2c123ee980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:38.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.963+0000 7f2c123ee980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:38.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.963+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5ca360 con 0x564f4d5ab240 2024-05-09T09:47:38.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.963+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'48 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2c00036040 con 0x564f4d5ab240 2024-05-09T09:47:38.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.963+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5ca8d0 con 0x564f4d5afbe0 2024-05-09T09:47:38.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.967+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'43 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:38.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.967+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5ca8d0 con 0x564f4d5b4480 2024-05-09T09:47:38.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.967+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'42 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2c040491c0 con 0x564f4d5b4480 2024-05-09T09:47:38.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.967+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5cb1a0 con 0x564f4d5ab240 2024-05-09T09:47:38.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.971+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'185 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2c00036040 con 0x564f4d5ab240 2024-05-09T09:47:38.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.971+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5cb710 con 0x7f2c0401fbe0 2024-05-09T09:47:38.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.971+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'116 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2c00036040 con 0x7f2c0401fbe0 2024-05-09T09:47:38.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.971+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5cbbc0 con 0x564f4d5b4480 2024-05-09T09:47:38.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.971+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'78 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2c040491c0 con 0x564f4d5b4480 2024-05-09T09:47:38.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.971+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5cc130 con 0x564f4d5ab240 2024-05-09T09:47:38.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.975+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'44 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2c00036040 con 0x564f4d5ab240 2024-05-09T09:47:38.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.975+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5cc130 con 0x564f4d5afbe0 2024-05-09T09:47:38.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.975+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'77 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:38.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.975+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5cc130 con 0x7f2c0401fbe0 2024-05-09T09:47:38.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.979+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'42 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2c00036040 con 0x7f2c0401fbe0 2024-05-09T09:47:38.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.979+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5cc4f0 con 0x564f4d5b4480 2024-05-09T09:47:38.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.979+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'48 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2c040491c0 con 0x564f4d5b4480 2024-05-09T09:47:38.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.979+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5cc4f0 con 0x7f2c0401fbe0 2024-05-09T09:47:38.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.979+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'117 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c00036040 con 0x7f2c0401fbe0 2024-05-09T09:47:38.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.979+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5cc4f0 con 0x564f4d5afbe0 2024-05-09T09:47:38.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.983+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'44 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:38.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.983+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5cc4f0 con 0x7f2c0401fbe0 2024-05-09T09:47:38.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.983+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'42 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c00036040 con 0x7f2c0401fbe0 2024-05-09T09:47:38.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.983+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5cc4f0 con 0x564f4d5afbe0 2024-05-09T09:47:38.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.987+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'83 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:38.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.987+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5cc4f0 con 0x564f4d5ab240 2024-05-09T09:47:38.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.987+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'186 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c00036040 con 0x564f4d5ab240 2024-05-09T09:47:38.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.987+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5cc4f0 con 0x564f4d5b4480 2024-05-09T09:47:38.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.991+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'110 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c040491c0 con 0x564f4d5b4480 2024-05-09T09:47:38.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.991+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5cc580 con 0x7f2c0401fbe0 2024-05-09T09:47:38.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.991+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'118 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c00036040 con 0x7f2c0401fbe0 2024-05-09T09:47:38.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.991+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5cc580 con 0x564f4d5b4480 2024-05-09T09:47:38.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.991+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'42 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c040491c0 con 0x564f4d5b4480 2024-05-09T09:47:38.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.991+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5cc640 con 0x564f4d5ab240 2024-05-09T09:47:38.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.995+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'50 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c00036040 con 0x564f4d5ab240 2024-05-09T09:47:38.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.995+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5cc640 con 0x564f4d5ab240 2024-05-09T09:47:38.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.995+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'187 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c00036040 con 0x564f4d5ab240 2024-05-09T09:47:38.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.995+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5cc610 con 0x564f4d5b4480 2024-05-09T09:47:38.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.999+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'111 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c040491c0 con 0x564f4d5b4480 2024-05-09T09:47:38.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.999+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5cc610 con 0x7f2c0401fbe0 2024-05-09T09:47:38.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.999+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'52 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c00036040 con 0x7f2c0401fbe0 2024-05-09T09:47:38.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.999+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5cc610 con 0x564f4d5b4480 2024-05-09T09:47:38.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.999+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'44 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c040491c0 con 0x564f4d5b4480 2024-05-09T09:47:38.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:38.999+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5cc610 con 0x564f4d5b4480 2024-05-09T09:47:39.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.003+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'48 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c040491c0 con 0x564f4d5b4480 2024-05-09T09:47:39.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.003+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5cc610 con 0x564f4d5b4480 2024-05-09T09:47:39.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.003+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'38 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c040491c0 con 0x564f4d5b4480 2024-05-09T09:47:39.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.003+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5cc610 con 0x564f4d5b4480 2024-05-09T09:47:39.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.003+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'79 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c040491c0 con 0x564f4d5b4480 2024-05-09T09:47:39.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.003+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5cc610 con 0x564f4d5afbe0 2024-05-09T09:47:39.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.007+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'44 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:39.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.007+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5cc610 con 0x564f4d5b4480 2024-05-09T09:47:39.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.007+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'42 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c040491c0 con 0x564f4d5b4480 2024-05-09T09:47:39.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.007+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5cc610 con 0x564f4d5afbe0 2024-05-09T09:47:39.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.011+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'78 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:39.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.011+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5cc580 con 0x564f4d5b4480 2024-05-09T09:47:39.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.015+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'112 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c040491c0 con 0x564f4d5b4480 2024-05-09T09:47:39.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.015+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5cc580 con 0x564f4d5afbe0 2024-05-09T09:47:39.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.015+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'84 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:39.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.015+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5cc580 con 0x7f2c0401fbe0 2024-05-09T09:47:39.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'48 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2c00036040 con 0x7f2c0401fbe0 2024-05-09T09:47:39.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2a3f7fe640 20 reqs_thread_entry: start 2024-05-09T09:47:39.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2c123ee980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:39.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2a3d7fa640 20 reqs_thread_entry: start 2024-05-09T09:47:39.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2c123ee980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5c86a0 con 0x7f2c0401fbe0 2024-05-09T09:47:39.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f2c00036040 con 0x7f2c0401fbe0 2024-05-09T09:47:39.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2c123ee980 20 rados_obj.operate() r=0 bl.length=165 2024-05-09T09:47:39.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2c123ee980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 8.5 8:a7233c95:root::.bucket.meta.myfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5e8de0 con 0x564f4d5ab240 2024-05-09T09:47:39.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(95 .bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f2c00036040 con 0x564f4d5ab240 2024-05-09T09:47:39.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2c123ee980 20 rados_obj.operate() r=0 bl.length=379 2024-05-09T09:47:39.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2c123ee980 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-09T09:47:39.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2c123ee980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:96 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5e8a90 con 0x7f2c0401fbe0 2024-05-09T09:47:39.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(96 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f2c00036040 con 0x7f2c0401fbe0 2024-05-09T09:47:39.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2c123ee980 20 rados_obj.operate() r=0 bl.length=165 2024-05-09T09:47:39.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2c123ee980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 8.5 8:a7233c95:root::.bucket.meta.myfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5c82a0 con 0x564f4d5ab240 2024-05-09T09:47:39.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(97 .bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f2c00036040 con 0x564f4d5ab240 2024-05-09T09:47:39.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2c123ee980 20 rados_obj.operate() r=0 bl.length=379 2024-05-09T09:47:39.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2c123ee980 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-09T09:47:39.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:98 4.b 4:d25ceb2d:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5eb8b0 con 0x7f2c0401fbe0 2024-05-09T09:47:39.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:99 4.3 4:c0b28912:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5ee220 con 0x564f4d5ab240 2024-05-09T09:47:39.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:100 4.4 4:20a0679d:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5f0cc0 con 0x564f4d5afbe0 2024-05-09T09:47:39.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:101 4.26 4:6777fe5e:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5f3530 con 0x564f4d5afbe0 2024-05-09T09:47:39.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 4.3 4:c063be13:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5f6080 con 0x564f4d5ab240 2024-05-09T09:47:39.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 4.31 4:8f008dfd:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5f0cc0 con 0x564f4d5ab240 2024-05-09T09:47:39.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 4.33 4:ccd4db27:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5fb580 con 0x564f4d5afbe0 2024-05-09T09:47:39.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:105 4.1d 4:bb2bb3ce:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5fdeb0 con 0x564f4d5b4480 2024-05-09T09:47:39.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.019+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:106 4.36 4:6fb2fa4a:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d6007a0 con 0x564f4d5ab240 2024-05-09T09:47:39.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.023+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:107 4.17 4:ea8823bf:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d602c70 con 0x564f4d5afbe0 2024-05-09T09:47:39.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.023+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:108 4.3a 4:5f6cb505:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564f4d605860 con 0x564f4d5b4480 2024-05-09T09:47:39.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.023+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(99 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2c00036040 con 0x564f4d5ab240 2024-05-09T09:47:39.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.023+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(98 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2c00036040 con 0x7f2c0401fbe0 2024-05-09T09:47:39.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.023+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(105 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2c040491c0 con 0x564f4d5b4480 2024-05-09T09:47:39.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.023+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(102 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.4 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2c00036040 con 0x564f4d5ab240 2024-05-09T09:47:39.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.023+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(103 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f2c00036040 con 0x564f4d5ab240 2024-05-09T09:47:39.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.023+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(101 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:39.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.023+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(106 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2c00036040 con 0x564f4d5ab240 2024-05-09T09:47:39.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.023+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(108 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f2c040491c0 con 0x564f4d5b4480 2024-05-09T09:47:39.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.023+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(104 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:39.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.023+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(100 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:39.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.023+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(107 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:39.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.023+0000 7f2ac4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:39.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.023+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:109 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94898600273360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5c16a0 con 0x564f4d5ab240 2024-05-09T09:47:39.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.023+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(109 data_loggenerations_metadata [watch unwatch cookie 94898600273360] v30'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2c00036040 con 0x564f4d5ab240 2024-05-09T09:47:39.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.023+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:110 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94898600249392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5c16a0 con 0x7f2c0401fbe0 2024-05-09T09:47:39.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.027+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(110 notify.0 [watch unwatch cookie 94898600249392] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c00036040 con 0x7f2c0401fbe0 2024-05-09T09:47:39.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.027+0000 7f2c123ee980 20 remove_watcher() i=0 2024-05-09T09:47:39.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.027+0000 7f2c123ee980 2 removed watcher, disabling cache 2024-05-09T09:47:39.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.027+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:111 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94898600253488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5c16a0 con 0x564f4d5ab240 2024-05-09T09:47:39.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.027+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(111 notify.1 [watch unwatch cookie 94898600253488] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c00036040 con 0x564f4d5ab240 2024-05-09T09:47:39.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.027+0000 7f2c123ee980 20 remove_watcher() i=1 2024-05-09T09:47:39.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.027+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:112 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94898600246880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5c16a0 con 0x564f4d5b4480 2024-05-09T09:47:39.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.031+0000 7f2c0f708640 1 -- 172.21.15.157:0/1951908754 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== osd_op_reply(112 notify.2 [watch unwatch cookie 94898600246880] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c040491c0 con 0x564f4d5b4480 2024-05-09T09:47:39.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.031+0000 7f2c123ee980 20 remove_watcher() i=2 2024-05-09T09:47:39.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.031+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:113 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94898600259504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5c16a0 con 0x7f2c0401fbe0 2024-05-09T09:47:39.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.031+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(113 notify.3 [watch unwatch cookie 94898600259504] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c00036040 con 0x7f2c0401fbe0 2024-05-09T09:47:39.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.031+0000 7f2c123ee980 20 remove_watcher() i=3 2024-05-09T09:47:39.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.031+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:114 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94898600263952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5c16a0 con 0x564f4d5ab240 2024-05-09T09:47:39.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.035+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(114 notify.4 [watch unwatch cookie 94898600263952] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c00036040 con 0x564f4d5ab240 2024-05-09T09:47:39.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.035+0000 7f2c123ee980 20 remove_watcher() i=4 2024-05-09T09:47:39.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.035+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:115 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94898600266160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5bc110 con 0x564f4d5afbe0 2024-05-09T09:47:39.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.035+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(115 notify.5 [watch unwatch cookie 94898600266160] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:39.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.035+0000 7f2c123ee980 20 remove_watcher() i=5 2024-05-09T09:47:39.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.035+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:116 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94898600269712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5c16a0 con 0x564f4d5afbe0 2024-05-09T09:47:39.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.039+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(116 notify.6 [watch unwatch cookie 94898600269712] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:39.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.039+0000 7f2c123ee980 20 remove_watcher() i=6 2024-05-09T09:47:39.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.039+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:117 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94898600271840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564f4d5bc9b0 con 0x564f4d5afbe0 2024-05-09T09:47:39.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.039+0000 7f2c0ff09640 1 -- 172.21.15.157:0/1951908754 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(117 notify.7 [watch unwatch cookie 94898600271840] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c0810f030 con 0x564f4d5afbe0 2024-05-09T09:47:39.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.039+0000 7f2c123ee980 20 remove_watcher() i=7 2024-05-09T09:47:39.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.039+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x564f4d5afbe0 msgr2=0x564f4d5b1fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.039+0000 7f2c123ee980 1 --2- 172.21.15.157:0/1951908754 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x564f4d5afbe0 0x564f4d5b1fd0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.039+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x564f4d5ab240 msgr2=0x564f4d5ad6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.039+0000 7f2c123ee980 1 --2- 172.21.15.157:0/1951908754 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x564f4d5ab240 0x564f4d5ad6e0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.039+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2c0401fbe0 msgr2=0x7f2c0403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.039+0000 7f2c123ee980 1 --2- 172.21.15.157:0/1951908754 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2c0401fbe0 0x7f2c0403a3c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.039+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x564f4d5b4480 msgr2=0x564f4d5b6940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.039+0000 7f2c123ee980 1 --2- 172.21.15.157:0/1951908754 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x564f4d5b4480 0x564f4d5b6940 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.039+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2ad8034b10 msgr2=0x7f2ad8036fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.039+0000 7f2c123ee980 1 --2- 172.21.15.157:0/1951908754 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2ad8034b10 0x7f2ad8036fd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400c010 tx=0x7f2c04010000 comp rx=0 tx=0).stop 2024-05-09T09:47:39.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.039+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d597460 msgr2=0x564f4d59e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.039+0000 7f2c123ee980 1 --2- 172.21.15.157:0/1951908754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d597460 0x564f4d59e850 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2c080e24f0 tx=0x7f2c080d5f10 comp rx=0 tx=0).stop 2024-05-09T09:47:39.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.039+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 reap_dead start 2024-05-09T09:47:39.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.039+0000 7f2c1070a640 1 -- 172.21.15.157:0/1951908754 reap_dead start 2024-05-09T09:47:39.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.039+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 shutdown_connections 2024-05-09T09:47:39.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.039+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 >> 172.21.15.157:0/1951908754 conn(0x564f4d593830 msgr2=0x564f4d590e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:39.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.039+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 shutdown_connections 2024-05-09T09:47:39.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.039+0000 7f2c123ee980 1 -- 172.21.15.157:0/1951908754 wait complete. 2024-05-09T09:47:39.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.043+0000 7f2c123ee980 1 -- 172.21.15.157:0/1025232727 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2ae8034bb0 msgr2=0x7f2ae8037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.043+0000 7f2c123ee980 1 --2- 172.21.15.157:0/1025232727 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2ae8034bb0 0x7f2ae8037070 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x564f4d5556a0 tx=0x7f2c0400f000 comp rx=0 tx=0).stop 2024-05-09T09:47:39.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.043+0000 7f2c123ee980 1 -- 172.21.15.157:0/1025232727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d58a480 msgr2=0x564f4d58a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.043+0000 7f2c123ee980 1 --2- 172.21.15.157:0/1025232727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d58a480 0x564f4d58a8a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2c080e3780 tx=0x7f2c080a9da0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.043+0000 7f2c123ee980 1 -- 172.21.15.157:0/1025232727 shutdown_connections 2024-05-09T09:47:39.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.043+0000 7f2c123ee980 1 --2- 172.21.15.157:0/1025232727 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2ae8034bb0 0x7f2ae8037070 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.043+0000 7f2c123ee980 1 --2- 172.21.15.157:0/1025232727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d58a480 0x564f4d58a8a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.043+0000 7f2c123ee980 1 -- 172.21.15.157:0/1025232727 >> 172.21.15.157:0/1025232727 conn(0x564f4d45a970 msgr2=0x564f4d45ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:39.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.043+0000 7f2c123ee980 1 -- 172.21.15.157:0/1025232727 shutdown_connections 2024-05-09T09:47:39.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.043+0000 7f2c123ee980 1 -- 172.21.15.157:0/1025232727 wait complete. 2024-05-09T09:47:39.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.043+0000 7f2c123ee980 1 -- 172.21.15.157:0/1638380670 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x564f4d557520 msgr2=0x564f4d559910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.043+0000 7f2c123ee980 1 --2- 172.21.15.157:0/1638380670 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x564f4d557520 0x564f4d559910 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.043+0000 7f2c123ee980 1 -- 172.21.15.157:0/1638380670 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x564f4d45eb30 msgr2=0x564f4d554ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.043+0000 7f2c123ee980 1 --2- 172.21.15.157:0/1638380670 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x564f4d45eb30 0x564f4d554ba0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.043+0000 7f2c123ee980 1 -- 172.21.15.157:0/1638380670 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x564f4d55b460 msgr2=0x564f4d55d850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.043+0000 7f2c123ee980 1 --2- 172.21.15.157:0/1638380670 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x564f4d55b460 0x564f4d55d850 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.043+0000 7f2c123ee980 1 -- 172.21.15.157:0/1638380670 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2af8034c00 msgr2=0x7f2af80370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.043+0000 7f2c123ee980 1 --2- 172.21.15.157:0/1638380670 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2af8034c00 0x7f2af80370c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2c04000f70 tx=0x7f2c04001380 comp rx=0 tx=0).stop 2024-05-09T09:47:39.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.043+0000 7f2c123ee980 1 -- 172.21.15.157:0/1638380670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d3cfa70 msgr2=0x564f4d54dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.043+0000 7f2c123ee980 1 --2- 172.21.15.157:0/1638380670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564f4d3cfa70 0x564f4d54dc60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2c080033f0 tx=0x7f2c08017e30 comp rx=0 tx=0).stop 2024-05-09T09:47:39.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.043+0000 7f2c1070a640 1 -- 172.21.15.157:0/1638380670 reap_dead start 2024-05-09T09:47:39.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.043+0000 7f2c123ee980 1 -- 172.21.15.157:0/1638380670 shutdown_connections 2024-05-09T09:47:39.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.043+0000 7f2c123ee980 1 -- 172.21.15.157:0/1638380670 >> 172.21.15.157:0/1638380670 conn(0x564f4d4560d0 msgr2=0x564f4d5411f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:39.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.043+0000 7f2c123ee980 1 -- 172.21.15.157:0/1638380670 shutdown_connections 2024-05-09T09:47:39.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.043+0000 7f2c123ee980 1 -- 172.21.15.157:0/1638380670 wait complete. 2024-05-09T09:47:39.053 INFO:teuthology.orchestra.run.smithi157.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"69d0cd00-5979-46bf-b012-5813947e658a","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1","marker":"b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-05-09T09:47:37.457331Z","creation_time":"2024-05-09T09:47:37.451022Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-05-09T09:47:39.053 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '69d0cd00-5979-46bf-b012-5813947e658a', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1', 'marker': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-09T09:47:37.457331Z', 'creation_time': '2024-05-09T09:47:37.451022Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-09T09:47:39.053 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-05-09T09:47:39.053 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-05-09T09:47:39.053 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-05-09T09:47:39.135 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:39.135 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:39.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.139+0000 7ff58d524980 1 Processor -- start 2024-05-09T09:47:39.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.139+0000 7ff58d524980 1 -- start start 2024-05-09T09:47:39.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.139+0000 7ff58d524980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55ad929cdd70 0x55ad929d0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.139+0000 7ff58d524980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ad92880440 con 0x55ad929c9810 2024-05-09T09:47:39.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.139+0000 7ff58d524980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55ad9286b5f0 con 0x55ad929cdd70 2024-05-09T09:47:39.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.139+0000 7ff58a83e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55ad929cdd70 0x55ad929d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.139+0000 7ff58a83e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55ad929cdd70 0x55ad929d0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58810/0 (socket says 172.21.15.157:58810) 2024-05-09T09:47:39.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.139+0000 7ff58a83e640 1 -- 172.21.15.157:0/2847811986 learned_addr learned my addr 172.21.15.157:0/2847811986 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:39.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.139+0000 7ff58b03f640 1 --1- 172.21.15.157:0/2847811986 >> v1:172.21.15.110:6789/0 conn(0x55ad929c9810 0x55ad929c9bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:51666/0 (socket says 172.21.15.157:51666) 2024-05-09T09:47:39.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.139+0000 7ff58a83e640 1 -- 172.21.15.157:0/2847811986 >> v1:172.21.15.110:6789/0 conn(0x55ad929c9810 legacy=0x55ad929c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.139+0000 7ff58a83e640 1 -- 172.21.15.157:0/2847811986 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad92876990 con 0x55ad929cdd70 2024-05-09T09:47:39.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.143+0000 7ff58a83e640 1 --2- 172.21.15.157:0/2847811986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad929cdd70 0x55ad929d0160 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff57400a5c0 tx=0x7ff57401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffcf8bbca683f42b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.143+0000 7ff58a03d640 1 -- 172.21.15.157:0/2847811986 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5740a6070 con 0x55ad929cdd70 2024-05-09T09:47:39.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.143+0000 7ff58a03d640 1 -- 172.21.15.157:0/2847811986 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5740af070 con 0x55ad929cdd70 2024-05-09T09:47:39.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.143+0000 7ff58a03d640 1 -- 172.21.15.157:0/2847811986 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5740aa5c0 con 0x55ad929cdd70 2024-05-09T09:47:39.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.143+0000 7ff58d524980 1 -- 172.21.15.157:0/2847811986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad929cdd70 msgr2=0x55ad929d0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.143+0000 7ff58d524980 1 --2- 172.21.15.157:0/2847811986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad929cdd70 0x55ad929d0160 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff57400a5c0 tx=0x7ff57401b340 comp rx=0 tx=0).stop 2024-05-09T09:47:39.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.143+0000 7ff58d524980 1 -- 172.21.15.157:0/2847811986 shutdown_connections 2024-05-09T09:47:39.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.143+0000 7ff58d524980 1 --2- 172.21.15.157:0/2847811986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad929cdd70 0x55ad929d0160 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.143+0000 7ff58d524980 1 -- 172.21.15.157:0/2847811986 >> 172.21.15.157:0/2847811986 conn(0x55ad929c50e0 msgr2=0x55ad929c7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:39.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.143+0000 7ff58d524980 1 -- 172.21.15.157:0/2847811986 shutdown_connections 2024-05-09T09:47:39.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.143+0000 7ff58d524980 1 -- 172.21.15.157:0/2847811986 wait complete. 2024-05-09T09:47:39.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.159+0000 7ff58d524980 1 Processor -- start 2024-05-09T09:47:39.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.159+0000 7ff58d524980 1 -- start start 2024-05-09T09:47:39.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.159+0000 7ff58d524980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad929c9810 0x55ad929d3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.159+0000 7ff58d524980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ad928cdfe0 con 0x55ad929c9810 2024-05-09T09:47:39.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.159+0000 7ff58b03f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad929c9810 0x55ad929d3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.159+0000 7ff58b03f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad929c9810 0x55ad929d3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58818/0 (socket says 172.21.15.157:58818) 2024-05-09T09:47:39.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.159+0000 7ff58b03f640 1 -- 172.21.15.157:0/3648092658 learned_addr learned my addr 172.21.15.157:0/3648092658 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:39.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.159+0000 7ff58b03f640 1 -- 172.21.15.157:0/3648092658 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad92852ae0 con 0x55ad929c9810 2024-05-09T09:47:39.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.159+0000 7ff58b03f640 1 --2- 172.21.15.157:0/3648092658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad929c9810 0x55ad929d3030 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0015f0 tx=0x7ff57c001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57cc8f538e7a894b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.159+0000 7ff47960a640 1 -- 172.21.15.157:0/3648092658 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff57c013420 con 0x55ad929c9810 2024-05-09T09:47:39.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.159+0000 7ff47960a640 1 -- 172.21.15.157:0/3648092658 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff57c0135e0 con 0x55ad929c9810 2024-05-09T09:47:39.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.159+0000 7ff47960a640 1 -- 172.21.15.157:0/3648092658 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff57c013940 con 0x55ad929c9810 2024-05-09T09:47:39.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.163+0000 7ff58d524980 1 -- 172.21.15.157:0/3648092658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad929c9810 msgr2=0x55ad929d3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.163+0000 7ff58d524980 1 --2- 172.21.15.157:0/3648092658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad929c9810 0x55ad929d3030 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0015f0 tx=0x7ff57c001ab0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.163+0000 7ff58d524980 1 -- 172.21.15.157:0/3648092658 shutdown_connections 2024-05-09T09:47:39.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.163+0000 7ff58d524980 1 --2- 172.21.15.157:0/3648092658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad929c9810 0x55ad929d3030 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.163+0000 7ff58d524980 1 -- 172.21.15.157:0/3648092658 >> 172.21.15.157:0/3648092658 conn(0x55ad929c50e0 msgr2=0x55ad92ab1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:39.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.163+0000 7ff58d524980 1 -- 172.21.15.157:0/3648092658 shutdown_connections 2024-05-09T09:47:39.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.163+0000 7ff58d524980 1 -- 172.21.15.157:0/3648092658 wait complete. 2024-05-09T09:47:39.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.163+0000 7ff58d524980 1 Processor -- start 2024-05-09T09:47:39.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.163+0000 7ff58d524980 1 -- start start 2024-05-09T09:47:39.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.163+0000 7ff58d524980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad929c9810 0x55ad92abefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.163+0000 7ff58d524980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ad929d1180 con 0x55ad929c9810 2024-05-09T09:47:39.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.163+0000 7ff58b03f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad929c9810 0x55ad92abefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.163+0000 7ff58b03f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad929c9810 0x55ad92abefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58820/0 (socket says 172.21.15.157:58820) 2024-05-09T09:47:39.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.163+0000 7ff58b03f640 1 -- 172.21.15.157:0/1462827803 learned_addr learned my addr 172.21.15.157:0/1462827803 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:39.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.163+0000 7ff58b03f640 1 -- 172.21.15.157:0/1462827803 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad92abf4e0 con 0x55ad929c9810 2024-05-09T09:47:39.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.163+0000 7ff58b03f640 1 --2- 172.21.15.157:0/1462827803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad929c9810 0x55ad92abefa0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff57c006640 tx=0x7ff57c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.163+0000 7ff477e07640 1 -- 172.21.15.157:0/1462827803 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff57c022020 con 0x55ad929c9810 2024-05-09T09:47:39.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.163+0000 7ff477e07640 1 -- 172.21.15.157:0/1462827803 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff57c006320 con 0x55ad929c9810 2024-05-09T09:47:39.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.163+0000 7ff477e07640 1 -- 172.21.15.157:0/1462827803 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff57c004af0 con 0x55ad929c9810 2024-05-09T09:47:39.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.163+0000 7ff58d524980 1 -- 172.21.15.157:0/1462827803 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad92abf770 con 0x55ad929c9810 2024-05-09T09:47:39.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.163+0000 7ff58d524980 1 -- 172.21.15.157:0/1462827803 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad92ac2400 con 0x55ad929c9810 2024-05-09T09:47:39.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.167+0000 7ff477e07640 1 -- 172.21.15.157:0/1462827803 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7ff57c025020 con 0x55ad929c9810 2024-05-09T09:47:39.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.167+0000 7ff477e07640 1 --2- 172.21.15.157:0/1462827803 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff470034c00 0x7ff4700370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.167+0000 7ff477e07640 1 -- 172.21.15.157:0/1462827803 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7ff57c018030 con 0x55ad929c9810 2024-05-09T09:47:39.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.167+0000 7ff58a83e640 1 --2- 172.21.15.157:0/1462827803 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff470034c00 0x7ff4700370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.167+0000 7ff58d524980 1 --2- 172.21.15.157:0/1462827803 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ad929cdd70 0x55ad92ac5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.167+0000 7ff58d524980 1 -- 172.21.15.157:0/1462827803 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92ac6590 con 0x55ad929cdd70 2024-05-09T09:47:39.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.167+0000 7ff58b840640 1 --2- 172.21.15.157:0/1462827803 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ad929cdd70 0x55ad92ac5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.167+0000 7ff58a83e640 1 --2- 172.21.15.157:0/1462827803 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff470034c00 0x7ff4700370c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff5740ae000 tx=0x7ff5740a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.167+0000 7ff58b840640 1 --2- 172.21.15.157:0/1462827803 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ad929cdd70 0x55ad92ac5f20 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.167+0000 7ff58b840640 1 -- 172.21.15.157:0/1462827803 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5840083f0 con 0x55ad929cdd70 2024-05-09T09:47:39.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.167+0000 7ff58d524980 1 -- 172.21.15.157:0/1462827803 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92ac3620 con 0x55ad929cdd70 2024-05-09T09:47:39.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.167+0000 7ff58b840640 1 -- 172.21.15.157:0/1462827803 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff5840083f0 con 0x55ad929cdd70 2024-05-09T09:47:39.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.167+0000 7ff58d524980 1 --2- 172.21.15.157:0/1462827803 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ad92ac88c0 0x55ad92acacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.167+0000 7ff58d524980 1 -- 172.21.15.157:0/1462827803 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92acb380 con 0x55ad92ac88c0 2024-05-09T09:47:39.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.167+0000 7ff58b03f640 1 --2- 172.21.15.157:0/1462827803 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ad92ac88c0 0x55ad92acacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.171+0000 7ff58b03f640 1 --2- 172.21.15.157:0/1462827803 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ad92ac88c0 0x55ad92acacb0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.171+0000 7ff58b03f640 1 -- 172.21.15.157:0/1462827803 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff57c01b070 con 0x55ad92ac88c0 2024-05-09T09:47:39.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.171+0000 7ff58d524980 1 -- 172.21.15.157:0/1462827803 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92ac7760 con 0x55ad929cdd70 2024-05-09T09:47:39.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.171+0000 7ff58b840640 1 -- 172.21.15.157:0/1462827803 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff5840083f0 con 0x55ad929cdd70 2024-05-09T09:47:39.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.171+0000 7ff58d524980 1 --2- 172.21.15.157:0/1462827803 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ad92acc7e0 0x55ad92acebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.171+0000 7ff58d524980 1 -- 172.21.15.157:0/1462827803 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92acf310 con 0x55ad92acc7e0 2024-05-09T09:47:39.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.171+0000 7ff58a83e640 1 --2- 172.21.15.157:0/1462827803 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ad92acc7e0 0x55ad92acebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.171+0000 7ff58a83e640 1 --2- 172.21.15.157:0/1462827803 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ad92acc7e0 0x55ad92acebd0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.171+0000 7ff58a83e640 1 -- 172.21.15.157:0/1462827803 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92acc7e0 2024-05-09T09:47:39.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.175+0000 7ff58d524980 1 Processor -- start 2024-05-09T09:47:39.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.175+0000 7ff58d524980 1 -- start start 2024-05-09T09:47:39.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.175+0000 7ff58d524980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad92af51a0 0x55ad92af55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.175+0000 7ff58d524980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ad928d2020 con 0x55ad92af51a0 2024-05-09T09:47:39.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.175+0000 7ff58b03f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad92af51a0 0x55ad92af55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.175+0000 7ff58b03f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad92af51a0 0x55ad92af55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58836/0 (socket says 172.21.15.157:58836) 2024-05-09T09:47:39.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.175+0000 7ff58b03f640 1 -- 172.21.15.157:0/3486742468 learned_addr learned my addr 172.21.15.157:0/3486742468 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:39.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.175+0000 7ff58b03f640 1 -- 172.21.15.157:0/3486742468 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad92af5b00 con 0x55ad92af51a0 2024-05-09T09:47:39.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.175+0000 7ff58b03f640 1 --2- 172.21.15.157:0/3486742468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad92af51a0 0x55ad92af55c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff57c014fd0 tx=0x7ff57c010520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.175+0000 7ff46ffff640 1 -- 172.21.15.157:0/3486742468 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff57c01d950 con 0x55ad92af51a0 2024-05-09T09:47:39.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.179+0000 7ff58d524980 1 -- 172.21.15.157:0/3486742468 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad92af6590 con 0x55ad92af51a0 2024-05-09T09:47:39.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.179+0000 7ff46ffff640 1 -- 172.21.15.157:0/3486742468 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff57c01daf0 con 0x55ad92af51a0 2024-05-09T09:47:39.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.179+0000 7ff46ffff640 1 -- 172.21.15.157:0/3486742468 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff57c01ddd0 con 0x55ad92af51a0 2024-05-09T09:47:39.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.179+0000 7ff58d524980 1 -- 172.21.15.157:0/3486742468 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad92af6a70 con 0x55ad92af51a0 2024-05-09T09:47:39.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.179+0000 7ff46ffff640 1 -- 172.21.15.157:0/3486742468 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7ff57c010070 con 0x55ad92af51a0 2024-05-09T09:47:39.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.179+0000 7ff46ffff640 1 --2- 172.21.15.157:0/3486742468 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff464034c00 0x7ff4640370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.179+0000 7ff46ffff640 1 -- 172.21.15.157:0/3486742468 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7ff57c0495a0 con 0x55ad92af51a0 2024-05-09T09:47:39.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.179+0000 7ff58a83e640 1 --2- 172.21.15.157:0/3486742468 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff464034c00 0x7ff4640370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.179+0000 7ff58d524980 1 Processor -- start 2024-05-09T09:47:39.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.179+0000 7ff58d524980 1 -- start start 2024-05-09T09:47:39.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.179+0000 7ff58d524980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad92b02160 0x55ad92b02580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.179+0000 7ff58d524980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ad929d1760 con 0x55ad92b02160 2024-05-09T09:47:39.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.179+0000 7ff58a83e640 1 --2- 172.21.15.157:0/3486742468 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff464034c00 0x7ff4640370c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55ad92ac6e70 tx=0x7ff574005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.179+0000 7ff58b03f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad92b02160 0x55ad92b02580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.179+0000 7ff58b03f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad92b02160 0x55ad92b02580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58838/0 (socket says 172.21.15.157:58838) 2024-05-09T09:47:39.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.179+0000 7ff58b03f640 1 -- 172.21.15.157:0/833636210 learned_addr learned my addr 172.21.15.157:0/833636210 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:39.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.179+0000 7ff58b03f640 1 -- 172.21.15.157:0/833636210 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad92b02b50 con 0x55ad92b02160 2024-05-09T09:47:39.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.179+0000 7ff58b03f640 1 --2- 172.21.15.157:0/833636210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad92b02160 0x55ad92b02580 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff57c004d30 tx=0x7ff57c031890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5749cbbbfe97787a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.179+0000 7ff46dffb640 1 -- 172.21.15.157:0/833636210 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff57c04a580 con 0x55ad92b02160 2024-05-09T09:47:39.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.179+0000 7ff46dffb640 1 -- 172.21.15.157:0/833636210 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff57c03ed00 con 0x55ad92b02160 2024-05-09T09:47:39.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.179+0000 7ff46dffb640 1 -- 172.21.15.157:0/833636210 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff57c027400 con 0x55ad92b02160 2024-05-09T09:47:39.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.183+0000 7ff58d524980 1 -- 172.21.15.157:0/833636210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad92b02160 msgr2=0x55ad92b02580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.183+0000 7ff58d524980 1 --2- 172.21.15.157:0/833636210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad92b02160 0x55ad92b02580 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff57c004d30 tx=0x7ff57c031890 comp rx=0 tx=0).stop 2024-05-09T09:47:39.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.183+0000 7ff58d524980 1 -- 172.21.15.157:0/833636210 shutdown_connections 2024-05-09T09:47:39.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.183+0000 7ff58d524980 1 --2- 172.21.15.157:0/833636210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad92b02160 0x55ad92b02580 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.183+0000 7ff58d524980 1 -- 172.21.15.157:0/833636210 >> 172.21.15.157:0/833636210 conn(0x55ad92afe4e0 msgr2=0x55ad92afc540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:39.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.183+0000 7ff58d524980 1 -- 172.21.15.157:0/833636210 shutdown_connections 2024-05-09T09:47:39.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.183+0000 7ff58d524980 1 -- 172.21.15.157:0/833636210 wait complete. 2024-05-09T09:47:39.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.183+0000 7ff58d524980 1 Processor -- start 2024-05-09T09:47:39.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.183+0000 7ff58d524980 1 -- start start 2024-05-09T09:47:39.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.183+0000 7ff58d524980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad92b02160 0x55ad92b09420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.183+0000 7ff58d524980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ad92b03220 con 0x55ad92b02160 2024-05-09T09:47:39.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.183+0000 7ff58b03f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad92b02160 0x55ad92b09420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.183+0000 7ff58b03f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad92b02160 0x55ad92b09420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58854/0 (socket says 172.21.15.157:58854) 2024-05-09T09:47:39.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.183+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 learned_addr learned my addr 172.21.15.157:0/3305590953 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:39.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.183+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad92b09960 con 0x55ad92b02160 2024-05-09T09:47:39.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.183+0000 7ff58b03f640 1 --2- 172.21.15.157:0/3305590953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad92b02160 0x55ad92b09420 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff57c006790 tx=0x7ff57c049240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.183+0000 7ff45bfff640 1 -- 172.21.15.157:0/3305590953 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff57c065070 con 0x55ad92b02160 2024-05-09T09:47:39.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.183+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad92b09960 con 0x55ad92b02160 2024-05-09T09:47:39.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.183+0000 7ff45bfff640 1 -- 172.21.15.157:0/3305590953 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff57c04a9a0 con 0x55ad92b02160 2024-05-09T09:47:39.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.183+0000 7ff45bfff640 1 -- 172.21.15.157:0/3305590953 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff57c04ad00 con 0x55ad92b02160 2024-05-09T09:47:39.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.183+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad92b09de0 con 0x55ad92b02160 2024-05-09T09:47:39.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.183+0000 7ff45bfff640 1 -- 172.21.15.157:0/3305590953 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7ff57c068070 con 0x55ad92b02160 2024-05-09T09:47:39.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.183+0000 7ff58d524980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.183+0000 7ff45bfff640 1 --2- 172.21.15.157:0/3305590953 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff454034c00 0x7ff4540370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.183+0000 7ff45bfff640 1 -- 172.21.15.157:0/3305590953 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7ff57c05e040 con 0x55ad92b02160 2024-05-09T09:47:39.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.183+0000 7ff58a83e640 1 --2- 172.21.15.157:0/3305590953 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff454034c00 0x7ff4540370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.183+0000 7ff58d524980 1 --2- 172.21.15.157:0/3305590953 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ad92b15d50 0x55ad92b181f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.183+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b18940 con 0x55ad92b15d50 2024-05-09T09:47:39.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58b840640 1 --2- 172.21.15.157:0/3305590953 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ad92b15d50 0x55ad92b181f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58b840640 1 --2- 172.21.15.157:0/3305590953 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ad92b15d50 0x55ad92b181f0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58a83e640 1 --2- 172.21.15.157:0/3305590953 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff454034c00 0x7ff4540370c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff57401b380 tx=0x7ff5740c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5840083f0 con 0x55ad92b15d50 2024-05-09T09:47:39.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58d524980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:39.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58d524980 20 realm 2024-05-09T09:47:39.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58d524980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b18d50 con 0x55ad92b15d50 2024-05-09T09:47:39.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5840083f0 con 0x55ad92b15d50 2024-05-09T09:47:39.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58d524980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:39.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58d524980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:39.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58d524980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b195f0 con 0x55ad92b15d50 2024-05-09T09:47:39.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5840083f0 con 0x55ad92b15d50 2024-05-09T09:47:39.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58d524980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:39.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58d524980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x55ad92b15d50 2024-05-09T09:47:39.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff5840083f0 con 0x55ad92b15d50 2024-05-09T09:47:39.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58d524980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:39.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58d524980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58d524980 1 --2- 172.21.15.157:0/3305590953 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ad92b1a4c0 0x55ad92b1c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b1cff0 con 0x55ad92b1a4c0 2024-05-09T09:47:39.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58b03f640 1 --2- 172.21.15.157:0/3305590953 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ad92b1a4c0 0x55ad92b1c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58b03f640 1 --2- 172.21.15.157:0/3305590953 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ad92b1a4c0 0x55ad92b1c8b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58d524980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:39.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58d524980 20 searching for the correct realm 2024-05-09T09:47:39.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58d524980 1 --2- 172.21.15.157:0/3305590953 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ad92b1ef90 0x55ad92b21430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b21b00 con 0x55ad92b1ef90 2024-05-09T09:47:39.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.187+0000 7ff58a83e640 1 --2- 172.21.15.157:0/3305590953 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ad92b1ef90 0x55ad92b21430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.191+0000 7ff58a83e640 1 --2- 172.21.15.157:0/3305590953 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ad92b1ef90 0x55ad92b21430 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.191+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92b1ef90 2024-05-09T09:47:39.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.191+0000 7ff58a83e640 1 --2- 172.21.15.157:0/3305590953 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7ff5740e0040 0x7ff5740e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.191+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b21b00 con 0x7ff5740e0040 2024-05-09T09:47:39.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.191+0000 7ff58b840640 1 --2- 172.21.15.157:0/3305590953 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7ff5740e0040 0x7ff5740e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.191+0000 7ff58b840640 1 --2- 172.21.15.157:0/3305590953 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7ff5740e0040 0x7ff5740e0420 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.191+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5840083f0 con 0x7ff5740e0040 2024-05-09T09:47:39.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.191+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x55ad92b1a4c0 2024-05-09T09:47:39.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.191+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.191+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x55ad92b15d50 2024-05-09T09:47:39.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.191+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5840083f0 con 0x55ad92b15d50 2024-05-09T09:47:39.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.191+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x55ad92b15d50 2024-05-09T09:47:39.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.191+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff584026040 con 0x55ad92b15d50 2024-05-09T09:47:39.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.191+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x55ad92b1a4c0 2024-05-09T09:47:39.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.191+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.191+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x55ad92b1a4c0 2024-05-09T09:47:39.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.195+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.195+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x7ff5740e0040 2024-05-09T09:47:39.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.195+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff584026040 con 0x7ff5740e0040 2024-05-09T09:47:39.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.195+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x55ad92b1ef90 2024-05-09T09:47:39.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.195+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92b1ef90 2024-05-09T09:47:39.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.195+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x55ad92b15d50 2024-05-09T09:47:39.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.195+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff584026040 con 0x55ad92b15d50 2024-05-09T09:47:39.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.195+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x55ad92b1a4c0 2024-05-09T09:47:39.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.195+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.195+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x55ad92b15d50 2024-05-09T09:47:39.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.195+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff584026040 con 0x55ad92b15d50 2024-05-09T09:47:39.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.195+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x7ff5740e0040 2024-05-09T09:47:39.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.195+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff584026040 con 0x7ff5740e0040 2024-05-09T09:47:39.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.195+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x55ad92b1ef90 2024-05-09T09:47:39.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.195+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92b1ef90 2024-05-09T09:47:39.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.195+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x55ad92b1ef90 2024-05-09T09:47:39.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.195+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92b1ef90 2024-05-09T09:47:39.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.195+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x55ad92b1a4c0 2024-05-09T09:47:39.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.199+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.199+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x55ad92b1ef90 2024-05-09T09:47:39.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.199+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92b1ef90 2024-05-09T09:47:39.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.199+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x55ad92b1ef90 2024-05-09T09:47:39.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.199+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92b1ef90 2024-05-09T09:47:39.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.199+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x55ad92b15d50 2024-05-09T09:47:39.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.199+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff584026040 con 0x55ad92b15d50 2024-05-09T09:47:39.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.199+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x55ad92b15d50 2024-05-09T09:47:39.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.199+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff584026040 con 0x55ad92b15d50 2024-05-09T09:47:39.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.199+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x55ad92b1a4c0 2024-05-09T09:47:39.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.199+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.199+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x55ad92b1ef90 2024-05-09T09:47:39.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.199+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92b1ef90 2024-05-09T09:47:39.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.199+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x7ff5740e0040 2024-05-09T09:47:39.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.199+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff584026040 con 0x7ff5740e0040 2024-05-09T09:47:39.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.199+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x55ad92b15d50 2024-05-09T09:47:39.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.199+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff584026040 con 0x55ad92b15d50 2024-05-09T09:47:39.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.199+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x55ad92b1a4c0 2024-05-09T09:47:39.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x55ad92b1ef90 2024-05-09T09:47:39.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92b1ef90 2024-05-09T09:47:39.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x55ad92b1a4c0 2024-05-09T09:47:39.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x7ff5740e0040 2024-05-09T09:47:39.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff584026040 con 0x7ff5740e0040 2024-05-09T09:47:39.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x55ad92b1ef90 2024-05-09T09:47:39.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92b1ef90 2024-05-09T09:47:39.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x55ad92b1a4c0 2024-05-09T09:47:39.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x55ad92b15d50 2024-05-09T09:47:39.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff584026040 con 0x55ad92b15d50 2024-05-09T09:47:39.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b19990 con 0x7ff5740e0040 2024-05-09T09:47:39.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff584026040 con 0x7ff5740e0040 2024-05-09T09:47:39.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58d524980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:39.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58d524980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:39.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58d524980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:39.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58d524980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:39.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58d524980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:39.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58d524980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:39.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58d524980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b1d8b0 con 0x55ad92b15d50 2024-05-09T09:47:39.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff584026040 con 0x55ad92b15d50 2024-05-09T09:47:39.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58d524980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:39.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58d524980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b1d8b0 con 0x55ad92b15d50 2024-05-09T09:47:39.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff584026040 con 0x55ad92b15d50 2024-05-09T09:47:39.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58d524980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:39.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58d524980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.203+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b1d8b0 con 0x55ad92b1ef90 2024-05-09T09:47:39.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.207+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92b1ef90 2024-05-09T09:47:39.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.207+0000 7ff58d524980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:39.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.207+0000 7ff58d524980 20 zone default found 2024-05-09T09:47:39.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.207+0000 7ff58d524980 4 Realm: () 2024-05-09T09:47:39.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.207+0000 7ff58d524980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:39.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.207+0000 7ff58d524980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:39.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.207+0000 7ff58d524980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:39.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.207+0000 7ff58d524980 20 zonegroup default 2024-05-09T09:47:39.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.207+0000 7ff58d524980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.207+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b1e150 con 0x55ad92b1a4c0 2024-05-09T09:47:39.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.207+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.207+0000 7ff58d524980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:39.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.207+0000 7ff58d524980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.207+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b23960 con 0x55ad92b1ef90 2024-05-09T09:47:39.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.207+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92b1ef90 2024-05-09T09:47:39.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.207+0000 7ff58d524980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:39.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.207+0000 7ff58d524980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.207+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b23d00 con 0x55ad92b1ef90 2024-05-09T09:47:39.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.207+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92b1ef90 2024-05-09T09:47:39.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.207+0000 7ff58d524980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:39.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.207+0000 7ff58d524980 20 started sync module instance, tier type = 2024-05-09T09:47:39.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.207+0000 7ff58d524980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:39.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.207+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b22e00 con 0x7ff5740e0040 2024-05-09T09:47:39.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.207+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff584026040 con 0x7ff5740e0040 2024-05-09T09:47:39.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.207+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94203978855216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b22e00 con 0x7ff5740e0040 2024-05-09T09:47:39.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.207+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b24700 con 0x55ad92b15d50 2024-05-09T09:47:39.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.211+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94203978855216] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff584036040 con 0x7ff5740e0040 2024-05-09T09:47:39.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.211+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff584036040 con 0x55ad92b15d50 2024-05-09T09:47:39.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.211+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94203978859024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b22e00 con 0x55ad92b15d50 2024-05-09T09:47:39.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.211+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b25110 con 0x55ad92b1ef90 2024-05-09T09:47:39.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.211+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92b1ef90 2024-05-09T09:47:39.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.211+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94203978859024] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff584036040 con 0x55ad92b15d50 2024-05-09T09:47:39.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.211+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94203978852688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b22d70 con 0x55ad92b1ef90 2024-05-09T09:47:39.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.211+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b25e60 con 0x7ff5740e0040 2024-05-09T09:47:39.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.215+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff584036040 con 0x7ff5740e0040 2024-05-09T09:47:39.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.215+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94203978865376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b26700 con 0x7ff5740e0040 2024-05-09T09:47:39.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.215+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b27100 con 0x55ad92b15d50 2024-05-09T09:47:39.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.215+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94203978852688] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92b1ef90 2024-05-09T09:47:39.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.215+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94203978865376] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff584036040 con 0x7ff5740e0040 2024-05-09T09:47:39.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.215+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff584036040 con 0x55ad92b15d50 2024-05-09T09:47:39.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.215+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94203978863872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b261e0 con 0x55ad92b15d50 2024-05-09T09:47:39.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.215+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b279a0 con 0x55ad92b1a4c0 2024-05-09T09:47:39.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.219+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94203978863872] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff584036040 con 0x55ad92b15d50 2024-05-09T09:47:39.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.219+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.219+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94203978872048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b261e0 con 0x55ad92b1a4c0 2024-05-09T09:47:39.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.219+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b281f0 con 0x55ad92b1a4c0 2024-05-09T09:47:39.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.219+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94203978872048] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.219+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.219+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94203978874176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b28610 con 0x55ad92b1a4c0 2024-05-09T09:47:39.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.219+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b28fd0 con 0x55ad92b1a4c0 2024-05-09T09:47:39.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.223+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.223+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94203978877728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b293f0 con 0x55ad92b1a4c0 2024-05-09T09:47:39.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.223+0000 7ff58d524980 20 add_watcher() i=0 2024-05-09T09:47:39.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.223+0000 7ff58d524980 20 add_watcher() i=1 2024-05-09T09:47:39.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.223+0000 7ff58d524980 20 add_watcher() i=2 2024-05-09T09:47:39.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.223+0000 7ff58d524980 20 add_watcher() i=3 2024-05-09T09:47:39.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.223+0000 7ff58d524980 20 add_watcher() i=4 2024-05-09T09:47:39.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.223+0000 7ff58d524980 20 add_watcher() i=5 2024-05-09T09:47:39.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.223+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94203978874176] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.223+0000 7ff58d524980 20 add_watcher() i=6 2024-05-09T09:47:39.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.223+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94203978877728] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.223+0000 7ff58d524980 20 add_watcher() i=7 2024-05-09T09:47:39.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.223+0000 7ff58d524980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:39.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.223+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b28160 con 0x55ad92b15d50 2024-05-09T09:47:39.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.223+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff584036040 con 0x55ad92b15d50 2024-05-09T09:47:39.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.223+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94203978875232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b29930 con 0x55ad92b15d50 2024-05-09T09:47:39.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.227+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94203978875232] v30'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff584036040 con 0x55ad92b15d50 2024-05-09T09:47:39.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.227+0000 7ff440fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:39.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.227+0000 7ff58d524980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:39.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.227+0000 7ff58d524980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:39.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.227+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b349f0 con 0x55ad92b15d50 2024-05-09T09:47:39.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.227+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'49 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff584036040 con 0x55ad92b15d50 2024-05-09T09:47:39.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.227+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b35020 con 0x55ad92b1a4c0 2024-05-09T09:47:39.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.231+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'44 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.231+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b35440 con 0x55ad92b1ef90 2024-05-09T09:47:39.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.231+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'43 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92b1ef90 2024-05-09T09:47:39.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.231+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b357b0 con 0x55ad92b15d50 2024-05-09T09:47:39.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.231+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'190 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff584036040 con 0x55ad92b15d50 2024-05-09T09:47:39.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.231+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b329d0 con 0x7ff5740e0040 2024-05-09T09:47:39.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.235+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'119 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff584036040 con 0x7ff5740e0040 2024-05-09T09:47:39.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.235+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b329d0 con 0x55ad92b1ef90 2024-05-09T09:47:39.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.235+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'80 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92b1ef90 2024-05-09T09:47:39.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.235+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b36460 con 0x55ad92b15d50 2024-05-09T09:47:39.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.239+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'45 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff584036040 con 0x55ad92b15d50 2024-05-09T09:47:39.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.239+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b36460 con 0x55ad92b1a4c0 2024-05-09T09:47:39.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.239+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'79 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.239+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b36460 con 0x7ff5740e0040 2024-05-09T09:47:39.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.243+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'43 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff584036040 con 0x7ff5740e0040 2024-05-09T09:47:39.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.243+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b36460 con 0x55ad92b1ef90 2024-05-09T09:47:39.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.243+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'49 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92b1ef90 2024-05-09T09:47:39.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.243+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b369d0 con 0x7ff5740e0040 2024-05-09T09:47:39.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.243+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'120 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff584036040 con 0x7ff5740e0040 2024-05-09T09:47:39.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.243+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b369d0 con 0x55ad92b1a4c0 2024-05-09T09:47:39.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.247+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'45 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.247+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b369d0 con 0x7ff5740e0040 2024-05-09T09:47:39.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.247+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'43 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff584036040 con 0x7ff5740e0040 2024-05-09T09:47:39.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.247+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b369d0 con 0x55ad92b1a4c0 2024-05-09T09:47:39.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.251+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'85 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.251+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b369d0 con 0x55ad92b15d50 2024-05-09T09:47:39.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.251+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'191 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff584036040 con 0x55ad92b15d50 2024-05-09T09:47:39.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.251+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b369d0 con 0x55ad92b1ef90 2024-05-09T09:47:39.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.255+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'113 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92b1ef90 2024-05-09T09:47:39.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.255+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b369d0 con 0x7ff5740e0040 2024-05-09T09:47:39.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.255+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'121 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff584036040 con 0x7ff5740e0040 2024-05-09T09:47:39.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.255+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b369d0 con 0x55ad92b1ef90 2024-05-09T09:47:39.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.259+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'43 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92b1ef90 2024-05-09T09:47:39.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.259+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b369d0 con 0x55ad92b15d50 2024-05-09T09:47:39.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.259+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'51 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff584036040 con 0x55ad92b15d50 2024-05-09T09:47:39.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.259+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b36fa0 con 0x55ad92b15d50 2024-05-09T09:47:39.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.263+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'192 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff584036040 con 0x55ad92b15d50 2024-05-09T09:47:39.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.263+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b36f20 con 0x55ad92b1ef90 2024-05-09T09:47:39.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.263+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'114 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92b1ef90 2024-05-09T09:47:39.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.263+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b36ae0 con 0x7ff5740e0040 2024-05-09T09:47:39.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.267+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'53 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff584036040 con 0x7ff5740e0040 2024-05-09T09:47:39.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.267+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b36ae0 con 0x55ad92b1ef90 2024-05-09T09:47:39.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.267+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'45 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92b1ef90 2024-05-09T09:47:39.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.267+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b36ae0 con 0x55ad92b1ef90 2024-05-09T09:47:39.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.267+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'49 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92b1ef90 2024-05-09T09:47:39.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.267+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b36ae0 con 0x55ad92b1ef90 2024-05-09T09:47:39.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.267+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'39 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92b1ef90 2024-05-09T09:47:39.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.267+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b36ae0 con 0x55ad92b1ef90 2024-05-09T09:47:39.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.271+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'81 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92b1ef90 2024-05-09T09:47:39.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.271+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b36ae0 con 0x55ad92b1a4c0 2024-05-09T09:47:39.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.271+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'45 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.271+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b36ae0 con 0x55ad92b1ef90 2024-05-09T09:47:39.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.275+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'43 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92b1ef90 2024-05-09T09:47:39.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.275+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b36ae0 con 0x55ad92b1a4c0 2024-05-09T09:47:39.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.275+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'80 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.275+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b36ae0 con 0x55ad92b1ef90 2024-05-09T09:47:39.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.279+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'115 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92b1ef90 2024-05-09T09:47:39.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.279+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b36910 con 0x55ad92b1a4c0 2024-05-09T09:47:39.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.283+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'86 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.283+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b36ae0 con 0x7ff5740e0040 2024-05-09T09:47:39.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.283+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'49 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff584036040 con 0x7ff5740e0040 2024-05-09T09:47:39.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.283+0000 7ff3bb7fe640 20 reqs_thread_entry: start 2024-05-09T09:47:39.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.283+0000 7ff58d524980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:39.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.283+0000 7ff3b97fa640 20 reqs_thread_entry: start 2024-05-09T09:47:39.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58d524980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b52600 con 0x55ad92b15d50 2024-05-09T09:47:39.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff584036040 con 0x55ad92b15d50 2024-05-09T09:47:39.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58d524980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:47:39.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b31670 con 0x7ff5740e0040 2024-05-09T09:47:39.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7ff584036040 con 0x7ff5740e0040 2024-05-09T09:47:39.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58d524980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 8.5 8:a7233c95:root::.bucket.meta.myfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b536f0 con 0x55ad92b15d50 2024-05-09T09:47:39.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(96 .bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7ff584036040 con 0x55ad92b15d50 2024-05-09T09:47:39.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58d524980 20 rados_obj.operate() r=0 bl.length=379 2024-05-09T09:47:39.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58d524980 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-09T09:47:39.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:97 4.b 4:d25ceb2d:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b55230 con 0x7ff5740e0040 2024-05-09T09:47:39.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 4.3 4:c0b28912:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b57b60 con 0x55ad92b15d50 2024-05-09T09:47:39.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:99 4.4 4:20a0679d:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b5a7b0 con 0x55ad92b1a4c0 2024-05-09T09:47:39.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:100 4.26 4:6777fe5e:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b5d060 con 0x55ad92b1a4c0 2024-05-09T09:47:39.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:101 4.3 4:c063be13:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b5f9d0 con 0x55ad92b15d50 2024-05-09T09:47:39.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 4.31 4:8f008dfd:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b5d060 con 0x55ad92b15d50 2024-05-09T09:47:39.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 4.33 4:ccd4db27:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b64b30 con 0x55ad92b1a4c0 2024-05-09T09:47:39.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:104 4.1d 4:bb2bb3ce:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b673a0 con 0x55ad92b1ef90 2024-05-09T09:47:39.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(97 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff584036040 con 0x7ff5740e0040 2024-05-09T09:47:39.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:105 4.36 4:6fb2fa4a:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b69c10 con 0x55ad92b15d50 2024-05-09T09:47:39.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:106 4.17 4:ea8823bf:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b69fb0 con 0x55ad92b1a4c0 2024-05-09T09:47:39.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:107 4.3a 4:5f6cb505:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b6c820 con 0x55ad92b1ef90 2024-05-09T09:47:39.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(98 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff584036040 con 0x55ad92b15d50 2024-05-09T09:47:39.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(102 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7ff584036040 con 0x55ad92b15d50 2024-05-09T09:47:39.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(101 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.4 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff584036040 con 0x55ad92b15d50 2024-05-09T09:47:39.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(99 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(104 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92b1ef90 2024-05-09T09:47:39.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(100 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(105 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff584036040 con 0x55ad92b15d50 2024-05-09T09:47:39.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(103 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(107 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92b1ef90 2024-05-09T09:47:39.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(106 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.287+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:108 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b536f0 con 0x7ff5740e0040 2024-05-09T09:47:39.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.291+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(108 foo.buckets [call] v30'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff584036040 con 0x7ff5740e0040 2024-05-09T09:47:39.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.291+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:109 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b536f0 con 0x7ff5740e0040 2024-05-09T09:47:39.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.291+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(109 foo.buckets [call] v30'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff584036040 con 0x7ff5740e0040 2024-05-09T09:47:39.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.291+0000 7ff58d524980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.291+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:110 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b536f0 con 0x55ad92b15d50 2024-05-09T09:47:39.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.291+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(110 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff584036040 con 0x55ad92b15d50 2024-05-09T09:47:39.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.295+0000 7ff58d524980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:47:39.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.295+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:111 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b536f0 con 0x7ff5740e0040 2024-05-09T09:47:39.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.295+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(111 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7ff584036040 con 0x7ff5740e0040 2024-05-09T09:47:39.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.295+0000 7ff440fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:39.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.295+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:112 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94203978875232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b536f0 con 0x55ad92b15d50 2024-05-09T09:47:39.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.295+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(112 data_loggenerations_metadata [watch unwatch cookie 94203978875232] v30'193 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff584036040 con 0x55ad92b15d50 2024-05-09T09:47:39.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.295+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:113 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94203978855216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b536f0 con 0x7ff5740e0040 2024-05-09T09:47:39.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.299+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.2 v2:172.21.15.157:6800/354455204 23 ==== osd_op_reply(113 notify.0 [watch unwatch cookie 94203978855216] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff584036040 con 0x7ff5740e0040 2024-05-09T09:47:39.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.299+0000 7ff58d524980 20 remove_watcher() i=0 2024-05-09T09:47:39.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.299+0000 7ff58d524980 2 removed watcher, disabling cache 2024-05-09T09:47:39.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.299+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:114 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94203978859024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b28160 con 0x55ad92b15d50 2024-05-09T09:47:39.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.299+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(114 notify.1 [watch unwatch cookie 94203978859024] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff584036040 con 0x55ad92b15d50 2024-05-09T09:47:39.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.299+0000 7ff58d524980 20 remove_watcher() i=1 2024-05-09T09:47:39.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.299+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:115 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94203978852688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b24210 con 0x55ad92b1ef90 2024-05-09T09:47:39.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.303+0000 7ff58a83e640 1 -- 172.21.15.157:0/3305590953 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== osd_op_reply(115 notify.2 [watch unwatch cookie 94203978852688] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5740aaa00 con 0x55ad92b1ef90 2024-05-09T09:47:39.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.303+0000 7ff58d524980 20 remove_watcher() i=2 2024-05-09T09:47:39.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.303+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:116 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94203978865376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b24210 con 0x7ff5740e0040 2024-05-09T09:47:39.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.303+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.2 v2:172.21.15.157:6800/354455204 24 ==== osd_op_reply(116 notify.3 [watch unwatch cookie 94203978865376] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff584036040 con 0x7ff5740e0040 2024-05-09T09:47:39.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.303+0000 7ff58d524980 20 remove_watcher() i=3 2024-05-09T09:47:39.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.303+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:117 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94203978863872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b24210 con 0x55ad92b15d50 2024-05-09T09:47:39.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.307+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 <== osd.1 v2:172.21.15.157:6808/3930131338 36 ==== osd_op_reply(117 notify.4 [watch unwatch cookie 94203978863872] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff584036040 con 0x55ad92b15d50 2024-05-09T09:47:39.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.307+0000 7ff58d524980 20 remove_watcher() i=4 2024-05-09T09:47:39.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.307+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:118 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94203978872048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b25500 con 0x55ad92b1a4c0 2024-05-09T09:47:39.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.307+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(118 notify.5 [watch unwatch cookie 94203978872048] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.307+0000 7ff58d524980 20 remove_watcher() i=5 2024-05-09T09:47:39.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.307+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:119 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94203978874176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b24210 con 0x55ad92b1a4c0 2024-05-09T09:47:39.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.311+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(119 notify.6 [watch unwatch cookie 94203978874176] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.311+0000 7ff58d524980 20 remove_watcher() i=6 2024-05-09T09:47:39.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.311+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:120 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94203978877728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ad92b25500 con 0x55ad92b1a4c0 2024-05-09T09:47:39.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.311+0000 7ff58b03f640 1 -- 172.21.15.157:0/3305590953 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(120 notify.7 [watch unwatch cookie 94203978877728] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57c071070 con 0x55ad92b1a4c0 2024-05-09T09:47:39.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.311+0000 7ff58d524980 20 remove_watcher() i=7 2024-05-09T09:47:39.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.311+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ad92b1a4c0 msgr2=0x55ad92b1c8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.311+0000 7ff58d524980 1 --2- 172.21.15.157:0/3305590953 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ad92b1a4c0 0x55ad92b1c8b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.311+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ad92b15d50 msgr2=0x55ad92b181f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.311+0000 7ff58d524980 1 --2- 172.21.15.157:0/3305590953 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ad92b15d50 0x55ad92b181f0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.311+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7ff5740e0040 msgr2=0x7ff5740e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.311+0000 7ff58d524980 1 --2- 172.21.15.157:0/3305590953 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7ff5740e0040 0x7ff5740e0420 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.311+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ad92b1ef90 msgr2=0x55ad92b21430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.311+0000 7ff58d524980 1 --2- 172.21.15.157:0/3305590953 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ad92b1ef90 0x55ad92b21430 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.311+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff454034c00 msgr2=0x7ff4540370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.311+0000 7ff58d524980 1 --2- 172.21.15.157:0/3305590953 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff454034c00 0x7ff4540370c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff57401b380 tx=0x7ff5740c1040 comp rx=0 tx=0).stop 2024-05-09T09:47:39.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.311+0000 7ff58b840640 1 -- 172.21.15.157:0/3305590953 reap_dead start 2024-05-09T09:47:39.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.311+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad92b02160 msgr2=0x55ad92b09420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.311+0000 7ff58d524980 1 --2- 172.21.15.157:0/3305590953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad92b02160 0x55ad92b09420 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff57c006790 tx=0x7ff57c049240 comp rx=0 tx=0).stop 2024-05-09T09:47:39.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.311+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 shutdown_connections 2024-05-09T09:47:39.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.311+0000 7ff58d524980 1 --2- 172.21.15.157:0/3305590953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad92b02160 0x55ad92b09420 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.311+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 >> 172.21.15.157:0/3305590953 conn(0x55ad92afe4e0 msgr2=0x55ad92afc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:39.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.311+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 shutdown_connections 2024-05-09T09:47:39.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.311+0000 7ff58d524980 1 -- 172.21.15.157:0/3305590953 wait complete. 2024-05-09T09:47:39.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.315+0000 7ff58d524980 1 -- 172.21.15.157:0/3486742468 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff464034c00 msgr2=0x7ff4640370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.315+0000 7ff58d524980 1 --2- 172.21.15.157:0/3486742468 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff464034c00 0x7ff4640370c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55ad92ac6e70 tx=0x7ff574005ad0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.315+0000 7ff58d524980 1 -- 172.21.15.157:0/3486742468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad92af51a0 msgr2=0x55ad92af55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.315+0000 7ff58d524980 1 --2- 172.21.15.157:0/3486742468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad92af51a0 0x55ad92af55c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff57c014fd0 tx=0x7ff57c010520 comp rx=0 tx=0).stop 2024-05-09T09:47:39.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.315+0000 7ff58d524980 1 -- 172.21.15.157:0/3486742468 shutdown_connections 2024-05-09T09:47:39.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.315+0000 7ff58d524980 1 --2- 172.21.15.157:0/3486742468 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff464034c00 0x7ff4640370c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.315+0000 7ff58d524980 1 --2- 172.21.15.157:0/3486742468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad92af51a0 0x55ad92af55c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.315+0000 7ff58d524980 1 -- 172.21.15.157:0/3486742468 >> 172.21.15.157:0/3486742468 conn(0x55ad92ae9f70 msgr2=0x55ad92aeaa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:39.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.315+0000 7ff58d524980 1 -- 172.21.15.157:0/3486742468 shutdown_connections 2024-05-09T09:47:39.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.315+0000 7ff58d524980 1 -- 172.21.15.157:0/3486742468 wait complete. 2024-05-09T09:47:39.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.315+0000 7ff58d524980 1 -- 172.21.15.157:0/1462827803 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ad92ac88c0 msgr2=0x55ad92acacb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.315+0000 7ff58d524980 1 --2- 172.21.15.157:0/1462827803 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ad92ac88c0 0x55ad92acacb0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.315+0000 7ff58d524980 1 -- 172.21.15.157:0/1462827803 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ad929cdd70 msgr2=0x55ad92ac5f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.315+0000 7ff58d524980 1 --2- 172.21.15.157:0/1462827803 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ad929cdd70 0x55ad92ac5f20 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.315+0000 7ff58d524980 1 -- 172.21.15.157:0/1462827803 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ad92acc7e0 msgr2=0x55ad92acebd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.315+0000 7ff58d524980 1 --2- 172.21.15.157:0/1462827803 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ad92acc7e0 0x55ad92acebd0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.315+0000 7ff58d524980 1 -- 172.21.15.157:0/1462827803 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff470034c00 msgr2=0x7ff4700370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.315+0000 7ff58d524980 1 --2- 172.21.15.157:0/1462827803 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff470034c00 0x7ff4700370c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff5740ae000 tx=0x7ff5740a6000 comp rx=0 tx=0).stop 2024-05-09T09:47:39.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.315+0000 7ff58d524980 1 -- 172.21.15.157:0/1462827803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad929c9810 msgr2=0x55ad92abefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.315+0000 7ff58d524980 1 --2- 172.21.15.157:0/1462827803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ad929c9810 0x55ad92abefa0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff57c006640 tx=0x7ff57c000f50 comp rx=0 tx=0).stop 2024-05-09T09:47:39.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.315+0000 7ff58b840640 1 -- 172.21.15.157:0/1462827803 reap_dead start 2024-05-09T09:47:39.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.315+0000 7ff58d524980 1 -- 172.21.15.157:0/1462827803 shutdown_connections 2024-05-09T09:47:39.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.315+0000 7ff58d524980 1 -- 172.21.15.157:0/1462827803 >> 172.21.15.157:0/1462827803 conn(0x55ad929c50e0 msgr2=0x55ad929d1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:39.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.315+0000 7ff58d524980 1 -- 172.21.15.157:0/1462827803 shutdown_connections 2024-05-09T09:47:39.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.315+0000 7ff58d524980 1 -- 172.21.15.157:0/1462827803 wait complete. 2024-05-09T09:47:39.326 INFO:teuthology.orchestra.run.smithi157.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-05-09T09:47:39.293760Z","last_stats_update":"2024-05-09T09:47:39.291353Z"} 2024-05-09T09:47:39.326 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-05-09T09:47:39.293760Z', 'last_stats_update': '2024-05-09T09:47:39.291353Z'} 2024-05-09T09:47:39.333 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-09T09:47:39.333 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-05-09T09:47:39.333 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-05-09T09:47:39.334 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-05-09T09:47:39.401 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:39.402 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:39.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.403+0000 7f87e3f34980 1 Processor -- start 2024-05-09T09:47:39.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.403+0000 7f87e3f34980 1 -- start start 2024-05-09T09:47:39.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.403+0000 7f87e3f34980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5573ac79f2c0 0x5573ac82d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.403+0000 7f87e3f34980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5573ac6e0440 con 0x5573ac82db80 2024-05-09T09:47:39.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.403+0000 7f87e3f34980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5573ac6cb5f0 con 0x5573ac79f2c0 2024-05-09T09:47:39.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.403+0000 7f87e1a4f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5573ac79f2c0 0x5573ac82d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.403+0000 7f87e1a4f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5573ac79f2c0 0x5573ac82d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58858/0 (socket says 172.21.15.157:58858) 2024-05-09T09:47:39.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.403+0000 7f87e1a4f640 1 -- 172.21.15.157:0/265503131 learned_addr learned my addr 172.21.15.157:0/265503131 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:39.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.403+0000 7f87e124e640 1 --1- 172.21.15.157:0/265503131 >> v1:172.21.15.110:6789/0 conn(0x5573ac82db80 0x5573ac82ff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:51678/0 (socket says 172.21.15.157:51678) 2024-05-09T09:47:39.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.407+0000 7f87e1a4f640 1 -- 172.21.15.157:0/265503131 >> v1:172.21.15.110:6789/0 conn(0x5573ac82db80 legacy=0x5573ac82ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.407+0000 7f87e1a4f640 1 -- 172.21.15.157:0/265503131 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573ac6d6990 con 0x5573ac79f2c0 2024-05-09T09:47:39.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.407+0000 7f87e1a4f640 1 --2- 172.21.15.157:0/265503131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac79f2c0 0x5573ac82d640 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f87d400a5c0 tx=0x7f87d401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1273f344ab2e595 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.407+0000 7f87e0a4d640 1 -- 172.21.15.157:0/265503131 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87d40a6070 con 0x5573ac79f2c0 2024-05-09T09:47:39.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.407+0000 7f87e0a4d640 1 -- 172.21.15.157:0/265503131 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87d40af070 con 0x5573ac79f2c0 2024-05-09T09:47:39.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.407+0000 7f87e0a4d640 1 -- 172.21.15.157:0/265503131 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87d40aa5c0 con 0x5573ac79f2c0 2024-05-09T09:47:39.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.407+0000 7f87e3f34980 1 -- 172.21.15.157:0/265503131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac79f2c0 msgr2=0x5573ac82d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.407+0000 7f87e3f34980 1 --2- 172.21.15.157:0/265503131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac79f2c0 0x5573ac82d640 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f87d400a5c0 tx=0x7f87d401b340 comp rx=0 tx=0).stop 2024-05-09T09:47:39.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.407+0000 7f87e3f34980 1 -- 172.21.15.157:0/265503131 shutdown_connections 2024-05-09T09:47:39.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.407+0000 7f87e3f34980 1 --2- 172.21.15.157:0/265503131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac79f2c0 0x5573ac82d640 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.407+0000 7f87e3f34980 1 -- 172.21.15.157:0/265503131 >> 172.21.15.157:0/265503131 conn(0x5573ac825120 msgr2=0x5573ac827540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:39.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.407+0000 7f87e3f34980 1 -- 172.21.15.157:0/265503131 shutdown_connections 2024-05-09T09:47:39.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.407+0000 7f87e3f34980 1 -- 172.21.15.157:0/265503131 wait complete. 2024-05-09T09:47:39.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.423+0000 7f87e3f34980 1 Processor -- start 2024-05-09T09:47:39.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.423+0000 7f87e3f34980 1 -- start start 2024-05-09T09:47:39.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.423+0000 7f87e3f34980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac79f2c0 0x5573ac915b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.423+0000 7f87e3f34980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5573ac72dfe0 con 0x5573ac79f2c0 2024-05-09T09:47:39.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.423+0000 7f87e1a4f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac79f2c0 0x5573ac915b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.427+0000 7f87e1a4f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac79f2c0 0x5573ac915b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58862/0 (socket says 172.21.15.157:58862) 2024-05-09T09:47:39.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.427+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2287109826 learned_addr learned my addr 172.21.15.157:0/2287109826 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:39.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.427+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2287109826 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573ac6b2ae0 con 0x5573ac79f2c0 2024-05-09T09:47:39.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.427+0000 7f87e1a4f640 1 --2- 172.21.15.157:0/2287109826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac79f2c0 0x5573ac915b80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f87d40ac040 tx=0x7f87d4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f79311f3d46b11 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.427+0000 7f86cfe07640 1 -- 172.21.15.157:0/2287109826 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87d40aa970 con 0x5573ac79f2c0 2024-05-09T09:47:39.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.427+0000 7f86cfe07640 1 -- 172.21.15.157:0/2287109826 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87d40aab10 con 0x5573ac79f2c0 2024-05-09T09:47:39.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.427+0000 7f86cfe07640 1 -- 172.21.15.157:0/2287109826 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87d40aae30 con 0x5573ac79f2c0 2024-05-09T09:47:39.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.427+0000 7f87e3f34980 1 -- 172.21.15.157:0/2287109826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac79f2c0 msgr2=0x5573ac915b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.427+0000 7f87e3f34980 1 --2- 172.21.15.157:0/2287109826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac79f2c0 0x5573ac915b80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f87d40ac040 tx=0x7f87d4003030 comp rx=0 tx=0).stop 2024-05-09T09:47:39.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.427+0000 7f87e3f34980 1 -- 172.21.15.157:0/2287109826 shutdown_connections 2024-05-09T09:47:39.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.427+0000 7f87e3f34980 1 --2- 172.21.15.157:0/2287109826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac79f2c0 0x5573ac915b80 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.427+0000 7f87e3f34980 1 -- 172.21.15.157:0/2287109826 >> 172.21.15.157:0/2287109826 conn(0x5573ac825120 msgr2=0x5573ac911710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:39.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.427+0000 7f87e3f34980 1 -- 172.21.15.157:0/2287109826 shutdown_connections 2024-05-09T09:47:39.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.427+0000 7f87e3f34980 1 -- 172.21.15.157:0/2287109826 wait complete. 2024-05-09T09:47:39.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.427+0000 7f87e3f34980 1 Processor -- start 2024-05-09T09:47:39.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.427+0000 7f87e3f34980 1 -- start start 2024-05-09T09:47:39.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.427+0000 7f87e3f34980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac79f2c0 0x5573ac91a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.427+0000 7f87e3f34980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5573ac8321a0 con 0x5573ac79f2c0 2024-05-09T09:47:39.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.427+0000 7f87e1a4f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac79f2c0 0x5573ac91a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.427+0000 7f87e1a4f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac79f2c0 0x5573ac91a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58876/0 (socket says 172.21.15.157:58876) 2024-05-09T09:47:39.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.427+0000 7f87e1a4f640 1 -- 172.21.15.157:0/3084912770 learned_addr learned my addr 172.21.15.157:0/3084912770 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:39.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.427+0000 7f87e1a4f640 1 -- 172.21.15.157:0/3084912770 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573ac91aef0 con 0x5573ac79f2c0 2024-05-09T09:47:39.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.427+0000 7f87e1a4f640 1 --2- 172.21.15.157:0/3084912770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac79f2c0 0x5573ac91a9b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f87d4003070 tx=0x7f87d40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.431+0000 7f86ce604640 1 -- 172.21.15.157:0/3084912770 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87d40c6710 con 0x5573ac79f2c0 2024-05-09T09:47:39.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.431+0000 7f87e3f34980 1 -- 172.21.15.157:0/3084912770 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573ac91b180 con 0x5573ac79f2c0 2024-05-09T09:47:39.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.431+0000 7f86ce604640 1 -- 172.21.15.157:0/3084912770 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87d40c68b0 con 0x5573ac79f2c0 2024-05-09T09:47:39.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.431+0000 7f86ce604640 1 -- 172.21.15.157:0/3084912770 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87d40c6b90 con 0x5573ac79f2c0 2024-05-09T09:47:39.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.431+0000 7f87e3f34980 1 -- 172.21.15.157:0/3084912770 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573ac91ddc0 con 0x5573ac79f2c0 2024-05-09T09:47:39.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.431+0000 7f86ce604640 1 -- 172.21.15.157:0/3084912770 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f87d40d0400 con 0x5573ac79f2c0 2024-05-09T09:47:39.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.431+0000 7f86ce604640 1 --2- 172.21.15.157:0/3084912770 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f86c8039010 0x7f86c803b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.431+0000 7f86ce604640 1 -- 172.21.15.157:0/3084912770 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f87d40e61d0 con 0x5573ac79f2c0 2024-05-09T09:47:39.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.431+0000 7f87e124e640 1 --2- 172.21.15.157:0/3084912770 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f86c8039010 0x7f86c803b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.431+0000 7f87e3f34980 1 --2- 172.21.15.157:0/3084912770 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5573ac82db80 0x5573ac9218a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.431+0000 7f87e3f34980 1 -- 172.21.15.157:0/3084912770 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ac921f10 con 0x5573ac82db80 2024-05-09T09:47:39.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.431+0000 7f87e2250640 1 --2- 172.21.15.157:0/3084912770 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5573ac82db80 0x5573ac9218a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.431+0000 7f87e124e640 1 --2- 172.21.15.157:0/3084912770 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f86c8039010 0x7f86c803b4d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f87d8001e50 tx=0x7f87d80013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.431+0000 7f87e2250640 1 --2- 172.21.15.157:0/3084912770 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5573ac82db80 0x5573ac9218a0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.431+0000 7f87e2250640 1 -- 172.21.15.157:0/3084912770 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac82db80 2024-05-09T09:47:39.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.431+0000 7f87e3f34980 1 -- 172.21.15.157:0/3084912770 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ac922800 con 0x5573ac82db80 2024-05-09T09:47:39.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.431+0000 7f87e2250640 1 -- 172.21.15.157:0/3084912770 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac82db80 2024-05-09T09:47:39.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.431+0000 7f87e3f34980 1 --2- 172.21.15.157:0/3084912770 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5573ac924110 0x5573ac9265d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.431+0000 7f87e3f34980 1 -- 172.21.15.157:0/3084912770 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ac926d60 con 0x5573ac924110 2024-05-09T09:47:39.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.435+0000 7f87e1a4f640 1 --2- 172.21.15.157:0/3084912770 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5573ac924110 0x5573ac9265d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.435+0000 7f87e1a4f640 1 --2- 172.21.15.157:0/3084912770 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5573ac924110 0x5573ac9265d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.435+0000 7f87e1a4f640 1 -- 172.21.15.157:0/3084912770 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f87d40cd020 con 0x5573ac924110 2024-05-09T09:47:39.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.435+0000 7f87e3f34980 1 -- 172.21.15.157:0/3084912770 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ac923050 con 0x5573ac82db80 2024-05-09T09:47:39.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.435+0000 7f87e2250640 1 -- 172.21.15.157:0/3084912770 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac82db80 2024-05-09T09:47:39.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.435+0000 7f87e3f34980 1 --2- 172.21.15.157:0/3084912770 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5573ac9281c0 0x5573ac92a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.435+0000 7f87e3f34980 1 -- 172.21.15.157:0/3084912770 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ac92aca0 con 0x5573ac9281c0 2024-05-09T09:47:39.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.435+0000 7f87e124e640 1 --2- 172.21.15.157:0/3084912770 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5573ac9281c0 0x5573ac92a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.435+0000 7f87e124e640 1 --2- 172.21.15.157:0/3084912770 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5573ac9281c0 0x5573ac92a5b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.435+0000 7f87e124e640 1 -- 172.21.15.157:0/3084912770 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f87d800f700 con 0x5573ac9281c0 2024-05-09T09:47:39.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.439+0000 7f87e3f34980 1 Processor -- start 2024-05-09T09:47:39.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.439+0000 7f87e3f34980 1 -- start start 2024-05-09T09:47:39.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.439+0000 7f87e3f34980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac950b90 0x5573ac950fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.439+0000 7f87e3f34980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5573ac732020 con 0x5573ac950b90 2024-05-09T09:47:39.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.443+0000 7f87e1a4f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac950b90 0x5573ac950fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.443+0000 7f87e1a4f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac950b90 0x5573ac950fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58890/0 (socket says 172.21.15.157:58890) 2024-05-09T09:47:39.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.443+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2641802563 learned_addr learned my addr 172.21.15.157:0/2641802563 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:39.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.443+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2641802563 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573ac9514f0 con 0x5573ac950b90 2024-05-09T09:47:39.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.443+0000 7f87e1a4f640 1 --2- 172.21.15.157:0/2641802563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac950b90 0x5573ac950fb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f87d40c6fd0 tx=0x7f87d40c5e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.443+0000 7f86c63a1640 1 -- 172.21.15.157:0/2641802563 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87d40d0ac0 con 0x5573ac950b90 2024-05-09T09:47:39.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.443+0000 7f86c63a1640 1 -- 172.21.15.157:0/2641802563 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87d40ab960 con 0x5573ac950b90 2024-05-09T09:47:39.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.443+0000 7f86c63a1640 1 -- 172.21.15.157:0/2641802563 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87d40d0c60 con 0x5573ac950b90 2024-05-09T09:47:39.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.443+0000 7f87e3f34980 1 -- 172.21.15.157:0/2641802563 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573ac951f80 con 0x5573ac950b90 2024-05-09T09:47:39.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.443+0000 7f87e3f34980 1 -- 172.21.15.157:0/2641802563 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573ac951f80 con 0x5573ac950b90 2024-05-09T09:47:39.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.443+0000 7f86c63a1640 1 -- 172.21.15.157:0/2641802563 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f87d40c53a0 con 0x5573ac950b90 2024-05-09T09:47:39.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.443+0000 7f86c63a1640 1 --2- 172.21.15.157:0/2641802563 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f86bc034bb0 0x7f86bc037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.443+0000 7f86c63a1640 1 -- 172.21.15.157:0/2641802563 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f87d40efc50 con 0x5573ac950b90 2024-05-09T09:47:39.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.443+0000 7f87e124e640 1 --2- 172.21.15.157:0/2641802563 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f86bc034bb0 0x7f86bc037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.443+0000 7f87e3f34980 1 Processor -- start 2024-05-09T09:47:39.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.443+0000 7f87e3f34980 1 -- start start 2024-05-09T09:47:39.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.447+0000 7f87e3f34980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac95d9a0 0x5573ac95dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.447+0000 7f87e3f34980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5573ac9161e0 con 0x5573ac95d9a0 2024-05-09T09:47:39.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.447+0000 7f87e124e640 1 --2- 172.21.15.157:0/2641802563 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f86bc034bb0 0x7f86bc037070 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x5573ac91f020 tx=0x7f87d800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.447+0000 7f87e1a4f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac95d9a0 0x5573ac95dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.447+0000 7f87e1a4f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac95d9a0 0x5573ac95dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58896/0 (socket says 172.21.15.157:58896) 2024-05-09T09:47:39.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.447+0000 7f87e1a4f640 1 -- 172.21.15.157:0/1029978315 learned_addr learned my addr 172.21.15.157:0/1029978315 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:39.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.447+0000 7f87e1a4f640 1 -- 172.21.15.157:0/1029978315 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573ac95e350 con 0x5573ac95d9a0 2024-05-09T09:47:39.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.447+0000 7f87e1a4f640 1 --2- 172.21.15.157:0/1029978315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac95d9a0 0x5573ac95dd80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f87d4009e20 tx=0x7f87d40d09f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3163bff25239999 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.447+0000 7f86b3fff640 1 -- 172.21.15.157:0/1029978315 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87d40f3030 con 0x5573ac95d9a0 2024-05-09T09:47:39.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.447+0000 7f86b3fff640 1 -- 172.21.15.157:0/1029978315 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87d40a4ce0 con 0x5573ac95d9a0 2024-05-09T09:47:39.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.447+0000 7f86b3fff640 1 -- 172.21.15.157:0/1029978315 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87d4009420 con 0x5573ac95d9a0 2024-05-09T09:47:39.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.447+0000 7f87e3f34980 1 -- 172.21.15.157:0/1029978315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac95d9a0 msgr2=0x5573ac95dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.447+0000 7f87e3f34980 1 --2- 172.21.15.157:0/1029978315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac95d9a0 0x5573ac95dd80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f87d4009e20 tx=0x7f87d40d09f0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.447+0000 7f87e3f34980 1 -- 172.21.15.157:0/1029978315 shutdown_connections 2024-05-09T09:47:39.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.447+0000 7f87e3f34980 1 --2- 172.21.15.157:0/1029978315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac95d9a0 0x5573ac95dd80 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.447+0000 7f87e3f34980 1 -- 172.21.15.157:0/1029978315 >> 172.21.15.157:0/1029978315 conn(0x5573ac959d20 msgr2=0x5573ac957d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:39.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.447+0000 7f87e3f34980 1 -- 172.21.15.157:0/1029978315 shutdown_connections 2024-05-09T09:47:39.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.447+0000 7f87e3f34980 1 -- 172.21.15.157:0/1029978315 wait complete. 2024-05-09T09:47:39.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.447+0000 7f87e3f34980 1 Processor -- start 2024-05-09T09:47:39.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.447+0000 7f87e3f34980 1 -- start start 2024-05-09T09:47:39.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.447+0000 7f87e3f34980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac95d9a0 0x5573ac964d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.447+0000 7f87e3f34980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5573ac95ea60 con 0x5573ac95d9a0 2024-05-09T09:47:39.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.447+0000 7f87e1a4f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac95d9a0 0x5573ac964d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.447+0000 7f87e1a4f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac95d9a0 0x5573ac964d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58908/0 (socket says 172.21.15.157:58908) 2024-05-09T09:47:39.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.447+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 learned_addr learned my addr 172.21.15.157:0/2631510558 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:39.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.447+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573ac9652c0 con 0x5573ac95d9a0 2024-05-09T09:47:39.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f87e1a4f640 1 --2- 172.21.15.157:0/2631510558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac95d9a0 0x5573ac964d80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f87d4009920 tx=0x7f87d40c9f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f86b27fc640 1 -- 172.21.15.157:0/2631510558 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87d4112070 con 0x5573ac95d9a0 2024-05-09T09:47:39.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573ac9652c0 con 0x5573ac95d9a0 2024-05-09T09:47:39.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f86b27fc640 1 -- 172.21.15.157:0/2631510558 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87d40d44e0 con 0x5573ac95d9a0 2024-05-09T09:47:39.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f86b27fc640 1 -- 172.21.15.157:0/2631510558 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87d40b3bc0 con 0x5573ac95d9a0 2024-05-09T09:47:39.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573ac965740 con 0x5573ac95d9a0 2024-05-09T09:47:39.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f86b27fc640 1 -- 172.21.15.157:0/2631510558 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f87d4115070 con 0x5573ac95d9a0 2024-05-09T09:47:39.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f86b27fc640 1 --2- 172.21.15.157:0/2631510558 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f86ac034bb0 0x7f86ac037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f86b27fc640 1 -- 172.21.15.157:0/2631510558 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f87d410a070 con 0x5573ac95d9a0 2024-05-09T09:47:39.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f87e124e640 1 --2- 172.21.15.157:0/2631510558 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f86ac034bb0 0x7f86ac037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f87e3f34980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f87e3f34980 1 --2- 172.21.15.157:0/2631510558 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5573ac9716c0 0x5573ac973b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ac9742d0 con 0x5573ac9716c0 2024-05-09T09:47:39.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f87e2250640 1 --2- 172.21.15.157:0/2631510558 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5573ac9716c0 0x5573ac973b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f87e124e640 1 --2- 172.21.15.157:0/2631510558 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f86ac034bb0 0x7f86ac037070 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x5573ac92b0a0 tx=0x7f87d8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f87e2250640 1 --2- 172.21.15.157:0/2631510558 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5573ac9716c0 0x5573ac973b80 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f87e3f34980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:39.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f87e3f34980 20 realm 2024-05-09T09:47:39.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f87e3f34980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ac9746e0 con 0x5573ac9716c0 2024-05-09T09:47:39.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f87e3f34980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:39.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f87e3f34980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:39.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f87e3f34980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ac974fb0 con 0x5573ac9716c0 2024-05-09T09:47:39.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f87e3f34980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:39.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f87e3f34980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.451+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x5573ac9716c0 2024-05-09T09:47:39.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.455+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.455+0000 7f87e3f34980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:39.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.455+0000 7f87e3f34980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.455+0000 7f87e3f34980 1 --2- 172.21.15.157:0/2631510558 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5573ac9760b0 0x5573ac9784a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.455+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ac978ab0 con 0x5573ac9760b0 2024-05-09T09:47:39.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.455+0000 7f87e1a4f640 1 --2- 172.21.15.157:0/2631510558 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5573ac9760b0 0x5573ac9784a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.455+0000 7f87e1a4f640 1 --2- 172.21.15.157:0/2631510558 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5573ac9760b0 0x5573ac9784a0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.455+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f87d4114030 con 0x5573ac9760b0 2024-05-09T09:47:39.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.455+0000 7f87e3f34980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:39.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.455+0000 7f87e3f34980 20 searching for the correct realm 2024-05-09T09:47:39.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.455+0000 7f87e3f34980 1 --2- 172.21.15.157:0/2631510558 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5573ac97aa00 0x5573ac97ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.455+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac97d4b0 con 0x5573ac97aa00 2024-05-09T09:47:39.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.455+0000 7f87e124e640 1 --2- 172.21.15.157:0/2631510558 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5573ac97aa00 0x5573ac97ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.455+0000 7f87e124e640 1 --2- 172.21.15.157:0/2631510558 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5573ac97aa00 0x5573ac97ce30 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.459+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d8037040 con 0x5573ac97aa00 2024-05-09T09:47:39.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.459+0000 7f87e124e640 1 --2- 172.21.15.157:0/2631510558 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f87d801fbe0 0x7f87d803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.459+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac97d4b0 con 0x7f87d801fbe0 2024-05-09T09:47:39.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.459+0000 7f87e2250640 1 --2- 172.21.15.157:0/2631510558 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f87d801fbe0 0x7f87d803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.459+0000 7f87e2250640 1 --2- 172.21.15.157:0/2631510558 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f87d801fbe0 0x7f87d803a3c0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.459+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87dc00a4d0 con 0x7f87d801fbe0 2024-05-09T09:47:39.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.459+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x5573ac9760b0 2024-05-09T09:47:39.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.459+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d4114030 con 0x5573ac9760b0 2024-05-09T09:47:39.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.459+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x5573ac9716c0 2024-05-09T09:47:39.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.459+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.459+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x5573ac9716c0 2024-05-09T09:47:39.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.459+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.459+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x5573ac9760b0 2024-05-09T09:47:39.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.459+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d4114030 con 0x5573ac9760b0 2024-05-09T09:47:39.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.459+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x5573ac9760b0 2024-05-09T09:47:39.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.463+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d4114030 con 0x5573ac9760b0 2024-05-09T09:47:39.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.463+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x7f87d801fbe0 2024-05-09T09:47:39.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.463+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87dc00a4d0 con 0x7f87d801fbe0 2024-05-09T09:47:39.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.463+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x5573ac97aa00 2024-05-09T09:47:39.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.463+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d8037040 con 0x5573ac97aa00 2024-05-09T09:47:39.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.463+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x5573ac9716c0 2024-05-09T09:47:39.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.463+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.463+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x5573ac9760b0 2024-05-09T09:47:39.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.463+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d4114030 con 0x5573ac9760b0 2024-05-09T09:47:39.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.463+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x5573ac9716c0 2024-05-09T09:47:39.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.463+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.463+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x7f87d801fbe0 2024-05-09T09:47:39.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.463+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f87dc00a4d0 con 0x7f87d801fbe0 2024-05-09T09:47:39.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.463+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x5573ac97aa00 2024-05-09T09:47:39.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.463+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d8037040 con 0x5573ac97aa00 2024-05-09T09:47:39.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.463+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x5573ac97aa00 2024-05-09T09:47:39.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.463+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f87d8037040 con 0x5573ac97aa00 2024-05-09T09:47:39.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.463+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x5573ac9760b0 2024-05-09T09:47:39.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.463+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d4114030 con 0x5573ac9760b0 2024-05-09T09:47:39.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.463+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x5573ac97aa00 2024-05-09T09:47:39.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.467+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d8037040 con 0x5573ac97aa00 2024-05-09T09:47:39.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.467+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x5573ac97aa00 2024-05-09T09:47:39.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.467+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d8037040 con 0x5573ac97aa00 2024-05-09T09:47:39.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.467+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x5573ac9716c0 2024-05-09T09:47:39.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.467+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.467+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x5573ac9716c0 2024-05-09T09:47:39.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.467+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.467+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x5573ac9760b0 2024-05-09T09:47:39.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.467+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d4114030 con 0x5573ac9760b0 2024-05-09T09:47:39.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.467+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x5573ac97aa00 2024-05-09T09:47:39.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.467+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d8037040 con 0x5573ac97aa00 2024-05-09T09:47:39.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.467+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x7f87d801fbe0 2024-05-09T09:47:39.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.467+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87dc00a4d0 con 0x7f87d801fbe0 2024-05-09T09:47:39.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.467+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x5573ac9716c0 2024-05-09T09:47:39.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.467+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.467+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x5573ac9760b0 2024-05-09T09:47:39.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.467+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f87d4114030 con 0x5573ac9760b0 2024-05-09T09:47:39.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.467+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x5573ac97aa00 2024-05-09T09:47:39.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.467+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d8037040 con 0x5573ac97aa00 2024-05-09T09:47:39.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.467+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x5573ac9760b0 2024-05-09T09:47:39.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d4114030 con 0x5573ac9760b0 2024-05-09T09:47:39.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x7f87d801fbe0 2024-05-09T09:47:39.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87dc00a4d0 con 0x7f87d801fbe0 2024-05-09T09:47:39.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x5573ac97aa00 2024-05-09T09:47:39.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d8049040 con 0x5573ac97aa00 2024-05-09T09:47:39.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x5573ac9760b0 2024-05-09T09:47:39.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d4114030 con 0x5573ac9760b0 2024-05-09T09:47:39.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x5573ac9716c0 2024-05-09T09:47:39.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ac975350 con 0x7f87d801fbe0 2024-05-09T09:47:39.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87dc00a4d0 con 0x7f87d801fbe0 2024-05-09T09:47:39.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e3f34980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:39.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e3f34980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:39.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e3f34980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:39.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e3f34980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:39.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e3f34980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:39.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e3f34980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:39.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e3f34980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ac979370 con 0x5573ac9716c0 2024-05-09T09:47:39.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e3f34980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:39.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e3f34980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ac979370 con 0x5573ac9716c0 2024-05-09T09:47:39.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e3f34980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:39.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e3f34980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ac979370 con 0x5573ac97aa00 2024-05-09T09:47:39.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f87d8049040 con 0x5573ac97aa00 2024-05-09T09:47:39.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e3f34980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:39.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e3f34980 20 zone default found 2024-05-09T09:47:39.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e3f34980 4 Realm: () 2024-05-09T09:47:39.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e3f34980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:39.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e3f34980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:39.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e3f34980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:39.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e3f34980 20 zonegroup default 2024-05-09T09:47:39.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e3f34980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.471+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ac979d00 con 0x5573ac9760b0 2024-05-09T09:47:39.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.475+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f87d4114030 con 0x5573ac9760b0 2024-05-09T09:47:39.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.475+0000 7f87e3f34980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:39.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.475+0000 7f87e3f34980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.475+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ac97f3a0 con 0x5573ac97aa00 2024-05-09T09:47:39.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.475+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f87d8049040 con 0x5573ac97aa00 2024-05-09T09:47:39.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.475+0000 7f87e3f34980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:39.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.475+0000 7f87e3f34980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.475+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ac97f890 con 0x5573ac97aa00 2024-05-09T09:47:39.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.475+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f87d8049040 con 0x5573ac97aa00 2024-05-09T09:47:39.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.475+0000 7f87e3f34980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:39.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.475+0000 7f87e3f34980 20 started sync module instance, tier type = 2024-05-09T09:47:39.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.475+0000 7f87e3f34980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:39.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.475+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac97e7b0 con 0x7f87d801fbe0 2024-05-09T09:47:39.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.475+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x7f87d801fbe0 2024-05-09T09:47:39.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.475+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93955305237712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac97e7b0 con 0x7f87d801fbe0 2024-05-09T09:47:39.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.475+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac980310 con 0x5573ac9716c0 2024-05-09T09:47:39.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.475+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93955305237712] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x7f87d801fbe0 2024-05-09T09:47:39.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.479+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.479+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93955305235200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac980310 con 0x5573ac9716c0 2024-05-09T09:47:39.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.479+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac980cd0 con 0x5573ac97aa00 2024-05-09T09:47:39.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.479+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87d8049040 con 0x5573ac97aa00 2024-05-09T09:47:39.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.479+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93955305244704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac981570 con 0x5573ac97aa00 2024-05-09T09:47:39.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.479+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac981fe0 con 0x7f87d801fbe0 2024-05-09T09:47:39.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.479+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93955305235200] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.483+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x7f87d801fbe0 2024-05-09T09:47:39.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.483+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93955305249456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac9823d0 con 0x7f87d801fbe0 2024-05-09T09:47:39.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.483+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac982d90 con 0x5573ac9716c0 2024-05-09T09:47:39.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.483+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93955305244704] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87d8049040 con 0x5573ac97aa00 2024-05-09T09:47:39.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.483+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93955305249456] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x7f87d801fbe0 2024-05-09T09:47:39.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.483+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.483+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93955305242208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac9828e0 con 0x5573ac9716c0 2024-05-09T09:47:39.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.483+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac983130 con 0x5573ac9760b0 2024-05-09T09:47:39.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.487+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87d4114030 con 0x5573ac9760b0 2024-05-09T09:47:39.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.487+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93955305253392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac983980 con 0x5573ac9760b0 2024-05-09T09:47:39.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.487+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac984340 con 0x5573ac9760b0 2024-05-09T09:47:39.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.487+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93955305242208] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.487+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93955305253392] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87d4114030 con 0x5573ac9760b0 2024-05-09T09:47:39.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.487+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87d4114030 con 0x5573ac9760b0 2024-05-09T09:47:39.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.487+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93955305258640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac9846e0 con 0x5573ac9760b0 2024-05-09T09:47:39.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.487+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac984f30 con 0x5573ac9760b0 2024-05-09T09:47:39.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.491+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87d4114030 con 0x5573ac9760b0 2024-05-09T09:47:39.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.491+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93955305261248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac985350 con 0x5573ac9760b0 2024-05-09T09:47:39.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.491+0000 7f87e3f34980 20 add_watcher() i=0 2024-05-09T09:47:39.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.491+0000 7f87e3f34980 20 add_watcher() i=1 2024-05-09T09:47:39.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.491+0000 7f87e3f34980 20 add_watcher() i=2 2024-05-09T09:47:39.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.491+0000 7f87e3f34980 20 add_watcher() i=3 2024-05-09T09:47:39.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.491+0000 7f87e3f34980 20 add_watcher() i=4 2024-05-09T09:47:39.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.491+0000 7f87e3f34980 20 add_watcher() i=5 2024-05-09T09:47:39.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.491+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93955305258640] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87d4114030 con 0x5573ac9760b0 2024-05-09T09:47:39.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.491+0000 7f87e3f34980 20 add_watcher() i=6 2024-05-09T09:47:39.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.491+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93955305261248] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87d4114030 con 0x5573ac9760b0 2024-05-09T09:47:39.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.491+0000 7f87e3f34980 20 add_watcher() i=7 2024-05-09T09:47:39.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.491+0000 7f87e3f34980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:39.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.491+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ac9810c0 con 0x5573ac9716c0 2024-05-09T09:47:39.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.491+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.491+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93955305246912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac985900 con 0x5573ac9716c0 2024-05-09T09:47:39.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.495+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93955305246912] v30'194 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.495+0000 7f86977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:39.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.495+0000 7f87e3f34980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:39.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.495+0000 7f87e3f34980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:39.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.495+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac990d30 con 0x5573ac9716c0 2024-05-09T09:47:39.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.495+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'50 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.495+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac991380 con 0x5573ac9760b0 2024-05-09T09:47:39.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.499+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'45 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f87d4114030 con 0x5573ac9760b0 2024-05-09T09:47:39.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.499+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac991380 con 0x5573ac97aa00 2024-05-09T09:47:39.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.499+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'44 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f87d8049040 con 0x5573ac97aa00 2024-05-09T09:47:39.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.499+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac991e60 con 0x5573ac9716c0 2024-05-09T09:47:39.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.503+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'195 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.503+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac98eb80 con 0x7f87d801fbe0 2024-05-09T09:47:39.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.503+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'122 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x7f87d801fbe0 2024-05-09T09:47:39.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.503+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac98eb80 con 0x5573ac97aa00 2024-05-09T09:47:39.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.503+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'82 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f87d8049040 con 0x5573ac97aa00 2024-05-09T09:47:39.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.503+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac992b90 con 0x5573ac9716c0 2024-05-09T09:47:39.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.507+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'46 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.507+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac992b90 con 0x5573ac9760b0 2024-05-09T09:47:39.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.511+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'81 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f87d4114030 con 0x5573ac9760b0 2024-05-09T09:47:39.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.511+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac992c20 con 0x7f87d801fbe0 2024-05-09T09:47:39.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.511+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'44 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x7f87d801fbe0 2024-05-09T09:47:39.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.511+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac992cb0 con 0x5573ac97aa00 2024-05-09T09:47:39.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.515+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'50 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f87d8049040 con 0x5573ac97aa00 2024-05-09T09:47:39.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.515+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac993160 con 0x7f87d801fbe0 2024-05-09T09:47:39.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.515+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'123 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x7f87d801fbe0 2024-05-09T09:47:39.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.515+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac993160 con 0x5573ac9760b0 2024-05-09T09:47:39.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.519+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'46 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87d4114030 con 0x5573ac9760b0 2024-05-09T09:47:39.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.519+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac993160 con 0x7f87d801fbe0 2024-05-09T09:47:39.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.519+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'44 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x7f87d801fbe0 2024-05-09T09:47:39.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.519+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac9930d0 con 0x5573ac9760b0 2024-05-09T09:47:39.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.523+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'87 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87d4114030 con 0x5573ac9760b0 2024-05-09T09:47:39.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.523+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac9930d0 con 0x5573ac9716c0 2024-05-09T09:47:39.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.523+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'196 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.523+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac9930d0 con 0x5573ac97aa00 2024-05-09T09:47:39.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.527+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'116 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87d8049040 con 0x5573ac97aa00 2024-05-09T09:47:39.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.527+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac993160 con 0x7f87d801fbe0 2024-05-09T09:47:39.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.527+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'124 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x7f87d801fbe0 2024-05-09T09:47:39.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.527+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac993160 con 0x5573ac97aa00 2024-05-09T09:47:39.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.527+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'44 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87d8049040 con 0x5573ac97aa00 2024-05-09T09:47:39.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.527+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac993210 con 0x5573ac9716c0 2024-05-09T09:47:39.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.531+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'52 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.531+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac993210 con 0x5573ac9716c0 2024-05-09T09:47:39.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.531+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'197 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.531+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac993210 con 0x5573ac97aa00 2024-05-09T09:47:39.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.535+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'117 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87d8049040 con 0x5573ac97aa00 2024-05-09T09:47:39.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.535+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac993210 con 0x7f87d801fbe0 2024-05-09T09:47:39.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.535+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'54 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x7f87d801fbe0 2024-05-09T09:47:39.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.535+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac993210 con 0x5573ac97aa00 2024-05-09T09:47:39.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.535+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'46 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87d8049040 con 0x5573ac97aa00 2024-05-09T09:47:39.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.535+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac993210 con 0x5573ac97aa00 2024-05-09T09:47:39.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.539+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'50 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87d8049040 con 0x5573ac97aa00 2024-05-09T09:47:39.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.539+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac993210 con 0x5573ac97aa00 2024-05-09T09:47:39.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.539+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'40 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87d8049040 con 0x5573ac97aa00 2024-05-09T09:47:39.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.539+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac993210 con 0x5573ac97aa00 2024-05-09T09:47:39.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.539+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'83 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87d8049040 con 0x5573ac97aa00 2024-05-09T09:47:39.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.539+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac993210 con 0x5573ac9760b0 2024-05-09T09:47:39.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.543+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'46 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87d4114030 con 0x5573ac9760b0 2024-05-09T09:47:39.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.543+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac993210 con 0x5573ac97aa00 2024-05-09T09:47:39.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.543+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'44 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87d8049040 con 0x5573ac97aa00 2024-05-09T09:47:39.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.543+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac993210 con 0x5573ac9760b0 2024-05-09T09:47:39.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.547+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'82 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87d4114030 con 0x5573ac9760b0 2024-05-09T09:47:39.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.547+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac993210 con 0x5573ac97aa00 2024-05-09T09:47:39.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.547+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'118 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87d8049040 con 0x5573ac97aa00 2024-05-09T09:47:39.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.547+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac993210 con 0x5573ac9760b0 2024-05-09T09:47:39.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.551+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'88 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87d4114030 con 0x5573ac9760b0 2024-05-09T09:47:39.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.551+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac993210 con 0x7f87d801fbe0 2024-05-09T09:47:39.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'50 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x7f87d801fbe0 2024-05-09T09:47:39.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f86967e4640 20 reqs_thread_entry: start 2024-05-09T09:47:39.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f87e3f34980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:39.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f868f7fe640 20 reqs_thread_entry: start 2024-05-09T09:47:39.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f87e3f34980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-09T09:47:39.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f87e3f34980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ac98d9f0 con 0x5573ac9716c0 2024-05-09T09:47:39.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f87e3f34980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:47:39.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f87e3f34980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-09T09:47:39.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f87e3f34980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:39.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f87e3f34980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:39.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f87e3f34980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-09T09:47:39.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f87e3f34980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:95 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ac98e0b0 con 0x7f87d801fbe0 2024-05-09T09:47:39.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(95 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f87dc00a4d0 con 0x7f87d801fbe0 2024-05-09T09:47:39.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f87e3f34980 20 rados_obj.operate() r=0 bl.length=165 2024-05-09T09:47:39.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f87e3f34980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-09T09:47:39.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f87e3f34980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-09T09:47:39.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f87e3f34980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 : miss 2024-05-09T09:47:39.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f87e3f34980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 8.5 8:a7233c95:root::.bucket.meta.myfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ac9b23e0 con 0x5573ac9716c0 2024-05-09T09:47:39.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(96 .bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f87e3f34980 20 rados_obj.operate() r=0 bl.length=379 2024-05-09T09:47:39.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f87e3f34980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 info.flags=0x17 2024-05-09T09:47:39.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f87e3f34980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 to cache LRU end 2024-05-09T09:47:39.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f87e3f34980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:39.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f87e3f34980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-09T09:47:39.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f87e3f34980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 2024-05-09T09:47:39.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f87e3f34980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-05-09T09:47:39.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.555+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:97 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac9b36e0 con 0x7f87d801fbe0 2024-05-09T09:47:39.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.559+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(97 foo.buckets [call] v30'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x7f87d801fbe0 2024-05-09T09:47:39.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.559+0000 7f87e3f34980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-05-09T09:47:39.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.559+0000 7f87e3f34980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.559+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:98 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ac9b3230 con 0x7f87d801fbe0 2024-05-09T09:47:39.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.559+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(98 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f87dc00a4d0 con 0x7f87d801fbe0 2024-05-09T09:47:39.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.559+0000 7f87e3f34980 20 rados_obj.operate() r=0 bl.length=165 2024-05-09T09:47:39.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.559+0000 7f87e3f34980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-05-09T09:47:39.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.559+0000 7f87e3f34980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-09T09:47:39.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.559+0000 7f87e3f34980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:39.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.559+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac9b96d0 con 0x7f87d801fbe0 2024-05-09T09:47:39.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.563+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(99 myfoo [delete,create,call,call,writefull 0~165] v30'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x7f87d801fbe0 2024-05-09T09:47:39.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.563+0000 7f87e3f34980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-05-09T09:47:39.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.563+0000 7f87e3f34980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-09T09:47:39.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.563+0000 7f87e3f34980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-09T09:47:39.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.563+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93955305460192 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ac9b6bc0 con 0x5573ac9760b0 2024-05-09T09:47:39.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.563+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== watch-notify(notify (1) cookie 93955305258640 notify 128849018882 ret 0) ==== 380+0+0 (crc 0 0 0) 0x5573ac98ea70 con 0x5573ac9760b0 2024-05-09T09:47:39.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.563+0000 7f86b3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 93955305258640 notifier 4489 bl.length()=338 2024-05-09T09:47:39.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.563+0000 7f86b3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-05-09T09:47:39.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.563+0000 7f86b3fff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-09T09:47:39.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.563+0000 7f86b3fff640 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f86a40056c0 con 0x5573ac9760b0 2024-05-09T09:47:39.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.563+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(100 notify.6 [notify cookie 93955305460192 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f87d4114030 con 0x5573ac9760b0 2024-05-09T09:47:39.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.563+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87d4114030 con 0x5573ac9760b0 2024-05-09T09:47:39.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.563+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== watch-notify(notify_complete (2) cookie 93955305460192 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5573ac91ddc0 con 0x5573ac9760b0 2024-05-09T09:47:39.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.567+0000 7f86977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:39.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.567+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93955305246912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac98cbb0 con 0x5573ac9716c0 2024-05-09T09:47:39.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.567+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(102 data_loggenerations_metadata [watch unwatch cookie 93955305246912] v30'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.567+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:103 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93955305237712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac98cbb0 con 0x7f87d801fbe0 2024-05-09T09:47:39.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.567+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(103 notify.0 [watch unwatch cookie 93955305237712] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x7f87d801fbe0 2024-05-09T09:47:39.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.567+0000 7f87e3f34980 20 remove_watcher() i=0 2024-05-09T09:47:39.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.567+0000 7f87e3f34980 2 removed watcher, disabling cache 2024-05-09T09:47:39.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.567+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:104 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93955305235200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac97ecd0 con 0x5573ac9716c0 2024-05-09T09:47:39.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.571+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(104 notify.1 [watch unwatch cookie 93955305235200] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.571+0000 7f87e3f34980 20 remove_watcher() i=1 2024-05-09T09:47:39.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.571+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:105 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93955305244704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac97e300 con 0x5573ac97aa00 2024-05-09T09:47:39.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.571+0000 7f87e124e640 1 -- 172.21.15.157:0/2631510558 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(105 notify.2 [watch unwatch cookie 93955305244704] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87d8049040 con 0x5573ac97aa00 2024-05-09T09:47:39.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.571+0000 7f87e3f34980 20 remove_watcher() i=2 2024-05-09T09:47:39.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.571+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:106 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93955305249456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac97e300 con 0x7f87d801fbe0 2024-05-09T09:47:39.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.575+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.2 v2:172.21.15.157:6800/354455204 23 ==== osd_op_reply(106 notify.3 [watch unwatch cookie 93955305249456] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x7f87d801fbe0 2024-05-09T09:47:39.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.575+0000 7f87e3f34980 20 remove_watcher() i=3 2024-05-09T09:47:39.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.575+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93955305242208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac97e300 con 0x5573ac9716c0 2024-05-09T09:47:39.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.575+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(107 notify.4 [watch unwatch cookie 93955305242208] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87dc00a4d0 con 0x5573ac9716c0 2024-05-09T09:47:39.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.575+0000 7f87e3f34980 20 remove_watcher() i=4 2024-05-09T09:47:39.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.575+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:108 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93955305253392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac97e300 con 0x5573ac9760b0 2024-05-09T09:47:39.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.579+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(108 notify.5 [watch unwatch cookie 93955305253392] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87d4114030 con 0x5573ac9760b0 2024-05-09T09:47:39.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.579+0000 7f87e3f34980 20 remove_watcher() i=5 2024-05-09T09:47:39.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.579+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:109 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93955305258640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac982a10 con 0x5573ac9760b0 2024-05-09T09:47:39.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.583+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(109 notify.6 [watch unwatch cookie 93955305258640] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87d4114030 con 0x5573ac9760b0 2024-05-09T09:47:39.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.583+0000 7f87e3f34980 20 remove_watcher() i=6 2024-05-09T09:47:39.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.583+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:110 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93955305261248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ac982a10 con 0x5573ac9760b0 2024-05-09T09:47:39.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.583+0000 7f87e1a4f640 1 -- 172.21.15.157:0/2631510558 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(110 notify.7 [watch unwatch cookie 93955305261248] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87d4114030 con 0x5573ac9760b0 2024-05-09T09:47:39.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.583+0000 7f87e3f34980 20 remove_watcher() i=7 2024-05-09T09:47:39.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.583+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5573ac9760b0 msgr2=0x5573ac9784a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.583+0000 7f87e3f34980 1 --2- 172.21.15.157:0/2631510558 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5573ac9760b0 0x5573ac9784a0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.583+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5573ac9716c0 msgr2=0x5573ac973b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.583+0000 7f87e3f34980 1 --2- 172.21.15.157:0/2631510558 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5573ac9716c0 0x5573ac973b80 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.583+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f87d801fbe0 msgr2=0x7f87d803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.583+0000 7f87e3f34980 1 --2- 172.21.15.157:0/2631510558 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f87d801fbe0 0x7f87d803a3c0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.583+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5573ac97aa00 msgr2=0x5573ac97ce30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.583+0000 7f87e3f34980 1 --2- 172.21.15.157:0/2631510558 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5573ac97aa00 0x5573ac97ce30 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f86ac034bb0 msgr2=0x7f86ac037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 --2- 172.21.15.157:0/2631510558 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f86ac034bb0 0x7f86ac037070 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x5573ac92b0a0 tx=0x7f87d8010000 comp rx=0 tx=0).stop 2024-05-09T09:47:39.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac95d9a0 msgr2=0x5573ac964d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 --2- 172.21.15.157:0/2631510558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac95d9a0 0x5573ac964d80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f87d4009920 tx=0x7f87d40c9f30 comp rx=0 tx=0).stop 2024-05-09T09:47:39.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e2250640 1 -- 172.21.15.157:0/2631510558 reap_dead start 2024-05-09T09:47:39.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 shutdown_connections 2024-05-09T09:47:39.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 >> 172.21.15.157:0/2631510558 conn(0x5573ac959d20 msgr2=0x5573ac9573a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:39.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 shutdown_connections 2024-05-09T09:47:39.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 -- 172.21.15.157:0/2631510558 wait complete. 2024-05-09T09:47:39.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 -- 172.21.15.157:0/2641802563 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f86bc034bb0 msgr2=0x7f86bc037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 --2- 172.21.15.157:0/2641802563 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f86bc034bb0 0x7f86bc037070 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x5573ac91f020 tx=0x7f87d800f000 comp rx=0 tx=0).stop 2024-05-09T09:47:39.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 -- 172.21.15.157:0/2641802563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac950b90 msgr2=0x5573ac950fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 --2- 172.21.15.157:0/2641802563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac950b90 0x5573ac950fb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f87d40c6fd0 tx=0x7f87d40c5e00 comp rx=0 tx=0).stop 2024-05-09T09:47:39.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 -- 172.21.15.157:0/2641802563 shutdown_connections 2024-05-09T09:47:39.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 --2- 172.21.15.157:0/2641802563 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f86bc034bb0 0x7f86bc037070 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 --2- 172.21.15.157:0/2641802563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac950b90 0x5573ac950fb0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 -- 172.21.15.157:0/2641802563 >> 172.21.15.157:0/2641802563 conn(0x5573ac945960 msgr2=0x5573ac946470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:39.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 -- 172.21.15.157:0/2641802563 shutdown_connections 2024-05-09T09:47:39.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 -- 172.21.15.157:0/2641802563 wait complete. 2024-05-09T09:47:39.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 -- 172.21.15.157:0/3084912770 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5573ac924110 msgr2=0x5573ac9265d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 --2- 172.21.15.157:0/3084912770 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5573ac924110 0x5573ac9265d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 -- 172.21.15.157:0/3084912770 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5573ac82db80 msgr2=0x5573ac9218a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 --2- 172.21.15.157:0/3084912770 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5573ac82db80 0x5573ac9218a0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 -- 172.21.15.157:0/3084912770 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5573ac9281c0 msgr2=0x5573ac92a5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 --2- 172.21.15.157:0/3084912770 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5573ac9281c0 0x5573ac92a5b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 -- 172.21.15.157:0/3084912770 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f86c8039010 msgr2=0x7f86c803b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 --2- 172.21.15.157:0/3084912770 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f86c8039010 0x7f86c803b4d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f87d8001e50 tx=0x7f87d80013b0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 -- 172.21.15.157:0/3084912770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac79f2c0 msgr2=0x5573ac91a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 --2- 172.21.15.157:0/3084912770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5573ac79f2c0 0x5573ac91a9b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f87d4003070 tx=0x7f87d40180e0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e2250640 1 -- 172.21.15.157:0/3084912770 reap_dead start 2024-05-09T09:47:39.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 -- 172.21.15.157:0/3084912770 shutdown_connections 2024-05-09T09:47:39.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 -- 172.21.15.157:0/3084912770 >> 172.21.15.157:0/3084912770 conn(0x5573ac825120 msgr2=0x5573ac910220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:39.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 -- 172.21.15.157:0/3084912770 shutdown_connections 2024-05-09T09:47:39.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.587+0000 7f87e3f34980 1 -- 172.21.15.157:0/3084912770 wait complete. 2024-05-09T09:47:39.608 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-05-09T09:47:39.608 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-05-09T09:47:39.608 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-05-09T09:47:39.698 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:39.698 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:39.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.699+0000 7fb6e591e980 1 Processor -- start 2024-05-09T09:47:39.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.699+0000 7fb6e591e980 1 -- start start 2024-05-09T09:47:39.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.699+0000 7fb6e591e980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5561dd084af0 0x5561dd1135f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.699+0000 7fb6e591e980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5561dcfc6440 con 0x5561dd113b30 2024-05-09T09:47:39.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.699+0000 7fb6e591e980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5561dcfb15f0 con 0x5561dd084af0 2024-05-09T09:47:39.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.703+0000 7fb6e3439640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5561dd084af0 0x5561dd1135f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.703+0000 7fb6e3439640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5561dd084af0 0x5561dd1135f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58920/0 (socket says 172.21.15.157:58920) 2024-05-09T09:47:39.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.703+0000 7fb6e3439640 1 -- 172.21.15.157:0/536831406 learned_addr learned my addr 172.21.15.157:0/536831406 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:39.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.703+0000 7fb6e3439640 1 -- 172.21.15.157:0/536831406 >> v1:172.21.15.110:6789/0 conn(0x5561dd113b30 legacy=0x5561dd115f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.703+0000 7fb6e3439640 1 -- 172.21.15.157:0/536831406 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561dcfbc990 con 0x5561dd084af0 2024-05-09T09:47:39.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.703+0000 7fb6e3439640 1 --2- 172.21.15.157:0/536831406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd084af0 0x5561dd1135f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb6d400a5c0 tx=0x7fb6d401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e158603adccd79b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.703+0000 7fb6e2437640 1 -- 172.21.15.157:0/536831406 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d40a6070 con 0x5561dd084af0 2024-05-09T09:47:39.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.703+0000 7fb6e2437640 1 -- 172.21.15.157:0/536831406 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d40af070 con 0x5561dd084af0 2024-05-09T09:47:39.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.703+0000 7fb6e2437640 1 -- 172.21.15.157:0/536831406 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d40aa5c0 con 0x5561dd084af0 2024-05-09T09:47:39.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.703+0000 7fb6e591e980 1 -- 172.21.15.157:0/536831406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd084af0 msgr2=0x5561dd1135f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.703+0000 7fb6e591e980 1 --2- 172.21.15.157:0/536831406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd084af0 0x5561dd1135f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb6d400a5c0 tx=0x7fb6d401b340 comp rx=0 tx=0).stop 2024-05-09T09:47:39.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.707+0000 7fb6e591e980 1 -- 172.21.15.157:0/536831406 shutdown_connections 2024-05-09T09:47:39.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.707+0000 7fb6e591e980 1 --2- 172.21.15.157:0/536831406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd084af0 0x5561dd1135f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.707+0000 7fb6e591e980 1 -- 172.21.15.157:0/536831406 >> 172.21.15.157:0/536831406 conn(0x5561dd10b110 msgr2=0x5561dd10d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:39.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.707+0000 7fb6e591e980 1 -- 172.21.15.157:0/536831406 shutdown_connections 2024-05-09T09:47:39.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.707+0000 7fb6e591e980 1 -- 172.21.15.157:0/536831406 wait complete. 2024-05-09T09:47:39.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.723+0000 7fb6e591e980 1 Processor -- start 2024-05-09T09:47:39.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.723+0000 7fb6e591e980 1 -- start start 2024-05-09T09:47:39.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.723+0000 7fb6e591e980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd084af0 0x5561dd1fbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.723+0000 7fb6e591e980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5561dd013fe0 con 0x5561dd084af0 2024-05-09T09:47:39.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.723+0000 7fb6e3439640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd084af0 0x5561dd1fbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.723+0000 7fb6e3439640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd084af0 0x5561dd1fbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58934/0 (socket says 172.21.15.157:58934) 2024-05-09T09:47:39.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.723+0000 7fb6e3439640 1 -- 172.21.15.157:0/1491630971 learned_addr learned my addr 172.21.15.157:0/1491630971 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:39.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.723+0000 7fb6e3439640 1 -- 172.21.15.157:0/1491630971 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561dcf98ae0 con 0x5561dd084af0 2024-05-09T09:47:39.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.723+0000 7fb6e3439640 1 --2- 172.21.15.157:0/1491630971 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd084af0 0x5561dd1fbc50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4018f70 tx=0x7fb6d4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634c59dcc60f7d56 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.723+0000 7fb5d160a640 1 -- 172.21.15.157:0/1491630971 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d40aa9e0 con 0x5561dd084af0 2024-05-09T09:47:39.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.723+0000 7fb5d160a640 1 -- 172.21.15.157:0/1491630971 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d40aab80 con 0x5561dd084af0 2024-05-09T09:47:39.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.723+0000 7fb5d160a640 1 -- 172.21.15.157:0/1491630971 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d40aae60 con 0x5561dd084af0 2024-05-09T09:47:39.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.723+0000 7fb6e591e980 1 -- 172.21.15.157:0/1491630971 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd084af0 msgr2=0x5561dd1fbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.723+0000 7fb6e591e980 1 --2- 172.21.15.157:0/1491630971 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd084af0 0x5561dd1fbc50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4018f70 tx=0x7fb6d4003030 comp rx=0 tx=0).stop 2024-05-09T09:47:39.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.723+0000 7fb6e591e980 1 -- 172.21.15.157:0/1491630971 shutdown_connections 2024-05-09T09:47:39.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.723+0000 7fb6e591e980 1 --2- 172.21.15.157:0/1491630971 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd084af0 0x5561dd1fbc50 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.723+0000 7fb6e591e980 1 -- 172.21.15.157:0/1491630971 >> 172.21.15.157:0/1491630971 conn(0x5561dd10b110 msgr2=0x5561dd1f77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:39.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.723+0000 7fb6e591e980 1 -- 172.21.15.157:0/1491630971 shutdown_connections 2024-05-09T09:47:39.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.723+0000 7fb6e591e980 1 -- 172.21.15.157:0/1491630971 wait complete. 2024-05-09T09:47:39.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.723+0000 7fb6e591e980 1 Processor -- start 2024-05-09T09:47:39.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.723+0000 7fb6e591e980 1 -- start start 2024-05-09T09:47:39.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.723+0000 7fb6e591e980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd084af0 0x5561dd202d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.723+0000 7fb6e591e980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5561dd118150 con 0x5561dd084af0 2024-05-09T09:47:39.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.727+0000 7fb6e3439640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd084af0 0x5561dd202d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.727+0000 7fb6e3439640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd084af0 0x5561dd202d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58946/0 (socket says 172.21.15.157:58946) 2024-05-09T09:47:39.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.727+0000 7fb6e3439640 1 -- 172.21.15.157:0/709591159 learned_addr learned my addr 172.21.15.157:0/709591159 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:39.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.727+0000 7fb6e3439640 1 -- 172.21.15.157:0/709591159 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561dd203260 con 0x5561dd084af0 2024-05-09T09:47:39.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.727+0000 7fb6e3439640 1 --2- 172.21.15.157:0/709591159 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd084af0 0x5561dd202d20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4003070 tx=0x7fb6d40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.727+0000 7fb5cfe07640 1 -- 172.21.15.157:0/709591159 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d40cb020 con 0x5561dd084af0 2024-05-09T09:47:39.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.727+0000 7fb5cfe07640 1 -- 172.21.15.157:0/709591159 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d40c6710 con 0x5561dd084af0 2024-05-09T09:47:39.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.727+0000 7fb5cfe07640 1 -- 172.21.15.157:0/709591159 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d40c69f0 con 0x5561dd084af0 2024-05-09T09:47:39.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.727+0000 7fb6e591e980 1 -- 172.21.15.157:0/709591159 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561dd2034f0 con 0x5561dd084af0 2024-05-09T09:47:39.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.727+0000 7fb6e591e980 1 -- 172.21.15.157:0/709591159 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561dd206180 con 0x5561dd084af0 2024-05-09T09:47:39.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.727+0000 7fb5cfe07640 1 -- 172.21.15.157:0/709591159 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fb6d40ce020 con 0x5561dd084af0 2024-05-09T09:47:39.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.727+0000 7fb5cfe07640 1 --2- 172.21.15.157:0/709591159 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb5c8034bb0 0x7fb5c8037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.727+0000 7fb5cfe07640 1 -- 172.21.15.157:0/709591159 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fb6d40e5b60 con 0x5561dd084af0 2024-05-09T09:47:39.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.731+0000 7fb6e2c38640 1 --2- 172.21.15.157:0/709591159 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb5c8034bb0 0x7fb5c8037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.731+0000 7fb6e591e980 1 --2- 172.21.15.157:0/709591159 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5561dd113b30 0x5561dd209ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.731+0000 7fb6e591e980 1 -- 172.21.15.157:0/709591159 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5561dd20a310 con 0x5561dd113b30 2024-05-09T09:47:39.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.731+0000 7fb6e3c3a640 1 --2- 172.21.15.157:0/709591159 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5561dd113b30 0x5561dd209ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.731+0000 7fb6e2c38640 1 --2- 172.21.15.157:0/709591159 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb5c8034bb0 0x7fb5c8037070 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8001e20 tx=0x7fb6d80013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.731+0000 7fb6e3c3a640 1 --2- 172.21.15.157:0/709591159 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5561dd113b30 0x5561dd209ca0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.731+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/709591159 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd113b30 2024-05-09T09:47:39.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.731+0000 7fb6e591e980 1 -- 172.21.15.157:0/709591159 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5561dd2073a0 con 0x5561dd113b30 2024-05-09T09:47:39.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.731+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/709591159 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd113b30 2024-05-09T09:47:39.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.731+0000 7fb6e591e980 1 --2- 172.21.15.157:0/709591159 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5561dd20c660 0x5561dd20ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.731+0000 7fb6e591e980 1 -- 172.21.15.157:0/709591159 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5561dd20f120 con 0x5561dd20c660 2024-05-09T09:47:39.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.731+0000 7fb6e3439640 1 --2- 172.21.15.157:0/709591159 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5561dd20c660 0x5561dd20ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.731+0000 7fb6e3439640 1 --2- 172.21.15.157:0/709591159 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5561dd20c660 0x5561dd20ea50 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.731+0000 7fb6e3439640 1 -- 172.21.15.157:0/709591159 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd20c660 2024-05-09T09:47:39.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.731+0000 7fb6e591e980 1 -- 172.21.15.157:0/709591159 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5561dd20b500 con 0x5561dd113b30 2024-05-09T09:47:39.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.731+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/709591159 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd113b30 2024-05-09T09:47:39.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.731+0000 7fb6e591e980 1 --2- 172.21.15.157:0/709591159 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5561dd210580 0x5561dd212970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.731+0000 7fb6e591e980 1 -- 172.21.15.157:0/709591159 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5561dd213070 con 0x5561dd210580 2024-05-09T09:47:39.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.731+0000 7fb6e2c38640 1 --2- 172.21.15.157:0/709591159 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5561dd210580 0x5561dd212970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.735+0000 7fb6e2c38640 1 --2- 172.21.15.157:0/709591159 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5561dd210580 0x5561dd212970 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.735+0000 7fb6e2c38640 1 -- 172.21.15.157:0/709591159 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb6d800d040 con 0x5561dd210580 2024-05-09T09:47:39.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.739+0000 7fb6e591e980 1 Processor -- start 2024-05-09T09:47:39.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.739+0000 7fb6e591e980 1 -- start start 2024-05-09T09:47:39.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.739+0000 7fb6e591e980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd111120 0x5561dd10f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.739+0000 7fb6e591e980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5561dd018020 con 0x5561dd111120 2024-05-09T09:47:39.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.739+0000 7fb6e3439640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd111120 0x5561dd10f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.739+0000 7fb6e3439640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd111120 0x5561dd10f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58956/0 (socket says 172.21.15.157:58956) 2024-05-09T09:47:39.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.739+0000 7fb6e3439640 1 -- 172.21.15.157:0/2171714810 learned_addr learned my addr 172.21.15.157:0/2171714810 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:39.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.739+0000 7fb6e3439640 1 -- 172.21.15.157:0/2171714810 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561dd10faf0 con 0x5561dd111120 2024-05-09T09:47:39.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.739+0000 7fb6e3439640 1 --2- 172.21.15.157:0/2171714810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd111120 0x5561dd10f5b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb6d40bdf00 tx=0x7fb6d40bd620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.739+0000 7fb5c7fff640 1 -- 172.21.15.157:0/2171714810 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d40cf730 con 0x5561dd111120 2024-05-09T09:47:39.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.739+0000 7fb6e591e980 1 -- 172.21.15.157:0/2171714810 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561dd10fde0 con 0x5561dd111120 2024-05-09T09:47:39.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.739+0000 7fb5c7fff640 1 -- 172.21.15.157:0/2171714810 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d40cf8d0 con 0x5561dd111120 2024-05-09T09:47:39.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.739+0000 7fb5c7fff640 1 -- 172.21.15.157:0/2171714810 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d4001800 con 0x5561dd111120 2024-05-09T09:47:39.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.739+0000 7fb6e591e980 1 -- 172.21.15.157:0/2171714810 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561dd1102c0 con 0x5561dd111120 2024-05-09T09:47:39.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.743+0000 7fb5c7fff640 1 -- 172.21.15.157:0/2171714810 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fb6d40019a0 con 0x5561dd111120 2024-05-09T09:47:39.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.743+0000 7fb5c7fff640 1 --2- 172.21.15.157:0/2171714810 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb5bc034c00 0x7fb5bc0370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.743+0000 7fb5c7fff640 1 -- 172.21.15.157:0/2171714810 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fb6d40efca0 con 0x5561dd111120 2024-05-09T09:47:39.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.743+0000 7fb6e2c38640 1 --2- 172.21.15.157:0/2171714810 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb5bc034c00 0x7fb5bc0370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.743+0000 7fb6e591e980 1 Processor -- start 2024-05-09T09:47:39.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.743+0000 7fb6e591e980 1 -- start start 2024-05-09T09:47:39.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.743+0000 7fb6e2c38640 1 --2- 172.21.15.157:0/2171714810 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb5bc034c00 0x7fb5bc0370c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x5561dd20ac10 tx=0x7fb6d8006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.743+0000 7fb6e591e980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd248060 0x5561dd248480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.743+0000 7fb6e591e980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5561dd1fc2e0 con 0x5561dd248060 2024-05-09T09:47:39.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.743+0000 7fb6e3439640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd248060 0x5561dd248480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.743+0000 7fb6e3439640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd248060 0x5561dd248480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58962/0 (socket says 172.21.15.157:58962) 2024-05-09T09:47:39.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.743+0000 7fb6e3439640 1 -- 172.21.15.157:0/841159762 learned_addr learned my addr 172.21.15.157:0/841159762 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:39.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.743+0000 7fb6e3439640 1 -- 172.21.15.157:0/841159762 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561dd248a50 con 0x5561dd248060 2024-05-09T09:47:39.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.743+0000 7fb6e3439640 1 --2- 172.21.15.157:0/841159762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd248060 0x5561dd248480 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb6d40bcf90 tx=0x7fb6d40db4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5701da24992b1be5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.743+0000 7fb5c5ffb640 1 -- 172.21.15.157:0/841159762 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d4107070 con 0x5561dd248060 2024-05-09T09:47:39.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.743+0000 7fb5c5ffb640 1 -- 172.21.15.157:0/841159762 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d40bc780 con 0x5561dd248060 2024-05-09T09:47:39.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.743+0000 7fb5c5ffb640 1 -- 172.21.15.157:0/841159762 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d40fe040 con 0x5561dd248060 2024-05-09T09:47:39.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.743+0000 7fb6e591e980 1 -- 172.21.15.157:0/841159762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd248060 msgr2=0x5561dd248480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.743+0000 7fb6e591e980 1 --2- 172.21.15.157:0/841159762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd248060 0x5561dd248480 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb6d40bcf90 tx=0x7fb6d40db4f0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.743+0000 7fb6e591e980 1 -- 172.21.15.157:0/841159762 shutdown_connections 2024-05-09T09:47:39.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.743+0000 7fb6e591e980 1 --2- 172.21.15.157:0/841159762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd248060 0x5561dd248480 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.743+0000 7fb6e591e980 1 -- 172.21.15.157:0/841159762 >> 172.21.15.157:0/841159762 conn(0x5561dd244430 msgr2=0x5561dd242490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:39.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.743+0000 7fb6e591e980 1 -- 172.21.15.157:0/841159762 shutdown_connections 2024-05-09T09:47:39.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.743+0000 7fb6e591e980 1 -- 172.21.15.157:0/841159762 wait complete. 2024-05-09T09:47:39.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.747+0000 7fb6e591e980 1 Processor -- start 2024-05-09T09:47:39.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.747+0000 7fb6e591e980 1 -- start start 2024-05-09T09:47:39.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.747+0000 7fb6e591e980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd248060 0x5561dd24f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.747+0000 7fb6e591e980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5561dd248ff0 con 0x5561dd248060 2024-05-09T09:47:39.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.747+0000 7fb6e3439640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd248060 0x5561dd24f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.747+0000 7fb6e3439640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd248060 0x5561dd24f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58972/0 (socket says 172.21.15.157:58972) 2024-05-09T09:47:39.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.747+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 learned_addr learned my addr 172.21.15.157:0/966100362 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:39.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.747+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561dd24f980 con 0x5561dd248060 2024-05-09T09:47:39.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.751+0000 7fb6e3439640 1 --2- 172.21.15.157:0/966100362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd248060 0x5561dd24f440 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb6d40cfbd0 tx=0x7fb6d40d3690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.751+0000 7fb5b3fff640 1 -- 172.21.15.157:0/966100362 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d410f020 con 0x5561dd248060 2024-05-09T09:47:39.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.751+0000 7fb5b3fff640 1 -- 172.21.15.157:0/966100362 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d40c56f0 con 0x5561dd248060 2024-05-09T09:47:39.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.751+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561dd24f980 con 0x5561dd248060 2024-05-09T09:47:39.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.751+0000 7fb5b3fff640 1 -- 172.21.15.157:0/966100362 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d4107040 con 0x5561dd248060 2024-05-09T09:47:39.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.751+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561dd24f980 con 0x5561dd248060 2024-05-09T09:47:39.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.751+0000 7fb5b3fff640 1 -- 172.21.15.157:0/966100362 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fb6d4112020 con 0x5561dd248060 2024-05-09T09:47:39.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.751+0000 7fb6e591e980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.751+0000 7fb5b3fff640 1 --2- 172.21.15.157:0/966100362 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb5ac034b60 0x7fb5ac037020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.751+0000 7fb5b3fff640 1 -- 172.21.15.157:0/966100362 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fb6d4115c60 con 0x5561dd248060 2024-05-09T09:47:39.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.751+0000 7fb6e2c38640 1 --2- 172.21.15.157:0/966100362 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb5ac034b60 0x7fb5ac037020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.751+0000 7fb6e591e980 1 --2- 172.21.15.157:0/966100362 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5561dd25be40 0x5561dd25e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.751+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25ea30 con 0x5561dd25be40 2024-05-09T09:47:39.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.751+0000 7fb6e3c3a640 1 --2- 172.21.15.157:0/966100362 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5561dd25be40 0x5561dd25e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.751+0000 7fb6e2c38640 1 --2- 172.21.15.157:0/966100362 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb5ac034b60 0x7fb5ac037020 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x5561dd213470 tx=0x7fb6d8011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.751+0000 7fb6e3c3a640 1 --2- 172.21.15.157:0/966100362 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5561dd25be40 0x5561dd25e2e0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.751+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd25be40 2024-05-09T09:47:39.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.751+0000 7fb6e591e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:39.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.751+0000 7fb6e591e980 20 realm 2024-05-09T09:47:39.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.751+0000 7fb6e591e980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.751+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25ee40 con 0x5561dd25be40 2024-05-09T09:47:39.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.755+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd25be40 2024-05-09T09:47:39.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.755+0000 7fb6e591e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:39.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.755+0000 7fb6e591e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:39.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.755+0000 7fb6e591e980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.755+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25f6e0 con 0x5561dd25be40 2024-05-09T09:47:39.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.755+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd25be40 2024-05-09T09:47:39.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.755+0000 7fb6e591e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:39.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.755+0000 7fb6e591e980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.755+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x5561dd25be40 2024-05-09T09:47:39.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.755+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd25be40 2024-05-09T09:47:39.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.755+0000 7fb6e591e980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:39.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.755+0000 7fb6e591e980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.755+0000 7fb6e591e980 1 --2- 172.21.15.157:0/966100362 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5561dd2607e0 0x5561dd262bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.755+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5561dd263220 con 0x5561dd2607e0 2024-05-09T09:47:39.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.755+0000 7fb6e3439640 1 --2- 172.21.15.157:0/966100362 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5561dd2607e0 0x5561dd262bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.755+0000 7fb6e3439640 1 --2- 172.21.15.157:0/966100362 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5561dd2607e0 0x5561dd262bd0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.755+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.755+0000 7fb6e591e980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:39.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.755+0000 7fb6e591e980 20 searching for the correct realm 2024-05-09T09:47:39.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.755+0000 7fb6e591e980 1 --2- 172.21.15.157:0/966100362 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5561dd265100 0x5561dd267570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.755+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd267bf0 con 0x5561dd265100 2024-05-09T09:47:39.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.755+0000 7fb6e2c38640 1 --2- 172.21.15.157:0/966100362 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5561dd265100 0x5561dd267570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.755+0000 7fb6e2c38640 1 --2- 172.21.15.157:0/966100362 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5561dd265100 0x5561dd267570 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.759+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d8036040 con 0x5561dd265100 2024-05-09T09:47:39.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.759+0000 7fb6e2c38640 1 --2- 172.21.15.157:0/966100362 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fb6d800f3d0 0x7fb6d800f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.759+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd267bf0 con 0x7fb6d800f3d0 2024-05-09T09:47:39.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.759+0000 7fb6e3c3a640 1 --2- 172.21.15.157:0/966100362 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fb6d800f3d0 0x7fb6d800f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.759+0000 7fb6e3c3a640 1 --2- 172.21.15.157:0/966100362 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fb6d800f3d0 0x7fb6d800f7f0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.759+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x7fb6d800f3d0 2024-05-09T09:47:39.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.759+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x5561dd2607e0 2024-05-09T09:47:39.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.759+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.759+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x5561dd25be40 2024-05-09T09:47:39.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.759+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd25be40 2024-05-09T09:47:39.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.759+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x5561dd25be40 2024-05-09T09:47:39.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.759+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd25be40 2024-05-09T09:47:39.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.759+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x5561dd2607e0 2024-05-09T09:47:39.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.759+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.759+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x5561dd2607e0 2024-05-09T09:47:39.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.759+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.759+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x7fb6d800f3d0 2024-05-09T09:47:39.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.763+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x7fb6d800f3d0 2024-05-09T09:47:39.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.763+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x5561dd265100 2024-05-09T09:47:39.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.763+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d8036040 con 0x5561dd265100 2024-05-09T09:47:39.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.763+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x5561dd25be40 2024-05-09T09:47:39.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.763+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd25be40 2024-05-09T09:47:39.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.763+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x5561dd2607e0 2024-05-09T09:47:39.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.763+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.763+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x5561dd25be40 2024-05-09T09:47:39.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.763+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd25be40 2024-05-09T09:47:39.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.763+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x7fb6d800f3d0 2024-05-09T09:47:39.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.763+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x7fb6d800f3d0 2024-05-09T09:47:39.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.763+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x5561dd265100 2024-05-09T09:47:39.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.763+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d8036040 con 0x5561dd265100 2024-05-09T09:47:39.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.763+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x5561dd265100 2024-05-09T09:47:39.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.763+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb6d8036040 con 0x5561dd265100 2024-05-09T09:47:39.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.763+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x5561dd2607e0 2024-05-09T09:47:39.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.763+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.763+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x5561dd265100 2024-05-09T09:47:39.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.763+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d8036040 con 0x5561dd265100 2024-05-09T09:47:39.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.763+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x5561dd265100 2024-05-09T09:47:39.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.763+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d8036040 con 0x5561dd265100 2024-05-09T09:47:39.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.763+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x5561dd25be40 2024-05-09T09:47:39.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.763+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd25be40 2024-05-09T09:47:39.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.763+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x5561dd25be40 2024-05-09T09:47:39.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.767+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd25be40 2024-05-09T09:47:39.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.767+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x5561dd2607e0 2024-05-09T09:47:39.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.767+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.767+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x5561dd265100 2024-05-09T09:47:39.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.767+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d8036040 con 0x5561dd265100 2024-05-09T09:47:39.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.767+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x7fb6d800f3d0 2024-05-09T09:47:39.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.767+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x7fb6d800f3d0 2024-05-09T09:47:39.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.767+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x5561dd25be40 2024-05-09T09:47:39.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.767+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd25be40 2024-05-09T09:47:39.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.767+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x5561dd2607e0 2024-05-09T09:47:39.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.767+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.767+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x5561dd265100 2024-05-09T09:47:39.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.767+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d8036040 con 0x5561dd265100 2024-05-09T09:47:39.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.767+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x5561dd2607e0 2024-05-09T09:47:39.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.767+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.767+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x7fb6d800f3d0 2024-05-09T09:47:39.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.767+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x7fb6d800f3d0 2024-05-09T09:47:39.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.767+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x5561dd265100 2024-05-09T09:47:39.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d8048040 con 0x5561dd265100 2024-05-09T09:47:39.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x5561dd2607e0 2024-05-09T09:47:39.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x5561dd25be40 2024-05-09T09:47:39.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd25be40 2024-05-09T09:47:39.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5561dd25fa80 con 0x7fb6d800f3d0 2024-05-09T09:47:39.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x7fb6d800f3d0 2024-05-09T09:47:39.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:39.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:39.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:39.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:39.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:39.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:39.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5561dd263a70 con 0x5561dd25be40 2024-05-09T09:47:39.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd25be40 2024-05-09T09:47:39.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:39.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5561dd263a70 con 0x5561dd25be40 2024-05-09T09:47:39.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd25be40 2024-05-09T09:47:39.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:39.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5561dd263a70 con 0x5561dd265100 2024-05-09T09:47:39.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb6d8048040 con 0x5561dd265100 2024-05-09T09:47:39.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:39.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 20 zone default found 2024-05-09T09:47:39.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 4 Realm: () 2024-05-09T09:47:39.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:39.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:39.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:39.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 20 zonegroup default 2024-05-09T09:47:39.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5561dd264410 con 0x5561dd2607e0 2024-05-09T09:47:39.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:39.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5561dd269ae0 con 0x5561dd265100 2024-05-09T09:47:39.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb6d8048040 con 0x5561dd265100 2024-05-09T09:47:39.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:39.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5561dd269f20 con 0x5561dd265100 2024-05-09T09:47:39.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb6d8048040 con 0x5561dd265100 2024-05-09T09:47:39.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:39.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.771+0000 7fb6e591e980 20 started sync module instance, tier type = 2024-05-09T09:47:39.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.775+0000 7fb6e591e980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:39.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.775+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd268ef0 con 0x7fb6d800f3d0 2024-05-09T09:47:39.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.775+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x7fb6d800f3d0 2024-05-09T09:47:39.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.775+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93878810481680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd268ef0 con 0x7fb6d800f3d0 2024-05-09T09:47:39.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.775+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd26aa20 con 0x5561dd25be40 2024-05-09T09:47:39.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.775+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93878810481680] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x7fb6d800f3d0 2024-05-09T09:47:39.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.775+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd25be40 2024-05-09T09:47:39.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.775+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93878810486000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd268ef0 con 0x5561dd25be40 2024-05-09T09:47:39.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.775+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd26b430 con 0x5561dd265100 2024-05-09T09:47:39.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.779+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d8048040 con 0x5561dd265100 2024-05-09T09:47:39.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.779+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93878810488704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd26bcd0 con 0x5561dd265100 2024-05-09T09:47:39.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.779+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd26c710 con 0x7fb6d800f3d0 2024-05-09T09:47:39.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.779+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93878810486000] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd25be40 2024-05-09T09:47:39.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.779+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x7fb6d800f3d0 2024-05-09T09:47:39.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.779+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93878810493408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd26c6d0 con 0x7fb6d800f3d0 2024-05-09T09:47:39.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.779+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd26d120 con 0x5561dd25be40 2024-05-09T09:47:39.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.783+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93878810493408] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x7fb6d800f3d0 2024-05-09T09:47:39.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.783+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93878810488704] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d8048040 con 0x5561dd265100 2024-05-09T09:47:39.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.783+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd25be40 2024-05-09T09:47:39.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.783+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93878810490912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd26cc70 con 0x5561dd25be40 2024-05-09T09:47:39.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.783+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd26d4c0 con 0x5561dd2607e0 2024-05-09T09:47:39.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.783+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93878810490912] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd25be40 2024-05-09T09:47:39.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.787+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.787+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93878810496112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd26d090 con 0x5561dd2607e0 2024-05-09T09:47:39.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.787+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd26e1c0 con 0x5561dd2607e0 2024-05-09T09:47:39.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.787+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93878810496112] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.787+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.787+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93878810499648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd26ea10 con 0x5561dd2607e0 2024-05-09T09:47:39.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.787+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd26f3d0 con 0x5561dd2607e0 2024-05-09T09:47:39.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.791+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.791+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93878810505264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd26fb20 con 0x5561dd2607e0 2024-05-09T09:47:39.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.791+0000 7fb6e591e980 20 add_watcher() i=0 2024-05-09T09:47:39.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.791+0000 7fb6e591e980 20 add_watcher() i=1 2024-05-09T09:47:39.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.791+0000 7fb6e591e980 20 add_watcher() i=2 2024-05-09T09:47:39.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.791+0000 7fb6e591e980 20 add_watcher() i=3 2024-05-09T09:47:39.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.791+0000 7fb6e591e980 20 add_watcher() i=4 2024-05-09T09:47:39.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.791+0000 7fb6e591e980 20 add_watcher() i=5 2024-05-09T09:47:39.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.791+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93878810499648] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.791+0000 7fb6e591e980 20 add_watcher() i=6 2024-05-09T09:47:39.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.791+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93878810505264] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.791+0000 7fb6e591e980 20 add_watcher() i=7 2024-05-09T09:47:39.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.791+0000 7fb6e591e980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:39.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.791+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5561dd26e560 con 0x5561dd25be40 2024-05-09T09:47:39.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.791+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd25be40 2024-05-09T09:47:39.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.791+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93878810502496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd2700a0 con 0x5561dd25be40 2024-05-09T09:47:39.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.795+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93878810502496] v30'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd25be40 2024-05-09T09:47:39.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.795+0000 7fb598fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:39.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.795+0000 7fb6e591e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:39.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.795+0000 7fb6e591e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:39.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.795+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27b530 con 0x5561dd25be40 2024-05-09T09:47:39.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.795+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'51 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd25be40 2024-05-09T09:47:39.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.795+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27bb80 con 0x5561dd2607e0 2024-05-09T09:47:39.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.799+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'46 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.799+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27bb80 con 0x5561dd265100 2024-05-09T09:47:39.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.799+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'45 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb6d8048040 con 0x5561dd265100 2024-05-09T09:47:39.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.799+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27c1b0 con 0x5561dd25be40 2024-05-09T09:47:39.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.803+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'200 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd25be40 2024-05-09T09:47:39.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.803+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27c660 con 0x7fb6d800f3d0 2024-05-09T09:47:39.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.803+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'125 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x7fb6d800f3d0 2024-05-09T09:47:39.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.803+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd279410 con 0x5561dd265100 2024-05-09T09:47:39.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.803+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'84 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb6d8048040 con 0x5561dd265100 2024-05-09T09:47:39.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.803+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd279410 con 0x5561dd25be40 2024-05-09T09:47:39.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.807+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'47 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd25be40 2024-05-09T09:47:39.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.807+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27d3e0 con 0x5561dd2607e0 2024-05-09T09:47:39.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.811+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'83 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.811+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27d3e0 con 0x7fb6d800f3d0 2024-05-09T09:47:39.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.811+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'45 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x7fb6d800f3d0 2024-05-09T09:47:39.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.811+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27d3e0 con 0x5561dd265100 2024-05-09T09:47:39.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.811+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'51 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb6d8048040 con 0x5561dd265100 2024-05-09T09:47:39.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.811+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27d950 con 0x7fb6d800f3d0 2024-05-09T09:47:39.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.815+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'126 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x7fb6d800f3d0 2024-05-09T09:47:39.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.815+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27d950 con 0x5561dd2607e0 2024-05-09T09:47:39.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.815+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'47 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.815+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27d950 con 0x7fb6d800f3d0 2024-05-09T09:47:39.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.819+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'45 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x7fb6d800f3d0 2024-05-09T09:47:39.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.819+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27d950 con 0x5561dd2607e0 2024-05-09T09:47:39.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.819+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'89 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.819+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27d950 con 0x5561dd25be40 2024-05-09T09:47:39.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.823+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'201 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd25be40 2024-05-09T09:47:39.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.823+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27d950 con 0x5561dd265100 2024-05-09T09:47:39.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.823+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'119 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6d8048040 con 0x5561dd265100 2024-05-09T09:47:39.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.823+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27df00 con 0x7fb6d800f3d0 2024-05-09T09:47:39.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.827+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'127 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x7fb6d800f3d0 2024-05-09T09:47:39.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.827+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27dca0 con 0x5561dd265100 2024-05-09T09:47:39.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.827+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'45 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6d8048040 con 0x5561dd265100 2024-05-09T09:47:39.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.827+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27dca0 con 0x5561dd25be40 2024-05-09T09:47:39.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.831+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'53 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd25be40 2024-05-09T09:47:39.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.831+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27dca0 con 0x5561dd25be40 2024-05-09T09:47:39.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.831+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'202 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd25be40 2024-05-09T09:47:39.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.831+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27dca0 con 0x5561dd265100 2024-05-09T09:47:39.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.835+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'120 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6d8048040 con 0x5561dd265100 2024-05-09T09:47:39.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.835+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27dca0 con 0x7fb6d800f3d0 2024-05-09T09:47:39.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.835+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'55 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x7fb6d800f3d0 2024-05-09T09:47:39.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.835+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27dca0 con 0x5561dd265100 2024-05-09T09:47:39.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.835+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'47 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6d8048040 con 0x5561dd265100 2024-05-09T09:47:39.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.835+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27dca0 con 0x5561dd265100 2024-05-09T09:47:39.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.839+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'51 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6d8048040 con 0x5561dd265100 2024-05-09T09:47:39.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.839+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27dca0 con 0x5561dd265100 2024-05-09T09:47:39.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.839+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'41 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6d8048040 con 0x5561dd265100 2024-05-09T09:47:39.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.839+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27dca0 con 0x5561dd265100 2024-05-09T09:47:39.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.839+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'85 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6d8048040 con 0x5561dd265100 2024-05-09T09:47:39.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.839+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27dca0 con 0x5561dd2607e0 2024-05-09T09:47:39.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.843+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'47 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.843+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27dca0 con 0x5561dd265100 2024-05-09T09:47:39.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.843+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'45 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6d8048040 con 0x5561dd265100 2024-05-09T09:47:39.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.843+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27dca0 con 0x5561dd2607e0 2024-05-09T09:47:39.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.847+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'84 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.847+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27dca0 con 0x5561dd265100 2024-05-09T09:47:39.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.847+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'121 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6d8048040 con 0x5561dd265100 2024-05-09T09:47:39.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.847+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27dca0 con 0x5561dd2607e0 2024-05-09T09:47:39.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.851+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'90 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.851+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd27dca0 con 0x7fb6d800f3d0 2024-05-09T09:47:39.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.855+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'51 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x7fb6d800f3d0 2024-05-09T09:47:39.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.855+0000 7fb5137fe640 20 reqs_thread_entry: start 2024-05-09T09:47:39.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.855+0000 7fb6e591e980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:39.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.855+0000 7fb5117fa640 20 reqs_thread_entry: start 2024-05-09T09:47:39.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.855+0000 7fb6e591e980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-09T09:47:39.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.855+0000 7fb6e591e980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.855+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5561dd2783c0 con 0x5561dd2607e0 2024-05-09T09:47:39.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.855+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.855+0000 7fb6e591e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:39.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.855+0000 7fb6e591e980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-05-09T09:47:39.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.855+0000 7fb6e591e980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-09T09:47:39.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.855+0000 7fb6e591e980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-05-09T09:47:39.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.855+0000 7fb6e591e980 20 rados->read ofs=0 len=0 2024-05-09T09:47:39.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.855+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:95 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5561dd278900 con 0x5561dd2607e0 2024-05-09T09:47:39.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.859+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(95 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.859+0000 7fb6e591e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:39.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.859+0000 7fb6e591e980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-05-09T09:47:39.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.859+0000 7fb6e591e980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-09T09:47:39.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.859+0000 7fb6e591e980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-09T09:47:39.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.859+0000 7fb6e591e980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-09T09:47:39.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.859+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:96 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd2783c0 con 0x5561dd2607e0 2024-05-09T09:47:39.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.859+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(96 fud [delete,create,call,writefull 0~380] v30'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.859+0000 7fb6e591e980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-05-09T09:47:39.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.859+0000 7fb6e591e980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-05-09T09:47:39.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.859+0000 7fb6e591e980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-05-09T09:47:39.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.859+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 93878810685088 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5561dd29cad0 con 0x5561dd2607e0 2024-05-09T09:47:39.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.863+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== watch-notify(notify (1) cookie 93878810496112 notify 128849018883 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5561dd2780e0 con 0x5561dd2607e0 2024-05-09T09:47:39.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.863+0000 7fb5c5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 93878810496112 notifier 4496 bl.length()=556 2024-05-09T09:47:39.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.863+0000 7fb5c5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-05-09T09:47:39.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.863+0000 7fb5c5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-05-09T09:47:39.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.863+0000 7fb5c5ffb640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fb5a80056c0 con 0x5561dd2607e0 2024-05-09T09:47:39.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.863+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(97 notify.5 [notify cookie 93878810685088 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.863+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.863+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== watch-notify(notify_complete (2) cookie 93878810685088 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5561dd10faf0 con 0x5561dd2607e0 2024-05-09T09:47:39.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.863+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:99 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd29a340 con 0x5561dd2607e0 2024-05-09T09:47:39.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.867+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 32 ==== osd_op_reply(99 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v30'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.867+0000 7fb6e591e980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-09T09:47:39.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.867+0000 7fb6e591e980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-09T09:47:39.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.867+0000 7fb6e591e980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-09T09:47:39.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.867+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:100 7.15 7:a93a5511:::notify.2:head [notify cookie 93878810680976 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5561dd29a2b0 con 0x5561dd265100 2024-05-09T09:47:39.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.867+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== watch-notify(notify (1) cookie 93878810488704 notify 128849018882 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5561dd278e70 con 0x5561dd265100 2024-05-09T09:47:39.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.867+0000 7fb5c57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 93878810488704 notifier 4496 bl.length()=177 2024-05-09T09:47:39.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.867+0000 7fb5c57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-09T09:47:39.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.867+0000 7fb5c57fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-09T09:47:39.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.867+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(100 notify.2 [notify cookie 93878810680976 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb6d8048040 con 0x5561dd265100 2024-05-09T09:47:39.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.867+0000 7fb5c57fa640 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fb518003a70 con 0x5561dd265100 2024-05-09T09:47:39.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.867+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== watch-notify(notify_complete (2) cookie 93878810680976 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5561dd279a40 con 0x5561dd265100 2024-05-09T09:47:39.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.867+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 30 ==== osd_op_reply(101 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d8048040 con 0x5561dd265100 2024-05-09T09:47:39.866 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-09T09:47:39.860573Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:47:39.860554Z","tags":[],"group_ids":[]} 2024-05-09T09:47:39.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.867+0000 7fb598fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:39.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.867+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93878810502496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd277350 con 0x5561dd25be40 2024-05-09T09:47:39.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.871+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(102 data_loggenerations_metadata [watch unwatch cookie 93878810502496] v30'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd25be40 2024-05-09T09:47:39.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.871+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:103 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93878810481680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd26e560 con 0x7fb6d800f3d0 2024-05-09T09:47:39.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.871+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(103 notify.0 [watch unwatch cookie 93878810481680] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x7fb6d800f3d0 2024-05-09T09:47:39.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.871+0000 7fb6e591e980 20 remove_watcher() i=0 2024-05-09T09:47:39.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.871+0000 7fb6e591e980 2 removed watcher, disabling cache 2024-05-09T09:47:39.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.871+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:104 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93878810486000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd269410 con 0x5561dd25be40 2024-05-09T09:47:39.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.875+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(104 notify.1 [watch unwatch cookie 93878810486000] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd25be40 2024-05-09T09:47:39.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.875+0000 7fb6e591e980 20 remove_watcher() i=1 2024-05-09T09:47:39.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.875+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:105 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93878810488704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd269410 con 0x5561dd265100 2024-05-09T09:47:39.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.875+0000 7fb6e2c38640 1 -- 172.21.15.157:0/966100362 <== osd.3 v2:172.21.15.157:6816/2487336710 31 ==== osd_op_reply(105 notify.2 [watch unwatch cookie 93878810488704] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d8048040 con 0x5561dd265100 2024-05-09T09:47:39.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.875+0000 7fb6e591e980 20 remove_watcher() i=2 2024-05-09T09:47:39.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.875+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:106 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93878810493408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd269410 con 0x7fb6d800f3d0 2024-05-09T09:47:39.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.879+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(106 notify.3 [watch unwatch cookie 93878810493408] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x7fb6d800f3d0 2024-05-09T09:47:39.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.879+0000 7fb6e591e980 20 remove_watcher() i=3 2024-05-09T09:47:39.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.879+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93878810490912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd269410 con 0x5561dd25be40 2024-05-09T09:47:39.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.879+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(107 notify.4 [watch unwatch cookie 93878810490912] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5561dd25be40 2024-05-09T09:47:39.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.879+0000 7fb6e591e980 20 remove_watcher() i=4 2024-05-09T09:47:39.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.879+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:108 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93878810496112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd26b820 con 0x5561dd2607e0 2024-05-09T09:47:39.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.883+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 33 ==== osd_op_reply(108 notify.5 [watch unwatch cookie 93878810496112] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.883+0000 7fb6e591e980 20 remove_watcher() i=5 2024-05-09T09:47:39.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.883+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:109 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93878810499648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd269410 con 0x5561dd2607e0 2024-05-09T09:47:39.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.883+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 34 ==== osd_op_reply(109 notify.6 [watch unwatch cookie 93878810499648] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.883+0000 7fb6e591e980 20 remove_watcher() i=6 2024-05-09T09:47:39.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.883+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:110 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93878810505264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5561dd26cc70 con 0x5561dd2607e0 2024-05-09T09:47:39.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.887+0000 7fb6e3439640 1 -- 172.21.15.157:0/966100362 <== osd.0 v2:172.21.15.110:6800/231209037 35 ==== osd_op_reply(110 notify.7 [watch unwatch cookie 93878810505264] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d40bda00 con 0x5561dd2607e0 2024-05-09T09:47:39.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.887+0000 7fb6e591e980 20 remove_watcher() i=7 2024-05-09T09:47:39.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.887+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5561dd2607e0 msgr2=0x5561dd262bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.887+0000 7fb6e591e980 1 --2- 172.21.15.157:0/966100362 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5561dd2607e0 0x5561dd262bd0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.887+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5561dd25be40 msgr2=0x5561dd25e2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.887+0000 7fb6e591e980 1 --2- 172.21.15.157:0/966100362 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5561dd25be40 0x5561dd25e2e0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.887+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fb6d800f3d0 msgr2=0x7fb6d800f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.887+0000 7fb6e591e980 1 --2- 172.21.15.157:0/966100362 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fb6d800f3d0 0x7fb6d800f7f0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.887+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5561dd265100 msgr2=0x5561dd267570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.887+0000 7fb6e591e980 1 --2- 172.21.15.157:0/966100362 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5561dd265100 0x5561dd267570 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.887+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb5ac034b60 msgr2=0x7fb5ac037020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.887+0000 7fb6e591e980 1 --2- 172.21.15.157:0/966100362 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb5ac034b60 0x7fb5ac037020 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x5561dd213470 tx=0x7fb6d8011000 comp rx=0 tx=0).stop 2024-05-09T09:47:39.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.887+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd248060 msgr2=0x5561dd24f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.887+0000 7fb6e591e980 1 --2- 172.21.15.157:0/966100362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd248060 0x5561dd24f440 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb6d40cfbd0 tx=0x7fb6d40d3690 comp rx=0 tx=0).stop 2024-05-09T09:47:39.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.887+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 reap_dead start 2024-05-09T09:47:39.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.887+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/966100362 reap_dead start 2024-05-09T09:47:39.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.887+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 shutdown_connections 2024-05-09T09:47:39.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.887+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 >> 172.21.15.157:0/966100362 conn(0x5561dd244430 msgr2=0x5561dd241a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:39.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.887+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 shutdown_connections 2024-05-09T09:47:39.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.887+0000 7fb6e591e980 1 -- 172.21.15.157:0/966100362 wait complete. 2024-05-09T09:47:39.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.887+0000 7fb6e591e980 1 -- 172.21.15.157:0/2171714810 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb5bc034c00 msgr2=0x7fb5bc0370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.887+0000 7fb6e591e980 1 --2- 172.21.15.157:0/2171714810 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb5bc034c00 0x7fb5bc0370c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x5561dd20ac10 tx=0x7fb6d8006000 comp rx=0 tx=0).stop 2024-05-09T09:47:39.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.887+0000 7fb6e591e980 1 -- 172.21.15.157:0/2171714810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd111120 msgr2=0x5561dd10f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.887+0000 7fb6e591e980 1 --2- 172.21.15.157:0/2171714810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd111120 0x5561dd10f5b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb6d40bdf00 tx=0x7fb6d40bd620 comp rx=0 tx=0).stop 2024-05-09T09:47:39.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.891+0000 7fb6e591e980 1 -- 172.21.15.157:0/2171714810 shutdown_connections 2024-05-09T09:47:39.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.891+0000 7fb6e591e980 1 --2- 172.21.15.157:0/2171714810 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb5bc034c00 0x7fb5bc0370c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.891+0000 7fb6e591e980 1 --2- 172.21.15.157:0/2171714810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd111120 0x5561dd10f5b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.891+0000 7fb6e591e980 1 -- 172.21.15.157:0/2171714810 >> 172.21.15.157:0/2171714810 conn(0x5561dd22dd30 msgr2=0x5561dd22e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:39.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.891+0000 7fb6e591e980 1 -- 172.21.15.157:0/2171714810 shutdown_connections 2024-05-09T09:47:39.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.891+0000 7fb6e591e980 1 -- 172.21.15.157:0/2171714810 wait complete. 2024-05-09T09:47:39.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.891+0000 7fb6e591e980 1 -- 172.21.15.157:0/709591159 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5561dd20c660 msgr2=0x5561dd20ea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.891+0000 7fb6e591e980 1 --2- 172.21.15.157:0/709591159 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5561dd20c660 0x5561dd20ea50 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.891+0000 7fb6e591e980 1 -- 172.21.15.157:0/709591159 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5561dd113b30 msgr2=0x5561dd209ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.891+0000 7fb6e591e980 1 --2- 172.21.15.157:0/709591159 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5561dd113b30 0x5561dd209ca0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.891+0000 7fb6e591e980 1 -- 172.21.15.157:0/709591159 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5561dd210580 msgr2=0x5561dd212970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.891+0000 7fb6e591e980 1 --2- 172.21.15.157:0/709591159 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5561dd210580 0x5561dd212970 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.891+0000 7fb6e591e980 1 -- 172.21.15.157:0/709591159 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb5c8034bb0 msgr2=0x7fb5c8037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.891+0000 7fb6e591e980 1 --2- 172.21.15.157:0/709591159 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb5c8034bb0 0x7fb5c8037070 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8001e20 tx=0x7fb6d80013a0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.891+0000 7fb6e591e980 1 -- 172.21.15.157:0/709591159 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd084af0 msgr2=0x5561dd202d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.891+0000 7fb6e591e980 1 --2- 172.21.15.157:0/709591159 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5561dd084af0 0x5561dd202d20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4003070 tx=0x7fb6d40180e0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.891+0000 7fb6e3c3a640 1 -- 172.21.15.157:0/709591159 reap_dead start 2024-05-09T09:47:39.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.891+0000 7fb6e591e980 1 -- 172.21.15.157:0/709591159 shutdown_connections 2024-05-09T09:47:39.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.891+0000 7fb6e591e980 1 -- 172.21.15.157:0/709591159 >> 172.21.15.157:0/709591159 conn(0x5561dd10b110 msgr2=0x5561dd1f62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:39.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.891+0000 7fb6e591e980 1 -- 172.21.15.157:0/709591159 shutdown_connections 2024-05-09T09:47:39.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.891+0000 7fb6e591e980 1 -- 172.21.15.157:0/709591159 wait complete. 2024-05-09T09:47:39.906 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-09T09:47:39.860573Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:47:39.860554Z', 'tags': [], 'group_ids': []} 2024-05-09T09:47:39.915 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-05-09T09:47:39.921 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-09T09:47:39.921 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-05-09T09:47:39.921 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-05-09T09:47:39.922 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-05-09T09:47:39.956 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:39.956 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:39.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.959+0000 7fb2597cb980 1 Processor -- start 2024-05-09T09:47:39.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.959+0000 7fb2597cb980 1 -- start start 2024-05-09T09:47:39.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.959+0000 7fb2597cb980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55606ff0ca70 0x55606ff9d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.959+0000 7fb2597cb980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55606fe4e440 con 0x55606ff9df30 2024-05-09T09:47:39.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.959+0000 7fb2597cb980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55606fe395f0 con 0x55606ff0ca70 2024-05-09T09:47:39.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.959+0000 7fb2572e6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55606ff0ca70 0x55606ff9d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.959+0000 7fb2572e6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55606ff0ca70 0x55606ff9d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58984/0 (socket says 172.21.15.157:58984) 2024-05-09T09:47:39.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.959+0000 7fb256ae5640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x55606ff9df30 0x55606ffa0320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:51696/0 (socket says 172.21.15.157:51696) 2024-05-09T09:47:39.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.959+0000 7fb2572e6640 1 -- 172.21.15.157:0/1219732081 learned_addr learned my addr 172.21.15.157:0/1219732081 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:39.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.959+0000 7fb2572e6640 1 -- 172.21.15.157:0/1219732081 >> v1:172.21.15.110:6789/0 conn(0x55606ff9df30 legacy=0x55606ffa0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.959+0000 7fb2572e6640 1 -- 172.21.15.157:0/1219732081 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55606fe44990 con 0x55606ff0ca70 2024-05-09T09:47:39.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.963+0000 7fb2572e6640 1 --2- 172.21.15.157:0/1219732081 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55606ff0ca70 0x55606ff9d9f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb24800a5c0 tx=0x7fb24801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a486d93a10262eb8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.963+0000 7fb2562e4640 1 -- 172.21.15.157:0/1219732081 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2480a6070 con 0x55606ff0ca70 2024-05-09T09:47:39.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.963+0000 7fb2562e4640 1 -- 172.21.15.157:0/1219732081 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2480af070 con 0x55606ff0ca70 2024-05-09T09:47:39.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.963+0000 7fb2562e4640 1 -- 172.21.15.157:0/1219732081 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2480aa5c0 con 0x55606ff0ca70 2024-05-09T09:47:39.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.963+0000 7fb2597cb980 1 -- 172.21.15.157:0/1219732081 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55606ff0ca70 msgr2=0x55606ff9d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.963+0000 7fb2597cb980 1 --2- 172.21.15.157:0/1219732081 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55606ff0ca70 0x55606ff9d9f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb24800a5c0 tx=0x7fb24801b340 comp rx=0 tx=0).stop 2024-05-09T09:47:39.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.963+0000 7fb2597cb980 1 -- 172.21.15.157:0/1219732081 shutdown_connections 2024-05-09T09:47:39.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.963+0000 7fb2597cb980 1 --2- 172.21.15.157:0/1219732081 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55606ff0ca70 0x55606ff9d9f0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.963+0000 7fb2597cb980 1 -- 172.21.15.157:0/1219732081 >> 172.21.15.157:0/1219732081 conn(0x55606ff930d0 msgr2=0x55606ff954f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:39.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.963+0000 7fb2597cb980 1 -- 172.21.15.157:0/1219732081 shutdown_connections 2024-05-09T09:47:39.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.963+0000 7fb2597cb980 1 -- 172.21.15.157:0/1219732081 wait complete. 2024-05-09T09:47:39.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.979+0000 7fb2597cb980 1 Processor -- start 2024-05-09T09:47:39.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.979+0000 7fb2597cb980 1 -- start start 2024-05-09T09:47:39.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.979+0000 7fb2597cb980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55606ff0ca70 0x556070085d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.979+0000 7fb2597cb980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55606fe9bfe0 con 0x55606ff0ca70 2024-05-09T09:47:39.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.983+0000 7fb2572e6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55606ff0ca70 0x556070085d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.983+0000 7fb2572e6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55606ff0ca70 0x556070085d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58986/0 (socket says 172.21.15.157:58986) 2024-05-09T09:47:39.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.983+0000 7fb2572e6640 1 -- 172.21.15.157:0/3268451721 learned_addr learned my addr 172.21.15.157:0/3268451721 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:39.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.983+0000 7fb2572e6640 1 -- 172.21.15.157:0/3268451721 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55606fe20ae0 con 0x55606ff0ca70 2024-05-09T09:47:39.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.983+0000 7fb2572e6640 1 --2- 172.21.15.157:0/3268451721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55606ff0ca70 0x556070085d10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb248018f70 tx=0x7fb248003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5395b990473df19b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.987+0000 7fb14560a640 1 -- 172.21.15.157:0/3268451721 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2480aa9e0 con 0x55606ff0ca70 2024-05-09T09:47:39.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.987+0000 7fb14560a640 1 -- 172.21.15.157:0/3268451721 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2480aab80 con 0x55606ff0ca70 2024-05-09T09:47:39.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.987+0000 7fb14560a640 1 -- 172.21.15.157:0/3268451721 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2480aae60 con 0x55606ff0ca70 2024-05-09T09:47:39.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.987+0000 7fb2597cb980 1 -- 172.21.15.157:0/3268451721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55606ff0ca70 msgr2=0x556070085d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:39.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.987+0000 7fb2597cb980 1 --2- 172.21.15.157:0/3268451721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55606ff0ca70 0x556070085d10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb248018f70 tx=0x7fb248003030 comp rx=0 tx=0).stop 2024-05-09T09:47:39.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.987+0000 7fb2597cb980 1 -- 172.21.15.157:0/3268451721 shutdown_connections 2024-05-09T09:47:39.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.987+0000 7fb2597cb980 1 --2- 172.21.15.157:0/3268451721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55606ff0ca70 0x556070085d10 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:39.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.987+0000 7fb2597cb980 1 -- 172.21.15.157:0/3268451721 >> 172.21.15.157:0/3268451721 conn(0x55606ff930d0 msgr2=0x5560700818a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:39.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.987+0000 7fb2597cb980 1 -- 172.21.15.157:0/3268451721 shutdown_connections 2024-05-09T09:47:39.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.987+0000 7fb2597cb980 1 -- 172.21.15.157:0/3268451721 wait complete. 2024-05-09T09:47:39.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.987+0000 7fb2597cb980 1 Processor -- start 2024-05-09T09:47:39.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.987+0000 7fb2597cb980 1 -- start start 2024-05-09T09:47:39.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.987+0000 7fb2597cb980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55606ff0ca70 0x55607008ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.987+0000 7fb2597cb980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55606ffa44a0 con 0x55606ff0ca70 2024-05-09T09:47:39.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.987+0000 7fb2572e6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55606ff0ca70 0x55607008ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.987+0000 7fb2572e6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55606ff0ca70 0x55607008ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:58994/0 (socket says 172.21.15.157:58994) 2024-05-09T09:47:39.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.987+0000 7fb2572e6640 1 -- 172.21.15.157:0/1460875735 learned_addr learned my addr 172.21.15.157:0/1460875735 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:39.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.987+0000 7fb2572e6640 1 -- 172.21.15.157:0/1460875735 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55607008d3c0 con 0x55606ff0ca70 2024-05-09T09:47:39.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.991+0000 7fb2572e6640 1 --2- 172.21.15.157:0/1460875735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55606ff0ca70 0x55607008ce80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb248000c10 tx=0x7fb2480180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.991+0000 7fb143e07640 1 -- 172.21.15.157:0/1460875735 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2480cb020 con 0x55606ff0ca70 2024-05-09T09:47:39.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.991+0000 7fb143e07640 1 -- 172.21.15.157:0/1460875735 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2480c6710 con 0x55606ff0ca70 2024-05-09T09:47:39.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.991+0000 7fb2597cb980 1 -- 172.21.15.157:0/1460875735 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55607008d650 con 0x55606ff0ca70 2024-05-09T09:47:39.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.991+0000 7fb143e07640 1 -- 172.21.15.157:0/1460875735 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2480c69f0 con 0x55606ff0ca70 2024-05-09T09:47:39.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.991+0000 7fb2597cb980 1 -- 172.21.15.157:0/1460875735 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560700902e0 con 0x55606ff0ca70 2024-05-09T09:47:39.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.991+0000 7fb143e07640 1 -- 172.21.15.157:0/1460875735 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fb2480ce020 con 0x55606ff0ca70 2024-05-09T09:47:39.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.991+0000 7fb143e07640 1 --2- 172.21.15.157:0/1460875735 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb13c034c50 0x7fb13c037110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.991+0000 7fb143e07640 1 -- 172.21.15.157:0/1460875735 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fb2480e5a10 con 0x55606ff0ca70 2024-05-09T09:47:39.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.991+0000 7fb256ae5640 1 --2- 172.21.15.157:0/1460875735 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb13c034c50 0x7fb13c037110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.991+0000 7fb2597cb980 1 --2- 172.21.15.157:0/1460875735 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55606ff9df30 0x556070093e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.991+0000 7fb2597cb980 1 -- 172.21.15.157:0/1460875735 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556070094470 con 0x55606ff9df30 2024-05-09T09:47:39.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.991+0000 7fb257ae7640 1 --2- 172.21.15.157:0/1460875735 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55606ff9df30 0x556070093e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.991+0000 7fb256ae5640 1 --2- 172.21.15.157:0/1460875735 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb13c034c50 0x7fb13c037110 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb24c000f70 tx=0x7fb24c001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.995+0000 7fb257ae7640 1 --2- 172.21.15.157:0/1460875735 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55606ff9df30 0x556070093e00 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.995+0000 7fb257ae7640 1 -- 172.21.15.157:0/1460875735 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x55606ff9df30 2024-05-09T09:47:39.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.995+0000 7fb2597cb980 1 -- 172.21.15.157:0/1460875735 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556070091500 con 0x55606ff9df30 2024-05-09T09:47:39.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.995+0000 7fb257ae7640 1 -- 172.21.15.157:0/1460875735 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb25000a4d0 con 0x55606ff9df30 2024-05-09T09:47:39.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.995+0000 7fb2597cb980 1 --2- 172.21.15.157:0/1460875735 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5560700967a0 0x556070098b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.995+0000 7fb2597cb980 1 -- 172.21.15.157:0/1460875735 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556070099260 con 0x5560700967a0 2024-05-09T09:47:39.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.995+0000 7fb2572e6640 1 --2- 172.21.15.157:0/1460875735 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5560700967a0 0x556070098b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.999+0000 7fb2572e6640 1 --2- 172.21.15.157:0/1460875735 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5560700967a0 0x556070098b90 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:39.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.999+0000 7fb2572e6640 1 -- 172.21.15.157:0/1460875735 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb2480bd960 con 0x5560700967a0 2024-05-09T09:47:39.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.999+0000 7fb2597cb980 1 -- 172.21.15.157:0/1460875735 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556070095640 con 0x55606ff9df30 2024-05-09T09:47:39.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.999+0000 7fb257ae7640 1 -- 172.21.15.157:0/1460875735 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb25000a4d0 con 0x55606ff9df30 2024-05-09T09:47:39.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.999+0000 7fb2597cb980 1 --2- 172.21.15.157:0/1460875735 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55607009a6c0 0x55607009cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:39.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.999+0000 7fb2597cb980 1 -- 172.21.15.157:0/1460875735 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55607009d1a0 con 0x55607009a6c0 2024-05-09T09:47:39.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.999+0000 7fb256ae5640 1 --2- 172.21.15.157:0/1460875735 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55607009a6c0 0x55607009cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:39.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.999+0000 7fb256ae5640 1 --2- 172.21.15.157:0/1460875735 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55607009a6c0 0x55607009cab0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:39.999+0000 7fb256ae5640 1 -- 172.21.15.157:0/1460875735 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb24c00f6a0 con 0x55607009a6c0 2024-05-09T09:47:40.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.003+0000 7fb2597cb980 1 Processor -- start 2024-05-09T09:47:40.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.003+0000 7fb2597cb980 1 -- start start 2024-05-09T09:47:40.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.003+0000 7fb2597cb980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560700c3090 0x5560700c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.003+0000 7fb2597cb980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55606fea0020 con 0x5560700c3090 2024-05-09T09:47:40.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.007+0000 7fb2572e6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560700c3090 0x5560700c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.007+0000 7fb2572e6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560700c3090 0x5560700c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59002/0 (socket says 172.21.15.157:59002) 2024-05-09T09:47:40.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.007+0000 7fb2572e6640 1 -- 172.21.15.157:0/3502831629 learned_addr learned my addr 172.21.15.157:0/3502831629 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:40.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.007+0000 7fb2572e6640 1 -- 172.21.15.157:0/3502831629 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560700c39f0 con 0x5560700c3090 2024-05-09T09:47:40.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.007+0000 7fb2572e6640 1 --2- 172.21.15.157:0/3502831629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560700c3090 0x5560700c34b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb2480a4fe0 tx=0x7fb2480c0dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.007+0000 7fb13bfff640 1 -- 172.21.15.157:0/3502831629 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2480cf940 con 0x5560700c3090 2024-05-09T09:47:40.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.011+0000 7fb13bfff640 1 -- 172.21.15.157:0/3502831629 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2480bc5a0 con 0x5560700c3090 2024-05-09T09:47:40.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.011+0000 7fb2597cb980 1 -- 172.21.15.157:0/3502831629 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560700c4480 con 0x5560700c3090 2024-05-09T09:47:40.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.011+0000 7fb13bfff640 1 -- 172.21.15.157:0/3502831629 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2480bc880 con 0x5560700c3090 2024-05-09T09:47:40.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.011+0000 7fb2597cb980 1 -- 172.21.15.157:0/3502831629 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560700c4960 con 0x5560700c3090 2024-05-09T09:47:40.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.011+0000 7fb13bfff640 1 -- 172.21.15.157:0/3502831629 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fb2480bca20 con 0x5560700c3090 2024-05-09T09:47:40.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.015+0000 7fb13bfff640 1 --2- 172.21.15.157:0/3502831629 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb130034c50 0x7fb130037110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.015+0000 7fb13bfff640 1 -- 172.21.15.157:0/3502831629 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fb2480f3a00 con 0x5560700c3090 2024-05-09T09:47:40.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.015+0000 7fb256ae5640 1 --2- 172.21.15.157:0/3502831629 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb130034c50 0x7fb130037110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.015+0000 7fb2597cb980 1 Processor -- start 2024-05-09T09:47:40.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.015+0000 7fb2597cb980 1 -- start start 2024-05-09T09:47:40.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.015+0000 7fb2597cb980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560700d0100 0x5560700d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.015+0000 7fb2597cb980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5560700863a0 con 0x5560700d0100 2024-05-09T09:47:40.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.015+0000 7fb256ae5640 1 --2- 172.21.15.157:0/3502831629 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb130034c50 0x7fb130037110 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x556070094d50 tx=0x7fb24c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.015+0000 7fb2572e6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560700d0100 0x5560700d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.015+0000 7fb2572e6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560700d0100 0x5560700d04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59010/0 (socket says 172.21.15.157:59010) 2024-05-09T09:47:40.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.015+0000 7fb2572e6640 1 -- 172.21.15.157:0/2773299603 learned_addr learned my addr 172.21.15.157:0/2773299603 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:40.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.019+0000 7fb2572e6640 1 -- 172.21.15.157:0/2773299603 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560700d0ab0 con 0x5560700d0100 2024-05-09T09:47:40.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.019+0000 7fb2572e6640 1 --2- 172.21.15.157:0/2773299603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560700d0100 0x5560700d04e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb2480e5010 tx=0x7fb2480d0530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9547c07ce0fc56 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.019+0000 7fb139ffb640 1 -- 172.21.15.157:0/2773299603 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2480e51e0 con 0x5560700d0100 2024-05-09T09:47:40.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.019+0000 7fb139ffb640 1 -- 172.21.15.157:0/2773299603 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2480c0640 con 0x5560700d0100 2024-05-09T09:47:40.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.019+0000 7fb139ffb640 1 -- 172.21.15.157:0/2773299603 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2480ee400 con 0x5560700d0100 2024-05-09T09:47:40.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.019+0000 7fb2597cb980 1 -- 172.21.15.157:0/2773299603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560700d0100 msgr2=0x5560700d04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.019+0000 7fb2597cb980 1 --2- 172.21.15.157:0/2773299603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560700d0100 0x5560700d04e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb2480e5010 tx=0x7fb2480d0530 comp rx=0 tx=0).stop 2024-05-09T09:47:40.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.019+0000 7fb2597cb980 1 -- 172.21.15.157:0/2773299603 shutdown_connections 2024-05-09T09:47:40.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.019+0000 7fb2597cb980 1 --2- 172.21.15.157:0/2773299603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560700d0100 0x5560700d04e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.019+0000 7fb2597cb980 1 -- 172.21.15.157:0/2773299603 >> 172.21.15.157:0/2773299603 conn(0x5560700cc480 msgr2=0x5560700ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:40.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.019+0000 7fb2597cb980 1 -- 172.21.15.157:0/2773299603 shutdown_connections 2024-05-09T09:47:40.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.019+0000 7fb2597cb980 1 -- 172.21.15.157:0/2773299603 wait complete. 2024-05-09T09:47:40.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.019+0000 7fb2597cb980 1 Processor -- start 2024-05-09T09:47:40.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.019+0000 7fb2597cb980 1 -- start start 2024-05-09T09:47:40.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.019+0000 7fb2597cb980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560700d0100 0x5560700d7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.019+0000 7fb2597cb980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5560700d11c0 con 0x5560700d0100 2024-05-09T09:47:40.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.019+0000 7fb2572e6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560700d0100 0x5560700d7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.019+0000 7fb2572e6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560700d0100 0x5560700d7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59020/0 (socket says 172.21.15.157:59020) 2024-05-09T09:47:40.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.019+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 learned_addr learned my addr 172.21.15.157:0/98250494 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:40.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.019+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560700d79b0 con 0x5560700d0100 2024-05-09T09:47:40.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.019+0000 7fb2572e6640 1 --2- 172.21.15.157:0/98250494 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560700d0100 0x5560700d7470 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb2480cfba0 tx=0x7fb2480aff40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb127fff640 1 -- 172.21.15.157:0/98250494 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2480e50b0 con 0x5560700d0100 2024-05-09T09:47:40.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560700d79b0 con 0x5560700d0100 2024-05-09T09:47:40.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb127fff640 1 -- 172.21.15.157:0/98250494 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2480f3c50 con 0x5560700d0100 2024-05-09T09:47:40.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560700d7e30 con 0x5560700d0100 2024-05-09T09:47:40.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb127fff640 1 -- 172.21.15.157:0/98250494 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2480e5250 con 0x5560700d0100 2024-05-09T09:47:40.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb127fff640 1 -- 172.21.15.157:0/98250494 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fb2480ee780 con 0x5560700d0100 2024-05-09T09:47:40.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb2597cb980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb127fff640 1 --2- 172.21.15.157:0/98250494 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb120034bb0 0x7fb120037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb127fff640 1 -- 172.21.15.157:0/98250494 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fb248114c90 con 0x5560700d0100 2024-05-09T09:47:40.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb256ae5640 1 --2- 172.21.15.157:0/98250494 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb120034bb0 0x7fb120037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb2597cb980 1 --2- 172.21.15.157:0/98250494 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5560700e3e70 0x5560700e6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560700e6a80 con 0x5560700e3e70 2024-05-09T09:47:40.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb257ae7640 1 --2- 172.21.15.157:0/98250494 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5560700e3e70 0x5560700e6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb256ae5640 1 --2- 172.21.15.157:0/98250494 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb120034bb0 0x7fb120037070 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb24c00ffd0 tx=0x7fb24c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb257ae7640 1 --2- 172.21.15.157:0/98250494 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5560700e3e70 0x5560700e6330 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x5560700e3e70 2024-05-09T09:47:40.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb2597cb980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:40.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb2597cb980 20 realm 2024-05-09T09:47:40.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb2597cb980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560700e6e90 con 0x5560700e3e70 2024-05-09T09:47:40.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x5560700e3e70 2024-05-09T09:47:40.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb2597cb980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:40.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb2597cb980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:40.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb2597cb980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7730 con 0x5560700e3e70 2024-05-09T09:47:40.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x5560700e3e70 2024-05-09T09:47:40.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb2597cb980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:40.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb2597cb980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x5560700e3e70 2024-05-09T09:47:40.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb25000a4d0 con 0x5560700e3e70 2024-05-09T09:47:40.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb2597cb980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:40.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb2597cb980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb2597cb980 1 --2- 172.21.15.157:0/98250494 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5560700e8600 0x5560700ea9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.023+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560700eb130 con 0x5560700e8600 2024-05-09T09:47:40.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.027+0000 7fb2572e6640 1 --2- 172.21.15.157:0/98250494 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5560700e8600 0x5560700ea9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.027+0000 7fb2572e6640 1 --2- 172.21.15.157:0/98250494 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5560700e8600 0x5560700ea9f0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.027+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb2480eb020 con 0x5560700e8600 2024-05-09T09:47:40.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.027+0000 7fb2597cb980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:40.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.027+0000 7fb2597cb980 20 searching for the correct realm 2024-05-09T09:47:40.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.027+0000 7fb2597cb980 1 --2- 172.21.15.157:0/98250494 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5560700ed0d0 0x5560700ef560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.027+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700efc30 con 0x5560700ed0d0 2024-05-09T09:47:40.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.027+0000 7fb256ae5640 1 --2- 172.21.15.157:0/98250494 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5560700ed0d0 0x5560700ef560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.027+0000 7fb256ae5640 1 --2- 172.21.15.157:0/98250494 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5560700ed0d0 0x5560700ef560 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.027+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c037040 con 0x5560700ed0d0 2024-05-09T09:47:40.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.027+0000 7fb256ae5640 1 --2- 172.21.15.157:0/98250494 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fb24c01fbe0 0x7fb24c03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.027+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700efc30 con 0x7fb24c01fbe0 2024-05-09T09:47:40.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.027+0000 7fb257ae7640 1 --2- 172.21.15.157:0/98250494 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fb24c01fbe0 0x7fb24c03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.027+0000 7fb257ae7640 1 --2- 172.21.15.157:0/98250494 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fb24c01fbe0 0x7fb24c03a3c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.027+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25000a4d0 con 0x7fb24c01fbe0 2024-05-09T09:47:40.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.027+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x5560700e8600 2024-05-09T09:47:40.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.031+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2480eb020 con 0x5560700e8600 2024-05-09T09:47:40.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.031+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x5560700e3e70 2024-05-09T09:47:40.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.031+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25000a4d0 con 0x5560700e3e70 2024-05-09T09:47:40.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.031+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x5560700e3e70 2024-05-09T09:47:40.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.031+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25000a4d0 con 0x5560700e3e70 2024-05-09T09:47:40.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.031+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x5560700e8600 2024-05-09T09:47:40.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.031+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2480eb020 con 0x5560700e8600 2024-05-09T09:47:40.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.031+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x5560700e8600 2024-05-09T09:47:40.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.031+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2480eb020 con 0x5560700e8600 2024-05-09T09:47:40.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.031+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x7fb24c01fbe0 2024-05-09T09:47:40.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.031+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25000a4d0 con 0x7fb24c01fbe0 2024-05-09T09:47:40.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.031+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x5560700ed0d0 2024-05-09T09:47:40.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.031+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c037040 con 0x5560700ed0d0 2024-05-09T09:47:40.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.031+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x5560700e3e70 2024-05-09T09:47:40.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.031+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25000a4d0 con 0x5560700e3e70 2024-05-09T09:47:40.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.031+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x5560700e8600 2024-05-09T09:47:40.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.031+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2480eb020 con 0x5560700e8600 2024-05-09T09:47:40.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.035+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x5560700e3e70 2024-05-09T09:47:40.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.035+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25000a4d0 con 0x5560700e3e70 2024-05-09T09:47:40.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.035+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x7fb24c01fbe0 2024-05-09T09:47:40.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.035+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb25000a4d0 con 0x7fb24c01fbe0 2024-05-09T09:47:40.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.035+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x5560700ed0d0 2024-05-09T09:47:40.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.035+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c037040 con 0x5560700ed0d0 2024-05-09T09:47:40.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.035+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x5560700ed0d0 2024-05-09T09:47:40.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.035+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb24c037040 con 0x5560700ed0d0 2024-05-09T09:47:40.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.035+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x5560700e8600 2024-05-09T09:47:40.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.035+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2480eb020 con 0x5560700e8600 2024-05-09T09:47:40.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.035+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x5560700ed0d0 2024-05-09T09:47:40.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.035+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c037040 con 0x5560700ed0d0 2024-05-09T09:47:40.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.035+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x5560700ed0d0 2024-05-09T09:47:40.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.035+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c037040 con 0x5560700ed0d0 2024-05-09T09:47:40.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.035+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x5560700e3e70 2024-05-09T09:47:40.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.035+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25000a4d0 con 0x5560700e3e70 2024-05-09T09:47:40.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.035+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x5560700e3e70 2024-05-09T09:47:40.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.035+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb25000a4d0 con 0x5560700e3e70 2024-05-09T09:47:40.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.035+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x5560700e8600 2024-05-09T09:47:40.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.039+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2480eb020 con 0x5560700e8600 2024-05-09T09:47:40.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.039+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x5560700ed0d0 2024-05-09T09:47:40.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.039+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c037040 con 0x5560700ed0d0 2024-05-09T09:47:40.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.039+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x7fb24c01fbe0 2024-05-09T09:47:40.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.039+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25000a4d0 con 0x7fb24c01fbe0 2024-05-09T09:47:40.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.039+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x5560700e3e70 2024-05-09T09:47:40.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.039+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25000a4d0 con 0x5560700e3e70 2024-05-09T09:47:40.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.039+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x5560700e8600 2024-05-09T09:47:40.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.039+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb2480eb020 con 0x5560700e8600 2024-05-09T09:47:40.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.039+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x5560700ed0d0 2024-05-09T09:47:40.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.039+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c037040 con 0x5560700ed0d0 2024-05-09T09:47:40.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.039+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x5560700e8600 2024-05-09T09:47:40.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.039+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2480eb020 con 0x5560700e8600 2024-05-09T09:47:40.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.039+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x7fb24c01fbe0 2024-05-09T09:47:40.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.039+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25000a4d0 con 0x7fb24c01fbe0 2024-05-09T09:47:40.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.039+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x5560700ed0d0 2024-05-09T09:47:40.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.039+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb24c04a040 con 0x5560700ed0d0 2024-05-09T09:47:40.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.039+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x5560700e8600 2024-05-09T09:47:40.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2480eb020 con 0x5560700e8600 2024-05-09T09:47:40.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x5560700e3e70 2024-05-09T09:47:40.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb25000a4d0 con 0x5560700e3e70 2024-05-09T09:47:40.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5560700e7ad0 con 0x7fb24c01fbe0 2024-05-09T09:47:40.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25000a4d0 con 0x7fb24c01fbe0 2024-05-09T09:47:40.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:40.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:40.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:40.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:40.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:40.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:40.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560700eb9f0 con 0x5560700e3e70 2024-05-09T09:47:40.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x5560700e3e70 2024-05-09T09:47:40.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:40.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560700eb9f0 con 0x5560700e3e70 2024-05-09T09:47:40.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb25000a4d0 con 0x5560700e3e70 2024-05-09T09:47:40.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:40.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560700eb9f0 con 0x5560700ed0d0 2024-05-09T09:47:40.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb24c04a040 con 0x5560700ed0d0 2024-05-09T09:47:40.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:40.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 20 zone default found 2024-05-09T09:47:40.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 4 Realm: () 2024-05-09T09:47:40.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:40.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:40.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:40.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 20 zonegroup default 2024-05-09T09:47:40.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560700ec290 con 0x5560700e8600 2024-05-09T09:47:40.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb2480eb020 con 0x5560700e8600 2024-05-09T09:47:40.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:40.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560700f1a90 con 0x5560700ed0d0 2024-05-09T09:47:40.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb24c04a040 con 0x5560700ed0d0 2024-05-09T09:47:40.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:40.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560700f1e30 con 0x5560700ed0d0 2024-05-09T09:47:40.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb24c04a040 con 0x5560700ed0d0 2024-05-09T09:47:40.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:40.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 20 started sync module instance, tier type = 2024-05-09T09:47:40.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:40.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.043+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560700f0f30 con 0x7fb24c01fbe0 2024-05-09T09:47:40.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.047+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x7fb24c01fbe0 2024-05-09T09:47:40.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.047+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93872685257808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560700f0f30 con 0x7fb24c01fbe0 2024-05-09T09:47:40.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.047+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560700f2860 con 0x5560700e3e70 2024-05-09T09:47:40.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.047+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93872685257808] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x7fb24c01fbe0 2024-05-09T09:47:40.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.047+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x5560700e3e70 2024-05-09T09:47:40.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.047+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93872685261632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560700f0f30 con 0x5560700e3e70 2024-05-09T09:47:40.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.047+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560700f32a0 con 0x5560700ed0d0 2024-05-09T09:47:40.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.051+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93872685261632] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x5560700e3e70 2024-05-09T09:47:40.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.051+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb24c04a040 con 0x5560700ed0d0 2024-05-09T09:47:40.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.051+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93872685255296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560700f0ea0 con 0x5560700ed0d0 2024-05-09T09:47:40.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.051+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560700f4050 con 0x7fb24c01fbe0 2024-05-09T09:47:40.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.051+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x7fb24c01fbe0 2024-05-09T09:47:40.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.051+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93872685267776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560700f48f0 con 0x7fb24c01fbe0 2024-05-09T09:47:40.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.051+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560700f52f0 con 0x5560700e3e70 2024-05-09T09:47:40.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.051+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93872685255296] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb24c04a040 con 0x5560700ed0d0 2024-05-09T09:47:40.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.055+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93872685267776] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x7fb24c01fbe0 2024-05-09T09:47:40.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.055+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x5560700e3e70 2024-05-09T09:47:40.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.055+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93872685266576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560700f43f0 con 0x5560700e3e70 2024-05-09T09:47:40.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.055+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560700f5b90 con 0x5560700e8600 2024-05-09T09:47:40.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.055+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93872685266576] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x5560700e3e70 2024-05-09T09:47:40.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.055+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2480eb020 con 0x5560700e8600 2024-05-09T09:47:40.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.055+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93872685274848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560700f43f0 con 0x5560700e8600 2024-05-09T09:47:40.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.055+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560700f63e0 con 0x5560700e8600 2024-05-09T09:47:40.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.059+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2480eb020 con 0x5560700e8600 2024-05-09T09:47:40.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.059+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93872685279104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560700f7050 con 0x5560700e8600 2024-05-09T09:47:40.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.059+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560700f7a10 con 0x5560700e8600 2024-05-09T09:47:40.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.059+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93872685274848] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2480eb020 con 0x5560700e8600 2024-05-09T09:47:40.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.059+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2480eb020 con 0x5560700e8600 2024-05-09T09:47:40.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.059+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93872685282656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560700f7e30 con 0x5560700e8600 2024-05-09T09:47:40.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.059+0000 7fb2597cb980 20 add_watcher() i=0 2024-05-09T09:47:40.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.059+0000 7fb2597cb980 20 add_watcher() i=1 2024-05-09T09:47:40.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.059+0000 7fb2597cb980 20 add_watcher() i=2 2024-05-09T09:47:40.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.059+0000 7fb2597cb980 20 add_watcher() i=3 2024-05-09T09:47:40.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.059+0000 7fb2597cb980 20 add_watcher() i=4 2024-05-09T09:47:40.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.059+0000 7fb2597cb980 20 add_watcher() i=5 2024-05-09T09:47:40.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.063+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93872685279104] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2480eb020 con 0x5560700e8600 2024-05-09T09:47:40.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.063+0000 7fb2597cb980 20 add_watcher() i=6 2024-05-09T09:47:40.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.063+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93872685282656] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2480eb020 con 0x5560700e8600 2024-05-09T09:47:40.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.063+0000 7fb2597cb980 20 add_watcher() i=7 2024-05-09T09:47:40.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.063+0000 7fb2597cb980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:40.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.063+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5560700fae60 con 0x5560700e3e70 2024-05-09T09:47:40.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.063+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb25000a4d0 con 0x5560700e3e70 2024-05-09T09:47:40.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.063+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93872685283712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560700f8250 con 0x5560700e3e70 2024-05-09T09:47:40.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.063+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93872685283712] v30'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x5560700e3e70 2024-05-09T09:47:40.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.063+0000 7fb10cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:40.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.063+0000 7fb2597cb980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:40.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.063+0000 7fb2597cb980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:40.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.063+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556070103250 con 0x5560700e3e70 2024-05-09T09:47:40.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.067+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'52 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x5560700e3e70 2024-05-09T09:47:40.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.067+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556070103900 con 0x5560700e8600 2024-05-09T09:47:40.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.071+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'47 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2480eb020 con 0x5560700e8600 2024-05-09T09:47:40.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.071+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556070103900 con 0x5560700ed0d0 2024-05-09T09:47:40.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.071+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'46 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb24c04a040 con 0x5560700ed0d0 2024-05-09T09:47:40.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.071+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560701043a0 con 0x5560700e3e70 2024-05-09T09:47:40.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.075+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'205 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x5560700e3e70 2024-05-09T09:47:40.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.075+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556070104910 con 0x7fb24c01fbe0 2024-05-09T09:47:40.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.075+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'128 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x7fb24c01fbe0 2024-05-09T09:47:40.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.075+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556070104dc0 con 0x5560700ed0d0 2024-05-09T09:47:40.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.075+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'86 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb24c04a040 con 0x5560700ed0d0 2024-05-09T09:47:40.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.075+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556070101230 con 0x5560700e3e70 2024-05-09T09:47:40.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.079+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'48 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x5560700e3e70 2024-05-09T09:47:40.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.079+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556070101230 con 0x5560700e8600 2024-05-09T09:47:40.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.079+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'85 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2480eb020 con 0x5560700e8600 2024-05-09T09:47:40.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.079+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556070101230 con 0x7fb24c01fbe0 2024-05-09T09:47:40.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.083+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'46 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x7fb24c01fbe0 2024-05-09T09:47:40.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.083+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556070101360 con 0x5560700ed0d0 2024-05-09T09:47:40.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.083+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'52 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb24c04a040 con 0x5560700ed0d0 2024-05-09T09:47:40.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.083+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556070105920 con 0x7fb24c01fbe0 2024-05-09T09:47:40.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.087+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'129 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x7fb24c01fbe0 2024-05-09T09:47:40.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.087+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556070105920 con 0x5560700e8600 2024-05-09T09:47:40.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.087+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'48 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2480eb020 con 0x5560700e8600 2024-05-09T09:47:40.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.087+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556070105920 con 0x7fb24c01fbe0 2024-05-09T09:47:40.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.087+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'46 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x7fb24c01fbe0 2024-05-09T09:47:40.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.087+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556070105920 con 0x5560700e8600 2024-05-09T09:47:40.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.091+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'91 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2480eb020 con 0x5560700e8600 2024-05-09T09:47:40.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.091+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556070105920 con 0x5560700e3e70 2024-05-09T09:47:40.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.091+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'206 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x5560700e3e70 2024-05-09T09:47:40.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.091+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556070105920 con 0x5560700ed0d0 2024-05-09T09:47:40.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.095+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'122 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb24c04a040 con 0x5560700ed0d0 2024-05-09T09:47:40.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.095+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556070105920 con 0x7fb24c01fbe0 2024-05-09T09:47:40.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.095+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'130 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x7fb24c01fbe0 2024-05-09T09:47:40.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.095+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556070105920 con 0x5560700ed0d0 2024-05-09T09:47:40.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.099+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'46 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb24c04a040 con 0x5560700ed0d0 2024-05-09T09:47:40.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.099+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560701059b0 con 0x5560700e3e70 2024-05-09T09:47:40.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.099+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'54 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x5560700e3e70 2024-05-09T09:47:40.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.099+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560701059b0 con 0x5560700e3e70 2024-05-09T09:47:40.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.099+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'207 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x5560700e3e70 2024-05-09T09:47:40.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.099+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560701059b0 con 0x5560700ed0d0 2024-05-09T09:47:40.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.103+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'123 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb24c04a040 con 0x5560700ed0d0 2024-05-09T09:47:40.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.103+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556070105a40 con 0x7fb24c01fbe0 2024-05-09T09:47:40.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.103+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'56 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x7fb24c01fbe0 2024-05-09T09:47:40.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.103+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556070105a40 con 0x5560700ed0d0 2024-05-09T09:47:40.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.107+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'48 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb24c04a040 con 0x5560700ed0d0 2024-05-09T09:47:40.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.107+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556070105a40 con 0x5560700ed0d0 2024-05-09T09:47:40.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.107+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'52 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb24c04a040 con 0x5560700ed0d0 2024-05-09T09:47:40.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.107+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556070100c40 con 0x5560700ed0d0 2024-05-09T09:47:40.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.107+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'42 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb24c04a040 con 0x5560700ed0d0 2024-05-09T09:47:40.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.107+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556070100c40 con 0x5560700ed0d0 2024-05-09T09:47:40.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.111+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'87 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb24c04a040 con 0x5560700ed0d0 2024-05-09T09:47:40.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.111+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556070100e10 con 0x5560700e8600 2024-05-09T09:47:40.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.115+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'48 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2480eb020 con 0x5560700e8600 2024-05-09T09:47:40.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.115+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556070100e10 con 0x5560700ed0d0 2024-05-09T09:47:40.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.115+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'46 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb24c04a040 con 0x5560700ed0d0 2024-05-09T09:47:40.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.115+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556070100e10 con 0x5560700e8600 2024-05-09T09:47:40.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.119+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'86 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2480eb020 con 0x5560700e8600 2024-05-09T09:47:40.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.119+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556070100e10 con 0x5560700ed0d0 2024-05-09T09:47:40.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.119+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'124 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb24c04a040 con 0x5560700ed0d0 2024-05-09T09:47:40.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.119+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556070100e10 con 0x5560700e8600 2024-05-09T09:47:40.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.123+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'92 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2480eb020 con 0x5560700e8600 2024-05-09T09:47:40.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.123+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556070100e10 con 0x7fb24c01fbe0 2024-05-09T09:47:40.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.123+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'52 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x7fb24c01fbe0 2024-05-09T09:47:40.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.127+0000 7fb0877fe640 20 reqs_thread_entry: start 2024-05-09T09:47:40.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.127+0000 7fb2597cb980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:40.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.127+0000 7fb0857fa640 20 reqs_thread_entry: start 2024-05-09T09:47:40.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.127+0000 7fb2597cb980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.127+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556070121590 con 0x7fb24c01fbe0 2024-05-09T09:47:40.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.127+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(94 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7fb25000a4d0 con 0x7fb24c01fbe0 2024-05-09T09:47:40.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.127+0000 7fb2597cb980 20 rados_obj.operate() r=0 bl.length=165 2024-05-09T09:47:40.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.127+0000 7fb10cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:40.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.127+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93872685283712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560700fcb70 con 0x5560700e3e70 2024-05-09T09:47:40.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.131+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93872685283712] v30'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x5560700e3e70 2024-05-09T09:47:40.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.131+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93872685257808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560700fcb70 con 0x7fb24c01fbe0 2024-05-09T09:47:40.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.131+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93872685257808] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x7fb24c01fbe0 2024-05-09T09:47:40.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.131+0000 7fb2597cb980 20 remove_watcher() i=0 2024-05-09T09:47:40.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.131+0000 7fb2597cb980 2 removed watcher, disabling cache 2024-05-09T09:47:40.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.131+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93872685261632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560700f1450 con 0x5560700e3e70 2024-05-09T09:47:40.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.135+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93872685261632] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x5560700e3e70 2024-05-09T09:47:40.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.135+0000 7fb2597cb980 20 remove_watcher() i=1 2024-05-09T09:47:40.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.135+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93872685255296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560700f1450 con 0x5560700ed0d0 2024-05-09T09:47:40.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.135+0000 7fb256ae5640 1 -- 172.21.15.157:0/98250494 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93872685255296] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb24c04a040 con 0x5560700ed0d0 2024-05-09T09:47:40.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.135+0000 7fb2597cb980 20 remove_watcher() i=2 2024-05-09T09:47:40.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.135+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93872685267776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560700f0a80 con 0x7fb24c01fbe0 2024-05-09T09:47:40.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.139+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93872685267776] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x7fb24c01fbe0 2024-05-09T09:47:40.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.139+0000 7fb2597cb980 20 remove_watcher() i=3 2024-05-09T09:47:40.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.139+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93872685266576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560700f1450 con 0x5560700e3e70 2024-05-09T09:47:40.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.139+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93872685266576] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25000a4d0 con 0x5560700e3e70 2024-05-09T09:47:40.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.139+0000 7fb2597cb980 20 remove_watcher() i=4 2024-05-09T09:47:40.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.139+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93872685274848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560700f0a80 con 0x5560700e8600 2024-05-09T09:47:40.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.143+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93872685274848] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2480eb020 con 0x5560700e8600 2024-05-09T09:47:40.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.143+0000 7fb2597cb980 20 remove_watcher() i=5 2024-05-09T09:47:40.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.143+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93872685279104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560700f1450 con 0x5560700e8600 2024-05-09T09:47:40.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.143+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93872685279104] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2480eb020 con 0x5560700e8600 2024-05-09T09:47:40.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.143+0000 7fb2597cb980 20 remove_watcher() i=6 2024-05-09T09:47:40.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.143+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93872685282656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5560700f0a80 con 0x5560700e8600 2024-05-09T09:47:40.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2572e6640 1 -- 172.21.15.157:0/98250494 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93872685282656] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2480eb020 con 0x5560700e8600 2024-05-09T09:47:40.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 20 remove_watcher() i=7 2024-05-09T09:47:40.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5560700e8600 msgr2=0x5560700ea9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 --2- 172.21.15.157:0/98250494 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5560700e8600 0x5560700ea9f0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5560700e3e70 msgr2=0x5560700e6330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 --2- 172.21.15.157:0/98250494 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5560700e3e70 0x5560700e6330 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fb24c01fbe0 msgr2=0x7fb24c03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 --2- 172.21.15.157:0/98250494 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fb24c01fbe0 0x7fb24c03a3c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5560700ed0d0 msgr2=0x5560700ef560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 --2- 172.21.15.157:0/98250494 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5560700ed0d0 0x5560700ef560 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb120034bb0 msgr2=0x7fb120037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 --2- 172.21.15.157:0/98250494 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb120034bb0 0x7fb120037070 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb24c00ffd0 tx=0x7fb24c010000 comp rx=0 tx=0).stop 2024-05-09T09:47:40.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560700d0100 msgr2=0x5560700d7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb257ae7640 1 -- 172.21.15.157:0/98250494 reap_dead start 2024-05-09T09:47:40.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 --2- 172.21.15.157:0/98250494 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560700d0100 0x5560700d7470 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb2480cfba0 tx=0x7fb2480aff40 comp rx=0 tx=0).stop 2024-05-09T09:47:40.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 shutdown_connections 2024-05-09T09:47:40.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 --2- 172.21.15.157:0/98250494 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560700d0100 0x5560700d7470 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 >> 172.21.15.157:0/98250494 conn(0x5560700cc480 msgr2=0x5560700c9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:40.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 shutdown_connections 2024-05-09T09:47:40.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 -- 172.21.15.157:0/98250494 wait complete. 2024-05-09T09:47:40.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 -- 172.21.15.157:0/3502831629 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb130034c50 msgr2=0x7fb130037110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 --2- 172.21.15.157:0/3502831629 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb130034c50 0x7fb130037110 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x556070094d50 tx=0x7fb24c00f000 comp rx=0 tx=0).stop 2024-05-09T09:47:40.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 -- 172.21.15.157:0/3502831629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560700c3090 msgr2=0x5560700c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 --2- 172.21.15.157:0/3502831629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560700c3090 0x5560700c34b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb2480a4fe0 tx=0x7fb2480c0dc0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 -- 172.21.15.157:0/3502831629 shutdown_connections 2024-05-09T09:47:40.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 --2- 172.21.15.157:0/3502831629 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb130034c50 0x7fb130037110 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 --2- 172.21.15.157:0/3502831629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5560700c3090 0x5560700c34b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 -- 172.21.15.157:0/3502831629 >> 172.21.15.157:0/3502831629 conn(0x5560700b7e60 msgr2=0x5560700b8970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:40.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 -- 172.21.15.157:0/3502831629 shutdown_connections 2024-05-09T09:47:40.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 -- 172.21.15.157:0/3502831629 wait complete. 2024-05-09T09:47:40.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 -- 172.21.15.157:0/1460875735 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5560700967a0 msgr2=0x556070098b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 --2- 172.21.15.157:0/1460875735 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5560700967a0 0x556070098b90 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 -- 172.21.15.157:0/1460875735 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55606ff9df30 msgr2=0x556070093e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 --2- 172.21.15.157:0/1460875735 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55606ff9df30 0x556070093e00 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 -- 172.21.15.157:0/1460875735 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55607009a6c0 msgr2=0x55607009cab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 --2- 172.21.15.157:0/1460875735 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55607009a6c0 0x55607009cab0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 -- 172.21.15.157:0/1460875735 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb13c034c50 msgr2=0x7fb13c037110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 --2- 172.21.15.157:0/1460875735 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb13c034c50 0x7fb13c037110 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb24c000f70 tx=0x7fb24c001380 comp rx=0 tx=0).stop 2024-05-09T09:47:40.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 -- 172.21.15.157:0/1460875735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55606ff0ca70 msgr2=0x55607008ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 --2- 172.21.15.157:0/1460875735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55606ff0ca70 0x55607008ce80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb248000c10 tx=0x7fb2480180e0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb257ae7640 1 -- 172.21.15.157:0/1460875735 reap_dead start 2024-05-09T09:47:40.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 -- 172.21.15.157:0/1460875735 shutdown_connections 2024-05-09T09:47:40.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 -- 172.21.15.157:0/1460875735 >> 172.21.15.157:0/1460875735 conn(0x55606ff930d0 msgr2=0x5560700803b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:40.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 -- 172.21.15.157:0/1460875735 shutdown_connections 2024-05-09T09:47:40.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.147+0000 7fb2597cb980 1 -- 172.21.15.157:0/1460875735 wait complete. 2024-05-09T09:47:40.161 INFO:teuthology.orchestra.run.smithi157.stdout:{"key":"bucket:myfoo","ver":{"tag":"_f7tDKiQdRqpFVrZTbRZec_3","ver":2},"mtime":"2024-05-09T09:47:39.562513Z","data":{"bucket":{"name":"myfoo","marker":"b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1","bucket_id":"b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-05-09T09:47:37.451022Z","linked":false,"has_bucket_info":false}} 2024-05-09T09:47:40.161 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_f7tDKiQdRqpFVrZTbRZec_3', 'ver': 2}, 'mtime': '2024-05-09T09:47:39.562513Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1', 'bucket_id': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-05-09T09:47:37.451022Z', 'linked': False, 'has_bucket_info': False}} 2024-05-09T09:47:40.161 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1'] 2024-05-09T09:47:40.161 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1'] 2024-05-09T09:47:40.161 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 2024-05-09T09:47:40.244 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:40.244 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:40.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.247+0000 7f1f83a92980 1 Processor -- start 2024-05-09T09:47:40.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.247+0000 7f1f83a92980 1 -- start start 2024-05-09T09:47:40.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.247+0000 7f1f83a92980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x556a4130fad0 0x556a4130feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.247+0000 7f1f83a92980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556a411c3440 con 0x556a413103f0 2024-05-09T09:47:40.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.247+0000 7f1f83a92980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x556a411ae5f0 con 0x556a4130fad0 2024-05-09T09:47:40.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.247+0000 7f1f815ad640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x556a4130fad0 0x556a4130feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.247+0000 7f1f815ad640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x556a4130fad0 0x556a4130feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59034/0 (socket says 172.21.15.157:59034) 2024-05-09T09:47:40.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.247+0000 7f1f80dac640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x556a413103f0 0x556a41310da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:51702/0 (socket says 172.21.15.157:51702) 2024-05-09T09:47:40.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.247+0000 7f1f815ad640 1 -- 172.21.15.157:0/3743680186 learned_addr learned my addr 172.21.15.157:0/3743680186 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:40.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.247+0000 7f1f815ad640 1 -- 172.21.15.157:0/3743680186 >> v1:172.21.15.110:6789/0 conn(0x556a413103f0 legacy=0x556a41310da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.247+0000 7f1f815ad640 1 -- 172.21.15.157:0/3743680186 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a411b9990 con 0x556a4130fad0 2024-05-09T09:47:40.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.251+0000 7f1f815ad640 1 --2- 172.21.15.157:0/3743680186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a4130fad0 0x556a4130feb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1f7400a4e0 tx=0x7f1f7401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85429a059a13aa53 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.251+0000 7f1f73fff640 1 -- 172.21.15.157:0/3743680186 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f740aa540 con 0x556a4130fad0 2024-05-09T09:47:40.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.251+0000 7f1f73fff640 1 -- 172.21.15.157:0/3743680186 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f740aa6e0 con 0x556a4130fad0 2024-05-09T09:47:40.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.251+0000 7f1f73fff640 1 -- 172.21.15.157:0/3743680186 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f740aaa40 con 0x556a4130fad0 2024-05-09T09:47:40.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.251+0000 7f1f83a92980 1 -- 172.21.15.157:0/3743680186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a4130fad0 msgr2=0x556a4130feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.251+0000 7f1f83a92980 1 --2- 172.21.15.157:0/3743680186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a4130fad0 0x556a4130feb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1f7400a4e0 tx=0x7f1f7401b090 comp rx=0 tx=0).stop 2024-05-09T09:47:40.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.251+0000 7f1f83a92980 1 -- 172.21.15.157:0/3743680186 shutdown_connections 2024-05-09T09:47:40.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.251+0000 7f1f83a92980 1 --2- 172.21.15.157:0/3743680186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a4130fad0 0x556a4130feb0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.251+0000 7f1f83a92980 1 -- 172.21.15.157:0/3743680186 >> 172.21.15.157:0/3743680186 conn(0x556a412831f0 msgr2=0x556a41283600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:40.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.251+0000 7f1f83a92980 1 -- 172.21.15.157:0/3743680186 shutdown_connections 2024-05-09T09:47:40.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.251+0000 7f1f83a92980 1 -- 172.21.15.157:0/3743680186 wait complete. 2024-05-09T09:47:40.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.267+0000 7f1f83a92980 1 Processor -- start 2024-05-09T09:47:40.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.267+0000 7f1f83a92980 1 -- start start 2024-05-09T09:47:40.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.267+0000 7f1f83a92980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a4130fad0 0x556a413fb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.267+0000 7f1f83a92980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x556a41210fe0 con 0x556a4130fad0 2024-05-09T09:47:40.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.267+0000 7f1f815ad640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a4130fad0 0x556a413fb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.267+0000 7f1f815ad640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a4130fad0 0x556a413fb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59048/0 (socket says 172.21.15.157:59048) 2024-05-09T09:47:40.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.267+0000 7f1f815ad640 1 -- 172.21.15.157:0/3694799670 learned_addr learned my addr 172.21.15.157:0/3694799670 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:40.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.267+0000 7f1f815ad640 1 -- 172.21.15.157:0/3694799670 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a41195ae0 con 0x556a4130fad0 2024-05-09T09:47:40.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.267+0000 7f1f815ad640 1 --2- 172.21.15.157:0/3694799670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a4130fad0 0x556a413fb4b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1f740ac040 tx=0x7f1f740033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c897b5989dcae5d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.267+0000 7f1e6f606640 1 -- 172.21.15.157:0/3694799670 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f740b9030 con 0x556a4130fad0 2024-05-09T09:47:40.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.267+0000 7f1e6f606640 1 -- 172.21.15.157:0/3694799670 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f740aaa40 con 0x556a4130fad0 2024-05-09T09:47:40.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.267+0000 7f1e6f606640 1 -- 172.21.15.157:0/3694799670 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f740aad20 con 0x556a4130fad0 2024-05-09T09:47:40.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.271+0000 7f1f83a92980 1 -- 172.21.15.157:0/3694799670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a4130fad0 msgr2=0x556a413fb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.271+0000 7f1f83a92980 1 --2- 172.21.15.157:0/3694799670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a4130fad0 0x556a413fb4b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1f740ac040 tx=0x7f1f740033b0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.271+0000 7f1f83a92980 1 -- 172.21.15.157:0/3694799670 shutdown_connections 2024-05-09T09:47:40.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.271+0000 7f1f83a92980 1 --2- 172.21.15.157:0/3694799670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a4130fad0 0x556a413fb4b0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.271+0000 7f1f83a92980 1 -- 172.21.15.157:0/3694799670 >> 172.21.15.157:0/3694799670 conn(0x556a412831f0 msgr2=0x556a413f7040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:40.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.271+0000 7f1f83a92980 1 -- 172.21.15.157:0/3694799670 shutdown_connections 2024-05-09T09:47:40.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.271+0000 7f1f83a92980 1 -- 172.21.15.157:0/3694799670 wait complete. 2024-05-09T09:47:40.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.271+0000 7f1f83a92980 1 Processor -- start 2024-05-09T09:47:40.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.271+0000 7f1f83a92980 1 -- start start 2024-05-09T09:47:40.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.271+0000 7f1f83a92980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a4130fad0 0x556a41402550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.271+0000 7f1f83a92980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x556a41319b10 con 0x556a4130fad0 2024-05-09T09:47:40.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.271+0000 7f1f815ad640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a4130fad0 0x556a41402550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.271+0000 7f1f815ad640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a4130fad0 0x556a41402550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59052/0 (socket says 172.21.15.157:59052) 2024-05-09T09:47:40.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.271+0000 7f1f815ad640 1 -- 172.21.15.157:0/3784666367 learned_addr learned my addr 172.21.15.157:0/3784666367 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:40.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.271+0000 7f1f815ad640 1 -- 172.21.15.157:0/3784666367 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a41402a90 con 0x556a4130fad0 2024-05-09T09:47:40.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.271+0000 7f1f815ad640 1 --2- 172.21.15.157:0/3784666367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a4130fad0 0x556a41402550 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1f74000f90 tx=0x7f1f74017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.271+0000 7f1e6de03640 1 -- 172.21.15.157:0/3784666367 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f740b9030 con 0x556a4130fad0 2024-05-09T09:47:40.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.271+0000 7f1e6de03640 1 -- 172.21.15.157:0/3784666367 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f740c2070 con 0x556a4130fad0 2024-05-09T09:47:40.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.271+0000 7f1f83a92980 1 -- 172.21.15.157:0/3784666367 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a41402d20 con 0x556a4130fad0 2024-05-09T09:47:40.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.271+0000 7f1e6de03640 1 -- 172.21.15.157:0/3784666367 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f740be610 con 0x556a4130fad0 2024-05-09T09:47:40.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.271+0000 7f1f83a92980 1 -- 172.21.15.157:0/3784666367 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a414059b0 con 0x556a4130fad0 2024-05-09T09:47:40.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.275+0000 7f1e6de03640 1 -- 172.21.15.157:0/3784666367 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f1f740c4030 con 0x556a4130fad0 2024-05-09T09:47:40.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.275+0000 7f1e6de03640 1 --2- 172.21.15.157:0/3784666367 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e68034bb0 0x7f1e68037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.275+0000 7f1e6de03640 1 -- 172.21.15.157:0/3784666367 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f1f740ba070 con 0x556a4130fad0 2024-05-09T09:47:40.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.275+0000 7f1f80dac640 1 --2- 172.21.15.157:0/3784666367 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e68034bb0 0x7f1e68037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.275+0000 7f1f83a92980 1 --2- 172.21.15.157:0/3784666367 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x556a413103f0 0x556a41409490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.275+0000 7f1f83a92980 1 -- 172.21.15.157:0/3784666367 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a41409b00 con 0x556a413103f0 2024-05-09T09:47:40.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.275+0000 7f1f81dae640 1 --2- 172.21.15.157:0/3784666367 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x556a413103f0 0x556a41409490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.275+0000 7f1f80dac640 1 --2- 172.21.15.157:0/3784666367 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e68034bb0 0x7f1e68037070 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1f78000f70 tx=0x7f1f78001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.275+0000 7f1f81dae640 1 --2- 172.21.15.157:0/3784666367 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x556a413103f0 0x556a41409490 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.275+0000 7f1f81dae640 1 -- 172.21.15.157:0/3784666367 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f7c0083f0 con 0x556a413103f0 2024-05-09T09:47:40.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.275+0000 7f1f83a92980 1 -- 172.21.15.157:0/3784666367 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a41406bd0 con 0x556a413103f0 2024-05-09T09:47:40.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.275+0000 7f1f81dae640 1 -- 172.21.15.157:0/3784666367 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1f7c0083f0 con 0x556a413103f0 2024-05-09T09:47:40.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.275+0000 7f1f83a92980 1 --2- 172.21.15.157:0/3784666367 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x556a4140be80 0x556a4140e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.275+0000 7f1f83a92980 1 -- 172.21.15.157:0/3784666367 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a4140e940 con 0x556a4140be80 2024-05-09T09:47:40.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.275+0000 7f1f815ad640 1 --2- 172.21.15.157:0/3784666367 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x556a4140be80 0x556a4140e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.275+0000 7f1f815ad640 1 --2- 172.21.15.157:0/3784666367 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x556a4140be80 0x556a4140e270 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.279+0000 7f1f815ad640 1 -- 172.21.15.157:0/3784666367 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1f740cd070 con 0x556a4140be80 2024-05-09T09:47:40.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.279+0000 7f1f83a92980 1 -- 172.21.15.157:0/3784666367 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a4140ad20 con 0x556a413103f0 2024-05-09T09:47:40.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.279+0000 7f1f81dae640 1 -- 172.21.15.157:0/3784666367 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1f7c0083f0 con 0x556a413103f0 2024-05-09T09:47:40.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.279+0000 7f1f83a92980 1 --2- 172.21.15.157:0/3784666367 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x556a4140fda0 0x556a41412190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.279+0000 7f1f83a92980 1 -- 172.21.15.157:0/3784666367 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a41412890 con 0x556a4140fda0 2024-05-09T09:47:40.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.279+0000 7f1f80dac640 1 --2- 172.21.15.157:0/3784666367 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x556a4140fda0 0x556a41412190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.279+0000 7f1f80dac640 1 --2- 172.21.15.157:0/3784666367 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x556a4140fda0 0x556a41412190 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.279+0000 7f1f80dac640 1 -- 172.21.15.157:0/3784666367 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1f7800f6a0 con 0x556a4140fda0 2024-05-09T09:47:40.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.283+0000 7f1f83a92980 1 Processor -- start 2024-05-09T09:47:40.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.283+0000 7f1f83a92980 1 -- start start 2024-05-09T09:47:40.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.283+0000 7f1f83a92980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a41438780 0x556a41438ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.283+0000 7f1f83a92980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x556a41215020 con 0x556a41438780 2024-05-09T09:47:40.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.283+0000 7f1f815ad640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a41438780 0x556a41438ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.283+0000 7f1f815ad640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a41438780 0x556a41438ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59054/0 (socket says 172.21.15.157:59054) 2024-05-09T09:47:40.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.283+0000 7f1f815ad640 1 -- 172.21.15.157:0/1453282813 learned_addr learned my addr 172.21.15.157:0/1453282813 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:40.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.283+0000 7f1f815ad640 1 -- 172.21.15.157:0/1453282813 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a414390e0 con 0x556a41438780 2024-05-09T09:47:40.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.283+0000 7f1f815ad640 1 --2- 172.21.15.157:0/1453282813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a41438780 0x556a41438ba0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1f740e3890 tx=0x7f1f740bced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.283+0000 7f1e65ba0640 1 -- 172.21.15.157:0/1453282813 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f740cb040 con 0x556a41438780 2024-05-09T09:47:40.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.283+0000 7f1e65ba0640 1 -- 172.21.15.157:0/1453282813 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f740ced60 con 0x556a41438780 2024-05-09T09:47:40.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.283+0000 7f1f83a92980 1 -- 172.21.15.157:0/1453282813 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a41439b70 con 0x556a41438780 2024-05-09T09:47:40.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.283+0000 7f1e65ba0640 1 -- 172.21.15.157:0/1453282813 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f740e5180 con 0x556a41438780 2024-05-09T09:47:40.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.283+0000 7f1f83a92980 1 -- 172.21.15.157:0/1453282813 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a4143a050 con 0x556a41438780 2024-05-09T09:47:40.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.287+0000 7f1e65ba0640 1 -- 172.21.15.157:0/1453282813 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f1f740b3040 con 0x556a41438780 2024-05-09T09:47:40.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.287+0000 7f1e65ba0640 1 --2- 172.21.15.157:0/1453282813 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e58034c00 0x7f1e580370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.287+0000 7f1e65ba0640 1 -- 172.21.15.157:0/1453282813 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f1f740eaa00 con 0x556a41438780 2024-05-09T09:47:40.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.287+0000 7f1f80dac640 1 --2- 172.21.15.157:0/1453282813 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e58034c00 0x7f1e580370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.287+0000 7f1f83a92980 1 Processor -- start 2024-05-09T09:47:40.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.287+0000 7f1f83a92980 1 -- start start 2024-05-09T09:47:40.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.287+0000 7f1f83a92980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a414457d0 0x556a41445bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.287+0000 7f1f83a92980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x556a413fbb40 con 0x556a414457d0 2024-05-09T09:47:40.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.287+0000 7f1f80dac640 1 --2- 172.21.15.157:0/1453282813 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e58034c00 0x7f1e580370c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x556a4140a430 tx=0x7f1f7800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.287+0000 7f1f815ad640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a414457d0 0x556a41445bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.287+0000 7f1f815ad640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a414457d0 0x556a41445bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59064/0 (socket says 172.21.15.157:59064) 2024-05-09T09:47:40.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.287+0000 7f1f815ad640 1 -- 172.21.15.157:0/3438799937 learned_addr learned my addr 172.21.15.157:0/3438799937 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:40.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.287+0000 7f1f815ad640 1 -- 172.21.15.157:0/3438799937 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a41446180 con 0x556a414457d0 2024-05-09T09:47:40.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.287+0000 7f1f815ad640 1 --2- 172.21.15.157:0/3438799937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a414457d0 0x556a41445bb0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1f740b7040 tx=0x7f1f740e2570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf8b7d2bbf93c0f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.287+0000 7f1e5f7fe640 1 -- 172.21.15.157:0/3438799937 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f740f7020 con 0x556a414457d0 2024-05-09T09:47:40.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.287+0000 7f1e5f7fe640 1 -- 172.21.15.157:0/3438799937 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f740dd3a0 con 0x556a414457d0 2024-05-09T09:47:40.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.287+0000 7f1e5f7fe640 1 -- 172.21.15.157:0/3438799937 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f74001390 con 0x556a414457d0 2024-05-09T09:47:40.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.287+0000 7f1f83a92980 1 -- 172.21.15.157:0/3438799937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a414457d0 msgr2=0x556a41445bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.287+0000 7f1f83a92980 1 --2- 172.21.15.157:0/3438799937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a414457d0 0x556a41445bb0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1f740b7040 tx=0x7f1f740e2570 comp rx=0 tx=0).stop 2024-05-09T09:47:40.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.287+0000 7f1f83a92980 1 -- 172.21.15.157:0/3438799937 shutdown_connections 2024-05-09T09:47:40.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.287+0000 7f1f83a92980 1 --2- 172.21.15.157:0/3438799937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a414457d0 0x556a41445bb0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.287+0000 7f1f83a92980 1 -- 172.21.15.157:0/3438799937 >> 172.21.15.157:0/3438799937 conn(0x556a41441b50 msgr2=0x556a4143fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:40.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.287+0000 7f1f83a92980 1 -- 172.21.15.157:0/3438799937 shutdown_connections 2024-05-09T09:47:40.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.287+0000 7f1f83a92980 1 -- 172.21.15.157:0/3438799937 wait complete. 2024-05-09T09:47:40.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.287+0000 7f1f83a92980 1 Processor -- start 2024-05-09T09:47:40.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.287+0000 7f1f83a92980 1 -- start start 2024-05-09T09:47:40.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.291+0000 7f1f83a92980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a414457d0 0x556a4144cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.291+0000 7f1f83a92980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x556a41446890 con 0x556a414457d0 2024-05-09T09:47:40.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.291+0000 7f1f815ad640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a414457d0 0x556a4144cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.291+0000 7f1f815ad640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a414457d0 0x556a4144cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59076/0 (socket says 172.21.15.157:59076) 2024-05-09T09:47:40.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.291+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 learned_addr learned my addr 172.21.15.157:0/3773286172 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:40.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.291+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a4144d100 con 0x556a414457d0 2024-05-09T09:47:40.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.291+0000 7f1f815ad640 1 --2- 172.21.15.157:0/3773286172 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a414457d0 0x556a4144cbc0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f1f740dd550 tx=0x7f1f740dbfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.291+0000 7f1e5dffb640 1 -- 172.21.15.157:0/3773286172 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f7410b070 con 0x556a414457d0 2024-05-09T09:47:40.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.291+0000 7f1e5dffb640 1 -- 172.21.15.157:0/3773286172 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f74001260 con 0x556a414457d0 2024-05-09T09:47:40.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.291+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a4144d100 con 0x556a414457d0 2024-05-09T09:47:40.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.291+0000 7f1e5dffb640 1 -- 172.21.15.157:0/3773286172 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f740de990 con 0x556a414457d0 2024-05-09T09:47:40.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.291+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a4144d100 con 0x556a414457d0 2024-05-09T09:47:40.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.291+0000 7f1e5dffb640 1 -- 172.21.15.157:0/3773286172 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f1f7410e070 con 0x556a414457d0 2024-05-09T09:47:40.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.291+0000 7f1e5dffb640 1 --2- 172.21.15.157:0/3773286172 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e50034bb0 0x7f1e50037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.291+0000 7f1e5dffb640 1 -- 172.21.15.157:0/3773286172 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f1f74111ca0 con 0x556a414457d0 2024-05-09T09:47:40.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.291+0000 7f1f80dac640 1 --2- 172.21.15.157:0/3773286172 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e50034bb0 0x7f1e50037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.291+0000 7f1f83a92980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.291+0000 7f1f83a92980 1 --2- 172.21.15.157:0/3773286172 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x556a414594c0 0x556a4145b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.291+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a4145c0d0 con 0x556a414594c0 2024-05-09T09:47:40.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.291+0000 7f1f81dae640 1 --2- 172.21.15.157:0/3773286172 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x556a414594c0 0x556a4145b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f80dac640 1 --2- 172.21.15.157:0/3773286172 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e50034bb0 0x7f1e50037070 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1f7800ffd0 tx=0x7f1f78010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f81dae640 1 --2- 172.21.15.157:0/3773286172 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x556a414594c0 0x556a4145b980 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f7c0083f0 con 0x556a414594c0 2024-05-09T09:47:40.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f83a92980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:40.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f83a92980 20 realm 2024-05-09T09:47:40.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f83a92980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a4145c4e0 con 0x556a414594c0 2024-05-09T09:47:40.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f7c0083f0 con 0x556a414594c0 2024-05-09T09:47:40.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f83a92980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:40.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f83a92980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:40.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f83a92980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a4145cdb0 con 0x556a414594c0 2024-05-09T09:47:40.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f7c0083f0 con 0x556a414594c0 2024-05-09T09:47:40.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f83a92980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:40.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f83a92980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x556a414594c0 2024-05-09T09:47:40.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1f7c0083f0 con 0x556a414594c0 2024-05-09T09:47:40.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f83a92980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:40.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f83a92980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f83a92980 1 --2- 172.21.15.157:0/3773286172 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x556a4145deb0 0x556a414602a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a414608b0 con 0x556a4145deb0 2024-05-09T09:47:40.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f815ad640 1 --2- 172.21.15.157:0/3773286172 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x556a4145deb0 0x556a414602a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f815ad640 1 --2- 172.21.15.157:0/3773286172 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x556a4145deb0 0x556a414602a0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f83a92980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:40.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f83a92980 20 searching for the correct realm 2024-05-09T09:47:40.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f83a92980 1 --2- 172.21.15.157:0/3773286172 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x556a41462800 0x556a41464c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a414652e0 con 0x556a41462800 2024-05-09T09:47:40.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f80dac640 1 --2- 172.21.15.157:0/3773286172 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x556a41462800 0x556a41464c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.295+0000 7f1f80dac640 1 --2- 172.21.15.157:0/3773286172 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x556a41462800 0x556a41464c10 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.299+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f78037040 con 0x556a41462800 2024-05-09T09:47:40.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.299+0000 7f1f80dac640 1 --2- 172.21.15.157:0/3773286172 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f1f7801fbe0 0x7f1f7803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.299+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a414652e0 con 0x7f1f7801fbe0 2024-05-09T09:47:40.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.299+0000 7f1f81dae640 1 --2- 172.21.15.157:0/3773286172 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f1f7801fbe0 0x7f1f7803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.299+0000 7f1f81dae640 1 --2- 172.21.15.157:0/3773286172 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f1f7801fbe0 0x7f1f7803a3c0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.299+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f7c0083f0 con 0x7f1f7801fbe0 2024-05-09T09:47:40.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.299+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x556a4145deb0 2024-05-09T09:47:40.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.299+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.299+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x556a414594c0 2024-05-09T09:47:40.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.299+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f7c0083f0 con 0x556a414594c0 2024-05-09T09:47:40.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.299+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x556a414594c0 2024-05-09T09:47:40.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.299+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f7c026040 con 0x556a414594c0 2024-05-09T09:47:40.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.299+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x556a4145deb0 2024-05-09T09:47:40.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.299+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.299+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x556a4145deb0 2024-05-09T09:47:40.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.299+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.299+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x7f1f7801fbe0 2024-05-09T09:47:40.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.299+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f7c026040 con 0x7f1f7801fbe0 2024-05-09T09:47:40.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.299+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x556a41462800 2024-05-09T09:47:40.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.303+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f78037040 con 0x556a41462800 2024-05-09T09:47:40.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.303+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x556a414594c0 2024-05-09T09:47:40.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.303+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f7c026040 con 0x556a414594c0 2024-05-09T09:47:40.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.303+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x556a4145deb0 2024-05-09T09:47:40.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.303+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.303+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x556a414594c0 2024-05-09T09:47:40.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.303+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f7c026040 con 0x556a414594c0 2024-05-09T09:47:40.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.303+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x7f1f7801fbe0 2024-05-09T09:47:40.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.303+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1f7c026040 con 0x7f1f7801fbe0 2024-05-09T09:47:40.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.303+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x556a41462800 2024-05-09T09:47:40.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.303+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f78037040 con 0x556a41462800 2024-05-09T09:47:40.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.303+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x556a41462800 2024-05-09T09:47:40.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.303+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1f78037040 con 0x556a41462800 2024-05-09T09:47:40.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.303+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x556a4145deb0 2024-05-09T09:47:40.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.303+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.303+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x556a41462800 2024-05-09T09:47:40.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.303+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f78037040 con 0x556a41462800 2024-05-09T09:47:40.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.303+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x556a41462800 2024-05-09T09:47:40.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.303+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f78037040 con 0x556a41462800 2024-05-09T09:47:40.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.303+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x556a414594c0 2024-05-09T09:47:40.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.307+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f7c026040 con 0x556a414594c0 2024-05-09T09:47:40.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.307+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x556a414594c0 2024-05-09T09:47:40.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.307+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1f7c026040 con 0x556a414594c0 2024-05-09T09:47:40.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.307+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x556a4145deb0 2024-05-09T09:47:40.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.307+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.307+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x556a41462800 2024-05-09T09:47:40.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.307+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f78037040 con 0x556a41462800 2024-05-09T09:47:40.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.307+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x7f1f7801fbe0 2024-05-09T09:47:40.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.307+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f7c026040 con 0x7f1f7801fbe0 2024-05-09T09:47:40.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.307+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x556a414594c0 2024-05-09T09:47:40.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.307+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f7c026040 con 0x556a414594c0 2024-05-09T09:47:40.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.307+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x556a4145deb0 2024-05-09T09:47:40.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.307+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.307+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x556a41462800 2024-05-09T09:47:40.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.307+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f78037040 con 0x556a41462800 2024-05-09T09:47:40.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.307+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x556a4145deb0 2024-05-09T09:47:40.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x7f1f7801fbe0 2024-05-09T09:47:40.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f7c026040 con 0x7f1f7801fbe0 2024-05-09T09:47:40.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x556a41462800 2024-05-09T09:47:40.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f78049040 con 0x556a41462800 2024-05-09T09:47:40.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x556a4145deb0 2024-05-09T09:47:40.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x556a414594c0 2024-05-09T09:47:40.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1f7c026040 con 0x556a414594c0 2024-05-09T09:47:40.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556a4145d150 con 0x7f1f7801fbe0 2024-05-09T09:47:40.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f7c026040 con 0x7f1f7801fbe0 2024-05-09T09:47:40.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f83a92980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:40.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f83a92980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:40.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f83a92980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:40.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f83a92980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:40.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f83a92980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:40.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f83a92980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:40.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f83a92980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a41461170 con 0x556a414594c0 2024-05-09T09:47:40.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f7c026040 con 0x556a414594c0 2024-05-09T09:47:40.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f83a92980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:40.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f83a92980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a41461170 con 0x556a414594c0 2024-05-09T09:47:40.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1f7c026040 con 0x556a414594c0 2024-05-09T09:47:40.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f83a92980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:40.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f83a92980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a41461170 con 0x556a41462800 2024-05-09T09:47:40.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1f78049040 con 0x556a41462800 2024-05-09T09:47:40.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f83a92980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:40.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f83a92980 20 zone default found 2024-05-09T09:47:40.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f83a92980 4 Realm: () 2024-05-09T09:47:40.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f83a92980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:40.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f83a92980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:40.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f83a92980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:40.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f83a92980 20 zonegroup default 2024-05-09T09:47:40.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f83a92980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a41461af0 con 0x556a4145deb0 2024-05-09T09:47:40.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f83a92980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:40.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f83a92980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.311+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a414671d0 con 0x556a41462800 2024-05-09T09:47:40.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.315+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1f78049040 con 0x556a41462800 2024-05-09T09:47:40.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.315+0000 7f1f83a92980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:40.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.315+0000 7f1f83a92980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.315+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a41467640 con 0x556a41462800 2024-05-09T09:47:40.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.315+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1f78049040 con 0x556a41462800 2024-05-09T09:47:40.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.315+0000 7f1f83a92980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:40.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.315+0000 7f1f83a92980 20 started sync module instance, tier type = 2024-05-09T09:47:40.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.315+0000 7f1f83a92980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:40.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.315+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a414665e0 con 0x7f1f7801fbe0 2024-05-09T09:47:40.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.315+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f7c026040 con 0x7f1f7801fbe0 2024-05-09T09:47:40.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.315+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93914850028288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a414665e0 con 0x7f1f7801fbe0 2024-05-09T09:47:40.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.315+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a41468180 con 0x556a414594c0 2024-05-09T09:47:40.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.315+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93914850028288] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f7c036040 con 0x7f1f7801fbe0 2024-05-09T09:47:40.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.315+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f7c036040 con 0x556a414594c0 2024-05-09T09:47:40.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.315+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93914850032752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a414665e0 con 0x556a414594c0 2024-05-09T09:47:40.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.315+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a41468bc0 con 0x556a41462800 2024-05-09T09:47:40.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.319+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93914850032752] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f7c036040 con 0x556a414594c0 2024-05-09T09:47:40.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.319+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f78049040 con 0x556a41462800 2024-05-09T09:47:40.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.319+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93914850025776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a41466550 con 0x556a41462800 2024-05-09T09:47:40.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.319+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a41469920 con 0x7f1f7801fbe0 2024-05-09T09:47:40.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.319+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f7c036040 con 0x7f1f7801fbe0 2024-05-09T09:47:40.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.319+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93914850038800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4146a1c0 con 0x7f1f7801fbe0 2024-05-09T09:47:40.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.319+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4146abc0 con 0x556a414594c0 2024-05-09T09:47:40.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.323+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93914850025776] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f78049040 con 0x556a41462800 2024-05-09T09:47:40.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.323+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93914850038800] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f7c036040 con 0x7f1f7801fbe0 2024-05-09T09:47:40.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.323+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f7c036040 con 0x556a414594c0 2024-05-09T09:47:40.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.323+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93914850037600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a41469c90 con 0x556a414594c0 2024-05-09T09:47:40.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.323+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a41469c90 con 0x556a4145deb0 2024-05-09T09:47:40.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.323+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93914850037600] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f7c036040 con 0x556a414594c0 2024-05-09T09:47:40.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.327+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.327+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93914850043600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4146b460 con 0x556a4145deb0 2024-05-09T09:47:40.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.327+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4146bcb0 con 0x556a4145deb0 2024-05-09T09:47:40.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.327+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.327+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93914850043600] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.327+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93914850048000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4146c500 con 0x556a4145deb0 2024-05-09T09:47:40.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.327+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4146cdd0 con 0x556a4145deb0 2024-05-09T09:47:40.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.331+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.331+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93914850048000] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.331+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93914850051840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4146d240 con 0x556a4145deb0 2024-05-09T09:47:40.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.331+0000 7f1f83a92980 20 add_watcher() i=0 2024-05-09T09:47:40.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.331+0000 7f1f83a92980 20 add_watcher() i=1 2024-05-09T09:47:40.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.331+0000 7f1f83a92980 20 add_watcher() i=2 2024-05-09T09:47:40.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.331+0000 7f1f83a92980 20 add_watcher() i=3 2024-05-09T09:47:40.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.331+0000 7f1f83a92980 20 add_watcher() i=4 2024-05-09T09:47:40.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.331+0000 7f1f83a92980 20 add_watcher() i=5 2024-05-09T09:47:40.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.331+0000 7f1f83a92980 20 add_watcher() i=6 2024-05-09T09:47:40.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.331+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93914850051840] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.331+0000 7f1f83a92980 20 add_watcher() i=7 2024-05-09T09:47:40.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.331+0000 7f1f83a92980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:40.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.331+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a4146d240 con 0x556a414594c0 2024-05-09T09:47:40.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.331+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1f7c036040 con 0x556a414594c0 2024-05-09T09:47:40.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.331+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93914850053520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4146dae0 con 0x556a414594c0 2024-05-09T09:47:40.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.331+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93914850053520] v30'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1f7c036040 con 0x556a414594c0 2024-05-09T09:47:40.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.331+0000 7f1e367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:40.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.331+0000 7f1f83a92980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:40.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.331+0000 7f1f83a92980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:40.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.331+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a41478ba0 con 0x556a414594c0 2024-05-09T09:47:40.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.335+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'53 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f7c036040 con 0x556a414594c0 2024-05-09T09:47:40.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.335+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a41479270 con 0x556a4145deb0 2024-05-09T09:47:40.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.339+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'48 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.339+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a41479270 con 0x556a41462800 2024-05-09T09:47:40.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.339+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'47 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f78049040 con 0x556a41462800 2024-05-09T09:47:40.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.339+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a41479d10 con 0x556a414594c0 2024-05-09T09:47:40.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.339+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'210 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f7c036040 con 0x556a414594c0 2024-05-09T09:47:40.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.339+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a41476ad0 con 0x7f1f7801fbe0 2024-05-09T09:47:40.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.339+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'131 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f7c036040 con 0x7f1f7801fbe0 2024-05-09T09:47:40.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.343+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4147a870 con 0x556a41462800 2024-05-09T09:47:40.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.343+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'88 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f78049040 con 0x556a41462800 2024-05-09T09:47:40.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.343+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4147ad20 con 0x556a414594c0 2024-05-09T09:47:40.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.347+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'49 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f7c036040 con 0x556a414594c0 2024-05-09T09:47:40.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.347+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4147ad20 con 0x556a4145deb0 2024-05-09T09:47:40.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.347+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'87 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.347+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4147ad20 con 0x7f1f7801fbe0 2024-05-09T09:47:40.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.351+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'47 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f7c036040 con 0x7f1f7801fbe0 2024-05-09T09:47:40.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.351+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4147ad20 con 0x556a41462800 2024-05-09T09:47:40.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.351+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'53 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1f78049040 con 0x556a41462800 2024-05-09T09:47:40.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.351+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4147aef0 con 0x7f1f7801fbe0 2024-05-09T09:47:40.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.355+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'132 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f7c036040 con 0x7f1f7801fbe0 2024-05-09T09:47:40.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.355+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4147aef0 con 0x556a4145deb0 2024-05-09T09:47:40.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.355+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'49 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.355+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4147af80 con 0x7f1f7801fbe0 2024-05-09T09:47:40.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.359+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'47 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f7c036040 con 0x7f1f7801fbe0 2024-05-09T09:47:40.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.359+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4147af80 con 0x556a4145deb0 2024-05-09T09:47:40.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.359+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'93 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.359+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4147af80 con 0x556a414594c0 2024-05-09T09:47:40.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.363+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'211 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f7c036040 con 0x556a414594c0 2024-05-09T09:47:40.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.363+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4147af80 con 0x556a41462800 2024-05-09T09:47:40.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.363+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'125 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f78049040 con 0x556a41462800 2024-05-09T09:47:40.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.363+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4147b010 con 0x7f1f7801fbe0 2024-05-09T09:47:40.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.367+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'133 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f7c036040 con 0x7f1f7801fbe0 2024-05-09T09:47:40.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.367+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4147b010 con 0x556a41462800 2024-05-09T09:47:40.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.367+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'47 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f78049040 con 0x556a41462800 2024-05-09T09:47:40.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.367+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4147b0a0 con 0x556a414594c0 2024-05-09T09:47:40.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.367+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'55 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f7c036040 con 0x556a414594c0 2024-05-09T09:47:40.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.367+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4147b0a0 con 0x556a414594c0 2024-05-09T09:47:40.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.371+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'212 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f7c036040 con 0x556a414594c0 2024-05-09T09:47:40.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.371+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4147b0a0 con 0x556a41462800 2024-05-09T09:47:40.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.371+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'126 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f78049040 con 0x556a41462800 2024-05-09T09:47:40.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.371+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4147b130 con 0x7f1f7801fbe0 2024-05-09T09:47:40.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.375+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'57 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f7c036040 con 0x7f1f7801fbe0 2024-05-09T09:47:40.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.375+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4147b130 con 0x556a41462800 2024-05-09T09:47:40.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.375+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'49 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f78049040 con 0x556a41462800 2024-05-09T09:47:40.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.375+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4147b130 con 0x556a41462800 2024-05-09T09:47:40.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.379+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'53 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f78049040 con 0x556a41462800 2024-05-09T09:47:40.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.379+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4147b630 con 0x556a41462800 2024-05-09T09:47:40.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.379+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'43 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f78049040 con 0x556a41462800 2024-05-09T09:47:40.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.379+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4147b630 con 0x556a41462800 2024-05-09T09:47:40.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.379+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'89 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f78049040 con 0x556a41462800 2024-05-09T09:47:40.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.379+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4147b630 con 0x556a4145deb0 2024-05-09T09:47:40.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.383+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'49 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.383+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4147b630 con 0x556a41462800 2024-05-09T09:47:40.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.387+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'47 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f78049040 con 0x556a41462800 2024-05-09T09:47:40.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.387+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4147b630 con 0x556a4145deb0 2024-05-09T09:47:40.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.391+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'88 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.391+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4147b630 con 0x556a41462800 2024-05-09T09:47:40.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.391+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'127 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f78049040 con 0x556a41462800 2024-05-09T09:47:40.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.391+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4147b630 con 0x556a4145deb0 2024-05-09T09:47:40.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.395+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'94 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.395+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4147b630 con 0x7f1f7801fbe0 2024-05-09T09:47:40.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.399+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'53 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1f7c036040 con 0x7f1f7801fbe0 2024-05-09T09:47:40.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.399+0000 7f1e357e2640 20 reqs_thread_entry: start 2024-05-09T09:47:40.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.399+0000 7f1f83a92980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:40.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.399+0000 7f1da6ffd640 20 reqs_thread_entry: start 2024-05-09T09:47:40.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.399+0000 7f1f83a92980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-09T09:47:40.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.399+0000 7f1f83a92980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.399+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a41496d60 con 0x556a4145deb0 2024-05-09T09:47:40.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.399+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.399+0000 7f1f83a92980 20 rados_obj.operate() r=0 bl.length=380 2024-05-09T09:47:40.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.399+0000 7f1f83a92980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-09T09:47:40.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.399+0000 7f1f83a92980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-09T09:47:40.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.399+0000 7f1f83a92980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:40.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.399+0000 7f1f83a92980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-09T09:47:40.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.399+0000 7f1f83a92980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.399+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:95 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a41498d80 con 0x7f1f7801fbe0 2024-05-09T09:47:40.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.399+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(95 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1f7c036040 con 0x7f1f7801fbe0 2024-05-09T09:47:40.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.399+0000 7f1f83a92980 20 rados_obj.operate() r=0 bl.length=165 2024-05-09T09:47:40.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.399+0000 7f1f83a92980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-09T09:47:40.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.399+0000 7f1f83a92980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-09T09:47:40.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.399+0000 7f1f83a92980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 : miss 2024-05-09T09:47:40.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.399+0000 7f1f83a92980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.399+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 8.5 8:a7233c95:root::.bucket.meta.myfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a4149a670 con 0x556a414594c0 2024-05-09T09:47:40.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.403+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(96 .bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f1f7c036040 con 0x556a414594c0 2024-05-09T09:47:40.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.403+0000 7f1f83a92980 20 rados_obj.operate() r=0 bl.length=379 2024-05-09T09:47:40.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.403+0000 7f1f83a92980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 info.flags=0x17 2024-05-09T09:47:40.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.403+0000 7f1f83a92980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 to cache LRU end 2024-05-09T09:47:40.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.403+0000 7f1f83a92980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:40.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.403+0000 7f1f83a92980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-09T09:47:40.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.403+0000 7f1f83a92980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 2024-05-09T09:47:40.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.403+0000 7f1f83a92980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-05-09T09:47:40.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.403+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:97 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4149e880 con 0x7f1f7801fbe0 2024-05-09T09:47:40.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.403+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(97 foo.buckets [call] v30'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1f7c036040 con 0x7f1f7801fbe0 2024-05-09T09:47:40.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.403+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 8.5 8:a7233c95:root::.bucket.meta.myfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a414a4760 con 0x556a414594c0 2024-05-09T09:47:40.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.403+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(98 .bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v30'2 uv2 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f1f7c036040 con 0x556a414594c0 2024-05-09T09:47:40.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.403+0000 7f1f83a92980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 info.flags=0x17 2024-05-09T09:47:40.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.403+0000 7f1f83a92980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 to cache LRU end 2024-05-09T09:47:40.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.403+0000 7f1f83a92980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-09T09:47:40.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.403+0000 7f1f83a92980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1, ofs0, ns] 2024-05-09T09:47:40.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.403+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:99 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93914850239968 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a4149ecb0 con 0x556a4145deb0 2024-05-09T09:47:40.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.407+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== watch-notify(notify (1) cookie 93914850048000 notify 128849018884 ret 0) ==== 794+0+0 (crc 0 0 0) 0x556a4147b1e0 con 0x556a4145deb0 2024-05-09T09:47:40.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.407+0000 7f1e5f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 93914850048000 notifier 4510 bl.length()=752 2024-05-09T09:47:40.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.407+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(99 notify.6 [notify cookie 93914850239968 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.407+0000 7f1e5f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 info.flags=0x17 2024-05-09T09:47:40.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.407+0000 7f1e5f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 to cache LRU end 2024-05-09T09:47:40.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.407+0000 7f1e5f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-09T09:47:40.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.407+0000 7f1e5f7fe640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f1e440056c0 con 0x556a4145deb0 2024-05-09T09:47:40.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.407+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(100 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.407+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== watch-notify(notify_complete (2) cookie 93914850239968 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556a414390e0 con 0x556a4145deb0 2024-05-09T09:47:40.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.407+0000 7f1f83a92980 20 handle_bi_update(): bucket=:myfoo[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1]): orig_sources= new_sources= 2024-05-09T09:47:40.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.407+0000 7f1f83a92980 20 handle_bi_update(): bucket=:myfoo[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1]): potential sources added=[] removed=[] 2024-05-09T09:47:40.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.407+0000 7f1f83a92980 20 handle_bi_update(): bucket=:myfoo[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1]): orig_dests= new_dests= 2024-05-09T09:47:40.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.407+0000 7f1f83a92980 20 handle_bi_update(): bucket=:myfoo[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1]): potential dests added=[] removed=[] 2024-05-09T09:47:40.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.407+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:101 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a414a2fa0 con 0x556a4145deb0 2024-05-09T09:47:40.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.407+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(101 fud.buckets [call] v30'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.411+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:102 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a414a3fb0 con 0x7f1f7801fbe0 2024-05-09T09:47:40.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.411+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(102 myfoo [delete,create,call,writefull 0~165] v30'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f1f7c036040 con 0x7f1f7801fbe0 2024-05-09T09:47:40.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.411+0000 7f1f83a92980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-09T09:47:40.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.411+0000 7f1f83a92980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-09T09:47:40.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.411+0000 7f1f83a92980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-09T09:47:40.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.411+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93914850239968 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556a414a3450 con 0x556a4145deb0 2024-05-09T09:47:40.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.411+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== watch-notify(notify (1) cookie 93914850048000 notify 128849018885 ret 0) ==== 356+0+0 (crc 0 0 0) 0x556a414059b0 con 0x556a4145deb0 2024-05-09T09:47:40.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.411+0000 7f1e5f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 93914850048000 notifier 4510 bl.length()=314 2024-05-09T09:47:40.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.411+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 32 ==== osd_op_reply(103 notify.6 [notify cookie 93914850239968 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.411+0000 7f1e5f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-09T09:47:40.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.411+0000 7f1e5f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-09T09:47:40.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.411+0000 7f1e5f7fe640 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f1e440056c0 con 0x556a4145deb0 2024-05-09T09:47:40.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.415+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 33 ==== osd_op_reply(104 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.415+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 34 ==== watch-notify(notify_complete (2) cookie 93914850239968 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556a41402d20 con 0x556a4145deb0 2024-05-09T09:47:40.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.415+0000 7f1e367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:40.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.415+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93914850053520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a41474620 con 0x556a414594c0 2024-05-09T09:47:40.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.415+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 93914850053520] v30'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1f7c036040 con 0x556a414594c0 2024-05-09T09:47:40.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.415+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93914850028288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a4146cd90 con 0x7f1f7801fbe0 2024-05-09T09:47:40.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.419+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 93914850028288] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f7c036040 con 0x7f1f7801fbe0 2024-05-09T09:47:40.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.419+0000 7f1f83a92980 20 remove_watcher() i=0 2024-05-09T09:47:40.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.419+0000 7f1f83a92980 2 removed watcher, disabling cache 2024-05-09T09:47:40.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.419+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93914850032752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a41466b00 con 0x556a414594c0 2024-05-09T09:47:40.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.419+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 93914850032752] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f7c036040 con 0x556a414594c0 2024-05-09T09:47:40.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.419+0000 7f1f83a92980 20 remove_watcher() i=1 2024-05-09T09:47:40.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.419+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93914850025776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a41466b00 con 0x556a41462800 2024-05-09T09:47:40.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.423+0000 7f1f80dac640 1 -- 172.21.15.157:0/3773286172 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 93914850025776] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f78049040 con 0x556a41462800 2024-05-09T09:47:40.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.423+0000 7f1f83a92980 20 remove_watcher() i=2 2024-05-09T09:47:40.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.423+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93914850038800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a41466130 con 0x7f1f7801fbe0 2024-05-09T09:47:40.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.423+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 93914850038800] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f7c036040 con 0x7f1f7801fbe0 2024-05-09T09:47:40.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.423+0000 7f1f83a92980 20 remove_watcher() i=3 2024-05-09T09:47:40.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.423+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93914850037600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a41466b00 con 0x556a414594c0 2024-05-09T09:47:40.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.427+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 93914850037600] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f7c036040 con 0x556a414594c0 2024-05-09T09:47:40.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.427+0000 7f1f83a92980 20 remove_watcher() i=4 2024-05-09T09:47:40.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.427+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93914850043600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a41466130 con 0x556a4145deb0 2024-05-09T09:47:40.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.427+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 35 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 93914850043600] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.427+0000 7f1f83a92980 20 remove_watcher() i=5 2024-05-09T09:47:40.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.427+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93914850048000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a41466b00 con 0x556a4145deb0 2024-05-09T09:47:40.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.431+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 36 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 93914850048000] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.431+0000 7f1f83a92980 20 remove_watcher() i=6 2024-05-09T09:47:40.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.431+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93914850051840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556a41466130 con 0x556a4145deb0 2024-05-09T09:47:40.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.431+0000 7f1f815ad640 1 -- 172.21.15.157:0/3773286172 <== osd.0 v2:172.21.15.110:6800/231209037 37 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 93914850051840] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f7410d030 con 0x556a4145deb0 2024-05-09T09:47:40.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.431+0000 7f1f83a92980 20 remove_watcher() i=7 2024-05-09T09:47:40.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.431+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x556a4145deb0 msgr2=0x556a414602a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.431+0000 7f1f83a92980 1 --2- 172.21.15.157:0/3773286172 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x556a4145deb0 0x556a414602a0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.431+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x556a414594c0 msgr2=0x556a4145b980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.431+0000 7f1f83a92980 1 --2- 172.21.15.157:0/3773286172 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x556a414594c0 0x556a4145b980 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.431+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f1f7801fbe0 msgr2=0x7f1f7803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.431+0000 7f1f83a92980 1 --2- 172.21.15.157:0/3773286172 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f1f7801fbe0 0x7f1f7803a3c0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.431+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x556a41462800 msgr2=0x556a41464c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.431+0000 7f1f83a92980 1 --2- 172.21.15.157:0/3773286172 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x556a41462800 0x556a41464c10 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e50034bb0 msgr2=0x7f1e50037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 --2- 172.21.15.157:0/3773286172 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e50034bb0 0x7f1e50037070 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1f7800ffd0 tx=0x7f1f78010000 comp rx=0 tx=0).stop 2024-05-09T09:47:40.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a414457d0 msgr2=0x556a4144cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 --2- 172.21.15.157:0/3773286172 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a414457d0 0x556a4144cbc0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f1f740dd550 tx=0x7f1f740dbfa0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 reap_dead start 2024-05-09T09:47:40.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f81dae640 1 -- 172.21.15.157:0/3773286172 reap_dead start 2024-05-09T09:47:40.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 shutdown_connections 2024-05-09T09:47:40.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 >> 172.21.15.157:0/3773286172 conn(0x556a41441b50 msgr2=0x556a4143f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:40.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 shutdown_connections 2024-05-09T09:47:40.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 -- 172.21.15.157:0/3773286172 wait complete. 2024-05-09T09:47:40.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 -- 172.21.15.157:0/1453282813 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e58034c00 msgr2=0x7f1e580370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 --2- 172.21.15.157:0/1453282813 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e58034c00 0x7f1e580370c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x556a4140a430 tx=0x7f1f7800f000 comp rx=0 tx=0).stop 2024-05-09T09:47:40.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 -- 172.21.15.157:0/1453282813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a41438780 msgr2=0x556a41438ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 --2- 172.21.15.157:0/1453282813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a41438780 0x556a41438ba0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1f740e3890 tx=0x7f1f740bced0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 -- 172.21.15.157:0/1453282813 shutdown_connections 2024-05-09T09:47:40.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 --2- 172.21.15.157:0/1453282813 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e58034c00 0x7f1e580370c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 --2- 172.21.15.157:0/1453282813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a41438780 0x556a41438ba0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 -- 172.21.15.157:0/1453282813 >> 172.21.15.157:0/1453282813 conn(0x556a4142d550 msgr2=0x556a4142e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:40.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 -- 172.21.15.157:0/1453282813 shutdown_connections 2024-05-09T09:47:40.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 -- 172.21.15.157:0/1453282813 wait complete. 2024-05-09T09:47:40.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 -- 172.21.15.157:0/3784666367 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x556a4140be80 msgr2=0x556a4140e270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 --2- 172.21.15.157:0/3784666367 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x556a4140be80 0x556a4140e270 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 -- 172.21.15.157:0/3784666367 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x556a413103f0 msgr2=0x556a41409490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 --2- 172.21.15.157:0/3784666367 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x556a413103f0 0x556a41409490 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 -- 172.21.15.157:0/3784666367 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x556a4140fda0 msgr2=0x556a41412190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 --2- 172.21.15.157:0/3784666367 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x556a4140fda0 0x556a41412190 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 -- 172.21.15.157:0/3784666367 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e68034bb0 msgr2=0x7f1e68037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 --2- 172.21.15.157:0/3784666367 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1e68034bb0 0x7f1e68037070 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1f78000f70 tx=0x7f1f78001380 comp rx=0 tx=0).stop 2024-05-09T09:47:40.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 -- 172.21.15.157:0/3784666367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a4130fad0 msgr2=0x556a41402550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 --2- 172.21.15.157:0/3784666367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556a4130fad0 0x556a41402550 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1f74000f90 tx=0x7f1f74017e30 comp rx=0 tx=0).stop 2024-05-09T09:47:40.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f81dae640 1 -- 172.21.15.157:0/3784666367 reap_dead start 2024-05-09T09:47:40.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 -- 172.21.15.157:0/3784666367 shutdown_connections 2024-05-09T09:47:40.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 -- 172.21.15.157:0/3784666367 >> 172.21.15.157:0/3784666367 conn(0x556a412831f0 msgr2=0x556a413f5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:40.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 -- 172.21.15.157:0/3784666367 shutdown_connections 2024-05-09T09:47:40.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.435+0000 7f1f83a92980 1 -- 172.21.15.157:0/3784666367 wait complete. 2024-05-09T09:47:40.448 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-05-09T09:47:40.449 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-05-09T09:47:40.449 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-05-09T09:47:40.532 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:40.532 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:40.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.535+0000 7f9c4124a980 1 Processor -- start 2024-05-09T09:47:40.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.535+0000 7f9c4124a980 1 -- start start 2024-05-09T09:47:40.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.535+0000 7f9c4124a980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5559fe28fa70 0x5559fe31e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.535+0000 7f9c4124a980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5559fe1d1440 con 0x5559fe31eb30 2024-05-09T09:47:40.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.535+0000 7f9c4124a980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5559fe1bc5f0 con 0x5559fe28fa70 2024-05-09T09:47:40.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.535+0000 7f9c3ed65640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5559fe28fa70 0x5559fe31e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.535+0000 7f9c3ed65640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5559fe28fa70 0x5559fe31e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59080/0 (socket says 172.21.15.157:59080) 2024-05-09T09:47:40.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.535+0000 7f9c3e564640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x5559fe31eb30 0x5559fe320f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:51718/0 (socket says 172.21.15.157:51718) 2024-05-09T09:47:40.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.535+0000 7f9c3ed65640 1 -- 172.21.15.157:0/2091117591 learned_addr learned my addr 172.21.15.157:0/2091117591 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:40.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.535+0000 7f9c3ed65640 1 -- 172.21.15.157:0/2091117591 >> v1:172.21.15.110:6789/0 conn(0x5559fe31eb30 legacy=0x5559fe320f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.535+0000 7f9c3ed65640 1 -- 172.21.15.157:0/2091117591 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559fe1c7990 con 0x5559fe28fa70 2024-05-09T09:47:40.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.539+0000 7f9c3ed65640 1 --2- 172.21.15.157:0/2091117591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe28fa70 0x5559fe31e5f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9c3000a4e0 tx=0x7f9c3001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40fca63c124c4dc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.539+0000 7f9c3dd63640 1 -- 172.21.15.157:0/2091117591 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c300aa540 con 0x5559fe28fa70 2024-05-09T09:47:40.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.539+0000 7f9c3dd63640 1 -- 172.21.15.157:0/2091117591 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c300aa6e0 con 0x5559fe28fa70 2024-05-09T09:47:40.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.539+0000 7f9c3dd63640 1 -- 172.21.15.157:0/2091117591 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c300aaa40 con 0x5559fe28fa70 2024-05-09T09:47:40.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.539+0000 7f9c4124a980 1 -- 172.21.15.157:0/2091117591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe28fa70 msgr2=0x5559fe31e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.539+0000 7f9c4124a980 1 --2- 172.21.15.157:0/2091117591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe28fa70 0x5559fe31e5f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9c3000a4e0 tx=0x7f9c3001b090 comp rx=0 tx=0).stop 2024-05-09T09:47:40.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.539+0000 7f9c4124a980 1 -- 172.21.15.157:0/2091117591 shutdown_connections 2024-05-09T09:47:40.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.539+0000 7f9c4124a980 1 --2- 172.21.15.157:0/2091117591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe28fa70 0x5559fe31e5f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.539+0000 7f9c4124a980 1 -- 172.21.15.157:0/2091117591 >> 172.21.15.157:0/2091117591 conn(0x5559fe3160d0 msgr2=0x5559fe3184f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:40.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.539+0000 7f9c4124a980 1 -- 172.21.15.157:0/2091117591 shutdown_connections 2024-05-09T09:47:40.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.539+0000 7f9c4124a980 1 -- 172.21.15.157:0/2091117591 wait complete. 2024-05-09T09:47:40.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.555+0000 7f9c4124a980 1 Processor -- start 2024-05-09T09:47:40.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.555+0000 7f9c4124a980 1 -- start start 2024-05-09T09:47:40.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.555+0000 7f9c4124a980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe28fa70 0x5559fe406b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.555+0000 7f9c4124a980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5559fe21efe0 con 0x5559fe28fa70 2024-05-09T09:47:40.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.555+0000 7f9c3ed65640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe28fa70 0x5559fe406b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.555+0000 7f9c3ed65640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe28fa70 0x5559fe406b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59088/0 (socket says 172.21.15.157:59088) 2024-05-09T09:47:40.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.555+0000 7f9c3ed65640 1 -- 172.21.15.157:0/3353563694 learned_addr learned my addr 172.21.15.157:0/3353563694 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:40.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.559+0000 7f9c3ed65640 1 -- 172.21.15.157:0/3353563694 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559fe1a3ae0 con 0x5559fe28fa70 2024-05-09T09:47:40.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.559+0000 7f9c3ed65640 1 --2- 172.21.15.157:0/3353563694 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe28fa70 0x5559fe406b50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9c30018cc0 tx=0x7f9c300033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=855c6fb859e5c786 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.559+0000 7f9b2ce09640 1 -- 172.21.15.157:0/3353563694 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c300b9070 con 0x5559fe28fa70 2024-05-09T09:47:40.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.559+0000 7f9b2ce09640 1 -- 172.21.15.157:0/3353563694 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c300aaa80 con 0x5559fe28fa70 2024-05-09T09:47:40.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.559+0000 7f9b2ce09640 1 -- 172.21.15.157:0/3353563694 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c300aad60 con 0x5559fe28fa70 2024-05-09T09:47:40.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.559+0000 7f9c4124a980 1 -- 172.21.15.157:0/3353563694 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe28fa70 msgr2=0x5559fe406b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.559+0000 7f9c4124a980 1 --2- 172.21.15.157:0/3353563694 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe28fa70 0x5559fe406b50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9c30018cc0 tx=0x7f9c300033b0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.559+0000 7f9c4124a980 1 -- 172.21.15.157:0/3353563694 shutdown_connections 2024-05-09T09:47:40.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.559+0000 7f9c4124a980 1 --2- 172.21.15.157:0/3353563694 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe28fa70 0x5559fe406b50 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.559+0000 7f9c4124a980 1 -- 172.21.15.157:0/3353563694 >> 172.21.15.157:0/3353563694 conn(0x5559fe3160d0 msgr2=0x5559fe4026e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:40.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.559+0000 7f9c4124a980 1 -- 172.21.15.157:0/3353563694 shutdown_connections 2024-05-09T09:47:40.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.559+0000 7f9c4124a980 1 -- 172.21.15.157:0/3353563694 wait complete. 2024-05-09T09:47:40.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.559+0000 7f9c4124a980 1 Processor -- start 2024-05-09T09:47:40.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.559+0000 7f9c4124a980 1 -- start start 2024-05-09T09:47:40.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.559+0000 7f9c4124a980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe28fa70 0x5559fe40db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.559+0000 7f9c4124a980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5559fe323150 con 0x5559fe28fa70 2024-05-09T09:47:40.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.559+0000 7f9c3ed65640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe28fa70 0x5559fe40db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.559+0000 7f9c3ed65640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe28fa70 0x5559fe40db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59098/0 (socket says 172.21.15.157:59098) 2024-05-09T09:47:40.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.559+0000 7f9c3ed65640 1 -- 172.21.15.157:0/4140265382 learned_addr learned my addr 172.21.15.157:0/4140265382 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:40.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.559+0000 7f9c3ed65640 1 -- 172.21.15.157:0/4140265382 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559fe40e0d0 con 0x5559fe28fa70 2024-05-09T09:47:40.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.559+0000 7f9c3ed65640 1 --2- 172.21.15.157:0/4140265382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe28fa70 0x5559fe40db90 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9c3001aec0 tx=0x7f9c30017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.563+0000 7f9b2b606640 1 -- 172.21.15.157:0/4140265382 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c300b9070 con 0x5559fe28fa70 2024-05-09T09:47:40.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.563+0000 7f9c4124a980 1 -- 172.21.15.157:0/4140265382 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559fe40e360 con 0x5559fe28fa70 2024-05-09T09:47:40.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.563+0000 7f9b2b606640 1 -- 172.21.15.157:0/4140265382 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c300c7410 con 0x5559fe28fa70 2024-05-09T09:47:40.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.563+0000 7f9b2b606640 1 -- 172.21.15.157:0/4140265382 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c300c76f0 con 0x5559fe28fa70 2024-05-09T09:47:40.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.563+0000 7f9c4124a980 1 -- 172.21.15.157:0/4140265382 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559fe410ff0 con 0x5559fe28fa70 2024-05-09T09:47:40.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.563+0000 7f9b2b606640 1 -- 172.21.15.157:0/4140265382 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f9c300b3040 con 0x5559fe28fa70 2024-05-09T09:47:40.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.563+0000 7f9b2b606640 1 --2- 172.21.15.157:0/4140265382 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b24034bb0 0x7f9b24037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.563+0000 7f9b2b606640 1 -- 172.21.15.157:0/4140265382 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f9c300c4070 con 0x5559fe28fa70 2024-05-09T09:47:40.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.563+0000 7f9c3e564640 1 --2- 172.21.15.157:0/4140265382 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b24034bb0 0x7f9b24037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.563+0000 7f9c4124a980 1 --2- 172.21.15.157:0/4140265382 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5559fe31eb30 0x5559fe414c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.563+0000 7f9c4124a980 1 -- 172.21.15.157:0/4140265382 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559fe4151c0 con 0x5559fe31eb30 2024-05-09T09:47:40.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.563+0000 7f9c3f566640 1 --2- 172.21.15.157:0/4140265382 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5559fe31eb30 0x5559fe414c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.563+0000 7f9c3e564640 1 --2- 172.21.15.157:0/4140265382 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b24034bb0 0x7f9b24037070 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9c28000f70 tx=0x7f9c28001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.563+0000 7f9c3f566640 1 --2- 172.21.15.157:0/4140265382 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5559fe31eb30 0x5559fe414c40 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.563+0000 7f9c3f566640 1 -- 172.21.15.157:0/4140265382 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c380083f0 con 0x5559fe31eb30 2024-05-09T09:47:40.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.563+0000 7f9c4124a980 1 -- 172.21.15.157:0/4140265382 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559fe412210 con 0x5559fe31eb30 2024-05-09T09:47:40.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.563+0000 7f9c3f566640 1 -- 172.21.15.157:0/4140265382 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9c380083f0 con 0x5559fe31eb30 2024-05-09T09:47:40.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.563+0000 7f9c4124a980 1 --2- 172.21.15.157:0/4140265382 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5559fe4174d0 0x5559fe4198c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.563+0000 7f9c4124a980 1 -- 172.21.15.157:0/4140265382 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559fe419fb0 con 0x5559fe4174d0 2024-05-09T09:47:40.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.563+0000 7f9c3ed65640 1 --2- 172.21.15.157:0/4140265382 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5559fe4174d0 0x5559fe4198c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.567+0000 7f9c3ed65640 1 --2- 172.21.15.157:0/4140265382 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5559fe4174d0 0x5559fe4198c0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.567+0000 7f9c3ed65640 1 -- 172.21.15.157:0/4140265382 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9c300cd060 con 0x5559fe4174d0 2024-05-09T09:47:40.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.567+0000 7f9c4124a980 1 -- 172.21.15.157:0/4140265382 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559fe416370 con 0x5559fe31eb30 2024-05-09T09:47:40.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.567+0000 7f9c3f566640 1 -- 172.21.15.157:0/4140265382 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9c380083f0 con 0x5559fe31eb30 2024-05-09T09:47:40.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.567+0000 7f9c4124a980 1 --2- 172.21.15.157:0/4140265382 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5559fe41b410 0x5559fe41d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.567+0000 7f9c4124a980 1 -- 172.21.15.157:0/4140265382 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559fe41df40 con 0x5559fe41b410 2024-05-09T09:47:40.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.567+0000 7f9c3e564640 1 --2- 172.21.15.157:0/4140265382 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5559fe41b410 0x5559fe41d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.567+0000 7f9c3e564640 1 --2- 172.21.15.157:0/4140265382 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5559fe41b410 0x5559fe41d800 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.567+0000 7f9c3e564640 1 -- 172.21.15.157:0/4140265382 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9c2800f6a0 con 0x5559fe41b410 2024-05-09T09:47:40.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.571+0000 7f9c4124a980 1 Processor -- start 2024-05-09T09:47:40.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.571+0000 7f9c4124a980 1 -- start start 2024-05-09T09:47:40.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.571+0000 7f9c4124a980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe443fc0 0x5559fe4443e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.571+0000 7f9c4124a980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5559fe223020 con 0x5559fe443fc0 2024-05-09T09:47:40.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.571+0000 7f9c3ed65640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe443fc0 0x5559fe4443e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.571+0000 7f9c3ed65640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe443fc0 0x5559fe4443e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59102/0 (socket says 172.21.15.157:59102) 2024-05-09T09:47:40.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.571+0000 7f9c3ed65640 1 -- 172.21.15.157:0/1443616596 learned_addr learned my addr 172.21.15.157:0/1443616596 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:40.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.571+0000 7f9c3ed65640 1 -- 172.21.15.157:0/1443616596 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559fe444920 con 0x5559fe443fc0 2024-05-09T09:47:40.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.571+0000 7f9c3ed65640 1 --2- 172.21.15.157:0/1443616596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe443fc0 0x5559fe4443e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9c300e3690 tx=0x7f9c300c6db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.571+0000 7f9b237fe640 1 -- 172.21.15.157:0/1443616596 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c300db020 con 0x5559fe443fc0 2024-05-09T09:47:40.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.575+0000 7f9b237fe640 1 -- 172.21.15.157:0/1443616596 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c300e2300 con 0x5559fe443fc0 2024-05-09T09:47:40.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.575+0000 7f9c4124a980 1 -- 172.21.15.157:0/1443616596 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559fe4453b0 con 0x5559fe443fc0 2024-05-09T09:47:40.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.575+0000 7f9b237fe640 1 -- 172.21.15.157:0/1443616596 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c300c6660 con 0x5559fe443fc0 2024-05-09T09:47:40.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.575+0000 7f9c4124a980 1 -- 172.21.15.157:0/1443616596 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559fe445890 con 0x5559fe443fc0 2024-05-09T09:47:40.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.575+0000 7f9b237fe640 1 -- 172.21.15.157:0/1443616596 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f9c300ec060 con 0x5559fe443fc0 2024-05-09T09:47:40.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.575+0000 7f9b237fe640 1 --2- 172.21.15.157:0/1443616596 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b18034c50 0x7f9b18037110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.575+0000 7f9b237fe640 1 -- 172.21.15.157:0/1443616596 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f9c300df030 con 0x5559fe443fc0 2024-05-09T09:47:40.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.575+0000 7f9c3e564640 1 --2- 172.21.15.157:0/1443616596 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b18034c50 0x7f9b18037110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.575+0000 7f9c4124a980 1 Processor -- start 2024-05-09T09:47:40.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.575+0000 7f9c4124a980 1 -- start start 2024-05-09T09:47:40.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.575+0000 7f9c3e564640 1 --2- 172.21.15.157:0/1443616596 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b18034c50 0x7f9b18037110 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x5559fe415650 tx=0x7f9c2800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.575+0000 7f9c4124a980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe31bb90 0x5559fe31bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.575+0000 7f9c4124a980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5559fe4071e0 con 0x5559fe31bb90 2024-05-09T09:47:40.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.575+0000 7f9c3ed65640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe31bb90 0x5559fe31bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.575+0000 7f9c3ed65640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe31bb90 0x5559fe31bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59106/0 (socket says 172.21.15.157:59106) 2024-05-09T09:47:40.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.575+0000 7f9c3ed65640 1 -- 172.21.15.157:0/589566427 learned_addr learned my addr 172.21.15.157:0/589566427 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:40.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.575+0000 7f9c3ed65640 1 -- 172.21.15.157:0/589566427 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559fe31a3d0 con 0x5559fe31bb90 2024-05-09T09:47:40.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.575+0000 7f9c3ed65640 1 --2- 172.21.15.157:0/589566427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe31bb90 0x5559fe31bfb0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9c300ee7f0 tx=0x7f9c300a5e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf825457ace0804 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.575+0000 7f9b217fa640 1 -- 172.21.15.157:0/589566427 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c300fe070 con 0x5559fe31bb90 2024-05-09T09:47:40.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.579+0000 7f9b217fa640 1 -- 172.21.15.157:0/589566427 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c300ed3b0 con 0x5559fe31bb90 2024-05-09T09:47:40.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.579+0000 7f9b217fa640 1 -- 172.21.15.157:0/589566427 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c300d7e60 con 0x5559fe31bb90 2024-05-09T09:47:40.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.579+0000 7f9c4124a980 1 -- 172.21.15.157:0/589566427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe31bb90 msgr2=0x5559fe31bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.579+0000 7f9c4124a980 1 --2- 172.21.15.157:0/589566427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe31bb90 0x5559fe31bfb0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9c300ee7f0 tx=0x7f9c300a5e20 comp rx=0 tx=0).stop 2024-05-09T09:47:40.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.579+0000 7f9c4124a980 1 -- 172.21.15.157:0/589566427 shutdown_connections 2024-05-09T09:47:40.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.579+0000 7f9c4124a980 1 --2- 172.21.15.157:0/589566427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe31bb90 0x5559fe31bfb0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.579+0000 7f9c4124a980 1 -- 172.21.15.157:0/589566427 >> 172.21.15.157:0/589566427 conn(0x5559fe44d2f0 msgr2=0x5559fe44b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:40.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.579+0000 7f9c4124a980 1 -- 172.21.15.157:0/589566427 shutdown_connections 2024-05-09T09:47:40.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.579+0000 7f9c4124a980 1 -- 172.21.15.157:0/589566427 wait complete. 2024-05-09T09:47:40.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.579+0000 7f9c4124a980 1 Processor -- start 2024-05-09T09:47:40.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.579+0000 7f9c4124a980 1 -- start start 2024-05-09T09:47:40.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.579+0000 7f9c4124a980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe31bb90 0x5559fe45a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.579+0000 7f9c4124a980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5559fe31a640 con 0x5559fe31bb90 2024-05-09T09:47:40.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.579+0000 7f9c3ed65640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe31bb90 0x5559fe45a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.579+0000 7f9c3ed65640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe31bb90 0x5559fe45a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59120/0 (socket says 172.21.15.157:59120) 2024-05-09T09:47:40.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.579+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 learned_addr learned my addr 172.21.15.157:0/442038788 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:40.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.579+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559fe45aa00 con 0x5559fe31bb90 2024-05-09T09:47:40.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.579+0000 7f9c3ed65640 1 --2- 172.21.15.157:0/442038788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe31bb90 0x5559fe45a4c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9c300d8fb0 tx=0x7f9c300d5e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.579+0000 7f9b0f7fe640 1 -- 172.21.15.157:0/442038788 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c30109020 con 0x5559fe31bb90 2024-05-09T09:47:40.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.579+0000 7f9b0f7fe640 1 -- 172.21.15.157:0/442038788 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c300bc360 con 0x5559fe31bb90 2024-05-09T09:47:40.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.579+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559fe45aa00 con 0x5559fe31bb90 2024-05-09T09:47:40.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.579+0000 7f9b0f7fe640 1 -- 172.21.15.157:0/442038788 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c300fe030 con 0x5559fe31bb90 2024-05-09T09:47:40.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.579+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559fe45aa00 con 0x5559fe31bb90 2024-05-09T09:47:40.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9b0f7fe640 1 -- 172.21.15.157:0/442038788 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f9c3010c020 con 0x5559fe31bb90 2024-05-09T09:47:40.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9b0f7fe640 1 --2- 172.21.15.157:0/442038788 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b08034bb0 0x7f9b08037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9b0f7fe640 1 -- 172.21.15.157:0/442038788 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f9c300ff070 con 0x5559fe31bb90 2024-05-09T09:47:40.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9c3e564640 1 --2- 172.21.15.157:0/442038788 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b08034bb0 0x7f9b08037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9c4124a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9c4124a980 1 --2- 172.21.15.157:0/442038788 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5559fe467070 0x5559fe469530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559fe469c80 con 0x5559fe467070 2024-05-09T09:47:40.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9c3f566640 1 --2- 172.21.15.157:0/442038788 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5559fe467070 0x5559fe469530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9c3e564640 1 --2- 172.21.15.157:0/442038788 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b08034bb0 0x7f9b08037070 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800c010 tx=0x7f9c28010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9c3f566640 1 --2- 172.21.15.157:0/442038788 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5559fe467070 0x5559fe469530 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c380083f0 con 0x5559fe467070 2024-05-09T09:47:40.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9c4124a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:40.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9c4124a980 20 realm 2024-05-09T09:47:40.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9c4124a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46a090 con 0x5559fe467070 2024-05-09T09:47:40.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c380083f0 con 0x5559fe467070 2024-05-09T09:47:40.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9c4124a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:40.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9c4124a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:40.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9c4124a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46a960 con 0x5559fe467070 2024-05-09T09:47:40.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c380083f0 con 0x5559fe467070 2024-05-09T09:47:40.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9c4124a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:40.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9c4124a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x5559fe467070 2024-05-09T09:47:40.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9c380083f0 con 0x5559fe467070 2024-05-09T09:47:40.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9c4124a980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:40.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9c4124a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9c4124a980 1 --2- 172.21.15.157:0/442038788 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5559fe46ba60 0x5559fe46de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46e420 con 0x5559fe46ba60 2024-05-09T09:47:40.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9c3ed65640 1 --2- 172.21.15.157:0/442038788 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5559fe46ba60 0x5559fe46de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.583+0000 7f9c3ed65640 1 --2- 172.21.15.157:0/442038788 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5559fe46ba60 0x5559fe46de50 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.587+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9c300e2070 con 0x5559fe46ba60 2024-05-09T09:47:40.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.587+0000 7f9c4124a980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:40.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.587+0000 7f9c4124a980 20 searching for the correct realm 2024-05-09T09:47:40.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.587+0000 7f9c4124a980 1 --2- 172.21.15.157:0/442038788 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5559fe470370 0x5559fe4727a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.587+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe472e70 con 0x5559fe470370 2024-05-09T09:47:40.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.587+0000 7f9c3e564640 1 --2- 172.21.15.157:0/442038788 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5559fe470370 0x5559fe4727a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.587+0000 7f9c3e564640 1 --2- 172.21.15.157:0/442038788 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5559fe470370 0x5559fe4727a0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.587+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c28037040 con 0x5559fe470370 2024-05-09T09:47:40.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.587+0000 7f9c3e564640 1 --2- 172.21.15.157:0/442038788 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f9c2801fbe0 0x7f9c2803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.587+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe472e70 con 0x7f9c2801fbe0 2024-05-09T09:47:40.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.587+0000 7f9c3f566640 1 --2- 172.21.15.157:0/442038788 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f9c2801fbe0 0x7f9c2803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.587+0000 7f9c3f566640 1 --2- 172.21.15.157:0/442038788 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f9c2801fbe0 0x7f9c2803a3c0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.587+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c380083f0 con 0x7f9c2801fbe0 2024-05-09T09:47:40.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.587+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x5559fe46ba60 2024-05-09T09:47:40.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.587+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c300e2070 con 0x5559fe46ba60 2024-05-09T09:47:40.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.587+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x5559fe467070 2024-05-09T09:47:40.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.587+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c380083f0 con 0x5559fe467070 2024-05-09T09:47:40.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.587+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x5559fe467070 2024-05-09T09:47:40.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.587+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c38026040 con 0x5559fe467070 2024-05-09T09:47:40.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.587+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x5559fe46ba60 2024-05-09T09:47:40.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.591+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c300e2070 con 0x5559fe46ba60 2024-05-09T09:47:40.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.591+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x5559fe46ba60 2024-05-09T09:47:40.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.591+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c300e2070 con 0x5559fe46ba60 2024-05-09T09:47:40.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.591+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x7f9c2801fbe0 2024-05-09T09:47:40.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.591+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c38026040 con 0x7f9c2801fbe0 2024-05-09T09:47:40.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.591+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x5559fe470370 2024-05-09T09:47:40.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.591+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c28037040 con 0x5559fe470370 2024-05-09T09:47:40.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.591+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x5559fe467070 2024-05-09T09:47:40.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.591+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c38026040 con 0x5559fe467070 2024-05-09T09:47:40.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.591+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x5559fe46ba60 2024-05-09T09:47:40.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.591+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c300e2070 con 0x5559fe46ba60 2024-05-09T09:47:40.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.591+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x5559fe467070 2024-05-09T09:47:40.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.591+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c38026040 con 0x5559fe467070 2024-05-09T09:47:40.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.591+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x7f9c2801fbe0 2024-05-09T09:47:40.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.591+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9c38026040 con 0x7f9c2801fbe0 2024-05-09T09:47:40.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.591+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x5559fe470370 2024-05-09T09:47:40.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.591+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c28037040 con 0x5559fe470370 2024-05-09T09:47:40.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.591+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x5559fe470370 2024-05-09T09:47:40.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.595+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9c28037040 con 0x5559fe470370 2024-05-09T09:47:40.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.595+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x5559fe46ba60 2024-05-09T09:47:40.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.595+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c300e2070 con 0x5559fe46ba60 2024-05-09T09:47:40.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.595+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x5559fe470370 2024-05-09T09:47:40.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.595+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c28037040 con 0x5559fe470370 2024-05-09T09:47:40.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.595+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x5559fe470370 2024-05-09T09:47:40.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.595+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c28037040 con 0x5559fe470370 2024-05-09T09:47:40.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.595+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x5559fe467070 2024-05-09T09:47:40.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.595+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c38026040 con 0x5559fe467070 2024-05-09T09:47:40.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.595+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x5559fe467070 2024-05-09T09:47:40.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.595+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9c38026040 con 0x5559fe467070 2024-05-09T09:47:40.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.595+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x5559fe46ba60 2024-05-09T09:47:40.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.595+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c300e2070 con 0x5559fe46ba60 2024-05-09T09:47:40.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.595+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x5559fe470370 2024-05-09T09:47:40.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.595+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c28037040 con 0x5559fe470370 2024-05-09T09:47:40.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.595+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x7f9c2801fbe0 2024-05-09T09:47:40.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.595+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c38026040 con 0x7f9c2801fbe0 2024-05-09T09:47:40.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.595+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x5559fe467070 2024-05-09T09:47:40.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.599+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c38026040 con 0x5559fe467070 2024-05-09T09:47:40.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.599+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x5559fe46ba60 2024-05-09T09:47:40.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.599+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9c300e2070 con 0x5559fe46ba60 2024-05-09T09:47:40.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.599+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x5559fe470370 2024-05-09T09:47:40.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.599+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c28037040 con 0x5559fe470370 2024-05-09T09:47:40.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.599+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x5559fe46ba60 2024-05-09T09:47:40.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.599+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c300e2070 con 0x5559fe46ba60 2024-05-09T09:47:40.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.599+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x7f9c2801fbe0 2024-05-09T09:47:40.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.599+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c38026040 con 0x7f9c2801fbe0 2024-05-09T09:47:40.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.599+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x5559fe470370 2024-05-09T09:47:40.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.599+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c28049040 con 0x5559fe470370 2024-05-09T09:47:40.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.599+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x5559fe46ba60 2024-05-09T09:47:40.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.599+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c300e2070 con 0x5559fe46ba60 2024-05-09T09:47:40.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.599+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x5559fe467070 2024-05-09T09:47:40.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.599+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9c38026040 con 0x5559fe467070 2024-05-09T09:47:40.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.599+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ad00 con 0x7f9c2801fbe0 2024-05-09T09:47:40.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.599+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c38026040 con 0x7f9c2801fbe0 2024-05-09T09:47:40.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.599+0000 7f9c4124a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:40.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.599+0000 7f9c4124a980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:40.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.599+0000 7f9c4124a980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:40.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.599+0000 7f9c4124a980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:40.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.599+0000 7f9c4124a980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:40.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.599+0000 7f9c4124a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:40.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.599+0000 7f9c4124a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.599+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ece0 con 0x5559fe467070 2024-05-09T09:47:40.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c38026040 con 0x5559fe467070 2024-05-09T09:47:40.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c4124a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:40.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c4124a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ece0 con 0x5559fe467070 2024-05-09T09:47:40.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9c38026040 con 0x5559fe467070 2024-05-09T09:47:40.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c4124a980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:40.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c4124a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46ece0 con 0x5559fe470370 2024-05-09T09:47:40.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9c28049040 con 0x5559fe470370 2024-05-09T09:47:40.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c4124a980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:40.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c4124a980 20 zone default found 2024-05-09T09:47:40.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c4124a980 4 Realm: () 2024-05-09T09:47:40.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c4124a980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:40.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c4124a980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:40.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c4124a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:40.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c4124a980 20 zonegroup default 2024-05-09T09:47:40.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c4124a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559fe46f700 con 0x5559fe46ba60 2024-05-09T09:47:40.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9c300e2070 con 0x5559fe46ba60 2024-05-09T09:47:40.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c4124a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:40.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c4124a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559fe475180 con 0x5559fe470370 2024-05-09T09:47:40.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9c28049040 con 0x5559fe470370 2024-05-09T09:47:40.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c4124a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:40.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c4124a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559fe475520 con 0x5559fe470370 2024-05-09T09:47:40.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9c28049040 con 0x5559fe470370 2024-05-09T09:47:40.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c4124a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:40.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c4124a980 20 started sync module instance, tier type = 2024-05-09T09:47:40.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c4124a980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:40.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe4745c0 con 0x7f9c2801fbe0 2024-05-09T09:47:40.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c38026040 con 0x7f9c2801fbe0 2024-05-09T09:47:40.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93845006535136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe4745c0 con 0x7f9c2801fbe0 2024-05-09T09:47:40.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.603+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe475d70 con 0x5559fe467070 2024-05-09T09:47:40.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.607+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93845006535136] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c38036040 con 0x7f9c2801fbe0 2024-05-09T09:47:40.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.607+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c38036040 con 0x5559fe467070 2024-05-09T09:47:40.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.607+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93845006539216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe4745c0 con 0x5559fe467070 2024-05-09T09:47:40.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.607+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe476780 con 0x5559fe470370 2024-05-09T09:47:40.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.611+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93845006539216] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c38036040 con 0x5559fe467070 2024-05-09T09:47:40.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.611+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c28049040 con 0x5559fe470370 2024-05-09T09:47:40.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.611+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93845006532880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe474530 con 0x5559fe470370 2024-05-09T09:47:40.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.611+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe477480 con 0x7f9c2801fbe0 2024-05-09T09:47:40.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.611+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c38036040 con 0x7f9c2801fbe0 2024-05-09T09:47:40.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.611+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93845006545152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe477d20 con 0x7f9c2801fbe0 2024-05-09T09:47:40.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.611+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe4786e0 con 0x5559fe467070 2024-05-09T09:47:40.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.611+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93845006532880] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c28049040 con 0x5559fe470370 2024-05-09T09:47:40.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.611+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93845006545152] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c38036040 con 0x7f9c2801fbe0 2024-05-09T09:47:40.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.611+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c38036040 con 0x5559fe467070 2024-05-09T09:47:40.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.611+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93845006549552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe477c90 con 0x5559fe467070 2024-05-09T09:47:40.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.611+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe478650 con 0x5559fe46ba60 2024-05-09T09:47:40.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.615+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93845006549552] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c38036040 con 0x5559fe467070 2024-05-09T09:47:40.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.615+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c300e2070 con 0x5559fe46ba60 2024-05-09T09:47:40.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.615+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93845006547216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe478f80 con 0x5559fe46ba60 2024-05-09T09:47:40.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.615+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe4797d0 con 0x5559fe46ba60 2024-05-09T09:47:40.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.615+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93845006547216] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c300e2070 con 0x5559fe46ba60 2024-05-09T09:47:40.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.619+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c300e2070 con 0x5559fe46ba60 2024-05-09T09:47:40.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.619+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93845006551760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe47a020 con 0x5559fe46ba60 2024-05-09T09:47:40.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.619+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe47a8b0 con 0x5559fe46ba60 2024-05-09T09:47:40.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.619+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93845006551760] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c300e2070 con 0x5559fe46ba60 2024-05-09T09:47:40.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.619+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c300e2070 con 0x5559fe46ba60 2024-05-09T09:47:40.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.619+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93845006556016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe47aa90 con 0x5559fe46ba60 2024-05-09T09:47:40.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.619+0000 7f9c4124a980 20 add_watcher() i=0 2024-05-09T09:47:40.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.619+0000 7f9c4124a980 20 add_watcher() i=1 2024-05-09T09:47:40.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.619+0000 7f9c4124a980 20 add_watcher() i=2 2024-05-09T09:47:40.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.619+0000 7f9c4124a980 20 add_watcher() i=3 2024-05-09T09:47:40.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.619+0000 7f9c4124a980 20 add_watcher() i=4 2024-05-09T09:47:40.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.619+0000 7f9c4124a980 20 add_watcher() i=5 2024-05-09T09:47:40.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.619+0000 7f9c4124a980 20 add_watcher() i=6 2024-05-09T09:47:40.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.623+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93845006556016] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c300e2070 con 0x5559fe46ba60 2024-05-09T09:47:40.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.623+0000 7f9c4124a980 20 add_watcher() i=7 2024-05-09T09:47:40.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.623+0000 7f9c4124a980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:40.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.623+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559fe47de60 con 0x5559fe467070 2024-05-09T09:47:40.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.623+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9c38036040 con 0x5559fe467070 2024-05-09T09:47:40.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.623+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93845006559616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe47b250 con 0x5559fe467070 2024-05-09T09:47:40.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.623+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93845006559616] v30'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9c38036040 con 0x5559fe467070 2024-05-09T09:47:40.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.623+0000 7f9aef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:40.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.623+0000 7f9c4124a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:40.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.623+0000 7f9c4124a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:40.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.623+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe486690 con 0x5559fe467070 2024-05-09T09:47:40.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.627+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'54 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c38036040 con 0x5559fe467070 2024-05-09T09:47:40.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.627+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe486ce0 con 0x5559fe46ba60 2024-05-09T09:47:40.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.627+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'49 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c300e2070 con 0x5559fe46ba60 2024-05-09T09:47:40.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.627+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe486ce0 con 0x5559fe470370 2024-05-09T09:47:40.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.627+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'48 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c28049040 con 0x5559fe470370 2024-05-09T09:47:40.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.627+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe4877a0 con 0x5559fe467070 2024-05-09T09:47:40.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.631+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'215 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c38036040 con 0x5559fe467070 2024-05-09T09:47:40.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.631+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe484490 con 0x7f9c2801fbe0 2024-05-09T09:47:40.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.631+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'134 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c38036040 con 0x7f9c2801fbe0 2024-05-09T09:47:40.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.631+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe484490 con 0x5559fe470370 2024-05-09T09:47:40.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.635+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'90 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c28049040 con 0x5559fe470370 2024-05-09T09:47:40.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.635+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe4884d0 con 0x5559fe467070 2024-05-09T09:47:40.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.635+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'50 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c38036040 con 0x5559fe467070 2024-05-09T09:47:40.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.635+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe4884d0 con 0x5559fe46ba60 2024-05-09T09:47:40.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.639+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'89 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c300e2070 con 0x5559fe46ba60 2024-05-09T09:47:40.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.639+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe4884d0 con 0x7f9c2801fbe0 2024-05-09T09:47:40.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.639+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'48 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c38036040 con 0x7f9c2801fbe0 2024-05-09T09:47:40.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.639+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe4884d0 con 0x5559fe470370 2024-05-09T09:47:40.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.639+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'54 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9c28049040 con 0x5559fe470370 2024-05-09T09:47:40.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.639+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe488980 con 0x7f9c2801fbe0 2024-05-09T09:47:40.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.643+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'135 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c38036040 con 0x7f9c2801fbe0 2024-05-09T09:47:40.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.643+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe488980 con 0x5559fe46ba60 2024-05-09T09:47:40.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.643+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'50 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c300e2070 con 0x5559fe46ba60 2024-05-09T09:47:40.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.643+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe488980 con 0x7f9c2801fbe0 2024-05-09T09:47:40.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.647+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'48 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c38036040 con 0x7f9c2801fbe0 2024-05-09T09:47:40.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.647+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe488980 con 0x5559fe46ba60 2024-05-09T09:47:40.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.647+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'95 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c300e2070 con 0x5559fe46ba60 2024-05-09T09:47:40.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.647+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe488980 con 0x5559fe467070 2024-05-09T09:47:40.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.647+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'216 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c38036040 con 0x5559fe467070 2024-05-09T09:47:40.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.647+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe488980 con 0x5559fe470370 2024-05-09T09:47:40.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.651+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'128 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c28049040 con 0x5559fe470370 2024-05-09T09:47:40.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.651+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe488a10 con 0x7f9c2801fbe0 2024-05-09T09:47:40.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.651+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'136 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c38036040 con 0x7f9c2801fbe0 2024-05-09T09:47:40.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.651+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe488a10 con 0x5559fe470370 2024-05-09T09:47:40.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.655+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'48 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c28049040 con 0x5559fe470370 2024-05-09T09:47:40.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.655+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe488b10 con 0x5559fe467070 2024-05-09T09:47:40.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.655+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'56 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c38036040 con 0x5559fe467070 2024-05-09T09:47:40.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.655+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe488b10 con 0x5559fe467070 2024-05-09T09:47:40.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.655+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'217 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c38036040 con 0x5559fe467070 2024-05-09T09:47:40.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.659+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe488b10 con 0x5559fe470370 2024-05-09T09:47:40.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.659+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'129 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c28049040 con 0x5559fe470370 2024-05-09T09:47:40.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.659+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe488fc0 con 0x7f9c2801fbe0 2024-05-09T09:47:40.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.659+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'58 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c38036040 con 0x7f9c2801fbe0 2024-05-09T09:47:40.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.659+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe488fc0 con 0x5559fe470370 2024-05-09T09:47:40.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.663+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'50 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c28049040 con 0x5559fe470370 2024-05-09T09:47:40.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.663+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe488fc0 con 0x5559fe470370 2024-05-09T09:47:40.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.663+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'54 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c28049040 con 0x5559fe470370 2024-05-09T09:47:40.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.663+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe488fc0 con 0x5559fe470370 2024-05-09T09:47:40.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.663+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'44 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c28049040 con 0x5559fe470370 2024-05-09T09:47:40.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.663+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe488fc0 con 0x5559fe470370 2024-05-09T09:47:40.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.667+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'91 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c28049040 con 0x5559fe470370 2024-05-09T09:47:40.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.667+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe488fc0 con 0x5559fe46ba60 2024-05-09T09:47:40.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.667+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'50 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c300e2070 con 0x5559fe46ba60 2024-05-09T09:47:40.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.667+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe488fc0 con 0x5559fe470370 2024-05-09T09:47:40.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.671+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'48 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c28049040 con 0x5559fe470370 2024-05-09T09:47:40.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.671+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe488fc0 con 0x5559fe46ba60 2024-05-09T09:47:40.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.671+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'90 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c300e2070 con 0x5559fe46ba60 2024-05-09T09:47:40.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.671+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe488fc0 con 0x5559fe470370 2024-05-09T09:47:40.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.675+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'130 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c28049040 con 0x5559fe470370 2024-05-09T09:47:40.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.675+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe488fc0 con 0x5559fe46ba60 2024-05-09T09:47:40.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.675+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'96 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c300e2070 con 0x5559fe46ba60 2024-05-09T09:47:40.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.675+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe488fc0 con 0x7f9c2801fbe0 2024-05-09T09:47:40.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.679+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'54 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9c38036040 con 0x7f9c2801fbe0 2024-05-09T09:47:40.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.679+0000 7f9aee7fc640 20 reqs_thread_entry: start 2024-05-09T09:47:40.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.679+0000 7f9c4124a980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:40.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.679+0000 7f9a5ffff640 20 reqs_thread_entry: start 2024-05-09T09:47:40.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.679+0000 7f9c4124a980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-09T09:47:40.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.679+0000 7f9c4124a980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.679+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559fe483460 con 0x5559fe46ba60 2024-05-09T09:47:40.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.679+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f9c300e2070 con 0x5559fe46ba60 2024-05-09T09:47:40.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.679+0000 7f9c4124a980 20 rados_obj.operate() r=0 bl.length=380 2024-05-09T09:47:40.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.679+0000 7f9c4124a980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-09T09:47:40.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.679+0000 7f9c4124a980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-09T09:47:40.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.679+0000 7f9c4124a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:40.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.679+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5559fe4a7020 con 0x5559fe46ba60 2024-05-09T09:47:40.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.683+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f9c300e2070 con 0x5559fe46ba60 2024-05-09T09:47:40.680 INFO:teuthology.orchestra.run.smithi157.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-05-09T09:47:40.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.683+0000 7f9aef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:40.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.683+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93845006559616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe47fdd0 con 0x5559fe467070 2024-05-09T09:47:40.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.683+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 93845006559616] v30'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9c38036040 con 0x5559fe467070 2024-05-09T09:47:40.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.683+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93845006535136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe47a980 con 0x7f9c2801fbe0 2024-05-09T09:47:40.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.683+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 93845006535136] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c38036040 con 0x7f9c2801fbe0 2024-05-09T09:47:40.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.683+0000 7f9c4124a980 20 remove_watcher() i=0 2024-05-09T09:47:40.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.683+0000 7f9c4124a980 2 removed watcher, disabling cache 2024-05-09T09:47:40.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.683+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93845006539216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe47a980 con 0x5559fe467070 2024-05-09T09:47:40.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.687+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 93845006539216] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c38036040 con 0x5559fe467070 2024-05-09T09:47:40.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.687+0000 7f9c4124a980 20 remove_watcher() i=1 2024-05-09T09:47:40.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.687+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93845006532880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe4759d0 con 0x5559fe470370 2024-05-09T09:47:40.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.691+0000 7f9c3e564640 1 -- 172.21.15.157:0/442038788 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 93845006532880] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c28049040 con 0x5559fe470370 2024-05-09T09:47:40.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.691+0000 7f9c4124a980 20 remove_watcher() i=2 2024-05-09T09:47:40.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.691+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93845006545152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe47a980 con 0x7f9c2801fbe0 2024-05-09T09:47:40.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.691+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 93845006545152] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c38036040 con 0x7f9c2801fbe0 2024-05-09T09:47:40.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.691+0000 7f9c4124a980 20 remove_watcher() i=3 2024-05-09T09:47:40.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.691+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93845006549552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe474110 con 0x5559fe467070 2024-05-09T09:47:40.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.691+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 93845006549552] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c38036040 con 0x5559fe467070 2024-05-09T09:47:40.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.691+0000 7f9c4124a980 20 remove_watcher() i=4 2024-05-09T09:47:40.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.691+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93845006547216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe4759d0 con 0x5559fe46ba60 2024-05-09T09:47:40.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.695+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 93845006547216] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c300e2070 con 0x5559fe46ba60 2024-05-09T09:47:40.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.695+0000 7f9c4124a980 20 remove_watcher() i=5 2024-05-09T09:47:40.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.695+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93845006551760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe477100 con 0x5559fe46ba60 2024-05-09T09:47:40.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.695+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 93845006551760] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c300e2070 con 0x5559fe46ba60 2024-05-09T09:47:40.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.695+0000 7f9c4124a980 20 remove_watcher() i=6 2024-05-09T09:47:40.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.695+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93845006556016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5559fe47a980 con 0x5559fe46ba60 2024-05-09T09:47:40.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c3ed65640 1 -- 172.21.15.157:0/442038788 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 93845006556016] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c300e2070 con 0x5559fe46ba60 2024-05-09T09:47:40.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 20 remove_watcher() i=7 2024-05-09T09:47:40.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5559fe46ba60 msgr2=0x5559fe46de50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 --2- 172.21.15.157:0/442038788 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5559fe46ba60 0x5559fe46de50 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5559fe467070 msgr2=0x5559fe469530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 --2- 172.21.15.157:0/442038788 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5559fe467070 0x5559fe469530 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f9c2801fbe0 msgr2=0x7f9c2803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 --2- 172.21.15.157:0/442038788 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f9c2801fbe0 0x7f9c2803a3c0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5559fe470370 msgr2=0x5559fe4727a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 --2- 172.21.15.157:0/442038788 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5559fe470370 0x5559fe4727a0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b08034bb0 msgr2=0x7f9b08037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 --2- 172.21.15.157:0/442038788 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b08034bb0 0x7f9b08037070 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800c010 tx=0x7f9c28010000 comp rx=0 tx=0).stop 2024-05-09T09:47:40.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe31bb90 msgr2=0x5559fe45a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 --2- 172.21.15.157:0/442038788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe31bb90 0x5559fe45a4c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9c300d8fb0 tx=0x7f9c300d5e90 comp rx=0 tx=0).stop 2024-05-09T09:47:40.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c3f566640 1 -- 172.21.15.157:0/442038788 reap_dead start 2024-05-09T09:47:40.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 shutdown_connections 2024-05-09T09:47:40.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 --2- 172.21.15.157:0/442038788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe31bb90 0x5559fe45a4c0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 >> 172.21.15.157:0/442038788 conn(0x5559fe44d2f0 msgr2=0x5559fe44a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:40.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 shutdown_connections 2024-05-09T09:47:40.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 -- 172.21.15.157:0/442038788 wait complete. 2024-05-09T09:47:40.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 -- 172.21.15.157:0/1443616596 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b18034c50 msgr2=0x7f9b18037110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 --2- 172.21.15.157:0/1443616596 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b18034c50 0x7f9b18037110 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x5559fe415650 tx=0x7f9c2800f000 comp rx=0 tx=0).stop 2024-05-09T09:47:40.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 -- 172.21.15.157:0/1443616596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe443fc0 msgr2=0x5559fe4443e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 --2- 172.21.15.157:0/1443616596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe443fc0 0x5559fe4443e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9c300e3690 tx=0x7f9c300c6db0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 -- 172.21.15.157:0/1443616596 shutdown_connections 2024-05-09T09:47:40.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 --2- 172.21.15.157:0/1443616596 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b18034c50 0x7f9b18037110 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 --2- 172.21.15.157:0/1443616596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe443fc0 0x5559fe4443e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 -- 172.21.15.157:0/1443616596 >> 172.21.15.157:0/1443616596 conn(0x5559fe438d90 msgr2=0x5559fe4398a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:40.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 -- 172.21.15.157:0/1443616596 shutdown_connections 2024-05-09T09:47:40.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 -- 172.21.15.157:0/1443616596 wait complete. 2024-05-09T09:47:40.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 -- 172.21.15.157:0/4140265382 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5559fe4174d0 msgr2=0x5559fe4198c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 --2- 172.21.15.157:0/4140265382 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5559fe4174d0 0x5559fe4198c0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 -- 172.21.15.157:0/4140265382 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5559fe31eb30 msgr2=0x5559fe414c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 --2- 172.21.15.157:0/4140265382 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5559fe31eb30 0x5559fe414c40 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 -- 172.21.15.157:0/4140265382 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5559fe41b410 msgr2=0x5559fe41d800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 --2- 172.21.15.157:0/4140265382 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5559fe41b410 0x5559fe41d800 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 -- 172.21.15.157:0/4140265382 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b24034bb0 msgr2=0x7f9b24037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 --2- 172.21.15.157:0/4140265382 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9b24034bb0 0x7f9b24037070 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9c28000f70 tx=0x7f9c28001380 comp rx=0 tx=0).stop 2024-05-09T09:47:40.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 -- 172.21.15.157:0/4140265382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe28fa70 msgr2=0x5559fe40db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 --2- 172.21.15.157:0/4140265382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5559fe28fa70 0x5559fe40db90 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9c3001aec0 tx=0x7f9c30017e30 comp rx=0 tx=0).stop 2024-05-09T09:47:40.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c3f566640 1 -- 172.21.15.157:0/4140265382 reap_dead start 2024-05-09T09:47:40.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 -- 172.21.15.157:0/4140265382 shutdown_connections 2024-05-09T09:47:40.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 -- 172.21.15.157:0/4140265382 >> 172.21.15.157:0/4140265382 conn(0x5559fe3160d0 msgr2=0x5559fe4011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:40.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 -- 172.21.15.157:0/4140265382 shutdown_connections 2024-05-09T09:47:40.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.699+0000 7f9c4124a980 1 -- 172.21.15.157:0/4140265382 wait complete. 2024-05-09T09:47:40.710 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-05-09T09:47:40.711 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-05-09T09:47:40.711 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-05-09T09:47:40.711 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-05-09T09:47:40.786 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:40.786 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:40.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.787+0000 7f267481f980 1 Processor -- start 2024-05-09T09:47:40.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.787+0000 7f267481f980 1 -- start start 2024-05-09T09:47:40.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.787+0000 7f267481f980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5627b5234810 0x5627b5234bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.787+0000 7f267481f980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5627b50eb440 con 0x5627b5235130 2024-05-09T09:47:40.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.787+0000 7f267481f980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5627b50d65f0 con 0x5627b5234810 2024-05-09T09:47:40.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.791+0000 7f267233a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5627b5234810 0x5627b5234bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.791+0000 7f267233a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5627b5234810 0x5627b5234bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59136/0 (socket says 172.21.15.157:59136) 2024-05-09T09:47:40.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.791+0000 7f267233a640 1 -- 172.21.15.157:0/2792828529 learned_addr learned my addr 172.21.15.157:0/2792828529 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:40.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.791+0000 7f2671b39640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x5627b5235130 0x5627b5235b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:51722/0 (socket says 172.21.15.157:51722) 2024-05-09T09:47:40.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.791+0000 7f267233a640 1 -- 172.21.15.157:0/2792828529 >> v1:172.21.15.110:6789/0 conn(0x5627b5235130 legacy=0x5627b5235b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.791+0000 7f267233a640 1 -- 172.21.15.157:0/2792828529 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627b50e1990 con 0x5627b5234810 2024-05-09T09:47:40.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.791+0000 7f267233a640 1 --2- 172.21.15.157:0/2792828529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b5234810 0x5627b5234bf0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f266400a750 tx=0x7f266401d200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fe79dc27eaee692 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.791+0000 7f2671338640 1 -- 172.21.15.157:0/2792828529 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26640b1070 con 0x5627b5234810 2024-05-09T09:47:40.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.791+0000 7f2671338640 1 -- 172.21.15.157:0/2792828529 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26640a5e50 con 0x5627b5234810 2024-05-09T09:47:40.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.791+0000 7f2671338640 1 -- 172.21.15.157:0/2792828529 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f266400a350 con 0x5627b5234810 2024-05-09T09:47:40.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.795+0000 7f267481f980 1 -- 172.21.15.157:0/2792828529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b5234810 msgr2=0x5627b5234bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.795+0000 7f267481f980 1 --2- 172.21.15.157:0/2792828529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b5234810 0x5627b5234bf0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f266400a750 tx=0x7f266401d200 comp rx=0 tx=0).stop 2024-05-09T09:47:40.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.795+0000 7f267481f980 1 -- 172.21.15.157:0/2792828529 shutdown_connections 2024-05-09T09:47:40.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.795+0000 7f267481f980 1 --2- 172.21.15.157:0/2792828529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b5234810 0x5627b5234bf0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.795+0000 7f267481f980 1 -- 172.21.15.157:0/2792828529 >> 172.21.15.157:0/2792828529 conn(0x5627b52300e0 msgr2=0x5627b5232500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:40.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.795+0000 7f267481f980 1 -- 172.21.15.157:0/2792828529 shutdown_connections 2024-05-09T09:47:40.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.795+0000 7f267481f980 1 -- 172.21.15.157:0/2792828529 wait complete. 2024-05-09T09:47:40.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.807+0000 7f267481f980 1 Processor -- start 2024-05-09T09:47:40.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.807+0000 7f267481f980 1 -- start start 2024-05-09T09:47:40.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.807+0000 7f267481f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b5234810 0x5627b531f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.807+0000 7f267481f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5627b5138fe0 con 0x5627b5234810 2024-05-09T09:47:40.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.807+0000 7f267233a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b5234810 0x5627b531f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.807+0000 7f267233a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b5234810 0x5627b531f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59142/0 (socket says 172.21.15.157:59142) 2024-05-09T09:47:40.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.807+0000 7f267233a640 1 -- 172.21.15.157:0/1219803969 learned_addr learned my addr 172.21.15.157:0/1219803969 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:40.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.811+0000 7f267233a640 1 -- 172.21.15.157:0/1219803969 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627b50bdae0 con 0x5627b5234810 2024-05-09T09:47:40.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.811+0000 7f267233a640 1 --2- 172.21.15.157:0/1219803969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b5234810 0x5627b531f0d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f26640af040 tx=0x7f2664003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bded253f40a161c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.811+0000 7f2560608640 1 -- 172.21.15.157:0/1219803969 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26640b1050 con 0x5627b5234810 2024-05-09T09:47:40.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.811+0000 7f2560608640 1 -- 172.21.15.157:0/1219803969 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26640bd070 con 0x5627b5234810 2024-05-09T09:47:40.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.811+0000 7f2560608640 1 -- 172.21.15.157:0/1219803969 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26640086d0 con 0x5627b5234810 2024-05-09T09:47:40.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.811+0000 7f267481f980 1 -- 172.21.15.157:0/1219803969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b5234810 msgr2=0x5627b531f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.811+0000 7f267481f980 1 --2- 172.21.15.157:0/1219803969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b5234810 0x5627b531f0d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f26640af040 tx=0x7f2664003030 comp rx=0 tx=0).stop 2024-05-09T09:47:40.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.811+0000 7f267481f980 1 -- 172.21.15.157:0/1219803969 shutdown_connections 2024-05-09T09:47:40.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.811+0000 7f267481f980 1 --2- 172.21.15.157:0/1219803969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b5234810 0x5627b531f0d0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.811+0000 7f267481f980 1 -- 172.21.15.157:0/1219803969 >> 172.21.15.157:0/1219803969 conn(0x5627b52300e0 msgr2=0x5627b531ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:40.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.811+0000 7f267481f980 1 -- 172.21.15.157:0/1219803969 shutdown_connections 2024-05-09T09:47:40.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.811+0000 7f267481f980 1 -- 172.21.15.157:0/1219803969 wait complete. 2024-05-09T09:47:40.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.811+0000 7f267481f980 1 Processor -- start 2024-05-09T09:47:40.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.811+0000 7f267481f980 1 -- start start 2024-05-09T09:47:40.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.811+0000 7f267481f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b5234810 0x5627b5326190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.811+0000 7f267481f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5627b51a9980 con 0x5627b5234810 2024-05-09T09:47:40.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.811+0000 7f267233a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b5234810 0x5627b5326190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.811+0000 7f267233a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b5234810 0x5627b5326190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59146/0 (socket says 172.21.15.157:59146) 2024-05-09T09:47:40.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.811+0000 7f267233a640 1 -- 172.21.15.157:0/3124528795 learned_addr learned my addr 172.21.15.157:0/3124528795 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:40.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.811+0000 7f267233a640 1 -- 172.21.15.157:0/3124528795 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627b53266d0 con 0x5627b5234810 2024-05-09T09:47:40.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.815+0000 7f267233a640 1 --2- 172.21.15.157:0/3124528795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b5234810 0x5627b5326190 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f26640ba040 tx=0x7f2664019fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.815+0000 7f255ee05640 1 -- 172.21.15.157:0/3124528795 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2664008e30 con 0x5627b5234810 2024-05-09T09:47:40.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.815+0000 7f255ee05640 1 -- 172.21.15.157:0/3124528795 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26640b2040 con 0x5627b5234810 2024-05-09T09:47:40.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.815+0000 7f255ee05640 1 -- 172.21.15.157:0/3124528795 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26640b8bb0 con 0x5627b5234810 2024-05-09T09:47:40.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.815+0000 7f267481f980 1 -- 172.21.15.157:0/3124528795 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627b5326960 con 0x5627b5234810 2024-05-09T09:47:40.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.815+0000 7f267481f980 1 -- 172.21.15.157:0/3124528795 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627b53295f0 con 0x5627b5234810 2024-05-09T09:47:40.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.815+0000 7f255ee05640 1 -- 172.21.15.157:0/3124528795 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f26640c9020 con 0x5627b5234810 2024-05-09T09:47:40.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.815+0000 7f255ee05640 1 --2- 172.21.15.157:0/3124528795 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2558034c00 0x7f25580370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.815+0000 7f255ee05640 1 -- 172.21.15.157:0/3124528795 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f26640e6ef0 con 0x5627b5234810 2024-05-09T09:47:40.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.815+0000 7f2671b39640 1 --2- 172.21.15.157:0/3124528795 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2558034c00 0x7f25580370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.815+0000 7f267481f980 1 --2- 172.21.15.157:0/3124528795 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5627b5235130 0x5627b532d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.815+0000 7f267481f980 1 -- 172.21.15.157:0/3124528795 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b532d6f0 con 0x5627b5235130 2024-05-09T09:47:40.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.815+0000 7f2672b3b640 1 --2- 172.21.15.157:0/3124528795 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5627b5235130 0x5627b532d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.815+0000 7f2671b39640 1 --2- 172.21.15.157:0/3124528795 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2558034c00 0x7f25580370c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f265c0016c0 tx=0x7f265c0066c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.815+0000 7f2672b3b640 1 --2- 172.21.15.157:0/3124528795 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5627b5235130 0x5627b532d0d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.819+0000 7f2672b3b640 1 -- 172.21.15.157:0/3124528795 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f266c0083f0 con 0x5627b5235130 2024-05-09T09:47:40.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.819+0000 7f267481f980 1 -- 172.21.15.157:0/3124528795 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b532a7f0 con 0x5627b5235130 2024-05-09T09:47:40.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.819+0000 7f2672b3b640 1 -- 172.21.15.157:0/3124528795 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f266c0083f0 con 0x5627b5235130 2024-05-09T09:47:40.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.819+0000 7f267481f980 1 --2- 172.21.15.157:0/3124528795 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5627b532fa70 0x5627b5331e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.819+0000 7f267481f980 1 -- 172.21.15.157:0/3124528795 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b5332550 con 0x5627b532fa70 2024-05-09T09:47:40.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.819+0000 7f267233a640 1 --2- 172.21.15.157:0/3124528795 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5627b532fa70 0x5627b5331e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.819+0000 7f267233a640 1 --2- 172.21.15.157:0/3124528795 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5627b532fa70 0x5627b5331e60 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.819+0000 7f267233a640 1 -- 172.21.15.157:0/3124528795 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f26640b4070 con 0x5627b532fa70 2024-05-09T09:47:40.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.819+0000 7f267481f980 1 -- 172.21.15.157:0/3124528795 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b532e910 con 0x5627b5235130 2024-05-09T09:47:40.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.819+0000 7f2672b3b640 1 -- 172.21.15.157:0/3124528795 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f266c0083f0 con 0x5627b5235130 2024-05-09T09:47:40.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.819+0000 7f267481f980 1 --2- 172.21.15.157:0/3124528795 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5627b53339b0 0x5627b5335da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.819+0000 7f267481f980 1 -- 172.21.15.157:0/3124528795 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b5336490 con 0x5627b53339b0 2024-05-09T09:47:40.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.819+0000 7f2671b39640 1 --2- 172.21.15.157:0/3124528795 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5627b53339b0 0x5627b5335da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.819+0000 7f2671b39640 1 --2- 172.21.15.157:0/3124528795 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5627b53339b0 0x5627b5335da0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.819+0000 7f2671b39640 1 -- 172.21.15.157:0/3124528795 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f265c00f070 con 0x5627b53339b0 2024-05-09T09:47:40.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.823+0000 7f267481f980 1 Processor -- start 2024-05-09T09:47:40.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.823+0000 7f267481f980 1 -- start start 2024-05-09T09:47:40.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.823+0000 7f267481f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b535c380 0x5627b535c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.823+0000 7f267481f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5627b513d020 con 0x5627b535c380 2024-05-09T09:47:40.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.823+0000 7f267233a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b535c380 0x5627b535c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.823+0000 7f267233a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b535c380 0x5627b535c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59162/0 (socket says 172.21.15.157:59162) 2024-05-09T09:47:40.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.823+0000 7f267233a640 1 -- 172.21.15.157:0/2882832044 learned_addr learned my addr 172.21.15.157:0/2882832044 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:40.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.827+0000 7f267233a640 1 -- 172.21.15.157:0/2882832044 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627b535cce0 con 0x5627b535c380 2024-05-09T09:47:40.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.827+0000 7f267233a640 1 --2- 172.21.15.157:0/2882832044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b535c380 0x5627b535c7a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f26640b7980 tx=0x7f26640c0e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.827+0000 7f2556ba2640 1 -- 172.21.15.157:0/2882832044 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26640bb120 con 0x5627b535c380 2024-05-09T09:47:40.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.827+0000 7f2556ba2640 1 -- 172.21.15.157:0/2882832044 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26640ac610 con 0x5627b535c380 2024-05-09T09:47:40.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.827+0000 7f2556ba2640 1 -- 172.21.15.157:0/2882832044 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26640ad9a0 con 0x5627b535c380 2024-05-09T09:47:40.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.827+0000 7f267481f980 1 -- 172.21.15.157:0/2882832044 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627b535d770 con 0x5627b535c380 2024-05-09T09:47:40.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.827+0000 7f267481f980 1 -- 172.21.15.157:0/2882832044 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627b535d770 con 0x5627b535c380 2024-05-09T09:47:40.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.827+0000 7f2556ba2640 1 -- 172.21.15.157:0/2882832044 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f26640adb40 con 0x5627b535c380 2024-05-09T09:47:40.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.827+0000 7f2556ba2640 1 --2- 172.21.15.157:0/2882832044 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f254c034c00 0x7f254c0370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.827+0000 7f2556ba2640 1 -- 172.21.15.157:0/2882832044 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f26640e3070 con 0x5627b535c380 2024-05-09T09:47:40.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.827+0000 7f2671b39640 1 --2- 172.21.15.157:0/2882832044 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f254c034c00 0x7f254c0370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.827+0000 7f267481f980 1 Processor -- start 2024-05-09T09:47:40.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.827+0000 7f267481f980 1 -- start start 2024-05-09T09:47:40.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.827+0000 7f2671b39640 1 --2- 172.21.15.157:0/2882832044 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f254c034c00 0x7f254c0370c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f265c006340 tx=0x7f265c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.827+0000 7f267481f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b536d560 0x5627b536d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.827+0000 7f267481f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5627b531f760 con 0x5627b536d560 2024-05-09T09:47:40.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.831+0000 7f267233a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b536d560 0x5627b536d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.831+0000 7f267233a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b536d560 0x5627b536d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59174/0 (socket says 172.21.15.157:59174) 2024-05-09T09:47:40.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.831+0000 7f267233a640 1 -- 172.21.15.157:0/2521081896 learned_addr learned my addr 172.21.15.157:0/2521081896 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:40.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.831+0000 7f267233a640 1 -- 172.21.15.157:0/2521081896 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627b536df10 con 0x5627b536d560 2024-05-09T09:47:40.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.831+0000 7f267233a640 1 --2- 172.21.15.157:0/2521081896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b536d560 0x5627b536d940 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f26640c0f20 tx=0x7f26640f56e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a600df146e90634 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.831+0000 7f2554b9e640 1 -- 172.21.15.157:0/2521081896 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26640ade30 con 0x5627b536d560 2024-05-09T09:47:40.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.831+0000 7f2554b9e640 1 -- 172.21.15.157:0/2521081896 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26640cc400 con 0x5627b536d560 2024-05-09T09:47:40.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.831+0000 7f2554b9e640 1 -- 172.21.15.157:0/2521081896 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26640e5e50 con 0x5627b536d560 2024-05-09T09:47:40.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.831+0000 7f267481f980 1 -- 172.21.15.157:0/2521081896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b536d560 msgr2=0x5627b536d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.831+0000 7f267481f980 1 --2- 172.21.15.157:0/2521081896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b536d560 0x5627b536d940 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f26640c0f20 tx=0x7f26640f56e0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.831+0000 7f267481f980 1 -- 172.21.15.157:0/2521081896 shutdown_connections 2024-05-09T09:47:40.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.831+0000 7f267481f980 1 --2- 172.21.15.157:0/2521081896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b536d560 0x5627b536d940 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.831+0000 7f267481f980 1 -- 172.21.15.157:0/2521081896 >> 172.21.15.157:0/2521081896 conn(0x5627b53654d0 msgr2=0x5627b5363530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:40.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.831+0000 7f267481f980 1 -- 172.21.15.157:0/2521081896 shutdown_connections 2024-05-09T09:47:40.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.831+0000 7f267481f980 1 -- 172.21.15.157:0/2521081896 wait complete. 2024-05-09T09:47:40.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.831+0000 7f267481f980 1 Processor -- start 2024-05-09T09:47:40.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.831+0000 7f267481f980 1 -- start start 2024-05-09T09:47:40.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.831+0000 7f267481f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b536d560 0x5627b53748c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.831+0000 7f267481f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5627b536e620 con 0x5627b536d560 2024-05-09T09:47:40.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.831+0000 7f267233a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b536d560 0x5627b53748c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.831+0000 7f267233a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b536d560 0x5627b53748c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59188/0 (socket says 172.21.15.157:59188) 2024-05-09T09:47:40.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.831+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 learned_addr learned my addr 172.21.15.157:0/38457131 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:40.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.831+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627b5374e00 con 0x5627b536d560 2024-05-09T09:47:40.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.831+0000 7f267233a640 1 --2- 172.21.15.157:0/38457131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b536d560 0x5627b53748c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f26640e5c70 tx=0x7f26640f5e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.831+0000 7f2542ffd640 1 -- 172.21.15.157:0/38457131 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2664115070 con 0x5627b536d560 2024-05-09T09:47:40.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.831+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627b5374e00 con 0x5627b536d560 2024-05-09T09:47:40.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.831+0000 7f2542ffd640 1 -- 172.21.15.157:0/38457131 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26640ade30 con 0x5627b536d560 2024-05-09T09:47:40.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.831+0000 7f2542ffd640 1 -- 172.21.15.157:0/38457131 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26640c1870 con 0x5627b536d560 2024-05-09T09:47:40.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.831+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627b5374e00 con 0x5627b536d560 2024-05-09T09:47:40.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f2542ffd640 1 -- 172.21.15.157:0/38457131 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f2664118070 con 0x5627b536d560 2024-05-09T09:47:40.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f2542ffd640 1 --2- 172.21.15.157:0/38457131 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f253c034c00 0x7f253c0370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f2542ffd640 1 -- 172.21.15.157:0/38457131 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f266410b030 con 0x5627b536d560 2024-05-09T09:47:40.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f2671b39640 1 --2- 172.21.15.157:0/38457131 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f253c034c00 0x7f253c0370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f267481f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f267481f980 1 --2- 172.21.15.157:0/38457131 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5627b5381400 0x5627b53838c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b5384010 con 0x5627b5381400 2024-05-09T09:47:40.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f2672b3b640 1 --2- 172.21.15.157:0/38457131 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5627b5381400 0x5627b53838c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f2671b39640 1 --2- 172.21.15.157:0/38457131 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f253c034c00 0x7f253c0370c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x5627b5332920 tx=0x7f265c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f2672b3b640 1 --2- 172.21.15.157:0/38457131 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5627b5381400 0x5627b53838c0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f266c0083f0 con 0x5627b5381400 2024-05-09T09:47:40.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f267481f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:40.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f267481f980 20 realm 2024-05-09T09:47:40.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f267481f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b5384420 con 0x5627b5381400 2024-05-09T09:47:40.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f266c0083f0 con 0x5627b5381400 2024-05-09T09:47:40.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f267481f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:40.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f267481f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:40.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f267481f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b5384cf0 con 0x5627b5381400 2024-05-09T09:47:40.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f266c0083f0 con 0x5627b5381400 2024-05-09T09:47:40.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f267481f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:40.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f267481f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x5627b5381400 2024-05-09T09:47:40.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f266c0083f0 con 0x5627b5381400 2024-05-09T09:47:40.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f267481f980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:40.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f267481f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f267481f980 1 --2- 172.21.15.157:0/38457131 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5627b5385df0 0x5627b53881e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b53887a0 con 0x5627b5385df0 2024-05-09T09:47:40.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.835+0000 7f267233a640 1 --2- 172.21.15.157:0/38457131 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5627b5385df0 0x5627b53881e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.839+0000 7f267233a640 1 --2- 172.21.15.157:0/38457131 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5627b5385df0 0x5627b53881e0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.839+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.839+0000 7f267481f980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:40.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.839+0000 7f267481f980 20 searching for the correct realm 2024-05-09T09:47:40.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.839+0000 7f267481f980 1 --2- 172.21.15.157:0/38457131 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5627b538a6f0 0x5627b538cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.839+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b538d1d0 con 0x5627b538a6f0 2024-05-09T09:47:40.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.839+0000 7f2671b39640 1 --2- 172.21.15.157:0/38457131 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5627b538a6f0 0x5627b538cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.839+0000 7f2671b39640 1 --2- 172.21.15.157:0/38457131 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5627b538a6f0 0x5627b538cb00 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.839+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c00f070 con 0x5627b538a6f0 2024-05-09T09:47:40.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.839+0000 7f2671b39640 1 --2- 172.21.15.157:0/38457131 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f265c024070 0x7f265c031460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:40.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.839+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b538d1d0 con 0x7f265c024070 2024-05-09T09:47:40.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.839+0000 7f2672b3b640 1 --2- 172.21.15.157:0/38457131 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f265c024070 0x7f265c031460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:40.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.839+0000 7f2672b3b640 1 --2- 172.21.15.157:0/38457131 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f265c024070 0x7f265c031460 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:40.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.839+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c0083f0 con 0x7f265c024070 2024-05-09T09:47:40.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.839+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x5627b5385df0 2024-05-09T09:47:40.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.839+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.839+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x5627b5381400 2024-05-09T09:47:40.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.843+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c0083f0 con 0x5627b5381400 2024-05-09T09:47:40.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.843+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x5627b5381400 2024-05-09T09:47:40.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.843+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c026040 con 0x5627b5381400 2024-05-09T09:47:40.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.843+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x5627b5385df0 2024-05-09T09:47:40.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.843+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.843+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x5627b5385df0 2024-05-09T09:47:40.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.843+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.843+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x7f265c024070 2024-05-09T09:47:40.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.843+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c026040 con 0x7f265c024070 2024-05-09T09:47:40.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.843+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x5627b538a6f0 2024-05-09T09:47:40.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.843+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c00f070 con 0x5627b538a6f0 2024-05-09T09:47:40.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.843+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x5627b5381400 2024-05-09T09:47:40.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.843+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c026040 con 0x5627b5381400 2024-05-09T09:47:40.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.843+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x5627b5385df0 2024-05-09T09:47:40.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.843+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.843+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x5627b5381400 2024-05-09T09:47:40.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.843+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c026040 con 0x5627b5381400 2024-05-09T09:47:40.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.843+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x7f265c024070 2024-05-09T09:47:40.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.843+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f266c026040 con 0x7f265c024070 2024-05-09T09:47:40.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.843+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x5627b538a6f0 2024-05-09T09:47:40.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.847+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c040040 con 0x5627b538a6f0 2024-05-09T09:47:40.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.847+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x5627b538a6f0 2024-05-09T09:47:40.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.847+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f265c040040 con 0x5627b538a6f0 2024-05-09T09:47:40.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.847+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x5627b5385df0 2024-05-09T09:47:40.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.847+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.847+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x5627b538a6f0 2024-05-09T09:47:40.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.847+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c040040 con 0x5627b538a6f0 2024-05-09T09:47:40.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.847+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x5627b538a6f0 2024-05-09T09:47:40.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.847+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c040040 con 0x5627b538a6f0 2024-05-09T09:47:40.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.847+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x5627b5381400 2024-05-09T09:47:40.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.847+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c026040 con 0x5627b5381400 2024-05-09T09:47:40.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.847+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x5627b5381400 2024-05-09T09:47:40.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.847+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f266c026040 con 0x5627b5381400 2024-05-09T09:47:40.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.847+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x5627b5385df0 2024-05-09T09:47:40.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.847+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.847+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x5627b538a6f0 2024-05-09T09:47:40.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.847+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c040040 con 0x5627b538a6f0 2024-05-09T09:47:40.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.847+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x7f265c024070 2024-05-09T09:47:40.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.847+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c026040 con 0x7f265c024070 2024-05-09T09:47:40.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.847+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x5627b5381400 2024-05-09T09:47:40.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.847+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c026040 con 0x5627b5381400 2024-05-09T09:47:40.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.847+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x5627b5385df0 2024-05-09T09:47:40.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.851+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.851+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x5627b538a6f0 2024-05-09T09:47:40.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.851+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c040040 con 0x5627b538a6f0 2024-05-09T09:47:40.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.851+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x5627b5385df0 2024-05-09T09:47:40.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.851+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.851+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x7f265c024070 2024-05-09T09:47:40.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.851+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c026040 con 0x7f265c024070 2024-05-09T09:47:40.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.851+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x5627b538a6f0 2024-05-09T09:47:40.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.851+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265c040040 con 0x5627b538a6f0 2024-05-09T09:47:40.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.851+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x5627b5385df0 2024-05-09T09:47:40.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.851+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.851+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x5627b5381400 2024-05-09T09:47:40.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.851+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f266c026040 con 0x5627b5381400 2024-05-09T09:47:40.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.851+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b5385090 con 0x7f265c024070 2024-05-09T09:47:40.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.851+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c026040 con 0x7f265c024070 2024-05-09T09:47:40.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.851+0000 7f267481f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:40.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.851+0000 7f267481f980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:40.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.851+0000 7f267481f980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:40.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.851+0000 7f267481f980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:40.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.851+0000 7f267481f980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:40.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.851+0000 7f267481f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:40.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.851+0000 7f267481f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.851+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b5389060 con 0x5627b5381400 2024-05-09T09:47:40.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f266c026040 con 0x5627b5381400 2024-05-09T09:47:40.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f267481f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:40.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f267481f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b5389060 con 0x5627b5381400 2024-05-09T09:47:40.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f266c026040 con 0x5627b5381400 2024-05-09T09:47:40.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f267481f980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:40.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f267481f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b5389060 con 0x5627b538a6f0 2024-05-09T09:47:40.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f265c040040 con 0x5627b538a6f0 2024-05-09T09:47:40.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f267481f980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:40.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f267481f980 20 zone default found 2024-05-09T09:47:40.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f267481f980 4 Realm: () 2024-05-09T09:47:40.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f267481f980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:40.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f267481f980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:40.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f267481f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:40.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f267481f980 20 zonegroup default 2024-05-09T09:47:40.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f267481f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b5389a50 con 0x5627b5385df0 2024-05-09T09:47:40.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f267481f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:40.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f267481f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b5389600 con 0x5627b538a6f0 2024-05-09T09:47:40.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f265c040040 con 0x5627b538a6f0 2024-05-09T09:47:40.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f267481f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:40.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f267481f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b538f5b0 con 0x5627b538a6f0 2024-05-09T09:47:40.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f265c040040 con 0x5627b538a6f0 2024-05-09T09:47:40.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f267481f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:40.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f267481f980 20 started sync module instance, tier type = 2024-05-09T09:47:40.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f267481f980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:40.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b538e970 con 0x7f265c024070 2024-05-09T09:47:40.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c026040 con 0x7f265c024070 2024-05-09T09:47:40.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94728544120464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b538e970 con 0x7f265c024070 2024-05-09T09:47:40.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.855+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b5390090 con 0x5627b5381400 2024-05-09T09:47:40.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.859+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94728544120464] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c036040 con 0x7f265c024070 2024-05-09T09:47:40.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.859+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c036040 con 0x5627b5381400 2024-05-09T09:47:40.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.859+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94728544123776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b538e970 con 0x5627b5381400 2024-05-09T09:47:40.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.859+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b5390aa0 con 0x5627b538a6f0 2024-05-09T09:47:40.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.859+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94728544123776] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c036040 con 0x5627b5381400 2024-05-09T09:47:40.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.863+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f265c040040 con 0x5627b538a6f0 2024-05-09T09:47:40.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.863+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94728544117952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b538e8e0 con 0x5627b538a6f0 2024-05-09T09:47:40.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.863+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b5391800 con 0x7f265c024070 2024-05-09T09:47:40.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.863+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c036040 con 0x7f265c024070 2024-05-09T09:47:40.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.863+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94728544129776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53920a0 con 0x7f265c024070 2024-05-09T09:47:40.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.863+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b5392aa0 con 0x5627b5381400 2024-05-09T09:47:40.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.863+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94728544117952] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f265c040040 con 0x5627b538a6f0 2024-05-09T09:47:40.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.863+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94728544129776] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c036040 con 0x7f265c024070 2024-05-09T09:47:40.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.863+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c036040 con 0x5627b5381400 2024-05-09T09:47:40.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.863+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94728544128576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b5391ba0 con 0x5627b5381400 2024-05-09T09:47:40.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.863+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b5393340 con 0x5627b5385df0 2024-05-09T09:47:40.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.867+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94728544128576] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c036040 con 0x5627b5381400 2024-05-09T09:47:40.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.867+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.867+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94728544136848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b5391ba0 con 0x5627b5385df0 2024-05-09T09:47:40.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.867+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b5393b90 con 0x5627b5385df0 2024-05-09T09:47:40.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.867+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94728544136848] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.867+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.867+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94728544134576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53943e0 con 0x5627b5385df0 2024-05-09T09:47:40.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.867+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b5394da0 con 0x5627b5385df0 2024-05-09T09:47:40.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.871+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94728544134576] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.871+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.871+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94728544141376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b5394da0 con 0x5627b5385df0 2024-05-09T09:47:40.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.871+0000 7f267481f980 20 add_watcher() i=0 2024-05-09T09:47:40.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.871+0000 7f267481f980 20 add_watcher() i=1 2024-05-09T09:47:40.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.871+0000 7f267481f980 20 add_watcher() i=2 2024-05-09T09:47:40.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.871+0000 7f267481f980 20 add_watcher() i=3 2024-05-09T09:47:40.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.871+0000 7f267481f980 20 add_watcher() i=4 2024-05-09T09:47:40.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.871+0000 7f267481f980 20 add_watcher() i=5 2024-05-09T09:47:40.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.871+0000 7f267481f980 20 add_watcher() i=6 2024-05-09T09:47:40.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.871+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94728544141376] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.871+0000 7f267481f980 20 add_watcher() i=7 2024-05-09T09:47:40.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.875+0000 7f267481f980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:40.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.875+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b53980f0 con 0x5627b5381400 2024-05-09T09:47:40.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.875+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f266c036040 con 0x5627b5381400 2024-05-09T09:47:40.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.875+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94728544156416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b5394f10 con 0x5627b5381400 2024-05-09T09:47:40.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.875+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94728544156416] v30'219 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f266c036040 con 0x5627b5381400 2024-05-09T09:47:40.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.875+0000 7f2527fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:40.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.875+0000 7f267481f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:40.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.875+0000 7f267481f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:40.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.875+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53973b0 con 0x5627b5381400 2024-05-09T09:47:40.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.875+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'55 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f266c036040 con 0x5627b5381400 2024-05-09T09:47:40.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.875+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a1200 con 0x5627b5385df0 2024-05-09T09:47:40.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.879+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'50 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.879+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a1200 con 0x5627b538a6f0 2024-05-09T09:47:40.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.879+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'49 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f265c040040 con 0x5627b538a6f0 2024-05-09T09:47:40.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.879+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a1b10 con 0x5627b5381400 2024-05-09T09:47:40.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.883+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'220 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f266c036040 con 0x5627b5381400 2024-05-09T09:47:40.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.883+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a09c0 con 0x7f265c024070 2024-05-09T09:47:40.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.883+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'137 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f266c036040 con 0x7f265c024070 2024-05-09T09:47:40.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.883+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a2650 con 0x5627b538a6f0 2024-05-09T09:47:40.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.883+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'92 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f265c040040 con 0x5627b538a6f0 2024-05-09T09:47:40.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.883+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a2b00 con 0x5627b5381400 2024-05-09T09:47:40.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.887+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'51 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f266c036040 con 0x5627b5381400 2024-05-09T09:47:40.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.887+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a2b00 con 0x5627b5385df0 2024-05-09T09:47:40.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.887+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'91 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.887+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a2b00 con 0x7f265c024070 2024-05-09T09:47:40.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.891+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'49 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f266c036040 con 0x7f265c024070 2024-05-09T09:47:40.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.891+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a2b00 con 0x5627b538a6f0 2024-05-09T09:47:40.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.891+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'55 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f265c040040 con 0x5627b538a6f0 2024-05-09T09:47:40.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.891+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a2cd0 con 0x7f265c024070 2024-05-09T09:47:40.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.895+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'138 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f266c036040 con 0x7f265c024070 2024-05-09T09:47:40.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.895+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a2cd0 con 0x5627b5385df0 2024-05-09T09:47:40.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.895+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'51 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.895+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a2cd0 con 0x7f265c024070 2024-05-09T09:47:40.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.899+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'49 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f266c036040 con 0x7f265c024070 2024-05-09T09:47:40.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.899+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a2cd0 con 0x5627b5385df0 2024-05-09T09:47:40.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.899+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'97 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.899+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a2d60 con 0x5627b5381400 2024-05-09T09:47:40.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.899+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'221 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f266c036040 con 0x5627b5381400 2024-05-09T09:47:40.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.899+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a2d60 con 0x5627b538a6f0 2024-05-09T09:47:40.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.903+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'131 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f265c040040 con 0x5627b538a6f0 2024-05-09T09:47:40.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.903+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a2d60 con 0x7f265c024070 2024-05-09T09:47:40.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.903+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'139 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f266c036040 con 0x7f265c024070 2024-05-09T09:47:40.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.903+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a2d60 con 0x5627b538a6f0 2024-05-09T09:47:40.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.907+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'49 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f265c040040 con 0x5627b538a6f0 2024-05-09T09:47:40.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.907+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a32e0 con 0x5627b5381400 2024-05-09T09:47:40.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.907+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'57 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f266c036040 con 0x5627b5381400 2024-05-09T09:47:40.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.907+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a32e0 con 0x5627b5381400 2024-05-09T09:47:40.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.907+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'222 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f266c036040 con 0x5627b5381400 2024-05-09T09:47:40.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.907+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a32e0 con 0x5627b538a6f0 2024-05-09T09:47:40.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.911+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'132 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f265c040040 con 0x5627b538a6f0 2024-05-09T09:47:40.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.911+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a32e0 con 0x7f265c024070 2024-05-09T09:47:40.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.911+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'59 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f266c036040 con 0x7f265c024070 2024-05-09T09:47:40.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.911+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a32e0 con 0x5627b538a6f0 2024-05-09T09:47:40.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.915+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'51 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f265c040040 con 0x5627b538a6f0 2024-05-09T09:47:40.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.915+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a32e0 con 0x5627b538a6f0 2024-05-09T09:47:40.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.915+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'55 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f265c040040 con 0x5627b538a6f0 2024-05-09T09:47:40.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.915+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a32e0 con 0x5627b538a6f0 2024-05-09T09:47:40.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.915+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'45 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f265c040040 con 0x5627b538a6f0 2024-05-09T09:47:40.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.915+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a32e0 con 0x5627b538a6f0 2024-05-09T09:47:40.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.919+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'93 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f265c040040 con 0x5627b538a6f0 2024-05-09T09:47:40.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.919+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a32e0 con 0x5627b5385df0 2024-05-09T09:47:40.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.919+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'51 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.919+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a32e0 con 0x5627b538a6f0 2024-05-09T09:47:40.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.919+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'49 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f265c040040 con 0x5627b538a6f0 2024-05-09T09:47:40.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.919+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a32e0 con 0x5627b5385df0 2024-05-09T09:47:40.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.923+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'92 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.923+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a32e0 con 0x5627b538a6f0 2024-05-09T09:47:40.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.927+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'133 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f265c040040 con 0x5627b538a6f0 2024-05-09T09:47:40.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.927+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a32e0 con 0x5627b5385df0 2024-05-09T09:47:40.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.927+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'98 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.927+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53a32e0 con 0x7f265c024070 2024-05-09T09:47:40.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'55 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f266c036040 con 0x7f265c024070 2024-05-09T09:47:40.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f2526fe5640 20 reqs_thread_entry: start 2024-05-09T09:47:40.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f267481f980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:40.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f2524fe1640 20 reqs_thread_entry: start 2024-05-09T09:47:40.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f267481f980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-09T09:47:40.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f267481f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b53bec50 con 0x5627b5385df0 2024-05-09T09:47:40.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f267481f980 20 rados_obj.operate() r=0 bl.length=380 2024-05-09T09:47:40.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f267481f980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-09T09:47:40.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f267481f980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-09T09:47:40.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f267481f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:40.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f267481f980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-09T09:47:40.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f267481f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:95 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b53c0800 con 0x7f265c024070 2024-05-09T09:47:40.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(95 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f266c036040 con 0x7f265c024070 2024-05-09T09:47:40.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f267481f980 20 rados_obj.operate() r=0 bl.length=165 2024-05-09T09:47:40.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f267481f980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-09T09:47:40.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f267481f980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-09T09:47:40.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f267481f980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 : miss 2024-05-09T09:47:40.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f267481f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 8.5 8:a7233c95:root::.bucket.meta.myfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b53c2370 con 0x5627b5381400 2024-05-09T09:47:40.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(96 .bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f266c036040 con 0x5627b5381400 2024-05-09T09:47:40.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f267481f980 20 rados_obj.operate() r=0 bl.length=379 2024-05-09T09:47:40.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f267481f980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 info.flags=0x17 2024-05-09T09:47:40.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f267481f980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 to cache LRU end 2024-05-09T09:47:40.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f267481f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:40.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f267481f980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-09T09:47:40.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f267481f980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 2024-05-09T09:47:40.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f267481f980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-05-09T09:47:40.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.931+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:97 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53c5560 con 0x5627b5385df0 2024-05-09T09:47:40.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.935+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(97 fud.buckets [call] v30'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.935+0000 7f267481f980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-05-09T09:47:40.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.935+0000 7f267481f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:40.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.935+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:98 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b53c4630 con 0x7f265c024070 2024-05-09T09:47:40.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.935+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(98 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f266c036040 con 0x7f265c024070 2024-05-09T09:47:40.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.935+0000 7f267481f980 20 rados_obj.operate() r=0 bl.length=165 2024-05-09T09:47:40.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.935+0000 7f267481f980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-05-09T09:47:40.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.935+0000 7f267481f980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-09T09:47:40.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.935+0000 7f267481f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:40.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.935+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53c9210 con 0x7f265c024070 2024-05-09T09:47:40.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.939+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(99 myfoo [delete,create,call,call,writefull 0~165] v30'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f266c036040 con 0x7f265c024070 2024-05-09T09:47:40.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.939+0000 7f267481f980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-05-09T09:47:40.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.939+0000 7f267481f980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-09T09:47:40.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.939+0000 7f267481f980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-09T09:47:40.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.939+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94728544357504 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b53c5ff0 con 0x5627b5385df0 2024-05-09T09:47:40.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.939+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== watch-notify(notify (1) cookie 94728544134576 notify 128849018886 ret 0) ==== 380+0+0 (crc 0 0 0) 0x5627b53a0400 con 0x5627b5385df0 2024-05-09T09:47:40.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.939+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(100 notify.6 [notify cookie 94728544357504 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.939+0000 7f2554b9e640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018886 cookie 94728544134576 notifier 4524 bl.length()=338 2024-05-09T09:47:40.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.939+0000 7f2554b9e640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-05-09T09:47:40.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.939+0000 7f2554b9e640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-09T09:47:40.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.939+0000 7f2554b9e640 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f25340056c0 con 0x5627b5385df0 2024-05-09T09:47:40.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.939+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.939+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== watch-notify(notify_complete (2) cookie 94728544357504 notify 128849018886 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f26640da040 con 0x5627b5385df0 2024-05-09T09:47:40.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.943+0000 7f2527fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:40.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.943+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94728544156416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53c8c80 con 0x5627b5381400 2024-05-09T09:47:40.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.943+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(102 data_loggenerations_metadata [watch unwatch cookie 94728544156416] v30'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f266c036040 con 0x5627b5381400 2024-05-09T09:47:40.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.943+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:103 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94728544120464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53c8c80 con 0x7f265c024070 2024-05-09T09:47:40.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.943+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(103 notify.0 [watch unwatch cookie 94728544120464] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c036040 con 0x7f265c024070 2024-05-09T09:47:40.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.943+0000 7f267481f980 20 remove_watcher() i=0 2024-05-09T09:47:40.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.943+0000 7f267481f980 2 removed watcher, disabling cache 2024-05-09T09:47:40.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.943+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:104 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94728544123776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53c8c80 con 0x5627b5381400 2024-05-09T09:47:40.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.947+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(104 notify.1 [watch unwatch cookie 94728544123776] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c036040 con 0x5627b5381400 2024-05-09T09:47:40.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.947+0000 7f267481f980 20 remove_watcher() i=1 2024-05-09T09:47:40.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.947+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:105 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94728544117952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b538fb80 con 0x5627b538a6f0 2024-05-09T09:47:40.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.947+0000 7f2671b39640 1 -- 172.21.15.157:0/38457131 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(105 notify.2 [watch unwatch cookie 94728544117952] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f265c040040 con 0x5627b538a6f0 2024-05-09T09:47:40.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.951+0000 7f267481f980 20 remove_watcher() i=2 2024-05-09T09:47:40.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.951+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:106 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94728544129776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53c8c80 con 0x7f265c024070 2024-05-09T09:47:40.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.951+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(106 notify.3 [watch unwatch cookie 94728544129776] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c036040 con 0x7f265c024070 2024-05-09T09:47:40.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.951+0000 7f267481f980 20 remove_watcher() i=3 2024-05-09T09:47:40.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.951+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94728544128576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b538e4c0 con 0x5627b5381400 2024-05-09T09:47:40.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.951+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(107 notify.4 [watch unwatch cookie 94728544128576] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c036040 con 0x5627b5381400 2024-05-09T09:47:40.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.951+0000 7f267481f980 20 remove_watcher() i=4 2024-05-09T09:47:40.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.951+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:108 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94728544136848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53912f0 con 0x5627b5385df0 2024-05-09T09:47:40.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.955+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(108 notify.5 [watch unwatch cookie 94728544136848] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.955+0000 7f267481f980 20 remove_watcher() i=5 2024-05-09T09:47:40.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.955+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:109 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94728544134576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b53c8c80 con 0x5627b5385df0 2024-05-09T09:47:40.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.955+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 32 ==== osd_op_reply(109 notify.6 [watch unwatch cookie 94728544134576] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.955+0000 7f267481f980 20 remove_watcher() i=6 2024-05-09T09:47:40.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.955+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:110 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94728544141376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b5390e40 con 0x5627b5385df0 2024-05-09T09:47:40.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267233a640 1 -- 172.21.15.157:0/38457131 <== osd.0 v2:172.21.15.110:6800/231209037 33 ==== osd_op_reply(110 notify.7 [watch unwatch cookie 94728544141376] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2664117030 con 0x5627b5385df0 2024-05-09T09:47:40.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 20 remove_watcher() i=7 2024-05-09T09:47:40.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5627b5385df0 msgr2=0x5627b53881e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 --2- 172.21.15.157:0/38457131 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5627b5385df0 0x5627b53881e0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5627b5381400 msgr2=0x5627b53838c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 --2- 172.21.15.157:0/38457131 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5627b5381400 0x5627b53838c0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f265c024070 msgr2=0x7f265c031460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 --2- 172.21.15.157:0/38457131 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f265c024070 0x7f265c031460 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5627b538a6f0 msgr2=0x5627b538cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 --2- 172.21.15.157:0/38457131 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5627b538a6f0 0x5627b538cb00 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f253c034c00 msgr2=0x7f253c0370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 --2- 172.21.15.157:0/38457131 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f253c034c00 0x7f253c0370c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x5627b5332920 tx=0x7f265c010000 comp rx=0 tx=0).stop 2024-05-09T09:47:40.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b536d560 msgr2=0x5627b53748c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f2672b3b640 1 -- 172.21.15.157:0/38457131 reap_dead start 2024-05-09T09:47:40.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 --2- 172.21.15.157:0/38457131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b536d560 0x5627b53748c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f26640e5c70 tx=0x7f26640f5e70 comp rx=0 tx=0).stop 2024-05-09T09:47:40.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 shutdown_connections 2024-05-09T09:47:40.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 --2- 172.21.15.157:0/38457131 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b536d560 0x5627b53748c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 >> 172.21.15.157:0/38457131 conn(0x5627b53654d0 msgr2=0x5627b5362b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:40.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 shutdown_connections 2024-05-09T09:47:40.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 -- 172.21.15.157:0/38457131 wait complete. 2024-05-09T09:47:40.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 -- 172.21.15.157:0/2882832044 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f254c034c00 msgr2=0x7f254c0370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 --2- 172.21.15.157:0/2882832044 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f254c034c00 0x7f254c0370c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f265c006340 tx=0x7f265c00f000 comp rx=0 tx=0).stop 2024-05-09T09:47:40.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 -- 172.21.15.157:0/2882832044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b535c380 msgr2=0x5627b535c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 --2- 172.21.15.157:0/2882832044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b535c380 0x5627b535c7a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f26640b7980 tx=0x7f26640c0e50 comp rx=0 tx=0).stop 2024-05-09T09:47:40.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 -- 172.21.15.157:0/2882832044 shutdown_connections 2024-05-09T09:47:40.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 --2- 172.21.15.157:0/2882832044 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f254c034c00 0x7f254c0370c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 --2- 172.21.15.157:0/2882832044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b535c380 0x5627b535c7a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 -- 172.21.15.157:0/2882832044 >> 172.21.15.157:0/2882832044 conn(0x5627b5351150 msgr2=0x5627b5351c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:40.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 -- 172.21.15.157:0/2882832044 shutdown_connections 2024-05-09T09:47:40.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 -- 172.21.15.157:0/2882832044 wait complete. 2024-05-09T09:47:40.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 -- 172.21.15.157:0/3124528795 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5627b532fa70 msgr2=0x5627b5331e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 --2- 172.21.15.157:0/3124528795 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5627b532fa70 0x5627b5331e60 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 -- 172.21.15.157:0/3124528795 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5627b5235130 msgr2=0x5627b532d0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 --2- 172.21.15.157:0/3124528795 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5627b5235130 0x5627b532d0d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 -- 172.21.15.157:0/3124528795 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5627b53339b0 msgr2=0x5627b5335da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 --2- 172.21.15.157:0/3124528795 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5627b53339b0 0x5627b5335da0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 -- 172.21.15.157:0/3124528795 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2558034c00 msgr2=0x7f25580370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 --2- 172.21.15.157:0/3124528795 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2558034c00 0x7f25580370c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f265c0016c0 tx=0x7f265c0066c0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 -- 172.21.15.157:0/3124528795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b5234810 msgr2=0x5627b5326190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:40.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 --2- 172.21.15.157:0/3124528795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5627b5234810 0x5627b5326190 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f26640ba040 tx=0x7f2664019fa0 comp rx=0 tx=0).stop 2024-05-09T09:47:40.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f2672b3b640 1 -- 172.21.15.157:0/3124528795 reap_dead start 2024-05-09T09:47:40.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 -- 172.21.15.157:0/3124528795 shutdown_connections 2024-05-09T09:47:40.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.959+0000 7f267481f980 1 -- 172.21.15.157:0/3124528795 >> 172.21.15.157:0/3124528795 conn(0x5627b52300e0 msgr2=0x5627b5319770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:40.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.963+0000 7f267481f980 1 -- 172.21.15.157:0/3124528795 shutdown_connections 2024-05-09T09:47:40.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:40.963+0000 7f267481f980 1 -- 172.21.15.157:0/3124528795 wait complete. 2024-05-09T09:47:40.972 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1'] 2024-05-09T09:47:40.972 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1'] 2024-05-09T09:47:40.972 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 2024-05-09T09:47:41.056 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:41.056 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:41.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.059+0000 7f69b978c980 1 Processor -- start 2024-05-09T09:47:41.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.059+0000 7f69b978c980 1 -- start start 2024-05-09T09:47:41.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.059+0000 7f69b978c980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x557c97551fd0 0x557c975543c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.059+0000 7f69b978c980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557c97401440 con 0x557c9754dad0 2024-05-09T09:47:41.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.059+0000 7f69b978c980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x557c973ec5f0 con 0x557c97551fd0 2024-05-09T09:47:41.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.059+0000 7f69b6aa6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x557c97551fd0 0x557c975543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.059+0000 7f69b6aa6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x557c97551fd0 0x557c975543c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59192/0 (socket says 172.21.15.157:59192) 2024-05-09T09:47:41.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.059+0000 7f69b6aa6640 1 -- 172.21.15.157:0/81327751 learned_addr learned my addr 172.21.15.157:0/81327751 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:41.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.059+0000 7f69b72a7640 1 --1- 172.21.15.157:0/81327751 >> v1:172.21.15.110:6789/0 conn(0x557c9754dad0 0x557c9754deb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:51724/0 (socket says 172.21.15.157:51724) 2024-05-09T09:47:41.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.059+0000 7f69b6aa6640 1 -- 172.21.15.157:0/81327751 >> v1:172.21.15.110:6789/0 conn(0x557c9754dad0 legacy=0x557c9754deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.059+0000 7f69b6aa6640 1 -- 172.21.15.157:0/81327751 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c973f7990 con 0x557c97551fd0 2024-05-09T09:47:41.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.063+0000 7f69b6aa6640 1 --2- 172.21.15.157:0/81327751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c97551fd0 0x557c975543c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f69a800a4e0 tx=0x7f69a801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bfbb3c1a3befce8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.063+0000 7f69b62a5640 1 -- 172.21.15.157:0/81327751 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69a80aa540 con 0x557c97551fd0 2024-05-09T09:47:41.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.063+0000 7f69b62a5640 1 -- 172.21.15.157:0/81327751 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69a80aa6e0 con 0x557c97551fd0 2024-05-09T09:47:41.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.063+0000 7f69b62a5640 1 -- 172.21.15.157:0/81327751 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69a80aaa40 con 0x557c97551fd0 2024-05-09T09:47:41.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.063+0000 7f69b978c980 1 -- 172.21.15.157:0/81327751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c97551fd0 msgr2=0x557c975543c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.063+0000 7f69b978c980 1 --2- 172.21.15.157:0/81327751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c97551fd0 0x557c975543c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f69a800a4e0 tx=0x7f69a801b090 comp rx=0 tx=0).stop 2024-05-09T09:47:41.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.063+0000 7f69b978c980 1 -- 172.21.15.157:0/81327751 shutdown_connections 2024-05-09T09:47:41.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.063+0000 7f69b978c980 1 --2- 172.21.15.157:0/81327751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c97551fd0 0x557c975543c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.063+0000 7f69b978c980 1 -- 172.21.15.157:0/81327751 >> 172.21.15.157:0/81327751 conn(0x557c974c11f0 msgr2=0x557c974c1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:41.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.063+0000 7f69b978c980 1 -- 172.21.15.157:0/81327751 shutdown_connections 2024-05-09T09:47:41.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.063+0000 7f69b978c980 1 -- 172.21.15.157:0/81327751 wait complete. 2024-05-09T09:47:41.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.079+0000 7f69b978c980 1 Processor -- start 2024-05-09T09:47:41.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.079+0000 7f69b978c980 1 -- start start 2024-05-09T09:47:41.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.079+0000 7f69b978c980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c9754dad0 0x557c97638d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.079+0000 7f69b978c980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557c9744efe0 con 0x557c9754dad0 2024-05-09T09:47:41.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.079+0000 7f69b72a7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c9754dad0 0x557c97638d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.079+0000 7f69b72a7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c9754dad0 0x557c97638d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59208/0 (socket says 172.21.15.157:59208) 2024-05-09T09:47:41.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.079+0000 7f69b72a7640 1 -- 172.21.15.157:0/3596784388 learned_addr learned my addr 172.21.15.157:0/3596784388 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:41.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.079+0000 7f69b72a7640 1 -- 172.21.15.157:0/3596784388 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c973d3ae0 con 0x557c9754dad0 2024-05-09T09:47:41.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.079+0000 7f69b72a7640 1 --2- 172.21.15.157:0/3596784388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c9754dad0 0x557c97638d90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f69a000b240 tx=0x7f69a000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4765899698c318d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.083+0000 7f68a560a640 1 -- 172.21.15.157:0/3596784388 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69a000e700 con 0x557c9754dad0 2024-05-09T09:47:41.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.083+0000 7f68a560a640 1 -- 172.21.15.157:0/3596784388 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69a000e8a0 con 0x557c9754dad0 2024-05-09T09:47:41.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.083+0000 7f68a560a640 1 -- 172.21.15.157:0/3596784388 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69a000eb80 con 0x557c9754dad0 2024-05-09T09:47:41.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.083+0000 7f69b978c980 1 -- 172.21.15.157:0/3596784388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c9754dad0 msgr2=0x557c97638d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.083+0000 7f69b978c980 1 --2- 172.21.15.157:0/3596784388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c9754dad0 0x557c97638d90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f69a000b240 tx=0x7f69a000b700 comp rx=0 tx=0).stop 2024-05-09T09:47:41.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.083+0000 7f69b978c980 1 -- 172.21.15.157:0/3596784388 shutdown_connections 2024-05-09T09:47:41.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.083+0000 7f69b978c980 1 --2- 172.21.15.157:0/3596784388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c9754dad0 0x557c97638d90 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.083+0000 7f69b978c980 1 -- 172.21.15.157:0/3596784388 >> 172.21.15.157:0/3596784388 conn(0x557c974c11f0 msgr2=0x557c97634920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:41.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.083+0000 7f69b978c980 1 -- 172.21.15.157:0/3596784388 shutdown_connections 2024-05-09T09:47:41.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.083+0000 7f69b978c980 1 -- 172.21.15.157:0/3596784388 wait complete. 2024-05-09T09:47:41.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.083+0000 7f69b978c980 1 Processor -- start 2024-05-09T09:47:41.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.083+0000 7f69b978c980 1 -- start start 2024-05-09T09:47:41.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.083+0000 7f69b978c980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c9754dad0 0x557c9763ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.083+0000 7f69b978c980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557c975573f0 con 0x557c9754dad0 2024-05-09T09:47:41.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.083+0000 7f69b72a7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c9754dad0 0x557c9763ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.083+0000 7f69b72a7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c9754dad0 0x557c9763ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59224/0 (socket says 172.21.15.157:59224) 2024-05-09T09:47:41.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.083+0000 7f69b72a7640 1 -- 172.21.15.157:0/2874158013 learned_addr learned my addr 172.21.15.157:0/2874158013 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:41.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.083+0000 7f69b72a7640 1 -- 172.21.15.157:0/2874158013 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c976404a0 con 0x557c9754dad0 2024-05-09T09:47:41.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.083+0000 7f69b72a7640 1 --2- 172.21.15.157:0/2874158013 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c9754dad0 0x557c9763ff60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f69a0000fe0 tx=0x7f69a0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.083+0000 7f68a3e07640 1 -- 172.21.15.157:0/2874158013 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69a000f9c0 con 0x557c9754dad0 2024-05-09T09:47:41.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.083+0000 7f69b978c980 1 -- 172.21.15.157:0/2874158013 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557c97640730 con 0x557c9754dad0 2024-05-09T09:47:41.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.083+0000 7f68a3e07640 1 -- 172.21.15.157:0/2874158013 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69a000fb80 con 0x557c9754dad0 2024-05-09T09:47:41.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.083+0000 7f68a3e07640 1 -- 172.21.15.157:0/2874158013 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69a001a480 con 0x557c9754dad0 2024-05-09T09:47:41.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.083+0000 7f69b978c980 1 -- 172.21.15.157:0/2874158013 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c97643410 con 0x557c9754dad0 2024-05-09T09:47:41.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.087+0000 7f68a3e07640 1 -- 172.21.15.157:0/2874158013 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f69a0017070 con 0x557c9754dad0 2024-05-09T09:47:41.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.087+0000 7f68a3e07640 1 --2- 172.21.15.157:0/2874158013 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f689c034c00 0x7f689c0370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.087+0000 7f68a3e07640 1 -- 172.21.15.157:0/2874158013 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f69a0015020 con 0x557c9754dad0 2024-05-09T09:47:41.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.087+0000 7f69b6aa6640 1 --2- 172.21.15.157:0/2874158013 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f689c034c00 0x7f689c0370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.087+0000 7f69b978c980 1 --2- 172.21.15.157:0/2874158013 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557c97551fd0 0x557c97646ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.087+0000 7f69b978c980 1 -- 172.21.15.157:0/2874158013 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c97647510 con 0x557c97551fd0 2024-05-09T09:47:41.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.087+0000 7f69b7aa8640 1 --2- 172.21.15.157:0/2874158013 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557c97551fd0 0x557c97646ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.087+0000 7f69b6aa6640 1 --2- 172.21.15.157:0/2874158013 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f689c034c00 0x7f689c0370c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f69a80ab000 tx=0x7f69a80a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.087+0000 7f69b7aa8640 1 --2- 172.21.15.157:0/2874158013 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557c97551fd0 0x557c97646ef0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.087+0000 7f69b7aa8640 1 -- 172.21.15.157:0/2874158013 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69b00083f0 con 0x557c97551fd0 2024-05-09T09:47:41.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.087+0000 7f69b978c980 1 -- 172.21.15.157:0/2874158013 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c97644630 con 0x557c97551fd0 2024-05-09T09:47:41.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.087+0000 7f69b7aa8640 1 -- 172.21.15.157:0/2874158013 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f69b00083f0 con 0x557c97551fd0 2024-05-09T09:47:41.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.087+0000 7f69b978c980 1 --2- 172.21.15.157:0/2874158013 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557c976498b0 0x557c9764bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.087+0000 7f69b978c980 1 -- 172.21.15.157:0/2874158013 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c9764c370 con 0x557c976498b0 2024-05-09T09:47:41.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.087+0000 7f69b72a7640 1 --2- 172.21.15.157:0/2874158013 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557c976498b0 0x557c9764bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.087+0000 7f69b72a7640 1 --2- 172.21.15.157:0/2874158013 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557c976498b0 0x557c9764bca0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.091+0000 7f69b72a7640 1 -- 172.21.15.157:0/2874158013 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f69a002e070 con 0x557c976498b0 2024-05-09T09:47:41.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.091+0000 7f69b978c980 1 -- 172.21.15.157:0/2874158013 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c97648750 con 0x557c97551fd0 2024-05-09T09:47:41.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.091+0000 7f69b7aa8640 1 -- 172.21.15.157:0/2874158013 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f69b00083f0 con 0x557c97551fd0 2024-05-09T09:47:41.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.091+0000 7f69b978c980 1 --2- 172.21.15.157:0/2874158013 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557c9764d7d0 0x557c9764fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.091+0000 7f69b978c980 1 -- 172.21.15.157:0/2874158013 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c97650300 con 0x557c9764d7d0 2024-05-09T09:47:41.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.091+0000 7f69b6aa6640 1 --2- 172.21.15.157:0/2874158013 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557c9764d7d0 0x557c9764fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.091+0000 7f69b6aa6640 1 --2- 172.21.15.157:0/2874158013 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557c9764d7d0 0x557c9764fbc0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.091+0000 7f69b6aa6640 1 -- 172.21.15.157:0/2874158013 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f69a80bc040 con 0x557c9764d7d0 2024-05-09T09:47:41.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.095+0000 7f69b978c980 1 Processor -- start 2024-05-09T09:47:41.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.095+0000 7f69b978c980 1 -- start start 2024-05-09T09:47:41.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.095+0000 7f69b978c980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c97676150 0x557c97676570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.095+0000 7f69b978c980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557c97453020 con 0x557c97676150 2024-05-09T09:47:41.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.095+0000 7f69b72a7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c97676150 0x557c97676570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.095+0000 7f69b72a7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c97676150 0x557c97676570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59228/0 (socket says 172.21.15.157:59228) 2024-05-09T09:47:41.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.095+0000 7f69b72a7640 1 -- 172.21.15.157:0/1031975402 learned_addr learned my addr 172.21.15.157:0/1031975402 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:41.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.095+0000 7f69b72a7640 1 -- 172.21.15.157:0/1031975402 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c97676ab0 con 0x557c97676150 2024-05-09T09:47:41.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.095+0000 7f69b72a7640 1 --2- 172.21.15.157:0/1031975402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c97676150 0x557c97676570 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f69a001af20 tx=0x7f69a0019e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.095+0000 7f689bfff640 1 -- 172.21.15.157:0/1031975402 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69a001b3d0 con 0x557c97676150 2024-05-09T09:47:41.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.095+0000 7f69b978c980 1 -- 172.21.15.157:0/1031975402 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557c97677540 con 0x557c97676150 2024-05-09T09:47:41.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.095+0000 7f689bfff640 1 -- 172.21.15.157:0/1031975402 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69a001b570 con 0x557c97676150 2024-05-09T09:47:41.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.095+0000 7f689bfff640 1 -- 172.21.15.157:0/1031975402 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69a001a620 con 0x557c97676150 2024-05-09T09:47:41.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.095+0000 7f69b978c980 1 -- 172.21.15.157:0/1031975402 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c97677540 con 0x557c97676150 2024-05-09T09:47:41.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.099+0000 7f689bfff640 1 -- 172.21.15.157:0/1031975402 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f69a001a7c0 con 0x557c97676150 2024-05-09T09:47:41.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.099+0000 7f689bfff640 1 --2- 172.21.15.157:0/1031975402 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6890034bb0 0x7f6890037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.099+0000 7f689bfff640 1 -- 172.21.15.157:0/1031975402 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f69a004a050 con 0x557c97676150 2024-05-09T09:47:41.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.099+0000 7f69b6aa6640 1 --2- 172.21.15.157:0/1031975402 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6890034bb0 0x7f6890037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.099+0000 7f69b978c980 1 Processor -- start 2024-05-09T09:47:41.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.099+0000 7f69b978c980 1 -- start start 2024-05-09T09:47:41.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.099+0000 7f69b978c980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c97682f80 0x557c976833a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.099+0000 7f69b978c980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557c976394e0 con 0x557c97682f80 2024-05-09T09:47:41.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.099+0000 7f69b6aa6640 1 --2- 172.21.15.157:0/1031975402 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6890034bb0 0x7f6890037070 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x557c97647e60 tx=0x7f69a8005e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.099+0000 7f69b72a7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c97682f80 0x557c976833a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.099+0000 7f69b72a7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c97682f80 0x557c976833a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59240/0 (socket says 172.21.15.157:59240) 2024-05-09T09:47:41.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.099+0000 7f69b72a7640 1 -- 172.21.15.157:0/2300503484 learned_addr learned my addr 172.21.15.157:0/2300503484 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:41.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.099+0000 7f69b72a7640 1 -- 172.21.15.157:0/2300503484 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c97683970 con 0x557c97682f80 2024-05-09T09:47:41.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.099+0000 7f69b72a7640 1 --2- 172.21.15.157:0/2300503484 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c97682f80 0x557c976833a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f69a0011210 tx=0x7f69a003d480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cea1496a4349e8e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.099+0000 7f6899ffb640 1 -- 172.21.15.157:0/2300503484 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69a0042e40 con 0x557c97682f80 2024-05-09T09:47:41.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.099+0000 7f6899ffb640 1 -- 172.21.15.157:0/2300503484 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69a0030ae0 con 0x557c97682f80 2024-05-09T09:47:41.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.099+0000 7f6899ffb640 1 -- 172.21.15.157:0/2300503484 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69a0042fe0 con 0x557c97682f80 2024-05-09T09:47:41.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.099+0000 7f69b978c980 1 -- 172.21.15.157:0/2300503484 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c97682f80 msgr2=0x557c976833a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.099+0000 7f69b978c980 1 --2- 172.21.15.157:0/2300503484 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c97682f80 0x557c976833a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f69a0011210 tx=0x7f69a003d480 comp rx=0 tx=0).stop 2024-05-09T09:47:41.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.099+0000 7f69b978c980 1 -- 172.21.15.157:0/2300503484 shutdown_connections 2024-05-09T09:47:41.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.099+0000 7f69b978c980 1 --2- 172.21.15.157:0/2300503484 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c97682f80 0x557c976833a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.099+0000 7f69b978c980 1 -- 172.21.15.157:0/2300503484 >> 172.21.15.157:0/2300503484 conn(0x557c9767f300 msgr2=0x557c9767d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:41.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.099+0000 7f69b978c980 1 -- 172.21.15.157:0/2300503484 shutdown_connections 2024-05-09T09:47:41.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.099+0000 7f69b978c980 1 -- 172.21.15.157:0/2300503484 wait complete. 2024-05-09T09:47:41.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.099+0000 7f69b978c980 1 Processor -- start 2024-05-09T09:47:41.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.099+0000 7f69b978c980 1 -- start start 2024-05-09T09:47:41.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.099+0000 7f69b978c980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c97682f80 0x557c9768a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.099+0000 7f69b978c980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557c97683ec0 con 0x557c97682f80 2024-05-09T09:47:41.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.103+0000 7f69b72a7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c97682f80 0x557c9768a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.103+0000 7f69b72a7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c97682f80 0x557c9768a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59248/0 (socket says 172.21.15.157:59248) 2024-05-09T09:47:41.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.103+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 learned_addr learned my addr 172.21.15.157:0/4186259993 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:41.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.103+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c9768a730 con 0x557c97682f80 2024-05-09T09:47:41.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.103+0000 7f69b72a7640 1 --2- 172.21.15.157:0/4186259993 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c97682f80 0x557c9768a1f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f69a001cfd0 tx=0x7f69a0010f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.103+0000 7f6887fff640 1 -- 172.21.15.157:0/4186259993 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69a0037350 con 0x557c97682f80 2024-05-09T09:47:41.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.103+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557c9768a730 con 0x557c97682f80 2024-05-09T09:47:41.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.103+0000 7f6887fff640 1 -- 172.21.15.157:0/4186259993 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69a0028a10 con 0x557c97682f80 2024-05-09T09:47:41.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.103+0000 7f6887fff640 1 -- 172.21.15.157:0/4186259993 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69a0028d30 con 0x557c97682f80 2024-05-09T09:47:41.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.103+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c9768a730 con 0x557c97682f80 2024-05-09T09:47:41.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.103+0000 7f6887fff640 1 -- 172.21.15.157:0/4186259993 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f69a0067020 con 0x557c97682f80 2024-05-09T09:47:41.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.103+0000 7f6887fff640 1 --2- 172.21.15.157:0/4186259993 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6880034bb0 0x7f6880037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.103+0000 7f6887fff640 1 -- 172.21.15.157:0/4186259993 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f69a005dc90 con 0x557c97682f80 2024-05-09T09:47:41.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.103+0000 7f69b6aa6640 1 --2- 172.21.15.157:0/4186259993 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6880034bb0 0x7f6880037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.103+0000 7f69b978c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.103+0000 7f69b978c980 1 --2- 172.21.15.157:0/4186259993 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557c97696b50 0x557c97699010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.103+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c97699760 con 0x557c97696b50 2024-05-09T09:47:41.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.103+0000 7f69b7aa8640 1 --2- 172.21.15.157:0/4186259993 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557c97696b50 0x557c97699010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.103+0000 7f69b6aa6640 1 --2- 172.21.15.157:0/4186259993 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6880034bb0 0x7f6880037070 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f69a8000f90 tx=0x7f69a80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.103+0000 7f69b7aa8640 1 --2- 172.21.15.157:0/4186259993 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557c97696b50 0x557c97699010 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69b00083f0 con 0x557c97696b50 2024-05-09T09:47:41.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b978c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b978c980 20 realm 2024-05-09T09:47:41.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b978c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c97699b70 con 0x557c97696b50 2024-05-09T09:47:41.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69b00083f0 con 0x557c97696b50 2024-05-09T09:47:41.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b978c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b978c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:41.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b978c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a440 con 0x557c97696b50 2024-05-09T09:47:41.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69b00083f0 con 0x557c97696b50 2024-05-09T09:47:41.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b978c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b978c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x557c97696b50 2024-05-09T09:47:41.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f69b00083f0 con 0x557c97696b50 2024-05-09T09:47:41.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b978c980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:41.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b978c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b978c980 1 --2- 172.21.15.157:0/4186259993 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557c9769b540 0x557c9769d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c9769def0 con 0x557c9769b540 2024-05-09T09:47:41.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b72a7640 1 --2- 172.21.15.157:0/4186259993 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557c9769b540 0x557c9769d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b72a7640 1 --2- 172.21.15.157:0/4186259993 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557c9769b540 0x557c9769d930 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b978c980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:41.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b978c980 20 searching for the correct realm 2024-05-09T09:47:41.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b978c980 1 --2- 172.21.15.157:0/4186259993 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557c9769fe40 0x557c976a2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c976a28a0 con 0x557c9769fe40 2024-05-09T09:47:41.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b6aa6640 1 --2- 172.21.15.157:0/4186259993 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557c9769fe40 0x557c976a2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b6aa6640 1 --2- 172.21.15.157:0/4186259993 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557c9769fe40 0x557c976a2270 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a80ca070 con 0x557c9769fe40 2024-05-09T09:47:41.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b6aa6640 1 --2- 172.21.15.157:0/4186259993 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f69a80cd050 0x7f69a80cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.107+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c976a28a0 con 0x7f69a80cd050 2024-05-09T09:47:41.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.111+0000 7f69b7aa8640 1 --2- 172.21.15.157:0/4186259993 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f69a80cd050 0x7f69a80cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.111+0000 7f69b7aa8640 1 --2- 172.21.15.157:0/4186259993 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f69a80cd050 0x7f69a80cd430 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.111+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69b00083f0 con 0x7f69a80cd050 2024-05-09T09:47:41.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.111+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x557c9769b540 2024-05-09T09:47:41.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.111+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.111+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x557c97696b50 2024-05-09T09:47:41.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.111+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69b00083f0 con 0x557c97696b50 2024-05-09T09:47:41.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.111+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x557c97696b50 2024-05-09T09:47:41.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.111+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69b0026040 con 0x557c97696b50 2024-05-09T09:47:41.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.111+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x557c9769b540 2024-05-09T09:47:41.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.111+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.111+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x557c9769b540 2024-05-09T09:47:41.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.111+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.111+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x7f69a80cd050 2024-05-09T09:47:41.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.111+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69b0026040 con 0x7f69a80cd050 2024-05-09T09:47:41.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.111+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x557c9769fe40 2024-05-09T09:47:41.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.111+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a80ca070 con 0x557c9769fe40 2024-05-09T09:47:41.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.111+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x557c97696b50 2024-05-09T09:47:41.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.115+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69b0026040 con 0x557c97696b50 2024-05-09T09:47:41.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.115+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x557c9769b540 2024-05-09T09:47:41.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.115+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.115+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x557c97696b50 2024-05-09T09:47:41.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.115+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69b0026040 con 0x557c97696b50 2024-05-09T09:47:41.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.115+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x7f69a80cd050 2024-05-09T09:47:41.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.115+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f69b0026040 con 0x7f69a80cd050 2024-05-09T09:47:41.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.115+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x557c9769fe40 2024-05-09T09:47:41.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.115+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a80ca070 con 0x557c9769fe40 2024-05-09T09:47:41.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.115+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x557c9769fe40 2024-05-09T09:47:41.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.115+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f69a80ca070 con 0x557c9769fe40 2024-05-09T09:47:41.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.115+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x557c9769b540 2024-05-09T09:47:41.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.115+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.115+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x557c9769fe40 2024-05-09T09:47:41.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.115+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a80ca070 con 0x557c9769fe40 2024-05-09T09:47:41.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.115+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x557c9769fe40 2024-05-09T09:47:41.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.115+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a80ca070 con 0x557c9769fe40 2024-05-09T09:47:41.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.115+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x557c97696b50 2024-05-09T09:47:41.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.115+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69b0026040 con 0x557c97696b50 2024-05-09T09:47:41.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.115+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x557c97696b50 2024-05-09T09:47:41.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.115+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f69b0026040 con 0x557c97696b50 2024-05-09T09:47:41.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.115+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x557c9769b540 2024-05-09T09:47:41.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.119+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.119+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x557c9769fe40 2024-05-09T09:47:41.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.119+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a80ca070 con 0x557c9769fe40 2024-05-09T09:47:41.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.119+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x7f69a80cd050 2024-05-09T09:47:41.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.119+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69b0026040 con 0x7f69a80cd050 2024-05-09T09:47:41.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.119+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x557c97696b50 2024-05-09T09:47:41.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.119+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69b0026040 con 0x557c97696b50 2024-05-09T09:47:41.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.119+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x557c9769b540 2024-05-09T09:47:41.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.119+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.119+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x557c9769fe40 2024-05-09T09:47:41.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.119+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a80ca070 con 0x557c9769fe40 2024-05-09T09:47:41.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.119+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x557c9769b540 2024-05-09T09:47:41.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.119+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.119+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x7f69a80cd050 2024-05-09T09:47:41.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.119+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69b0026040 con 0x7f69a80cd050 2024-05-09T09:47:41.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.119+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x557c9769fe40 2024-05-09T09:47:41.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.119+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a80ca070 con 0x557c9769fe40 2024-05-09T09:47:41.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.119+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x557c9769b540 2024-05-09T09:47:41.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x557c97696b50 2024-05-09T09:47:41.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f69b0026040 con 0x557c97696b50 2024-05-09T09:47:41.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x557c9769a7e0 con 0x7f69a80cd050 2024-05-09T09:47:41.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69b0026040 con 0x7f69a80cd050 2024-05-09T09:47:41.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:41.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:41.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:41.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:41.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:41.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:41.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c9769e7b0 con 0x557c97696b50 2024-05-09T09:47:41.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69b0026040 con 0x557c97696b50 2024-05-09T09:47:41.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c9769e7b0 con 0x557c97696b50 2024-05-09T09:47:41.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f69b0026040 con 0x557c97696b50 2024-05-09T09:47:41.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:41.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c9769e7b0 con 0x557c9769fe40 2024-05-09T09:47:41.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f69a80ca070 con 0x557c9769fe40 2024-05-09T09:47:41.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:41.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 20 zone default found 2024-05-09T09:47:41.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 4 Realm: () 2024-05-09T09:47:41.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:41.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:41.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:41.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 20 zonegroup default 2024-05-09T09:47:41.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c9769f1b0 con 0x557c9769b540 2024-05-09T09:47:41.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c9769ed40 con 0x557c9769fe40 2024-05-09T09:47:41.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f69a80ca070 con 0x557c9769fe40 2024-05-09T09:47:41.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c976a4c80 con 0x557c9769fe40 2024-05-09T09:47:41.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f69a80ca070 con 0x557c9769fe40 2024-05-09T09:47:41.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 20 started sync module instance, tier type = 2024-05-09T09:47:41.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:41.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.123+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976a4040 con 0x7f69a80cd050 2024-05-09T09:47:41.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.127+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69b0026040 con 0x7f69a80cd050 2024-05-09T09:47:41.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.127+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93993604629856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976a4040 con 0x7f69a80cd050 2024-05-09T09:47:41.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.127+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976a5740 con 0x557c97696b50 2024-05-09T09:47:41.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.127+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93993604629856] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69b0036040 con 0x7f69a80cd050 2024-05-09T09:47:41.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.127+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69b0036040 con 0x557c97696b50 2024-05-09T09:47:41.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.127+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93993604633136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976a4040 con 0x557c97696b50 2024-05-09T09:47:41.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.127+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976a6150 con 0x557c9769fe40 2024-05-09T09:47:41.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.131+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93993604633136] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69b0036040 con 0x557c97696b50 2024-05-09T09:47:41.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.131+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69a80ca070 con 0x557c9769fe40 2024-05-09T09:47:41.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.131+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93993604627344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976a3fb0 con 0x557c9769fe40 2024-05-09T09:47:41.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.131+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976a6f20 con 0x7f69a80cd050 2024-05-09T09:47:41.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.131+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69b0036040 con 0x7f69a80cd050 2024-05-09T09:47:41.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.131+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93993604639216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976a77c0 con 0x7f69a80cd050 2024-05-09T09:47:41.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.131+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976a81c0 con 0x557c97696b50 2024-05-09T09:47:41.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.131+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93993604627344] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69a80ca070 con 0x557c9769fe40 2024-05-09T09:47:41.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.135+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93993604639216] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69b0036040 con 0x7f69a80cd050 2024-05-09T09:47:41.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.135+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69b0036040 con 0x557c97696b50 2024-05-09T09:47:41.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.135+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93993604638016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976a72c0 con 0x557c97696b50 2024-05-09T09:47:41.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.135+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976a8a60 con 0x557c9769b540 2024-05-09T09:47:41.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.135+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93993604638016] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69b0036040 con 0x557c97696b50 2024-05-09T09:47:41.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.135+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.135+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93993604646320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976a72c0 con 0x557c9769b540 2024-05-09T09:47:41.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.135+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976a92b0 con 0x557c9769b540 2024-05-09T09:47:41.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.139+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.139+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93993604646320] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.139+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93993604648448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976a96d0 con 0x557c9769b540 2024-05-09T09:47:41.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.139+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976a7cf0 con 0x557c9769b540 2024-05-09T09:47:41.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.139+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.139+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93993604652224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976a96d0 con 0x557c9769b540 2024-05-09T09:47:41.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.139+0000 7f69b978c980 20 add_watcher() i=0 2024-05-09T09:47:41.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.139+0000 7f69b978c980 20 add_watcher() i=1 2024-05-09T09:47:41.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.139+0000 7f69b978c980 20 add_watcher() i=2 2024-05-09T09:47:41.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.139+0000 7f69b978c980 20 add_watcher() i=3 2024-05-09T09:47:41.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.139+0000 7f69b978c980 20 add_watcher() i=4 2024-05-09T09:47:41.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.139+0000 7f69b978c980 20 add_watcher() i=5 2024-05-09T09:47:41.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.139+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93993604648448] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.139+0000 7f69b978c980 20 add_watcher() i=6 2024-05-09T09:47:41.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.143+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93993604652224] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.143+0000 7f69b978c980 20 add_watcher() i=7 2024-05-09T09:47:41.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.143+0000 7f69b978c980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:41.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.143+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c976ad110 con 0x557c97696b50 2024-05-09T09:47:41.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.143+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f69b0036040 con 0x557c97696b50 2024-05-09T09:47:41.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.143+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93993604650016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976aa5c0 con 0x557c97696b50 2024-05-09T09:47:41.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.143+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93993604650016] v30'224 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f69b0036040 con 0x557c97696b50 2024-05-09T09:47:41.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.143+0000 7f686cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:41.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.143+0000 7f69b978c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:41.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.143+0000 7f69b978c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:41.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.143+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b5a50 con 0x557c97696b50 2024-05-09T09:47:41.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.147+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'56 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69b0036040 con 0x557c97696b50 2024-05-09T09:47:41.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.147+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b6120 con 0x557c9769b540 2024-05-09T09:47:41.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.147+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'51 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.147+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b6120 con 0x557c9769fe40 2024-05-09T09:47:41.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.151+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'50 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69a80ca070 con 0x557c9769fe40 2024-05-09T09:47:41.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.151+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b6bc0 con 0x557c97696b50 2024-05-09T09:47:41.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.151+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'225 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69b0036040 con 0x557c97696b50 2024-05-09T09:47:41.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.151+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b3840 con 0x7f69a80cd050 2024-05-09T09:47:41.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.151+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'140 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69b0036040 con 0x7f69a80cd050 2024-05-09T09:47:41.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.151+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b3840 con 0x557c9769fe40 2024-05-09T09:47:41.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.155+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'94 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69a80ca070 con 0x557c9769fe40 2024-05-09T09:47:41.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.155+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b78f0 con 0x557c97696b50 2024-05-09T09:47:41.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.155+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'52 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69b0036040 con 0x557c97696b50 2024-05-09T09:47:41.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.155+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b78f0 con 0x557c9769b540 2024-05-09T09:47:41.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.159+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'93 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.159+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b78f0 con 0x7f69a80cd050 2024-05-09T09:47:41.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.159+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'50 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69b0036040 con 0x7f69a80cd050 2024-05-09T09:47:41.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.159+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b78f0 con 0x557c9769fe40 2024-05-09T09:47:41.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.163+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'56 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69a80ca070 con 0x557c9769fe40 2024-05-09T09:47:41.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.163+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b7da0 con 0x7f69a80cd050 2024-05-09T09:47:41.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.163+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'141 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69b0036040 con 0x7f69a80cd050 2024-05-09T09:47:41.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.163+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b7da0 con 0x557c9769b540 2024-05-09T09:47:41.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.163+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'52 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.163+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b7da0 con 0x7f69a80cd050 2024-05-09T09:47:41.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.167+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'50 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69b0036040 con 0x7f69a80cd050 2024-05-09T09:47:41.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.167+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b7da0 con 0x557c9769b540 2024-05-09T09:47:41.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.167+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'99 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.167+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b7da0 con 0x557c97696b50 2024-05-09T09:47:41.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.171+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'226 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69b0036040 con 0x557c97696b50 2024-05-09T09:47:41.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.171+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b7da0 con 0x557c9769fe40 2024-05-09T09:47:41.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.171+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'134 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69a80ca070 con 0x557c9769fe40 2024-05-09T09:47:41.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.171+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b7e30 con 0x7f69a80cd050 2024-05-09T09:47:41.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.175+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'142 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69b0036040 con 0x7f69a80cd050 2024-05-09T09:47:41.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.175+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b7e30 con 0x557c9769fe40 2024-05-09T09:47:41.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.175+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'50 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69a80ca070 con 0x557c9769fe40 2024-05-09T09:47:41.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.175+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b7f40 con 0x557c97696b50 2024-05-09T09:47:41.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.179+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'58 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69b0036040 con 0x557c97696b50 2024-05-09T09:47:41.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.179+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b7f40 con 0x557c97696b50 2024-05-09T09:47:41.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.179+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'227 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69b0036040 con 0x557c97696b50 2024-05-09T09:47:41.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.179+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b7f40 con 0x557c9769fe40 2024-05-09T09:47:41.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.179+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'135 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69a80ca070 con 0x557c9769fe40 2024-05-09T09:47:41.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.179+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b8030 con 0x7f69a80cd050 2024-05-09T09:47:41.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.183+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'60 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69b0036040 con 0x7f69a80cd050 2024-05-09T09:47:41.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.183+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b8030 con 0x557c9769fe40 2024-05-09T09:47:41.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.183+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'52 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69a80ca070 con 0x557c9769fe40 2024-05-09T09:47:41.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.183+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b7fd0 con 0x557c9769fe40 2024-05-09T09:47:41.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.187+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'56 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69a80ca070 con 0x557c9769fe40 2024-05-09T09:47:41.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.187+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b8420 con 0x557c9769fe40 2024-05-09T09:47:41.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.187+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'46 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69a80ca070 con 0x557c9769fe40 2024-05-09T09:47:41.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.187+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b8420 con 0x557c9769fe40 2024-05-09T09:47:41.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.187+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'95 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69a80ca070 con 0x557c9769fe40 2024-05-09T09:47:41.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.187+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b8420 con 0x557c9769b540 2024-05-09T09:47:41.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.191+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'52 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.191+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b8420 con 0x557c9769fe40 2024-05-09T09:47:41.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.191+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'50 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69a80ca070 con 0x557c9769fe40 2024-05-09T09:47:41.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.191+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b8420 con 0x557c9769b540 2024-05-09T09:47:41.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.195+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'94 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.195+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b8420 con 0x557c9769fe40 2024-05-09T09:47:41.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.199+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'136 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69a80ca070 con 0x557c9769fe40 2024-05-09T09:47:41.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.199+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b8420 con 0x557c9769b540 2024-05-09T09:47:41.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.203+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'100 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.203+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976b8420 con 0x7f69a80cd050 2024-05-09T09:47:41.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.203+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'56 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69b0036040 con 0x7f69a80cd050 2024-05-09T09:47:41.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.203+0000 7f67e77fe640 20 reqs_thread_entry: start 2024-05-09T09:47:41.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.203+0000 7f69b978c980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:41.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.203+0000 7f67e57fa640 20 reqs_thread_entry: start 2024-05-09T09:47:41.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.203+0000 7f69b978c980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-09T09:47:41.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.203+0000 7f69b978c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.203+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c976d3940 con 0x557c97696b50 2024-05-09T09:47:41.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.207+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f69b0036040 con 0x557c97696b50 2024-05-09T09:47:41.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.207+0000 7f69b978c980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:47:41.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.207+0000 7f69b978c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-09T09:47:41.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.207+0000 7f69b978c980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:41.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.207+0000 7f69b978c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:41.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.207+0000 7f69b978c980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-09T09:47:41.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.207+0000 7f69b978c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.207+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:95 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c976d3890 con 0x7f69a80cd050 2024-05-09T09:47:41.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.207+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(95 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f69b0036040 con 0x7f69a80cd050 2024-05-09T09:47:41.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.207+0000 7f69b978c980 20 rados_obj.operate() r=0 bl.length=165 2024-05-09T09:47:41.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.207+0000 7f69b978c980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-09T09:47:41.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.207+0000 7f69b978c980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-09T09:47:41.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.207+0000 7f69b978c980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 : miss 2024-05-09T09:47:41.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.207+0000 7f69b978c980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.207+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 8.5 8:a7233c95:root::.bucket.meta.myfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c976d7050 con 0x557c97696b50 2024-05-09T09:47:41.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.207+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(96 .bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f69b0036040 con 0x557c97696b50 2024-05-09T09:47:41.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.207+0000 7f69b978c980 20 rados_obj.operate() r=0 bl.length=379 2024-05-09T09:47:41.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.207+0000 7f69b978c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 info.flags=0x17 2024-05-09T09:47:41.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.207+0000 7f69b978c980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 to cache LRU end 2024-05-09T09:47:41.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.207+0000 7f69b978c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:41.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.207+0000 7f69b978c980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-09T09:47:41.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.207+0000 7f69b978c980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 2024-05-09T09:47:41.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.207+0000 7f69b978c980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-05-09T09:47:41.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.207+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:97 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976db450 con 0x557c9769b540 2024-05-09T09:47:41.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.207+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(97 fud.buckets [call] v30'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.207+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 8.5 8:a7233c95:root::.bucket.meta.myfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976e1370 con 0x557c97696b50 2024-05-09T09:47:41.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.211+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(98 .bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v30'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f69b0036040 con 0x557c97696b50 2024-05-09T09:47:41.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.211+0000 7f69b978c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 info.flags=0x17 2024-05-09T09:47:41.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.211+0000 7f69b978c980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 to cache LRU end 2024-05-09T09:47:41.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.211+0000 7f69b978c980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-09T09:47:41.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.211+0000 7f69b978c980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1, ofs0, ns] 2024-05-09T09:47:41.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.211+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:99 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93993604835584 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c976db880 con 0x557c9769b540 2024-05-09T09:47:41.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.211+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== watch-notify(notify (1) cookie 93993604648448 notify 128849018887 ret 0) ==== 794+0+0 (crc 0 0 0) 0x557c976b3810 con 0x557c9769b540 2024-05-09T09:47:41.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.211+0000 7f6899ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018887 cookie 93993604648448 notifier 4531 bl.length()=752 2024-05-09T09:47:41.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.211+0000 7f6899ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 info.flags=0x17 2024-05-09T09:47:41.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.211+0000 7f6899ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 to cache LRU end 2024-05-09T09:47:41.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.211+0000 7f6899ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-09T09:47:41.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.211+0000 7f6899ffb640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f687c0056c0 con 0x557c9769b540 2024-05-09T09:47:41.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.211+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(99 notify.6 [notify cookie 93993604835584 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.211+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(100 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.211+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== watch-notify(notify_complete (2) cookie 93993604835584 notify 128849018887 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557c97643410 con 0x557c9769b540 2024-05-09T09:47:41.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.211+0000 7f69b978c980 20 handle_bi_update(): bucket=:myfoo[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1]): orig_sources= new_sources= 2024-05-09T09:47:41.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.211+0000 7f69b978c980 20 handle_bi_update(): bucket=:myfoo[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1]): potential sources added=[] removed=[] 2024-05-09T09:47:41.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.211+0000 7f69b978c980 20 handle_bi_update(): bucket=:myfoo[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1]): orig_dests= new_dests= 2024-05-09T09:47:41.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.211+0000 7f69b978c980 20 handle_bi_update(): bucket=:myfoo[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1]): potential dests added=[] removed=[] 2024-05-09T09:47:41.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.211+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:101 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976d6900 con 0x7f69a80cd050 2024-05-09T09:47:41.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.215+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(101 foo.buckets [call] v30'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f69b0036040 con 0x7f69a80cd050 2024-05-09T09:47:41.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.215+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:102 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976d6900 con 0x7f69a80cd050 2024-05-09T09:47:41.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.215+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(102 myfoo [delete,create,call,writefull 0~165] v30'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f69b0036040 con 0x7f69a80cd050 2024-05-09T09:47:41.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.215+0000 7f69b978c980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-09T09:47:41.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.215+0000 7f69b978c980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-09T09:47:41.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.215+0000 7f69b978c980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-09T09:47:41.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.215+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93993604835584 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x557c976e0020 con 0x557c9769b540 2024-05-09T09:47:41.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.219+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== watch-notify(notify (1) cookie 93993604648448 notify 128849018888 ret 0) ==== 356+0+0 (crc 0 0 0) 0x557c97640730 con 0x557c9769b540 2024-05-09T09:47:41.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.219+0000 7f68997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018888 cookie 93993604648448 notifier 4531 bl.length()=314 2024-05-09T09:47:41.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.219+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(103 notify.6 [notify cookie 93993604835584 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.219+0000 7f68997fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-09T09:47:41.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.219+0000 7f68997fa640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-09T09:47:41.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.219+0000 7f68997fa640 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f67ec003a70 con 0x557c9769b540 2024-05-09T09:47:41.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.219+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 32 ==== osd_op_reply(104 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.219+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 33 ==== watch-notify(notify_complete (2) cookie 93993604835584 notify 128849018888 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557c976404a0 con 0x557c9769b540 2024-05-09T09:47:41.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.219+0000 7f686cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:41.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.219+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93993604650016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976d7de0 con 0x557c97696b50 2024-05-09T09:47:41.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.223+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 93993604650016] v30'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f69b0036040 con 0x557c97696b50 2024-05-09T09:47:41.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.223+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93993604629856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976a93f0 con 0x7f69a80cd050 2024-05-09T09:47:41.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.223+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 93993604629856] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69b0036040 con 0x7f69a80cd050 2024-05-09T09:47:41.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.223+0000 7f69b978c980 20 remove_watcher() i=0 2024-05-09T09:47:41.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.223+0000 7f69b978c980 2 removed watcher, disabling cache 2024-05-09T09:47:41.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.223+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93993604633136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976a4540 con 0x557c97696b50 2024-05-09T09:47:41.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.223+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 93993604633136] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69b0036040 con 0x557c97696b50 2024-05-09T09:47:41.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.223+0000 7f69b978c980 20 remove_watcher() i=1 2024-05-09T09:47:41.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.223+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93993604627344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976a5230 con 0x557c9769fe40 2024-05-09T09:47:41.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.227+0000 7f69b6aa6640 1 -- 172.21.15.157:0/4186259993 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 93993604627344] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69a80ca070 con 0x557c9769fe40 2024-05-09T09:47:41.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.227+0000 7f69b978c980 20 remove_watcher() i=2 2024-05-09T09:47:41.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.227+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93993604639216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976a3b90 con 0x7f69a80cd050 2024-05-09T09:47:41.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.227+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 93993604639216] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69b0036040 con 0x7f69a80cd050 2024-05-09T09:47:41.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.227+0000 7f69b978c980 20 remove_watcher() i=3 2024-05-09T09:47:41.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.227+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93993604638016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976a3b90 con 0x557c97696b50 2024-05-09T09:47:41.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.231+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 93993604638016] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69b0036040 con 0x557c97696b50 2024-05-09T09:47:41.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.231+0000 7f69b978c980 20 remove_watcher() i=4 2024-05-09T09:47:41.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.231+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93993604646320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976a3b90 con 0x557c9769b540 2024-05-09T09:47:41.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.231+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 34 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 93993604646320] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.231+0000 7f69b978c980 20 remove_watcher() i=5 2024-05-09T09:47:41.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.231+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93993604648448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976a3b90 con 0x557c9769b540 2024-05-09T09:47:41.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.235+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 35 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 93993604648448] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.235+0000 7f69b978c980 20 remove_watcher() i=6 2024-05-09T09:47:41.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.235+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93993604652224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x557c976a3b90 con 0x557c9769b540 2024-05-09T09:47:41.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b72a7640 1 -- 172.21.15.157:0/4186259993 <== osd.0 v2:172.21.15.110:6800/231209037 36 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 93993604652224] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69a002e070 con 0x557c9769b540 2024-05-09T09:47:41.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 20 remove_watcher() i=7 2024-05-09T09:47:41.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557c9769b540 msgr2=0x557c9769d930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 --2- 172.21.15.157:0/4186259993 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557c9769b540 0x557c9769d930 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557c97696b50 msgr2=0x557c97699010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 --2- 172.21.15.157:0/4186259993 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557c97696b50 0x557c97699010 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f69a80cd050 msgr2=0x7f69a80cd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 --2- 172.21.15.157:0/4186259993 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f69a80cd050 0x7f69a80cd430 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557c9769fe40 msgr2=0x557c976a2270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 --2- 172.21.15.157:0/4186259993 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557c9769fe40 0x557c976a2270 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6880034bb0 msgr2=0x7f6880037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 --2- 172.21.15.157:0/4186259993 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6880034bb0 0x7f6880037070 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f69a8000f90 tx=0x7f69a80a6000 comp rx=0 tx=0).stop 2024-05-09T09:47:41.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c97682f80 msgr2=0x557c9768a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 --2- 172.21.15.157:0/4186259993 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c97682f80 0x557c9768a1f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f69a001cfd0 tx=0x7f69a0010f50 comp rx=0 tx=0).stop 2024-05-09T09:47:41.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 reap_dead start 2024-05-09T09:47:41.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b7aa8640 1 -- 172.21.15.157:0/4186259993 reap_dead start 2024-05-09T09:47:41.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 shutdown_connections 2024-05-09T09:47:41.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 >> 172.21.15.157:0/4186259993 conn(0x557c9767f300 msgr2=0x557c9767c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:41.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 shutdown_connections 2024-05-09T09:47:41.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 -- 172.21.15.157:0/4186259993 wait complete. 2024-05-09T09:47:41.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 -- 172.21.15.157:0/1031975402 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6890034bb0 msgr2=0x7f6890037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 --2- 172.21.15.157:0/1031975402 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6890034bb0 0x7f6890037070 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x557c97647e60 tx=0x7f69a8005e50 comp rx=0 tx=0).stop 2024-05-09T09:47:41.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 -- 172.21.15.157:0/1031975402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c97676150 msgr2=0x557c97676570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 --2- 172.21.15.157:0/1031975402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c97676150 0x557c97676570 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f69a001af20 tx=0x7f69a0019e50 comp rx=0 tx=0).stop 2024-05-09T09:47:41.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 -- 172.21.15.157:0/1031975402 shutdown_connections 2024-05-09T09:47:41.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 --2- 172.21.15.157:0/1031975402 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6890034bb0 0x7f6890037070 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 --2- 172.21.15.157:0/1031975402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c97676150 0x557c97676570 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 -- 172.21.15.157:0/1031975402 >> 172.21.15.157:0/1031975402 conn(0x557c9766af20 msgr2=0x557c9766ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:41.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 -- 172.21.15.157:0/1031975402 shutdown_connections 2024-05-09T09:47:41.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 -- 172.21.15.157:0/1031975402 wait complete. 2024-05-09T09:47:41.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 -- 172.21.15.157:0/2874158013 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557c976498b0 msgr2=0x557c9764bca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 --2- 172.21.15.157:0/2874158013 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557c976498b0 0x557c9764bca0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 -- 172.21.15.157:0/2874158013 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557c97551fd0 msgr2=0x557c97646ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 --2- 172.21.15.157:0/2874158013 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557c97551fd0 0x557c97646ef0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 -- 172.21.15.157:0/2874158013 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557c9764d7d0 msgr2=0x557c9764fbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 --2- 172.21.15.157:0/2874158013 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557c9764d7d0 0x557c9764fbc0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 -- 172.21.15.157:0/2874158013 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f689c034c00 msgr2=0x7f689c0370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 --2- 172.21.15.157:0/2874158013 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f689c034c00 0x7f689c0370c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f69a80ab000 tx=0x7f69a80a5000 comp rx=0 tx=0).stop 2024-05-09T09:47:41.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 -- 172.21.15.157:0/2874158013 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c9754dad0 msgr2=0x557c9763ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 --2- 172.21.15.157:0/2874158013 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c9754dad0 0x557c9763ff60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f69a0000fe0 tx=0x7f69a0000ee0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b7aa8640 1 -- 172.21.15.157:0/2874158013 reap_dead start 2024-05-09T09:47:41.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 -- 172.21.15.157:0/2874158013 shutdown_connections 2024-05-09T09:47:41.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 -- 172.21.15.157:0/2874158013 >> 172.21.15.157:0/2874158013 conn(0x557c974c11f0 msgr2=0x557c97633430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:41.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 -- 172.21.15.157:0/2874158013 shutdown_connections 2024-05-09T09:47:41.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.239+0000 7f69b978c980 1 -- 172.21.15.157:0/2874158013 wait complete. 2024-05-09T09:47:41.251 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-05-09T09:47:41.251 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-05-09T09:47:41.251 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-05-09T09:47:41.325 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:41.325 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:41.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.327+0000 7f87994df980 1 Processor -- start 2024-05-09T09:47:41.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.327+0000 7f87994df980 1 -- start start 2024-05-09T09:47:41.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.327+0000 7f87994df980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x555fdbe33d60 0x555fdbe36150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.327+0000 7f87994df980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555fdbce6440 con 0x555fdbe2f800 2024-05-09T09:47:41.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.327+0000 7f87994df980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x555fdbcd15f0 con 0x555fdbe33d60 2024-05-09T09:47:41.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.327+0000 7f87967f9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x555fdbe33d60 0x555fdbe36150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.327+0000 7f8796ffa640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x555fdbe2f800 0x555fdbe2fbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:51740/0 (socket says 172.21.15.157:51740) 2024-05-09T09:47:41.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.327+0000 7f8796ffa640 1 -- 172.21.15.157:0/75720952 learned_addr learned my addr 172.21.15.157:0/75720952 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:47:41.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.327+0000 7f87967f9640 1 -- 172.21.15.157:0/75720952 >> v1:172.21.15.110:6789/0 conn(0x555fdbe2f800 legacy=0x555fdbe2fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.327+0000 7f87967f9640 1 -- 172.21.15.157:0/75720952 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fdbcdc990 con 0x555fdbe33d60 2024-05-09T09:47:41.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.331+0000 7f87967f9640 1 --2- 172.21.15.157:0/75720952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbe33d60 0x555fdbe36150 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f878c00a480 tx=0x7f878c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8930eac9304b115e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.331+0000 7f8795ff8640 1 -- 172.21.15.157:0/75720952 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f878c0b0070 con 0x555fdbe33d60 2024-05-09T09:47:41.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.331+0000 7f8795ff8640 1 -- 172.21.15.157:0/75720952 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f878c0ab540 con 0x555fdbe33d60 2024-05-09T09:47:41.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.331+0000 7f8795ff8640 1 -- 172.21.15.157:0/75720952 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f878c0ab840 con 0x555fdbe33d60 2024-05-09T09:47:41.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.331+0000 7f87994df980 1 -- 172.21.15.157:0/75720952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbe33d60 msgr2=0x555fdbe36150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.331+0000 7f87994df980 1 --2- 172.21.15.157:0/75720952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbe33d60 0x555fdbe36150 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f878c00a480 tx=0x7f878c01b280 comp rx=0 tx=0).stop 2024-05-09T09:47:41.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.331+0000 7f87994df980 1 -- 172.21.15.157:0/75720952 shutdown_connections 2024-05-09T09:47:41.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.331+0000 7f87994df980 1 --2- 172.21.15.157:0/75720952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbe33d60 0x555fdbe36150 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.331+0000 7f87994df980 1 -- 172.21.15.157:0/75720952 >> 172.21.15.157:0/75720952 conn(0x555fdbe2b0d0 msgr2=0x555fdbe2d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:41.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.331+0000 7f87994df980 1 -- 172.21.15.157:0/75720952 shutdown_connections 2024-05-09T09:47:41.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.331+0000 7f87994df980 1 -- 172.21.15.157:0/75720952 wait complete. 2024-05-09T09:47:41.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.347+0000 7f87994df980 1 Processor -- start 2024-05-09T09:47:41.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.351+0000 7f87994df980 1 -- start start 2024-05-09T09:47:41.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.351+0000 7f87994df980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbe2f800 0x555fdbda4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.351+0000 7f87994df980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x555fdbd33fe0 con 0x555fdbe2f800 2024-05-09T09:47:41.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.351+0000 7f8796ffa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbe2f800 0x555fdbda4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.351+0000 7f8796ffa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbe2f800 0x555fdbda4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59262/0 (socket says 172.21.15.157:59262) 2024-05-09T09:47:41.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.351+0000 7f8796ffa640 1 -- 172.21.15.157:0/1716360661 learned_addr learned my addr 172.21.15.157:0/1716360661 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:41.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.351+0000 7f8796ffa640 1 -- 172.21.15.157:0/1716360661 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fdbcb8ae0 con 0x555fdbe2f800 2024-05-09T09:47:41.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.351+0000 7f8796ffa640 1 --2- 172.21.15.157:0/1716360661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbe2f800 0x555fdbda4180 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8788001e20 tx=0x7f878800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3638928a9f57f673 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.351+0000 7f8684e09640 1 -- 172.21.15.157:0/1716360661 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8788012020 con 0x555fdbe2f800 2024-05-09T09:47:41.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.351+0000 7f8684e09640 1 -- 172.21.15.157:0/1716360661 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f878800e7c0 con 0x555fdbe2f800 2024-05-09T09:47:41.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.351+0000 7f8684e09640 1 -- 172.21.15.157:0/1716360661 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f878800eb00 con 0x555fdbe2f800 2024-05-09T09:47:41.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.351+0000 7f87994df980 1 -- 172.21.15.157:0/1716360661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbe2f800 msgr2=0x555fdbda4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.351+0000 7f87994df980 1 --2- 172.21.15.157:0/1716360661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbe2f800 0x555fdbda4180 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8788001e20 tx=0x7f878800b790 comp rx=0 tx=0).stop 2024-05-09T09:47:41.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.351+0000 7f87994df980 1 -- 172.21.15.157:0/1716360661 shutdown_connections 2024-05-09T09:47:41.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.351+0000 7f87994df980 1 --2- 172.21.15.157:0/1716360661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbe2f800 0x555fdbda4180 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.351+0000 7f87994df980 1 -- 172.21.15.157:0/1716360661 >> 172.21.15.157:0/1716360661 conn(0x555fdbe2b0d0 msgr2=0x555fdbf166b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:41.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.351+0000 7f87994df980 1 -- 172.21.15.157:0/1716360661 shutdown_connections 2024-05-09T09:47:41.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.351+0000 7f87994df980 1 -- 172.21.15.157:0/1716360661 wait complete. 2024-05-09T09:47:41.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.351+0000 7f87994df980 1 Processor -- start 2024-05-09T09:47:41.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.351+0000 7f87994df980 1 -- start start 2024-05-09T09:47:41.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.351+0000 7f87994df980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbe2f800 0x555fdbf1c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.351+0000 7f87994df980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x555fdbe39180 con 0x555fdbe2f800 2024-05-09T09:47:41.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.351+0000 7f8796ffa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbe2f800 0x555fdbf1c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.351+0000 7f8796ffa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbe2f800 0x555fdbf1c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59278/0 (socket says 172.21.15.157:59278) 2024-05-09T09:47:41.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.351+0000 7f8796ffa640 1 -- 172.21.15.157:0/3702590950 learned_addr learned my addr 172.21.15.157:0/3702590950 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:41.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.355+0000 7f8796ffa640 1 -- 172.21.15.157:0/3702590950 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fdbf1c8e0 con 0x555fdbe2f800 2024-05-09T09:47:41.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.355+0000 7f8796ffa640 1 --2- 172.21.15.157:0/3702590950 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbe2f800 0x555fdbf1c3a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8788001e20 tx=0x7f8788000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.355+0000 7f8683606640 1 -- 172.21.15.157:0/3702590950 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8788012030 con 0x555fdbe2f800 2024-05-09T09:47:41.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.355+0000 7f8683606640 1 -- 172.21.15.157:0/3702590950 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8788001480 con 0x555fdbe2f800 2024-05-09T09:47:41.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.355+0000 7f87994df980 1 -- 172.21.15.157:0/3702590950 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555fdbf1aac0 con 0x555fdbe2f800 2024-05-09T09:47:41.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.355+0000 7f8683606640 1 -- 172.21.15.157:0/3702590950 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f878801a910 con 0x555fdbe2f800 2024-05-09T09:47:41.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.355+0000 7f87994df980 1 -- 172.21.15.157:0/3702590950 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fdbf1afb0 con 0x555fdbe2f800 2024-05-09T09:47:41.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.355+0000 7f8683606640 1 -- 172.21.15.157:0/3702590950 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f8788015020 con 0x555fdbe2f800 2024-05-09T09:47:41.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.355+0000 7f8683606640 1 --2- 172.21.15.157:0/3702590950 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f867c034bb0 0x7f867c037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.355+0000 7f8683606640 1 -- 172.21.15.157:0/3702590950 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f8788020030 con 0x555fdbe2f800 2024-05-09T09:47:41.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.355+0000 7f87967f9640 1 --2- 172.21.15.157:0/3702590950 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f867c034bb0 0x7f867c037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.355+0000 7f87994df980 1 --2- 172.21.15.157:0/3702590950 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555fdbf2a2d0 0x555fdbf2c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.355+0000 7f87994df980 1 -- 172.21.15.157:0/3702590950 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf2cc00 con 0x555fdbf2a2d0 2024-05-09T09:47:41.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.355+0000 7f87977fb640 1 --2- 172.21.15.157:0/3702590950 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555fdbf2a2d0 0x555fdbf2c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.355+0000 7f87967f9640 1 --2- 172.21.15.157:0/3702590950 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f867c034bb0 0x7f867c037070 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f878c0ad000 tx=0x7f878c0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.355+0000 7f87977fb640 1 --2- 172.21.15.157:0/3702590950 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555fdbf2a2d0 0x555fdbf2c6c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.355+0000 7f87977fb640 1 -- 172.21.15.157:0/3702590950 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf2a2d0 2024-05-09T09:47:41.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.355+0000 7f87994df980 1 -- 172.21.15.157:0/3702590950 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf2cfe0 con 0x555fdbf2a2d0 2024-05-09T09:47:41.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.359+0000 7f87977fb640 1 -- 172.21.15.157:0/3702590950 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf2a2d0 2024-05-09T09:47:41.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.359+0000 7f87994df980 1 --2- 172.21.15.157:0/3702590950 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555fdbf2edf0 0x555fdbf311e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.359+0000 7f87994df980 1 -- 172.21.15.157:0/3702590950 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf318d0 con 0x555fdbf2edf0 2024-05-09T09:47:41.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.359+0000 7f8796ffa640 1 --2- 172.21.15.157:0/3702590950 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555fdbf2edf0 0x555fdbf311e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.359+0000 7f8796ffa640 1 --2- 172.21.15.157:0/3702590950 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555fdbf2edf0 0x555fdbf311e0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.359+0000 7f8796ffa640 1 -- 172.21.15.157:0/3702590950 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf2edf0 2024-05-09T09:47:41.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.359+0000 7f87994df980 1 -- 172.21.15.157:0/3702590950 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf2dc60 con 0x555fdbf2a2d0 2024-05-09T09:47:41.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.359+0000 7f87977fb640 1 -- 172.21.15.157:0/3702590950 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf2a2d0 2024-05-09T09:47:41.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.359+0000 7f87994df980 1 --2- 172.21.15.157:0/3702590950 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555fdbf32d30 0x555fdbf35120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.359+0000 7f87994df980 1 -- 172.21.15.157:0/3702590950 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf35820 con 0x555fdbf32d30 2024-05-09T09:47:41.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.359+0000 7f87967f9640 1 --2- 172.21.15.157:0/3702590950 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555fdbf32d30 0x555fdbf35120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.359+0000 7f87967f9640 1 --2- 172.21.15.157:0/3702590950 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555fdbf32d30 0x555fdbf35120 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.359+0000 7f87967f9640 1 -- 172.21.15.157:0/3702590950 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f878c0b3040 con 0x555fdbf32d30 2024-05-09T09:47:41.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.363+0000 7f87994df980 1 Processor -- start 2024-05-09T09:47:41.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.363+0000 7f87994df980 1 -- start start 2024-05-09T09:47:41.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.363+0000 7f87994df980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbf5b710 0x555fdbf5bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.363+0000 7f87994df980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x555fdbd38020 con 0x555fdbf5b710 2024-05-09T09:47:41.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.363+0000 7f8796ffa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbf5b710 0x555fdbf5bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.363+0000 7f8796ffa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbf5b710 0x555fdbf5bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59280/0 (socket says 172.21.15.157:59280) 2024-05-09T09:47:41.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.363+0000 7f8796ffa640 1 -- 172.21.15.157:0/997180171 learned_addr learned my addr 172.21.15.157:0/997180171 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:41.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.367+0000 7f8796ffa640 1 -- 172.21.15.157:0/997180171 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fdbf5c070 con 0x555fdbf5b710 2024-05-09T09:47:41.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.367+0000 7f8796ffa640 1 --2- 172.21.15.157:0/997180171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbf5b710 0x555fdbf5bb30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f878800efb0 tx=0x7f878800db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.367+0000 7f867b7fe640 1 -- 172.21.15.157:0/997180171 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f878800d510 con 0x555fdbf5b710 2024-05-09T09:47:41.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.367+0000 7f867b7fe640 1 -- 172.21.15.157:0/997180171 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f878801ac90 con 0x555fdbf5b710 2024-05-09T09:47:41.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.367+0000 7f87994df980 1 -- 172.21.15.157:0/997180171 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555fdbf5cb00 con 0x555fdbf5b710 2024-05-09T09:47:41.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.367+0000 7f867b7fe640 1 -- 172.21.15.157:0/997180171 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8788017c50 con 0x555fdbf5b710 2024-05-09T09:47:41.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.367+0000 7f87994df980 1 -- 172.21.15.157:0/997180171 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fdbf5cfe0 con 0x555fdbf5b710 2024-05-09T09:47:41.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.367+0000 7f867b7fe640 1 -- 172.21.15.157:0/997180171 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f8788009070 con 0x555fdbf5b710 2024-05-09T09:47:41.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.367+0000 7f867b7fe640 1 --2- 172.21.15.157:0/997180171 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8670034ca0 0x7f8670037160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.367+0000 7f867b7fe640 1 -- 172.21.15.157:0/997180171 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f8788039070 con 0x555fdbf5b710 2024-05-09T09:47:41.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.367+0000 7f87967f9640 1 --2- 172.21.15.157:0/997180171 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8670034ca0 0x7f8670037160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.367+0000 7f87994df980 1 Processor -- start 2024-05-09T09:47:41.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.367+0000 7f87994df980 1 -- start start 2024-05-09T09:47:41.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.367+0000 7f87994df980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbf68680 0x555fdbf68a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.367+0000 7f87967f9640 1 --2- 172.21.15.157:0/997180171 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8670034ca0 0x7f8670037160 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x555fdbf1b2d0 tx=0x7f878c005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.367+0000 7f87994df980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x555fdbda48d0 con 0x555fdbf68680 2024-05-09T09:47:41.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.371+0000 7f8796ffa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbf68680 0x555fdbf68a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.371+0000 7f8796ffa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbf68680 0x555fdbf68a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59294/0 (socket says 172.21.15.157:59294) 2024-05-09T09:47:41.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.371+0000 7f8796ffa640 1 -- 172.21.15.157:0/130724850 learned_addr learned my addr 172.21.15.157:0/130724850 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:41.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.371+0000 7f8796ffa640 1 -- 172.21.15.157:0/130724850 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fdbf69030 con 0x555fdbf68680 2024-05-09T09:47:41.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.371+0000 7f8796ffa640 1 --2- 172.21.15.157:0/130724850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbf68680 0x555fdbf68a60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8788018740 tx=0x7f87880216a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1dd2637547eda4d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.371+0000 7f86797fa640 1 -- 172.21.15.157:0/130724850 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f878803b5b0 con 0x555fdbf68680 2024-05-09T09:47:41.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.371+0000 7f86797fa640 1 -- 172.21.15.157:0/130724850 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8788032e30 con 0x555fdbf68680 2024-05-09T09:47:41.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.371+0000 7f86797fa640 1 -- 172.21.15.157:0/130724850 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f878801ddc0 con 0x555fdbf68680 2024-05-09T09:47:41.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.371+0000 7f87994df980 1 -- 172.21.15.157:0/130724850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbf68680 msgr2=0x555fdbf68a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.371+0000 7f87994df980 1 --2- 172.21.15.157:0/130724850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbf68680 0x555fdbf68a60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8788018740 tx=0x7f87880216a0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.371+0000 7f87994df980 1 -- 172.21.15.157:0/130724850 shutdown_connections 2024-05-09T09:47:41.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.371+0000 7f87994df980 1 --2- 172.21.15.157:0/130724850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbf68680 0x555fdbf68a60 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.371+0000 7f87994df980 1 -- 172.21.15.157:0/130724850 >> 172.21.15.157:0/130724850 conn(0x555fdbf64a00 msgr2=0x555fdbf62a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:41.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.371+0000 7f87994df980 1 -- 172.21.15.157:0/130724850 shutdown_connections 2024-05-09T09:47:41.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.371+0000 7f87994df980 1 -- 172.21.15.157:0/130724850 wait complete. 2024-05-09T09:47:41.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.371+0000 7f87994df980 1 Processor -- start 2024-05-09T09:47:41.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.371+0000 7f87994df980 1 -- start start 2024-05-09T09:47:41.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.371+0000 7f87994df980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbf68680 0x555fdbf6fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.371+0000 7f87994df980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x555fdbf69740 con 0x555fdbf68680 2024-05-09T09:47:41.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.371+0000 7f8796ffa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbf68680 0x555fdbf6fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.371+0000 7f8796ffa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbf68680 0x555fdbf6fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59298/0 (socket says 172.21.15.157:59298) 2024-05-09T09:47:41.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.371+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 learned_addr learned my addr 172.21.15.157:0/1246137958 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:41.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.371+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fdbf6ff80 con 0x555fdbf68680 2024-05-09T09:47:41.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.371+0000 7f8796ffa640 1 --2- 172.21.15.157:0/1246137958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbf68680 0x555fdbf6fa40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8788018740 tx=0x7f87880420e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.371+0000 7f86677fe640 1 -- 172.21.15.157:0/1246137958 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f878803b3b0 con 0x555fdbf68680 2024-05-09T09:47:41.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.371+0000 7f86677fe640 1 -- 172.21.15.157:0/1246137958 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f878804ad90 con 0x555fdbf68680 2024-05-09T09:47:41.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.371+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555fdbf6ff80 con 0x555fdbf68680 2024-05-09T09:47:41.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.371+0000 7f86677fe640 1 -- 172.21.15.157:0/1246137958 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87880219f0 con 0x555fdbf68680 2024-05-09T09:47:41.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fdbf6ff80 con 0x555fdbf68680 2024-05-09T09:47:41.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f86677fe640 1 -- 172.21.15.157:0/1246137958 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f878806d060 con 0x555fdbf68680 2024-05-09T09:47:41.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f86677fe640 1 --2- 172.21.15.157:0/1246137958 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8660034bb0 0x7f8660037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f86677fe640 1 -- 172.21.15.157:0/1246137958 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f8788005050 con 0x555fdbf68680 2024-05-09T09:47:41.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f87967f9640 1 --2- 172.21.15.157:0/1246137958 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8660034bb0 0x7f8660037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f87994df980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f87994df980 1 --2- 172.21.15.157:0/1246137958 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555fdbf7c500 0x555fdbf7e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf7f110 con 0x555fdbf7c500 2024-05-09T09:47:41.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f87977fb640 1 --2- 172.21.15.157:0/1246137958 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555fdbf7c500 0x555fdbf7e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f87967f9640 1 --2- 172.21.15.157:0/1246137958 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8660034bb0 0x7f8660037070 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x555fdbf35c20 tx=0x7f878c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f87977fb640 1 --2- 172.21.15.157:0/1246137958 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555fdbf7c500 0x555fdbf7e9c0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf7c500 2024-05-09T09:47:41.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f87994df980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f87994df980 20 realm 2024-05-09T09:47:41.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f87994df980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf7f520 con 0x555fdbf7c500 2024-05-09T09:47:41.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf7c500 2024-05-09T09:47:41.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f87994df980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f87994df980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:41.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f87994df980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf7fdf0 con 0x555fdbf7c500 2024-05-09T09:47:41.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf7c500 2024-05-09T09:47:41.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f87994df980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f87994df980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf80190 con 0x555fdbf7c500 2024-05-09T09:47:41.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf7c500 2024-05-09T09:47:41.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f87994df980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:41.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f87994df980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f87994df980 1 --2- 172.21.15.157:0/1246137958 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555fdbf80ef0 0x555fdbf832e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.375+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf838f0 con 0x555fdbf80ef0 2024-05-09T09:47:41.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.379+0000 7f8796ffa640 1 --2- 172.21.15.157:0/1246137958 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555fdbf80ef0 0x555fdbf832e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.379+0000 7f8796ffa640 1 --2- 172.21.15.157:0/1246137958 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555fdbf80ef0 0x555fdbf832e0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.379+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.379+0000 7f87994df980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:41.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.379+0000 7f87994df980 20 searching for the correct realm 2024-05-09T09:47:41.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.379+0000 7f87994df980 1 --2- 172.21.15.157:0/1246137958 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555fdbf85840 0x555fdbf87c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.379+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf88320 con 0x555fdbf85840 2024-05-09T09:47:41.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.379+0000 7f87967f9640 1 --2- 172.21.15.157:0/1246137958 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555fdbf85840 0x555fdbf87c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.379+0000 7f87967f9640 1 --2- 172.21.15.157:0/1246137958 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555fdbf85840 0x555fdbf87c50 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.379+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f878c0d9070 con 0x555fdbf85840 2024-05-09T09:47:41.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.379+0000 7f87967f9640 1 --2- 172.21.15.157:0/1246137958 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f878c0ce040 0x7f878c0db410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.379+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf88320 con 0x7f878c0ce040 2024-05-09T09:47:41.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.379+0000 7f87977fb640 1 --2- 172.21.15.157:0/1246137958 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f878c0ce040 0x7f878c0db410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.379+0000 7f87977fb640 1 --2- 172.21.15.157:0/1246137958 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f878c0ce040 0x7f878c0db410 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.379+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f879000a4d0 con 0x7f878c0ce040 2024-05-09T09:47:41.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.379+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf80190 con 0x555fdbf80ef0 2024-05-09T09:47:41.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.383+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.383+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf80190 con 0x555fdbf7c500 2024-05-09T09:47:41.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.383+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf7c500 2024-05-09T09:47:41.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.383+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf80190 con 0x555fdbf7c500 2024-05-09T09:47:41.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.383+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf7c500 2024-05-09T09:47:41.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.383+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf80190 con 0x555fdbf80ef0 2024-05-09T09:47:41.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.383+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.383+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf80190 con 0x555fdbf80ef0 2024-05-09T09:47:41.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.383+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.383+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf80190 con 0x7f878c0ce040 2024-05-09T09:47:41.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.383+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f879000a4d0 con 0x7f878c0ce040 2024-05-09T09:47:41.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.383+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf80190 con 0x555fdbf85840 2024-05-09T09:47:41.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.383+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f878c0d9070 con 0x555fdbf85840 2024-05-09T09:47:41.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.383+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf80190 con 0x555fdbf7c500 2024-05-09T09:47:41.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.383+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf7c500 2024-05-09T09:47:41.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.383+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf80190 con 0x555fdbf80ef0 2024-05-09T09:47:41.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.387+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.387+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf80190 con 0x555fdbf7c500 2024-05-09T09:47:41.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.387+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf7c500 2024-05-09T09:47:41.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.387+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf80190 con 0x7f878c0ce040 2024-05-09T09:47:41.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.387+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f879000a4d0 con 0x7f878c0ce040 2024-05-09T09:47:41.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.387+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf80190 con 0x555fdbf85840 2024-05-09T09:47:41.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.387+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f878c0d9070 con 0x555fdbf85840 2024-05-09T09:47:41.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.387+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f878c0e8040 con 0x555fdbf85840 2024-05-09T09:47:41.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.387+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f878c0d9070 con 0x555fdbf85840 2024-05-09T09:47:41.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.387+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f878c0e8040 con 0x555fdbf80ef0 2024-05-09T09:47:41.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.387+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.387+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f878c0e8040 con 0x555fdbf85840 2024-05-09T09:47:41.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.387+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f878c0d9070 con 0x555fdbf85840 2024-05-09T09:47:41.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.387+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f878c0e8040 con 0x555fdbf85840 2024-05-09T09:47:41.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.387+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f878c0d9070 con 0x555fdbf85840 2024-05-09T09:47:41.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.387+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f878c0e8040 con 0x555fdbf7c500 2024-05-09T09:47:41.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.387+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf7c500 2024-05-09T09:47:41.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.387+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f878c0e8040 con 0x555fdbf7c500 2024-05-09T09:47:41.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.387+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf7c500 2024-05-09T09:47:41.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.387+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f878c0e8040 con 0x555fdbf80ef0 2024-05-09T09:47:41.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.391+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.391+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f878c0e8040 con 0x555fdbf85840 2024-05-09T09:47:41.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.391+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f878c0d9070 con 0x555fdbf85840 2024-05-09T09:47:41.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.391+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f878c0e8040 con 0x7f878c0ce040 2024-05-09T09:47:41.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.391+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f879000a4d0 con 0x7f878c0ce040 2024-05-09T09:47:41.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.391+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f878c0e8040 con 0x555fdbf7c500 2024-05-09T09:47:41.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.391+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf7c500 2024-05-09T09:47:41.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.391+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f878c0e8040 con 0x555fdbf80ef0 2024-05-09T09:47:41.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.391+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.391+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f878c0e8040 con 0x555fdbf85840 2024-05-09T09:47:41.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.391+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f878c0d9070 con 0x555fdbf85840 2024-05-09T09:47:41.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.391+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f878c0e8040 con 0x555fdbf80ef0 2024-05-09T09:47:41.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.391+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.391+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f878c0e8040 con 0x7f878c0ce040 2024-05-09T09:47:41.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.391+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f879000a4d0 con 0x7f878c0ce040 2024-05-09T09:47:41.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.391+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f878c0e8040 con 0x555fdbf85840 2024-05-09T09:47:41.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.391+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f878c0d9070 con 0x555fdbf85840 2024-05-09T09:47:41.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.391+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f878c0e8040 con 0x555fdbf80ef0 2024-05-09T09:47:41.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f878c0e8040 con 0x555fdbf7c500 2024-05-09T09:47:41.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf7c500 2024-05-09T09:47:41.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f878c0e8040 con 0x7f878c0ce040 2024-05-09T09:47:41.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f879000a4d0 con 0x7f878c0ce040 2024-05-09T09:47:41.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:41.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:41.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:41.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:41.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:41.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:41.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf841b0 con 0x555fdbf7c500 2024-05-09T09:47:41.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf7c500 2024-05-09T09:47:41.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf841b0 con 0x555fdbf7c500 2024-05-09T09:47:41.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf7c500 2024-05-09T09:47:41.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:41.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf841b0 con 0x555fdbf85840 2024-05-09T09:47:41.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f878c0d9070 con 0x555fdbf85840 2024-05-09T09:47:41.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:41.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 20 zone default found 2024-05-09T09:47:41.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 4 Realm: () 2024-05-09T09:47:41.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:41.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:41.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:41.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 20 zonegroup default 2024-05-09T09:47:41.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf84b70 con 0x555fdbf80ef0 2024-05-09T09:47:41.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf84750 con 0x555fdbf85840 2024-05-09T09:47:41.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f878c0d9070 con 0x555fdbf85840 2024-05-09T09:47:41.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf8a740 con 0x555fdbf85840 2024-05-09T09:47:41.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f878c0d9070 con 0x555fdbf85840 2024-05-09T09:47:41.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 20 started sync module instance, tier type = 2024-05-09T09:47:41.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:41.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.395+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf89ac0 con 0x7f878c0ce040 2024-05-09T09:47:41.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.399+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x7f878c0ce040 2024-05-09T09:47:41.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.399+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93870200758208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf89ac0 con 0x7f878c0ce040 2024-05-09T09:47:41.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.399+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf8b1c0 con 0x555fdbf7c500 2024-05-09T09:47:41.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.399+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93870200758208] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x7f878c0ce040 2024-05-09T09:47:41.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.399+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf7c500 2024-05-09T09:47:41.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.399+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93870200761888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf89ac0 con 0x555fdbf7c500 2024-05-09T09:47:41.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.399+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf8bbd0 con 0x555fdbf85840 2024-05-09T09:47:41.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.403+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f878c0d9070 con 0x555fdbf85840 2024-05-09T09:47:41.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.403+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93870200761888] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf7c500 2024-05-09T09:47:41.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.403+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93870200755728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf89a30 con 0x555fdbf85840 2024-05-09T09:47:41.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.403+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf8c910 con 0x7f878c0ce040 2024-05-09T09:47:41.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.403+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x7f878c0ce040 2024-05-09T09:47:41.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.403+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93870200767520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf8c840 con 0x7f878c0ce040 2024-05-09T09:47:41.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.403+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf8d810 con 0x555fdbf7c500 2024-05-09T09:47:41.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.403+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93870200755728] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f878c0d9070 con 0x555fdbf85840 2024-05-09T09:47:41.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.407+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93870200767520] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x7f878c0ce040 2024-05-09T09:47:41.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.407+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf7c500 2024-05-09T09:47:41.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.407+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93870200766320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf8d320 con 0x555fdbf7c500 2024-05-09T09:47:41.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.407+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf8e0b0 con 0x555fdbf80ef0 2024-05-09T09:47:41.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.407+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93870200766320] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf7c500 2024-05-09T09:47:41.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.407+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.407+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93870200773632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf8d320 con 0x555fdbf80ef0 2024-05-09T09:47:41.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.407+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf8e900 con 0x555fdbf80ef0 2024-05-09T09:47:41.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.411+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93870200773632] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.411+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.411+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93870200775760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf8ed20 con 0x555fdbf80ef0 2024-05-09T09:47:41.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.411+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf8f6e0 con 0x555fdbf80ef0 2024-05-09T09:47:41.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.411+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93870200775760] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.411+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.411+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93870200776816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf8f8c0 con 0x555fdbf80ef0 2024-05-09T09:47:41.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.411+0000 7f87994df980 20 add_watcher() i=0 2024-05-09T09:47:41.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.411+0000 7f87994df980 20 add_watcher() i=1 2024-05-09T09:47:41.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.411+0000 7f87994df980 20 add_watcher() i=2 2024-05-09T09:47:41.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.411+0000 7f87994df980 20 add_watcher() i=3 2024-05-09T09:47:41.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.411+0000 7f87994df980 20 add_watcher() i=4 2024-05-09T09:47:41.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.411+0000 7f87994df980 20 add_watcher() i=5 2024-05-09T09:47:41.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.411+0000 7f87994df980 20 add_watcher() i=6 2024-05-09T09:47:41.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.415+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93870200776816] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.415+0000 7f87994df980 20 add_watcher() i=7 2024-05-09T09:47:41.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.415+0000 7f87994df980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:41.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.415+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf92ac0 con 0x555fdbf7c500 2024-05-09T09:47:41.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.415+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf7c500 2024-05-09T09:47:41.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.415+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93870200792208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf8f860 con 0x555fdbf7c500 2024-05-09T09:47:41.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.415+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93870200792208] v30'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf7c500 2024-05-09T09:47:41.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.415+0000 7f86477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:41.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.415+0000 7f87994df980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:41.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.415+0000 7f87994df980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:41.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.415+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf91d40 con 0x555fdbf7c500 2024-05-09T09:47:41.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.419+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'57 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf7c500 2024-05-09T09:47:41.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.419+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9bb80 con 0x555fdbf80ef0 2024-05-09T09:47:41.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.419+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'52 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.419+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9bb80 con 0x555fdbf85840 2024-05-09T09:47:41.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.423+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'51 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f878c0d9070 con 0x555fdbf85840 2024-05-09T09:47:41.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.423+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9bb80 con 0x555fdbf7c500 2024-05-09T09:47:41.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.423+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'230 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf7c500 2024-05-09T09:47:41.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.423+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9c660 con 0x7f878c0ce040 2024-05-09T09:47:41.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.423+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'143 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x7f878c0ce040 2024-05-09T09:47:41.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.423+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9cbd0 con 0x555fdbf85840 2024-05-09T09:47:41.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.427+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'96 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f878c0d9070 con 0x555fdbf85840 2024-05-09T09:47:41.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.427+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9d080 con 0x555fdbf7c500 2024-05-09T09:47:41.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.427+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'53 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf7c500 2024-05-09T09:47:41.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.427+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9d080 con 0x555fdbf80ef0 2024-05-09T09:47:41.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.431+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'95 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.431+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9d130 con 0x7f878c0ce040 2024-05-09T09:47:41.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.431+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'51 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x7f878c0ce040 2024-05-09T09:47:41.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.431+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9d130 con 0x555fdbf85840 2024-05-09T09:47:41.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.435+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'57 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f878c0d9070 con 0x555fdbf85840 2024-05-09T09:47:41.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.435+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9d630 con 0x7f878c0ce040 2024-05-09T09:47:41.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.435+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'144 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x7f878c0ce040 2024-05-09T09:47:41.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.435+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9d630 con 0x555fdbf80ef0 2024-05-09T09:47:41.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.435+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'53 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.435+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9d630 con 0x7f878c0ce040 2024-05-09T09:47:41.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.439+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'51 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x7f878c0ce040 2024-05-09T09:47:41.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.439+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9d630 con 0x555fdbf80ef0 2024-05-09T09:47:41.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.439+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'101 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.439+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9d6c0 con 0x555fdbf7c500 2024-05-09T09:47:41.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.443+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'231 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf7c500 2024-05-09T09:47:41.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.443+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9d6c0 con 0x555fdbf85840 2024-05-09T09:47:41.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.443+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'137 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f878c0d9070 con 0x555fdbf85840 2024-05-09T09:47:41.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.443+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9d6c0 con 0x7f878c0ce040 2024-05-09T09:47:41.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.443+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'145 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x7f878c0ce040 2024-05-09T09:47:41.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.443+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9d6c0 con 0x555fdbf85840 2024-05-09T09:47:41.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.447+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'51 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f878c0d9070 con 0x555fdbf85840 2024-05-09T09:47:41.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.447+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9d630 con 0x555fdbf7c500 2024-05-09T09:47:41.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.447+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'59 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf7c500 2024-05-09T09:47:41.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.447+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9d630 con 0x555fdbf7c500 2024-05-09T09:47:41.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.451+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'232 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf7c500 2024-05-09T09:47:41.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.451+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9d630 con 0x555fdbf85840 2024-05-09T09:47:41.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.451+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'138 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f878c0d9070 con 0x555fdbf85840 2024-05-09T09:47:41.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.451+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9d630 con 0x7f878c0ce040 2024-05-09T09:47:41.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.455+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'61 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x7f878c0ce040 2024-05-09T09:47:41.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.455+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9d630 con 0x555fdbf85840 2024-05-09T09:47:41.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.455+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'53 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f878c0d9070 con 0x555fdbf85840 2024-05-09T09:47:41.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.455+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9d630 con 0x555fdbf85840 2024-05-09T09:47:41.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.455+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'57 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f878c0d9070 con 0x555fdbf85840 2024-05-09T09:47:41.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.455+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9d630 con 0x555fdbf85840 2024-05-09T09:47:41.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.459+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'47 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f878c0d9070 con 0x555fdbf85840 2024-05-09T09:47:41.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.459+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9d630 con 0x555fdbf85840 2024-05-09T09:47:41.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.459+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'97 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f878c0d9070 con 0x555fdbf85840 2024-05-09T09:47:41.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.459+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9c1b0 con 0x555fdbf80ef0 2024-05-09T09:47:41.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.459+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'53 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.459+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9c1b0 con 0x555fdbf85840 2024-05-09T09:47:41.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.463+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'51 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f878c0d9070 con 0x555fdbf85840 2024-05-09T09:47:41.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.463+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9dd60 con 0x555fdbf80ef0 2024-05-09T09:47:41.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.463+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'96 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.463+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9dd60 con 0x555fdbf85840 2024-05-09T09:47:41.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.467+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'139 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f878c0d9070 con 0x555fdbf85840 2024-05-09T09:47:41.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.467+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9dd60 con 0x555fdbf80ef0 2024-05-09T09:47:41.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.467+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'102 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.467+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9dd60 con 0x7f878c0ce040 2024-05-09T09:47:41.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.471+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'57 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x7f878c0ce040 2024-05-09T09:47:41.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.471+0000 7f86467fc640 20 reqs_thread_entry: start 2024-05-09T09:47:41.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.471+0000 7f87994df980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:41.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.471+0000 7f85b7fff640 20 reqs_thread_entry: start 2024-05-09T09:47:41.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.471+0000 7f87994df980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-09T09:47:41.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.471+0000 7f87994df980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.471+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf9a060 con 0x555fdbf80ef0 2024-05-09T09:47:41.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.471+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.471+0000 7f87994df980 20 rados_obj.operate() r=0 bl.length=380 2024-05-09T09:47:41.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.471+0000 7f87994df980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-09T09:47:41.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.471+0000 7f87994df980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-09T09:47:41.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.471+0000 7f87994df980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:41.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.471+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf99fe0 con 0x555fdbf80ef0 2024-05-09T09:47:41.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.475+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.475+0000 7f87994df980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-05-09T09:47:41.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.475+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf99fe0 con 0x555fdbf80ef0 2024-05-09T09:47:41.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.475+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v30'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.475+0000 7f87994df980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-09T09:47:41.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.475+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 93870200822720 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555fdbfbc2f0 con 0x555fdbf85840 2024-05-09T09:47:41.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.475+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== watch-notify(notify (1) cookie 93870200755728 notify 128849018883 ret 0) ==== 212+0+0 (crc 0 0 0) 0x555fdbf9d630 con 0x555fdbf85840 2024-05-09T09:47:41.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.475+0000 7f86797fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 93870200755728 notifier 4538 bl.length()=170 2024-05-09T09:47:41.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.475+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(97 notify.2 [notify cookie 93870200822720 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f878c0d9070 con 0x555fdbf85840 2024-05-09T09:47:41.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.475+0000 7f86797fa640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f8658005580 con 0x555fdbf85840 2024-05-09T09:47:41.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.475+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f878c0d9070 con 0x555fdbf85840 2024-05-09T09:47:41.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.475+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 30 ==== watch-notify(notify_complete (2) cookie 93870200822720 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555fdbf9c730 con 0x555fdbf85840 2024-05-09T09:47:41.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.475+0000 7f87994df980 10 removing email index: 2024-05-09T09:47:41.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.475+0000 7f87994df980 10 removing user buckets index 2024-05-09T09:47:41.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.475+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf99b90 con 0x555fdbf80ef0 2024-05-09T09:47:41.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.479+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(99 fud.buckets [delete] v30'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.479+0000 7f87994df980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-05-09T09:47:41.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.479+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93870200822672 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555fdbfbc2f0 con 0x555fdbf80ef0 2024-05-09T09:47:41.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.479+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== watch-notify(notify (1) cookie 93870200775760 notify 128849018889 ret 0) ==== 202+0+0 (crc 0 0 0) 0x555fdbf9d130 con 0x555fdbf80ef0 2024-05-09T09:47:41.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.479+0000 7f86797fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 93870200775760 notifier 4538 bl.length()=160 2024-05-09T09:47:41.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.479+0000 7f86797fa640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f8658005580 con 0x555fdbf80ef0 2024-05-09T09:47:41.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.479+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(100 notify.6 [notify cookie 93870200822672 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.479+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.479+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 32 ==== watch-notify(notify_complete (2) cookie 93870200822672 notify 128849018889 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555fdbf5c070 con 0x555fdbf80ef0 2024-05-09T09:47:41.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.479+0000 7f87994df980 10 removing user index: fud 2024-05-09T09:47:41.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.479+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbfbe2c0 con 0x555fdbf80ef0 2024-05-09T09:47:41.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.483+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 33 ==== osd_op_reply(102 fud [call,call,delete] v30'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.483+0000 7f87994df980 10 removing default.rgw.meta+users.uid+fud from cache 2024-05-09T09:47:41.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.483+0000 7f87994df980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-05-09T09:47:41.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.483+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 93870200954320 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555fdbfbb6b0 con 0x555fdbf80ef0 2024-05-09T09:47:41.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.483+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 34 ==== watch-notify(notify (1) cookie 93870200773632 notify 128849018890 ret 0) ==== 194+0+0 (crc 0 0 0) 0x555fdbf5c070 con 0x555fdbf80ef0 2024-05-09T09:47:41.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.483+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 35 ==== osd_op_reply(103 notify.5 [notify cookie 93870200954320 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.483+0000 7f8678ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 93870200773632 notifier 4538 bl.length()=152 2024-05-09T09:47:41.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.483+0000 7f8678ff9640 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f85c0003930 con 0x555fdbf80ef0 2024-05-09T09:47:41.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.483+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 36 ==== watch-notify(notify_complete (2) cookie 93870200954320 notify 128849018890 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555fdbf1afb0 con 0x555fdbf80ef0 2024-05-09T09:47:41.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.483+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 37 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.487+0000 7f86477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:41.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.487+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93870200792208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf77520 con 0x555fdbf7c500 2024-05-09T09:47:41.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.487+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 93870200792208] v30'233 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf7c500 2024-05-09T09:47:41.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.487+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93870200758208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf92490 con 0x7f878c0ce040 2024-05-09T09:47:41.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.487+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 93870200758208] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x7f878c0ce040 2024-05-09T09:47:41.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.487+0000 7f87994df980 20 remove_watcher() i=0 2024-05-09T09:47:41.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.487+0000 7f87994df980 2 removed watcher, disabling cache 2024-05-09T09:47:41.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.487+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93870200761888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf92490 con 0x555fdbf7c500 2024-05-09T09:47:41.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.491+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 93870200761888] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf7c500 2024-05-09T09:47:41.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.491+0000 7f87994df980 20 remove_watcher() i=1 2024-05-09T09:47:41.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.491+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93870200755728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf92490 con 0x555fdbf85840 2024-05-09T09:47:41.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.491+0000 7f87967f9640 1 -- 172.21.15.157:0/1246137958 <== osd.3 v2:172.21.15.157:6816/2487336710 31 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 93870200755728] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f878c0d9070 con 0x555fdbf85840 2024-05-09T09:47:41.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.491+0000 7f87994df980 20 remove_watcher() i=2 2024-05-09T09:47:41.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.491+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93870200767520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf89610 con 0x7f878c0ce040 2024-05-09T09:47:41.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.495+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 93870200767520] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x7f878c0ce040 2024-05-09T09:47:41.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.495+0000 7f87994df980 20 remove_watcher() i=3 2024-05-09T09:47:41.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.495+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93870200766320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf92490 con 0x555fdbf7c500 2024-05-09T09:47:41.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.495+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 93870200766320] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f879000a4d0 con 0x555fdbf7c500 2024-05-09T09:47:41.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.495+0000 7f87994df980 20 remove_watcher() i=4 2024-05-09T09:47:41.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.495+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93870200773632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf8c420 con 0x555fdbf80ef0 2024-05-09T09:47:41.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.499+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 38 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 93870200773632] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.499+0000 7f87994df980 20 remove_watcher() i=5 2024-05-09T09:47:41.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.499+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93870200775760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf89610 con 0x555fdbf80ef0 2024-05-09T09:47:41.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.499+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 39 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 93870200775760] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.499+0000 7f87994df980 20 remove_watcher() i=6 2024-05-09T09:47:41.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.499+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93870200776816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555fdbf92490 con 0x555fdbf80ef0 2024-05-09T09:47:41.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f8796ffa640 1 -- 172.21.15.157:0/1246137958 <== osd.0 v2:172.21.15.110:6800/231209037 40 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 93870200776816] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8788008030 con 0x555fdbf80ef0 2024-05-09T09:47:41.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 20 remove_watcher() i=7 2024-05-09T09:47:41.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555fdbf80ef0 msgr2=0x555fdbf832e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 --2- 172.21.15.157:0/1246137958 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555fdbf80ef0 0x555fdbf832e0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555fdbf7c500 msgr2=0x555fdbf7e9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 --2- 172.21.15.157:0/1246137958 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555fdbf7c500 0x555fdbf7e9c0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f878c0ce040 msgr2=0x7f878c0db410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 --2- 172.21.15.157:0/1246137958 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f878c0ce040 0x7f878c0db410 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555fdbf85840 msgr2=0x555fdbf87c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 --2- 172.21.15.157:0/1246137958 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555fdbf85840 0x555fdbf87c50 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8660034bb0 msgr2=0x7f8660037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 --2- 172.21.15.157:0/1246137958 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8660034bb0 0x7f8660037070 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x555fdbf35c20 tx=0x7f878c0a6000 comp rx=0 tx=0).stop 2024-05-09T09:47:41.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbf68680 msgr2=0x555fdbf6fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 --2- 172.21.15.157:0/1246137958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbf68680 0x555fdbf6fa40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8788018740 tx=0x7f87880420e0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87977fb640 1 -- 172.21.15.157:0/1246137958 reap_dead start 2024-05-09T09:47:41.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 shutdown_connections 2024-05-09T09:47:41.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 >> 172.21.15.157:0/1246137958 conn(0x555fdbf64a00 msgr2=0x555fdbf62060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:41.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 shutdown_connections 2024-05-09T09:47:41.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 -- 172.21.15.157:0/1246137958 wait complete. 2024-05-09T09:47:41.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 -- 172.21.15.157:0/997180171 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8670034ca0 msgr2=0x7f8670037160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 --2- 172.21.15.157:0/997180171 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8670034ca0 0x7f8670037160 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x555fdbf1b2d0 tx=0x7f878c005a10 comp rx=0 tx=0).stop 2024-05-09T09:47:41.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 -- 172.21.15.157:0/997180171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbf5b710 msgr2=0x555fdbf5bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 --2- 172.21.15.157:0/997180171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbf5b710 0x555fdbf5bb30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f878800efb0 tx=0x7f878800db30 comp rx=0 tx=0).stop 2024-05-09T09:47:41.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 -- 172.21.15.157:0/997180171 shutdown_connections 2024-05-09T09:47:41.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 --2- 172.21.15.157:0/997180171 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8670034ca0 0x7f8670037160 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 --2- 172.21.15.157:0/997180171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbf5b710 0x555fdbf5bb30 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 -- 172.21.15.157:0/997180171 >> 172.21.15.157:0/997180171 conn(0x555fdbf504e0 msgr2=0x555fdbf50ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:41.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 -- 172.21.15.157:0/997180171 shutdown_connections 2024-05-09T09:47:41.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 -- 172.21.15.157:0/997180171 wait complete. 2024-05-09T09:47:41.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 -- 172.21.15.157:0/3702590950 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555fdbf2edf0 msgr2=0x555fdbf311e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 --2- 172.21.15.157:0/3702590950 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555fdbf2edf0 0x555fdbf311e0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 -- 172.21.15.157:0/3702590950 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555fdbf2a2d0 msgr2=0x555fdbf2c6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 --2- 172.21.15.157:0/3702590950 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555fdbf2a2d0 0x555fdbf2c6c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 -- 172.21.15.157:0/3702590950 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555fdbf32d30 msgr2=0x555fdbf35120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 --2- 172.21.15.157:0/3702590950 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555fdbf32d30 0x555fdbf35120 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 -- 172.21.15.157:0/3702590950 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f867c034bb0 msgr2=0x7f867c037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 --2- 172.21.15.157:0/3702590950 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f867c034bb0 0x7f867c037070 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f878c0ad000 tx=0x7f878c0a5040 comp rx=0 tx=0).stop 2024-05-09T09:47:41.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 -- 172.21.15.157:0/3702590950 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbe2f800 msgr2=0x555fdbf1c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 --2- 172.21.15.157:0/3702590950 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555fdbe2f800 0x555fdbf1c3a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8788001e20 tx=0x7f8788000ee0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87977fb640 1 -- 172.21.15.157:0/3702590950 reap_dead start 2024-05-09T09:47:41.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 -- 172.21.15.157:0/3702590950 shutdown_connections 2024-05-09T09:47:41.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 -- 172.21.15.157:0/3702590950 >> 172.21.15.157:0/3702590950 conn(0x555fdbe2b0d0 msgr2=0x555fdbf151c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:41.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 -- 172.21.15.157:0/3702590950 shutdown_connections 2024-05-09T09:47:41.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.503+0000 7f87994df980 1 -- 172.21.15.157:0/3702590950 wait complete. 2024-05-09T09:47:41.517 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-05-09T09:47:41.518 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-05-09T09:47:41.518 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-05-09T09:47:41.606 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:41.606 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:41.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.607+0000 7f175ba77980 1 Processor -- start 2024-05-09T09:47:41.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.607+0000 7f175ba77980 1 -- start start 2024-05-09T09:47:41.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.607+0000 7f175ba77980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55cff2e8cad0 0x55cff2e8ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.607+0000 7f175ba77980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cff2d40440 con 0x55cff2e8d3f0 2024-05-09T09:47:41.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.607+0000 7f175ba77980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55cff2d2b5f0 con 0x55cff2e8cad0 2024-05-09T09:47:41.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.611+0000 7f1759592640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55cff2e8cad0 0x55cff2e8ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.611+0000 7f1758d91640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x55cff2e8d3f0 0x55cff2e8dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:51742/0 (socket says 172.21.15.157:51742) 2024-05-09T09:47:41.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.611+0000 7f1758d91640 1 -- 172.21.15.157:0/176960169 learned_addr learned my addr 172.21.15.157:0/176960169 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:47:41.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.611+0000 7f1759592640 1 -- 172.21.15.157:0/176960169 >> v1:172.21.15.110:6789/0 conn(0x55cff2e8d3f0 legacy=0x55cff2e8dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.611+0000 7f1759592640 1 -- 172.21.15.157:0/176960169 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cff2d36990 con 0x55cff2e8cad0 2024-05-09T09:47:41.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.615+0000 7f1759592640 1 --2- 172.21.15.157:0/176960169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2e8cad0 0x55cff2e8ceb0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f174c00a480 tx=0x7f174c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e6778e65cc89f9f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.615+0000 7f174bfff640 1 -- 172.21.15.157:0/176960169 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f174c0b0070 con 0x55cff2e8cad0 2024-05-09T09:47:41.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.615+0000 7f174bfff640 1 -- 172.21.15.157:0/176960169 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f174c0ab540 con 0x55cff2e8cad0 2024-05-09T09:47:41.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.615+0000 7f174bfff640 1 -- 172.21.15.157:0/176960169 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f174c0ab840 con 0x55cff2e8cad0 2024-05-09T09:47:41.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.615+0000 7f175ba77980 1 -- 172.21.15.157:0/176960169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2e8cad0 msgr2=0x55cff2e8ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.615+0000 7f175ba77980 1 --2- 172.21.15.157:0/176960169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2e8cad0 0x55cff2e8ceb0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f174c00a480 tx=0x7f174c01b280 comp rx=0 tx=0).stop 2024-05-09T09:47:41.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.615+0000 7f175ba77980 1 -- 172.21.15.157:0/176960169 shutdown_connections 2024-05-09T09:47:41.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.615+0000 7f175ba77980 1 --2- 172.21.15.157:0/176960169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2e8cad0 0x55cff2e8ceb0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.615+0000 7f175ba77980 1 -- 172.21.15.157:0/176960169 >> 172.21.15.157:0/176960169 conn(0x55cff2e001f0 msgr2=0x55cff2e00600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:41.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.615+0000 7f175ba77980 1 -- 172.21.15.157:0/176960169 shutdown_connections 2024-05-09T09:47:41.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.615+0000 7f175ba77980 1 -- 172.21.15.157:0/176960169 wait complete. 2024-05-09T09:47:41.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.631+0000 7f175ba77980 1 Processor -- start 2024-05-09T09:47:41.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.631+0000 7f175ba77980 1 -- start start 2024-05-09T09:47:41.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.631+0000 7f175ba77980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2e8cad0 0x55cff2f78520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.631+0000 7f175ba77980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55cff2d8dfe0 con 0x55cff2e8cad0 2024-05-09T09:47:41.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.631+0000 7f1759592640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2e8cad0 0x55cff2f78520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.631+0000 7f1759592640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2e8cad0 0x55cff2f78520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59308/0 (socket says 172.21.15.157:59308) 2024-05-09T09:47:41.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.631+0000 7f1759592640 1 -- 172.21.15.157:0/2103032032 learned_addr learned my addr 172.21.15.157:0/2103032032 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:41.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.631+0000 7f1759592640 1 -- 172.21.15.157:0/2103032032 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cff2d12ae0 con 0x55cff2e8cad0 2024-05-09T09:47:41.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.631+0000 7f1759592640 1 --2- 172.21.15.157:0/2103032032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2e8cad0 0x55cff2f78520 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f174c018eb0 tx=0x7f174c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f6c092a7e1ee1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.631+0000 7f1647606640 1 -- 172.21.15.157:0/2103032032 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f174c0b0030 con 0x55cff2e8cad0 2024-05-09T09:47:41.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.631+0000 7f1647606640 1 -- 172.21.15.157:0/2103032032 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f174c0bb070 con 0x55cff2e8cad0 2024-05-09T09:47:41.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.631+0000 7f1647606640 1 -- 172.21.15.157:0/2103032032 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f174c0ab820 con 0x55cff2e8cad0 2024-05-09T09:47:41.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.631+0000 7f175ba77980 1 -- 172.21.15.157:0/2103032032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2e8cad0 msgr2=0x55cff2f78520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.631+0000 7f175ba77980 1 --2- 172.21.15.157:0/2103032032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2e8cad0 0x55cff2f78520 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f174c018eb0 tx=0x7f174c003030 comp rx=0 tx=0).stop 2024-05-09T09:47:41.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.631+0000 7f175ba77980 1 -- 172.21.15.157:0/2103032032 shutdown_connections 2024-05-09T09:47:41.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.631+0000 7f175ba77980 1 --2- 172.21.15.157:0/2103032032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2e8cad0 0x55cff2f78520 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.631+0000 7f175ba77980 1 -- 172.21.15.157:0/2103032032 >> 172.21.15.157:0/2103032032 conn(0x55cff2e001f0 msgr2=0x55cff2f740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:41.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.631+0000 7f175ba77980 1 -- 172.21.15.157:0/2103032032 shutdown_connections 2024-05-09T09:47:41.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.631+0000 7f175ba77980 1 -- 172.21.15.157:0/2103032032 wait complete. 2024-05-09T09:47:41.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.635+0000 7f175ba77980 1 Processor -- start 2024-05-09T09:47:41.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.635+0000 7f175ba77980 1 -- start start 2024-05-09T09:47:41.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.635+0000 7f175ba77980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2e8cad0 0x55cff2f7f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.635+0000 7f175ba77980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55cff2e96b10 con 0x55cff2e8cad0 2024-05-09T09:47:41.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.635+0000 7f1759592640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2e8cad0 0x55cff2f7f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.635+0000 7f1759592640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2e8cad0 0x55cff2f7f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59324/0 (socket says 172.21.15.157:59324) 2024-05-09T09:47:41.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.635+0000 7f1759592640 1 -- 172.21.15.157:0/650615046 learned_addr learned my addr 172.21.15.157:0/650615046 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:41.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.635+0000 7f1759592640 1 -- 172.21.15.157:0/650615046 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cff2f7f9f0 con 0x55cff2e8cad0 2024-05-09T09:47:41.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.635+0000 7f1759592640 1 --2- 172.21.15.157:0/650615046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2e8cad0 0x55cff2f7f4b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f174c018eb0 tx=0x7f174c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.635+0000 7f1645e03640 1 -- 172.21.15.157:0/650615046 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f174c0b6630 con 0x55cff2e8cad0 2024-05-09T09:47:41.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.635+0000 7f175ba77980 1 -- 172.21.15.157:0/650615046 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cff2f7fc80 con 0x55cff2e8cad0 2024-05-09T09:47:41.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.635+0000 7f1645e03640 1 -- 172.21.15.157:0/650615046 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f174c0c5070 con 0x55cff2e8cad0 2024-05-09T09:47:41.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.635+0000 7f1645e03640 1 -- 172.21.15.157:0/650615046 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f174c0b6900 con 0x55cff2e8cad0 2024-05-09T09:47:41.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.635+0000 7f175ba77980 1 -- 172.21.15.157:0/650615046 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cff2f82910 con 0x55cff2e8cad0 2024-05-09T09:47:41.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.635+0000 7f1645e03640 1 -- 172.21.15.157:0/650615046 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f174c0b6aa0 con 0x55cff2e8cad0 2024-05-09T09:47:41.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.635+0000 7f1645e03640 1 --2- 172.21.15.157:0/650615046 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1640034bb0 0x7f1640037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.635+0000 7f1645e03640 1 -- 172.21.15.157:0/650615046 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f174c0a8070 con 0x55cff2e8cad0 2024-05-09T09:47:41.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.635+0000 7f1758d91640 1 --2- 172.21.15.157:0/650615046 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1640034bb0 0x7f1640037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.635+0000 7f175ba77980 1 --2- 172.21.15.157:0/650615046 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cff2e8d3f0 0x55cff2f86560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.635+0000 7f175ba77980 1 -- 172.21.15.157:0/650615046 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cff2f86aa0 con 0x55cff2e8d3f0 2024-05-09T09:47:41.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.635+0000 7f1759d93640 1 --2- 172.21.15.157:0/650615046 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cff2e8d3f0 0x55cff2f86560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.635+0000 7f1758d91640 1 --2- 172.21.15.157:0/650615046 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1640034bb0 0x7f1640037070 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1750000f70 tx=0x7f17500012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.639+0000 7f1759d93640 1 --2- 172.21.15.157:0/650615046 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cff2e8d3f0 0x55cff2f86560 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.639+0000 7f1759d93640 1 -- 172.21.15.157:0/650615046 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2e8d3f0 2024-05-09T09:47:41.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.639+0000 7f175ba77980 1 -- 172.21.15.157:0/650615046 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cff2f83b10 con 0x55cff2e8d3f0 2024-05-09T09:47:41.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.639+0000 7f1759d93640 1 -- 172.21.15.157:0/650615046 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2e8d3f0 2024-05-09T09:47:41.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.639+0000 7f175ba77980 1 --2- 172.21.15.157:0/650615046 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cff2f88d90 0x55cff2f8b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.639+0000 7f175ba77980 1 -- 172.21.15.157:0/650615046 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cff2f8b870 con 0x55cff2f88d90 2024-05-09T09:47:41.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.639+0000 7f1759592640 1 --2- 172.21.15.157:0/650615046 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cff2f88d90 0x55cff2f8b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.639+0000 7f1759592640 1 --2- 172.21.15.157:0/650615046 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cff2f88d90 0x55cff2f8b180 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.639+0000 7f1759592640 1 -- 172.21.15.157:0/650615046 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f174c0cacc0 con 0x55cff2f88d90 2024-05-09T09:47:41.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.639+0000 7f175ba77980 1 -- 172.21.15.157:0/650615046 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cff2f87c30 con 0x55cff2e8d3f0 2024-05-09T09:47:41.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.639+0000 7f1759d93640 1 -- 172.21.15.157:0/650615046 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2e8d3f0 2024-05-09T09:47:41.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.639+0000 7f175ba77980 1 --2- 172.21.15.157:0/650615046 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cff2f8ccd0 0x55cff2f8f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.639+0000 7f175ba77980 1 -- 172.21.15.157:0/650615046 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cff2f8f800 con 0x55cff2f8ccd0 2024-05-09T09:47:41.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.639+0000 7f1758d91640 1 --2- 172.21.15.157:0/650615046 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cff2f8ccd0 0x55cff2f8f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.639+0000 7f1758d91640 1 --2- 172.21.15.157:0/650615046 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cff2f8ccd0 0x55cff2f8f0c0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.639+0000 7f1758d91640 1 -- 172.21.15.157:0/650615046 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f175000e620 con 0x55cff2f8ccd0 2024-05-09T09:47:41.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.643+0000 7f175ba77980 1 Processor -- start 2024-05-09T09:47:41.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.643+0000 7f175ba77980 1 -- start start 2024-05-09T09:47:41.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.643+0000 7f175ba77980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2fb56f0 0x55cff2fb5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.643+0000 7f175ba77980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55cff2d92020 con 0x55cff2fb56f0 2024-05-09T09:47:41.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.647+0000 7f1759592640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2fb56f0 0x55cff2fb5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.647+0000 7f1759592640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2fb56f0 0x55cff2fb5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59334/0 (socket says 172.21.15.157:59334) 2024-05-09T09:47:41.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.647+0000 7f1759592640 1 -- 172.21.15.157:0/308043992 learned_addr learned my addr 172.21.15.157:0/308043992 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:41.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.647+0000 7f1759592640 1 -- 172.21.15.157:0/308043992 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cff2fb6050 con 0x55cff2fb56f0 2024-05-09T09:47:41.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.647+0000 7f1759592640 1 --2- 172.21.15.157:0/308043992 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2fb56f0 0x55cff2fb5b10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f174c0e3be0 tx=0x7f174c009fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.647+0000 7f163dba0640 1 -- 172.21.15.157:0/308043992 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f174c0ca470 con 0x55cff2fb56f0 2024-05-09T09:47:41.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.647+0000 7f163dba0640 1 -- 172.21.15.157:0/308043992 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f174c0e9030 con 0x55cff2fb56f0 2024-05-09T09:47:41.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.647+0000 7f175ba77980 1 -- 172.21.15.157:0/308043992 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cff2fb6ae0 con 0x55cff2fb56f0 2024-05-09T09:47:41.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.647+0000 7f163dba0640 1 -- 172.21.15.157:0/308043992 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f174c0ca740 con 0x55cff2fb56f0 2024-05-09T09:47:41.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.647+0000 7f175ba77980 1 -- 172.21.15.157:0/308043992 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cff2fb6fc0 con 0x55cff2fb56f0 2024-05-09T09:47:41.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.647+0000 7f163dba0640 1 -- 172.21.15.157:0/308043992 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f174c0e5050 con 0x55cff2fb56f0 2024-05-09T09:47:41.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.647+0000 7f163dba0640 1 --2- 172.21.15.157:0/308043992 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1630034bb0 0x7f1630037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.647+0000 7f163dba0640 1 -- 172.21.15.157:0/308043992 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f174c0efc80 con 0x55cff2fb56f0 2024-05-09T09:47:41.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.647+0000 7f1758d91640 1 --2- 172.21.15.157:0/308043992 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1630034bb0 0x7f1630037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.647+0000 7f175ba77980 1 Processor -- start 2024-05-09T09:47:41.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.647+0000 7f175ba77980 1 -- start start 2024-05-09T09:47:41.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.647+0000 7f1758d91640 1 --2- 172.21.15.157:0/308043992 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1630034bb0 0x7f1630037070 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f175000bf60 tx=0x7f175000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.647+0000 7f175ba77980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2fc2680 0x55cff2fc2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.651+0000 7f175ba77980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55cff2f78bb0 con 0x55cff2fc2680 2024-05-09T09:47:41.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.651+0000 7f1759592640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2fc2680 0x55cff2fc2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.651+0000 7f1759592640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2fc2680 0x55cff2fc2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59350/0 (socket says 172.21.15.157:59350) 2024-05-09T09:47:41.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.651+0000 7f1759592640 1 -- 172.21.15.157:0/3336592336 learned_addr learned my addr 172.21.15.157:0/3336592336 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:41.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.651+0000 7f1759592640 1 -- 172.21.15.157:0/3336592336 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cff2fc3030 con 0x55cff2fc2680 2024-05-09T09:47:41.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.651+0000 7f1759592640 1 --2- 172.21.15.157:0/3336592336 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2fc2680 0x55cff2fc2a60 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f174c01b2a0 tx=0x7f174c0be370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c7c4473332ca3a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.651+0000 7f16377fe640 1 -- 172.21.15.157:0/3336592336 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f174c0f3030 con 0x55cff2fc2680 2024-05-09T09:47:41.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.651+0000 7f16377fe640 1 -- 172.21.15.157:0/3336592336 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f174c0b1040 con 0x55cff2fc2680 2024-05-09T09:47:41.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.651+0000 7f16377fe640 1 -- 172.21.15.157:0/3336592336 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f174c0e5ae0 con 0x55cff2fc2680 2024-05-09T09:47:41.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.651+0000 7f175ba77980 1 -- 172.21.15.157:0/3336592336 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2fc2680 msgr2=0x55cff2fc2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.651+0000 7f175ba77980 1 --2- 172.21.15.157:0/3336592336 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2fc2680 0x55cff2fc2a60 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f174c01b2a0 tx=0x7f174c0be370 comp rx=0 tx=0).stop 2024-05-09T09:47:41.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.651+0000 7f175ba77980 1 -- 172.21.15.157:0/3336592336 shutdown_connections 2024-05-09T09:47:41.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.651+0000 7f175ba77980 1 --2- 172.21.15.157:0/3336592336 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2fc2680 0x55cff2fc2a60 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.651+0000 7f175ba77980 1 -- 172.21.15.157:0/3336592336 >> 172.21.15.157:0/3336592336 conn(0x55cff2fbea00 msgr2=0x55cff2fbca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:41.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.651+0000 7f175ba77980 1 -- 172.21.15.157:0/3336592336 shutdown_connections 2024-05-09T09:47:41.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.651+0000 7f175ba77980 1 -- 172.21.15.157:0/3336592336 wait complete. 2024-05-09T09:47:41.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.651+0000 7f175ba77980 1 Processor -- start 2024-05-09T09:47:41.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.651+0000 7f175ba77980 1 -- start start 2024-05-09T09:47:41.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.651+0000 7f175ba77980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2fc2680 0x55cff2fc9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.651+0000 7f175ba77980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55cff2fc3740 con 0x55cff2fc2680 2024-05-09T09:47:41.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.651+0000 7f1759592640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2fc2680 0x55cff2fc9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.651+0000 7f1759592640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2fc2680 0x55cff2fc9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59352/0 (socket says 172.21.15.157:59352) 2024-05-09T09:47:41.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.651+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 learned_addr learned my addr 172.21.15.157:0/2264172062 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:41.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cff2fc9ed0 con 0x55cff2fc2680 2024-05-09T09:47:41.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f1759592640 1 --2- 172.21.15.157:0/2264172062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2fc2680 0x55cff2fc9990 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f174c01b2a0 tx=0x7f174c0c7f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f1635ffb640 1 -- 172.21.15.157:0/2264172062 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f174c112070 con 0x55cff2fc2680 2024-05-09T09:47:41.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cff2fc9ed0 con 0x55cff2fc2680 2024-05-09T09:47:41.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f1635ffb640 1 -- 172.21.15.157:0/2264172062 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f174c0e2400 con 0x55cff2fc2680 2024-05-09T09:47:41.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f1635ffb640 1 -- 172.21.15.157:0/2264172062 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f174c0e26e0 con 0x55cff2fc2680 2024-05-09T09:47:41.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cff2fca3b0 con 0x55cff2fc2680 2024-05-09T09:47:41.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f1635ffb640 1 -- 172.21.15.157:0/2264172062 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f174c115070 con 0x55cff2fc2680 2024-05-09T09:47:41.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f1635ffb640 1 --2- 172.21.15.157:0/2264172062 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1628034bb0 0x7f1628037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f1635ffb640 1 -- 172.21.15.157:0/2264172062 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f174c0fe030 con 0x55cff2fc2680 2024-05-09T09:47:41.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f1758d91640 1 --2- 172.21.15.157:0/2264172062 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1628034bb0 0x7f1628037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f175ba77980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f175ba77980 1 --2- 172.21.15.157:0/2264172062 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cff2fd6510 0x55cff2fd89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fd9120 con 0x55cff2fd6510 2024-05-09T09:47:41.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f1759d93640 1 --2- 172.21.15.157:0/2264172062 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cff2fd6510 0x55cff2fd89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f1758d91640 1 --2- 172.21.15.157:0/2264172062 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1628034bb0 0x7f1628037070 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55cff2f86f30 tx=0x7f1750010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f1759d93640 1 --2- 172.21.15.157:0/2264172062 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cff2fd6510 0x55cff2fd89d0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2fd6510 2024-05-09T09:47:41.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f175ba77980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f175ba77980 20 realm 2024-05-09T09:47:41.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f175ba77980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fd9530 con 0x55cff2fd6510 2024-05-09T09:47:41.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2fd6510 2024-05-09T09:47:41.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f175ba77980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f175ba77980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:41.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f175ba77980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fd9e00 con 0x55cff2fd6510 2024-05-09T09:47:41.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2fd6510 2024-05-09T09:47:41.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f175ba77980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f175ba77980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.655+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x55cff2fd6510 2024-05-09T09:47:41.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.659+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2fd6510 2024-05-09T09:47:41.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.659+0000 7f175ba77980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:41.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.659+0000 7f175ba77980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.659+0000 7f175ba77980 1 --2- 172.21.15.157:0/2264172062 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cff2fdaf00 0x55cff2fdd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.659+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fdd900 con 0x55cff2fdaf00 2024-05-09T09:47:41.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.659+0000 7f1759592640 1 --2- 172.21.15.157:0/2264172062 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cff2fdaf00 0x55cff2fdd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.659+0000 7f1759592640 1 --2- 172.21.15.157:0/2264172062 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cff2fdaf00 0x55cff2fdd2f0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.659+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.659+0000 7f175ba77980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:41.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.659+0000 7f175ba77980 20 searching for the correct realm 2024-05-09T09:47:41.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.659+0000 7f175ba77980 1 --2- 172.21.15.157:0/2264172062 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cff2fdf850 0x55cff2fe1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.659+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fe2330 con 0x55cff2fdf850 2024-05-09T09:47:41.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.659+0000 7f1758d91640 1 --2- 172.21.15.157:0/2264172062 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cff2fdf850 0x55cff2fe1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.659+0000 7f1758d91640 1 --2- 172.21.15.157:0/2264172062 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cff2fdf850 0x55cff2fe1c60 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.659+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175000e620 con 0x55cff2fdf850 2024-05-09T09:47:41.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.659+0000 7f1758d91640 1 --2- 172.21.15.157:0/2264172062 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f1750037040 0x7f1750036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.659+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fe2330 con 0x7f1750037040 2024-05-09T09:47:41.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.659+0000 7f1759d93640 1 --2- 172.21.15.157:0/2264172062 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f1750037040 0x7f1750036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.659+0000 7f1759d93640 1 --2- 172.21.15.157:0/2264172062 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f1750037040 0x7f1750036410 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.659+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175400a4d0 con 0x7f1750037040 2024-05-09T09:47:41.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.659+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x55cff2fdaf00 2024-05-09T09:47:41.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.663+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.663+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x55cff2fd6510 2024-05-09T09:47:41.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.663+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2fd6510 2024-05-09T09:47:41.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.663+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x55cff2fd6510 2024-05-09T09:47:41.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.663+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2fd6510 2024-05-09T09:47:41.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.663+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x55cff2fdaf00 2024-05-09T09:47:41.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.663+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.663+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x55cff2fdaf00 2024-05-09T09:47:41.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.663+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.663+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x7f1750037040 2024-05-09T09:47:41.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.663+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175400a4d0 con 0x7f1750037040 2024-05-09T09:47:41.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.663+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x55cff2fdf850 2024-05-09T09:47:41.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.663+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175000e620 con 0x55cff2fdf850 2024-05-09T09:47:41.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.663+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x55cff2fd6510 2024-05-09T09:47:41.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.663+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2fd6510 2024-05-09T09:47:41.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.663+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x55cff2fdaf00 2024-05-09T09:47:41.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.667+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.667+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x55cff2fd6510 2024-05-09T09:47:41.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.667+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2fd6510 2024-05-09T09:47:41.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.667+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x7f1750037040 2024-05-09T09:47:41.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.667+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f175400a4d0 con 0x7f1750037040 2024-05-09T09:47:41.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.667+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x55cff2fdf850 2024-05-09T09:47:41.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.667+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175000e620 con 0x55cff2fdf850 2024-05-09T09:47:41.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.667+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x55cff2fdf850 2024-05-09T09:47:41.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.667+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f175000e620 con 0x55cff2fdf850 2024-05-09T09:47:41.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.667+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x55cff2fdaf00 2024-05-09T09:47:41.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.667+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.667+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x55cff2fdf850 2024-05-09T09:47:41.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.667+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175000e620 con 0x55cff2fdf850 2024-05-09T09:47:41.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.667+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x55cff2fdf850 2024-05-09T09:47:41.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.667+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175000e620 con 0x55cff2fdf850 2024-05-09T09:47:41.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.667+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x55cff2fd6510 2024-05-09T09:47:41.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.667+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2fd6510 2024-05-09T09:47:41.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.667+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x55cff2fd6510 2024-05-09T09:47:41.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.667+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2fd6510 2024-05-09T09:47:41.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.667+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x55cff2fdaf00 2024-05-09T09:47:41.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.671+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.671+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x55cff2fdf850 2024-05-09T09:47:41.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.671+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175000e620 con 0x55cff2fdf850 2024-05-09T09:47:41.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.671+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x7f1750037040 2024-05-09T09:47:41.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.671+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175400a4d0 con 0x7f1750037040 2024-05-09T09:47:41.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.671+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x55cff2fd6510 2024-05-09T09:47:41.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.671+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2fd6510 2024-05-09T09:47:41.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.671+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x55cff2fdaf00 2024-05-09T09:47:41.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.671+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.671+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x55cff2fdf850 2024-05-09T09:47:41.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.671+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175000e620 con 0x55cff2fdf850 2024-05-09T09:47:41.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.671+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x55cff2fdaf00 2024-05-09T09:47:41.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.671+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.671+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x7f1750037040 2024-05-09T09:47:41.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.671+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175400a4d0 con 0x7f1750037040 2024-05-09T09:47:41.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.671+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x55cff2fdf850 2024-05-09T09:47:41.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.671+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175000e620 con 0x55cff2fdf850 2024-05-09T09:47:41.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.671+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x55cff2fdaf00 2024-05-09T09:47:41.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x55cff2fd6510 2024-05-09T09:47:41.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2fd6510 2024-05-09T09:47:41.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fda1a0 con 0x7f1750037040 2024-05-09T09:47:41.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f175400a4d0 con 0x7f1750037040 2024-05-09T09:47:41.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:41.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:41.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:41.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:41.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:41.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:41.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fde1c0 con 0x55cff2fd6510 2024-05-09T09:47:41.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2fd6510 2024-05-09T09:47:41.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fde1c0 con 0x55cff2fd6510 2024-05-09T09:47:41.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2fd6510 2024-05-09T09:47:41.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:41.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fde1c0 con 0x55cff2fdf850 2024-05-09T09:47:41.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f175000e620 con 0x55cff2fdf850 2024-05-09T09:47:41.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:41.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 20 zone default found 2024-05-09T09:47:41.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 4 Realm: () 2024-05-09T09:47:41.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:41.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:41.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:41.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 20 zonegroup default 2024-05-09T09:47:41.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fdebc0 con 0x55cff2fdaf00 2024-05-09T09:47:41.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fde790 con 0x55cff2fdf850 2024-05-09T09:47:41.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f175000e620 con 0x55cff2fdf850 2024-05-09T09:47:41.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fe4730 con 0x55cff2fdf850 2024-05-09T09:47:41.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f175000e620 con 0x55cff2fdf850 2024-05-09T09:47:41.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 20 started sync module instance, tier type = 2024-05-09T09:47:41.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:41.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.675+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fe3ad0 con 0x7f1750037040 2024-05-09T09:47:41.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.679+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x7f1750037040 2024-05-09T09:47:41.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.679+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94351623340016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fe3ad0 con 0x7f1750037040 2024-05-09T09:47:41.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.679+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fe51f0 con 0x55cff2fd6510 2024-05-09T09:47:41.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.679+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94351623340016] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x7f1750037040 2024-05-09T09:47:41.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.679+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2fd6510 2024-05-09T09:47:41.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.679+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94351623343360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fe3ad0 con 0x55cff2fd6510 2024-05-09T09:47:41.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.679+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fe5c30 con 0x55cff2fdf850 2024-05-09T09:47:41.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.683+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f175000e620 con 0x55cff2fdf850 2024-05-09T09:47:41.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.683+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94351623346048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fe6480 con 0x55cff2fdf850 2024-05-09T09:47:41.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.683+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fe6e80 con 0x7f1750037040 2024-05-09T09:47:41.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.683+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94351623343360] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2fd6510 2024-05-09T09:47:41.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.683+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x7f1750037040 2024-05-09T09:47:41.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.683+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94351623337504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fe7270 con 0x7f1750037040 2024-05-09T09:47:41.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.683+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fe7c30 con 0x55cff2fd6510 2024-05-09T09:47:41.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.683+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94351623346048] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f175000e620 con 0x55cff2fdf850 2024-05-09T09:47:41.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.683+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94351623337504] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x7f1750037040 2024-05-09T09:47:41.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.687+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2fd6510 2024-05-09T09:47:41.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.687+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94351623350672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fe7780 con 0x55cff2fd6510 2024-05-09T09:47:41.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.687+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fe7fd0 con 0x55cff2fdaf00 2024-05-09T09:47:41.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.687+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94351623350672] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2fd6510 2024-05-09T09:47:41.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.687+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.687+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94351623354240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fe7ba0 con 0x55cff2fdaf00 2024-05-09T09:47:41.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.687+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fe8cd0 con 0x55cff2fdaf00 2024-05-09T09:47:41.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.691+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94351623354240] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.691+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.691+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94351623357296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fe8c40 con 0x55cff2fdaf00 2024-05-09T09:47:41.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.691+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fe9710 con 0x55cff2fdaf00 2024-05-09T09:47:41.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.691+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.691+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94351623361024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fe9b80 con 0x55cff2fdaf00 2024-05-09T09:47:41.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.691+0000 7f175ba77980 20 add_watcher() i=0 2024-05-09T09:47:41.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.691+0000 7f175ba77980 20 add_watcher() i=1 2024-05-09T09:47:41.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.691+0000 7f175ba77980 20 add_watcher() i=2 2024-05-09T09:47:41.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.691+0000 7f175ba77980 20 add_watcher() i=3 2024-05-09T09:47:41.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.691+0000 7f175ba77980 20 add_watcher() i=4 2024-05-09T09:47:41.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.691+0000 7f175ba77980 20 add_watcher() i=5 2024-05-09T09:47:41.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.691+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94351623357296] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.691+0000 7f175ba77980 20 add_watcher() i=6 2024-05-09T09:47:41.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.695+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94351623361024] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.695+0000 7f175ba77980 20 add_watcher() i=7 2024-05-09T09:47:41.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.695+0000 7f175ba77980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:41.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.695+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fe8790 con 0x55cff2fd6510 2024-05-09T09:47:41.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.695+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2fd6510 2024-05-09T09:47:41.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.695+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94351623358352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fea0d0 con 0x55cff2fd6510 2024-05-09T09:47:41.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.695+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94351623358352] v30'234 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2fd6510 2024-05-09T09:47:41.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.695+0000 7f160efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:41.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.695+0000 7f175ba77980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:41.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.695+0000 7f175ba77980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:41.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.695+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff5500 con 0x55cff2fd6510 2024-05-09T09:47:41.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.699+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'58 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2fd6510 2024-05-09T09:47:41.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.699+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff5b50 con 0x55cff2fdaf00 2024-05-09T09:47:41.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.699+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'53 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.699+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff5b50 con 0x55cff2fdf850 2024-05-09T09:47:41.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.703+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'52 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f175000e620 con 0x55cff2fdf850 2024-05-09T09:47:41.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.703+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff6180 con 0x55cff2fd6510 2024-05-09T09:47:41.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.703+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'235 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2fd6510 2024-05-09T09:47:41.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.703+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff6630 con 0x7f1750037040 2024-05-09T09:47:41.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.703+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'146 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x7f1750037040 2024-05-09T09:47:41.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.703+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff3350 con 0x55cff2fdf850 2024-05-09T09:47:41.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.707+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'98 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f175000e620 con 0x55cff2fdf850 2024-05-09T09:47:41.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.707+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff3350 con 0x55cff2fd6510 2024-05-09T09:47:41.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.707+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'54 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2fd6510 2024-05-09T09:47:41.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.707+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff7190 con 0x55cff2fdaf00 2024-05-09T09:47:41.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.711+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'97 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.711+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff7190 con 0x7f1750037040 2024-05-09T09:47:41.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.711+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'52 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x7f1750037040 2024-05-09T09:47:41.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.711+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff7190 con 0x55cff2fdf850 2024-05-09T09:47:41.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.711+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'58 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f175000e620 con 0x55cff2fdf850 2024-05-09T09:47:41.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.711+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff76d0 con 0x7f1750037040 2024-05-09T09:47:41.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.715+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'147 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x7f1750037040 2024-05-09T09:47:41.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.715+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff76b0 con 0x55cff2fdaf00 2024-05-09T09:47:41.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.715+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'54 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.715+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff76b0 con 0x7f1750037040 2024-05-09T09:47:41.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.719+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'52 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x7f1750037040 2024-05-09T09:47:41.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.719+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff76b0 con 0x55cff2fdaf00 2024-05-09T09:47:41.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.719+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'103 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.719+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff76b0 con 0x55cff2fd6510 2024-05-09T09:47:41.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.719+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'236 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2fd6510 2024-05-09T09:47:41.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.719+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff76b0 con 0x55cff2fdf850 2024-05-09T09:47:41.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.723+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'140 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f175000e620 con 0x55cff2fdf850 2024-05-09T09:47:41.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.723+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff7770 con 0x7f1750037040 2024-05-09T09:47:41.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.723+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'148 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x7f1750037040 2024-05-09T09:47:41.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.723+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff7770 con 0x55cff2fdf850 2024-05-09T09:47:41.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.727+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'52 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f175000e620 con 0x55cff2fdf850 2024-05-09T09:47:41.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.727+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff7800 con 0x55cff2fd6510 2024-05-09T09:47:41.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.727+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'60 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2fd6510 2024-05-09T09:47:41.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.727+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff7800 con 0x55cff2fd6510 2024-05-09T09:47:41.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.727+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'237 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2fd6510 2024-05-09T09:47:41.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.727+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff77d0 con 0x55cff2fdf850 2024-05-09T09:47:41.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.731+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'141 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f175000e620 con 0x55cff2fdf850 2024-05-09T09:47:41.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.731+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff77d0 con 0x7f1750037040 2024-05-09T09:47:41.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.731+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'62 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x7f1750037040 2024-05-09T09:47:41.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.731+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff77f0 con 0x55cff2fdf850 2024-05-09T09:47:41.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.731+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'54 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f175000e620 con 0x55cff2fdf850 2024-05-09T09:47:41.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.735+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff77f0 con 0x55cff2fdf850 2024-05-09T09:47:41.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.735+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'58 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f175000e620 con 0x55cff2fdf850 2024-05-09T09:47:41.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.735+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff77f0 con 0x55cff2fdf850 2024-05-09T09:47:41.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.735+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'48 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f175000e620 con 0x55cff2fdf850 2024-05-09T09:47:41.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.735+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff77f0 con 0x55cff2fdf850 2024-05-09T09:47:41.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.735+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'99 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f175000e620 con 0x55cff2fdf850 2024-05-09T09:47:41.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.735+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff77f0 con 0x55cff2fdaf00 2024-05-09T09:47:41.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.739+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'54 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.739+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff77f0 con 0x55cff2fdf850 2024-05-09T09:47:41.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.739+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'52 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f175000e620 con 0x55cff2fdf850 2024-05-09T09:47:41.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.739+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff77f0 con 0x55cff2fdaf00 2024-05-09T09:47:41.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.743+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'98 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.743+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff77f0 con 0x55cff2fdf850 2024-05-09T09:47:41.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.743+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'142 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f175000e620 con 0x55cff2fdf850 2024-05-09T09:47:41.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.743+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff77f0 con 0x55cff2fdaf00 2024-05-09T09:47:41.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.747+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'104 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.747+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff77f0 con 0x7f1750037040 2024-05-09T09:47:41.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.747+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'58 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x7f1750037040 2024-05-09T09:47:41.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.747+0000 7f160dfe3640 20 reqs_thread_entry: start 2024-05-09T09:47:41.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.747+0000 7f175ba77980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:41.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.747+0000 7f1606ffd640 20 reqs_thread_entry: start 2024-05-09T09:47:41.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.747+0000 7f175ba77980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-05-09T09:47:41.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.747+0000 7f175ba77980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.747+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff2320 con 0x55cff2fdaf00 2024-05-09T09:47:41.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.751+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(94 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.751+0000 7f175ba77980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.751+0000 7f175ba77980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-05-09T09:47:41.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.751+0000 7f175ba77980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-09T09:47:41.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.751+0000 7f175ba77980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-05-09T09:47:41.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.751+0000 7f175ba77980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.751+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:95 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff22e0 con 0x55cff2fdaf00 2024-05-09T09:47:41.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.751+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(95 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.751+0000 7f175ba77980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.751+0000 7f175ba77980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-05-09T09:47:41.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.751+0000 7f175ba77980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-09T09:47:41.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.751+0000 7f175ba77980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-09T09:47:41.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.751+0000 7f175ba77980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-09T09:47:41.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.751+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:96 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff30161c0 con 0x55cff2fdaf00 2024-05-09T09:47:41.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.755+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(96 testx$tenanteduser [delete,create,call,writefull 0~419] v30'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.755+0000 7f175ba77980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-05-09T09:47:41.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.755+0000 7f175ba77980 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-09T09:47:41.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.755+0000 7f175ba77980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-05-09T09:47:41.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.755+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:97 7.e 7:7759931f:::notify.3:head [notify cookie 94351623397776 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cff3016c70 con 0x7f1750037040 2024-05-09T09:47:41.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.755+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== watch-notify(notify (1) cookie 94351623337504 notify 128849018892 ret 0) ==== 652+0+0 (crc 0 0 0) 0x55cff2ff2ea0 con 0x7f1750037040 2024-05-09T09:47:41.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.755+0000 7f16377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 94351623337504 notifier 4545 bl.length()=610 2024-05-09T09:47:41.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.755+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(97 notify.3 [notify cookie 94351623397776 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f175400a4d0 con 0x7f1750037040 2024-05-09T09:47:41.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.755+0000 7f16377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-05-09T09:47:41.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.755+0000 7f16377fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-09T09:47:41.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.755+0000 7f16377fe640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f161c0056c0 con 0x7f1750037040 2024-05-09T09:47:41.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.755+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(98 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x7f1750037040 2024-05-09T09:47:41.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.755+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== watch-notify(notify_complete (2) cookie 94351623397776 notify 128849018892 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cff2ff5170 con 0x7f1750037040 2024-05-09T09:47:41.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.755+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:99 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff21d0 con 0x55cff2fdaf00 2024-05-09T09:47:41.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.755+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(99 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v30'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.755+0000 7f175ba77980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-09T09:47:41.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.755+0000 7f175ba77980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-09T09:47:41.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.755+0000 7f175ba77980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-09T09:47:41.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.755+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:100 7.15 7:a93a5511:::notify.2:head [notify cookie 94351623545504 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cff2ff21d0 con 0x55cff2fdf850 2024-05-09T09:47:41.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.755+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== watch-notify(notify (1) cookie 94351623346048 notify 128849018884 ret 0) ==== 234+0+0 (crc 0 0 0) 0x55cff2ff39a0 con 0x55cff2fdf850 2024-05-09T09:47:41.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.755+0000 7f1636ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94351623346048 notifier 4545 bl.length()=192 2024-05-09T09:47:41.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.755+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(100 notify.2 [notify cookie 94351623545504 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f175000e620 con 0x55cff2fdf850 2024-05-09T09:47:41.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.755+0000 7f1636ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-09T09:47:41.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.755+0000 7f1636ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-09T09:47:41.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.755+0000 7f1636ffd640 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f1580003a70 con 0x55cff2fdf850 2024-05-09T09:47:41.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.759+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== watch-notify(notify_complete (2) cookie 94351623545504 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cff2ff36f0 con 0x55cff2fdf850 2024-05-09T09:47:41.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.759+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 30 ==== osd_op_reply(101 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f175000e620 con 0x55cff2fdf850 2024-05-09T09:47:41.757 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-09T09:47:41.753500Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:47:41.753474Z","tags":[],"group_ids":[]} 2024-05-09T09:47:41.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.759+0000 7f160efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:41.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.759+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94351623358352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff3013c40 con 0x55cff2fd6510 2024-05-09T09:47:41.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.759+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(102 data_loggenerations_metadata [watch unwatch cookie 94351623358352] v30'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2fd6510 2024-05-09T09:47:41.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.759+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:103 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94351623340016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff3013c40 con 0x7f1750037040 2024-05-09T09:47:41.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.763+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(103 notify.0 [watch unwatch cookie 94351623340016] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x7f1750037040 2024-05-09T09:47:41.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.763+0000 7f175ba77980 20 remove_watcher() i=0 2024-05-09T09:47:41.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.763+0000 7f175ba77980 2 removed watcher, disabling cache 2024-05-09T09:47:41.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.763+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:104 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94351623343360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff3013c40 con 0x55cff2fd6510 2024-05-09T09:47:41.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.763+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(104 notify.1 [watch unwatch cookie 94351623343360] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2fd6510 2024-05-09T09:47:41.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.763+0000 7f175ba77980 20 remove_watcher() i=1 2024-05-09T09:47:41.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.763+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:105 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94351623346048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fe4d00 con 0x55cff2fdf850 2024-05-09T09:47:41.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.767+0000 7f1758d91640 1 -- 172.21.15.157:0/2264172062 <== osd.3 v2:172.21.15.157:6816/2487336710 31 ==== osd_op_reply(105 notify.2 [watch unwatch cookie 94351623346048] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f175000e620 con 0x55cff2fdf850 2024-05-09T09:47:41.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.767+0000 7f175ba77980 20 remove_watcher() i=2 2024-05-09T09:47:41.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.767+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:106 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94351623337504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fe4d00 con 0x7f1750037040 2024-05-09T09:47:41.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.767+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.2 v2:172.21.15.157:6800/354455204 23 ==== osd_op_reply(106 notify.3 [watch unwatch cookie 94351623337504] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x7f1750037040 2024-05-09T09:47:41.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.767+0000 7f175ba77980 20 remove_watcher() i=3 2024-05-09T09:47:41.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.767+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94351623350672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fe3620 con 0x55cff2fd6510 2024-05-09T09:47:41.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.767+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(107 notify.4 [watch unwatch cookie 94351623350672] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f175400a4d0 con 0x55cff2fd6510 2024-05-09T09:47:41.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.767+0000 7f175ba77980 20 remove_watcher() i=4 2024-05-09T09:47:41.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.767+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:108 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94351623354240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fe4d00 con 0x55cff2fdaf00 2024-05-09T09:47:41.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.771+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(108 notify.5 [watch unwatch cookie 94351623354240] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.771+0000 7f175ba77980 20 remove_watcher() i=5 2024-05-09T09:47:41.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.771+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:109 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94351623357296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fe6990 con 0x55cff2fdaf00 2024-05-09T09:47:41.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(109 notify.6 [watch unwatch cookie 94351623357296] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 20 remove_watcher() i=6 2024-05-09T09:47:41.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:110 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94351623361024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cff2fe8820 con 0x55cff2fdaf00 2024-05-09T09:47:41.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f1759592640 1 -- 172.21.15.157:0/2264172062 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(110 notify.7 [watch unwatch cookie 94351623361024] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f174c114030 con 0x55cff2fdaf00 2024-05-09T09:47:41.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 20 remove_watcher() i=7 2024-05-09T09:47:41.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cff2fdaf00 msgr2=0x55cff2fdd2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 --2- 172.21.15.157:0/2264172062 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cff2fdaf00 0x55cff2fdd2f0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cff2fd6510 msgr2=0x55cff2fd89d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 --2- 172.21.15.157:0/2264172062 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cff2fd6510 0x55cff2fd89d0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f1750037040 msgr2=0x7f1750036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 --2- 172.21.15.157:0/2264172062 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f1750037040 0x7f1750036410 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cff2fdf850 msgr2=0x55cff2fe1c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 --2- 172.21.15.157:0/2264172062 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cff2fdf850 0x55cff2fe1c60 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1628034bb0 msgr2=0x7f1628037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 --2- 172.21.15.157:0/2264172062 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1628034bb0 0x7f1628037070 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55cff2f86f30 tx=0x7f1750010000 comp rx=0 tx=0).stop 2024-05-09T09:47:41.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2fc2680 msgr2=0x55cff2fc9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 --2- 172.21.15.157:0/2264172062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2fc2680 0x55cff2fc9990 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f174c01b2a0 tx=0x7f174c0c7f60 comp rx=0 tx=0).stop 2024-05-09T09:47:41.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f1759d93640 1 -- 172.21.15.157:0/2264172062 reap_dead start 2024-05-09T09:47:41.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 shutdown_connections 2024-05-09T09:47:41.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 --2- 172.21.15.157:0/2264172062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2fc2680 0x55cff2fc9990 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 >> 172.21.15.157:0/2264172062 conn(0x55cff2fbea00 msgr2=0x55cff2fbc060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:41.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 shutdown_connections 2024-05-09T09:47:41.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 -- 172.21.15.157:0/2264172062 wait complete. 2024-05-09T09:47:41.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 -- 172.21.15.157:0/308043992 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1630034bb0 msgr2=0x7f1630037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 --2- 172.21.15.157:0/308043992 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1630034bb0 0x7f1630037070 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f175000bf60 tx=0x7f175000f000 comp rx=0 tx=0).stop 2024-05-09T09:47:41.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 -- 172.21.15.157:0/308043992 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2fb56f0 msgr2=0x55cff2fb5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 --2- 172.21.15.157:0/308043992 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2fb56f0 0x55cff2fb5b10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f174c0e3be0 tx=0x7f174c009fa0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 -- 172.21.15.157:0/308043992 shutdown_connections 2024-05-09T09:47:41.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 --2- 172.21.15.157:0/308043992 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1630034bb0 0x7f1630037070 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 --2- 172.21.15.157:0/308043992 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2fb56f0 0x55cff2fb5b10 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 -- 172.21.15.157:0/308043992 >> 172.21.15.157:0/308043992 conn(0x55cff2faa4c0 msgr2=0x55cff2faafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:41.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 -- 172.21.15.157:0/308043992 shutdown_connections 2024-05-09T09:47:41.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 -- 172.21.15.157:0/308043992 wait complete. 2024-05-09T09:47:41.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 -- 172.21.15.157:0/650615046 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cff2f88d90 msgr2=0x55cff2f8b180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.775+0000 7f175ba77980 1 --2- 172.21.15.157:0/650615046 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cff2f88d90 0x55cff2f8b180 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.779+0000 7f175ba77980 1 -- 172.21.15.157:0/650615046 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cff2e8d3f0 msgr2=0x55cff2f86560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.779+0000 7f175ba77980 1 --2- 172.21.15.157:0/650615046 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cff2e8d3f0 0x55cff2f86560 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.779+0000 7f175ba77980 1 -- 172.21.15.157:0/650615046 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cff2f8ccd0 msgr2=0x55cff2f8f0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.779+0000 7f175ba77980 1 --2- 172.21.15.157:0/650615046 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cff2f8ccd0 0x55cff2f8f0c0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.779+0000 7f175ba77980 1 -- 172.21.15.157:0/650615046 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1640034bb0 msgr2=0x7f1640037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.779+0000 7f175ba77980 1 --2- 172.21.15.157:0/650615046 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1640034bb0 0x7f1640037070 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1750000f70 tx=0x7f17500012c0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.779+0000 7f175ba77980 1 -- 172.21.15.157:0/650615046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2e8cad0 msgr2=0x55cff2f7f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.779+0000 7f175ba77980 1 --2- 172.21.15.157:0/650615046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cff2e8cad0 0x55cff2f7f4b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f174c018eb0 tx=0x7f174c018020 comp rx=0 tx=0).stop 2024-05-09T09:47:41.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.779+0000 7f1759d93640 1 -- 172.21.15.157:0/650615046 reap_dead start 2024-05-09T09:47:41.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.779+0000 7f175ba77980 1 -- 172.21.15.157:0/650615046 shutdown_connections 2024-05-09T09:47:41.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.779+0000 7f175ba77980 1 -- 172.21.15.157:0/650615046 >> 172.21.15.157:0/650615046 conn(0x55cff2e001f0 msgr2=0x55cff2f72bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:41.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.779+0000 7f175ba77980 1 -- 172.21.15.157:0/650615046 shutdown_connections 2024-05-09T09:47:41.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.779+0000 7f175ba77980 1 -- 172.21.15.157:0/650615046 wait complete. 2024-05-09T09:47:41.787 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-09T09:47:41.753500Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:47:41.753474Z', 'tags': [], 'group_ids': []} 2024-05-09T09:47:41.788 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-05-09T09:47:41.788 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-05-09T09:47:41.788 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-05-09T09:47:41.823 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:41.824 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:41.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.827+0000 7f995905b980 1 Processor -- start 2024-05-09T09:47:41.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.827+0000 7f995905b980 1 -- start start 2024-05-09T09:47:41.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.827+0000 7f995905b980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x560522b0b250 0x560522b995d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.827+0000 7f995905b980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560522a4c440 con 0x560522b99b10 2024-05-09T09:47:41.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.827+0000 7f995905b980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x560522a375f0 con 0x560522b0b250 2024-05-09T09:47:41.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.827+0000 7f9956375640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x560522b99b10 0x560522b9bf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:51758/0 (socket says 172.21.15.157:51758) 2024-05-09T09:47:41.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.827+0000 7f9956b76640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x560522b0b250 0x560522b995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.827+0000 7f9956375640 1 -- 172.21.15.157:0/3267200821 learned_addr learned my addr 172.21.15.157:0/3267200821 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:47:41.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.831+0000 7f9956b76640 1 -- 172.21.15.157:0/3267200821 >> v1:172.21.15.110:6789/0 conn(0x560522b99b10 legacy=0x560522b9bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.831+0000 7f9956b76640 1 -- 172.21.15.157:0/3267200821 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560522a42990 con 0x560522b0b250 2024-05-09T09:47:41.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.831+0000 7f9956b76640 1 --2- 172.21.15.157:0/3267200821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522b0b250 0x560522b995d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f994800a480 tx=0x7f994801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105b27275f62da59 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.835+0000 7f9955b74640 1 -- 172.21.15.157:0/3267200821 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99480b0070 con 0x560522b0b250 2024-05-09T09:47:41.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.835+0000 7f9955b74640 1 -- 172.21.15.157:0/3267200821 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99480ab540 con 0x560522b0b250 2024-05-09T09:47:41.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.835+0000 7f9955b74640 1 -- 172.21.15.157:0/3267200821 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99480ab840 con 0x560522b0b250 2024-05-09T09:47:41.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.835+0000 7f995905b980 1 -- 172.21.15.157:0/3267200821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522b0b250 msgr2=0x560522b995d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.835+0000 7f995905b980 1 --2- 172.21.15.157:0/3267200821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522b0b250 0x560522b995d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f994800a480 tx=0x7f994801b280 comp rx=0 tx=0).stop 2024-05-09T09:47:41.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.835+0000 7f995905b980 1 -- 172.21.15.157:0/3267200821 shutdown_connections 2024-05-09T09:47:41.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.835+0000 7f995905b980 1 --2- 172.21.15.157:0/3267200821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522b0b250 0x560522b995d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.835+0000 7f995905b980 1 -- 172.21.15.157:0/3267200821 >> 172.21.15.157:0/3267200821 conn(0x560522b910b0 msgr2=0x560522b934d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:41.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.835+0000 7f995905b980 1 -- 172.21.15.157:0/3267200821 shutdown_connections 2024-05-09T09:47:41.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.835+0000 7f995905b980 1 -- 172.21.15.157:0/3267200821 wait complete. 2024-05-09T09:47:41.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.847+0000 7f995905b980 1 Processor -- start 2024-05-09T09:47:41.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.847+0000 7f995905b980 1 -- start start 2024-05-09T09:47:41.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.851+0000 7f995905b980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522b0b250 0x560522c81b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.851+0000 7f995905b980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560522a99fe0 con 0x560522b0b250 2024-05-09T09:47:41.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.851+0000 7f9956b76640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522b0b250 0x560522c81b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.851+0000 7f9956b76640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522b0b250 0x560522c81b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59364/0 (socket says 172.21.15.157:59364) 2024-05-09T09:47:41.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.851+0000 7f9956b76640 1 -- 172.21.15.157:0/3733067099 learned_addr learned my addr 172.21.15.157:0/3733067099 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:41.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.851+0000 7f9956b76640 1 -- 172.21.15.157:0/3733067099 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560522a1eae0 con 0x560522b0b250 2024-05-09T09:47:41.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.851+0000 7f9956b76640 1 --2- 172.21.15.157:0/3733067099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522b0b250 0x560522c81b50 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f99480ae040 tx=0x7f9948003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5137805ce0e8aaa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.851+0000 7f9844e09640 1 -- 172.21.15.157:0/3733067099 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99480b0040 con 0x560522b0b250 2024-05-09T09:47:41.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.851+0000 7f9844e09640 1 -- 172.21.15.157:0/3733067099 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f994800a300 con 0x560522b0b250 2024-05-09T09:47:41.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.851+0000 7f9844e09640 1 -- 172.21.15.157:0/3733067099 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99480ab820 con 0x560522b0b250 2024-05-09T09:47:41.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.851+0000 7f995905b980 1 -- 172.21.15.157:0/3733067099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522b0b250 msgr2=0x560522c81b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.851+0000 7f995905b980 1 --2- 172.21.15.157:0/3733067099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522b0b250 0x560522c81b50 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f99480ae040 tx=0x7f9948003030 comp rx=0 tx=0).stop 2024-05-09T09:47:41.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.851+0000 7f995905b980 1 -- 172.21.15.157:0/3733067099 shutdown_connections 2024-05-09T09:47:41.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.851+0000 7f995905b980 1 --2- 172.21.15.157:0/3733067099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522b0b250 0x560522c81b50 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.851+0000 7f995905b980 1 -- 172.21.15.157:0/3733067099 >> 172.21.15.157:0/3733067099 conn(0x560522b910b0 msgr2=0x560522c7d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:41.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.851+0000 7f995905b980 1 -- 172.21.15.157:0/3733067099 shutdown_connections 2024-05-09T09:47:41.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.851+0000 7f995905b980 1 -- 172.21.15.157:0/3733067099 wait complete. 2024-05-09T09:47:41.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.851+0000 7f995905b980 1 Processor -- start 2024-05-09T09:47:41.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.851+0000 7f995905b980 1 -- start start 2024-05-09T09:47:41.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.851+0000 7f995905b980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522b0b250 0x560522c88c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.851+0000 7f995905b980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560522b9e130 con 0x560522b0b250 2024-05-09T09:47:41.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.851+0000 7f9956b76640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522b0b250 0x560522c88c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.851+0000 7f9956b76640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522b0b250 0x560522c88c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59366/0 (socket says 172.21.15.157:59366) 2024-05-09T09:47:41.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.851+0000 7f9956b76640 1 -- 172.21.15.157:0/983309805 learned_addr learned my addr 172.21.15.157:0/983309805 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:41.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.851+0000 7f9956b76640 1 -- 172.21.15.157:0/983309805 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560522c89140 con 0x560522b0b250 2024-05-09T09:47:41.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.855+0000 7f9956b76640 1 --2- 172.21.15.157:0/983309805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522b0b250 0x560522c88c00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9948019930 tx=0x7f9948018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.855+0000 7f9843606640 1 -- 172.21.15.157:0/983309805 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99480b0040 con 0x560522b0b250 2024-05-09T09:47:41.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.855+0000 7f995905b980 1 -- 172.21.15.157:0/983309805 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560522c893d0 con 0x560522b0b250 2024-05-09T09:47:41.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.855+0000 7f9843606640 1 -- 172.21.15.157:0/983309805 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99480c0870 con 0x560522b0b250 2024-05-09T09:47:41.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.855+0000 7f9843606640 1 -- 172.21.15.157:0/983309805 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99480c0b50 con 0x560522b0b250 2024-05-09T09:47:41.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.855+0000 7f995905b980 1 -- 172.21.15.157:0/983309805 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560522c8c010 con 0x560522b0b250 2024-05-09T09:47:41.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.855+0000 7f9843606640 1 -- 172.21.15.157:0/983309805 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f99480c0cf0 con 0x560522b0b250 2024-05-09T09:47:41.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.855+0000 7f9843606640 1 --2- 172.21.15.157:0/983309805 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f983c034bb0 0x7f983c037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.855+0000 7f9843606640 1 -- 172.21.15.157:0/983309805 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f99480bb070 con 0x560522b0b250 2024-05-09T09:47:41.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.855+0000 7f9956375640 1 --2- 172.21.15.157:0/983309805 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f983c034bb0 0x7f983c037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.855+0000 7f995905b980 1 --2- 172.21.15.157:0/983309805 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560522b99b10 0x560522c8fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.855+0000 7f995905b980 1 -- 172.21.15.157:0/983309805 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560522c901a0 con 0x560522b99b10 2024-05-09T09:47:41.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.855+0000 7f9957377640 1 --2- 172.21.15.157:0/983309805 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560522b99b10 0x560522c8fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.855+0000 7f9956375640 1 --2- 172.21.15.157:0/983309805 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f983c034bb0 0x7f983c037070 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f994c000f70 tx=0x7f994c0012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.855+0000 7f9957377640 1 --2- 172.21.15.157:0/983309805 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560522b99b10 0x560522c8fb30 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.855+0000 7f9957377640 1 -- 172.21.15.157:0/983309805 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x560522b99b10 2024-05-09T09:47:41.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.855+0000 7f995905b980 1 -- 172.21.15.157:0/983309805 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560522c8d230 con 0x560522b99b10 2024-05-09T09:47:41.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.855+0000 7f9957377640 1 -- 172.21.15.157:0/983309805 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f995000a4d0 con 0x560522b99b10 2024-05-09T09:47:41.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.855+0000 7f995905b980 1 --2- 172.21.15.157:0/983309805 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560522c924d0 0x560522c948c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.855+0000 7f995905b980 1 -- 172.21.15.157:0/983309805 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560522c94f90 con 0x560522c924d0 2024-05-09T09:47:41.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.855+0000 7f9956b76640 1 --2- 172.21.15.157:0/983309805 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560522c924d0 0x560522c948c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.859+0000 7f9956b76640 1 --2- 172.21.15.157:0/983309805 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560522c924d0 0x560522c948c0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.859+0000 7f9956b76640 1 -- 172.21.15.157:0/983309805 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f99480b3040 con 0x560522c924d0 2024-05-09T09:47:41.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.859+0000 7f995905b980 1 -- 172.21.15.157:0/983309805 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560522c91370 con 0x560522b99b10 2024-05-09T09:47:41.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.859+0000 7f9957377640 1 -- 172.21.15.157:0/983309805 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f995000a4d0 con 0x560522b99b10 2024-05-09T09:47:41.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.859+0000 7f995905b980 1 --2- 172.21.15.157:0/983309805 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560522c963f0 0x560522c987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.859+0000 7f995905b980 1 -- 172.21.15.157:0/983309805 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560522c98ee0 con 0x560522c963f0 2024-05-09T09:47:41.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.859+0000 7f9956375640 1 --2- 172.21.15.157:0/983309805 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560522c963f0 0x560522c987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.859+0000 7f9956375640 1 --2- 172.21.15.157:0/983309805 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560522c963f0 0x560522c987e0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.859+0000 7f9956375640 1 -- 172.21.15.157:0/983309805 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f994c00e620 con 0x560522c963f0 2024-05-09T09:47:41.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.863+0000 7f995905b980 1 Processor -- start 2024-05-09T09:47:41.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.863+0000 7f995905b980 1 -- start start 2024-05-09T09:47:41.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.863+0000 7f995905b980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522cbef60 0x560522cbf380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.863+0000 7f995905b980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560522a9e020 con 0x560522cbef60 2024-05-09T09:47:41.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.863+0000 7f9956b76640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522cbef60 0x560522cbf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.863+0000 7f9956b76640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522cbef60 0x560522cbf380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59370/0 (socket says 172.21.15.157:59370) 2024-05-09T09:47:41.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.863+0000 7f9956b76640 1 -- 172.21.15.157:0/481277713 learned_addr learned my addr 172.21.15.157:0/481277713 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:41.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.863+0000 7f9956b76640 1 -- 172.21.15.157:0/481277713 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560522cbf8c0 con 0x560522cbef60 2024-05-09T09:47:41.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.863+0000 7f9956b76640 1 --2- 172.21.15.157:0/481277713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522cbef60 0x560522cbf380 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f99480e3a80 tx=0x7f99480e0120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.863+0000 7f983b7fe640 1 -- 172.21.15.157:0/481277713 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99480ea070 con 0x560522cbef60 2024-05-09T09:47:41.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.863+0000 7f983b7fe640 1 -- 172.21.15.157:0/481277713 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99480e3c90 con 0x560522cbef60 2024-05-09T09:47:41.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.863+0000 7f995905b980 1 -- 172.21.15.157:0/481277713 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560522cc0350 con 0x560522cbef60 2024-05-09T09:47:41.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.863+0000 7f983b7fe640 1 -- 172.21.15.157:0/481277713 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99480c7b90 con 0x560522cbef60 2024-05-09T09:47:41.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.863+0000 7f995905b980 1 -- 172.21.15.157:0/481277713 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560522cc0830 con 0x560522cbef60 2024-05-09T09:47:41.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.867+0000 7f983b7fe640 1 -- 172.21.15.157:0/481277713 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f99480ed070 con 0x560522cbef60 2024-05-09T09:47:41.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.867+0000 7f983b7fe640 1 --2- 172.21.15.157:0/481277713 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9830034bb0 0x7f9830037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.867+0000 7f983b7fe640 1 -- 172.21.15.157:0/481277713 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f99480a8070 con 0x560522cbef60 2024-05-09T09:47:41.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.867+0000 7f9956375640 1 --2- 172.21.15.157:0/481277713 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9830034bb0 0x7f9830037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.867+0000 7f995905b980 1 Processor -- start 2024-05-09T09:47:41.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.867+0000 7f995905b980 1 -- start start 2024-05-09T09:47:41.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.867+0000 7f9956375640 1 --2- 172.21.15.157:0/481277713 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9830034bb0 0x7f9830037070 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f994c00bf60 tx=0x7f994c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.867+0000 7f995905b980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522ccdbe0 0x560522cce000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.867+0000 7f995905b980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560522c821e0 con 0x560522ccdbe0 2024-05-09T09:47:41.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.867+0000 7f9956b76640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522ccdbe0 0x560522cce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.867+0000 7f9956b76640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522ccdbe0 0x560522cce000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59378/0 (socket says 172.21.15.157:59378) 2024-05-09T09:47:41.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.867+0000 7f9956b76640 1 -- 172.21.15.157:0/1805175854 learned_addr learned my addr 172.21.15.157:0/1805175854 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:41.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.867+0000 7f9956b76640 1 -- 172.21.15.157:0/1805175854 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560522cce5d0 con 0x560522ccdbe0 2024-05-09T09:47:41.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.867+0000 7f9956b76640 1 --2- 172.21.15.157:0/1805175854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522ccdbe0 0x560522cce000 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f99480e03f0 tx=0x7f99480e0870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467efd6b5c6450d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.867+0000 7f98397fa640 1 -- 172.21.15.157:0/1805175854 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99480dd800 con 0x560522ccdbe0 2024-05-09T09:47:41.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.867+0000 7f98397fa640 1 -- 172.21.15.157:0/1805175854 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99480e25f0 con 0x560522ccdbe0 2024-05-09T09:47:41.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.867+0000 7f98397fa640 1 -- 172.21.15.157:0/1805175854 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99480ddc20 con 0x560522ccdbe0 2024-05-09T09:47:41.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.867+0000 7f995905b980 1 -- 172.21.15.157:0/1805175854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522ccdbe0 msgr2=0x560522cce000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:41.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.867+0000 7f995905b980 1 --2- 172.21.15.157:0/1805175854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522ccdbe0 0x560522cce000 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f99480e03f0 tx=0x7f99480e0870 comp rx=0 tx=0).stop 2024-05-09T09:47:41.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.867+0000 7f995905b980 1 -- 172.21.15.157:0/1805175854 shutdown_connections 2024-05-09T09:47:41.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.867+0000 7f995905b980 1 --2- 172.21.15.157:0/1805175854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522ccdbe0 0x560522cce000 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:41.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.867+0000 7f995905b980 1 -- 172.21.15.157:0/1805175854 >> 172.21.15.157:0/1805175854 conn(0x560522b956b0 msgr2=0x560522b95ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:41.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.867+0000 7f995905b980 1 -- 172.21.15.157:0/1805175854 shutdown_connections 2024-05-09T09:47:41.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.867+0000 7f995905b980 1 -- 172.21.15.157:0/1805175854 wait complete. 2024-05-09T09:47:41.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.871+0000 7f995905b980 1 Processor -- start 2024-05-09T09:47:41.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.871+0000 7f995905b980 1 -- start start 2024-05-09T09:47:41.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.871+0000 7f995905b980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522ccdbe0 0x560522cd5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.871+0000 7f995905b980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560522ccedb0 con 0x560522ccdbe0 2024-05-09T09:47:41.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.871+0000 7f9956b76640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522ccdbe0 0x560522cd5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.871+0000 7f9956b76640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522ccdbe0 0x560522cd5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59394/0 (socket says 172.21.15.157:59394) 2024-05-09T09:47:41.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.871+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 learned_addr learned my addr 172.21.15.157:0/2677337300 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:41.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.871+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560522cd5560 con 0x560522ccdbe0 2024-05-09T09:47:41.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.871+0000 7f9956b76640 1 --2- 172.21.15.157:0/2677337300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522ccdbe0 0x560522cd5020 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f99480ddbd0 tx=0x7f99480b0ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.871+0000 7f98277fe640 1 -- 172.21.15.157:0/2677337300 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99480dd800 con 0x560522ccdbe0 2024-05-09T09:47:41.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.871+0000 7f98277fe640 1 -- 172.21.15.157:0/2677337300 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99480b8e50 con 0x560522ccdbe0 2024-05-09T09:47:41.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.871+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560522cd5560 con 0x560522ccdbe0 2024-05-09T09:47:41.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.871+0000 7f98277fe640 1 -- 172.21.15.157:0/2677337300 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99480e51e0 con 0x560522ccdbe0 2024-05-09T09:47:41.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.871+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560522cd5560 con 0x560522ccdbe0 2024-05-09T09:47:41.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.871+0000 7f98277fe640 1 -- 172.21.15.157:0/2677337300 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f99480e5810 con 0x560522ccdbe0 2024-05-09T09:47:41.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.871+0000 7f98277fe640 1 --2- 172.21.15.157:0/2677337300 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9820034b10 0x7f9820036fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.871+0000 7f98277fe640 1 -- 172.21.15.157:0/2677337300 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f994810dca0 con 0x560522ccdbe0 2024-05-09T09:47:41.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.871+0000 7f9956375640 1 --2- 172.21.15.157:0/2677337300 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9820034b10 0x7f9820036fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.871+0000 7f995905b980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.871+0000 7f995905b980 1 --2- 172.21.15.157:0/2677337300 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560522ce1940 0x560522ce3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.871+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560522ce4550 con 0x560522ce1940 2024-05-09T09:47:41.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f9957377640 1 --2- 172.21.15.157:0/2677337300 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560522ce1940 0x560522ce3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f9956375640 1 --2- 172.21.15.157:0/2677337300 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9820034b10 0x7f9820036fd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x560522c90a80 tx=0x7f994c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f9957377640 1 --2- 172.21.15.157:0/2677337300 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560522ce1940 0x560522ce3e00 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f995905b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f995905b980 20 realm 2024-05-09T09:47:41.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f995905b980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560522ce4960 con 0x560522ce1940 2024-05-09T09:47:41.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f995905b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f995905b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:41.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f995905b980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560522ce5230 con 0x560522ce1940 2024-05-09T09:47:41.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f995905b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f995905b980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x560522ce1940 2024-05-09T09:47:41.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f995905b980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:41.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f995905b980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f995905b980 1 --2- 172.21.15.157:0/2677337300 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560522ce6330 0x560522ce8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560522ce8d30 con 0x560522ce6330 2024-05-09T09:47:41.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f9956b76640 1 --2- 172.21.15.157:0/2677337300 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560522ce6330 0x560522ce8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f9956b76640 1 --2- 172.21.15.157:0/2677337300 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560522ce6330 0x560522ce8720 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f995905b980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:41.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f995905b980 20 searching for the correct realm 2024-05-09T09:47:41.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f995905b980 1 --2- 172.21.15.157:0/2677337300 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560522ceac80 0x560522ced090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ced760 con 0x560522ceac80 2024-05-09T09:47:41.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f9956375640 1 --2- 172.21.15.157:0/2677337300 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560522ceac80 0x560522ced090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.875+0000 7f9956375640 1 --2- 172.21.15.157:0/2677337300 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560522ceac80 0x560522ced090 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.879+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c00e620 con 0x560522ceac80 2024-05-09T09:47:41.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.879+0000 7f9956375640 1 --2- 172.21.15.157:0/2677337300 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f994c037040 0x7f994c036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:41.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.879+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ced760 con 0x7f994c037040 2024-05-09T09:47:41.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.879+0000 7f9957377640 1 --2- 172.21.15.157:0/2677337300 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f994c037040 0x7f994c036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:41.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.879+0000 7f9957377640 1 --2- 172.21.15.157:0/2677337300 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f994c037040 0x7f994c036410 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:41.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.879+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f995000a4d0 con 0x7f994c037040 2024-05-09T09:47:41.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.879+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x560522ce6330 2024-05-09T09:47:41.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.879+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.879+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x560522ce1940 2024-05-09T09:47:41.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.879+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.879+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x560522ce1940 2024-05-09T09:47:41.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.879+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.879+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x560522ce6330 2024-05-09T09:47:41.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.879+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.879+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x560522ce6330 2024-05-09T09:47:41.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.879+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.879+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x7f994c037040 2024-05-09T09:47:41.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.883+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f995000a4d0 con 0x7f994c037040 2024-05-09T09:47:41.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.883+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x560522ceac80 2024-05-09T09:47:41.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.883+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c00e620 con 0x560522ceac80 2024-05-09T09:47:41.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.883+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x560522ce1940 2024-05-09T09:47:41.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.883+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.883+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x560522ce6330 2024-05-09T09:47:41.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.883+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.883+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x560522ce1940 2024-05-09T09:47:41.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.883+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.883+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x7f994c037040 2024-05-09T09:47:41.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.883+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f995000a4d0 con 0x7f994c037040 2024-05-09T09:47:41.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.883+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x560522ceac80 2024-05-09T09:47:41.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.883+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c00e620 con 0x560522ceac80 2024-05-09T09:47:41.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.883+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x560522ceac80 2024-05-09T09:47:41.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.883+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f994c00e620 con 0x560522ceac80 2024-05-09T09:47:41.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.883+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x560522ce6330 2024-05-09T09:47:41.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.883+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.883+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x560522ceac80 2024-05-09T09:47:41.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.883+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c00e620 con 0x560522ceac80 2024-05-09T09:47:41.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.883+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x560522ceac80 2024-05-09T09:47:41.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.883+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c00e620 con 0x560522ceac80 2024-05-09T09:47:41.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.883+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x560522ce1940 2024-05-09T09:47:41.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.887+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.887+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x560522ce1940 2024-05-09T09:47:41.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.887+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.887+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x560522ce6330 2024-05-09T09:47:41.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.887+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.887+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x560522ceac80 2024-05-09T09:47:41.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.887+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c00e620 con 0x560522ceac80 2024-05-09T09:47:41.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.887+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x7f994c037040 2024-05-09T09:47:41.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.887+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f995000a4d0 con 0x7f994c037040 2024-05-09T09:47:41.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.887+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x560522ce1940 2024-05-09T09:47:41.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.887+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.887+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x560522ce6330 2024-05-09T09:47:41.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.887+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.887+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x560522ceac80 2024-05-09T09:47:41.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.887+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c00e620 con 0x560522ceac80 2024-05-09T09:47:41.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.887+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x560522ce6330 2024-05-09T09:47:41.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.887+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.887+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x7f994c037040 2024-05-09T09:47:41.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.887+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f995000a4d0 con 0x7f994c037040 2024-05-09T09:47:41.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.887+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x560522ceac80 2024-05-09T09:47:41.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994c00e620 con 0x560522ceac80 2024-05-09T09:47:41.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x560522ce6330 2024-05-09T09:47:41.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x560522ce1940 2024-05-09T09:47:41.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560522ce55d0 con 0x7f994c037040 2024-05-09T09:47:41.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f995000a4d0 con 0x7f994c037040 2024-05-09T09:47:41.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:41.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:41.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:41.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:41.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:41.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:41.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560522ce95f0 con 0x560522ce1940 2024-05-09T09:47:41.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560522ce95f0 con 0x560522ce1940 2024-05-09T09:47:41.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:41.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560522ce95f0 con 0x560522ceac80 2024-05-09T09:47:41.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f994c00e620 con 0x560522ceac80 2024-05-09T09:47:41.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:41.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 20 zone default found 2024-05-09T09:47:41.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 4 Realm: () 2024-05-09T09:47:41.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:41.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:41.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:41.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 20 zonegroup default 2024-05-09T09:47:41.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560522cea040 con 0x560522ce6330 2024-05-09T09:47:41.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560522cefa70 con 0x560522ceac80 2024-05-09T09:47:41.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f994c00e620 con 0x560522ceac80 2024-05-09T09:47:41.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560522cefe10 con 0x560522ceac80 2024-05-09T09:47:41.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f994c00e620 con 0x560522ceac80 2024-05-09T09:47:41.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:41.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 20 started sync module instance, tier type = 2024-05-09T09:47:41.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:41.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.891+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522ceeeb0 con 0x7f994c037040 2024-05-09T09:47:41.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.895+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x7f994c037040 2024-05-09T09:47:41.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.895+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94580058813088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522ceeeb0 con 0x7f994c037040 2024-05-09T09:47:41.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.895+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522cf06a0 con 0x560522ce1940 2024-05-09T09:47:41.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.895+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94580058813088] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x7f994c037040 2024-05-09T09:47:41.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.895+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.895+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94580058816944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522ceeeb0 con 0x560522ce1940 2024-05-09T09:47:41.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.895+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522cf10b0 con 0x560522ceac80 2024-05-09T09:47:41.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.899+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c00e620 con 0x560522ceac80 2024-05-09T09:47:41.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.899+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94580058819584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522cf1900 con 0x560522ceac80 2024-05-09T09:47:41.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.899+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522cf2300 con 0x7f994c037040 2024-05-09T09:47:41.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.899+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94580058816944] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.899+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x7f994c037040 2024-05-09T09:47:41.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.899+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94580058810880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522cf26f0 con 0x7f994c037040 2024-05-09T09:47:41.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.899+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522cf30b0 con 0x560522ce1940 2024-05-09T09:47:41.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.899+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94580058819584] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c00e620 con 0x560522ceac80 2024-05-09T09:47:41.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.899+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94580058810880] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x7f994c037040 2024-05-09T09:47:41.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.903+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.903+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94580058824208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522cf2c00 con 0x560522ce1940 2024-05-09T09:47:41.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.903+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522cf3450 con 0x560522ce6330 2024-05-09T09:47:41.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.903+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94580058824208] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.903+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.903+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94580058827776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522cf3020 con 0x560522ce6330 2024-05-09T09:47:41.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.903+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522cf41a0 con 0x560522ce6330 2024-05-09T09:47:41.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.907+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.907+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94580058832384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522cf4850 con 0x560522ce6330 2024-05-09T09:47:41.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.907+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522cf5370 con 0x560522ce6330 2024-05-09T09:47:41.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.907+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94580058827776] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.907+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.907+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94580058836544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522cf5330 con 0x560522ce6330 2024-05-09T09:47:41.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.907+0000 7f995905b980 20 add_watcher() i=0 2024-05-09T09:47:41.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.907+0000 7f995905b980 20 add_watcher() i=1 2024-05-09T09:47:41.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.907+0000 7f995905b980 20 add_watcher() i=2 2024-05-09T09:47:41.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.907+0000 7f995905b980 20 add_watcher() i=3 2024-05-09T09:47:41.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.907+0000 7f995905b980 20 add_watcher() i=4 2024-05-09T09:47:41.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.907+0000 7f995905b980 20 add_watcher() i=5 2024-05-09T09:47:41.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.907+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94580058832384] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.907+0000 7f995905b980 20 add_watcher() i=6 2024-05-09T09:47:41.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.911+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94580058836544] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.911+0000 7f995905b980 20 add_watcher() i=7 2024-05-09T09:47:41.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.911+0000 7f995905b980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:41.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.911+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560522cf42e0 con 0x560522ce1940 2024-05-09T09:47:41.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.911+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.911+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94580058833568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522cf57a0 con 0x560522ce1940 2024-05-09T09:47:41.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.911+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94580058833568] v30'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.911+0000 7f98077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:41.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.911+0000 7f995905b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:41.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.911+0000 7f995905b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:41.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.911+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d00cb0 con 0x560522ce1940 2024-05-09T09:47:41.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.915+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'59 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.915+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d01360 con 0x560522ce6330 2024-05-09T09:47:41.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.915+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'54 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.915+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d01360 con 0x560522ceac80 2024-05-09T09:47:41.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.919+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'53 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f994c00e620 con 0x560522ceac80 2024-05-09T09:47:41.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.919+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d01950 con 0x560522ce1940 2024-05-09T09:47:41.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.919+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'240 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.919+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d01e00 con 0x7f994c037040 2024-05-09T09:47:41.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.919+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'149 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x7f994c037040 2024-05-09T09:47:41.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.919+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522cfed50 con 0x560522ceac80 2024-05-09T09:47:41.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.919+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'100 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f994c00e620 con 0x560522ceac80 2024-05-09T09:47:41.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.919+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d02960 con 0x560522ce1940 2024-05-09T09:47:41.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.923+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'55 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.923+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d02960 con 0x560522ce6330 2024-05-09T09:47:41.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.927+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'99 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.927+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d029f0 con 0x7f994c037040 2024-05-09T09:47:41.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.927+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'53 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x7f994c037040 2024-05-09T09:47:41.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.927+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d02a80 con 0x560522ceac80 2024-05-09T09:47:41.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.927+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'59 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f994c00e620 con 0x560522ceac80 2024-05-09T09:47:41.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.927+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d02f30 con 0x7f994c037040 2024-05-09T09:47:41.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.931+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'150 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x7f994c037040 2024-05-09T09:47:41.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.931+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d02f30 con 0x560522ce6330 2024-05-09T09:47:41.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.931+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'55 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.931+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d02f30 con 0x7f994c037040 2024-05-09T09:47:41.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.935+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'53 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x7f994c037040 2024-05-09T09:47:41.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.935+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d02ea0 con 0x560522ce6330 2024-05-09T09:47:41.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.935+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'105 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.935+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d02ea0 con 0x560522ce1940 2024-05-09T09:47:41.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.939+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'241 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.939+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d02ea0 con 0x560522ceac80 2024-05-09T09:47:41.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.939+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'143 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f994c00e620 con 0x560522ceac80 2024-05-09T09:47:41.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.939+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d02ea0 con 0x7f994c037040 2024-05-09T09:47:41.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.939+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'151 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x7f994c037040 2024-05-09T09:47:41.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.939+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d02ea0 con 0x560522ceac80 2024-05-09T09:47:41.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.943+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'53 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f994c00e620 con 0x560522ceac80 2024-05-09T09:47:41.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.943+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d02ea0 con 0x560522ce1940 2024-05-09T09:47:41.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.943+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'61 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.943+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d02ea0 con 0x560522ce1940 2024-05-09T09:47:41.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.947+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'242 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.947+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d02ea0 con 0x560522ceac80 2024-05-09T09:47:41.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.947+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'144 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f994c00e620 con 0x560522ceac80 2024-05-09T09:47:41.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.947+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d033a0 con 0x7f994c037040 2024-05-09T09:47:41.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.951+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'63 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x7f994c037040 2024-05-09T09:47:41.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.951+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d033a0 con 0x560522ceac80 2024-05-09T09:47:41.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.951+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'55 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f994c00e620 con 0x560522ceac80 2024-05-09T09:47:41.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.951+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d03310 con 0x560522ceac80 2024-05-09T09:47:41.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.951+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'59 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f994c00e620 con 0x560522ceac80 2024-05-09T09:47:41.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.951+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d03310 con 0x560522ceac80 2024-05-09T09:47:41.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.951+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'49 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f994c00e620 con 0x560522ceac80 2024-05-09T09:47:41.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.951+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d03310 con 0x560522ceac80 2024-05-09T09:47:41.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.955+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'101 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f994c00e620 con 0x560522ceac80 2024-05-09T09:47:41.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.955+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d03310 con 0x560522ce6330 2024-05-09T09:47:41.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.955+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'55 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.955+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d03310 con 0x560522ceac80 2024-05-09T09:47:41.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.959+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'53 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f994c00e620 con 0x560522ceac80 2024-05-09T09:47:41.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.959+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d03310 con 0x560522ce6330 2024-05-09T09:47:41.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.959+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'100 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.959+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d03310 con 0x560522ceac80 2024-05-09T09:47:41.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.963+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'145 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f994c00e620 con 0x560522ceac80 2024-05-09T09:47:41.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.963+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d03310 con 0x560522ce6330 2024-05-09T09:47:41.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.963+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'106 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.963+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d03310 con 0x7f994c037040 2024-05-09T09:47:41.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.967+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'59 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x7f994c037040 2024-05-09T09:47:41.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.967+0000 7f98067fc640 20 reqs_thread_entry: start 2024-05-09T09:47:41.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.967+0000 7f995905b980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:41.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.967+0000 7f9777fff640 20 reqs_thread_entry: start 2024-05-09T09:47:41.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.967+0000 7f995905b980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-05-09T09:47:41.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.967+0000 7f995905b980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.967+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560522d1ee40 con 0x560522ce6330 2024-05-09T09:47:41.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.967+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.967+0000 7f995905b980 20 rados_obj.operate() r=0 bl.length=419 2024-05-09T09:47:41.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.967+0000 7f995905b980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-05-09T09:47:41.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.967+0000 7f995905b980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-09T09:47:41.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.967+0000 7f995905b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:41.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.967+0000 7f995905b980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-09T09:47:41.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.967+0000 7f995905b980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.967+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:95 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560522d209d0 con 0x7f994c037040 2024-05-09T09:47:41.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.971+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(95 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f995000a4d0 con 0x7f994c037040 2024-05-09T09:47:41.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.971+0000 7f995905b980 20 rados_obj.operate() r=0 bl.length=165 2024-05-09T09:47:41.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.971+0000 7f995905b980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-09T09:47:41.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.971+0000 7f995905b980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-09T09:47:41.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.971+0000 7f995905b980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 : miss 2024-05-09T09:47:41.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.971+0000 7f995905b980 20 rados->read ofs=0 len=0 2024-05-09T09:47:41.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.971+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 8.5 8:a7233c95:root::.bucket.meta.myfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560522d22460 con 0x560522ce1940 2024-05-09T09:47:41.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.971+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(96 .bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.971+0000 7f995905b980 20 rados_obj.operate() r=0 bl.length=379 2024-05-09T09:47:41.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.971+0000 7f995905b980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 info.flags=0x17 2024-05-09T09:47:41.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.971+0000 7f995905b980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 to cache LRU end 2024-05-09T09:47:41.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.971+0000 7f995905b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:41.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.971+0000 7f995905b980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-09T09:47:41.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.971+0000 7f995905b980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 2024-05-09T09:47:41.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.971+0000 7f995905b980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-05-09T09:47:41.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.971+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:97 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d267e0 con 0x7f994c037040 2024-05-09T09:47:41.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.971+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(97 foo.buckets [call] v30'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x7f994c037040 2024-05-09T09:47:41.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.971+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:98 8.11 8:88bf1649:root::.bucket.meta.testx%3amyfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1:head [create,call version.inc in=38b,writefull 0~412 in=412b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d2a0f0 con 0x560522ceac80 2024-05-09T09:47:41.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.975+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(98 .bucket.meta.testx:myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 [create,call,writefull 0~412,setxattr (203)] v30'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f994c00e620 con 0x560522ceac80 2024-05-09T09:47:41.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.975+0000 7f995905b980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 info.flags=0x7 2024-05-09T09:47:41.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.975+0000 7f995905b980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 to cache LRU end 2024-05-09T09:47:41.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.975+0000 7f995905b980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-05-09T09:47:41.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.975+0000 7f995905b980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1, ofs0, ns] 2024-05-09T09:47:41.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.975+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify cookie 94580059045120 in=859b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560522d29940 con 0x560522ce6330 2024-05-09T09:47:41.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.975+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== watch-notify(notify (1) cookie 94580058827776 notify 128849018891 ret 0) ==== 889+0+0 (crc 0 0 0) 0x560522cfef20 con 0x560522ce6330 2024-05-09T09:47:41.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.975+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(99 notify.5 [notify cookie 94580059045120 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.975+0000 7f98397fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018891 cookie 94580058827776 notifier 4552 bl.length()=847 2024-05-09T09:47:41.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.975+0000 7f98397fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 info.flags=0x7 2024-05-09T09:47:41.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.975+0000 7f98397fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 to cache LRU end 2024-05-09T09:47:41.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.975+0000 7f98397fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-05-09T09:47:41.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.975+0000 7f98397fa640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f98180056c0 con 0x560522ce6330 2024-05-09T09:47:41.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.975+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(100 notify.5 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.975+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== watch-notify(notify_complete (2) cookie 94580059045120 notify 128849018891 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560522c8c010 con 0x560522ce6330 2024-05-09T09:47:41.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.975+0000 7f995905b980 20 handle_bi_update(): bucket=testx:myfoo[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1]): orig_sources= new_sources= 2024-05-09T09:47:41.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.975+0000 7f995905b980 20 handle_bi_update(): bucket=testx:myfoo[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1]): potential sources added=[] removed=[] 2024-05-09T09:47:41.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.975+0000 7f995905b980 20 handle_bi_update(): bucket=testx:myfoo[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1]): orig_dests= new_dests= 2024-05-09T09:47:41.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.975+0000 7f995905b980 20 handle_bi_update(): bucket=testx:myfoo[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1]): potential dests added=[] removed=[] 2024-05-09T09:47:41.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.975+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:101 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d259e0 con 0x560522ce1940 2024-05-09T09:47:41.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.979+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(101 testx$tenanteduser.buckets [call] v30'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.979+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d28d10 con 0x560522ce1940 2024-05-09T09:47:41.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.979+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(102 testx/myfoo [delete,create,call,writefull 0~193] v30'4 uv4 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.979+0000 7f995905b980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-05-09T09:47:41.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.979+0000 7f995905b980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-05-09T09:47:41.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.979+0000 7f995905b980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-05-09T09:47:41.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.979+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 7.d 7:b4812045:::notify.4:head [notify cookie 94580059034928 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560522d28d10 con 0x560522ce1940 2024-05-09T09:47:41.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.979+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== watch-notify(notify (1) cookie 94580058824208 notify 128849018897 ret 0) ==== 390+0+0 (crc 0 0 0) 0x560522d2a360 con 0x560522ce1940 2024-05-09T09:47:41.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.979+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(103 notify.4 [notify cookie 94580059034928 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.979+0000 7f98397fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018897 cookie 94580058824208 notifier 4552 bl.length()=348 2024-05-09T09:47:41.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.979+0000 7f98397fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-05-09T09:47:41.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.979+0000 7f98397fa640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-05-09T09:47:41.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.979+0000 7f98397fa640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:104 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f98180056c0 con 0x560522ce1940 2024-05-09T09:47:41.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.979+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== watch-notify(notify_complete (2) cookie 94580059034928 notify 128849018897 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9950040040 con 0x560522ce1940 2024-05-09T09:47:41.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.979+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(104 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.979+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:105 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d259e0 con 0x7f994c037040 2024-05-09T09:47:41.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.983+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(105 myfoo [call,delete] v30'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x7f994c037040 2024-05-09T09:47:41.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.983+0000 7f995905b980 10 removing default.rgw.meta+root+myfoo from cache 2024-05-09T09:47:41.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.983+0000 7f995905b980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-09T09:47:41.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.983+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:106 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94580059034928 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560522d25e00 con 0x560522ce6330 2024-05-09T09:47:41.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.983+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== watch-notify(notify (1) cookie 94580058832384 notify 128849018892 ret 0) ==== 191+0+0 (crc 0 0 0) 0x560522c8c010 con 0x560522ce6330 2024-05-09T09:47:41.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.983+0000 7f98397fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 94580058832384 notifier 4552 bl.length()=149 2024-05-09T09:47:41.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.983+0000 7f98397fa640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f98180056c0 con 0x560522ce6330 2024-05-09T09:47:41.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.983+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(106 notify.6 [notify cookie 94580059034928 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.983+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 32 ==== osd_op_reply(107 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.983+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 33 ==== watch-notify(notify_complete (2) cookie 94580059034928 notify 128849018892 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f99480cd030 con 0x560522ce6330 2024-05-09T09:47:41.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.983+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:108 8.5 8:a7233c95:root::.bucket.meta.myfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d259e0 con 0x560522ce1940 2024-05-09T09:47:41.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.987+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(108 .bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 [call,delete] v30'5 uv5 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.987+0000 7f995905b980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 from cache 2024-05-09T09:47:41.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.987+0000 7f995905b980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1, ofs0, ns] 2024-05-09T09:47:41.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.987+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:109 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94580059020480 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560522d259e0 con 0x560522ce6330 2024-05-09T09:47:41.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.987+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 34 ==== watch-notify(notify (1) cookie 94580058832384 notify 128849018893 ret 0) ==== 248+0+0 (crc 0 0 0) 0x7f99480cd030 con 0x560522ce6330 2024-05-09T09:47:41.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.987+0000 7f9838ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 94580058832384 notifier 4552 bl.length()=206 2024-05-09T09:47:41.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.987+0000 7f9838ff9640 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f9780003930 con 0x560522ce6330 2024-05-09T09:47:41.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.987+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 35 ==== osd_op_reply(109 notify.6 [notify cookie 94580059020480 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.987+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 36 ==== osd_op_reply(110 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.987+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 37 ==== watch-notify(notify_complete (2) cookie 94580059020480 notify 128849018893 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560522c893d0 con 0x560522ce6330 2024-05-09T09:47:41.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.987+0000 7f98077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:41.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.987+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:111 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94580058833568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d01e80 con 0x560522ce1940 2024-05-09T09:47:41.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.991+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(111 data_loggenerations_metadata [watch unwatch cookie 94580058833568] v30'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.991+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:112 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94580058813088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d01e80 con 0x7f994c037040 2024-05-09T09:47:41.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.991+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(112 notify.0 [watch unwatch cookie 94580058813088] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x7f994c037040 2024-05-09T09:47:41.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.991+0000 7f995905b980 20 remove_watcher() i=0 2024-05-09T09:47:41.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.991+0000 7f995905b980 2 removed watcher, disabling cache 2024-05-09T09:47:41.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.991+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:113 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94580058816944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d01e80 con 0x560522ce1940 2024-05-09T09:47:41.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.991+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 36 ==== osd_op_reply(113 notify.1 [watch unwatch cookie 94580058816944] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.991+0000 7f995905b980 20 remove_watcher() i=1 2024-05-09T09:47:41.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.991+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:114 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94580058819584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d01e80 con 0x560522ceac80 2024-05-09T09:47:41.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.995+0000 7f9956375640 1 -- 172.21.15.157:0/2677337300 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(114 notify.2 [watch unwatch cookie 94580058819584] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994c00e620 con 0x560522ceac80 2024-05-09T09:47:41.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.995+0000 7f995905b980 20 remove_watcher() i=2 2024-05-09T09:47:41.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.995+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:115 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94580058810880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d01e80 con 0x7f994c037040 2024-05-09T09:47:41.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.995+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(115 notify.3 [watch unwatch cookie 94580058810880] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x7f994c037040 2024-05-09T09:47:41.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.995+0000 7f995905b980 20 remove_watcher() i=3 2024-05-09T09:47:41.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.995+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:116 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94580058824208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d01e80 con 0x560522ce1940 2024-05-09T09:47:41.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.999+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 <== osd.1 v2:172.21.15.157:6808/3930131338 37 ==== osd_op_reply(116 notify.4 [watch unwatch cookie 94580058824208] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f995000a4d0 con 0x560522ce1940 2024-05-09T09:47:41.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.999+0000 7f995905b980 20 remove_watcher() i=4 2024-05-09T09:47:41.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.999+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:117 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94580058827776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d01e80 con 0x560522ce6330 2024-05-09T09:47:41.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.999+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 38 ==== osd_op_reply(117 notify.5 [watch unwatch cookie 94580058827776] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:41.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.999+0000 7f995905b980 20 remove_watcher() i=5 2024-05-09T09:47:41.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:41.999+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:118 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94580058832384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d01e80 con 0x560522ce6330 2024-05-09T09:47:42.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.003+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 39 ==== osd_op_reply(118 notify.6 [watch unwatch cookie 94580058832384] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:42.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.003+0000 7f995905b980 20 remove_watcher() i=6 2024-05-09T09:47:42.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.003+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:119 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94580058836544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560522d01e80 con 0x560522ce6330 2024-05-09T09:47:42.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.003+0000 7f9956b76640 1 -- 172.21.15.157:0/2677337300 <== osd.0 v2:172.21.15.110:6800/231209037 40 ==== osd_op_reply(119 notify.7 [watch unwatch cookie 94580058836544] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99480ec030 con 0x560522ce6330 2024-05-09T09:47:42.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.003+0000 7f995905b980 20 remove_watcher() i=7 2024-05-09T09:47:42.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.003+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560522ce6330 msgr2=0x560522ce8720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.003+0000 7f995905b980 1 --2- 172.21.15.157:0/2677337300 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560522ce6330 0x560522ce8720 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.003+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560522ce1940 msgr2=0x560522ce3e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.003+0000 7f995905b980 1 --2- 172.21.15.157:0/2677337300 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560522ce1940 0x560522ce3e00 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.003+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f994c037040 msgr2=0x7f994c036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.003+0000 7f995905b980 1 --2- 172.21.15.157:0/2677337300 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f994c037040 0x7f994c036410 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.003+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560522ceac80 msgr2=0x560522ced090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.003+0000 7f995905b980 1 --2- 172.21.15.157:0/2677337300 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560522ceac80 0x560522ced090 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.003+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9820034b10 msgr2=0x7f9820036fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.003+0000 7f995905b980 1 --2- 172.21.15.157:0/2677337300 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9820034b10 0x7f9820036fd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x560522c90a80 tx=0x7f994c010000 comp rx=0 tx=0).stop 2024-05-09T09:47:42.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.003+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522ccdbe0 msgr2=0x560522cd5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.003+0000 7f9957377640 1 -- 172.21.15.157:0/2677337300 reap_dead start 2024-05-09T09:47:42.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.003+0000 7f995905b980 1 --2- 172.21.15.157:0/2677337300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522ccdbe0 0x560522cd5020 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f99480ddbd0 tx=0x7f99480b0ea0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.003+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 shutdown_connections 2024-05-09T09:47:42.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.003+0000 7f995905b980 1 --2- 172.21.15.157:0/2677337300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522ccdbe0 0x560522cd5020 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.003+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 >> 172.21.15.157:0/2677337300 conn(0x560522b956b0 msgr2=0x560522b95a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:42.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.003+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 shutdown_connections 2024-05-09T09:47:42.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.003+0000 7f995905b980 1 -- 172.21.15.157:0/2677337300 wait complete. 2024-05-09T09:47:42.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.007+0000 7f995905b980 1 -- 172.21.15.157:0/481277713 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9830034bb0 msgr2=0x7f9830037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.007+0000 7f995905b980 1 --2- 172.21.15.157:0/481277713 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9830034bb0 0x7f9830037070 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f994c00bf60 tx=0x7f994c00f000 comp rx=0 tx=0).stop 2024-05-09T09:47:42.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.007+0000 7f995905b980 1 -- 172.21.15.157:0/481277713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522cbef60 msgr2=0x560522cbf380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.007+0000 7f995905b980 1 --2- 172.21.15.157:0/481277713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522cbef60 0x560522cbf380 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f99480e3a80 tx=0x7f99480e0120 comp rx=0 tx=0).stop 2024-05-09T09:47:42.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.007+0000 7f995905b980 1 -- 172.21.15.157:0/481277713 shutdown_connections 2024-05-09T09:47:42.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.007+0000 7f995905b980 1 --2- 172.21.15.157:0/481277713 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9830034bb0 0x7f9830037070 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.007+0000 7f995905b980 1 --2- 172.21.15.157:0/481277713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522cbef60 0x560522cbf380 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.007+0000 7f995905b980 1 -- 172.21.15.157:0/481277713 >> 172.21.15.157:0/481277713 conn(0x560522cb3d30 msgr2=0x560522cb4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:42.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.007+0000 7f995905b980 1 -- 172.21.15.157:0/481277713 shutdown_connections 2024-05-09T09:47:42.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.007+0000 7f995905b980 1 -- 172.21.15.157:0/481277713 wait complete. 2024-05-09T09:47:42.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.007+0000 7f995905b980 1 -- 172.21.15.157:0/983309805 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560522c924d0 msgr2=0x560522c948c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.007+0000 7f995905b980 1 --2- 172.21.15.157:0/983309805 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560522c924d0 0x560522c948c0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.007+0000 7f995905b980 1 -- 172.21.15.157:0/983309805 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560522b99b10 msgr2=0x560522c8fb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.007+0000 7f995905b980 1 --2- 172.21.15.157:0/983309805 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560522b99b10 0x560522c8fb30 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.007+0000 7f995905b980 1 -- 172.21.15.157:0/983309805 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560522c963f0 msgr2=0x560522c987e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.007+0000 7f995905b980 1 --2- 172.21.15.157:0/983309805 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560522c963f0 0x560522c987e0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.007+0000 7f995905b980 1 -- 172.21.15.157:0/983309805 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f983c034bb0 msgr2=0x7f983c037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.007+0000 7f995905b980 1 --2- 172.21.15.157:0/983309805 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f983c034bb0 0x7f983c037070 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f994c000f70 tx=0x7f994c0012c0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.007+0000 7f995905b980 1 -- 172.21.15.157:0/983309805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522b0b250 msgr2=0x560522c88c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.007+0000 7f995905b980 1 --2- 172.21.15.157:0/983309805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560522b0b250 0x560522c88c00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9948019930 tx=0x7f9948018020 comp rx=0 tx=0).stop 2024-05-09T09:47:42.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.007+0000 7f9957377640 1 -- 172.21.15.157:0/983309805 reap_dead start 2024-05-09T09:47:42.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.007+0000 7f995905b980 1 -- 172.21.15.157:0/983309805 shutdown_connections 2024-05-09T09:47:42.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.007+0000 7f995905b980 1 -- 172.21.15.157:0/983309805 >> 172.21.15.157:0/983309805 conn(0x560522b910b0 msgr2=0x560522c7c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:42.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.007+0000 7f995905b980 1 -- 172.21.15.157:0/983309805 shutdown_connections 2024-05-09T09:47:42.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.007+0000 7f995905b980 1 -- 172.21.15.157:0/983309805 wait complete. 2024-05-09T09:47:42.016 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-05-09T09:47:42.016 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-05-09T09:47:42.016 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-05-09T09:47:42.094 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:42.094 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:42.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.095+0000 7f4abd698980 1 Processor -- start 2024-05-09T09:47:42.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.095+0000 7f4abd698980 1 -- start start 2024-05-09T09:47:42.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.095+0000 7f4abd698980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55bd260d0800 0x55bd260d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.095+0000 7f4abd698980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bd25f87440 con 0x55bd260d1120 2024-05-09T09:47:42.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.095+0000 7f4abd698980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55bd25f725f0 con 0x55bd260d0800 2024-05-09T09:47:42.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.095+0000 7f4abb1b3640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55bd260d0800 0x55bd260d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.095+0000 7f4abb1b3640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55bd260d0800 0x55bd260d0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59406/0 (socket says 172.21.15.157:59406) 2024-05-09T09:47:42.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.095+0000 7f4abb1b3640 1 -- 172.21.15.157:0/1672473360 learned_addr learned my addr 172.21.15.157:0/1672473360 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:42.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.099+0000 7f4abb1b3640 1 -- 172.21.15.157:0/1672473360 >> v1:172.21.15.110:6789/0 conn(0x55bd260d1120 legacy=0x55bd260d1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.099+0000 7f4aba1b1640 1 -- 172.21.15.157:0/1672473360 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 812405327 0 0) 0x55bd25f87440 con 0x55bd260d1120 2024-05-09T09:47:42.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.099+0000 7f4abb1b3640 1 -- 172.21.15.157:0/1672473360 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd25f7d990 con 0x55bd260d0800 2024-05-09T09:47:42.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.099+0000 7f4abb1b3640 1 --2- 172.21.15.157:0/1672473360 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd260d0800 0x55bd260d0be0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4aac00a5c0 tx=0x7f4aac01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a289c5c67c0a72cb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.099+0000 7f4aba1b1640 1 -- 172.21.15.157:0/1672473360 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4aac0a6070 con 0x55bd260d0800 2024-05-09T09:47:42.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.103+0000 7f4aba1b1640 1 -- 172.21.15.157:0/1672473360 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aac0af070 con 0x55bd260d0800 2024-05-09T09:47:42.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.103+0000 7f4aba1b1640 1 -- 172.21.15.157:0/1672473360 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4aac0aa5c0 con 0x55bd260d0800 2024-05-09T09:47:42.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.103+0000 7f4abd698980 1 -- 172.21.15.157:0/1672473360 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd260d0800 msgr2=0x55bd260d0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.103+0000 7f4abd698980 1 --2- 172.21.15.157:0/1672473360 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd260d0800 0x55bd260d0be0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4aac00a5c0 tx=0x7f4aac01b340 comp rx=0 tx=0).stop 2024-05-09T09:47:42.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.103+0000 7f4abd698980 1 -- 172.21.15.157:0/1672473360 shutdown_connections 2024-05-09T09:47:42.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.103+0000 7f4abd698980 1 --2- 172.21.15.157:0/1672473360 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd260d0800 0x55bd260d0be0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.103+0000 7f4abd698980 1 -- 172.21.15.157:0/1672473360 >> 172.21.15.157:0/1672473360 conn(0x55bd260cc0d0 msgr2=0x55bd260ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:42.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.103+0000 7f4abd698980 1 -- 172.21.15.157:0/1672473360 shutdown_connections 2024-05-09T09:47:42.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.103+0000 7f4abd698980 1 -- 172.21.15.157:0/1672473360 wait complete. 2024-05-09T09:47:42.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.115+0000 7f4abd698980 1 Processor -- start 2024-05-09T09:47:42.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.115+0000 7f4abd698980 1 -- start start 2024-05-09T09:47:42.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.119+0000 7f4abd698980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd260d0800 0x55bd26045180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.119+0000 7f4abd698980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55bd25fd4fe0 con 0x55bd260d0800 2024-05-09T09:47:42.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.119+0000 7f4abb1b3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd260d0800 0x55bd26045180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.119+0000 7f4abb1b3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd260d0800 0x55bd26045180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59420/0 (socket says 172.21.15.157:59420) 2024-05-09T09:47:42.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.119+0000 7f4abb1b3640 1 -- 172.21.15.157:0/1701255350 learned_addr learned my addr 172.21.15.157:0/1701255350 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:42.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.119+0000 7f4abb1b3640 1 -- 172.21.15.157:0/1701255350 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd25f59ae0 con 0x55bd260d0800 2024-05-09T09:47:42.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.119+0000 7f4abb1b3640 1 --2- 172.21.15.157:0/1701255350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd260d0800 0x55bd26045180 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0ac040 tx=0x7f4aac003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a66cebcfd8338d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.119+0000 7f49a960a640 1 -- 172.21.15.157:0/1701255350 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4aac0aa970 con 0x55bd260d0800 2024-05-09T09:47:42.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.119+0000 7f49a960a640 1 -- 172.21.15.157:0/1701255350 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aac0aab10 con 0x55bd260d0800 2024-05-09T09:47:42.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.119+0000 7f49a960a640 1 -- 172.21.15.157:0/1701255350 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4aac0aae30 con 0x55bd260d0800 2024-05-09T09:47:42.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.119+0000 7f4abd698980 1 -- 172.21.15.157:0/1701255350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd260d0800 msgr2=0x55bd26045180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.119+0000 7f4abd698980 1 --2- 172.21.15.157:0/1701255350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd260d0800 0x55bd26045180 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0ac040 tx=0x7f4aac003030 comp rx=0 tx=0).stop 2024-05-09T09:47:42.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.119+0000 7f4abd698980 1 -- 172.21.15.157:0/1701255350 shutdown_connections 2024-05-09T09:47:42.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.119+0000 7f4abd698980 1 --2- 172.21.15.157:0/1701255350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd260d0800 0x55bd26045180 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.119+0000 7f4abd698980 1 -- 172.21.15.157:0/1701255350 >> 172.21.15.157:0/1701255350 conn(0x55bd260cc0d0 msgr2=0x55bd261b7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:42.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.119+0000 7f4abd698980 1 -- 172.21.15.157:0/1701255350 shutdown_connections 2024-05-09T09:47:42.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.119+0000 7f4abd698980 1 -- 172.21.15.157:0/1701255350 wait complete. 2024-05-09T09:47:42.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.119+0000 7f4abd698980 1 Processor -- start 2024-05-09T09:47:42.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.119+0000 7f4abd698980 1 -- start start 2024-05-09T09:47:42.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.119+0000 7f4abd698980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd260d0800 0x55bd261c41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.119+0000 7f4abd698980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55bd260da8a0 con 0x55bd260d0800 2024-05-09T09:47:42.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.119+0000 7f4abb1b3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd260d0800 0x55bd261c41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.119+0000 7f4abb1b3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd260d0800 0x55bd261c41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59428/0 (socket says 172.21.15.157:59428) 2024-05-09T09:47:42.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.119+0000 7f4abb1b3640 1 -- 172.21.15.157:0/1156836961 learned_addr learned my addr 172.21.15.157:0/1156836961 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:42.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.123+0000 7f4abb1b3640 1 -- 172.21.15.157:0/1156836961 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd261c46e0 con 0x55bd260d0800 2024-05-09T09:47:42.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.123+0000 7f4abb1b3640 1 --2- 172.21.15.157:0/1156836961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd260d0800 0x55bd261c41a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4aac003070 tx=0x7f4aac0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.123+0000 7f49a7e07640 1 -- 172.21.15.157:0/1156836961 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4aac0c6690 con 0x55bd260d0800 2024-05-09T09:47:42.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.123+0000 7f4abd698980 1 -- 172.21.15.157:0/1156836961 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd261c4970 con 0x55bd260d0800 2024-05-09T09:47:42.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.123+0000 7f49a7e07640 1 -- 172.21.15.157:0/1156836961 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aac0cc070 con 0x55bd260d0800 2024-05-09T09:47:42.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.123+0000 7f49a7e07640 1 -- 172.21.15.157:0/1156836961 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4aac0c6960 con 0x55bd260d0800 2024-05-09T09:47:42.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.123+0000 7f4abd698980 1 -- 172.21.15.157:0/1156836961 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd261c75b0 con 0x55bd260d0800 2024-05-09T09:47:42.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.123+0000 7f49a7e07640 1 -- 172.21.15.157:0/1156836961 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f4aac0c6b00 con 0x55bd260d0800 2024-05-09T09:47:42.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.123+0000 7f49a7e07640 1 --2- 172.21.15.157:0/1156836961 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f49a0034bb0 0x7f49a0037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.123+0000 7f49a7e07640 1 -- 172.21.15.157:0/1156836961 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f4aac0e5cf0 con 0x55bd260d0800 2024-05-09T09:47:42.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.123+0000 7f4aba9b2640 1 --2- 172.21.15.157:0/1156836961 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f49a0034bb0 0x7f49a0037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.123+0000 7f4abd698980 1 --2- 172.21.15.157:0/1156836961 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55bd260d1120 0x55bd261cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.123+0000 7f4abd698980 1 -- 172.21.15.157:0/1156836961 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bd261cb740 con 0x55bd260d1120 2024-05-09T09:47:42.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.123+0000 7f4abb9b4640 1 --2- 172.21.15.157:0/1156836961 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55bd260d1120 0x55bd261cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.123+0000 7f4aba9b2640 1 --2- 172.21.15.157:0/1156836961 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f49a0034bb0 0x7f49a0037070 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0000f70 tx=0x7f4ab0001400 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.123+0000 7f4abb9b4640 1 --2- 172.21.15.157:0/1156836961 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55bd260d1120 0x55bd261cb0d0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.123+0000 7f4abb9b4640 1 -- 172.21.15.157:0/1156836961 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd260d1120 2024-05-09T09:47:42.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.123+0000 7f4abd698980 1 -- 172.21.15.157:0/1156836961 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bd261c8790 con 0x55bd260d1120 2024-05-09T09:47:42.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.127+0000 7f4abb9b4640 1 -- 172.21.15.157:0/1156836961 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd260d1120 2024-05-09T09:47:42.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.127+0000 7f4abd698980 1 --2- 172.21.15.157:0/1156836961 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55bd261cda70 0x55bd261cfe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.127+0000 7f4abd698980 1 -- 172.21.15.157:0/1156836961 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bd261d0530 con 0x55bd261cda70 2024-05-09T09:47:42.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.127+0000 7f4abb1b3640 1 --2- 172.21.15.157:0/1156836961 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55bd261cda70 0x55bd261cfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.127+0000 7f4abb1b3640 1 --2- 172.21.15.157:0/1156836961 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55bd261cda70 0x55bd261cfe60 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.127+0000 7f4abb1b3640 1 -- 172.21.15.157:0/1156836961 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4aac0d1cc0 con 0x55bd261cda70 2024-05-09T09:47:42.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.127+0000 7f4abd698980 1 -- 172.21.15.157:0/1156836961 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bd261cc910 con 0x55bd260d1120 2024-05-09T09:47:42.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.127+0000 7f4abb9b4640 1 -- 172.21.15.157:0/1156836961 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd260d1120 2024-05-09T09:47:42.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.127+0000 7f4abd698980 1 --2- 172.21.15.157:0/1156836961 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55bd261d1970 0x55bd261d3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.127+0000 7f4abd698980 1 -- 172.21.15.157:0/1156836961 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bd261d44a0 con 0x55bd261d1970 2024-05-09T09:47:42.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.127+0000 7f4aba9b2640 1 --2- 172.21.15.157:0/1156836961 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55bd261d1970 0x55bd261d3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.127+0000 7f4aba9b2640 1 --2- 172.21.15.157:0/1156836961 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55bd261d1970 0x55bd261d3d60 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.127+0000 7f4aba9b2640 1 -- 172.21.15.157:0/1156836961 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4ab0010690 con 0x55bd261d1970 2024-05-09T09:47:42.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.131+0000 7f4abd698980 1 Processor -- start 2024-05-09T09:47:42.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.131+0000 7f4abd698980 1 -- start start 2024-05-09T09:47:42.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.131+0000 7f4abd698980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd261fa380 0x55bd261fa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.131+0000 7f4abd698980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55bd25fd9020 con 0x55bd261fa380 2024-05-09T09:47:42.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.131+0000 7f4abb1b3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd261fa380 0x55bd261fa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.131+0000 7f4abb1b3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd261fa380 0x55bd261fa7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59442/0 (socket says 172.21.15.157:59442) 2024-05-09T09:47:42.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.131+0000 7f4abb1b3640 1 -- 172.21.15.157:0/4054283269 learned_addr learned my addr 172.21.15.157:0/4054283269 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:42.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.131+0000 7f4abb1b3640 1 -- 172.21.15.157:0/4054283269 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd261face0 con 0x55bd261fa380 2024-05-09T09:47:42.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.131+0000 7f4abb1b3640 1 --2- 172.21.15.157:0/4054283269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd261fa380 0x55bd261fa7a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0e4080 tx=0x7f4aac0b5b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.135+0000 7f499ffff640 1 -- 172.21.15.157:0/4054283269 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4aac0c5ae0 con 0x55bd261fa380 2024-05-09T09:47:42.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.135+0000 7f4abd698980 1 -- 172.21.15.157:0/4054283269 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd261fb770 con 0x55bd261fa380 2024-05-09T09:47:42.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.135+0000 7f499ffff640 1 -- 172.21.15.157:0/4054283269 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aac0c5c80 con 0x55bd261fa380 2024-05-09T09:47:42.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.135+0000 7f499ffff640 1 -- 172.21.15.157:0/4054283269 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4aac0aacc0 con 0x55bd261fa380 2024-05-09T09:47:42.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.135+0000 7f4abd698980 1 -- 172.21.15.157:0/4054283269 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd261fbc50 con 0x55bd261fa380 2024-05-09T09:47:42.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.135+0000 7f499ffff640 1 -- 172.21.15.157:0/4054283269 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f4aac0aae60 con 0x55bd261fa380 2024-05-09T09:47:42.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.135+0000 7f499ffff640 1 --2- 172.21.15.157:0/4054283269 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4994034bb0 0x7f4994037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.135+0000 7f499ffff640 1 -- 172.21.15.157:0/4054283269 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f4aac0efc60 con 0x55bd261fa380 2024-05-09T09:47:42.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.135+0000 7f4aba9b2640 1 --2- 172.21.15.157:0/4054283269 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4994034bb0 0x7f4994037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.135+0000 7f4abd698980 1 Processor -- start 2024-05-09T09:47:42.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.135+0000 7f4abd698980 1 -- start start 2024-05-09T09:47:42.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.135+0000 7f4aba9b2640 1 --2- 172.21.15.157:0/4054283269 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4994034bb0 0x7f4994037070 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4ab000c010 tx=0x7f4ab0006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.135+0000 7f4abd698980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd26207310 0x55bd26207730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.135+0000 7f4abd698980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55bd26045810 con 0x55bd26207310 2024-05-09T09:47:42.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.135+0000 7f4abb1b3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd26207310 0x55bd26207730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.135+0000 7f4abb1b3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd26207310 0x55bd26207730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59444/0 (socket says 172.21.15.157:59444) 2024-05-09T09:47:42.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.135+0000 7f4abb1b3640 1 -- 172.21.15.157:0/2820090176 learned_addr learned my addr 172.21.15.157:0/2820090176 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:42.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.135+0000 7f4abb1b3640 1 -- 172.21.15.157:0/2820090176 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd26207d00 con 0x55bd26207310 2024-05-09T09:47:42.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.135+0000 7f4abb1b3640 1 --2- 172.21.15.157:0/2820090176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd26207310 0x55bd26207730 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0b3560 tx=0x7f4aac0bb3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3cbef3dd462a78a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.135+0000 7f499dffb640 1 -- 172.21.15.157:0/2820090176 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4aac107070 con 0x55bd26207310 2024-05-09T09:47:42.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.135+0000 7f499dffb640 1 -- 172.21.15.157:0/2820090176 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aac0d08c0 con 0x55bd26207310 2024-05-09T09:47:42.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.135+0000 7f499dffb640 1 -- 172.21.15.157:0/2820090176 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4aac0f3070 con 0x55bd26207310 2024-05-09T09:47:42.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.139+0000 7f4abd698980 1 -- 172.21.15.157:0/2820090176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd26207310 msgr2=0x55bd26207730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.139+0000 7f4abd698980 1 --2- 172.21.15.157:0/2820090176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd26207310 0x55bd26207730 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0b3560 tx=0x7f4aac0bb3c0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.139+0000 7f4abd698980 1 -- 172.21.15.157:0/2820090176 shutdown_connections 2024-05-09T09:47:42.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.139+0000 7f4abd698980 1 --2- 172.21.15.157:0/2820090176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd26207310 0x55bd26207730 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.139+0000 7f4abd698980 1 -- 172.21.15.157:0/2820090176 >> 172.21.15.157:0/2820090176 conn(0x55bd26203690 msgr2=0x55bd262016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:42.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.139+0000 7f4abd698980 1 -- 172.21.15.157:0/2820090176 shutdown_connections 2024-05-09T09:47:42.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.139+0000 7f4abd698980 1 -- 172.21.15.157:0/2820090176 wait complete. 2024-05-09T09:47:42.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.139+0000 7f4abd698980 1 Processor -- start 2024-05-09T09:47:42.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.139+0000 7f4abd698980 1 -- start start 2024-05-09T09:47:42.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.139+0000 7f4abd698980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd26207310 0x55bd261bd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.139+0000 7f4abd698980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55bd26208280 con 0x55bd26207310 2024-05-09T09:47:42.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.139+0000 7f4abb1b3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd26207310 0x55bd261bd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.139+0000 7f4abb1b3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd26207310 0x55bd261bd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59456/0 (socket says 172.21.15.157:59456) 2024-05-09T09:47:42.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.139+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 learned_addr learned my addr 172.21.15.157:0/3998564646 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:42.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.139+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd261bbe90 con 0x55bd26207310 2024-05-09T09:47:42.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.139+0000 7f4abb1b3640 1 --2- 172.21.15.157:0/3998564646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd26207310 0x55bd261bd780 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0aba60 tx=0x7f4aac0f6f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.143+0000 7f498bfff640 1 -- 172.21.15.157:0/3998564646 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4aac107050 con 0x55bd26207310 2024-05-09T09:47:42.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.143+0000 7f498bfff640 1 -- 172.21.15.157:0/3998564646 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aac111070 con 0x55bd26207310 2024-05-09T09:47:42.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.143+0000 7f498bfff640 1 -- 172.21.15.157:0/3998564646 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4aac0bcb10 con 0x55bd26207310 2024-05-09T09:47:42.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.143+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd261bbe90 con 0x55bd26207310 2024-05-09T09:47:42.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.143+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd261bc310 con 0x55bd26207310 2024-05-09T09:47:42.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f4abd698980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f498bfff640 1 -- 172.21.15.157:0/3998564646 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f4aac006390 con 0x55bd26207310 2024-05-09T09:47:42.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f498bfff640 1 --2- 172.21.15.157:0/3998564646 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4984034bb0 0x7f4984037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f498bfff640 1 -- 172.21.15.157:0/3998564646 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f4aac0ff070 con 0x55bd26207310 2024-05-09T09:47:42.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f4aba9b2640 1 --2- 172.21.15.157:0/3998564646 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4984034bb0 0x7f4984037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f4abd698980 1 --2- 172.21.15.157:0/3998564646 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55bd2621d3a0 0x55bd2621f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bd2621ffb0 con 0x55bd2621d3a0 2024-05-09T09:47:42.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f4abb9b4640 1 --2- 172.21.15.157:0/3998564646 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55bd2621d3a0 0x55bd2621f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f4aba9b2640 1 --2- 172.21.15.157:0/3998564646 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4984034bb0 0x7f4984037070 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55bd261cc020 tx=0x7f4ab0022040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f4abb9b4640 1 --2- 172.21.15.157:0/3998564646 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55bd2621d3a0 0x55bd2621f860 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f4abd698980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:42.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f4abd698980 20 realm 2024-05-09T09:47:42.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f4abd698980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bd262203c0 con 0x55bd2621d3a0 2024-05-09T09:47:42.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f4abd698980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:42.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f4abd698980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:42.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f4abd698980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bd26220c60 con 0x55bd2621d3a0 2024-05-09T09:47:42.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f4abd698980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:42.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f4abd698980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x55bd2621d3a0 2024-05-09T09:47:42.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f4abd698980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:42.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f4abd698980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f4abd698980 1 --2- 172.21.15.157:0/3998564646 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55bd26221b30 0x55bd26223f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bd26224660 con 0x55bd26221b30 2024-05-09T09:47:42.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.147+0000 7f4abb1b3640 1 --2- 172.21.15.157:0/3998564646 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55bd26221b30 0x55bd26223f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.151+0000 7f4abb1b3640 1 --2- 172.21.15.157:0/3998564646 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55bd26221b30 0x55bd26223f20 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.151+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4aac10a070 con 0x55bd26221b30 2024-05-09T09:47:42.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.151+0000 7f4abd698980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:42.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.151+0000 7f4abd698980 20 searching for the correct realm 2024-05-09T09:47:42.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.151+0000 7f4abd698980 1 --2- 172.21.15.157:0/3998564646 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55bd26226600 0x55bd26228aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.151+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26229170 con 0x55bd26226600 2024-05-09T09:47:42.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.151+0000 7f4aba9b2640 1 --2- 172.21.15.157:0/3998564646 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55bd26226600 0x55bd26228aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.151+0000 7f4aba9b2640 1 --2- 172.21.15.157:0/3998564646 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55bd26226600 0x55bd26228aa0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.151+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ab0036040 con 0x55bd26226600 2024-05-09T09:47:42.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.151+0000 7f4aba9b2640 1 --2- 172.21.15.157:0/3998564646 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f4ab0010070 0x7f4ab00393c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.151+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26229170 con 0x7f4ab0010070 2024-05-09T09:47:42.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.151+0000 7f4abb9b4640 1 --2- 172.21.15.157:0/3998564646 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f4ab0010070 0x7f4ab00393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.151+0000 7f4abb9b4640 1 --2- 172.21.15.157:0/3998564646 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f4ab0010070 0x7f4ab00393c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.151+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ab400a4d0 con 0x7f4ab0010070 2024-05-09T09:47:42.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.151+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x55bd26221b30 2024-05-09T09:47:42.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.151+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4aac10a070 con 0x55bd26221b30 2024-05-09T09:47:42.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.151+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x55bd2621d3a0 2024-05-09T09:47:42.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.151+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.151+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x55bd2621d3a0 2024-05-09T09:47:42.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.155+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.155+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x55bd26221b30 2024-05-09T09:47:42.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.155+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4aac10a070 con 0x55bd26221b30 2024-05-09T09:47:42.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.155+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x55bd26221b30 2024-05-09T09:47:42.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.155+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4aac10a070 con 0x55bd26221b30 2024-05-09T09:47:42.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.155+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x7f4ab0010070 2024-05-09T09:47:42.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.155+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ab400a4d0 con 0x7f4ab0010070 2024-05-09T09:47:42.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.155+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x55bd26226600 2024-05-09T09:47:42.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.155+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ab0036040 con 0x55bd26226600 2024-05-09T09:47:42.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.155+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x55bd2621d3a0 2024-05-09T09:47:42.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.155+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.155+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x55bd26221b30 2024-05-09T09:47:42.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.155+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4aac10a070 con 0x55bd26221b30 2024-05-09T09:47:42.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.155+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x55bd2621d3a0 2024-05-09T09:47:42.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.155+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.155+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x7f4ab0010070 2024-05-09T09:47:42.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.155+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4ab400a4d0 con 0x7f4ab0010070 2024-05-09T09:47:42.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.155+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x55bd26226600 2024-05-09T09:47:42.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.155+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ab0036040 con 0x55bd26226600 2024-05-09T09:47:42.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.155+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x55bd26226600 2024-05-09T09:47:42.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.155+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4ab0036040 con 0x55bd26226600 2024-05-09T09:47:42.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.155+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x55bd26221b30 2024-05-09T09:47:42.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.159+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4aac10a070 con 0x55bd26221b30 2024-05-09T09:47:42.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.159+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x55bd26226600 2024-05-09T09:47:42.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.159+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ab0036040 con 0x55bd26226600 2024-05-09T09:47:42.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.159+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x55bd26226600 2024-05-09T09:47:42.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.159+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ab0036040 con 0x55bd26226600 2024-05-09T09:47:42.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.159+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x55bd2621d3a0 2024-05-09T09:47:42.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.159+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.159+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x55bd2621d3a0 2024-05-09T09:47:42.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.159+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.159+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x55bd26221b30 2024-05-09T09:47:42.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.159+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4aac10a070 con 0x55bd26221b30 2024-05-09T09:47:42.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.159+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x55bd26226600 2024-05-09T09:47:42.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.159+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ab0036040 con 0x55bd26226600 2024-05-09T09:47:42.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.159+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x7f4ab0010070 2024-05-09T09:47:42.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.159+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ab400a4d0 con 0x7f4ab0010070 2024-05-09T09:47:42.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.159+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x55bd2621d3a0 2024-05-09T09:47:42.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.159+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.159+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x55bd26221b30 2024-05-09T09:47:42.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4aac10a070 con 0x55bd26221b30 2024-05-09T09:47:42.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x55bd26226600 2024-05-09T09:47:42.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ab0036040 con 0x55bd26226600 2024-05-09T09:47:42.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x55bd26221b30 2024-05-09T09:47:42.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4aac10a070 con 0x55bd26221b30 2024-05-09T09:47:42.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x7f4ab0010070 2024-05-09T09:47:42.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ab400a4d0 con 0x7f4ab0010070 2024-05-09T09:47:42.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x55bd26226600 2024-05-09T09:47:42.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ab0048040 con 0x55bd26226600 2024-05-09T09:47:42.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x55bd26221b30 2024-05-09T09:47:42.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4aac10a070 con 0x55bd26221b30 2024-05-09T09:47:42.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x55bd2621d3a0 2024-05-09T09:47:42.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bd26221000 con 0x7f4ab0010070 2024-05-09T09:47:42.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ab400a4d0 con 0x7f4ab0010070 2024-05-09T09:47:42.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abd698980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:42.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abd698980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:42.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abd698980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:42.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abd698980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:42.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abd698980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:42.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abd698980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:42.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abd698980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bd26224f20 con 0x55bd2621d3a0 2024-05-09T09:47:42.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abd698980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:42.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abd698980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bd26224f20 con 0x55bd2621d3a0 2024-05-09T09:47:42.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abd698980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:42.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abd698980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bd26224f20 con 0x55bd26226600 2024-05-09T09:47:42.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4ab0048040 con 0x55bd26226600 2024-05-09T09:47:42.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abd698980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:42.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abd698980 20 zone default found 2024-05-09T09:47:42.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abd698980 4 Realm: () 2024-05-09T09:47:42.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abd698980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:42.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abd698980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:42.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abd698980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:42.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abd698980 20 zonegroup default 2024-05-09T09:47:42.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abd698980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.163+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bd262257c0 con 0x55bd26221b30 2024-05-09T09:47:42.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.167+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4aac10a070 con 0x55bd26221b30 2024-05-09T09:47:42.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.167+0000 7f4abd698980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:42.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.167+0000 7f4abd698980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.167+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bd2622afd0 con 0x55bd26226600 2024-05-09T09:47:42.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.167+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4ab0048040 con 0x55bd26226600 2024-05-09T09:47:42.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.167+0000 7f4abd698980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:42.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.167+0000 7f4abd698980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.167+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bd2622b370 con 0x55bd26226600 2024-05-09T09:47:42.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.167+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4ab0048040 con 0x55bd26226600 2024-05-09T09:47:42.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.167+0000 7f4abd698980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:42.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.167+0000 7f4abd698980 20 started sync module instance, tier type = 2024-05-09T09:47:42.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.167+0000 7f4abd698980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:42.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.167+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2622a470 con 0x7f4ab0010070 2024-05-09T09:47:42.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.167+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x7f4ab0010070 2024-05-09T09:47:42.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.167+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94270876985760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2622a470 con 0x7f4ab0010070 2024-05-09T09:47:42.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.167+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2622be40 con 0x55bd2621d3a0 2024-05-09T09:47:42.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.167+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94270876985760] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x7f4ab0010070 2024-05-09T09:47:42.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.171+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.171+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94270876989728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2622a470 con 0x55bd2621d3a0 2024-05-09T09:47:42.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.171+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2622c850 con 0x55bd26226600 2024-05-09T09:47:42.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.171+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ab0048040 con 0x55bd26226600 2024-05-09T09:47:42.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.171+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94270876992416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2622d0f0 con 0x55bd26226600 2024-05-09T09:47:42.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.171+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2622db10 con 0x7f4ab0010070 2024-05-09T09:47:42.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.171+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94270876989728] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.175+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x7f4ab0010070 2024-05-09T09:47:42.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.175+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94270876997120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2622df00 con 0x7f4ab0010070 2024-05-09T09:47:42.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.175+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2622e8c0 con 0x55bd2621d3a0 2024-05-09T09:47:42.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.175+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94270876992416] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ab0048040 con 0x55bd26226600 2024-05-09T09:47:42.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.175+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94270876997120] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x7f4ab0010070 2024-05-09T09:47:42.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.175+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.175+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94270876983232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2622e410 con 0x55bd2621d3a0 2024-05-09T09:47:42.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.175+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2622ec60 con 0x55bd26221b30 2024-05-09T09:47:42.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.179+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94270876983232] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.179+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4aac10a070 con 0x55bd26221b30 2024-05-09T09:47:42.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.179+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94270877000720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2622e830 con 0x55bd26221b30 2024-05-09T09:47:42.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.179+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2622f960 con 0x55bd26221b30 2024-05-09T09:47:42.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.179+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4aac10a070 con 0x55bd26221b30 2024-05-09T09:47:42.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.179+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94270877004976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2622fd80 con 0x55bd26221b30 2024-05-09T09:47:42.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.179+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd26230870 con 0x55bd26221b30 2024-05-09T09:47:42.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.179+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94270877000720] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4aac10a070 con 0x55bd26221b30 2024-05-09T09:47:42.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.183+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4aac10a070 con 0x55bd26221b30 2024-05-09T09:47:42.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.183+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94270877008704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd26230830 con 0x55bd26221b30 2024-05-09T09:47:42.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.183+0000 7f4abd698980 20 add_watcher() i=0 2024-05-09T09:47:42.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.183+0000 7f4abd698980 20 add_watcher() i=1 2024-05-09T09:47:42.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.183+0000 7f4abd698980 20 add_watcher() i=2 2024-05-09T09:47:42.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.183+0000 7f4abd698980 20 add_watcher() i=3 2024-05-09T09:47:42.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.183+0000 7f4abd698980 20 add_watcher() i=4 2024-05-09T09:47:42.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.183+0000 7f4abd698980 20 add_watcher() i=5 2024-05-09T09:47:42.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.183+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94270877004976] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4aac10a070 con 0x55bd26221b30 2024-05-09T09:47:42.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.183+0000 7f4abd698980 20 add_watcher() i=6 2024-05-09T09:47:42.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.183+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94270877008704] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4aac10a070 con 0x55bd26221b30 2024-05-09T09:47:42.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.183+0000 7f4abd698980 20 add_watcher() i=7 2024-05-09T09:47:42.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.183+0000 7f4abd698980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:42.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.183+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bd2622f8d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.183+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.183+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94270877006032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd26230cd0 con 0x55bd2621d3a0 2024-05-09T09:47:42.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.183+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94270877006032] v30'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.183+0000 7f4970fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:42.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.183+0000 7f4abd698980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:42.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.183+0000 7f4abd698980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:42.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.183+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623be00 con 0x55bd2621d3a0 2024-05-09T09:47:42.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.187+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'60 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.187+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623c490 con 0x55bd26221b30 2024-05-09T09:47:42.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.187+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'55 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4aac10a070 con 0x55bd26221b30 2024-05-09T09:47:42.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.187+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623c490 con 0x55bd26226600 2024-05-09T09:47:42.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.191+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'54 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4ab0048040 con 0x55bd26226600 2024-05-09T09:47:42.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.191+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623ca60 con 0x55bd2621d3a0 2024-05-09T09:47:42.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.191+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'245 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.191+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623cf10 con 0x7f4ab0010070 2024-05-09T09:47:42.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.191+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'152 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x7f4ab0010070 2024-05-09T09:47:42.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.191+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd26239e70 con 0x55bd26226600 2024-05-09T09:47:42.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.195+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'102 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4ab0048040 con 0x55bd26226600 2024-05-09T09:47:42.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.195+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd26239e70 con 0x55bd2621d3a0 2024-05-09T09:47:42.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.195+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'56 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.195+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623da70 con 0x55bd26221b30 2024-05-09T09:47:42.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.199+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'101 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4aac10a070 con 0x55bd26221b30 2024-05-09T09:47:42.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.199+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623da70 con 0x7f4ab0010070 2024-05-09T09:47:42.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.199+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'54 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x7f4ab0010070 2024-05-09T09:47:42.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.199+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623db50 con 0x55bd26226600 2024-05-09T09:47:42.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.199+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'60 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4ab0048040 con 0x55bd26226600 2024-05-09T09:47:42.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.199+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623e210 con 0x7f4ab0010070 2024-05-09T09:47:42.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.203+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'153 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x7f4ab0010070 2024-05-09T09:47:42.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.203+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623e210 con 0x55bd26221b30 2024-05-09T09:47:42.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.203+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'56 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4aac10a070 con 0x55bd26221b30 2024-05-09T09:47:42.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.203+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623e210 con 0x7f4ab0010070 2024-05-09T09:47:42.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.207+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'54 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x7f4ab0010070 2024-05-09T09:47:42.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.207+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623e210 con 0x55bd26221b30 2024-05-09T09:47:42.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.207+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'107 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4aac10a070 con 0x55bd26221b30 2024-05-09T09:47:42.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.207+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623e210 con 0x55bd2621d3a0 2024-05-09T09:47:42.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.207+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'246 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.207+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623e210 con 0x55bd26226600 2024-05-09T09:47:42.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.211+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'146 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ab0048040 con 0x55bd26226600 2024-05-09T09:47:42.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.211+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623e6c0 con 0x7f4ab0010070 2024-05-09T09:47:42.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.211+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'154 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x7f4ab0010070 2024-05-09T09:47:42.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.211+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623e6c0 con 0x55bd26226600 2024-05-09T09:47:42.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.211+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'54 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ab0048040 con 0x55bd26226600 2024-05-09T09:47:42.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.211+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623e6c0 con 0x55bd2621d3a0 2024-05-09T09:47:42.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.215+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'62 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.215+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623e6c0 con 0x55bd2621d3a0 2024-05-09T09:47:42.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.215+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'247 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.215+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623e6c0 con 0x55bd26226600 2024-05-09T09:47:42.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.219+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'147 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ab0048040 con 0x55bd26226600 2024-05-09T09:47:42.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.219+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623e6c0 con 0x7f4ab0010070 2024-05-09T09:47:42.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.219+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'64 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x7f4ab0010070 2024-05-09T09:47:42.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.219+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623e6c0 con 0x55bd26226600 2024-05-09T09:47:42.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.219+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'56 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ab0048040 con 0x55bd26226600 2024-05-09T09:47:42.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.219+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623e6c0 con 0x55bd26226600 2024-05-09T09:47:42.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.223+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'60 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ab0048040 con 0x55bd26226600 2024-05-09T09:47:42.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.223+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623e6c0 con 0x55bd26226600 2024-05-09T09:47:42.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.223+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'50 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ab0048040 con 0x55bd26226600 2024-05-09T09:47:42.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.223+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623e6c0 con 0x55bd26226600 2024-05-09T09:47:42.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.223+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'103 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ab0048040 con 0x55bd26226600 2024-05-09T09:47:42.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.223+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623e6c0 con 0x55bd26221b30 2024-05-09T09:47:42.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.227+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'56 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4aac10a070 con 0x55bd26221b30 2024-05-09T09:47:42.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.227+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623e6c0 con 0x55bd26226600 2024-05-09T09:47:42.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.227+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'54 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ab0048040 con 0x55bd26226600 2024-05-09T09:47:42.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.227+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623e6c0 con 0x55bd26221b30 2024-05-09T09:47:42.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.231+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'102 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4aac10a070 con 0x55bd26221b30 2024-05-09T09:47:42.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.231+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623e6c0 con 0x55bd26226600 2024-05-09T09:47:42.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.231+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'148 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ab0048040 con 0x55bd26226600 2024-05-09T09:47:42.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.231+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623e6c0 con 0x55bd26221b30 2024-05-09T09:47:42.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.235+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'108 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4aac10a070 con 0x55bd26221b30 2024-05-09T09:47:42.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.235+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2623e6c0 con 0x7f4ab0010070 2024-05-09T09:47:42.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.235+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'60 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x7f4ab0010070 2024-05-09T09:47:42.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.235+0000 7f48eb7fe640 20 reqs_thread_entry: start 2024-05-09T09:47:42.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.235+0000 7f4abd698980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:42.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.235+0000 7f48e97fa640 20 reqs_thread_entry: start 2024-05-09T09:47:42.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.235+0000 7f4abd698980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.235+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bd26259d40 con 0x55bd2621d3a0 2024-05-09T09:47:42.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.235+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.235+0000 7f4abd698980 20 rados_obj.operate() r=0 bl.length=193 2024-05-09T09:47:42.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.235+0000 7f4970fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:42.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.235+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94270877006032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd26235720 con 0x55bd2621d3a0 2024-05-09T09:47:42.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.239+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94270877006032] v30'248 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.239+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94270876985760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2622f8d0 con 0x7f4ab0010070 2024-05-09T09:47:42.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.239+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94270876985760] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x7f4ab0010070 2024-05-09T09:47:42.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.239+0000 7f4abd698980 20 remove_watcher() i=0 2024-05-09T09:47:42.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.239+0000 7f4abd698980 2 removed watcher, disabling cache 2024-05-09T09:47:42.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.239+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94270876989728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2622a9a0 con 0x55bd2621d3a0 2024-05-09T09:47:42.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.243+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94270876989728] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.243+0000 7f4abd698980 20 remove_watcher() i=1 2024-05-09T09:47:42.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.243+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94270876992416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2622a9a0 con 0x55bd26226600 2024-05-09T09:47:42.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.243+0000 7f4aba9b2640 1 -- 172.21.15.157:0/3998564646 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94270876992416] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ab0048040 con 0x55bd26226600 2024-05-09T09:47:42.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.243+0000 7f4abd698980 20 remove_watcher() i=2 2024-05-09T09:47:42.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.243+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94270876997120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2622c3a0 con 0x7f4ab0010070 2024-05-09T09:47:42.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.243+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94270876997120] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x7f4ab0010070 2024-05-09T09:47:42.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.243+0000 7f4abd698980 20 remove_watcher() i=3 2024-05-09T09:47:42.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.243+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94270876983232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2622a9a0 con 0x55bd2621d3a0 2024-05-09T09:47:42.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.247+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94270876983232] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ab400a4d0 con 0x55bd2621d3a0 2024-05-09T09:47:42.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.247+0000 7f4abd698980 20 remove_watcher() i=4 2024-05-09T09:47:42.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.247+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94270877000720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2622c3a0 con 0x55bd26221b30 2024-05-09T09:47:42.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.251+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94270877000720] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4aac10a070 con 0x55bd26221b30 2024-05-09T09:47:42.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.251+0000 7f4abd698980 20 remove_watcher() i=5 2024-05-09T09:47:42.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.251+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94270877004976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd26229fc0 con 0x55bd26221b30 2024-05-09T09:47:42.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.251+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94270877004976] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4aac10a070 con 0x55bd26221b30 2024-05-09T09:47:42.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.251+0000 7f4abd698980 20 remove_watcher() i=6 2024-05-09T09:47:42.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.251+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94270877008704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bd2622a9a0 con 0x55bd26221b30 2024-05-09T09:47:42.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.251+0000 7f4abb1b3640 1 -- 172.21.15.157:0/3998564646 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94270877008704] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4aac10a070 con 0x55bd26221b30 2024-05-09T09:47:42.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.251+0000 7f4abd698980 20 remove_watcher() i=7 2024-05-09T09:47:42.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55bd26221b30 msgr2=0x55bd26223f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 --2- 172.21.15.157:0/3998564646 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55bd26221b30 0x55bd26223f20 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55bd2621d3a0 msgr2=0x55bd2621f860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 --2- 172.21.15.157:0/3998564646 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55bd2621d3a0 0x55bd2621f860 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f4ab0010070 msgr2=0x7f4ab00393c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 --2- 172.21.15.157:0/3998564646 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f4ab0010070 0x7f4ab00393c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55bd26226600 msgr2=0x55bd26228aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 --2- 172.21.15.157:0/3998564646 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55bd26226600 0x55bd26228aa0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4984034bb0 msgr2=0x7f4984037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 --2- 172.21.15.157:0/3998564646 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4984034bb0 0x7f4984037070 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55bd261cc020 tx=0x7f4ab0022040 comp rx=0 tx=0).stop 2024-05-09T09:47:42.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd26207310 msgr2=0x55bd261bd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abb9b4640 1 -- 172.21.15.157:0/3998564646 reap_dead start 2024-05-09T09:47:42.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 --2- 172.21.15.157:0/3998564646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd26207310 0x55bd261bd780 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0aba60 tx=0x7f4aac0f6f30 comp rx=0 tx=0).stop 2024-05-09T09:47:42.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 shutdown_connections 2024-05-09T09:47:42.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 --2- 172.21.15.157:0/3998564646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd26207310 0x55bd261bd780 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 >> 172.21.15.157:0/3998564646 conn(0x55bd26203690 msgr2=0x55bd26200cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:42.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 shutdown_connections 2024-05-09T09:47:42.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 -- 172.21.15.157:0/3998564646 wait complete. 2024-05-09T09:47:42.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 -- 172.21.15.157:0/4054283269 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4994034bb0 msgr2=0x7f4994037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 --2- 172.21.15.157:0/4054283269 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4994034bb0 0x7f4994037070 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4ab000c010 tx=0x7f4ab0006000 comp rx=0 tx=0).stop 2024-05-09T09:47:42.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 -- 172.21.15.157:0/4054283269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd261fa380 msgr2=0x55bd261fa7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 --2- 172.21.15.157:0/4054283269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd261fa380 0x55bd261fa7a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0e4080 tx=0x7f4aac0b5b10 comp rx=0 tx=0).stop 2024-05-09T09:47:42.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 -- 172.21.15.157:0/4054283269 shutdown_connections 2024-05-09T09:47:42.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 --2- 172.21.15.157:0/4054283269 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4994034bb0 0x7f4994037070 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 --2- 172.21.15.157:0/4054283269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd261fa380 0x55bd261fa7a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 -- 172.21.15.157:0/4054283269 >> 172.21.15.157:0/4054283269 conn(0x55bd261ef150 msgr2=0x55bd261efc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:42.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 -- 172.21.15.157:0/4054283269 shutdown_connections 2024-05-09T09:47:42.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 -- 172.21.15.157:0/4054283269 wait complete. 2024-05-09T09:47:42.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 -- 172.21.15.157:0/1156836961 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55bd261cda70 msgr2=0x55bd261cfe60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 --2- 172.21.15.157:0/1156836961 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55bd261cda70 0x55bd261cfe60 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 -- 172.21.15.157:0/1156836961 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55bd260d1120 msgr2=0x55bd261cb0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 --2- 172.21.15.157:0/1156836961 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55bd260d1120 0x55bd261cb0d0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 -- 172.21.15.157:0/1156836961 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55bd261d1970 msgr2=0x55bd261d3d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 --2- 172.21.15.157:0/1156836961 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55bd261d1970 0x55bd261d3d60 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 -- 172.21.15.157:0/1156836961 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f49a0034bb0 msgr2=0x7f49a0037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 --2- 172.21.15.157:0/1156836961 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f49a0034bb0 0x7f49a0037070 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0000f70 tx=0x7f4ab0001400 comp rx=0 tx=0).stop 2024-05-09T09:47:42.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 -- 172.21.15.157:0/1156836961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd260d0800 msgr2=0x55bd261c41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 --2- 172.21.15.157:0/1156836961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bd260d0800 0x55bd261c41a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4aac003070 tx=0x7f4aac0180e0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abb9b4640 1 -- 172.21.15.157:0/1156836961 reap_dead start 2024-05-09T09:47:42.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 -- 172.21.15.157:0/1156836961 shutdown_connections 2024-05-09T09:47:42.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 -- 172.21.15.157:0/1156836961 >> 172.21.15.157:0/1156836961 conn(0x55bd260cc0d0 msgr2=0x55bd261b6630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:42.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 -- 172.21.15.157:0/1156836961 shutdown_connections 2024-05-09T09:47:42.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.255+0000 7f4abd698980 1 -- 172.21.15.157:0/1156836961 wait complete. 2024-05-09T09:47:42.262 INFO:teuthology.orchestra.run.smithi157.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"zkNDKPxOWEsQSORaKtGHMZ6+","ver":2},"mtime":"2024-05-09T09:47:41.980931Z","data":{"bucket":{"name":"myfoo","marker":"b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1","bucket_id":"b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-05-09T09:47:37.451022Z","linked":true,"has_bucket_info":false}} 2024-05-09T09:47:42.263 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'zkNDKPxOWEsQSORaKtGHMZ6+', 'ver': 2}, 'mtime': '2024-05-09T09:47:41.980931Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1', 'bucket_id': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-05-09T09:47:37.451022Z', 'linked': True, 'has_bucket_info': False}} 2024-05-09T09:47:42.263 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-05-09T09:47:42.263 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-05-09T09:47:42.263 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-05-09T09:47:42.339 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:42.339 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:42.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.343+0000 7fc3007ff980 1 Processor -- start 2024-05-09T09:47:42.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.343+0000 7fc3007ff980 1 -- start start 2024-05-09T09:47:42.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.343+0000 7fc3007ff980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x560544c5d950 0x560544c5dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.343+0000 7fc3007ff980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560544b13440 con 0x560544c5e270 2024-05-09T09:47:42.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.343+0000 7fc3007ff980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x560544afe5f0 con 0x560544c5d950 2024-05-09T09:47:42.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.343+0000 7fc2fdb19640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x560544c5e270 0x560544c5ec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:51776/0 (socket says 172.21.15.157:51776) 2024-05-09T09:47:42.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.343+0000 7fc2fdb19640 1 -- 172.21.15.157:0/2029642092 learned_addr learned my addr 172.21.15.157:0/2029642092 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:47:42.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.343+0000 7fc2fd318640 1 -- 172.21.15.157:0/2029642092 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4229438680 0 0) 0x560544b13440 con 0x560544c5e270 2024-05-09T09:47:42.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.343+0000 7fc2fd318640 1 -- 172.21.15.157:0/2029642092 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2e8001e20 con 0x560544c5e270 2024-05-09T09:47:42.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.343+0000 7fc2fe31a640 1 --2- 172.21.15.157:0/2029642092 >> v2:172.21.15.110:3300/0 conn(0x560544c5d950 0x560544c5dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.343+0000 7fc2fd318640 1 -- 172.21.15.157:0/2029642092 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3580855716 0 0) 0x7fc2e8001e20 con 0x560544c5e270 2024-05-09T09:47:42.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.343+0000 7fc2fd318640 1 -- 172.21.15.157:0/2029642092 >> v2:172.21.15.110:3300/0 conn(0x560544c5d950 msgr2=0x560544c5dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T09:47:42.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.343+0000 7fc2fd318640 1 --2- 172.21.15.157:0/2029642092 >> v2:172.21.15.110:3300/0 conn(0x560544c5d950 0x560544c5dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.343+0000 7fc2fd318640 1 -- 172.21.15.157:0/2029642092 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560544b09990 con 0x560544c5e270 2024-05-09T09:47:42.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.343+0000 7fc2fd318640 1 -- 172.21.15.157:0/2029642092 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 3696504228 0 0) 0x7fc2f40015b0 con 0x560544c5e270 2024-05-09T09:47:42.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.343+0000 7fc2fd318640 1 -- 172.21.15.157:0/2029642092 >> v1:172.21.15.110:6789/0 conn(0x560544c5e270 legacy=0x560544c5ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.343+0000 7fc2fd318640 1 --2- 172.21.15.157:0/2029642092 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2e80022b0 0x7fc2e80026b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.343+0000 7fc2fd318640 1 -- 172.21.15.157:0/2029642092 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560544afe5f0 con 0x7fc2e80022b0 2024-05-09T09:47:42.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.347+0000 7fc2fe31a640 1 --2- 172.21.15.157:0/2029642092 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2e80022b0 0x7fc2e80026b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.347+0000 7fc2fe31a640 1 -- 172.21.15.157:0/2029642092 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e8001e20 con 0x7fc2e80022b0 2024-05-09T09:47:42.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.351+0000 7fc2fe31a640 1 --2- 172.21.15.157:0/2029642092 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2e80022b0 0x7fc2e80026b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc2f000a7e0 tx=0x7fc2f001b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9840da313291530 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.351+0000 7fc2fd318640 1 -- 172.21.15.157:0/2029642092 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f00aa070 con 0x7fc2e80022b0 2024-05-09T09:47:42.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.351+0000 7fc2fd318640 1 -- 172.21.15.157:0/2029642092 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f00a4880 con 0x7fc2e80022b0 2024-05-09T09:47:42.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.351+0000 7fc2fd318640 1 -- 172.21.15.157:0/2029642092 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f000a430 con 0x7fc2e80022b0 2024-05-09T09:47:42.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.351+0000 7fc3007ff980 1 -- 172.21.15.157:0/2029642092 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2e80022b0 msgr2=0x7fc2e80026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.351+0000 7fc3007ff980 1 --2- 172.21.15.157:0/2029642092 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2e80022b0 0x7fc2e80026b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc2f000a7e0 tx=0x7fc2f001b970 comp rx=0 tx=0).stop 2024-05-09T09:47:42.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.351+0000 7fc3007ff980 1 -- 172.21.15.157:0/2029642092 shutdown_connections 2024-05-09T09:47:42.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.351+0000 7fc3007ff980 1 --2- 172.21.15.157:0/2029642092 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2e80022b0 0x7fc2e80026b0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.351+0000 7fc3007ff980 1 --2- 172.21.15.157:0/2029642092 >> v2:172.21.15.110:3300/0 conn(0x560544c5d950 0x560544c5dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.351+0000 7fc3007ff980 1 -- 172.21.15.157:0/2029642092 >> 172.21.15.157:0/2029642092 conn(0x560544c59220 msgr2=0x560544c5b640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:42.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.351+0000 7fc3007ff980 1 -- 172.21.15.157:0/2029642092 shutdown_connections 2024-05-09T09:47:42.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.351+0000 7fc3007ff980 1 -- 172.21.15.157:0/2029642092 wait complete. 2024-05-09T09:47:42.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.363+0000 7fc3007ff980 1 Processor -- start 2024-05-09T09:47:42.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.363+0000 7fc3007ff980 1 -- start start 2024-05-09T09:47:42.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.367+0000 7fc3007ff980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544c5d950 0x560544bd3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.367+0000 7fc3007ff980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560544b60fe0 con 0x560544c5d950 2024-05-09T09:47:42.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.367+0000 7fc2fe31a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544c5d950 0x560544bd3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.367+0000 7fc2fe31a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544c5d950 0x560544bd3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59484/0 (socket says 172.21.15.157:59484) 2024-05-09T09:47:42.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.367+0000 7fc2fe31a640 1 -- 172.21.15.157:0/3338483941 learned_addr learned my addr 172.21.15.157:0/3338483941 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:42.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.367+0000 7fc2fe31a640 1 -- 172.21.15.157:0/3338483941 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560544ae5ae0 con 0x560544c5d950 2024-05-09T09:47:42.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.367+0000 7fc2fe31a640 1 --2- 172.21.15.157:0/3338483941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544c5d950 0x560544bd3860 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc2f000a780 tx=0x7fc2f0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd2d760832a0a3b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.367+0000 7fc1ec608640 1 -- 172.21.15.157:0/3338483941 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f00bc070 con 0x560544c5d950 2024-05-09T09:47:42.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.367+0000 7fc1ec608640 1 -- 172.21.15.157:0/3338483941 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f000a230 con 0x560544c5d950 2024-05-09T09:47:42.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.367+0000 7fc1ec608640 1 -- 172.21.15.157:0/3338483941 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f00aa040 con 0x560544c5d950 2024-05-09T09:47:42.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.367+0000 7fc3007ff980 1 -- 172.21.15.157:0/3338483941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544c5d950 msgr2=0x560544bd3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.367+0000 7fc3007ff980 1 --2- 172.21.15.157:0/3338483941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544c5d950 0x560544bd3860 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc2f000a780 tx=0x7fc2f0003030 comp rx=0 tx=0).stop 2024-05-09T09:47:42.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.367+0000 7fc3007ff980 1 -- 172.21.15.157:0/3338483941 shutdown_connections 2024-05-09T09:47:42.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.367+0000 7fc3007ff980 1 --2- 172.21.15.157:0/3338483941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544c5d950 0x560544bd3860 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.367+0000 7fc3007ff980 1 -- 172.21.15.157:0/3338483941 >> 172.21.15.157:0/3338483941 conn(0x560544c59220 msgr2=0x560544d44a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:42.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.367+0000 7fc3007ff980 1 -- 172.21.15.157:0/3338483941 shutdown_connections 2024-05-09T09:47:42.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.367+0000 7fc3007ff980 1 -- 172.21.15.157:0/3338483941 wait complete. 2024-05-09T09:47:42.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.367+0000 7fc3007ff980 1 Processor -- start 2024-05-09T09:47:42.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.367+0000 7fc3007ff980 1 -- start start 2024-05-09T09:47:42.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.367+0000 7fc3007ff980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544c5d950 0x560544d52090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.367+0000 7fc3007ff980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560544c679a0 con 0x560544c5d950 2024-05-09T09:47:42.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.367+0000 7fc2fe31a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544c5d950 0x560544d52090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.367+0000 7fc2fe31a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544c5d950 0x560544d52090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59492/0 (socket says 172.21.15.157:59492) 2024-05-09T09:47:42.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.367+0000 7fc2fe31a640 1 -- 172.21.15.157:0/3420967328 learned_addr learned my addr 172.21.15.157:0/3420967328 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:42.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.367+0000 7fc2fe31a640 1 -- 172.21.15.157:0/3420967328 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560544d525d0 con 0x560544c5d950 2024-05-09T09:47:42.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.371+0000 7fc2fe31a640 1 --2- 172.21.15.157:0/3420967328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544c5d950 0x560544d52090 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc2f001b9b0 tx=0x7fc2e8004130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.371+0000 7fc1eae05640 1 -- 172.21.15.157:0/3420967328 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f00c5020 con 0x560544c5d950 2024-05-09T09:47:42.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.371+0000 7fc1eae05640 1 -- 172.21.15.157:0/3420967328 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f00bd040 con 0x560544c5d950 2024-05-09T09:47:42.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.371+0000 7fc1eae05640 1 -- 172.21.15.157:0/3420967328 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f00bc070 con 0x560544c5d950 2024-05-09T09:47:42.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.371+0000 7fc3007ff980 1 -- 172.21.15.157:0/3420967328 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560544d52860 con 0x560544c5d950 2024-05-09T09:47:42.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.371+0000 7fc3007ff980 1 -- 172.21.15.157:0/3420967328 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560544d554f0 con 0x560544c5d950 2024-05-09T09:47:42.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.371+0000 7fc1eae05640 1 -- 172.21.15.157:0/3420967328 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fc2f00c8020 con 0x560544c5d950 2024-05-09T09:47:42.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.371+0000 7fc1eae05640 1 --2- 172.21.15.157:0/3420967328 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc1e4034c00 0x7fc1e40370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.371+0000 7fc1eae05640 1 -- 172.21.15.157:0/3420967328 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fc2f00e4cd0 con 0x560544c5d950 2024-05-09T09:47:42.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.371+0000 7fc2fdb19640 1 --2- 172.21.15.157:0/3420967328 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc1e4034c00 0x7fc1e40370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.371+0000 7fc3007ff980 1 --2- 172.21.15.157:0/3420967328 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560544c5e270 0x560544d59140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.371+0000 7fc3007ff980 1 -- 172.21.15.157:0/3420967328 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560544d59680 con 0x560544c5e270 2024-05-09T09:47:42.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.371+0000 7fc2feb1b640 1 --2- 172.21.15.157:0/3420967328 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560544c5e270 0x560544d59140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.371+0000 7fc2fdb19640 1 --2- 172.21.15.157:0/3420967328 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc1e4034c00 0x7fc1e40370c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4001000 tx=0x7fc2f4001190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.371+0000 7fc2feb1b640 1 --2- 172.21.15.157:0/3420967328 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560544c5e270 0x560544d59140 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.371+0000 7fc2feb1b640 1 -- 172.21.15.157:0/3420967328 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544c5e270 2024-05-09T09:47:42.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.371+0000 7fc3007ff980 1 -- 172.21.15.157:0/3420967328 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560544d566f0 con 0x560544c5e270 2024-05-09T09:47:42.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.371+0000 7fc2feb1b640 1 -- 172.21.15.157:0/3420967328 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544c5e270 2024-05-09T09:47:42.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.371+0000 7fc3007ff980 1 --2- 172.21.15.157:0/3420967328 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x7fc2e80022b0 0x560544d5d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.371+0000 7fc3007ff980 1 -- 172.21.15.157:0/3420967328 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560544d5e0b0 con 0x7fc2e80022b0 2024-05-09T09:47:42.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.375+0000 7fc2fe31a640 1 --2- 172.21.15.157:0/3420967328 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x7fc2e80022b0 0x560544d5d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.375+0000 7fc2fe31a640 1 --2- 172.21.15.157:0/3420967328 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x7fc2e80022b0 0x560544d5d9c0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.375+0000 7fc2fe31a640 1 -- 172.21.15.157:0/3420967328 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc2f00bf070 con 0x7fc2e80022b0 2024-05-09T09:47:42.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.375+0000 7fc3007ff980 1 -- 172.21.15.157:0/3420967328 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560544d5a850 con 0x560544c5e270 2024-05-09T09:47:42.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.375+0000 7fc2feb1b640 1 -- 172.21.15.157:0/3420967328 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544c5e270 2024-05-09T09:47:42.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.375+0000 7fc3007ff980 1 --2- 172.21.15.157:0/3420967328 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560544d5f510 0x560544d61900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.375+0000 7fc3007ff980 1 -- 172.21.15.157:0/3420967328 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560544d62040 con 0x560544d5f510 2024-05-09T09:47:42.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.375+0000 7fc2fdb19640 1 --2- 172.21.15.157:0/3420967328 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560544d5f510 0x560544d61900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.375+0000 7fc2fdb19640 1 --2- 172.21.15.157:0/3420967328 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560544d5f510 0x560544d61900 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.375+0000 7fc2fdb19640 1 -- 172.21.15.157:0/3420967328 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc2f400f800 con 0x560544d5f510 2024-05-09T09:47:42.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.379+0000 7fc3007ff980 1 Processor -- start 2024-05-09T09:47:42.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.379+0000 7fc3007ff980 1 -- start start 2024-05-09T09:47:42.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.379+0000 7fc3007ff980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544d88250 0x560544d88670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.379+0000 7fc3007ff980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560544b65020 con 0x560544d88250 2024-05-09T09:47:42.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.379+0000 7fc2fe31a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544d88250 0x560544d88670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.379+0000 7fc2fe31a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544d88250 0x560544d88670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59498/0 (socket says 172.21.15.157:59498) 2024-05-09T09:47:42.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.379+0000 7fc2fe31a640 1 -- 172.21.15.157:0/1627882987 learned_addr learned my addr 172.21.15.157:0/1627882987 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:42.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.383+0000 7fc2fe31a640 1 -- 172.21.15.157:0/1627882987 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560544d88bb0 con 0x560544d88250 2024-05-09T09:47:42.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.383+0000 7fc2fe31a640 1 --2- 172.21.15.157:0/1627882987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544d88250 0x560544d88670 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc2f00e3340 tx=0x7fc2f00c9a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.383+0000 7fc1e2ba2640 1 -- 172.21.15.157:0/1627882987 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f00aa040 con 0x560544d88250 2024-05-09T09:47:42.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.383+0000 7fc1e2ba2640 1 -- 172.21.15.157:0/1627882987 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f00ada70 con 0x560544d88250 2024-05-09T09:47:42.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.383+0000 7fc1e2ba2640 1 -- 172.21.15.157:0/1627882987 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f0009420 con 0x560544d88250 2024-05-09T09:47:42.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.383+0000 7fc3007ff980 1 -- 172.21.15.157:0/1627882987 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560544d89640 con 0x560544d88250 2024-05-09T09:47:42.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.383+0000 7fc3007ff980 1 -- 172.21.15.157:0/1627882987 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560544d89b20 con 0x560544d88250 2024-05-09T09:47:42.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.383+0000 7fc1e2ba2640 1 -- 172.21.15.157:0/1627882987 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fc2f00095c0 con 0x560544d88250 2024-05-09T09:47:42.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.383+0000 7fc1e2ba2640 1 --2- 172.21.15.157:0/1627882987 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc1d8034c00 0x7fc1d80370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.383+0000 7fc1e2ba2640 1 -- 172.21.15.157:0/1627882987 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fc2f00efca0 con 0x560544d88250 2024-05-09T09:47:42.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.383+0000 7fc2fdb19640 1 --2- 172.21.15.157:0/1627882987 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc1d8034c00 0x7fc1d80370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.383+0000 7fc3007ff980 1 Processor -- start 2024-05-09T09:47:42.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.383+0000 7fc3007ff980 1 -- start start 2024-05-09T09:47:42.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.383+0000 7fc2fdb19640 1 --2- 172.21.15.157:0/1627882987 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc1d8034c00 0x7fc1d80370c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x560544d59b50 tx=0x7fc2f4006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.383+0000 7fc3007ff980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544d95130 0x560544d95550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.383+0000 7fc3007ff980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560544bd3f50 con 0x560544d95130 2024-05-09T09:47:42.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.387+0000 7fc2fe31a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544d95130 0x560544d95550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.387+0000 7fc2fe31a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544d95130 0x560544d95550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59500/0 (socket says 172.21.15.157:59500) 2024-05-09T09:47:42.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.387+0000 7fc2fe31a640 1 -- 172.21.15.157:0/2812073101 learned_addr learned my addr 172.21.15.157:0/2812073101 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:42.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.387+0000 7fc2fe31a640 1 -- 172.21.15.157:0/2812073101 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560544d95b20 con 0x560544d95130 2024-05-09T09:47:42.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.387+0000 7fc2fe31a640 1 --2- 172.21.15.157:0/2812073101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544d95130 0x560544d95550 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc2f00c9bd0 tx=0x7fc2f00b6be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baee613804aa8f1f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.387+0000 7fc1e0b9e640 1 -- 172.21.15.157:0/2812073101 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f00df7c0 con 0x560544d95130 2024-05-09T09:47:42.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.387+0000 7fc1e0b9e640 1 -- 172.21.15.157:0/2812073101 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f00fc070 con 0x560544d95130 2024-05-09T09:47:42.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.387+0000 7fc1e0b9e640 1 -- 172.21.15.157:0/2812073101 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f00e7160 con 0x560544d95130 2024-05-09T09:47:42.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.387+0000 7fc3007ff980 1 -- 172.21.15.157:0/2812073101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544d95130 msgr2=0x560544d95550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.387+0000 7fc3007ff980 1 --2- 172.21.15.157:0/2812073101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544d95130 0x560544d95550 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc2f00c9bd0 tx=0x7fc2f00b6be0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.387+0000 7fc3007ff980 1 -- 172.21.15.157:0/2812073101 shutdown_connections 2024-05-09T09:47:42.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.387+0000 7fc3007ff980 1 --2- 172.21.15.157:0/2812073101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544d95130 0x560544d95550 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.387+0000 7fc3007ff980 1 -- 172.21.15.157:0/2812073101 >> 172.21.15.157:0/2812073101 conn(0x560544d91540 msgr2=0x560544d8f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:42.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.387+0000 7fc3007ff980 1 -- 172.21.15.157:0/2812073101 shutdown_connections 2024-05-09T09:47:42.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.387+0000 7fc3007ff980 1 -- 172.21.15.157:0/2812073101 wait complete. 2024-05-09T09:47:42.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.387+0000 7fc3007ff980 1 Processor -- start 2024-05-09T09:47:42.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.387+0000 7fc3007ff980 1 -- start start 2024-05-09T09:47:42.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.387+0000 7fc3007ff980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544d95130 0x560544d9c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.387+0000 7fc3007ff980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560544d96100 con 0x560544d95130 2024-05-09T09:47:42.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.387+0000 7fc2fe31a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544d95130 0x560544d9c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.387+0000 7fc2fe31a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544d95130 0x560544d9c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59516/0 (socket says 172.21.15.157:59516) 2024-05-09T09:47:42.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.387+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 learned_addr learned my addr 172.21.15.157:0/614468317 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:42.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.387+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560544d9ca20 con 0x560544d95130 2024-05-09T09:47:42.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc2fe31a640 1 --2- 172.21.15.157:0/614468317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544d95130 0x560544d9c4e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc2f00ed5a0 tx=0x7fc2f00dcea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc1ceffd640 1 -- 172.21.15.157:0/614468317 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f00a9a80 con 0x560544d95130 2024-05-09T09:47:42.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc1ceffd640 1 -- 172.21.15.157:0/614468317 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f00a9c40 con 0x560544d95130 2024-05-09T09:47:42.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560544d9ca20 con 0x560544d95130 2024-05-09T09:47:42.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc1ceffd640 1 -- 172.21.15.157:0/614468317 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f00098b0 con 0x560544d95130 2024-05-09T09:47:42.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560544d9ca20 con 0x560544d95130 2024-05-09T09:47:42.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc1ceffd640 1 -- 172.21.15.157:0/614468317 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fc2f0112060 con 0x560544d95130 2024-05-09T09:47:42.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc3007ff980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc1ceffd640 1 --2- 172.21.15.157:0/614468317 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc1c8034c50 0x7fc1c8037110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc1ceffd640 1 -- 172.21.15.157:0/614468317 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fc2f00f4040 con 0x560544d95130 2024-05-09T09:47:42.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc2fdb19640 1 --2- 172.21.15.157:0/614468317 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc1c8034c50 0x7fc1c8037110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc3007ff980 1 --2- 172.21.15.157:0/614468317 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560544da8eb0 0x560544dab370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560544dabac0 con 0x560544da8eb0 2024-05-09T09:47:42.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc2feb1b640 1 --2- 172.21.15.157:0/614468317 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560544da8eb0 0x560544dab370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc2fdb19640 1 --2- 172.21.15.157:0/614468317 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc1c8034c50 0x7fc1c8037110 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400ffd0 tx=0x7fc2f4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc2feb1b640 1 --2- 172.21.15.157:0/614468317 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560544da8eb0 0x560544dab370 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc3007ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:42.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc3007ff980 20 realm 2024-05-09T09:47:42.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc3007ff980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560544dabed0 con 0x560544da8eb0 2024-05-09T09:47:42.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc3007ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:42.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc3007ff980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:42.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc3007ff980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560544dac770 con 0x560544da8eb0 2024-05-09T09:47:42.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc3007ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:42.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc3007ff980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.391+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x560544da8eb0 2024-05-09T09:47:42.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.395+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.395+0000 7fc3007ff980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:42.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.395+0000 7fc3007ff980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.395+0000 7fc3007ff980 1 --2- 172.21.15.157:0/614468317 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560544dad870 0x560544dafc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.395+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560544db0300 con 0x560544dad870 2024-05-09T09:47:42.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.395+0000 7fc2fe31a640 1 --2- 172.21.15.157:0/614468317 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560544dad870 0x560544dafc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.395+0000 7fc2fe31a640 1 --2- 172.21.15.157:0/614468317 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560544dad870 0x560544dafc60 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.395+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.395+0000 7fc3007ff980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:42.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.395+0000 7fc3007ff980 20 searching for the correct realm 2024-05-09T09:47:42.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.395+0000 7fc3007ff980 1 --2- 172.21.15.157:0/614468317 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560544db21e0 0x560544db4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.395+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544db4cb0 con 0x560544db21e0 2024-05-09T09:47:42.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.395+0000 7fc2fdb19640 1 --2- 172.21.15.157:0/614468317 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560544db21e0 0x560544db4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.395+0000 7fc2fdb19640 1 --2- 172.21.15.157:0/614468317 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560544db21e0 0x560544db4630 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.395+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f4037040 con 0x560544db21e0 2024-05-09T09:47:42.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.395+0000 7fc2fdb19640 1 --2- 172.21.15.157:0/614468317 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fc2f402e910 0x7fc2f403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.395+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544db4cb0 con 0x7fc2f402e910 2024-05-09T09:47:42.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.395+0000 7fc2feb1b640 1 --2- 172.21.15.157:0/614468317 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fc2f402e910 0x7fc2f403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.395+0000 7fc2feb1b640 1 --2- 172.21.15.157:0/614468317 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fc2f402e910 0x7fc2f403a3c0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.395+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f800a4d0 con 0x7fc2f402e910 2024-05-09T09:47:42.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.395+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x560544dad870 2024-05-09T09:47:42.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.399+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.399+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x560544da8eb0 2024-05-09T09:47:42.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.399+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.399+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x560544da8eb0 2024-05-09T09:47:42.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.399+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.399+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x560544dad870 2024-05-09T09:47:42.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.399+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.399+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x560544dad870 2024-05-09T09:47:42.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.399+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.399+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x7fc2f402e910 2024-05-09T09:47:42.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.399+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f800a4d0 con 0x7fc2f402e910 2024-05-09T09:47:42.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.399+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x560544db21e0 2024-05-09T09:47:42.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.399+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f4037040 con 0x560544db21e0 2024-05-09T09:47:42.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.399+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x560544da8eb0 2024-05-09T09:47:42.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.399+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.399+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x560544dad870 2024-05-09T09:47:42.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.399+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.399+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x560544da8eb0 2024-05-09T09:47:42.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.403+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.403+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x7fc2f402e910 2024-05-09T09:47:42.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.403+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc2f800a4d0 con 0x7fc2f402e910 2024-05-09T09:47:42.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.403+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x560544db21e0 2024-05-09T09:47:42.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.403+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f4037040 con 0x560544db21e0 2024-05-09T09:47:42.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.403+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x560544db21e0 2024-05-09T09:47:42.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.403+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc2f4037040 con 0x560544db21e0 2024-05-09T09:47:42.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.403+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x560544dad870 2024-05-09T09:47:42.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.403+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.403+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x560544db21e0 2024-05-09T09:47:42.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.403+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f4037040 con 0x560544db21e0 2024-05-09T09:47:42.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.403+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x560544db21e0 2024-05-09T09:47:42.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.403+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f4037040 con 0x560544db21e0 2024-05-09T09:47:42.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.403+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x560544da8eb0 2024-05-09T09:47:42.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.403+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.403+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x560544da8eb0 2024-05-09T09:47:42.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.403+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.403+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x560544dad870 2024-05-09T09:47:42.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.403+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.403+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x560544db21e0 2024-05-09T09:47:42.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.403+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f4037040 con 0x560544db21e0 2024-05-09T09:47:42.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.403+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x7fc2f402e910 2024-05-09T09:47:42.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.403+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f800a4d0 con 0x7fc2f402e910 2024-05-09T09:47:42.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.403+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x560544da8eb0 2024-05-09T09:47:42.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.407+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.407+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x560544dad870 2024-05-09T09:47:42.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.407+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.407+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x560544db21e0 2024-05-09T09:47:42.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.407+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f4037040 con 0x560544db21e0 2024-05-09T09:47:42.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.407+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x560544dad870 2024-05-09T09:47:42.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.407+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.407+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x7fc2f402e910 2024-05-09T09:47:42.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.407+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f800a4d0 con 0x7fc2f402e910 2024-05-09T09:47:42.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.407+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x560544db21e0 2024-05-09T09:47:42.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.407+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f4049040 con 0x560544db21e0 2024-05-09T09:47:42.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.407+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x560544dad870 2024-05-09T09:47:42.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.407+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.407+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x560544da8eb0 2024-05-09T09:47:42.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.407+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.407+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560544dacb10 con 0x7fc2f402e910 2024-05-09T09:47:42.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.407+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f800a4d0 con 0x7fc2f402e910 2024-05-09T09:47:42.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.407+0000 7fc3007ff980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:42.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.407+0000 7fc3007ff980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:42.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.407+0000 7fc3007ff980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:42.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.407+0000 7fc3007ff980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:42.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.407+0000 7fc3007ff980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:42.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.407+0000 7fc3007ff980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:42.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.407+0000 7fc3007ff980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.407+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560544db0b50 con 0x560544da8eb0 2024-05-09T09:47:42.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.407+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.407+0000 7fc3007ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:42.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.407+0000 7fc3007ff980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.407+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560544db0b50 con 0x560544da8eb0 2024-05-09T09:47:42.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc3007ff980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:42.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc3007ff980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560544db0b50 con 0x560544db21e0 2024-05-09T09:47:42.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc2f4049040 con 0x560544db21e0 2024-05-09T09:47:42.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc3007ff980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:42.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc3007ff980 20 zone default found 2024-05-09T09:47:42.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc3007ff980 4 Realm: () 2024-05-09T09:47:42.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc3007ff980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:42.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc3007ff980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:42.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc3007ff980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:42.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc3007ff980 20 zonegroup default 2024-05-09T09:47:42.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc3007ff980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560544db1510 con 0x560544dad870 2024-05-09T09:47:42.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc3007ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:42.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc3007ff980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560544db1090 con 0x560544db21e0 2024-05-09T09:47:42.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc2f4049040 con 0x560544db21e0 2024-05-09T09:47:42.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc3007ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:42.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc3007ff980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560544db7140 con 0x560544db21e0 2024-05-09T09:47:42.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc2f4049040 con 0x560544db21e0 2024-05-09T09:47:42.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc3007ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:42.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc3007ff980 20 started sync module instance, tier type = 2024-05-09T09:47:42.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc3007ff980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:42.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544db6450 con 0x7fc2f402e910 2024-05-09T09:47:42.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x7fc2f402e910 2024-05-09T09:47:42.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94580630055280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544db6450 con 0x7fc2f402e910 2024-05-09T09:47:42.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544db7c00 con 0x560544da8eb0 2024-05-09T09:47:42.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.411+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94580630055280] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x7fc2f402e910 2024-05-09T09:47:42.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.415+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.415+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94580630058768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544db6450 con 0x560544da8eb0 2024-05-09T09:47:42.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.415+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544db8610 con 0x560544db21e0 2024-05-09T09:47:42.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.415+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f4049040 con 0x560544db21e0 2024-05-09T09:47:42.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.415+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94580630058768] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.415+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94580630061408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544db8e60 con 0x560544db21e0 2024-05-09T09:47:42.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.415+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544db5fa0 con 0x7fc2f402e910 2024-05-09T09:47:42.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.419+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x7fc2f402e910 2024-05-09T09:47:42.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.419+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94580630066032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544db9c40 con 0x7fc2f402e910 2024-05-09T09:47:42.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.419+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dba510 con 0x560544da8eb0 2024-05-09T09:47:42.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.419+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94580630066032] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x7fc2f402e910 2024-05-09T09:47:42.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.419+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94580630061408] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f4049040 con 0x560544db21e0 2024-05-09T09:47:42.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.419+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.419+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94580630063536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544db9c40 con 0x560544da8eb0 2024-05-09T09:47:42.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.419+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dbadb0 con 0x560544dad870 2024-05-09T09:47:42.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.419+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94580630063536] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.423+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.423+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94580630071552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544db9c40 con 0x560544dad870 2024-05-09T09:47:42.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.423+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dbb600 con 0x560544dad870 2024-05-09T09:47:42.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.423+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.423+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94580630071552] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.423+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94580630075808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dbc270 con 0x560544dad870 2024-05-09T09:47:42.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.423+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544db9790 con 0x560544dad870 2024-05-09T09:47:42.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.427+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94580630075808] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.427+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.427+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94580630076864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dbcc30 con 0x560544dad870 2024-05-09T09:47:42.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.427+0000 7fc3007ff980 20 add_watcher() i=0 2024-05-09T09:47:42.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.427+0000 7fc3007ff980 20 add_watcher() i=1 2024-05-09T09:47:42.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.427+0000 7fc3007ff980 20 add_watcher() i=2 2024-05-09T09:47:42.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.427+0000 7fc3007ff980 20 add_watcher() i=3 2024-05-09T09:47:42.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.427+0000 7fc3007ff980 20 add_watcher() i=4 2024-05-09T09:47:42.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.427+0000 7fc3007ff980 20 add_watcher() i=5 2024-05-09T09:47:42.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.427+0000 7fc3007ff980 20 add_watcher() i=6 2024-05-09T09:47:42.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.427+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94580630076864] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.427+0000 7fc3007ff980 20 add_watcher() i=7 2024-05-09T09:47:42.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.427+0000 7fc3007ff980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:42.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.427+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560544dbfe40 con 0x560544da8eb0 2024-05-09T09:47:42.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.427+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.427+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94580630079728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dbd1c0 con 0x560544da8eb0 2024-05-09T09:47:42.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.427+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94580630079728] v30'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.431+0000 7fc1b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:42.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.431+0000 7fc3007ff980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:42.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.431+0000 7fc3007ff980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:42.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.431+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dbf720 con 0x560544da8eb0 2024-05-09T09:47:42.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.431+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'61 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.431+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dc8f00 con 0x560544dad870 2024-05-09T09:47:42.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.431+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'56 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.431+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dc8f00 con 0x560544db21e0 2024-05-09T09:47:42.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.435+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'55 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2f4049040 con 0x560544db21e0 2024-05-09T09:47:42.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.435+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dc9940 con 0x560544da8eb0 2024-05-09T09:47:42.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.435+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'250 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.435+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dc8570 con 0x7fc2f402e910 2024-05-09T09:47:42.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.435+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'155 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x7fc2f402e910 2024-05-09T09:47:42.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.435+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dc8570 con 0x560544db21e0 2024-05-09T09:47:42.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.435+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'104 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2f4049040 con 0x560544db21e0 2024-05-09T09:47:42.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.435+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dca670 con 0x560544da8eb0 2024-05-09T09:47:42.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.439+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'57 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.439+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dcab20 con 0x560544dad870 2024-05-09T09:47:42.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.439+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'103 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.439+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dcab20 con 0x7fc2f402e910 2024-05-09T09:47:42.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.443+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'55 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x7fc2f402e910 2024-05-09T09:47:42.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.443+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dcab20 con 0x560544db21e0 2024-05-09T09:47:42.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.443+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'61 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2f4049040 con 0x560544db21e0 2024-05-09T09:47:42.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.443+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dca9e0 con 0x7fc2f402e910 2024-05-09T09:47:42.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.443+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'156 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x7fc2f402e910 2024-05-09T09:47:42.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.443+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dca9e0 con 0x560544dad870 2024-05-09T09:47:42.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.447+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'57 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.447+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dca9e0 con 0x7fc2f402e910 2024-05-09T09:47:42.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.447+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'55 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x7fc2f402e910 2024-05-09T09:47:42.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.447+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dca9e0 con 0x560544dad870 2024-05-09T09:47:42.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.451+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'109 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.451+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dca950 con 0x560544da8eb0 2024-05-09T09:47:42.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.451+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'251 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.451+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dca950 con 0x560544db21e0 2024-05-09T09:47:42.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.455+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'149 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f4049040 con 0x560544db21e0 2024-05-09T09:47:42.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.455+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dca9e0 con 0x7fc2f402e910 2024-05-09T09:47:42.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.455+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'157 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x7fc2f402e910 2024-05-09T09:47:42.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.455+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dca9e0 con 0x560544db21e0 2024-05-09T09:47:42.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.455+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'55 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f4049040 con 0x560544db21e0 2024-05-09T09:47:42.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.455+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dcaa70 con 0x560544da8eb0 2024-05-09T09:47:42.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.459+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'63 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.459+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dcaa70 con 0x560544da8eb0 2024-05-09T09:47:42.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.459+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'252 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.459+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dcaa70 con 0x560544db21e0 2024-05-09T09:47:42.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.463+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'150 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f4049040 con 0x560544db21e0 2024-05-09T09:47:42.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.463+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dcaa70 con 0x7fc2f402e910 2024-05-09T09:47:42.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.463+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'65 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x7fc2f402e910 2024-05-09T09:47:42.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.463+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dca9e0 con 0x560544db21e0 2024-05-09T09:47:42.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.463+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'57 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f4049040 con 0x560544db21e0 2024-05-09T09:47:42.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.463+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dca9e0 con 0x560544db21e0 2024-05-09T09:47:42.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.463+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'61 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f4049040 con 0x560544db21e0 2024-05-09T09:47:42.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.463+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dcaa20 con 0x560544db21e0 2024-05-09T09:47:42.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.467+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'51 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f4049040 con 0x560544db21e0 2024-05-09T09:47:42.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.467+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dca9e0 con 0x560544db21e0 2024-05-09T09:47:42.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.467+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'105 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f4049040 con 0x560544db21e0 2024-05-09T09:47:42.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.467+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dca9e0 con 0x560544dad870 2024-05-09T09:47:42.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.471+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'57 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.471+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dca9e0 con 0x560544db21e0 2024-05-09T09:47:42.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.471+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'55 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f4049040 con 0x560544db21e0 2024-05-09T09:47:42.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.471+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dca950 con 0x560544dad870 2024-05-09T09:47:42.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.471+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'104 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.471+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dca950 con 0x560544db21e0 2024-05-09T09:47:42.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.475+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'151 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f4049040 con 0x560544db21e0 2024-05-09T09:47:42.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.475+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dca950 con 0x560544dad870 2024-05-09T09:47:42.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.479+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'110 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.479+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dca950 con 0x7fc2f402e910 2024-05-09T09:47:42.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.479+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'61 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x7fc2f402e910 2024-05-09T09:47:42.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.479+0000 7fc1b27e4640 20 reqs_thread_entry: start 2024-05-09T09:47:42.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.479+0000 7fc3007ff980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:42.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.479+0000 7fc123fff640 20 reqs_thread_entry: start 2024-05-09T09:47:42.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.479+0000 7fc3007ff980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-09T09:47:42.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.479+0000 7fc3007ff980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.479+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560544de67c0 con 0x560544da8eb0 2024-05-09T09:47:42.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.479+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.479+0000 7fc3007ff980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:47:42.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.479+0000 7fc3007ff980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-09T09:47:42.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.479+0000 7fc3007ff980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:42.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.479+0000 7fc3007ff980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:42.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.479+0000 7fc3007ff980 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-05-09T09:47:42.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.479+0000 7fc3007ff980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.479+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560544de8330 con 0x560544da8eb0 2024-05-09T09:47:42.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.479+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(95 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv4 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.479+0000 7fc3007ff980 20 rados_obj.operate() r=0 bl.length=193 2024-05-09T09:47:42.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.479+0000 7fc3007ff980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-05-09T09:47:42.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.479+0000 7fc3007ff980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-05-09T09:47:42.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.479+0000 7fc3007ff980 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 : miss 2024-05-09T09:47:42.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.479+0000 7fc3007ff980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.479+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:96 8.11 8:88bf1649:root::.bucket.meta.testx%3amyfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560544de9e40 con 0x560544db21e0 2024-05-09T09:47:42.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.483+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(96 .bucket.meta.testx:myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 [call out=48b,stat out=16b,read 0~412 out=412b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+774 (crc 0 0 0) 0x7fc2f4049040 con 0x560544db21e0 2024-05-09T09:47:42.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.483+0000 7fc3007ff980 20 rados_obj.operate() r=0 bl.length=412 2024-05-09T09:47:42.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.483+0000 7fc3007ff980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 info.flags=0x17 2024-05-09T09:47:42.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.483+0000 7fc3007ff980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 to cache LRU end 2024-05-09T09:47:42.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.483+0000 7fc3007ff980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:42.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.483+0000 7fc3007ff980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-05-09T09:47:42.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.483+0000 7fc3007ff980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 2024-05-09T09:47:42.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.483+0000 7fc3007ff980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-05-09T09:47:42.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.483+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dee080 con 0x560544da8eb0 2024-05-09T09:47:42.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.483+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(97 testx$tenanteduser.buckets [call] v30'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.483+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 8.5 8:a7233c95:root::.bucket.meta.myfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1:head [create,call version.inc in=38b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544df1990 con 0x560544da8eb0 2024-05-09T09:47:42.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.483+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(98 .bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 [create,call,writefull 0~379,setxattr (123)] v30'6 uv6 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.483+0000 7fc3007ff980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 info.flags=0x7 2024-05-09T09:47:42.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.483+0000 7fc3007ff980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 to cache LRU end 2024-05-09T09:47:42.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.483+0000 7fc3007ff980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-09T09:47:42.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.483+0000 7fc3007ff980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1, ofs0, ns] 2024-05-09T09:47:42.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.483+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:99 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94580630287664 in=740b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560544df1170 con 0x560544dad870 2024-05-09T09:47:42.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.483+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== watch-notify(notify (1) cookie 94580630075808 notify 128849018894 ret 0) ==== 770+0+0 (crc 0 0 0) 0x560544dc85a0 con 0x560544dad870 2024-05-09T09:47:42.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.483+0000 7fc1e0b9e640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018894 cookie 94580630075808 notifier 4566 bl.length()=728 2024-05-09T09:47:42.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.483+0000 7fc1e0b9e640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 info.flags=0x7 2024-05-09T09:47:42.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.483+0000 7fc1e0b9e640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 to cache LRU end 2024-05-09T09:47:42.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.483+0000 7fc1e0b9e640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-09T09:47:42.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.483+0000 7fc1e0b9e640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fc1c00056c0 con 0x560544dad870 2024-05-09T09:47:42.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.483+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(99 notify.6 [notify cookie 94580630287664 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.487+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(100 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.487+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== watch-notify(notify_complete (2) cookie 94580630287664 notify 128849018894 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560544d88bb0 con 0x560544dad870 2024-05-09T09:47:42.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.487+0000 7fc3007ff980 20 handle_bi_update(): bucket=:myfoo[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1]): orig_sources= new_sources= 2024-05-09T09:47:42.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.487+0000 7fc3007ff980 20 handle_bi_update(): bucket=:myfoo[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1]): potential sources added=[] removed=[] 2024-05-09T09:47:42.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.487+0000 7fc3007ff980 20 handle_bi_update(): bucket=:myfoo[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1]): orig_dests= new_dests= 2024-05-09T09:47:42.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.487+0000 7fc3007ff980 20 handle_bi_update(): bucket=:myfoo[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1]): potential dests added=[] removed=[] 2024-05-09T09:47:42.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.487+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:101 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544df0540 con 0x7fc2f402e910 2024-05-09T09:47:42.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.487+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(101 foo.buckets [call] v30'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x7fc2f402e910 2024-05-09T09:47:42.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.487+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:102 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544ded120 con 0x7fc2f402e910 2024-05-09T09:47:42.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.491+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(102 myfoo [delete,create,call,writefull 0~165] v30'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x7fc2f402e910 2024-05-09T09:47:42.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.491+0000 7fc3007ff980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-09T09:47:42.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.491+0000 7fc3007ff980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-09T09:47:42.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.491+0000 7fc3007ff980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-09T09:47:42.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.491+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94580630277232 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560544ded540 con 0x560544dad870 2024-05-09T09:47:42.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.491+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== watch-notify(notify (1) cookie 94580630075808 notify 128849018895 ret 0) ==== 356+0+0 (crc 0 0 0) 0x560544d554f0 con 0x560544dad870 2024-05-09T09:47:42.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.491+0000 7fc1cffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018895 cookie 94580630075808 notifier 4566 bl.length()=314 2024-05-09T09:47:42.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.491+0000 7fc1cffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-09T09:47:42.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.491+0000 7fc1cffff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-09T09:47:42.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.491+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(103 notify.6 [notify cookie 94580630277232 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.491+0000 7fc1cffff640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fc130003a70 con 0x560544dad870 2024-05-09T09:47:42.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.491+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== watch-notify(notify_complete (2) cookie 94580630277232 notify 128849018895 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560544d52860 con 0x560544dad870 2024-05-09T09:47:42.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.491+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 32 ==== osd_op_reply(104 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.491+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:105 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544def9e0 con 0x560544da8eb0 2024-05-09T09:47:42.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.495+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(105 testx/myfoo [call,delete] v30'7 uv7 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.495+0000 7fc3007ff980 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-05-09T09:47:42.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.495+0000 7fc3007ff980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-05-09T09:47:42.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.495+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [notify cookie 94580630277232 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560544ded540 con 0x560544da8eb0 2024-05-09T09:47:42.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.495+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== watch-notify(notify (1) cookie 94580630063536 notify 128849018898 ret 0) ==== 197+0+0 (crc 0 0 0) 0x560544df0540 con 0x560544da8eb0 2024-05-09T09:47:42.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.495+0000 7fc1e0b9e640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018898 cookie 94580630063536 notifier 4566 bl.length()=155 2024-05-09T09:47:42.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.495+0000 7fc1e0b9e640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fc1c00056c0 con 0x560544da8eb0 2024-05-09T09:47:42.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.495+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(106 notify.4 [notify cookie 94580630277232 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.495+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== watch-notify(notify_complete (2) cookie 94580630277232 notify 128849018898 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560544dc8910 con 0x560544da8eb0 2024-05-09T09:47:42.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.495+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(107 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.495+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:108 8.11 8:88bf1649:root::.bucket.meta.testx%3amyfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544dee9d0 con 0x560544db21e0 2024-05-09T09:47:42.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.495+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(108 .bucket.meta.testx:myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 [call,delete] v30'2 uv2 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7fc2f4049040 con 0x560544db21e0 2024-05-09T09:47:42.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.495+0000 7fc3007ff980 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 from cache 2024-05-09T09:47:42.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.495+0000 7fc3007ff980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1, ofs0, ns] 2024-05-09T09:47:42.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.495+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [notify cookie 94580630265264 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560544de87e0 con 0x560544dad870 2024-05-09T09:47:42.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.495+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 33 ==== watch-notify(notify (1) cookie 94580630071552 notify 128849018896 ret 0) ==== 254+0+0 (crc 0 0 0) 0x560544d52860 con 0x560544dad870 2024-05-09T09:47:42.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.495+0000 7fc1cffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018896 cookie 94580630071552 notifier 4566 bl.length()=212 2024-05-09T09:47:42.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.495+0000 7fc1cffff640 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fc130005000 con 0x560544dad870 2024-05-09T09:47:42.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.495+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 34 ==== osd_op_reply(109 notify.5 [notify cookie 94580630265264 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.499+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 35 ==== osd_op_reply(110 notify.5 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.499+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 36 ==== watch-notify(notify_complete (2) cookie 94580630265264 notify 128849018896 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560544d525d0 con 0x560544dad870 2024-05-09T09:47:42.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.499+0000 7fc1b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:42.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.499+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:111 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94580630079728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544de9860 con 0x560544da8eb0 2024-05-09T09:47:42.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.499+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 36 ==== osd_op_reply(111 data_loggenerations_metadata [watch unwatch cookie 94580630079728] v30'253 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.499+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:112 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94580630055280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544de9860 con 0x7fc2f402e910 2024-05-09T09:47:42.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.503+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(112 notify.0 [watch unwatch cookie 94580630055280] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x7fc2f402e910 2024-05-09T09:47:42.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.503+0000 7fc3007ff980 20 remove_watcher() i=0 2024-05-09T09:47:42.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.503+0000 7fc3007ff980 2 removed watcher, disabling cache 2024-05-09T09:47:42.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.503+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:113 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94580630058768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544de9860 con 0x560544da8eb0 2024-05-09T09:47:42.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.503+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 37 ==== osd_op_reply(113 notify.1 [watch unwatch cookie 94580630058768] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.503+0000 7fc3007ff980 20 remove_watcher() i=1 2024-05-09T09:47:42.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.503+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:114 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94580630061408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544de9860 con 0x560544db21e0 2024-05-09T09:47:42.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.507+0000 7fc2fdb19640 1 -- 172.21.15.157:0/614468317 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== osd_op_reply(114 notify.2 [watch unwatch cookie 94580630061408] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f4049040 con 0x560544db21e0 2024-05-09T09:47:42.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.507+0000 7fc3007ff980 20 remove_watcher() i=2 2024-05-09T09:47:42.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.507+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:115 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94580630066032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544de9860 con 0x7fc2f402e910 2024-05-09T09:47:42.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.507+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(115 notify.3 [watch unwatch cookie 94580630066032] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x7fc2f402e910 2024-05-09T09:47:42.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.507+0000 7fc3007ff980 20 remove_watcher() i=3 2024-05-09T09:47:42.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.507+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:116 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94580630063536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544de9860 con 0x560544da8eb0 2024-05-09T09:47:42.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.507+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 <== osd.1 v2:172.21.15.157:6808/3930131338 38 ==== osd_op_reply(116 notify.4 [watch unwatch cookie 94580630063536] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f800a4d0 con 0x560544da8eb0 2024-05-09T09:47:42.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.507+0000 7fc3007ff980 20 remove_watcher() i=4 2024-05-09T09:47:42.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.507+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:117 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94580630071552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544de9860 con 0x560544dad870 2024-05-09T09:47:42.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.511+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 37 ==== osd_op_reply(117 notify.5 [watch unwatch cookie 94580630071552] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.511+0000 7fc3007ff980 20 remove_watcher() i=5 2024-05-09T09:47:42.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.511+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:118 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94580630075808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544de9860 con 0x560544dad870 2024-05-09T09:47:42.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.511+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 38 ==== osd_op_reply(118 notify.6 [watch unwatch cookie 94580630075808] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.511+0000 7fc3007ff980 20 remove_watcher() i=6 2024-05-09T09:47:42.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.511+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:119 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94580630076864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560544de9860 con 0x560544dad870 2024-05-09T09:47:42.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc2fe31a640 1 -- 172.21.15.157:0/614468317 <== osd.0 v2:172.21.15.110:6800/231209037 39 ==== osd_op_reply(119 notify.7 [watch unwatch cookie 94580630076864] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00dd070 con 0x560544dad870 2024-05-09T09:47:42.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 20 remove_watcher() i=7 2024-05-09T09:47:42.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560544dad870 msgr2=0x560544dafc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 --2- 172.21.15.157:0/614468317 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560544dad870 0x560544dafc60 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560544da8eb0 msgr2=0x560544dab370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 --2- 172.21.15.157:0/614468317 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560544da8eb0 0x560544dab370 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fc2f402e910 msgr2=0x7fc2f403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 --2- 172.21.15.157:0/614468317 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fc2f402e910 0x7fc2f403a3c0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560544db21e0 msgr2=0x560544db4630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 --2- 172.21.15.157:0/614468317 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560544db21e0 0x560544db4630 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc1c8034c50 msgr2=0x7fc1c8037110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 --2- 172.21.15.157:0/614468317 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc1c8034c50 0x7fc1c8037110 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400ffd0 tx=0x7fc2f4010000 comp rx=0 tx=0).stop 2024-05-09T09:47:42.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc2feb1b640 1 -- 172.21.15.157:0/614468317 reap_dead start 2024-05-09T09:47:42.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544d95130 msgr2=0x560544d9c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 --2- 172.21.15.157:0/614468317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544d95130 0x560544d9c4e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc2f00ed5a0 tx=0x7fc2f00dcea0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 shutdown_connections 2024-05-09T09:47:42.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 --2- 172.21.15.157:0/614468317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544d95130 0x560544d9c4e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 >> 172.21.15.157:0/614468317 conn(0x560544d91540 msgr2=0x560544d8eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:42.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 shutdown_connections 2024-05-09T09:47:42.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 -- 172.21.15.157:0/614468317 wait complete. 2024-05-09T09:47:42.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 -- 172.21.15.157:0/1627882987 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc1d8034c00 msgr2=0x7fc1d80370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 --2- 172.21.15.157:0/1627882987 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc1d8034c00 0x7fc1d80370c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x560544d59b50 tx=0x7fc2f4006000 comp rx=0 tx=0).stop 2024-05-09T09:47:42.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 -- 172.21.15.157:0/1627882987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544d88250 msgr2=0x560544d88670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 --2- 172.21.15.157:0/1627882987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544d88250 0x560544d88670 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc2f00e3340 tx=0x7fc2f00c9a00 comp rx=0 tx=0).stop 2024-05-09T09:47:42.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 -- 172.21.15.157:0/1627882987 shutdown_connections 2024-05-09T09:47:42.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 --2- 172.21.15.157:0/1627882987 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc1d8034c00 0x7fc1d80370c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 --2- 172.21.15.157:0/1627882987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544d88250 0x560544d88670 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 -- 172.21.15.157:0/1627882987 >> 172.21.15.157:0/1627882987 conn(0x560544d7d020 msgr2=0x560544d7db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:42.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 -- 172.21.15.157:0/1627882987 shutdown_connections 2024-05-09T09:47:42.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 -- 172.21.15.157:0/1627882987 wait complete. 2024-05-09T09:47:42.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 -- 172.21.15.157:0/3420967328 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x7fc2e80022b0 msgr2=0x560544d5d9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 --2- 172.21.15.157:0/3420967328 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x7fc2e80022b0 0x560544d5d9c0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 -- 172.21.15.157:0/3420967328 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560544c5e270 msgr2=0x560544d59140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 --2- 172.21.15.157:0/3420967328 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560544c5e270 0x560544d59140 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 -- 172.21.15.157:0/3420967328 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560544d5f510 msgr2=0x560544d61900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 --2- 172.21.15.157:0/3420967328 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560544d5f510 0x560544d61900 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 -- 172.21.15.157:0/3420967328 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc1e4034c00 msgr2=0x7fc1e40370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 --2- 172.21.15.157:0/3420967328 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc1e4034c00 0x7fc1e40370c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4001000 tx=0x7fc2f4001190 comp rx=0 tx=0).stop 2024-05-09T09:47:42.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 -- 172.21.15.157:0/3420967328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544c5d950 msgr2=0x560544d52090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 --2- 172.21.15.157:0/3420967328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560544c5d950 0x560544d52090 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc2f001b9b0 tx=0x7fc2e8004130 comp rx=0 tx=0).stop 2024-05-09T09:47:42.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc2feb1b640 1 -- 172.21.15.157:0/3420967328 reap_dead start 2024-05-09T09:47:42.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 -- 172.21.15.157:0/3420967328 shutdown_connections 2024-05-09T09:47:42.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 -- 172.21.15.157:0/3420967328 >> 172.21.15.157:0/3420967328 conn(0x560544c59220 msgr2=0x560544bd2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:42.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 -- 172.21.15.157:0/3420967328 shutdown_connections 2024-05-09T09:47:42.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.515+0000 7fc3007ff980 1 -- 172.21.15.157:0/3420967328 wait complete. 2024-05-09T09:47:42.527 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-05-09T09:47:42.528 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-05-09T09:47:42.528 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-05-09T09:47:42.612 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:42.612 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:42.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.615+0000 7fc968022980 1 Processor -- start 2024-05-09T09:47:42.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.615+0000 7fc968022980 1 -- start start 2024-05-09T09:47:42.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.615+0000 7fc968022980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5602a7caf810 0x5602a7cafbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.615+0000 7fc968022980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5602a7b66440 con 0x5602a7cb0130 2024-05-09T09:47:42.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.615+0000 7fc968022980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5602a7b515f0 con 0x5602a7caf810 2024-05-09T09:47:42.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.615+0000 7fc965b3d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5602a7caf810 0x5602a7cafbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.615+0000 7fc965b3d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5602a7caf810 0x5602a7cafbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59518/0 (socket says 172.21.15.157:59518) 2024-05-09T09:47:42.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.615+0000 7fc965b3d640 1 -- 172.21.15.157:0/3100481267 learned_addr learned my addr 172.21.15.157:0/3100481267 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:42.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.615+0000 7fc95d33c640 1 --1- 172.21.15.157:0/3100481267 >> v1:172.21.15.110:6789/0 conn(0x5602a7cb0130 0x5602a7cb0b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:51792/0 (socket says 172.21.15.157:51792) 2024-05-09T09:47:42.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.615+0000 7fc965b3d640 1 -- 172.21.15.157:0/3100481267 >> v1:172.21.15.110:6789/0 conn(0x5602a7cb0130 legacy=0x5602a7cb0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.615+0000 7fc965b3d640 1 -- 172.21.15.157:0/3100481267 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602a7b5c990 con 0x5602a7caf810 2024-05-09T09:47:42.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.619+0000 7fc965b3d640 1 --2- 172.21.15.157:0/3100481267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7caf810 0x5602a7cafbf0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc95800a5c0 tx=0x7fc95801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b26263f7ed5bae server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.619+0000 7fc96533c640 1 -- 172.21.15.157:0/3100481267 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9580a6070 con 0x5602a7caf810 2024-05-09T09:47:42.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.619+0000 7fc96533c640 1 -- 172.21.15.157:0/3100481267 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9580af070 con 0x5602a7caf810 2024-05-09T09:47:42.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.619+0000 7fc96533c640 1 -- 172.21.15.157:0/3100481267 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9580aa5c0 con 0x5602a7caf810 2024-05-09T09:47:42.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.619+0000 7fc968022980 1 -- 172.21.15.157:0/3100481267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7caf810 msgr2=0x5602a7cafbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.619+0000 7fc968022980 1 --2- 172.21.15.157:0/3100481267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7caf810 0x5602a7cafbf0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc95800a5c0 tx=0x7fc95801b340 comp rx=0 tx=0).stop 2024-05-09T09:47:42.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.619+0000 7fc968022980 1 -- 172.21.15.157:0/3100481267 shutdown_connections 2024-05-09T09:47:42.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.619+0000 7fc968022980 1 --2- 172.21.15.157:0/3100481267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7caf810 0x5602a7cafbf0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.619+0000 7fc968022980 1 -- 172.21.15.157:0/3100481267 >> 172.21.15.157:0/3100481267 conn(0x5602a7cab0e0 msgr2=0x5602a7cad500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:42.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.619+0000 7fc968022980 1 -- 172.21.15.157:0/3100481267 shutdown_connections 2024-05-09T09:47:42.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.619+0000 7fc968022980 1 -- 172.21.15.157:0/3100481267 wait complete. 2024-05-09T09:47:42.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.631+0000 7fc968022980 1 Processor -- start 2024-05-09T09:47:42.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.631+0000 7fc968022980 1 -- start start 2024-05-09T09:47:42.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.631+0000 7fc968022980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7caf810 0x5602a7d9b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.631+0000 7fc968022980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5602a7bb3fe0 con 0x5602a7caf810 2024-05-09T09:47:42.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.631+0000 7fc965b3d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7caf810 0x5602a7d9b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.635+0000 7fc965b3d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7caf810 0x5602a7d9b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59524/0 (socket says 172.21.15.157:59524) 2024-05-09T09:47:42.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.635+0000 7fc965b3d640 1 -- 172.21.15.157:0/874740143 learned_addr learned my addr 172.21.15.157:0/874740143 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:42.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.635+0000 7fc965b3d640 1 -- 172.21.15.157:0/874740143 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602a7b38ae0 con 0x5602a7caf810 2024-05-09T09:47:42.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.635+0000 7fc965b3d640 1 --2- 172.21.15.157:0/874740143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7caf810 0x5602a7d9b140 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc958018f70 tx=0x7fc9580a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e27199ed96a779a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.635+0000 7fc853e07640 1 -- 172.21.15.157:0/874740143 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9580c3070 con 0x5602a7caf810 2024-05-09T09:47:42.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.635+0000 7fc853e07640 1 -- 172.21.15.157:0/874740143 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9580b4b00 con 0x5602a7caf810 2024-05-09T09:47:42.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.635+0000 7fc853e07640 1 -- 172.21.15.157:0/874740143 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9580b4de0 con 0x5602a7caf810 2024-05-09T09:47:42.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.635+0000 7fc968022980 1 -- 172.21.15.157:0/874740143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7caf810 msgr2=0x5602a7d9b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.635+0000 7fc968022980 1 --2- 172.21.15.157:0/874740143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7caf810 0x5602a7d9b140 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc958018f70 tx=0x7fc9580a6000 comp rx=0 tx=0).stop 2024-05-09T09:47:42.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.635+0000 7fc968022980 1 -- 172.21.15.157:0/874740143 shutdown_connections 2024-05-09T09:47:42.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.635+0000 7fc968022980 1 --2- 172.21.15.157:0/874740143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7caf810 0x5602a7d9b140 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.635+0000 7fc968022980 1 -- 172.21.15.157:0/874740143 >> 172.21.15.157:0/874740143 conn(0x5602a7cab0e0 msgr2=0x5602a7d96cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:42.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.635+0000 7fc968022980 1 -- 172.21.15.157:0/874740143 shutdown_connections 2024-05-09T09:47:42.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.635+0000 7fc968022980 1 -- 172.21.15.157:0/874740143 wait complete. 2024-05-09T09:47:42.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.635+0000 7fc968022980 1 Processor -- start 2024-05-09T09:47:42.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.635+0000 7fc968022980 1 -- start start 2024-05-09T09:47:42.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.635+0000 7fc968022980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7caf810 0x5602a7da1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.635+0000 7fc968022980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5602a7cb98b0 con 0x5602a7caf810 2024-05-09T09:47:42.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.635+0000 7fc965b3d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7caf810 0x5602a7da1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.635+0000 7fc965b3d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7caf810 0x5602a7da1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59528/0 (socket says 172.21.15.157:59528) 2024-05-09T09:47:42.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.635+0000 7fc965b3d640 1 -- 172.21.15.157:0/2168893916 learned_addr learned my addr 172.21.15.157:0/2168893916 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:42.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.635+0000 7fc965b3d640 1 -- 172.21.15.157:0/2168893916 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602a7da1770 con 0x5602a7caf810 2024-05-09T09:47:42.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.635+0000 7fc965b3d640 1 --2- 172.21.15.157:0/2168893916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7caf810 0x5602a7da1230 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc958018f70 tx=0x7fc9580180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.635+0000 7fc852604640 1 -- 172.21.15.157:0/2168893916 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9580c3040 con 0x5602a7caf810 2024-05-09T09:47:42.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.635+0000 7fc968022980 1 -- 172.21.15.157:0/2168893916 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5602a7da1a00 con 0x5602a7caf810 2024-05-09T09:47:42.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.635+0000 7fc852604640 1 -- 172.21.15.157:0/2168893916 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9580b4cb0 con 0x5602a7caf810 2024-05-09T09:47:42.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.635+0000 7fc852604640 1 -- 172.21.15.157:0/2168893916 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9580a3f00 con 0x5602a7caf810 2024-05-09T09:47:42.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.639+0000 7fc968022980 1 -- 172.21.15.157:0/2168893916 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602a7da4690 con 0x5602a7caf810 2024-05-09T09:47:42.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.639+0000 7fc852604640 1 -- 172.21.15.157:0/2168893916 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fc9580be410 con 0x5602a7caf810 2024-05-09T09:47:42.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.639+0000 7fc852604640 1 --2- 172.21.15.157:0/2168893916 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc84c034bb0 0x7fc84c037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.639+0000 7fc852604640 1 -- 172.21.15.157:0/2168893916 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fc9580bb070 con 0x5602a7caf810 2024-05-09T09:47:42.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.639+0000 7fc95d33c640 1 --2- 172.21.15.157:0/2168893916 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc84c034bb0 0x7fc84c037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.639+0000 7fc968022980 1 --2- 172.21.15.157:0/2168893916 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5602a7cb0130 0x5602a7da8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.639+0000 7fc968022980 1 -- 172.21.15.157:0/2168893916 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602a7da87c0 con 0x5602a7cb0130 2024-05-09T09:47:42.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.639+0000 7fc96633e640 1 --2- 172.21.15.157:0/2168893916 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5602a7cb0130 0x5602a7da8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.639+0000 7fc95d33c640 1 --2- 172.21.15.157:0/2168893916 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc84c034bb0 0x7fc84c037070 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc950000f70 tx=0x7fc950001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.639+0000 7fc96633e640 1 --2- 172.21.15.157:0/2168893916 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5602a7cb0130 0x5602a7da8170 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.639+0000 7fc96633e640 1 -- 172.21.15.157:0/2168893916 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7cb0130 2024-05-09T09:47:42.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.639+0000 7fc968022980 1 -- 172.21.15.157:0/2168893916 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602a7da5890 con 0x5602a7cb0130 2024-05-09T09:47:42.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.639+0000 7fc96633e640 1 -- 172.21.15.157:0/2168893916 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7cb0130 2024-05-09T09:47:42.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.639+0000 7fc968022980 1 --2- 172.21.15.157:0/2168893916 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602a7daab40 0x5602a7dacf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.639+0000 7fc968022980 1 -- 172.21.15.157:0/2168893916 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dad600 con 0x5602a7daab40 2024-05-09T09:47:42.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.639+0000 7fc965b3d640 1 --2- 172.21.15.157:0/2168893916 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602a7daab40 0x5602a7dacf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.639+0000 7fc965b3d640 1 --2- 172.21.15.157:0/2168893916 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602a7daab40 0x5602a7dacf30 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.643+0000 7fc965b3d640 1 -- 172.21.15.157:0/2168893916 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7daab40 2024-05-09T09:47:42.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.643+0000 7fc968022980 1 -- 172.21.15.157:0/2168893916 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602a7da99e0 con 0x5602a7cb0130 2024-05-09T09:47:42.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.643+0000 7fc96633e640 1 -- 172.21.15.157:0/2168893916 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7cb0130 2024-05-09T09:47:42.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.643+0000 7fc968022980 1 --2- 172.21.15.157:0/2168893916 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5602a7daea60 0x5602a7db0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.643+0000 7fc968022980 1 -- 172.21.15.157:0/2168893916 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602a7db1550 con 0x5602a7daea60 2024-05-09T09:47:42.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.643+0000 7fc95d33c640 1 --2- 172.21.15.157:0/2168893916 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5602a7daea60 0x5602a7db0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.643+0000 7fc95d33c640 1 --2- 172.21.15.157:0/2168893916 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5602a7daea60 0x5602a7db0e50 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.643+0000 7fc95d33c640 1 -- 172.21.15.157:0/2168893916 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc95000f6a0 con 0x5602a7daea60 2024-05-09T09:47:42.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.647+0000 7fc968022980 1 Processor -- start 2024-05-09T09:47:42.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.647+0000 7fc968022980 1 -- start start 2024-05-09T09:47:42.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.647+0000 7fc968022980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7ddb850 0x5602a7ddbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.647+0000 7fc968022980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5602a7bb8020 con 0x5602a7ddb850 2024-05-09T09:47:42.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.647+0000 7fc965b3d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7ddb850 0x5602a7ddbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.647+0000 7fc965b3d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7ddb850 0x5602a7ddbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59538/0 (socket says 172.21.15.157:59538) 2024-05-09T09:47:42.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.647+0000 7fc965b3d640 1 -- 172.21.15.157:0/4068126001 learned_addr learned my addr 172.21.15.157:0/4068126001 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:42.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.647+0000 7fc965b3d640 1 -- 172.21.15.157:0/4068126001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602a7ddc1b0 con 0x5602a7ddb850 2024-05-09T09:47:42.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.647+0000 7fc965b3d640 1 --2- 172.21.15.157:0/4068126001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7ddb850 0x5602a7ddbc70 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc9580e5d80 tx=0x7fc9580bea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.647+0000 7fc84a3a1640 1 -- 172.21.15.157:0/4068126001 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9580b4070 con 0x5602a7ddb850 2024-05-09T09:47:42.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.647+0000 7fc968022980 1 -- 172.21.15.157:0/4068126001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5602a7ddc1b0 con 0x5602a7ddb850 2024-05-09T09:47:42.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.647+0000 7fc84a3a1640 1 -- 172.21.15.157:0/4068126001 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9580b4210 con 0x5602a7ddb850 2024-05-09T09:47:42.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.647+0000 7fc84a3a1640 1 -- 172.21.15.157:0/4068126001 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9580e7aa0 con 0x5602a7ddb850 2024-05-09T09:47:42.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.647+0000 7fc968022980 1 -- 172.21.15.157:0/4068126001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602a7ddce30 con 0x5602a7ddb850 2024-05-09T09:47:42.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.651+0000 7fc84a3a1640 1 -- 172.21.15.157:0/4068126001 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fc9580e7c40 con 0x5602a7ddb850 2024-05-09T09:47:42.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.651+0000 7fc84a3a1640 1 --2- 172.21.15.157:0/4068126001 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc840034bb0 0x7fc840037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.651+0000 7fc84a3a1640 1 -- 172.21.15.157:0/4068126001 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fc9580e90c0 con 0x5602a7ddb850 2024-05-09T09:47:42.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.651+0000 7fc95d33c640 1 --2- 172.21.15.157:0/4068126001 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc840034bb0 0x7fc840037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.651+0000 7fc968022980 1 Processor -- start 2024-05-09T09:47:42.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.651+0000 7fc968022980 1 -- start start 2024-05-09T09:47:42.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.651+0000 7fc95d33c640 1 --2- 172.21.15.157:0/4068126001 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc840034bb0 0x7fc840037070 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x5602a7da90f0 tx=0x7fc95000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.651+0000 7fc968022980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7de8490 0x5602a7de88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.651+0000 7fc968022980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5602a7d9b830 con 0x5602a7de8490 2024-05-09T09:47:42.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.651+0000 7fc965b3d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7de8490 0x5602a7de88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.651+0000 7fc965b3d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7de8490 0x5602a7de88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59548/0 (socket says 172.21.15.157:59548) 2024-05-09T09:47:42.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.651+0000 7fc965b3d640 1 -- 172.21.15.157:0/1440434298 learned_addr learned my addr 172.21.15.157:0/1440434298 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:42.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.651+0000 7fc965b3d640 1 -- 172.21.15.157:0/1440434298 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602a7de8e80 con 0x5602a7de8490 2024-05-09T09:47:42.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.651+0000 7fc965b3d640 1 --2- 172.21.15.157:0/1440434298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7de8490 0x5602a7de88b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc958002670 tx=0x7fc958002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f5480cb0c73e0d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.651+0000 7fc837fff640 1 -- 172.21.15.157:0/1440434298 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9580e5950 con 0x5602a7de8490 2024-05-09T09:47:42.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.651+0000 7fc837fff640 1 -- 172.21.15.157:0/1440434298 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9580dd0c0 con 0x5602a7de8490 2024-05-09T09:47:42.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.651+0000 7fc837fff640 1 -- 172.21.15.157:0/1440434298 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9580e5af0 con 0x5602a7de8490 2024-05-09T09:47:42.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.651+0000 7fc968022980 1 -- 172.21.15.157:0/1440434298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7de8490 msgr2=0x5602a7de88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.651+0000 7fc968022980 1 --2- 172.21.15.157:0/1440434298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7de8490 0x5602a7de88b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc958002670 tx=0x7fc958002760 comp rx=0 tx=0).stop 2024-05-09T09:47:42.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.651+0000 7fc968022980 1 -- 172.21.15.157:0/1440434298 shutdown_connections 2024-05-09T09:47:42.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.651+0000 7fc968022980 1 --2- 172.21.15.157:0/1440434298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7de8490 0x5602a7de88b0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.651+0000 7fc968022980 1 -- 172.21.15.157:0/1440434298 >> 172.21.15.157:0/1440434298 conn(0x5602a7de4810 msgr2=0x5602a7de2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:42.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.651+0000 7fc968022980 1 -- 172.21.15.157:0/1440434298 shutdown_connections 2024-05-09T09:47:42.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.651+0000 7fc968022980 1 -- 172.21.15.157:0/1440434298 wait complete. 2024-05-09T09:47:42.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.651+0000 7fc968022980 1 Processor -- start 2024-05-09T09:47:42.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.651+0000 7fc968022980 1 -- start start 2024-05-09T09:47:42.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.651+0000 7fc968022980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7de8490 0x5602a7def7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.651+0000 7fc968022980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5602a7de9400 con 0x5602a7de8490 2024-05-09T09:47:42.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.655+0000 7fc965b3d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7de8490 0x5602a7def7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.655+0000 7fc965b3d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7de8490 0x5602a7def7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59560/0 (socket says 172.21.15.157:59560) 2024-05-09T09:47:42.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.655+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 learned_addr learned my addr 172.21.15.157:0/660210728 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:42.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.655+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602a7defd10 con 0x5602a7de8490 2024-05-09T09:47:42.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.655+0000 7fc965b3d640 1 --2- 172.21.15.157:0/660210728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7de8490 0x5602a7def7d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc958002dd0 tx=0x7fc9580edf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.655+0000 7fc8367fc640 1 -- 172.21.15.157:0/660210728 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9580c6780 con 0x5602a7de8490 2024-05-09T09:47:42.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.655+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5602a7defd10 con 0x5602a7de8490 2024-05-09T09:47:42.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.655+0000 7fc8367fc640 1 -- 172.21.15.157:0/660210728 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9580c6920 con 0x5602a7de8490 2024-05-09T09:47:42.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.655+0000 7fc8367fc640 1 -- 172.21.15.157:0/660210728 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9580c6c20 con 0x5602a7de8490 2024-05-09T09:47:42.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.655+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602a7df0190 con 0x5602a7de8490 2024-05-09T09:47:42.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.655+0000 7fc8367fc640 1 -- 172.21.15.157:0/660210728 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fc958114020 con 0x5602a7de8490 2024-05-09T09:47:42.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.655+0000 7fc8367fc640 1 --2- 172.21.15.157:0/660210728 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc830034bb0 0x7fc830037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.655+0000 7fc8367fc640 1 -- 172.21.15.157:0/660210728 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fc958112020 con 0x5602a7de8490 2024-05-09T09:47:42.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.655+0000 7fc968022980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.655+0000 7fc95d33c640 1 --2- 172.21.15.157:0/660210728 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc830034bb0 0x7fc830037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.655+0000 7fc968022980 1 --2- 172.21.15.157:0/660210728 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5602a7dfc360 0x5602a7dfe820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.655+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dfef70 con 0x5602a7dfc360 2024-05-09T09:47:42.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.655+0000 7fc96633e640 1 --2- 172.21.15.157:0/660210728 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5602a7dfc360 0x5602a7dfe820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.655+0000 7fc95d33c640 1 --2- 172.21.15.157:0/660210728 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc830034bb0 0x7fc830037070 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc95000ffd0 tx=0x7fc950010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.655+0000 7fc96633e640 1 --2- 172.21.15.157:0/660210728 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5602a7dfc360 0x5602a7dfe820 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.655+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.655+0000 7fc968022980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:42.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.655+0000 7fc968022980 20 realm 2024-05-09T09:47:42.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.655+0000 7fc968022980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.655+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dff380 con 0x5602a7dfc360 2024-05-09T09:47:42.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.655+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.655+0000 7fc968022980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:42.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.655+0000 7fc968022980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:42.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.655+0000 7fc968022980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.659+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffc50 con 0x5602a7dfc360 2024-05-09T09:47:42.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.659+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.659+0000 7fc968022980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:42.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.659+0000 7fc968022980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.659+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x5602a7dfc360 2024-05-09T09:47:42.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.659+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.659+0000 7fc968022980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:42.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.659+0000 7fc968022980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.659+0000 7fc968022980 1 --2- 172.21.15.157:0/660210728 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602a7e00d50 0x5602a7e03140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.659+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e03750 con 0x5602a7e00d50 2024-05-09T09:47:42.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.659+0000 7fc965b3d640 1 --2- 172.21.15.157:0/660210728 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602a7e00d50 0x5602a7e03140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.659+0000 7fc965b3d640 1 --2- 172.21.15.157:0/660210728 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602a7e00d50 0x5602a7e03140 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.659+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.659+0000 7fc968022980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:42.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.659+0000 7fc968022980 20 searching for the correct realm 2024-05-09T09:47:42.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.659+0000 7fc968022980 1 --2- 172.21.15.157:0/660210728 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5602a7e056a0 0x5602a7e07ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.659+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e08130 con 0x5602a7e056a0 2024-05-09T09:47:42.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.659+0000 7fc95d33c640 1 --2- 172.21.15.157:0/660210728 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5602a7e056a0 0x5602a7e07ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.659+0000 7fc95d33c640 1 --2- 172.21.15.157:0/660210728 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5602a7e056a0 0x5602a7e07ab0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.659+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc950037040 con 0x5602a7e056a0 2024-05-09T09:47:42.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.659+0000 7fc95d33c640 1 --2- 172.21.15.157:0/660210728 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fc95001fbe0 0x7fc95003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.659+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e08130 con 0x7fc95001fbe0 2024-05-09T09:47:42.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.659+0000 7fc96633e640 1 --2- 172.21.15.157:0/660210728 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fc95001fbe0 0x7fc95003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.663+0000 7fc96633e640 1 --2- 172.21.15.157:0/660210728 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fc95001fbe0 0x7fc95003a3c0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.663+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc96000a4d0 con 0x7fc95001fbe0 2024-05-09T09:47:42.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.663+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x5602a7e00d50 2024-05-09T09:47:42.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.663+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.663+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x5602a7dfc360 2024-05-09T09:47:42.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.663+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.663+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x5602a7dfc360 2024-05-09T09:47:42.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.663+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.663+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x5602a7e00d50 2024-05-09T09:47:42.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.663+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.663+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x5602a7e00d50 2024-05-09T09:47:42.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.663+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.663+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x7fc95001fbe0 2024-05-09T09:47:42.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.663+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc96000a4d0 con 0x7fc95001fbe0 2024-05-09T09:47:42.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.663+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x5602a7e056a0 2024-05-09T09:47:42.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.663+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc950037040 con 0x5602a7e056a0 2024-05-09T09:47:42.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.663+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x5602a7dfc360 2024-05-09T09:47:42.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.663+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.663+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x5602a7e00d50 2024-05-09T09:47:42.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.667+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.667+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x5602a7dfc360 2024-05-09T09:47:42.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.667+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.667+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x7fc95001fbe0 2024-05-09T09:47:42.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.667+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc96000a4d0 con 0x7fc95001fbe0 2024-05-09T09:47:42.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.667+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x5602a7e056a0 2024-05-09T09:47:42.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.667+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc950037040 con 0x5602a7e056a0 2024-05-09T09:47:42.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.667+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x5602a7e056a0 2024-05-09T09:47:42.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.667+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc950037040 con 0x5602a7e056a0 2024-05-09T09:47:42.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.667+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x5602a7e00d50 2024-05-09T09:47:42.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.667+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.667+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x5602a7e056a0 2024-05-09T09:47:42.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.667+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc950037040 con 0x5602a7e056a0 2024-05-09T09:47:42.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.667+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x5602a7e056a0 2024-05-09T09:47:42.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.667+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc950037040 con 0x5602a7e056a0 2024-05-09T09:47:42.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.667+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x5602a7dfc360 2024-05-09T09:47:42.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.667+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.667+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x5602a7dfc360 2024-05-09T09:47:42.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.667+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.667+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x5602a7e00d50 2024-05-09T09:47:42.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.671+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.671+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x5602a7e056a0 2024-05-09T09:47:42.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.671+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc950037040 con 0x5602a7e056a0 2024-05-09T09:47:42.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.671+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x7fc95001fbe0 2024-05-09T09:47:42.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.671+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc96000a4d0 con 0x7fc95001fbe0 2024-05-09T09:47:42.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.671+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x5602a7dfc360 2024-05-09T09:47:42.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.671+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.671+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x5602a7e00d50 2024-05-09T09:47:42.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.671+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.671+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x5602a7e056a0 2024-05-09T09:47:42.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.671+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc950037040 con 0x5602a7e056a0 2024-05-09T09:47:42.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.671+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x5602a7e00d50 2024-05-09T09:47:42.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.671+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.671+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x7fc95001fbe0 2024-05-09T09:47:42.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.671+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc96000a4d0 con 0x7fc95001fbe0 2024-05-09T09:47:42.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.671+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x5602a7e056a0 2024-05-09T09:47:42.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.671+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc950049040 con 0x5602a7e056a0 2024-05-09T09:47:42.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.671+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x5602a7e00d50 2024-05-09T09:47:42.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x5602a7dfc360 2024-05-09T09:47:42.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5602a7dffff0 con 0x7fc95001fbe0 2024-05-09T09:47:42.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc96000a4d0 con 0x7fc95001fbe0 2024-05-09T09:47:42.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:42.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:42.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:42.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:42.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:42.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:42.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e04010 con 0x5602a7dfc360 2024-05-09T09:47:42.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:42.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e04010 con 0x5602a7dfc360 2024-05-09T09:47:42.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:42.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e04010 con 0x5602a7e056a0 2024-05-09T09:47:42.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc950049040 con 0x5602a7e056a0 2024-05-09T09:47:42.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:42.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 20 zone default found 2024-05-09T09:47:42.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 4 Realm: () 2024-05-09T09:47:42.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:42.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:42.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:42.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 20 zonegroup default 2024-05-09T09:47:42.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e04a30 con 0x5602a7e00d50 2024-05-09T09:47:42.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:42.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e0a440 con 0x5602a7e056a0 2024-05-09T09:47:42.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc950049040 con 0x5602a7e056a0 2024-05-09T09:47:42.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:42.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e0a7e0 con 0x5602a7e056a0 2024-05-09T09:47:42.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc950049040 con 0x5602a7e056a0 2024-05-09T09:47:42.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:42.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 20 started sync module instance, tier type = 2024-05-09T09:47:42.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:42.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e09880 con 0x7fc95001fbe0 2024-05-09T09:47:42.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x7fc95001fbe0 2024-05-09T09:47:42.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94569406438512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e09880 con 0x7fc95001fbe0 2024-05-09T09:47:42.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.675+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e0b030 con 0x5602a7dfc360 2024-05-09T09:47:42.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.679+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94569406438512] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x7fc95001fbe0 2024-05-09T09:47:42.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.679+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.679+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94569406442672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e09880 con 0x5602a7dfc360 2024-05-09T09:47:42.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.679+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e0ba40 con 0x5602a7e056a0 2024-05-09T09:47:42.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.679+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc950049040 con 0x5602a7e056a0 2024-05-09T09:47:42.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.679+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94569406444944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e0c290 con 0x5602a7e056a0 2024-05-09T09:47:42.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.679+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e0ccb0 con 0x7fc95001fbe0 2024-05-09T09:47:42.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.683+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94569406442672] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.683+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x7fc95001fbe0 2024-05-09T09:47:42.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.683+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94569406449568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e0d0a0 con 0x7fc95001fbe0 2024-05-09T09:47:42.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.683+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e0da60 con 0x5602a7dfc360 2024-05-09T09:47:42.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.683+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94569406444944] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc950049040 con 0x5602a7e056a0 2024-05-09T09:47:42.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.683+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94569406449568] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x7fc95001fbe0 2024-05-09T09:47:42.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.683+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.683+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94569406436304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e0d5b0 con 0x5602a7dfc360 2024-05-09T09:47:42.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.683+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e0de00 con 0x5602a7e00d50 2024-05-09T09:47:42.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.687+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94569406436304] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.687+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.687+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94569406453168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e0e1f0 con 0x5602a7e00d50 2024-05-09T09:47:42.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.687+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e0ea40 con 0x5602a7e00d50 2024-05-09T09:47:42.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.687+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.687+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94569406456304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e0eb80 con 0x5602a7e00d50 2024-05-09T09:47:42.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.687+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e0f680 con 0x5602a7e00d50 2024-05-09T09:47:42.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.687+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94569406453168] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.691+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94569406456304] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.691+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.691+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94569406460272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e0e610 con 0x5602a7e00d50 2024-05-09T09:47:42.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.691+0000 7fc968022980 20 add_watcher() i=0 2024-05-09T09:47:42.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.691+0000 7fc968022980 20 add_watcher() i=1 2024-05-09T09:47:42.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.691+0000 7fc968022980 20 add_watcher() i=2 2024-05-09T09:47:42.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.691+0000 7fc968022980 20 add_watcher() i=3 2024-05-09T09:47:42.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.691+0000 7fc968022980 20 add_watcher() i=4 2024-05-09T09:47:42.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.691+0000 7fc968022980 20 add_watcher() i=5 2024-05-09T09:47:42.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.691+0000 7fc968022980 20 add_watcher() i=6 2024-05-09T09:47:42.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.691+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94569406460272] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.691+0000 7fc968022980 20 add_watcher() i=7 2024-05-09T09:47:42.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.691+0000 7fc968022980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:42.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.691+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e12670 con 0x5602a7dfc360 2024-05-09T09:47:42.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.691+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.691+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94569406454224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e0faf0 con 0x5602a7dfc360 2024-05-09T09:47:42.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.695+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94569406454224] v30'254 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.695+0000 7fc81afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:42.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.695+0000 7fc968022980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:42.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.695+0000 7fc968022980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:42.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.695+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1af10 con 0x5602a7dfc360 2024-05-09T09:47:42.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.695+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'62 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.695+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1b560 con 0x5602a7e00d50 2024-05-09T09:47:42.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.699+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'57 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.699+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1b9c0 con 0x5602a7e056a0 2024-05-09T09:47:42.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.699+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'56 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc950049040 con 0x5602a7e056a0 2024-05-09T09:47:42.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.699+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1aa40 con 0x5602a7dfc360 2024-05-09T09:47:42.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.699+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'255 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.699+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1c440 con 0x7fc95001fbe0 2024-05-09T09:47:42.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.699+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'158 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x7fc95001fbe0 2024-05-09T09:47:42.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.699+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1c9b0 con 0x5602a7e056a0 2024-05-09T09:47:42.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.703+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'106 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc950049040 con 0x5602a7e056a0 2024-05-09T09:47:42.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.703+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1cf20 con 0x5602a7dfc360 2024-05-09T09:47:42.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.703+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'58 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.703+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1cfb0 con 0x5602a7e00d50 2024-05-09T09:47:42.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.707+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'105 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.707+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1d040 con 0x7fc95001fbe0 2024-05-09T09:47:42.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.707+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'56 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x7fc95001fbe0 2024-05-09T09:47:42.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.707+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1d170 con 0x5602a7e056a0 2024-05-09T09:47:42.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.711+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'62 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc950049040 con 0x5602a7e056a0 2024-05-09T09:47:42.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.711+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1d670 con 0x7fc95001fbe0 2024-05-09T09:47:42.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.711+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'159 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x7fc95001fbe0 2024-05-09T09:47:42.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.711+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1d670 con 0x5602a7e00d50 2024-05-09T09:47:42.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.711+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'58 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.711+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1d670 con 0x7fc95001fbe0 2024-05-09T09:47:42.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.715+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'56 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x7fc95001fbe0 2024-05-09T09:47:42.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.715+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1d700 con 0x5602a7e00d50 2024-05-09T09:47:42.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.715+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'111 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.719+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1d790 con 0x5602a7dfc360 2024-05-09T09:47:42.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.719+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'256 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.719+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1d790 con 0x5602a7e056a0 2024-05-09T09:47:42.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.719+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'152 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc950049040 con 0x5602a7e056a0 2024-05-09T09:47:42.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.719+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1d880 con 0x7fc95001fbe0 2024-05-09T09:47:42.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.723+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'160 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x7fc95001fbe0 2024-05-09T09:47:42.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.723+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1d880 con 0x5602a7e056a0 2024-05-09T09:47:42.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.723+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'56 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc950049040 con 0x5602a7e056a0 2024-05-09T09:47:42.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.723+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1d910 con 0x5602a7dfc360 2024-05-09T09:47:42.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.723+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'64 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.723+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1d910 con 0x5602a7dfc360 2024-05-09T09:47:42.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.727+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'257 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.727+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1d8b0 con 0x5602a7e056a0 2024-05-09T09:47:42.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.727+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'153 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc950049040 con 0x5602a7e056a0 2024-05-09T09:47:42.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.727+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1d8b0 con 0x7fc95001fbe0 2024-05-09T09:47:42.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.731+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'66 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x7fc95001fbe0 2024-05-09T09:47:42.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.731+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1d820 con 0x5602a7e056a0 2024-05-09T09:47:42.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.731+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'58 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc950049040 con 0x5602a7e056a0 2024-05-09T09:47:42.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.731+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1d820 con 0x5602a7e056a0 2024-05-09T09:47:42.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.731+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'62 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc950049040 con 0x5602a7e056a0 2024-05-09T09:47:42.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.731+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1d820 con 0x5602a7e056a0 2024-05-09T09:47:42.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.731+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'52 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc950049040 con 0x5602a7e056a0 2024-05-09T09:47:42.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.731+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1d820 con 0x5602a7e056a0 2024-05-09T09:47:42.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.735+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'107 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc950049040 con 0x5602a7e056a0 2024-05-09T09:47:42.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.735+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1d820 con 0x5602a7e00d50 2024-05-09T09:47:42.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.735+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'58 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.735+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1d820 con 0x5602a7e056a0 2024-05-09T09:47:42.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.739+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'56 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc950049040 con 0x5602a7e056a0 2024-05-09T09:47:42.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.739+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1d820 con 0x5602a7e00d50 2024-05-09T09:47:42.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.739+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'106 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.739+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1d820 con 0x5602a7e056a0 2024-05-09T09:47:42.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.743+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'154 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc950049040 con 0x5602a7e056a0 2024-05-09T09:47:42.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.743+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1d820 con 0x5602a7e00d50 2024-05-09T09:47:42.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.747+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'112 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.747+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e1d820 con 0x7fc95001fbe0 2024-05-09T09:47:42.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.747+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'62 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x7fc95001fbe0 2024-05-09T09:47:42.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.751+0000 7fc819fe3640 20 reqs_thread_entry: start 2024-05-09T09:47:42.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.751+0000 7fc968022980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:42.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.751+0000 7fc78b7fe640 20 reqs_thread_entry: start 2024-05-09T09:47:42.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.751+0000 7fc968022980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-05-09T09:47:42.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.751+0000 7fc968022980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.751+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e395e0 con 0x5602a7e00d50 2024-05-09T09:47:42.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.751+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.751+0000 7fc968022980 20 rados_obj.operate() r=0 bl.length=419 2024-05-09T09:47:42.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.751+0000 7fc968022980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-05-09T09:47:42.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.751+0000 7fc968022980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-09T09:47:42.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.751+0000 7fc968022980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:42.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.751+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e3bb00 con 0x5602a7dfc360 2024-05-09T09:47:42.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.751+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.751+0000 7fc968022980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-05-09T09:47:42.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.751+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e39ae0 con 0x5602a7e00d50 2024-05-09T09:47:42.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.755+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v30'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.755+0000 7fc968022980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-09T09:47:42.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.755+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94569406632992 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e3c150 con 0x5602a7e056a0 2024-05-09T09:47:42.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.755+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== watch-notify(notify (1) cookie 94569406444944 notify 128849018885 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5602a7e1c9b0 con 0x5602a7e056a0 2024-05-09T09:47:42.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.755+0000 7fc837fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94569406444944 notifier 4573 bl.length()=170 2024-05-09T09:47:42.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.755+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(97 notify.2 [notify cookie 94569406632992 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc950049040 con 0x5602a7e056a0 2024-05-09T09:47:42.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.755+0000 7fc837fff640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fc828005580 con 0x5602a7e056a0 2024-05-09T09:47:42.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.755+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== watch-notify(notify_complete (2) cookie 94569406632992 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5602a7e1cd50 con 0x5602a7e056a0 2024-05-09T09:47:42.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.755+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 30 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc950049040 con 0x5602a7e056a0 2024-05-09T09:47:42.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.755+0000 7fc968022980 10 removing email index: 2024-05-09T09:47:42.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.755+0000 7fc968022980 10 removing user buckets index 2024-05-09T09:47:42.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.755+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e3c0d0 con 0x5602a7dfc360 2024-05-09T09:47:42.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.755+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v30'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.755+0000 7fc968022980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-05-09T09:47:42.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.755+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94569406644432 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e39420 con 0x5602a7dfc360 2024-05-09T09:47:42.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.755+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== watch-notify(notify (1) cookie 94569406436304 notify 128849018899 ret 0) ==== 217+0+0 (crc 0 0 0) 0x5602a7e1cb80 con 0x5602a7dfc360 2024-05-09T09:47:42.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.755+0000 7fc8377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018899 cookie 94569406436304 notifier 4573 bl.length()=175 2024-05-09T09:47:42.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.755+0000 7fc8377fe640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fc798003930 con 0x5602a7dfc360 2024-05-09T09:47:42.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.755+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(100 notify.4 [notify cookie 94569406644432 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.755+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== watch-notify(notify_complete (2) cookie 94569406644432 notify 128849018899 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5602a7e1c7e0 con 0x5602a7dfc360 2024-05-09T09:47:42.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.755+0000 7fc968022980 10 removing user index: testx$tenanteduser 2024-05-09T09:47:42.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.755+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.755+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e3c0d0 con 0x5602a7e00d50 2024-05-09T09:47:42.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.759+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v30'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.759+0000 7fc968022980 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-05-09T09:47:42.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.759+0000 7fc968022980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-05-09T09:47:42.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.759+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94569406644432 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e3aaf0 con 0x7fc95001fbe0 2024-05-09T09:47:42.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.759+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== watch-notify(notify (1) cookie 94569406449568 notify 128849018893 ret 0) ==== 209+0+0 (crc 0 0 0) 0x5602a7e1c7e0 con 0x7fc95001fbe0 2024-05-09T09:47:42.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.759+0000 7fc837fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 94569406449568 notifier 4573 bl.length()=167 2024-05-09T09:47:42.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.759+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(103 notify.3 [notify cookie 94569406644432 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc96000a4d0 con 0x7fc95001fbe0 2024-05-09T09:47:42.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.759+0000 7fc837fff640 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fc828005580 con 0x7fc95001fbe0 2024-05-09T09:47:42.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.759+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x7fc95001fbe0 2024-05-09T09:47:42.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.759+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== watch-notify(notify_complete (2) cookie 94569406644432 notify 128849018893 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5602a7e1aa40 con 0x7fc95001fbe0 2024-05-09T09:47:42.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.759+0000 7fc81afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:42.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.759+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94569406454224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e3c0d0 con 0x5602a7dfc360 2024-05-09T09:47:42.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.763+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94569406454224] v30'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.763+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94569406438512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e3c0d0 con 0x7fc95001fbe0 2024-05-09T09:47:42.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.763+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94569406438512] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x7fc95001fbe0 2024-05-09T09:47:42.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.763+0000 7fc968022980 20 remove_watcher() i=0 2024-05-09T09:47:42.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.763+0000 7fc968022980 2 removed watcher, disabling cache 2024-05-09T09:47:42.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.763+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94569406442672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e09c70 con 0x5602a7dfc360 2024-05-09T09:47:42.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.763+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94569406442672] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.763+0000 7fc968022980 20 remove_watcher() i=1 2024-05-09T09:47:42.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.763+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94569406444944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e3c0d0 con 0x5602a7e056a0 2024-05-09T09:47:42.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.767+0000 7fc95d33c640 1 -- 172.21.15.157:0/660210728 <== osd.3 v2:172.21.15.157:6816/2487336710 31 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94569406444944] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc950049040 con 0x5602a7e056a0 2024-05-09T09:47:42.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.767+0000 7fc968022980 20 remove_watcher() i=2 2024-05-09T09:47:42.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.767+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94569406449568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e09c70 con 0x7fc95001fbe0 2024-05-09T09:47:42.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.767+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.2 v2:172.21.15.157:6800/354455204 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94569406449568] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x7fc95001fbe0 2024-05-09T09:47:42.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.767+0000 7fc968022980 20 remove_watcher() i=3 2024-05-09T09:47:42.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.767+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94569406436304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e3c0d0 con 0x5602a7dfc360 2024-05-09T09:47:42.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.771+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94569406436304] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc96000a4d0 con 0x5602a7dfc360 2024-05-09T09:47:42.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.771+0000 7fc968022980 20 remove_watcher() i=4 2024-05-09T09:47:42.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.771+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94569406453168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e09c70 con 0x5602a7e00d50 2024-05-09T09:47:42.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.771+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94569406453168] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.771+0000 7fc968022980 20 remove_watcher() i=5 2024-05-09T09:47:42.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.771+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94569406456304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e093d0 con 0x5602a7e00d50 2024-05-09T09:47:42.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.775+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94569406456304] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.775+0000 7fc968022980 20 remove_watcher() i=6 2024-05-09T09:47:42.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.775+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94569406460272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5602a7e09c70 con 0x5602a7e00d50 2024-05-09T09:47:42.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.775+0000 7fc965b3d640 1 -- 172.21.15.157:0/660210728 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94569406460272] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9580d6070 con 0x5602a7e00d50 2024-05-09T09:47:42.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.775+0000 7fc968022980 20 remove_watcher() i=7 2024-05-09T09:47:42.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.775+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602a7e00d50 msgr2=0x5602a7e03140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.775+0000 7fc968022980 1 --2- 172.21.15.157:0/660210728 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602a7e00d50 0x5602a7e03140 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.775+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5602a7dfc360 msgr2=0x5602a7dfe820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.775+0000 7fc968022980 1 --2- 172.21.15.157:0/660210728 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5602a7dfc360 0x5602a7dfe820 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.775+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fc95001fbe0 msgr2=0x7fc95003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.775+0000 7fc968022980 1 --2- 172.21.15.157:0/660210728 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fc95001fbe0 0x7fc95003a3c0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.775+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5602a7e056a0 msgr2=0x5602a7e07ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.775+0000 7fc968022980 1 --2- 172.21.15.157:0/660210728 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5602a7e056a0 0x5602a7e07ab0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.775+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc830034bb0 msgr2=0x7fc830037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.775+0000 7fc968022980 1 --2- 172.21.15.157:0/660210728 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc830034bb0 0x7fc830037070 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc95000ffd0 tx=0x7fc950010000 comp rx=0 tx=0).stop 2024-05-09T09:47:42.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.775+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7de8490 msgr2=0x5602a7def7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.775+0000 7fc968022980 1 --2- 172.21.15.157:0/660210728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7de8490 0x5602a7def7d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc958002dd0 tx=0x7fc9580edf80 comp rx=0 tx=0).stop 2024-05-09T09:47:42.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.775+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 reap_dead start 2024-05-09T09:47:42.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.775+0000 7fc96633e640 1 -- 172.21.15.157:0/660210728 reap_dead start 2024-05-09T09:47:42.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.775+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 shutdown_connections 2024-05-09T09:47:42.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.775+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 >> 172.21.15.157:0/660210728 conn(0x5602a7de4810 msgr2=0x5602a7de1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:42.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.775+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 shutdown_connections 2024-05-09T09:47:42.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.775+0000 7fc968022980 1 -- 172.21.15.157:0/660210728 wait complete. 2024-05-09T09:47:42.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.779+0000 7fc968022980 1 -- 172.21.15.157:0/4068126001 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc840034bb0 msgr2=0x7fc840037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.779+0000 7fc968022980 1 --2- 172.21.15.157:0/4068126001 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc840034bb0 0x7fc840037070 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x5602a7da90f0 tx=0x7fc95000f000 comp rx=0 tx=0).stop 2024-05-09T09:47:42.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.779+0000 7fc968022980 1 -- 172.21.15.157:0/4068126001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7ddb850 msgr2=0x5602a7ddbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.779+0000 7fc968022980 1 --2- 172.21.15.157:0/4068126001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7ddb850 0x5602a7ddbc70 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc9580e5d80 tx=0x7fc9580bea70 comp rx=0 tx=0).stop 2024-05-09T09:47:42.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.779+0000 7fc968022980 1 -- 172.21.15.157:0/4068126001 shutdown_connections 2024-05-09T09:47:42.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.779+0000 7fc968022980 1 --2- 172.21.15.157:0/4068126001 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc840034bb0 0x7fc840037070 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.779+0000 7fc968022980 1 --2- 172.21.15.157:0/4068126001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7ddb850 0x5602a7ddbc70 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.779+0000 7fc968022980 1 -- 172.21.15.157:0/4068126001 >> 172.21.15.157:0/4068126001 conn(0x5602a7dd0620 msgr2=0x5602a7dd1130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:42.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.779+0000 7fc968022980 1 -- 172.21.15.157:0/4068126001 shutdown_connections 2024-05-09T09:47:42.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.779+0000 7fc968022980 1 -- 172.21.15.157:0/4068126001 wait complete. 2024-05-09T09:47:42.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.779+0000 7fc968022980 1 -- 172.21.15.157:0/2168893916 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602a7daab40 msgr2=0x5602a7dacf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.779+0000 7fc968022980 1 --2- 172.21.15.157:0/2168893916 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602a7daab40 0x5602a7dacf30 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.779+0000 7fc968022980 1 -- 172.21.15.157:0/2168893916 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5602a7cb0130 msgr2=0x5602a7da8170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.779+0000 7fc968022980 1 --2- 172.21.15.157:0/2168893916 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5602a7cb0130 0x5602a7da8170 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.779+0000 7fc968022980 1 -- 172.21.15.157:0/2168893916 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5602a7daea60 msgr2=0x5602a7db0e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.779+0000 7fc968022980 1 --2- 172.21.15.157:0/2168893916 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5602a7daea60 0x5602a7db0e50 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.779+0000 7fc968022980 1 -- 172.21.15.157:0/2168893916 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc84c034bb0 msgr2=0x7fc84c037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.779+0000 7fc968022980 1 --2- 172.21.15.157:0/2168893916 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc84c034bb0 0x7fc84c037070 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc950000f70 tx=0x7fc950001380 comp rx=0 tx=0).stop 2024-05-09T09:47:42.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.779+0000 7fc968022980 1 -- 172.21.15.157:0/2168893916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7caf810 msgr2=0x5602a7da1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.779+0000 7fc968022980 1 --2- 172.21.15.157:0/2168893916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5602a7caf810 0x5602a7da1230 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc958018f70 tx=0x7fc9580180e0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.779+0000 7fc96633e640 1 -- 172.21.15.157:0/2168893916 reap_dead start 2024-05-09T09:47:42.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.779+0000 7fc968022980 1 -- 172.21.15.157:0/2168893916 shutdown_connections 2024-05-09T09:47:42.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.779+0000 7fc968022980 1 -- 172.21.15.157:0/2168893916 >> 172.21.15.157:0/2168893916 conn(0x5602a7cab0e0 msgr2=0x5602a7d957e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:42.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.779+0000 7fc968022980 1 -- 172.21.15.157:0/2168893916 shutdown_connections 2024-05-09T09:47:42.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.779+0000 7fc968022980 1 -- 172.21.15.157:0/2168893916 wait complete. 2024-05-09T09:47:42.794 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-05-09T09:47:42.798 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-05-09T09:47:42.801 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-09T09:47:42.801 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-05-09T09:47:42.801 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-05-09T09:47:42.801 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-05-09T09:47:42.863 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:42.863 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:42.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.867+0000 7fe1fa7ba980 1 Processor -- start 2024-05-09T09:47:42.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.867+0000 7fe1fa7ba980 1 -- start start 2024-05-09T09:47:42.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.867+0000 7fe1fa7ba980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x563c70de3390 0x563c70de1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.867+0000 7fe1fa7ba980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563c70d22440 con 0x563c70de1ed0 2024-05-09T09:47:42.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.867+0000 7fe1fa7ba980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x563c70d0d5f0 con 0x563c70de3390 2024-05-09T09:47:42.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.867+0000 7fe1f82d5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x563c70de3390 0x563c70de1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.867+0000 7fe1f82d5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x563c70de3390 0x563c70de1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59568/0 (socket says 172.21.15.157:59568) 2024-05-09T09:47:42.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.867+0000 7fe1f82d5640 1 -- 172.21.15.157:0/93786002 learned_addr learned my addr 172.21.15.157:0/93786002 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:42.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.867+0000 7fe1f82d5640 1 -- 172.21.15.157:0/93786002 >> v1:172.21.15.110:6789/0 conn(0x563c70de1ed0 legacy=0x563c70e79180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.867+0000 7fe1f82d5640 1 -- 172.21.15.157:0/93786002 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c70d18990 con 0x563c70de3390 2024-05-09T09:47:42.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.867+0000 7fe1f82d5640 1 --2- 172.21.15.157:0/93786002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70de3390 0x563c70de1990 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe1e800a4e0 tx=0x7fe1e801aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e1ae3ab964f797 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.867+0000 7fe1f72d3640 1 -- 172.21.15.157:0/93786002 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1e80ab410 con 0x563c70de3390 2024-05-09T09:47:42.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.867+0000 7fe1f72d3640 1 -- 172.21.15.157:0/93786002 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1e80a7070 con 0x563c70de3390 2024-05-09T09:47:42.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.867+0000 7fe1f72d3640 1 -- 172.21.15.157:0/93786002 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1e80ab760 con 0x563c70de3390 2024-05-09T09:47:42.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.871+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/93786002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70de3390 msgr2=0x563c70de1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.871+0000 7fe1fa7ba980 1 --2- 172.21.15.157:0/93786002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70de3390 0x563c70de1990 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe1e800a4e0 tx=0x7fe1e801aeb0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.871+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/93786002 shutdown_connections 2024-05-09T09:47:42.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.871+0000 7fe1fa7ba980 1 --2- 172.21.15.157:0/93786002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70de3390 0x563c70de1990 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.871+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/93786002 >> 172.21.15.157:0/93786002 conn(0x563c70e68260 msgr2=0x563c70e6a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:42.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.871+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/93786002 shutdown_connections 2024-05-09T09:47:42.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.871+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/93786002 wait complete. 2024-05-09T09:47:42.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.883+0000 7fe1fa7ba980 1 Processor -- start 2024-05-09T09:47:42.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.883+0000 7fe1fa7ba980 1 -- start start 2024-05-09T09:47:42.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.883+0000 7fe1fa7ba980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70de1ed0 0x563c70f5eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.883+0000 7fe1fa7ba980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563c70d6ffe0 con 0x563c70de1ed0 2024-05-09T09:47:42.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.883+0000 7fe1f82d5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70de1ed0 0x563c70f5eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.883+0000 7fe1f82d5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70de1ed0 0x563c70f5eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59582/0 (socket says 172.21.15.157:59582) 2024-05-09T09:47:42.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.883+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3083195634 learned_addr learned my addr 172.21.15.157:0/3083195634 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:42.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.883+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3083195634 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c70cf4ae0 con 0x563c70de1ed0 2024-05-09T09:47:42.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.883+0000 7fe1f82d5640 1 --2- 172.21.15.157:0/3083195634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70de1ed0 0x563c70f5eb20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8017ac0 tx=0x7fe1e80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e973c9edbbe9ca5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.883+0000 7fe0e660c640 1 -- 172.21.15.157:0/3083195634 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1e80ab540 con 0x563c70de1ed0 2024-05-09T09:47:42.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.883+0000 7fe0e660c640 1 -- 172.21.15.157:0/3083195634 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1e80ab6e0 con 0x563c70de1ed0 2024-05-09T09:47:42.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.883+0000 7fe0e660c640 1 -- 172.21.15.157:0/3083195634 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1e80ab9c0 con 0x563c70de1ed0 2024-05-09T09:47:42.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.887+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3083195634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70de1ed0 msgr2=0x563c70f5eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.887+0000 7fe1fa7ba980 1 --2- 172.21.15.157:0/3083195634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70de1ed0 0x563c70f5eb20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8017ac0 tx=0x7fe1e80033b0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.887+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3083195634 shutdown_connections 2024-05-09T09:47:42.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.887+0000 7fe1fa7ba980 1 --2- 172.21.15.157:0/3083195634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70de1ed0 0x563c70f5eb20 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.887+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3083195634 >> 172.21.15.157:0/3083195634 conn(0x563c70e68260 msgr2=0x563c70f5a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:42.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.887+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3083195634 shutdown_connections 2024-05-09T09:47:42.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.887+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3083195634 wait complete. 2024-05-09T09:47:42.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.887+0000 7fe1fa7ba980 1 Processor -- start 2024-05-09T09:47:42.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.887+0000 7fe1fa7ba980 1 -- start start 2024-05-09T09:47:42.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.887+0000 7fe1fa7ba980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70de1ed0 0x563c70f65b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.887+0000 7fe1fa7ba980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563c70e7d360 con 0x563c70de1ed0 2024-05-09T09:47:42.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.887+0000 7fe1f82d5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70de1ed0 0x563c70f65b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.887+0000 7fe1f82d5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70de1ed0 0x563c70f65b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59596/0 (socket says 172.21.15.157:59596) 2024-05-09T09:47:42.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.887+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3952261625 learned_addr learned my addr 172.21.15.157:0/3952261625 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:42.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.887+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3952261625 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c70f66070 con 0x563c70de1ed0 2024-05-09T09:47:42.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.887+0000 7fe1f82d5640 1 --2- 172.21.15.157:0/3952261625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70de1ed0 0x563c70f65b30 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe1e80a4eb0 tx=0x7fe1e8017c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.887+0000 7fe0e4e09640 1 -- 172.21.15.157:0/3952261625 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1e80c3020 con 0x563c70de1ed0 2024-05-09T09:47:42.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.887+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3952261625 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563c70f66300 con 0x563c70de1ed0 2024-05-09T09:47:42.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.887+0000 7fe0e4e09640 1 -- 172.21.15.157:0/3952261625 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1e80bf470 con 0x563c70de1ed0 2024-05-09T09:47:42.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.887+0000 7fe0e4e09640 1 -- 172.21.15.157:0/3952261625 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1e80ab540 con 0x563c70de1ed0 2024-05-09T09:47:42.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.887+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3952261625 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c70f68fe0 con 0x563c70de1ed0 2024-05-09T09:47:42.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.887+0000 7fe0e4e09640 1 -- 172.21.15.157:0/3952261625 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fe1e80c6020 con 0x563c70de1ed0 2024-05-09T09:47:42.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.887+0000 7fe0e4e09640 1 --2- 172.21.15.157:0/3952261625 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe0e0034bb0 0x7fe0e0037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.887+0000 7fe0e4e09640 1 -- 172.21.15.157:0/3952261625 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fe1e80ba040 con 0x563c70de1ed0 2024-05-09T09:47:42.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.887+0000 7fe1f7ad4640 1 --2- 172.21.15.157:0/3952261625 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe0e0034bb0 0x7fe0e0037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.891+0000 7fe1fa7ba980 1 --2- 172.21.15.157:0/3952261625 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563c70de3390 0x563c70f6cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.891+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3952261625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c70f6d1b0 con 0x563c70de3390 2024-05-09T09:47:42.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.891+0000 7fe1f8ad6640 1 --2- 172.21.15.157:0/3952261625 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563c70de3390 0x563c70f6cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.891+0000 7fe1f7ad4640 1 --2- 172.21.15.157:0/3952261625 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe0e0034bb0 0x7fe0e0037070 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0000f70 tx=0x7fe1e0001420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.891+0000 7fe1f8ad6640 1 --2- 172.21.15.157:0/3952261625 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563c70de3390 0x563c70f6cc30 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.891+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3952261625 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1f00083f0 con 0x563c70de3390 2024-05-09T09:47:42.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.891+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3952261625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c70f6a200 con 0x563c70de3390 2024-05-09T09:47:42.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.891+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3952261625 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe1f00083f0 con 0x563c70de3390 2024-05-09T09:47:42.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.891+0000 7fe1fa7ba980 1 --2- 172.21.15.157:0/3952261625 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563c70f6f4e0 0x563c70f718d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.891+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3952261625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c70f71fa0 con 0x563c70f6f4e0 2024-05-09T09:47:42.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.891+0000 7fe1f82d5640 1 --2- 172.21.15.157:0/3952261625 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563c70f6f4e0 0x563c70f718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.891+0000 7fe1f82d5640 1 --2- 172.21.15.157:0/3952261625 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563c70f6f4e0 0x563c70f718d0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.891+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3952261625 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe1e80b3360 con 0x563c70f6f4e0 2024-05-09T09:47:42.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.891+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3952261625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c70f6e380 con 0x563c70de3390 2024-05-09T09:47:42.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.891+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3952261625 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe1f00083f0 con 0x563c70de3390 2024-05-09T09:47:42.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.891+0000 7fe1fa7ba980 1 --2- 172.21.15.157:0/3952261625 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563c70f73400 0x563c70f757f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.891+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3952261625 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c70f75ef0 con 0x563c70f73400 2024-05-09T09:47:42.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.891+0000 7fe1f7ad4640 1 --2- 172.21.15.157:0/3952261625 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563c70f73400 0x563c70f757f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.891+0000 7fe1f7ad4640 1 --2- 172.21.15.157:0/3952261625 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563c70f73400 0x563c70f757f0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.891+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3952261625 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe1e000d040 con 0x563c70f73400 2024-05-09T09:47:42.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.895+0000 7fe1fa7ba980 1 Processor -- start 2024-05-09T09:47:42.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.895+0000 7fe1fa7ba980 1 -- start start 2024-05-09T09:47:42.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.895+0000 7fe1fa7ba980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70f9bde0 0x563c70f9c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.895+0000 7fe1fa7ba980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563c70d74020 con 0x563c70f9bde0 2024-05-09T09:47:42.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.895+0000 7fe1f82d5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70f9bde0 0x563c70f9c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.895+0000 7fe1f82d5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70f9bde0 0x563c70f9c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59600/0 (socket says 172.21.15.157:59600) 2024-05-09T09:47:42.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.895+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3480944531 learned_addr learned my addr 172.21.15.157:0/3480944531 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:42.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.899+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3480944531 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c70f9c740 con 0x563c70f9bde0 2024-05-09T09:47:42.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.899+0000 7fe1f82d5640 1 --2- 172.21.15.157:0/3480944531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70f9bde0 0x563c70f9c200 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8000f90 tx=0x7fe1e80e4420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.899+0000 7fe0dcb9e640 1 -- 172.21.15.157:0/3480944531 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1e80e9070 con 0x563c70f9bde0 2024-05-09T09:47:42.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.899+0000 7fe0dcb9e640 1 -- 172.21.15.157:0/3480944531 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1e80bed60 con 0x563c70f9bde0 2024-05-09T09:47:42.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.899+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3480944531 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563c70f9d1d0 con 0x563c70f9bde0 2024-05-09T09:47:42.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.899+0000 7fe0dcb9e640 1 -- 172.21.15.157:0/3480944531 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1e80dc530 con 0x563c70f9bde0 2024-05-09T09:47:42.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.899+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3480944531 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c70f9d6b0 con 0x563c70f9bde0 2024-05-09T09:47:42.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.899+0000 7fe0dcb9e640 1 -- 172.21.15.157:0/3480944531 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fe1e80ec070 con 0x563c70f9bde0 2024-05-09T09:47:42.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.899+0000 7fe0dcb9e640 1 --2- 172.21.15.157:0/3480944531 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe0d0034c00 0x7fe0d00370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.899+0000 7fe0dcb9e640 1 -- 172.21.15.157:0/3480944531 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fe1e80b0050 con 0x563c70f9bde0 2024-05-09T09:47:42.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.899+0000 7fe1f7ad4640 1 --2- 172.21.15.157:0/3480944531 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe0d0034c00 0x7fe0d00370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.899+0000 7fe1fa7ba980 1 Processor -- start 2024-05-09T09:47:42.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.899+0000 7fe1fa7ba980 1 -- start start 2024-05-09T09:47:42.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.899+0000 7fe1f7ad4640 1 --2- 172.21.15.157:0/3480944531 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe0d0034c00 0x7fe0d00370c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x563c70f6da90 tx=0x7fe1e0006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.899+0000 7fe1fa7ba980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70fa8bf0 0x563c70fa9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.899+0000 7fe1fa7ba980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563c70f5f1b0 con 0x563c70fa8bf0 2024-05-09T09:47:42.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.899+0000 7fe1f82d5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70fa8bf0 0x563c70fa9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.899+0000 7fe1f82d5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70fa8bf0 0x563c70fa9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59608/0 (socket says 172.21.15.157:59608) 2024-05-09T09:47:42.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.899+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3387945986 learned_addr learned my addr 172.21.15.157:0/3387945986 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:42.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.903+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3387945986 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c70fa95e0 con 0x563c70fa8bf0 2024-05-09T09:47:42.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.903+0000 7fe1f82d5640 1 --2- 172.21.15.157:0/3387945986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70fa8bf0 0x563c70fa9010 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe1e80c7d20 tx=0x7fe1e80b3e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a056768817a88cf8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.903+0000 7fe0d67fc640 1 -- 172.21.15.157:0/3387945986 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1e8100070 con 0x563c70fa8bf0 2024-05-09T09:47:42.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.903+0000 7fe0d67fc640 1 -- 172.21.15.157:0/3387945986 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1e80c0920 con 0x563c70fa8bf0 2024-05-09T09:47:42.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.903+0000 7fe0d67fc640 1 -- 172.21.15.157:0/3387945986 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1e80b4e60 con 0x563c70fa8bf0 2024-05-09T09:47:42.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.903+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3387945986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70fa8bf0 msgr2=0x563c70fa9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:42.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.903+0000 7fe1fa7ba980 1 --2- 172.21.15.157:0/3387945986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70fa8bf0 0x563c70fa9010 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe1e80c7d20 tx=0x7fe1e80b3e40 comp rx=0 tx=0).stop 2024-05-09T09:47:42.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.903+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3387945986 shutdown_connections 2024-05-09T09:47:42.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.903+0000 7fe1fa7ba980 1 --2- 172.21.15.157:0/3387945986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70fa8bf0 0x563c70fa9010 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:42.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.903+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3387945986 >> 172.21.15.157:0/3387945986 conn(0x563c70fa4f70 msgr2=0x563c70fa2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:42.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.903+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3387945986 shutdown_connections 2024-05-09T09:47:42.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.903+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3387945986 wait complete. 2024-05-09T09:47:42.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.903+0000 7fe1fa7ba980 1 Processor -- start 2024-05-09T09:47:42.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.903+0000 7fe1fa7ba980 1 -- start start 2024-05-09T09:47:42.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.903+0000 7fe1fa7ba980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70fa8bf0 0x563c70fafd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.903+0000 7fe1fa7ba980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563c70fa9b40 con 0x563c70fa8bf0 2024-05-09T09:47:42.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.903+0000 7fe1f82d5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70fa8bf0 0x563c70fafd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.903+0000 7fe1f82d5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70fa8bf0 0x563c70fafd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59616/0 (socket says 172.21.15.157:59616) 2024-05-09T09:47:42.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.903+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 learned_addr learned my addr 172.21.15.157:0/3763304080 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:42.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.903+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c70fb02c0 con 0x563c70fa8bf0 2024-05-09T09:47:42.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.903+0000 7fe1f82d5640 1 --2- 172.21.15.157:0/3763304080 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70fa8bf0 0x563c70fafd80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe1e80c7d20 tx=0x7fe1e80a9ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.903+0000 7fe0d4ff9640 1 -- 172.21.15.157:0/3763304080 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1e8100040 con 0x563c70fa8bf0 2024-05-09T09:47:42.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.903+0000 7fe0d4ff9640 1 -- 172.21.15.157:0/3763304080 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1e80e4b20 con 0x563c70fa8bf0 2024-05-09T09:47:42.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.903+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563c70fb02c0 con 0x563c70fa8bf0 2024-05-09T09:47:42.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.903+0000 7fe0d4ff9640 1 -- 172.21.15.157:0/3763304080 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1e80b4e60 con 0x563c70fa8bf0 2024-05-09T09:47:42.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.903+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c70fb02c0 con 0x563c70fa8bf0 2024-05-09T09:47:42.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe0d4ff9640 1 -- 172.21.15.157:0/3763304080 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fe1e810d020 con 0x563c70fa8bf0 2024-05-09T09:47:42.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe0d4ff9640 1 --2- 172.21.15.157:0/3763304080 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe0c0034bb0 0x7fe0c0037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe0d4ff9640 1 -- 172.21.15.157:0/3763304080 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fe1e810b020 con 0x563c70fa8bf0 2024-05-09T09:47:42.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1fa7ba980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1fa7ba980 1 --2- 172.21.15.157:0/3763304080 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563c70fbc780 0x563c70fbec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c70fbf390 con 0x563c70fbc780 2024-05-09T09:47:42.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1f7ad4640 1 --2- 172.21.15.157:0/3763304080 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe0c0034bb0 0x7fe0c0037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1f8ad6640 1 --2- 172.21.15.157:0/3763304080 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563c70fbc780 0x563c70fbec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1f8ad6640 1 --2- 172.21.15.157:0/3763304080 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563c70fbc780 0x563c70fbec40 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1f7ad4640 1 --2- 172.21.15.157:0/3763304080 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe0c0034bb0 0x7fe0c0037070 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0010fd0 tx=0x7fe1e0011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1f00083f0 con 0x563c70fbc780 2024-05-09T09:47:42.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1fa7ba980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:42.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1fa7ba980 20 realm 2024-05-09T09:47:42.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1fa7ba980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c70fbf7a0 con 0x563c70fbc780 2024-05-09T09:47:42.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1f00083f0 con 0x563c70fbc780 2024-05-09T09:47:42.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1fa7ba980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:42.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1fa7ba980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:42.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1fa7ba980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0070 con 0x563c70fbc780 2024-05-09T09:47:42.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1f00083f0 con 0x563c70fbc780 2024-05-09T09:47:42.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1fa7ba980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:42.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1fa7ba980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x563c70fbc780 2024-05-09T09:47:42.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe1f00083f0 con 0x563c70fbc780 2024-05-09T09:47:42.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1fa7ba980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:42.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1fa7ba980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1fa7ba980 1 --2- 172.21.15.157:0/3763304080 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563c70fc1170 0x563c70fc3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc3b70 con 0x563c70fc1170 2024-05-09T09:47:42.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1f82d5640 1 --2- 172.21.15.157:0/3763304080 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563c70fc1170 0x563c70fc3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1f82d5640 1 --2- 172.21.15.157:0/3763304080 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563c70fc1170 0x563c70fc3560 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe1e80eb030 con 0x563c70fc1170 2024-05-09T09:47:42.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1fa7ba980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:42.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1fa7ba980 20 searching for the correct realm 2024-05-09T09:47:42.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1fa7ba980 1 --2- 172.21.15.157:0/3763304080 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563c70fc5ac0 0x563c70fc7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.907+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc8570 con 0x563c70fc5ac0 2024-05-09T09:47:42.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.911+0000 7fe1f7ad4640 1 --2- 172.21.15.157:0/3763304080 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563c70fc5ac0 0x563c70fc7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.911+0000 7fe1f7ad4640 1 --2- 172.21.15.157:0/3763304080 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563c70fc5ac0 0x563c70fc7ef0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.911+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1e0036040 con 0x563c70fc5ac0 2024-05-09T09:47:42.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.911+0000 7fe1f7ad4640 1 --2- 172.21.15.157:0/3763304080 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fe1e000f3d0 0x7fe1e000f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:42.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.911+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc8570 con 0x7fe1e000f3d0 2024-05-09T09:47:42.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.911+0000 7fe1f8ad6640 1 --2- 172.21.15.157:0/3763304080 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fe1e000f3d0 0x7fe1e000f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:42.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.911+0000 7fe1f8ad6640 1 --2- 172.21.15.157:0/3763304080 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fe1e000f3d0 0x7fe1e000f7f0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:42.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.911+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f00083f0 con 0x7fe1e000f3d0 2024-05-09T09:47:42.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.911+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x563c70fc1170 2024-05-09T09:47:42.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.911+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1e80eb030 con 0x563c70fc1170 2024-05-09T09:47:42.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.911+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x563c70fbc780 2024-05-09T09:47:42.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.911+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f00083f0 con 0x563c70fbc780 2024-05-09T09:47:42.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.911+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x563c70fbc780 2024-05-09T09:47:42.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.911+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f00083f0 con 0x563c70fbc780 2024-05-09T09:47:42.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.911+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x563c70fc1170 2024-05-09T09:47:42.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.911+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1e80eb030 con 0x563c70fc1170 2024-05-09T09:47:42.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.911+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x563c70fc1170 2024-05-09T09:47:42.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.915+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1e80eb030 con 0x563c70fc1170 2024-05-09T09:47:42.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.915+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x7fe1e000f3d0 2024-05-09T09:47:42.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.915+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f00083f0 con 0x7fe1e000f3d0 2024-05-09T09:47:42.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.915+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x563c70fc5ac0 2024-05-09T09:47:42.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.915+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1e0036040 con 0x563c70fc5ac0 2024-05-09T09:47:42.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.915+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x563c70fbc780 2024-05-09T09:47:42.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.915+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f00083f0 con 0x563c70fbc780 2024-05-09T09:47:42.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.915+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x563c70fc1170 2024-05-09T09:47:42.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.915+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1e80eb030 con 0x563c70fc1170 2024-05-09T09:47:42.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.915+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x563c70fbc780 2024-05-09T09:47:42.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.915+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f00083f0 con 0x563c70fbc780 2024-05-09T09:47:42.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.915+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x7fe1e000f3d0 2024-05-09T09:47:42.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.915+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe1f00083f0 con 0x7fe1e000f3d0 2024-05-09T09:47:42.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.915+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x563c70fc5ac0 2024-05-09T09:47:42.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.915+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1e0036040 con 0x563c70fc5ac0 2024-05-09T09:47:42.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.915+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x563c70fc5ac0 2024-05-09T09:47:42.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.915+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe1e0036040 con 0x563c70fc5ac0 2024-05-09T09:47:42.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.915+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x563c70fc1170 2024-05-09T09:47:42.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.915+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1e80eb030 con 0x563c70fc1170 2024-05-09T09:47:42.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.915+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x563c70fc5ac0 2024-05-09T09:47:42.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.915+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1e0036040 con 0x563c70fc5ac0 2024-05-09T09:47:42.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.915+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x563c70fc5ac0 2024-05-09T09:47:42.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.915+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1e0036040 con 0x563c70fc5ac0 2024-05-09T09:47:42.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.915+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x563c70fbc780 2024-05-09T09:47:42.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.915+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f00083f0 con 0x563c70fbc780 2024-05-09T09:47:42.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.915+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x563c70fbc780 2024-05-09T09:47:42.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.919+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe1f00083f0 con 0x563c70fbc780 2024-05-09T09:47:42.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.919+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x563c70fc1170 2024-05-09T09:47:42.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.919+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1e80eb030 con 0x563c70fc1170 2024-05-09T09:47:42.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.919+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x563c70fc5ac0 2024-05-09T09:47:42.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.919+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1e0036040 con 0x563c70fc5ac0 2024-05-09T09:47:42.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.919+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x7fe1e000f3d0 2024-05-09T09:47:42.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.919+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f00083f0 con 0x7fe1e000f3d0 2024-05-09T09:47:42.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.919+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x563c70fbc780 2024-05-09T09:47:42.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.919+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f00083f0 con 0x563c70fbc780 2024-05-09T09:47:42.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.919+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x563c70fc1170 2024-05-09T09:47:42.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.919+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe1e80eb030 con 0x563c70fc1170 2024-05-09T09:47:42.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.919+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x563c70fc5ac0 2024-05-09T09:47:42.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.919+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1e0036040 con 0x563c70fc5ac0 2024-05-09T09:47:42.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.919+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x563c70fc1170 2024-05-09T09:47:42.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.919+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1e80eb030 con 0x563c70fc1170 2024-05-09T09:47:42.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.919+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x7fe1e000f3d0 2024-05-09T09:47:42.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.919+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f00083f0 con 0x7fe1e000f3d0 2024-05-09T09:47:42.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.919+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x563c70fc5ac0 2024-05-09T09:47:42.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1e0048040 con 0x563c70fc5ac0 2024-05-09T09:47:42.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x563c70fc1170 2024-05-09T09:47:42.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1e80eb030 con 0x563c70fc1170 2024-05-09T09:47:42.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x563c70fbc780 2024-05-09T09:47:42.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe1f00083f0 con 0x563c70fbc780 2024-05-09T09:47:42.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc0410 con 0x7fe1e000f3d0 2024-05-09T09:47:42.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f00083f0 con 0x7fe1e000f3d0 2024-05-09T09:47:42.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:42.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:42.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:42.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:42.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:42.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:42.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc4430 con 0x563c70fbc780 2024-05-09T09:47:42.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1f00083f0 con 0x563c70fbc780 2024-05-09T09:47:42.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:42.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc4430 con 0x563c70fbc780 2024-05-09T09:47:42.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe1f00083f0 con 0x563c70fbc780 2024-05-09T09:47:42.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:42.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc4430 con 0x563c70fc5ac0 2024-05-09T09:47:42.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe1e0048040 con 0x563c70fc5ac0 2024-05-09T09:47:42.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:42.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 20 zone default found 2024-05-09T09:47:42.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 4 Realm: () 2024-05-09T09:47:42.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:42.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:42.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:42.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 20 zonegroup default 2024-05-09T09:47:42.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc4e30 con 0x563c70fc1170 2024-05-09T09:47:42.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe1e80eb030 con 0x563c70fc1170 2024-05-09T09:47:42.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:42.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc4a00 con 0x563c70fc5ac0 2024-05-09T09:47:42.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe1e0048040 con 0x563c70fc5ac0 2024-05-09T09:47:42.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:42.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c70fca920 con 0x563c70fc5ac0 2024-05-09T09:47:42.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe1e0048040 con 0x563c70fc5ac0 2024-05-09T09:47:42.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:42.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 20 started sync module instance, tier type = 2024-05-09T09:47:42.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:42.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.923+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc9d10 con 0x7fe1e000f3d0 2024-05-09T09:47:42.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.927+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f00083f0 con 0x7fe1e000f3d0 2024-05-09T09:47:42.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.927+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94817593631280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc9d10 con 0x7fe1e000f3d0 2024-05-09T09:47:42.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.927+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fcb3f0 con 0x563c70fbc780 2024-05-09T09:47:42.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.927+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94817593631280] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f0035040 con 0x7fe1e000f3d0 2024-05-09T09:47:42.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.927+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f0035040 con 0x563c70fbc780 2024-05-09T09:47:42.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.927+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94817593634496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fc9d10 con 0x563c70fbc780 2024-05-09T09:47:42.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.927+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fcbe00 con 0x563c70fc5ac0 2024-05-09T09:47:42.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.931+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1e0048040 con 0x563c70fc5ac0 2024-05-09T09:47:42.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.931+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94817593637200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fcc650 con 0x563c70fc5ac0 2024-05-09T09:47:42.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.931+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fcd070 con 0x7fe1e000f3d0 2024-05-09T09:47:42.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.931+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94817593634496] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f0035040 con 0x563c70fbc780 2024-05-09T09:47:42.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.931+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f0035040 con 0x7fe1e000f3d0 2024-05-09T09:47:42.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.931+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94817593641824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fcd030 con 0x7fe1e000f3d0 2024-05-09T09:47:42.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.931+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fcda80 con 0x563c70fbc780 2024-05-09T09:47:42.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.931+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94817593637200] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1e0048040 con 0x563c70fc5ac0 2024-05-09T09:47:42.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.931+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94817593641824] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f0035040 con 0x7fe1e000f3d0 2024-05-09T09:47:42.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.935+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f0035040 con 0x563c70fbc780 2024-05-09T09:47:42.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.935+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94817593628768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fcd5d0 con 0x563c70fbc780 2024-05-09T09:47:42.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.935+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fcde20 con 0x563c70fc1170 2024-05-09T09:47:42.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.935+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94817593628768] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f0035040 con 0x563c70fbc780 2024-05-09T09:47:42.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.935+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1e80eb030 con 0x563c70fc1170 2024-05-09T09:47:42.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.935+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94817593644496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fcd9f0 con 0x563c70fc1170 2024-05-09T09:47:42.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.935+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fceb20 con 0x563c70fc1170 2024-05-09T09:47:42.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.935+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94817593644496] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1e80eb030 con 0x563c70fc1170 2024-05-09T09:47:42.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.939+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1e80eb030 con 0x563c70fc1170 2024-05-09T09:47:42.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.939+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94817593648032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fcedd0 con 0x563c70fc1170 2024-05-09T09:47:42.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.939+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fcf8f0 con 0x563c70fc1170 2024-05-09T09:47:42.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.939+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1e80eb030 con 0x563c70fc1170 2024-05-09T09:47:42.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.939+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94817593652160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fcfd60 con 0x563c70fc1170 2024-05-09T09:47:42.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.939+0000 7fe1fa7ba980 20 add_watcher() i=0 2024-05-09T09:47:42.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.939+0000 7fe1fa7ba980 20 add_watcher() i=1 2024-05-09T09:47:42.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.939+0000 7fe1fa7ba980 20 add_watcher() i=2 2024-05-09T09:47:42.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.939+0000 7fe1fa7ba980 20 add_watcher() i=3 2024-05-09T09:47:42.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.939+0000 7fe1fa7ba980 20 add_watcher() i=4 2024-05-09T09:47:42.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.939+0000 7fe1fa7ba980 20 add_watcher() i=5 2024-05-09T09:47:42.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.939+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94817593648032] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1e80eb030 con 0x563c70fc1170 2024-05-09T09:47:42.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.939+0000 7fe1fa7ba980 20 add_watcher() i=6 2024-05-09T09:47:42.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.943+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94817593652160] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1e80eb030 con 0x563c70fc1170 2024-05-09T09:47:42.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.943+0000 7fe1fa7ba980 20 add_watcher() i=7 2024-05-09T09:47:42.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.943+0000 7fe1fa7ba980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:42.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.943+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c70fce860 con 0x563c70fbc780 2024-05-09T09:47:42.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.943+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe1f0035040 con 0x563c70fbc780 2024-05-09T09:47:42.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.943+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94817593649184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fd0270 con 0x563c70fbc780 2024-05-09T09:47:42.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.943+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94817593649184] v30'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe1f0035040 con 0x563c70fbc780 2024-05-09T09:47:42.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.943+0000 7fe0ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:42.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.943+0000 7fe1fa7ba980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:42.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.943+0000 7fe1fa7ba980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:42.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.943+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fdb730 con 0x563c70fbc780 2024-05-09T09:47:42.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.943+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'63 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe1f0035040 con 0x563c70fbc780 2024-05-09T09:47:42.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.943+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fdbe00 con 0x563c70fc1170 2024-05-09T09:47:42.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.947+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'58 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe1e80eb030 con 0x563c70fc1170 2024-05-09T09:47:42.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.947+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fdbe00 con 0x563c70fc5ac0 2024-05-09T09:47:42.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.947+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'57 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe1e0048040 con 0x563c70fc5ac0 2024-05-09T09:47:42.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.947+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fdc3f0 con 0x563c70fbc780 2024-05-09T09:47:42.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.951+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'260 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe1f0035040 con 0x563c70fbc780 2024-05-09T09:47:42.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.951+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fdc8a0 con 0x7fe1e000f3d0 2024-05-09T09:47:42.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.951+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'161 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe1f0035040 con 0x7fe1e000f3d0 2024-05-09T09:47:42.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.951+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fd9650 con 0x563c70fc5ac0 2024-05-09T09:47:42.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.951+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'108 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe1e0048040 con 0x563c70fc5ac0 2024-05-09T09:47:42.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.951+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fd9650 con 0x563c70fbc780 2024-05-09T09:47:42.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.955+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'59 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe1f0035040 con 0x563c70fbc780 2024-05-09T09:47:42.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.955+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fdd650 con 0x563c70fc1170 2024-05-09T09:47:42.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.955+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'107 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe1e80eb030 con 0x563c70fc1170 2024-05-09T09:47:42.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.955+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fdd650 con 0x7fe1e000f3d0 2024-05-09T09:47:42.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.959+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'57 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe1f0035040 con 0x7fe1e000f3d0 2024-05-09T09:47:42.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.959+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fdd650 con 0x563c70fc5ac0 2024-05-09T09:47:42.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.959+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'63 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe1e0048040 con 0x563c70fc5ac0 2024-05-09T09:47:42.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.959+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fddb50 con 0x7fe1e000f3d0 2024-05-09T09:47:42.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.959+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'162 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1f0035040 con 0x7fe1e000f3d0 2024-05-09T09:47:42.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.959+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fddb50 con 0x563c70fc1170 2024-05-09T09:47:42.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.963+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'59 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1e80eb030 con 0x563c70fc1170 2024-05-09T09:47:42.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.963+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fddb50 con 0x7fe1e000f3d0 2024-05-09T09:47:42.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.963+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'57 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1f0035040 con 0x7fe1e000f3d0 2024-05-09T09:47:42.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.963+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fddb50 con 0x563c70fc1170 2024-05-09T09:47:42.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.967+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'113 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1e80eb030 con 0x563c70fc1170 2024-05-09T09:47:42.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.967+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fddb50 con 0x563c70fbc780 2024-05-09T09:47:42.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.967+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'261 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1f0035040 con 0x563c70fbc780 2024-05-09T09:47:42.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.967+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fddb50 con 0x563c70fc5ac0 2024-05-09T09:47:42.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.971+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'155 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1e0048040 con 0x563c70fc5ac0 2024-05-09T09:47:42.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.971+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fddb50 con 0x7fe1e000f3d0 2024-05-09T09:47:42.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.971+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'163 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1f0035040 con 0x7fe1e000f3d0 2024-05-09T09:47:42.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.971+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fddb50 con 0x563c70fc5ac0 2024-05-09T09:47:42.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.971+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'57 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1e0048040 con 0x563c70fc5ac0 2024-05-09T09:47:42.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.971+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fddb50 con 0x563c70fbc780 2024-05-09T09:47:42.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.975+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'65 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1f0035040 con 0x563c70fbc780 2024-05-09T09:47:42.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.975+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fddb50 con 0x563c70fbc780 2024-05-09T09:47:42.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.975+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'262 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1f0035040 con 0x563c70fbc780 2024-05-09T09:47:42.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.975+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fddb50 con 0x563c70fc5ac0 2024-05-09T09:47:42.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.975+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'156 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1e0048040 con 0x563c70fc5ac0 2024-05-09T09:47:42.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.975+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fddbe0 con 0x7fe1e000f3d0 2024-05-09T09:47:42.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.979+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'67 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1f0035040 con 0x7fe1e000f3d0 2024-05-09T09:47:42.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.979+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fddbe0 con 0x563c70fc5ac0 2024-05-09T09:47:42.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.979+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'59 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1e0048040 con 0x563c70fc5ac0 2024-05-09T09:47:42.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.979+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fddbe0 con 0x563c70fc5ac0 2024-05-09T09:47:42.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.979+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'63 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1e0048040 con 0x563c70fc5ac0 2024-05-09T09:47:42.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.979+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fddb50 con 0x563c70fc5ac0 2024-05-09T09:47:42.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.983+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'53 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1e0048040 con 0x563c70fc5ac0 2024-05-09T09:47:42.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.983+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fddb50 con 0x563c70fc5ac0 2024-05-09T09:47:42.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.983+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'109 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1e0048040 con 0x563c70fc5ac0 2024-05-09T09:47:42.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.983+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fddb50 con 0x563c70fc1170 2024-05-09T09:47:42.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.983+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'59 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1e80eb030 con 0x563c70fc1170 2024-05-09T09:47:42.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.983+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fddb50 con 0x563c70fc5ac0 2024-05-09T09:47:42.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.987+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'57 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1e0048040 con 0x563c70fc5ac0 2024-05-09T09:47:42.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.987+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fddb50 con 0x563c70fc1170 2024-05-09T09:47:42.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.987+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'108 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1e80eb030 con 0x563c70fc1170 2024-05-09T09:47:42.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.987+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fddb50 con 0x563c70fc5ac0 2024-05-09T09:47:42.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.991+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'157 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1e0048040 con 0x563c70fc5ac0 2024-05-09T09:47:42.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.991+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fddb50 con 0x563c70fc1170 2024-05-09T09:47:42.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.991+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'114 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1e80eb030 con 0x563c70fc1170 2024-05-09T09:47:42.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.991+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fddb50 con 0x7fe1e000f3d0 2024-05-09T09:47:42.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'63 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe1f0035040 con 0x7fe1e000f3d0 2024-05-09T09:47:42.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe027fff640 20 reqs_thread_entry: start 2024-05-09T09:47:42.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe1fa7ba980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:42.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe025ffb640 20 reqs_thread_entry: start 2024-05-09T09:47:42.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe1fa7ba980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-09T09:47:42.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe1fa7ba980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c70ff9660 con 0x7fe1e000f3d0 2024-05-09T09:47:42.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fe1f0035040 con 0x7fe1e000f3d0 2024-05-09T09:47:42.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe1fa7ba980 20 rados_obj.operate() r=0 bl.length=165 2024-05-09T09:47:42.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe1fa7ba980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-09T09:47:42.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe1fa7ba980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-09T09:47:42.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe1fa7ba980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 : miss 2024-05-09T09:47:42.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe1fa7ba980 20 rados->read ofs=0 len=0 2024-05-09T09:47:42.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 8.5 8:a7233c95:root::.bucket.meta.myfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c70ffaf50 con 0x563c70fbc780 2024-05-09T09:47:42.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(95 .bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fe1f0035040 con 0x563c70fbc780 2024-05-09T09:47:42.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe1fa7ba980 20 rados_obj.operate() r=0 bl.length=379 2024-05-09T09:47:42.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe1fa7ba980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 info.flags=0x17 2024-05-09T09:47:42.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe1fa7ba980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 to cache LRU end 2024-05-09T09:47:42.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe1fa7ba980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:42.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe1fa7ba980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-09T09:47:42.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe1fa7ba980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 2024-05-09T09:47:42.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe1fa7ba980 20 get_obj_state: octx=0x7fe1f0008c70 obj=myfoo:four state=0x563c70ffc1f8 s->prefetch_data=0 2024-05-09T09:47:42.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 3.25s0 3:a76bdbca:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563c70ffd020 con 0x563c70fbc780 2024-05-09T09:47:42.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(96 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1_four [getxattrs out=849b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+865 (crc 0 0 0) 0x7fe1f0035040 con 0x563c70fbc780 2024-05-09T09:47:42.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe1fa7ba980 10 manifest: total_size = 4 2024-05-09T09:47:42.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe1fa7ba980 20 get_obj_state: setting s->obj_tag to b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7954700834965001085 2024-05-09T09:47:42.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe1fa7ba980 20 get_obj_state: octx=0x7fe1f0008c70 obj=myfoo:four state=0x563c70ffc1f8 s->prefetch_data=0 2024-05-09T09:47:42.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe1fa7ba980 20 prepare_atomic_modification: state is not atomic. state=0x563c70ffc1f8 2024-05-09T09:47:42.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe1fa7ba980 20 bucket index object: :.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.6 2024-05-09T09:47:42.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.995+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:97 4.33 4:ccd4db27:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c71001a10 con 0x563c70fc1170 2024-05-09T09:47:42.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.999+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(97 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.6 [stat,call,call] v30'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe1e80eb030 con 0x563c70fc1170 2024-05-09T09:47:42.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:42.999+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 3.25s0 3:a76bdbca:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c71001a10 con 0x563c70fbc780 2024-05-09T09:47:43.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.003+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(98 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1_four [call] v30'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7fe1f0035040 con 0x563c70fbc780 2024-05-09T09:47:43.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.003+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:99 4.33 4:ccd4db27:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c710024a0 con 0x563c70fc1170 2024-05-09T09:47:43.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.003+0000 7fe0ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:43.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.003+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94817593649184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c710024a0 con 0x563c70fbc780 2024-05-09T09:47:43.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.003+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94817593649184] v30'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe1f0035040 con 0x563c70fbc780 2024-05-09T09:47:43.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.003+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94817593631280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c710024a0 con 0x7fe1e000f3d0 2024-05-09T09:47:43.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.003+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(99 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.6 [stat,call,call] v30'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe1e80eb030 con 0x563c70fc1170 2024-05-09T09:47:43.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.003+0000 7fe0d67fc640 20 handle_completion(): completion ok for obj=four 2024-05-09T09:47:43.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.003+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94817593631280] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f0035040 con 0x7fe1e000f3d0 2024-05-09T09:47:43.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.003+0000 7fe1fa7ba980 20 remove_watcher() i=0 2024-05-09T09:47:43.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.003+0000 7fe1fa7ba980 2 removed watcher, disabling cache 2024-05-09T09:47:43.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.007+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94817593634496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c710024a0 con 0x563c70fbc780 2024-05-09T09:47:43.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.007+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94817593634496] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f0035040 con 0x563c70fbc780 2024-05-09T09:47:43.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.007+0000 7fe1fa7ba980 20 remove_watcher() i=1 2024-05-09T09:47:43.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.007+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94817593637200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fcaec0 con 0x563c70fc5ac0 2024-05-09T09:47:43.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.007+0000 7fe1f7ad4640 1 -- 172.21.15.157:0/3763304080 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94817593637200] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1e0048040 con 0x563c70fc5ac0 2024-05-09T09:47:43.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.011+0000 7fe1fa7ba980 20 remove_watcher() i=2 2024-05-09T09:47:43.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.011+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94817593641824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fcaec0 con 0x7fe1e000f3d0 2024-05-09T09:47:43.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.011+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94817593641824] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f0035040 con 0x7fe1e000f3d0 2024-05-09T09:47:43.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.011+0000 7fe1fa7ba980 20 remove_watcher() i=3 2024-05-09T09:47:43.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.011+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94817593628768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fcaec0 con 0x563c70fbc780 2024-05-09T09:47:43.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.011+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94817593628768] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f0035040 con 0x563c70fbc780 2024-05-09T09:47:43.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.011+0000 7fe1fa7ba980 20 remove_watcher() i=4 2024-05-09T09:47:43.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.011+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94817593644496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fcaec0 con 0x563c70fc1170 2024-05-09T09:47:43.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.015+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94817593644496] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1e80eb030 con 0x563c70fc1170 2024-05-09T09:47:43.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.015+0000 7fe1fa7ba980 20 remove_watcher() i=5 2024-05-09T09:47:43.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.015+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94817593648032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fcd5d0 con 0x563c70fc1170 2024-05-09T09:47:43.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.015+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94817593648032] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1e80eb030 con 0x563c70fc1170 2024-05-09T09:47:43.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.015+0000 7fe1fa7ba980 20 remove_watcher() i=6 2024-05-09T09:47:43.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.015+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94817593652160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563c70fcaec0 con 0x563c70fc1170 2024-05-09T09:47:43.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1f82d5640 1 -- 172.21.15.157:0/3763304080 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94817593652160] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1e80eb030 con 0x563c70fc1170 2024-05-09T09:47:43.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 20 remove_watcher() i=7 2024-05-09T09:47:43.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563c70fc1170 msgr2=0x563c70fc3560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 --2- 172.21.15.157:0/3763304080 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563c70fc1170 0x563c70fc3560 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563c70fbc780 msgr2=0x563c70fbec40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 --2- 172.21.15.157:0/3763304080 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563c70fbc780 0x563c70fbec40 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fe1e000f3d0 msgr2=0x7fe1e000f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 --2- 172.21.15.157:0/3763304080 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fe1e000f3d0 0x7fe1e000f7f0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563c70fc5ac0 msgr2=0x563c70fc7ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 --2- 172.21.15.157:0/3763304080 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563c70fc5ac0 0x563c70fc7ef0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe0c0034bb0 msgr2=0x7fe0c0037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 --2- 172.21.15.157:0/3763304080 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe0c0034bb0 0x7fe0c0037070 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0010fd0 tx=0x7fe1e0011000 comp rx=0 tx=0).stop 2024-05-09T09:47:43.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70fa8bf0 msgr2=0x563c70fafd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3763304080 reap_dead start 2024-05-09T09:47:43.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 --2- 172.21.15.157:0/3763304080 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70fa8bf0 0x563c70fafd80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe1e80c7d20 tx=0x7fe1e80a9ec0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 shutdown_connections 2024-05-09T09:47:43.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 --2- 172.21.15.157:0/3763304080 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70fa8bf0 0x563c70fafd80 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 >> 172.21.15.157:0/3763304080 conn(0x563c70fa4f70 msgr2=0x563c70fa25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:43.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 shutdown_connections 2024-05-09T09:47:43.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3763304080 wait complete. 2024-05-09T09:47:43.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3480944531 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe0d0034c00 msgr2=0x7fe0d00370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 --2- 172.21.15.157:0/3480944531 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe0d0034c00 0x7fe0d00370c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x563c70f6da90 tx=0x7fe1e0006000 comp rx=0 tx=0).stop 2024-05-09T09:47:43.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3480944531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70f9bde0 msgr2=0x563c70f9c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 --2- 172.21.15.157:0/3480944531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70f9bde0 0x563c70f9c200 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8000f90 tx=0x7fe1e80e4420 comp rx=0 tx=0).stop 2024-05-09T09:47:43.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3480944531 shutdown_connections 2024-05-09T09:47:43.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 --2- 172.21.15.157:0/3480944531 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe0d0034c00 0x7fe0d00370c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 --2- 172.21.15.157:0/3480944531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70f9bde0 0x563c70f9c200 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3480944531 >> 172.21.15.157:0/3480944531 conn(0x563c70f90bb0 msgr2=0x563c70f916c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:43.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3480944531 shutdown_connections 2024-05-09T09:47:43.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3480944531 wait complete. 2024-05-09T09:47:43.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3952261625 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563c70f6f4e0 msgr2=0x563c70f718d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 --2- 172.21.15.157:0/3952261625 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563c70f6f4e0 0x563c70f718d0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3952261625 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563c70de3390 msgr2=0x563c70f6cc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 --2- 172.21.15.157:0/3952261625 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563c70de3390 0x563c70f6cc30 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3952261625 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563c70f73400 msgr2=0x563c70f757f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 --2- 172.21.15.157:0/3952261625 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563c70f73400 0x563c70f757f0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3952261625 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe0e0034bb0 msgr2=0x7fe0e0037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 --2- 172.21.15.157:0/3952261625 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe0e0034bb0 0x7fe0e0037070 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0000f70 tx=0x7fe1e0001420 comp rx=0 tx=0).stop 2024-05-09T09:47:43.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3952261625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70de1ed0 msgr2=0x563c70f65b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 --2- 172.21.15.157:0/3952261625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c70de1ed0 0x563c70f65b30 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe1e80a4eb0 tx=0x7fe1e8017c50 comp rx=0 tx=0).stop 2024-05-09T09:47:43.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1f8ad6640 1 -- 172.21.15.157:0/3952261625 reap_dead start 2024-05-09T09:47:43.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3952261625 shutdown_connections 2024-05-09T09:47:43.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3952261625 >> 172.21.15.157:0/3952261625 conn(0x563c70e68260 msgr2=0x563c70f591c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:43.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3952261625 shutdown_connections 2024-05-09T09:47:43.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.019+0000 7fe1fa7ba980 1 -- 172.21.15.157:0/3952261625 wait complete. 2024-05-09T09:47:43.028 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-05-09T09:47:43.028 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-05-09T09:47:43.029 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-05-09T09:47:43.106 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:43.107 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:43.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.107+0000 7f01b1039980 1 Processor -- start 2024-05-09T09:47:43.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.107+0000 7f01b1039980 1 -- start start 2024-05-09T09:47:43.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.107+0000 7f01b1039980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x556539937b30 0x556539937f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.111+0000 7f01b1039980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5565397eb440 con 0x556539938450 2024-05-09T09:47:43.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.111+0000 7f01b1039980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5565397d65f0 con 0x556539937b30 2024-05-09T09:47:43.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.111+0000 7f01aeb54640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x556539937b30 0x556539937f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.111+0000 7f01aeb54640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x556539937b30 0x556539937f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59626/0 (socket says 172.21.15.157:59626) 2024-05-09T09:47:43.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.111+0000 7f01aeb54640 1 -- 172.21.15.157:0/626030410 learned_addr learned my addr 172.21.15.157:0/626030410 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:43.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.111+0000 7f01aeb54640 1 -- 172.21.15.157:0/626030410 >> v1:172.21.15.110:6789/0 conn(0x556539938450 legacy=0x556539938e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.111+0000 7f01aeb54640 1 -- 172.21.15.157:0/626030410 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565397e1990 con 0x556539937b30 2024-05-09T09:47:43.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.111+0000 7f01aeb54640 1 --2- 172.21.15.157:0/626030410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539937b30 0x556539937f10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f01a000a5c0 tx=0x7f01a001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e285e9db8164a671 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.111+0000 7f01ae353640 1 -- 172.21.15.157:0/626030410 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a00a6070 con 0x556539937b30 2024-05-09T09:47:43.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.111+0000 7f01ae353640 1 -- 172.21.15.157:0/626030410 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a00af070 con 0x556539937b30 2024-05-09T09:47:43.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.111+0000 7f01ae353640 1 -- 172.21.15.157:0/626030410 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a00aa5c0 con 0x556539937b30 2024-05-09T09:47:43.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.115+0000 7f01b1039980 1 -- 172.21.15.157:0/626030410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539937b30 msgr2=0x556539937f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.115+0000 7f01b1039980 1 --2- 172.21.15.157:0/626030410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539937b30 0x556539937f10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f01a000a5c0 tx=0x7f01a001b340 comp rx=0 tx=0).stop 2024-05-09T09:47:43.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.115+0000 7f01b1039980 1 -- 172.21.15.157:0/626030410 shutdown_connections 2024-05-09T09:47:43.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.115+0000 7f01b1039980 1 --2- 172.21.15.157:0/626030410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539937b30 0x556539937f10 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.115+0000 7f01b1039980 1 -- 172.21.15.157:0/626030410 >> 172.21.15.157:0/626030410 conn(0x5565398ab250 msgr2=0x5565398ab660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:43.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.115+0000 7f01b1039980 1 -- 172.21.15.157:0/626030410 shutdown_connections 2024-05-09T09:47:43.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.115+0000 7f01b1039980 1 -- 172.21.15.157:0/626030410 wait complete. 2024-05-09T09:47:43.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.127+0000 7f01b1039980 1 Processor -- start 2024-05-09T09:47:43.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.127+0000 7f01b1039980 1 -- start start 2024-05-09T09:47:43.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.127+0000 7f01b1039980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539937b30 0x556539a233d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.127+0000 7f01b1039980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x556539838fe0 con 0x556539937b30 2024-05-09T09:47:43.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.127+0000 7f01aeb54640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539937b30 0x556539a233d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.127+0000 7f01aeb54640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539937b30 0x556539a233d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59632/0 (socket says 172.21.15.157:59632) 2024-05-09T09:47:43.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.127+0000 7f01aeb54640 1 -- 172.21.15.157:0/254061962 learned_addr learned my addr 172.21.15.157:0/254061962 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:43.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.127+0000 7f01aeb54640 1 -- 172.21.15.157:0/254061962 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565397bdae0 con 0x556539937b30 2024-05-09T09:47:43.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.127+0000 7f01aeb54640 1 --2- 172.21.15.157:0/254061962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539937b30 0x556539a233d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f01a0018f70 tx=0x7f01a0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7be65eaeb8811 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.127+0000 7f009ce09640 1 -- 172.21.15.157:0/254061962 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a00aa9e0 con 0x556539937b30 2024-05-09T09:47:43.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.127+0000 7f009ce09640 1 -- 172.21.15.157:0/254061962 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a00aab80 con 0x556539937b30 2024-05-09T09:47:43.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.127+0000 7f009ce09640 1 -- 172.21.15.157:0/254061962 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a00aae60 con 0x556539937b30 2024-05-09T09:47:43.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.131+0000 7f01b1039980 1 -- 172.21.15.157:0/254061962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539937b30 msgr2=0x556539a233d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.131+0000 7f01b1039980 1 --2- 172.21.15.157:0/254061962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539937b30 0x556539a233d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f01a0018f70 tx=0x7f01a0003030 comp rx=0 tx=0).stop 2024-05-09T09:47:43.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.131+0000 7f01b1039980 1 -- 172.21.15.157:0/254061962 shutdown_connections 2024-05-09T09:47:43.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.131+0000 7f01b1039980 1 --2- 172.21.15.157:0/254061962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539937b30 0x556539a233d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.131+0000 7f01b1039980 1 -- 172.21.15.157:0/254061962 >> 172.21.15.157:0/254061962 conn(0x5565398ab250 msgr2=0x556539a1ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:43.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.131+0000 7f01b1039980 1 -- 172.21.15.157:0/254061962 shutdown_connections 2024-05-09T09:47:43.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.131+0000 7f01b1039980 1 -- 172.21.15.157:0/254061962 wait complete. 2024-05-09T09:47:43.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.131+0000 7f01b1039980 1 Processor -- start 2024-05-09T09:47:43.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.131+0000 7f01b1039980 1 -- start start 2024-05-09T09:47:43.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.131+0000 7f01b1039980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539937b30 0x556539a2a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.131+0000 7f01b1039980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x556539941b70 con 0x556539937b30 2024-05-09T09:47:43.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.131+0000 7f01aeb54640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539937b30 0x556539a2a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.131+0000 7f01aeb54640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539937b30 0x556539a2a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59642/0 (socket says 172.21.15.157:59642) 2024-05-09T09:47:43.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.131+0000 7f01aeb54640 1 -- 172.21.15.157:0/4214263430 learned_addr learned my addr 172.21.15.157:0/4214263430 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:43.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.131+0000 7f01aeb54640 1 -- 172.21.15.157:0/4214263430 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556539a2a970 con 0x556539937b30 2024-05-09T09:47:43.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.131+0000 7f01aeb54640 1 --2- 172.21.15.157:0/4214263430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539937b30 0x556539a2a430 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f01a001b170 tx=0x7f01a00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.131+0000 7f009b606640 1 -- 172.21.15.157:0/4214263430 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a00bd7c0 con 0x556539937b30 2024-05-09T09:47:43.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.131+0000 7f01b1039980 1 -- 172.21.15.157:0/4214263430 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556539a2ac00 con 0x556539937b30 2024-05-09T09:47:43.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.131+0000 7f009b606640 1 -- 172.21.15.157:0/4214263430 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a00bd960 con 0x556539937b30 2024-05-09T09:47:43.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.131+0000 7f009b606640 1 -- 172.21.15.157:0/4214263430 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a00bdc40 con 0x556539937b30 2024-05-09T09:47:43.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.131+0000 7f01b1039980 1 -- 172.21.15.157:0/4214263430 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556539a2d890 con 0x556539937b30 2024-05-09T09:47:43.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.135+0000 7f009b606640 1 -- 172.21.15.157:0/4214263430 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f01a00ce030 con 0x556539937b30 2024-05-09T09:47:43.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.135+0000 7f009b606640 1 --2- 172.21.15.157:0/4214263430 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0094034bb0 0x7f0094037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.135+0000 7f009b606640 1 -- 172.21.15.157:0/4214263430 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f01a00cc020 con 0x556539937b30 2024-05-09T09:47:43.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.135+0000 7f01a7fff640 1 --2- 172.21.15.157:0/4214263430 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0094034bb0 0x7f0094037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.135+0000 7f01b1039980 1 --2- 172.21.15.157:0/4214263430 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x556539938450 0x556539a314e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.135+0000 7f01b1039980 1 -- 172.21.15.157:0/4214263430 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539a31a60 con 0x556539938450 2024-05-09T09:47:43.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.135+0000 7f01af355640 1 --2- 172.21.15.157:0/4214263430 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x556539938450 0x556539a314e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.135+0000 7f01a7fff640 1 --2- 172.21.15.157:0/4214263430 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0094034bb0 0x7f0094037070 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0198000f70 tx=0x7f0198001420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.135+0000 7f01af355640 1 --2- 172.21.15.157:0/4214263430 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x556539938450 0x556539a314e0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.135+0000 7f01af355640 1 -- 172.21.15.157:0/4214263430 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539938450 2024-05-09T09:47:43.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.135+0000 7f01b1039980 1 -- 172.21.15.157:0/4214263430 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539a2eab0 con 0x556539938450 2024-05-09T09:47:43.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.135+0000 7f01af355640 1 -- 172.21.15.157:0/4214263430 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539938450 2024-05-09T09:47:43.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.135+0000 7f01b1039980 1 --2- 172.21.15.157:0/4214263430 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x556539a33de0 0x556539a361d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.135+0000 7f01b1039980 1 -- 172.21.15.157:0/4214263430 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539a368a0 con 0x556539a33de0 2024-05-09T09:47:43.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.135+0000 7f01aeb54640 1 --2- 172.21.15.157:0/4214263430 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x556539a33de0 0x556539a361d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.135+0000 7f01aeb54640 1 --2- 172.21.15.157:0/4214263430 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x556539a33de0 0x556539a361d0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.135+0000 7f01aeb54640 1 -- 172.21.15.157:0/4214263430 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f01a00c6d20 con 0x556539a33de0 2024-05-09T09:47:43.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.135+0000 7f01b1039980 1 -- 172.21.15.157:0/4214263430 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539a32c80 con 0x556539938450 2024-05-09T09:47:43.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.139+0000 7f01af355640 1 -- 172.21.15.157:0/4214263430 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539938450 2024-05-09T09:47:43.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.139+0000 7f01b1039980 1 --2- 172.21.15.157:0/4214263430 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x556539a37d00 0x556539a3a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.139+0000 7f01b1039980 1 -- 172.21.15.157:0/4214263430 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539a3a7f0 con 0x556539a37d00 2024-05-09T09:47:43.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.139+0000 7f01a7fff640 1 --2- 172.21.15.157:0/4214263430 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x556539a37d00 0x556539a3a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.139+0000 7f01a7fff640 1 --2- 172.21.15.157:0/4214263430 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x556539a37d00 0x556539a3a0f0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.139+0000 7f01a7fff640 1 -- 172.21.15.157:0/4214263430 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f019800d040 con 0x556539a37d00 2024-05-09T09:47:43.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.143+0000 7f01b1039980 1 Processor -- start 2024-05-09T09:47:43.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.143+0000 7f01b1039980 1 -- start start 2024-05-09T09:47:43.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.143+0000 7f01b1039980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539a606e0 0x556539a60b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.143+0000 7f01b1039980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55653983d020 con 0x556539a606e0 2024-05-09T09:47:43.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.143+0000 7f01aeb54640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539a606e0 0x556539a60b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.143+0000 7f01aeb54640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539a606e0 0x556539a60b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59650/0 (socket says 172.21.15.157:59650) 2024-05-09T09:47:43.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.143+0000 7f01aeb54640 1 -- 172.21.15.157:0/1086231650 learned_addr learned my addr 172.21.15.157:0/1086231650 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:43.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.143+0000 7f01aeb54640 1 -- 172.21.15.157:0/1086231650 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556539a61040 con 0x556539a606e0 2024-05-09T09:47:43.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.143+0000 7f01aeb54640 1 --2- 172.21.15.157:0/1086231650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539a606e0 0x556539a60b00 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f01a00cf710 tx=0x7f01a00c9df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.147+0000 7f00937fe640 1 -- 172.21.15.157:0/1086231650 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a00cfd40 con 0x556539a606e0 2024-05-09T09:47:43.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.147+0000 7f00937fe640 1 -- 172.21.15.157:0/1086231650 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a00e9070 con 0x556539a606e0 2024-05-09T09:47:43.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.147+0000 7f01b1039980 1 -- 172.21.15.157:0/1086231650 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556539a61ad0 con 0x556539a606e0 2024-05-09T09:47:43.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.147+0000 7f00937fe640 1 -- 172.21.15.157:0/1086231650 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a00c65d0 con 0x556539a606e0 2024-05-09T09:47:43.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.147+0000 7f01b1039980 1 -- 172.21.15.157:0/1086231650 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556539a61fb0 con 0x556539a606e0 2024-05-09T09:47:43.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.147+0000 7f00937fe640 1 -- 172.21.15.157:0/1086231650 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f01a00eb020 con 0x556539a606e0 2024-05-09T09:47:43.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.147+0000 7f00937fe640 1 --2- 172.21.15.157:0/1086231650 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0088034bb0 0x7f0088037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.147+0000 7f00937fe640 1 -- 172.21.15.157:0/1086231650 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f01a00de0a0 con 0x556539a606e0 2024-05-09T09:47:43.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.147+0000 7f01a7fff640 1 --2- 172.21.15.157:0/1086231650 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0088034bb0 0x7f0088037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.147+0000 7f01b1039980 1 Processor -- start 2024-05-09T09:47:43.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.147+0000 7f01b1039980 1 -- start start 2024-05-09T09:47:43.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.147+0000 7f01a7fff640 1 --2- 172.21.15.157:0/1086231650 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0088034bb0 0x7f0088037070 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x556539a32390 tx=0x7f0198006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.147+0000 7f01b1039980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539a6d6d0 0x556539a6daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.147+0000 7f01b1039980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x556539a23a60 con 0x556539a6d6d0 2024-05-09T09:47:43.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.147+0000 7f01aeb54640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539a6d6d0 0x556539a6daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.147+0000 7f01aeb54640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539a6d6d0 0x556539a6daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59664/0 (socket says 172.21.15.157:59664) 2024-05-09T09:47:43.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.147+0000 7f01aeb54640 1 -- 172.21.15.157:0/2217255247 learned_addr learned my addr 172.21.15.157:0/2217255247 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:43.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.147+0000 7f01aeb54640 1 -- 172.21.15.157:0/2217255247 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556539a6e0c0 con 0x556539a6d6d0 2024-05-09T09:47:43.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.147+0000 7f01aeb54640 1 --2- 172.21.15.157:0/2217255247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539a6d6d0 0x556539a6daf0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f01a00e7fd0 tx=0x7f01a00dca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68113b4ee68ad6d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.147+0000 7f00917fa640 1 -- 172.21.15.157:0/2217255247 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a00ed410 con 0x556539a6d6d0 2024-05-09T09:47:43.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.147+0000 7f00917fa640 1 -- 172.21.15.157:0/2217255247 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a00c7590 con 0x556539a6d6d0 2024-05-09T09:47:43.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.147+0000 7f00917fa640 1 -- 172.21.15.157:0/2217255247 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a00c9070 con 0x556539a6d6d0 2024-05-09T09:47:43.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.151+0000 7f01b1039980 1 -- 172.21.15.157:0/2217255247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539a6d6d0 msgr2=0x556539a6daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.151+0000 7f01b1039980 1 --2- 172.21.15.157:0/2217255247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539a6d6d0 0x556539a6daf0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f01a00e7fd0 tx=0x7f01a00dca00 comp rx=0 tx=0).stop 2024-05-09T09:47:43.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.151+0000 7f01b1039980 1 -- 172.21.15.157:0/2217255247 shutdown_connections 2024-05-09T09:47:43.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.151+0000 7f01b1039980 1 --2- 172.21.15.157:0/2217255247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539a6d6d0 0x556539a6daf0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.151+0000 7f01b1039980 1 -- 172.21.15.157:0/2217255247 >> 172.21.15.157:0/2217255247 conn(0x556539a69a50 msgr2=0x556539a67ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:43.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.151+0000 7f01b1039980 1 -- 172.21.15.157:0/2217255247 shutdown_connections 2024-05-09T09:47:43.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.151+0000 7f01b1039980 1 -- 172.21.15.157:0/2217255247 wait complete. 2024-05-09T09:47:43.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.151+0000 7f01b1039980 1 Processor -- start 2024-05-09T09:47:43.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.151+0000 7f01b1039980 1 -- start start 2024-05-09T09:47:43.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.151+0000 7f01b1039980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539a6d6d0 0x556539a74aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.151+0000 7f01b1039980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x556539a6e7a0 con 0x556539a6d6d0 2024-05-09T09:47:43.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.151+0000 7f01aeb54640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539a6d6d0 0x556539a74aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.151+0000 7f01aeb54640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539a6d6d0 0x556539a74aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59668/0 (socket says 172.21.15.157:59668) 2024-05-09T09:47:43.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.151+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 learned_addr learned my addr 172.21.15.157:0/1593453837 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:43.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.151+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556539a74fe0 con 0x556539a6d6d0 2024-05-09T09:47:43.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.151+0000 7f01aeb54640 1 --2- 172.21.15.157:0/1593453837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539a6d6d0 0x556539a74aa0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f01a00dc990 tx=0x7f01a00daf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.151+0000 7f007f7fe640 1 -- 172.21.15.157:0/1593453837 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a00ed410 con 0x556539a6d6d0 2024-05-09T09:47:43.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.151+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556539a74fe0 con 0x556539a6d6d0 2024-05-09T09:47:43.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.151+0000 7f007f7fe640 1 -- 172.21.15.157:0/1593453837 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a00c6950 con 0x556539a6d6d0 2024-05-09T09:47:43.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.151+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556539a74fe0 con 0x556539a6d6d0 2024-05-09T09:47:43.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.151+0000 7f007f7fe640 1 -- 172.21.15.157:0/1593453837 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a00bfd90 con 0x556539a6d6d0 2024-05-09T09:47:43.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.151+0000 7f01b1039980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.151+0000 7f007f7fe640 1 -- 172.21.15.157:0/1593453837 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f01a00ed5d0 con 0x556539a6d6d0 2024-05-09T09:47:43.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.151+0000 7f007f7fe640 1 --2- 172.21.15.157:0/1593453837 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0078034bb0 0x7f0078037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.151+0000 7f007f7fe640 1 -- 172.21.15.157:0/1593453837 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f01a00fb9d0 con 0x556539a6d6d0 2024-05-09T09:47:43.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.151+0000 7f01a7fff640 1 --2- 172.21.15.157:0/1593453837 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0078034bb0 0x7f0078037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01b1039980 1 --2- 172.21.15.157:0/1593453837 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x556539a81500 0x556539a839c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539a84110 con 0x556539a81500 2024-05-09T09:47:43.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01af355640 1 --2- 172.21.15.157:0/1593453837 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x556539a81500 0x556539a839c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01a7fff640 1 --2- 172.21.15.157:0/1593453837 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0078034bb0 0x7f0078037070 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x556539a3abf0 tx=0x7f0198011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01af355640 1 --2- 172.21.15.157:0/1593453837 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x556539a81500 0x556539a839c0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01b1039980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:43.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01b1039980 20 realm 2024-05-09T09:47:43.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01b1039980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539a84570 con 0x556539a81500 2024-05-09T09:47:43.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01b1039980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:43.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01b1039980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:43.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01b1039980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539a84e10 con 0x556539a81500 2024-05-09T09:47:43.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01b1039980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:43.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01b1039980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x556539a81500 2024-05-09T09:47:43.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01b1039980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:43.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01b1039980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01b1039980 1 --2- 172.21.15.157:0/1593453837 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x556539a85f10 0x556539a88300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539a88880 con 0x556539a85f10 2024-05-09T09:47:43.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01aeb54640 1 --2- 172.21.15.157:0/1593453837 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x556539a85f10 0x556539a88300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01aeb54640 1 --2- 172.21.15.157:0/1593453837 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x556539a85f10 0x556539a88300 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01b1039980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:43.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01b1039980 20 searching for the correct realm 2024-05-09T09:47:43.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01b1039980 1 --2- 172.21.15.157:0/1593453837 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x556539a8a7b0 0x556539a8cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a8d320 con 0x556539a8a7b0 2024-05-09T09:47:43.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01a7fff640 1 --2- 172.21.15.157:0/1593453837 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x556539a8a7b0 0x556539a8cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.155+0000 7f01a7fff640 1 --2- 172.21.15.157:0/1593453837 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x556539a8a7b0 0x556539a8cc50 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.159+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0198036040 con 0x556539a8a7b0 2024-05-09T09:47:43.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.159+0000 7f01a7fff640 1 --2- 172.21.15.157:0/1593453837 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f019800f3d0 0x7f019800f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.159+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a8d320 con 0x7f019800f3d0 2024-05-09T09:47:43.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.159+0000 7f01af355640 1 --2- 172.21.15.157:0/1593453837 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f019800f3d0 0x7f019800f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.159+0000 7f01af355640 1 --2- 172.21.15.157:0/1593453837 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f019800f3d0 0x7f019800f7f0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.159+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a800a4d0 con 0x7f019800f3d0 2024-05-09T09:47:43.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.159+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x556539a85f10 2024-05-09T09:47:43.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.159+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.159+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x556539a81500 2024-05-09T09:47:43.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.159+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.159+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x556539a81500 2024-05-09T09:47:43.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.159+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.159+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x556539a85f10 2024-05-09T09:47:43.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.159+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.159+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x556539a85f10 2024-05-09T09:47:43.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.159+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.159+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x7f019800f3d0 2024-05-09T09:47:43.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.159+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a800a4d0 con 0x7f019800f3d0 2024-05-09T09:47:43.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.159+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x556539a8a7b0 2024-05-09T09:47:43.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.159+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0198036040 con 0x556539a8a7b0 2024-05-09T09:47:43.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.159+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x556539a81500 2024-05-09T09:47:43.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.163+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.163+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x556539a85f10 2024-05-09T09:47:43.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.163+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.163+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x556539a81500 2024-05-09T09:47:43.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.163+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.163+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x7f019800f3d0 2024-05-09T09:47:43.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.163+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f01a800a4d0 con 0x7f019800f3d0 2024-05-09T09:47:43.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.163+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x556539a8a7b0 2024-05-09T09:47:43.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.163+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0198036040 con 0x556539a8a7b0 2024-05-09T09:47:43.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.163+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x556539a8a7b0 2024-05-09T09:47:43.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.163+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0198036040 con 0x556539a8a7b0 2024-05-09T09:47:43.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.163+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x556539a85f10 2024-05-09T09:47:43.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.163+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.163+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x556539a8a7b0 2024-05-09T09:47:43.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.163+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0198036040 con 0x556539a8a7b0 2024-05-09T09:47:43.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.163+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x556539a8a7b0 2024-05-09T09:47:43.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.163+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0198036040 con 0x556539a8a7b0 2024-05-09T09:47:43.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.163+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x556539a81500 2024-05-09T09:47:43.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.163+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.163+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x556539a81500 2024-05-09T09:47:43.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.163+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.163+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x556539a85f10 2024-05-09T09:47:43.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.167+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.167+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x556539a8a7b0 2024-05-09T09:47:43.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.167+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0198036040 con 0x556539a8a7b0 2024-05-09T09:47:43.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.167+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x7f019800f3d0 2024-05-09T09:47:43.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.167+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a800a4d0 con 0x7f019800f3d0 2024-05-09T09:47:43.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.167+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x556539a81500 2024-05-09T09:47:43.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.167+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.167+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x556539a85f10 2024-05-09T09:47:43.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.167+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.167+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x556539a8a7b0 2024-05-09T09:47:43.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.167+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0198036040 con 0x556539a8a7b0 2024-05-09T09:47:43.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.167+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x556539a85f10 2024-05-09T09:47:43.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x7f019800f3d0 2024-05-09T09:47:43.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a800a4d0 con 0x7f019800f3d0 2024-05-09T09:47:43.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x556539a8a7b0 2024-05-09T09:47:43.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0198049040 con 0x556539a8a7b0 2024-05-09T09:47:43.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x556539a85f10 2024-05-09T09:47:43.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x556539a81500 2024-05-09T09:47:43.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556539a851b0 con 0x7f019800f3d0 2024-05-09T09:47:43.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a800a4d0 con 0x7f019800f3d0 2024-05-09T09:47:43.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01b1039980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:43.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01b1039980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:43.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01b1039980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:43.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01b1039980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:43.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01b1039980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:43.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01b1039980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:43.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01b1039980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539a890d0 con 0x556539a81500 2024-05-09T09:47:43.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01b1039980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:43.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01b1039980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539a890d0 con 0x556539a81500 2024-05-09T09:47:43.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01b1039980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:43.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01b1039980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539a890d0 con 0x556539a8a7b0 2024-05-09T09:47:43.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0198049040 con 0x556539a8a7b0 2024-05-09T09:47:43.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01b1039980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:43.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01b1039980 20 zone default found 2024-05-09T09:47:43.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01b1039980 4 Realm: () 2024-05-09T09:47:43.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01b1039980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:43.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01b1039980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:43.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01b1039980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:43.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01b1039980 20 zonegroup default 2024-05-09T09:47:43.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01b1039980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.171+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539a89970 con 0x556539a85f10 2024-05-09T09:47:43.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.175+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.175+0000 7f01b1039980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:43.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.175+0000 7f01b1039980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.175+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539a8f180 con 0x556539a8a7b0 2024-05-09T09:47:43.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.175+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0198049040 con 0x556539a8a7b0 2024-05-09T09:47:43.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.175+0000 7f01b1039980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:43.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.175+0000 7f01b1039980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.175+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539a8f520 con 0x556539a8a7b0 2024-05-09T09:47:43.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.175+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0198049040 con 0x556539a8a7b0 2024-05-09T09:47:43.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.175+0000 7f01b1039980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:43.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.175+0000 7f01b1039980 20 started sync module instance, tier type = 2024-05-09T09:47:43.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.175+0000 7f01b1039980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:43.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.175+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539a8e620 con 0x7f019800f3d0 2024-05-09T09:47:43.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.175+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x7f019800f3d0 2024-05-09T09:47:43.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.175+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93893247429408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539a8e620 con 0x7f019800f3d0 2024-05-09T09:47:43.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.175+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539a8ff20 con 0x556539a81500 2024-05-09T09:47:43.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.175+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93893247429408] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x7f019800f3d0 2024-05-09T09:47:43.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.175+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.175+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93893247433264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539a8e620 con 0x556539a81500 2024-05-09T09:47:43.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.175+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539a90930 con 0x556539a8a7b0 2024-05-09T09:47:43.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.179+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93893247433264] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.179+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0198049040 con 0x556539a8a7b0 2024-05-09T09:47:43.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.179+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93893247426928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539a8e590 con 0x556539a8a7b0 2024-05-09T09:47:43.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.179+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539a91700 con 0x7f019800f3d0 2024-05-09T09:47:43.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.179+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x7f019800f3d0 2024-05-09T09:47:43.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.179+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93893247439312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539a916c0 con 0x7f019800f3d0 2024-05-09T09:47:43.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.179+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539a925c0 con 0x556539a81500 2024-05-09T09:47:43.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.183+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93893247439312] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x7f019800f3d0 2024-05-09T09:47:43.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.183+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93893247426928] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0198049040 con 0x556539a8a7b0 2024-05-09T09:47:43.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.183+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.183+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93893247438112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539a92110 con 0x556539a81500 2024-05-09T09:47:43.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.183+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539a92e90 con 0x556539a85f10 2024-05-09T09:47:43.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.183+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93893247438112] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.183+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.183+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93893247445472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539a92110 con 0x556539a85f10 2024-05-09T09:47:43.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.183+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539a936e0 con 0x556539a85f10 2024-05-09T09:47:43.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.187+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93893247445472] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.187+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.187+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93893247440848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539a93f30 con 0x556539a85f10 2024-05-09T09:47:43.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.187+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539a947c0 con 0x556539a85f10 2024-05-09T09:47:43.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.187+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93893247440848] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.187+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.187+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93893247449728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539a94350 con 0x556539a85f10 2024-05-09T09:47:43.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.187+0000 7f01b1039980 20 add_watcher() i=0 2024-05-09T09:47:43.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.187+0000 7f01b1039980 20 add_watcher() i=1 2024-05-09T09:47:43.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.187+0000 7f01b1039980 20 add_watcher() i=2 2024-05-09T09:47:43.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.187+0000 7f01b1039980 20 add_watcher() i=3 2024-05-09T09:47:43.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.187+0000 7f01b1039980 20 add_watcher() i=4 2024-05-09T09:47:43.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.187+0000 7f01b1039980 20 add_watcher() i=5 2024-05-09T09:47:43.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.187+0000 7f01b1039980 20 add_watcher() i=6 2024-05-09T09:47:43.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.191+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93893247449728] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.191+0000 7f01b1039980 20 add_watcher() i=7 2024-05-09T09:47:43.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.191+0000 7f01b1039980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:43.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.191+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539a97c40 con 0x556539a81500 2024-05-09T09:47:43.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.191+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.191+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93893247451248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539a950f0 con 0x556539a81500 2024-05-09T09:47:43.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.191+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93893247451248] v30'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.191+0000 7f005f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:43.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.191+0000 7f01b1039980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:43.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.191+0000 7f01b1039980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:43.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.191+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa02e0 con 0x556539a81500 2024-05-09T09:47:43.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.195+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'64 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.195+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa0850 con 0x556539a85f10 2024-05-09T09:47:43.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.195+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'59 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.195+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa0850 con 0x556539a8a7b0 2024-05-09T09:47:43.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.195+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'58 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0198049040 con 0x556539a8a7b0 2024-05-09T09:47:43.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.195+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa0de0 con 0x556539a81500 2024-05-09T09:47:43.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.199+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'265 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.199+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa1290 con 0x7f019800f3d0 2024-05-09T09:47:43.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.199+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'164 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x7f019800f3d0 2024-05-09T09:47:43.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.199+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa1650 con 0x556539a8a7b0 2024-05-09T09:47:43.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.199+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'110 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0198049040 con 0x556539a8a7b0 2024-05-09T09:47:43.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.199+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa1bc0 con 0x556539a81500 2024-05-09T09:47:43.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.203+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'60 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.203+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa2070 con 0x556539a85f10 2024-05-09T09:47:43.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.203+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'109 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.203+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa2070 con 0x7f019800f3d0 2024-05-09T09:47:43.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.207+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'58 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x7f019800f3d0 2024-05-09T09:47:43.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.207+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa2070 con 0x556539a8a7b0 2024-05-09T09:47:43.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.207+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'64 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0198049040 con 0x556539a8a7b0 2024-05-09T09:47:43.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.207+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa25e0 con 0x7f019800f3d0 2024-05-09T09:47:43.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.207+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'165 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x7f019800f3d0 2024-05-09T09:47:43.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.207+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa25e0 con 0x556539a85f10 2024-05-09T09:47:43.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.211+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'60 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.211+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa25e0 con 0x7f019800f3d0 2024-05-09T09:47:43.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.211+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'58 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x7f019800f3d0 2024-05-09T09:47:43.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.211+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa25e0 con 0x556539a85f10 2024-05-09T09:47:43.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.215+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'115 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.215+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa25e0 con 0x556539a81500 2024-05-09T09:47:43.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.215+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'266 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.215+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa25e0 con 0x556539a8a7b0 2024-05-09T09:47:43.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.219+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'158 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0198049040 con 0x556539a8a7b0 2024-05-09T09:47:43.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.219+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa28c0 con 0x7f019800f3d0 2024-05-09T09:47:43.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.219+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'166 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x7f019800f3d0 2024-05-09T09:47:43.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.219+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa28c0 con 0x556539a8a7b0 2024-05-09T09:47:43.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.219+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'58 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0198049040 con 0x556539a8a7b0 2024-05-09T09:47:43.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.219+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa28c0 con 0x556539a81500 2024-05-09T09:47:43.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.223+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'66 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.223+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa28c0 con 0x556539a81500 2024-05-09T09:47:43.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.223+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'267 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.223+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa28c0 con 0x556539a8a7b0 2024-05-09T09:47:43.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.227+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'159 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0198049040 con 0x556539a8a7b0 2024-05-09T09:47:43.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.227+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa2950 con 0x7f019800f3d0 2024-05-09T09:47:43.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.227+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'68 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x7f019800f3d0 2024-05-09T09:47:43.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.227+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa2950 con 0x556539a8a7b0 2024-05-09T09:47:43.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.227+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'60 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0198049040 con 0x556539a8a7b0 2024-05-09T09:47:43.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.227+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa2950 con 0x556539a8a7b0 2024-05-09T09:47:43.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.231+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'64 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0198049040 con 0x556539a8a7b0 2024-05-09T09:47:43.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.231+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa2950 con 0x556539a8a7b0 2024-05-09T09:47:43.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.231+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'54 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0198049040 con 0x556539a8a7b0 2024-05-09T09:47:43.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.231+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa2950 con 0x556539a8a7b0 2024-05-09T09:47:43.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.231+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'111 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0198049040 con 0x556539a8a7b0 2024-05-09T09:47:43.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.231+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa2950 con 0x556539a85f10 2024-05-09T09:47:43.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.235+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'60 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.235+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa2950 con 0x556539a8a7b0 2024-05-09T09:47:43.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.239+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'58 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0198049040 con 0x556539a8a7b0 2024-05-09T09:47:43.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.239+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa2950 con 0x556539a85f10 2024-05-09T09:47:43.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.239+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'110 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.239+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa2950 con 0x556539a8a7b0 2024-05-09T09:47:43.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.243+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'160 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0198049040 con 0x556539a8a7b0 2024-05-09T09:47:43.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.243+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa2950 con 0x556539a85f10 2024-05-09T09:47:43.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.247+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'116 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.247+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539aa2950 con 0x7f019800f3d0 2024-05-09T09:47:43.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.247+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'64 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x7f019800f3d0 2024-05-09T09:47:43.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.247+0000 7f005e7fc640 20 reqs_thread_entry: start 2024-05-09T09:47:43.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.247+0000 7f01b1039980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:43.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.247+0000 7effcffff640 20 reqs_thread_entry: start 2024-05-09T09:47:43.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.247+0000 7f01b1039980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.247+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539abe5f0 con 0x7f019800f3d0 2024-05-09T09:47:43.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f01a800a4d0 con 0x7f019800f3d0 2024-05-09T09:47:43.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01b1039980 20 rados_obj.operate() r=0 bl.length=165 2024-05-09T09:47:43.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01b1039980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 8.5 8:a7233c95:root::.bucket.meta.myfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539abee80 con 0x556539a81500 2024-05-09T09:47:43.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(95 .bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01b1039980 20 rados_obj.operate() r=0 bl.length=379 2024-05-09T09:47:43.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01b1039980 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-09T09:47:43.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01b1039980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:96 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539abf030 con 0x7f019800f3d0 2024-05-09T09:47:43.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(96 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f01a800a4d0 con 0x7f019800f3d0 2024-05-09T09:47:43.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01b1039980 20 rados_obj.operate() r=0 bl.length=165 2024-05-09T09:47:43.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01b1039980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 8.5 8:a7233c95:root::.bucket.meta.myfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539a9e610 con 0x556539a81500 2024-05-09T09:47:43.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(97 .bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01b1039980 20 rados_obj.operate() r=0 bl.length=379 2024-05-09T09:47:43.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01b1039980 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-09T09:47:43.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:98 4.b 4:d25ceb2d:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539ac1920 con 0x7f019800f3d0 2024-05-09T09:47:43.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:99 4.3 4:c0b28912:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539ac4460 con 0x556539a81500 2024-05-09T09:47:43.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:100 4.4 4:20a0679d:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539ac4460 con 0x556539a85f10 2024-05-09T09:47:43.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:101 4.26 4:6777fe5e:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539ac94f0 con 0x556539a85f10 2024-05-09T09:47:43.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 4.3 4:c063be13:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539acbea0 con 0x556539a81500 2024-05-09T09:47:43.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 4.31 4:8f008dfd:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539aced10 con 0x556539a81500 2024-05-09T09:47:43.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 4.33 4:ccd4db27:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539ad1a90 con 0x556539a85f10 2024-05-09T09:47:43.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:105 4.1d 4:bb2bb3ce:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539aced10 con 0x556539a8a7b0 2024-05-09T09:47:43.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:106 4.36 4:6fb2fa4a:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539ad6be0 con 0x556539a81500 2024-05-09T09:47:43.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(98 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01a800a4d0 con 0x7f019800f3d0 2024-05-09T09:47:43.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(99 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:107 4.17 4:ea8823bf:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539aced10 con 0x556539a85f10 2024-05-09T09:47:43.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:108 4.3a 4:5f6cb505:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556539ad7070 con 0x556539a8a7b0 2024-05-09T09:47:43.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(105 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0198049040 con 0x556539a8a7b0 2024-05-09T09:47:43.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(102 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.4 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(103 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(106 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.8 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(108 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0198049040 con 0x556539a8a7b0 2024-05-09T09:47:43.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(100 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(101 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(104 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.6 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.251+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(107 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.255+0000 7f005f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:43.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.255+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:109 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93893247451248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539a9db00 con 0x556539a81500 2024-05-09T09:47:43.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.255+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(109 data_loggenerations_metadata [watch unwatch cookie 93893247451248] v30'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.255+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:110 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93893247429408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539a9d3e0 con 0x7f019800f3d0 2024-05-09T09:47:43.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.255+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(110 notify.0 [watch unwatch cookie 93893247429408] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x7f019800f3d0 2024-05-09T09:47:43.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.255+0000 7f01b1039980 20 remove_watcher() i=0 2024-05-09T09:47:43.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.255+0000 7f01b1039980 2 removed watcher, disabling cache 2024-05-09T09:47:43.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.255+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:111 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93893247433264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539a8e9c0 con 0x556539a81500 2024-05-09T09:47:43.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.259+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(111 notify.1 [watch unwatch cookie 93893247433264] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.259+0000 7f01b1039980 20 remove_watcher() i=1 2024-05-09T09:47:43.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.259+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:112 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93893247426928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539a8fa30 con 0x556539a8a7b0 2024-05-09T09:47:43.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.259+0000 7f01a7fff640 1 -- 172.21.15.157:0/1593453837 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== osd_op_reply(112 notify.2 [watch unwatch cookie 93893247426928] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0198049040 con 0x556539a8a7b0 2024-05-09T09:47:43.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.259+0000 7f01b1039980 20 remove_watcher() i=2 2024-05-09T09:47:43.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.259+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:113 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93893247439312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539a8fa30 con 0x7f019800f3d0 2024-05-09T09:47:43.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.259+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(113 notify.3 [watch unwatch cookie 93893247439312] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x7f019800f3d0 2024-05-09T09:47:43.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.259+0000 7f01b1039980 20 remove_watcher() i=3 2024-05-09T09:47:43.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.259+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:114 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93893247438112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539a911d0 con 0x556539a81500 2024-05-09T09:47:43.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.263+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(114 notify.4 [watch unwatch cookie 93893247438112] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a800a4d0 con 0x556539a81500 2024-05-09T09:47:43.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.263+0000 7f01b1039980 20 remove_watcher() i=4 2024-05-09T09:47:43.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.263+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:115 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93893247445472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539a8fa30 con 0x556539a85f10 2024-05-09T09:47:43.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.263+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(115 notify.5 [watch unwatch cookie 93893247445472] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.263+0000 7f01b1039980 20 remove_watcher() i=5 2024-05-09T09:47:43.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.263+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:116 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93893247440848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539a90d20 con 0x556539a85f10 2024-05-09T09:47:43.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.267+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(116 notify.6 [watch unwatch cookie 93893247440848] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.267+0000 7f01b1039980 20 remove_watcher() i=6 2024-05-09T09:47:43.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.267+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:117 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93893247449728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556539a929e0 con 0x556539a85f10 2024-05-09T09:47:43.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.267+0000 7f01aeb54640 1 -- 172.21.15.157:0/1593453837 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(117 notify.7 [watch unwatch cookie 93893247449728] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a0107020 con 0x556539a85f10 2024-05-09T09:47:43.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.267+0000 7f01b1039980 20 remove_watcher() i=7 2024-05-09T09:47:43.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.267+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x556539a85f10 msgr2=0x556539a88300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.267+0000 7f01b1039980 1 --2- 172.21.15.157:0/1593453837 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x556539a85f10 0x556539a88300 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.267+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x556539a81500 msgr2=0x556539a839c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.267+0000 7f01b1039980 1 --2- 172.21.15.157:0/1593453837 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x556539a81500 0x556539a839c0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.267+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f019800f3d0 msgr2=0x7f019800f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.267+0000 7f01b1039980 1 --2- 172.21.15.157:0/1593453837 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f019800f3d0 0x7f019800f7f0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.267+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x556539a8a7b0 msgr2=0x556539a8cc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.267+0000 7f01b1039980 1 --2- 172.21.15.157:0/1593453837 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x556539a8a7b0 0x556539a8cc50 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.267+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0078034bb0 msgr2=0x7f0078037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.267+0000 7f01b1039980 1 --2- 172.21.15.157:0/1593453837 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0078034bb0 0x7f0078037070 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x556539a3abf0 tx=0x7f0198011000 comp rx=0 tx=0).stop 2024-05-09T09:47:43.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.267+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539a6d6d0 msgr2=0x556539a74aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.267+0000 7f01af355640 1 -- 172.21.15.157:0/1593453837 reap_dead start 2024-05-09T09:47:43.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.267+0000 7f01b1039980 1 --2- 172.21.15.157:0/1593453837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539a6d6d0 0x556539a74aa0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f01a00dc990 tx=0x7f01a00daf90 comp rx=0 tx=0).stop 2024-05-09T09:47:43.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.267+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 shutdown_connections 2024-05-09T09:47:43.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.267+0000 7f01b1039980 1 --2- 172.21.15.157:0/1593453837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539a6d6d0 0x556539a74aa0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.267+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 >> 172.21.15.157:0/1593453837 conn(0x556539a69a50 msgr2=0x556539a670b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:43.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.271+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 shutdown_connections 2024-05-09T09:47:43.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.271+0000 7f01b1039980 1 -- 172.21.15.157:0/1593453837 wait complete. 2024-05-09T09:47:43.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.271+0000 7f01b1039980 1 -- 172.21.15.157:0/1086231650 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0088034bb0 msgr2=0x7f0088037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.271+0000 7f01b1039980 1 --2- 172.21.15.157:0/1086231650 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0088034bb0 0x7f0088037070 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x556539a32390 tx=0x7f0198006000 comp rx=0 tx=0).stop 2024-05-09T09:47:43.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.271+0000 7f01b1039980 1 -- 172.21.15.157:0/1086231650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539a606e0 msgr2=0x556539a60b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.271+0000 7f01b1039980 1 --2- 172.21.15.157:0/1086231650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539a606e0 0x556539a60b00 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f01a00cf710 tx=0x7f01a00c9df0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.271+0000 7f01b1039980 1 -- 172.21.15.157:0/1086231650 shutdown_connections 2024-05-09T09:47:43.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.271+0000 7f01b1039980 1 --2- 172.21.15.157:0/1086231650 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0088034bb0 0x7f0088037070 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.271+0000 7f01b1039980 1 --2- 172.21.15.157:0/1086231650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539a606e0 0x556539a60b00 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.271+0000 7f01b1039980 1 -- 172.21.15.157:0/1086231650 >> 172.21.15.157:0/1086231650 conn(0x556539a554b0 msgr2=0x556539a55fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:43.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.271+0000 7f01b1039980 1 -- 172.21.15.157:0/1086231650 shutdown_connections 2024-05-09T09:47:43.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.271+0000 7f01b1039980 1 -- 172.21.15.157:0/1086231650 wait complete. 2024-05-09T09:47:43.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.271+0000 7f01b1039980 1 -- 172.21.15.157:0/4214263430 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x556539a33de0 msgr2=0x556539a361d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.271+0000 7f01b1039980 1 --2- 172.21.15.157:0/4214263430 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x556539a33de0 0x556539a361d0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.271+0000 7f01b1039980 1 -- 172.21.15.157:0/4214263430 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x556539938450 msgr2=0x556539a314e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.271+0000 7f01b1039980 1 --2- 172.21.15.157:0/4214263430 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x556539938450 0x556539a314e0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.271+0000 7f01b1039980 1 -- 172.21.15.157:0/4214263430 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x556539a37d00 msgr2=0x556539a3a0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.271+0000 7f01b1039980 1 --2- 172.21.15.157:0/4214263430 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x556539a37d00 0x556539a3a0f0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.271+0000 7f01b1039980 1 -- 172.21.15.157:0/4214263430 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0094034bb0 msgr2=0x7f0094037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.271+0000 7f01b1039980 1 --2- 172.21.15.157:0/4214263430 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0094034bb0 0x7f0094037070 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0198000f70 tx=0x7f0198001420 comp rx=0 tx=0).stop 2024-05-09T09:47:43.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.271+0000 7f01b1039980 1 -- 172.21.15.157:0/4214263430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539937b30 msgr2=0x556539a2a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.271+0000 7f01b1039980 1 --2- 172.21.15.157:0/4214263430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556539937b30 0x556539a2a430 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f01a001b170 tx=0x7f01a00180e0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.271+0000 7f01af355640 1 -- 172.21.15.157:0/4214263430 reap_dead start 2024-05-09T09:47:43.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.271+0000 7f01b1039980 1 -- 172.21.15.157:0/4214263430 shutdown_connections 2024-05-09T09:47:43.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.271+0000 7f01b1039980 1 -- 172.21.15.157:0/4214263430 >> 172.21.15.157:0/4214263430 conn(0x5565398ab250 msgr2=0x556539a1da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:43.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.271+0000 7f01b1039980 1 -- 172.21.15.157:0/4214263430 shutdown_connections 2024-05-09T09:47:43.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.271+0000 7f01b1039980 1 -- 172.21.15.157:0/4214263430 wait complete. 2024-05-09T09:47:43.279 INFO:teuthology.orchestra.run.smithi157.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"69d0cd00-5979-46bf-b012-5813947e658a","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1","marker":"b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-05-09T09:47:42.485623Z","creation_time":"2024-05-09T09:47:37.451022Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-05-09T09:47:43.279 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '69d0cd00-5979-46bf-b012-5813947e658a', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1', 'marker': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-09T09:47:42.485623Z', 'creation_time': '2024-05-09T09:47:37.451022Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-09T09:47:43.279 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-05-09T09:47:43.279 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-05-09T09:47:43.279 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-05-09T09:47:43.352 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:43.353 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:43.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.355+0000 7f27c806f980 1 Processor -- start 2024-05-09T09:47:43.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.355+0000 7f27c806f980 1 -- start start 2024-05-09T09:47:43.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.355+0000 7f27c806f980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55cfb8756020 0x55cfb8758410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.355+0000 7f27c806f980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cfb8605440 con 0x55cfb8751b20 2024-05-09T09:47:43.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.355+0000 7f27c806f980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55cfb85f05f0 con 0x55cfb8756020 2024-05-09T09:47:43.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.355+0000 7f27c5389640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55cfb8756020 0x55cfb8758410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.355+0000 7f27c5b8a640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x55cfb8751b20 0x55cfb8751f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:51806/0 (socket says 172.21.15.157:51806) 2024-05-09T09:47:43.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.355+0000 7f27c5b8a640 1 -- 172.21.15.157:0/1519082706 learned_addr learned my addr 172.21.15.157:0/1519082706 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:47:43.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.355+0000 7f27c4b88640 1 -- 172.21.15.157:0/1519082706 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2376479020 0 0) 0x55cfb8605440 con 0x55cfb8751b20 2024-05-09T09:47:43.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.355+0000 7f27c4b88640 1 -- 172.21.15.157:0/1519082706 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27b0001e20 con 0x55cfb8751b20 2024-05-09T09:47:43.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.355+0000 7f27c5389640 1 -- 172.21.15.157:0/1519082706 >> v1:172.21.15.110:6789/0 conn(0x55cfb8751b20 legacy=0x55cfb8751f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.355+0000 7f27c5389640 1 -- 172.21.15.157:0/1519082706 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfb85fb990 con 0x55cfb8756020 2024-05-09T09:47:43.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.359+0000 7f27c5389640 1 --2- 172.21.15.157:0/1519082706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb8756020 0x55cfb8758410 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f27bc00a420 tx=0x7f27bc01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b28e242459bd96c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.359+0000 7f27c4b88640 1 -- 172.21.15.157:0/1519082706 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27bc0af070 con 0x55cfb8756020 2024-05-09T09:47:43.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.359+0000 7f27c4b88640 1 -- 172.21.15.157:0/1519082706 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27bc0aa530 con 0x55cfb8756020 2024-05-09T09:47:43.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.359+0000 7f27c4b88640 1 -- 172.21.15.157:0/1519082706 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27bc0aa850 con 0x55cfb8756020 2024-05-09T09:47:43.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.359+0000 7f27c806f980 1 -- 172.21.15.157:0/1519082706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb8756020 msgr2=0x55cfb8758410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.359+0000 7f27c806f980 1 --2- 172.21.15.157:0/1519082706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb8756020 0x55cfb8758410 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f27bc00a420 tx=0x7f27bc01afd0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.359+0000 7f27c806f980 1 -- 172.21.15.157:0/1519082706 shutdown_connections 2024-05-09T09:47:43.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.359+0000 7f27c806f980 1 --2- 172.21.15.157:0/1519082706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb8756020 0x55cfb8758410 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.359+0000 7f27c806f980 1 -- 172.21.15.157:0/1519082706 >> 172.21.15.157:0/1519082706 conn(0x55cfb86c5240 msgr2=0x55cfb86c5650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:43.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.359+0000 7f27c806f980 1 -- 172.21.15.157:0/1519082706 shutdown_connections 2024-05-09T09:47:43.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.359+0000 7f27c806f980 1 -- 172.21.15.157:0/1519082706 wait complete. 2024-05-09T09:47:43.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.371+0000 7f27c806f980 1 Processor -- start 2024-05-09T09:47:43.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.375+0000 7f27c806f980 1 -- start start 2024-05-09T09:47:43.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.375+0000 7f27c806f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb8751b20 0x55cfb883caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.375+0000 7f27c806f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55cfb8652fe0 con 0x55cfb8751b20 2024-05-09T09:47:43.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.375+0000 7f27c5b8a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb8751b20 0x55cfb883caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.375+0000 7f27c5b8a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb8751b20 0x55cfb883caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59686/0 (socket says 172.21.15.157:59686) 2024-05-09T09:47:43.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.375+0000 7f27c5b8a640 1 -- 172.21.15.157:0/1311442466 learned_addr learned my addr 172.21.15.157:0/1311442466 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:43.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.375+0000 7f27c5b8a640 1 -- 172.21.15.157:0/1311442466 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfb85d7ae0 con 0x55cfb8751b20 2024-05-09T09:47:43.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.375+0000 7f27c5b8a640 1 --2- 172.21.15.157:0/1311442466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb8751b20 0x55cfb883caf0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f27c0001dc0 tx=0x7f27c000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b843383f29398b0e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.375+0000 7f26b3e07640 1 -- 172.21.15.157:0/1311442466 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27c0012020 con 0x55cfb8751b20 2024-05-09T09:47:43.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.375+0000 7f26b3e07640 1 -- 172.21.15.157:0/1311442466 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27c000e7c0 con 0x55cfb8751b20 2024-05-09T09:47:43.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.375+0000 7f26b3e07640 1 -- 172.21.15.157:0/1311442466 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27c000eb40 con 0x55cfb8751b20 2024-05-09T09:47:43.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.375+0000 7f27c806f980 1 -- 172.21.15.157:0/1311442466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb8751b20 msgr2=0x55cfb883caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.375+0000 7f27c806f980 1 --2- 172.21.15.157:0/1311442466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb8751b20 0x55cfb883caf0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f27c0001dc0 tx=0x7f27c000b6d0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.375+0000 7f27c806f980 1 -- 172.21.15.157:0/1311442466 shutdown_connections 2024-05-09T09:47:43.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.375+0000 7f27c806f980 1 --2- 172.21.15.157:0/1311442466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb8751b20 0x55cfb883caf0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.375+0000 7f27c806f980 1 -- 172.21.15.157:0/1311442466 >> 172.21.15.157:0/1311442466 conn(0x55cfb86c5240 msgr2=0x55cfb8838680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:43.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.375+0000 7f27c806f980 1 -- 172.21.15.157:0/1311442466 shutdown_connections 2024-05-09T09:47:43.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.375+0000 7f27c806f980 1 -- 172.21.15.157:0/1311442466 wait complete. 2024-05-09T09:47:43.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.375+0000 7f27c806f980 1 Processor -- start 2024-05-09T09:47:43.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.375+0000 7f27c806f980 1 -- start start 2024-05-09T09:47:43.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.375+0000 7f27c806f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb8756020 0x55cfb8843eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.375+0000 7f27c806f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55cfb875b440 con 0x55cfb8756020 2024-05-09T09:47:43.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.375+0000 7f27c5b8a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb8756020 0x55cfb8843eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.375+0000 7f27c5b8a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb8756020 0x55cfb8843eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59702/0 (socket says 172.21.15.157:59702) 2024-05-09T09:47:43.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.375+0000 7f27c5b8a640 1 -- 172.21.15.157:0/1611730210 learned_addr learned my addr 172.21.15.157:0/1611730210 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:43.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.379+0000 7f27c5b8a640 1 -- 172.21.15.157:0/1611730210 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfb88443f0 con 0x55cfb8756020 2024-05-09T09:47:43.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.379+0000 7f27c5b8a640 1 --2- 172.21.15.157:0/1611730210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb8756020 0x55cfb8843eb0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x55cfb883d980 tx=0x7f27c0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.379+0000 7f26b2604640 1 -- 172.21.15.157:0/1611730210 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27c0012030 con 0x55cfb8756020 2024-05-09T09:47:43.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.379+0000 7f26b2604640 1 -- 172.21.15.157:0/1611730210 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27c0001440 con 0x55cfb8756020 2024-05-09T09:47:43.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.379+0000 7f26b2604640 1 -- 172.21.15.157:0/1611730210 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27c001aa50 con 0x55cfb8756020 2024-05-09T09:47:43.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.379+0000 7f27c806f980 1 -- 172.21.15.157:0/1611730210 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cfb8844680 con 0x55cfb8756020 2024-05-09T09:47:43.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.379+0000 7f27c806f980 1 -- 172.21.15.157:0/1611730210 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfb8847360 con 0x55cfb8756020 2024-05-09T09:47:43.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.379+0000 7f26b2604640 1 -- 172.21.15.157:0/1611730210 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f27c0015020 con 0x55cfb8756020 2024-05-09T09:47:43.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.379+0000 7f26b2604640 1 --2- 172.21.15.157:0/1611730210 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f26ac034bb0 0x7f26ac037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.379+0000 7f26b2604640 1 -- 172.21.15.157:0/1611730210 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f27c0020030 con 0x55cfb8756020 2024-05-09T09:47:43.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.379+0000 7f27c5389640 1 --2- 172.21.15.157:0/1611730210 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f26ac034bb0 0x7f26ac037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.379+0000 7f27c806f980 1 --2- 172.21.15.157:0/1611730210 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cfb8848e30 0x55cfb884b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.379+0000 7f27c806f980 1 -- 172.21.15.157:0/1611730210 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cfb884b8a0 con 0x55cfb8848e30 2024-05-09T09:47:43.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.379+0000 7f27c638b640 1 --2- 172.21.15.157:0/1611730210 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cfb8848e30 0x55cfb884b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.379+0000 7f27c5389640 1 --2- 172.21.15.157:0/1611730210 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f26ac034bb0 0x7f26ac037070 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f27bc0ac000 tx=0x7f27bc0a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.379+0000 7f27c638b640 1 --2- 172.21.15.157:0/1611730210 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cfb8848e30 0x55cfb884b260 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.379+0000 7f27c638b640 1 -- 172.21.15.157:0/1611730210 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27b80083f0 con 0x55cfb8848e30 2024-05-09T09:47:43.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.379+0000 7f27c806f980 1 -- 172.21.15.157:0/1611730210 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cfb884c180 con 0x55cfb8848e30 2024-05-09T09:47:43.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.383+0000 7f27c638b640 1 -- 172.21.15.157:0/1611730210 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f27b80083f0 con 0x55cfb8848e30 2024-05-09T09:47:43.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.383+0000 7f27c806f980 1 --2- 172.21.15.157:0/1611730210 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cfb884da90 0x55cfb884ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.383+0000 7f27c806f980 1 -- 172.21.15.157:0/1611730210 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88506c0 con 0x55cfb884da90 2024-05-09T09:47:43.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.383+0000 7f27c5b8a640 1 --2- 172.21.15.157:0/1611730210 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cfb884da90 0x55cfb884ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.383+0000 7f27c5b8a640 1 --2- 172.21.15.157:0/1611730210 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cfb884da90 0x55cfb884ff30 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.387+0000 7f27c5b8a640 1 -- 172.21.15.157:0/1611730210 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f27c0008030 con 0x55cfb884da90 2024-05-09T09:47:43.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.387+0000 7f27c806f980 1 -- 172.21.15.157:0/1611730210 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cfb884c9d0 con 0x55cfb8848e30 2024-05-09T09:47:43.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.387+0000 7f27c638b640 1 -- 172.21.15.157:0/1611730210 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f27b80083f0 con 0x55cfb8848e30 2024-05-09T09:47:43.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.387+0000 7f27c806f980 1 --2- 172.21.15.157:0/1611730210 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cfb8851b20 0x55cfb8853f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.387+0000 7f27c806f980 1 -- 172.21.15.157:0/1611730210 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cfb8854650 con 0x55cfb8851b20 2024-05-09T09:47:43.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.387+0000 7f27c5389640 1 --2- 172.21.15.157:0/1611730210 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cfb8851b20 0x55cfb8853f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.387+0000 7f27c5389640 1 --2- 172.21.15.157:0/1611730210 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cfb8851b20 0x55cfb8853f10 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.387+0000 7f27c5389640 1 -- 172.21.15.157:0/1611730210 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f27bc0b2070 con 0x55cfb8851b20 2024-05-09T09:47:43.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.391+0000 7f27c806f980 1 Processor -- start 2024-05-09T09:47:43.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.391+0000 7f27c806f980 1 -- start start 2024-05-09T09:47:43.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.391+0000 7f27c806f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb887a4e0 0x55cfb887a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.391+0000 7f27c806f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55cfb8657020 con 0x55cfb887a4e0 2024-05-09T09:47:43.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.391+0000 7f27c5b8a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb887a4e0 0x55cfb887a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.391+0000 7f27c5b8a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb887a4e0 0x55cfb887a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59704/0 (socket says 172.21.15.157:59704) 2024-05-09T09:47:43.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.391+0000 7f27c5b8a640 1 -- 172.21.15.157:0/4000575738 learned_addr learned my addr 172.21.15.157:0/4000575738 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:43.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.391+0000 7f27c5b8a640 1 -- 172.21.15.157:0/4000575738 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfb887ae40 con 0x55cfb887a4e0 2024-05-09T09:47:43.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.391+0000 7f27c5b8a640 1 --2- 172.21.15.157:0/4000575738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb887a4e0 0x55cfb887a900 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f27c0016db0 tx=0x7f27c0018700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.395+0000 7f26aa3a1640 1 -- 172.21.15.157:0/4000575738 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27c003d070 con 0x55cfb887a4e0 2024-05-09T09:47:43.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.395+0000 7f26aa3a1640 1 -- 172.21.15.157:0/4000575738 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27c0045050 con 0x55cfb887a4e0 2024-05-09T09:47:43.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.395+0000 7f26aa3a1640 1 -- 172.21.15.157:0/4000575738 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27c002d3f0 con 0x55cfb887a4e0 2024-05-09T09:47:43.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.395+0000 7f27c806f980 1 -- 172.21.15.157:0/4000575738 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cfb887b8d0 con 0x55cfb887a4e0 2024-05-09T09:47:43.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.395+0000 7f27c806f980 1 -- 172.21.15.157:0/4000575738 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfb887bdb0 con 0x55cfb887a4e0 2024-05-09T09:47:43.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.395+0000 7f26aa3a1640 1 -- 172.21.15.157:0/4000575738 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f27c0009070 con 0x55cfb887a4e0 2024-05-09T09:47:43.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.395+0000 7f26aa3a1640 1 --2- 172.21.15.157:0/4000575738 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f26a0034b60 0x7f26a0037020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.395+0000 7f26aa3a1640 1 -- 172.21.15.157:0/4000575738 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f27c0005050 con 0x55cfb887a4e0 2024-05-09T09:47:43.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.395+0000 7f27c5389640 1 --2- 172.21.15.157:0/4000575738 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f26a0034b60 0x7f26a0037020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.395+0000 7f27c806f980 1 Processor -- start 2024-05-09T09:47:43.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.395+0000 7f27c806f980 1 -- start start 2024-05-09T09:47:43.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.395+0000 7f27c5389640 1 --2- 172.21.15.157:0/4000575738 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f26a0034b60 0x7f26a0037020 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f27bc0ad040 tx=0x7f27bc005d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.395+0000 7f27c806f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb88874b0 0x55cfb88878d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.395+0000 7f27c806f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55cfb883d240 con 0x55cfb88874b0 2024-05-09T09:47:43.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.395+0000 7f27c5b8a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb88874b0 0x55cfb88878d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.395+0000 7f27c5b8a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb88874b0 0x55cfb88878d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59718/0 (socket says 172.21.15.157:59718) 2024-05-09T09:47:43.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.395+0000 7f27c5b8a640 1 -- 172.21.15.157:0/307182504 learned_addr learned my addr 172.21.15.157:0/307182504 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:43.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.395+0000 7f27c5b8a640 1 -- 172.21.15.157:0/307182504 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfb8887ea0 con 0x55cfb88874b0 2024-05-09T09:47:43.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.395+0000 7f27c5b8a640 1 --2- 172.21.15.157:0/307182504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb88874b0 0x55cfb88878d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f27c0050f80 tx=0x7f27c0045b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3321fb0e2b4b73cb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.395+0000 7f2697fff640 1 -- 172.21.15.157:0/307182504 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27c002fe30 con 0x55cfb88874b0 2024-05-09T09:47:43.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.395+0000 7f2697fff640 1 -- 172.21.15.157:0/307182504 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27c005f070 con 0x55cfb88874b0 2024-05-09T09:47:43.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.395+0000 7f2697fff640 1 -- 172.21.15.157:0/307182504 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27c004ab70 con 0x55cfb88874b0 2024-05-09T09:47:43.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.399+0000 7f27c806f980 1 -- 172.21.15.157:0/307182504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb88874b0 msgr2=0x55cfb88878d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.399+0000 7f27c806f980 1 --2- 172.21.15.157:0/307182504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb88874b0 0x55cfb88878d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f27c0050f80 tx=0x7f27c0045b90 comp rx=0 tx=0).stop 2024-05-09T09:47:43.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.399+0000 7f27c806f980 1 -- 172.21.15.157:0/307182504 shutdown_connections 2024-05-09T09:47:43.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.399+0000 7f27c806f980 1 --2- 172.21.15.157:0/307182504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb88874b0 0x55cfb88878d0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.399+0000 7f27c806f980 1 -- 172.21.15.157:0/307182504 >> 172.21.15.157:0/307182504 conn(0x55cfb8883830 msgr2=0x55cfb8881890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:43.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.399+0000 7f27c806f980 1 -- 172.21.15.157:0/307182504 shutdown_connections 2024-05-09T09:47:43.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.399+0000 7f27c806f980 1 -- 172.21.15.157:0/307182504 wait complete. 2024-05-09T09:47:43.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.399+0000 7f27c806f980 1 Processor -- start 2024-05-09T09:47:43.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.399+0000 7f27c806f980 1 -- start start 2024-05-09T09:47:43.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.399+0000 7f27c806f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb88874b0 0x55cfb888e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.399+0000 7f27c806f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55cfb88885a0 con 0x55cfb88874b0 2024-05-09T09:47:43.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.399+0000 7f27c5b8a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb88874b0 0x55cfb888e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.399+0000 7f27c5b8a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb88874b0 0x55cfb888e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59724/0 (socket says 172.21.15.157:59724) 2024-05-09T09:47:43.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.399+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 learned_addr learned my addr 172.21.15.157:0/326399827 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:43.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.399+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfb888edd0 con 0x55cfb88874b0 2024-05-09T09:47:43.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.399+0000 7f27c5b8a640 1 --2- 172.21.15.157:0/326399827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb88874b0 0x55cfb888e890 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f27c0050f80 tx=0x7f27c0050eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.399+0000 7f26967fc640 1 -- 172.21.15.157:0/326399827 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27c001e340 con 0x55cfb88874b0 2024-05-09T09:47:43.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.399+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cfb888edd0 con 0x55cfb88874b0 2024-05-09T09:47:43.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.399+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfb888edd0 con 0x55cfb88874b0 2024-05-09T09:47:43.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.399+0000 7f26967fc640 1 -- 172.21.15.157:0/326399827 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27c000d840 con 0x55cfb88874b0 2024-05-09T09:47:43.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.399+0000 7f26967fc640 1 -- 172.21.15.157:0/326399827 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27c000db20 con 0x55cfb88874b0 2024-05-09T09:47:43.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.399+0000 7f27c806f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.399+0000 7f26967fc640 1 -- 172.21.15.157:0/326399827 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f27c0058040 con 0x55cfb88874b0 2024-05-09T09:47:43.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.399+0000 7f26967fc640 1 --2- 172.21.15.157:0/326399827 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2690034d00 0x7f26900371c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f26967fc640 1 -- 172.21.15.157:0/326399827 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f27c0055040 con 0x55cfb88874b0 2024-05-09T09:47:43.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c5389640 1 --2- 172.21.15.157:0/326399827 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2690034d00 0x7f26900371c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c806f980 1 --2- 172.21.15.157:0/326399827 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cfb889b370 0x55cfb889d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889df80 con 0x55cfb889b370 2024-05-09T09:47:43.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c638b640 1 --2- 172.21.15.157:0/326399827 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cfb889b370 0x55cfb889d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c5389640 1 --2- 172.21.15.157:0/326399827 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2690034d00 0x7f26900371c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f27bc0aafd0 tx=0x7f27bc0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c638b640 1 --2- 172.21.15.157:0/326399827 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cfb889b370 0x55cfb889d830 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27b80083f0 con 0x55cfb889b370 2024-05-09T09:47:43.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c806f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:43.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c806f980 20 realm 2024-05-09T09:47:43.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c806f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889e390 con 0x55cfb889b370 2024-05-09T09:47:43.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27b80083f0 con 0x55cfb889b370 2024-05-09T09:47:43.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c806f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:43.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c806f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:43.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c806f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889ec30 con 0x55cfb889b370 2024-05-09T09:47:43.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27b80083f0 con 0x55cfb889b370 2024-05-09T09:47:43.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c806f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:43.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c806f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb889b370 2024-05-09T09:47:43.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f27b80083f0 con 0x55cfb889b370 2024-05-09T09:47:43.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c806f980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:43.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c806f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c806f980 1 --2- 172.21.15.157:0/326399827 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cfb889fd30 0x55cfb88a2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88a26a0 con 0x55cfb889fd30 2024-05-09T09:47:43.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c5b8a640 1 --2- 172.21.15.157:0/326399827 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cfb889fd30 0x55cfb88a2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c5b8a640 1 --2- 172.21.15.157:0/326399827 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cfb889fd30 0x55cfb88a2120 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c806f980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:43.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c806f980 20 searching for the correct realm 2024-05-09T09:47:43.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c806f980 1 --2- 172.21.15.157:0/326399827 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cfb88a4610 0x55cfb88a6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88a71a0 con 0x55cfb88a4610 2024-05-09T09:47:43.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c5389640 1 --2- 172.21.15.157:0/326399827 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cfb88a4610 0x55cfb88a6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.403+0000 7f27c5389640 1 --2- 172.21.15.157:0/326399827 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cfb88a4610 0x55cfb88a6ad0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.407+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.407+0000 7f27c5389640 1 --2- 172.21.15.157:0/326399827 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f27bc0da040 0x7f27bc0da420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.407+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88a71a0 con 0x7f27bc0da040 2024-05-09T09:47:43.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.407+0000 7f27c638b640 1 --2- 172.21.15.157:0/326399827 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f27bc0da040 0x7f27bc0da420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.407+0000 7f27c638b640 1 --2- 172.21.15.157:0/326399827 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f27bc0da040 0x7f27bc0da420 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.407+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27b80083f0 con 0x7f27bc0da040 2024-05-09T09:47:43.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.407+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb889fd30 2024-05-09T09:47:43.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.407+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.407+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb889b370 2024-05-09T09:47:43.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.407+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27b80083f0 con 0x55cfb889b370 2024-05-09T09:47:43.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.407+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb889b370 2024-05-09T09:47:43.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.407+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27b8026040 con 0x55cfb889b370 2024-05-09T09:47:43.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.407+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb889fd30 2024-05-09T09:47:43.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.407+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.407+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb889fd30 2024-05-09T09:47:43.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.407+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.407+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x7f27bc0da040 2024-05-09T09:47:43.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.407+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27b8026040 con 0x7f27bc0da040 2024-05-09T09:47:43.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.407+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb88a4610 2024-05-09T09:47:43.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.407+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.407+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb889b370 2024-05-09T09:47:43.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.411+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27b8026040 con 0x55cfb889b370 2024-05-09T09:47:43.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.411+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb889fd30 2024-05-09T09:47:43.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.411+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.411+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb889b370 2024-05-09T09:47:43.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.411+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27b8026040 con 0x55cfb889b370 2024-05-09T09:47:43.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.411+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x7f27bc0da040 2024-05-09T09:47:43.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.411+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f27b8026040 con 0x7f27bc0da040 2024-05-09T09:47:43.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.411+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb88a4610 2024-05-09T09:47:43.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.411+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.411+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb88a4610 2024-05-09T09:47:43.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.411+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.411+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb889fd30 2024-05-09T09:47:43.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.411+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.411+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb88a4610 2024-05-09T09:47:43.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.411+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.411+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb88a4610 2024-05-09T09:47:43.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.411+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.411+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb889b370 2024-05-09T09:47:43.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.411+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27b8026040 con 0x55cfb889b370 2024-05-09T09:47:43.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.411+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb889b370 2024-05-09T09:47:43.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.411+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f27b8026040 con 0x55cfb889b370 2024-05-09T09:47:43.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.411+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb889fd30 2024-05-09T09:47:43.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.415+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.415+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb88a4610 2024-05-09T09:47:43.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.415+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.415+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x7f27bc0da040 2024-05-09T09:47:43.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.415+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27b8026040 con 0x7f27bc0da040 2024-05-09T09:47:43.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.415+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb889b370 2024-05-09T09:47:43.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.415+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27b8026040 con 0x55cfb889b370 2024-05-09T09:47:43.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.415+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb889fd30 2024-05-09T09:47:43.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.415+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.415+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb88a4610 2024-05-09T09:47:43.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.415+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.415+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb889fd30 2024-05-09T09:47:43.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.415+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.415+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x7f27bc0da040 2024-05-09T09:47:43.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.415+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27b8026040 con 0x7f27bc0da040 2024-05-09T09:47:43.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.415+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb88a4610 2024-05-09T09:47:43.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.415+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.415+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb889fd30 2024-05-09T09:47:43.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.415+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.415+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb889b370 2024-05-09T09:47:43.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f27b8026040 con 0x55cfb889b370 2024-05-09T09:47:43.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x7f27bc0da040 2024-05-09T09:47:43.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27b8026040 con 0x7f27bc0da040 2024-05-09T09:47:43.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:43.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:43.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:43.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:43.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:43.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:43.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88a2ef0 con 0x55cfb889b370 2024-05-09T09:47:43.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27b8026040 con 0x55cfb889b370 2024-05-09T09:47:43.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:43.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88a2ef0 con 0x55cfb889b370 2024-05-09T09:47:43.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f27b8026040 con 0x55cfb889b370 2024-05-09T09:47:43.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:43.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88a2ef0 con 0x55cfb88a4610 2024-05-09T09:47:43.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:43.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 20 zone default found 2024-05-09T09:47:43.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 4 Realm: () 2024-05-09T09:47:43.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:43.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:43.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:43.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 20 zonegroup default 2024-05-09T09:47:43.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88a3790 con 0x55cfb889fd30 2024-05-09T09:47:43.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:43.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88a9000 con 0x55cfb88a4610 2024-05-09T09:47:43.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:43.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88a93a0 con 0x55cfb88a4610 2024-05-09T09:47:43.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:43.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 20 started sync module instance, tier type = 2024-05-09T09:47:43.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:43.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88a84a0 con 0x7f27bc0da040 2024-05-09T09:47:43.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27b8026040 con 0x7f27bc0da040 2024-05-09T09:47:43.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94350642678256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88a84a0 con 0x7f27bc0da040 2024-05-09T09:47:43.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.419+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88a9d60 con 0x55cfb889b370 2024-05-09T09:47:43.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.423+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94350642678256] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27b8036040 con 0x7f27bc0da040 2024-05-09T09:47:43.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.423+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27b8036040 con 0x55cfb889b370 2024-05-09T09:47:43.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.423+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94350642682304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88a84a0 con 0x55cfb889b370 2024-05-09T09:47:43.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.423+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88aa770 con 0x55cfb88a4610 2024-05-09T09:47:43.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.423+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94350642682304] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27b8036040 con 0x55cfb889b370 2024-05-09T09:47:43.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.423+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.423+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94350642675696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88a8410 con 0x55cfb88a4610 2024-05-09T09:47:43.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.423+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88ab470 con 0x7f27bc0da040 2024-05-09T09:47:43.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.427+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27b8036040 con 0x7f27bc0da040 2024-05-09T09:47:43.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.427+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94350642688240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88abd10 con 0x7f27bc0da040 2024-05-09T09:47:43.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.427+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88ac6d0 con 0x55cfb889b370 2024-05-09T09:47:43.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.427+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94350642688240] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27b8036040 con 0x7f27bc0da040 2024-05-09T09:47:43.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.427+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94350642675696] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.427+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27b8036040 con 0x55cfb889b370 2024-05-09T09:47:43.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.427+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94350642692640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88abc80 con 0x55cfb889b370 2024-05-09T09:47:43.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.427+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88ac640 con 0x55cfb889fd30 2024-05-09T09:47:43.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.431+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94350642692640] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27b8036040 con 0x55cfb889b370 2024-05-09T09:47:43.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.431+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.431+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94350642690304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88acf70 con 0x55cfb889fd30 2024-05-09T09:47:43.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.431+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88ad7c0 con 0x55cfb889fd30 2024-05-09T09:47:43.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.431+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.431+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94350642690304] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.431+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94350642699104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88ae430 con 0x55cfb889fd30 2024-05-09T09:47:43.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.431+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88acb00 con 0x55cfb889fd30 2024-05-09T09:47:43.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.435+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94350642699104] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.435+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.435+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94350642700160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88ae3a0 con 0x55cfb889fd30 2024-05-09T09:47:43.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.435+0000 7f27c806f980 20 add_watcher() i=0 2024-05-09T09:47:43.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.435+0000 7f27c806f980 20 add_watcher() i=1 2024-05-09T09:47:43.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.435+0000 7f27c806f980 20 add_watcher() i=2 2024-05-09T09:47:43.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.435+0000 7f27c806f980 20 add_watcher() i=3 2024-05-09T09:47:43.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.435+0000 7f27c806f980 20 add_watcher() i=4 2024-05-09T09:47:43.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.435+0000 7f27c806f980 20 add_watcher() i=5 2024-05-09T09:47:43.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.435+0000 7f27c806f980 20 add_watcher() i=6 2024-05-09T09:47:43.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.435+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94350642700160] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.435+0000 7f27c806f980 20 add_watcher() i=7 2024-05-09T09:47:43.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.435+0000 7f27c806f980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:43.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.435+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88b1e50 con 0x55cfb889b370 2024-05-09T09:47:43.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.435+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f27b8036040 con 0x55cfb889b370 2024-05-09T09:47:43.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.435+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94350642702704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88af2b0 con 0x55cfb889b370 2024-05-09T09:47:43.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.439+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94350642702704] v30'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f27b8036040 con 0x55cfb889b370 2024-05-09T09:47:43.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.439+0000 7f267b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:43.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.439+0000 7f27c806f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:43.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.439+0000 7f27c806f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:43.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.439+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88ba3e0 con 0x55cfb889b370 2024-05-09T09:47:43.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.439+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'65 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f27b8036040 con 0x55cfb889b370 2024-05-09T09:47:43.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.439+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88ba970 con 0x55cfb889fd30 2024-05-09T09:47:43.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.443+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'60 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.443+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88ba970 con 0x55cfb88a4610 2024-05-09T09:47:43.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.443+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'59 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.443+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88bb3f0 con 0x55cfb889b370 2024-05-09T09:47:43.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.443+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'270 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f27b8036040 con 0x55cfb889b370 2024-05-09T09:47:43.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.443+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88b8420 con 0x7f27bc0da040 2024-05-09T09:47:43.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.443+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'167 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f27b8036040 con 0x7f27bc0da040 2024-05-09T09:47:43.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.443+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88b83c0 con 0x55cfb88a4610 2024-05-09T09:47:43.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.447+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'112 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.447+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88bc120 con 0x55cfb889b370 2024-05-09T09:47:43.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.447+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'61 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f27b8036040 con 0x55cfb889b370 2024-05-09T09:47:43.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.447+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88bc120 con 0x55cfb889fd30 2024-05-09T09:47:43.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.451+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'111 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.451+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88bc560 con 0x7f27bc0da040 2024-05-09T09:47:43.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.451+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'59 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f27b8036040 con 0x7f27bc0da040 2024-05-09T09:47:43.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.451+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88bc560 con 0x55cfb88a4610 2024-05-09T09:47:43.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.455+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'65 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.455+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88bc560 con 0x7f27bc0da040 2024-05-09T09:47:43.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.455+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'168 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27b8036040 con 0x7f27bc0da040 2024-05-09T09:47:43.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.455+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88bc560 con 0x55cfb889fd30 2024-05-09T09:47:43.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.455+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'61 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.455+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88bc560 con 0x7f27bc0da040 2024-05-09T09:47:43.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.459+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'59 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27b8036040 con 0x7f27bc0da040 2024-05-09T09:47:43.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.459+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88bc560 con 0x55cfb889fd30 2024-05-09T09:47:43.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.459+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'117 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.459+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88bc560 con 0x55cfb889b370 2024-05-09T09:47:43.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.459+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'271 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27b8036040 con 0x55cfb889b370 2024-05-09T09:47:43.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.459+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88bc560 con 0x55cfb88a4610 2024-05-09T09:47:43.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.463+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'161 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.463+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88bc650 con 0x7f27bc0da040 2024-05-09T09:47:43.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.463+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'169 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27b8036040 con 0x7f27bc0da040 2024-05-09T09:47:43.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.463+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88bc650 con 0x55cfb88a4610 2024-05-09T09:47:43.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.463+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'59 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.463+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88bc720 con 0x55cfb889b370 2024-05-09T09:47:43.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.467+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'67 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27b8036040 con 0x55cfb889b370 2024-05-09T09:47:43.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.467+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88bc720 con 0x55cfb889b370 2024-05-09T09:47:43.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.467+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'272 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27b8036040 con 0x55cfb889b370 2024-05-09T09:47:43.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.467+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88bc720 con 0x55cfb88a4610 2024-05-09T09:47:43.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.471+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'162 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.471+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88bc810 con 0x7f27bc0da040 2024-05-09T09:47:43.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.471+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'69 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27b8036040 con 0x7f27bc0da040 2024-05-09T09:47:43.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.471+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88bcdd0 con 0x55cfb88a4610 2024-05-09T09:47:43.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.471+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'61 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.471+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88bcdd0 con 0x55cfb88a4610 2024-05-09T09:47:43.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.475+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'65 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.475+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88bcdd0 con 0x55cfb88a4610 2024-05-09T09:47:43.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.475+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'55 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.475+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88bcdd0 con 0x55cfb88a4610 2024-05-09T09:47:43.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.475+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'113 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.475+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88bcdd0 con 0x55cfb889fd30 2024-05-09T09:47:43.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.479+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'61 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.479+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88bcdd0 con 0x55cfb88a4610 2024-05-09T09:47:43.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.479+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'59 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.479+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88bcdd0 con 0x55cfb889fd30 2024-05-09T09:47:43.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.479+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'112 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.479+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88bcdd0 con 0x55cfb88a4610 2024-05-09T09:47:43.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.483+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'163 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.483+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88bcdd0 con 0x55cfb889fd30 2024-05-09T09:47:43.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.483+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'118 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.483+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88bcdd0 con 0x7f27bc0da040 2024-05-09T09:47:43.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.487+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'65 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f27b8036040 con 0x7f27bc0da040 2024-05-09T09:47:43.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.487+0000 7f267a7e4640 20 reqs_thread_entry: start 2024-05-09T09:47:43.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.487+0000 7f27c806f980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:43.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.487+0000 7f26737fe640 20 reqs_thread_entry: start 2024-05-09T09:47:43.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.487+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:94 6.0 6:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88b7820 con 0x55cfb889fd30 2024-05-09T09:47:43.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.487+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(94 [pgnls start_epoch 30 out=254b] v30'118 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.487+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:95 6.10 6:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88ad7c0 con 0x55cfb889fd30 2024-05-09T09:47:43.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.491+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(95 [pgnls start_epoch 30 out=131b] v30'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.491+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:96 6.8 6:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88ad7c0 con 0x55cfb88a4610 2024-05-09T09:47:43.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.491+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(96 [pgnls start_epoch 30 out=295b] v30'65 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.491+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:97 6.18 6:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88ba970 con 0x55cfb889fd30 2024-05-09T09:47:43.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.491+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(97 [pgnls start_epoch 30 out=172b] v30'60 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.491+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 6.4 6:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88ba970 con 0x55cfb889b370 2024-05-09T09:47:43.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.491+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(98 [pgnls start_epoch 30 out=335b] v30'272 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7f27b8036040 con 0x55cfb889b370 2024-05-09T09:47:43.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.491+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 6.14 6:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x7f27bc0da040 2024-05-09T09:47:43.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.491+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(99 [pgnls start_epoch 30 out=213b] v30'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f27b8036040 con 0x7f27bc0da040 2024-05-09T09:47:43.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.491+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:100 6.c 6:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb88a4610 2024-05-09T09:47:43.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.491+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(100 [pgnls start_epoch 30 out=254b] v30'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.491+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:101 6.1c 6:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb88a4610 2024-05-09T09:47:43.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.491+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== osd_op_reply(101 [pgnls start_epoch 30 out=295b] v30'65 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.491+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:102 6.2 6:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb88a4610 2024-05-09T09:47:43.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.491+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 30 ==== osd_op_reply(102 [pgnls start_epoch 30 out=213b] v30'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.491+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:103 6.12 6:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x7f27bc0da040 2024-05-09T09:47:43.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.495+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(103 [pgnls start_epoch 30 out=172b] v30'59 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f27b8036040 con 0x7f27bc0da040 2024-05-09T09:47:43.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.495+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:104 6.a 6:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x7f27bc0da040 2024-05-09T09:47:43.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.495+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(104 [pgnls start_epoch 30 out=336b] v30'69 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7f27b8036040 con 0x7f27bc0da040 2024-05-09T09:47:43.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.495+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:105 6.1a 6:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb88a4610 2024-05-09T09:47:43.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.495+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 31 ==== osd_op_reply(105 [pgnls start_epoch 30 out=131b] v30'59 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.495+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:106 6.6 6:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb88a4610 2024-05-09T09:47:43.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.495+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 32 ==== osd_op_reply(106 [pgnls start_epoch 30 out=254b] v30'13 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.495+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:107 6.16 6:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb88a4610 2024-05-09T09:47:43.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.495+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 33 ==== osd_op_reply(107 [pgnls start_epoch 30 out=90b] v30'59 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.495+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:108 6.e 6:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb889b370 2024-05-09T09:47:43.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.495+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(108 [pgnls start_epoch 30 out=213b] v30'61 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f27b8036040 con 0x55cfb889b370 2024-05-09T09:47:43.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.495+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:109 6.1e 6:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb88a4610 2024-05-09T09:47:43.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.495+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 34 ==== osd_op_reply(109 [pgnls start_epoch 30 out=254b] v30'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.495+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:110 6.1 6:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb889b370 2024-05-09T09:47:43.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.495+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(110 [pgnls start_epoch 30 out=254b] v30'14 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f27b8036040 con 0x55cfb889b370 2024-05-09T09:47:43.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.495+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:111 6.11 6:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb88a4610 2024-05-09T09:47:43.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.495+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 35 ==== osd_op_reply(111 [pgnls start_epoch 30 out=213b] v30'61 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.495+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:112 6.9 6:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb88a4610 2024-05-09T09:47:43.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.495+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 36 ==== osd_op_reply(112 [pgnls start_epoch 30 out=172b] v30'113 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.495+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:113 6.19 6:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb889b370 2024-05-09T09:47:43.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.495+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(113 [pgnls start_epoch 30 out=295b] v30'65 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f27b8036040 con 0x55cfb889b370 2024-05-09T09:47:43.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.495+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:114 6.5 6:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x7f27bc0da040 2024-05-09T09:47:43.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.495+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(114 [pgnls start_epoch 30 out=276b] v30'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7f27b8036040 con 0x7f27bc0da040 2024-05-09T09:47:43.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.495+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:115 6.15 6:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x7f27bc0da040 2024-05-09T09:47:43.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.495+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(115 [pgnls start_epoch 30 out=172b] v30'59 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f27b8036040 con 0x7f27bc0da040 2024-05-09T09:47:43.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.495+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:116 6.d 6:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb889b370 2024-05-09T09:47:43.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.499+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(116 [pgnls start_epoch 30 out=295b] v30'67 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f27b8036040 con 0x55cfb889b370 2024-05-09T09:47:43.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.499+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:117 6.1d 6:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb889fd30 2024-05-09T09:47:43.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.499+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(117 [pgnls start_epoch 30 out=172b] v30'112 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.499+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:118 6.3 6:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x7f27bc0da040 2024-05-09T09:47:43.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.499+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.2 v2:172.21.15.157:6800/354455204 23 ==== osd_op_reply(118 [pgnls start_epoch 30 out=213b] v30'169 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f27b8036040 con 0x7f27bc0da040 2024-05-09T09:47:43.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.499+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:119 6.13 6:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb889fd30 2024-05-09T09:47:43.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.499+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(119 [pgnls start_epoch 30 out=172b] v30'61 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.499+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:120 6.b 6:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb88a4610 2024-05-09T09:47:43.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.499+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 37 ==== osd_op_reply(120 [pgnls start_epoch 30 out=172b] v30'59 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.499+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:121 6.1b 6:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb88a4610 2024-05-09T09:47:43.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.499+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 38 ==== osd_op_reply(121 [pgnls start_epoch 30 out=90b] v30'55 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.499+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:122 6.7 6:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb88a4610 2024-05-09T09:47:43.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.499+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 39 ==== osd_op_reply(122 [pgnls start_epoch 30 out=90b] v30'163 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.499+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:123 6.17 6:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb889b370 2024-05-09T09:47:43.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.503+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(123 [pgnls start_epoch 30 out=131b] v30'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f27b8036040 con 0x55cfb889b370 2024-05-09T09:47:43.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.503+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:124 6.f 6:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x7f27bc0da040 2024-05-09T09:47:43.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.503+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.2 v2:172.21.15.157:6800/354455204 24 ==== osd_op_reply(124 [pgnls start_epoch 30 out=295b] v30'65 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f27b8036040 con 0x7f27bc0da040 2024-05-09T09:47:43.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.503+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:125 6.1f 6:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cfb889efd0 con 0x55cfb889fd30 2024-05-09T09:47:43.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.503+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(125 [pgnls start_epoch 30 out=213b] v30'61 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.503 INFO:teuthology.orchestra.run.smithi157.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-05-09T09:47:43.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.507+0000 7f267b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:43.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.507+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:126 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94350642702704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88ba970 con 0x55cfb889b370 2024-05-09T09:47:43.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.507+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(126 data_loggenerations_metadata [watch unwatch cookie 94350642702704] v30'273 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f27b8036040 con 0x55cfb889b370 2024-05-09T09:47:43.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.507+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:127 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94350642678256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88b7770 con 0x7f27bc0da040 2024-05-09T09:47:43.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.507+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.2 v2:172.21.15.157:6800/354455204 25 ==== osd_op_reply(127 notify.0 [watch unwatch cookie 94350642678256] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27b8036040 con 0x7f27bc0da040 2024-05-09T09:47:43.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.507+0000 7f27c806f980 20 remove_watcher() i=0 2024-05-09T09:47:43.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.507+0000 7f27c806f980 2 removed watcher, disabling cache 2024-05-09T09:47:43.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.507+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:128 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94350642682304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88b7770 con 0x55cfb889b370 2024-05-09T09:47:43.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.511+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(128 notify.1 [watch unwatch cookie 94350642682304] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27b8036040 con 0x55cfb889b370 2024-05-09T09:47:43.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.511+0000 7f27c806f980 20 remove_watcher() i=1 2024-05-09T09:47:43.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.511+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:129 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94350642675696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88b7770 con 0x55cfb88a4610 2024-05-09T09:47:43.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.511+0000 7f27c5389640 1 -- 172.21.15.157:0/326399827 <== osd.3 v2:172.21.15.157:6816/2487336710 40 ==== osd_op_reply(129 notify.2 [watch unwatch cookie 94350642675696] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27bc0c9070 con 0x55cfb88a4610 2024-05-09T09:47:43.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.511+0000 7f27c806f980 20 remove_watcher() i=2 2024-05-09T09:47:43.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.511+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:130 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94350642688240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88a89f0 con 0x7f27bc0da040 2024-05-09T09:47:43.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.515+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.2 v2:172.21.15.157:6800/354455204 26 ==== osd_op_reply(130 notify.3 [watch unwatch cookie 94350642688240] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27b8036040 con 0x7f27bc0da040 2024-05-09T09:47:43.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.515+0000 7f27c806f980 20 remove_watcher() i=3 2024-05-09T09:47:43.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.515+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:131 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94350642692640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88a7ff0 con 0x55cfb889b370 2024-05-09T09:47:43.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.515+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(131 notify.4 [watch unwatch cookie 94350642692640] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27b8036040 con 0x55cfb889b370 2024-05-09T09:47:43.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.515+0000 7f27c806f980 20 remove_watcher() i=4 2024-05-09T09:47:43.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.515+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:132 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94350642690304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88a89f0 con 0x55cfb889fd30 2024-05-09T09:47:43.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.519+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(132 notify.5 [watch unwatch cookie 94350642690304] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.519+0000 7f27c806f980 20 remove_watcher() i=5 2024-05-09T09:47:43.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.519+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:133 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94350642699104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88ac220 con 0x55cfb889fd30 2024-05-09T09:47:43.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.519+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 32 ==== osd_op_reply(133 notify.6 [watch unwatch cookie 94350642699104] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.519+0000 7f27c806f980 20 remove_watcher() i=6 2024-05-09T09:47:43.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.519+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:134 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94350642700160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cfb88a7ff0 con 0x55cfb889fd30 2024-05-09T09:47:43.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c5b8a640 1 -- 172.21.15.157:0/326399827 <== osd.0 v2:172.21.15.110:6800/231209037 33 ==== osd_op_reply(134 notify.7 [watch unwatch cookie 94350642700160] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27c0074020 con 0x55cfb889fd30 2024-05-09T09:47:43.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 20 remove_watcher() i=7 2024-05-09T09:47:43.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cfb889fd30 msgr2=0x55cfb88a2120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 --2- 172.21.15.157:0/326399827 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cfb889fd30 0x55cfb88a2120 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cfb889b370 msgr2=0x55cfb889d830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 --2- 172.21.15.157:0/326399827 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cfb889b370 0x55cfb889d830 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f27bc0da040 msgr2=0x7f27bc0da420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 --2- 172.21.15.157:0/326399827 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f27bc0da040 0x7f27bc0da420 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cfb88a4610 msgr2=0x55cfb88a6ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 --2- 172.21.15.157:0/326399827 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cfb88a4610 0x55cfb88a6ad0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2690034d00 msgr2=0x7f26900371c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 --2- 172.21.15.157:0/326399827 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2690034d00 0x7f26900371c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f27bc0aafd0 tx=0x7f27bc0a7000 comp rx=0 tx=0).stop 2024-05-09T09:47:43.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb88874b0 msgr2=0x55cfb888e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c638b640 1 -- 172.21.15.157:0/326399827 reap_dead start 2024-05-09T09:47:43.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 --2- 172.21.15.157:0/326399827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb88874b0 0x55cfb888e890 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f27c0050f80 tx=0x7f27c0050eb0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 shutdown_connections 2024-05-09T09:47:43.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 --2- 172.21.15.157:0/326399827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb88874b0 0x55cfb888e890 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 >> 172.21.15.157:0/326399827 conn(0x55cfb8883830 msgr2=0x55cfb8880e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:43.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 shutdown_connections 2024-05-09T09:47:43.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 -- 172.21.15.157:0/326399827 wait complete. 2024-05-09T09:47:43.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 -- 172.21.15.157:0/4000575738 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f26a0034b60 msgr2=0x7f26a0037020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 --2- 172.21.15.157:0/4000575738 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f26a0034b60 0x7f26a0037020 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f27bc0ad040 tx=0x7f27bc005d90 comp rx=0 tx=0).stop 2024-05-09T09:47:43.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 -- 172.21.15.157:0/4000575738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb887a4e0 msgr2=0x55cfb887a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 --2- 172.21.15.157:0/4000575738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb887a4e0 0x55cfb887a900 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f27c0016db0 tx=0x7f27c0018700 comp rx=0 tx=0).stop 2024-05-09T09:47:43.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 -- 172.21.15.157:0/4000575738 shutdown_connections 2024-05-09T09:47:43.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 --2- 172.21.15.157:0/4000575738 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f26a0034b60 0x7f26a0037020 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 --2- 172.21.15.157:0/4000575738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb887a4e0 0x55cfb887a900 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 -- 172.21.15.157:0/4000575738 >> 172.21.15.157:0/4000575738 conn(0x55cfb886f2b0 msgr2=0x55cfb886fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:43.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 -- 172.21.15.157:0/4000575738 shutdown_connections 2024-05-09T09:47:43.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 -- 172.21.15.157:0/4000575738 wait complete. 2024-05-09T09:47:43.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 -- 172.21.15.157:0/1611730210 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cfb884da90 msgr2=0x55cfb884ff30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 --2- 172.21.15.157:0/1611730210 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cfb884da90 0x55cfb884ff30 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 -- 172.21.15.157:0/1611730210 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cfb8848e30 msgr2=0x55cfb884b260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 --2- 172.21.15.157:0/1611730210 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cfb8848e30 0x55cfb884b260 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 -- 172.21.15.157:0/1611730210 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cfb8851b20 msgr2=0x55cfb8853f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 --2- 172.21.15.157:0/1611730210 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cfb8851b20 0x55cfb8853f10 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 -- 172.21.15.157:0/1611730210 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f26ac034bb0 msgr2=0x7f26ac037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 --2- 172.21.15.157:0/1611730210 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f26ac034bb0 0x7f26ac037070 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f27bc0ac000 tx=0x7f27bc0a5000 comp rx=0 tx=0).stop 2024-05-09T09:47:43.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 -- 172.21.15.157:0/1611730210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb8756020 msgr2=0x55cfb8843eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 --2- 172.21.15.157:0/1611730210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cfb8756020 0x55cfb8843eb0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x55cfb883d980 tx=0x7f27c0000bd0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c638b640 1 -- 172.21.15.157:0/1611730210 reap_dead start 2024-05-09T09:47:43.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 -- 172.21.15.157:0/1611730210 shutdown_connections 2024-05-09T09:47:43.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 -- 172.21.15.157:0/1611730210 >> 172.21.15.157:0/1611730210 conn(0x55cfb86c5240 msgr2=0x55cfb8837190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:43.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 -- 172.21.15.157:0/1611730210 shutdown_connections 2024-05-09T09:47:43.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.523+0000 7f27c806f980 1 -- 172.21.15.157:0/1611730210 wait complete. 2024-05-09T09:47:43.533 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-05-09T09:47:43.533 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-05-09T09:47:43.534 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-05-09T09:47:43.534 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-05-09T09:47:43.605 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:43.606 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:43.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.607+0000 7f3475cad980 1 Processor -- start 2024-05-09T09:47:43.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.607+0000 7f3475cad980 1 -- start start 2024-05-09T09:47:43.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.607+0000 7f3475cad980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55cb7af0bcd0 0x55cb7af0e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.607+0000 7f3475cad980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cb7adbd440 con 0x55cb7ae7bab0 2024-05-09T09:47:43.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.607+0000 7f3475cad980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55cb7ada85f0 con 0x55cb7af0bcd0 2024-05-09T09:47:43.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.607+0000 7f3472fc7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55cb7af0bcd0 0x55cb7af0e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.607+0000 7f3472fc7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55cb7af0bcd0 0x55cb7af0e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59726/0 (socket says 172.21.15.157:59726) 2024-05-09T09:47:43.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.607+0000 7f34737c8640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x55cb7ae7bab0 0x55cb7af0a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:51808/0 (socket says 172.21.15.157:51808) 2024-05-09T09:47:43.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.607+0000 7f3472fc7640 1 -- 172.21.15.157:0/2750314745 learned_addr learned my addr 172.21.15.157:0/2750314745 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:43.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.607+0000 7f3472fc7640 1 -- 172.21.15.157:0/2750314745 >> v1:172.21.15.110:6789/0 conn(0x55cb7ae7bab0 legacy=0x55cb7af0a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.607+0000 7f3472fc7640 1 -- 172.21.15.157:0/2750314745 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb7adb3990 con 0x55cb7af0bcd0 2024-05-09T09:47:43.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.611+0000 7f3472fc7640 1 --2- 172.21.15.157:0/2750314745 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7af0bcd0 0x55cb7af0e0c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f346800a5c0 tx=0x7f346801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c8fafcfa88ad2a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.611+0000 7f34727c6640 1 -- 172.21.15.157:0/2750314745 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34680a6070 con 0x55cb7af0bcd0 2024-05-09T09:47:43.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.611+0000 7f34727c6640 1 -- 172.21.15.157:0/2750314745 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34680af070 con 0x55cb7af0bcd0 2024-05-09T09:47:43.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.611+0000 7f34727c6640 1 -- 172.21.15.157:0/2750314745 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34680aa5c0 con 0x55cb7af0bcd0 2024-05-09T09:47:43.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.611+0000 7f3475cad980 1 -- 172.21.15.157:0/2750314745 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7af0bcd0 msgr2=0x55cb7af0e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.611+0000 7f3475cad980 1 --2- 172.21.15.157:0/2750314745 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7af0bcd0 0x55cb7af0e0c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f346800a5c0 tx=0x7f346801b340 comp rx=0 tx=0).stop 2024-05-09T09:47:43.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.611+0000 7f3475cad980 1 -- 172.21.15.157:0/2750314745 shutdown_connections 2024-05-09T09:47:43.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.611+0000 7f3475cad980 1 --2- 172.21.15.157:0/2750314745 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7af0bcd0 0x55cb7af0e0c0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.611+0000 7f3475cad980 1 -- 172.21.15.157:0/2750314745 >> 172.21.15.157:0/2750314745 conn(0x55cb7af020d0 msgr2=0x55cb7af044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:43.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.611+0000 7f3475cad980 1 -- 172.21.15.157:0/2750314745 shutdown_connections 2024-05-09T09:47:43.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.611+0000 7f3475cad980 1 -- 172.21.15.157:0/2750314745 wait complete. 2024-05-09T09:47:43.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.627+0000 7f3475cad980 1 Processor -- start 2024-05-09T09:47:43.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.627+0000 7f3475cad980 1 -- start start 2024-05-09T09:47:43.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.627+0000 7f3475cad980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7ae7bab0 0x55cb7aff2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.627+0000 7f3475cad980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55cb7ae0afe0 con 0x55cb7ae7bab0 2024-05-09T09:47:43.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.627+0000 7f34737c8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7ae7bab0 0x55cb7aff2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.627+0000 7f34737c8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7ae7bab0 0x55cb7aff2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59736/0 (socket says 172.21.15.157:59736) 2024-05-09T09:47:43.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.627+0000 7f34737c8640 1 -- 172.21.15.157:0/1598239786 learned_addr learned my addr 172.21.15.157:0/1598239786 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:43.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.627+0000 7f34737c8640 1 -- 172.21.15.157:0/1598239786 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb7ad8fae0 con 0x55cb7ae7bab0 2024-05-09T09:47:43.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.631+0000 7f34737c8640 1 --2- 172.21.15.157:0/1598239786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7ae7bab0 0x55cb7aff2b80 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3464001e50 tx=0x7f3464001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=400d889470ce7f14 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.631+0000 7f336160a640 1 -- 172.21.15.157:0/1598239786 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f346400e5d0 con 0x55cb7ae7bab0 2024-05-09T09:47:43.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.631+0000 7f336160a640 1 -- 172.21.15.157:0/1598239786 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f346400e770 con 0x55cb7ae7bab0 2024-05-09T09:47:43.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.631+0000 7f336160a640 1 -- 172.21.15.157:0/1598239786 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f346400eab0 con 0x55cb7ae7bab0 2024-05-09T09:47:43.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.631+0000 7f3475cad980 1 -- 172.21.15.157:0/1598239786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7ae7bab0 msgr2=0x55cb7aff2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.631+0000 7f3475cad980 1 --2- 172.21.15.157:0/1598239786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7ae7bab0 0x55cb7aff2b80 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3464001e50 tx=0x7f3464001e80 comp rx=0 tx=0).stop 2024-05-09T09:47:43.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.631+0000 7f3475cad980 1 -- 172.21.15.157:0/1598239786 shutdown_connections 2024-05-09T09:47:43.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.631+0000 7f3475cad980 1 --2- 172.21.15.157:0/1598239786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7ae7bab0 0x55cb7aff2b80 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.631+0000 7f3475cad980 1 -- 172.21.15.157:0/1598239786 >> 172.21.15.157:0/1598239786 conn(0x55cb7af020d0 msgr2=0x55cb7afee710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:43.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.631+0000 7f3475cad980 1 -- 172.21.15.157:0/1598239786 shutdown_connections 2024-05-09T09:47:43.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.631+0000 7f3475cad980 1 -- 172.21.15.157:0/1598239786 wait complete. 2024-05-09T09:47:43.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.631+0000 7f3475cad980 1 Processor -- start 2024-05-09T09:47:43.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.631+0000 7f3475cad980 1 -- start start 2024-05-09T09:47:43.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.631+0000 7f3475cad980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7ae7bab0 0x55cb7aff9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.631+0000 7f3475cad980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55cb7af0f1a0 con 0x55cb7ae7bab0 2024-05-09T09:47:43.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.631+0000 7f34737c8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7ae7bab0 0x55cb7aff9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.631+0000 7f34737c8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7ae7bab0 0x55cb7aff9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59748/0 (socket says 172.21.15.157:59748) 2024-05-09T09:47:43.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.631+0000 7f34737c8640 1 -- 172.21.15.157:0/1956647129 learned_addr learned my addr 172.21.15.157:0/1956647129 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:43.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.635+0000 7f34737c8640 1 -- 172.21.15.157:0/1956647129 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb7affa260 con 0x55cb7ae7bab0 2024-05-09T09:47:43.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.635+0000 7f34737c8640 1 --2- 172.21.15.157:0/1956647129 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7ae7bab0 0x55cb7aff9d20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x55cb7aff3a10 tx=0x7f3464000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.635+0000 7f335fe07640 1 -- 172.21.15.157:0/1956647129 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3464001260 con 0x55cb7ae7bab0 2024-05-09T09:47:43.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.635+0000 7f3475cad980 1 -- 172.21.15.157:0/1956647129 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cb7affa4f0 con 0x55cb7ae7bab0 2024-05-09T09:47:43.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.635+0000 7f335fe07640 1 -- 172.21.15.157:0/1956647129 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f346400f920 con 0x55cb7ae7bab0 2024-05-09T09:47:43.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.635+0000 7f335fe07640 1 -- 172.21.15.157:0/1956647129 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f346400fcc0 con 0x55cb7ae7bab0 2024-05-09T09:47:43.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.635+0000 7f3475cad980 1 -- 172.21.15.157:0/1956647129 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb7affd1d0 con 0x55cb7ae7bab0 2024-05-09T09:47:43.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.635+0000 7f335fe07640 1 -- 172.21.15.157:0/1956647129 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f3464017070 con 0x55cb7ae7bab0 2024-05-09T09:47:43.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.635+0000 7f335fe07640 1 --2- 172.21.15.157:0/1956647129 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3358034c00 0x7f33580370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.635+0000 7f335fe07640 1 -- 172.21.15.157:0/1956647129 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f3464015020 con 0x55cb7ae7bab0 2024-05-09T09:47:43.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.635+0000 7f3472fc7640 1 --2- 172.21.15.157:0/1956647129 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3358034c00 0x7f33580370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.635+0000 7f3475cad980 1 --2- 172.21.15.157:0/1956647129 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cb7af0bcd0 0x55cb7b000cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.635+0000 7f3475cad980 1 -- 172.21.15.157:0/1956647129 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b001300 con 0x55cb7af0bcd0 2024-05-09T09:47:43.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.635+0000 7f3473fc9640 1 --2- 172.21.15.157:0/1956647129 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cb7af0bcd0 0x55cb7b000cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.635+0000 7f3472fc7640 1 --2- 172.21.15.157:0/1956647129 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3358034c00 0x7f33580370c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f34680ae000 tx=0x7f34680a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.635+0000 7f3473fc9640 1 --2- 172.21.15.157:0/1956647129 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cb7af0bcd0 0x55cb7b000cb0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.635+0000 7f3473fc9640 1 -- 172.21.15.157:0/1956647129 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7af0bcd0 2024-05-09T09:47:43.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.635+0000 7f3475cad980 1 -- 172.21.15.157:0/1956647129 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb7affe3f0 con 0x55cb7af0bcd0 2024-05-09T09:47:43.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.639+0000 7f3473fc9640 1 -- 172.21.15.157:0/1956647129 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7af0bcd0 2024-05-09T09:47:43.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.639+0000 7f3475cad980 1 --2- 172.21.15.157:0/1956647129 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cb7b003650 0x55cb7b005a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.639+0000 7f3475cad980 1 -- 172.21.15.157:0/1956647129 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b006110 con 0x55cb7b003650 2024-05-09T09:47:43.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.639+0000 7f34737c8640 1 --2- 172.21.15.157:0/1956647129 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cb7b003650 0x55cb7b005a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.639+0000 7f34737c8640 1 --2- 172.21.15.157:0/1956647129 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cb7b003650 0x55cb7b005a40 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.639+0000 7f34737c8640 1 -- 172.21.15.157:0/1956647129 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b003650 2024-05-09T09:47:43.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.639+0000 7f3475cad980 1 -- 172.21.15.157:0/1956647129 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0024f0 con 0x55cb7af0bcd0 2024-05-09T09:47:43.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.639+0000 7f3473fc9640 1 -- 172.21.15.157:0/1956647129 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7af0bcd0 2024-05-09T09:47:43.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.639+0000 7f3475cad980 1 --2- 172.21.15.157:0/1956647129 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cb7b007550 0x55cb7b009940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.639+0000 7f3475cad980 1 -- 172.21.15.157:0/1956647129 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b00a0d0 con 0x55cb7b007550 2024-05-09T09:47:43.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.639+0000 7f3472fc7640 1 --2- 172.21.15.157:0/1956647129 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cb7b007550 0x55cb7b009940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.639+0000 7f3472fc7640 1 --2- 172.21.15.157:0/1956647129 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cb7b007550 0x55cb7b009940 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.639+0000 7f3472fc7640 1 -- 172.21.15.157:0/1956647129 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f34680aaae0 con 0x55cb7b007550 2024-05-09T09:47:43.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.643+0000 7f3475cad980 1 Processor -- start 2024-05-09T09:47:43.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.643+0000 7f3475cad980 1 -- start start 2024-05-09T09:47:43.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.643+0000 7f3475cad980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7b02ff60 0x55cb7b030380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.643+0000 7f3475cad980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55cb7ae0f020 con 0x55cb7b02ff60 2024-05-09T09:47:43.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.643+0000 7f34737c8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7b02ff60 0x55cb7b030380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.643+0000 7f34737c8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7b02ff60 0x55cb7b030380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59758/0 (socket says 172.21.15.157:59758) 2024-05-09T09:47:43.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.643+0000 7f34737c8640 1 -- 172.21.15.157:0/2534266767 learned_addr learned my addr 172.21.15.157:0/2534266767 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:43.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.643+0000 7f34737c8640 1 -- 172.21.15.157:0/2534266767 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb7b0308c0 con 0x55cb7b02ff60 2024-05-09T09:47:43.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.643+0000 7f34737c8640 1 --2- 172.21.15.157:0/2534266767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7b02ff60 0x55cb7b030380 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f3464001440 tx=0x7f3464042e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.647+0000 7f3357fff640 1 -- 172.21.15.157:0/2534266767 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f346402c040 con 0x55cb7b02ff60 2024-05-09T09:47:43.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.647+0000 7f3475cad980 1 -- 172.21.15.157:0/2534266767 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cb7b031350 con 0x55cb7b02ff60 2024-05-09T09:47:43.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.647+0000 7f3357fff640 1 -- 172.21.15.157:0/2534266767 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3464017dc0 con 0x55cb7b02ff60 2024-05-09T09:47:43.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.647+0000 7f3475cad980 1 -- 172.21.15.157:0/2534266767 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb7b031830 con 0x55cb7b02ff60 2024-05-09T09:47:43.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.647+0000 7f3357fff640 1 -- 172.21.15.157:0/2534266767 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34640422f0 con 0x55cb7b02ff60 2024-05-09T09:47:43.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.647+0000 7f3357fff640 1 -- 172.21.15.157:0/2534266767 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f3464042760 con 0x55cb7b02ff60 2024-05-09T09:47:43.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.647+0000 7f3357fff640 1 --2- 172.21.15.157:0/2534266767 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f334c034c00 0x7f334c0370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.647+0000 7f3357fff640 1 -- 172.21.15.157:0/2534266767 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f3464051c80 con 0x55cb7b02ff60 2024-05-09T09:47:43.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.647+0000 7f3472fc7640 1 --2- 172.21.15.157:0/2534266767 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f334c034c00 0x7f334c0370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.647+0000 7f3475cad980 1 Processor -- start 2024-05-09T09:47:43.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.647+0000 7f3475cad980 1 -- start start 2024-05-09T09:47:43.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.647+0000 7f3472fc7640 1 --2- 172.21.15.157:0/2534266767 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f334c034c00 0x7f334c0370c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f34680ac040 tx=0x7f3468005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.647+0000 7f3475cad980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7b03cd50 0x55cb7b03d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.647+0000 7f3475cad980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55cb7aff32d0 con 0x55cb7b03cd50 2024-05-09T09:47:43.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.647+0000 7f34737c8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7b03cd50 0x55cb7b03d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.647+0000 7f34737c8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7b03cd50 0x55cb7b03d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59762/0 (socket says 172.21.15.157:59762) 2024-05-09T09:47:43.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.647+0000 7f34737c8640 1 -- 172.21.15.157:0/3116314419 learned_addr learned my addr 172.21.15.157:0/3116314419 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:43.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.647+0000 7f34737c8640 1 -- 172.21.15.157:0/3116314419 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb7b03d740 con 0x55cb7b03cd50 2024-05-09T09:47:43.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.651+0000 7f34737c8640 1 --2- 172.21.15.157:0/3116314419 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7b03cd50 0x55cb7b03d170 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f3464040040 tx=0x7f346403ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ba6328fe9f4dd3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.651+0000 7f3355ffb640 1 -- 172.21.15.157:0/3116314419 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3464061070 con 0x55cb7b03cd50 2024-05-09T09:47:43.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.651+0000 7f3355ffb640 1 -- 172.21.15.157:0/3116314419 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f346401dab0 con 0x55cb7b03cd50 2024-05-09T09:47:43.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.651+0000 7f3355ffb640 1 -- 172.21.15.157:0/3116314419 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3464049540 con 0x55cb7b03cd50 2024-05-09T09:47:43.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.651+0000 7f3475cad980 1 -- 172.21.15.157:0/3116314419 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7b03cd50 msgr2=0x55cb7b03d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.651+0000 7f3475cad980 1 --2- 172.21.15.157:0/3116314419 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7b03cd50 0x55cb7b03d170 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f3464040040 tx=0x7f346403ebe0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.651+0000 7f3475cad980 1 -- 172.21.15.157:0/3116314419 shutdown_connections 2024-05-09T09:47:43.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.651+0000 7f3475cad980 1 --2- 172.21.15.157:0/3116314419 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7b03cd50 0x55cb7b03d170 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.651+0000 7f3475cad980 1 -- 172.21.15.157:0/3116314419 >> 172.21.15.157:0/3116314419 conn(0x55cb7b0390d0 msgr2=0x55cb7b037130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:43.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.651+0000 7f3475cad980 1 -- 172.21.15.157:0/3116314419 shutdown_connections 2024-05-09T09:47:43.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.651+0000 7f3475cad980 1 -- 172.21.15.157:0/3116314419 wait complete. 2024-05-09T09:47:43.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.651+0000 7f3475cad980 1 Processor -- start 2024-05-09T09:47:43.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.651+0000 7f3475cad980 1 -- start start 2024-05-09T09:47:43.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.651+0000 7f3475cad980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7b03cd50 0x55cb7b0440b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.651+0000 7f3475cad980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55cb7b03de10 con 0x55cb7b03cd50 2024-05-09T09:47:43.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.651+0000 7f34737c8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7b03cd50 0x55cb7b0440b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.651+0000 7f34737c8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7b03cd50 0x55cb7b0440b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59768/0 (socket says 172.21.15.157:59768) 2024-05-09T09:47:43.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.651+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 learned_addr learned my addr 172.21.15.157:0/109625316 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:43.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.651+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb7b0445f0 con 0x55cb7b03cd50 2024-05-09T09:47:43.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.651+0000 7f34737c8640 1 --2- 172.21.15.157:0/109625316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7b03cd50 0x55cb7b0440b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f346404ad00 tx=0x7f346402eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.651+0000 7f3343fff640 1 -- 172.21.15.157:0/109625316 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f346406c020 con 0x55cb7b03cd50 2024-05-09T09:47:43.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.651+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cb7b0445f0 con 0x55cb7b03cd50 2024-05-09T09:47:43.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.651+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb7b0445f0 con 0x55cb7b03cd50 2024-05-09T09:47:43.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.651+0000 7f3343fff640 1 -- 172.21.15.157:0/109625316 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3464019c90 con 0x55cb7b03cd50 2024-05-09T09:47:43.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.651+0000 7f3343fff640 1 -- 172.21.15.157:0/109625316 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3464061030 con 0x55cb7b03cd50 2024-05-09T09:47:43.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f3343fff640 1 -- 172.21.15.157:0/109625316 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f346406f020 con 0x55cb7b03cd50 2024-05-09T09:47:43.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f3343fff640 1 --2- 172.21.15.157:0/109625316 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f333c034c00 0x7f333c0370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f3343fff640 1 -- 172.21.15.157:0/109625316 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7f3464062070 con 0x55cb7b03cd50 2024-05-09T09:47:43.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f3472fc7640 1 --2- 172.21.15.157:0/109625316 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f333c034c00 0x7f333c0370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f3475cad980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f3475cad980 1 --2- 172.21.15.157:0/109625316 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cb7b050c40 0x55cb7b053100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b053850 con 0x55cb7b050c40 2024-05-09T09:47:43.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f3473fc9640 1 --2- 172.21.15.157:0/109625316 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cb7b050c40 0x55cb7b053100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f3472fc7640 1 --2- 172.21.15.157:0/109625316 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f333c034c00 0x7f333c0370c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f34680aa910 tx=0x7f34680c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f3473fc9640 1 --2- 172.21.15.157:0/109625316 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cb7b050c40 0x55cb7b053100 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f3475cad980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:43.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f3475cad980 20 realm 2024-05-09T09:47:43.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f3475cad980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b053c60 con 0x55cb7b050c40 2024-05-09T09:47:43.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f3475cad980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:43.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f3475cad980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:43.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f3475cad980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b054530 con 0x55cb7b050c40 2024-05-09T09:47:43.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f3475cad980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:43.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f3475cad980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x55cb7b050c40 2024-05-09T09:47:43.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f3475cad980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:43.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f3475cad980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f3475cad980 1 --2- 172.21.15.157:0/109625316 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cb7b055630 0x55cb7b057a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b057ff0 con 0x55cb7b055630 2024-05-09T09:47:43.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.655+0000 7f34737c8640 1 --2- 172.21.15.157:0/109625316 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cb7b055630 0x55cb7b057a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.659+0000 7f34737c8640 1 --2- 172.21.15.157:0/109625316 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cb7b055630 0x55cb7b057a20 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.659+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b055630 2024-05-09T09:47:43.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.659+0000 7f3475cad980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:43.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.659+0000 7f3475cad980 20 searching for the correct realm 2024-05-09T09:47:43.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.659+0000 7f3475cad980 1 --2- 172.21.15.157:0/109625316 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cb7b059f40 0x55cb7b05c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.659+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b05ca40 con 0x55cb7b059f40 2024-05-09T09:47:43.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.659+0000 7f3472fc7640 1 --2- 172.21.15.157:0/109625316 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cb7b059f40 0x55cb7b05c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.659+0000 7f3472fc7640 1 --2- 172.21.15.157:0/109625316 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cb7b059f40 0x55cb7b05c370 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.659+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34680aaae0 con 0x55cb7b059f40 2024-05-09T09:47:43.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.659+0000 7f3472fc7640 1 --2- 172.21.15.157:0/109625316 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f34680e0040 0x7f34680e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.659+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b05ca40 con 0x7f34680e0040 2024-05-09T09:47:43.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.659+0000 7f3473fc9640 1 --2- 172.21.15.157:0/109625316 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f34680e0040 0x7f34680e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.659+0000 7f3473fc9640 1 --2- 172.21.15.157:0/109625316 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f34680e0040 0x7f34680e0420 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.659+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f346c00a4d0 con 0x7f34680e0040 2024-05-09T09:47:43.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.659+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x55cb7b055630 2024-05-09T09:47:43.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.659+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b055630 2024-05-09T09:47:43.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.659+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x55cb7b050c40 2024-05-09T09:47:43.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.659+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.659+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x55cb7b050c40 2024-05-09T09:47:43.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.659+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.659+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x55cb7b055630 2024-05-09T09:47:43.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.663+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b055630 2024-05-09T09:47:43.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.663+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x55cb7b055630 2024-05-09T09:47:43.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.663+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b055630 2024-05-09T09:47:43.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.663+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x7f34680e0040 2024-05-09T09:47:43.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.663+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f346c00a4d0 con 0x7f34680e0040 2024-05-09T09:47:43.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.663+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x55cb7b059f40 2024-05-09T09:47:43.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.663+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34680aaae0 con 0x55cb7b059f40 2024-05-09T09:47:43.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.663+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x55cb7b050c40 2024-05-09T09:47:43.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.663+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.663+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x55cb7b055630 2024-05-09T09:47:43.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.663+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b055630 2024-05-09T09:47:43.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.663+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x55cb7b050c40 2024-05-09T09:47:43.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.663+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.663+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x7f34680e0040 2024-05-09T09:47:43.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.663+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f346c00a4d0 con 0x7f34680e0040 2024-05-09T09:47:43.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.663+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x55cb7b059f40 2024-05-09T09:47:43.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.663+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34680aaae0 con 0x55cb7b059f40 2024-05-09T09:47:43.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.663+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x55cb7b059f40 2024-05-09T09:47:43.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.663+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f34680aaae0 con 0x55cb7b059f40 2024-05-09T09:47:43.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.663+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x55cb7b055630 2024-05-09T09:47:43.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.667+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b055630 2024-05-09T09:47:43.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.667+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x55cb7b059f40 2024-05-09T09:47:43.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.667+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34680aaae0 con 0x55cb7b059f40 2024-05-09T09:47:43.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.667+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x55cb7b059f40 2024-05-09T09:47:43.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.667+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34680aaae0 con 0x55cb7b059f40 2024-05-09T09:47:43.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.667+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x55cb7b050c40 2024-05-09T09:47:43.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.667+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.667+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x55cb7b050c40 2024-05-09T09:47:43.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.667+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.667+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x55cb7b055630 2024-05-09T09:47:43.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.667+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b055630 2024-05-09T09:47:43.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.667+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x55cb7b059f40 2024-05-09T09:47:43.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.667+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34680aaae0 con 0x55cb7b059f40 2024-05-09T09:47:43.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.667+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x7f34680e0040 2024-05-09T09:47:43.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.667+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f346c00a4d0 con 0x7f34680e0040 2024-05-09T09:47:43.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.667+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x55cb7b050c40 2024-05-09T09:47:43.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.667+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.667+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x55cb7b055630 2024-05-09T09:47:43.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.667+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b055630 2024-05-09T09:47:43.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.667+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x55cb7b059f40 2024-05-09T09:47:43.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.667+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34680aaae0 con 0x55cb7b059f40 2024-05-09T09:47:43.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.667+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x55cb7b055630 2024-05-09T09:47:43.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b055630 2024-05-09T09:47:43.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x7f34680e0040 2024-05-09T09:47:43.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f346c00a4d0 con 0x7f34680e0040 2024-05-09T09:47:43.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x55cb7b059f40 2024-05-09T09:47:43.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34680aaae0 con 0x55cb7b059f40 2024-05-09T09:47:43.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x55cb7b055630 2024-05-09T09:47:43.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b055630 2024-05-09T09:47:43.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x55cb7b050c40 2024-05-09T09:47:43.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0548d0 con 0x7f34680e0040 2024-05-09T09:47:43.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f346c00a4d0 con 0x7f34680e0040 2024-05-09T09:47:43.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:43.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:43.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:43.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:43.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:43.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:43.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0588b0 con 0x55cb7b050c40 2024-05-09T09:47:43.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:43.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0588b0 con 0x55cb7b050c40 2024-05-09T09:47:43.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:43.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0588b0 con 0x55cb7b059f40 2024-05-09T09:47:43.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f34680aaae0 con 0x55cb7b059f40 2024-05-09T09:47:43.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:43.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 20 zone default found 2024-05-09T09:47:43.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 4 Realm: () 2024-05-09T09:47:43.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:43.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:43.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:43.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 20 zonegroup default 2024-05-09T09:47:43.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b059260 con 0x55cb7b055630 2024-05-09T09:47:43.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b055630 2024-05-09T09:47:43.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:43.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b058dc0 con 0x55cb7b059f40 2024-05-09T09:47:43.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f34680aaae0 con 0x55cb7b059f40 2024-05-09T09:47:43.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:43.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b05edd0 con 0x55cb7b059f40 2024-05-09T09:47:43.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f34680aaae0 con 0x55cb7b059f40 2024-05-09T09:47:43.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:43.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 20 started sync module instance, tier type = 2024-05-09T09:47:43.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.671+0000 7f3475cad980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:43.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.675+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b05e1e0 con 0x7f34680e0040 2024-05-09T09:47:43.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.675+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x7f34680e0040 2024-05-09T09:47:43.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.675+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94332430706432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b05e1e0 con 0x7f34680e0040 2024-05-09T09:47:43.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.675+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b05f8b0 con 0x55cb7b050c40 2024-05-09T09:47:43.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.675+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94332430706432] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x7f34680e0040 2024-05-09T09:47:43.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.675+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.675+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94332430709632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b05e1e0 con 0x55cb7b050c40 2024-05-09T09:47:43.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.675+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0602c0 con 0x55cb7b059f40 2024-05-09T09:47:43.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.679+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94332430709632] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.679+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34680aaae0 con 0x55cb7b059f40 2024-05-09T09:47:43.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.679+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94332430703920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b05e150 con 0x55cb7b059f40 2024-05-09T09:47:43.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.679+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b061050 con 0x7f34680e0040 2024-05-09T09:47:43.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.679+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x7f34680e0040 2024-05-09T09:47:43.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.679+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94332430715744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0618f0 con 0x7f34680e0040 2024-05-09T09:47:43.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.679+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0622b0 con 0x55cb7b050c40 2024-05-09T09:47:43.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.679+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94332430715744] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x7f34680e0040 2024-05-09T09:47:43.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.679+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94332430703920] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34680aaae0 con 0x55cb7b059f40 2024-05-09T09:47:43.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.683+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.683+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94332430720512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b062220 con 0x55cb7b050c40 2024-05-09T09:47:43.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.683+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b061840 con 0x55cb7b055630 2024-05-09T09:47:43.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.683+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94332430720512] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.683+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b055630 2024-05-09T09:47:43.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.683+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94332430717840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b062b50 con 0x55cb7b055630 2024-05-09T09:47:43.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.683+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0633a0 con 0x55cb7b055630 2024-05-09T09:47:43.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.687+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94332430717840] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b055630 2024-05-09T09:47:43.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.687+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b055630 2024-05-09T09:47:43.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.687+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94332430722720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b063bf0 con 0x55cb7b055630 2024-05-09T09:47:43.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.687+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0644c0 con 0x55cb7b055630 2024-05-09T09:47:43.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.687+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b055630 2024-05-09T09:47:43.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.687+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94332430722720] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b055630 2024-05-09T09:47:43.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.687+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94332430729104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b064cb0 con 0x55cb7b055630 2024-05-09T09:47:43.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.687+0000 7f3475cad980 20 add_watcher() i=0 2024-05-09T09:47:43.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.687+0000 7f3475cad980 20 add_watcher() i=1 2024-05-09T09:47:43.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.687+0000 7f3475cad980 20 add_watcher() i=2 2024-05-09T09:47:43.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.687+0000 7f3475cad980 20 add_watcher() i=3 2024-05-09T09:47:43.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.687+0000 7f3475cad980 20 add_watcher() i=4 2024-05-09T09:47:43.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.687+0000 7f3475cad980 20 add_watcher() i=5 2024-05-09T09:47:43.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.687+0000 7f3475cad980 20 add_watcher() i=6 2024-05-09T09:47:43.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.691+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94332430729104] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b055630 2024-05-09T09:47:43.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.691+0000 7f3475cad980 20 add_watcher() i=7 2024-05-09T09:47:43.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.691+0000 7f3475cad980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:43.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.691+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b063830 con 0x55cb7b050c40 2024-05-09T09:47:43.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.691+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.691+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94332430731072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b063830 con 0x55cb7b050c40 2024-05-09T09:47:43.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.691+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94332430731072] v30'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.691+0000 7f3328fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:43.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.691+0000 7f3475cad980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:43.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.691+0000 7f3475cad980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:43.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.691+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b070740 con 0x55cb7b050c40 2024-05-09T09:47:43.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.695+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'66 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.695+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b070e10 con 0x55cb7b055630 2024-05-09T09:47:43.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.695+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'61 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b055630 2024-05-09T09:47:43.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.695+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b070e10 con 0x55cb7b059f40 2024-05-09T09:47:43.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.695+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'60 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34680aaae0 con 0x55cb7b059f40 2024-05-09T09:47:43.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.695+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b071400 con 0x55cb7b050c40 2024-05-09T09:47:43.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.699+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'275 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.699+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0718b0 con 0x7f34680e0040 2024-05-09T09:47:43.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.699+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'170 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x7f34680e0040 2024-05-09T09:47:43.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.699+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b06e590 con 0x55cb7b059f40 2024-05-09T09:47:43.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.699+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'114 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34680aaae0 con 0x55cb7b059f40 2024-05-09T09:47:43.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.699+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b06e590 con 0x55cb7b050c40 2024-05-09T09:47:43.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.703+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'62 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.703+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b072410 con 0x55cb7b055630 2024-05-09T09:47:43.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.703+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'113 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b055630 2024-05-09T09:47:43.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.703+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b072410 con 0x7f34680e0040 2024-05-09T09:47:43.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.707+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'60 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x7f34680e0040 2024-05-09T09:47:43.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.707+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0724a0 con 0x55cb7b059f40 2024-05-09T09:47:43.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.707+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'66 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34680aaae0 con 0x55cb7b059f40 2024-05-09T09:47:43.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.707+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b072a70 con 0x7f34680e0040 2024-05-09T09:47:43.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.707+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'171 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x7f34680e0040 2024-05-09T09:47:43.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.707+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b072a30 con 0x55cb7b055630 2024-05-09T09:47:43.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.711+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'62 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b055630 2024-05-09T09:47:43.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.711+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b072a30 con 0x7f34680e0040 2024-05-09T09:47:43.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.711+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'60 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x7f34680e0040 2024-05-09T09:47:43.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.711+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b072a30 con 0x55cb7b055630 2024-05-09T09:47:43.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.715+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'119 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b055630 2024-05-09T09:47:43.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.715+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b072a30 con 0x55cb7b050c40 2024-05-09T09:47:43.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.715+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'276 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.715+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b072a30 con 0x55cb7b059f40 2024-05-09T09:47:43.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.715+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'164 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34680aaae0 con 0x55cb7b059f40 2024-05-09T09:47:43.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.715+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b072a30 con 0x7f34680e0040 2024-05-09T09:47:43.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.719+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'172 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x7f34680e0040 2024-05-09T09:47:43.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.719+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b072a30 con 0x55cb7b059f40 2024-05-09T09:47:43.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.719+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'60 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34680aaae0 con 0x55cb7b059f40 2024-05-09T09:47:43.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.719+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b072ac0 con 0x55cb7b050c40 2024-05-09T09:47:43.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.719+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'68 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.719+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b072ac0 con 0x55cb7b050c40 2024-05-09T09:47:43.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.723+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'277 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.723+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b072ac0 con 0x55cb7b059f40 2024-05-09T09:47:43.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.723+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'165 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34680aaae0 con 0x55cb7b059f40 2024-05-09T09:47:43.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.723+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b072b50 con 0x7f34680e0040 2024-05-09T09:47:43.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.727+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'70 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x7f34680e0040 2024-05-09T09:47:43.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.727+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b072b50 con 0x55cb7b059f40 2024-05-09T09:47:43.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.727+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'62 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34680aaae0 con 0x55cb7b059f40 2024-05-09T09:47:43.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.727+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b072b50 con 0x55cb7b059f40 2024-05-09T09:47:43.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.727+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'66 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34680aaae0 con 0x55cb7b059f40 2024-05-09T09:47:43.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.727+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b072b50 con 0x55cb7b059f40 2024-05-09T09:47:43.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.727+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'56 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34680aaae0 con 0x55cb7b059f40 2024-05-09T09:47:43.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.727+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b072b50 con 0x55cb7b059f40 2024-05-09T09:47:43.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.731+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'115 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34680aaae0 con 0x55cb7b059f40 2024-05-09T09:47:43.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.731+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b072b50 con 0x55cb7b055630 2024-05-09T09:47:43.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.731+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'62 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b055630 2024-05-09T09:47:43.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.731+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b072b50 con 0x55cb7b059f40 2024-05-09T09:47:43.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.731+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'60 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34680aaae0 con 0x55cb7b059f40 2024-05-09T09:47:43.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.731+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b072b50 con 0x55cb7b055630 2024-05-09T09:47:43.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.735+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'114 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b055630 2024-05-09T09:47:43.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.735+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b072b50 con 0x55cb7b059f40 2024-05-09T09:47:43.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.735+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'166 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34680aaae0 con 0x55cb7b059f40 2024-05-09T09:47:43.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.735+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b072b50 con 0x55cb7b055630 2024-05-09T09:47:43.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.739+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'120 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b055630 2024-05-09T09:47:43.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.739+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b072b50 con 0x7f34680e0040 2024-05-09T09:47:43.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.739+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'66 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x7f34680e0040 2024-05-09T09:47:43.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f32a37fe640 20 reqs_thread_entry: start 2024-05-09T09:47:43.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:43.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f32a17fa640 20 reqs_thread_entry: start 2024-05-09T09:47:43.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-09T09:47:43.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b08e680 con 0x55cb7b050c40 2024-05-09T09:47:43.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:47:43.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-09T09:47:43.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:43.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:43.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0909c0 con 0x7f34680e0040 2024-05-09T09:47:43.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f346c00a4d0 con 0x7f34680e0040 2024-05-09T09:47:43.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 20 disabling bucket name=myfoo 2024-05-09T09:47:43.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-09T09:47:43.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:96 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b08e900 con 0x7f34680e0040 2024-05-09T09:47:43.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(96 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f346c00a4d0 con 0x7f34680e0040 2024-05-09T09:47:43.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 20 rados_obj.operate() r=0 bl.length=165 2024-05-09T09:47:43.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-05-09T09:47:43.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-09T09:47:43.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 : miss 2024-05-09T09:47:43.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 8.5 8:a7233c95:root::.bucket.meta.myfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b091570 con 0x55cb7b050c40 2024-05-09T09:47:43.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(97 .bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 20 rados_obj.operate() r=0 bl.length=379 2024-05-09T09:47:43.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 info.flags=0x17 2024-05-09T09:47:43.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 to cache LRU end 2024-05-09T09:47:43.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:43.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-09T09:47:43.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 2024-05-09T09:47:43.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 8.5 8:a7233c95:root::.bucket.meta.myfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b098d40 con 0x55cb7b050c40 2024-05-09T09:47:43.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(98 .bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v30'8 uv8 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 info.flags=0x17 2024-05-09T09:47:43.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 to cache LRU end 2024-05-09T09:47:43.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-09T09:47:43.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1, ofs0, ns] 2024-05-09T09:47:43.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.743+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:99 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94332430913088 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0943a0 con 0x55cb7b055630 2024-05-09T09:47:43.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.747+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== watch-notify(notify (1) cookie 94332430722720 notify 128849018897 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55cb7b06e060 con 0x55cb7b055630 2024-05-09T09:47:43.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.747+0000 7f3355ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018897 cookie 94332430722720 notifier 4601 bl.length()=752 2024-05-09T09:47:43.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.747+0000 7f3355ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 info.flags=0x17 2024-05-09T09:47:43.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.747+0000 7f3355ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 to cache LRU end 2024-05-09T09:47:43.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.747+0000 7f3355ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-09T09:47:43.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.747+0000 7f3355ffb640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f33380056c0 con 0x55cb7b055630 2024-05-09T09:47:43.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.747+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(99 notify.6 [notify cookie 94332430913088 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b055630 2024-05-09T09:47:43.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.747+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(100 notify.6 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b055630 2024-05-09T09:47:43.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.747+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== watch-notify(notify_complete (2) cookie 94332430913088 notify 128849018897 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cb7affd1d0 con 0x55cb7b055630 2024-05-09T09:47:43.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.747+0000 7f3475cad980 20 handle_bi_update(): bucket=:myfoo[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1]): orig_sources= new_sources= 2024-05-09T09:47:43.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.747+0000 7f3475cad980 20 handle_bi_update(): bucket=:myfoo[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1]): potential sources added=[] removed=[] 2024-05-09T09:47:43.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.747+0000 7f3475cad980 20 handle_bi_update(): bucket=:myfoo[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1]): orig_dests= new_dests= 2024-05-09T09:47:43.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.747+0000 7f3475cad980 20 handle_bi_update(): bucket=:myfoo[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1]): potential dests added=[] removed=[] 2024-05-09T09:47:43.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.747+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:101 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0920c0 con 0x55cb7b050c40 2024-05-09T09:47:43.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.747+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(101 foo [delete,create,call,call,writefull 0~391] v30'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.747+0000 7f3475cad980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:47:43.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.747+0000 7f3475cad980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:43.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.747+0000 7f3475cad980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-09T09:47:43.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.747+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 7.d 7:b4812045:::notify.4:head [notify cookie 94332430919328 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b0920c0 con 0x55cb7b050c40 2024-05-09T09:47:43.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.747+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== watch-notify(notify (1) cookie 94332430720512 notify 128849018900 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55cb7b090610 con 0x55cb7b050c40 2024-05-09T09:47:43.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.747+0000 7f33557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018900 cookie 94332430720512 notifier 4601 bl.length()=567 2024-05-09T09:47:43.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.747+0000 7f33557fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:47:43.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.747+0000 7f33557fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:43.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.747+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(102 notify.4 [notify cookie 94332430919328 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.747+0000 7f33557fa640 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f32a8003aa0 con 0x55cb7b050c40 2024-05-09T09:47:43.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.747+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(103 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.747+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== watch-notify(notify_complete (2) cookie 94332430919328 notify 128849018900 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cb7b0703b0 con 0x55cb7b050c40 2024-05-09T09:47:43.753 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-09T09:47:32.044078Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:47:32.044055Z","tags":[],"group_ids":[]} 2024-05-09T09:47:43.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.747+0000 7f3328fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:43.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.747+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:104 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94332430731072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b06fa60 con 0x55cb7b050c40 2024-05-09T09:47:43.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.751+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(104 data_loggenerations_metadata [watch unwatch cookie 94332430731072] v30'278 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.751+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94332430706432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b06fa60 con 0x7f34680e0040 2024-05-09T09:47:43.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.751+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 94332430706432] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x7f34680e0040 2024-05-09T09:47:43.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.751+0000 7f3475cad980 20 remove_watcher() i=0 2024-05-09T09:47:43.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.751+0000 7f3475cad980 2 removed watcher, disabling cache 2024-05-09T09:47:43.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.751+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94332430709632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b06fa60 con 0x55cb7b050c40 2024-05-09T09:47:43.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.755+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 36 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 94332430709632] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.755+0000 7f3475cad980 20 remove_watcher() i=1 2024-05-09T09:47:43.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.755+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94332430703920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b06fa60 con 0x55cb7b059f40 2024-05-09T09:47:43.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.755+0000 7f3472fc7640 1 -- 172.21.15.157:0/109625316 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 94332430703920] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34680aaae0 con 0x55cb7b059f40 2024-05-09T09:47:43.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.755+0000 7f3475cad980 20 remove_watcher() i=2 2024-05-09T09:47:43.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.755+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94332430715744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b06fa60 con 0x7f34680e0040 2024-05-09T09:47:43.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.755+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 94332430715744] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x7f34680e0040 2024-05-09T09:47:43.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.755+0000 7f3475cad980 20 remove_watcher() i=3 2024-05-09T09:47:43.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.755+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94332430720512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b06fa60 con 0x55cb7b050c40 2024-05-09T09:47:43.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.759+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 <== osd.1 v2:172.21.15.157:6808/3930131338 37 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 94332430720512] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f346c00a4d0 con 0x55cb7b050c40 2024-05-09T09:47:43.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.759+0000 7f3475cad980 20 remove_watcher() i=4 2024-05-09T09:47:43.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.759+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94332430717840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b06fa60 con 0x55cb7b055630 2024-05-09T09:47:43.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.759+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 94332430717840] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b055630 2024-05-09T09:47:43.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.759+0000 7f3475cad980 20 remove_watcher() i=5 2024-05-09T09:47:43.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.759+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94332430722720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b06fa60 con 0x55cb7b055630 2024-05-09T09:47:43.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 94332430722720] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b055630 2024-05-09T09:47:43.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3475cad980 20 remove_watcher() i=6 2024-05-09T09:47:43.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94332430729104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb7b06fa60 con 0x55cb7b055630 2024-05-09T09:47:43.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f34737c8640 1 -- 172.21.15.157:0/109625316 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 94332430729104] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f346402e070 con 0x55cb7b055630 2024-05-09T09:47:43.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3475cad980 20 remove_watcher() i=7 2024-05-09T09:47:43.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cb7b055630 msgr2=0x55cb7b057a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3475cad980 1 --2- 172.21.15.157:0/109625316 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cb7b055630 0x55cb7b057a20 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cb7b050c40 msgr2=0x55cb7b053100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3475cad980 1 --2- 172.21.15.157:0/109625316 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cb7b050c40 0x55cb7b053100 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f34680e0040 msgr2=0x7f34680e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3475cad980 1 --2- 172.21.15.157:0/109625316 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f34680e0040 0x7f34680e0420 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cb7b059f40 msgr2=0x55cb7b05c370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3475cad980 1 --2- 172.21.15.157:0/109625316 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cb7b059f40 0x55cb7b05c370 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f333c034c00 msgr2=0x7f333c0370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3475cad980 1 --2- 172.21.15.157:0/109625316 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f333c034c00 0x7f333c0370c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f34680aa910 tx=0x7f34680c1040 comp rx=0 tx=0).stop 2024-05-09T09:47:43.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7b03cd50 msgr2=0x55cb7b0440b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3475cad980 1 --2- 172.21.15.157:0/109625316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7b03cd50 0x55cb7b0440b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f346404ad00 tx=0x7f346402eea0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 reap_dead start 2024-05-09T09:47:43.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3473fc9640 1 -- 172.21.15.157:0/109625316 reap_dead start 2024-05-09T09:47:43.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 shutdown_connections 2024-05-09T09:47:43.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 >> 172.21.15.157:0/109625316 conn(0x55cb7b0390d0 msgr2=0x55cb7b036730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:43.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 shutdown_connections 2024-05-09T09:47:43.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3475cad980 1 -- 172.21.15.157:0/109625316 wait complete. 2024-05-09T09:47:43.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3475cad980 1 -- 172.21.15.157:0/2534266767 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f334c034c00 msgr2=0x7f334c0370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3475cad980 1 --2- 172.21.15.157:0/2534266767 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f334c034c00 0x7f334c0370c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f34680ac040 tx=0x7f3468005ad0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3475cad980 1 -- 172.21.15.157:0/2534266767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7b02ff60 msgr2=0x55cb7b030380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3475cad980 1 --2- 172.21.15.157:0/2534266767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7b02ff60 0x55cb7b030380 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f3464001440 tx=0x7f3464042e60 comp rx=0 tx=0).stop 2024-05-09T09:47:43.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3475cad980 1 -- 172.21.15.157:0/2534266767 shutdown_connections 2024-05-09T09:47:43.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3475cad980 1 --2- 172.21.15.157:0/2534266767 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f334c034c00 0x7f334c0370c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3475cad980 1 --2- 172.21.15.157:0/2534266767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7b02ff60 0x55cb7b030380 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3475cad980 1 -- 172.21.15.157:0/2534266767 >> 172.21.15.157:0/2534266767 conn(0x55cb7b024d30 msgr2=0x55cb7b025840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:43.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3475cad980 1 -- 172.21.15.157:0/2534266767 shutdown_connections 2024-05-09T09:47:43.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.763+0000 7f3475cad980 1 -- 172.21.15.157:0/2534266767 wait complete. 2024-05-09T09:47:43.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.767+0000 7f3475cad980 1 -- 172.21.15.157:0/1956647129 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cb7b003650 msgr2=0x55cb7b005a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.767+0000 7f3475cad980 1 --2- 172.21.15.157:0/1956647129 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cb7b003650 0x55cb7b005a40 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.767+0000 7f3475cad980 1 -- 172.21.15.157:0/1956647129 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cb7af0bcd0 msgr2=0x55cb7b000cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.767+0000 7f3475cad980 1 --2- 172.21.15.157:0/1956647129 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cb7af0bcd0 0x55cb7b000cb0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.767+0000 7f3475cad980 1 -- 172.21.15.157:0/1956647129 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cb7b007550 msgr2=0x55cb7b009940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.767+0000 7f3475cad980 1 --2- 172.21.15.157:0/1956647129 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cb7b007550 0x55cb7b009940 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.767+0000 7f3475cad980 1 -- 172.21.15.157:0/1956647129 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3358034c00 msgr2=0x7f33580370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.767+0000 7f3475cad980 1 --2- 172.21.15.157:0/1956647129 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3358034c00 0x7f33580370c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f34680ae000 tx=0x7f34680a6000 comp rx=0 tx=0).stop 2024-05-09T09:47:43.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.767+0000 7f3475cad980 1 -- 172.21.15.157:0/1956647129 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7ae7bab0 msgr2=0x55cb7aff9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.767+0000 7f3475cad980 1 --2- 172.21.15.157:0/1956647129 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cb7ae7bab0 0x55cb7aff9d20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x55cb7aff3a10 tx=0x7f3464000bd0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.767+0000 7f3473fc9640 1 -- 172.21.15.157:0/1956647129 reap_dead start 2024-05-09T09:47:43.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.767+0000 7f3475cad980 1 -- 172.21.15.157:0/1956647129 shutdown_connections 2024-05-09T09:47:43.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.767+0000 7f3475cad980 1 -- 172.21.15.157:0/1956647129 >> 172.21.15.157:0/1956647129 conn(0x55cb7af020d0 msgr2=0x55cb7afed220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:43.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.767+0000 7f3475cad980 1 -- 172.21.15.157:0/1956647129 shutdown_connections 2024-05-09T09:47:43.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.767+0000 7f3475cad980 1 -- 172.21.15.157:0/1956647129 wait complete. 2024-05-09T09:47:43.773 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-09T09:47:32.044078Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:47:32.044055Z', 'tags': [], 'group_ids': []} 2024-05-09T09:47:43.775 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-05-09T09:47:43.776 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-05-09T09:47:43.776 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-05-09T09:47:43.849 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:43.849 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:43.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.851+0000 7fb81b6ac980 1 Processor -- start 2024-05-09T09:47:43.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.851+0000 7fb81b6ac980 1 -- start start 2024-05-09T09:47:43.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.851+0000 7fb81b6ac980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55ecfde48030 0x55ecfde4a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.851+0000 7fb81b6ac980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ecfdcf7440 con 0x55ecfde43b30 2024-05-09T09:47:43.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.851+0000 7fb81b6ac980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55ecfdce25f0 con 0x55ecfde48030 2024-05-09T09:47:43.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.851+0000 7fb8189c6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55ecfde48030 0x55ecfde4a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.851+0000 7fb8191c7640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x55ecfde43b30 0x55ecfde43f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:51818/0 (socket says 172.21.15.157:51818) 2024-05-09T09:47:43.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.851+0000 7fb8189c6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55ecfde48030 0x55ecfde4a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59784/0 (socket says 172.21.15.157:59784) 2024-05-09T09:47:43.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.851+0000 7fb8191c7640 1 -- 172.21.15.157:0/1716372933 learned_addr learned my addr 172.21.15.157:0/1716372933 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:47:43.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.851+0000 7fb8189c6640 1 -- 172.21.15.157:0/1716372933 >> v1:172.21.15.110:6789/0 conn(0x55ecfde43b30 legacy=0x55ecfde43f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.851+0000 7fb8189c6640 1 -- 172.21.15.157:0/1716372933 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecfdced990 con 0x55ecfde48030 2024-05-09T09:47:43.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.855+0000 7fb8189c6640 1 --2- 172.21.15.157:0/1716372933 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfde48030 0x55ecfde4a420 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb80400a480 tx=0x7fb80401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac317f0b1a6b2c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.855+0000 7fb813fff640 1 -- 172.21.15.157:0/1716372933 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8040b0070 con 0x55ecfde48030 2024-05-09T09:47:43.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.855+0000 7fb813fff640 1 -- 172.21.15.157:0/1716372933 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8040ab540 con 0x55ecfde48030 2024-05-09T09:47:43.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.855+0000 7fb813fff640 1 -- 172.21.15.157:0/1716372933 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8040ab840 con 0x55ecfde48030 2024-05-09T09:47:43.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.855+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1716372933 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfde48030 msgr2=0x55ecfde4a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.855+0000 7fb81b6ac980 1 --2- 172.21.15.157:0/1716372933 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfde48030 0x55ecfde4a420 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb80400a480 tx=0x7fb80401b280 comp rx=0 tx=0).stop 2024-05-09T09:47:43.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.855+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1716372933 shutdown_connections 2024-05-09T09:47:43.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.855+0000 7fb81b6ac980 1 --2- 172.21.15.157:0/1716372933 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfde48030 0x55ecfde4a420 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.855+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1716372933 >> 172.21.15.157:0/1716372933 conn(0x55ecfddb7250 msgr2=0x55ecfddb7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:43.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.855+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1716372933 shutdown_connections 2024-05-09T09:47:43.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.855+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1716372933 wait complete. 2024-05-09T09:47:43.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.871+0000 7fb81b6ac980 1 Processor -- start 2024-05-09T09:47:43.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.871+0000 7fb81b6ac980 1 -- start start 2024-05-09T09:47:43.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.871+0000 7fb81b6ac980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfde43b30 0x55ecfdf2ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.871+0000 7fb81b6ac980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ecfdd44fe0 con 0x55ecfde43b30 2024-05-09T09:47:43.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.871+0000 7fb8191c7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfde43b30 0x55ecfdf2ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.871+0000 7fb8191c7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfde43b30 0x55ecfdf2ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59792/0 (socket says 172.21.15.157:59792) 2024-05-09T09:47:43.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.871+0000 7fb8191c7640 1 -- 172.21.15.157:0/1577628761 learned_addr learned my addr 172.21.15.157:0/1577628761 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:43.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.871+0000 7fb8191c7640 1 -- 172.21.15.157:0/1577628761 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecfdcc9ae0 con 0x55ecfde43b30 2024-05-09T09:47:43.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.875+0000 7fb8191c7640 1 --2- 172.21.15.157:0/1577628761 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfde43b30 0x55ecfdf2ed30 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb80c001d90 tx=0x7fb80c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c35cdc017d6fb5d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.875+0000 7fb707606640 1 -- 172.21.15.157:0/1577628761 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb80c013030 con 0x55ecfde43b30 2024-05-09T09:47:43.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.875+0000 7fb707606640 1 -- 172.21.15.157:0/1577628761 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb80c00e690 con 0x55ecfde43b30 2024-05-09T09:47:43.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.875+0000 7fb707606640 1 -- 172.21.15.157:0/1577628761 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb80c00ea10 con 0x55ecfde43b30 2024-05-09T09:47:43.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.875+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1577628761 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfde43b30 msgr2=0x55ecfdf2ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.875+0000 7fb81b6ac980 1 --2- 172.21.15.157:0/1577628761 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfde43b30 0x55ecfdf2ed30 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb80c001d90 tx=0x7fb80c001e80 comp rx=0 tx=0).stop 2024-05-09T09:47:43.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.875+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1577628761 shutdown_connections 2024-05-09T09:47:43.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.875+0000 7fb81b6ac980 1 --2- 172.21.15.157:0/1577628761 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfde43b30 0x55ecfdf2ed30 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.875+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1577628761 >> 172.21.15.157:0/1577628761 conn(0x55ecfddb7250 msgr2=0x55ecfdf2a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:43.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.875+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1577628761 shutdown_connections 2024-05-09T09:47:43.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.875+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1577628761 wait complete. 2024-05-09T09:47:43.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.875+0000 7fb81b6ac980 1 Processor -- start 2024-05-09T09:47:43.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.875+0000 7fb81b6ac980 1 -- start start 2024-05-09T09:47:43.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.875+0000 7fb81b6ac980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfde43b30 0x55ecfdf35f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.875+0000 7fb81b6ac980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ecfde4d450 con 0x55ecfde43b30 2024-05-09T09:47:43.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.875+0000 7fb8191c7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfde43b30 0x55ecfdf35f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.875+0000 7fb8191c7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfde43b30 0x55ecfdf35f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59794/0 (socket says 172.21.15.157:59794) 2024-05-09T09:47:43.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.875+0000 7fb8191c7640 1 -- 172.21.15.157:0/3085261587 learned_addr learned my addr 172.21.15.157:0/3085261587 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:43.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.875+0000 7fb8191c7640 1 -- 172.21.15.157:0/3085261587 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecfdf36490 con 0x55ecfde43b30 2024-05-09T09:47:43.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.875+0000 7fb8191c7640 1 --2- 172.21.15.157:0/3085261587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfde43b30 0x55ecfdf35f50 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x55ecfdf2fbc0 tx=0x7fb80c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.875+0000 7fb705e03640 1 -- 172.21.15.157:0/3085261587 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb80c027070 con 0x55ecfde43b30 2024-05-09T09:47:43.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.875+0000 7fb81b6ac980 1 -- 172.21.15.157:0/3085261587 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ecfdf36720 con 0x55ecfde43b30 2024-05-09T09:47:43.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.875+0000 7fb705e03640 1 -- 172.21.15.157:0/3085261587 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb80c019900 con 0x55ecfde43b30 2024-05-09T09:47:43.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.875+0000 7fb81b6ac980 1 -- 172.21.15.157:0/3085261587 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecfdf393b0 con 0x55ecfde43b30 2024-05-09T09:47:43.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.875+0000 7fb705e03640 1 -- 172.21.15.157:0/3085261587 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb80c019be0 con 0x55ecfde43b30 2024-05-09T09:47:43.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.879+0000 7fb705e03640 1 -- 172.21.15.157:0/3085261587 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fb80c02a070 con 0x55ecfde43b30 2024-05-09T09:47:43.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.879+0000 7fb705e03640 1 --2- 172.21.15.157:0/3085261587 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb700034c00 0x7fb7000370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.879+0000 7fb705e03640 1 -- 172.21.15.157:0/3085261587 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fb80c01f070 con 0x55ecfde43b30 2024-05-09T09:47:43.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.879+0000 7fb8189c6640 1 --2- 172.21.15.157:0/3085261587 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb700034c00 0x7fb7000370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.879+0000 7fb81b6ac980 1 --2- 172.21.15.157:0/3085261587 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ecfde48030 0x55ecfdf3ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.879+0000 7fb81b6ac980 1 -- 172.21.15.157:0/3085261587 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf3d520 con 0x55ecfde48030 2024-05-09T09:47:43.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.879+0000 7fb8199c8640 1 --2- 172.21.15.157:0/3085261587 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ecfde48030 0x55ecfdf3ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.879+0000 7fb8189c6640 1 --2- 172.21.15.157:0/3085261587 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb700034c00 0x7fb7000370c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb8040ad000 tx=0x7fb8040a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.879+0000 7fb8199c8640 1 --2- 172.21.15.157:0/3085261587 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ecfde48030 0x55ecfdf3ceb0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.879+0000 7fb8199c8640 1 -- 172.21.15.157:0/3085261587 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfde48030 2024-05-09T09:47:43.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.879+0000 7fb81b6ac980 1 -- 172.21.15.157:0/3085261587 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf3a5d0 con 0x55ecfde48030 2024-05-09T09:47:43.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.879+0000 7fb8199c8640 1 -- 172.21.15.157:0/3085261587 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfde48030 2024-05-09T09:47:43.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.879+0000 7fb81b6ac980 1 --2- 172.21.15.157:0/3085261587 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ecfdf3f870 0x55ecfdf41c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.879+0000 7fb81b6ac980 1 -- 172.21.15.157:0/3085261587 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf42350 con 0x55ecfdf3f870 2024-05-09T09:47:43.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.879+0000 7fb8191c7640 1 --2- 172.21.15.157:0/3085261587 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ecfdf3f870 0x55ecfdf41c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.879+0000 7fb8191c7640 1 --2- 172.21.15.157:0/3085261587 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ecfdf3f870 0x55ecfdf41c60 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.883+0000 7fb8191c7640 1 -- 172.21.15.157:0/3085261587 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb80c029030 con 0x55ecfdf3f870 2024-05-09T09:47:43.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.883+0000 7fb81b6ac980 1 -- 172.21.15.157:0/3085261587 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf3e710 con 0x55ecfde48030 2024-05-09T09:47:43.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.883+0000 7fb8199c8640 1 -- 172.21.15.157:0/3085261587 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfde48030 2024-05-09T09:47:43.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.883+0000 7fb81b6ac980 1 --2- 172.21.15.157:0/3085261587 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ecfdf437b0 0x55ecfdf45ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.883+0000 7fb81b6ac980 1 -- 172.21.15.157:0/3085261587 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf462e0 con 0x55ecfdf437b0 2024-05-09T09:47:43.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.883+0000 7fb8189c6640 1 --2- 172.21.15.157:0/3085261587 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ecfdf437b0 0x55ecfdf45ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.883+0000 7fb8189c6640 1 --2- 172.21.15.157:0/3085261587 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ecfdf437b0 0x55ecfdf45ba0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.883+0000 7fb8189c6640 1 -- 172.21.15.157:0/3085261587 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb8040b3040 con 0x55ecfdf437b0 2024-05-09T09:47:43.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.887+0000 7fb81b6ac980 1 Processor -- start 2024-05-09T09:47:43.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.887+0000 7fb81b6ac980 1 -- start start 2024-05-09T09:47:43.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.887+0000 7fb81b6ac980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfdf6c160 0x55ecfdf6c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.887+0000 7fb81b6ac980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ecfdd49020 con 0x55ecfdf6c160 2024-05-09T09:47:43.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.887+0000 7fb8191c7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfdf6c160 0x55ecfdf6c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.887+0000 7fb8191c7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfdf6c160 0x55ecfdf6c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59804/0 (socket says 172.21.15.157:59804) 2024-05-09T09:47:43.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.887+0000 7fb8191c7640 1 -- 172.21.15.157:0/4273243136 learned_addr learned my addr 172.21.15.157:0/4273243136 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:43.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.887+0000 7fb8191c7640 1 -- 172.21.15.157:0/4273243136 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecfdf6cac0 con 0x55ecfdf6c160 2024-05-09T09:47:43.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.891+0000 7fb8191c7640 1 --2- 172.21.15.157:0/4273243136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfdf6c160 0x55ecfdf6c580 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb80c048a90 tx=0x7fb80c016ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.891+0000 7fb6fdba0640 1 -- 172.21.15.157:0/4273243136 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb80c037040 con 0x55ecfdf6c160 2024-05-09T09:47:43.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.891+0000 7fb81b6ac980 1 -- 172.21.15.157:0/4273243136 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ecfdf6d550 con 0x55ecfdf6c160 2024-05-09T09:47:43.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.891+0000 7fb6fdba0640 1 -- 172.21.15.157:0/4273243136 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb80c048b70 con 0x55ecfdf6c160 2024-05-09T09:47:43.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.891+0000 7fb6fdba0640 1 -- 172.21.15.157:0/4273243136 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb80c048d60 con 0x55ecfdf6c160 2024-05-09T09:47:43.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.891+0000 7fb81b6ac980 1 -- 172.21.15.157:0/4273243136 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecfdf6da30 con 0x55ecfdf6c160 2024-05-09T09:47:43.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.891+0000 7fb6fdba0640 1 -- 172.21.15.157:0/4273243136 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fb80c016070 con 0x55ecfdf6c160 2024-05-09T09:47:43.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.891+0000 7fb6fdba0640 1 --2- 172.21.15.157:0/4273243136 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb6f0034bb0 0x7fb6f0037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.891+0000 7fb6fdba0640 1 -- 172.21.15.157:0/4273243136 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fb80c014070 con 0x55ecfdf6c160 2024-05-09T09:47:43.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.891+0000 7fb8189c6640 1 --2- 172.21.15.157:0/4273243136 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb6f0034bb0 0x7fb6f0037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.891+0000 7fb81b6ac980 1 Processor -- start 2024-05-09T09:47:43.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.895+0000 7fb81b6ac980 1 -- start start 2024-05-09T09:47:43.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.895+0000 7fb81b6ac980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfdf790e0 0x55ecfdf794e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.895+0000 7fb81b6ac980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ecfdf2f480 con 0x55ecfdf790e0 2024-05-09T09:47:43.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.895+0000 7fb8189c6640 1 --2- 172.21.15.157:0/4273243136 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb6f0034bb0 0x7fb6f0037070 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55ecfdf3d9f0 tx=0x7fb804005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.895+0000 7fb8191c7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfdf790e0 0x55ecfdf794e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.895+0000 7fb8191c7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfdf790e0 0x55ecfdf794e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59810/0 (socket says 172.21.15.157:59810) 2024-05-09T09:47:43.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.895+0000 7fb8191c7640 1 -- 172.21.15.157:0/2707792968 learned_addr learned my addr 172.21.15.157:0/2707792968 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:43.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.895+0000 7fb8191c7640 1 -- 172.21.15.157:0/2707792968 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecfdf79ab0 con 0x55ecfdf790e0 2024-05-09T09:47:43.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.895+0000 7fb8191c7640 1 --2- 172.21.15.157:0/2707792968 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfdf790e0 0x55ecfdf794e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb80c016670 tx=0x7fb80c02c620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470613a4a3d02a80 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.895+0000 7fb6f77fe640 1 -- 172.21.15.157:0/2707792968 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb80c04bde0 con 0x55ecfdf790e0 2024-05-09T09:47:43.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.895+0000 7fb6f77fe640 1 -- 172.21.15.157:0/2707792968 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb80c05a070 con 0x55ecfdf790e0 2024-05-09T09:47:43.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.895+0000 7fb6f77fe640 1 -- 172.21.15.157:0/2707792968 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb80c00c6a0 con 0x55ecfdf790e0 2024-05-09T09:47:43.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.895+0000 7fb81b6ac980 1 -- 172.21.15.157:0/2707792968 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfdf790e0 msgr2=0x55ecfdf794e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:43.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.895+0000 7fb81b6ac980 1 --2- 172.21.15.157:0/2707792968 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfdf790e0 0x55ecfdf794e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb80c016670 tx=0x7fb80c02c620 comp rx=0 tx=0).stop 2024-05-09T09:47:43.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.895+0000 7fb81b6ac980 1 -- 172.21.15.157:0/2707792968 shutdown_connections 2024-05-09T09:47:43.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.895+0000 7fb81b6ac980 1 --2- 172.21.15.157:0/2707792968 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfdf790e0 0x55ecfdf794e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:43.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.895+0000 7fb81b6ac980 1 -- 172.21.15.157:0/2707792968 >> 172.21.15.157:0/2707792968 conn(0x55ecfdf754b0 msgr2=0x55ecfdf73510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:43.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.895+0000 7fb81b6ac980 1 -- 172.21.15.157:0/2707792968 shutdown_connections 2024-05-09T09:47:43.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.895+0000 7fb81b6ac980 1 -- 172.21.15.157:0/2707792968 wait complete. 2024-05-09T09:47:43.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.895+0000 7fb81b6ac980 1 Processor -- start 2024-05-09T09:47:43.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.895+0000 7fb81b6ac980 1 -- start start 2024-05-09T09:47:43.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.895+0000 7fb81b6ac980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfdf790e0 0x55ecfdf80520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.895+0000 7fb81b6ac980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ecfdf7a070 con 0x55ecfdf790e0 2024-05-09T09:47:43.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.895+0000 7fb8191c7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfdf790e0 0x55ecfdf80520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.895+0000 7fb8191c7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfdf790e0 0x55ecfdf80520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59822/0 (socket says 172.21.15.157:59822) 2024-05-09T09:47:43.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.895+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 learned_addr learned my addr 172.21.15.157:0/1624076022 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:43.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.895+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecfdf80a60 con 0x55ecfdf790e0 2024-05-09T09:47:43.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb8191c7640 1 --2- 172.21.15.157:0/1624076022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfdf790e0 0x55ecfdf80520 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00c010 tx=0x7fb80c003e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb6f5ffb640 1 -- 172.21.15.157:0/1624076022 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb80c06d070 con 0x55ecfdf790e0 2024-05-09T09:47:43.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ecfdf80a60 con 0x55ecfdf790e0 2024-05-09T09:47:43.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb6f5ffb640 1 -- 172.21.15.157:0/1624076022 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb80c04a1a0 con 0x55ecfdf790e0 2024-05-09T09:47:43.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb6f5ffb640 1 -- 172.21.15.157:0/1624076022 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb80c00c900 con 0x55ecfdf790e0 2024-05-09T09:47:43.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecfdf80a60 con 0x55ecfdf790e0 2024-05-09T09:47:43.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb6f5ffb640 1 -- 172.21.15.157:0/1624076022 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fb80c070070 con 0x55ecfdf790e0 2024-05-09T09:47:43.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb6f5ffb640 1 --2- 172.21.15.157:0/1624076022 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb6e8034c00 0x7fb6e80370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb6f5ffb640 1 -- 172.21.15.157:0/1624076022 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6133+0+0 (secure 0 0 0) 0x7fb80c005050 con 0x55ecfdf790e0 2024-05-09T09:47:43.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb8189c6640 1 --2- 172.21.15.157:0/1624076022 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb6e8034c00 0x7fb6e80370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb81b6ac980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb81b6ac980 1 --2- 172.21.15.157:0/1624076022 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ecfdf8cf40 0x55ecfdf8f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf8fb50 con 0x55ecfdf8cf40 2024-05-09T09:47:43.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb8199c8640 1 --2- 172.21.15.157:0/1624076022 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ecfdf8cf40 0x55ecfdf8f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb8189c6640 1 --2- 172.21.15.157:0/1624076022 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb6e8034c00 0x7fb6e80370c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb8040abfd0 tx=0x7fb8040a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb8199c8640 1 --2- 172.21.15.157:0/1624076022 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ecfdf8cf40 0x55ecfdf8f400 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb81b6ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:43.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb81b6ac980 20 realm 2024-05-09T09:47:43.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb81b6ac980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf8ff60 con 0x55ecfdf8cf40 2024-05-09T09:47:43.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb81b6ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:43.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb81b6ac980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:43.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb81b6ac980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf90830 con 0x55ecfdf8cf40 2024-05-09T09:47:43.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb81b6ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:43.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb81b6ac980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf90bd0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb81b6ac980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:43.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb81b6ac980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb81b6ac980 1 --2- 172.21.15.157:0/1624076022 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ecfdf91930 0x55ecfdf93d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.899+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf94330 con 0x55ecfdf91930 2024-05-09T09:47:43.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.903+0000 7fb8191c7640 1 --2- 172.21.15.157:0/1624076022 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ecfdf91930 0x55ecfdf93d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.903+0000 7fb8191c7640 1 --2- 172.21.15.157:0/1624076022 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ecfdf91930 0x55ecfdf93d20 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.903+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb80c06f030 con 0x55ecfdf91930 2024-05-09T09:47:43.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.903+0000 7fb81b6ac980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:43.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.903+0000 7fb81b6ac980 20 searching for the correct realm 2024-05-09T09:47:43.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.903+0000 7fb81b6ac980 1 --2- 172.21.15.157:0/1624076022 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ecfdf96280 0x55ecfdf98670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.903+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf98d40 con 0x55ecfdf96280 2024-05-09T09:47:43.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.903+0000 7fb8189c6640 1 --2- 172.21.15.157:0/1624076022 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ecfdf96280 0x55ecfdf98670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.903+0000 7fb8189c6640 1 --2- 172.21.15.157:0/1624076022 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ecfdf96280 0x55ecfdf98670 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.903+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8040d9070 con 0x55ecfdf96280 2024-05-09T09:47:43.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.903+0000 7fb8189c6640 1 --2- 172.21.15.157:0/1624076022 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fb8040ce040 0x7fb8040db410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:43.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.903+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf98d40 con 0x7fb8040ce040 2024-05-09T09:47:43.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.903+0000 7fb8199c8640 1 --2- 172.21.15.157:0/1624076022 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fb8040ce040 0x7fb8040db410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:43.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.903+0000 7fb8199c8640 1 --2- 172.21.15.157:0/1624076022 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fb8040ce040 0x7fb8040db410 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:43.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.903+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb81400a4d0 con 0x7fb8040ce040 2024-05-09T09:47:43.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.903+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf90bd0 con 0x55ecfdf91930 2024-05-09T09:47:43.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.907+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb80c06f030 con 0x55ecfdf91930 2024-05-09T09:47:43.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.907+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf90bd0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.907+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.907+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf90bd0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.907+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.907+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf90bd0 con 0x55ecfdf91930 2024-05-09T09:47:43.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.907+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb80c06f030 con 0x55ecfdf91930 2024-05-09T09:47:43.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.907+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf90bd0 con 0x55ecfdf91930 2024-05-09T09:47:43.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.907+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb80c06f030 con 0x55ecfdf91930 2024-05-09T09:47:43.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.907+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf90bd0 con 0x7fb8040ce040 2024-05-09T09:47:43.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.907+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb81400a4d0 con 0x7fb8040ce040 2024-05-09T09:47:43.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.907+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf90bd0 con 0x55ecfdf96280 2024-05-09T09:47:43.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.907+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8040d9070 con 0x55ecfdf96280 2024-05-09T09:47:43.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.907+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf90bd0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.907+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.907+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf90bd0 con 0x55ecfdf91930 2024-05-09T09:47:43.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.907+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb80c06f030 con 0x55ecfdf91930 2024-05-09T09:47:43.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.907+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf90bd0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.907+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.907+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf90bd0 con 0x7fb8040ce040 2024-05-09T09:47:43.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.911+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb81400a4d0 con 0x7fb8040ce040 2024-05-09T09:47:43.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.911+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf90bd0 con 0x55ecfdf96280 2024-05-09T09:47:43.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.911+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8040d9070 con 0x55ecfdf96280 2024-05-09T09:47:43.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.911+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb8040e8040 con 0x55ecfdf96280 2024-05-09T09:47:43.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.911+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb8040d9070 con 0x55ecfdf96280 2024-05-09T09:47:43.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.911+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb8040e8040 con 0x55ecfdf91930 2024-05-09T09:47:43.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.911+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb80c06f030 con 0x55ecfdf91930 2024-05-09T09:47:43.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.911+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb8040e8040 con 0x55ecfdf96280 2024-05-09T09:47:43.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.911+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8040d9070 con 0x55ecfdf96280 2024-05-09T09:47:43.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.911+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb8040e8040 con 0x55ecfdf96280 2024-05-09T09:47:43.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.911+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8040d9070 con 0x55ecfdf96280 2024-05-09T09:47:43.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.911+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb8040e8040 con 0x55ecfdf8cf40 2024-05-09T09:47:43.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.911+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.911+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb8040e8040 con 0x55ecfdf8cf40 2024-05-09T09:47:43.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.911+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.911+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb8040e8040 con 0x55ecfdf91930 2024-05-09T09:47:43.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.911+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb80c06f030 con 0x55ecfdf91930 2024-05-09T09:47:43.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.911+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb8040e8040 con 0x55ecfdf96280 2024-05-09T09:47:43.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.911+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8040d9070 con 0x55ecfdf96280 2024-05-09T09:47:43.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.911+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb8040e8040 con 0x7fb8040ce040 2024-05-09T09:47:43.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.911+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb81400a4d0 con 0x7fb8040ce040 2024-05-09T09:47:43.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.911+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb8040e8040 con 0x55ecfdf8cf40 2024-05-09T09:47:43.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.911+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.911+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb8040e8040 con 0x55ecfdf91930 2024-05-09T09:47:43.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.915+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb80c06f030 con 0x55ecfdf91930 2024-05-09T09:47:43.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.915+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb8040e8040 con 0x55ecfdf96280 2024-05-09T09:47:43.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.915+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8040d9070 con 0x55ecfdf96280 2024-05-09T09:47:43.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.915+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb8040e8040 con 0x55ecfdf91930 2024-05-09T09:47:43.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.915+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb80c06f030 con 0x55ecfdf91930 2024-05-09T09:47:43.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.915+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb8040e8040 con 0x7fb8040ce040 2024-05-09T09:47:43.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.915+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb81400a4d0 con 0x7fb8040ce040 2024-05-09T09:47:43.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.915+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb8040e8040 con 0x55ecfdf96280 2024-05-09T09:47:43.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.915+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8040d9070 con 0x55ecfdf96280 2024-05-09T09:47:43.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.915+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb8040e8040 con 0x55ecfdf91930 2024-05-09T09:47:43.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.915+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb80c06f030 con 0x55ecfdf91930 2024-05-09T09:47:43.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.915+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb8040e8040 con 0x55ecfdf8cf40 2024-05-09T09:47:43.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.915+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.915+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb8040e8040 con 0x7fb8040ce040 2024-05-09T09:47:43.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.915+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb81400a4d0 con 0x7fb8040ce040 2024-05-09T09:47:43.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.915+0000 7fb81b6ac980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:43.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.915+0000 7fb81b6ac980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:43.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.915+0000 7fb81b6ac980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:43.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.915+0000 7fb81b6ac980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:43.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.915+0000 7fb81b6ac980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:43.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.915+0000 7fb81b6ac980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:43.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.915+0000 7fb81b6ac980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.915+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf94bf0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.915+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.915+0000 7fb81b6ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:43.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.915+0000 7fb81b6ac980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.915+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf94bf0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb81b6ac980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:43.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb81b6ac980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf94bf0 con 0x55ecfdf96280 2024-05-09T09:47:43.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb8040d9070 con 0x55ecfdf96280 2024-05-09T09:47:43.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb81b6ac980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:43.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb81b6ac980 20 zone default found 2024-05-09T09:47:43.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb81b6ac980 4 Realm: () 2024-05-09T09:47:43.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb81b6ac980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:43.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb81b6ac980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:43.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb81b6ac980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:43.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb81b6ac980 20 zonegroup default 2024-05-09T09:47:43.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb81b6ac980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf955b0 con 0x55ecfdf91930 2024-05-09T09:47:43.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb80c06f030 con 0x55ecfdf91930 2024-05-09T09:47:43.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb81b6ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:43.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb81b6ac980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf95150 con 0x55ecfdf96280 2024-05-09T09:47:43.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb8040d9070 con 0x55ecfdf96280 2024-05-09T09:47:43.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb81b6ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:43.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb81b6ac980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf9b0f0 con 0x55ecfdf96280 2024-05-09T09:47:43.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb8040d9070 con 0x55ecfdf96280 2024-05-09T09:47:43.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb81b6ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:43.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb81b6ac980 20 started sync module instance, tier type = 2024-05-09T09:47:43.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb81b6ac980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:43.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf9a4e0 con 0x7fb8040ce040 2024-05-09T09:47:43.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x7fb8040ce040 2024-05-09T09:47:43.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94476361640448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf9a4e0 con 0x7fb8040ce040 2024-05-09T09:47:43.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.919+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf9bb70 con 0x55ecfdf8cf40 2024-05-09T09:47:43.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.923+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94476361640448] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x7fb8040ce040 2024-05-09T09:47:43.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.923+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.923+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94476361643984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf9a4e0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.923+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf9c580 con 0x55ecfdf96280 2024-05-09T09:47:43.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.923+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94476361643984] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.923+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8040d9070 con 0x55ecfdf96280 2024-05-09T09:47:43.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.923+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94476361637936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf9a450 con 0x55ecfdf96280 2024-05-09T09:47:43.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.923+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf9d2c0 con 0x7fb8040ce040 2024-05-09T09:47:43.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.927+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x7fb8040ce040 2024-05-09T09:47:43.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.927+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94476361649616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf9d1f0 con 0x7fb8040ce040 2024-05-09T09:47:43.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.927+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf9e1c0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.927+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94476361637936] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8040d9070 con 0x55ecfdf96280 2024-05-09T09:47:43.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.927+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94476361649616] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x7fb8040ce040 2024-05-09T09:47:43.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.927+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.927+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94476361648416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf9dcd0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.927+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf9ea60 con 0x55ecfdf91930 2024-05-09T09:47:43.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.931+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94476361648416] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.931+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb80c06f030 con 0x55ecfdf91930 2024-05-09T09:47:43.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.931+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94476361655728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf9dcd0 con 0x55ecfdf91930 2024-05-09T09:47:43.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.931+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf9f2b0 con 0x55ecfdf91930 2024-05-09T09:47:43.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.931+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb80c06f030 con 0x55ecfdf91930 2024-05-09T09:47:43.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.931+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94476361655728] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb80c06f030 con 0x55ecfdf91930 2024-05-09T09:47:43.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.931+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94476361657856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf9f710 con 0x55ecfdf91930 2024-05-09T09:47:43.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.931+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf9fd00 con 0x55ecfdf91930 2024-05-09T09:47:43.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.935+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94476361657856] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb80c06f030 con 0x55ecfdf91930 2024-05-09T09:47:43.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.935+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb80c06f030 con 0x55ecfdf91930 2024-05-09T09:47:43.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.935+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94476361651808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf9fd00 con 0x55ecfdf91930 2024-05-09T09:47:43.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.935+0000 7fb81b6ac980 20 add_watcher() i=0 2024-05-09T09:47:43.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.935+0000 7fb81b6ac980 20 add_watcher() i=1 2024-05-09T09:47:43.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.935+0000 7fb81b6ac980 20 add_watcher() i=2 2024-05-09T09:47:43.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.935+0000 7fb81b6ac980 20 add_watcher() i=3 2024-05-09T09:47:43.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.935+0000 7fb81b6ac980 20 add_watcher() i=4 2024-05-09T09:47:43.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.935+0000 7fb81b6ac980 20 add_watcher() i=5 2024-05-09T09:47:43.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.935+0000 7fb81b6ac980 20 add_watcher() i=6 2024-05-09T09:47:43.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.935+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94476361651808] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb80c06f030 con 0x55ecfdf91930 2024-05-09T09:47:43.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.935+0000 7fb81b6ac980 20 add_watcher() i=7 2024-05-09T09:47:43.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.935+0000 7fb81b6ac980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:43.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.935+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfa3100 con 0x55ecfdf8cf40 2024-05-09T09:47:43.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.939+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.939+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94476361658912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfa0650 con 0x55ecfdf8cf40 2024-05-09T09:47:43.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.939+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94476361658912] v30'279 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.939+0000 7fb6ce7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:43.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.939+0000 7fb81b6ac980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:43.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.939+0000 7fb81b6ac980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:43.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.939+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfaba30 con 0x55ecfdf8cf40 2024-05-09T09:47:43.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.939+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'67 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.939+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfac080 con 0x55ecfdf91930 2024-05-09T09:47:43.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.943+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'62 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb80c06f030 con 0x55ecfdf91930 2024-05-09T09:47:43.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.943+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfac080 con 0x55ecfdf96280 2024-05-09T09:47:43.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.943+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'61 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb8040d9070 con 0x55ecfdf96280 2024-05-09T09:47:43.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.943+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfac6b0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.947+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'280 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.947+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfacb60 con 0x7fb8040ce040 2024-05-09T09:47:43.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.947+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'173 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x7fb8040ce040 2024-05-09T09:47:43.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.947+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfa9880 con 0x55ecfdf96280 2024-05-09T09:47:43.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.947+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'116 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb8040d9070 con 0x55ecfdf96280 2024-05-09T09:47:43.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.947+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfa9880 con 0x55ecfdf8cf40 2024-05-09T09:47:43.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.951+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'63 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.951+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfad6c0 con 0x55ecfdf91930 2024-05-09T09:47:43.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.951+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'115 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb80c06f030 con 0x55ecfdf91930 2024-05-09T09:47:43.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.951+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfad6c0 con 0x7fb8040ce040 2024-05-09T09:47:43.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.955+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'61 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x7fb8040ce040 2024-05-09T09:47:43.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.955+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfad6c0 con 0x55ecfdf96280 2024-05-09T09:47:43.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.955+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'67 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb8040d9070 con 0x55ecfdf96280 2024-05-09T09:47:43.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.955+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfadae0 con 0x7fb8040ce040 2024-05-09T09:47:43.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.955+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'174 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x7fb8040ce040 2024-05-09T09:47:43.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.955+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfadae0 con 0x55ecfdf91930 2024-05-09T09:47:43.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.959+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'63 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb80c06f030 con 0x55ecfdf91930 2024-05-09T09:47:43.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.959+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfadae0 con 0x7fb8040ce040 2024-05-09T09:47:43.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.959+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'61 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x7fb8040ce040 2024-05-09T09:47:43.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.959+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfadae0 con 0x55ecfdf91930 2024-05-09T09:47:43.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.963+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'121 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb80c06f030 con 0x55ecfdf91930 2024-05-09T09:47:43.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.963+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfadae0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.963+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'281 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.963+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfadae0 con 0x55ecfdf96280 2024-05-09T09:47:43.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.967+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'167 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8040d9070 con 0x55ecfdf96280 2024-05-09T09:47:43.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.967+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfadae0 con 0x7fb8040ce040 2024-05-09T09:47:43.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.967+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'175 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x7fb8040ce040 2024-05-09T09:47:43.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.967+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfadae0 con 0x55ecfdf96280 2024-05-09T09:47:43.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.971+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'61 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8040d9070 con 0x55ecfdf96280 2024-05-09T09:47:43.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.971+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfadcb0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.971+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'69 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.971+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfadcb0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.971+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'282 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.971+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfadcb0 con 0x55ecfdf96280 2024-05-09T09:47:43.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.975+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'168 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8040d9070 con 0x55ecfdf96280 2024-05-09T09:47:43.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.975+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfadcb0 con 0x7fb8040ce040 2024-05-09T09:47:43.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.975+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'71 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x7fb8040ce040 2024-05-09T09:47:43.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.975+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfadcb0 con 0x55ecfdf96280 2024-05-09T09:47:43.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.979+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'63 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8040d9070 con 0x55ecfdf96280 2024-05-09T09:47:43.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.979+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfadae0 con 0x55ecfdf96280 2024-05-09T09:47:43.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.979+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'67 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8040d9070 con 0x55ecfdf96280 2024-05-09T09:47:43.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.979+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfadb00 con 0x55ecfdf96280 2024-05-09T09:47:43.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.979+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'57 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8040d9070 con 0x55ecfdf96280 2024-05-09T09:47:43.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.979+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfadb00 con 0x55ecfdf96280 2024-05-09T09:47:43.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.979+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'117 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8040d9070 con 0x55ecfdf96280 2024-05-09T09:47:43.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.979+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfadb00 con 0x55ecfdf91930 2024-05-09T09:47:43.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.983+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'63 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb80c06f030 con 0x55ecfdf91930 2024-05-09T09:47:43.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.983+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfadb00 con 0x55ecfdf96280 2024-05-09T09:47:43.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.987+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'61 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8040d9070 con 0x55ecfdf96280 2024-05-09T09:47:43.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.987+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfadb00 con 0x55ecfdf91930 2024-05-09T09:47:43.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.987+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'116 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb80c06f030 con 0x55ecfdf91930 2024-05-09T09:47:43.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.987+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfadb00 con 0x55ecfdf96280 2024-05-09T09:47:43.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.991+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'169 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8040d9070 con 0x55ecfdf96280 2024-05-09T09:47:43.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.991+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfadb00 con 0x55ecfdf91930 2024-05-09T09:47:43.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.995+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'122 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb80c06f030 con 0x55ecfdf91930 2024-05-09T09:47:43.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.995+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfadb00 con 0x7fb8040ce040 2024-05-09T09:47:43.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.995+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'67 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x7fb8040ce040 2024-05-09T09:47:43.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.995+0000 7fb6cd7e2640 20 reqs_thread_entry: start 2024-05-09T09:47:43.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.995+0000 7fb81b6ac980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:43.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb63effd640 20 reqs_thread_entry: start 2024-05-09T09:47:43.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb81b6ac980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-09T09:47:43.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb81b6ac980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfc98c0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:43.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb81b6ac980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:47:43.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb81b6ac980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-09T09:47:43.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb81b6ac980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:43.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb81b6ac980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:43.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfcbca0 con 0x7fb8040ce040 2024-05-09T09:47:43.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fb81400a4d0 con 0x7fb8040ce040 2024-05-09T09:47:43.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb81b6ac980 20 enabling bucket name=myfoo 2024-05-09T09:47:43.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb81b6ac980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-09T09:47:43.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb81b6ac980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:96 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfc97a0 con 0x7fb8040ce040 2024-05-09T09:47:43.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(96 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7fb81400a4d0 con 0x7fb8040ce040 2024-05-09T09:47:43.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb81b6ac980 20 rados_obj.operate() r=0 bl.length=165 2024-05-09T09:47:43.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb81b6ac980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-05-09T09:47:43.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb81b6ac980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-09T09:47:43.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb81b6ac980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 : miss 2024-05-09T09:47:43.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb81b6ac980 20 rados->read ofs=0 len=0 2024-05-09T09:47:43.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 8.5 8:a7233c95:root::.bucket.meta.myfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfcc910 con 0x55ecfdf8cf40 2024-05-09T09:47:43.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(97 .bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv8 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:44.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb81b6ac980 20 rados_obj.operate() r=0 bl.length=379 2024-05-09T09:47:44.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb81b6ac980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 info.flags=0x17 2024-05-09T09:47:44.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb81b6ac980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 to cache LRU end 2024-05-09T09:47:44.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb81b6ac980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:47:44.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb81b6ac980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-09T09:47:44.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb81b6ac980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 2024-05-09T09:47:44.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:43.999+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 8.5 8:a7233c95:root::.bucket.meta.myfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfd4070 con 0x55ecfdf8cf40 2024-05-09T09:47:44.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(98 .bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v30'9 uv9 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:44.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb81b6ac980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 info.flags=0x17 2024-05-09T09:47:44.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb81b6ac980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 to cache LRU end 2024-05-09T09:47:44.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb81b6ac980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-09T09:47:44.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb81b6ac980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1, ofs0, ns] 2024-05-09T09:47:44.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:99 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94476361843168 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfcf6d0 con 0x55ecfdf91930 2024-05-09T09:47:44.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== watch-notify(notify (1) cookie 94476361657856 notify 128849018898 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55ecfdfad6c0 con 0x55ecfdf91930 2024-05-09T09:47:44.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb6f77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018898 cookie 94476361657856 notifier 4608 bl.length()=752 2024-05-09T09:47:44.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb6f77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 info.flags=0x17 2024-05-09T09:47:44.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb6f77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1 to cache LRU end 2024-05-09T09:47:44.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb6f77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-09T09:47:44.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb6f77fe640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fb6dc0056c0 con 0x55ecfdf91930 2024-05-09T09:47:44.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(99 notify.6 [notify cookie 94476361843168 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb80c06f030 con 0x55ecfdf91930 2024-05-09T09:47:44.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(100 notify.6 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb80c06f030 con 0x55ecfdf91930 2024-05-09T09:47:44.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== watch-notify(notify_complete (2) cookie 94476361843168 notify 128849018898 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ecfdf6cac0 con 0x55ecfdf91930 2024-05-09T09:47:44.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb81b6ac980 20 handle_bi_update(): bucket=:myfoo[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1]): orig_sources= new_sources= 2024-05-09T09:47:44.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb81b6ac980 20 handle_bi_update(): bucket=:myfoo[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1]): potential sources added=[] removed=[] 2024-05-09T09:47:44.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb81b6ac980 20 handle_bi_update(): bucket=:myfoo[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1]): orig_dests= new_dests= 2024-05-09T09:47:44.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb81b6ac980 20 handle_bi_update(): bucket=:myfoo[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1]): potential dests added=[] removed=[] 2024-05-09T09:47:44.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:101 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfd1900 con 0x55ecfdf8cf40 2024-05-09T09:47:44.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(101 foo [delete,create,call,call,writefull 0~391] v30'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:44.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb81b6ac980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:47:44.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb81b6ac980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:44.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb81b6ac980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-09T09:47:44.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 7.d 7:b4812045:::notify.4:head [notify cookie 94476361866976 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfd1900 con 0x55ecfdf8cf40 2024-05-09T09:47:44.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== watch-notify(notify (1) cookie 94476361648416 notify 128849018901 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55ecfdfcbe00 con 0x55ecfdf8cf40 2024-05-09T09:47:44.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(102 notify.4 [notify cookie 94476361866976 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:44.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb6f6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018901 cookie 94476361648416 notifier 4608 bl.length()=567 2024-05-09T09:47:44.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb6f6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:47:44.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb6f6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:47:44.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.003+0000 7fb6f6ffd640 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fb64c003aa0 con 0x55ecfdf8cf40 2024-05-09T09:47:44.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.007+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(103 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:44.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.007+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== watch-notify(notify_complete (2) cookie 94476361866976 notify 128849018901 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ecfdfab680 con 0x55ecfdf8cf40 2024-05-09T09:47:44.005 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-09T09:47:32.044078Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:47:32.044055Z","tags":[],"group_ids":[]} 2024-05-09T09:47:44.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.007+0000 7fb6ce7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:44.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.007+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:104 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94476361658912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdfa7520 con 0x55ecfdf8cf40 2024-05-09T09:47:44.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.007+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(104 data_loggenerations_metadata [watch unwatch cookie 94476361658912] v30'283 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:44.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.007+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94476361640448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf9f220 con 0x7fb8040ce040 2024-05-09T09:47:44.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.011+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 94476361640448] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x7fb8040ce040 2024-05-09T09:47:44.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.011+0000 7fb81b6ac980 20 remove_watcher() i=0 2024-05-09T09:47:44.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.011+0000 7fb81b6ac980 2 removed watcher, disabling cache 2024-05-09T09:47:44.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.011+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94476361643984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf9a9e0 con 0x55ecfdf8cf40 2024-05-09T09:47:44.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.011+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 36 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 94476361643984] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:44.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.011+0000 7fb81b6ac980 20 remove_watcher() i=1 2024-05-09T09:47:44.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.011+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94476361637936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf9b7d0 con 0x55ecfdf96280 2024-05-09T09:47:44.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.015+0000 7fb8189c6640 1 -- 172.21.15.157:0/1624076022 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 94476361637936] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8040d9070 con 0x55ecfdf96280 2024-05-09T09:47:44.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.015+0000 7fb81b6ac980 20 remove_watcher() i=2 2024-05-09T09:47:44.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.015+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94476361649616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf9b7d0 con 0x7fb8040ce040 2024-05-09T09:47:44.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.015+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 94476361649616] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x7fb8040ce040 2024-05-09T09:47:44.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.015+0000 7fb81b6ac980 20 remove_watcher() i=3 2024-05-09T09:47:44.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.015+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94476361648416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf9cdd0 con 0x55ecfdf8cf40 2024-05-09T09:47:44.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.015+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 <== osd.1 v2:172.21.15.157:6808/3930131338 37 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 94476361648416] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb81400a4d0 con 0x55ecfdf8cf40 2024-05-09T09:47:44.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.015+0000 7fb81b6ac980 20 remove_watcher() i=4 2024-05-09T09:47:44.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.015+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94476361655728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf9b7d0 con 0x55ecfdf91930 2024-05-09T09:47:44.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.019+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 94476361655728] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb80c06f030 con 0x55ecfdf91930 2024-05-09T09:47:44.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.019+0000 7fb81b6ac980 20 remove_watcher() i=5 2024-05-09T09:47:44.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.019+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94476361657856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf9cdd0 con 0x55ecfdf91930 2024-05-09T09:47:44.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.019+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 94476361657856] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb80c06f030 con 0x55ecfdf91930 2024-05-09T09:47:44.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.019+0000 7fb81b6ac980 20 remove_watcher() i=6 2024-05-09T09:47:44.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.019+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94476361651808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ecfdf9b7d0 con 0x55ecfdf91930 2024-05-09T09:47:44.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb8191c7640 1 -- 172.21.15.157:0/1624076022 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 94476361651808] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb80c06f030 con 0x55ecfdf91930 2024-05-09T09:47:44.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 20 remove_watcher() i=7 2024-05-09T09:47:44.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ecfdf91930 msgr2=0x55ecfdf93d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:44.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 --2- 172.21.15.157:0/1624076022 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ecfdf91930 0x55ecfdf93d20 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:44.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ecfdf8cf40 msgr2=0x55ecfdf8f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:44.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 --2- 172.21.15.157:0/1624076022 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ecfdf8cf40 0x55ecfdf8f400 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:44.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fb8040ce040 msgr2=0x7fb8040db410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:44.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 --2- 172.21.15.157:0/1624076022 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fb8040ce040 0x7fb8040db410 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:44.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ecfdf96280 msgr2=0x55ecfdf98670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:44.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 --2- 172.21.15.157:0/1624076022 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ecfdf96280 0x55ecfdf98670 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:44.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb6e8034c00 msgr2=0x7fb6e80370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:44.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 --2- 172.21.15.157:0/1624076022 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb6e8034c00 0x7fb6e80370c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb8040abfd0 tx=0x7fb8040a6000 comp rx=0 tx=0).stop 2024-05-09T09:47:44.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfdf790e0 msgr2=0x55ecfdf80520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:44.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 --2- 172.21.15.157:0/1624076022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfdf790e0 0x55ecfdf80520 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00c010 tx=0x7fb80c003e70 comp rx=0 tx=0).stop 2024-05-09T09:47:44.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb8199c8640 1 -- 172.21.15.157:0/1624076022 reap_dead start 2024-05-09T09:47:44.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 shutdown_connections 2024-05-09T09:47:44.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 --2- 172.21.15.157:0/1624076022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfdf790e0 0x55ecfdf80520 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:44.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 >> 172.21.15.157:0/1624076022 conn(0x55ecfdf754b0 msgr2=0x55ecfdf72b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:44.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 shutdown_connections 2024-05-09T09:47:44.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 -- 172.21.15.157:0/1624076022 wait complete. 2024-05-09T09:47:44.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 -- 172.21.15.157:0/4273243136 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb6f0034bb0 msgr2=0x7fb6f0037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:44.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 --2- 172.21.15.157:0/4273243136 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb6f0034bb0 0x7fb6f0037070 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55ecfdf3d9f0 tx=0x7fb804005a10 comp rx=0 tx=0).stop 2024-05-09T09:47:44.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 -- 172.21.15.157:0/4273243136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfdf6c160 msgr2=0x55ecfdf6c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:44.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 --2- 172.21.15.157:0/4273243136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfdf6c160 0x55ecfdf6c580 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb80c048a90 tx=0x7fb80c016ab0 comp rx=0 tx=0).stop 2024-05-09T09:47:44.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 -- 172.21.15.157:0/4273243136 shutdown_connections 2024-05-09T09:47:44.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 --2- 172.21.15.157:0/4273243136 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb6f0034bb0 0x7fb6f0037070 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:44.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 --2- 172.21.15.157:0/4273243136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfdf6c160 0x55ecfdf6c580 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:44.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 -- 172.21.15.157:0/4273243136 >> 172.21.15.157:0/4273243136 conn(0x55ecfdf60f30 msgr2=0x55ecfdf61a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:44.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 -- 172.21.15.157:0/4273243136 shutdown_connections 2024-05-09T09:47:44.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 -- 172.21.15.157:0/4273243136 wait complete. 2024-05-09T09:47:44.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 -- 172.21.15.157:0/3085261587 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ecfdf3f870 msgr2=0x55ecfdf41c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:44.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 --2- 172.21.15.157:0/3085261587 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ecfdf3f870 0x55ecfdf41c60 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:44.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 -- 172.21.15.157:0/3085261587 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ecfde48030 msgr2=0x55ecfdf3ceb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:44.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 --2- 172.21.15.157:0/3085261587 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ecfde48030 0x55ecfdf3ceb0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:44.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 -- 172.21.15.157:0/3085261587 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ecfdf437b0 msgr2=0x55ecfdf45ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:44.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 --2- 172.21.15.157:0/3085261587 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55ecfdf437b0 0x55ecfdf45ba0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:44.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 -- 172.21.15.157:0/3085261587 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb700034c00 msgr2=0x7fb7000370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:44.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 --2- 172.21.15.157:0/3085261587 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb700034c00 0x7fb7000370c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb8040ad000 tx=0x7fb8040a5040 comp rx=0 tx=0).stop 2024-05-09T09:47:44.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 -- 172.21.15.157:0/3085261587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfde43b30 msgr2=0x55ecfdf35f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:44.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 --2- 172.21.15.157:0/3085261587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ecfde43b30 0x55ecfdf35f50 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x55ecfdf2fbc0 tx=0x7fb80c000bd0 comp rx=0 tx=0).stop 2024-05-09T09:47:44.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb8199c8640 1 -- 172.21.15.157:0/3085261587 reap_dead start 2024-05-09T09:47:44.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 -- 172.21.15.157:0/3085261587 shutdown_connections 2024-05-09T09:47:44.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 -- 172.21.15.157:0/3085261587 >> 172.21.15.157:0/3085261587 conn(0x55ecfddb7250 msgr2=0x55ecfdf293d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:44.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 -- 172.21.15.157:0/3085261587 shutdown_connections 2024-05-09T09:47:44.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:44.023+0000 7fb81b6ac980 1 -- 172.21.15.157:0/3085261587 wait complete. 2024-05-09T09:47:44.035 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-09T09:47:32.044078Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:47:32.044055Z', 'tags': [], 'group_ids': []} 2024-05-09T09:47:44.045 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-05-09T09:47:44.392 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-05-09T09:47:44.407 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-09T09:47:59.408 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-05-09T09:47:59.408 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-05-09T09:47:59.409 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-05-09T09:47:59.448 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:59.448 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:59.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.450+0000 7fc97a9a5980 1 Processor -- start 2024-05-09T09:47:59.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.450+0000 7fc97a9a5980 1 -- start start 2024-05-09T09:47:59.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.450+0000 7fc97a9a5980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5556715d9030 0x5556715db420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.450+0000 7fc97a9a5980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555671488440 con 0x5556715d4b30 2024-05-09T09:47:59.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.450+0000 7fc97a9a5980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5556714735f0 con 0x5556715d9030 2024-05-09T09:47:59.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.450+0000 7fc977cbf640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5556715d9030 0x5556715db420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.450+0000 7fc977cbf640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5556715d9030 0x5556715db420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:34778/0 (socket says 172.21.15.157:34778) 2024-05-09T09:47:59.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.450+0000 7fc977cbf640 1 -- 172.21.15.157:0/1780604909 learned_addr learned my addr 172.21.15.157:0/1780604909 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:59.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.450+0000 7fc9784c0640 1 --1- 172.21.15.157:0/1780604909 >> v1:172.21.15.110:6789/0 conn(0x5556715d4b30 0x5556715d4f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:56150/0 (socket says 172.21.15.157:56150) 2024-05-09T09:47:59.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.450+0000 7fc977cbf640 1 -- 172.21.15.157:0/1780604909 >> v1:172.21.15.110:6789/0 conn(0x5556715d4b30 legacy=0x5556715d4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:59.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.450+0000 7fc977cbf640 1 -- 172.21.15.157:0/1780604909 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55567147e990 con 0x5556715d9030 2024-05-09T09:47:59.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.454+0000 7fc977cbf640 1 --2- 172.21.15.157:0/1780604909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5556715d9030 0x5556715db420 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc96000a5c0 tx=0x7fc96001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4992785437eb1658 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.454+0000 7fc9774be640 1 -- 172.21.15.157:0/1780604909 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9600a6070 con 0x5556715d9030 2024-05-09T09:47:59.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.454+0000 7fc9774be640 1 -- 172.21.15.157:0/1780604909 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9600af070 con 0x5556715d9030 2024-05-09T09:47:59.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.454+0000 7fc9774be640 1 -- 172.21.15.157:0/1780604909 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9600aa5c0 con 0x5556715d9030 2024-05-09T09:47:59.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.454+0000 7fc97a9a5980 1 -- 172.21.15.157:0/1780604909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5556715d9030 msgr2=0x5556715db420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:59.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.454+0000 7fc97a9a5980 1 --2- 172.21.15.157:0/1780604909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5556715d9030 0x5556715db420 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc96000a5c0 tx=0x7fc96001b340 comp rx=0 tx=0).stop 2024-05-09T09:47:59.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.454+0000 7fc97a9a5980 1 -- 172.21.15.157:0/1780604909 shutdown_connections 2024-05-09T09:47:59.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.454+0000 7fc97a9a5980 1 --2- 172.21.15.157:0/1780604909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5556715d9030 0x5556715db420 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:59.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.454+0000 7fc97a9a5980 1 -- 172.21.15.157:0/1780604909 >> 172.21.15.157:0/1780604909 conn(0x555671548250 msgr2=0x555671548660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:59.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.454+0000 7fc97a9a5980 1 -- 172.21.15.157:0/1780604909 shutdown_connections 2024-05-09T09:47:59.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.454+0000 7fc97a9a5980 1 -- 172.21.15.157:0/1780604909 wait complete. 2024-05-09T09:47:59.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.470+0000 7fc97a9a5980 1 Processor -- start 2024-05-09T09:47:59.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.470+0000 7fc97a9a5980 1 -- start start 2024-05-09T09:47:59.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.470+0000 7fc97a9a5980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5556715d4b30 0x5556716bfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.470+0000 7fc97a9a5980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5556714d5fe0 con 0x5556715d4b30 2024-05-09T09:47:59.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.470+0000 7fc9784c0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5556715d4b30 0x5556716bfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.470+0000 7fc9784c0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5556715d4b30 0x5556716bfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:34794/0 (socket says 172.21.15.157:34794) 2024-05-09T09:47:59.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.470+0000 7fc9784c0640 1 -- 172.21.15.157:0/642029783 learned_addr learned my addr 172.21.15.157:0/642029783 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:59.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.470+0000 7fc9784c0640 1 -- 172.21.15.157:0/642029783 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55567145aae0 con 0x5556715d4b30 2024-05-09T09:47:59.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.470+0000 7fc9784c0640 1 --2- 172.21.15.157:0/642029783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5556715d4b30 0x5556716bfd70 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc9680015f0 tx=0x7fc968001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30931d5cd28dc902 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.474+0000 7fc86660c640 1 -- 172.21.15.157:0/642029783 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc968013420 con 0x5556715d4b30 2024-05-09T09:47:59.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.474+0000 7fc86660c640 1 -- 172.21.15.157:0/642029783 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9680135e0 con 0x5556715d4b30 2024-05-09T09:47:59.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.474+0000 7fc86660c640 1 -- 172.21.15.157:0/642029783 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc968013940 con 0x5556715d4b30 2024-05-09T09:47:59.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.474+0000 7fc97a9a5980 1 -- 172.21.15.157:0/642029783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5556715d4b30 msgr2=0x5556716bfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:59.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.474+0000 7fc97a9a5980 1 --2- 172.21.15.157:0/642029783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5556715d4b30 0x5556716bfd70 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc9680015f0 tx=0x7fc968001ab0 comp rx=0 tx=0).stop 2024-05-09T09:47:59.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.474+0000 7fc97a9a5980 1 -- 172.21.15.157:0/642029783 shutdown_connections 2024-05-09T09:47:59.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.474+0000 7fc97a9a5980 1 --2- 172.21.15.157:0/642029783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5556715d4b30 0x5556716bfd70 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:59.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.474+0000 7fc97a9a5980 1 -- 172.21.15.157:0/642029783 >> 172.21.15.157:0/642029783 conn(0x555671548250 msgr2=0x5556716bb900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:59.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.474+0000 7fc97a9a5980 1 -- 172.21.15.157:0/642029783 shutdown_connections 2024-05-09T09:47:59.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.474+0000 7fc97a9a5980 1 -- 172.21.15.157:0/642029783 wait complete. 2024-05-09T09:47:59.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.474+0000 7fc97a9a5980 1 Processor -- start 2024-05-09T09:47:59.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.474+0000 7fc97a9a5980 1 -- start start 2024-05-09T09:47:59.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.474+0000 7fc97a9a5980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5556715d4b30 0x5556716c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.474+0000 7fc97a9a5980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5556715de450 con 0x5556715d4b30 2024-05-09T09:47:59.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.474+0000 7fc9784c0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5556715d4b30 0x5556716c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.474+0000 7fc9784c0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5556715d4b30 0x5556716c6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:34796/0 (socket says 172.21.15.157:34796) 2024-05-09T09:47:59.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.474+0000 7fc9784c0640 1 -- 172.21.15.157:0/1931168489 learned_addr learned my addr 172.21.15.157:0/1931168489 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:59.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.474+0000 7fc9784c0640 1 -- 172.21.15.157:0/1931168489 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556716c74f0 con 0x5556715d4b30 2024-05-09T09:47:59.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.474+0000 7fc9784c0640 1 --2- 172.21.15.157:0/1931168489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5556715d4b30 0x5556716c6fb0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x5556716c0c00 tx=0x7fc968000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.474+0000 7fc864e09640 1 -- 172.21.15.157:0/1931168489 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc968022020 con 0x5556715d4b30 2024-05-09T09:47:59.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.474+0000 7fc97a9a5980 1 -- 172.21.15.157:0/1931168489 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5556716c7780 con 0x5556715d4b30 2024-05-09T09:47:59.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.474+0000 7fc864e09640 1 -- 172.21.15.157:0/1931168489 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc968006320 con 0x5556715d4b30 2024-05-09T09:47:59.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.474+0000 7fc864e09640 1 -- 172.21.15.157:0/1931168489 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc968004b30 con 0x5556715d4b30 2024-05-09T09:47:59.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.474+0000 7fc97a9a5980 1 -- 172.21.15.157:0/1931168489 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556716ca410 con 0x5556715d4b30 2024-05-09T09:47:59.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.478+0000 7fc864e09640 1 -- 172.21.15.157:0/1931168489 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fc968025020 con 0x5556715d4b30 2024-05-09T09:47:59.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.478+0000 7fc864e09640 1 --2- 172.21.15.157:0/1931168489 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc860034c00 0x7fc8600370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.478+0000 7fc864e09640 1 -- 172.21.15.157:0/1931168489 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fc968018030 con 0x5556715d4b30 2024-05-09T09:47:59.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.478+0000 7fc977cbf640 1 --2- 172.21.15.157:0/1931168489 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc860034c00 0x7fc8600370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.478+0000 7fc97a9a5980 1 --2- 172.21.15.157:0/1931168489 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5556715d9030 0x5556716cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.478+0000 7fc97a9a5980 1 -- 172.21.15.157:0/1931168489 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556716ce5c0 con 0x5556715d9030 2024-05-09T09:47:59.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.478+0000 7fc978cc1640 1 --2- 172.21.15.157:0/1931168489 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5556715d9030 0x5556716cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.478+0000 7fc977cbf640 1 --2- 172.21.15.157:0/1931168489 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc860034c00 0x7fc8600370c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc9600ae000 tx=0x7fc9600a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.478+0000 7fc978cc1640 1 --2- 172.21.15.157:0/1931168489 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5556715d9030 0x5556716cdf50 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.478+0000 7fc978cc1640 1 -- 172.21.15.157:0/1931168489 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9700083f0 con 0x5556715d9030 2024-05-09T09:47:59.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.478+0000 7fc97a9a5980 1 -- 172.21.15.157:0/1931168489 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556716cb610 con 0x5556715d9030 2024-05-09T09:47:59.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.478+0000 7fc978cc1640 1 -- 172.21.15.157:0/1931168489 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc9700083f0 con 0x5556715d9030 2024-05-09T09:47:59.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.478+0000 7fc97a9a5980 1 --2- 172.21.15.157:0/1931168489 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5556716d08f0 0x5556716d2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.478+0000 7fc97a9a5980 1 -- 172.21.15.157:0/1931168489 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556716d33d0 con 0x5556716d08f0 2024-05-09T09:47:59.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.478+0000 7fc9784c0640 1 --2- 172.21.15.157:0/1931168489 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5556716d08f0 0x5556716d2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.478+0000 7fc9784c0640 1 --2- 172.21.15.157:0/1931168489 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5556716d08f0 0x5556716d2ce0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.482+0000 7fc9784c0640 1 -- 172.21.15.157:0/1931168489 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc96801b070 con 0x5556716d08f0 2024-05-09T09:47:59.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.482+0000 7fc97a9a5980 1 -- 172.21.15.157:0/1931168489 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556716cf760 con 0x5556715d9030 2024-05-09T09:47:59.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.482+0000 7fc978cc1640 1 -- 172.21.15.157:0/1931168489 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc9700083f0 con 0x5556715d9030 2024-05-09T09:47:59.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.482+0000 7fc97a9a5980 1 --2- 172.21.15.157:0/1931168489 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5556716d4830 0x5556716d6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.482+0000 7fc97a9a5980 1 -- 172.21.15.157:0/1931168489 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556716d7320 con 0x5556716d4830 2024-05-09T09:47:59.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.482+0000 7fc977cbf640 1 --2- 172.21.15.157:0/1931168489 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5556716d4830 0x5556716d6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.482+0000 7fc977cbf640 1 --2- 172.21.15.157:0/1931168489 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5556716d4830 0x5556716d6c20 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.482+0000 7fc977cbf640 1 -- 172.21.15.157:0/1931168489 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc9600aaa80 con 0x5556716d4830 2024-05-09T09:47:59.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.486+0000 7fc97a9a5980 1 Processor -- start 2024-05-09T09:47:59.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.486+0000 7fc97a9a5980 1 -- start start 2024-05-09T09:47:59.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.486+0000 7fc97a9a5980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5556716fd1a0 0x5556716fd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.486+0000 7fc97a9a5980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5556714da020 con 0x5556716fd1a0 2024-05-09T09:47:59.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.486+0000 7fc9784c0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5556716fd1a0 0x5556716fd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.486+0000 7fc9784c0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5556716fd1a0 0x5556716fd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:34808/0 (socket says 172.21.15.157:34808) 2024-05-09T09:47:59.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.486+0000 7fc9784c0640 1 -- 172.21.15.157:0/2216379083 learned_addr learned my addr 172.21.15.157:0/2216379083 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:59.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.486+0000 7fc9784c0640 1 -- 172.21.15.157:0/2216379083 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556716fdb00 con 0x5556716fd1a0 2024-05-09T09:47:59.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.486+0000 7fc9784c0640 1 --2- 172.21.15.157:0/2216379083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5556716fd1a0 0x5556716fd5c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc968048ae0 tx=0x7fc96801ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.486+0000 7fc85cb9e640 1 -- 172.21.15.157:0/2216379083 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc968010520 con 0x5556716fd1a0 2024-05-09T09:47:59.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.486+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2216379083 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5556716fe590 con 0x5556716fd1a0 2024-05-09T09:47:59.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.486+0000 7fc85cb9e640 1 -- 172.21.15.157:0/2216379083 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9680106c0 con 0x5556716fd1a0 2024-05-09T09:47:59.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.486+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2216379083 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556716fea70 con 0x5556716fd1a0 2024-05-09T09:47:59.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.486+0000 7fc85cb9e640 1 -- 172.21.15.157:0/2216379083 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc968010870 con 0x5556716fd1a0 2024-05-09T09:47:59.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.490+0000 7fc85cb9e640 1 -- 172.21.15.157:0/2216379083 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fc968048020 con 0x5556716fd1a0 2024-05-09T09:47:59.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.490+0000 7fc85cb9e640 1 --2- 172.21.15.157:0/2216379083 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc850034bb0 0x7fc850037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.490+0000 7fc85cb9e640 1 -- 172.21.15.157:0/2216379083 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fc968046020 con 0x5556716fd1a0 2024-05-09T09:47:59.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.490+0000 7fc977cbf640 1 --2- 172.21.15.157:0/2216379083 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc850034bb0 0x7fc850037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.490+0000 7fc97a9a5980 1 Processor -- start 2024-05-09T09:47:59.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.490+0000 7fc97a9a5980 1 -- start start 2024-05-09T09:47:59.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.490+0000 7fc97a9a5980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55567170a030 0x55567170a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.490+0000 7fc97a9a5980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5556716c04c0 con 0x55567170a030 2024-05-09T09:47:59.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.490+0000 7fc977cbf640 1 --2- 172.21.15.157:0/2216379083 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc850034bb0 0x7fc850037070 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x5556716cea90 tx=0x7fc960005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.490+0000 7fc9784c0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55567170a030 0x55567170a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.490+0000 7fc9784c0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55567170a030 0x55567170a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:34820/0 (socket says 172.21.15.157:34820) 2024-05-09T09:47:59.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.490+0000 7fc9784c0640 1 -- 172.21.15.157:0/2238735459 learned_addr learned my addr 172.21.15.157:0/2238735459 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:59.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.490+0000 7fc9784c0640 1 -- 172.21.15.157:0/2238735459 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55567170aa20 con 0x55567170a030 2024-05-09T09:47:59.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.490+0000 7fc9784c0640 1 --2- 172.21.15.157:0/2238735459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55567170a030 0x55567170a450 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc968032810 tx=0x7fc968032900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7dc8c326188040 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.490+0000 7fc8567fc640 1 -- 172.21.15.157:0/2238735459 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc968058030 con 0x55567170a030 2024-05-09T09:47:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.490+0000 7fc8567fc640 1 -- 172.21.15.157:0/2238735459 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc968041cf0 con 0x55567170a030 2024-05-09T09:47:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.490+0000 7fc8567fc640 1 -- 172.21.15.157:0/2238735459 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc96801e3f0 con 0x55567170a030 2024-05-09T09:47:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.490+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2238735459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55567170a030 msgr2=0x55567170a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.490+0000 7fc97a9a5980 1 --2- 172.21.15.157:0/2238735459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55567170a030 0x55567170a450 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc968032810 tx=0x7fc968032900 comp rx=0 tx=0).stop 2024-05-09T09:47:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.490+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2238735459 shutdown_connections 2024-05-09T09:47:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.490+0000 7fc97a9a5980 1 --2- 172.21.15.157:0/2238735459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55567170a030 0x55567170a450 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.490+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2238735459 >> 172.21.15.157:0/2238735459 conn(0x5556717063b0 msgr2=0x555671704410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.490+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2238735459 shutdown_connections 2024-05-09T09:47:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.490+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2238735459 wait complete. 2024-05-09T09:47:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.490+0000 7fc97a9a5980 1 Processor -- start 2024-05-09T09:47:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.490+0000 7fc97a9a5980 1 -- start start 2024-05-09T09:47:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.494+0000 7fc97a9a5980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55567170a030 0x5556717112d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.494+0000 7fc97a9a5980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55567170af70 con 0x55567170a030 2024-05-09T09:47:59.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.494+0000 7fc9784c0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55567170a030 0x5556717112d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.494+0000 7fc9784c0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55567170a030 0x5556717112d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:34830/0 (socket says 172.21.15.157:34830) 2024-05-09T09:47:59.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.494+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 learned_addr learned my addr 172.21.15.157:0/2782988393 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:59.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.494+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555671711810 con 0x55567170a030 2024-05-09T09:47:59.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.494+0000 7fc9784c0640 1 --2- 172.21.15.157:0/2782988393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55567170a030 0x5556717112d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc968012fd0 tx=0x7fc96800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.494+0000 7fc854ff9640 1 -- 172.21.15.157:0/2782988393 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc968032e50 con 0x55567170a030 2024-05-09T09:47:59.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.494+0000 7fc854ff9640 1 -- 172.21.15.157:0/2782988393 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc96802a120 con 0x55567170a030 2024-05-09T09:47:59.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.494+0000 7fc854ff9640 1 -- 172.21.15.157:0/2782988393 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc96802a420 con 0x55567170a030 2024-05-09T09:47:59.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.494+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555671711810 con 0x55567170a030 2024-05-09T09:47:59.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.494+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555671711cf0 con 0x55567170a030 2024-05-09T09:47:59.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.494+0000 7fc854ff9640 1 -- 172.21.15.157:0/2782988393 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fc96806c070 con 0x55567170a030 2024-05-09T09:47:59.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.494+0000 7fc97a9a5980 20 rados->read ofs=0 len=0 2024-05-09T09:47:59.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.494+0000 7fc854ff9640 1 --2- 172.21.15.157:0/2782988393 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc840034d50 0x7fc840037210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.494+0000 7fc854ff9640 1 -- 172.21.15.157:0/2782988393 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fc96805c070 con 0x55567170a030 2024-05-09T09:47:59.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.494+0000 7fc977cbf640 1 --2- 172.21.15.157:0/2782988393 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc840034d50 0x7fc840037210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.494+0000 7fc97a9a5980 1 --2- 172.21.15.157:0/2782988393 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55567171de50 0x5556717202d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.494+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555671720a20 con 0x55567171de50 2024-05-09T09:47:59.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.494+0000 7fc978cc1640 1 --2- 172.21.15.157:0/2782988393 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55567171de50 0x5556717202d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.494+0000 7fc977cbf640 1 --2- 172.21.15.157:0/2782988393 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc840034d50 0x7fc840037210 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc9600aafd0 tx=0x7fc9600c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.494+0000 7fc978cc1640 1 --2- 172.21.15.157:0/2782988393 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55567171de50 0x5556717202d0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9700083f0 con 0x55567171de50 2024-05-09T09:47:59.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc97a9a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:59.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc97a9a5980 20 realm 2024-05-09T09:47:59.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc97a9a5980 20 rados->read ofs=0 len=0 2024-05-09T09:47:59.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555671720e30 con 0x55567171de50 2024-05-09T09:47:59.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9700083f0 con 0x55567171de50 2024-05-09T09:47:59.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc97a9a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:59.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc97a9a5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:59.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc97a9a5980 20 rados->read ofs=0 len=0 2024-05-09T09:47:59.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556717216d0 con 0x55567171de50 2024-05-09T09:47:59.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9700083f0 con 0x55567171de50 2024-05-09T09:47:59.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc97a9a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:59.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc97a9a5980 20 rados->read ofs=0 len=0 2024-05-09T09:47:59.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x55567171de50 2024-05-09T09:47:59.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc9700083f0 con 0x55567171de50 2024-05-09T09:47:59.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc97a9a5980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:59.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc97a9a5980 20 rados->read ofs=0 len=0 2024-05-09T09:47:59.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc97a9a5980 1 --2- 172.21.15.157:0/2782988393 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5556717227d0 0x555671724bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555671725140 con 0x5556717227d0 2024-05-09T09:47:59.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc9784c0640 1 --2- 172.21.15.157:0/2782988393 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5556717227d0 0x555671724bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc9784c0640 1 --2- 172.21.15.157:0/2782988393 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5556717227d0 0x555671724bc0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc968075020 con 0x5556717227d0 2024-05-09T09:47:59.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc97a9a5980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:59.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc97a9a5980 20 searching for the correct realm 2024-05-09T09:47:59.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc97a9a5980 1 --2- 172.21.15.157:0/2782988393 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555671727070 0x555671729530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671729c00 con 0x555671727070 2024-05-09T09:47:59.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc977cbf640 1 --2- 172.21.15.157:0/2782988393 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555671727070 0x555671729530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc977cbf640 1 --2- 172.21.15.157:0/2782988393 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555671727070 0x555671729530 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc977cbf640 1 --2- 172.21.15.157:0/2782988393 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fc9600e0040 0x7fc9600e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671729c00 con 0x7fc9600e0040 2024-05-09T09:47:59.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.498+0000 7fc978cc1640 1 --2- 172.21.15.157:0/2782988393 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fc9600e0040 0x7fc9600e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.502+0000 7fc978cc1640 1 --2- 172.21.15.157:0/2782988393 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fc9600e0040 0x7fc9600e0420 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.502+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9700083f0 con 0x7fc9600e0040 2024-05-09T09:47:59.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.502+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x5556717227d0 2024-05-09T09:47:59.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.502+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc968075020 con 0x5556717227d0 2024-05-09T09:47:59.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.502+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x55567171de50 2024-05-09T09:47:59.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.502+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9700083f0 con 0x55567171de50 2024-05-09T09:47:59.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.502+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x55567171de50 2024-05-09T09:47:59.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.502+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc970026040 con 0x55567171de50 2024-05-09T09:47:59.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.502+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x5556717227d0 2024-05-09T09:47:59.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.502+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc968075020 con 0x5556717227d0 2024-05-09T09:47:59.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.502+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x5556717227d0 2024-05-09T09:47:59.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.502+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc968075020 con 0x5556717227d0 2024-05-09T09:47:59.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.502+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x7fc9600e0040 2024-05-09T09:47:59.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.502+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc970026040 con 0x7fc9600e0040 2024-05-09T09:47:59.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.502+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x555671727070 2024-05-09T09:47:59.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.502+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.506+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x55567171de50 2024-05-09T09:47:59.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.506+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc970026040 con 0x55567171de50 2024-05-09T09:47:59.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.506+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x5556717227d0 2024-05-09T09:47:59.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.506+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc968075020 con 0x5556717227d0 2024-05-09T09:47:59.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.506+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x55567171de50 2024-05-09T09:47:59.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.506+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc970026040 con 0x55567171de50 2024-05-09T09:47:59.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.506+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x7fc9600e0040 2024-05-09T09:47:59.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.506+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc970026040 con 0x7fc9600e0040 2024-05-09T09:47:59.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.506+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x555671727070 2024-05-09T09:47:59.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.506+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.506+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x555671727070 2024-05-09T09:47:59.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.506+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.506+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x5556717227d0 2024-05-09T09:47:59.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.506+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.506+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x555671727070 2024-05-09T09:47:59.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.506+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.506+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x555671727070 2024-05-09T09:47:59.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.506+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.506+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x55567171de50 2024-05-09T09:47:59.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.506+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc970026040 con 0x55567171de50 2024-05-09T09:47:59.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.506+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x55567171de50 2024-05-09T09:47:59.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.506+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc970026040 con 0x55567171de50 2024-05-09T09:47:59.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.506+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x5556717227d0 2024-05-09T09:47:59.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.510+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.510+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x555671727070 2024-05-09T09:47:59.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.510+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.510+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x7fc9600e0040 2024-05-09T09:47:59.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.510+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc970026040 con 0x7fc9600e0040 2024-05-09T09:47:59.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.510+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x55567171de50 2024-05-09T09:47:59.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.510+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc970026040 con 0x55567171de50 2024-05-09T09:47:59.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.510+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x5556717227d0 2024-05-09T09:47:59.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.510+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.510+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x555671727070 2024-05-09T09:47:59.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.510+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.510+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x5556717227d0 2024-05-09T09:47:59.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.510+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.510+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x7fc9600e0040 2024-05-09T09:47:59.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.510+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc970026040 con 0x7fc9600e0040 2024-05-09T09:47:59.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.510+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x555671727070 2024-05-09T09:47:59.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x5556717227d0 2024-05-09T09:47:59.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x55567171de50 2024-05-09T09:47:59.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc970026040 con 0x55567171de50 2024-05-09T09:47:59.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555671721a70 con 0x7fc9600e0040 2024-05-09T09:47:59.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc970026040 con 0x7fc9600e0040 2024-05-09T09:47:59.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:59.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:59.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:59.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:59.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:59.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:59.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 20 rados->read ofs=0 len=0 2024-05-09T09:47:59.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555671725990 con 0x55567171de50 2024-05-09T09:47:59.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc970026040 con 0x55567171de50 2024-05-09T09:47:59.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:59.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 20 rados->read ofs=0 len=0 2024-05-09T09:47:59.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555671725990 con 0x55567171de50 2024-05-09T09:47:59.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc970026040 con 0x55567171de50 2024-05-09T09:47:59.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:59.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 20 rados->read ofs=0 len=0 2024-05-09T09:47:59.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555671725990 con 0x555671727070 2024-05-09T09:47:59.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:59.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 20 zone default found 2024-05-09T09:47:59.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 4 Realm: () 2024-05-09T09:47:59.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:59.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:59.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:59.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 20 zonegroup default 2024-05-09T09:47:59.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 20 rados->read ofs=0 len=0 2024-05-09T09:47:59.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555671726230 con 0x5556717227d0 2024-05-09T09:47:59.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:59.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 20 rados->read ofs=0 len=0 2024-05-09T09:47:59.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567172ba60 con 0x555671727070 2024-05-09T09:47:59.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:59.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 20 rados->read ofs=0 len=0 2024-05-09T09:47:59.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567172be00 con 0x555671727070 2024-05-09T09:47:59.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:59.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 20 started sync module instance, tier type = 2024-05-09T09:47:59.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:59.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.514+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567172af00 con 0x7fc9600e0040 2024-05-09T09:47:59.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.518+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc970026040 con 0x7fc9600e0040 2024-05-09T09:47:59.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.518+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93829758891088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567172af00 con 0x7fc9600e0040 2024-05-09T09:47:59.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.518+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567172c880 con 0x55567171de50 2024-05-09T09:47:59.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.518+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93829758891088] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.518+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.518+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93829758894960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567172af00 con 0x55567171de50 2024-05-09T09:47:59.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.518+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567172d290 con 0x555671727070 2024-05-09T09:47:59.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.522+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93829758894960] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.522+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.522+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93829758888528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567172ae70 con 0x555671727070 2024-05-09T09:47:59.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.522+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567172e000 con 0x7fc9600e0040 2024-05-09T09:47:59.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.522+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.522+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93829758901040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567172e8a0 con 0x7fc9600e0040 2024-05-09T09:47:59.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.522+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567172f260 con 0x55567171de50 2024-05-09T09:47:59.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.526+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93829758901040] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.526+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93829758888528] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.526+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.526+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93829758905776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567172f1d0 con 0x55567171de50 2024-05-09T09:47:59.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.526+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567172e800 con 0x5556717227d0 2024-05-09T09:47:59.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.526+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93829758905776] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.526+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.526+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93829758903120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567172fb00 con 0x5556717227d0 2024-05-09T09:47:59.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.526+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555671730350 con 0x5556717227d0 2024-05-09T09:47:59.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.530+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93829758903120] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.530+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.530+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93829758910112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555671730770 con 0x5556717227d0 2024-05-09T09:47:59.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.530+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555671731130 con 0x5556717227d0 2024-05-09T09:47:59.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.534+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93829758910112] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.534+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.534+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93829758911472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555671731130 con 0x5556717227d0 2024-05-09T09:47:59.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.534+0000 7fc97a9a5980 20 add_watcher() i=0 2024-05-09T09:47:59.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.534+0000 7fc97a9a5980 20 add_watcher() i=1 2024-05-09T09:47:59.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.534+0000 7fc97a9a5980 20 add_watcher() i=2 2024-05-09T09:47:59.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.534+0000 7fc97a9a5980 20 add_watcher() i=3 2024-05-09T09:47:59.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.534+0000 7fc97a9a5980 20 add_watcher() i=4 2024-05-09T09:47:59.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.534+0000 7fc97a9a5980 20 add_watcher() i=5 2024-05-09T09:47:59.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.534+0000 7fc97a9a5980 20 add_watcher() i=6 2024-05-09T09:47:59.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.534+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93829758911472] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.534+0000 7fc97a9a5980 20 add_watcher() i=7 2024-05-09T09:47:59.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.534+0000 7fc97a9a5980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:59.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.534+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555671734450 con 0x55567171de50 2024-05-09T09:47:59.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.534+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.534+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93829758914032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556717316c0 con 0x55567171de50 2024-05-09T09:47:59.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.538+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93829758914032] v32'284 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.538+0000 7fc82dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:59.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.538+0000 7fc97a9a5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:59.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.538+0000 7fc97a9a5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:59.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.538+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173cb80 con 0x55567171de50 2024-05-09T09:47:59.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.538+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'68 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.538+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173d0f0 con 0x5556717227d0 2024-05-09T09:47:59.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.542+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'63 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.542+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173d0f0 con 0x555671727070 2024-05-09T09:47:59.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.542+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'62 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.542+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173d510 con 0x55567171de50 2024-05-09T09:47:59.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.542+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'285 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.542+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173da80 con 0x7fc9600e0040 2024-05-09T09:47:59.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.546+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'176 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.546+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173dff0 con 0x555671727070 2024-05-09T09:47:59.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.546+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'118 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.546+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173e4a0 con 0x55567171de50 2024-05-09T09:47:59.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.550+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'64 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.550+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173e390 con 0x5556717227d0 2024-05-09T09:47:59.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.550+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'117 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.550+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173e390 con 0x7fc9600e0040 2024-05-09T09:47:59.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.554+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'62 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.554+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173e360 con 0x555671727070 2024-05-09T09:47:59.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.554+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'68 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.554+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173ea50 con 0x7fc9600e0040 2024-05-09T09:47:59.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.554+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'177 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.554+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173ea50 con 0x5556717227d0 2024-05-09T09:47:59.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.558+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'65 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.558+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173ea50 con 0x7fc9600e0040 2024-05-09T09:47:59.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.558+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'62 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.558+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173ea50 con 0x5556717227d0 2024-05-09T09:47:59.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.562+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'123 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.562+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173ea50 con 0x55567171de50 2024-05-09T09:47:59.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.562+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'286 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.562+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173ea50 con 0x555671727070 2024-05-09T09:47:59.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.566+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'170 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.566+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173f000 con 0x7fc9600e0040 2024-05-09T09:47:59.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.566+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'178 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.566+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173f000 con 0x555671727070 2024-05-09T09:47:59.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.570+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'62 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.570+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173f000 con 0x55567171de50 2024-05-09T09:47:59.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.570+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'70 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.570+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173f000 con 0x55567171de50 2024-05-09T09:47:59.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.570+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'287 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.574+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173f000 con 0x555671727070 2024-05-09T09:47:59.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.574+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'171 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.574+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173f000 con 0x7fc9600e0040 2024-05-09T09:47:59.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.574+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'73 uv72 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.574+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173f000 con 0x555671727070 2024-05-09T09:47:59.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.578+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'64 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.578+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173f000 con 0x555671727070 2024-05-09T09:47:59.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.578+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'68 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.578+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173f000 con 0x555671727070 2024-05-09T09:47:59.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.578+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'58 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.578+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173f000 con 0x555671727070 2024-05-09T09:47:59.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.582+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'119 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.582+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173f000 con 0x5556717227d0 2024-05-09T09:47:59.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.582+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'64 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.582+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173f000 con 0x555671727070 2024-05-09T09:47:59.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.586+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'62 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.586+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173f000 con 0x5556717227d0 2024-05-09T09:47:59.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.586+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'118 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.586+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173f000 con 0x555671727070 2024-05-09T09:47:59.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.590+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'172 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.590+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173f000 con 0x5556717227d0 2024-05-09T09:47:59.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.594+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'124 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.594+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567173f000 con 0x7fc9600e0040 2024-05-09T09:47:59.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.594+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'68 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.594+0000 7fc82cfe1640 20 reqs_thread_entry: start 2024-05-09T09:47:59.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.594+0000 7fc97a9a5980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:59.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.594+0000 7fc825ffb640 20 reqs_thread_entry: start 2024-05-09T09:47:59.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.594+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x55567171de50 2024-05-09T09:47:59.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.598+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.598+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x55567171de50 2024-05-09T09:47:59.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.598+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.598+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x55567171de50 2024-05-09T09:47:59.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.598+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.598+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x5556717227d0 2024-05-09T09:47:59.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.598+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.598+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x5556717227d0 2024-05-09T09:47:59.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.598+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.598+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x5556717227d0 2024-05-09T09:47:59.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.598+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.602+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x555671727070 2024-05-09T09:47:59.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.602+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.602+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x555671727070 2024-05-09T09:47:59.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.602+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.602+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x555671727070 2024-05-09T09:47:59.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.602+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.602+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x55567171de50 2024-05-09T09:47:59.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.602+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.602+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x55567171de50 2024-05-09T09:47:59.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.602+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.602+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x55567171de50 2024-05-09T09:47:59.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.602+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.602+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x7fc9600e0040 2024-05-09T09:47:59.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.602+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.602+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x7fc9600e0040 2024-05-09T09:47:59.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.602+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.602+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x7fc9600e0040 2024-05-09T09:47:59.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.602+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.602+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x555671727070 2024-05-09T09:47:59.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.602+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 30 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.602+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x555671727070 2024-05-09T09:47:59.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.602+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 31 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv4 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.602+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x555671727070 2024-05-09T09:47:59.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.606+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 32 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.606+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x55567171de50 2024-05-09T09:47:59.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.606+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.606+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x55567171de50 2024-05-09T09:47:59.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.606+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.606+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x55567171de50 2024-05-09T09:47:59.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.606+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.606+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x5556717227d0 2024-05-09T09:47:59.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.606+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.606+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x5556717227d0 2024-05-09T09:47:59.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.606+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv4 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.606+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x5556717227d0 2024-05-09T09:47:59.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.606+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.606+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x7fc9600e0040 2024-05-09T09:47:59.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.610+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.610+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x7fc9600e0040 2024-05-09T09:47:59.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.610+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.610+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x7fc9600e0040 2024-05-09T09:47:59.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.610+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 23 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.610+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x555671727070 2024-05-09T09:47:59.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.610+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 33 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.610+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x555671727070 2024-05-09T09:47:59.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.610+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 34 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.610+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x555671727070 2024-05-09T09:47:59.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.610+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 35 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.610+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x7fc9600e0040 2024-05-09T09:47:59.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.610+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 24 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.610+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x7fc9600e0040 2024-05-09T09:47:59.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.610+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 25 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.610+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x7fc9600e0040 2024-05-09T09:47:59.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.610+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 26 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.610+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x5556717227d0 2024-05-09T09:47:59.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.614+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.614+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x5556717227d0 2024-05-09T09:47:59.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.614+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 32 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.614+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x5556717227d0 2024-05-09T09:47:59.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.614+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 33 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.614+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x7fc9600e0040 2024-05-09T09:47:59.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.614+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 27 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.614+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x7fc9600e0040 2024-05-09T09:47:59.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.618+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 28 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.618+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x7fc9600e0040 2024-05-09T09:47:59.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.618+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 29 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.618+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x5556717227d0 2024-05-09T09:47:59.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.618+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 34 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.618+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x5556717227d0 2024-05-09T09:47:59.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.618+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 35 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.618+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x5556717227d0 2024-05-09T09:47:59.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.618+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 36 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.618+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x55567171de50 2024-05-09T09:47:59.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.622+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.622+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x55567171de50 2024-05-09T09:47:59.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.622+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.622+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x55567171de50 2024-05-09T09:47:59.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.622+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.622+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x555671727070 2024-05-09T09:47:59.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.622+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.622+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x555671727070 2024-05-09T09:47:59.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.622+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 37 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.622+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x555671727070 2024-05-09T09:47:59.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.622+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 38 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.622+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x7fc9600e0040 2024-05-09T09:47:59.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.622+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 30 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.622+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x7fc9600e0040 2024-05-09T09:47:59.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.622+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 31 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.622+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x7fc9600e0040 2024-05-09T09:47:59.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.622+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 32 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.622+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x555671727070 2024-05-09T09:47:59.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.622+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 39 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.622+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x555671727070 2024-05-09T09:47:59.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.626+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 40 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.626+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x555671727070 2024-05-09T09:47:59.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.626+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 41 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.626+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x55567171de50 2024-05-09T09:47:59.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.626+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.626+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x55567171de50 2024-05-09T09:47:59.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.626+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.626+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x55567171de50 2024-05-09T09:47:59.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.626+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.626+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x55567171de50 2024-05-09T09:47:59.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.626+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.626+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x55567171de50 2024-05-09T09:47:59.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.626+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.626+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x55567171de50 2024-05-09T09:47:59.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.626+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.626+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x555671727070 2024-05-09T09:47:59.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.626+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 42 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.626+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x555671727070 2024-05-09T09:47:59.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.626+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 43 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.626+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x555671727070 2024-05-09T09:47:59.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.626+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 44 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.626+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x7fc9600e0040 2024-05-09T09:47:59.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.630+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 33 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv72 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.630+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x7fc9600e0040 2024-05-09T09:47:59.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.630+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 34 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv72 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.630+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173b150 con 0x7fc9600e0040 2024-05-09T09:47:59.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.630+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 35 ==== osd_op_reply(159 gc.21 [call out=1700b] v0'0 uv72 ondisk = 0) ==== 149+0+1700 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.630+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173a240 con 0x555671727070 2024-05-09T09:47:59.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.630+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 45 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.630+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555671739d90 con 0x555671727070 2024-05-09T09:47:59.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.630+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 46 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.630+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173a240 con 0x555671727070 2024-05-09T09:47:59.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.630+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 47 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.630+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173a240 con 0x555671727070 2024-05-09T09:47:59.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.630+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 48 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.630+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555671739d90 con 0x555671727070 2024-05-09T09:47:59.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.630+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 49 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.630+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173a240 con 0x555671727070 2024-05-09T09:47:59.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.630+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 50 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.630+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555671739d90 con 0x555671727070 2024-05-09T09:47:59.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.630+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 51 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.630+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555671739d90 con 0x555671727070 2024-05-09T09:47:59.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.630+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 52 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.630+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555671739d90 con 0x555671727070 2024-05-09T09:47:59.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.634+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 53 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.634+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173a240 con 0x555671727070 2024-05-09T09:47:59.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.634+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 54 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv10 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.634+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555671739d90 con 0x555671727070 2024-05-09T09:47:59.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.634+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 55 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv10 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.634+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173a240 con 0x555671727070 2024-05-09T09:47:59.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.634+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 56 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv10 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.634+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173a240 con 0x5556717227d0 2024-05-09T09:47:59.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.634+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 37 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.634+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555671739d90 con 0x5556717227d0 2024-05-09T09:47:59.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.634+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 38 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.634+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555671739d90 con 0x5556717227d0 2024-05-09T09:47:59.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.634+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 39 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.634+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173a240 con 0x555671727070 2024-05-09T09:47:59.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.634+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 57 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.634+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555671739d90 con 0x555671727070 2024-05-09T09:47:59.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.638+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 58 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.638+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173a240 con 0x555671727070 2024-05-09T09:47:59.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.638+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 59 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.638+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173a240 con 0x5556717227d0 2024-05-09T09:47:59.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.638+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 40 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.638+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555671739d90 con 0x5556717227d0 2024-05-09T09:47:59.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.638+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 41 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv8 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.638+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173a240 con 0x5556717227d0 2024-05-09T09:47:59.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.638+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 42 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.638+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173a240 con 0x555671727070 2024-05-09T09:47:59.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.638+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 60 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.638+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555671739d90 con 0x555671727070 2024-05-09T09:47:59.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.638+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 61 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.638+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173a240 con 0x555671727070 2024-05-09T09:47:59.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.642+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 62 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.642+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555671739d90 con 0x5556717227d0 2024-05-09T09:47:59.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.642+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 43 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.642+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555671739d90 con 0x5556717227d0 2024-05-09T09:47:59.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.642+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 44 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.642+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555671739d90 con 0x5556717227d0 2024-05-09T09:47:59.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.642+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 45 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.642+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173a240 con 0x7fc9600e0040 2024-05-09T09:47:59.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.646+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 36 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.646+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173a240 con 0x7fc9600e0040 2024-05-09T09:47:59.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.646+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 37 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.646+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55567173a240 con 0x7fc9600e0040 2024-05-09T09:47:59.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.646+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 38 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.646+0000 7fc82dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:59.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.646+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93829758914032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555671739810 con 0x55567171de50 2024-05-09T09:47:59.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.646+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 93829758914032] v32'288 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.650+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93829758891088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555671730df0 con 0x7fc9600e0040 2024-05-09T09:47:59.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.650+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 39 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 93829758891088] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.650+0000 7fc97a9a5980 20 remove_watcher() i=0 2024-05-09T09:47:59.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.650+0000 7fc97a9a5980 2 removed watcher, disabling cache 2024-05-09T09:47:59.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.650+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93829758894960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555671730df0 con 0x55567171de50 2024-05-09T09:47:59.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.650+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 93829758894960] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.650+0000 7fc97a9a5980 20 remove_watcher() i=1 2024-05-09T09:47:59.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.650+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93829758888528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555671730df0 con 0x555671727070 2024-05-09T09:47:59.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.654+0000 7fc977cbf640 1 -- 172.21.15.157:0/2782988393 <== osd.3 v2:172.21.15.157:6816/2487336710 63 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 93829758888528] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9600aaa80 con 0x555671727070 2024-05-09T09:47:59.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.654+0000 7fc97a9a5980 20 remove_watcher() i=2 2024-05-09T09:47:59.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.654+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93829758901040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555671730df0 con 0x7fc9600e0040 2024-05-09T09:47:59.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.658+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.2 v2:172.21.15.157:6800/354455204 40 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 93829758901040] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc970036040 con 0x7fc9600e0040 2024-05-09T09:47:59.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.658+0000 7fc97a9a5980 20 remove_watcher() i=3 2024-05-09T09:47:59.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.658+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93829758905776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555671730df0 con 0x55567171de50 2024-05-09T09:47:59.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.658+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 <== osd.1 v2:172.21.15.157:6808/3930131338 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 93829758905776] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc970036040 con 0x55567171de50 2024-05-09T09:47:59.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.658+0000 7fc97a9a5980 20 remove_watcher() i=4 2024-05-09T09:47:59.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.658+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93829758903120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567172edb0 con 0x5556717227d0 2024-05-09T09:47:59.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.662+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 46 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 93829758903120] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.662+0000 7fc97a9a5980 20 remove_watcher() i=5 2024-05-09T09:47:59.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.662+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93829758910112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555671730df0 con 0x5556717227d0 2024-05-09T09:47:59.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.662+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 47 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 93829758910112] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.662+0000 7fc97a9a5980 20 remove_watcher() i=6 2024-05-09T09:47:59.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.662+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93829758911472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55567172e350 con 0x5556717227d0 2024-05-09T09:47:59.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc9784c0640 1 -- 172.21.15.157:0/2782988393 <== osd.0 v2:172.21.15.110:6800/231209037 48 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 93829758911472] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc968087040 con 0x5556717227d0 2024-05-09T09:47:59.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 20 remove_watcher() i=7 2024-05-09T09:47:59.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5556717227d0 msgr2=0x555671724bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:59.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 --2- 172.21.15.157:0/2782988393 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5556717227d0 0x555671724bc0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:59.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55567171de50 msgr2=0x5556717202d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:59.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 --2- 172.21.15.157:0/2782988393 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55567171de50 0x5556717202d0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:59.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fc9600e0040 msgr2=0x7fc9600e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:59.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 --2- 172.21.15.157:0/2782988393 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fc9600e0040 0x7fc9600e0420 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:59.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555671727070 msgr2=0x555671729530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:59.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 --2- 172.21.15.157:0/2782988393 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555671727070 0x555671729530 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:59.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc840034d50 msgr2=0x7fc840037210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:59.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 --2- 172.21.15.157:0/2782988393 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc840034d50 0x7fc840037210 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc9600aafd0 tx=0x7fc9600c1040 comp rx=0 tx=0).stop 2024-05-09T09:47:59.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55567170a030 msgr2=0x5556717112d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:59.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 --2- 172.21.15.157:0/2782988393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55567170a030 0x5556717112d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc968012fd0 tx=0x7fc96800eea0 comp rx=0 tx=0).stop 2024-05-09T09:47:59.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc978cc1640 1 -- 172.21.15.157:0/2782988393 reap_dead start 2024-05-09T09:47:59.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 shutdown_connections 2024-05-09T09:47:59.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 >> 172.21.15.157:0/2782988393 conn(0x5556717063b0 msgr2=0x555671703a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:59.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 shutdown_connections 2024-05-09T09:47:59.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2782988393 wait complete. 2024-05-09T09:47:59.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2216379083 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc850034bb0 msgr2=0x7fc850037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:59.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 --2- 172.21.15.157:0/2216379083 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc850034bb0 0x7fc850037070 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x5556716cea90 tx=0x7fc960005ad0 comp rx=0 tx=0).stop 2024-05-09T09:47:59.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2216379083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5556716fd1a0 msgr2=0x5556716fd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:59.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 --2- 172.21.15.157:0/2216379083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5556716fd1a0 0x5556716fd5c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc968048ae0 tx=0x7fc96801ee40 comp rx=0 tx=0).stop 2024-05-09T09:47:59.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2216379083 shutdown_connections 2024-05-09T09:47:59.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 --2- 172.21.15.157:0/2216379083 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc850034bb0 0x7fc850037070 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:59.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 --2- 172.21.15.157:0/2216379083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5556716fd1a0 0x5556716fd5c0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:59.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2216379083 >> 172.21.15.157:0/2216379083 conn(0x5556716f1f70 msgr2=0x5556716f2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:59.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2216379083 shutdown_connections 2024-05-09T09:47:59.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 -- 172.21.15.157:0/2216379083 wait complete. 2024-05-09T09:47:59.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 -- 172.21.15.157:0/1931168489 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5556716d08f0 msgr2=0x5556716d2ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:59.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 --2- 172.21.15.157:0/1931168489 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5556716d08f0 0x5556716d2ce0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:59.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 -- 172.21.15.157:0/1931168489 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5556715d9030 msgr2=0x5556716cdf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:59.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 --2- 172.21.15.157:0/1931168489 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5556715d9030 0x5556716cdf50 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:59.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 -- 172.21.15.157:0/1931168489 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5556716d4830 msgr2=0x5556716d6c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:59.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 --2- 172.21.15.157:0/1931168489 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5556716d4830 0x5556716d6c20 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:59.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 -- 172.21.15.157:0/1931168489 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc860034c00 msgr2=0x7fc8600370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:59.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 --2- 172.21.15.157:0/1931168489 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc860034c00 0x7fc8600370c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc9600ae000 tx=0x7fc9600a6000 comp rx=0 tx=0).stop 2024-05-09T09:47:59.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 -- 172.21.15.157:0/1931168489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5556715d4b30 msgr2=0x5556716c6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:59.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 --2- 172.21.15.157:0/1931168489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5556715d4b30 0x5556716c6fb0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x5556716c0c00 tx=0x7fc968000f50 comp rx=0 tx=0).stop 2024-05-09T09:47:59.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc978cc1640 1 -- 172.21.15.157:0/1931168489 reap_dead start 2024-05-09T09:47:59.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 -- 172.21.15.157:0/1931168489 shutdown_connections 2024-05-09T09:47:59.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 -- 172.21.15.157:0/1931168489 >> 172.21.15.157:0/1931168489 conn(0x555671548250 msgr2=0x5556716ba410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:59.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 -- 172.21.15.157:0/1931168489 shutdown_connections 2024-05-09T09:47:59.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.666+0000 7fc97a9a5980 1 -- 172.21.15.157:0/1931168489 wait complete. 2024-05-09T09:47:59.679 INFO:teuthology.orchestra.run.smithi157.stdout:[{"tag":"b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.158458219382852161\u0000","time":"2024-05-09T09:47:59.408478+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_7","key":"","instance":""}]}] 2024-05-09T09:47:59.680 DEBUG:tasks.util.rgw: json result: [{'tag': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.158458219382852161\x00', 'time': '2024-05-09T09:47:59.408478+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_7', 'key': '', 'instance': ''}]}] 2024-05-09T09:47:59.680 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-05-09T09:47:59.680 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-05-09T09:47:59.680 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-05-09T09:47:59.758 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:47:59.758 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:47:59.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.758+0000 7f8c94b8d980 1 Processor -- start 2024-05-09T09:47:59.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.758+0000 7f8c94b8d980 1 -- start start 2024-05-09T09:47:59.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.758+0000 7f8c94b8d980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x561898d29100 0x561898d2b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.758+0000 7f8c94b8d980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561898bd8440 con 0x561898c96a60 2024-05-09T09:47:59.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.758+0000 7f8c94b8d980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x561898bc35f0 con 0x561898d29100 2024-05-09T09:47:59.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.758+0000 7f8c926a8640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x561898c96a60 0x561898d279e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:56158/0 (socket says 172.21.15.157:56158) 2024-05-09T09:47:59.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.758+0000 7f8c926a8640 1 -- 172.21.15.157:0/1268560512 learned_addr learned my addr 172.21.15.157:0/1268560512 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:47:59.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.758+0000 7f8c91ea7640 1 --2- 172.21.15.157:0/1268560512 >> v2:172.21.15.110:3300/0 conn(0x561898d29100 0x561898d2b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.762+0000 7f8c916a6640 1 -- 172.21.15.157:0/1268560512 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3368059779 0 0) 0x561898bd8440 con 0x561898c96a60 2024-05-09T09:47:59.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.762+0000 7f8c916a6640 1 -- 172.21.15.157:0/1268560512 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c80001e20 con 0x561898c96a60 2024-05-09T09:47:59.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.762+0000 7f8c91ea7640 1 -- 172.21.15.157:0/1268560512 >> v1:172.21.15.110:6789/0 conn(0x561898c96a60 legacy=0x561898d279e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:59.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.762+0000 7f8c91ea7640 1 -- 172.21.15.157:0/1268560512 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561898bce990 con 0x561898d29100 2024-05-09T09:47:59.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.762+0000 7f8c91ea7640 1 --2- 172.21.15.157:0/1268560512 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898d29100 0x561898d2b4f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00a480 tx=0x7f8c7c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c673700c736e41 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.762+0000 7f8c916a6640 1 -- 172.21.15.157:0/1268560512 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c7c0b0070 con 0x561898d29100 2024-05-09T09:47:59.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.762+0000 7f8c916a6640 1 -- 172.21.15.157:0/1268560512 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c7c0ab540 con 0x561898d29100 2024-05-09T09:47:59.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.762+0000 7f8c916a6640 1 -- 172.21.15.157:0/1268560512 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c7c0ab820 con 0x561898d29100 2024-05-09T09:47:59.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.766+0000 7f8c94b8d980 1 -- 172.21.15.157:0/1268560512 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898d29100 msgr2=0x561898d2b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:59.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.766+0000 7f8c94b8d980 1 --2- 172.21.15.157:0/1268560512 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898d29100 0x561898d2b4f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00a480 tx=0x7f8c7c01b280 comp rx=0 tx=0).stop 2024-05-09T09:47:59.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.766+0000 7f8c94b8d980 1 -- 172.21.15.157:0/1268560512 shutdown_connections 2024-05-09T09:47:59.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.766+0000 7f8c94b8d980 1 --2- 172.21.15.157:0/1268560512 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898d29100 0x561898d2b4f0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:59.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.766+0000 7f8c94b8d980 1 -- 172.21.15.157:0/1268560512 >> 172.21.15.157:0/1268560512 conn(0x561898d1d0c0 msgr2=0x561898d1f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:59.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.766+0000 7f8c94b8d980 1 -- 172.21.15.157:0/1268560512 shutdown_connections 2024-05-09T09:47:59.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.766+0000 7f8c94b8d980 1 -- 172.21.15.157:0/1268560512 wait complete. 2024-05-09T09:47:59.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.778+0000 7f8c94b8d980 1 Processor -- start 2024-05-09T09:47:59.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.782+0000 7f8c94b8d980 1 -- start start 2024-05-09T09:47:59.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.782+0000 7f8c94b8d980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898c96a60 0x561898e0fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.782+0000 7f8c94b8d980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561898c25fe0 con 0x561898c96a60 2024-05-09T09:47:59.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.782+0000 7f8c926a8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898c96a60 0x561898e0fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.782+0000 7f8c926a8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898c96a60 0x561898e0fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:34854/0 (socket says 172.21.15.157:34854) 2024-05-09T09:47:59.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.782+0000 7f8c926a8640 1 -- 172.21.15.157:0/1868536762 learned_addr learned my addr 172.21.15.157:0/1868536762 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:59.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.782+0000 7f8c926a8640 1 -- 172.21.15.157:0/1868536762 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561898baaae0 con 0x561898c96a60 2024-05-09T09:47:59.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.782+0000 7f8c926a8640 1 --2- 172.21.15.157:0/1868536762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898c96a60 0x561898e0fb10 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8c84006fc0 tx=0x7f8c84001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5aaec155a3abac9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.782+0000 7f8b80608640 1 -- 172.21.15.157:0/1868536762 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c84004530 con 0x561898c96a60 2024-05-09T09:47:59.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.782+0000 7f8b80608640 1 -- 172.21.15.157:0/1868536762 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c840046d0 con 0x561898c96a60 2024-05-09T09:47:59.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.782+0000 7f8b80608640 1 -- 172.21.15.157:0/1868536762 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c84004a70 con 0x561898c96a60 2024-05-09T09:47:59.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.782+0000 7f8c94b8d980 1 -- 172.21.15.157:0/1868536762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898c96a60 msgr2=0x561898e0fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:59.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.782+0000 7f8c94b8d980 1 --2- 172.21.15.157:0/1868536762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898c96a60 0x561898e0fb10 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8c84006fc0 tx=0x7f8c84001af0 comp rx=0 tx=0).stop 2024-05-09T09:47:59.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.782+0000 7f8c94b8d980 1 -- 172.21.15.157:0/1868536762 shutdown_connections 2024-05-09T09:47:59.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.782+0000 7f8c94b8d980 1 --2- 172.21.15.157:0/1868536762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898c96a60 0x561898e0fb10 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:59.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.782+0000 7f8c94b8d980 1 -- 172.21.15.157:0/1868536762 >> 172.21.15.157:0/1868536762 conn(0x561898d1d0c0 msgr2=0x561898e0b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:59.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.782+0000 7f8c94b8d980 1 -- 172.21.15.157:0/1868536762 shutdown_connections 2024-05-09T09:47:59.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.782+0000 7f8c94b8d980 1 -- 172.21.15.157:0/1868536762 wait complete. 2024-05-09T09:47:59.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.782+0000 7f8c94b8d980 1 Processor -- start 2024-05-09T09:47:59.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.782+0000 7f8c94b8d980 1 -- start start 2024-05-09T09:47:59.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.782+0000 7f8c94b8d980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898c96a60 0x561898e16cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.782+0000 7f8c94b8d980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561898d2e490 con 0x561898c96a60 2024-05-09T09:47:59.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.782+0000 7f8c926a8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898c96a60 0x561898e16cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.782+0000 7f8c926a8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898c96a60 0x561898e16cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:34864/0 (socket says 172.21.15.157:34864) 2024-05-09T09:47:59.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.782+0000 7f8c926a8640 1 -- 172.21.15.157:0/3806662974 learned_addr learned my addr 172.21.15.157:0/3806662974 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:59.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.786+0000 7f8c926a8640 1 -- 172.21.15.157:0/3806662974 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561898e171f0 con 0x561898c96a60 2024-05-09T09:47:59.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.786+0000 7f8c926a8640 1 --2- 172.21.15.157:0/3806662974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898c96a60 0x561898e16cb0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8c84002260 tx=0x7f8c84000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.786+0000 7f8b7ee05640 1 -- 172.21.15.157:0/3806662974 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c84013760 con 0x561898c96a60 2024-05-09T09:47:59.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.786+0000 7f8c94b8d980 1 -- 172.21.15.157:0/3806662974 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561898e17480 con 0x561898c96a60 2024-05-09T09:47:59.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.786+0000 7f8b7ee05640 1 -- 172.21.15.157:0/3806662974 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c84013900 con 0x561898c96a60 2024-05-09T09:47:59.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.786+0000 7f8b7ee05640 1 -- 172.21.15.157:0/3806662974 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c84013c20 con 0x561898c96a60 2024-05-09T09:47:59.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.786+0000 7f8c94b8d980 1 -- 172.21.15.157:0/3806662974 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561898e1a160 con 0x561898c96a60 2024-05-09T09:47:59.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.786+0000 7f8b7ee05640 1 -- 172.21.15.157:0/3806662974 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f8c84010070 con 0x561898c96a60 2024-05-09T09:47:59.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.786+0000 7f8b7ee05640 1 --2- 172.21.15.157:0/3806662974 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8b78034bb0 0x7f8b78037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.786+0000 7f8b7ee05640 1 -- 172.21.15.157:0/3806662974 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f8c84018070 con 0x561898c96a60 2024-05-09T09:47:59.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.786+0000 7f8c91ea7640 1 --2- 172.21.15.157:0/3806662974 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8b78034bb0 0x7f8b78037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.786+0000 7f8c94b8d980 1 --2- 172.21.15.157:0/3806662974 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561898d29100 0x561898e1ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.786+0000 7f8c94b8d980 1 -- 172.21.15.157:0/3806662974 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e1e330 con 0x561898d29100 2024-05-09T09:47:59.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.786+0000 7f8c92ea9640 1 --2- 172.21.15.157:0/3806662974 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561898d29100 0x561898e1ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.786+0000 7f8c91ea7640 1 --2- 172.21.15.157:0/3806662974 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8b78034bb0 0x7f8b78037070 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0ad000 tx=0x7f8c7c0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.786+0000 7f8c92ea9640 1 --2- 172.21.15.157:0/3806662974 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561898d29100 0x561898e1ddb0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.786+0000 7f8c92ea9640 1 -- 172.21.15.157:0/3806662974 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c8c0083f0 con 0x561898d29100 2024-05-09T09:47:59.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.786+0000 7f8c94b8d980 1 -- 172.21.15.157:0/3806662974 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e1b380 con 0x561898d29100 2024-05-09T09:47:59.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.790+0000 7f8c92ea9640 1 -- 172.21.15.157:0/3806662974 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8c8c0083f0 con 0x561898d29100 2024-05-09T09:47:59.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.790+0000 7f8c94b8d980 1 --2- 172.21.15.157:0/3806662974 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561898e206b0 0x561898e22aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.790+0000 7f8c94b8d980 1 -- 172.21.15.157:0/3806662974 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e23170 con 0x561898e206b0 2024-05-09T09:47:59.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.790+0000 7f8c926a8640 1 --2- 172.21.15.157:0/3806662974 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561898e206b0 0x561898e22aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.790+0000 7f8c926a8640 1 --2- 172.21.15.157:0/3806662974 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561898e206b0 0x561898e22aa0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.790+0000 7f8c926a8640 1 -- 172.21.15.157:0/3806662974 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8c8401b030 con 0x561898e206b0 2024-05-09T09:47:59.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.790+0000 7f8c94b8d980 1 -- 172.21.15.157:0/3806662974 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e1f550 con 0x561898d29100 2024-05-09T09:47:59.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.790+0000 7f8c92ea9640 1 -- 172.21.15.157:0/3806662974 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8c8c0083f0 con 0x561898d29100 2024-05-09T09:47:59.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.790+0000 7f8c94b8d980 1 --2- 172.21.15.157:0/3806662974 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561898e245d0 0x561898e269c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.790+0000 7f8c94b8d980 1 -- 172.21.15.157:0/3806662974 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e270c0 con 0x561898e245d0 2024-05-09T09:47:59.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.790+0000 7f8c91ea7640 1 --2- 172.21.15.157:0/3806662974 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561898e245d0 0x561898e269c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.790+0000 7f8c91ea7640 1 --2- 172.21.15.157:0/3806662974 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561898e245d0 0x561898e269c0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.790+0000 7f8c91ea7640 1 -- 172.21.15.157:0/3806662974 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8c7c0b3040 con 0x561898e245d0 2024-05-09T09:47:59.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.794+0000 7f8c94b8d980 1 Processor -- start 2024-05-09T09:47:59.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.794+0000 7f8c94b8d980 1 -- start start 2024-05-09T09:47:59.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.794+0000 7f8c94b8d980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898e4cf30 0x561898e4d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.794+0000 7f8c94b8d980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561898c2a020 con 0x561898e4cf30 2024-05-09T09:47:59.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.794+0000 7f8c926a8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898e4cf30 0x561898e4d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.794+0000 7f8c926a8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898e4cf30 0x561898e4d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:34880/0 (socket says 172.21.15.157:34880) 2024-05-09T09:47:59.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.794+0000 7f8c926a8640 1 -- 172.21.15.157:0/3485566884 learned_addr learned my addr 172.21.15.157:0/3485566884 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:59.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.798+0000 7f8c926a8640 1 -- 172.21.15.157:0/3485566884 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561898e4d890 con 0x561898e4cf30 2024-05-09T09:47:59.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.798+0000 7f8c926a8640 1 --2- 172.21.15.157:0/3485566884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898e4cf30 0x561898e4d350 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8c84048ba0 tx=0x7f8c840286e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.798+0000 7f8b76ba2640 1 -- 172.21.15.157:0/3485566884 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c840125d0 con 0x561898e4cf30 2024-05-09T09:47:59.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.798+0000 7f8b76ba2640 1 -- 172.21.15.157:0/3485566884 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c84012770 con 0x561898e4cf30 2024-05-09T09:47:59.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.798+0000 7f8b76ba2640 1 -- 172.21.15.157:0/3485566884 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c8404a0c0 con 0x561898e4cf30 2024-05-09T09:47:59.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.798+0000 7f8c94b8d980 1 -- 172.21.15.157:0/3485566884 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561898e4e320 con 0x561898e4cf30 2024-05-09T09:47:59.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.798+0000 7f8c94b8d980 1 -- 172.21.15.157:0/3485566884 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561898e4e800 con 0x561898e4cf30 2024-05-09T09:47:59.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.802+0000 7f8b76ba2640 1 -- 172.21.15.157:0/3485566884 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f8c84029d10 con 0x561898e4cf30 2024-05-09T09:47:59.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.802+0000 7f8b76ba2640 1 --2- 172.21.15.157:0/3485566884 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8b6c034c00 0x7f8b6c0370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.802+0000 7f8b76ba2640 1 -- 172.21.15.157:0/3485566884 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f8c84040d10 con 0x561898e4cf30 2024-05-09T09:47:59.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.802+0000 7f8c91ea7640 1 --2- 172.21.15.157:0/3485566884 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8b6c034c00 0x7f8b6c0370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.802+0000 7f8c94b8d980 1 Processor -- start 2024-05-09T09:47:59.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.802+0000 7f8c94b8d980 1 -- start start 2024-05-09T09:47:59.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.802+0000 7f8c94b8d980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898e59f60 0x561898e5a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.802+0000 7f8c94b8d980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561898e10260 con 0x561898e59f60 2024-05-09T09:47:59.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.802+0000 7f8c91ea7640 1 --2- 172.21.15.157:0/3485566884 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8b6c034c00 0x7f8b6c0370c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x561898e1ec60 tx=0x7f8c7c005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.802+0000 7f8c926a8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898e59f60 0x561898e5a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.802+0000 7f8c926a8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898e59f60 0x561898e5a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:34884/0 (socket says 172.21.15.157:34884) 2024-05-09T09:47:59.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.802+0000 7f8c926a8640 1 -- 172.21.15.157:0/274707725 learned_addr learned my addr 172.21.15.157:0/274707725 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:59.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.802+0000 7f8c926a8640 1 -- 172.21.15.157:0/274707725 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561898e5a950 con 0x561898e59f60 2024-05-09T09:47:59.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.802+0000 7f8c926a8640 1 --2- 172.21.15.157:0/274707725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898e59f60 0x561898e5a380 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f8c8404a3a0 tx=0x7f8c84011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a37a65cce39737e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.802+0000 7f8b74b9e640 1 -- 172.21.15.157:0/274707725 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c8405a070 con 0x561898e59f60 2024-05-09T09:47:59.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.802+0000 7f8b74b9e640 1 -- 172.21.15.157:0/274707725 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c84042250 con 0x561898e59f60 2024-05-09T09:47:59.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.802+0000 7f8b74b9e640 1 -- 172.21.15.157:0/274707725 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c8404ab00 con 0x561898e59f60 2024-05-09T09:47:59.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.802+0000 7f8c94b8d980 1 -- 172.21.15.157:0/274707725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898e59f60 msgr2=0x561898e5a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:47:59.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.802+0000 7f8c94b8d980 1 --2- 172.21.15.157:0/274707725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898e59f60 0x561898e5a380 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f8c8404a3a0 tx=0x7f8c84011f30 comp rx=0 tx=0).stop 2024-05-09T09:47:59.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.802+0000 7f8c94b8d980 1 -- 172.21.15.157:0/274707725 shutdown_connections 2024-05-09T09:47:59.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.802+0000 7f8c94b8d980 1 --2- 172.21.15.157:0/274707725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898e59f60 0x561898e5a380 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:47:59.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.802+0000 7f8c94b8d980 1 -- 172.21.15.157:0/274707725 >> 172.21.15.157:0/274707725 conn(0x561898e562e0 msgr2=0x561898e54340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:47:59.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.802+0000 7f8c94b8d980 1 -- 172.21.15.157:0/274707725 shutdown_connections 2024-05-09T09:47:59.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.802+0000 7f8c94b8d980 1 -- 172.21.15.157:0/274707725 wait complete. 2024-05-09T09:47:59.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.802+0000 7f8c94b8d980 1 Processor -- start 2024-05-09T09:47:59.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.802+0000 7f8c94b8d980 1 -- start start 2024-05-09T09:47:59.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.802+0000 7f8c94b8d980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898e59f60 0x561898e612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.802+0000 7f8c94b8d980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561898e5b020 con 0x561898e59f60 2024-05-09T09:47:59.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.806+0000 7f8c926a8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898e59f60 0x561898e612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.806+0000 7f8c926a8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898e59f60 0x561898e612f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:34886/0 (socket says 172.21.15.157:34886) 2024-05-09T09:47:59.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.806+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 learned_addr learned my addr 172.21.15.157:0/601430668 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:47:59.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.806+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561898e61830 con 0x561898e59f60 2024-05-09T09:47:59.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.806+0000 7f8c926a8640 1 --2- 172.21.15.157:0/601430668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898e59f60 0x561898e612f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f8c84042870 tx=0x7f8c84042800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.806+0000 7f8b62ffd640 1 -- 172.21.15.157:0/601430668 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c8406f070 con 0x561898e59f60 2024-05-09T09:47:59.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.806+0000 7f8b62ffd640 1 -- 172.21.15.157:0/601430668 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c84047260 con 0x561898e59f60 2024-05-09T09:47:59.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.806+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561898e61830 con 0x561898e59f60 2024-05-09T09:47:59.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.806+0000 7f8b62ffd640 1 -- 172.21.15.157:0/601430668 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c840475a0 con 0x561898e59f60 2024-05-09T09:47:59.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.806+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561898e61830 con 0x561898e59f60 2024-05-09T09:47:59.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.806+0000 7f8c94b8d980 20 rados->read ofs=0 len=0 2024-05-09T09:47:59.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.806+0000 7f8b62ffd640 1 -- 172.21.15.157:0/601430668 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f8c84072070 con 0x561898e59f60 2024-05-09T09:47:59.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.806+0000 7f8b62ffd640 1 --2- 172.21.15.157:0/601430668 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8b5c034bb0 0x7f8b5c037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.806+0000 7f8b62ffd640 1 -- 172.21.15.157:0/601430668 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f8c84066030 con 0x561898e59f60 2024-05-09T09:47:59.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c91ea7640 1 --2- 172.21.15.157:0/601430668 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8b5c034bb0 0x7f8b5c037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c94b8d980 1 --2- 172.21.15.157:0/601430668 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561898e6dea0 0x561898e70360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e70ab0 con 0x561898e6dea0 2024-05-09T09:47:59.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c92ea9640 1 --2- 172.21.15.157:0/601430668 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561898e6dea0 0x561898e70360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c91ea7640 1 --2- 172.21.15.157:0/601430668 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8b5c034bb0 0x7f8b5c037070 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x561898e274c0 tx=0x7f8c7c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c92ea9640 1 --2- 172.21.15.157:0/601430668 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561898e6dea0 0x561898e70360 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c8c0083f0 con 0x561898e6dea0 2024-05-09T09:47:59.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c94b8d980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:59.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c94b8d980 20 realm 2024-05-09T09:47:59.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c94b8d980 20 rados->read ofs=0 len=0 2024-05-09T09:47:59.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e70ec0 con 0x561898e6dea0 2024-05-09T09:47:59.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c8c0083f0 con 0x561898e6dea0 2024-05-09T09:47:59.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c94b8d980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:59.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c94b8d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:47:59.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c94b8d980 20 rados->read ofs=0 len=0 2024-05-09T09:47:59.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e71760 con 0x561898e6dea0 2024-05-09T09:47:59.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c8c0083f0 con 0x561898e6dea0 2024-05-09T09:47:59.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c94b8d980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:59.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c94b8d980 20 rados->read ofs=0 len=0 2024-05-09T09:47:59.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x561898e6dea0 2024-05-09T09:47:59.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8c8c0083f0 con 0x561898e6dea0 2024-05-09T09:47:59.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c94b8d980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:59.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c94b8d980 20 rados->read ofs=0 len=0 2024-05-09T09:47:59.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c94b8d980 1 --2- 172.21.15.157:0/601430668 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561898e72860 0x561898e74c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e752a0 con 0x561898e72860 2024-05-09T09:47:59.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c926a8640 1 --2- 172.21.15.157:0/601430668 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561898e72860 0x561898e74c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c926a8640 1 --2- 172.21.15.157:0/601430668 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561898e72860 0x561898e74c50 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c94b8d980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:47:59.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c94b8d980 20 searching for the correct realm 2024-05-09T09:47:59.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c94b8d980 1 --2- 172.21.15.157:0/601430668 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561898e77180 0x561898e795f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e79c70 con 0x561898e77180 2024-05-09T09:47:59.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.810+0000 7f8c91ea7640 1 --2- 172.21.15.157:0/601430668 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561898e77180 0x561898e795f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.814+0000 7f8c91ea7640 1 --2- 172.21.15.157:0/601430668 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561898e77180 0x561898e795f0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.814+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.814+0000 7f8c91ea7640 1 --2- 172.21.15.157:0/601430668 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f8c7c0dd040 0x7f8c7c0cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:47:59.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.814+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e79c70 con 0x7f8c7c0dd040 2024-05-09T09:47:59.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.814+0000 7f8c92ea9640 1 --2- 172.21.15.157:0/601430668 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f8c7c0dd040 0x7f8c7c0cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:47:59.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.814+0000 7f8c92ea9640 1 --2- 172.21.15.157:0/601430668 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f8c7c0dd040 0x7f8c7c0cf430 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:47:59.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.814+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c8c0083f0 con 0x7f8c7c0dd040 2024-05-09T09:47:59.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.814+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x561898e72860 2024-05-09T09:47:59.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.814+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.814+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x561898e6dea0 2024-05-09T09:47:59.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.814+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c8c0083f0 con 0x561898e6dea0 2024-05-09T09:47:59.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.814+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x561898e6dea0 2024-05-09T09:47:59.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.814+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c8c026040 con 0x561898e6dea0 2024-05-09T09:47:59.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.814+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x561898e72860 2024-05-09T09:47:59.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.814+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.814+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x561898e72860 2024-05-09T09:47:59.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.818+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.818+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x7f8c7c0dd040 2024-05-09T09:47:59.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.818+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c8c026040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.818+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x561898e77180 2024-05-09T09:47:59.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.818+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.818+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x561898e6dea0 2024-05-09T09:47:59.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.818+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c8c026040 con 0x561898e6dea0 2024-05-09T09:47:59.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.818+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x561898e72860 2024-05-09T09:47:59.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.818+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.818+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x561898e6dea0 2024-05-09T09:47:59.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.818+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c8c026040 con 0x561898e6dea0 2024-05-09T09:47:59.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.818+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x7f8c7c0dd040 2024-05-09T09:47:59.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.818+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8c8c026040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.818+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x561898e77180 2024-05-09T09:47:59.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.818+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.818+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x561898e77180 2024-05-09T09:47:59.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.818+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.818+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x561898e72860 2024-05-09T09:47:59.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.822+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.822+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x561898e77180 2024-05-09T09:47:59.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.822+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.822+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x561898e77180 2024-05-09T09:47:59.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.822+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.822+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x561898e6dea0 2024-05-09T09:47:59.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.822+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c8c026040 con 0x561898e6dea0 2024-05-09T09:47:59.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.822+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x561898e6dea0 2024-05-09T09:47:59.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.822+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8c8c026040 con 0x561898e6dea0 2024-05-09T09:47:59.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.822+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x561898e72860 2024-05-09T09:47:59.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.822+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.822+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x561898e77180 2024-05-09T09:47:59.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.822+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.822+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x7f8c7c0dd040 2024-05-09T09:47:59.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.822+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c8c026040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.822+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x561898e6dea0 2024-05-09T09:47:59.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.822+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c8c026040 con 0x561898e6dea0 2024-05-09T09:47:59.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.822+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x561898e72860 2024-05-09T09:47:59.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.822+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.822+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x561898e77180 2024-05-09T09:47:59.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.826+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.826+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x561898e72860 2024-05-09T09:47:59.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.826+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.826+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x7f8c7c0dd040 2024-05-09T09:47:59.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.826+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c8c026040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.826+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x561898e77180 2024-05-09T09:47:59.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.826+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.826+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x561898e72860 2024-05-09T09:47:59.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.826+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.826+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x561898e6dea0 2024-05-09T09:47:59.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.826+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8c8c026040 con 0x561898e6dea0 2024-05-09T09:47:59.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.826+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561898e71b00 con 0x7f8c7c0dd040 2024-05-09T09:47:59.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.826+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c8c026040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.826+0000 7f8c94b8d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:47:59.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.826+0000 7f8c94b8d980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:47:59.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.826+0000 7f8c94b8d980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:47:59.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.826+0000 7f8c94b8d980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:47:59.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.826+0000 7f8c94b8d980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:47:59.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.826+0000 7f8c94b8d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:47:59.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.826+0000 7f8c94b8d980 20 rados->read ofs=0 len=0 2024-05-09T09:47:59.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.826+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e75af0 con 0x561898e6dea0 2024-05-09T09:47:59.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.826+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c8c026040 con 0x561898e6dea0 2024-05-09T09:47:59.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.826+0000 7f8c94b8d980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:59.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.826+0000 7f8c94b8d980 20 rados->read ofs=0 len=0 2024-05-09T09:47:59.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.826+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e75af0 con 0x561898e6dea0 2024-05-09T09:47:59.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.826+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8c8c026040 con 0x561898e6dea0 2024-05-09T09:47:59.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.826+0000 7f8c94b8d980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:47:59.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.826+0000 7f8c94b8d980 20 rados->read ofs=0 len=0 2024-05-09T09:47:59.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.826+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e75af0 con 0x561898e77180 2024-05-09T09:47:59.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.830+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.830+0000 7f8c94b8d980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:47:59.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.830+0000 7f8c94b8d980 20 zone default found 2024-05-09T09:47:59.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.830+0000 7f8c94b8d980 4 Realm: () 2024-05-09T09:47:59.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.830+0000 7f8c94b8d980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:47:59.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.830+0000 7f8c94b8d980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:47:59.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.830+0000 7f8c94b8d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:47:59.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.830+0000 7f8c94b8d980 20 zonegroup default 2024-05-09T09:47:59.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.830+0000 7f8c94b8d980 20 rados->read ofs=0 len=0 2024-05-09T09:47:59.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.830+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e764d0 con 0x561898e72860 2024-05-09T09:47:59.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.830+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.830+0000 7f8c94b8d980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:59.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.830+0000 7f8c94b8d980 20 rados->read ofs=0 len=0 2024-05-09T09:47:59.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.830+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e76060 con 0x561898e77180 2024-05-09T09:47:59.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.830+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.830+0000 7f8c94b8d980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:59.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.830+0000 7f8c94b8d980 20 rados->read ofs=0 len=0 2024-05-09T09:47:59.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.830+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e7c000 con 0x561898e77180 2024-05-09T09:47:59.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.830+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.830+0000 7f8c94b8d980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:47:59.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.830+0000 7f8c94b8d980 20 started sync module instance, tier type = 2024-05-09T09:47:59.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.830+0000 7f8c94b8d980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:47:59.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.830+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e7b410 con 0x7f8c7c0dd040 2024-05-09T09:47:59.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.830+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c8c026040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.830+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94663644526944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e7b410 con 0x7f8c7c0dd040 2024-05-09T09:47:59.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.830+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e7cb10 con 0x561898e6dea0 2024-05-09T09:47:59.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.834+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94663644526944] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.834+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:47:59.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.834+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94663644530176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e7b410 con 0x561898e6dea0 2024-05-09T09:47:59.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.834+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e7d550 con 0x561898e77180 2024-05-09T09:47:59.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.834+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.834+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94663644532896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e7dda0 con 0x561898e77180 2024-05-09T09:47:59.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.834+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e7e7a0 con 0x7f8c7c0dd040 2024-05-09T09:47:59.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.838+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94663644530176] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:47:59.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.838+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.838+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94663644524384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e7eb90 con 0x7f8c7c0dd040 2024-05-09T09:47:59.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.838+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e7f550 con 0x561898e6dea0 2024-05-09T09:47:59.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.838+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94663644532896] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.838+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94663644524384] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.838+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:47:59.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.838+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94663644537520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e7f0a0 con 0x561898e6dea0 2024-05-09T09:47:59.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.838+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e7f8f0 con 0x561898e72860 2024-05-09T09:47:59.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.842+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94663644537520] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:47:59.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.842+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.842+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94663644541088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e7f4c0 con 0x561898e72860 2024-05-09T09:47:59.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.842+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e805f0 con 0x561898e72860 2024-05-09T09:47:59.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.842+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.842+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94663644541088] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.842+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94663644545344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e80a10 con 0x561898e72860 2024-05-09T09:47:59.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.842+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e7fc90 con 0x561898e72860 2024-05-09T09:47:59.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.846+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94663644545344] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.846+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.846+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94663644549072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e80a10 con 0x561898e72860 2024-05-09T09:47:59.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.846+0000 7f8c94b8d980 20 add_watcher() i=0 2024-05-09T09:47:59.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.846+0000 7f8c94b8d980 20 add_watcher() i=1 2024-05-09T09:47:59.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.846+0000 7f8c94b8d980 20 add_watcher() i=2 2024-05-09T09:47:59.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.846+0000 7f8c94b8d980 20 add_watcher() i=3 2024-05-09T09:47:59.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.846+0000 7f8c94b8d980 20 add_watcher() i=4 2024-05-09T09:47:59.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.846+0000 7f8c94b8d980 20 add_watcher() i=5 2024-05-09T09:47:59.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.846+0000 7f8c94b8d980 20 add_watcher() i=6 2024-05-09T09:47:59.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.846+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94663644549072] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.846+0000 7f8c94b8d980 20 add_watcher() i=7 2024-05-09T09:47:59.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.846+0000 7f8c94b8d980 2 all 8 watchers are set, enabling cache 2024-05-09T09:47:59.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.846+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e844f0 con 0x561898e6dea0 2024-05-09T09:47:59.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.850+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:47:59.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.850+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94663644546864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e81970 con 0x561898e6dea0 2024-05-09T09:47:59.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.850+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94663644546864] v32'289 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:47:59.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.850+0000 7f8b47fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:47:59.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.850+0000 7f8c94b8d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:47:59.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.850+0000 7f8c94b8d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:47:59.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.850+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8cd60 con 0x561898e6dea0 2024-05-09T09:47:59.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.850+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'69 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:47:59.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.850+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8d430 con 0x561898e72860 2024-05-09T09:47:59.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.854+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'64 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.854+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8d430 con 0x561898e77180 2024-05-09T09:47:59.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.858+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'63 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.858+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8da20 con 0x561898e6dea0 2024-05-09T09:47:59.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.858+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'290 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:47:59.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.858+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8ded0 con 0x7f8c7c0dd040 2024-05-09T09:47:59.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.858+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'179 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.858+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8acd0 con 0x561898e77180 2024-05-09T09:47:59.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.862+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'120 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.862+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8acd0 con 0x561898e6dea0 2024-05-09T09:47:59.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.862+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'65 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:47:59.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.862+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8ea30 con 0x561898e72860 2024-05-09T09:47:59.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.866+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'119 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.866+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8ea30 con 0x7f8c7c0dd040 2024-05-09T09:47:59.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.870+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'63 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.870+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8ea30 con 0x561898e77180 2024-05-09T09:47:59.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.870+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'69 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.870+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8eac0 con 0x7f8c7c0dd040 2024-05-09T09:47:59.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.870+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'180 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.870+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8f0d0 con 0x561898e72860 2024-05-09T09:47:59.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.874+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'66 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.874+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8f0d0 con 0x7f8c7c0dd040 2024-05-09T09:47:59.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.874+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'63 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.874+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8f0d0 con 0x561898e72860 2024-05-09T09:47:59.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.878+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'125 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.878+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8f0d0 con 0x561898e6dea0 2024-05-09T09:47:59.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.882+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'291 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:47:59.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.882+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8f0d0 con 0x561898e77180 2024-05-09T09:47:59.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.882+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'173 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.882+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8f0d0 con 0x7f8c7c0dd040 2024-05-09T09:47:59.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.886+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'181 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.886+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8f0d0 con 0x561898e77180 2024-05-09T09:47:59.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.886+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'63 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.886+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8f0d0 con 0x561898e6dea0 2024-05-09T09:47:59.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.890+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'71 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:47:59.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.890+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8f0d0 con 0x561898e6dea0 2024-05-09T09:47:59.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.890+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'292 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:47:59.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.890+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8f0d0 con 0x561898e77180 2024-05-09T09:47:59.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.894+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'174 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.894+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8f0d0 con 0x7f8c7c0dd040 2024-05-09T09:47:59.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.894+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'74 uv72 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.894+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8f0d0 con 0x561898e77180 2024-05-09T09:47:59.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.898+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'65 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.898+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8f0d0 con 0x561898e77180 2024-05-09T09:47:59.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.898+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'69 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.898+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8f0d0 con 0x561898e77180 2024-05-09T09:47:59.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.898+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'59 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.898+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8f0d0 con 0x561898e77180 2024-05-09T09:47:59.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.902+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'121 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.902+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8f0d0 con 0x561898e72860 2024-05-09T09:47:59.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.906+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'65 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.906+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8f0d0 con 0x561898e77180 2024-05-09T09:47:59.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.906+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'63 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.906+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8f0d0 con 0x561898e72860 2024-05-09T09:47:59.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.910+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'120 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.910+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8f0d0 con 0x561898e77180 2024-05-09T09:47:59.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.914+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'175 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.914+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8f0d0 con 0x561898e72860 2024-05-09T09:47:59.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.918+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'126 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.918+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8f0d0 con 0x7f8c7c0dd040 2024-05-09T09:47:59.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.918+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'69 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.922+0000 7f8b46fe5640 20 reqs_thread_entry: start 2024-05-09T09:47:59.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.922+0000 7f8c94b8d980 20 init_complete bucket index max shards: 11 2024-05-09T09:47:59.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.922+0000 7f8b44fe1640 20 reqs_thread_entry: start 2024-05-09T09:47:59.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.922+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-05-09T09:47:59.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.922+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:94 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x7f8c7c0dd040 2024-05-09T09:47:59.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.922+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(94 gc.16 [call] v32'182 uv182 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.922+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:95 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x7f8c7c0dd040 2024-05-09T09:47:59.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.922+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(95 gc.16 [call out=15b] v0'0 uv182 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.922+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:47:59.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.922+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:96 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x7f8c7c0dd040 2024-05-09T09:47:59.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.922+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(96 gc.16 [call out=24b] v0'0 uv182 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.922+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:97 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x7f8c7c0dd040 2024-05-09T09:47:59.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.926+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(97 gc.16 [call out=15b] v0'0 uv182 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.926+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:47:59.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.926+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:98 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x7f8c7c0dd040 2024-05-09T09:47:59.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.926+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(98 gc.16 [call out=15b] v0'0 uv182 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.926+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:47:59.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.926+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x7f8c7c0dd040 2024-05-09T09:47:59.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.926+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 23 ==== osd_op_reply(99 gc.16 [call] v32'183 uv183 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.926+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-05-09T09:47:59.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.926+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:100 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x561898e77180 2024-05-09T09:47:59.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.926+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(100 gc.17 [call] v32'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.926+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:101 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x561898e77180 2024-05-09T09:47:59.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.930+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(101 gc.17 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.930+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:47:59.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.930+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:102 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x561898e77180 2024-05-09T09:47:59.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.930+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== osd_op_reply(102 gc.17 [call out=24b] v0'0 uv64 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.930+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:103 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x561898e77180 2024-05-09T09:47:59.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.930+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 30 ==== osd_op_reply(103 gc.17 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.930+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:47:59.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.930+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:104 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x561898e77180 2024-05-09T09:47:59.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.930+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 31 ==== osd_op_reply(104 gc.17 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.930+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:47:59.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.930+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:105 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x561898e77180 2024-05-09T09:47:59.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.930+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 32 ==== osd_op_reply(105 gc.17 [call] v32'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.930+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-05-09T09:47:59.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.930+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:106 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x561898e6dea0 2024-05-09T09:47:59.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.934+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(106 gc.18 [call] v32'72 uv72 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:47:59.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.934+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:107 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x561898e6dea0 2024-05-09T09:47:59.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.934+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(107 gc.18 [call out=15b] v0'0 uv72 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:47:59.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.934+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:47:59.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.934+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:108 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x561898e6dea0 2024-05-09T09:47:59.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.934+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(108 gc.18 [call out=24b] v0'0 uv72 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:47:59.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.934+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:109 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x561898e6dea0 2024-05-09T09:47:59.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.934+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(109 gc.18 [call out=15b] v0'0 uv72 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:47:59.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.934+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:47:59.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.934+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:110 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x561898e6dea0 2024-05-09T09:47:59.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.934+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(110 gc.18 [call out=15b] v0'0 uv72 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:47:59.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.934+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:47:59.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.934+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:111 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x561898e6dea0 2024-05-09T09:47:59.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.938+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(111 gc.18 [call] v32'73 uv73 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:47:59.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.938+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-05-09T09:47:59.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.938+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:112 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x561898e6dea0 2024-05-09T09:47:59.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.938+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(112 gc.19 [call] v32'293 uv293 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:47:59.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.938+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:113 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x561898e6dea0 2024-05-09T09:47:59.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.938+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(113 gc.19 [call out=15b] v0'0 uv293 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:47:59.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.938+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:47:59.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.938+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:114 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x561898e6dea0 2024-05-09T09:47:59.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.938+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(114 gc.19 [call out=24b] v0'0 uv293 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:47:59.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.938+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:115 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x561898e6dea0 2024-05-09T09:47:59.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.942+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 36 ==== osd_op_reply(115 gc.19 [call out=15b] v0'0 uv293 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:47:59.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.942+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:47:59.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.942+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:116 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x561898e6dea0 2024-05-09T09:47:59.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.942+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 37 ==== osd_op_reply(116 gc.19 [call out=15b] v0'0 uv293 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:47:59.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.942+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:47:59.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.942+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:117 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x561898e6dea0 2024-05-09T09:47:59.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.942+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 38 ==== osd_op_reply(117 gc.19 [call] v32'294 uv294 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:47:59.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.942+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-05-09T09:47:59.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.942+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:118 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x561898e77180 2024-05-09T09:47:59.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.946+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 33 ==== osd_op_reply(118 gc.20 [call] v32'176 uv176 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.946+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:119 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x561898e77180 2024-05-09T09:47:59.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.946+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 34 ==== osd_op_reply(119 gc.20 [call out=15b] v0'0 uv176 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.946+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:47:59.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.946+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:120 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x561898e77180 2024-05-09T09:47:59.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.946+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 35 ==== osd_op_reply(120 gc.20 [call out=24b] v0'0 uv176 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.946+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:121 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x561898e77180 2024-05-09T09:47:59.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.946+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 36 ==== osd_op_reply(121 gc.20 [call out=15b] v0'0 uv176 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.946+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:47:59.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.946+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:122 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x561898e77180 2024-05-09T09:47:59.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.946+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 37 ==== osd_op_reply(122 gc.20 [call out=15b] v0'0 uv176 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.946+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:47:59.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.946+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:123 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x561898e77180 2024-05-09T09:47:59.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.950+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 38 ==== osd_op_reply(123 gc.20 [call] v32'177 uv177 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.950+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-05-09T09:47:59.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.950+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:124 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x7f8c7c0dd040 2024-05-09T09:47:59.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.950+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 24 ==== osd_op_reply(124 gc.21 [call] v32'75 uv75 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.950+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:125 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x7f8c7c0dd040 2024-05-09T09:47:59.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.950+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 25 ==== osd_op_reply(125 gc.21 [call out=15b] v0'0 uv75 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.950+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:47:59.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.950+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:126 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x7f8c7c0dd040 2024-05-09T09:47:59.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.950+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 26 ==== osd_op_reply(126 gc.21 [call out=24b] v0'0 uv75 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.950+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:127 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x7f8c7c0dd040 2024-05-09T09:47:59.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.950+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 27 ==== osd_op_reply(127 gc.21 [call out=15b] v0'0 uv75 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.950+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:47:59.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.950+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:128 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e89df0 con 0x7f8c7c0dd040 2024-05-09T09:47:59.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.954+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 28 ==== osd_op_reply(128 gc.21 [call out=1700b] v0'0 uv75 ondisk = 0) ==== 149+0+1700 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.954+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-05-09T09:47:59.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.954+0000 7f8c94b8d980 20 garbage collection: RGWGC::process iterating over entry tag='b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.158458219382852161', time=2024-05-09T09:47:59.408478+0000, chain.objs.size()=7 2024-05-09T09:47:59.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.954+0000 7f8c94b8d980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_1 2024-05-09T09:47:59.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.954+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:129 3.30s0 3:0fac3db1:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_1:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e8a170 con 0x561898e77180 2024-05-09T09:47:59.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.954+0000 7f8c94b8d980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_2 2024-05-09T09:47:59.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.954+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:130 3.1fs0 3:f9ef5a92:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_2:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eaf080 con 0x561898e6dea0 2024-05-09T09:47:59.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.954+0000 7f8c94b8d980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_3 2024-05-09T09:47:59.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.954+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:131 3.cs0 3:32dc68e1:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_3:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eb1ca0 con 0x561898e77180 2024-05-09T09:47:59.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.954+0000 7f8c94b8d980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_4 2024-05-09T09:47:59.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.954+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:132 3.es0 3:7382f9a4:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_4:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x7f8c7c0dd040 2024-05-09T09:47:59.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.954+0000 7f8c94b8d980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_5 2024-05-09T09:47:59.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.954+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:133 3.cs0 3:33ff3e40:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_5:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eb74b0 con 0x561898e77180 2024-05-09T09:47:59.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.954+0000 7f8c94b8d980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_6 2024-05-09T09:47:59.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.954+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:134 3.ds0 3:b05c0416:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_6:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eb9f60 con 0x561898e77180 2024-05-09T09:47:59.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.954+0000 7f8c94b8d980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_7 2024-05-09T09:47:59.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.954+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:135 3.cs0 3:309528a4:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_7:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898ebc830 con 0x561898e77180 2024-05-09T09:47:59.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.958+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 39 ==== osd_op_reply(130 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_2 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:47:59.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.958+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 39 ==== osd_op_reply(134 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_6 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.958+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 40 ==== osd_op_reply(129 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_1 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.958+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 41 ==== osd_op_reply(131 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_3 [call] v32'4 uv4 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.958+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 42 ==== osd_op_reply(133 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_5 [call] v32'5 uv5 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.958+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 29 ==== osd_op_reply(132 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_4 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.962+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 43 ==== osd_op_reply(135 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.1__shadow_.4jc-tjw7EoBjrXnsdqYk2LiH-gA5fSH_7 [call] v32'6 uv6 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.962+0000 7f8c94b8d980 5 garbage collection: RGWGC::process removing entries, marker: 2024-05-09T09:47:59.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.962+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:136 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x7f8c7c0dd040 2024-05-09T09:47:59.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.962+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 30 ==== osd_op_reply(136 gc.21 [call] v32'76 uv76 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.962+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:137 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eb74b0 con 0x7f8c7c0dd040 2024-05-09T09:47:59.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.966+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 31 ==== osd_op_reply(137 gc.21 [call] v32'77 uv77 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:47:59.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.966+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-05-09T09:47:59.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.966+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:138 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eb1ca0 con 0x561898e77180 2024-05-09T09:47:59.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.966+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 44 ==== osd_op_reply(138 gc.22 [call] v32'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.966+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:139 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e77180 2024-05-09T09:47:59.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.966+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 45 ==== osd_op_reply(139 gc.22 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.966+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:47:59.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.966+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:140 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb1ca0 con 0x561898e77180 2024-05-09T09:47:59.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.966+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 46 ==== osd_op_reply(140 gc.22 [call out=24b] v0'0 uv66 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.966+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:141 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb74b0 con 0x561898e77180 2024-05-09T09:47:59.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.966+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 47 ==== osd_op_reply(141 gc.22 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.966+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:47:59.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.966+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:142 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e77180 2024-05-09T09:47:59.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.970+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 48 ==== osd_op_reply(142 gc.22 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.970+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:47:59.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.970+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:143 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eb74b0 con 0x561898e77180 2024-05-09T09:47:59.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.970+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 49 ==== osd_op_reply(143 gc.22 [call] v32'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.970+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-05-09T09:47:59.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.970+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:144 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eb1ca0 con 0x561898e77180 2024-05-09T09:47:59.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.970+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 50 ==== osd_op_reply(144 gc.23 [call] v32'70 uv70 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.970+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:145 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e77180 2024-05-09T09:47:59.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.970+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 51 ==== osd_op_reply(145 gc.23 [call out=15b] v0'0 uv70 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.970+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:47:59.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.970+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:146 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb1ca0 con 0x561898e77180 2024-05-09T09:47:59.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.970+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 52 ==== osd_op_reply(146 gc.23 [call out=24b] v0'0 uv70 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.970+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:147 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e77180 2024-05-09T09:47:59.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.974+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 53 ==== osd_op_reply(147 gc.23 [call out=15b] v0'0 uv70 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.974+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:47:59.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.974+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:148 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb1ca0 con 0x561898e77180 2024-05-09T09:47:59.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.974+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 54 ==== osd_op_reply(148 gc.23 [call out=15b] v0'0 uv70 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.974+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:47:59.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.974+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:149 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e77180 2024-05-09T09:47:59.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.974+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 55 ==== osd_op_reply(149 gc.23 [call] v32'71 uv71 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.974+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-05-09T09:47:59.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.974+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:150 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eb1ca0 con 0x561898e77180 2024-05-09T09:47:59.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.974+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 56 ==== osd_op_reply(150 gc.24 [call] v32'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.974+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:151 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e77180 2024-05-09T09:47:59.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.978+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 57 ==== osd_op_reply(151 gc.24 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.978+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:47:59.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.978+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:152 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb1ca0 con 0x561898e77180 2024-05-09T09:47:59.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.978+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 58 ==== osd_op_reply(152 gc.24 [call out=24b] v0'0 uv60 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.978+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:153 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e77180 2024-05-09T09:47:59.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.978+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 59 ==== osd_op_reply(153 gc.24 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.978+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:47:59.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.978+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:154 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e77180 2024-05-09T09:47:59.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.978+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 60 ==== osd_op_reply(154 gc.24 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.978+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:47:59.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.978+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:155 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e77180 2024-05-09T09:47:59.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.978+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 61 ==== osd_op_reply(155 gc.24 [call] v32'61 uv61 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.978+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-05-09T09:47:59.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.978+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:156 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e77180 2024-05-09T09:47:59.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.982+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 62 ==== osd_op_reply(156 gc.25 [call] v32'122 uv122 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.982+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:157 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e77180 2024-05-09T09:47:59.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.982+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 63 ==== osd_op_reply(157 gc.25 [call out=15b] v0'0 uv122 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.982+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:47:59.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.982+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:158 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e77180 2024-05-09T09:47:59.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.982+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 64 ==== osd_op_reply(158 gc.25 [call out=24b] v0'0 uv122 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.982+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:159 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e77180 2024-05-09T09:47:59.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.982+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 65 ==== osd_op_reply(159 gc.25 [call out=15b] v0'0 uv122 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.982+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:47:59.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.982+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:160 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e77180 2024-05-09T09:47:59.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.982+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 66 ==== osd_op_reply(160 gc.25 [call out=15b] v0'0 uv122 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.982+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:47:59.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.982+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:161 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e77180 2024-05-09T09:47:59.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.982+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 67 ==== osd_op_reply(161 gc.25 [call] v32'123 uv123 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.982+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-05-09T09:47:59.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.982+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:162 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e72860 2024-05-09T09:47:59.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.986+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(162 gc.26 [call] v32'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.986+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:163 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e72860 2024-05-09T09:47:59.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.986+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(163 gc.26 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.986+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:47:59.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.986+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:164 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e72860 2024-05-09T09:47:59.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.990+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(164 gc.26 [call out=24b] v0'0 uv66 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.990+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:165 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e72860 2024-05-09T09:47:59.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.990+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(165 gc.26 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.990+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:47:59.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.990+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:166 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e72860 2024-05-09T09:47:59.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.990+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(166 gc.26 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.990+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:47:59.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.990+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:167 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e72860 2024-05-09T09:47:59.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.994+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(167 gc.26 [call] v32'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:47:59.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.994+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-05-09T09:47:59.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.994+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:168 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e77180 2024-05-09T09:47:59.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.998+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 68 ==== osd_op_reply(168 gc.27 [call] v32'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.998+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:169 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e77180 2024-05-09T09:47:59.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.998+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 69 ==== osd_op_reply(169 gc.27 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.998+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:47:59.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.998+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:170 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e77180 2024-05-09T09:47:59.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.998+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 70 ==== osd_op_reply(170 gc.27 [call out=24b] v0'0 uv64 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.998+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:171 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e77180 2024-05-09T09:47:59.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.998+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 71 ==== osd_op_reply(171 gc.27 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.998+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:47:59.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.998+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:172 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e77180 2024-05-09T09:47:59.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.998+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 72 ==== osd_op_reply(172 gc.27 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:47:59.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.998+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:47:59.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:47:59.998+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:173 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e77180 2024-05-09T09:48:00.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.002+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 73 ==== osd_op_reply(173 gc.27 [call] v32'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.002+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-05-09T09:48:00.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.002+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:174 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e72860 2024-05-09T09:48:00.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.002+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(174 gc.28 [call] v32'121 uv121 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.002+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:175 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e72860 2024-05-09T09:48:00.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.002+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 32 ==== osd_op_reply(175 gc.28 [call out=15b] v0'0 uv121 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.002+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.002+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:176 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e72860 2024-05-09T09:48:00.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.002+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 33 ==== osd_op_reply(176 gc.28 [call out=24b] v0'0 uv121 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.002+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:177 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e72860 2024-05-09T09:48:00.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.006+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 34 ==== osd_op_reply(177 gc.28 [call out=15b] v0'0 uv121 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.006+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:48:00.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.006+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e72860 2024-05-09T09:48:00.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.006+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 35 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv121 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.006+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.006+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e72860 2024-05-09T09:48:00.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.006+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 36 ==== osd_op_reply(179 gc.28 [call] v32'122 uv122 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.006+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-05-09T09:48:00.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.006+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:180 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e77180 2024-05-09T09:48:00.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.010+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 74 ==== osd_op_reply(180 gc.29 [call] v32'178 uv178 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.010+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e77180 2024-05-09T09:48:00.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.010+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 75 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv178 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.010+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.010+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e77180 2024-05-09T09:48:00.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.010+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 76 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv178 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.010+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e77180 2024-05-09T09:48:00.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.010+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 77 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv178 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.010+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:48:00.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.010+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:184 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e77180 2024-05-09T09:48:00.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.010+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 78 ==== osd_op_reply(184 gc.29 [call out=15b] v0'0 uv178 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.010+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.010+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:185 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e77180 2024-05-09T09:48:00.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.010+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 79 ==== osd_op_reply(185 gc.29 [call] v32'179 uv179 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.010+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-05-09T09:48:00.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.010+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e72860 2024-05-09T09:48:00.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.014+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 37 ==== osd_op_reply(186 gc.30 [call] v32'127 uv127 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.014+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:187 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e72860 2024-05-09T09:48:00.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.014+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 38 ==== osd_op_reply(187 gc.30 [call out=15b] v0'0 uv127 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.014+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.014+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:188 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e72860 2024-05-09T09:48:00.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.014+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 39 ==== osd_op_reply(188 gc.30 [call out=24b] v0'0 uv127 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.014+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:189 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e72860 2024-05-09T09:48:00.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.014+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 40 ==== osd_op_reply(189 gc.30 [call out=15b] v0'0 uv127 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.014+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:48:00.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.014+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:190 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e72860 2024-05-09T09:48:00.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.014+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 41 ==== osd_op_reply(190 gc.30 [call out=15b] v0'0 uv127 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.014+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.014+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:191 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x561898e72860 2024-05-09T09:48:00.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.018+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 42 ==== osd_op_reply(191 gc.30 [call] v32'128 uv128 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.018+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-05-09T09:48:00.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.018+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:192 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x7f8c7c0dd040 2024-05-09T09:48:00.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.018+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 32 ==== osd_op_reply(192 gc.31 [call] v32'70 uv70 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.018+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:193 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eb48b0 con 0x7f8c7c0dd040 2024-05-09T09:48:00.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.018+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 33 ==== osd_op_reply(193 gc.31 [call out=15b] v0'0 uv70 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.018+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.018+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:194 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e89b80 con 0x7f8c7c0dd040 2024-05-09T09:48:00.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.018+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 34 ==== osd_op_reply(194 gc.31 [call out=24b] v0'0 uv70 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.018+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:195 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e89b80 con 0x7f8c7c0dd040 2024-05-09T09:48:00.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.022+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 35 ==== osd_op_reply(195 gc.31 [call out=15b] v0'0 uv70 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.022+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:48:00.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.022+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:196 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e89b80 con 0x7f8c7c0dd040 2024-05-09T09:48:00.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.022+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 36 ==== osd_op_reply(196 gc.31 [call out=15b] v0'0 uv70 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.022+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.022+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:197 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e89b80 con 0x7f8c7c0dd040 2024-05-09T09:48:00.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.022+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 37 ==== osd_op_reply(197 gc.31 [call] v32'71 uv71 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.022+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-05-09T09:48:00.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.022+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:198 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e89b80 con 0x561898e6dea0 2024-05-09T09:48:00.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.026+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 40 ==== osd_op_reply(198 gc.0 [call] v32'70 uv70 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:48:00.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.026+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:199 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898e89b80 con 0x561898e6dea0 2024-05-09T09:48:00.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.026+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 41 ==== osd_op_reply(199 gc.0 [call out=15b] v0'0 uv70 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:48:00.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.026+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.026+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:200 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eab7e0 con 0x561898e6dea0 2024-05-09T09:48:00.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.026+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 42 ==== osd_op_reply(200 gc.0 [call out=24b] v0'0 uv70 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:48:00.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.026+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:201 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eab7e0 con 0x561898e6dea0 2024-05-09T09:48:00.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.026+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 43 ==== osd_op_reply(201 gc.0 [call out=15b] v0'0 uv70 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:48:00.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.026+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:48:00.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.026+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:202 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eab7e0 con 0x561898e6dea0 2024-05-09T09:48:00.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.026+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 44 ==== osd_op_reply(202 gc.0 [call out=15b] v0'0 uv70 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:48:00.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.026+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.026+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:203 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e6dea0 2024-05-09T09:48:00.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.026+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 45 ==== osd_op_reply(203 gc.0 [call] v32'71 uv71 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:48:00.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.026+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-05-09T09:48:00.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.026+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:204 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e72860 2024-05-09T09:48:00.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.030+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 43 ==== osd_op_reply(204 gc.1 [call] v32'65 uv65 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.030+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:205 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e72860 2024-05-09T09:48:00.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.030+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 44 ==== osd_op_reply(205 gc.1 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.030+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.030+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:206 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e72860 2024-05-09T09:48:00.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.034+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 45 ==== osd_op_reply(206 gc.1 [call out=24b] v0'0 uv65 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.034+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:207 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e72860 2024-05-09T09:48:00.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.034+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 46 ==== osd_op_reply(207 gc.1 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.034+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:48:00.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.034+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:208 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e72860 2024-05-09T09:48:00.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.034+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 47 ==== osd_op_reply(208 gc.1 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.034+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.034+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:209 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e72860 2024-05-09T09:48:00.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.038+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 48 ==== osd_op_reply(209 gc.1 [call] v32'66 uv66 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.038+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-05-09T09:48:00.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.038+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:210 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e77180 2024-05-09T09:48:00.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.038+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 80 ==== osd_op_reply(210 gc.2 [call] v32'64 uv64 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.038+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:211 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e77180 2024-05-09T09:48:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.042+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 81 ==== osd_op_reply(211 gc.2 [call out=15b] v0'0 uv64 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.042+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.042+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:212 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e77180 2024-05-09T09:48:00.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.042+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 82 ==== osd_op_reply(212 gc.2 [call out=24b] v0'0 uv64 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.042+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:213 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e77180 2024-05-09T09:48:00.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.042+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 83 ==== osd_op_reply(213 gc.2 [call out=15b] v0'0 uv64 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.042+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:48:00.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.042+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:214 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e77180 2024-05-09T09:48:00.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.042+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 84 ==== osd_op_reply(214 gc.2 [call out=15b] v0'0 uv64 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.042+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.042+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:215 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e77180 2024-05-09T09:48:00.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.046+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 85 ==== osd_op_reply(215 gc.2 [call] v32'65 uv65 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.046+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-05-09T09:48:00.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.046+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:216 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e6dea0 2024-05-09T09:48:00.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.046+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 46 ==== osd_op_reply(216 gc.3 [call] v32'295 uv295 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:48:00.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.046+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:217 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e6dea0 2024-05-09T09:48:00.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.046+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 47 ==== osd_op_reply(217 gc.3 [call out=15b] v0'0 uv295 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:48:00.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.046+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.046+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:218 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eab7e0 con 0x561898e6dea0 2024-05-09T09:48:00.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.046+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 48 ==== osd_op_reply(218 gc.3 [call out=24b] v0'0 uv295 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:48:00.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.046+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:219 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eab7e0 con 0x561898e6dea0 2024-05-09T09:48:00.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.046+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 49 ==== osd_op_reply(219 gc.3 [call out=15b] v0'0 uv295 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:48:00.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.046+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:48:00.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.046+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:220 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eab7e0 con 0x561898e6dea0 2024-05-09T09:48:00.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.050+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 50 ==== osd_op_reply(220 gc.3 [call out=15b] v0'0 uv295 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:48:00.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.050+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.050+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:221 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e6dea0 2024-05-09T09:48:00.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.050+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 51 ==== osd_op_reply(221 gc.3 [call] v32'296 uv296 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:48:00.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.050+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-05-09T09:48:00.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.050+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:222 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x7f8c7c0dd040 2024-05-09T09:48:00.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.050+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 38 ==== osd_op_reply(222 gc.4 [call] v32'184 uv184 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.050+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:223 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x7f8c7c0dd040 2024-05-09T09:48:00.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.054+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 39 ==== osd_op_reply(223 gc.4 [call out=15b] v0'0 uv184 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.054+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.054+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:224 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eab7e0 con 0x7f8c7c0dd040 2024-05-09T09:48:00.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.054+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 40 ==== osd_op_reply(224 gc.4 [call out=24b] v0'0 uv184 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.054+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:225 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eab7e0 con 0x7f8c7c0dd040 2024-05-09T09:48:00.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.054+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 41 ==== osd_op_reply(225 gc.4 [call out=15b] v0'0 uv184 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.054+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:48:00.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.054+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:226 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eab7e0 con 0x7f8c7c0dd040 2024-05-09T09:48:00.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.054+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 42 ==== osd_op_reply(226 gc.4 [call out=15b] v0'0 uv184 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.054+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.054+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:227 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x7f8c7c0dd040 2024-05-09T09:48:00.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.054+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 43 ==== osd_op_reply(227 gc.4 [call] v32'185 uv185 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.054+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-05-09T09:48:00.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.054+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:228 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e77180 2024-05-09T09:48:00.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.058+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 86 ==== osd_op_reply(228 gc.5 [call] v32'124 uv124 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.058+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:229 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e77180 2024-05-09T09:48:00.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.058+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 87 ==== osd_op_reply(229 gc.5 [call out=15b] v0'0 uv124 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.058+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.058+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:230 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e77180 2024-05-09T09:48:00.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.058+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 88 ==== osd_op_reply(230 gc.5 [call out=24b] v0'0 uv124 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.058+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:231 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e77180 2024-05-09T09:48:00.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.058+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 89 ==== osd_op_reply(231 gc.5 [call out=15b] v0'0 uv124 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.058+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:48:00.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.058+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:232 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e77180 2024-05-09T09:48:00.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.058+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 90 ==== osd_op_reply(232 gc.5 [call out=15b] v0'0 uv124 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.058+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.058+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:233 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e77180 2024-05-09T09:48:00.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.062+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 91 ==== osd_op_reply(233 gc.5 [call] v32'125 uv125 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.062+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-05-09T09:48:00.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.062+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:234 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e6dea0 2024-05-09T09:48:00.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.066+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 52 ==== osd_op_reply(234 gc.6 [call] v32'66 uv66 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:48:00.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.066+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:235 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e6dea0 2024-05-09T09:48:00.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.066+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 53 ==== osd_op_reply(235 gc.6 [call out=15b] v0'0 uv66 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:48:00.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.066+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.066+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:236 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eab7e0 con 0x561898e6dea0 2024-05-09T09:48:00.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.066+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 54 ==== osd_op_reply(236 gc.6 [call out=24b] v0'0 uv66 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:48:00.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.066+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:237 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eab7e0 con 0x561898e6dea0 2024-05-09T09:48:00.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.066+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 55 ==== osd_op_reply(237 gc.6 [call out=15b] v0'0 uv66 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:48:00.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.066+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:48:00.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.066+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:238 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eab7e0 con 0x561898e6dea0 2024-05-09T09:48:00.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.066+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 56 ==== osd_op_reply(238 gc.6 [call out=15b] v0'0 uv66 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:48:00.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.066+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.066+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:239 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e6dea0 2024-05-09T09:48:00.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.070+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 57 ==== osd_op_reply(239 gc.6 [call] v32'67 uv67 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:48:00.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.070+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-05-09T09:48:00.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.070+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:240 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e72860 2024-05-09T09:48:00.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.074+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 49 ==== osd_op_reply(240 gc.7 [call] v32'123 uv123 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.074+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:241 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e72860 2024-05-09T09:48:00.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.074+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 50 ==== osd_op_reply(241 gc.7 [call out=15b] v0'0 uv123 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.074+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.074+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:242 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e72860 2024-05-09T09:48:00.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.074+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 51 ==== osd_op_reply(242 gc.7 [call out=24b] v0'0 uv123 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.074+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:243 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e72860 2024-05-09T09:48:00.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.074+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 52 ==== osd_op_reply(243 gc.7 [call out=15b] v0'0 uv123 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.074+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:48:00.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.074+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:244 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e72860 2024-05-09T09:48:00.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.074+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 53 ==== osd_op_reply(244 gc.7 [call out=15b] v0'0 uv123 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.074+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.074+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:245 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e72860 2024-05-09T09:48:00.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.078+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 54 ==== osd_op_reply(245 gc.7 [call] v32'124 uv124 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.078+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-05-09T09:48:00.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.078+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:246 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x7f8c7c0dd040 2024-05-09T09:48:00.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.082+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 44 ==== osd_op_reply(246 gc.8 [call] v32'64 uv64 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.082+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:247 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x7f8c7c0dd040 2024-05-09T09:48:00.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.082+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 45 ==== osd_op_reply(247 gc.8 [call out=15b] v0'0 uv64 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.082+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.082+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:248 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x7f8c7c0dd040 2024-05-09T09:48:00.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.082+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 46 ==== osd_op_reply(248 gc.8 [call out=24b] v0'0 uv64 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.082+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:249 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x7f8c7c0dd040 2024-05-09T09:48:00.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.082+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 47 ==== osd_op_reply(249 gc.8 [call out=15b] v0'0 uv64 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.082+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:48:00.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.082+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:250 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x7f8c7c0dd040 2024-05-09T09:48:00.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.082+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 48 ==== osd_op_reply(250 gc.8 [call out=15b] v0'0 uv64 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.082+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.082+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:251 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x7f8c7c0dd040 2024-05-09T09:48:00.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.086+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 49 ==== osd_op_reply(251 gc.8 [call] v32'65 uv65 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.086+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-05-09T09:48:00.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.086+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:252 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e77180 2024-05-09T09:48:00.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.086+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 92 ==== osd_op_reply(252 gc.9 [call] v32'70 uv70 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.090+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:253 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e77180 2024-05-09T09:48:00.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.090+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 93 ==== osd_op_reply(253 gc.9 [call out=15b] v0'0 uv70 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.090+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.090+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:254 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e77180 2024-05-09T09:48:00.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.090+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 94 ==== osd_op_reply(254 gc.9 [call out=24b] v0'0 uv70 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.090+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:255 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e77180 2024-05-09T09:48:00.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.090+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 95 ==== osd_op_reply(255 gc.9 [call out=15b] v0'0 uv70 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.090+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:48:00.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.090+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:256 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e77180 2024-05-09T09:48:00.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.090+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 96 ==== osd_op_reply(256 gc.9 [call out=15b] v0'0 uv70 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.090+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.090+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:257 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e77180 2024-05-09T09:48:00.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.094+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 97 ==== osd_op_reply(257 gc.9 [call] v32'71 uv71 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.094+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-05-09T09:48:00.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.094+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:258 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x7f8c7c0dd040 2024-05-09T09:48:00.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.094+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 50 ==== osd_op_reply(258 gc.10 [call] v32'186 uv186 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.094+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:259 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x7f8c7c0dd040 2024-05-09T09:48:00.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.094+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 51 ==== osd_op_reply(259 gc.10 [call out=15b] v0'0 uv186 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.094+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.094+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:260 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x7f8c7c0dd040 2024-05-09T09:48:00.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.094+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 52 ==== osd_op_reply(260 gc.10 [call out=24b] v0'0 uv186 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.094+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:261 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x7f8c7c0dd040 2024-05-09T09:48:00.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.098+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 53 ==== osd_op_reply(261 gc.10 [call out=15b] v0'0 uv186 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.098+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:48:00.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.098+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:262 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x7f8c7c0dd040 2024-05-09T09:48:00.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.098+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 54 ==== osd_op_reply(262 gc.10 [call out=15b] v0'0 uv186 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.098+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.098+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:263 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x7f8c7c0dd040 2024-05-09T09:48:00.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.098+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 55 ==== osd_op_reply(263 gc.10 [call] v32'187 uv187 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.098+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-05-09T09:48:00.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.098+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:264 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e72860 2024-05-09T09:48:00.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.102+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 55 ==== osd_op_reply(264 gc.11 [call] v32'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.102+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:265 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e72860 2024-05-09T09:48:00.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.102+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 56 ==== osd_op_reply(265 gc.11 [call out=15b] v0'0 uv67 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.102+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.102+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:266 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e72860 2024-05-09T09:48:00.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.106+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 57 ==== osd_op_reply(266 gc.11 [call out=24b] v0'0 uv67 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.106+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:267 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e72860 2024-05-09T09:48:00.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.106+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 58 ==== osd_op_reply(267 gc.11 [call out=15b] v0'0 uv67 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.106+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:48:00.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.106+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:268 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e72860 2024-05-09T09:48:00.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.106+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 59 ==== osd_op_reply(268 gc.11 [call out=15b] v0'0 uv67 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.106+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.106+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:269 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e72860 2024-05-09T09:48:00.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.110+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 60 ==== osd_op_reply(269 gc.11 [call] v32'68 uv68 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.110+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-05-09T09:48:00.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.110+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:270 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x7f8c7c0dd040 2024-05-09T09:48:00.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.110+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 56 ==== osd_op_reply(270 gc.12 [call] v32'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.110+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:271 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x7f8c7c0dd040 2024-05-09T09:48:00.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.110+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 57 ==== osd_op_reply(271 gc.12 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.110+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.110+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:272 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x7f8c7c0dd040 2024-05-09T09:48:00.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.114+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 58 ==== osd_op_reply(272 gc.12 [call out=24b] v0'0 uv64 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.114+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:273 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x7f8c7c0dd040 2024-05-09T09:48:00.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.114+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 59 ==== osd_op_reply(273 gc.12 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.114+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:48:00.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.114+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:274 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x7f8c7c0dd040 2024-05-09T09:48:00.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.114+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 60 ==== osd_op_reply(274 gc.12 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.114+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.114+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:275 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x7f8c7c0dd040 2024-05-09T09:48:00.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.114+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 61 ==== osd_op_reply(275 gc.12 [call] v32'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.114+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-05-09T09:48:00.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.114+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:276 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e72860 2024-05-09T09:48:00.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.118+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 61 ==== osd_op_reply(276 gc.13 [call] v32'129 uv129 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.118+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:277 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e72860 2024-05-09T09:48:00.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.122+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 62 ==== osd_op_reply(277 gc.13 [call out=15b] v0'0 uv129 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.122+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.122+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:278 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e72860 2024-05-09T09:48:00.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.122+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 63 ==== osd_op_reply(278 gc.13 [call out=24b] v0'0 uv129 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.122+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:279 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e72860 2024-05-09T09:48:00.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.122+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 64 ==== osd_op_reply(279 gc.13 [call out=15b] v0'0 uv129 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.122+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:48:00.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.122+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:280 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e72860 2024-05-09T09:48:00.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.126+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 65 ==== osd_op_reply(280 gc.13 [call out=15b] v0'0 uv129 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.126+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.126+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:281 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e72860 2024-05-09T09:48:00.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.126+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 66 ==== osd_op_reply(281 gc.13 [call] v32'130 uv130 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.126+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-05-09T09:48:00.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.126+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:282 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e6dea0 2024-05-09T09:48:00.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.130+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 58 ==== osd_op_reply(282 gc.14 [call] v32'297 uv297 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:48:00.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.130+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:283 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e6dea0 2024-05-09T09:48:00.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.130+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 59 ==== osd_op_reply(283 gc.14 [call out=15b] v0'0 uv297 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:48:00.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.130+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.130+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:284 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e6dea0 2024-05-09T09:48:00.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.130+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 60 ==== osd_op_reply(284 gc.14 [call out=24b] v0'0 uv297 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:48:00.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.130+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:285 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e6dea0 2024-05-09T09:48:00.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.130+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 61 ==== osd_op_reply(285 gc.14 [call out=15b] v0'0 uv297 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:48:00.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.130+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:48:00.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.130+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:286 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e6dea0 2024-05-09T09:48:00.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.134+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 62 ==== osd_op_reply(286 gc.14 [call out=15b] v0'0 uv297 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:48:00.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.134+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.134+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:287 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e6dea0 2024-05-09T09:48:00.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.134+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 63 ==== osd_op_reply(287 gc.14 [call] v32'298 uv298 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:48:00.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.134+0000 7f8c94b8d980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-05-09T09:48:00.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.134+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:288 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e77180 2024-05-09T09:48:00.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.138+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 98 ==== osd_op_reply(288 gc.15 [call] v32'180 uv180 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.138+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:289 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e77180 2024-05-09T09:48:00.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.138+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 99 ==== osd_op_reply(289 gc.15 [call out=15b] v0'0 uv180 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.138+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.138+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:290 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e77180 2024-05-09T09:48:00.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.138+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 100 ==== osd_op_reply(290 gc.15 [call out=24b] v0'0 uv180 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.138+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:291 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e77180 2024-05-09T09:48:00.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.138+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 101 ==== osd_op_reply(291 gc.15 [call out=15b] v0'0 uv180 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.138+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:48:00.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.138+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:292 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e77180 2024-05-09T09:48:00.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.138+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 102 ==== osd_op_reply(292 gc.15 [call out=15b] v0'0 uv180 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.138+0000 7f8c94b8d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:48:00.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.138+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:293 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e77180 2024-05-09T09:48:00.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.142+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 103 ==== osd_op_reply(293 gc.15 [call] v32'181 uv181 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.142+0000 7f8b47fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:00.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.142+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94663644546864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898eac910 con 0x561898e6dea0 2024-05-09T09:48:00.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.146+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 64 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94663644546864] v32'299 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:48:00.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.146+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94663644526944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e89b80 con 0x7f8c7c0dd040 2024-05-09T09:48:00.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.146+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 62 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94663644526944] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.146+0000 7f8c94b8d980 20 remove_watcher() i=0 2024-05-09T09:48:00.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.146+0000 7f8c94b8d980 2 removed watcher, disabling cache 2024-05-09T09:48:00.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.146+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94663644530176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e7b960 con 0x561898e6dea0 2024-05-09T09:48:00.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.150+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 65 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94663644530176] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:48:00.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.150+0000 7f8c94b8d980 20 remove_watcher() i=1 2024-05-09T09:48:00.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.150+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94663644532896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e7b960 con 0x561898e77180 2024-05-09T09:48:00.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.154+0000 7f8c91ea7640 1 -- 172.21.15.157:0/601430668 <== osd.3 v2:172.21.15.157:6816/2487336710 104 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94663644532896] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7c0ca030 con 0x561898e77180 2024-05-09T09:48:00.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.154+0000 7f8c94b8d980 20 remove_watcher() i=2 2024-05-09T09:48:00.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.154+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94663644524384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e7d0a0 con 0x7f8c7c0dd040 2024-05-09T09:48:00.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.154+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.2 v2:172.21.15.157:6800/354455204 63 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94663644524384] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x7f8c7c0dd040 2024-05-09T09:48:00.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.154+0000 7f8c94b8d980 20 remove_watcher() i=3 2024-05-09T09:48:00.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.154+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94663644537520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e7b960 con 0x561898e6dea0 2024-05-09T09:48:00.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.158+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 <== osd.1 v2:172.21.15.157:6808/3930131338 66 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94663644537520] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c8c036040 con 0x561898e6dea0 2024-05-09T09:48:00.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.158+0000 7f8c94b8d980 20 remove_watcher() i=4 2024-05-09T09:48:00.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.158+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94663644541088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e7af60 con 0x561898e72860 2024-05-09T09:48:00.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.158+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 67 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94663644541088] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.158+0000 7f8c94b8d980 20 remove_watcher() i=5 2024-05-09T09:48:00.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.158+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94663644545344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e7d0a0 con 0x561898e72860 2024-05-09T09:48:00.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.162+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 68 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94663644545344] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.162+0000 7f8c94b8d980 20 remove_watcher() i=6 2024-05-09T09:48:00.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.162+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94663644549072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561898e7f0a0 con 0x561898e72860 2024-05-09T09:48:00.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.162+0000 7f8c926a8640 1 -- 172.21.15.157:0/601430668 <== osd.0 v2:172.21.15.110:6800/231209037 69 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94663644549072] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c84071030 con 0x561898e72860 2024-05-09T09:48:00.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.162+0000 7f8c94b8d980 20 remove_watcher() i=7 2024-05-09T09:48:00.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.162+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561898e72860 msgr2=0x561898e74c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.162+0000 7f8c94b8d980 1 --2- 172.21.15.157:0/601430668 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561898e72860 0x561898e74c50 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.162+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561898e6dea0 msgr2=0x561898e70360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.162+0000 7f8c94b8d980 1 --2- 172.21.15.157:0/601430668 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561898e6dea0 0x561898e70360 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.162+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f8c7c0dd040 msgr2=0x7f8c7c0cf430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.162+0000 7f8c94b8d980 1 --2- 172.21.15.157:0/601430668 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f8c7c0dd040 0x7f8c7c0cf430 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.162+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561898e77180 msgr2=0x561898e795f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.162+0000 7f8c94b8d980 1 --2- 172.21.15.157:0/601430668 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561898e77180 0x561898e795f0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.162+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8b5c034bb0 msgr2=0x7f8b5c037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.162+0000 7f8c94b8d980 1 --2- 172.21.15.157:0/601430668 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8b5c034bb0 0x7f8b5c037070 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x561898e274c0 tx=0x7f8c7c0a6000 comp rx=0 tx=0).stop 2024-05-09T09:48:00.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.162+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898e59f60 msgr2=0x561898e612f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.162+0000 7f8c94b8d980 1 --2- 172.21.15.157:0/601430668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898e59f60 0x561898e612f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f8c84042870 tx=0x7f8c84042800 comp rx=0 tx=0).stop 2024-05-09T09:48:00.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.162+0000 7f8c92ea9640 1 -- 172.21.15.157:0/601430668 reap_dead start 2024-05-09T09:48:00.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.166+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 shutdown_connections 2024-05-09T09:48:00.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.166+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 >> 172.21.15.157:0/601430668 conn(0x561898e562e0 msgr2=0x561898e54310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:00.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.166+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 shutdown_connections 2024-05-09T09:48:00.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.166+0000 7f8c94b8d980 1 -- 172.21.15.157:0/601430668 wait complete. 2024-05-09T09:48:00.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.166+0000 7f8c94b8d980 1 -- 172.21.15.157:0/3485566884 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8b6c034c00 msgr2=0x7f8b6c0370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.166+0000 7f8c94b8d980 1 --2- 172.21.15.157:0/3485566884 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8b6c034c00 0x7f8b6c0370c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x561898e1ec60 tx=0x7f8c7c005a10 comp rx=0 tx=0).stop 2024-05-09T09:48:00.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.166+0000 7f8c94b8d980 1 -- 172.21.15.157:0/3485566884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898e4cf30 msgr2=0x561898e4d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.166+0000 7f8c94b8d980 1 --2- 172.21.15.157:0/3485566884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898e4cf30 0x561898e4d350 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8c84048ba0 tx=0x7f8c840286e0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.166+0000 7f8c94b8d980 1 -- 172.21.15.157:0/3485566884 shutdown_connections 2024-05-09T09:48:00.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.166+0000 7f8c94b8d980 1 --2- 172.21.15.157:0/3485566884 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8b6c034c00 0x7f8b6c0370c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.166+0000 7f8c94b8d980 1 --2- 172.21.15.157:0/3485566884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898e4cf30 0x561898e4d350 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.166+0000 7f8c94b8d980 1 -- 172.21.15.157:0/3485566884 >> 172.21.15.157:0/3485566884 conn(0x561898e41d00 msgr2=0x561898e42810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:00.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.166+0000 7f8c94b8d980 1 -- 172.21.15.157:0/3485566884 shutdown_connections 2024-05-09T09:48:00.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.166+0000 7f8c94b8d980 1 -- 172.21.15.157:0/3485566884 wait complete. 2024-05-09T09:48:00.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.166+0000 7f8c94b8d980 1 -- 172.21.15.157:0/3806662974 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561898e206b0 msgr2=0x561898e22aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.166+0000 7f8c94b8d980 1 --2- 172.21.15.157:0/3806662974 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561898e206b0 0x561898e22aa0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.166+0000 7f8c94b8d980 1 -- 172.21.15.157:0/3806662974 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561898d29100 msgr2=0x561898e1ddb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.166+0000 7f8c94b8d980 1 --2- 172.21.15.157:0/3806662974 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561898d29100 0x561898e1ddb0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.166+0000 7f8c94b8d980 1 -- 172.21.15.157:0/3806662974 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561898e245d0 msgr2=0x561898e269c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.166+0000 7f8c94b8d980 1 --2- 172.21.15.157:0/3806662974 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561898e245d0 0x561898e269c0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.166+0000 7f8c94b8d980 1 -- 172.21.15.157:0/3806662974 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8b78034bb0 msgr2=0x7f8b78037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.166+0000 7f8c94b8d980 1 --2- 172.21.15.157:0/3806662974 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8b78034bb0 0x7f8b78037070 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0ad000 tx=0x7f8c7c0a5040 comp rx=0 tx=0).stop 2024-05-09T09:48:00.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.166+0000 7f8c94b8d980 1 -- 172.21.15.157:0/3806662974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898c96a60 msgr2=0x561898e16cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.166+0000 7f8c94b8d980 1 --2- 172.21.15.157:0/3806662974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561898c96a60 0x561898e16cb0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8c84002260 tx=0x7f8c84000f50 comp rx=0 tx=0).stop 2024-05-09T09:48:00.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.166+0000 7f8c92ea9640 1 -- 172.21.15.157:0/3806662974 reap_dead start 2024-05-09T09:48:00.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.166+0000 7f8c94b8d980 1 -- 172.21.15.157:0/3806662974 shutdown_connections 2024-05-09T09:48:00.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.166+0000 7f8c94b8d980 1 -- 172.21.15.157:0/3806662974 >> 172.21.15.157:0/3806662974 conn(0x561898d1d0c0 msgr2=0x561898e0a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:00.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.166+0000 7f8c94b8d980 1 -- 172.21.15.157:0/3806662974 shutdown_connections 2024-05-09T09:48:00.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.166+0000 7f8c94b8d980 1 -- 172.21.15.157:0/3806662974 wait complete. 2024-05-09T09:48:00.181 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-05-09T09:48:00.181 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-05-09T09:48:00.181 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-05-09T09:48:00.258 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:48:00.258 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:48:00.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.258+0000 7fe32e933980 1 Processor -- start 2024-05-09T09:48:00.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.258+0000 7fe32e933980 1 -- start start 2024-05-09T09:48:00.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.258+0000 7fe32e933980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55d6de9a50a0 0x55d6de9a5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.258+0000 7fe32e933980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d6de859440 con 0x55d6de9a59c0 2024-05-09T09:48:00.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.258+0000 7fe32e933980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55d6de8445f0 con 0x55d6de9a50a0 2024-05-09T09:48:00.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.258+0000 7fe32c44e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55d6de9a50a0 0x55d6de9a5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.258+0000 7fe32c44e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55d6de9a50a0 0x55d6de9a5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:34892/0 (socket says 172.21.15.157:34892) 2024-05-09T09:48:00.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.258+0000 7fe32c44e640 1 -- 172.21.15.157:0/1381381899 learned_addr learned my addr 172.21.15.157:0/1381381899 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:00.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.258+0000 7fe32c44e640 1 -- 172.21.15.157:0/1381381899 >> v1:172.21.15.110:6789/0 conn(0x55d6de9a59c0 legacy=0x55d6de9a1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.258+0000 7fe32c44e640 1 -- 172.21.15.157:0/1381381899 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6de84f990 con 0x55d6de9a50a0 2024-05-09T09:48:00.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.262+0000 7fe32c44e640 1 --2- 172.21.15.157:0/1381381899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6de9a50a0 0x55d6de9a5480 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe31400a5c0 tx=0x7fe31401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f346ca258c0fd52 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.262+0000 7fe32bc4d640 1 -- 172.21.15.157:0/1381381899 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3140b0070 con 0x55d6de9a50a0 2024-05-09T09:48:00.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.262+0000 7fe32bc4d640 1 -- 172.21.15.157:0/1381381899 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3140ab520 con 0x55d6de9a50a0 2024-05-09T09:48:00.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.262+0000 7fe32bc4d640 1 -- 172.21.15.157:0/1381381899 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3140ab820 con 0x55d6de9a50a0 2024-05-09T09:48:00.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.266+0000 7fe32e933980 1 -- 172.21.15.157:0/1381381899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6de9a50a0 msgr2=0x55d6de9a5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.266+0000 7fe32e933980 1 --2- 172.21.15.157:0/1381381899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6de9a50a0 0x55d6de9a5480 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe31400a5c0 tx=0x7fe31401b340 comp rx=0 tx=0).stop 2024-05-09T09:48:00.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.266+0000 7fe32e933980 1 -- 172.21.15.157:0/1381381899 shutdown_connections 2024-05-09T09:48:00.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.266+0000 7fe32e933980 1 --2- 172.21.15.157:0/1381381899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6de9a50a0 0x55d6de9a5480 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.266+0000 7fe32e933980 1 -- 172.21.15.157:0/1381381899 >> 172.21.15.157:0/1381381899 conn(0x55d6de99d850 msgr2=0x55d6de99fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:00.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.266+0000 7fe32e933980 1 -- 172.21.15.157:0/1381381899 shutdown_connections 2024-05-09T09:48:00.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.266+0000 7fe32e933980 1 -- 172.21.15.157:0/1381381899 wait complete. 2024-05-09T09:48:00.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.278+0000 7fe32e933980 1 Processor -- start 2024-05-09T09:48:00.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.278+0000 7fe32e933980 1 -- start start 2024-05-09T09:48:00.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.278+0000 7fe32e933980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6de9a50a0 0x55d6dea8f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.278+0000 7fe32e933980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d6de8a6fe0 con 0x55d6de9a50a0 2024-05-09T09:48:00.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.278+0000 7fe32c44e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6de9a50a0 0x55d6dea8f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.278+0000 7fe32c44e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6de9a50a0 0x55d6dea8f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:34898/0 (socket says 172.21.15.157:34898) 2024-05-09T09:48:00.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.278+0000 7fe32c44e640 1 -- 172.21.15.157:0/2028948435 learned_addr learned my addr 172.21.15.157:0/2028948435 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:00.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.282+0000 7fe32c44e640 1 -- 172.21.15.157:0/2028948435 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6de82bae0 con 0x55d6de9a50a0 2024-05-09T09:48:00.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.282+0000 7fe32c44e640 1 --2- 172.21.15.157:0/2028948435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6de9a50a0 0x55d6dea8f420 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fe314018f70 tx=0x7fe314003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3a3c06f58d4da1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.282+0000 7fe21a60c640 1 -- 172.21.15.157:0/2028948435 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3140b0070 con 0x55d6de9a50a0 2024-05-09T09:48:00.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.282+0000 7fe21a60c640 1 -- 172.21.15.157:0/2028948435 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3140bc070 con 0x55d6de9a50a0 2024-05-09T09:48:00.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.282+0000 7fe21a60c640 1 -- 172.21.15.157:0/2028948435 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3140abbd0 con 0x55d6de9a50a0 2024-05-09T09:48:00.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.282+0000 7fe32e933980 1 -- 172.21.15.157:0/2028948435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6de9a50a0 msgr2=0x55d6dea8f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.282+0000 7fe32e933980 1 --2- 172.21.15.157:0/2028948435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6de9a50a0 0x55d6dea8f420 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fe314018f70 tx=0x7fe314003030 comp rx=0 tx=0).stop 2024-05-09T09:48:00.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.282+0000 7fe32e933980 1 -- 172.21.15.157:0/2028948435 shutdown_connections 2024-05-09T09:48:00.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.282+0000 7fe32e933980 1 --2- 172.21.15.157:0/2028948435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6de9a50a0 0x55d6dea8f420 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.282+0000 7fe32e933980 1 -- 172.21.15.157:0/2028948435 >> 172.21.15.157:0/2028948435 conn(0x55d6de99d850 msgr2=0x55d6dea8afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:00.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.286+0000 7fe32e933980 1 -- 172.21.15.157:0/2028948435 shutdown_connections 2024-05-09T09:48:00.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.286+0000 7fe32e933980 1 -- 172.21.15.157:0/2028948435 wait complete. 2024-05-09T09:48:00.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.286+0000 7fe32e933980 1 Processor -- start 2024-05-09T09:48:00.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.286+0000 7fe32e933980 1 -- start start 2024-05-09T09:48:00.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.286+0000 7fe32e933980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6de9a50a0 0x55d6de9a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.286+0000 7fe32e933980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d6de9adba0 con 0x55d6de9a50a0 2024-05-09T09:48:00.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.286+0000 7fe32c44e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6de9a50a0 0x55d6de9a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.286+0000 7fe32c44e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6de9a50a0 0x55d6de9a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:34912/0 (socket says 172.21.15.157:34912) 2024-05-09T09:48:00.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.286+0000 7fe32c44e640 1 -- 172.21.15.157:0/1456997792 learned_addr learned my addr 172.21.15.157:0/1456997792 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:00.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.286+0000 7fe32c44e640 1 -- 172.21.15.157:0/1456997792 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6de9a4c10 con 0x55d6de9a50a0 2024-05-09T09:48:00.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.286+0000 7fe32c44e640 1 --2- 172.21.15.157:0/1456997792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6de9a50a0 0x55d6de9a46d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe3140b9040 tx=0x7fe3140180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.286+0000 7fe218e09640 1 -- 172.21.15.157:0/1456997792 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3140b7670 con 0x55d6de9a50a0 2024-05-09T09:48:00.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.286+0000 7fe32e933980 1 -- 172.21.15.157:0/1456997792 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d6de9a2e40 con 0x55d6de9a50a0 2024-05-09T09:48:00.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.286+0000 7fe218e09640 1 -- 172.21.15.157:0/1456997792 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe314000e50 con 0x55d6de9a50a0 2024-05-09T09:48:00.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.286+0000 7fe218e09640 1 -- 172.21.15.157:0/1456997792 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3140b7980 con 0x55d6de9a50a0 2024-05-09T09:48:00.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.286+0000 7fe32e933980 1 -- 172.21.15.157:0/1456997792 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6de9a3390 con 0x55d6de9a50a0 2024-05-09T09:48:00.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.290+0000 7fe218e09640 1 -- 172.21.15.157:0/1456997792 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fe3140b7bf0 con 0x55d6de9a50a0 2024-05-09T09:48:00.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.290+0000 7fe218e09640 1 --2- 172.21.15.157:0/1456997792 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe214034bb0 0x7fe214037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.290+0000 7fe218e09640 1 -- 172.21.15.157:0/1456997792 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fe3140e5840 con 0x55d6de9a50a0 2024-05-09T09:48:00.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.290+0000 7fe323fff640 1 --2- 172.21.15.157:0/1456997792 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe214034bb0 0x7fe214037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.290+0000 7fe32e933980 1 --2- 172.21.15.157:0/1456997792 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d6de9a59c0 0x55d6dea9f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.290+0000 7fe32e933980 1 -- 172.21.15.157:0/1456997792 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6dea9ff00 con 0x55d6de9a59c0 2024-05-09T09:48:00.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.290+0000 7fe32cc4f640 1 --2- 172.21.15.157:0/1456997792 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d6de9a59c0 0x55d6dea9f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.290+0000 7fe323fff640 1 --2- 172.21.15.157:0/1456997792 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe214034bb0 0x7fe214037070 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe31c001e20 tx=0x7fe31c0013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.290+0000 7fe32cc4f640 1 --2- 172.21.15.157:0/1456997792 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d6de9a59c0 0x55d6dea9f9c0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.290+0000 7fe32cc4f640 1 -- 172.21.15.157:0/1456997792 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6de9a59c0 2024-05-09T09:48:00.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.290+0000 7fe32e933980 1 -- 172.21.15.157:0/1456997792 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaa02a0 con 0x55d6de9a59c0 2024-05-09T09:48:00.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.290+0000 7fe32cc4f640 1 -- 172.21.15.157:0/1456997792 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6de9a59c0 2024-05-09T09:48:00.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.290+0000 7fe32e933980 1 --2- 172.21.15.157:0/1456997792 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d6deaa20b0 0x55d6deaa44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.290+0000 7fe32e933980 1 -- 172.21.15.157:0/1456997792 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaa4b90 con 0x55d6deaa20b0 2024-05-09T09:48:00.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.290+0000 7fe32c44e640 1 --2- 172.21.15.157:0/1456997792 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d6deaa20b0 0x55d6deaa44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.294+0000 7fe32c44e640 1 --2- 172.21.15.157:0/1456997792 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d6deaa20b0 0x55d6deaa44a0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.294+0000 7fe32c44e640 1 -- 172.21.15.157:0/1456997792 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe3140d0020 con 0x55d6deaa20b0 2024-05-09T09:48:00.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.294+0000 7fe32e933980 1 -- 172.21.15.157:0/1456997792 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaa0f50 con 0x55d6de9a59c0 2024-05-09T09:48:00.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.298+0000 7fe32cc4f640 1 -- 172.21.15.157:0/1456997792 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6de9a59c0 2024-05-09T09:48:00.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.298+0000 7fe32e933980 1 --2- 172.21.15.157:0/1456997792 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d6deaa5ff0 0x55d6deaa83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.298+0000 7fe32e933980 1 -- 172.21.15.157:0/1456997792 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaa8b20 con 0x55d6deaa5ff0 2024-05-09T09:48:00.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.298+0000 7fe323fff640 1 --2- 172.21.15.157:0/1456997792 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d6deaa5ff0 0x55d6deaa83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.298+0000 7fe323fff640 1 --2- 172.21.15.157:0/1456997792 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d6deaa5ff0 0x55d6deaa83e0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.298+0000 7fe323fff640 1 -- 172.21.15.157:0/1456997792 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe31c00d040 con 0x55d6deaa5ff0 2024-05-09T09:48:00.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.302+0000 7fe32e933980 1 Processor -- start 2024-05-09T09:48:00.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.302+0000 7fe32e933980 1 -- start start 2024-05-09T09:48:00.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.302+0000 7fe32e933980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6deacea10 0x55d6deacee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.302+0000 7fe32e933980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d6de8ab020 con 0x55d6deacea10 2024-05-09T09:48:00.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.302+0000 7fe32c44e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6deacea10 0x55d6deacee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.302+0000 7fe32c44e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6deacea10 0x55d6deacee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:34928/0 (socket says 172.21.15.157:34928) 2024-05-09T09:48:00.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.302+0000 7fe32c44e640 1 -- 172.21.15.157:0/3806145799 learned_addr learned my addr 172.21.15.157:0/3806145799 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:00.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.302+0000 7fe32c44e640 1 -- 172.21.15.157:0/3806145799 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6deacf370 con 0x55d6deacea10 2024-05-09T09:48:00.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.302+0000 7fe32c44e640 1 --2- 172.21.15.157:0/3806145799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6deacea10 0x55d6deacee30 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe3140b5b30 tx=0x7fe3140c1540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.302+0000 7fe210b9e640 1 -- 172.21.15.157:0/3806145799 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3140b6510 con 0x55d6deacea10 2024-05-09T09:48:00.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.302+0000 7fe210b9e640 1 -- 172.21.15.157:0/3806145799 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3140b1040 con 0x55d6deacea10 2024-05-09T09:48:00.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.302+0000 7fe32e933980 1 -- 172.21.15.157:0/3806145799 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d6deacfe00 con 0x55d6deacea10 2024-05-09T09:48:00.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.302+0000 7fe210b9e640 1 -- 172.21.15.157:0/3806145799 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3140b5cf0 con 0x55d6deacea10 2024-05-09T09:48:00.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.302+0000 7fe32e933980 1 -- 172.21.15.157:0/3806145799 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6deacfe00 con 0x55d6deacea10 2024-05-09T09:48:00.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.302+0000 7fe210b9e640 1 -- 172.21.15.157:0/3806145799 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fe3140e5b60 con 0x55d6deacea10 2024-05-09T09:48:00.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.302+0000 7fe210b9e640 1 --2- 172.21.15.157:0/3806145799 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe204034c00 0x7fe2040370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.302+0000 7fe210b9e640 1 -- 172.21.15.157:0/3806145799 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fe3140f3ac0 con 0x55d6deacea10 2024-05-09T09:48:00.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.302+0000 7fe323fff640 1 --2- 172.21.15.157:0/3806145799 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe204034c00 0x7fe2040370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.306+0000 7fe32e933980 1 Processor -- start 2024-05-09T09:48:00.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.306+0000 7fe32e933980 1 -- start start 2024-05-09T09:48:00.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.306+0000 7fe32e933980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6deadb7e0 0x55d6deadbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.306+0000 7fe32e933980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d6dea8fb10 con 0x55d6deadb7e0 2024-05-09T09:48:00.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.306+0000 7fe323fff640 1 --2- 172.21.15.157:0/3806145799 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe204034c00 0x7fe2040370c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55d6de9a3720 tx=0x7fe31c006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.306+0000 7fe32c44e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6deadb7e0 0x55d6deadbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.306+0000 7fe32c44e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6deadb7e0 0x55d6deadbc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:34942/0 (socket says 172.21.15.157:34942) 2024-05-09T09:48:00.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.306+0000 7fe32c44e640 1 -- 172.21.15.157:0/1700362197 learned_addr learned my addr 172.21.15.157:0/1700362197 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:00.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.306+0000 7fe32c44e640 1 -- 172.21.15.157:0/1700362197 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6deadc1d0 con 0x55d6deadb7e0 2024-05-09T09:48:00.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.306+0000 7fe32c44e640 1 --2- 172.21.15.157:0/1700362197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6deadb7e0 0x55d6deadbc00 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe3140c1710 tx=0x7fe3140db790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee73c9de2dd1315 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.306+0000 7fe20a7fc640 1 -- 172.21.15.157:0/1700362197 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe314101020 con 0x55d6deadb7e0 2024-05-09T09:48:00.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.306+0000 7fe20a7fc640 1 -- 172.21.15.157:0/1700362197 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3140b6c00 con 0x55d6deadb7e0 2024-05-09T09:48:00.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.306+0000 7fe20a7fc640 1 -- 172.21.15.157:0/1700362197 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3140f3e90 con 0x55d6deadb7e0 2024-05-09T09:48:00.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.306+0000 7fe32e933980 1 -- 172.21.15.157:0/1700362197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6deadb7e0 msgr2=0x55d6deadbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.306+0000 7fe32e933980 1 --2- 172.21.15.157:0/1700362197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6deadb7e0 0x55d6deadbc00 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe3140c1710 tx=0x7fe3140db790 comp rx=0 tx=0).stop 2024-05-09T09:48:00.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.306+0000 7fe32e933980 1 -- 172.21.15.157:0/1700362197 shutdown_connections 2024-05-09T09:48:00.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.306+0000 7fe32e933980 1 --2- 172.21.15.157:0/1700362197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6deadb7e0 0x55d6deadbc00 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.306+0000 7fe32e933980 1 -- 172.21.15.157:0/1700362197 >> 172.21.15.157:0/1700362197 conn(0x55d6dead7b60 msgr2=0x55d6dead5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:00.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.306+0000 7fe32e933980 1 -- 172.21.15.157:0/1700362197 shutdown_connections 2024-05-09T09:48:00.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.306+0000 7fe32e933980 1 -- 172.21.15.157:0/1700362197 wait complete. 2024-05-09T09:48:00.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.306+0000 7fe32e933980 1 Processor -- start 2024-05-09T09:48:00.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.306+0000 7fe32e933980 1 -- start start 2024-05-09T09:48:00.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.306+0000 7fe32e933980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6deadb7e0 0x55d6deae2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.306+0000 7fe32e933980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55d6deadc8a0 con 0x55d6deadb7e0 2024-05-09T09:48:00.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.306+0000 7fe32c44e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6deadb7e0 0x55d6deae2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.306+0000 7fe32c44e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6deadb7e0 0x55d6deae2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:34948/0 (socket says 172.21.15.157:34948) 2024-05-09T09:48:00.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.306+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 learned_addr learned my addr 172.21.15.157:0/956969387 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:00.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.306+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6deae3040 con 0x55d6deadb7e0 2024-05-09T09:48:00.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe32c44e640 1 --2- 172.21.15.157:0/956969387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6deadb7e0 0x55d6deae2b00 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe3140c1710 tx=0x7fe3140eaed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe208ff9640 1 -- 172.21.15.157:0/956969387 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe314115070 con 0x55d6deadb7e0 2024-05-09T09:48:00.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d6deae3040 con 0x55d6deadb7e0 2024-05-09T09:48:00.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6deae3040 con 0x55d6deadb7e0 2024-05-09T09:48:00.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe208ff9640 1 -- 172.21.15.157:0/956969387 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3140b6960 con 0x55d6deadb7e0 2024-05-09T09:48:00.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe208ff9640 1 -- 172.21.15.157:0/956969387 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3140e6d80 con 0x55d6deadb7e0 2024-05-09T09:48:00.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe32e933980 20 rados->read ofs=0 len=0 2024-05-09T09:48:00.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe208ff9640 1 -- 172.21.15.157:0/956969387 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fe314118070 con 0x55d6deadb7e0 2024-05-09T09:48:00.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe208ff9640 1 --2- 172.21.15.157:0/956969387 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe1f4034bb0 0x7fe1f4037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe208ff9640 1 -- 172.21.15.157:0/956969387 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fe31411bd60 con 0x55d6deadb7e0 2024-05-09T09:48:00.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe323fff640 1 --2- 172.21.15.157:0/956969387 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe1f4034bb0 0x7fe1f4037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe32e933980 1 --2- 172.21.15.157:0/956969387 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d6deaef4d0 0x55d6deaf1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf20c0 con 0x55d6deaef4d0 2024-05-09T09:48:00.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe32cc4f640 1 --2- 172.21.15.157:0/956969387 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d6deaef4d0 0x55d6deaf1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe323fff640 1 --2- 172.21.15.157:0/956969387 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe1f4034bb0 0x7fe1f4037070 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55d6deaa8f20 tx=0x7fe31c011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe32cc4f640 1 --2- 172.21.15.157:0/956969387 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d6deaef4d0 0x55d6deaf1970 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe32e933980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:00.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe32e933980 20 realm 2024-05-09T09:48:00.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe32e933980 20 rados->read ofs=0 len=0 2024-05-09T09:48:00.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf24d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe32e933980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:00.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe32e933980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:48:00.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe32e933980 20 rados->read ofs=0 len=0 2024-05-09T09:48:00.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf2d70 con 0x55d6deaef4d0 2024-05-09T09:48:00.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe32e933980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:00.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe32e933980 20 rados->read ofs=0 len=0 2024-05-09T09:48:00.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.310+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x55d6deaef4d0 2024-05-09T09:48:00.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.314+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.314+0000 7fe32e933980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:00.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.314+0000 7fe32e933980 20 rados->read ofs=0 len=0 2024-05-09T09:48:00.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.314+0000 7fe32e933980 1 --2- 172.21.15.157:0/956969387 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d6deaf3e70 0x55d6deaf6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.314+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf67e0 con 0x55d6deaf3e70 2024-05-09T09:48:00.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.314+0000 7fe32c44e640 1 --2- 172.21.15.157:0/956969387 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d6deaf3e70 0x55d6deaf6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.314+0000 7fe32c44e640 1 --2- 172.21.15.157:0/956969387 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d6deaf3e70 0x55d6deaf6260 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.314+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.314+0000 7fe32e933980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:48:00.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.314+0000 7fe32e933980 20 searching for the correct realm 2024-05-09T09:48:00.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.314+0000 7fe32e933980 1 --2- 172.21.15.157:0/956969387 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d6deaf8750 0x55d6deafac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.314+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deafb2e0 con 0x55d6deaf8750 2024-05-09T09:48:00.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.314+0000 7fe323fff640 1 --2- 172.21.15.157:0/956969387 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d6deaf8750 0x55d6deafac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.314+0000 7fe323fff640 1 --2- 172.21.15.157:0/956969387 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d6deaf8750 0x55d6deafac10 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.314+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe31c036040 con 0x55d6deaf8750 2024-05-09T09:48:00.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.314+0000 7fe323fff640 1 --2- 172.21.15.157:0/956969387 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fe31c00f3d0 0x7fe31c00f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.314+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deafb2e0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.314+0000 7fe32cc4f640 1 --2- 172.21.15.157:0/956969387 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fe31c00f3d0 0x7fe31c00f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.314+0000 7fe32cc4f640 1 --2- 172.21.15.157:0/956969387 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fe31c00f3d0 0x7fe31c00f810 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.314+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.314+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x55d6deaf3e70 2024-05-09T09:48:00.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.318+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.318+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x55d6deaef4d0 2024-05-09T09:48:00.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.318+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.318+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x55d6deaef4d0 2024-05-09T09:48:00.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.318+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.318+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x55d6deaf3e70 2024-05-09T09:48:00.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.318+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.318+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x55d6deaf3e70 2024-05-09T09:48:00.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.318+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.318+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x7fe31c00f3d0 2024-05-09T09:48:00.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.318+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.318+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x55d6deaf8750 2024-05-09T09:48:00.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.318+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe31c036040 con 0x55d6deaf8750 2024-05-09T09:48:00.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.318+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x55d6deaef4d0 2024-05-09T09:48:00.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.318+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.318+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x55d6deaf3e70 2024-05-09T09:48:00.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.322+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.322+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x55d6deaef4d0 2024-05-09T09:48:00.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.322+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.322+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x7fe31c00f3d0 2024-05-09T09:48:00.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.322+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.322+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x55d6deaf8750 2024-05-09T09:48:00.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.322+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe31c036040 con 0x55d6deaf8750 2024-05-09T09:48:00.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.322+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x55d6deaf8750 2024-05-09T09:48:00.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.322+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe31c036040 con 0x55d6deaf8750 2024-05-09T09:48:00.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.322+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x55d6deaf3e70 2024-05-09T09:48:00.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.322+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.322+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x55d6deaf8750 2024-05-09T09:48:00.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.322+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe31c036040 con 0x55d6deaf8750 2024-05-09T09:48:00.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.322+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x55d6deaf8750 2024-05-09T09:48:00.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.322+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe31c036040 con 0x55d6deaf8750 2024-05-09T09:48:00.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.322+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x55d6deaef4d0 2024-05-09T09:48:00.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.322+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.322+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x55d6deaef4d0 2024-05-09T09:48:00.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.322+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.322+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x55d6deaf3e70 2024-05-09T09:48:00.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.322+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.322+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x55d6deaf8750 2024-05-09T09:48:00.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.326+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe31c036040 con 0x55d6deaf8750 2024-05-09T09:48:00.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.326+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x7fe31c00f3d0 2024-05-09T09:48:00.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.326+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.326+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x55d6deaef4d0 2024-05-09T09:48:00.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.326+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.326+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x55d6deaf3e70 2024-05-09T09:48:00.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.326+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.326+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x55d6deaf8750 2024-05-09T09:48:00.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.326+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe31c036040 con 0x55d6deaf8750 2024-05-09T09:48:00.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.326+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x55d6deaf3e70 2024-05-09T09:48:00.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.326+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.326+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x7fe31c00f3d0 2024-05-09T09:48:00.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.326+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.326+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x55d6deaf8750 2024-05-09T09:48:00.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.326+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.326+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x55d6deaf3e70 2024-05-09T09:48:00.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.326+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.326+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x55d6deaef4d0 2024-05-09T09:48:00.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf3110 con 0x7fe31c00f3d0 2024-05-09T09:48:00.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:48:00.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:48:00.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:48:00.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:48:00.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:48:00.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:48:00.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 20 rados->read ofs=0 len=0 2024-05-09T09:48:00.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf7030 con 0x55d6deaef4d0 2024-05-09T09:48:00.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:00.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 20 rados->read ofs=0 len=0 2024-05-09T09:48:00.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf7030 con 0x55d6deaef4d0 2024-05-09T09:48:00.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:00.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 20 rados->read ofs=0 len=0 2024-05-09T09:48:00.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf7030 con 0x55d6deaf8750 2024-05-09T09:48:00.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:48:00.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 20 zone default found 2024-05-09T09:48:00.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 4 Realm: () 2024-05-09T09:48:00.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:48:00.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:48:00.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:48:00.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 20 zonegroup default 2024-05-09T09:48:00.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 20 rados->read ofs=0 len=0 2024-05-09T09:48:00.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaf78d0 con 0x55d6deaf3e70 2024-05-09T09:48:00.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:00.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 20 rados->read ofs=0 len=0 2024-05-09T09:48:00.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deafd140 con 0x55d6deaf8750 2024-05-09T09:48:00.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:00.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 20 rados->read ofs=0 len=0 2024-05-09T09:48:00.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deafd4e0 con 0x55d6deaf8750 2024-05-09T09:48:00.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:00.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 20 started sync module instance, tier type = 2024-05-09T09:48:00.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:48:00.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.330+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deafc5e0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.334+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.334+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94381347425024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deafc5e0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.334+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deafdf90 con 0x55d6deaef4d0 2024-05-09T09:48:00.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.334+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94381347425024] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.334+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.334+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94381347428976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deafc5e0 con 0x55d6deaef4d0 2024-05-09T09:48:00.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.334+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deafe9a0 con 0x55d6deaf8750 2024-05-09T09:48:00.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.338+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94381347428976] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.338+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.338+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94381347422512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deafc550 con 0x55d6deaf8750 2024-05-09T09:48:00.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.338+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaff700 con 0x7fe31c00f3d0 2024-05-09T09:48:00.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.338+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.338+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94381347434992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deaff6c0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.338+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb005c0 con 0x55d6deaef4d0 2024-05-09T09:48:00.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.338+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94381347422512] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.338+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94381347434992] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.338+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.338+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94381347433792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb00110 con 0x55d6deaef4d0 2024-05-09T09:48:00.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.338+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb00960 con 0x55d6deaf3e70 2024-05-09T09:48:00.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.342+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94381347433792] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.342+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.342+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94381347438864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb00530 con 0x55d6deaf3e70 2024-05-09T09:48:00.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.342+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb016b0 con 0x55d6deaf3e70 2024-05-09T09:48:00.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.346+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94381347438864] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.346+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.346+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94381347442480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb01f00 con 0x55d6deaf3e70 2024-05-09T09:48:00.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.346+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb027d0 con 0x55d6deaf3e70 2024-05-09T09:48:00.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.346+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94381347442480] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.346+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.346+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94381347447456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb02a50 con 0x55d6deaf3e70 2024-05-09T09:48:00.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.346+0000 7fe32e933980 20 add_watcher() i=0 2024-05-09T09:48:00.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.346+0000 7fe32e933980 20 add_watcher() i=1 2024-05-09T09:48:00.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.346+0000 7fe32e933980 20 add_watcher() i=2 2024-05-09T09:48:00.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.346+0000 7fe32e933980 20 add_watcher() i=3 2024-05-09T09:48:00.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.346+0000 7fe32e933980 20 add_watcher() i=4 2024-05-09T09:48:00.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.346+0000 7fe32e933980 20 add_watcher() i=5 2024-05-09T09:48:00.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.346+0000 7fe32e933980 20 add_watcher() i=6 2024-05-09T09:48:00.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.350+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94381347447456] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.350+0000 7fe32e933980 20 add_watcher() i=7 2024-05-09T09:48:00.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.350+0000 7fe32e933980 2 all 8 watchers are set, enabling cache 2024-05-09T09:48:00.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.350+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb05fc0 con 0x55d6deaef4d0 2024-05-09T09:48:00.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.350+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.350+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94381347445328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb034b0 con 0x55d6deaef4d0 2024-05-09T09:48:00.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.350+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94381347445328] v32'300 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.350+0000 7fe1e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:00.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.350+0000 7fe32e933980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:48:00.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.350+0000 7fe32e933980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:48:00.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.350+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0e5f0 con 0x55d6deaef4d0 2024-05-09T09:48:00.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.354+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'72 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.354+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0eb60 con 0x55d6deaf3e70 2024-05-09T09:48:00.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.354+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'67 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.354+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0eb60 con 0x55d6deaf8750 2024-05-09T09:48:00.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.354+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'66 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.354+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0f110 con 0x55d6deaef4d0 2024-05-09T09:48:00.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.358+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'301 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.358+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0f5c0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.358+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'188 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.358+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0c690 con 0x55d6deaf8750 2024-05-09T09:48:00.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.358+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'126 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.358+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0c660 con 0x55d6deaef4d0 2024-05-09T09:48:00.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.362+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'68 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.362+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb10120 con 0x55d6deaf3e70 2024-05-09T09:48:00.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.362+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'125 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.362+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb10120 con 0x7fe31c00f3d0 2024-05-09T09:48:00.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.366+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'66 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.366+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb10120 con 0x55d6deaf8750 2024-05-09T09:48:00.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.366+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'72 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.366+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb106d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.366+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'189 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.366+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb106d0 con 0x55d6deaf3e70 2024-05-09T09:48:00.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.370+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'69 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.370+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb106d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.370+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'66 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.370+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb106d0 con 0x55d6deaf3e70 2024-05-09T09:48:00.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.374+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'131 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.374+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb106d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.374+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'302 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.374+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb106d0 con 0x55d6deaf8750 2024-05-09T09:48:00.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.378+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'182 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.378+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb109b0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.378+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'190 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.378+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb109b0 con 0x55d6deaf8750 2024-05-09T09:48:00.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.378+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'66 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.378+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb109b0 con 0x55d6deaef4d0 2024-05-09T09:48:00.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.382+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'74 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.382+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb109b0 con 0x55d6deaef4d0 2024-05-09T09:48:00.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.382+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'303 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.382+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb109b0 con 0x55d6deaf8750 2024-05-09T09:48:00.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.382+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'183 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.382+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb109b0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.386+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'78 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.386+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb109b0 con 0x55d6deaf8750 2024-05-09T09:48:00.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.386+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'68 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.386+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb109b0 con 0x55d6deaf8750 2024-05-09T09:48:00.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.386+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'72 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.386+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb109b0 con 0x55d6deaf8750 2024-05-09T09:48:00.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.390+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'62 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.390+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb109b0 con 0x55d6deaf8750 2024-05-09T09:48:00.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.390+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'127 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.390+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb109b0 con 0x55d6deaf3e70 2024-05-09T09:48:00.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.390+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'68 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.390+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb109b0 con 0x55d6deaf8750 2024-05-09T09:48:00.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.394+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'66 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.394+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb109b0 con 0x55d6deaf3e70 2024-05-09T09:48:00.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.394+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'126 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.394+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb109b0 con 0x55d6deaf8750 2024-05-09T09:48:00.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.398+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'184 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.398+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb109b0 con 0x55d6deaf3e70 2024-05-09T09:48:00.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.398+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'132 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.398+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb109b0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.402+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'72 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.402+0000 7fe15bfff640 20 reqs_thread_entry: start 2024-05-09T09:48:00.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.402+0000 7fe32e933980 20 init_complete bucket index max shards: 11 2024-05-09T09:48:00.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.402+0000 7fe159ffb640 20 reqs_thread_entry: start 2024-05-09T09:48:00.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.402+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaef4d0 2024-05-09T09:48:00.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.402+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv71 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.402+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaef4d0 2024-05-09T09:48:00.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.402+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv71 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.402+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaef4d0 2024-05-09T09:48:00.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.402+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv71 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.402+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf3e70 2024-05-09T09:48:00.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.402+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv66 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.402+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf3e70 2024-05-09T09:48:00.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.406+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv66 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.406+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf3e70 2024-05-09T09:48:00.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.406+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv66 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.406+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.406+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.406+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.406+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv65 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.406+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.406+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.406+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaef4d0 2024-05-09T09:48:00.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.406+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv296 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.406+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaef4d0 2024-05-09T09:48:00.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.406+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv296 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.406+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaef4d0 2024-05-09T09:48:00.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.406+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv296 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.406+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.410+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv185 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.410+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.410+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv185 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.410+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.410+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv185 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.410+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.410+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 30 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv125 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.410+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.410+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 31 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv125 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.410+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.410+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 32 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv125 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.410+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaef4d0 2024-05-09T09:48:00.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.410+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv67 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.410+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaef4d0 2024-05-09T09:48:00.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.410+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv67 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.410+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaef4d0 2024-05-09T09:48:00.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.410+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv67 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.410+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf3e70 2024-05-09T09:48:00.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.410+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv124 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.410+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf3e70 2024-05-09T09:48:00.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.414+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv124 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.414+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf3e70 2024-05-09T09:48:00.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.414+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv124 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.414+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.414+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.414+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.414+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv65 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.414+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.414+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 23 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.414+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.414+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 33 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv71 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.414+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.414+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 34 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv71 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.414+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.414+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 35 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv71 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.414+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.414+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 24 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv187 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.414+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.418+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 25 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv187 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.418+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.418+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 26 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv187 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.418+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf3e70 2024-05-09T09:48:00.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.418+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv68 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.418+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf3e70 2024-05-09T09:48:00.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.418+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 32 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv68 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.418+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf3e70 2024-05-09T09:48:00.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.418+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 33 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv68 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.418+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.418+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 27 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv65 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.418+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.418+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 28 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv65 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.418+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.418+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 29 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv65 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.418+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf3e70 2024-05-09T09:48:00.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.422+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 34 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv130 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.422+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf3e70 2024-05-09T09:48:00.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.422+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 35 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv130 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.422+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf3e70 2024-05-09T09:48:00.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.422+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 36 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv130 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.422+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaef4d0 2024-05-09T09:48:00.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.422+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv298 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.422+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaef4d0 2024-05-09T09:48:00.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.422+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv298 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.422+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaef4d0 2024-05-09T09:48:00.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.422+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv298 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.422+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.422+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv181 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.422+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.422+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 37 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv181 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.422+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.426+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 38 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv181 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.426+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.426+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 30 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv183 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.426+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.426+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 31 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv183 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.426+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.426+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 32 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv183 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.426+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.426+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 39 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv65 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.426+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.426+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 40 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv65 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.426+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.426+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 41 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv65 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.426+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaef4d0 2024-05-09T09:48:00.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.426+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv73 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.426+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaef4d0 2024-05-09T09:48:00.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.426+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv73 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.426+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaef4d0 2024-05-09T09:48:00.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.426+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv73 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.426+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaef4d0 2024-05-09T09:48:00.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.426+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv294 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.426+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaef4d0 2024-05-09T09:48:00.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.430+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv294 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.430+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaef4d0 2024-05-09T09:48:00.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.430+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv294 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.430+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.430+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 42 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv177 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.430+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.430+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 43 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv177 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.430+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.430+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 44 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv177 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.430+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.430+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 33 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv77 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.430+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.430+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 34 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv77 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.430+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.430+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 35 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv77 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.430+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.430+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 45 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv67 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.430+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.430+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 46 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv67 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.430+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.430+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 47 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv67 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.430+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.434+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 48 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv71 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.434+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.434+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 49 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv71 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.434+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.434+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 50 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv71 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.434+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.434+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 51 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv61 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.434+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.434+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 52 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv61 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.434+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.434+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 53 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv61 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.434+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.434+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 54 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv123 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.434+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.434+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 55 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv123 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.434+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.434+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 56 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv123 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.434+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf3e70 2024-05-09T09:48:00.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.434+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 37 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv67 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.434+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf3e70 2024-05-09T09:48:00.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.438+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 38 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv67 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.438+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf3e70 2024-05-09T09:48:00.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.438+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 39 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv67 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.438+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.438+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 57 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv65 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.438+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.438+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 58 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv65 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.438+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.438+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 59 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv65 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.438+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf3e70 2024-05-09T09:48:00.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.438+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 40 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv122 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.438+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf3e70 2024-05-09T09:48:00.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.442+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 41 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv122 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.442+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf3e70 2024-05-09T09:48:00.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.442+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 42 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv122 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.442+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.442+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 60 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv179 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.442+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.442+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 61 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv179 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.442+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.442+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 62 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv179 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.442+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf3e70 2024-05-09T09:48:00.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.442+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 43 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv128 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.442+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf3e70 2024-05-09T09:48:00.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.442+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 44 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv128 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.442+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf3e70 2024-05-09T09:48:00.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.446+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 45 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv128 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.446+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.446+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 36 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv71 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.446+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.446+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 37 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv71 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.446+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.446+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 38 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv71 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.446+0000 7fe1e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:00.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.446+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94381347445328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaef4d0 2024-05-09T09:48:00.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.450+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94381347445328] v32'304 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.450+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94381347425024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.450+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 39 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94381347425024] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.450+0000 7fe32e933980 20 remove_watcher() i=0 2024-05-09T09:48:00.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.450+0000 7fe32e933980 2 removed watcher, disabling cache 2024-05-09T09:48:00.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.450+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94381347428976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaef4d0 2024-05-09T09:48:00.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.450+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94381347428976] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.450+0000 7fe32e933980 20 remove_watcher() i=1 2024-05-09T09:48:00.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.450+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94381347422512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf8750 2024-05-09T09:48:00.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.454+0000 7fe323fff640 1 -- 172.21.15.157:0/956969387 <== osd.3 v2:172.21.15.157:6816/2487336710 63 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94381347422512] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe31c049040 con 0x55d6deaf8750 2024-05-09T09:48:00.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.454+0000 7fe32e933980 20 remove_watcher() i=2 2024-05-09T09:48:00.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.454+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94381347434992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.454+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.2 v2:172.21.15.157:6800/354455204 40 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94381347434992] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x7fe31c00f3d0 2024-05-09T09:48:00.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.454+0000 7fe32e933980 20 remove_watcher() i=3 2024-05-09T09:48:00.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.454+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94381347433792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaef4d0 2024-05-09T09:48:00.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.458+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 <== osd.1 v2:172.21.15.157:6808/3930131338 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94381347433792] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe32400a4d0 con 0x55d6deaef4d0 2024-05-09T09:48:00.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.458+0000 7fe32e933980 20 remove_watcher() i=4 2024-05-09T09:48:00.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.458+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94381347438864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf3e70 2024-05-09T09:48:00.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.458+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 46 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94381347438864] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.458+0000 7fe32e933980 20 remove_watcher() i=5 2024-05-09T09:48:00.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.458+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94381347442480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf3e70 2024-05-09T09:48:00.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.462+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 47 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94381347442480] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.462+0000 7fe32e933980 20 remove_watcher() i=6 2024-05-09T09:48:00.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.462+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94381347447456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d6deb0bbb0 con 0x55d6deaf3e70 2024-05-09T09:48:00.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.462+0000 7fe32c44e640 1 -- 172.21.15.157:0/956969387 <== osd.0 v2:172.21.15.110:6800/231209037 48 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94381347447456] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe314117030 con 0x55d6deaf3e70 2024-05-09T09:48:00.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.462+0000 7fe32e933980 20 remove_watcher() i=7 2024-05-09T09:48:00.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.462+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d6deaf3e70 msgr2=0x55d6deaf6260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.462+0000 7fe32e933980 1 --2- 172.21.15.157:0/956969387 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d6deaf3e70 0x55d6deaf6260 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.462+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d6deaef4d0 msgr2=0x55d6deaf1970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.462+0000 7fe32e933980 1 --2- 172.21.15.157:0/956969387 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d6deaef4d0 0x55d6deaf1970 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.462+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fe31c00f3d0 msgr2=0x7fe31c00f810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.462+0000 7fe32e933980 1 --2- 172.21.15.157:0/956969387 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fe31c00f3d0 0x7fe31c00f810 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.462+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d6deaf8750 msgr2=0x55d6deafac10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.462+0000 7fe32e933980 1 --2- 172.21.15.157:0/956969387 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d6deaf8750 0x55d6deafac10 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.462+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe1f4034bb0 msgr2=0x7fe1f4037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.462+0000 7fe32e933980 1 --2- 172.21.15.157:0/956969387 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe1f4034bb0 0x7fe1f4037070 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55d6deaa8f20 tx=0x7fe31c011000 comp rx=0 tx=0).stop 2024-05-09T09:48:00.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.462+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6deadb7e0 msgr2=0x55d6deae2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32e933980 1 --2- 172.21.15.157:0/956969387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6deadb7e0 0x55d6deae2b00 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe3140c1710 tx=0x7fe3140eaed0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 reap_dead start 2024-05-09T09:48:00.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32cc4f640 1 -- 172.21.15.157:0/956969387 reap_dead start 2024-05-09T09:48:00.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 shutdown_connections 2024-05-09T09:48:00.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 >> 172.21.15.157:0/956969387 conn(0x55d6dead7b60 msgr2=0x55d6dead5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:00.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 shutdown_connections 2024-05-09T09:48:00.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32e933980 1 -- 172.21.15.157:0/956969387 wait complete. 2024-05-09T09:48:00.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32e933980 1 -- 172.21.15.157:0/3806145799 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe204034c00 msgr2=0x7fe2040370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32e933980 1 --2- 172.21.15.157:0/3806145799 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe204034c00 0x7fe2040370c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55d6de9a3720 tx=0x7fe31c006000 comp rx=0 tx=0).stop 2024-05-09T09:48:00.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32e933980 1 -- 172.21.15.157:0/3806145799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6deacea10 msgr2=0x55d6deacee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32e933980 1 --2- 172.21.15.157:0/3806145799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6deacea10 0x55d6deacee30 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe3140b5b30 tx=0x7fe3140c1540 comp rx=0 tx=0).stop 2024-05-09T09:48:00.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32e933980 1 -- 172.21.15.157:0/3806145799 shutdown_connections 2024-05-09T09:48:00.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32e933980 1 --2- 172.21.15.157:0/3806145799 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe204034c00 0x7fe2040370c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32e933980 1 --2- 172.21.15.157:0/3806145799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6deacea10 0x55d6deacee30 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32e933980 1 -- 172.21.15.157:0/3806145799 >> 172.21.15.157:0/3806145799 conn(0x55d6deac37e0 msgr2=0x55d6deac42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:00.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32e933980 1 -- 172.21.15.157:0/3806145799 shutdown_connections 2024-05-09T09:48:00.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32e933980 1 -- 172.21.15.157:0/3806145799 wait complete. 2024-05-09T09:48:00.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32e933980 1 -- 172.21.15.157:0/1456997792 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d6deaa20b0 msgr2=0x55d6deaa44a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32e933980 1 --2- 172.21.15.157:0/1456997792 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55d6deaa20b0 0x55d6deaa44a0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32e933980 1 -- 172.21.15.157:0/1456997792 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d6de9a59c0 msgr2=0x55d6dea9f9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32e933980 1 --2- 172.21.15.157:0/1456997792 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55d6de9a59c0 0x55d6dea9f9c0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32e933980 1 -- 172.21.15.157:0/1456997792 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d6deaa5ff0 msgr2=0x55d6deaa83e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32e933980 1 --2- 172.21.15.157:0/1456997792 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55d6deaa5ff0 0x55d6deaa83e0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32e933980 1 -- 172.21.15.157:0/1456997792 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe214034bb0 msgr2=0x7fe214037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32e933980 1 --2- 172.21.15.157:0/1456997792 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe214034bb0 0x7fe214037070 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe31c001e20 tx=0x7fe31c0013a0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32e933980 1 -- 172.21.15.157:0/1456997792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6de9a50a0 msgr2=0x55d6de9a46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32e933980 1 --2- 172.21.15.157:0/1456997792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d6de9a50a0 0x55d6de9a46d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe3140b9040 tx=0x7fe3140180e0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32cc4f640 1 -- 172.21.15.157:0/1456997792 reap_dead start 2024-05-09T09:48:00.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32e933980 1 -- 172.21.15.157:0/1456997792 shutdown_connections 2024-05-09T09:48:00.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32e933980 1 -- 172.21.15.157:0/1456997792 >> 172.21.15.157:0/1456997792 conn(0x55d6de99d850 msgr2=0x55d6dea89ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:00.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32e933980 1 -- 172.21.15.157:0/1456997792 shutdown_connections 2024-05-09T09:48:00.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.466+0000 7fe32e933980 1 -- 172.21.15.157:0/1456997792 wait complete. 2024-05-09T09:48:00.480 INFO:teuthology.orchestra.run.smithi157.stdout:[] 2024-05-09T09:48:00.480 DEBUG:tasks.util.rgw: json result: [] 2024-05-09T09:48:00.480 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-05-09T09:48:00.481 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-05-09T09:48:00.481 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-05-09T09:48:00.561 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:48:00.561 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:48:00.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.562+0000 7fb38d476980 1 Processor -- start 2024-05-09T09:48:00.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.562+0000 7fb38d476980 1 -- start start 2024-05-09T09:48:00.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.562+0000 7fb38d476980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55beeb6cfb30 0x55beeb6cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.562+0000 7fb38d476980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55beeb583440 con 0x55beeb6d0450 2024-05-09T09:48:00.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.562+0000 7fb38d476980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55beeb56e5f0 con 0x55beeb6cfb30 2024-05-09T09:48:00.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.562+0000 7fb38af91640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55beeb6cfb30 0x55beeb6cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.562+0000 7fb38af91640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55beeb6cfb30 0x55beeb6cff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:34962/0 (socket says 172.21.15.157:34962) 2024-05-09T09:48:00.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.562+0000 7fb38af91640 1 -- 172.21.15.157:0/1755192383 learned_addr learned my addr 172.21.15.157:0/1755192383 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:00.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.562+0000 7fb38a790640 1 --1- 172.21.15.157:0/1755192383 >> v1:172.21.15.110:6789/0 conn(0x55beeb6d0450 0x55beeb6d0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:56170/0 (socket says 172.21.15.157:56170) 2024-05-09T09:48:00.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.562+0000 7fb38af91640 1 -- 172.21.15.157:0/1755192383 >> v1:172.21.15.110:6789/0 conn(0x55beeb6d0450 legacy=0x55beeb6d0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.562+0000 7fb38af91640 1 -- 172.21.15.157:0/1755192383 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55beeb579990 con 0x55beeb6cfb30 2024-05-09T09:48:00.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.566+0000 7fb38af91640 1 --2- 172.21.15.157:0/1755192383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb6cfb30 0x55beeb6cff10 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb37c00a5c0 tx=0x7fb37c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd70101a1aa506ab server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.566+0000 7fb389f8f640 1 -- 172.21.15.157:0/1755192383 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb37c0a6070 con 0x55beeb6cfb30 2024-05-09T09:48:00.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.566+0000 7fb389f8f640 1 -- 172.21.15.157:0/1755192383 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb37c0af070 con 0x55beeb6cfb30 2024-05-09T09:48:00.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.566+0000 7fb389f8f640 1 -- 172.21.15.157:0/1755192383 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb37c0aa5c0 con 0x55beeb6cfb30 2024-05-09T09:48:00.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.566+0000 7fb38d476980 1 -- 172.21.15.157:0/1755192383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb6cfb30 msgr2=0x55beeb6cff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.566+0000 7fb38d476980 1 --2- 172.21.15.157:0/1755192383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb6cfb30 0x55beeb6cff10 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb37c00a5c0 tx=0x7fb37c01b340 comp rx=0 tx=0).stop 2024-05-09T09:48:00.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.566+0000 7fb38d476980 1 -- 172.21.15.157:0/1755192383 shutdown_connections 2024-05-09T09:48:00.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.566+0000 7fb38d476980 1 --2- 172.21.15.157:0/1755192383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb6cfb30 0x55beeb6cff10 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.566+0000 7fb38d476980 1 -- 172.21.15.157:0/1755192383 >> 172.21.15.157:0/1755192383 conn(0x55beeb643250 msgr2=0x55beeb643660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:00.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.566+0000 7fb38d476980 1 -- 172.21.15.157:0/1755192383 shutdown_connections 2024-05-09T09:48:00.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.566+0000 7fb38d476980 1 -- 172.21.15.157:0/1755192383 wait complete. 2024-05-09T09:48:00.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.582+0000 7fb38d476980 1 Processor -- start 2024-05-09T09:48:00.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.582+0000 7fb38d476980 1 -- start start 2024-05-09T09:48:00.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.582+0000 7fb38d476980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb6cfb30 0x55beeb7bb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.582+0000 7fb38d476980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55beeb5d0fe0 con 0x55beeb6cfb30 2024-05-09T09:48:00.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.582+0000 7fb38af91640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb6cfb30 0x55beeb7bb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.582+0000 7fb38af91640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb6cfb30 0x55beeb7bb450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:34964/0 (socket says 172.21.15.157:34964) 2024-05-09T09:48:00.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.582+0000 7fb38af91640 1 -- 172.21.15.157:0/3778120848 learned_addr learned my addr 172.21.15.157:0/3778120848 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:00.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.586+0000 7fb38af91640 1 -- 172.21.15.157:0/3778120848 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55beeb555ae0 con 0x55beeb6cfb30 2024-05-09T09:48:00.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.590+0000 7fb38af91640 1 --2- 172.21.15.157:0/3778120848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb6cfb30 0x55beeb7bb450 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0ac040 tx=0x7fb37c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3828264947336aa6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.590+0000 7fb278e09640 1 -- 172.21.15.157:0/3778120848 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb37c0aa970 con 0x55beeb6cfb30 2024-05-09T09:48:00.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.590+0000 7fb278e09640 1 -- 172.21.15.157:0/3778120848 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb37c0aab10 con 0x55beeb6cfb30 2024-05-09T09:48:00.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.590+0000 7fb278e09640 1 -- 172.21.15.157:0/3778120848 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb37c0aae30 con 0x55beeb6cfb30 2024-05-09T09:48:00.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.590+0000 7fb38d476980 1 -- 172.21.15.157:0/3778120848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb6cfb30 msgr2=0x55beeb7bb450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.590+0000 7fb38d476980 1 --2- 172.21.15.157:0/3778120848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb6cfb30 0x55beeb7bb450 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0ac040 tx=0x7fb37c003030 comp rx=0 tx=0).stop 2024-05-09T09:48:00.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.590+0000 7fb38d476980 1 -- 172.21.15.157:0/3778120848 shutdown_connections 2024-05-09T09:48:00.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.590+0000 7fb38d476980 1 --2- 172.21.15.157:0/3778120848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb6cfb30 0x55beeb7bb450 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.590+0000 7fb38d476980 1 -- 172.21.15.157:0/3778120848 >> 172.21.15.157:0/3778120848 conn(0x55beeb643250 msgr2=0x55beeb7b6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:00.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.590+0000 7fb38d476980 1 -- 172.21.15.157:0/3778120848 shutdown_connections 2024-05-09T09:48:00.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.590+0000 7fb38d476980 1 -- 172.21.15.157:0/3778120848 wait complete. 2024-05-09T09:48:00.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.590+0000 7fb38d476980 1 Processor -- start 2024-05-09T09:48:00.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.590+0000 7fb38d476980 1 -- start start 2024-05-09T09:48:00.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.590+0000 7fb38d476980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb6cfb30 0x55beeb7c2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.590+0000 7fb38d476980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55beeb6d9b70 con 0x55beeb6cfb30 2024-05-09T09:48:00.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.590+0000 7fb38af91640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb6cfb30 0x55beeb7c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.590+0000 7fb38af91640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb6cfb30 0x55beeb7c2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:34978/0 (socket says 172.21.15.157:34978) 2024-05-09T09:48:00.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.590+0000 7fb38af91640 1 -- 172.21.15.157:0/3484057863 learned_addr learned my addr 172.21.15.157:0/3484057863 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:00.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.590+0000 7fb38af91640 1 -- 172.21.15.157:0/3484057863 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55beeb7c2a40 con 0x55beeb6cfb30 2024-05-09T09:48:00.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.594+0000 7fb38af91640 1 --2- 172.21.15.157:0/3484057863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb6cfb30 0x55beeb7c2500 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb37c003070 tx=0x7fb37c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.594+0000 7fb277606640 1 -- 172.21.15.157:0/3484057863 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb37c0c6750 con 0x55beeb6cfb30 2024-05-09T09:48:00.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.594+0000 7fb277606640 1 -- 172.21.15.157:0/3484057863 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb37c0cc070 con 0x55beeb6cfb30 2024-05-09T09:48:00.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.594+0000 7fb38d476980 1 -- 172.21.15.157:0/3484057863 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55beeb7c2cd0 con 0x55beeb6cfb30 2024-05-09T09:48:00.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.594+0000 7fb277606640 1 -- 172.21.15.157:0/3484057863 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb37c0c6a20 con 0x55beeb6cfb30 2024-05-09T09:48:00.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.594+0000 7fb38d476980 1 -- 172.21.15.157:0/3484057863 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55beeb7c5960 con 0x55beeb6cfb30 2024-05-09T09:48:00.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.594+0000 7fb277606640 1 -- 172.21.15.157:0/3484057863 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fb37c0c6c90 con 0x55beeb6cfb30 2024-05-09T09:48:00.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.594+0000 7fb277606640 1 --2- 172.21.15.157:0/3484057863 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb270034c00 0x7fb2700370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.594+0000 7fb277606640 1 -- 172.21.15.157:0/3484057863 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fb37c0e5c50 con 0x55beeb6cfb30 2024-05-09T09:48:00.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.594+0000 7fb38a790640 1 --2- 172.21.15.157:0/3484057863 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb270034c00 0x7fb2700370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.594+0000 7fb38d476980 1 --2- 172.21.15.157:0/3484057863 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55beeb6d0450 0x55beeb7c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.594+0000 7fb38d476980 1 -- 172.21.15.157:0/3484057863 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beeb7c9a90 con 0x55beeb6d0450 2024-05-09T09:48:00.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.594+0000 7fb38b792640 1 --2- 172.21.15.157:0/3484057863 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55beeb6d0450 0x55beeb7c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.594+0000 7fb38a790640 1 --2- 172.21.15.157:0/3484057863 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb270034c00 0x7fb2700370c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb380001e50 tx=0x7fb3800013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.594+0000 7fb38b792640 1 --2- 172.21.15.157:0/3484057863 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55beeb6d0450 0x55beeb7c9440 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.594+0000 7fb38b792640 1 -- 172.21.15.157:0/3484057863 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb6d0450 2024-05-09T09:48:00.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.594+0000 7fb38d476980 1 -- 172.21.15.157:0/3484057863 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beeb7ca370 con 0x55beeb6d0450 2024-05-09T09:48:00.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.594+0000 7fb38b792640 1 -- 172.21.15.157:0/3484057863 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb6d0450 2024-05-09T09:48:00.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.594+0000 7fb38d476980 1 --2- 172.21.15.157:0/3484057863 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55beeb7cbc80 0x55beeb7ce140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.594+0000 7fb38d476980 1 -- 172.21.15.157:0/3484057863 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beeb7ce8d0 con 0x55beeb7cbc80 2024-05-09T09:48:00.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.598+0000 7fb38af91640 1 --2- 172.21.15.157:0/3484057863 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55beeb7cbc80 0x55beeb7ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.598+0000 7fb38af91640 1 --2- 172.21.15.157:0/3484057863 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55beeb7cbc80 0x55beeb7ce140 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.598+0000 7fb38af91640 1 -- 172.21.15.157:0/3484057863 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb37c0b33f0 con 0x55beeb7cbc80 2024-05-09T09:48:00.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.598+0000 7fb38d476980 1 -- 172.21.15.157:0/3484057863 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beeb7cabc0 con 0x55beeb6d0450 2024-05-09T09:48:00.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.598+0000 7fb38b792640 1 -- 172.21.15.157:0/3484057863 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb6d0450 2024-05-09T09:48:00.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.598+0000 7fb38d476980 1 --2- 172.21.15.157:0/3484057863 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55beeb7cfd30 0x55beeb7d2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.598+0000 7fb38d476980 1 -- 172.21.15.157:0/3484057863 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beeb7d2810 con 0x55beeb7cfd30 2024-05-09T09:48:00.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.598+0000 7fb38a790640 1 --2- 172.21.15.157:0/3484057863 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55beeb7cfd30 0x55beeb7d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.598+0000 7fb38a790640 1 --2- 172.21.15.157:0/3484057863 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55beeb7cfd30 0x55beeb7d2120 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.598+0000 7fb38a790640 1 -- 172.21.15.157:0/3484057863 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb38000f700 con 0x55beeb7cfd30 2024-05-09T09:48:00.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.602+0000 7fb38d476980 1 Processor -- start 2024-05-09T09:48:00.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.602+0000 7fb38d476980 1 -- start start 2024-05-09T09:48:00.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.602+0000 7fb38d476980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb7f8700 0x55beeb7f8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.602+0000 7fb38d476980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55beeb5d5020 con 0x55beeb7f8700 2024-05-09T09:48:00.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.602+0000 7fb38af91640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb7f8700 0x55beeb7f8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.602+0000 7fb38af91640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb7f8700 0x55beeb7f8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:34980/0 (socket says 172.21.15.157:34980) 2024-05-09T09:48:00.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.602+0000 7fb38af91640 1 -- 172.21.15.157:0/3975932774 learned_addr learned my addr 172.21.15.157:0/3975932774 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:00.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.602+0000 7fb38af91640 1 -- 172.21.15.157:0/3975932774 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55beeb7f9060 con 0x55beeb7f8700 2024-05-09T09:48:00.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.602+0000 7fb38af91640 1 --2- 172.21.15.157:0/3975932774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb7f8700 0x55beeb7f8b20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0a5fd0 tx=0x7fb37c0c5f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.606+0000 7fb26f7fe640 1 -- 172.21.15.157:0/3975932774 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb37c0c55f0 con 0x55beeb7f8700 2024-05-09T09:48:00.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.606+0000 7fb38d476980 1 -- 172.21.15.157:0/3975932774 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55beeb7f9af0 con 0x55beeb7f8700 2024-05-09T09:48:00.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.606+0000 7fb26f7fe640 1 -- 172.21.15.157:0/3975932774 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb37c0c5790 con 0x55beeb7f8700 2024-05-09T09:48:00.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.606+0000 7fb26f7fe640 1 -- 172.21.15.157:0/3975932774 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb37c0b3850 con 0x55beeb7f8700 2024-05-09T09:48:00.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.606+0000 7fb38d476980 1 -- 172.21.15.157:0/3975932774 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55beeb7f9fd0 con 0x55beeb7f8700 2024-05-09T09:48:00.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.606+0000 7fb26f7fe640 1 -- 172.21.15.157:0/3975932774 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fb37c0b39f0 con 0x55beeb7f8700 2024-05-09T09:48:00.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.606+0000 7fb26f7fe640 1 --2- 172.21.15.157:0/3975932774 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb264034bb0 0x7fb264037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.606+0000 7fb26f7fe640 1 -- 172.21.15.157:0/3975932774 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fb37c0f0d60 con 0x55beeb7f8700 2024-05-09T09:48:00.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.606+0000 7fb38a790640 1 --2- 172.21.15.157:0/3975932774 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb264034bb0 0x7fb264037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.606+0000 7fb38d476980 1 Processor -- start 2024-05-09T09:48:00.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.606+0000 7fb38d476980 1 -- start start 2024-05-09T09:48:00.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.606+0000 7fb38a790640 1 --2- 172.21.15.157:0/3975932774 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb264034bb0 0x7fb264037070 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55beeb7c6bc0 tx=0x7fb38000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.606+0000 7fb38d476980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb805640 0x55beeb805a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.606+0000 7fb38d476980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55beeb7bbae0 con 0x55beeb805640 2024-05-09T09:48:00.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.606+0000 7fb38af91640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb805640 0x55beeb805a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.606+0000 7fb38af91640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb805640 0x55beeb805a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:34984/0 (socket says 172.21.15.157:34984) 2024-05-09T09:48:00.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.606+0000 7fb38af91640 1 -- 172.21.15.157:0/312647243 learned_addr learned my addr 172.21.15.157:0/312647243 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:00.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.610+0000 7fb38af91640 1 -- 172.21.15.157:0/312647243 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55beeb806030 con 0x55beeb805640 2024-05-09T09:48:00.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.610+0000 7fb38af91640 1 --2- 172.21.15.157:0/312647243 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb805640 0x55beeb805a60 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0e5c00 tx=0x7fb37c0dc4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa442cbaba9c71e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.610+0000 7fb26d7fa640 1 -- 172.21.15.157:0/312647243 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb37c105020 con 0x55beeb805640 2024-05-09T09:48:00.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.610+0000 7fb26d7fa640 1 -- 172.21.15.157:0/312647243 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb37c0d0540 con 0x55beeb805640 2024-05-09T09:48:00.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.610+0000 7fb26d7fa640 1 -- 172.21.15.157:0/312647243 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb37c0fadd0 con 0x55beeb805640 2024-05-09T09:48:00.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.610+0000 7fb38d476980 1 -- 172.21.15.157:0/312647243 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb805640 msgr2=0x55beeb805a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.610+0000 7fb38d476980 1 --2- 172.21.15.157:0/312647243 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb805640 0x55beeb805a60 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0e5c00 tx=0x7fb37c0dc4b0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.610+0000 7fb38d476980 1 -- 172.21.15.157:0/312647243 shutdown_connections 2024-05-09T09:48:00.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.610+0000 7fb38d476980 1 --2- 172.21.15.157:0/312647243 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb805640 0x55beeb805a60 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.610+0000 7fb38d476980 1 -- 172.21.15.157:0/312647243 >> 172.21.15.157:0/312647243 conn(0x55beeb801a50 msgr2=0x55beeb7ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:00.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.610+0000 7fb38d476980 1 -- 172.21.15.157:0/312647243 shutdown_connections 2024-05-09T09:48:00.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.610+0000 7fb38d476980 1 -- 172.21.15.157:0/312647243 wait complete. 2024-05-09T09:48:00.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.610+0000 7fb38d476980 1 Processor -- start 2024-05-09T09:48:00.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.610+0000 7fb38d476980 1 -- start start 2024-05-09T09:48:00.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.614+0000 7fb38d476980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb805640 0x55beeb80c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.614+0000 7fb38d476980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55beeb806030 con 0x55beeb805640 2024-05-09T09:48:00.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.614+0000 7fb38af91640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb805640 0x55beeb80c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.614+0000 7fb38af91640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb805640 0x55beeb80c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:34988/0 (socket says 172.21.15.157:34988) 2024-05-09T09:48:00.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.614+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 learned_addr learned my addr 172.21.15.157:0/2200738084 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:00.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.614+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55beeb80cd90 con 0x55beeb805640 2024-05-09T09:48:00.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.614+0000 7fb38af91640 1 --2- 172.21.15.157:0/2200738084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb805640 0x55beeb80c850 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0c5fb0 tx=0x7fb37c0ceed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.614+0000 7fb25b7fe640 1 -- 172.21.15.157:0/2200738084 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb37c11a070 con 0x55beeb805640 2024-05-09T09:48:00.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.614+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55beeb80cd90 con 0x55beeb805640 2024-05-09T09:48:00.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.614+0000 7fb25b7fe640 1 -- 172.21.15.157:0/2200738084 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb37c0d0790 con 0x55beeb805640 2024-05-09T09:48:00.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.614+0000 7fb25b7fe640 1 -- 172.21.15.157:0/2200738084 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb37c0ee3e0 con 0x55beeb805640 2024-05-09T09:48:00.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.614+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55beeb80cd90 con 0x55beeb805640 2024-05-09T09:48:00.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.614+0000 7fb25b7fe640 1 -- 172.21.15.157:0/2200738084 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fb37c11d070 con 0x55beeb805640 2024-05-09T09:48:00.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.614+0000 7fb25b7fe640 1 --2- 172.21.15.157:0/2200738084 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb254034bb0 0x7fb254037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.614+0000 7fb25b7fe640 1 -- 172.21.15.157:0/2200738084 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fb37c110030 con 0x55beeb805640 2024-05-09T09:48:00.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.614+0000 7fb38a790640 1 --2- 172.21.15.157:0/2200738084 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb254034bb0 0x7fb254037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.614+0000 7fb38d476980 20 rados->read ofs=0 len=0 2024-05-09T09:48:00.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.614+0000 7fb38d476980 1 --2- 172.21.15.157:0/2200738084 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55beeb819260 0x55beeb81b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.614+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81be70 con 0x55beeb819260 2024-05-09T09:48:00.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.614+0000 7fb38b792640 1 --2- 172.21.15.157:0/2200738084 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55beeb819260 0x55beeb81b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.618+0000 7fb38a790640 1 --2- 172.21.15.157:0/2200738084 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb254034bb0 0x7fb254037070 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55beeb7d2c10 tx=0x7fb380010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.618+0000 7fb38b792640 1 --2- 172.21.15.157:0/2200738084 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55beeb819260 0x55beeb81b720 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.618+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.618+0000 7fb38d476980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:00.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.618+0000 7fb38d476980 20 realm 2024-05-09T09:48:00.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.618+0000 7fb38d476980 20 rados->read ofs=0 len=0 2024-05-09T09:48:00.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.618+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81c280 con 0x55beeb819260 2024-05-09T09:48:00.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.618+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.618+0000 7fb38d476980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:00.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.618+0000 7fb38d476980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:48:00.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.618+0000 7fb38d476980 20 rados->read ofs=0 len=0 2024-05-09T09:48:00.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.618+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cb50 con 0x55beeb819260 2024-05-09T09:48:00.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.618+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.618+0000 7fb38d476980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:00.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.618+0000 7fb38d476980 20 rados->read ofs=0 len=0 2024-05-09T09:48:00.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.618+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x55beeb819260 2024-05-09T09:48:00.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.618+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.618+0000 7fb38d476980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:00.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.618+0000 7fb38d476980 20 rados->read ofs=0 len=0 2024-05-09T09:48:00.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.618+0000 7fb38d476980 1 --2- 172.21.15.157:0/2200738084 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55beeb81dc50 0x55beeb820040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.618+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beeb820650 con 0x55beeb81dc50 2024-05-09T09:48:00.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.618+0000 7fb38af91640 1 --2- 172.21.15.157:0/2200738084 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55beeb81dc50 0x55beeb820040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.618+0000 7fb38af91640 1 --2- 172.21.15.157:0/2200738084 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55beeb81dc50 0x55beeb820040 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.622+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb37c11c030 con 0x55beeb81dc50 2024-05-09T09:48:00.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.622+0000 7fb38d476980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:48:00.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.622+0000 7fb38d476980 20 searching for the correct realm 2024-05-09T09:48:00.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.622+0000 7fb38d476980 1 --2- 172.21.15.157:0/2200738084 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55beeb8225a0 0x55beeb8249b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.622+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb825080 con 0x55beeb8225a0 2024-05-09T09:48:00.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.622+0000 7fb38a790640 1 --2- 172.21.15.157:0/2200738084 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55beeb8225a0 0x55beeb8249b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.622+0000 7fb38a790640 1 --2- 172.21.15.157:0/2200738084 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55beeb8225a0 0x55beeb8249b0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.622+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb380037040 con 0x55beeb8225a0 2024-05-09T09:48:00.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.622+0000 7fb38a790640 1 --2- 172.21.15.157:0/2200738084 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fb38001fc60 0x7fb38003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.622+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb825080 con 0x7fb38001fc60 2024-05-09T09:48:00.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.622+0000 7fb38b792640 1 --2- 172.21.15.157:0/2200738084 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fb38001fc60 0x7fb38003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.622+0000 7fb38b792640 1 --2- 172.21.15.157:0/2200738084 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fb38001fc60 0x7fb38003a3c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.622+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb38400a4d0 con 0x7fb38001fc60 2024-05-09T09:48:00.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.622+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x55beeb81dc50 2024-05-09T09:48:00.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.622+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb37c11c030 con 0x55beeb81dc50 2024-05-09T09:48:00.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.622+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x55beeb819260 2024-05-09T09:48:00.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.622+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.622+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x55beeb819260 2024-05-09T09:48:00.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.626+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.626+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x55beeb81dc50 2024-05-09T09:48:00.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.626+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb37c11c030 con 0x55beeb81dc50 2024-05-09T09:48:00.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.626+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x55beeb81dc50 2024-05-09T09:48:00.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.626+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb37c11c030 con 0x55beeb81dc50 2024-05-09T09:48:00.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.626+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x7fb38001fc60 2024-05-09T09:48:00.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.626+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb38400a4d0 con 0x7fb38001fc60 2024-05-09T09:48:00.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.626+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x55beeb8225a0 2024-05-09T09:48:00.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.626+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb380037040 con 0x55beeb8225a0 2024-05-09T09:48:00.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.626+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x55beeb819260 2024-05-09T09:48:00.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.626+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.626+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x55beeb81dc50 2024-05-09T09:48:00.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.626+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb37c11c030 con 0x55beeb81dc50 2024-05-09T09:48:00.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.626+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x55beeb819260 2024-05-09T09:48:00.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.626+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.626+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x7fb38001fc60 2024-05-09T09:48:00.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.626+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb38400a4d0 con 0x7fb38001fc60 2024-05-09T09:48:00.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.626+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x55beeb8225a0 2024-05-09T09:48:00.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.630+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb380037040 con 0x55beeb8225a0 2024-05-09T09:48:00.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.630+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x55beeb8225a0 2024-05-09T09:48:00.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.630+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb380037040 con 0x55beeb8225a0 2024-05-09T09:48:00.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.630+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x55beeb81dc50 2024-05-09T09:48:00.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.630+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb37c11c030 con 0x55beeb81dc50 2024-05-09T09:48:00.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.630+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x55beeb8225a0 2024-05-09T09:48:00.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.630+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb380037040 con 0x55beeb8225a0 2024-05-09T09:48:00.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.630+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x55beeb8225a0 2024-05-09T09:48:00.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.630+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb380037040 con 0x55beeb8225a0 2024-05-09T09:48:00.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.630+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x55beeb819260 2024-05-09T09:48:00.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.630+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.630+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x55beeb819260 2024-05-09T09:48:00.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.630+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.630+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x55beeb81dc50 2024-05-09T09:48:00.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.630+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb37c11c030 con 0x55beeb81dc50 2024-05-09T09:48:00.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.630+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x55beeb8225a0 2024-05-09T09:48:00.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.630+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb380037040 con 0x55beeb8225a0 2024-05-09T09:48:00.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.630+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x7fb38001fc60 2024-05-09T09:48:00.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.630+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb38400a4d0 con 0x7fb38001fc60 2024-05-09T09:48:00.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.630+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x55beeb819260 2024-05-09T09:48:00.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.634+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.634+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x55beeb81dc50 2024-05-09T09:48:00.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.634+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb37c11c030 con 0x55beeb81dc50 2024-05-09T09:48:00.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.634+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x55beeb8225a0 2024-05-09T09:48:00.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.634+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb380037040 con 0x55beeb8225a0 2024-05-09T09:48:00.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.634+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x55beeb81dc50 2024-05-09T09:48:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.634+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb37c11c030 con 0x55beeb81dc50 2024-05-09T09:48:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.634+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x7fb38001fc60 2024-05-09T09:48:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.634+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb38400a4d0 con 0x7fb38001fc60 2024-05-09T09:48:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.634+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x55beeb8225a0 2024-05-09T09:48:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.634+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb38004a040 con 0x55beeb8225a0 2024-05-09T09:48:00.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.634+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x55beeb81dc50 2024-05-09T09:48:00.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.634+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb37c11c030 con 0x55beeb81dc50 2024-05-09T09:48:00.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.634+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x55beeb819260 2024-05-09T09:48:00.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.634+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.634+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55beeb81cef0 con 0x7fb38001fc60 2024-05-09T09:48:00.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb38400a4d0 con 0x7fb38001fc60 2024-05-09T09:48:00.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:48:00.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:48:00.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:48:00.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:48:00.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:48:00.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:48:00.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 20 rados->read ofs=0 len=0 2024-05-09T09:48:00.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beeb820f10 con 0x55beeb819260 2024-05-09T09:48:00.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:00.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 20 rados->read ofs=0 len=0 2024-05-09T09:48:00.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beeb820f10 con 0x55beeb819260 2024-05-09T09:48:00.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:00.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 20 rados->read ofs=0 len=0 2024-05-09T09:48:00.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beeb820f10 con 0x55beeb8225a0 2024-05-09T09:48:00.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb38004a040 con 0x55beeb8225a0 2024-05-09T09:48:00.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:48:00.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 20 zone default found 2024-05-09T09:48:00.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 4 Realm: () 2024-05-09T09:48:00.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:48:00.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:48:00.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:48:00.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 20 zonegroup default 2024-05-09T09:48:00.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 20 rados->read ofs=0 len=0 2024-05-09T09:48:00.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beeb821950 con 0x55beeb81dc50 2024-05-09T09:48:00.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb37c11c030 con 0x55beeb81dc50 2024-05-09T09:48:00.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:00.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 20 rados->read ofs=0 len=0 2024-05-09T09:48:00.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beeb827390 con 0x55beeb8225a0 2024-05-09T09:48:00.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb38004a040 con 0x55beeb8225a0 2024-05-09T09:48:00.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:00.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 20 rados->read ofs=0 len=0 2024-05-09T09:48:00.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beeb827730 con 0x55beeb8225a0 2024-05-09T09:48:00.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb38004a040 con 0x55beeb8225a0 2024-05-09T09:48:00.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:00.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 20 started sync module instance, tier type = 2024-05-09T09:48:00.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:48:00.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.638+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb8267d0 con 0x7fb38001fc60 2024-05-09T09:48:00.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.642+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x7fb38001fc60 2024-05-09T09:48:00.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.642+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94278483340224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb8267d0 con 0x7fb38001fc60 2024-05-09T09:48:00.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.642+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb827f80 con 0x55beeb819260 2024-05-09T09:48:00.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.642+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94278483340224] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x7fb38001fc60 2024-05-09T09:48:00.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.642+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.642+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94278483344352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb8267d0 con 0x55beeb819260 2024-05-09T09:48:00.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.642+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb828990 con 0x55beeb8225a0 2024-05-09T09:48:00.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.646+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94278483344352] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.646+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb38004a040 con 0x55beeb8225a0 2024-05-09T09:48:00.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.646+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94278483338016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb826740 con 0x55beeb8225a0 2024-05-09T09:48:00.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.646+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb829690 con 0x7fb38001fc60 2024-05-09T09:48:00.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.646+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x7fb38001fc60 2024-05-09T09:48:00.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.646+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94278483350288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb829f60 con 0x7fb38001fc60 2024-05-09T09:48:00.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.646+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb82a920 con 0x55beeb819260 2024-05-09T09:48:00.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.646+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94278483338016] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb38004a040 con 0x55beeb8225a0 2024-05-09T09:48:00.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.646+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94278483350288] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x7fb38001fc60 2024-05-09T09:48:00.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.650+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.650+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94278483354736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb82a890 con 0x55beeb819260 2024-05-09T09:48:00.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.650+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb829ec0 con 0x55beeb81dc50 2024-05-09T09:48:00.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.650+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94278483354736] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.650+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb37c11c030 con 0x55beeb81dc50 2024-05-09T09:48:00.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.650+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94278483352080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb82b1c0 con 0x55beeb81dc50 2024-05-09T09:48:00.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.650+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb82ba10 con 0x55beeb81dc50 2024-05-09T09:48:00.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.654+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94278483352080] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb37c11c030 con 0x55beeb81dc50 2024-05-09T09:48:00.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.654+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb37c11c030 con 0x55beeb81dc50 2024-05-09T09:48:00.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.654+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94278483359072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb82be30 con 0x55beeb81dc50 2024-05-09T09:48:00.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.654+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb82c7f0 con 0x55beeb81dc50 2024-05-09T09:48:00.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.654+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94278483359072] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb37c11c030 con 0x55beeb81dc50 2024-05-09T09:48:00.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.654+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb37c11c030 con 0x55beeb81dc50 2024-05-09T09:48:00.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.654+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94278483360608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb82c7f0 con 0x55beeb81dc50 2024-05-09T09:48:00.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.654+0000 7fb38d476980 20 add_watcher() i=0 2024-05-09T09:48:00.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.654+0000 7fb38d476980 20 add_watcher() i=1 2024-05-09T09:48:00.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.654+0000 7fb38d476980 20 add_watcher() i=2 2024-05-09T09:48:00.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.654+0000 7fb38d476980 20 add_watcher() i=3 2024-05-09T09:48:00.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.654+0000 7fb38d476980 20 add_watcher() i=4 2024-05-09T09:48:00.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.654+0000 7fb38d476980 20 add_watcher() i=5 2024-05-09T09:48:00.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.654+0000 7fb38d476980 20 add_watcher() i=6 2024-05-09T09:48:00.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.658+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94278483360608] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb37c11c030 con 0x55beeb81dc50 2024-05-09T09:48:00.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.658+0000 7fb38d476980 20 add_watcher() i=7 2024-05-09T09:48:00.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.658+0000 7fb38d476980 2 all 8 watchers are set, enabling cache 2024-05-09T09:48:00.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.658+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beeb82fbf0 con 0x55beeb819260 2024-05-09T09:48:00.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.658+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.658+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94278483363088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb82d180 con 0x55beeb819260 2024-05-09T09:48:00.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.658+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94278483363088] v32'305 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.658+0000 7fb23b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:00.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.658+0000 7fb38d476980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:48:00.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.658+0000 7fb38d476980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:48:00.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.658+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb838510 con 0x55beeb819260 2024-05-09T09:48:00.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.662+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'73 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.662+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb838b60 con 0x55beeb81dc50 2024-05-09T09:48:00.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.662+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'68 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb37c11c030 con 0x55beeb81dc50 2024-05-09T09:48:00.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.662+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb838b60 con 0x55beeb8225a0 2024-05-09T09:48:00.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.666+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'67 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb38004a040 con 0x55beeb8225a0 2024-05-09T09:48:00.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.666+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb839640 con 0x55beeb819260 2024-05-09T09:48:00.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.666+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'306 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.666+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb836360 con 0x7fb38001fc60 2024-05-09T09:48:00.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.666+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'191 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x7fb38001fc60 2024-05-09T09:48:00.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.666+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb836360 con 0x55beeb8225a0 2024-05-09T09:48:00.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.670+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'128 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb38004a040 con 0x55beeb8225a0 2024-05-09T09:48:00.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.670+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb83a370 con 0x55beeb819260 2024-05-09T09:48:00.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.670+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'69 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.670+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb83a400 con 0x55beeb81dc50 2024-05-09T09:48:00.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.674+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'127 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb37c11c030 con 0x55beeb81dc50 2024-05-09T09:48:00.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.674+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb83a490 con 0x7fb38001fc60 2024-05-09T09:48:00.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.674+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'67 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x7fb38001fc60 2024-05-09T09:48:00.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.674+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb83a520 con 0x55beeb8225a0 2024-05-09T09:48:00.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.678+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'73 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb38004a040 con 0x55beeb8225a0 2024-05-09T09:48:00.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.678+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb83ab10 con 0x7fb38001fc60 2024-05-09T09:48:00.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.678+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'192 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x7fb38001fc60 2024-05-09T09:48:00.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.678+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb83aa60 con 0x55beeb81dc50 2024-05-09T09:48:00.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.682+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'70 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb37c11c030 con 0x55beeb81dc50 2024-05-09T09:48:00.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.682+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb83aa60 con 0x7fb38001fc60 2024-05-09T09:48:00.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.682+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'67 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x7fb38001fc60 2024-05-09T09:48:00.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.682+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb83aa60 con 0x55beeb81dc50 2024-05-09T09:48:00.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.686+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'133 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb37c11c030 con 0x55beeb81dc50 2024-05-09T09:48:00.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.686+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb83a9d0 con 0x55beeb819260 2024-05-09T09:48:00.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.686+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'307 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.686+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb83a9d0 con 0x55beeb8225a0 2024-05-09T09:48:00.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.686+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'185 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb38004a040 con 0x55beeb8225a0 2024-05-09T09:48:00.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.686+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb83aa60 con 0x7fb38001fc60 2024-05-09T09:48:00.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.690+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'193 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x7fb38001fc60 2024-05-09T09:48:00.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.690+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb83aa60 con 0x55beeb8225a0 2024-05-09T09:48:00.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.690+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'67 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb38004a040 con 0x55beeb8225a0 2024-05-09T09:48:00.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.690+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb83ab10 con 0x55beeb819260 2024-05-09T09:48:00.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.694+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'75 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.694+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb83ab10 con 0x55beeb819260 2024-05-09T09:48:00.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.694+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'308 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.694+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb83ab10 con 0x55beeb8225a0 2024-05-09T09:48:00.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.698+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'186 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb38004a040 con 0x55beeb8225a0 2024-05-09T09:48:00.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.698+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb83abc0 con 0x7fb38001fc60 2024-05-09T09:48:00.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.698+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'79 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x7fb38001fc60 2024-05-09T09:48:00.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.698+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb83abc0 con 0x55beeb8225a0 2024-05-09T09:48:00.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.702+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'69 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb38004a040 con 0x55beeb8225a0 2024-05-09T09:48:00.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.702+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb83abc0 con 0x55beeb8225a0 2024-05-09T09:48:00.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.702+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'73 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb38004a040 con 0x55beeb8225a0 2024-05-09T09:48:00.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.702+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb83abc0 con 0x55beeb8225a0 2024-05-09T09:48:00.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.706+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'63 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb38004a040 con 0x55beeb8225a0 2024-05-09T09:48:00.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.706+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb83abc0 con 0x55beeb8225a0 2024-05-09T09:48:00.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.706+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'129 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb38004a040 con 0x55beeb8225a0 2024-05-09T09:48:00.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.706+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb83abc0 con 0x55beeb81dc50 2024-05-09T09:48:00.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.710+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'69 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb37c11c030 con 0x55beeb81dc50 2024-05-09T09:48:00.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.710+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb83abc0 con 0x55beeb8225a0 2024-05-09T09:48:00.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.710+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'67 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb38004a040 con 0x55beeb8225a0 2024-05-09T09:48:00.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.710+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb83abc0 con 0x55beeb81dc50 2024-05-09T09:48:00.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.714+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'128 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb37c11c030 con 0x55beeb81dc50 2024-05-09T09:48:00.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.714+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb83abc0 con 0x55beeb8225a0 2024-05-09T09:48:00.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.714+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'187 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb38004a040 con 0x55beeb8225a0 2024-05-09T09:48:00.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.714+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb83abc0 con 0x55beeb81dc50 2024-05-09T09:48:00.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.718+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'134 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb37c11c030 con 0x55beeb81dc50 2024-05-09T09:48:00.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.718+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb83abc0 con 0x7fb38001fc60 2024-05-09T09:48:00.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.722+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'73 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x7fb38001fc60 2024-05-09T09:48:00.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.722+0000 7fb23a7fc640 20 reqs_thread_entry: start 2024-05-09T09:48:00.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.722+0000 7fb38d476980 20 init_complete bucket index max shards: 11 2024-05-09T09:48:00.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.722+0000 7fb1abfff640 20 reqs_thread_entry: start 2024-05-09T09:48:00.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.722+0000 7fb38d476980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-09T09:48:00.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.722+0000 7fb38d476980 20 rados->read ofs=0 len=0 2024-05-09T09:48:00.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.722+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beeb856760 con 0x55beeb819260 2024-05-09T09:48:00.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.722+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.722+0000 7fb38d476980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:48:00.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.722+0000 7fb38d476980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-09T09:48:00.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.722+0000 7fb38d476980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:48:00.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.722+0000 7fb38d476980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:48:00.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.722+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55beeb858c80 con 0x7fb38001fc60 2024-05-09T09:48:00.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.722+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fb38400a4d0 con 0x7fb38001fc60 2024-05-09T09:48:00.725 INFO:teuthology.orchestra.run.smithi157.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-05-09T09:48:00.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.726+0000 7fb23b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:00.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.726+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94278483363088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb831ca0 con 0x55beeb819260 2024-05-09T09:48:00.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.726+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94278483363088] v32'309 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.726+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94278483340224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb82c4e0 con 0x7fb38001fc60 2024-05-09T09:48:00.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.726+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94278483340224] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x7fb38001fc60 2024-05-09T09:48:00.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.726+0000 7fb38d476980 20 remove_watcher() i=0 2024-05-09T09:48:00.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.726+0000 7fb38d476980 2 removed watcher, disabling cache 2024-05-09T09:48:00.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.726+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94278483344352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb826bc0 con 0x55beeb819260 2024-05-09T09:48:00.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.730+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94278483344352] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.730+0000 7fb38d476980 20 remove_watcher() i=1 2024-05-09T09:48:00.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.730+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94278483338016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb826bc0 con 0x55beeb8225a0 2024-05-09T09:48:00.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.734+0000 7fb38a790640 1 -- 172.21.15.157:0/2200738084 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94278483338016] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb38004a040 con 0x55beeb8225a0 2024-05-09T09:48:00.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.734+0000 7fb38d476980 20 remove_watcher() i=2 2024-05-09T09:48:00.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.734+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94278483350288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb826bc0 con 0x7fb38001fc60 2024-05-09T09:48:00.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.734+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94278483350288] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x7fb38001fc60 2024-05-09T09:48:00.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.734+0000 7fb38d476980 20 remove_watcher() i=3 2024-05-09T09:48:00.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.734+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94278483354736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb829310 con 0x55beeb819260 2024-05-09T09:48:00.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.734+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94278483354736] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb38400a4d0 con 0x55beeb819260 2024-05-09T09:48:00.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.734+0000 7fb38d476980 20 remove_watcher() i=4 2024-05-09T09:48:00.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.734+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94278483352080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb826bc0 con 0x55beeb81dc50 2024-05-09T09:48:00.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.738+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94278483352080] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb37c11c030 con 0x55beeb81dc50 2024-05-09T09:48:00.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.738+0000 7fb38d476980 20 remove_watcher() i=5 2024-05-09T09:48:00.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.738+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94278483359072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb82a470 con 0x55beeb81dc50 2024-05-09T09:48:00.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94278483359072] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb37c11c030 con 0x55beeb81dc50 2024-05-09T09:48:00.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38d476980 20 remove_watcher() i=6 2024-05-09T09:48:00.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94278483360608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55beeb829a10 con 0x55beeb81dc50 2024-05-09T09:48:00.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38af91640 1 -- 172.21.15.157:0/2200738084 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94278483360608] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb37c11c030 con 0x55beeb81dc50 2024-05-09T09:48:00.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38d476980 20 remove_watcher() i=7 2024-05-09T09:48:00.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55beeb81dc50 msgr2=0x55beeb820040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38d476980 1 --2- 172.21.15.157:0/2200738084 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55beeb81dc50 0x55beeb820040 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55beeb819260 msgr2=0x55beeb81b720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38d476980 1 --2- 172.21.15.157:0/2200738084 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55beeb819260 0x55beeb81b720 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fb38001fc60 msgr2=0x7fb38003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38d476980 1 --2- 172.21.15.157:0/2200738084 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fb38001fc60 0x7fb38003a3c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55beeb8225a0 msgr2=0x55beeb8249b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38d476980 1 --2- 172.21.15.157:0/2200738084 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55beeb8225a0 0x55beeb8249b0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb254034bb0 msgr2=0x7fb254037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38d476980 1 --2- 172.21.15.157:0/2200738084 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb254034bb0 0x7fb254037070 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55beeb7d2c10 tx=0x7fb380010000 comp rx=0 tx=0).stop 2024-05-09T09:48:00.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb805640 msgr2=0x55beeb80c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38d476980 1 --2- 172.21.15.157:0/2200738084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb805640 0x55beeb80c850 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0c5fb0 tx=0x7fb37c0ceed0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38b792640 1 -- 172.21.15.157:0/2200738084 reap_dead start 2024-05-09T09:48:00.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 shutdown_connections 2024-05-09T09:48:00.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38d476980 1 --2- 172.21.15.157:0/2200738084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb805640 0x55beeb80c850 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 >> 172.21.15.157:0/2200738084 conn(0x55beeb801a50 msgr2=0x55beeb7ff0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:00.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 shutdown_connections 2024-05-09T09:48:00.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38d476980 1 -- 172.21.15.157:0/2200738084 wait complete. 2024-05-09T09:48:00.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38d476980 1 -- 172.21.15.157:0/3975932774 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb264034bb0 msgr2=0x7fb264037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38d476980 1 --2- 172.21.15.157:0/3975932774 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb264034bb0 0x7fb264037070 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55beeb7c6bc0 tx=0x7fb38000f000 comp rx=0 tx=0).stop 2024-05-09T09:48:00.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38d476980 1 -- 172.21.15.157:0/3975932774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb7f8700 msgr2=0x55beeb7f8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38d476980 1 --2- 172.21.15.157:0/3975932774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb7f8700 0x55beeb7f8b20 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0a5fd0 tx=0x7fb37c0c5f40 comp rx=0 tx=0).stop 2024-05-09T09:48:00.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38d476980 1 -- 172.21.15.157:0/3975932774 shutdown_connections 2024-05-09T09:48:00.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38d476980 1 --2- 172.21.15.157:0/3975932774 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb264034bb0 0x7fb264037070 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38d476980 1 --2- 172.21.15.157:0/3975932774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb7f8700 0x55beeb7f8b20 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.742+0000 7fb38d476980 1 -- 172.21.15.157:0/3975932774 >> 172.21.15.157:0/3975932774 conn(0x55beeb7ed4d0 msgr2=0x55beeb7edfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:00.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.746+0000 7fb38d476980 1 -- 172.21.15.157:0/3975932774 shutdown_connections 2024-05-09T09:48:00.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.746+0000 7fb38d476980 1 -- 172.21.15.157:0/3975932774 wait complete. 2024-05-09T09:48:00.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.746+0000 7fb38d476980 1 -- 172.21.15.157:0/3484057863 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55beeb7cbc80 msgr2=0x55beeb7ce140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.746+0000 7fb38d476980 1 --2- 172.21.15.157:0/3484057863 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55beeb7cbc80 0x55beeb7ce140 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.746+0000 7fb38d476980 1 -- 172.21.15.157:0/3484057863 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55beeb6d0450 msgr2=0x55beeb7c9440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.746+0000 7fb38d476980 1 --2- 172.21.15.157:0/3484057863 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55beeb6d0450 0x55beeb7c9440 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.746+0000 7fb38d476980 1 -- 172.21.15.157:0/3484057863 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55beeb7cfd30 msgr2=0x55beeb7d2120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.746+0000 7fb38d476980 1 --2- 172.21.15.157:0/3484057863 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55beeb7cfd30 0x55beeb7d2120 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.746+0000 7fb38d476980 1 -- 172.21.15.157:0/3484057863 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb270034c00 msgr2=0x7fb2700370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.746+0000 7fb38d476980 1 --2- 172.21.15.157:0/3484057863 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb270034c00 0x7fb2700370c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb380001e50 tx=0x7fb3800013b0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.746+0000 7fb38d476980 1 -- 172.21.15.157:0/3484057863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb6cfb30 msgr2=0x55beeb7c2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.746+0000 7fb38d476980 1 --2- 172.21.15.157:0/3484057863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55beeb6cfb30 0x55beeb7c2500 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb37c003070 tx=0x7fb37c0180e0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.746+0000 7fb38b792640 1 -- 172.21.15.157:0/3484057863 reap_dead start 2024-05-09T09:48:00.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.746+0000 7fb38d476980 1 -- 172.21.15.157:0/3484057863 shutdown_connections 2024-05-09T09:48:00.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.746+0000 7fb38d476980 1 -- 172.21.15.157:0/3484057863 >> 172.21.15.157:0/3484057863 conn(0x55beeb643250 msgr2=0x55beeb7b5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:00.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.746+0000 7fb38d476980 1 -- 172.21.15.157:0/3484057863 shutdown_connections 2024-05-09T09:48:00.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.746+0000 7fb38d476980 1 -- 172.21.15.157:0/3484057863 wait complete. 2024-05-09T09:48:00.757 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-05-09T09:48:00.774 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-05-09T09:48:00.782 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-09T09:48:00.838 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-09T09:48:00.859 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-09T09:48:00.903 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-05-09T09:48:00.916 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-09T09:48:00.916 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-05-09T09:48:00.916 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-05-09T09:48:00.916 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-05-09T09:48:00.955 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:48:00.955 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:48:00.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.954+0000 7f06b3d06980 1 Processor -- start 2024-05-09T09:48:00.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.954+0000 7f06b3d06980 1 -- start start 2024-05-09T09:48:00.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.958+0000 7f06b3d06980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x56394f7990b0 0x56394f799490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.958+0000 7f06b3d06980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56394f64d440 con 0x56394f7999d0 2024-05-09T09:48:00.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.958+0000 7f06b3d06980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x56394f6385f0 con 0x56394f7990b0 2024-05-09T09:48:00.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.958+0000 7f06b1821640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x56394f7990b0 0x56394f799490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.958+0000 7f06b1821640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x56394f7990b0 0x56394f799490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35002/0 (socket says 172.21.15.157:35002) 2024-05-09T09:48:00.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.958+0000 7f06b1821640 1 -- 172.21.15.157:0/4131534021 learned_addr learned my addr 172.21.15.157:0/4131534021 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:00.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.958+0000 7f06b1821640 1 -- 172.21.15.157:0/4131534021 >> v1:172.21.15.110:6789/0 conn(0x56394f7999d0 legacy=0x56394f795b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.958+0000 7f06b1821640 1 -- 172.21.15.157:0/4131534021 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56394f643990 con 0x56394f7990b0 2024-05-09T09:48:00.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.962+0000 7f06b1821640 1 --2- 172.21.15.157:0/4131534021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f7990b0 0x56394f799490 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f06ac00a4e0 tx=0x7f06ac01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9893af752d7c4084 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.962+0000 7f06b081f640 1 -- 172.21.15.157:0/4131534021 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06ac0aa540 con 0x56394f7990b0 2024-05-09T09:48:00.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.962+0000 7f06b081f640 1 -- 172.21.15.157:0/4131534021 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06ac0aa6e0 con 0x56394f7990b0 2024-05-09T09:48:00.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.962+0000 7f06b081f640 1 -- 172.21.15.157:0/4131534021 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06ac0aaa40 con 0x56394f7990b0 2024-05-09T09:48:00.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.962+0000 7f06b3d06980 1 -- 172.21.15.157:0/4131534021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f7990b0 msgr2=0x56394f799490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.962+0000 7f06b3d06980 1 --2- 172.21.15.157:0/4131534021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f7990b0 0x56394f799490 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f06ac00a4e0 tx=0x7f06ac01b090 comp rx=0 tx=0).stop 2024-05-09T09:48:00.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.962+0000 7f06b3d06980 1 -- 172.21.15.157:0/4131534021 shutdown_connections 2024-05-09T09:48:00.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.962+0000 7f06b3d06980 1 --2- 172.21.15.157:0/4131534021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f7990b0 0x56394f799490 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.962+0000 7f06b3d06980 1 -- 172.21.15.157:0/4131534021 >> 172.21.15.157:0/4131534021 conn(0x56394f791860 msgr2=0x56394f793c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:00.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.962+0000 7f06b3d06980 1 -- 172.21.15.157:0/4131534021 shutdown_connections 2024-05-09T09:48:00.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.962+0000 7f06b3d06980 1 -- 172.21.15.157:0/4131534021 wait complete. 2024-05-09T09:48:00.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.978+0000 7f06b3d06980 1 Processor -- start 2024-05-09T09:48:00.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.978+0000 7f06b3d06980 1 -- start start 2024-05-09T09:48:00.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.978+0000 7f06b3d06980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f7990b0 0x56394f883420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.978+0000 7f06b3d06980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56394f69afe0 con 0x56394f7990b0 2024-05-09T09:48:00.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.978+0000 7f06b1821640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f7990b0 0x56394f883420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.978+0000 7f06b1821640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f7990b0 0x56394f883420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35010/0 (socket says 172.21.15.157:35010) 2024-05-09T09:48:00.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.978+0000 7f06b1821640 1 -- 172.21.15.157:0/1687466102 learned_addr learned my addr 172.21.15.157:0/1687466102 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:00.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.978+0000 7f06b1821640 1 -- 172.21.15.157:0/1687466102 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56394f61fae0 con 0x56394f7990b0 2024-05-09T09:48:00.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.978+0000 7f06b1821640 1 --2- 172.21.15.157:0/1687466102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f7990b0 0x56394f883420 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f06ac017ca0 tx=0x7f06ac0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=710c9a9da0c5063b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.978+0000 7f059fe07640 1 -- 172.21.15.157:0/1687466102 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06ac0b9030 con 0x56394f7990b0 2024-05-09T09:48:00.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.978+0000 7f059fe07640 1 -- 172.21.15.157:0/1687466102 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06ac0aaa90 con 0x56394f7990b0 2024-05-09T09:48:00.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.978+0000 7f059fe07640 1 -- 172.21.15.157:0/1687466102 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06ac0aad70 con 0x56394f7990b0 2024-05-09T09:48:00.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.978+0000 7f06b3d06980 1 -- 172.21.15.157:0/1687466102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f7990b0 msgr2=0x56394f883420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:00.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.978+0000 7f06b3d06980 1 --2- 172.21.15.157:0/1687466102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f7990b0 0x56394f883420 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f06ac017ca0 tx=0x7f06ac0033b0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.978+0000 7f06b3d06980 1 -- 172.21.15.157:0/1687466102 shutdown_connections 2024-05-09T09:48:00.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.978+0000 7f06b3d06980 1 --2- 172.21.15.157:0/1687466102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f7990b0 0x56394f883420 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:00.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.978+0000 7f06b3d06980 1 -- 172.21.15.157:0/1687466102 >> 172.21.15.157:0/1687466102 conn(0x56394f791860 msgr2=0x56394f87efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:00.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.978+0000 7f06b3d06980 1 -- 172.21.15.157:0/1687466102 shutdown_connections 2024-05-09T09:48:00.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.978+0000 7f06b3d06980 1 -- 172.21.15.157:0/1687466102 wait complete. 2024-05-09T09:48:00.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.982+0000 7f06b3d06980 1 Processor -- start 2024-05-09T09:48:00.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.982+0000 7f06b3d06980 1 -- start start 2024-05-09T09:48:00.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.982+0000 7f06b3d06980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f7990b0 0x56394f88a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.982+0000 7f06b3d06980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56394f7a1bb0 con 0x56394f7990b0 2024-05-09T09:48:00.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.982+0000 7f06b1821640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f7990b0 0x56394f88a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.982+0000 7f06b1821640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f7990b0 0x56394f88a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35012/0 (socket says 172.21.15.157:35012) 2024-05-09T09:48:00.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.982+0000 7f06b1821640 1 -- 172.21.15.157:0/2397520106 learned_addr learned my addr 172.21.15.157:0/2397520106 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:00.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.982+0000 7f06b1821640 1 -- 172.21.15.157:0/2397520106 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56394f88aa20 con 0x56394f7990b0 2024-05-09T09:48:00.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.982+0000 7f06b1821640 1 --2- 172.21.15.157:0/2397520106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f7990b0 0x56394f88a4e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f06ac01b0d0 tx=0x7f06ac017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.982+0000 7f059e604640 1 -- 172.21.15.157:0/2397520106 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06ac0b9030 con 0x56394f7990b0 2024-05-09T09:48:00.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.982+0000 7f06b3d06980 1 -- 172.21.15.157:0/2397520106 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56394f88acb0 con 0x56394f7990b0 2024-05-09T09:48:00.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.982+0000 7f059e604640 1 -- 172.21.15.157:0/2397520106 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06ac0c3070 con 0x56394f7990b0 2024-05-09T09:48:00.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.982+0000 7f059e604640 1 -- 172.21.15.157:0/2397520106 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06ac0c85a0 con 0x56394f7990b0 2024-05-09T09:48:00.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.982+0000 7f06b3d06980 1 -- 172.21.15.157:0/2397520106 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56394f88d940 con 0x56394f7990b0 2024-05-09T09:48:00.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.982+0000 7f059e604640 1 -- 172.21.15.157:0/2397520106 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f06ac0b3040 con 0x56394f7990b0 2024-05-09T09:48:00.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.982+0000 7f059e604640 1 --2- 172.21.15.157:0/2397520106 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0598034bb0 0x7f0598037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.982+0000 7f059e604640 1 -- 172.21.15.157:0/2397520106 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f06ac0ba070 con 0x56394f7990b0 2024-05-09T09:48:00.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.982+0000 7f06b1020640 1 --2- 172.21.15.157:0/2397520106 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0598034bb0 0x7f0598037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.982+0000 7f06b3d06980 1 --2- 172.21.15.157:0/2397520106 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56394f7999d0 0x56394f891590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.982+0000 7f06b3d06980 1 -- 172.21.15.157:0/2397520106 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56394f891b10 con 0x56394f7999d0 2024-05-09T09:48:00.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.986+0000 7f06b2022640 1 --2- 172.21.15.157:0/2397520106 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56394f7999d0 0x56394f891590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.986+0000 7f06b1020640 1 --2- 172.21.15.157:0/2397520106 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0598034bb0 0x7f0598037070 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f06a8001e20 tx=0x7f06a80013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.986+0000 7f06b2022640 1 --2- 172.21.15.157:0/2397520106 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56394f7999d0 0x56394f891590 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.986+0000 7f06b2022640 1 -- 172.21.15.157:0/2397520106 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06a40083f0 con 0x56394f7999d0 2024-05-09T09:48:00.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.986+0000 7f06b3d06980 1 -- 172.21.15.157:0/2397520106 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56394f892400 con 0x56394f7999d0 2024-05-09T09:48:00.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.986+0000 7f06b2022640 1 -- 172.21.15.157:0/2397520106 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f06a40083f0 con 0x56394f7999d0 2024-05-09T09:48:00.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.986+0000 7f06b3d06980 1 --2- 172.21.15.157:0/2397520106 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56394f893d50 0x56394f8961e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.986+0000 7f06b3d06980 1 -- 172.21.15.157:0/2397520106 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56394f896970 con 0x56394f893d50 2024-05-09T09:48:00.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.986+0000 7f06b1821640 1 --2- 172.21.15.157:0/2397520106 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56394f893d50 0x56394f8961e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.986+0000 7f06b1821640 1 --2- 172.21.15.157:0/2397520106 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56394f893d50 0x56394f8961e0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.986+0000 7f06b1821640 1 -- 172.21.15.157:0/2397520106 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f06ac0b4ca0 con 0x56394f893d50 2024-05-09T09:48:00.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.986+0000 7f06b3d06980 1 -- 172.21.15.157:0/2397520106 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56394f892c50 con 0x56394f7999d0 2024-05-09T09:48:00.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.986+0000 7f06b2022640 1 -- 172.21.15.157:0/2397520106 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f06a40083f0 con 0x56394f7999d0 2024-05-09T09:48:00.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.986+0000 7f06b3d06980 1 --2- 172.21.15.157:0/2397520106 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56394f897dd0 0x56394f89a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.986+0000 7f06b3d06980 1 -- 172.21.15.157:0/2397520106 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56394f89a900 con 0x56394f897dd0 2024-05-09T09:48:00.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.986+0000 7f06b1020640 1 --2- 172.21.15.157:0/2397520106 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56394f897dd0 0x56394f89a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.986+0000 7f06b1020640 1 --2- 172.21.15.157:0/2397520106 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56394f897dd0 0x56394f89a1c0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.990+0000 7f06b1020640 1 -- 172.21.15.157:0/2397520106 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f06a800d040 con 0x56394f897dd0 2024-05-09T09:48:00.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.990+0000 7f06b3d06980 1 Processor -- start 2024-05-09T09:48:00.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.990+0000 7f06b3d06980 1 -- start start 2024-05-09T09:48:00.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.994+0000 7f06b3d06980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f8c07c0 0x56394f8c0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.994+0000 7f06b3d06980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56394f69f020 con 0x56394f8c07c0 2024-05-09T09:48:00.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.994+0000 7f06b1821640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f8c07c0 0x56394f8c0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.994+0000 7f06b1821640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f8c07c0 0x56394f8c0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35018/0 (socket says 172.21.15.157:35018) 2024-05-09T09:48:00.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.994+0000 7f06b1821640 1 -- 172.21.15.157:0/1255688895 learned_addr learned my addr 172.21.15.157:0/1255688895 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:00.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.994+0000 7f06b1821640 1 -- 172.21.15.157:0/1255688895 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56394f8c1120 con 0x56394f8c07c0 2024-05-09T09:48:00.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.994+0000 7f06b1821640 1 --2- 172.21.15.157:0/1255688895 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f8c07c0 0x56394f8c0be0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f06ac0b5d40 tx=0x7f06ac0a9e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.994+0000 7f05963a1640 1 -- 172.21.15.157:0/1255688895 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06ac0ea070 con 0x56394f8c07c0 2024-05-09T09:48:00.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.994+0000 7f05963a1640 1 -- 172.21.15.157:0/1255688895 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06ac0be410 con 0x56394f8c07c0 2024-05-09T09:48:00.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.994+0000 7f05963a1640 1 -- 172.21.15.157:0/1255688895 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06ac0be730 con 0x56394f8c07c0 2024-05-09T09:48:00.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.994+0000 7f06b3d06980 1 -- 172.21.15.157:0/1255688895 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56394f8c1bb0 con 0x56394f8c07c0 2024-05-09T09:48:00.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.994+0000 7f06b3d06980 1 -- 172.21.15.157:0/1255688895 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56394f8c2090 con 0x56394f8c07c0 2024-05-09T09:48:00.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.994+0000 7f05963a1640 1 -- 172.21.15.157:0/1255688895 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f06ac0ed070 con 0x56394f8c07c0 2024-05-09T09:48:00.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.994+0000 7f05963a1640 1 --2- 172.21.15.157:0/1255688895 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f058c034c00 0x7f058c0370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.994+0000 7f05963a1640 1 -- 172.21.15.157:0/1255688895 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f06ac0e1030 con 0x56394f8c07c0 2024-05-09T09:48:00.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.994+0000 7f06b1020640 1 --2- 172.21.15.157:0/1255688895 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f058c034c00 0x7f058c0370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.998+0000 7f06b3d06980 1 Processor -- start 2024-05-09T09:48:00.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.998+0000 7f06b3d06980 1 -- start start 2024-05-09T09:48:00.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.998+0000 7f06b3d06980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f798410 0x56394f7987f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:00.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.998+0000 7f06b1020640 1 --2- 172.21.15.157:0/1255688895 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f058c034c00 0x7f058c0370c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x56394f88ecc0 tx=0x7f06a8006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.998+0000 7f06b3d06980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56394f883ab0 con 0x56394f798410 2024-05-09T09:48:00.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.998+0000 7f06b1821640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f798410 0x56394f7987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:00.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.998+0000 7f06b1821640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f798410 0x56394f7987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35032/0 (socket says 172.21.15.157:35032) 2024-05-09T09:48:00.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.998+0000 7f06b1821640 1 -- 172.21.15.157:0/3327672623 learned_addr learned my addr 172.21.15.157:0/3327672623 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:00.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.998+0000 7f06b1821640 1 -- 172.21.15.157:0/3327672623 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56394f796c30 con 0x56394f798410 2024-05-09T09:48:00.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.998+0000 7f06b1821640 1 --2- 172.21.15.157:0/3327672623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f798410 0x56394f7987f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f06ac0d93f0 tx=0x7f06ac0a5510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb91a4c0ff98f6a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:00.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.998+0000 7f0583fff640 1 -- 172.21.15.157:0/3327672623 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06ac0e2cc0 con 0x56394f798410 2024-05-09T09:48:00.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.998+0000 7f0583fff640 1 -- 172.21.15.157:0/3327672623 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06ac0bdcf0 con 0x56394f798410 2024-05-09T09:48:00.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.998+0000 7f0583fff640 1 -- 172.21.15.157:0/3327672623 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06ac0b49b0 con 0x56394f798410 2024-05-09T09:48:01.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.998+0000 7f06b3d06980 1 -- 172.21.15.157:0/3327672623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f798410 msgr2=0x56394f7987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.998+0000 7f06b3d06980 1 --2- 172.21.15.157:0/3327672623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f798410 0x56394f7987f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f06ac0d93f0 tx=0x7f06ac0a5510 comp rx=0 tx=0).stop 2024-05-09T09:48:01.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.998+0000 7f06b3d06980 1 -- 172.21.15.157:0/3327672623 shutdown_connections 2024-05-09T09:48:01.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.998+0000 7f06b3d06980 1 --2- 172.21.15.157:0/3327672623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f798410 0x56394f7987f0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.998+0000 7f06b3d06980 1 -- 172.21.15.157:0/3327672623 >> 172.21.15.157:0/3327672623 conn(0x56394f8c9a70 msgr2=0x56394f8c7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:01.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.998+0000 7f06b3d06980 1 -- 172.21.15.157:0/3327672623 shutdown_connections 2024-05-09T09:48:01.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.998+0000 7f06b3d06980 1 -- 172.21.15.157:0/3327672623 wait complete. 2024-05-09T09:48:01.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.998+0000 7f06b3d06980 1 Processor -- start 2024-05-09T09:48:01.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.998+0000 7f06b3d06980 1 -- start start 2024-05-09T09:48:01.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.998+0000 7f06b3d06980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f798410 0x56394f8d6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:00.998+0000 7f06b3d06980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56394f797040 con 0x56394f798410 2024-05-09T09:48:01.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.002+0000 7f06b1821640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f798410 0x56394f8d6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.002+0000 7f06b1821640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f798410 0x56394f8d6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35048/0 (socket says 172.21.15.157:35048) 2024-05-09T09:48:01.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.002+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 learned_addr learned my addr 172.21.15.157:0/894778611 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:01.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.002+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56394f8d7120 con 0x56394f798410 2024-05-09T09:48:01.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.002+0000 7f06b1821640 1 --2- 172.21.15.157:0/894778611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f798410 0x56394f8d6be0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f06ac0a5640 tx=0x7f06ac0d4ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.002+0000 7f05827fc640 1 -- 172.21.15.157:0/894778611 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06ac10c070 con 0x56394f798410 2024-05-09T09:48:01.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.002+0000 7f05827fc640 1 -- 172.21.15.157:0/894778611 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06ac0e2cc0 con 0x56394f798410 2024-05-09T09:48:01.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.002+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56394f8d7120 con 0x56394f798410 2024-05-09T09:48:01.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.002+0000 7f05827fc640 1 -- 172.21.15.157:0/894778611 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06ac0e5730 con 0x56394f798410 2024-05-09T09:48:01.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.002+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56394f8d7120 con 0x56394f798410 2024-05-09T09:48:01.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.002+0000 7f05827fc640 1 -- 172.21.15.157:0/894778611 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f06ac105040 con 0x56394f798410 2024-05-09T09:48:01.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f05827fc640 1 --2- 172.21.15.157:0/894778611 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f057c034c00 0x7f057c0370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f05827fc640 1 -- 172.21.15.157:0/894778611 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f06ac0fa070 con 0x56394f798410 2024-05-09T09:48:01.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f06b1020640 1 --2- 172.21.15.157:0/894778611 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f057c034c00 0x7f057c0370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f06b3d06980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f06b3d06980 1 --2- 172.21.15.157:0/894778611 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56394f8e3750 0x56394f8e5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e6360 con 0x56394f8e3750 2024-05-09T09:48:01.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f06b2022640 1 --2- 172.21.15.157:0/894778611 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56394f8e3750 0x56394f8e5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f06b1020640 1 --2- 172.21.15.157:0/894778611 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f057c034c00 0x7f057c0370c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x56394f89ace0 tx=0x7f06a8011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f06b2022640 1 --2- 172.21.15.157:0/894778611 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56394f8e3750 0x56394f8e5c10 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06a40083f0 con 0x56394f8e3750 2024-05-09T09:48:01.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f06b3d06980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:01.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f06b3d06980 20 realm 2024-05-09T09:48:01.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f06b3d06980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e6770 con 0x56394f8e3750 2024-05-09T09:48:01.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06a40083f0 con 0x56394f8e3750 2024-05-09T09:48:01.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f06b3d06980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:01.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f06b3d06980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:48:01.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f06b3d06980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e7040 con 0x56394f8e3750 2024-05-09T09:48:01.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06a40083f0 con 0x56394f8e3750 2024-05-09T09:48:01.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f06b3d06980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:01.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f06b3d06980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x56394f8e3750 2024-05-09T09:48:01.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f06a40083f0 con 0x56394f8e3750 2024-05-09T09:48:01.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f06b3d06980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:01.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f06b3d06980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f06b3d06980 1 --2- 172.21.15.157:0/894778611 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56394f8e8140 0x56394f8ea530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56394f8eab40 con 0x56394f8e8140 2024-05-09T09:48:01.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f06b1821640 1 --2- 172.21.15.157:0/894778611 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56394f8e8140 0x56394f8ea530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.006+0000 7f06b1821640 1 --2- 172.21.15.157:0/894778611 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56394f8e8140 0x56394f8ea530 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.010+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f06ac0ec030 con 0x56394f8e8140 2024-05-09T09:48:01.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.010+0000 7f06b3d06980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:48:01.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.010+0000 7f06b3d06980 20 searching for the correct realm 2024-05-09T09:48:01.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.010+0000 7f06b3d06980 1 --2- 172.21.15.157:0/894778611 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56394f8eca20 0x56394f8eee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.010+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8ef510 con 0x56394f8eca20 2024-05-09T09:48:01.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.010+0000 7f06b1020640 1 --2- 172.21.15.157:0/894778611 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56394f8eca20 0x56394f8eee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.010+0000 7f06b1020640 1 --2- 172.21.15.157:0/894778611 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56394f8eca20 0x56394f8eee90 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.010+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a8036040 con 0x56394f8eca20 2024-05-09T09:48:01.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.010+0000 7f06b1020640 1 --2- 172.21.15.157:0/894778611 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f06a800f3d0 0x7f06a800f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.010+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8ef510 con 0x7f06a800f3d0 2024-05-09T09:48:01.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.010+0000 7f06b2022640 1 --2- 172.21.15.157:0/894778611 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f06a800f3d0 0x7f06a800f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.010+0000 7f06b2022640 1 --2- 172.21.15.157:0/894778611 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f06a800f3d0 0x7f06a800f7f0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.010+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a40083f0 con 0x7f06a800f3d0 2024-05-09T09:48:01.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.010+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x56394f8e8140 2024-05-09T09:48:01.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.010+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06ac0ec030 con 0x56394f8e8140 2024-05-09T09:48:01.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.010+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x56394f8e3750 2024-05-09T09:48:01.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.010+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a40083f0 con 0x56394f8e3750 2024-05-09T09:48:01.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.010+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x56394f8e3750 2024-05-09T09:48:01.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.010+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a4026040 con 0x56394f8e3750 2024-05-09T09:48:01.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.010+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x56394f8e8140 2024-05-09T09:48:01.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.010+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06ac0ec030 con 0x56394f8e8140 2024-05-09T09:48:01.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.010+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x56394f8e8140 2024-05-09T09:48:01.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.014+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06ac0ec030 con 0x56394f8e8140 2024-05-09T09:48:01.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.014+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x7f06a800f3d0 2024-05-09T09:48:01.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.014+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a4026040 con 0x7f06a800f3d0 2024-05-09T09:48:01.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.014+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x56394f8eca20 2024-05-09T09:48:01.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.014+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a8036040 con 0x56394f8eca20 2024-05-09T09:48:01.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.014+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x56394f8e3750 2024-05-09T09:48:01.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.014+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a4026040 con 0x56394f8e3750 2024-05-09T09:48:01.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.014+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x56394f8e8140 2024-05-09T09:48:01.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.014+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06ac0ec030 con 0x56394f8e8140 2024-05-09T09:48:01.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.014+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x56394f8e3750 2024-05-09T09:48:01.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.014+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a4026040 con 0x56394f8e3750 2024-05-09T09:48:01.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.014+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x7f06a800f3d0 2024-05-09T09:48:01.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.014+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f06a4026040 con 0x7f06a800f3d0 2024-05-09T09:48:01.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.014+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x56394f8eca20 2024-05-09T09:48:01.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.014+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a8036040 con 0x56394f8eca20 2024-05-09T09:48:01.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.014+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x56394f8eca20 2024-05-09T09:48:01.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.014+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f06a8036040 con 0x56394f8eca20 2024-05-09T09:48:01.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.014+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x56394f8e8140 2024-05-09T09:48:01.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.018+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06ac0ec030 con 0x56394f8e8140 2024-05-09T09:48:01.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.018+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x56394f8eca20 2024-05-09T09:48:01.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.018+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a8036040 con 0x56394f8eca20 2024-05-09T09:48:01.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.018+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x56394f8eca20 2024-05-09T09:48:01.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.018+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a8036040 con 0x56394f8eca20 2024-05-09T09:48:01.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.018+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x56394f8e3750 2024-05-09T09:48:01.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.018+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a4026040 con 0x56394f8e3750 2024-05-09T09:48:01.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.018+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x56394f8e3750 2024-05-09T09:48:01.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.018+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f06a4026040 con 0x56394f8e3750 2024-05-09T09:48:01.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.018+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x56394f8e8140 2024-05-09T09:48:01.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.018+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06ac0ec030 con 0x56394f8e8140 2024-05-09T09:48:01.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.018+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x56394f8eca20 2024-05-09T09:48:01.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.018+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a8036040 con 0x56394f8eca20 2024-05-09T09:48:01.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.018+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x7f06a800f3d0 2024-05-09T09:48:01.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.018+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a4026040 con 0x7f06a800f3d0 2024-05-09T09:48:01.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.018+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x56394f8e3750 2024-05-09T09:48:01.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.018+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a4026040 con 0x56394f8e3750 2024-05-09T09:48:01.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.018+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x56394f8e8140 2024-05-09T09:48:01.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.018+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f06ac0ec030 con 0x56394f8e8140 2024-05-09T09:48:01.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.018+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x56394f8eca20 2024-05-09T09:48:01.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a8036040 con 0x56394f8eca20 2024-05-09T09:48:01.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x56394f8e8140 2024-05-09T09:48:01.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06ac0ec030 con 0x56394f8e8140 2024-05-09T09:48:01.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x7f06a800f3d0 2024-05-09T09:48:01.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a4026040 con 0x7f06a800f3d0 2024-05-09T09:48:01.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x56394f8eca20 2024-05-09T09:48:01.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a8049040 con 0x56394f8eca20 2024-05-09T09:48:01.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x56394f8e8140 2024-05-09T09:48:01.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06ac0ec030 con 0x56394f8e8140 2024-05-09T09:48:01.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x56394f8e3750 2024-05-09T09:48:01.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f06a4026040 con 0x56394f8e3750 2024-05-09T09:48:01.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56394f8e73e0 con 0x7f06a800f3d0 2024-05-09T09:48:01.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06a4026040 con 0x7f06a800f3d0 2024-05-09T09:48:01.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b3d06980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:48:01.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b3d06980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:48:01.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b3d06980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:48:01.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b3d06980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:48:01.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b3d06980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:48:01.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b3d06980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:48:01.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b3d06980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56394f8eb390 con 0x56394f8e3750 2024-05-09T09:48:01.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06a4026040 con 0x56394f8e3750 2024-05-09T09:48:01.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b3d06980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:01.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b3d06980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56394f8eb390 con 0x56394f8e3750 2024-05-09T09:48:01.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f06a4026040 con 0x56394f8e3750 2024-05-09T09:48:01.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b3d06980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:01.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b3d06980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56394f8eb390 con 0x56394f8eca20 2024-05-09T09:48:01.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f06a8049040 con 0x56394f8eca20 2024-05-09T09:48:01.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b3d06980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:48:01.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b3d06980 20 zone default found 2024-05-09T09:48:01.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b3d06980 4 Realm: () 2024-05-09T09:48:01.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b3d06980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:48:01.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b3d06980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:48:01.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b3d06980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:48:01.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b3d06980 20 zonegroup default 2024-05-09T09:48:01.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b3d06980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.022+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56394f8ebdc0 con 0x56394f8e8140 2024-05-09T09:48:01.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.026+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f06ac0ec030 con 0x56394f8e8140 2024-05-09T09:48:01.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.026+0000 7f06b3d06980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:01.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.026+0000 7f06b3d06980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.026+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56394f8f1820 con 0x56394f8eca20 2024-05-09T09:48:01.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.026+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f06a8049040 con 0x56394f8eca20 2024-05-09T09:48:01.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.026+0000 7f06b3d06980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:01.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.026+0000 7f06b3d06980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.026+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56394f8f1bc0 con 0x56394f8eca20 2024-05-09T09:48:01.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.026+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f06a8049040 con 0x56394f8eca20 2024-05-09T09:48:01.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.026+0000 7f06b3d06980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:01.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.026+0000 7f06b3d06980 20 started sync module instance, tier type = 2024-05-09T09:48:01.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.026+0000 7f06b3d06980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:48:01.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.026+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f8f0c60 con 0x7f06a800f3d0 2024-05-09T09:48:01.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.026+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a4026040 con 0x7f06a800f3d0 2024-05-09T09:48:01.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.026+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94804147900496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f8f0c60 con 0x7f06a800f3d0 2024-05-09T09:48:01.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.026+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f8f2410 con 0x56394f8e3750 2024-05-09T09:48:01.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.026+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94804147900496] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a4036040 con 0x7f06a800f3d0 2024-05-09T09:48:01.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.030+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a4036040 con 0x56394f8e3750 2024-05-09T09:48:01.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.030+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94804147904624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f8f0c60 con 0x56394f8e3750 2024-05-09T09:48:01.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.030+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f8f2e50 con 0x56394f8eca20 2024-05-09T09:48:01.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.030+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a8049040 con 0x56394f8eca20 2024-05-09T09:48:01.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.030+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94804147906976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f8f36a0 con 0x56394f8eca20 2024-05-09T09:48:01.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.030+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f8f4060 con 0x7f06a800f3d0 2024-05-09T09:48:01.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.030+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94804147904624] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a4036040 con 0x56394f8e3750 2024-05-09T09:48:01.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.034+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a4036040 con 0x7f06a800f3d0 2024-05-09T09:48:01.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.034+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94804147898288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f8f4060 con 0x7f06a800f3d0 2024-05-09T09:48:01.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.034+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f8f4aa0 con 0x56394f8e3750 2024-05-09T09:48:01.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.034+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94804147906976] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a8049040 con 0x56394f8eca20 2024-05-09T09:48:01.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.034+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94804147898288] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a4036040 con 0x7f06a800f3d0 2024-05-09T09:48:01.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.034+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a4036040 con 0x56394f8e3750 2024-05-09T09:48:01.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.034+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94804147911600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f8f45f0 con 0x56394f8e3750 2024-05-09T09:48:01.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.034+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f8f4e40 con 0x56394f8e8140 2024-05-09T09:48:01.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.038+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94804147911600] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a4036040 con 0x56394f8e3750 2024-05-09T09:48:01.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.038+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06ac0ec030 con 0x56394f8e8140 2024-05-09T09:48:01.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.038+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94804147914224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f8f4a10 con 0x56394f8e8140 2024-05-09T09:48:01.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.038+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f8f5b40 con 0x56394f8e8140 2024-05-09T09:48:01.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.038+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94804147914224] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06ac0ec030 con 0x56394f8e8140 2024-05-09T09:48:01.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.038+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06ac0ec030 con 0x56394f8e8140 2024-05-09T09:48:01.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.038+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94804147917760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f8f5db0 con 0x56394f8e8140 2024-05-09T09:48:01.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.038+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f8f68d0 con 0x56394f8e8140 2024-05-09T09:48:01.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.042+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06ac0ec030 con 0x56394f8e8140 2024-05-09T09:48:01.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.042+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94804147921824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f8f6d40 con 0x56394f8e8140 2024-05-09T09:48:01.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.042+0000 7f06b3d06980 20 add_watcher() i=0 2024-05-09T09:48:01.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.042+0000 7f06b3d06980 20 add_watcher() i=1 2024-05-09T09:48:01.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.042+0000 7f06b3d06980 20 add_watcher() i=2 2024-05-09T09:48:01.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.042+0000 7f06b3d06980 20 add_watcher() i=3 2024-05-09T09:48:01.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.042+0000 7f06b3d06980 20 add_watcher() i=4 2024-05-09T09:48:01.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.042+0000 7f06b3d06980 20 add_watcher() i=5 2024-05-09T09:48:01.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.042+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94804147917760] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06ac0ec030 con 0x56394f8e8140 2024-05-09T09:48:01.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.042+0000 7f06b3d06980 20 add_watcher() i=6 2024-05-09T09:48:01.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.042+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94804147921824] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06ac0ec030 con 0x56394f8e8140 2024-05-09T09:48:01.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.042+0000 7f06b3d06980 20 add_watcher() i=7 2024-05-09T09:48:01.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.042+0000 7f06b3d06980 2 all 8 watchers are set, enabling cache 2024-05-09T09:48:01.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.046+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56394f8f6d40 con 0x56394f8e3750 2024-05-09T09:48:01.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.046+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f06a4036040 con 0x56394f8e3750 2024-05-09T09:48:01.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.046+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94804147923088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f8f6cb0 con 0x56394f8e3750 2024-05-09T09:48:01.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.046+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94804147923088] v32'310 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f06a4036040 con 0x56394f8e3750 2024-05-09T09:48:01.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.046+0000 7f05677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:01.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.046+0000 7f06b3d06980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:48:01.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.046+0000 7f06b3d06980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:48:01.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.046+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f9026e0 con 0x56394f8e3750 2024-05-09T09:48:01.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.046+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'75 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f06a4036040 con 0x56394f8e3750 2024-05-09T09:48:01.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.050+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f902db0 con 0x56394f8e8140 2024-05-09T09:48:01.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.050+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'69 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f06ac0ec030 con 0x56394f8e8140 2024-05-09T09:48:01.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.050+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f902db0 con 0x56394f8eca20 2024-05-09T09:48:01.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.050+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'68 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f06a8049040 con 0x56394f8eca20 2024-05-09T09:48:01.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.050+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f9033a0 con 0x56394f8e3750 2024-05-09T09:48:01.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.054+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'311 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f06a4036040 con 0x56394f8e3750 2024-05-09T09:48:01.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.054+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f903850 con 0x7f06a800f3d0 2024-05-09T09:48:01.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.054+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'194 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f06a4036040 con 0x7f06a800f3d0 2024-05-09T09:48:01.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.054+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f903dc0 con 0x56394f8eca20 2024-05-09T09:48:01.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.054+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'130 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f06a8049040 con 0x56394f8eca20 2024-05-09T09:48:01.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.054+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f904270 con 0x56394f8e3750 2024-05-09T09:48:01.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.058+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'70 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f06a4036040 con 0x56394f8e3750 2024-05-09T09:48:01.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.058+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f9040a0 con 0x56394f8e8140 2024-05-09T09:48:01.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.058+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'129 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f06ac0ec030 con 0x56394f8e8140 2024-05-09T09:48:01.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.058+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f900400 con 0x7f06a800f3d0 2024-05-09T09:48:01.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.062+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'68 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f06a4036040 con 0x7f06a800f3d0 2024-05-09T09:48:01.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.062+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f900400 con 0x56394f8eca20 2024-05-09T09:48:01.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.062+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'74 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f06a8049040 con 0x56394f8eca20 2024-05-09T09:48:01.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.062+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f900400 con 0x7f06a800f3d0 2024-05-09T09:48:01.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.066+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'195 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06a4036040 con 0x7f06a800f3d0 2024-05-09T09:48:01.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.066+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f900400 con 0x56394f8e8140 2024-05-09T09:48:01.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.066+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'71 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06ac0ec030 con 0x56394f8e8140 2024-05-09T09:48:01.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.066+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f900400 con 0x7f06a800f3d0 2024-05-09T09:48:01.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.066+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'68 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06a4036040 con 0x7f06a800f3d0 2024-05-09T09:48:01.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.066+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f900400 con 0x56394f8e8140 2024-05-09T09:48:01.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.070+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'135 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06ac0ec030 con 0x56394f8e8140 2024-05-09T09:48:01.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.070+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f900400 con 0x56394f8e3750 2024-05-09T09:48:01.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.070+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'312 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06a4036040 con 0x56394f8e3750 2024-05-09T09:48:01.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.070+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f900400 con 0x56394f8eca20 2024-05-09T09:48:01.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.074+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'188 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06a8049040 con 0x56394f8eca20 2024-05-09T09:48:01.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.074+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f900490 con 0x7f06a800f3d0 2024-05-09T09:48:01.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.074+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'196 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06a4036040 con 0x7f06a800f3d0 2024-05-09T09:48:01.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.074+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f900490 con 0x56394f8eca20 2024-05-09T09:48:01.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.078+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'68 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06a8049040 con 0x56394f8eca20 2024-05-09T09:48:01.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.078+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f900520 con 0x56394f8e3750 2024-05-09T09:48:01.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.078+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'76 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06a4036040 con 0x56394f8e3750 2024-05-09T09:48:01.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.078+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f904c00 con 0x56394f8e3750 2024-05-09T09:48:01.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.082+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'313 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06a4036040 con 0x56394f8e3750 2024-05-09T09:48:01.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.082+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f904c00 con 0x56394f8eca20 2024-05-09T09:48:01.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.082+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'189 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06a8049040 con 0x56394f8eca20 2024-05-09T09:48:01.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.082+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f904c00 con 0x7f06a800f3d0 2024-05-09T09:48:01.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.086+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'80 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06a4036040 con 0x7f06a800f3d0 2024-05-09T09:48:01.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.086+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f904c00 con 0x56394f8eca20 2024-05-09T09:48:01.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.086+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'70 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06a8049040 con 0x56394f8eca20 2024-05-09T09:48:01.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.086+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f904c00 con 0x56394f8eca20 2024-05-09T09:48:01.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.086+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'74 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06a8049040 con 0x56394f8eca20 2024-05-09T09:48:01.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.086+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f904c00 con 0x56394f8eca20 2024-05-09T09:48:01.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.090+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'64 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06a8049040 con 0x56394f8eca20 2024-05-09T09:48:01.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.090+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f904c00 con 0x56394f8eca20 2024-05-09T09:48:01.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.090+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'131 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06a8049040 con 0x56394f8eca20 2024-05-09T09:48:01.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.090+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f904c00 con 0x56394f8e8140 2024-05-09T09:48:01.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.094+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'70 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06ac0ec030 con 0x56394f8e8140 2024-05-09T09:48:01.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.094+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f904c00 con 0x56394f8eca20 2024-05-09T09:48:01.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.094+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'68 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06a8049040 con 0x56394f8eca20 2024-05-09T09:48:01.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.094+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f904c00 con 0x56394f8e8140 2024-05-09T09:48:01.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.098+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'130 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06ac0ec030 con 0x56394f8e8140 2024-05-09T09:48:01.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.098+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f904c00 con 0x56394f8eca20 2024-05-09T09:48:01.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.102+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'190 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06a8049040 con 0x56394f8eca20 2024-05-09T09:48:01.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.102+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f904c00 con 0x56394f8e8140 2024-05-09T09:48:01.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.106+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'136 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06ac0ec030 con 0x56394f8e8140 2024-05-09T09:48:01.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.106+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f904c00 con 0x7f06a800f3d0 2024-05-09T09:48:01.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.106+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'74 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06a4036040 con 0x7f06a800f3d0 2024-05-09T09:48:01.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.106+0000 7f05667e4640 20 reqs_thread_entry: start 2024-05-09T09:48:01.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.106+0000 7f06b3d06980 20 init_complete bucket index max shards: 11 2024-05-09T09:48:01.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.106+0000 7f055ffff640 20 reqs_thread_entry: start 2024-05-09T09:48:01.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.106+0000 7f06b3d06980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-09T09:48:01.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.106+0000 7f06b3d06980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.106+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56394f8ffc70 con 0x7f06a800f3d0 2024-05-09T09:48:01.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.110+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f06a4036040 con 0x7f06a800f3d0 2024-05-09T09:48:01.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.110+0000 7f06b3d06980 20 rados_obj.operate() r=0 bl.length=165 2024-05-09T09:48:01.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.110+0000 7f06b3d06980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-09T09:48:01.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.110+0000 7f06b3d06980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-09T09:48:01.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.110+0000 7f06b3d06980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5 : miss 2024-05-09T09:48:01.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.110+0000 7f06b3d06980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.110+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:95 8.1 8:85b9a1ed:root::.bucket.meta.myfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56394f922290 con 0x56394f8e8140 2024-05-09T09:48:01.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.110+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(95 .bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f06ac0ec030 con 0x56394f8e8140 2024-05-09T09:48:01.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.110+0000 7f06b3d06980 20 rados_obj.operate() r=0 bl.length=379 2024-05-09T09:48:01.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.110+0000 7f06b3d06980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5 info.flags=0x17 2024-05-09T09:48:01.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.110+0000 7f06b3d06980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5 to cache LRU end 2024-05-09T09:48:01.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.110+0000 7f06b3d06980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:48:01.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.110+0000 7f06b3d06980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-09T09:48:01.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.110+0000 7f06b3d06980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5 2024-05-09T09:48:01.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.110+0000 7f06b3d06980 20 get_obj_state: octx=0x7f06a4008c50 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x56394f924958 s->prefetch_data=0 2024-05-09T09:48:01.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.110+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:96 3.29s0 3:96eeab6a:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56394f925780 con 0x56394f8e8140 2024-05-09T09:48:01.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.110+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(96 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=847b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+863 (crc 0 0 0) 0x7f06ac0ec030 con 0x56394f8e8140 2024-05-09T09:48:01.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.110+0000 7f06b3d06980 10 manifest: total_size = 5 2024-05-09T09:48:01.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.110+0000 7f06b3d06980 20 get_obj_state: setting s->obj_tag to _GwIsgzJVZLDtd7JSjKGhdmb4Gs0dWpu 2024-05-09T09:48:01.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.110+0000 7f05677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:01.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.110+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94804147923088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f8fef60 con 0x56394f8e3750 2024-05-09T09:48:01.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.114+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(97 data_loggenerations_metadata [watch unwatch cookie 94804147923088] v32'314 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f06a4036040 con 0x56394f8e3750 2024-05-09T09:48:01.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.114+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:98 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94804147900496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f8f6890 con 0x7f06a800f3d0 2024-05-09T09:48:01.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.114+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(98 notify.0 [watch unwatch cookie 94804147900496] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a4036040 con 0x7f06a800f3d0 2024-05-09T09:48:01.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.114+0000 7f06b3d06980 20 remove_watcher() i=0 2024-05-09T09:48:01.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.114+0000 7f06b3d06980 2 removed watcher, disabling cache 2024-05-09T09:48:01.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.114+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:99 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94804147904624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f8f6890 con 0x56394f8e3750 2024-05-09T09:48:01.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.118+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(99 notify.1 [watch unwatch cookie 94804147904624] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a4036040 con 0x56394f8e3750 2024-05-09T09:48:01.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.118+0000 7f06b3d06980 20 remove_watcher() i=1 2024-05-09T09:48:01.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.118+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:100 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94804147906976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f8f6890 con 0x56394f8eca20 2024-05-09T09:48:01.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.118+0000 7f06b1020640 1 -- 172.21.15.157:0/894778611 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(100 notify.2 [watch unwatch cookie 94804147906976] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a8049040 con 0x56394f8eca20 2024-05-09T09:48:01.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.118+0000 7f06b3d06980 20 remove_watcher() i=2 2024-05-09T09:48:01.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.118+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:101 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94804147898288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f8f6890 con 0x7f06a800f3d0 2024-05-09T09:48:01.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.118+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(101 notify.3 [watch unwatch cookie 94804147898288] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a4036040 con 0x7f06a800f3d0 2024-05-09T09:48:01.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.118+0000 7f06b3d06980 20 remove_watcher() i=3 2024-05-09T09:48:01.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.118+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94804147911600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f8f07b0 con 0x56394f8e3750 2024-05-09T09:48:01.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.122+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(102 notify.4 [watch unwatch cookie 94804147911600] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06a4036040 con 0x56394f8e3750 2024-05-09T09:48:01.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.122+0000 7f06b3d06980 20 remove_watcher() i=4 2024-05-09T09:48:01.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.122+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94804147914224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f8f6890 con 0x56394f8e8140 2024-05-09T09:48:01.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.122+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(103 notify.5 [watch unwatch cookie 94804147914224] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06ac0ec030 con 0x56394f8e8140 2024-05-09T09:48:01.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.122+0000 7f06b3d06980 20 remove_watcher() i=5 2024-05-09T09:48:01.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.122+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94804147917760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f8f3bb0 con 0x56394f8e8140 2024-05-09T09:48:01.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.126+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(104 notify.6 [watch unwatch cookie 94804147917760] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06ac0ec030 con 0x56394f8e8140 2024-05-09T09:48:01.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.126+0000 7f06b3d06980 20 remove_watcher() i=6 2024-05-09T09:48:01.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.126+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:105 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94804147921824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56394f8f45f0 con 0x56394f8e8140 2024-05-09T09:48:01.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b1821640 1 -- 172.21.15.157:0/894778611 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(105 notify.7 [watch unwatch cookie 94804147921824] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06ac0ec030 con 0x56394f8e8140 2024-05-09T09:48:01.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 20 remove_watcher() i=7 2024-05-09T09:48:01.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56394f8e8140 msgr2=0x56394f8ea530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 --2- 172.21.15.157:0/894778611 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56394f8e8140 0x56394f8ea530 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56394f8e3750 msgr2=0x56394f8e5c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 --2- 172.21.15.157:0/894778611 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56394f8e3750 0x56394f8e5c10 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f06a800f3d0 msgr2=0x7f06a800f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 --2- 172.21.15.157:0/894778611 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f06a800f3d0 0x7f06a800f7f0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56394f8eca20 msgr2=0x56394f8eee90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 --2- 172.21.15.157:0/894778611 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56394f8eca20 0x56394f8eee90 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f057c034c00 msgr2=0x7f057c0370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 --2- 172.21.15.157:0/894778611 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f057c034c00 0x7f057c0370c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x56394f89ace0 tx=0x7f06a8011000 comp rx=0 tx=0).stop 2024-05-09T09:48:01.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f798410 msgr2=0x56394f8d6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 --2- 172.21.15.157:0/894778611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f798410 0x56394f8d6be0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f06ac0a5640 tx=0x7f06ac0d4ed0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 reap_dead start 2024-05-09T09:48:01.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b2022640 1 -- 172.21.15.157:0/894778611 reap_dead start 2024-05-09T09:48:01.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 shutdown_connections 2024-05-09T09:48:01.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 >> 172.21.15.157:0/894778611 conn(0x56394f8c9a70 msgr2=0x56394f8c70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:01.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 shutdown_connections 2024-05-09T09:48:01.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 -- 172.21.15.157:0/894778611 wait complete. 2024-05-09T09:48:01.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 -- 172.21.15.157:0/1255688895 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f058c034c00 msgr2=0x7f058c0370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 --2- 172.21.15.157:0/1255688895 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f058c034c00 0x7f058c0370c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x56394f88ecc0 tx=0x7f06a8006000 comp rx=0 tx=0).stop 2024-05-09T09:48:01.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 -- 172.21.15.157:0/1255688895 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f8c07c0 msgr2=0x56394f8c0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 --2- 172.21.15.157:0/1255688895 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f8c07c0 0x56394f8c0be0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f06ac0b5d40 tx=0x7f06ac0a9e80 comp rx=0 tx=0).stop 2024-05-09T09:48:01.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 -- 172.21.15.157:0/1255688895 shutdown_connections 2024-05-09T09:48:01.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 --2- 172.21.15.157:0/1255688895 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f058c034c00 0x7f058c0370c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 --2- 172.21.15.157:0/1255688895 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f8c07c0 0x56394f8c0be0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 -- 172.21.15.157:0/1255688895 >> 172.21.15.157:0/1255688895 conn(0x56394f8b5590 msgr2=0x56394f8b60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:01.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 -- 172.21.15.157:0/1255688895 shutdown_connections 2024-05-09T09:48:01.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 -- 172.21.15.157:0/1255688895 wait complete. 2024-05-09T09:48:01.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 -- 172.21.15.157:0/2397520106 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56394f893d50 msgr2=0x56394f8961e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 --2- 172.21.15.157:0/2397520106 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56394f893d50 0x56394f8961e0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 -- 172.21.15.157:0/2397520106 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56394f7999d0 msgr2=0x56394f891590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 --2- 172.21.15.157:0/2397520106 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56394f7999d0 0x56394f891590 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 -- 172.21.15.157:0/2397520106 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56394f897dd0 msgr2=0x56394f89a1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 --2- 172.21.15.157:0/2397520106 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56394f897dd0 0x56394f89a1c0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 -- 172.21.15.157:0/2397520106 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0598034bb0 msgr2=0x7f0598037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 --2- 172.21.15.157:0/2397520106 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0598034bb0 0x7f0598037070 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f06a8001e20 tx=0x7f06a80013a0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 -- 172.21.15.157:0/2397520106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f7990b0 msgr2=0x56394f88a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 --2- 172.21.15.157:0/2397520106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56394f7990b0 0x56394f88a4e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f06ac01b0d0 tx=0x7f06ac017e30 comp rx=0 tx=0).stop 2024-05-09T09:48:01.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b2022640 1 -- 172.21.15.157:0/2397520106 reap_dead start 2024-05-09T09:48:01.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 -- 172.21.15.157:0/2397520106 shutdown_connections 2024-05-09T09:48:01.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 -- 172.21.15.157:0/2397520106 >> 172.21.15.157:0/2397520106 conn(0x56394f791860 msgr2=0x56394f87dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:01.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 -- 172.21.15.157:0/2397520106 shutdown_connections 2024-05-09T09:48:01.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.130+0000 7f06b3d06980 1 -- 172.21.15.157:0/2397520106 wait complete. 2024-05-09T09:48:01.142 INFO:teuthology.orchestra.run.smithi157.stdout:fooFoofooFooFULL_CONTROL 2024-05-09T09:48:01.143 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-05-09T09:48:01.147 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-05-09T09:48:01.157 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-09T09:48:01.157 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-05-09T09:48:01.157 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-05-09T09:48:01.157 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-05-09T09:48:01.223 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:48:01.223 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:48:01.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.222+0000 7f50ff9c5980 1 Processor -- start 2024-05-09T09:48:01.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.222+0000 7f50ff9c5980 1 -- start start 2024-05-09T09:48:01.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.226+0000 7f50ff9c5980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x562510751990 0x562510751d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.226+0000 7f50ff9c5980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562510607440 con 0x5625107522b0 2024-05-09T09:48:01.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.226+0000 7f50ff9c5980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5625105f25f0 con 0x562510751990 2024-05-09T09:48:01.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.226+0000 7f50fd4e0640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x562510751990 0x562510751d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.226+0000 7f50fd4e0640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x562510751990 0x562510751d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35062/0 (socket says 172.21.15.157:35062) 2024-05-09T09:48:01.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.226+0000 7f50fd4e0640 1 -- 172.21.15.157:0/4208655975 learned_addr learned my addr 172.21.15.157:0/4208655975 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:01.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.226+0000 7f50fd4e0640 1 -- 172.21.15.157:0/4208655975 >> v1:172.21.15.110:6789/0 conn(0x5625107522b0 legacy=0x562510752c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.226+0000 7f50fd4e0640 1 -- 172.21.15.157:0/4208655975 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625105fd990 con 0x562510751990 2024-05-09T09:48:01.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.226+0000 7f50fd4e0640 1 --2- 172.21.15.157:0/4208655975 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562510751990 0x562510751d70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f50f000a4e0 tx=0x7f50f001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4efa91bd8d0370e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.230+0000 7f50effff640 1 -- 172.21.15.157:0/4208655975 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50f00aa540 con 0x562510751990 2024-05-09T09:48:01.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.230+0000 7f50effff640 1 -- 172.21.15.157:0/4208655975 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f00aa6e0 con 0x562510751990 2024-05-09T09:48:01.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.230+0000 7f50effff640 1 -- 172.21.15.157:0/4208655975 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50f00aaa40 con 0x562510751990 2024-05-09T09:48:01.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.230+0000 7f50ff9c5980 1 -- 172.21.15.157:0/4208655975 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562510751990 msgr2=0x562510751d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.230+0000 7f50ff9c5980 1 --2- 172.21.15.157:0/4208655975 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562510751990 0x562510751d70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f50f000a4e0 tx=0x7f50f001b090 comp rx=0 tx=0).stop 2024-05-09T09:48:01.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.230+0000 7f50ff9c5980 1 -- 172.21.15.157:0/4208655975 shutdown_connections 2024-05-09T09:48:01.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.230+0000 7f50ff9c5980 1 --2- 172.21.15.157:0/4208655975 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562510751990 0x562510751d70 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.230+0000 7f50ff9c5980 1 -- 172.21.15.157:0/4208655975 >> 172.21.15.157:0/4208655975 conn(0x56251074d260 msgr2=0x56251074f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:01.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.230+0000 7f50ff9c5980 1 -- 172.21.15.157:0/4208655975 shutdown_connections 2024-05-09T09:48:01.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.230+0000 7f50ff9c5980 1 -- 172.21.15.157:0/4208655975 wait complete. 2024-05-09T09:48:01.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.246+0000 7f50ff9c5980 1 Processor -- start 2024-05-09T09:48:01.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.246+0000 7f50ff9c5980 1 -- start start 2024-05-09T09:48:01.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.246+0000 7f50ff9c5980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562510751990 0x56251083d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.246+0000 7f50ff9c5980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x562510654fe0 con 0x562510751990 2024-05-09T09:48:01.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.246+0000 7f50fd4e0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562510751990 0x56251083d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.246+0000 7f50fd4e0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562510751990 0x56251083d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35074/0 (socket says 172.21.15.157:35074) 2024-05-09T09:48:01.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.246+0000 7f50fd4e0640 1 -- 172.21.15.157:0/3669382658 learned_addr learned my addr 172.21.15.157:0/3669382658 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:01.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.246+0000 7f50fd4e0640 1 -- 172.21.15.157:0/3669382658 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625105d9ae0 con 0x562510751990 2024-05-09T09:48:01.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.246+0000 7f50fd4e0640 1 --2- 172.21.15.157:0/3669382658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562510751990 0x56251083d230 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f50f00ac040 tx=0x7f50f00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a4fbc98c8a4645 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.246+0000 7f4feb606640 1 -- 172.21.15.157:0/3669382658 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50f00b9030 con 0x562510751990 2024-05-09T09:48:01.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.246+0000 7f4feb606640 1 -- 172.21.15.157:0/3669382658 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f00aaa40 con 0x562510751990 2024-05-09T09:48:01.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.246+0000 7f4feb606640 1 -- 172.21.15.157:0/3669382658 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50f00aad20 con 0x562510751990 2024-05-09T09:48:01.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.250+0000 7f50ff9c5980 1 -- 172.21.15.157:0/3669382658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562510751990 msgr2=0x56251083d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.250+0000 7f50ff9c5980 1 --2- 172.21.15.157:0/3669382658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562510751990 0x56251083d230 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f50f00ac040 tx=0x7f50f00033b0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.250+0000 7f50ff9c5980 1 -- 172.21.15.157:0/3669382658 shutdown_connections 2024-05-09T09:48:01.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.250+0000 7f50ff9c5980 1 --2- 172.21.15.157:0/3669382658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562510751990 0x56251083d230 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.250+0000 7f50ff9c5980 1 -- 172.21.15.157:0/3669382658 >> 172.21.15.157:0/3669382658 conn(0x56251074d260 msgr2=0x562510838dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:01.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.250+0000 7f50ff9c5980 1 -- 172.21.15.157:0/3669382658 shutdown_connections 2024-05-09T09:48:01.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.250+0000 7f50ff9c5980 1 -- 172.21.15.157:0/3669382658 wait complete. 2024-05-09T09:48:01.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.250+0000 7f50ff9c5980 1 Processor -- start 2024-05-09T09:48:01.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.250+0000 7f50ff9c5980 1 -- start start 2024-05-09T09:48:01.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.250+0000 7f50ff9c5980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562510751990 0x562510844330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.250+0000 7f50ff9c5980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56251075b990 con 0x562510751990 2024-05-09T09:48:01.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.250+0000 7f50fd4e0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562510751990 0x562510844330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.250+0000 7f50fd4e0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562510751990 0x562510844330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35076/0 (socket says 172.21.15.157:35076) 2024-05-09T09:48:01.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.250+0000 7f50fd4e0640 1 -- 172.21.15.157:0/618779068 learned_addr learned my addr 172.21.15.157:0/618779068 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:01.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.250+0000 7f50fd4e0640 1 -- 172.21.15.157:0/618779068 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562510844870 con 0x562510751990 2024-05-09T09:48:01.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.250+0000 7f50fd4e0640 1 --2- 172.21.15.157:0/618779068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562510751990 0x562510844330 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f50f0000f90 tx=0x7f50f0017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.250+0000 7f4fe9e03640 1 -- 172.21.15.157:0/618779068 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50f00b9030 con 0x562510751990 2024-05-09T09:48:01.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.250+0000 7f4fe9e03640 1 -- 172.21.15.157:0/618779068 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f00c2070 con 0x562510751990 2024-05-09T09:48:01.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.250+0000 7f50ff9c5980 1 -- 172.21.15.157:0/618779068 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562510844b00 con 0x562510751990 2024-05-09T09:48:01.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.250+0000 7f50ff9c5980 1 -- 172.21.15.157:0/618779068 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562510847790 con 0x562510751990 2024-05-09T09:48:01.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.250+0000 7f4fe9e03640 1 -- 172.21.15.157:0/618779068 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50f00cb060 con 0x562510751990 2024-05-09T09:48:01.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.254+0000 7f4fe9e03640 1 -- 172.21.15.157:0/618779068 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f50f00c4030 con 0x562510751990 2024-05-09T09:48:01.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.254+0000 7f4fe9e03640 1 --2- 172.21.15.157:0/618779068 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4fe4034c00 0x7f4fe40370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.254+0000 7f4fe9e03640 1 -- 172.21.15.157:0/618779068 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f50f00ba070 con 0x562510751990 2024-05-09T09:48:01.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.254+0000 7f50fccdf640 1 --2- 172.21.15.157:0/618779068 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4fe4034c00 0x7f4fe40370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.254+0000 7f50ff9c5980 1 --2- 172.21.15.157:0/618779068 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5625107522b0 0x56251084b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.254+0000 7f50ff9c5980 1 -- 172.21.15.157:0/618779068 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56251084b890 con 0x5625107522b0 2024-05-09T09:48:01.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.254+0000 7f50fdce1640 1 --2- 172.21.15.157:0/618779068 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5625107522b0 0x56251084b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.254+0000 7f50fccdf640 1 --2- 172.21.15.157:0/618779068 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4fe4034c00 0x7f4fe40370c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f50f4001e20 tx=0x7f50f40013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.254+0000 7f50fdce1640 1 --2- 172.21.15.157:0/618779068 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5625107522b0 0x56251084b270 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.254+0000 7f50fdce1640 1 -- 172.21.15.157:0/618779068 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50f80083f0 con 0x5625107522b0 2024-05-09T09:48:01.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.254+0000 7f50ff9c5980 1 -- 172.21.15.157:0/618779068 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56251084c170 con 0x5625107522b0 2024-05-09T09:48:01.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.254+0000 7f50fdce1640 1 -- 172.21.15.157:0/618779068 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f50f80083f0 con 0x5625107522b0 2024-05-09T09:48:01.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.254+0000 7f50ff9c5980 1 --2- 172.21.15.157:0/618779068 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56251084da80 0x56251084ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.254+0000 7f50ff9c5980 1 -- 172.21.15.157:0/618779068 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625108506b0 con 0x56251084da80 2024-05-09T09:48:01.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.254+0000 7f50fd4e0640 1 --2- 172.21.15.157:0/618779068 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56251084da80 0x56251084ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.254+0000 7f50fd4e0640 1 --2- 172.21.15.157:0/618779068 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56251084da80 0x56251084ff20 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.258+0000 7f50fd4e0640 1 -- 172.21.15.157:0/618779068 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f50f00cfcc0 con 0x56251084da80 2024-05-09T09:48:01.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.258+0000 7f50ff9c5980 1 -- 172.21.15.157:0/618779068 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56251084c9c0 con 0x5625107522b0 2024-05-09T09:48:01.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.258+0000 7f50fdce1640 1 -- 172.21.15.157:0/618779068 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f50f80083f0 con 0x5625107522b0 2024-05-09T09:48:01.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.258+0000 7f50ff9c5980 1 --2- 172.21.15.157:0/618779068 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x562510851b10 0x562510853f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.258+0000 7f50ff9c5980 1 -- 172.21.15.157:0/618779068 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562510854670 con 0x562510851b10 2024-05-09T09:48:01.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.258+0000 7f50fccdf640 1 --2- 172.21.15.157:0/618779068 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x562510851b10 0x562510853f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.258+0000 7f50fccdf640 1 --2- 172.21.15.157:0/618779068 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x562510851b10 0x562510853f00 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.258+0000 7f50fccdf640 1 -- 172.21.15.157:0/618779068 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f50f400d040 con 0x562510851b10 2024-05-09T09:48:01.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.262+0000 7f50ff9c5980 1 Processor -- start 2024-05-09T09:48:01.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.262+0000 7f50ff9c5980 1 -- start start 2024-05-09T09:48:01.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.262+0000 7f50ff9c5980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5625106c8580 0x5625106c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.262+0000 7f50ff9c5980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x562510659020 con 0x5625106c8580 2024-05-09T09:48:01.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.262+0000 7f50fd4e0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5625106c8580 0x5625106c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.262+0000 7f50fd4e0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5625106c8580 0x5625106c6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35092/0 (socket says 172.21.15.157:35092) 2024-05-09T09:48:01.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.262+0000 7f50fd4e0640 1 -- 172.21.15.157:0/3146509939 learned_addr learned my addr 172.21.15.157:0/3146509939 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:01.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.262+0000 7f50fd4e0640 1 -- 172.21.15.157:0/3146509939 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625106c6f50 con 0x5625106c8580 2024-05-09T09:48:01.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.262+0000 7f50fd4e0640 1 --2- 172.21.15.157:0/3146509939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5625106c8580 0x5625106c6a10 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f50f00e3c20 tx=0x7f50f00cf690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.262+0000 7f4fe1ba0640 1 -- 172.21.15.157:0/3146509939 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50f00b4dc0 con 0x5625106c8580 2024-05-09T09:48:01.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.262+0000 7f4fe1ba0640 1 -- 172.21.15.157:0/3146509939 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f0007990 con 0x5625106c8580 2024-05-09T09:48:01.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.262+0000 7f50ff9c5980 1 -- 172.21.15.157:0/3146509939 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625106c7180 con 0x5625106c8580 2024-05-09T09:48:01.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.262+0000 7f4fe1ba0640 1 -- 172.21.15.157:0/3146509939 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50f0007c70 con 0x5625106c8580 2024-05-09T09:48:01.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.262+0000 7f50ff9c5980 1 -- 172.21.15.157:0/3146509939 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625106c7660 con 0x5625106c8580 2024-05-09T09:48:01.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.266+0000 7f4fe1ba0640 1 -- 172.21.15.157:0/3146509939 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f50f00b3040 con 0x5625106c8580 2024-05-09T09:48:01.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.266+0000 7f4fe1ba0640 1 --2- 172.21.15.157:0/3146509939 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4fd4034c50 0x7f4fd4037110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.266+0000 7f4fe1ba0640 1 -- 172.21.15.157:0/3146509939 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f50f00d6070 con 0x5625106c8580 2024-05-09T09:48:01.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.266+0000 7f50fccdf640 1 --2- 172.21.15.157:0/3146509939 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4fd4034c50 0x7f4fd4037110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.266+0000 7f50ff9c5980 1 Processor -- start 2024-05-09T09:48:01.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.266+0000 7f50ff9c5980 1 -- start start 2024-05-09T09:48:01.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.266+0000 7f50ff9c5980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56251088a8e0 0x56251088acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.266+0000 7f50ff9c5980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56251083d8c0 con 0x56251088a8e0 2024-05-09T09:48:01.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.266+0000 7f50fccdf640 1 --2- 172.21.15.157:0/3146509939 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4fd4034c50 0x7f4fd4037110 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x562510850a50 tx=0x7f50f4006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.266+0000 7f50fd4e0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56251088a8e0 0x56251088acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.266+0000 7f50fd4e0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56251088a8e0 0x56251088acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35108/0 (socket says 172.21.15.157:35108) 2024-05-09T09:48:01.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.266+0000 7f50fd4e0640 1 -- 172.21.15.157:0/2535545719 learned_addr learned my addr 172.21.15.157:0/2535545719 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:01.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.266+0000 7f50fd4e0640 1 -- 172.21.15.157:0/2535545719 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56251088b290 con 0x56251088a8e0 2024-05-09T09:48:01.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.266+0000 7f50fd4e0640 1 --2- 172.21.15.157:0/2535545719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56251088a8e0 0x56251088acc0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f50f00e3c50 tx=0x7f50f00e1f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=756867ff5d678f08 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.266+0000 7f4fdb7fe640 1 -- 172.21.15.157:0/2535545719 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50f00bde70 con 0x56251088a8e0 2024-05-09T09:48:01.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.266+0000 7f4fdb7fe640 1 -- 172.21.15.157:0/2535545719 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f00bd950 con 0x56251088a8e0 2024-05-09T09:48:01.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.266+0000 7f4fdb7fe640 1 -- 172.21.15.157:0/2535545719 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50f00ddd30 con 0x56251088a8e0 2024-05-09T09:48:01.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.266+0000 7f50ff9c5980 1 -- 172.21.15.157:0/2535545719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56251088a8e0 msgr2=0x56251088acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.266+0000 7f50ff9c5980 1 --2- 172.21.15.157:0/2535545719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56251088a8e0 0x56251088acc0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f50f00e3c50 tx=0x7f50f00e1f80 comp rx=0 tx=0).stop 2024-05-09T09:48:01.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.266+0000 7f50ff9c5980 1 -- 172.21.15.157:0/2535545719 shutdown_connections 2024-05-09T09:48:01.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.266+0000 7f50ff9c5980 1 --2- 172.21.15.157:0/2535545719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56251088a8e0 0x56251088acc0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.266+0000 7f50ff9c5980 1 -- 172.21.15.157:0/2535545719 >> 172.21.15.157:0/2535545719 conn(0x562510885980 msgr2=0x562510883a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:01.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.266+0000 7f50ff9c5980 1 -- 172.21.15.157:0/2535545719 shutdown_connections 2024-05-09T09:48:01.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.266+0000 7f50ff9c5980 1 -- 172.21.15.157:0/2535545719 wait complete. 2024-05-09T09:48:01.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.270+0000 7f50ff9c5980 1 Processor -- start 2024-05-09T09:48:01.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.270+0000 7f50ff9c5980 1 -- start start 2024-05-09T09:48:01.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.270+0000 7f50ff9c5980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56251088a8e0 0x562510890a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.270+0000 7f50ff9c5980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x562510889450 con 0x56251088a8e0 2024-05-09T09:48:01.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.270+0000 7f50fd4e0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56251088a8e0 0x562510890a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.270+0000 7f50fd4e0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56251088a8e0 0x562510890a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35110/0 (socket says 172.21.15.157:35110) 2024-05-09T09:48:01.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.270+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 learned_addr learned my addr 172.21.15.157:0/1538049122 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:01.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.270+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562510890fa0 con 0x56251088a8e0 2024-05-09T09:48:01.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.270+0000 7f50fd4e0640 1 --2- 172.21.15.157:0/1538049122 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56251088a8e0 0x562510890a60 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f50f00e3c50 tx=0x7f50f00a6f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.270+0000 7f4fd9ffb640 1 -- 172.21.15.157:0/1538049122 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50f00bd790 con 0x56251088a8e0 2024-05-09T09:48:01.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.270+0000 7f4fd9ffb640 1 -- 172.21.15.157:0/1538049122 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f0108070 con 0x56251088a8e0 2024-05-09T09:48:01.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.270+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562510890fa0 con 0x56251088a8e0 2024-05-09T09:48:01.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.270+0000 7f4fd9ffb640 1 -- 172.21.15.157:0/1538049122 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50f00e5a70 con 0x56251088a8e0 2024-05-09T09:48:01.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.270+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562510891420 con 0x56251088a8e0 2024-05-09T09:48:01.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.270+0000 7f4fd9ffb640 1 -- 172.21.15.157:0/1538049122 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f50f00e5cd0 con 0x56251088a8e0 2024-05-09T09:48:01.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.270+0000 7f4fd9ffb640 1 --2- 172.21.15.157:0/1538049122 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4fcc034b60 0x7f4fcc037020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.270+0000 7f4fd9ffb640 1 -- 172.21.15.157:0/1538049122 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f50f00fd140 con 0x56251088a8e0 2024-05-09T09:48:01.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.270+0000 7f50fccdf640 1 --2- 172.21.15.157:0/1538049122 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4fcc034b60 0x7f4fcc037020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.270+0000 7f50ff9c5980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.270+0000 7f50ff9c5980 1 --2- 172.21.15.157:0/1538049122 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56251089d570 0x56251089fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.270+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625108a0180 con 0x56251089d570 2024-05-09T09:48:01.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.274+0000 7f50fdce1640 1 --2- 172.21.15.157:0/1538049122 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56251089d570 0x56251089fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.274+0000 7f50fccdf640 1 --2- 172.21.15.157:0/1538049122 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4fcc034b60 0x7f4fcc037020 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x562510854a50 tx=0x7f50f4011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.274+0000 7f50fdce1640 1 --2- 172.21.15.157:0/1538049122 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56251089d570 0x56251089fa30 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.274+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50f80083f0 con 0x56251089d570 2024-05-09T09:48:01.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.274+0000 7f50ff9c5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:01.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.274+0000 7f50ff9c5980 20 realm 2024-05-09T09:48:01.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.274+0000 7f50ff9c5980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.274+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625108a0590 con 0x56251089d570 2024-05-09T09:48:01.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.274+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50f80083f0 con 0x56251089d570 2024-05-09T09:48:01.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.274+0000 7f50ff9c5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:01.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.274+0000 7f50ff9c5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:48:01.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.274+0000 7f50ff9c5980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.274+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625108a0e60 con 0x56251089d570 2024-05-09T09:48:01.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.274+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50f80083f0 con 0x56251089d570 2024-05-09T09:48:01.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.274+0000 7f50ff9c5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:01.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.274+0000 7f50ff9c5980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.274+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x56251089d570 2024-05-09T09:48:01.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.274+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f50f80083f0 con 0x56251089d570 2024-05-09T09:48:01.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.274+0000 7f50ff9c5980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:01.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.274+0000 7f50ff9c5980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.274+0000 7f50ff9c5980 1 --2- 172.21.15.157:0/1538049122 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5625108a1f60 0x5625108a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.274+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625108a4910 con 0x5625108a1f60 2024-05-09T09:48:01.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.274+0000 7f50fd4e0640 1 --2- 172.21.15.157:0/1538049122 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5625108a1f60 0x5625108a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.278+0000 7f50fd4e0640 1 --2- 172.21.15.157:0/1538049122 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5625108a1f60 0x5625108a4350 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.278+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f50f00ec070 con 0x5625108a1f60 2024-05-09T09:48:01.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.278+0000 7f50ff9c5980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:48:01.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.278+0000 7f50ff9c5980 20 searching for the correct realm 2024-05-09T09:48:01.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.278+0000 7f50ff9c5980 1 --2- 172.21.15.157:0/1538049122 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5625108a6860 0x5625108a8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.278+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a9340 con 0x5625108a6860 2024-05-09T09:48:01.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.278+0000 7f50fccdf640 1 --2- 172.21.15.157:0/1538049122 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5625108a6860 0x5625108a8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.278+0000 7f50fccdf640 1 --2- 172.21.15.157:0/1538049122 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5625108a6860 0x5625108a8c70 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.278+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50f4036040 con 0x5625108a6860 2024-05-09T09:48:01.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.278+0000 7f50fccdf640 1 --2- 172.21.15.157:0/1538049122 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f50f400f3d0 0x7f50f400f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.278+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a9340 con 0x7f50f400f3d0 2024-05-09T09:48:01.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.278+0000 7f50fdce1640 1 --2- 172.21.15.157:0/1538049122 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f50f400f3d0 0x7f50f400f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.278+0000 7f50fdce1640 1 --2- 172.21.15.157:0/1538049122 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f50f400f3d0 0x7f50f400f7f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.278+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50f80083f0 con 0x7f50f400f3d0 2024-05-09T09:48:01.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.278+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x5625108a1f60 2024-05-09T09:48:01.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.278+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50f00ec070 con 0x5625108a1f60 2024-05-09T09:48:01.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.278+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x56251089d570 2024-05-09T09:48:01.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.282+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50f80083f0 con 0x56251089d570 2024-05-09T09:48:01.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.282+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x56251089d570 2024-05-09T09:48:01.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.282+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50f8026040 con 0x56251089d570 2024-05-09T09:48:01.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.282+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x5625108a1f60 2024-05-09T09:48:01.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.282+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50f00ec070 con 0x5625108a1f60 2024-05-09T09:48:01.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.282+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x5625108a1f60 2024-05-09T09:48:01.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.282+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50f00ec070 con 0x5625108a1f60 2024-05-09T09:48:01.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.282+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x7f50f400f3d0 2024-05-09T09:48:01.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.282+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50f8026040 con 0x7f50f400f3d0 2024-05-09T09:48:01.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.282+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x5625108a6860 2024-05-09T09:48:01.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.282+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50f4036040 con 0x5625108a6860 2024-05-09T09:48:01.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.282+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x56251089d570 2024-05-09T09:48:01.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.282+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50f8026040 con 0x56251089d570 2024-05-09T09:48:01.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.282+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x5625108a1f60 2024-05-09T09:48:01.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.286+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50f00ec070 con 0x5625108a1f60 2024-05-09T09:48:01.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.286+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x56251089d570 2024-05-09T09:48:01.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.286+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50f8026040 con 0x56251089d570 2024-05-09T09:48:01.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.286+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x7f50f400f3d0 2024-05-09T09:48:01.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.286+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f50f8026040 con 0x7f50f400f3d0 2024-05-09T09:48:01.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.286+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x5625108a6860 2024-05-09T09:48:01.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.286+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50f4036040 con 0x5625108a6860 2024-05-09T09:48:01.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.286+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x5625108a6860 2024-05-09T09:48:01.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.286+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f50f4036040 con 0x5625108a6860 2024-05-09T09:48:01.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.286+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x5625108a1f60 2024-05-09T09:48:01.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.286+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50f00ec070 con 0x5625108a1f60 2024-05-09T09:48:01.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.286+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x5625108a6860 2024-05-09T09:48:01.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.286+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50f4036040 con 0x5625108a6860 2024-05-09T09:48:01.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.286+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x5625108a6860 2024-05-09T09:48:01.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.286+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50f4036040 con 0x5625108a6860 2024-05-09T09:48:01.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.286+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x56251089d570 2024-05-09T09:48:01.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.286+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50f8026040 con 0x56251089d570 2024-05-09T09:48:01.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.286+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x56251089d570 2024-05-09T09:48:01.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.286+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f50f8026040 con 0x56251089d570 2024-05-09T09:48:01.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.286+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x5625108a1f60 2024-05-09T09:48:01.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.290+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50f00ec070 con 0x5625108a1f60 2024-05-09T09:48:01.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.290+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x5625108a6860 2024-05-09T09:48:01.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.290+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50f4036040 con 0x5625108a6860 2024-05-09T09:48:01.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.290+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x7f50f400f3d0 2024-05-09T09:48:01.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.290+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50f8026040 con 0x7f50f400f3d0 2024-05-09T09:48:01.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.290+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x56251089d570 2024-05-09T09:48:01.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.290+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50f8026040 con 0x56251089d570 2024-05-09T09:48:01.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.290+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x5625108a1f60 2024-05-09T09:48:01.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.290+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f50f00ec070 con 0x5625108a1f60 2024-05-09T09:48:01.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.290+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x5625108a6860 2024-05-09T09:48:01.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.290+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50f4036040 con 0x5625108a6860 2024-05-09T09:48:01.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.290+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x5625108a1f60 2024-05-09T09:48:01.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.290+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50f00ec070 con 0x5625108a1f60 2024-05-09T09:48:01.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.290+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x7f50f400f3d0 2024-05-09T09:48:01.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.290+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50f8026040 con 0x7f50f400f3d0 2024-05-09T09:48:01.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.290+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x5625108a6860 2024-05-09T09:48:01.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.290+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50f4048040 con 0x5625108a6860 2024-05-09T09:48:01.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.290+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x5625108a1f60 2024-05-09T09:48:01.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.290+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50f00ec070 con 0x5625108a1f60 2024-05-09T09:48:01.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.290+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x56251089d570 2024-05-09T09:48:01.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f50f8026040 con 0x56251089d570 2024-05-09T09:48:01.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625108a1200 con 0x7f50f400f3d0 2024-05-09T09:48:01.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50f8026040 con 0x7f50f400f3d0 2024-05-09T09:48:01.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:48:01.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:48:01.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:48:01.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:48:01.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:48:01.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:48:01.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625108a51d0 con 0x56251089d570 2024-05-09T09:48:01.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50f8026040 con 0x56251089d570 2024-05-09T09:48:01.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:01.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625108a51d0 con 0x56251089d570 2024-05-09T09:48:01.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f50f8026040 con 0x56251089d570 2024-05-09T09:48:01.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:01.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625108a51d0 con 0x5625108a6860 2024-05-09T09:48:01.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f50f4048040 con 0x5625108a6860 2024-05-09T09:48:01.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:48:01.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 20 zone default found 2024-05-09T09:48:01.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 4 Realm: () 2024-05-09T09:48:01.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:48:01.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:48:01.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:48:01.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 20 zonegroup default 2024-05-09T09:48:01.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625108a5bb0 con 0x5625108a1f60 2024-05-09T09:48:01.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f50f00ec070 con 0x5625108a1f60 2024-05-09T09:48:01.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:01.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625108a5740 con 0x5625108a6860 2024-05-09T09:48:01.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f50f4048040 con 0x5625108a6860 2024-05-09T09:48:01.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:01.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625108ab760 con 0x5625108a6860 2024-05-09T09:48:01.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f50f4048040 con 0x5625108a6860 2024-05-09T09:48:01.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:01.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 20 started sync module instance, tier type = 2024-05-09T09:48:01.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:48:01.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.294+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108aaae0 con 0x7f50f400f3d0 2024-05-09T09:48:01.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.298+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50f8026040 con 0x7f50f400f3d0 2024-05-09T09:48:01.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.298+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94717191303168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108aaae0 con 0x7f50f400f3d0 2024-05-09T09:48:01.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.298+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108ac2f0 con 0x56251089d570 2024-05-09T09:48:01.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.298+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94717191303168] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50f8036040 con 0x7f50f400f3d0 2024-05-09T09:48:01.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.298+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50f8036040 con 0x56251089d570 2024-05-09T09:48:01.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.298+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94717191306720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108aaae0 con 0x56251089d570 2024-05-09T09:48:01.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.298+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108acd30 con 0x5625108a6860 2024-05-09T09:48:01.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.302+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94717191306720] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50f8036040 con 0x56251089d570 2024-05-09T09:48:01.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.302+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50f4048040 con 0x5625108a6860 2024-05-09T09:48:01.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.302+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94717191300656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108aaa50 con 0x5625108a6860 2024-05-09T09:48:01.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.302+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108ada80 con 0x7f50f400f3d0 2024-05-09T09:48:01.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.302+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50f8036040 con 0x7f50f400f3d0 2024-05-09T09:48:01.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.302+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94717191312848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108ad9f0 con 0x7f50f400f3d0 2024-05-09T09:48:01.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.302+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108ae970 con 0x56251089d570 2024-05-09T09:48:01.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.306+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94717191300656] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50f4048040 con 0x5625108a6860 2024-05-09T09:48:01.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.306+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94717191312848] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50f8036040 con 0x7f50f400f3d0 2024-05-09T09:48:01.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.306+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50f8036040 con 0x56251089d570 2024-05-09T09:48:01.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.306+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94717191311648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108ae4c0 con 0x56251089d570 2024-05-09T09:48:01.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.306+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108af210 con 0x5625108a1f60 2024-05-09T09:48:01.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.306+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94717191311648] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50f8036040 con 0x56251089d570 2024-05-09T09:48:01.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.306+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50f00ec070 con 0x5625108a1f60 2024-05-09T09:48:01.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.306+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94717191318880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108ae4c0 con 0x5625108a1f60 2024-05-09T09:48:01.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.306+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108afa60 con 0x5625108a1f60 2024-05-09T09:48:01.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.310+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94717191318880] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50f00ec070 con 0x5625108a1f60 2024-05-09T09:48:01.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.310+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50f00ec070 con 0x5625108a1f60 2024-05-09T09:48:01.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.310+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94717191314912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108b02b0 con 0x5625108a1f60 2024-05-09T09:48:01.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.310+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108b0b60 con 0x5625108a1f60 2024-05-09T09:48:01.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.310+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94717191314912] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50f00ec070 con 0x5625108a1f60 2024-05-09T09:48:01.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.310+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50f00ec070 con 0x5625108a1f60 2024-05-09T09:48:01.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.310+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94717191325264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108b0dc0 con 0x5625108a1f60 2024-05-09T09:48:01.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.310+0000 7f50ff9c5980 20 add_watcher() i=0 2024-05-09T09:48:01.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.310+0000 7f50ff9c5980 20 add_watcher() i=1 2024-05-09T09:48:01.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.310+0000 7f50ff9c5980 20 add_watcher() i=2 2024-05-09T09:48:01.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.310+0000 7f50ff9c5980 20 add_watcher() i=3 2024-05-09T09:48:01.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.310+0000 7f50ff9c5980 20 add_watcher() i=4 2024-05-09T09:48:01.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.310+0000 7f50ff9c5980 20 add_watcher() i=5 2024-05-09T09:48:01.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.310+0000 7f50ff9c5980 20 add_watcher() i=6 2024-05-09T09:48:01.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.314+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94717191325264] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50f00ec070 con 0x5625108a1f60 2024-05-09T09:48:01.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.314+0000 7f50ff9c5980 20 add_watcher() i=7 2024-05-09T09:48:01.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.314+0000 7f50ff9c5980 2 all 8 watchers are set, enabling cache 2024-05-09T09:48:01.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.314+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625108b4330 con 0x56251089d570 2024-05-09T09:48:01.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.314+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f50f8036040 con 0x56251089d570 2024-05-09T09:48:01.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.314+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94717191323136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108b1850 con 0x56251089d570 2024-05-09T09:48:01.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.314+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94717191323136] v32'315 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f50f8036040 con 0x56251089d570 2024-05-09T09:48:01.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.314+0000 7f4fb27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:01.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.318+0000 7f50ff9c5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:48:01.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.318+0000 7f50ff9c5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:48:01.317 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.318+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108b40d0 con 0x56251089d570 2024-05-09T09:48:01.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.318+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'76 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f50f8036040 con 0x56251089d570 2024-05-09T09:48:01.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.318+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bd3f0 con 0x5625108a1f60 2024-05-09T09:48:01.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.322+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'70 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f50f00ec070 con 0x5625108a1f60 2024-05-09T09:48:01.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.322+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bd3f0 con 0x5625108a6860 2024-05-09T09:48:01.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.322+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'69 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f50f4048040 con 0x5625108a6860 2024-05-09T09:48:01.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.322+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bd9a0 con 0x56251089d570 2024-05-09T09:48:01.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.322+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'316 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f50f8036040 con 0x56251089d570 2024-05-09T09:48:01.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.322+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bde50 con 0x7f50f400f3d0 2024-05-09T09:48:01.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.326+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'197 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f50f8036040 con 0x7f50f400f3d0 2024-05-09T09:48:01.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.326+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bcaa0 con 0x5625108a6860 2024-05-09T09:48:01.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.326+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'132 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f50f4048040 con 0x5625108a6860 2024-05-09T09:48:01.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.326+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bcaa0 con 0x56251089d570 2024-05-09T09:48:01.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.326+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'71 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f50f8036040 con 0x56251089d570 2024-05-09T09:48:01.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.326+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bcaa0 con 0x5625108a1f60 2024-05-09T09:48:01.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.330+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'131 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f50f00ec070 con 0x5625108a1f60 2024-05-09T09:48:01.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.330+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bcaa0 con 0x7f50f400f3d0 2024-05-09T09:48:01.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.334+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'69 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f50f8036040 con 0x7f50f400f3d0 2024-05-09T09:48:01.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.334+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bcaa0 con 0x5625108a6860 2024-05-09T09:48:01.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.334+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'75 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f50f4048040 con 0x5625108a6860 2024-05-09T09:48:01.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.334+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bedb0 con 0x7f50f400f3d0 2024-05-09T09:48:01.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.334+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'198 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f50f8036040 con 0x7f50f400f3d0 2024-05-09T09:48:01.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.334+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bedb0 con 0x5625108a1f60 2024-05-09T09:48:01.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.338+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'72 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f50f00ec070 con 0x5625108a1f60 2024-05-09T09:48:01.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.338+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bedb0 con 0x7f50f400f3d0 2024-05-09T09:48:01.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.338+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'69 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f50f8036040 con 0x7f50f400f3d0 2024-05-09T09:48:01.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.338+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bef80 con 0x5625108a1f60 2024-05-09T09:48:01.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.342+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'137 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f50f00ec070 con 0x5625108a1f60 2024-05-09T09:48:01.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.342+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bef80 con 0x56251089d570 2024-05-09T09:48:01.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.342+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'317 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f50f8036040 con 0x56251089d570 2024-05-09T09:48:01.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.342+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bef80 con 0x5625108a6860 2024-05-09T09:48:01.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.346+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'191 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f50f4048040 con 0x5625108a6860 2024-05-09T09:48:01.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.346+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bef80 con 0x7f50f400f3d0 2024-05-09T09:48:01.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.346+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'199 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f50f8036040 con 0x7f50f400f3d0 2024-05-09T09:48:01.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.346+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bef80 con 0x5625108a6860 2024-05-09T09:48:01.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.350+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'69 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f50f4048040 con 0x5625108a6860 2024-05-09T09:48:01.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.350+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bf5e0 con 0x56251089d570 2024-05-09T09:48:01.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.350+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'77 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f50f8036040 con 0x56251089d570 2024-05-09T09:48:01.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.350+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bf5e0 con 0x56251089d570 2024-05-09T09:48:01.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.354+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'318 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f50f8036040 con 0x56251089d570 2024-05-09T09:48:01.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.354+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bf5e0 con 0x5625108a6860 2024-05-09T09:48:01.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.354+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'192 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f50f4048040 con 0x5625108a6860 2024-05-09T09:48:01.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.354+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bf5e0 con 0x7f50f400f3d0 2024-05-09T09:48:01.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.358+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'81 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f50f8036040 con 0x7f50f400f3d0 2024-05-09T09:48:01.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.358+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bf5e0 con 0x5625108a6860 2024-05-09T09:48:01.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.358+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'71 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f50f4048040 con 0x5625108a6860 2024-05-09T09:48:01.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.358+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bf5e0 con 0x5625108a6860 2024-05-09T09:48:01.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.358+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'75 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f50f4048040 con 0x5625108a6860 2024-05-09T09:48:01.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.358+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bf5e0 con 0x5625108a6860 2024-05-09T09:48:01.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.362+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'65 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f50f4048040 con 0x5625108a6860 2024-05-09T09:48:01.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.362+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bf5e0 con 0x5625108a6860 2024-05-09T09:48:01.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.362+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'133 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f50f4048040 con 0x5625108a6860 2024-05-09T09:48:01.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.362+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bf5e0 con 0x5625108a1f60 2024-05-09T09:48:01.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.366+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'71 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f50f00ec070 con 0x5625108a1f60 2024-05-09T09:48:01.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.366+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bf5e0 con 0x5625108a6860 2024-05-09T09:48:01.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.366+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'69 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f50f4048040 con 0x5625108a6860 2024-05-09T09:48:01.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.366+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bf5e0 con 0x5625108a1f60 2024-05-09T09:48:01.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.370+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'132 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f50f00ec070 con 0x5625108a1f60 2024-05-09T09:48:01.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.370+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bf5e0 con 0x5625108a6860 2024-05-09T09:48:01.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.374+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'193 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f50f4048040 con 0x5625108a6860 2024-05-09T09:48:01.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.374+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bf5e0 con 0x5625108a1f60 2024-05-09T09:48:01.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.374+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'138 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f50f00ec070 con 0x5625108a1f60 2024-05-09T09:48:01.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.374+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108bf5e0 con 0x7f50f400f3d0 2024-05-09T09:48:01.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.378+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'75 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f50f8036040 con 0x7f50f400f3d0 2024-05-09T09:48:01.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.378+0000 7f4fb17e2640 20 reqs_thread_entry: start 2024-05-09T09:48:01.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.378+0000 7f50ff9c5980 20 init_complete bucket index max shards: 11 2024-05-09T09:48:01.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.378+0000 7f4f22ffd640 20 reqs_thread_entry: start 2024-05-09T09:48:01.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.378+0000 7f50ff9c5980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-09T09:48:01.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.378+0000 7f50ff9c5980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.378+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625108bbf80 con 0x7f50f400f3d0 2024-05-09T09:48:01.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.378+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f50f8036040 con 0x7f50f400f3d0 2024-05-09T09:48:01.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.378+0000 7f50ff9c5980 20 rados_obj.operate() r=0 bl.length=165 2024-05-09T09:48:01.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.378+0000 7f50ff9c5980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-09T09:48:01.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.378+0000 7f50ff9c5980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-09T09:48:01.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.378+0000 7f50ff9c5980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5 : miss 2024-05-09T09:48:01.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.378+0000 7f50ff9c5980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.378+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:95 8.1 8:85b9a1ed:root::.bucket.meta.myfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625108dcae0 con 0x5625108a1f60 2024-05-09T09:48:01.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.382+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(95 .bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f50f00ec070 con 0x5625108a1f60 2024-05-09T09:48:01.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.382+0000 7f50ff9c5980 20 rados_obj.operate() r=0 bl.length=379 2024-05-09T09:48:01.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.382+0000 7f50ff9c5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5 info.flags=0x17 2024-05-09T09:48:01.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.382+0000 7f50ff9c5980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5 to cache LRU end 2024-05-09T09:48:01.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.382+0000 7f50ff9c5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:48:01.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.382+0000 7f50ff9c5980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-09T09:48:01.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.382+0000 7f50ff9c5980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5 2024-05-09T09:48:01.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.382+0000 7f50ff9c5980 20 get_obj_state: octx=0x7f50f8008c70 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5625108deb98 s->prefetch_data=0 2024-05-09T09:48:01.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.382+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:96 3.29s0 3:96eeab6a:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625108dfdd0 con 0x5625108a1f60 2024-05-09T09:48:01.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.382+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(96 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=909b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+925 (crc 0 0 0) 0x7f50f00ec070 con 0x5625108a1f60 2024-05-09T09:48:01.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.382+0000 7f50ff9c5980 10 manifest: total_size = 5 2024-05-09T09:48:01.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.382+0000 7f50ff9c5980 20 get_obj_state: setting s->obj_tag to _qETNbHVkEbEBFKe9B__KHxflaspvi80 2024-05-09T09:48:01.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.382+0000 7f4fb27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:01.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.382+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94717191323136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108dfdd0 con 0x56251089d570 2024-05-09T09:48:01.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.382+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(97 data_loggenerations_metadata [watch unwatch cookie 94717191323136] v32'319 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f50f8036040 con 0x56251089d570 2024-05-09T09:48:01.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.382+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:98 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94717191303168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108dfdd0 con 0x7f50f400f3d0 2024-05-09T09:48:01.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.386+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(98 notify.0 [watch unwatch cookie 94717191303168] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50f8036040 con 0x7f50f400f3d0 2024-05-09T09:48:01.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.386+0000 7f50ff9c5980 20 remove_watcher() i=0 2024-05-09T09:48:01.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.386+0000 7f50ff9c5980 2 removed watcher, disabling cache 2024-05-09T09:48:01.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.386+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:99 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94717191306720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108dfdd0 con 0x56251089d570 2024-05-09T09:48:01.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.386+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(99 notify.1 [watch unwatch cookie 94717191306720] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50f8036040 con 0x56251089d570 2024-05-09T09:48:01.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.386+0000 7f50ff9c5980 20 remove_watcher() i=1 2024-05-09T09:48:01.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.386+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:100 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94717191300656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108dfdd0 con 0x5625108a6860 2024-05-09T09:48:01.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.390+0000 7f50fccdf640 1 -- 172.21.15.157:0/1538049122 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(100 notify.2 [watch unwatch cookie 94717191300656] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50f4048040 con 0x5625108a6860 2024-05-09T09:48:01.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.390+0000 7f50ff9c5980 20 remove_watcher() i=2 2024-05-09T09:48:01.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.390+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:101 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94717191312848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108dfdd0 con 0x7f50f400f3d0 2024-05-09T09:48:01.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.390+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(101 notify.3 [watch unwatch cookie 94717191312848] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50f8036040 con 0x7f50f400f3d0 2024-05-09T09:48:01.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.390+0000 7f50ff9c5980 20 remove_watcher() i=3 2024-05-09T09:48:01.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.390+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94717191311648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108dfdd0 con 0x56251089d570 2024-05-09T09:48:01.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.394+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(102 notify.4 [watch unwatch cookie 94717191311648] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50f8036040 con 0x56251089d570 2024-05-09T09:48:01.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.394+0000 7f50ff9c5980 20 remove_watcher() i=4 2024-05-09T09:48:01.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.394+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94717191318880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108dfdd0 con 0x5625108a1f60 2024-05-09T09:48:01.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.394+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(103 notify.5 [watch unwatch cookie 94717191318880] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50f00ec070 con 0x5625108a1f60 2024-05-09T09:48:01.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.394+0000 7f50ff9c5980 20 remove_watcher() i=5 2024-05-09T09:48:01.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.394+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94717191314912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108dfdd0 con 0x5625108a1f60 2024-05-09T09:48:01.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.398+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(104 notify.6 [watch unwatch cookie 94717191314912] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50f00ec070 con 0x5625108a1f60 2024-05-09T09:48:01.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.398+0000 7f50ff9c5980 20 remove_watcher() i=6 2024-05-09T09:48:01.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.398+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:105 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94717191325264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625108dfdd0 con 0x5625108a1f60 2024-05-09T09:48:01.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.398+0000 7f50fd4e0640 1 -- 172.21.15.157:0/1538049122 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(105 notify.7 [watch unwatch cookie 94717191325264] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50f00ec070 con 0x5625108a1f60 2024-05-09T09:48:01.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.398+0000 7f50ff9c5980 20 remove_watcher() i=7 2024-05-09T09:48:01.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5625108a1f60 msgr2=0x5625108a4350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 --2- 172.21.15.157:0/1538049122 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5625108a1f60 0x5625108a4350 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56251089d570 msgr2=0x56251089fa30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 --2- 172.21.15.157:0/1538049122 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56251089d570 0x56251089fa30 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f50f400f3d0 msgr2=0x7f50f400f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 --2- 172.21.15.157:0/1538049122 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f50f400f3d0 0x7f50f400f7f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5625108a6860 msgr2=0x5625108a8c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 --2- 172.21.15.157:0/1538049122 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5625108a6860 0x5625108a8c70 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4fcc034b60 msgr2=0x7f4fcc037020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 --2- 172.21.15.157:0/1538049122 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4fcc034b60 0x7f4fcc037020 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x562510854a50 tx=0x7f50f4011000 comp rx=0 tx=0).stop 2024-05-09T09:48:01.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56251088a8e0 msgr2=0x562510890a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50fdce1640 1 -- 172.21.15.157:0/1538049122 reap_dead start 2024-05-09T09:48:01.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 --2- 172.21.15.157:0/1538049122 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56251088a8e0 0x562510890a60 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f50f00e3c50 tx=0x7f50f00a6f90 comp rx=0 tx=0).stop 2024-05-09T09:48:01.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 shutdown_connections 2024-05-09T09:48:01.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 --2- 172.21.15.157:0/1538049122 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56251088a8e0 0x562510890a60 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 >> 172.21.15.157:0/1538049122 conn(0x562510885980 msgr2=0x562510883090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:01.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 shutdown_connections 2024-05-09T09:48:01.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 -- 172.21.15.157:0/1538049122 wait complete. 2024-05-09T09:48:01.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 -- 172.21.15.157:0/3146509939 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4fd4034c50 msgr2=0x7f4fd4037110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 --2- 172.21.15.157:0/3146509939 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4fd4034c50 0x7f4fd4037110 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x562510850a50 tx=0x7f50f4006000 comp rx=0 tx=0).stop 2024-05-09T09:48:01.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 -- 172.21.15.157:0/3146509939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5625106c8580 msgr2=0x5625106c6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 --2- 172.21.15.157:0/3146509939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5625106c8580 0x5625106c6a10 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f50f00e3c20 tx=0x7f50f00cf690 comp rx=0 tx=0).stop 2024-05-09T09:48:01.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 -- 172.21.15.157:0/3146509939 shutdown_connections 2024-05-09T09:48:01.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 --2- 172.21.15.157:0/3146509939 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4fd4034c50 0x7f4fd4037110 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 --2- 172.21.15.157:0/3146509939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5625106c8580 0x5625106c6a10 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 -- 172.21.15.157:0/3146509939 >> 172.21.15.157:0/3146509939 conn(0x56251086f300 msgr2=0x56251086fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:01.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 -- 172.21.15.157:0/3146509939 shutdown_connections 2024-05-09T09:48:01.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 -- 172.21.15.157:0/3146509939 wait complete. 2024-05-09T09:48:01.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 -- 172.21.15.157:0/618779068 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56251084da80 msgr2=0x56251084ff20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 --2- 172.21.15.157:0/618779068 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56251084da80 0x56251084ff20 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 -- 172.21.15.157:0/618779068 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5625107522b0 msgr2=0x56251084b270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 --2- 172.21.15.157:0/618779068 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5625107522b0 0x56251084b270 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 -- 172.21.15.157:0/618779068 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x562510851b10 msgr2=0x562510853f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 --2- 172.21.15.157:0/618779068 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x562510851b10 0x562510853f00 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 -- 172.21.15.157:0/618779068 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4fe4034c00 msgr2=0x7f4fe40370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 --2- 172.21.15.157:0/618779068 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4fe4034c00 0x7f4fe40370c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f50f4001e20 tx=0x7f50f40013a0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 -- 172.21.15.157:0/618779068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562510751990 msgr2=0x562510844330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 --2- 172.21.15.157:0/618779068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562510751990 0x562510844330 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f50f0000f90 tx=0x7f50f0017e30 comp rx=0 tx=0).stop 2024-05-09T09:48:01.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50fdce1640 1 -- 172.21.15.157:0/618779068 reap_dead start 2024-05-09T09:48:01.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 -- 172.21.15.157:0/618779068 shutdown_connections 2024-05-09T09:48:01.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 -- 172.21.15.157:0/618779068 >> 172.21.15.157:0/618779068 conn(0x56251074d260 msgr2=0x5625108378d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:01.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 -- 172.21.15.157:0/618779068 shutdown_connections 2024-05-09T09:48:01.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.402+0000 7f50ff9c5980 1 -- 172.21.15.157:0/618779068 wait complete. 2024-05-09T09:48:01.417 INFO:teuthology.orchestra.run.smithi157.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-05-09T09:48:01.417 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-05-09T09:48:01.420 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-05-09T09:48:01.442 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-09T09:48:01.550 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-05-09T09:48:01.551 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-05-09T09:48:01.551 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-05-09T09:48:01.551 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-05-09T09:48:01.551 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-05-09T09:48:01.551 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-05-09T09:48:01.551 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-05-09T09:48:01.592 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:48:01.592 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:48:01.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.594+0000 7f885cc0b980 1 Processor -- start 2024-05-09T09:48:01.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.594+0000 7f885cc0b980 1 -- start start 2024-05-09T09:48:01.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.594+0000 7f885cc0b980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x555e0414cf10 0x555e0414d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.594+0000 7f885cc0b980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555e04000440 con 0x555e0414ddd0 2024-05-09T09:48:01.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.594+0000 7f885cc0b980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x555e03feb5f0 con 0x555e0414cf10 2024-05-09T09:48:01.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.594+0000 7f885a726640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x555e0414cf10 0x555e0414d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.594+0000 7f885a726640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x555e0414cf10 0x555e0414d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35118/0 (socket says 172.21.15.157:35118) 2024-05-09T09:48:01.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.594+0000 7f885a726640 1 -- 172.21.15.157:0/494405614 learned_addr learned my addr 172.21.15.157:0/494405614 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:01.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.594+0000 7f885a726640 1 -- 172.21.15.157:0/494405614 >> v1:172.21.15.110:6789/0 conn(0x555e0414ddd0 legacy=0x555e0414e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.594+0000 7f885a726640 1 -- 172.21.15.157:0/494405614 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e03ff6990 con 0x555e0414cf10 2024-05-09T09:48:01.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.598+0000 7f885a726640 1 --2- 172.21.15.157:0/494405614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e0414cf10 0x555e0414d2f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f885400a4e0 tx=0x7f885401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f4567500dee7080 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.598+0000 7f8859724640 1 -- 172.21.15.157:0/494405614 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88540aa540 con 0x555e0414cf10 2024-05-09T09:48:01.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.598+0000 7f8859724640 1 -- 172.21.15.157:0/494405614 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88540aa6e0 con 0x555e0414cf10 2024-05-09T09:48:01.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.598+0000 7f8859724640 1 -- 172.21.15.157:0/494405614 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88540aaa40 con 0x555e0414cf10 2024-05-09T09:48:01.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.598+0000 7f885cc0b980 1 -- 172.21.15.157:0/494405614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e0414cf10 msgr2=0x555e0414d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.598+0000 7f885cc0b980 1 --2- 172.21.15.157:0/494405614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e0414cf10 0x555e0414d2f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f885400a4e0 tx=0x7f885401b090 comp rx=0 tx=0).stop 2024-05-09T09:48:01.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.598+0000 7f885cc0b980 1 -- 172.21.15.157:0/494405614 shutdown_connections 2024-05-09T09:48:01.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.598+0000 7f885cc0b980 1 --2- 172.21.15.157:0/494405614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e0414cf10 0x555e0414d2f0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.598+0000 7f885cc0b980 1 -- 172.21.15.157:0/494405614 >> 172.21.15.157:0/494405614 conn(0x555e040c02b0 msgr2=0x555e040c06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:01.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.598+0000 7f885cc0b980 1 -- 172.21.15.157:0/494405614 shutdown_connections 2024-05-09T09:48:01.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.598+0000 7f885cc0b980 1 -- 172.21.15.157:0/494405614 wait complete. 2024-05-09T09:48:01.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.614+0000 7f885cc0b980 1 Processor -- start 2024-05-09T09:48:01.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.614+0000 7f885cc0b980 1 -- start start 2024-05-09T09:48:01.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.614+0000 7f885cc0b980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e0414cf10 0x555e042382e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.614+0000 7f885cc0b980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x555e0404dfe0 con 0x555e0414cf10 2024-05-09T09:48:01.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.614+0000 7f885a726640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e0414cf10 0x555e042382e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.614+0000 7f885a726640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e0414cf10 0x555e042382e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35132/0 (socket says 172.21.15.157:35132) 2024-05-09T09:48:01.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.614+0000 7f885a726640 1 -- 172.21.15.157:0/3137592444 learned_addr learned my addr 172.21.15.157:0/3137592444 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:01.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.614+0000 7f885a726640 1 -- 172.21.15.157:0/3137592444 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e03fd2ae0 con 0x555e0414cf10 2024-05-09T09:48:01.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.614+0000 7f885a726640 1 --2- 172.21.15.157:0/3137592444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e0414cf10 0x555e042382e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8854018cc0 tx=0x7f88540033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f28c92c00d3b47 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.614+0000 7f8748608640 1 -- 172.21.15.157:0/3137592444 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88540b9070 con 0x555e0414cf10 2024-05-09T09:48:01.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.614+0000 7f8748608640 1 -- 172.21.15.157:0/3137592444 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88540aa9c0 con 0x555e0414cf10 2024-05-09T09:48:01.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.614+0000 7f8748608640 1 -- 172.21.15.157:0/3137592444 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88540aaca0 con 0x555e0414cf10 2024-05-09T09:48:01.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.618+0000 7f885cc0b980 1 -- 172.21.15.157:0/3137592444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e0414cf10 msgr2=0x555e042382e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.618+0000 7f885cc0b980 1 --2- 172.21.15.157:0/3137592444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e0414cf10 0x555e042382e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8854018cc0 tx=0x7f88540033b0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.618+0000 7f885cc0b980 1 -- 172.21.15.157:0/3137592444 shutdown_connections 2024-05-09T09:48:01.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.618+0000 7f885cc0b980 1 --2- 172.21.15.157:0/3137592444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e0414cf10 0x555e042382e0 secure :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8854018cc0 tx=0x7f88540033b0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.618+0000 7f885cc0b980 1 -- 172.21.15.157:0/3137592444 >> 172.21.15.157:0/3137592444 conn(0x555e040c02b0 msgr2=0x555e04233e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:01.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.618+0000 7f885cc0b980 1 -- 172.21.15.157:0/3137592444 shutdown_connections 2024-05-09T09:48:01.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.618+0000 7f885cc0b980 1 -- 172.21.15.157:0/3137592444 wait complete. 2024-05-09T09:48:01.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.618+0000 7f885cc0b980 1 Processor -- start 2024-05-09T09:48:01.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.618+0000 7f885cc0b980 1 -- start start 2024-05-09T09:48:01.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.618+0000 7f885cc0b980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e0414ddd0 0x555e0423f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.618+0000 7f885cc0b980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x555e04156b40 con 0x555e0414ddd0 2024-05-09T09:48:01.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.618+0000 7f885a726640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e0414ddd0 0x555e0423f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.618+0000 7f885a726640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e0414ddd0 0x555e0423f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35144/0 (socket says 172.21.15.157:35144) 2024-05-09T09:48:01.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.618+0000 7f885a726640 1 -- 172.21.15.157:0/4266721962 learned_addr learned my addr 172.21.15.157:0/4266721962 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:01.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.618+0000 7f885a726640 1 -- 172.21.15.157:0/4266721962 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e0423f9d0 con 0x555e0414ddd0 2024-05-09T09:48:01.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.618+0000 7f885a726640 1 --2- 172.21.15.157:0/4266721962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e0414ddd0 0x555e0423f490 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8854000f90 tx=0x7f8854017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.618+0000 7f8746e05640 1 -- 172.21.15.157:0/4266721962 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88540b9050 con 0x555e0414ddd0 2024-05-09T09:48:01.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.618+0000 7f885cc0b980 1 -- 172.21.15.157:0/4266721962 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e0423fc60 con 0x555e0414ddd0 2024-05-09T09:48:01.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.618+0000 7f8746e05640 1 -- 172.21.15.157:0/4266721962 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88540b69c0 con 0x555e0414ddd0 2024-05-09T09:48:01.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.618+0000 7f885cc0b980 1 -- 172.21.15.157:0/4266721962 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e042428f0 con 0x555e0414ddd0 2024-05-09T09:48:01.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.618+0000 7f8746e05640 1 -- 172.21.15.157:0/4266721962 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88540b6ca0 con 0x555e0414ddd0 2024-05-09T09:48:01.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.622+0000 7f8746e05640 1 -- 172.21.15.157:0/4266721962 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f88540cd060 con 0x555e0414ddd0 2024-05-09T09:48:01.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.622+0000 7f8746e05640 1 --2- 172.21.15.157:0/4266721962 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8740034c00 0x7f87400370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.622+0000 7f8746e05640 1 -- 172.21.15.157:0/4266721962 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f88540c3070 con 0x555e0414ddd0 2024-05-09T09:48:01.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.622+0000 7f8859f25640 1 --2- 172.21.15.157:0/4266721962 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8740034c00 0x7f87400370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.622+0000 7f885cc0b980 1 --2- 172.21.15.157:0/4266721962 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555e042443c0 0x555e042467b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.622+0000 7f885cc0b980 1 -- 172.21.15.157:0/4266721962 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e04246d80 con 0x555e042443c0 2024-05-09T09:48:01.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.622+0000 7f885af27640 1 --2- 172.21.15.157:0/4266721962 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555e042443c0 0x555e042467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.622+0000 7f885af27640 1 --2- 172.21.15.157:0/4266721962 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555e042443c0 0x555e042467b0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.622+0000 7f8859f25640 1 --2- 172.21.15.157:0/4266721962 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8740034c00 0x7f87400370c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8850000f70 tx=0x7f8850001420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.622+0000 7f885af27640 1 -- 172.21.15.157:0/4266721962 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f884c0083f0 con 0x555e042443c0 2024-05-09T09:48:01.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.622+0000 7f885cc0b980 1 -- 172.21.15.157:0/4266721962 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e04243b10 con 0x555e042443c0 2024-05-09T09:48:01.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.622+0000 7f885af27640 1 -- 172.21.15.157:0/4266721962 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f884c0083f0 con 0x555e042443c0 2024-05-09T09:48:01.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.622+0000 7f885cc0b980 1 --2- 172.21.15.157:0/4266721962 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555e042490d0 0x555e0424b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.622+0000 7f885cc0b980 1 -- 172.21.15.157:0/4266721962 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e0424bb90 con 0x555e042490d0 2024-05-09T09:48:01.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.622+0000 7f885a726640 1 --2- 172.21.15.157:0/4266721962 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555e042490d0 0x555e0424b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.622+0000 7f885a726640 1 --2- 172.21.15.157:0/4266721962 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555e042490d0 0x555e0424b4c0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.626+0000 7f885a726640 1 -- 172.21.15.157:0/4266721962 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f88540b12b0 con 0x555e042490d0 2024-05-09T09:48:01.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.626+0000 7f885cc0b980 1 -- 172.21.15.157:0/4266721962 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e04247f70 con 0x555e042443c0 2024-05-09T09:48:01.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.626+0000 7f885af27640 1 -- 172.21.15.157:0/4266721962 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f884c0083f0 con 0x555e042443c0 2024-05-09T09:48:01.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.626+0000 7f885cc0b980 1 --2- 172.21.15.157:0/4266721962 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555e0424cfd0 0x555e0424f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.626+0000 7f885cc0b980 1 -- 172.21.15.157:0/4266721962 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e0424fb50 con 0x555e0424cfd0 2024-05-09T09:48:01.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.626+0000 7f8859f25640 1 --2- 172.21.15.157:0/4266721962 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555e0424cfd0 0x555e0424f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.626+0000 7f8859f25640 1 --2- 172.21.15.157:0/4266721962 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555e0424cfd0 0x555e0424f3c0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.626+0000 7f8859f25640 1 -- 172.21.15.157:0/4266721962 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f885000d040 con 0x555e0424cfd0 2024-05-09T09:48:01.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.630+0000 7f885cc0b980 1 Processor -- start 2024-05-09T09:48:01.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.630+0000 7f885cc0b980 1 -- start start 2024-05-09T09:48:01.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.630+0000 7f885cc0b980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e04275b90 0x555e04275fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.630+0000 7f885cc0b980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x555e04052020 con 0x555e04275b90 2024-05-09T09:48:01.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.630+0000 7f885a726640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e04275b90 0x555e04275fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.630+0000 7f885a726640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e04275b90 0x555e04275fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35154/0 (socket says 172.21.15.157:35154) 2024-05-09T09:48:01.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.630+0000 7f885a726640 1 -- 172.21.15.157:0/1077984779 learned_addr learned my addr 172.21.15.157:0/1077984779 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:01.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.630+0000 7f885a726640 1 -- 172.21.15.157:0/1077984779 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e042764f0 con 0x555e04275b90 2024-05-09T09:48:01.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.630+0000 7f885a726640 1 --2- 172.21.15.157:0/1077984779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e04275b90 0x555e04275fb0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f88540e35f0 tx=0x7f88540a9870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.630+0000 7f873eba2640 1 -- 172.21.15.157:0/1077984779 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88540c5370 con 0x555e04275b90 2024-05-09T09:48:01.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.630+0000 7f873eba2640 1 -- 172.21.15.157:0/1077984779 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88540e5050 con 0x555e04275b90 2024-05-09T09:48:01.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.630+0000 7f885cc0b980 1 -- 172.21.15.157:0/1077984779 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e04276f80 con 0x555e04275b90 2024-05-09T09:48:01.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.630+0000 7f873eba2640 1 -- 172.21.15.157:0/1077984779 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88540ced60 con 0x555e04275b90 2024-05-09T09:48:01.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.630+0000 7f885cc0b980 1 -- 172.21.15.157:0/1077984779 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e04277460 con 0x555e04275b90 2024-05-09T09:48:01.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.634+0000 7f873eba2640 1 -- 172.21.15.157:0/1077984779 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f88540d8040 con 0x555e04275b90 2024-05-09T09:48:01.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.634+0000 7f873eba2640 1 --2- 172.21.15.157:0/1077984779 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8734034c00 0x7f87340370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.634+0000 7f873eba2640 1 -- 172.21.15.157:0/1077984779 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f88540e2050 con 0x555e04275b90 2024-05-09T09:48:01.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.634+0000 7f8859f25640 1 --2- 172.21.15.157:0/1077984779 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8734034c00 0x7f87340370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.634+0000 7f885cc0b980 1 Processor -- start 2024-05-09T09:48:01.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.634+0000 7f885cc0b980 1 -- start start 2024-05-09T09:48:01.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.634+0000 7f8859f25640 1 --2- 172.21.15.157:0/1077984779 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8734034c00 0x7f87340370c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x555e0424ff50 tx=0x7f8850006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.634+0000 7f885cc0b980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e04282b60 0x555e04282f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.634+0000 7f885cc0b980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x555e04238970 con 0x555e04282b60 2024-05-09T09:48:01.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.634+0000 7f885a726640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e04282b60 0x555e04282f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.634+0000 7f885a726640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e04282b60 0x555e04282f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35156/0 (socket says 172.21.15.157:35156) 2024-05-09T09:48:01.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.634+0000 7f885a726640 1 -- 172.21.15.157:0/3605973328 learned_addr learned my addr 172.21.15.157:0/3605973328 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:01.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.634+0000 7f885a726640 1 -- 172.21.15.157:0/3605973328 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e04283530 con 0x555e04282b60 2024-05-09T09:48:01.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.634+0000 7f885a726640 1 --2- 172.21.15.157:0/3605973328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e04282b60 0x555e04282f60 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f88540b47b0 tx=0x7f88540b08c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e64118eade94f19a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.634+0000 7f873cb9e640 1 -- 172.21.15.157:0/3605973328 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88540b02d0 con 0x555e04282b60 2024-05-09T09:48:01.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.634+0000 7f873cb9e640 1 -- 172.21.15.157:0/3605973328 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8854103070 con 0x555e04282b60 2024-05-09T09:48:01.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.634+0000 7f873cb9e640 1 -- 172.21.15.157:0/3605973328 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88540bd400 con 0x555e04282b60 2024-05-09T09:48:01.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.634+0000 7f885cc0b980 1 -- 172.21.15.157:0/3605973328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e04282b60 msgr2=0x555e04282f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.634+0000 7f885cc0b980 1 --2- 172.21.15.157:0/3605973328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e04282b60 0x555e04282f60 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f88540b47b0 tx=0x7f88540b08c0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.634+0000 7f885cc0b980 1 -- 172.21.15.157:0/3605973328 shutdown_connections 2024-05-09T09:48:01.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.634+0000 7f885cc0b980 1 --2- 172.21.15.157:0/3605973328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e04282b60 0x555e04282f60 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.634+0000 7f885cc0b980 1 -- 172.21.15.157:0/3605973328 >> 172.21.15.157:0/3605973328 conn(0x555e0427ef30 msgr2=0x555e0427cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:01.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.634+0000 7f885cc0b980 1 -- 172.21.15.157:0/3605973328 shutdown_connections 2024-05-09T09:48:01.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.634+0000 7f885cc0b980 1 -- 172.21.15.157:0/3605973328 wait complete. 2024-05-09T09:48:01.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.634+0000 7f885cc0b980 1 Processor -- start 2024-05-09T09:48:01.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.634+0000 7f885cc0b980 1 -- start start 2024-05-09T09:48:01.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.634+0000 7f885cc0b980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e04282b60 0x555e04289e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.634+0000 7f885cc0b980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x555e04283af0 con 0x555e04282b60 2024-05-09T09:48:01.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.638+0000 7f885a726640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e04282b60 0x555e04289e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.638+0000 7f885a726640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e04282b60 0x555e04289e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35158/0 (socket says 172.21.15.157:35158) 2024-05-09T09:48:01.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.638+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 learned_addr learned my addr 172.21.15.157:0/39680532 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:01.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.638+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e0428a3d0 con 0x555e04282b60 2024-05-09T09:48:01.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.638+0000 7f885a726640 1 --2- 172.21.15.157:0/39680532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e04282b60 0x555e04289e90 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f88540b1ec0 tx=0x7f88540d2ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.638+0000 7f872affd640 1 -- 172.21.15.157:0/39680532 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88540b02d0 con 0x555e04282b60 2024-05-09T09:48:01.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.638+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e0428a3d0 con 0x555e04282b60 2024-05-09T09:48:01.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.638+0000 7f872affd640 1 -- 172.21.15.157:0/39680532 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88540c5600 con 0x555e04282b60 2024-05-09T09:48:01.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.638+0000 7f872affd640 1 -- 172.21.15.157:0/39680532 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88540e3be0 con 0x555e04282b60 2024-05-09T09:48:01.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.638+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e0428a850 con 0x555e04282b60 2024-05-09T09:48:01.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.638+0000 7f872affd640 1 -- 172.21.15.157:0/39680532 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f88540b3040 con 0x555e04282b60 2024-05-09T09:48:01.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.638+0000 7f872affd640 1 --2- 172.21.15.157:0/39680532 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8724034bb0 0x7f8724037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.638+0000 7f872affd640 1 -- 172.21.15.157:0/39680532 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f8854114da0 con 0x555e04282b60 2024-05-09T09:48:01.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.638+0000 7f8859f25640 1 --2- 172.21.15.157:0/39680532 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8724034bb0 0x7f8724037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.638+0000 7f885cc0b980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.638+0000 7f885cc0b980 1 --2- 172.21.15.157:0/39680532 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555e04296a80 0x555e04298f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.638+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e04299690 con 0x555e04296a80 2024-05-09T09:48:01.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.638+0000 7f885af27640 1 --2- 172.21.15.157:0/39680532 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555e04296a80 0x555e04298f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.638+0000 7f8859f25640 1 --2- 172.21.15.157:0/39680532 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8724034bb0 0x7f8724037070 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8850010fd0 tx=0x7f8850011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.638+0000 7f885af27640 1 --2- 172.21.15.157:0/39680532 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555e04296a80 0x555e04298f40 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.638+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f884c0083f0 con 0x555e04296a80 2024-05-09T09:48:01.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.638+0000 7f885cc0b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:01.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.638+0000 7f885cc0b980 20 realm 2024-05-09T09:48:01.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.642+0000 7f885cc0b980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.642+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e04299aa0 con 0x555e04296a80 2024-05-09T09:48:01.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.642+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f884c0083f0 con 0x555e04296a80 2024-05-09T09:48:01.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.642+0000 7f885cc0b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:01.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.642+0000 7f885cc0b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:48:01.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.642+0000 7f885cc0b980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.642+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a370 con 0x555e04296a80 2024-05-09T09:48:01.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.642+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f884c0083f0 con 0x555e04296a80 2024-05-09T09:48:01.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.642+0000 7f885cc0b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:01.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.642+0000 7f885cc0b980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.642+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x555e04296a80 2024-05-09T09:48:01.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.642+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f884c0083f0 con 0x555e04296a80 2024-05-09T09:48:01.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.642+0000 7f885cc0b980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:01.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.642+0000 7f885cc0b980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.642+0000 7f885cc0b980 1 --2- 172.21.15.157:0/39680532 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555e0429b470 0x555e0429d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.642+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e0429de70 con 0x555e0429b470 2024-05-09T09:48:01.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.642+0000 7f885a726640 1 --2- 172.21.15.157:0/39680532 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555e0429b470 0x555e0429d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.642+0000 7f885a726640 1 --2- 172.21.15.157:0/39680532 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555e0429b470 0x555e0429d860 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.642+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.642+0000 7f885cc0b980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:48:01.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.642+0000 7f885cc0b980 20 searching for the correct realm 2024-05-09T09:48:01.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.642+0000 7f885cc0b980 1 --2- 172.21.15.157:0/39680532 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555e0429fdc0 0x555e042a21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.642+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e042a28a0 con 0x555e0429fdc0 2024-05-09T09:48:01.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.642+0000 7f8859f25640 1 --2- 172.21.15.157:0/39680532 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555e0429fdc0 0x555e042a21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.642+0000 7f8859f25640 1 --2- 172.21.15.157:0/39680532 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555e0429fdc0 0x555e042a21d0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.642+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8850036040 con 0x555e0429fdc0 2024-05-09T09:48:01.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.642+0000 7f8859f25640 1 --2- 172.21.15.157:0/39680532 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f885000f3d0 0x7f885000f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.642+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e042a28a0 con 0x7f885000f3d0 2024-05-09T09:48:01.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.642+0000 7f885af27640 1 --2- 172.21.15.157:0/39680532 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f885000f3d0 0x7f885000f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.646+0000 7f885af27640 1 --2- 172.21.15.157:0/39680532 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f885000f3d0 0x7f885000f7f0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.646+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f884c0083f0 con 0x7f885000f3d0 2024-05-09T09:48:01.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.646+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x555e0429b470 2024-05-09T09:48:01.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.646+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.646+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x555e04296a80 2024-05-09T09:48:01.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.646+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f884c0083f0 con 0x555e04296a80 2024-05-09T09:48:01.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.646+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x555e04296a80 2024-05-09T09:48:01.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.646+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f884c0083f0 con 0x555e04296a80 2024-05-09T09:48:01.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.646+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x555e0429b470 2024-05-09T09:48:01.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.646+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.646+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x555e0429b470 2024-05-09T09:48:01.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.646+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.646+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x7f885000f3d0 2024-05-09T09:48:01.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.646+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f884c0083f0 con 0x7f885000f3d0 2024-05-09T09:48:01.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.646+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x555e0429fdc0 2024-05-09T09:48:01.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.646+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8850036040 con 0x555e0429fdc0 2024-05-09T09:48:01.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.646+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x555e04296a80 2024-05-09T09:48:01.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.650+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f884c0083f0 con 0x555e04296a80 2024-05-09T09:48:01.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.650+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x555e0429b470 2024-05-09T09:48:01.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.650+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.650+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x555e04296a80 2024-05-09T09:48:01.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.650+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f884c0083f0 con 0x555e04296a80 2024-05-09T09:48:01.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.650+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x7f885000f3d0 2024-05-09T09:48:01.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.650+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f884c0083f0 con 0x7f885000f3d0 2024-05-09T09:48:01.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.650+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x555e0429fdc0 2024-05-09T09:48:01.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.650+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8850036040 con 0x555e0429fdc0 2024-05-09T09:48:01.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.650+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x555e0429fdc0 2024-05-09T09:48:01.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.650+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8850036040 con 0x555e0429fdc0 2024-05-09T09:48:01.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.650+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x555e0429b470 2024-05-09T09:48:01.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.650+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.650+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x555e0429fdc0 2024-05-09T09:48:01.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.650+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8850036040 con 0x555e0429fdc0 2024-05-09T09:48:01.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.650+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x555e0429fdc0 2024-05-09T09:48:01.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.650+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8850036040 con 0x555e0429fdc0 2024-05-09T09:48:01.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.650+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x555e04296a80 2024-05-09T09:48:01.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.650+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f884c0083f0 con 0x555e04296a80 2024-05-09T09:48:01.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.650+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x555e04296a80 2024-05-09T09:48:01.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.650+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f884c0083f0 con 0x555e04296a80 2024-05-09T09:48:01.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.650+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x555e0429b470 2024-05-09T09:48:01.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.654+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.654+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x555e0429fdc0 2024-05-09T09:48:01.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.654+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8850036040 con 0x555e0429fdc0 2024-05-09T09:48:01.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.654+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x7f885000f3d0 2024-05-09T09:48:01.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.654+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f884c0083f0 con 0x7f885000f3d0 2024-05-09T09:48:01.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.654+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x555e04296a80 2024-05-09T09:48:01.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.654+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f884c0083f0 con 0x555e04296a80 2024-05-09T09:48:01.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.654+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x555e0429b470 2024-05-09T09:48:01.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.654+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.654+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x555e0429fdc0 2024-05-09T09:48:01.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.654+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8850036040 con 0x555e0429fdc0 2024-05-09T09:48:01.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.654+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x555e0429b470 2024-05-09T09:48:01.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.654+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.654+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x7f885000f3d0 2024-05-09T09:48:01.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.654+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f884c0083f0 con 0x7f885000f3d0 2024-05-09T09:48:01.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.654+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x555e0429fdc0 2024-05-09T09:48:01.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x555e0429b470 2024-05-09T09:48:01.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x555e04296a80 2024-05-09T09:48:01.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f884c0083f0 con 0x555e04296a80 2024-05-09T09:48:01.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e0429a710 con 0x7f885000f3d0 2024-05-09T09:48:01.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f884c0083f0 con 0x7f885000f3d0 2024-05-09T09:48:01.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885cc0b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:48:01.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885cc0b980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:48:01.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885cc0b980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:48:01.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885cc0b980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:48:01.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885cc0b980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:48:01.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885cc0b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:48:01.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885cc0b980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e0429e730 con 0x555e04296a80 2024-05-09T09:48:01.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f884c0083f0 con 0x555e04296a80 2024-05-09T09:48:01.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885cc0b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:01.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885cc0b980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e0429e730 con 0x555e04296a80 2024-05-09T09:48:01.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f884c0083f0 con 0x555e04296a80 2024-05-09T09:48:01.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885cc0b980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:01.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885cc0b980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e0429e730 con 0x555e0429fdc0 2024-05-09T09:48:01.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885cc0b980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:48:01.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885cc0b980 20 zone default found 2024-05-09T09:48:01.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885cc0b980 4 Realm: () 2024-05-09T09:48:01.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885cc0b980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:48:01.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885cc0b980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:48:01.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885cc0b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:48:01.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885cc0b980 20 zonegroup default 2024-05-09T09:48:01.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885cc0b980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e0429f0f0 con 0x555e0429b470 2024-05-09T09:48:01.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885cc0b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:01.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885cc0b980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e0429ec90 con 0x555e0429fdc0 2024-05-09T09:48:01.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885cc0b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:01.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885cc0b980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042a4c50 con 0x555e0429fdc0 2024-05-09T09:48:01.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.658+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.662+0000 7f885cc0b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:01.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.662+0000 7f885cc0b980 20 started sync module instance, tier type = 2024-05-09T09:48:01.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.662+0000 7f885cc0b980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:48:01.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.662+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042a4040 con 0x7f885000f3d0 2024-05-09T09:48:01.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.662+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f884c0083f0 con 0x7f885000f3d0 2024-05-09T09:48:01.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.662+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93862285165920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042a4040 con 0x7f885000f3d0 2024-05-09T09:48:01.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.662+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042a56d0 con 0x555e04296a80 2024-05-09T09:48:01.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.662+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93862285165920] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.662+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f884c035040 con 0x555e04296a80 2024-05-09T09:48:01.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.662+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93862285169456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042a4040 con 0x555e04296a80 2024-05-09T09:48:01.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.662+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042a60e0 con 0x555e0429fdc0 2024-05-09T09:48:01.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.666+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.666+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93862285171760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042a6930 con 0x555e0429fdc0 2024-05-09T09:48:01.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.666+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042a7330 con 0x7f885000f3d0 2024-05-09T09:48:01.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.666+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93862285169456] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f884c035040 con 0x555e04296a80 2024-05-09T09:48:01.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.666+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.666+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93862285163408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042a72f0 con 0x7f885000f3d0 2024-05-09T09:48:01.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.666+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042a7d40 con 0x555e04296a80 2024-05-09T09:48:01.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.666+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93862285171760] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.670+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93862285163408] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.670+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f884c035040 con 0x555e04296a80 2024-05-09T09:48:01.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.670+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93862285176384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042a7890 con 0x555e04296a80 2024-05-09T09:48:01.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.670+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042a80e0 con 0x555e0429b470 2024-05-09T09:48:01.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.670+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93862285176384] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f884c035040 con 0x555e04296a80 2024-05-09T09:48:01.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.670+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.670+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93862285179024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042a7cb0 con 0x555e0429b470 2024-05-09T09:48:01.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.670+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042a8de0 con 0x555e0429b470 2024-05-09T09:48:01.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.674+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93862285179024] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.674+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.674+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93862285182560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042a91d0 con 0x555e0429b470 2024-05-09T09:48:01.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.674+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042a9b90 con 0x555e0429b470 2024-05-09T09:48:01.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.674+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.674+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93862285186784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042a9b00 con 0x555e0429b470 2024-05-09T09:48:01.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.674+0000 7f885cc0b980 20 add_watcher() i=0 2024-05-09T09:48:01.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.674+0000 7f885cc0b980 20 add_watcher() i=1 2024-05-09T09:48:01.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.674+0000 7f885cc0b980 20 add_watcher() i=2 2024-05-09T09:48:01.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.674+0000 7f885cc0b980 20 add_watcher() i=3 2024-05-09T09:48:01.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.674+0000 7f885cc0b980 20 add_watcher() i=4 2024-05-09T09:48:01.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.674+0000 7f885cc0b980 20 add_watcher() i=5 2024-05-09T09:48:01.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.678+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93862285182560] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.678+0000 7f885cc0b980 20 add_watcher() i=6 2024-05-09T09:48:01.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.678+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93862285186784] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.678+0000 7f885cc0b980 20 add_watcher() i=7 2024-05-09T09:48:01.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.678+0000 7f885cc0b980 2 all 8 watchers are set, enabling cache 2024-05-09T09:48:01.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.678+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042a8ac0 con 0x555e04296a80 2024-05-09T09:48:01.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.678+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f884c035040 con 0x555e04296a80 2024-05-09T09:48:01.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.678+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93862285183616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042aa5c0 con 0x555e04296a80 2024-05-09T09:48:01.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.678+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93862285183616] v32'320 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f884c035040 con 0x555e04296a80 2024-05-09T09:48:01.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.682+0000 7f870f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:01.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.682+0000 7f885cc0b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:48:01.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.682+0000 7f885cc0b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:48:01.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.682+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b5a50 con 0x555e04296a80 2024-05-09T09:48:01.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.682+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'77 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f884c035040 con 0x555e04296a80 2024-05-09T09:48:01.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.682+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b6120 con 0x555e0429b470 2024-05-09T09:48:01.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.686+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'71 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.686+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b6120 con 0x555e0429fdc0 2024-05-09T09:48:01.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.686+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'70 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.686+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b6710 con 0x555e04296a80 2024-05-09T09:48:01.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.686+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'321 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f884c035040 con 0x555e04296a80 2024-05-09T09:48:01.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.690+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b6bc0 con 0x7f885000f3d0 2024-05-09T09:48:01.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.690+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'200 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.690+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b7130 con 0x555e0429fdc0 2024-05-09T09:48:01.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.690+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'134 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.690+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b75e0 con 0x555e04296a80 2024-05-09T09:48:01.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.694+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'72 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f884c035040 con 0x555e04296a80 2024-05-09T09:48:01.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.694+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b7410 con 0x555e0429b470 2024-05-09T09:48:01.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.694+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'133 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.694+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b74a0 con 0x7f885000f3d0 2024-05-09T09:48:01.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.698+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'70 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.698+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b74a0 con 0x555e0429fdc0 2024-05-09T09:48:01.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.698+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'76 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.698+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b7a10 con 0x7f885000f3d0 2024-05-09T09:48:01.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.702+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'201 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.702+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b7a10 con 0x555e0429b470 2024-05-09T09:48:01.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.702+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'73 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.702+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b7a10 con 0x7f885000f3d0 2024-05-09T09:48:01.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.706+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'70 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.706+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b7a10 con 0x555e0429b470 2024-05-09T09:48:01.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.706+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'139 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.706+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b7a10 con 0x555e04296a80 2024-05-09T09:48:01.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.706+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'322 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f884c035040 con 0x555e04296a80 2024-05-09T09:48:01.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.710+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b7a10 con 0x555e0429fdc0 2024-05-09T09:48:01.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.710+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'194 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.710+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b7fa0 con 0x7f885000f3d0 2024-05-09T09:48:01.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.710+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'202 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.710+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b7d80 con 0x555e0429fdc0 2024-05-09T09:48:01.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.714+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'70 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.714+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b7d80 con 0x555e04296a80 2024-05-09T09:48:01.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.714+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'78 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f884c035040 con 0x555e04296a80 2024-05-09T09:48:01.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.714+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b7d80 con 0x555e04296a80 2024-05-09T09:48:01.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.718+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'323 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f884c035040 con 0x555e04296a80 2024-05-09T09:48:01.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.718+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b7d80 con 0x555e0429fdc0 2024-05-09T09:48:01.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.718+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'195 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.718+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b7d80 con 0x7f885000f3d0 2024-05-09T09:48:01.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.722+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'82 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.722+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b7d80 con 0x555e0429fdc0 2024-05-09T09:48:01.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.722+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'72 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.722+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b7d80 con 0x555e0429fdc0 2024-05-09T09:48:01.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.722+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'76 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.722+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b7d80 con 0x555e0429fdc0 2024-05-09T09:48:01.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.726+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'66 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.726+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b7d80 con 0x555e0429fdc0 2024-05-09T09:48:01.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.726+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'135 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.726+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b7d80 con 0x555e0429b470 2024-05-09T09:48:01.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.730+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'72 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.730+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b7d80 con 0x555e0429fdc0 2024-05-09T09:48:01.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.730+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'70 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.730+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b7d80 con 0x555e0429b470 2024-05-09T09:48:01.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.734+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'134 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.734+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b7d80 con 0x555e0429fdc0 2024-05-09T09:48:01.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.734+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'196 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.734+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b7d80 con 0x555e0429b470 2024-05-09T09:48:01.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.738+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'140 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.738+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b7d80 con 0x7f885000f3d0 2024-05-09T09:48:01.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.742+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'76 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.742+0000 7f870e7e4640 20 reqs_thread_entry: start 2024-05-09T09:48:01.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.742+0000 7f885cc0b980 20 init_complete bucket index max shards: 11 2024-05-09T09:48:01.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.742+0000 7f867ffff640 20 reqs_thread_entry: start 2024-05-09T09:48:01.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.742+0000 7f885cc0b980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-09T09:48:01.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.742+0000 7f885cc0b980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.742+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042b38b0 con 0x7f885000f3d0 2024-05-09T09:48:01.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.742+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.742+0000 7f885cc0b980 20 rados_obj.operate() r=0 bl.length=165 2024-05-09T09:48:01.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.742+0000 7f885cc0b980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-09T09:48:01.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.742+0000 7f885cc0b980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-09T09:48:01.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.742+0000 7f885cc0b980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5 : miss 2024-05-09T09:48:01.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.742+0000 7f885cc0b980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.742+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:95 8.1 8:85b9a1ed:root::.bucket.meta.myfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042d53c0 con 0x555e0429b470 2024-05-09T09:48:01.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.746+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(95 .bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.746+0000 7f885cc0b980 20 rados_obj.operate() r=0 bl.length=379 2024-05-09T09:48:01.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.746+0000 7f885cc0b980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5 info.flags=0x17 2024-05-09T09:48:01.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.746+0000 7f885cc0b980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5 to cache LRU end 2024-05-09T09:48:01.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.746+0000 7f885cc0b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:48:01.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.746+0000 7f885cc0b980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-09T09:48:01.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.746+0000 7f885cc0b980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5 2024-05-09T09:48:01.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.746+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:96 4.6 4:635c55d2:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e043528f0 con 0x555e0429fdc0 2024-05-09T09:48:01.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.746+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(96 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.746+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 4.2b 4:d4311523:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e043528f0 con 0x555e04296a80 2024-05-09T09:48:01.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.746+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(97 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f884c035040 con 0x555e04296a80 2024-05-09T09:48:01.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.746+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:98 4.1 4:83cde447:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e043528f0 con 0x7f885000f3d0 2024-05-09T09:48:01.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.746+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(98 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.2 [call out=426b] v0'0 uv7 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.746+0000 7f885cc0b980 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-05-09T09:48:01.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.746+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:99 4.1e 4:7b67c851:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e043528f0 con 0x555e0429b470 2024-05-09T09:48:01.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.746+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(99 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.746+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:100 4.34 4:2f304995:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e043528f0 con 0x7f885000f3d0 2024-05-09T09:48:01.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.746+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(100 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.746+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:101 4.12 4:4872faf3:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e04352e40 con 0x555e04296a80 2024-05-09T09:48:01.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.750+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(101 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f884c035040 con 0x555e04296a80 2024-05-09T09:48:01.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.750+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:102 4.25 4:a6f06d93:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e04352e40 con 0x555e0429fdc0 2024-05-09T09:48:01.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.750+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(102 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.6 [call out=425b] v0'0 uv3 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.750+0000 7f885cc0b980 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-05-09T09:48:01.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.750+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:103 4.29 4:94e96972:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e04352e40 con 0x555e0429fdc0 2024-05-09T09:48:01.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.750+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== osd_op_reply(103 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.750+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:104 4.1a 4:5b8886e5:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e04352e40 con 0x7f885000f3d0 2024-05-09T09:48:01.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.750+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(104 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.8 [call out=425b] v0'0 uv3 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.750+0000 7f885cc0b980 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-05-09T09:48:01.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.750+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:105 4.17 4:ea186d89:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e04352e40 con 0x555e0429b470 2024-05-09T09:48:01.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.750+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(105 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.750+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:106 4.18 4:1bb106a3:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e04352e40 con 0x7f885000f3d0 2024-05-09T09:48:01.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.750+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(106 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.10 [call out=697b] v0'0 uv11 ondisk = 0) ==== 195+0+697 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.750+0000 7f885cc0b980 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-05-09T09:48:01.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.750+0000 7f885cc0b980 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-05-09T09:48:01.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.750+0000 7f885cc0b980 20 get_obj_state: octx=0x7f884c008c70 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x555e042d5e98 s->prefetch_data=0 2024-05-09T09:48:01.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.750+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:107 3.8s0 3:1243f391:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e043505f0 con 0x555e0429fdc0 2024-05-09T09:48:01.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.750+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 30 ==== osd_op_reply(107 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.750+0000 7f885cc0b980 10 manifest: total_size = 6 2024-05-09T09:48:01.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.750+0000 7f885cc0b980 20 get_obj_state: setting s->obj_tag to b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11602011144205162363 2024-05-09T09:48:01.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.750+0000 7f885cc0b980 20 get_obj_state: octx=0x7f884c008c70 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x555e042d5e98 s->prefetch_data=0 2024-05-09T09:48:01.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.750+0000 7f885cc0b980 20 prepare_atomic_modification: state is not atomic. state=0x555e042d5e98 2024-05-09T09:48:01.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.750+0000 7f885cc0b980 20 bucket index object: :.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.2 2024-05-09T09:48:01.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.750+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:108 4.1 4:83cde447:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042da950 con 0x7f885000f3d0 2024-05-09T09:48:01.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.754+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 23 ==== osd_op_reply(108 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.2 [stat,call,call] v32'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.754+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:109 3.8s0 3:1243f391:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042d8830 con 0x555e0429fdc0 2024-05-09T09:48:01.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.754+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 31 ==== osd_op_reply(109 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5_9c8454ddf7aa50116496bac348d7550d [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.754+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:110 4.1 4:83cde447:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042db3e0 con 0x7f885000f3d0 2024-05-09T09:48:01.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.758+0000 7f885cc0b980 20 get_obj_state: octx=0x7f884c008c70 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x555e042d5e98 s->prefetch_data=0 2024-05-09T09:48:01.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.758+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:111 3.2ds0 3:b585fd6a:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042db3e0 con 0x555e0429fdc0 2024-05-09T09:48:01.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.758+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 32 ==== osd_op_reply(111 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.758+0000 7f885cc0b980 10 manifest: total_size = 3 2024-05-09T09:48:01.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.758+0000 7f885cc0b980 20 get_obj_state: setting s->obj_tag to b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9763109164794206171 2024-05-09T09:48:01.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.758+0000 7f885cc0b980 20 get_obj_state: octx=0x7f884c008c70 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x555e042d5e98 s->prefetch_data=0 2024-05-09T09:48:01.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.758+0000 7f885cc0b980 20 prepare_atomic_modification: state is not atomic. state=0x555e042d5e98 2024-05-09T09:48:01.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.758+0000 7f885cc0b980 20 bucket index object: :.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.6 2024-05-09T09:48:01.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.758+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:112 4.25 4:a6f06d93:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042e00a0 con 0x555e0429fdc0 2024-05-09T09:48:01.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.758+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 24 ==== osd_op_reply(110 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.2 [stat,call,call] v32'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.758+0000 7f873cb9e640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-05-09T09:48:01.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.758+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 33 ==== osd_op_reply(112 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.6 [stat,call,call] v32'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.758+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:113 3.2ds0 3:b585fd6a:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042d8830 con 0x555e0429fdc0 2024-05-09T09:48:01.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.762+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 34 ==== osd_op_reply(113 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5_b1b9a972ccd8c962a473909b97007eb4 [call] v32'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.762+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:114 4.25 4:a6f06d93:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042dc060 con 0x555e0429fdc0 2024-05-09T09:48:01.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.762+0000 7f885cc0b980 20 get_obj_state: octx=0x7f884c008c70 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x555e042d5e98 s->prefetch_data=0 2024-05-09T09:48:01.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.762+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:115 3.35s0 3:ac86e028:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042dc060 con 0x555e04296a80 2024-05-09T09:48:01.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.762+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(115 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f884c035040 con 0x555e04296a80 2024-05-09T09:48:01.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.762+0000 7f885cc0b980 10 manifest: total_size = 4 2024-05-09T09:48:01.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.762+0000 7f885cc0b980 20 get_obj_state: setting s->obj_tag to b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.8913303757989196877 2024-05-09T09:48:01.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.762+0000 7f885cc0b980 20 get_obj_state: octx=0x7f884c008c70 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x555e042d5e98 s->prefetch_data=0 2024-05-09T09:48:01.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.762+0000 7f885cc0b980 20 prepare_atomic_modification: state is not atomic. state=0x555e042d5e98 2024-05-09T09:48:01.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.762+0000 7f885cc0b980 20 bucket index object: :.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.8 2024-05-09T09:48:01.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.762+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:116 4.1a 4:5b8886e5:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042dc060 con 0x7f885000f3d0 2024-05-09T09:48:01.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.766+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 35 ==== osd_op_reply(114 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.6 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.766+0000 7f872bfff640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-05-09T09:48:01.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.766+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 25 ==== osd_op_reply(116 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.8 [stat,call,call] v32'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.766+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:117 3.35s0 3:ac86e028:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042dbbb0 con 0x555e04296a80 2024-05-09T09:48:01.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.766+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(117 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f884c035040 con 0x555e04296a80 2024-05-09T09:48:01.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.766+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:118 4.1a 4:5b8886e5:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042dbbb0 con 0x7f885000f3d0 2024-05-09T09:48:01.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.766+0000 7f885cc0b980 20 get_obj_state: octx=0x7f884c008c70 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x555e042d5e98 s->prefetch_data=0 2024-05-09T09:48:01.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.766+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:119 3.16s0 3:69aa0886:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042d7cd0 con 0x7f885000f3d0 2024-05-09T09:48:01.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.770+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 26 ==== osd_op_reply(119 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=877b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.770+0000 7f885cc0b980 10 manifest: total_size = 5 2024-05-09T09:48:01.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.770+0000 7f885cc0b980 20 get_obj_state: setting s->obj_tag to b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5684043077696771015 2024-05-09T09:48:01.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.770+0000 7f885cc0b980 20 get_obj_state: octx=0x7f884c008c70 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x555e042d5e98 s->prefetch_data=0 2024-05-09T09:48:01.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.770+0000 7f885cc0b980 20 prepare_atomic_modification: state is not atomic. state=0x555e042d5e98 2024-05-09T09:48:01.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.770+0000 7f885cc0b980 20 bucket index object: :.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.10 2024-05-09T09:48:01.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.770+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:120 4.18 4:1bb106a3:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042e15f0 con 0x7f885000f3d0 2024-05-09T09:48:01.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.770+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 27 ==== osd_op_reply(118 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.8 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.770+0000 7f873cb9e640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-05-09T09:48:01.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.770+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 28 ==== osd_op_reply(120 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.10 [stat,call,call] v32'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.770+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:121 3.16s0 3:69aa0886:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042e15f0 con 0x7f885000f3d0 2024-05-09T09:48:01.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.774+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 29 ==== osd_op_reply(121 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5_24d27c169c2c881eb09a065116f2aa5c [call] v32'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.774+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:122 4.18 4:1bb106a3:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042df5d0 con 0x7f885000f3d0 2024-05-09T09:48:01.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.774+0000 7f885cc0b980 20 get_obj_state: octx=0x7f884c008c70 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x555e042d5e98 s->prefetch_data=0 2024-05-09T09:48:01.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.774+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:123 3.29s0 3:96eeab6a:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042df5d0 con 0x555e0429b470 2024-05-09T09:48:01.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.774+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(123 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=909b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+925 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.774+0000 7f885cc0b980 10 manifest: total_size = 5 2024-05-09T09:48:01.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.774+0000 7f885cc0b980 20 get_obj_state: setting s->obj_tag to _qETNbHVkEbEBFKe9B__KHxflaspvi80 2024-05-09T09:48:01.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.774+0000 7f885cc0b980 20 get_obj_state: octx=0x7f884c008c70 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x555e042d5e98 s->prefetch_data=0 2024-05-09T09:48:01.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.774+0000 7f885cc0b980 20 prepare_atomic_modification: state is not atomic. state=0x555e042d5e98 2024-05-09T09:48:01.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.774+0000 7f885cc0b980 20 bucket index object: :.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.10 2024-05-09T09:48:01.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.774+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:124 4.18 4:1bb106a3:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042df5d0 con 0x7f885000f3d0 2024-05-09T09:48:01.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.774+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 30 ==== osd_op_reply(122 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.10 [stat,call,call] v32'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.774+0000 7f872bfff640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-05-09T09:48:01.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.778+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 31 ==== osd_op_reply(124 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.10 [stat,call,call] v32'14 uv14 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.778+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:125 3.29s0 3:96eeab6a:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042dfa60 con 0x555e0429b470 2024-05-09T09:48:01.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.782+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(125 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5_bb3aec0fdcdbc2974890f805c585d432 [call] v32'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.782+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:126 4.18 4:1bb106a3:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042df5d0 con 0x7f885000f3d0 2024-05-09T09:48:01.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.782+0000 7f885cc0b980 20 list_objects_ordered: starting attempt 1 2024-05-09T09:48:01.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.782+0000 7f885cc0b980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-09T09:48:01.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.782+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:127 4.6 4:635c55d2:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042df5d0 con 0x555e0429fdc0 2024-05-09T09:48:01.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.782+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:128 4.2b 4:d4311523:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042da1a0 con 0x555e04296a80 2024-05-09T09:48:01.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.782+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:129 4.1 4:83cde447:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042e4160 con 0x7f885000f3d0 2024-05-09T09:48:01.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.782+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:130 4.1e 4:7b67c851:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042e6ec0 con 0x555e0429b470 2024-05-09T09:48:01.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.782+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:131 4.34 4:2f304995:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042e9b80 con 0x7f885000f3d0 2024-05-09T09:48:01.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.782+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:132 4.12 4:4872faf3:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042e4160 con 0x555e04296a80 2024-05-09T09:48:01.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.782+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:133 4.25 4:a6f06d93:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042e6ec0 con 0x555e0429fdc0 2024-05-09T09:48:01.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.782+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:134 4.29 4:94e96972:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042f1260 con 0x555e0429fdc0 2024-05-09T09:48:01.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.782+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:135 4.1a 4:5b8886e5:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042f3db0 con 0x7f885000f3d0 2024-05-09T09:48:01.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.782+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 32 ==== osd_op_reply(129 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.2 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.782+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(130 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.782+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 33 ==== osd_op_reply(131 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.782+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 34 ==== osd_op_reply(135 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.8 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.782+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(128 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f884c035040 con 0x555e04296a80 2024-05-09T09:48:01.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.782+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:136 4.17 4:ea186d89:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042e6ec0 con 0x555e0429b470 2024-05-09T09:48:01.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.782+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:137 4.18 4:1bb106a3:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042f1260 con 0x7f885000f3d0 2024-05-09T09:48:01.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.782+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 36 ==== osd_op_reply(127 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.782+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 37 ==== osd_op_reply(133 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.782+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 38 ==== osd_op_reply(134 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.782+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(132 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f884c035040 con 0x555e04296a80 2024-05-09T09:48:01.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.782+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(136 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.782+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 35 ==== osd_op_reply(126 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.10 [stat,call,call] v32'15 uv15 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.782+0000 7f873cb9e640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-05-09T09:48:01.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.786+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 36 ==== osd_op_reply(137 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.10 [call out=124b] v0'0 uv15 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.786+0000 7f885cc0b980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-09T09:48:01.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.786+0000 7f885cc0b980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-09T09:48:01.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.786+0000 7f885cc0b980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-09T09:48:01.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.786+0000 7f885cc0b980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-09T09:48:01.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.786+0000 7f885cc0b980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5])"; uploads.size()=0; is_truncated=0 2024-05-09T09:48:01.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.786+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:138 4.6 4:635c55d2:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042da370 con 0x555e0429fdc0 2024-05-09T09:48:01.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.786+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:139 4.2b 4:d4311523:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042e6ec0 con 0x555e04296a80 2024-05-09T09:48:01.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.786+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:140 4.1 4:83cde447:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042e95f0 con 0x7f885000f3d0 2024-05-09T09:48:01.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.786+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:141 4.1e 4:7b67c851:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042f2740 con 0x555e0429b470 2024-05-09T09:48:01.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.786+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:142 4.34 4:2f304995:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042eff90 con 0x7f885000f3d0 2024-05-09T09:48:01.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.786+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:143 4.12 4:4872faf3:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042e6ec0 con 0x555e04296a80 2024-05-09T09:48:01.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.786+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:144 4.25 4:a6f06d93:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042e95f0 con 0x555e0429fdc0 2024-05-09T09:48:01.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.786+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:145 4.29 4:94e96972:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042f2740 con 0x555e0429fdc0 2024-05-09T09:48:01.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.786+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:146 4.1a 4:5b8886e5:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042eff90 con 0x7f885000f3d0 2024-05-09T09:48:01.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.786+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:147 4.17 4:ea186d89:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042ed3d0 con 0x555e0429b470 2024-05-09T09:48:01.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.786+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:148 4.18 4:1bb106a3:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042e95f0 con 0x7f885000f3d0 2024-05-09T09:48:01.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.786+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(139 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f884c035040 con 0x555e04296a80 2024-05-09T09:48:01.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.786+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(143 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f884c035040 con 0x555e04296a80 2024-05-09T09:48:01.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.786+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 37 ==== osd_op_reply(140 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.2 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.786+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 38 ==== osd_op_reply(142 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.786+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 39 ==== osd_op_reply(146 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.8 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.786+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 32 ==== osd_op_reply(141 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.786+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 40 ==== osd_op_reply(148 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.10 [call out=124b] v0'0 uv15 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.786+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 39 ==== osd_op_reply(138 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.786+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 40 ==== osd_op_reply(144 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.786+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 41 ==== osd_op_reply(145 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.786+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 33 ==== osd_op_reply(147 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.786+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042e6ec0 con 0x7f885000f3d0 2024-05-09T09:48:01.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.790+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 41 ==== osd_op_reply(149 foo.buckets [call] v32'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.790+0000 7f885cc0b980 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-05-09T09:48:01.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.790+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042f2740 con 0x7f885000f3d0 2024-05-09T09:48:01.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.790+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 42 ==== osd_op_reply(150 myfoo [call,call,delete] v32'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.790+0000 7f885cc0b980 10 removing default.rgw.meta+root+myfoo from cache 2024-05-09T09:48:01.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.790+0000 7f885cc0b980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-09T09:48:01.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.790+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93862285438400 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042e6720 con 0x555e0429b470 2024-05-09T09:48:01.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.790+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 34 ==== watch-notify(notify (1) cookie 93862285182560 notify 137438953497 ret 0) ==== 191+0+0 (crc 0 0 0) 0x555e042b3c90 con 0x555e0429b470 2024-05-09T09:48:01.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.790+0000 7f873cb9e640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953497 cookie 93862285182560 notifier 4656 bl.length()=149 2024-05-09T09:48:01.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.790+0000 7f873cb9e640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f871c005580 con 0x555e0429b470 2024-05-09T09:48:01.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.790+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 35 ==== osd_op_reply(151 notify.6 [notify cookie 93862285438400 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.794+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 36 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.794+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 37 ==== watch-notify(notify_complete (2) cookie 93862285438400 notify 137438953497 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555e042764f0 con 0x555e0429b470 2024-05-09T09:48:01.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.794+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:153 8.1 8:85b9a1ed:root::.bucket.meta.myfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042e6720 con 0x555e0429b470 2024-05-09T09:48:01.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.794+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 38 ==== osd_op_reply(153 .bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5 [call,call,delete] v32'6 uv6 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.794+0000 7f885cc0b980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5 from cache 2024-05-09T09:48:01.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.794+0000 7f885cc0b980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5, ofs0, ns] 2024-05-09T09:48:01.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.794+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:154 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93862285415920 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042e6720 con 0x555e0429b470 2024-05-09T09:48:01.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.798+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 39 ==== watch-notify(notify (1) cookie 93862285182560 notify 137438953498 ret 0) ==== 248+0+0 (crc 0 0 0) 0x555e042764f0 con 0x555e0429b470 2024-05-09T09:48:01.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.798+0000 7f872bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953498 cookie 93862285182560 notifier 4656 bl.length()=206 2024-05-09T09:48:01.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.798+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 40 ==== osd_op_reply(154 notify.6 [notify cookie 93862285415920 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.798+0000 7f872bfff640 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:155 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f868c003930 con 0x555e0429b470 2024-05-09T09:48:01.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.798+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 41 ==== watch-notify(notify_complete (2) cookie 93862285415920 notify 137438953498 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555e042428f0 con 0x555e0429b470 2024-05-09T09:48:01.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.798+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 42 ==== osd_op_reply(155 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.798+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:156 4.6 4:635c55d2:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042e6720 con 0x555e0429fdc0 2024-05-09T09:48:01.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.798+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:157 4.2b 4:d4311523:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042e0a90 con 0x555e04296a80 2024-05-09T09:48:01.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.798+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:158 4.1 4:83cde447:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042e12e0 con 0x7f885000f3d0 2024-05-09T09:48:01.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.798+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:159 4.1e 4:7b67c851:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042e1700 con 0x555e0429b470 2024-05-09T09:48:01.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.798+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:160 4.34 4:2f304995:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042e6720 con 0x7f885000f3d0 2024-05-09T09:48:01.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.798+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:161 4.12 4:4872faf3:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042e0a90 con 0x555e04296a80 2024-05-09T09:48:01.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.798+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:162 4.25 4:a6f06d93:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042e12e0 con 0x555e0429fdc0 2024-05-09T09:48:01.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.798+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:163 4.29 4:94e96972:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042e1700 con 0x555e0429fdc0 2024-05-09T09:48:01.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.798+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:164 4.1a 4:5b8886e5:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042e6720 con 0x7f885000f3d0 2024-05-09T09:48:01.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.798+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:165 4.17 4:ea186d89:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042e0a90 con 0x555e0429b470 2024-05-09T09:48:01.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.798+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:166 4.18 4:1bb106a3:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042e6720 con 0x7f885000f3d0 2024-05-09T09:48:01.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.802+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(157 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.1 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f884c035040 con 0x555e04296a80 2024-05-09T09:48:01.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.802+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 36 ==== osd_op_reply(161 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.5 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f884c035040 con 0x555e04296a80 2024-05-09T09:48:01.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.802+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 43 ==== osd_op_reply(159 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.3 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.802+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 42 ==== osd_op_reply(163 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.7 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.802+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 43 ==== osd_op_reply(156 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.0 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.802+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 44 ==== osd_op_reply(165 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.9 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.802+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 43 ==== osd_op_reply(158 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.2 [delete] v32'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.802+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 44 ==== osd_op_reply(162 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.6 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.802+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 44 ==== osd_op_reply(160 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.4 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.802+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 45 ==== osd_op_reply(164 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.8 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.802+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 46 ==== osd_op_reply(166 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5.10 [delete] v32'16 uv16 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.802+0000 7f885cc0b980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5 : miss 2024-05-09T09:48:01.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.802+0000 7f885cc0b980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.802+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:167 6.1b 6:defaf281:::pubsub..bucket.myfoo%2fb73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e042e05e0 con 0x555e0429fdc0 2024-05-09T09:48:01.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.802+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 45 ==== osd_op_reply(167 pubsub..bucket.myfoo/b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.802+0000 7f885cc0b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:01.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.802+0000 7f885cc0b980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5 info.flags=0x0 2024-05-09T09:48:01.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.802+0000 7f885cc0b980 10 adding default.rgw.log++pubsub..bucket.myfoo/b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5 to cache LRU end 2024-05-09T09:48:01.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.802+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:168 6.1b 6:defaf281:::pubsub..bucket.myfoo%2fb73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042e05e0 con 0x555e0429fdc0 2024-05-09T09:48:01.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.802+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 46 ==== osd_op_reply(168 pubsub..bucket.myfoo/b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.5 [delete] v32'67 uv61 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.802+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042e15f0 con 0x7f885000f3d0 2024-05-09T09:48:01.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.806+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 47 ==== osd_op_reply(169 foo.buckets [call] v32'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.806+0000 7f870f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:01.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.806+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93862285183616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b4a60 con 0x555e04296a80 2024-05-09T09:48:01.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.806+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 37 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 93862285183616] v32'324 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f884c035040 con 0x555e04296a80 2024-05-09T09:48:01.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.806+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93862285165920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b4a60 con 0x7f885000f3d0 2024-05-09T09:48:01.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.810+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 48 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 93862285165920] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.810+0000 7f885cc0b980 20 remove_watcher() i=0 2024-05-09T09:48:01.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.810+0000 7f885cc0b980 2 removed watcher, disabling cache 2024-05-09T09:48:01.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.810+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93862285169456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042a4560 con 0x555e04296a80 2024-05-09T09:48:01.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.814+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 38 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 93862285169456] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f884c035040 con 0x555e04296a80 2024-05-09T09:48:01.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.814+0000 7f885cc0b980 20 remove_watcher() i=1 2024-05-09T09:48:01.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.814+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93862285171760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042b4a60 con 0x555e0429fdc0 2024-05-09T09:48:01.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.814+0000 7f8859f25640 1 -- 172.21.15.157:0/39680532 <== osd.3 v2:172.21.15.157:6816/2487336710 47 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 93862285171760] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8850048040 con 0x555e0429fdc0 2024-05-09T09:48:01.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.814+0000 7f885cc0b980 20 remove_watcher() i=2 2024-05-09T09:48:01.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.814+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93862285163408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042a5330 con 0x7f885000f3d0 2024-05-09T09:48:01.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.814+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.2 v2:172.21.15.157:6800/354455204 49 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 93862285163408] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f884c035040 con 0x7f885000f3d0 2024-05-09T09:48:01.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.814+0000 7f885cc0b980 20 remove_watcher() i=3 2024-05-09T09:48:01.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.814+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93862285176384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042a4560 con 0x555e04296a80 2024-05-09T09:48:01.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.818+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 <== osd.1 v2:172.21.15.157:6808/3930131338 39 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 93862285176384] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f884c035040 con 0x555e04296a80 2024-05-09T09:48:01.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.818+0000 7f885cc0b980 20 remove_watcher() i=4 2024-05-09T09:48:01.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.818+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93862285179024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042a3b90 con 0x555e0429b470 2024-05-09T09:48:01.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.822+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 45 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 93862285179024] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.822+0000 7f885cc0b980 20 remove_watcher() i=5 2024-05-09T09:48:01.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.822+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93862285182560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042a5330 con 0x555e0429b470 2024-05-09T09:48:01.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.822+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 46 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 93862285182560] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.822+0000 7f885cc0b980 20 remove_watcher() i=6 2024-05-09T09:48:01.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.822+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93862285186784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e042a6e40 con 0x555e0429b470 2024-05-09T09:48:01.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885a726640 1 -- 172.21.15.157:0/39680532 <== osd.0 v2:172.21.15.110:6800/231209037 47 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 93862285186784] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88540b12b0 con 0x555e0429b470 2024-05-09T09:48:01.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 20 remove_watcher() i=7 2024-05-09T09:48:01.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555e0429b470 msgr2=0x555e0429d860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 --2- 172.21.15.157:0/39680532 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555e0429b470 0x555e0429d860 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555e04296a80 msgr2=0x555e04298f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 --2- 172.21.15.157:0/39680532 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555e04296a80 0x555e04298f40 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f885000f3d0 msgr2=0x7f885000f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 --2- 172.21.15.157:0/39680532 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f885000f3d0 0x7f885000f7f0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555e0429fdc0 msgr2=0x555e042a21d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 --2- 172.21.15.157:0/39680532 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555e0429fdc0 0x555e042a21d0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8724034bb0 msgr2=0x7f8724037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 --2- 172.21.15.157:0/39680532 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8724034bb0 0x7f8724037070 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8850010fd0 tx=0x7f8850011000 comp rx=0 tx=0).stop 2024-05-09T09:48:01.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e04282b60 msgr2=0x555e04289e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 --2- 172.21.15.157:0/39680532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e04282b60 0x555e04289e90 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f88540b1ec0 tx=0x7f88540d2ec0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885af27640 1 -- 172.21.15.157:0/39680532 reap_dead start 2024-05-09T09:48:01.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 shutdown_connections 2024-05-09T09:48:01.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 >> 172.21.15.157:0/39680532 conn(0x555e0427ef30 msgr2=0x555e0427c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:01.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 shutdown_connections 2024-05-09T09:48:01.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 -- 172.21.15.157:0/39680532 wait complete. 2024-05-09T09:48:01.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 -- 172.21.15.157:0/1077984779 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8734034c00 msgr2=0x7f87340370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 --2- 172.21.15.157:0/1077984779 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8734034c00 0x7f87340370c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x555e0424ff50 tx=0x7f8850006000 comp rx=0 tx=0).stop 2024-05-09T09:48:01.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 -- 172.21.15.157:0/1077984779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e04275b90 msgr2=0x555e04275fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 --2- 172.21.15.157:0/1077984779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e04275b90 0x555e04275fb0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f88540e35f0 tx=0x7f88540a9870 comp rx=0 tx=0).stop 2024-05-09T09:48:01.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 -- 172.21.15.157:0/1077984779 shutdown_connections 2024-05-09T09:48:01.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 --2- 172.21.15.157:0/1077984779 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8734034c00 0x7f87340370c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 --2- 172.21.15.157:0/1077984779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e04275b90 0x555e04275fb0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 -- 172.21.15.157:0/1077984779 >> 172.21.15.157:0/1077984779 conn(0x555e0426a960 msgr2=0x555e0426b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:01.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 -- 172.21.15.157:0/1077984779 shutdown_connections 2024-05-09T09:48:01.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 -- 172.21.15.157:0/1077984779 wait complete. 2024-05-09T09:48:01.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 -- 172.21.15.157:0/4266721962 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555e042490d0 msgr2=0x555e0424b4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 --2- 172.21.15.157:0/4266721962 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555e042490d0 0x555e0424b4c0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 -- 172.21.15.157:0/4266721962 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555e042443c0 msgr2=0x555e042467b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 --2- 172.21.15.157:0/4266721962 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555e042443c0 0x555e042467b0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 -- 172.21.15.157:0/4266721962 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555e0424cfd0 msgr2=0x555e0424f3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 --2- 172.21.15.157:0/4266721962 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555e0424cfd0 0x555e0424f3c0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 -- 172.21.15.157:0/4266721962 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8740034c00 msgr2=0x7f87400370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 --2- 172.21.15.157:0/4266721962 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8740034c00 0x7f87400370c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8850000f70 tx=0x7f8850001420 comp rx=0 tx=0).stop 2024-05-09T09:48:01.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 -- 172.21.15.157:0/4266721962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e0414ddd0 msgr2=0x555e0423f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 --2- 172.21.15.157:0/4266721962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555e0414ddd0 0x555e0423f490 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8854000f90 tx=0x7f8854017e30 comp rx=0 tx=0).stop 2024-05-09T09:48:01.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885af27640 1 -- 172.21.15.157:0/4266721962 reap_dead start 2024-05-09T09:48:01.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 -- 172.21.15.157:0/4266721962 shutdown_connections 2024-05-09T09:48:01.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 -- 172.21.15.157:0/4266721962 >> 172.21.15.157:0/4266721962 conn(0x555e040c02b0 msgr2=0x555e04232980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:01.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 -- 172.21.15.157:0/4266721962 shutdown_connections 2024-05-09T09:48:01.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.826+0000 7f885cc0b980 1 -- 172.21.15.157:0/4266721962 wait complete. 2024-05-09T09:48:01.841 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-05-09T09:48:01.841 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-05-09T09:48:01.841 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-05-09T09:48:01.927 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:48:01.927 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:48:01.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.926+0000 7f53dc19f980 1 Processor -- start 2024-05-09T09:48:01.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.926+0000 7f53dc19f980 1 -- start start 2024-05-09T09:48:01.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.926+0000 7f53dc19f980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55768c343ce0 0x55768c3460d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.926+0000 7f53dc19f980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55768c1f5440 con 0x55768c2b3ac0 2024-05-09T09:48:01.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.926+0000 7f53dc19f980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55768c1e05f0 con 0x55768c343ce0 2024-05-09T09:48:01.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.926+0000 7f53d94b9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55768c343ce0 0x55768c3460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.926+0000 7f53d9cba640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x55768c2b3ac0 0x55768c3425c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:56204/0 (socket says 172.21.15.157:56204) 2024-05-09T09:48:01.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.926+0000 7f53d9cba640 1 -- 172.21.15.157:0/2989694410 learned_addr learned my addr 172.21.15.157:0/2989694410 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:48:01.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.930+0000 7f53d94b9640 1 -- 172.21.15.157:0/2989694410 >> v1:172.21.15.110:6789/0 conn(0x55768c2b3ac0 legacy=0x55768c3425c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.930+0000 7f53d94b9640 1 -- 172.21.15.157:0/2989694410 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55768c1eb990 con 0x55768c343ce0 2024-05-09T09:48:01.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.930+0000 7f53d94b9640 1 --2- 172.21.15.157:0/2989694410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c343ce0 0x55768c3460d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f53c400a480 tx=0x7f53c401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e74ae94031093ac server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.930+0000 7f53d8cb8640 1 -- 172.21.15.157:0/2989694410 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53c40b0070 con 0x55768c343ce0 2024-05-09T09:48:01.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.930+0000 7f53d8cb8640 1 -- 172.21.15.157:0/2989694410 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53c40ab540 con 0x55768c343ce0 2024-05-09T09:48:01.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.930+0000 7f53d8cb8640 1 -- 172.21.15.157:0/2989694410 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53c40ab840 con 0x55768c343ce0 2024-05-09T09:48:01.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.930+0000 7f53dc19f980 1 -- 172.21.15.157:0/2989694410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c343ce0 msgr2=0x55768c3460d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.930+0000 7f53dc19f980 1 --2- 172.21.15.157:0/2989694410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c343ce0 0x55768c3460d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f53c400a480 tx=0x7f53c401b280 comp rx=0 tx=0).stop 2024-05-09T09:48:01.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.930+0000 7f53dc19f980 1 -- 172.21.15.157:0/2989694410 shutdown_connections 2024-05-09T09:48:01.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.930+0000 7f53dc19f980 1 --2- 172.21.15.157:0/2989694410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c343ce0 0x55768c3460d0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.930+0000 7f53dc19f980 1 -- 172.21.15.157:0/2989694410 >> 172.21.15.157:0/2989694410 conn(0x55768c33a0e0 msgr2=0x55768c33c500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:01.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.930+0000 7f53dc19f980 1 -- 172.21.15.157:0/2989694410 shutdown_connections 2024-05-09T09:48:01.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.934+0000 7f53dc19f980 1 -- 172.21.15.157:0/2989694410 wait complete. 2024-05-09T09:48:01.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.946+0000 7f53dc19f980 1 Processor -- start 2024-05-09T09:48:01.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.946+0000 7f53dc19f980 1 -- start start 2024-05-09T09:48:01.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.946+0000 7f53dc19f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c2b3ac0 0x55768c42ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.946+0000 7f53dc19f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55768c242fe0 con 0x55768c2b3ac0 2024-05-09T09:48:01.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.950+0000 7f53d9cba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c2b3ac0 0x55768c42ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.950+0000 7f53d9cba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c2b3ac0 0x55768c42ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35180/0 (socket says 172.21.15.157:35180) 2024-05-09T09:48:01.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.950+0000 7f53d9cba640 1 -- 172.21.15.157:0/3529394780 learned_addr learned my addr 172.21.15.157:0/3529394780 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:01.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.950+0000 7f53d9cba640 1 -- 172.21.15.157:0/3529394780 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55768c1c7ae0 con 0x55768c2b3ac0 2024-05-09T09:48:01.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.950+0000 7f53d9cba640 1 --2- 172.21.15.157:0/3529394780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c2b3ac0 0x55768c42ab90 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f53cc0015f0 tx=0x7f53cc001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e7bd62c0e8dc50 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.950+0000 7f52c7e07640 1 -- 172.21.15.157:0/3529394780 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc004530 con 0x55768c2b3ac0 2024-05-09T09:48:01.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.950+0000 7f52c7e07640 1 -- 172.21.15.157:0/3529394780 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53cc0046f0 con 0x55768c2b3ac0 2024-05-09T09:48:01.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.950+0000 7f52c7e07640 1 -- 172.21.15.157:0/3529394780 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc004a90 con 0x55768c2b3ac0 2024-05-09T09:48:01.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.950+0000 7f53dc19f980 1 -- 172.21.15.157:0/3529394780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c2b3ac0 msgr2=0x55768c42ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.950+0000 7f53dc19f980 1 --2- 172.21.15.157:0/3529394780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c2b3ac0 0x55768c42ab90 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f53cc0015f0 tx=0x7f53cc001ab0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.950+0000 7f53dc19f980 1 -- 172.21.15.157:0/3529394780 shutdown_connections 2024-05-09T09:48:01.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.950+0000 7f53dc19f980 1 --2- 172.21.15.157:0/3529394780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c2b3ac0 0x55768c42ab90 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.950+0000 7f53dc19f980 1 -- 172.21.15.157:0/3529394780 >> 172.21.15.157:0/3529394780 conn(0x55768c33a0e0 msgr2=0x55768c426720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:01.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.954+0000 7f53dc19f980 1 -- 172.21.15.157:0/3529394780 shutdown_connections 2024-05-09T09:48:01.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.954+0000 7f53dc19f980 1 -- 172.21.15.157:0/3529394780 wait complete. 2024-05-09T09:48:01.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.954+0000 7f53dc19f980 1 Processor -- start 2024-05-09T09:48:01.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.954+0000 7f53dc19f980 1 -- start start 2024-05-09T09:48:01.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.954+0000 7f53dc19f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c2b3ac0 0x55768c431d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.954+0000 7f53dc19f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55768c3471b0 con 0x55768c2b3ac0 2024-05-09T09:48:01.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.954+0000 7f53d9cba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c2b3ac0 0x55768c431d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.954+0000 7f53d9cba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c2b3ac0 0x55768c431d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35182/0 (socket says 172.21.15.157:35182) 2024-05-09T09:48:01.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.954+0000 7f53d9cba640 1 -- 172.21.15.157:0/1826490331 learned_addr learned my addr 172.21.15.157:0/1826490331 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:01.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.954+0000 7f53d9cba640 1 -- 172.21.15.157:0/1826490331 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55768c432280 con 0x55768c2b3ac0 2024-05-09T09:48:01.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.954+0000 7f53d9cba640 1 --2- 172.21.15.157:0/1826490331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c2b3ac0 0x55768c431d40 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x55768c42ba20 tx=0x7f53cc000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.954+0000 7f52c6604640 1 -- 172.21.15.157:0/1826490331 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc013760 con 0x55768c2b3ac0 2024-05-09T09:48:01.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.954+0000 7f52c6604640 1 -- 172.21.15.157:0/1826490331 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53cc013900 con 0x55768c2b3ac0 2024-05-09T09:48:01.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.954+0000 7f52c6604640 1 -- 172.21.15.157:0/1826490331 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc013be0 con 0x55768c2b3ac0 2024-05-09T09:48:01.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.954+0000 7f53dc19f980 1 -- 172.21.15.157:0/1826490331 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55768c432510 con 0x55768c2b3ac0 2024-05-09T09:48:01.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.954+0000 7f53dc19f980 1 -- 172.21.15.157:0/1826490331 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55768c4351f0 con 0x55768c2b3ac0 2024-05-09T09:48:01.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.954+0000 7f52c6604640 1 -- 172.21.15.157:0/1826490331 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f53cc010070 con 0x55768c2b3ac0 2024-05-09T09:48:01.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.958+0000 7f52c6604640 1 --2- 172.21.15.157:0/1826490331 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f52c0034bb0 0x7f52c0037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.958+0000 7f52c6604640 1 -- 172.21.15.157:0/1826490331 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f53cc018070 con 0x55768c2b3ac0 2024-05-09T09:48:01.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.958+0000 7f53d94b9640 1 --2- 172.21.15.157:0/1826490331 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f52c0034bb0 0x7f52c0037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.958+0000 7f53dc19f980 1 --2- 172.21.15.157:0/1826490331 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55768c343ce0 0x55768c438d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.958+0000 7f53dc19f980 1 -- 172.21.15.157:0/1826490331 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55768c4393a0 con 0x55768c343ce0 2024-05-09T09:48:01.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.958+0000 7f53da4bb640 1 --2- 172.21.15.157:0/1826490331 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55768c343ce0 0x55768c438d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.958+0000 7f53d94b9640 1 --2- 172.21.15.157:0/1826490331 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f52c0034bb0 0x7f52c0037070 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f53c40ad000 tx=0x7f53c40a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.958+0000 7f53da4bb640 1 --2- 172.21.15.157:0/1826490331 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55768c343ce0 0x55768c438d30 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.958+0000 7f53da4bb640 1 -- 172.21.15.157:0/1826490331 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53d40083f0 con 0x55768c343ce0 2024-05-09T09:48:01.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.958+0000 7f53dc19f980 1 -- 172.21.15.157:0/1826490331 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55768c4363f0 con 0x55768c343ce0 2024-05-09T09:48:01.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.958+0000 7f53da4bb640 1 -- 172.21.15.157:0/1826490331 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f53d40083f0 con 0x55768c343ce0 2024-05-09T09:48:01.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.958+0000 7f53dc19f980 1 --2- 172.21.15.157:0/1826490331 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55768c43b6d0 0x55768c43dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.958+0000 7f53dc19f980 1 -- 172.21.15.157:0/1826490331 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55768c43e190 con 0x55768c43b6d0 2024-05-09T09:48:01.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.958+0000 7f53d9cba640 1 --2- 172.21.15.157:0/1826490331 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55768c43b6d0 0x55768c43dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.958+0000 7f53d9cba640 1 --2- 172.21.15.157:0/1826490331 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55768c43b6d0 0x55768c43dac0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.958+0000 7f53d9cba640 1 -- 172.21.15.157:0/1826490331 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f53cc01b030 con 0x55768c43b6d0 2024-05-09T09:48:01.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.958+0000 7f53dc19f980 1 -- 172.21.15.157:0/1826490331 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55768c43a570 con 0x55768c343ce0 2024-05-09T09:48:01.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.958+0000 7f53da4bb640 1 -- 172.21.15.157:0/1826490331 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f53d40083f0 con 0x55768c343ce0 2024-05-09T09:48:01.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.958+0000 7f53dc19f980 1 --2- 172.21.15.157:0/1826490331 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55768c43f5d0 0x55768c4419c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.958+0000 7f53dc19f980 1 -- 172.21.15.157:0/1826490331 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55768c442150 con 0x55768c43f5d0 2024-05-09T09:48:01.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.958+0000 7f53d94b9640 1 --2- 172.21.15.157:0/1826490331 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55768c43f5d0 0x55768c4419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.962+0000 7f53d94b9640 1 --2- 172.21.15.157:0/1826490331 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55768c43f5d0 0x55768c4419c0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.962+0000 7f53d94b9640 1 -- 172.21.15.157:0/1826490331 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f53c40b3040 con 0x55768c43f5d0 2024-05-09T09:48:01.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.966+0000 7f53dc19f980 1 Processor -- start 2024-05-09T09:48:01.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.966+0000 7f53dc19f980 1 -- start start 2024-05-09T09:48:01.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.966+0000 7f53dc19f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c467f90 0x55768c4683b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.966+0000 7f53dc19f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55768c247020 con 0x55768c467f90 2024-05-09T09:48:01.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.966+0000 7f53d9cba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c467f90 0x55768c4683b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.966+0000 7f53d9cba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c467f90 0x55768c4683b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35188/0 (socket says 172.21.15.157:35188) 2024-05-09T09:48:01.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.966+0000 7f53d9cba640 1 -- 172.21.15.157:0/3237838313 learned_addr learned my addr 172.21.15.157:0/3237838313 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:01.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.966+0000 7f53d9cba640 1 -- 172.21.15.157:0/3237838313 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55768c4688f0 con 0x55768c467f90 2024-05-09T09:48:01.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.966+0000 7f53d9cba640 1 --2- 172.21.15.157:0/3237838313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c467f90 0x55768c4683b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f53cc048a20 tx=0x7f53cc029840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.966+0000 7f52be3a1640 1 -- 172.21.15.157:0/3237838313 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc010d70 con 0x55768c467f90 2024-05-09T09:48:01.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.966+0000 7f52be3a1640 1 -- 172.21.15.157:0/3237838313 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53cc04a0d0 con 0x55768c467f90 2024-05-09T09:48:01.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.966+0000 7f53dc19f980 1 -- 172.21.15.157:0/3237838313 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55768c469380 con 0x55768c467f90 2024-05-09T09:48:01.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.966+0000 7f52be3a1640 1 -- 172.21.15.157:0/3237838313 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc04a3f0 con 0x55768c467f90 2024-05-09T09:48:01.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.966+0000 7f53dc19f980 1 -- 172.21.15.157:0/3237838313 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55768c469860 con 0x55768c467f90 2024-05-09T09:48:01.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.966+0000 7f52be3a1640 1 -- 172.21.15.157:0/3237838313 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f53cc03d070 con 0x55768c467f90 2024-05-09T09:48:01.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.966+0000 7f52be3a1640 1 --2- 172.21.15.157:0/3237838313 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f52b4034bb0 0x7f52b4037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.966+0000 7f52be3a1640 1 -- 172.21.15.157:0/3237838313 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f53cc03b070 con 0x55768c467f90 2024-05-09T09:48:01.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.966+0000 7f53d94b9640 1 --2- 172.21.15.157:0/3237838313 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f52b4034bb0 0x7f52b4037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.966+0000 7f53dc19f980 1 Processor -- start 2024-05-09T09:48:01.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.966+0000 7f53dc19f980 1 -- start start 2024-05-09T09:48:01.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.970+0000 7f53dc19f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c474f90 0x55768c475390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.970+0000 7f53dc19f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55768c42b2e0 con 0x55768c474f90 2024-05-09T09:48:01.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.970+0000 7f53d94b9640 1 --2- 172.21.15.157:0/3237838313 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f52b4034bb0 0x7f52b4037070 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f53c401b2c0 tx=0x7f53c4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.970+0000 7f53d9cba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c474f90 0x55768c475390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.970+0000 7f53d9cba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c474f90 0x55768c475390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35204/0 (socket says 172.21.15.157:35204) 2024-05-09T09:48:01.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.970+0000 7f53d9cba640 1 -- 172.21.15.157:0/854976157 learned_addr learned my addr 172.21.15.157:0/854976157 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:01.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.970+0000 7f53d9cba640 1 -- 172.21.15.157:0/854976157 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55768c475960 con 0x55768c474f90 2024-05-09T09:48:01.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.970+0000 7f53d9cba640 1 --2- 172.21.15.157:0/854976157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c474f90 0x55768c475390 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f53cc04bff0 tx=0x7f53cc0345a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8d60b7055bf6c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.970+0000 7f52abfff640 1 -- 172.21.15.157:0/854976157 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc045e20 con 0x55768c474f90 2024-05-09T09:48:01.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.970+0000 7f52abfff640 1 -- 172.21.15.157:0/854976157 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53cc05a070 con 0x55768c474f90 2024-05-09T09:48:01.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.970+0000 7f52abfff640 1 -- 172.21.15.157:0/854976157 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc02a050 con 0x55768c474f90 2024-05-09T09:48:01.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.970+0000 7f53dc19f980 1 -- 172.21.15.157:0/854976157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c474f90 msgr2=0x55768c475390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:01.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.970+0000 7f53dc19f980 1 --2- 172.21.15.157:0/854976157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c474f90 0x55768c475390 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f53cc04bff0 tx=0x7f53cc0345a0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.970+0000 7f53dc19f980 1 -- 172.21.15.157:0/854976157 shutdown_connections 2024-05-09T09:48:01.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.970+0000 7f53dc19f980 1 --2- 172.21.15.157:0/854976157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c474f90 0x55768c475390 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:01.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.970+0000 7f53dc19f980 1 -- 172.21.15.157:0/854976157 >> 172.21.15.157:0/854976157 conn(0x55768c471310 msgr2=0x55768c46f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:01.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.970+0000 7f53dc19f980 1 -- 172.21.15.157:0/854976157 shutdown_connections 2024-05-09T09:48:01.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.970+0000 7f53dc19f980 1 -- 172.21.15.157:0/854976157 wait complete. 2024-05-09T09:48:01.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.970+0000 7f53dc19f980 1 Processor -- start 2024-05-09T09:48:01.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.970+0000 7f53dc19f980 1 -- start start 2024-05-09T09:48:01.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.970+0000 7f53dc19f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c474f90 0x55768c47c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.970+0000 7f53dc19f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55768c476050 con 0x55768c474f90 2024-05-09T09:48:01.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.970+0000 7f53d9cba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c474f90 0x55768c47c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.970+0000 7f53d9cba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c474f90 0x55768c47c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35212/0 (socket says 172.21.15.157:35212) 2024-05-09T09:48:01.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.970+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 learned_addr learned my addr 172.21.15.157:0/2293181117 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:01.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.970+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55768c47c830 con 0x55768c474f90 2024-05-09T09:48:01.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f53d9cba640 1 --2- 172.21.15.157:0/2293181117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c474f90 0x55768c47c2f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f53cc047820 tx=0x7f53cc02a240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f52aa7fc640 1 -- 172.21.15.157:0/2293181117 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc06f070 con 0x55768c474f90 2024-05-09T09:48:01.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f52aa7fc640 1 -- 172.21.15.157:0/2293181117 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53cc0115d0 con 0x55768c474f90 2024-05-09T09:48:01.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55768c47c830 con 0x55768c474f90 2024-05-09T09:48:01.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f52aa7fc640 1 -- 172.21.15.157:0/2293181117 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc045e20 con 0x55768c474f90 2024-05-09T09:48:01.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55768c47c830 con 0x55768c474f90 2024-05-09T09:48:01.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f52aa7fc640 1 -- 172.21.15.157:0/2293181117 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f53cc072070 con 0x55768c474f90 2024-05-09T09:48:01.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f52aa7fc640 1 --2- 172.21.15.157:0/2293181117 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f52a4034c00 0x7f52a40370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f52aa7fc640 1 -- 172.21.15.157:0/2293181117 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f53cc048e00 con 0x55768c474f90 2024-05-09T09:48:01.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f53d94b9640 1 --2- 172.21.15.157:0/2293181117 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f52a4034c00 0x7f52a40370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f53dc19f980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f53dc19f980 1 --2- 172.21.15.157:0/2293181117 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55768c488dd0 0x55768c48b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55768c48b9e0 con 0x55768c488dd0 2024-05-09T09:48:01.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f53da4bb640 1 --2- 172.21.15.157:0/2293181117 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55768c488dd0 0x55768c48b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f53d94b9640 1 --2- 172.21.15.157:0/2293181117 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f52a4034c00 0x7f52a40370c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f53c40abfd0 tx=0x7f53c40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f53da4bb640 1 --2- 172.21.15.157:0/2293181117 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55768c488dd0 0x55768c48b290 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53d40083f0 con 0x55768c488dd0 2024-05-09T09:48:01.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f53dc19f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:01.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f53dc19f980 20 realm 2024-05-09T09:48:01.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f53dc19f980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55768c48bdf0 con 0x55768c488dd0 2024-05-09T09:48:01.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53d40083f0 con 0x55768c488dd0 2024-05-09T09:48:01.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f53dc19f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:01.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f53dc19f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:48:01.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f53dc19f980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55768c48c6c0 con 0x55768c488dd0 2024-05-09T09:48:01.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53d40083f0 con 0x55768c488dd0 2024-05-09T09:48:01.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f53dc19f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:01.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f53dc19f980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.974+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55768c48ca60 con 0x55768c488dd0 2024-05-09T09:48:01.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.978+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f53d40083f0 con 0x55768c488dd0 2024-05-09T09:48:01.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.978+0000 7f53dc19f980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:01.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.978+0000 7f53dc19f980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.978+0000 7f53dc19f980 1 --2- 172.21.15.157:0/2293181117 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55768c48d7c0 0x55768c48fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.978+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55768c4901c0 con 0x55768c48d7c0 2024-05-09T09:48:01.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.978+0000 7f53d9cba640 1 --2- 172.21.15.157:0/2293181117 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55768c48d7c0 0x55768c48fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.978+0000 7f53d9cba640 1 --2- 172.21.15.157:0/2293181117 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55768c48d7c0 0x55768c48fbb0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.978+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f53cc071030 con 0x55768c48d7c0 2024-05-09T09:48:01.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.978+0000 7f53dc19f980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:48:01.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.978+0000 7f53dc19f980 20 searching for the correct realm 2024-05-09T09:48:01.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.978+0000 7f53dc19f980 1 --2- 172.21.15.157:0/2293181117 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55768c492110 0x55768c494520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.978+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55768c494bf0 con 0x55768c492110 2024-05-09T09:48:01.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.978+0000 7f53d94b9640 1 --2- 172.21.15.157:0/2293181117 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55768c492110 0x55768c494520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.978+0000 7f53d94b9640 1 --2- 172.21.15.157:0/2293181117 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55768c492110 0x55768c494520 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.978+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c40d9070 con 0x55768c492110 2024-05-09T09:48:01.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.978+0000 7f53d94b9640 1 --2- 172.21.15.157:0/2293181117 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f53c40ce040 0x7f53c40db410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:01.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.978+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55768c494bf0 con 0x7f53c40ce040 2024-05-09T09:48:01.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.978+0000 7f53da4bb640 1 --2- 172.21.15.157:0/2293181117 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f53c40ce040 0x7f53c40db410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:01.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.978+0000 7f53da4bb640 1 --2- 172.21.15.157:0/2293181117 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f53c40ce040 0x7f53c40db410 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:01.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.978+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d40083f0 con 0x7f53c40ce040 2024-05-09T09:48:01.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.982+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55768c48ca60 con 0x55768c48d7c0 2024-05-09T09:48:01.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.982+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53cc071030 con 0x55768c48d7c0 2024-05-09T09:48:01.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.982+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55768c48ca60 con 0x55768c488dd0 2024-05-09T09:48:01.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.982+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d40083f0 con 0x55768c488dd0 2024-05-09T09:48:01.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.982+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55768c48ca60 con 0x55768c488dd0 2024-05-09T09:48:01.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.982+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d4026040 con 0x55768c488dd0 2024-05-09T09:48:01.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.982+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55768c48ca60 con 0x55768c48d7c0 2024-05-09T09:48:01.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.982+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53cc071030 con 0x55768c48d7c0 2024-05-09T09:48:01.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.982+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55768c48ca60 con 0x55768c48d7c0 2024-05-09T09:48:01.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.982+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53cc071030 con 0x55768c48d7c0 2024-05-09T09:48:01.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.982+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55768c48ca60 con 0x7f53c40ce040 2024-05-09T09:48:01.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.982+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d4026040 con 0x7f53c40ce040 2024-05-09T09:48:01.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.982+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55768c48ca60 con 0x55768c492110 2024-05-09T09:48:01.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.982+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c40d9070 con 0x55768c492110 2024-05-09T09:48:01.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.982+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55768c48ca60 con 0x55768c488dd0 2024-05-09T09:48:01.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.982+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d4026040 con 0x55768c488dd0 2024-05-09T09:48:01.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.982+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55768c48ca60 con 0x55768c48d7c0 2024-05-09T09:48:01.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.986+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53cc071030 con 0x55768c48d7c0 2024-05-09T09:48:01.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.986+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55768c48ca60 con 0x55768c488dd0 2024-05-09T09:48:01.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.986+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d4026040 con 0x55768c488dd0 2024-05-09T09:48:01.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.986+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55768c48ca60 con 0x7f53c40ce040 2024-05-09T09:48:01.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.986+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f53d4026040 con 0x7f53c40ce040 2024-05-09T09:48:01.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.986+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55768c48ca60 con 0x55768c492110 2024-05-09T09:48:01.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.986+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c40d9070 con 0x55768c492110 2024-05-09T09:48:01.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.986+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f53c40e8040 con 0x55768c492110 2024-05-09T09:48:01.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.986+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f53c40d9070 con 0x55768c492110 2024-05-09T09:48:01.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.986+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f53c40e8040 con 0x55768c48d7c0 2024-05-09T09:48:01.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.986+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53cc071030 con 0x55768c48d7c0 2024-05-09T09:48:01.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.986+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f53c40e8040 con 0x55768c492110 2024-05-09T09:48:01.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.986+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c40d9070 con 0x55768c492110 2024-05-09T09:48:01.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.986+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f53c40e8040 con 0x55768c492110 2024-05-09T09:48:01.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.986+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c40d9070 con 0x55768c492110 2024-05-09T09:48:01.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.986+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f53c40e8040 con 0x55768c488dd0 2024-05-09T09:48:01.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.986+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d4026040 con 0x55768c488dd0 2024-05-09T09:48:01.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.986+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f53c40e8040 con 0x55768c488dd0 2024-05-09T09:48:01.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.990+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f53d4026040 con 0x55768c488dd0 2024-05-09T09:48:01.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.990+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f53c40e8040 con 0x55768c48d7c0 2024-05-09T09:48:01.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.990+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53cc071030 con 0x55768c48d7c0 2024-05-09T09:48:01.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.990+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f53c40e8040 con 0x55768c492110 2024-05-09T09:48:01.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.990+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c40d9070 con 0x55768c492110 2024-05-09T09:48:01.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.990+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f53c40e8040 con 0x7f53c40ce040 2024-05-09T09:48:01.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.990+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d4026040 con 0x7f53c40ce040 2024-05-09T09:48:01.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.990+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f53c40e8040 con 0x55768c488dd0 2024-05-09T09:48:01.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.990+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d4026040 con 0x55768c488dd0 2024-05-09T09:48:01.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.990+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f53c40e8040 con 0x55768c48d7c0 2024-05-09T09:48:01.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.990+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f53cc071030 con 0x55768c48d7c0 2024-05-09T09:48:01.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.990+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f53c40e8040 con 0x55768c492110 2024-05-09T09:48:01.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.990+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c40d9070 con 0x55768c492110 2024-05-09T09:48:01.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.990+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f53c40e8040 con 0x55768c48d7c0 2024-05-09T09:48:01.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.990+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53cc071030 con 0x55768c48d7c0 2024-05-09T09:48:01.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.990+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f53c40e8040 con 0x7f53c40ce040 2024-05-09T09:48:01.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d4026040 con 0x7f53c40ce040 2024-05-09T09:48:01.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f53c40e8040 con 0x55768c492110 2024-05-09T09:48:01.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53c40d9070 con 0x55768c492110 2024-05-09T09:48:01.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f53c40e8040 con 0x55768c48d7c0 2024-05-09T09:48:01.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53cc071030 con 0x55768c48d7c0 2024-05-09T09:48:01.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f53c40e8040 con 0x55768c488dd0 2024-05-09T09:48:01.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f53d4026040 con 0x55768c488dd0 2024-05-09T09:48:01.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f53c40e8040 con 0x7f53c40ce040 2024-05-09T09:48:01.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53d4026040 con 0x7f53c40ce040 2024-05-09T09:48:01.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53dc19f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:48:01.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53dc19f980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:48:01.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53dc19f980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:48:01.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53dc19f980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:48:01.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53dc19f980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:48:01.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53dc19f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:48:01.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53dc19f980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55768c490a80 con 0x55768c488dd0 2024-05-09T09:48:01.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53d4026040 con 0x55768c488dd0 2024-05-09T09:48:01.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53dc19f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:01.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53dc19f980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55768c490a80 con 0x55768c488dd0 2024-05-09T09:48:01.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f53d4026040 con 0x55768c488dd0 2024-05-09T09:48:01.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53dc19f980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:01.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53dc19f980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55768c490a80 con 0x55768c492110 2024-05-09T09:48:01.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f53c40d9070 con 0x55768c492110 2024-05-09T09:48:01.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53dc19f980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:48:01.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53dc19f980 20 zone default found 2024-05-09T09:48:01.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53dc19f980 4 Realm: () 2024-05-09T09:48:01.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53dc19f980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:48:01.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53dc19f980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:48:01.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53dc19f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:48:01.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53dc19f980 20 zonegroup default 2024-05-09T09:48:01.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53dc19f980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55768c491440 con 0x55768c48d7c0 2024-05-09T09:48:01.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f53cc071030 con 0x55768c48d7c0 2024-05-09T09:48:01.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53dc19f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:01.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53dc19f980 20 rados->read ofs=0 len=0 2024-05-09T09:48:01.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55768c490fe0 con 0x55768c492110 2024-05-09T09:48:01.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f53c40d9070 con 0x55768c492110 2024-05-09T09:48:01.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53dc19f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:01.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.994+0000 7f53dc19f980 20 rados->read ofs=0 len=0 2024-05-09T09:48:02.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.998+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55768c496fa0 con 0x55768c492110 2024-05-09T09:48:02.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.998+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f53c40d9070 con 0x55768c492110 2024-05-09T09:48:02.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.998+0000 7f53dc19f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:02.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.998+0000 7f53dc19f980 20 started sync module instance, tier type = 2024-05-09T09:48:02.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.998+0000 7f53dc19f980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:48:02.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.998+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c496390 con 0x7f53c40ce040 2024-05-09T09:48:02.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.998+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53d4026040 con 0x7f53c40ce040 2024-05-09T09:48:02.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.998+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93967648123104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c496390 con 0x7f53c40ce040 2024-05-09T09:48:02.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.998+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c497a00 con 0x55768c488dd0 2024-05-09T09:48:02.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.998+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93967648123104] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53d4036040 con 0x7f53c40ce040 2024-05-09T09:48:02.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.998+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53d4036040 con 0x55768c488dd0 2024-05-09T09:48:02.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.998+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93967648126560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c496390 con 0x55768c488dd0 2024-05-09T09:48:02.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:01.998+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c498410 con 0x55768c492110 2024-05-09T09:48:02.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.002+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93967648126560] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53d4036040 con 0x55768c488dd0 2024-05-09T09:48:02.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.002+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c40d9070 con 0x55768c492110 2024-05-09T09:48:02.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.002+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93967648120544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c496300 con 0x55768c492110 2024-05-09T09:48:02.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.002+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c499130 con 0x7f53c40ce040 2024-05-09T09:48:02.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.002+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53d4036040 con 0x7f53c40ce040 2024-05-09T09:48:02.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.002+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93967648132192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c499130 con 0x7f53c40ce040 2024-05-09T09:48:02.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.002+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c499ff0 con 0x55768c488dd0 2024-05-09T09:48:02.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.006+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93967648120544] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c40d9070 con 0x55768c492110 2024-05-09T09:48:02.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.006+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93967648132192] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53d4036040 con 0x7f53c40ce040 2024-05-09T09:48:02.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.006+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53d4036040 con 0x55768c488dd0 2024-05-09T09:48:02.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.006+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93967648130992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c499b40 con 0x55768c488dd0 2024-05-09T09:48:02.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.006+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c49a890 con 0x55768c48d7c0 2024-05-09T09:48:02.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.006+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93967648130992] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53d4036040 con 0x55768c488dd0 2024-05-09T09:48:02.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.006+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc071030 con 0x55768c48d7c0 2024-05-09T09:48:02.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.006+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93967648133696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c499b40 con 0x55768c48d7c0 2024-05-09T09:48:02.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.006+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c49ad40 con 0x55768c48d7c0 2024-05-09T09:48:02.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.010+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc071030 con 0x55768c48d7c0 2024-05-09T09:48:02.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.010+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93967648139408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c49b160 con 0x55768c48d7c0 2024-05-09T09:48:02.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.010+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c49bc50 con 0x55768c48d7c0 2024-05-09T09:48:02.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.010+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93967648133696] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc071030 con 0x55768c48d7c0 2024-05-09T09:48:02.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.014+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93967648139408] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc071030 con 0x55768c48d7c0 2024-05-09T09:48:02.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.014+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc071030 con 0x55768c48d7c0 2024-05-09T09:48:02.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.014+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93967648143136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c49acf0 con 0x55768c48d7c0 2024-05-09T09:48:02.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.014+0000 7f53dc19f980 20 add_watcher() i=0 2024-05-09T09:48:02.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.014+0000 7f53dc19f980 20 add_watcher() i=1 2024-05-09T09:48:02.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.014+0000 7f53dc19f980 20 add_watcher() i=2 2024-05-09T09:48:02.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.014+0000 7f53dc19f980 20 add_watcher() i=3 2024-05-09T09:48:02.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.014+0000 7f53dc19f980 20 add_watcher() i=4 2024-05-09T09:48:02.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.014+0000 7f53dc19f980 20 add_watcher() i=5 2024-05-09T09:48:02.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.014+0000 7f53dc19f980 20 add_watcher() i=6 2024-05-09T09:48:02.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.014+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93967648143136] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc071030 con 0x55768c48d7c0 2024-05-09T09:48:02.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.014+0000 7f53dc19f980 20 add_watcher() i=7 2024-05-09T09:48:02.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.014+0000 7f53dc19f980 2 all 8 watchers are set, enabling cache 2024-05-09T09:48:02.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.014+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55768c49ed50 con 0x55768c488dd0 2024-05-09T09:48:02.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.014+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f53d4036040 con 0x55768c488dd0 2024-05-09T09:48:02.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.014+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93967648138128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c49c1d0 con 0x55768c488dd0 2024-05-09T09:48:02.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.014+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93967648138128] v32'325 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f53d4036040 con 0x55768c488dd0 2024-05-09T09:48:02.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.018+0000 7f528f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:02.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.018+0000 7f53dc19f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:48:02.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.018+0000 7f53dc19f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:48:02.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.018+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a74f0 con 0x55768c488dd0 2024-05-09T09:48:02.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.018+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'78 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f53d4036040 con 0x55768c488dd0 2024-05-09T09:48:02.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.018+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a7b40 con 0x55768c48d7c0 2024-05-09T09:48:02.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.022+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'72 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f53cc071030 con 0x55768c48d7c0 2024-05-09T09:48:02.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.022+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a7b40 con 0x55768c492110 2024-05-09T09:48:02.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.022+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'71 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f53c40d9070 con 0x55768c492110 2024-05-09T09:48:02.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.022+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a8170 con 0x55768c488dd0 2024-05-09T09:48:02.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.022+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'326 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f53d4036040 con 0x55768c488dd0 2024-05-09T09:48:02.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.022+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a8620 con 0x7f53c40ce040 2024-05-09T09:48:02.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.026+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'203 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f53d4036040 con 0x7f53c40ce040 2024-05-09T09:48:02.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.026+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a52e0 con 0x55768c492110 2024-05-09T09:48:02.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.026+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'136 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f53c40d9070 con 0x55768c492110 2024-05-09T09:48:02.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.026+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a52e0 con 0x55768c488dd0 2024-05-09T09:48:02.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.030+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'73 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f53d4036040 con 0x55768c488dd0 2024-05-09T09:48:02.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.030+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a52e0 con 0x55768c48d7c0 2024-05-09T09:48:02.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.030+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'135 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f53cc071030 con 0x55768c48d7c0 2024-05-09T09:48:02.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.030+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a9180 con 0x7f53c40ce040 2024-05-09T09:48:02.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.034+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'71 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f53d4036040 con 0x7f53c40ce040 2024-05-09T09:48:02.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.034+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a9180 con 0x55768c492110 2024-05-09T09:48:02.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.034+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'77 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f53c40d9070 con 0x55768c492110 2024-05-09T09:48:02.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.034+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a9210 con 0x7f53c40ce040 2024-05-09T09:48:02.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.038+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'204 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f53d4036040 con 0x7f53c40ce040 2024-05-09T09:48:02.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.038+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a92f0 con 0x55768c48d7c0 2024-05-09T09:48:02.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.038+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'74 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f53cc071030 con 0x55768c48d7c0 2024-05-09T09:48:02.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.038+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a92f0 con 0x7f53c40ce040 2024-05-09T09:48:02.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.042+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'71 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f53d4036040 con 0x7f53c40ce040 2024-05-09T09:48:02.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.042+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a92f0 con 0x55768c48d7c0 2024-05-09T09:48:02.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.042+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'141 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f53cc071030 con 0x55768c48d7c0 2024-05-09T09:48:02.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.042+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a92f0 con 0x55768c488dd0 2024-05-09T09:48:02.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.046+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'327 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f53d4036040 con 0x55768c488dd0 2024-05-09T09:48:02.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.046+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a92f0 con 0x55768c492110 2024-05-09T09:48:02.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.046+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'197 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f53c40d9070 con 0x55768c492110 2024-05-09T09:48:02.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.046+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a97e0 con 0x7f53c40ce040 2024-05-09T09:48:02.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.050+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'205 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f53d4036040 con 0x7f53c40ce040 2024-05-09T09:48:02.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.050+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a97e0 con 0x55768c492110 2024-05-09T09:48:02.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.050+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'71 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f53c40d9070 con 0x55768c492110 2024-05-09T09:48:02.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.050+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a97e0 con 0x55768c488dd0 2024-05-09T09:48:02.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.054+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'79 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f53d4036040 con 0x55768c488dd0 2024-05-09T09:48:02.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.054+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a97e0 con 0x55768c488dd0 2024-05-09T09:48:02.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.054+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'328 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f53d4036040 con 0x55768c488dd0 2024-05-09T09:48:02.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.054+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a97e0 con 0x55768c492110 2024-05-09T09:48:02.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.058+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'198 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f53c40d9070 con 0x55768c492110 2024-05-09T09:48:02.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.058+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a97e0 con 0x7f53c40ce040 2024-05-09T09:48:02.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.058+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'83 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f53d4036040 con 0x7f53c40ce040 2024-05-09T09:48:02.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.058+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a97e0 con 0x55768c492110 2024-05-09T09:48:02.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.062+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'73 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f53c40d9070 con 0x55768c492110 2024-05-09T09:48:02.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.062+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a97e0 con 0x55768c492110 2024-05-09T09:48:02.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.062+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'77 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f53c40d9070 con 0x55768c492110 2024-05-09T09:48:02.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.062+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a97e0 con 0x55768c492110 2024-05-09T09:48:02.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.062+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'68 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f53c40d9070 con 0x55768c492110 2024-05-09T09:48:02.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.062+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a97e0 con 0x55768c492110 2024-05-09T09:48:02.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.066+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'137 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f53c40d9070 con 0x55768c492110 2024-05-09T09:48:02.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.066+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a97e0 con 0x55768c48d7c0 2024-05-09T09:48:02.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.070+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'73 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f53cc071030 con 0x55768c48d7c0 2024-05-09T09:48:02.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.070+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a97e0 con 0x55768c492110 2024-05-09T09:48:02.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.070+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'71 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f53c40d9070 con 0x55768c492110 2024-05-09T09:48:02.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.070+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a97e0 con 0x55768c48d7c0 2024-05-09T09:48:02.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.074+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'136 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f53cc071030 con 0x55768c48d7c0 2024-05-09T09:48:02.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.074+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a97e0 con 0x55768c492110 2024-05-09T09:48:02.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.074+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'199 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f53c40d9070 con 0x55768c492110 2024-05-09T09:48:02.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.074+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a97e0 con 0x55768c48d7c0 2024-05-09T09:48:02.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.078+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'142 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f53cc071030 con 0x55768c48d7c0 2024-05-09T09:48:02.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.078+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4a97e0 con 0x7f53c40ce040 2024-05-09T09:48:02.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.078+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'77 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f53d4036040 con 0x7f53c40ce040 2024-05-09T09:48:02.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.082+0000 7f528e7e4640 20 reqs_thread_entry: start 2024-05-09T09:48:02.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.082+0000 7f53dc19f980 20 init_complete bucket index max shards: 11 2024-05-09T09:48:02.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.082+0000 7f53dc19f980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-09T09:48:02.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.082+0000 7f53dc19f980 20 rados->read ofs=0 len=0 2024-05-09T09:48:02.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.082+0000 7f52877fe640 20 reqs_thread_entry: start 2024-05-09T09:48:02.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.082+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55768c4c50c0 con 0x55768c488dd0 2024-05-09T09:48:02.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.082+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f53d4036040 con 0x55768c488dd0 2024-05-09T09:48:02.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.082+0000 7f53dc19f980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:48:02.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.082+0000 7f53dc19f980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-09T09:48:02.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.082+0000 7f53dc19f980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:48:02.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.082+0000 7f53dc19f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:48:02.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.082+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c4caf60 con 0x55768c488dd0 2024-05-09T09:48:02.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.086+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(95 foo [delete,create,call,call,writefull 0~403] v32'16 uv16 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f53d4036040 con 0x55768c488dd0 2024-05-09T09:48:02.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.086+0000 7f53dc19f980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:48:02.085 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.086+0000 7f53dc19f980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:48:02.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.086+0000 7f53dc19f980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-09T09:48:02.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.086+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 7.d 7:b4812045:::notify.4:head [notify cookie 93967648336336 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55768c4c7a90 con 0x55768c488dd0 2024-05-09T09:48:02.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.086+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== watch-notify(notify (1) cookie 93967648130992 notify 137438953494 ret 0) ==== 621+0+0 (crc 0 0 0) 0x55768c4a7020 con 0x55768c488dd0 2024-05-09T09:48:02.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.086+0000 7f52abfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953494 cookie 93967648130992 notifier 4663 bl.length()=579 2024-05-09T09:48:02.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.086+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(96 notify.4 [notify cookie 93967648336336 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f53d4036040 con 0x55768c488dd0 2024-05-09T09:48:02.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.086+0000 7f52abfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:48:02.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.086+0000 7f52abfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:48:02.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.086+0000 7f52abfff640 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f529c0056c0 con 0x55768c488dd0 2024-05-09T09:48:02.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.086+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(97 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53d4036040 con 0x55768c488dd0 2024-05-09T09:48:02.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.086+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== watch-notify(notify_complete (2) cookie 93967648336336 notify 137438953494 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55768c4a6e50 con 0x55768c488dd0 2024-05-09T09:48:02.087 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-09T09:47:32.044078Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:47:32.044055Z","tags":[],"group_ids":[]} 2024-05-09T09:48:02.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.086+0000 7f528f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:02.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.086+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93967648138128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c480720 con 0x55768c488dd0 2024-05-09T09:48:02.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.090+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(98 data_loggenerations_metadata [watch unwatch cookie 93967648138128] v32'329 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f53d4036040 con 0x55768c488dd0 2024-05-09T09:48:02.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.090+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93967648123104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c480720 con 0x7f53c40ce040 2024-05-09T09:48:02.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.090+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(99 notify.0 [watch unwatch cookie 93967648123104] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53d4036040 con 0x7f53c40ce040 2024-05-09T09:48:02.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.090+0000 7f53dc19f980 20 remove_watcher() i=0 2024-05-09T09:48:02.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.090+0000 7f53dc19f980 2 removed watcher, disabling cache 2024-05-09T09:48:02.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.090+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93967648126560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c480720 con 0x55768c488dd0 2024-05-09T09:48:02.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.094+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(100 notify.1 [watch unwatch cookie 93967648126560] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53d4036040 con 0x55768c488dd0 2024-05-09T09:48:02.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.094+0000 7f53dc19f980 20 remove_watcher() i=1 2024-05-09T09:48:02.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.094+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93967648120544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c480720 con 0x55768c492110 2024-05-09T09:48:02.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.094+0000 7f53d94b9640 1 -- 172.21.15.157:0/2293181117 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(101 notify.2 [watch unwatch cookie 93967648120544] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53c40d9070 con 0x55768c492110 2024-05-09T09:48:02.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.094+0000 7f53dc19f980 20 remove_watcher() i=2 2024-05-09T09:48:02.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.094+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:102 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93967648132192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c480720 con 0x7f53c40ce040 2024-05-09T09:48:02.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.098+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(102 notify.3 [watch unwatch cookie 93967648132192] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53d4036040 con 0x7f53c40ce040 2024-05-09T09:48:02.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.098+0000 7f53dc19f980 20 remove_watcher() i=3 2024-05-09T09:48:02.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.098+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93967648130992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c480720 con 0x55768c488dd0 2024-05-09T09:48:02.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.098+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(103 notify.4 [watch unwatch cookie 93967648130992] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53d4036040 con 0x55768c488dd0 2024-05-09T09:48:02.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.098+0000 7f53dc19f980 20 remove_watcher() i=4 2024-05-09T09:48:02.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.098+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93967648133696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c480720 con 0x55768c48d7c0 2024-05-09T09:48:02.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.102+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(104 notify.5 [watch unwatch cookie 93967648133696] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc071030 con 0x55768c48d7c0 2024-05-09T09:48:02.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.102+0000 7f53dc19f980 20 remove_watcher() i=5 2024-05-09T09:48:02.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.102+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:105 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93967648139408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c480720 con 0x55768c48d7c0 2024-05-09T09:48:02.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.102+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(105 notify.6 [watch unwatch cookie 93967648139408] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc071030 con 0x55768c48d7c0 2024-05-09T09:48:02.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.102+0000 7f53dc19f980 20 remove_watcher() i=6 2024-05-09T09:48:02.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.102+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:106 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93967648143136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55768c480720 con 0x55768c48d7c0 2024-05-09T09:48:02.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53d9cba640 1 -- 172.21.15.157:0/2293181117 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(106 notify.7 [watch unwatch cookie 93967648143136] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53cc071030 con 0x55768c48d7c0 2024-05-09T09:48:02.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 20 remove_watcher() i=7 2024-05-09T09:48:02.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55768c48d7c0 msgr2=0x55768c48fbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 --2- 172.21.15.157:0/2293181117 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55768c48d7c0 0x55768c48fbb0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55768c488dd0 msgr2=0x55768c48b290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 --2- 172.21.15.157:0/2293181117 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55768c488dd0 0x55768c48b290 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f53c40ce040 msgr2=0x7f53c40db410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 --2- 172.21.15.157:0/2293181117 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f53c40ce040 0x7f53c40db410 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55768c492110 msgr2=0x55768c494520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 --2- 172.21.15.157:0/2293181117 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55768c492110 0x55768c494520 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f52a4034c00 msgr2=0x7f52a40370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 --2- 172.21.15.157:0/2293181117 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f52a4034c00 0x7f52a40370c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f53c40abfd0 tx=0x7f53c40a6000 comp rx=0 tx=0).stop 2024-05-09T09:48:02.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c474f90 msgr2=0x55768c47c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 --2- 172.21.15.157:0/2293181117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c474f90 0x55768c47c2f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f53cc047820 tx=0x7f53cc02a240 comp rx=0 tx=0).stop 2024-05-09T09:48:02.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53da4bb640 1 -- 172.21.15.157:0/2293181117 reap_dead start 2024-05-09T09:48:02.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 shutdown_connections 2024-05-09T09:48:02.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 --2- 172.21.15.157:0/2293181117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c474f90 0x55768c47c2f0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 >> 172.21.15.157:0/2293181117 conn(0x55768c471310 msgr2=0x55768c46f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:02.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 shutdown_connections 2024-05-09T09:48:02.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 -- 172.21.15.157:0/2293181117 wait complete. 2024-05-09T09:48:02.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 -- 172.21.15.157:0/3237838313 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f52b4034bb0 msgr2=0x7f52b4037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 --2- 172.21.15.157:0/3237838313 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f52b4034bb0 0x7f52b4037070 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f53c401b2c0 tx=0x7f53c4005a10 comp rx=0 tx=0).stop 2024-05-09T09:48:02.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 -- 172.21.15.157:0/3237838313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c467f90 msgr2=0x55768c4683b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 --2- 172.21.15.157:0/3237838313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c467f90 0x55768c4683b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f53cc048a20 tx=0x7f53cc029840 comp rx=0 tx=0).stop 2024-05-09T09:48:02.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 -- 172.21.15.157:0/3237838313 shutdown_connections 2024-05-09T09:48:02.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 --2- 172.21.15.157:0/3237838313 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f52b4034bb0 0x7f52b4037070 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 --2- 172.21.15.157:0/3237838313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c467f90 0x55768c4683b0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 -- 172.21.15.157:0/3237838313 >> 172.21.15.157:0/3237838313 conn(0x55768c45cd60 msgr2=0x55768c45d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:02.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 -- 172.21.15.157:0/3237838313 shutdown_connections 2024-05-09T09:48:02.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 -- 172.21.15.157:0/3237838313 wait complete. 2024-05-09T09:48:02.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 -- 172.21.15.157:0/1826490331 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55768c43b6d0 msgr2=0x55768c43dac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 --2- 172.21.15.157:0/1826490331 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55768c43b6d0 0x55768c43dac0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 -- 172.21.15.157:0/1826490331 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55768c343ce0 msgr2=0x55768c438d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 --2- 172.21.15.157:0/1826490331 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55768c343ce0 0x55768c438d30 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 -- 172.21.15.157:0/1826490331 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55768c43f5d0 msgr2=0x55768c4419c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 --2- 172.21.15.157:0/1826490331 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55768c43f5d0 0x55768c4419c0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 -- 172.21.15.157:0/1826490331 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f52c0034bb0 msgr2=0x7f52c0037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 --2- 172.21.15.157:0/1826490331 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f52c0034bb0 0x7f52c0037070 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f53c40ad000 tx=0x7f53c40a5040 comp rx=0 tx=0).stop 2024-05-09T09:48:02.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 -- 172.21.15.157:0/1826490331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c2b3ac0 msgr2=0x55768c431d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 --2- 172.21.15.157:0/1826490331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55768c2b3ac0 0x55768c431d40 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x55768c42ba20 tx=0x7f53cc000f50 comp rx=0 tx=0).stop 2024-05-09T09:48:02.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53da4bb640 1 -- 172.21.15.157:0/1826490331 reap_dead start 2024-05-09T09:48:02.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 -- 172.21.15.157:0/1826490331 shutdown_connections 2024-05-09T09:48:02.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 -- 172.21.15.157:0/1826490331 >> 172.21.15.157:0/1826490331 conn(0x55768c33a0e0 msgr2=0x55768c425230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:02.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 -- 172.21.15.157:0/1826490331 shutdown_connections 2024-05-09T09:48:02.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.106+0000 7f53dc19f980 1 -- 172.21.15.157:0/1826490331 wait complete. 2024-05-09T09:48:02.124 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-09T09:47:32.044078Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:47:32.044055Z', 'tags': [], 'group_ids': []} 2024-05-09T09:48:02.124 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-05-09T09:48:02.124 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-05-09T09:48:02.124 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-05-09T09:48:02.202 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:48:02.203 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:48:02.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.202+0000 7f5582d9e980 1 Processor -- start 2024-05-09T09:48:02.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.202+0000 7f5582d9e980 1 -- start start 2024-05-09T09:48:02.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.202+0000 7f5582d9e980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55dd12d2ed70 0x55dd12d31160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.202+0000 7f5582d9e980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dd12be1440 con 0x55dd12d2a810 2024-05-09T09:48:02.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.202+0000 7f5582d9e980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55dd12bcc5f0 con 0x55dd12d2ed70 2024-05-09T09:48:02.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.206+0000 7f55800b8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55dd12d2ed70 0x55dd12d31160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.206+0000 7f55800b8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55dd12d2ed70 0x55dd12d31160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35214/0 (socket says 172.21.15.157:35214) 2024-05-09T09:48:02.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.206+0000 7f55800b8640 1 -- 172.21.15.157:0/2439414656 learned_addr learned my addr 172.21.15.157:0/2439414656 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:02.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.206+0000 7f55800b8640 1 -- 172.21.15.157:0/2439414656 >> v1:172.21.15.110:6789/0 conn(0x55dd12d2a810 legacy=0x55dd12d2abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.206+0000 7f55800b8640 1 -- 172.21.15.157:0/2439414656 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd12bd7990 con 0x55dd12d2ed70 2024-05-09T09:48:02.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.210+0000 7f55800b8640 1 --2- 172.21.15.157:0/2439414656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12d2ed70 0x55dd12d31160 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f557000a5c0 tx=0x7f557001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80114054d8ea24d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.210+0000 7f557f8b7640 1 -- 172.21.15.157:0/2439414656 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55700a6070 con 0x55dd12d2ed70 2024-05-09T09:48:02.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.210+0000 7f557f8b7640 1 -- 172.21.15.157:0/2439414656 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55700af070 con 0x55dd12d2ed70 2024-05-09T09:48:02.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.210+0000 7f557f8b7640 1 -- 172.21.15.157:0/2439414656 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55700aa5c0 con 0x55dd12d2ed70 2024-05-09T09:48:02.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.210+0000 7f5582d9e980 1 -- 172.21.15.157:0/2439414656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12d2ed70 msgr2=0x55dd12d31160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.210+0000 7f5582d9e980 1 --2- 172.21.15.157:0/2439414656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12d2ed70 0x55dd12d31160 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f557000a5c0 tx=0x7f557001b340 comp rx=0 tx=0).stop 2024-05-09T09:48:02.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.210+0000 7f5582d9e980 1 -- 172.21.15.157:0/2439414656 shutdown_connections 2024-05-09T09:48:02.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.210+0000 7f5582d9e980 1 --2- 172.21.15.157:0/2439414656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12d2ed70 0x55dd12d31160 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.210+0000 7f5582d9e980 1 -- 172.21.15.157:0/2439414656 >> 172.21.15.157:0/2439414656 conn(0x55dd12d260e0 msgr2=0x55dd12d28500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:02.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.210+0000 7f5582d9e980 1 -- 172.21.15.157:0/2439414656 shutdown_connections 2024-05-09T09:48:02.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.210+0000 7f5582d9e980 1 -- 172.21.15.157:0/2439414656 wait complete. 2024-05-09T09:48:02.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.226+0000 7f5582d9e980 1 Processor -- start 2024-05-09T09:48:02.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.226+0000 7f5582d9e980 1 -- start start 2024-05-09T09:48:02.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.226+0000 7f5582d9e980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12d2a810 0x55dd12c9f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.226+0000 7f5582d9e980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55dd12c2efe0 con 0x55dd12d2a810 2024-05-09T09:48:02.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.226+0000 7f55808b9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12d2a810 0x55dd12c9f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.226+0000 7f55808b9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12d2a810 0x55dd12c9f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35226/0 (socket says 172.21.15.157:35226) 2024-05-09T09:48:02.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.226+0000 7f55808b9640 1 -- 172.21.15.157:0/3822706248 learned_addr learned my addr 172.21.15.157:0/3822706248 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:02.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.226+0000 7f55808b9640 1 -- 172.21.15.157:0/3822706248 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd12bb3ae0 con 0x55dd12d2a810 2024-05-09T09:48:02.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.226+0000 7f55808b9640 1 --2- 172.21.15.157:0/3822706248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12d2a810 0x55dd12c9f190 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f557400b1f0 tx=0x7f557400b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d52253f42cf050e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.230+0000 7f546ee0d640 1 -- 172.21.15.157:0/3822706248 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f557400a040 con 0x55dd12d2a810 2024-05-09T09:48:02.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.230+0000 7f546ee0d640 1 -- 172.21.15.157:0/3822706248 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f557400f750 con 0x55dd12d2a810 2024-05-09T09:48:02.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.230+0000 7f546ee0d640 1 -- 172.21.15.157:0/3822706248 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f557400fa70 con 0x55dd12d2a810 2024-05-09T09:48:02.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.230+0000 7f5582d9e980 1 -- 172.21.15.157:0/3822706248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12d2a810 msgr2=0x55dd12c9f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.230+0000 7f5582d9e980 1 --2- 172.21.15.157:0/3822706248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12d2a810 0x55dd12c9f190 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f557400b1f0 tx=0x7f557400b6b0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.230+0000 7f5582d9e980 1 -- 172.21.15.157:0/3822706248 shutdown_connections 2024-05-09T09:48:02.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.230+0000 7f5582d9e980 1 --2- 172.21.15.157:0/3822706248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12d2a810 0x55dd12c9f190 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.230+0000 7f5582d9e980 1 -- 172.21.15.157:0/3822706248 >> 172.21.15.157:0/3822706248 conn(0x55dd12d260e0 msgr2=0x55dd12e11560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:02.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.230+0000 7f5582d9e980 1 -- 172.21.15.157:0/3822706248 shutdown_connections 2024-05-09T09:48:02.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.230+0000 7f5582d9e980 1 -- 172.21.15.157:0/3822706248 wait complete. 2024-05-09T09:48:02.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.230+0000 7f5582d9e980 1 Processor -- start 2024-05-09T09:48:02.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.230+0000 7f5582d9e980 1 -- start start 2024-05-09T09:48:02.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.230+0000 7f5582d9e980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12d2a810 0x55dd12e1dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.230+0000 7f5582d9e980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55dd12d34190 con 0x55dd12d2a810 2024-05-09T09:48:02.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.230+0000 7f55808b9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12d2a810 0x55dd12e1dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.230+0000 7f55808b9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12d2a810 0x55dd12e1dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35230/0 (socket says 172.21.15.157:35230) 2024-05-09T09:48:02.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.230+0000 7f55808b9640 1 -- 172.21.15.157:0/1954619491 learned_addr learned my addr 172.21.15.157:0/1954619491 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:02.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.230+0000 7f55808b9640 1 -- 172.21.15.157:0/1954619491 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd12e1e200 con 0x55dd12d2a810 2024-05-09T09:48:02.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.230+0000 7f55808b9640 1 --2- 172.21.15.157:0/1954619491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12d2a810 0x55dd12e1dcc0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f557400b6f0 tx=0x7f5574000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.230+0000 7f546d60a640 1 -- 172.21.15.157:0/1954619491 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f557401c970 con 0x55dd12d2a810 2024-05-09T09:48:02.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.230+0000 7f5582d9e980 1 -- 172.21.15.157:0/1954619491 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dd12e1e490 con 0x55dd12d2a810 2024-05-09T09:48:02.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.230+0000 7f546d60a640 1 -- 172.21.15.157:0/1954619491 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f557401cb10 con 0x55dd12d2a810 2024-05-09T09:48:02.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.230+0000 7f5582d9e980 1 -- 172.21.15.157:0/1954619491 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd12e21170 con 0x55dd12d2a810 2024-05-09T09:48:02.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.230+0000 7f546d60a640 1 -- 172.21.15.157:0/1954619491 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f557402c060 con 0x55dd12d2a810 2024-05-09T09:48:02.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.234+0000 7f546d60a640 1 -- 172.21.15.157:0/1954619491 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f5574017050 con 0x55dd12d2a810 2024-05-09T09:48:02.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.234+0000 7f546d60a640 1 --2- 172.21.15.157:0/1954619491 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5468034c00 0x7f54680370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.234+0000 7f546d60a640 1 -- 172.21.15.157:0/1954619491 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f5574015020 con 0x55dd12d2a810 2024-05-09T09:48:02.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.234+0000 7f55800b8640 1 --2- 172.21.15.157:0/1954619491 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5468034c00 0x7f54680370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.234+0000 7f5582d9e980 1 --2- 172.21.15.157:0/1954619491 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55dd12d2ed70 0x55dd12e24dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.234+0000 7f5582d9e980 1 -- 172.21.15.157:0/1954619491 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e25300 con 0x55dd12d2ed70 2024-05-09T09:48:02.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.234+0000 7f55810ba640 1 --2- 172.21.15.157:0/1954619491 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55dd12d2ed70 0x55dd12e24dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.234+0000 7f55800b8640 1 --2- 172.21.15.157:0/1954619491 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5468034c00 0x7f54680370c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f55700ae000 tx=0x7f55700a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.234+0000 7f55810ba640 1 --2- 172.21.15.157:0/1954619491 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55dd12d2ed70 0x55dd12e24dc0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.234+0000 7f55810ba640 1 -- 172.21.15.157:0/1954619491 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12d2ed70 2024-05-09T09:48:02.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.234+0000 7f5582d9e980 1 -- 172.21.15.157:0/1954619491 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e22390 con 0x55dd12d2ed70 2024-05-09T09:48:02.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.234+0000 7f55810ba640 1 -- 172.21.15.157:0/1954619491 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12d2ed70 2024-05-09T09:48:02.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.234+0000 7f5582d9e980 1 --2- 172.21.15.157:0/1954619491 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55dd12e27680 0x55dd12e29a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.234+0000 7f5582d9e980 1 -- 172.21.15.157:0/1954619491 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e2a160 con 0x55dd12e27680 2024-05-09T09:48:02.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.234+0000 7f55808b9640 1 --2- 172.21.15.157:0/1954619491 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55dd12e27680 0x55dd12e29a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.234+0000 7f55808b9640 1 --2- 172.21.15.157:0/1954619491 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55dd12e27680 0x55dd12e29a70 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.238+0000 7f55808b9640 1 -- 172.21.15.157:0/1954619491 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f557402e070 con 0x55dd12e27680 2024-05-09T09:48:02.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.238+0000 7f5582d9e980 1 -- 172.21.15.157:0/1954619491 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e26520 con 0x55dd12d2ed70 2024-05-09T09:48:02.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.238+0000 7f55810ba640 1 -- 172.21.15.157:0/1954619491 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12d2ed70 2024-05-09T09:48:02.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.238+0000 7f5582d9e980 1 --2- 172.21.15.157:0/1954619491 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55dd12e2b5c0 0x55dd12e2d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.238+0000 7f5582d9e980 1 -- 172.21.15.157:0/1954619491 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e2e0f0 con 0x55dd12e2b5c0 2024-05-09T09:48:02.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.238+0000 7f55800b8640 1 --2- 172.21.15.157:0/1954619491 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55dd12e2b5c0 0x55dd12e2d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.238+0000 7f55800b8640 1 --2- 172.21.15.157:0/1954619491 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55dd12e2b5c0 0x55dd12e2d9b0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.238+0000 7f55800b8640 1 -- 172.21.15.157:0/1954619491 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f55700aaa60 con 0x55dd12e2b5c0 2024-05-09T09:48:02.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.242+0000 7f5582d9e980 1 Processor -- start 2024-05-09T09:48:02.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.242+0000 7f5582d9e980 1 -- start start 2024-05-09T09:48:02.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.242+0000 7f5582d9e980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12e53f80 0x55dd12e543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.242+0000 7f5582d9e980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55dd12c33020 con 0x55dd12e53f80 2024-05-09T09:48:02.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.242+0000 7f55808b9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12e53f80 0x55dd12e543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.242+0000 7f55808b9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12e53f80 0x55dd12e543a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35236/0 (socket says 172.21.15.157:35236) 2024-05-09T09:48:02.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.242+0000 7f55808b9640 1 -- 172.21.15.157:0/1466043488 learned_addr learned my addr 172.21.15.157:0/1466043488 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:02.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.242+0000 7f55808b9640 1 -- 172.21.15.157:0/1466043488 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd12e548e0 con 0x55dd12e53f80 2024-05-09T09:48:02.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.242+0000 7f55808b9640 1 --2- 172.21.15.157:0/1466043488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12e53f80 0x55dd12e543a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f557401cee0 tx=0x7f5574042f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.242+0000 7f546539f640 1 -- 172.21.15.157:0/1466043488 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5574042250 con 0x55dd12e53f80 2024-05-09T09:48:02.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.242+0000 7f546539f640 1 -- 172.21.15.157:0/1466043488 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5574019cb0 con 0x55dd12e53f80 2024-05-09T09:48:02.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.242+0000 7f5582d9e980 1 -- 172.21.15.157:0/1466043488 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dd12e55370 con 0x55dd12e53f80 2024-05-09T09:48:02.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.242+0000 7f546539f640 1 -- 172.21.15.157:0/1466043488 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f557404abd0 con 0x55dd12e53f80 2024-05-09T09:48:02.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.242+0000 7f5582d9e980 1 -- 172.21.15.157:0/1466043488 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd12e55850 con 0x55dd12e53f80 2024-05-09T09:48:02.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.246+0000 7f546539f640 1 -- 172.21.15.157:0/1466043488 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f5574042450 con 0x55dd12e53f80 2024-05-09T09:48:02.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.246+0000 7f546539f640 1 --2- 172.21.15.157:0/1466043488 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5458034bb0 0x7f5458037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.246+0000 7f546539f640 1 -- 172.21.15.157:0/1466043488 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f557404a040 con 0x55dd12e53f80 2024-05-09T09:48:02.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.246+0000 7f55800b8640 1 --2- 172.21.15.157:0/1466043488 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5458034bb0 0x7f5458037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.246+0000 7f5582d9e980 1 Processor -- start 2024-05-09T09:48:02.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.246+0000 7f5582d9e980 1 -- start start 2024-05-09T09:48:02.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.246+0000 7f5582d9e980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12e60f50 0x55dd12e61330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.246+0000 7f55800b8640 1 --2- 172.21.15.157:0/1466043488 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5458034bb0 0x7f5458037070 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55dd12e25800 tx=0x7f5570005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.246+0000 7f5582d9e980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55dd12c9f8e0 con 0x55dd12e60f50 2024-05-09T09:48:02.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.246+0000 7f55808b9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12e60f50 0x55dd12e61330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.246+0000 7f55808b9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12e60f50 0x55dd12e61330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35248/0 (socket says 172.21.15.157:35248) 2024-05-09T09:48:02.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.246+0000 7f55808b9640 1 -- 172.21.15.157:0/1269076268 learned_addr learned my addr 172.21.15.157:0/1269076268 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:02.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.246+0000 7f55808b9640 1 -- 172.21.15.157:0/1269076268 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd12e61900 con 0x55dd12e60f50 2024-05-09T09:48:02.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.246+0000 7f55808b9640 1 --2- 172.21.15.157:0/1269076268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12e60f50 0x55dd12e61330 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f557401c630 tx=0x7f55740266c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69195c185b769afc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.246+0000 7f545effd640 1 -- 172.21.15.157:0/1269076268 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f557401a9a0 con 0x55dd12e60f50 2024-05-09T09:48:02.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.246+0000 7f545effd640 1 -- 172.21.15.157:0/1269076268 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f557401a480 con 0x55dd12e60f50 2024-05-09T09:48:02.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.246+0000 7f545effd640 1 -- 172.21.15.157:0/1269076268 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f557401ab40 con 0x55dd12e60f50 2024-05-09T09:48:02.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.246+0000 7f5582d9e980 1 -- 172.21.15.157:0/1269076268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12e60f50 msgr2=0x55dd12e61330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.246+0000 7f5582d9e980 1 --2- 172.21.15.157:0/1269076268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12e60f50 0x55dd12e61330 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f557401c630 tx=0x7f55740266c0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.246+0000 7f5582d9e980 1 -- 172.21.15.157:0/1269076268 shutdown_connections 2024-05-09T09:48:02.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.246+0000 7f5582d9e980 1 --2- 172.21.15.157:0/1269076268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12e60f50 0x55dd12e61330 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.246+0000 7f5582d9e980 1 -- 172.21.15.157:0/1269076268 >> 172.21.15.157:0/1269076268 conn(0x55dd12e5d2d0 msgr2=0x55dd12e5b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:02.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.246+0000 7f5582d9e980 1 -- 172.21.15.157:0/1269076268 shutdown_connections 2024-05-09T09:48:02.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.246+0000 7f5582d9e980 1 -- 172.21.15.157:0/1269076268 wait complete. 2024-05-09T09:48:02.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.246+0000 7f5582d9e980 1 Processor -- start 2024-05-09T09:48:02.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.246+0000 7f5582d9e980 1 -- start start 2024-05-09T09:48:02.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.246+0000 7f5582d9e980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12e60f50 0x55dd12e68300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.246+0000 7f5582d9e980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55dd12e62010 con 0x55dd12e60f50 2024-05-09T09:48:02.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.250+0000 7f55808b9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12e60f50 0x55dd12e68300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.250+0000 7f55808b9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12e60f50 0x55dd12e68300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35250/0 (socket says 172.21.15.157:35250) 2024-05-09T09:48:02.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.250+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 learned_addr learned my addr 172.21.15.157:0/3900167711 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:02.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.250+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd12e68840 con 0x55dd12e60f50 2024-05-09T09:48:02.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.250+0000 7f55808b9640 1 --2- 172.21.15.157:0/3900167711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12e60f50 0x55dd12e68300 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5574007fd0 tx=0x7f55740334d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.250+0000 7f545d7fa640 1 -- 172.21.15.157:0/3900167711 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f557406e020 con 0x55dd12e60f50 2024-05-09T09:48:02.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.250+0000 7f545d7fa640 1 -- 172.21.15.157:0/3900167711 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f557404dad0 con 0x55dd12e60f50 2024-05-09T09:48:02.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.250+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dd12e68840 con 0x55dd12e60f50 2024-05-09T09:48:02.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.250+0000 7f545d7fa640 1 -- 172.21.15.157:0/3900167711 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55740327e0 con 0x55dd12e60f50 2024-05-09T09:48:02.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.250+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd12e68840 con 0x55dd12e60f50 2024-05-09T09:48:02.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.250+0000 7f545d7fa640 1 -- 172.21.15.157:0/3900167711 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f5574071020 con 0x55dd12e60f50 2024-05-09T09:48:02.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.250+0000 7f545d7fa640 1 --2- 172.21.15.157:0/3900167711 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5448034bb0 0x7f5448037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.250+0000 7f545d7fa640 1 -- 172.21.15.157:0/3900167711 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f5574064030 con 0x55dd12e60f50 2024-05-09T09:48:02.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.250+0000 7f55800b8640 1 --2- 172.21.15.157:0/3900167711 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5448034bb0 0x7f5448037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.250+0000 7f5582d9e980 20 rados->read ofs=0 len=0 2024-05-09T09:48:02.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.250+0000 7f5582d9e980 1 --2- 172.21.15.157:0/3900167711 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55dd12e74e20 0x55dd12e772e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.250+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e77a30 con 0x55dd12e74e20 2024-05-09T09:48:02.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.250+0000 7f55810ba640 1 --2- 172.21.15.157:0/3900167711 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55dd12e74e20 0x55dd12e772e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.250+0000 7f55800b8640 1 --2- 172.21.15.157:0/3900167711 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5448034bb0 0x7f5448037070 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55dd12e2e4f0 tx=0x7f55700c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.254+0000 7f55810ba640 1 --2- 172.21.15.157:0/3900167711 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55dd12e74e20 0x55dd12e772e0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.254+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.254+0000 7f5582d9e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:02.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.254+0000 7f5582d9e980 20 realm 2024-05-09T09:48:02.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.254+0000 7f5582d9e980 20 rados->read ofs=0 len=0 2024-05-09T09:48:02.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.254+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e77e40 con 0x55dd12e74e20 2024-05-09T09:48:02.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.254+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.254+0000 7f5582d9e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:02.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.254+0000 7f5582d9e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:48:02.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.254+0000 7f5582d9e980 20 rados->read ofs=0 len=0 2024-05-09T09:48:02.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.254+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78710 con 0x55dd12e74e20 2024-05-09T09:48:02.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.254+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.254+0000 7f5582d9e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:02.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.254+0000 7f5582d9e980 20 rados->read ofs=0 len=0 2024-05-09T09:48:02.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.254+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x55dd12e74e20 2024-05-09T09:48:02.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.254+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.254+0000 7f5582d9e980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:02.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.254+0000 7f5582d9e980 20 rados->read ofs=0 len=0 2024-05-09T09:48:02.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.254+0000 7f5582d9e980 1 --2- 172.21.15.157:0/3900167711 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55dd12e79810 0x55dd12e7bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.254+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e7c210 con 0x55dd12e79810 2024-05-09T09:48:02.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.254+0000 7f55808b9640 1 --2- 172.21.15.157:0/3900167711 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55dd12e79810 0x55dd12e7bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.254+0000 7f55808b9640 1 --2- 172.21.15.157:0/3900167711 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55dd12e79810 0x55dd12e7bc00 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.254+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5574067070 con 0x55dd12e79810 2024-05-09T09:48:02.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.254+0000 7f5582d9e980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:48:02.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.254+0000 7f5582d9e980 20 searching for the correct realm 2024-05-09T09:48:02.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.254+0000 7f5582d9e980 1 --2- 172.21.15.157:0/3900167711 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55dd12e7e160 0x55dd12e80570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.254+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e80c40 con 0x55dd12e7e160 2024-05-09T09:48:02.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.254+0000 7f55800b8640 1 --2- 172.21.15.157:0/3900167711 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55dd12e7e160 0x55dd12e80570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.254+0000 7f55800b8640 1 --2- 172.21.15.157:0/3900167711 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55dd12e7e160 0x55dd12e80570 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.258+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55700aaa60 con 0x55dd12e7e160 2024-05-09T09:48:02.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.258+0000 7f55800b8640 1 --2- 172.21.15.157:0/3900167711 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f55700e0040 0x7f55700e0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.258+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e80c40 con 0x7f55700e0040 2024-05-09T09:48:02.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.258+0000 7f55810ba640 1 --2- 172.21.15.157:0/3900167711 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f55700e0040 0x7f55700e0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.258+0000 7f55810ba640 1 --2- 172.21.15.157:0/3900167711 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f55700e0040 0x7f55700e0930 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.258+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557800a4d0 con 0x7f55700e0040 2024-05-09T09:48:02.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.258+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x55dd12e79810 2024-05-09T09:48:02.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.258+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5574067070 con 0x55dd12e79810 2024-05-09T09:48:02.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.258+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x55dd12e74e20 2024-05-09T09:48:02.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.258+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.258+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x55dd12e74e20 2024-05-09T09:48:02.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.258+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.258+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x55dd12e79810 2024-05-09T09:48:02.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.258+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5574067070 con 0x55dd12e79810 2024-05-09T09:48:02.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.258+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x55dd12e79810 2024-05-09T09:48:02.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.258+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5574067070 con 0x55dd12e79810 2024-05-09T09:48:02.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.258+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x7f55700e0040 2024-05-09T09:48:02.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.258+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557800a4d0 con 0x7f55700e0040 2024-05-09T09:48:02.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.262+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x55dd12e7e160 2024-05-09T09:48:02.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.262+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55700aaa60 con 0x55dd12e7e160 2024-05-09T09:48:02.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.262+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x55dd12e74e20 2024-05-09T09:48:02.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.262+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.262+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x55dd12e79810 2024-05-09T09:48:02.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.262+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5574067070 con 0x55dd12e79810 2024-05-09T09:48:02.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.262+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x55dd12e74e20 2024-05-09T09:48:02.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.262+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.262+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x7f55700e0040 2024-05-09T09:48:02.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.262+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f557800a4d0 con 0x7f55700e0040 2024-05-09T09:48:02.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.262+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x55dd12e7e160 2024-05-09T09:48:02.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.262+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55700aaa60 con 0x55dd12e7e160 2024-05-09T09:48:02.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.262+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x55dd12e7e160 2024-05-09T09:48:02.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.262+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f55700aaa60 con 0x55dd12e7e160 2024-05-09T09:48:02.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.262+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x55dd12e79810 2024-05-09T09:48:02.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.262+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5574067070 con 0x55dd12e79810 2024-05-09T09:48:02.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.262+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x55dd12e7e160 2024-05-09T09:48:02.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.262+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55700aaa60 con 0x55dd12e7e160 2024-05-09T09:48:02.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.262+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x55dd12e7e160 2024-05-09T09:48:02.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.266+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55700aaa60 con 0x55dd12e7e160 2024-05-09T09:48:02.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.266+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x55dd12e74e20 2024-05-09T09:48:02.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.266+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.266+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x55dd12e74e20 2024-05-09T09:48:02.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.266+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.266+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x55dd12e79810 2024-05-09T09:48:02.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.266+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5574067070 con 0x55dd12e79810 2024-05-09T09:48:02.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.266+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x55dd12e7e160 2024-05-09T09:48:02.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.266+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55700aaa60 con 0x55dd12e7e160 2024-05-09T09:48:02.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.266+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x7f55700e0040 2024-05-09T09:48:02.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.266+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557800a4d0 con 0x7f55700e0040 2024-05-09T09:48:02.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.266+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x55dd12e74e20 2024-05-09T09:48:02.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.266+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.266+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x55dd12e79810 2024-05-09T09:48:02.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.266+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5574067070 con 0x55dd12e79810 2024-05-09T09:48:02.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.266+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x55dd12e7e160 2024-05-09T09:48:02.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.266+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55700aaa60 con 0x55dd12e7e160 2024-05-09T09:48:02.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.266+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x55dd12e79810 2024-05-09T09:48:02.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5574067070 con 0x55dd12e79810 2024-05-09T09:48:02.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x7f55700e0040 2024-05-09T09:48:02.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557800a4d0 con 0x7f55700e0040 2024-05-09T09:48:02.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x55dd12e7e160 2024-05-09T09:48:02.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55700aaa60 con 0x55dd12e7e160 2024-05-09T09:48:02.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x55dd12e79810 2024-05-09T09:48:02.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5574067070 con 0x55dd12e79810 2024-05-09T09:48:02.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x55dd12e74e20 2024-05-09T09:48:02.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e78ab0 con 0x7f55700e0040 2024-05-09T09:48:02.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557800a4d0 con 0x7f55700e0040 2024-05-09T09:48:02.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f5582d9e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:48:02.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f5582d9e980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:48:02.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f5582d9e980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:48:02.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f5582d9e980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:48:02.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f5582d9e980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:48:02.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f5582d9e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:48:02.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f5582d9e980 20 rados->read ofs=0 len=0 2024-05-09T09:48:02.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e7cad0 con 0x55dd12e74e20 2024-05-09T09:48:02.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f5582d9e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:02.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f5582d9e980 20 rados->read ofs=0 len=0 2024-05-09T09:48:02.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e7cad0 con 0x55dd12e74e20 2024-05-09T09:48:02.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f5582d9e980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:02.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f5582d9e980 20 rados->read ofs=0 len=0 2024-05-09T09:48:02.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e7cad0 con 0x55dd12e7e160 2024-05-09T09:48:02.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f55700aaa60 con 0x55dd12e7e160 2024-05-09T09:48:02.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f5582d9e980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:48:02.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f5582d9e980 20 zone default found 2024-05-09T09:48:02.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f5582d9e980 4 Realm: () 2024-05-09T09:48:02.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f5582d9e980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:48:02.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f5582d9e980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:48:02.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f5582d9e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:48:02.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f5582d9e980 20 zonegroup default 2024-05-09T09:48:02.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f5582d9e980 20 rados->read ofs=0 len=0 2024-05-09T09:48:02.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e7d4a0 con 0x55dd12e79810 2024-05-09T09:48:02.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5574067070 con 0x55dd12e79810 2024-05-09T09:48:02.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f5582d9e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:02.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f5582d9e980 20 rados->read ofs=0 len=0 2024-05-09T09:48:02.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.270+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e7d040 con 0x55dd12e7e160 2024-05-09T09:48:02.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.274+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f55700aaa60 con 0x55dd12e7e160 2024-05-09T09:48:02.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.274+0000 7f5582d9e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:02.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.274+0000 7f5582d9e980 20 rados->read ofs=0 len=0 2024-05-09T09:48:02.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.274+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e82fc0 con 0x55dd12e7e160 2024-05-09T09:48:02.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.274+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f55700aaa60 con 0x55dd12e7e160 2024-05-09T09:48:02.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.274+0000 7f5582d9e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:02.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.274+0000 7f5582d9e980 20 started sync module instance, tier type = 2024-05-09T09:48:02.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.274+0000 7f5582d9e980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:48:02.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.274+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e823e0 con 0x7f55700e0040 2024-05-09T09:48:02.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.274+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x7f55700e0040 2024-05-09T09:48:02.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.274+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94407993338112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e823e0 con 0x7f55700e0040 2024-05-09T09:48:02.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.274+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e83a80 con 0x55dd12e74e20 2024-05-09T09:48:02.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.274+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94407993338112] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x7f55700e0040 2024-05-09T09:48:02.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.278+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.278+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94407993341328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e823e0 con 0x55dd12e74e20 2024-05-09T09:48:02.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.278+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e84490 con 0x55dd12e7e160 2024-05-09T09:48:02.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.278+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94407993341328] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.278+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55700aaa60 con 0x55dd12e7e160 2024-05-09T09:48:02.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.278+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94407993335600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e82350 con 0x55dd12e7e160 2024-05-09T09:48:02.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.278+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e851e0 con 0x7f55700e0040 2024-05-09T09:48:02.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.278+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x7f55700e0040 2024-05-09T09:48:02.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.278+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94407993347648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e85a80 con 0x7f55700e0040 2024-05-09T09:48:02.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.282+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e86440 con 0x55dd12e74e20 2024-05-09T09:48:02.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.282+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94407993335600] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55700aaa60 con 0x55dd12e7e160 2024-05-09T09:48:02.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.282+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94407993347648] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x7f55700e0040 2024-05-09T09:48:02.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.282+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.282+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94407993352080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e859d0 con 0x55dd12e74e20 2024-05-09T09:48:02.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.282+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e863b0 con 0x55dd12e79810 2024-05-09T09:48:02.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.282+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5574067070 con 0x55dd12e79810 2024-05-09T09:48:02.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.282+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94407993354336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e87130 con 0x55dd12e79810 2024-05-09T09:48:02.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.282+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e87af0 con 0x55dd12e79810 2024-05-09T09:48:02.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.286+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94407993352080] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.286+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94407993354336] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5574067070 con 0x55dd12e79810 2024-05-09T09:48:02.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.286+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5574067070 con 0x55dd12e79810 2024-05-09T09:48:02.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.286+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94407993357888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e87e90 con 0x55dd12e79810 2024-05-09T09:48:02.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.286+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e886e0 con 0x55dd12e79810 2024-05-09T09:48:02.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.290+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94407993357888] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5574067070 con 0x55dd12e79810 2024-05-09T09:48:02.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.290+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5574067070 con 0x55dd12e79810 2024-05-09T09:48:02.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.290+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94407993360016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e88760 con 0x55dd12e79810 2024-05-09T09:48:02.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.290+0000 7f5582d9e980 20 add_watcher() i=0 2024-05-09T09:48:02.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.290+0000 7f5582d9e980 20 add_watcher() i=1 2024-05-09T09:48:02.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.290+0000 7f5582d9e980 20 add_watcher() i=2 2024-05-09T09:48:02.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.290+0000 7f5582d9e980 20 add_watcher() i=3 2024-05-09T09:48:02.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.290+0000 7f5582d9e980 20 add_watcher() i=4 2024-05-09T09:48:02.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.290+0000 7f5582d9e980 20 add_watcher() i=5 2024-05-09T09:48:02.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.290+0000 7f5582d9e980 20 add_watcher() i=6 2024-05-09T09:48:02.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.290+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94407993360016] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5574067070 con 0x55dd12e79810 2024-05-09T09:48:02.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.290+0000 7f5582d9e980 20 add_watcher() i=7 2024-05-09T09:48:02.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.290+0000 7f5582d9e980 2 all 8 watchers are set, enabling cache 2024-05-09T09:48:02.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.290+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e8ba60 con 0x55dd12e74e20 2024-05-09T09:48:02.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.290+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.290+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94407993361440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e88cf0 con 0x55dd12e74e20 2024-05-09T09:48:02.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.294+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94407993361440] v32'330 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.294+0000 7f5435fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:02.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.294+0000 7f5582d9e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:48:02.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.294+0000 7f5582d9e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:48:02.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.294+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e8b2d0 con 0x55dd12e74e20 2024-05-09T09:48:02.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.294+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'79 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.294+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e94b20 con 0x55dd12e79810 2024-05-09T09:48:02.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.298+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'73 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5574067070 con 0x55dd12e79810 2024-05-09T09:48:02.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.298+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e94b20 con 0x55dd12e7e160 2024-05-09T09:48:02.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.298+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'72 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f55700aaa60 con 0x55dd12e7e160 2024-05-09T09:48:02.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.298+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e94b20 con 0x55dd12e74e20 2024-05-09T09:48:02.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.298+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'331 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.298+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e955a0 con 0x7f55700e0040 2024-05-09T09:48:02.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.302+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'206 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x7f55700e0040 2024-05-09T09:48:02.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.302+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e95a50 con 0x55dd12e7e160 2024-05-09T09:48:02.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.302+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'138 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f55700aaa60 con 0x55dd12e7e160 2024-05-09T09:48:02.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.302+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e95fc0 con 0x55dd12e74e20 2024-05-09T09:48:02.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.306+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'74 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.306+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e96050 con 0x55dd12e79810 2024-05-09T09:48:02.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.306+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'137 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5574067070 con 0x55dd12e79810 2024-05-09T09:48:02.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.306+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e960e0 con 0x7f55700e0040 2024-05-09T09:48:02.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.310+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'72 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x7f55700e0040 2024-05-09T09:48:02.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.310+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e961f0 con 0x55dd12e7e160 2024-05-09T09:48:02.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.310+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'78 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f55700aaa60 con 0x55dd12e7e160 2024-05-09T09:48:02.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.310+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e966f0 con 0x7f55700e0040 2024-05-09T09:48:02.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.310+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'207 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x7f55700e0040 2024-05-09T09:48:02.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.314+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e966f0 con 0x55dd12e79810 2024-05-09T09:48:02.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.314+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'75 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5574067070 con 0x55dd12e79810 2024-05-09T09:48:02.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.314+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e96af0 con 0x7f55700e0040 2024-05-09T09:48:02.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.314+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'72 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x7f55700e0040 2024-05-09T09:48:02.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.314+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e96af0 con 0x55dd12e79810 2024-05-09T09:48:02.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.318+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'143 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5574067070 con 0x55dd12e79810 2024-05-09T09:48:02.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.318+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e96af0 con 0x55dd12e74e20 2024-05-09T09:48:02.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.318+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'332 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.318+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e96af0 con 0x55dd12e7e160 2024-05-09T09:48:02.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.322+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'200 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f55700aaa60 con 0x55dd12e7e160 2024-05-09T09:48:02.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.322+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e96af0 con 0x7f55700e0040 2024-05-09T09:48:02.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.322+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'208 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x7f55700e0040 2024-05-09T09:48:02.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.322+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e96af0 con 0x55dd12e7e160 2024-05-09T09:48:02.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.322+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'72 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f55700aaa60 con 0x55dd12e7e160 2024-05-09T09:48:02.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.322+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e96af0 con 0x55dd12e74e20 2024-05-09T09:48:02.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.326+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'80 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.326+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e96cc0 con 0x55dd12e74e20 2024-05-09T09:48:02.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.326+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'333 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.326+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e96cc0 con 0x55dd12e7e160 2024-05-09T09:48:02.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.330+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'201 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f55700aaa60 con 0x55dd12e7e160 2024-05-09T09:48:02.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.330+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e96cc0 con 0x7f55700e0040 2024-05-09T09:48:02.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.330+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'84 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x7f55700e0040 2024-05-09T09:48:02.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.330+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e970e0 con 0x55dd12e7e160 2024-05-09T09:48:02.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.330+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'74 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f55700aaa60 con 0x55dd12e7e160 2024-05-09T09:48:02.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.330+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e970e0 con 0x55dd12e7e160 2024-05-09T09:48:02.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.334+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'78 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f55700aaa60 con 0x55dd12e7e160 2024-05-09T09:48:02.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.334+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e970e0 con 0x55dd12e7e160 2024-05-09T09:48:02.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.334+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'69 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f55700aaa60 con 0x55dd12e7e160 2024-05-09T09:48:02.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.334+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e970e0 con 0x55dd12e7e160 2024-05-09T09:48:02.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.334+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'139 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f55700aaa60 con 0x55dd12e7e160 2024-05-09T09:48:02.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.334+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e970e0 con 0x55dd12e79810 2024-05-09T09:48:02.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.338+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'74 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5574067070 con 0x55dd12e79810 2024-05-09T09:48:02.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.338+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e970e0 con 0x55dd12e7e160 2024-05-09T09:48:02.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.338+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'72 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f55700aaa60 con 0x55dd12e7e160 2024-05-09T09:48:02.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.338+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e970e0 con 0x55dd12e79810 2024-05-09T09:48:02.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.342+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'138 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5574067070 con 0x55dd12e79810 2024-05-09T09:48:02.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.342+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e970e0 con 0x55dd12e7e160 2024-05-09T09:48:02.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.346+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'202 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f55700aaa60 con 0x55dd12e7e160 2024-05-09T09:48:02.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.346+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e970e0 con 0x55dd12e79810 2024-05-09T09:48:02.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.346+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'144 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5574067070 con 0x55dd12e79810 2024-05-09T09:48:02.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.346+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e970e0 con 0x7f55700e0040 2024-05-09T09:48:02.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.350+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'78 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x7f55700e0040 2024-05-09T09:48:02.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.350+0000 7f5434fe1640 20 reqs_thread_entry: start 2024-05-09T09:48:02.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.350+0000 7f5582d9e980 20 init_complete bucket index max shards: 11 2024-05-09T09:48:02.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.350+0000 7f53ae7fc640 20 reqs_thread_entry: start 2024-05-09T09:48:02.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.350+0000 7f5582d9e980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-09T09:48:02.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.350+0000 7f5582d9e980 20 rados->read ofs=0 len=0 2024-05-09T09:48:02.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.350+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd12eb25c0 con 0x55dd12e74e20 2024-05-09T09:48:02.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.350+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv16 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.350+0000 7f5582d9e980 20 rados_obj.operate() r=0 bl.length=403 2024-05-09T09:48:02.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.350+0000 7f5582d9e980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-09T09:48:02.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.350+0000 7f5582d9e980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:48:02.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.350+0000 7f5582d9e980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:48:02.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.350+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12eb84f0 con 0x55dd12e74e20 2024-05-09T09:48:02.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.354+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(95 foo [delete,create,call,call,writefull 0~391] v32'17 uv17 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.354+0000 7f5582d9e980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:48:02.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.354+0000 7f5582d9e980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:48:02.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.354+0000 7f5582d9e980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-09T09:48:02.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.354+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 7.d 7:b4812045:::notify.4:head [notify cookie 94407993556832 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dd12eb3f80 con 0x55dd12e74e20 2024-05-09T09:48:02.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.354+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== watch-notify(notify (1) cookie 94407993352080 notify 137438953495 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55dd12e961f0 con 0x55dd12e74e20 2024-05-09T09:48:02.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.354+0000 7f545effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 94407993352080 notifier 4670 bl.length()=567 2024-05-09T09:48:02.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.354+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(96 notify.4 [notify cookie 94407993556832 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.354+0000 7f545effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-09T09:48:02.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.354+0000 7f545effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:48:02.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.354+0000 7f545effd640 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f54440056c0 con 0x55dd12e74e20 2024-05-09T09:48:02.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.354+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== watch-notify(notify_complete (2) cookie 94407993556832 notify 137438953495 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55dd12e951a0 con 0x55dd12e74e20 2024-05-09T09:48:02.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.354+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(97 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.355 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-09T09:47:32.044078Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:47:32.044055Z","tags":[],"group_ids":[]} 2024-05-09T09:48:02.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.354+0000 7f5435fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:02.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.354+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94407993361440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12eb7750 con 0x55dd12e74e20 2024-05-09T09:48:02.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.358+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(98 data_loggenerations_metadata [watch unwatch cookie 94407993361440] v32'334 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.358+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94407993338112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e88420 con 0x7f55700e0040 2024-05-09T09:48:02.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.358+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(99 notify.0 [watch unwatch cookie 94407993338112] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x7f55700e0040 2024-05-09T09:48:02.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.358+0000 7f5582d9e980 20 remove_watcher() i=0 2024-05-09T09:48:02.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.358+0000 7f5582d9e980 2 removed watcher, disabling cache 2024-05-09T09:48:02.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.358+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94407993341328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e88420 con 0x55dd12e74e20 2024-05-09T09:48:02.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.358+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(100 notify.1 [watch unwatch cookie 94407993341328] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.358+0000 7f5582d9e980 20 remove_watcher() i=1 2024-05-09T09:48:02.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.358+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94407993335600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e88420 con 0x55dd12e7e160 2024-05-09T09:48:02.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.362+0000 7f55800b8640 1 -- 172.21.15.157:0/3900167711 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(101 notify.2 [watch unwatch cookie 94407993335600] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55700aaa60 con 0x55dd12e7e160 2024-05-09T09:48:02.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.362+0000 7f5582d9e980 20 remove_watcher() i=2 2024-05-09T09:48:02.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.362+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:102 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94407993347648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e81f30 con 0x7f55700e0040 2024-05-09T09:48:02.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.362+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(102 notify.3 [watch unwatch cookie 94407993347648] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x7f55700e0040 2024-05-09T09:48:02.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.362+0000 7f5582d9e980 20 remove_watcher() i=3 2024-05-09T09:48:02.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.362+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94407993352080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e88420 con 0x55dd12e74e20 2024-05-09T09:48:02.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.366+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(103 notify.4 [watch unwatch cookie 94407993352080] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557800a4d0 con 0x55dd12e74e20 2024-05-09T09:48:02.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.366+0000 7f5582d9e980 20 remove_watcher() i=4 2024-05-09T09:48:02.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.366+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94407993354336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e84e40 con 0x55dd12e79810 2024-05-09T09:48:02.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.370+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(104 notify.5 [watch unwatch cookie 94407993354336] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5574067070 con 0x55dd12e79810 2024-05-09T09:48:02.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.370+0000 7f5582d9e980 20 remove_watcher() i=5 2024-05-09T09:48:02.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.370+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:105 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94407993357888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e81f30 con 0x55dd12e79810 2024-05-09T09:48:02.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.370+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(105 notify.6 [watch unwatch cookie 94407993357888] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5574067070 con 0x55dd12e79810 2024-05-09T09:48:02.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.370+0000 7f5582d9e980 20 remove_watcher() i=6 2024-05-09T09:48:02.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.370+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:106 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94407993360016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dd12e85f90 con 0x55dd12e79810 2024-05-09T09:48:02.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f55808b9640 1 -- 172.21.15.157:0/3900167711 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(106 notify.7 [watch unwatch cookie 94407993360016] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5574067070 con 0x55dd12e79810 2024-05-09T09:48:02.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 20 remove_watcher() i=7 2024-05-09T09:48:02.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55dd12e79810 msgr2=0x55dd12e7bc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 --2- 172.21.15.157:0/3900167711 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55dd12e79810 0x55dd12e7bc00 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55dd12e74e20 msgr2=0x55dd12e772e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 --2- 172.21.15.157:0/3900167711 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55dd12e74e20 0x55dd12e772e0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f55700e0040 msgr2=0x7f55700e0930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 --2- 172.21.15.157:0/3900167711 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f55700e0040 0x7f55700e0930 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55dd12e7e160 msgr2=0x55dd12e80570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 --2- 172.21.15.157:0/3900167711 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55dd12e7e160 0x55dd12e80570 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5448034bb0 msgr2=0x7f5448037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 --2- 172.21.15.157:0/3900167711 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5448034bb0 0x7f5448037070 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55dd12e2e4f0 tx=0x7f55700c1040 comp rx=0 tx=0).stop 2024-05-09T09:48:02.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12e60f50 msgr2=0x55dd12e68300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 --2- 172.21.15.157:0/3900167711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12e60f50 0x55dd12e68300 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5574007fd0 tx=0x7f55740334d0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f55810ba640 1 -- 172.21.15.157:0/3900167711 reap_dead start 2024-05-09T09:48:02.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 shutdown_connections 2024-05-09T09:48:02.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 --2- 172.21.15.157:0/3900167711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12e60f50 0x55dd12e68300 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 >> 172.21.15.157:0/3900167711 conn(0x55dd12e5d2d0 msgr2=0x55dd12e62770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:02.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 shutdown_connections 2024-05-09T09:48:02.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 -- 172.21.15.157:0/3900167711 wait complete. 2024-05-09T09:48:02.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 -- 172.21.15.157:0/1466043488 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5458034bb0 msgr2=0x7f5458037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 --2- 172.21.15.157:0/1466043488 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5458034bb0 0x7f5458037070 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55dd12e25800 tx=0x7f5570005ad0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 -- 172.21.15.157:0/1466043488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12e53f80 msgr2=0x55dd12e543a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 --2- 172.21.15.157:0/1466043488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12e53f80 0x55dd12e543a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f557401cee0 tx=0x7f5574042f80 comp rx=0 tx=0).stop 2024-05-09T09:48:02.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 -- 172.21.15.157:0/1466043488 shutdown_connections 2024-05-09T09:48:02.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 --2- 172.21.15.157:0/1466043488 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5458034bb0 0x7f5458037070 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 --2- 172.21.15.157:0/1466043488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12e53f80 0x55dd12e543a0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 -- 172.21.15.157:0/1466043488 >> 172.21.15.157:0/1466043488 conn(0x55dd12e48d50 msgr2=0x55dd12e49860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:02.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 -- 172.21.15.157:0/1466043488 shutdown_connections 2024-05-09T09:48:02.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 -- 172.21.15.157:0/1466043488 wait complete. 2024-05-09T09:48:02.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 -- 172.21.15.157:0/1954619491 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55dd12e27680 msgr2=0x55dd12e29a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 --2- 172.21.15.157:0/1954619491 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55dd12e27680 0x55dd12e29a70 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 -- 172.21.15.157:0/1954619491 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55dd12d2ed70 msgr2=0x55dd12e24dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 --2- 172.21.15.157:0/1954619491 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55dd12d2ed70 0x55dd12e24dc0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 -- 172.21.15.157:0/1954619491 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55dd12e2b5c0 msgr2=0x55dd12e2d9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 --2- 172.21.15.157:0/1954619491 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55dd12e2b5c0 0x55dd12e2d9b0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 -- 172.21.15.157:0/1954619491 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5468034c00 msgr2=0x7f54680370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 --2- 172.21.15.157:0/1954619491 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5468034c00 0x7f54680370c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f55700ae000 tx=0x7f55700a6000 comp rx=0 tx=0).stop 2024-05-09T09:48:02.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 -- 172.21.15.157:0/1954619491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12d2a810 msgr2=0x55dd12e1dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 --2- 172.21.15.157:0/1954619491 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55dd12d2a810 0x55dd12e1dcc0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f557400b6f0 tx=0x7f5574000ee0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f55810ba640 1 -- 172.21.15.157:0/1954619491 reap_dead start 2024-05-09T09:48:02.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 -- 172.21.15.157:0/1954619491 shutdown_connections 2024-05-09T09:48:02.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 -- 172.21.15.157:0/1954619491 >> 172.21.15.157:0/1954619491 conn(0x55dd12d260e0 msgr2=0x55dd12e10070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:02.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 -- 172.21.15.157:0/1954619491 shutdown_connections 2024-05-09T09:48:02.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.374+0000 7f5582d9e980 1 -- 172.21.15.157:0/1954619491 wait complete. 2024-05-09T09:48:02.386 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-09T09:47:32.044078Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:47:32.044055Z', 'tags': [], 'group_ids': []} 2024-05-09T09:48:02.403 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-09T09:48:02.404 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-05-09T09:48:02.404 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-05-09T09:48:02.404 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-05-09T09:48:02.461 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:48:02.461 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:48:02.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.462+0000 7f54794b0980 1 Processor -- start 2024-05-09T09:48:02.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.462+0000 7f54794b0980 1 -- start start 2024-05-09T09:48:02.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.462+0000 7f54794b0980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x557fcf296d10 0x557fcf299100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.462+0000 7f54794b0980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557fcf148440 con 0x557fcf206a70 2024-05-09T09:48:02.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.462+0000 7f54794b0980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x557fcf1335f0 con 0x557fcf296d10 2024-05-09T09:48:02.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.462+0000 7f54767ca640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x557fcf296d10 0x557fcf299100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.462+0000 7f54767ca640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x557fcf296d10 0x557fcf299100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35262/0 (socket says 172.21.15.157:35262) 2024-05-09T09:48:02.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.462+0000 7f5476fcb640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x557fcf206a70 0x557fcf2955f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:56220/0 (socket says 172.21.15.157:56220) 2024-05-09T09:48:02.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.462+0000 7f54767ca640 1 -- 172.21.15.157:0/4147674993 learned_addr learned my addr 172.21.15.157:0/4147674993 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:02.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.462+0000 7f54767ca640 1 -- 172.21.15.157:0/4147674993 >> v1:172.21.15.110:6789/0 conn(0x557fcf206a70 legacy=0x557fcf2955f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.462+0000 7f54767ca640 1 -- 172.21.15.157:0/4147674993 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fcf13e990 con 0x557fcf296d10 2024-05-09T09:48:02.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.466+0000 7f54767ca640 1 --2- 172.21.15.157:0/4147674993 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf296d10 0x557fcf299100 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f546c00a5c0 tx=0x7f546c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b781c70c746176f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.466+0000 7f5475fc9640 1 -- 172.21.15.157:0/4147674993 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f546c0a6070 con 0x557fcf296d10 2024-05-09T09:48:02.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.466+0000 7f5475fc9640 1 -- 172.21.15.157:0/4147674993 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f546c0af070 con 0x557fcf296d10 2024-05-09T09:48:02.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.466+0000 7f5475fc9640 1 -- 172.21.15.157:0/4147674993 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f546c0aa5c0 con 0x557fcf296d10 2024-05-09T09:48:02.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.466+0000 7f54794b0980 1 -- 172.21.15.157:0/4147674993 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf296d10 msgr2=0x557fcf299100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.466+0000 7f54794b0980 1 --2- 172.21.15.157:0/4147674993 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf296d10 0x557fcf299100 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f546c00a5c0 tx=0x7f546c01b340 comp rx=0 tx=0).stop 2024-05-09T09:48:02.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.466+0000 7f54794b0980 1 -- 172.21.15.157:0/4147674993 shutdown_connections 2024-05-09T09:48:02.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.466+0000 7f54794b0980 1 --2- 172.21.15.157:0/4147674993 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf296d10 0x557fcf299100 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.466+0000 7f54794b0980 1 -- 172.21.15.157:0/4147674993 >> 172.21.15.157:0/4147674993 conn(0x557fcf28d0d0 msgr2=0x557fcf28f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:02.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.466+0000 7f54794b0980 1 -- 172.21.15.157:0/4147674993 shutdown_connections 2024-05-09T09:48:02.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.466+0000 7f54794b0980 1 -- 172.21.15.157:0/4147674993 wait complete. 2024-05-09T09:48:02.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.482+0000 7f54794b0980 1 Processor -- start 2024-05-09T09:48:02.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.482+0000 7f54794b0980 1 -- start start 2024-05-09T09:48:02.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.482+0000 7f54794b0980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf206a70 0x557fcf292d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.482+0000 7f54794b0980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557fcf195fe0 con 0x557fcf206a70 2024-05-09T09:48:02.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.482+0000 7f5476fcb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf206a70 0x557fcf292d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.482+0000 7f5476fcb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf206a70 0x557fcf292d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35276/0 (socket says 172.21.15.157:35276) 2024-05-09T09:48:02.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.482+0000 7f5476fcb640 1 -- 172.21.15.157:0/765281642 learned_addr learned my addr 172.21.15.157:0/765281642 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:02.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.482+0000 7f5476fcb640 1 -- 172.21.15.157:0/765281642 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fcf11aae0 con 0x557fcf206a70 2024-05-09T09:48:02.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.482+0000 7f5476fcb640 1 --2- 172.21.15.157:0/765281642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf206a70 0x557fcf292d50 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5468001e50 tx=0x7f5468001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b07dc2dd5f29345 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.482+0000 7f5364e09640 1 -- 172.21.15.157:0/765281642 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f546800e5d0 con 0x557fcf206a70 2024-05-09T09:48:02.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.482+0000 7f5364e09640 1 -- 172.21.15.157:0/765281642 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f546800e770 con 0x557fcf206a70 2024-05-09T09:48:02.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.482+0000 7f5364e09640 1 -- 172.21.15.157:0/765281642 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f546800eab0 con 0x557fcf206a70 2024-05-09T09:48:02.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.486+0000 7f54794b0980 1 -- 172.21.15.157:0/765281642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf206a70 msgr2=0x557fcf292d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.486+0000 7f54794b0980 1 --2- 172.21.15.157:0/765281642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf206a70 0x557fcf292d50 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5468001e50 tx=0x7f5468001e80 comp rx=0 tx=0).stop 2024-05-09T09:48:02.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.486+0000 7f54794b0980 1 -- 172.21.15.157:0/765281642 shutdown_connections 2024-05-09T09:48:02.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.486+0000 7f54794b0980 1 --2- 172.21.15.157:0/765281642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf206a70 0x557fcf292d50 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.486+0000 7f54794b0980 1 -- 172.21.15.157:0/765281642 >> 172.21.15.157:0/765281642 conn(0x557fcf28d0d0 msgr2=0x557fcf379700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:02.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.486+0000 7f54794b0980 1 -- 172.21.15.157:0/765281642 shutdown_connections 2024-05-09T09:48:02.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.486+0000 7f54794b0980 1 -- 172.21.15.157:0/765281642 wait complete. 2024-05-09T09:48:02.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.486+0000 7f54794b0980 1 Processor -- start 2024-05-09T09:48:02.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.486+0000 7f54794b0980 1 -- start start 2024-05-09T09:48:02.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.486+0000 7f54794b0980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf296d10 0x557fcf387110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.486+0000 7f54794b0980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557fcf29a1e0 con 0x557fcf296d10 2024-05-09T09:48:02.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.486+0000 7f5476fcb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf296d10 0x557fcf387110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.486+0000 7f5476fcb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf296d10 0x557fcf387110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35292/0 (socket says 172.21.15.157:35292) 2024-05-09T09:48:02.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.486+0000 7f5476fcb640 1 -- 172.21.15.157:0/251901659 learned_addr learned my addr 172.21.15.157:0/251901659 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:02.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.486+0000 7f5476fcb640 1 -- 172.21.15.157:0/251901659 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fcf387650 con 0x557fcf296d10 2024-05-09T09:48:02.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.486+0000 7f5476fcb640 1 --2- 172.21.15.157:0/251901659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf296d10 0x557fcf387110 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5468004000 tx=0x7f5468000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.486+0000 7f5363606640 1 -- 172.21.15.157:0/251901659 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5468001260 con 0x557fcf296d10 2024-05-09T09:48:02.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.486+0000 7f5363606640 1 -- 172.21.15.157:0/251901659 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f546800f9a0 con 0x557fcf296d10 2024-05-09T09:48:02.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.486+0000 7f5363606640 1 -- 172.21.15.157:0/251901659 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f546800fce0 con 0x557fcf296d10 2024-05-09T09:48:02.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.486+0000 7f54794b0980 1 -- 172.21.15.157:0/251901659 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557fcf3878e0 con 0x557fcf296d10 2024-05-09T09:48:02.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.486+0000 7f54794b0980 1 -- 172.21.15.157:0/251901659 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fcf38a5c0 con 0x557fcf296d10 2024-05-09T09:48:02.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.490+0000 7f5363606640 1 -- 172.21.15.157:0/251901659 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f5468017070 con 0x557fcf296d10 2024-05-09T09:48:02.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.490+0000 7f5363606640 1 --2- 172.21.15.157:0/251901659 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f535c034c00 0x7f535c0370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.490+0000 7f5363606640 1 -- 172.21.15.157:0/251901659 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f5468015020 con 0x557fcf296d10 2024-05-09T09:48:02.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.490+0000 7f54767ca640 1 --2- 172.21.15.157:0/251901659 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f535c034c00 0x7f535c0370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.490+0000 7f54794b0980 1 --2- 172.21.15.157:0/251901659 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557fcf38c090 0x557fcf38e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.490+0000 7f54794b0980 1 -- 172.21.15.157:0/251901659 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fcf38eae0 con 0x557fcf38c090 2024-05-09T09:48:02.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.490+0000 7f54777cc640 1 --2- 172.21.15.157:0/251901659 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557fcf38c090 0x557fcf38e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.490+0000 7f54767ca640 1 --2- 172.21.15.157:0/251901659 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f535c034c00 0x7f535c0370c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f546c0ae000 tx=0x7f546c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.490+0000 7f54777cc640 1 --2- 172.21.15.157:0/251901659 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557fcf38c090 0x557fcf38e4a0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.490+0000 7f54777cc640 1 -- 172.21.15.157:0/251901659 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf38c090 2024-05-09T09:48:02.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.490+0000 7f54794b0980 1 -- 172.21.15.157:0/251901659 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fcf38b7e0 con 0x557fcf38c090 2024-05-09T09:48:02.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.490+0000 7f54777cc640 1 -- 172.21.15.157:0/251901659 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf38c090 2024-05-09T09:48:02.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.490+0000 7f54794b0980 1 --2- 172.21.15.157:0/251901659 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557fcf390e10 0x557fcf393200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.490+0000 7f54794b0980 1 -- 172.21.15.157:0/251901659 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3938d0 con 0x557fcf390e10 2024-05-09T09:48:02.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.490+0000 7f5476fcb640 1 --2- 172.21.15.157:0/251901659 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557fcf390e10 0x557fcf393200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.494+0000 7f5476fcb640 1 --2- 172.21.15.157:0/251901659 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557fcf390e10 0x557fcf393200 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.494+0000 7f5476fcb640 1 -- 172.21.15.157:0/251901659 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f546802e070 con 0x557fcf390e10 2024-05-09T09:48:02.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.494+0000 7f54794b0980 1 -- 172.21.15.157:0/251901659 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fcf38fcb0 con 0x557fcf38c090 2024-05-09T09:48:02.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.494+0000 7f54777cc640 1 -- 172.21.15.157:0/251901659 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf38c090 2024-05-09T09:48:02.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.494+0000 7f54794b0980 1 --2- 172.21.15.157:0/251901659 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557fcf394d10 0x557fcf397100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.494+0000 7f54794b0980 1 -- 172.21.15.157:0/251901659 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fcf397890 con 0x557fcf394d10 2024-05-09T09:48:02.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.494+0000 7f54767ca640 1 --2- 172.21.15.157:0/251901659 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557fcf394d10 0x557fcf397100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.494+0000 7f54767ca640 1 --2- 172.21.15.157:0/251901659 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557fcf394d10 0x557fcf397100 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.494+0000 7f54767ca640 1 -- 172.21.15.157:0/251901659 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f546c0aaa60 con 0x557fcf394d10 2024-05-09T09:48:02.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.498+0000 7f54794b0980 1 Processor -- start 2024-05-09T09:48:02.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.498+0000 7f54794b0980 1 -- start start 2024-05-09T09:48:02.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.498+0000 7f54794b0980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf3bd740 0x557fcf3bdb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.498+0000 7f54794b0980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557fcf19a020 con 0x557fcf3bd740 2024-05-09T09:48:02.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.498+0000 7f5476fcb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf3bd740 0x557fcf3bdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.498+0000 7f5476fcb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf3bd740 0x557fcf3bdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35306/0 (socket says 172.21.15.157:35306) 2024-05-09T09:48:02.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.498+0000 7f5476fcb640 1 -- 172.21.15.157:0/3123628937 learned_addr learned my addr 172.21.15.157:0/3123628937 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:02.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.498+0000 7f5476fcb640 1 -- 172.21.15.157:0/3123628937 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fcf3be0a0 con 0x557fcf3bd740 2024-05-09T09:48:02.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.498+0000 7f5476fcb640 1 --2- 172.21.15.157:0/3123628937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf3bd740 0x557fcf3bdb60 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f546801cfd0 tx=0x7f5468028810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.498+0000 7f535b7fe640 1 -- 172.21.15.157:0/3123628937 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5468017b90 con 0x557fcf3bd740 2024-05-09T09:48:02.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.498+0000 7f535b7fe640 1 -- 172.21.15.157:0/3123628937 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5468017d30 con 0x557fcf3bd740 2024-05-09T09:48:02.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.498+0000 7f54794b0980 1 -- 172.21.15.157:0/3123628937 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557fcf3beb30 con 0x557fcf3bd740 2024-05-09T09:48:02.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.498+0000 7f535b7fe640 1 -- 172.21.15.157:0/3123628937 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f546801a5b0 con 0x557fcf3bd740 2024-05-09T09:48:02.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.498+0000 7f54794b0980 1 -- 172.21.15.157:0/3123628937 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fcf3beb30 con 0x557fcf3bd740 2024-05-09T09:48:02.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.502+0000 7f535b7fe640 1 -- 172.21.15.157:0/3123628937 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f5468042060 con 0x557fcf3bd740 2024-05-09T09:48:02.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.502+0000 7f535b7fe640 1 --2- 172.21.15.157:0/3123628937 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5350034bb0 0x7f5350037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.502+0000 7f535b7fe640 1 -- 172.21.15.157:0/3123628937 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f546803cd20 con 0x557fcf3bd740 2024-05-09T09:48:02.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.502+0000 7f54767ca640 1 --2- 172.21.15.157:0/3123628937 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5350034bb0 0x7f5350037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.502+0000 7f54794b0980 1 Processor -- start 2024-05-09T09:48:02.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.502+0000 7f54794b0980 1 -- start start 2024-05-09T09:48:02.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.502+0000 7f54767ca640 1 --2- 172.21.15.157:0/3123628937 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5350034bb0 0x7f5350037070 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f546c01b380 tx=0x7f546c005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.502+0000 7f54794b0980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf3ca4c0 0x557fcf3ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.502+0000 7f54794b0980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557fcf291480 con 0x557fcf3ca4c0 2024-05-09T09:48:02.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.502+0000 7f5476fcb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf3ca4c0 0x557fcf3ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.502+0000 7f5476fcb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf3ca4c0 0x557fcf3ca8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35318/0 (socket says 172.21.15.157:35318) 2024-05-09T09:48:02.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.502+0000 7f5476fcb640 1 -- 172.21.15.157:0/151133224 learned_addr learned my addr 172.21.15.157:0/151133224 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:02.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.502+0000 7f5476fcb640 1 -- 172.21.15.157:0/151133224 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fcf3caeb0 con 0x557fcf3ca4c0 2024-05-09T09:48:02.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.502+0000 7f5476fcb640 1 --2- 172.21.15.157:0/151133224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf3ca4c0 0x557fcf3ca8e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f546804fa70 tx=0x7f546804f7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a6134eb3e2fe66a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.502+0000 7f53597fa640 1 -- 172.21.15.157:0/151133224 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5468056040 con 0x557fcf3ca4c0 2024-05-09T09:48:02.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.502+0000 7f53597fa640 1 -- 172.21.15.157:0/151133224 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f546801a930 con 0x557fcf3ca4c0 2024-05-09T09:48:02.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.502+0000 7f53597fa640 1 -- 172.21.15.157:0/151133224 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5468032d70 con 0x557fcf3ca4c0 2024-05-09T09:48:02.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.506+0000 7f54794b0980 1 -- 172.21.15.157:0/151133224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf3ca4c0 msgr2=0x557fcf3ca8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.506+0000 7f54794b0980 1 --2- 172.21.15.157:0/151133224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf3ca4c0 0x557fcf3ca8e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f546804fa70 tx=0x7f546804f7c0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.506+0000 7f54794b0980 1 -- 172.21.15.157:0/151133224 shutdown_connections 2024-05-09T09:48:02.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.506+0000 7f54794b0980 1 --2- 172.21.15.157:0/151133224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf3ca4c0 0x557fcf3ca8e0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.506+0000 7f54794b0980 1 -- 172.21.15.157:0/151133224 >> 172.21.15.157:0/151133224 conn(0x557fcf3c68d0 msgr2=0x557fcf3c4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:02.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.506+0000 7f54794b0980 1 -- 172.21.15.157:0/151133224 shutdown_connections 2024-05-09T09:48:02.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.506+0000 7f54794b0980 1 -- 172.21.15.157:0/151133224 wait complete. 2024-05-09T09:48:02.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.506+0000 7f54794b0980 1 Processor -- start 2024-05-09T09:48:02.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.506+0000 7f54794b0980 1 -- start start 2024-05-09T09:48:02.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.506+0000 7f54794b0980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf3ca4c0 0x557fcf3d1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.506+0000 7f54794b0980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557fcf3cb490 con 0x557fcf3ca4c0 2024-05-09T09:48:02.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.506+0000 7f5476fcb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf3ca4c0 0x557fcf3d1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.506+0000 7f5476fcb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf3ca4c0 0x557fcf3d1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:35326/0 (socket says 172.21.15.157:35326) 2024-05-09T09:48:02.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.506+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 learned_addr learned my addr 172.21.15.157:0/1940645510 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:02.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.506+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fcf3d1d80 con 0x557fcf3ca4c0 2024-05-09T09:48:02.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.506+0000 7f5476fcb640 1 --2- 172.21.15.157:0/1940645510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf3ca4c0 0x557fcf3d1840 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f54680482d0 tx=0x7f546803ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.506+0000 7f53477fe640 1 -- 172.21.15.157:0/1940645510 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54680499f0 con 0x557fcf3ca4c0 2024-05-09T09:48:02.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.506+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557fcf3d1d80 con 0x557fcf3ca4c0 2024-05-09T09:48:02.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.506+0000 7f53477fe640 1 -- 172.21.15.157:0/1940645510 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f546806a030 con 0x557fcf3ca4c0 2024-05-09T09:48:02.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.506+0000 7f53477fe640 1 -- 172.21.15.157:0/1940645510 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5468049cc0 con 0x557fcf3ca4c0 2024-05-09T09:48:02.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.506+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fcf3d1d80 con 0x557fcf3ca4c0 2024-05-09T09:48:02.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f53477fe640 1 -- 172.21.15.157:0/1940645510 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f546803a070 con 0x557fcf3ca4c0 2024-05-09T09:48:02.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f53477fe640 1 --2- 172.21.15.157:0/1940645510 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5340034bb0 0x7f5340037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f53477fe640 1 -- 172.21.15.157:0/1940645510 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f5468070d40 con 0x557fcf3ca4c0 2024-05-09T09:48:02.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f54767ca640 1 --2- 172.21.15.157:0/1940645510 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5340034bb0 0x7f5340037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f54794b0980 20 rados->read ofs=0 len=0 2024-05-09T09:48:02.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f54794b0980 1 --2- 172.21.15.157:0/1940645510 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557fcf3de320 0x557fcf3e07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e0f30 con 0x557fcf3de320 2024-05-09T09:48:02.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f54777cc640 1 --2- 172.21.15.157:0/1940645510 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557fcf3de320 0x557fcf3e07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f54767ca640 1 --2- 172.21.15.157:0/1940645510 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5340034bb0 0x7f5340037070 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f546c0aafd0 tx=0x7f546c0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f54777cc640 1 --2- 172.21.15.157:0/1940645510 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557fcf3de320 0x557fcf3e07e0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f54794b0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:02.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f54794b0980 20 realm 2024-05-09T09:48:02.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f54794b0980 20 rados->read ofs=0 len=0 2024-05-09T09:48:02.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1340 con 0x557fcf3de320 2024-05-09T09:48:02.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f54794b0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:02.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f54794b0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:48:02.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f54794b0980 20 rados->read ofs=0 len=0 2024-05-09T09:48:02.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1c10 con 0x557fcf3de320 2024-05-09T09:48:02.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f54794b0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:02.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f54794b0980 20 rados->read ofs=0 len=0 2024-05-09T09:48:02.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x557fcf3de320 2024-05-09T09:48:02.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f54794b0980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:02.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f54794b0980 20 rados->read ofs=0 len=0 2024-05-09T09:48:02.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f54794b0980 1 --2- 172.21.15.157:0/1940645510 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557fcf3e2d10 0x557fcf3e5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e56d0 con 0x557fcf3e2d10 2024-05-09T09:48:02.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.510+0000 7f5476fcb640 1 --2- 172.21.15.157:0/1940645510 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557fcf3e2d10 0x557fcf3e5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.514+0000 7f5476fcb640 1 --2- 172.21.15.157:0/1940645510 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557fcf3e2d10 0x557fcf3e5100 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.514+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5468076070 con 0x557fcf3e2d10 2024-05-09T09:48:02.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.514+0000 7f54794b0980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:48:02.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.514+0000 7f54794b0980 20 searching for the correct realm 2024-05-09T09:48:02.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.514+0000 7f54794b0980 1 --2- 172.21.15.157:0/1940645510 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557fcf3e7620 0x557fcf3e9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.514+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3ea120 con 0x557fcf3e7620 2024-05-09T09:48:02.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.514+0000 7f54767ca640 1 --2- 172.21.15.157:0/1940645510 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557fcf3e7620 0x557fcf3e9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.514+0000 7f54767ca640 1 --2- 172.21.15.157:0/1940645510 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557fcf3e7620 0x557fcf3e9a50 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.514+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f546c0aaa60 con 0x557fcf3e7620 2024-05-09T09:48:02.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.514+0000 7f54767ca640 1 --2- 172.21.15.157:0/1940645510 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f546c0e0040 0x7f546c0e0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:02.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.514+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3ea120 con 0x7f546c0e0040 2024-05-09T09:48:02.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.514+0000 7f54777cc640 1 --2- 172.21.15.157:0/1940645510 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f546c0e0040 0x7f546c0e0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:02.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.514+0000 7f54777cc640 1 --2- 172.21.15.157:0/1940645510 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f546c0e0040 0x7f546c0e0930 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:02.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.514+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547000a4d0 con 0x7f546c0e0040 2024-05-09T09:48:02.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.514+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x557fcf3e2d10 2024-05-09T09:48:02.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.514+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5468076070 con 0x557fcf3e2d10 2024-05-09T09:48:02.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.514+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x557fcf3de320 2024-05-09T09:48:02.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.514+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.514+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x557fcf3de320 2024-05-09T09:48:02.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.518+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.518+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x557fcf3e2d10 2024-05-09T09:48:02.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.518+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5468076070 con 0x557fcf3e2d10 2024-05-09T09:48:02.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.518+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x557fcf3e2d10 2024-05-09T09:48:02.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.518+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5468076070 con 0x557fcf3e2d10 2024-05-09T09:48:02.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.518+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x7f546c0e0040 2024-05-09T09:48:02.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.518+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547000a4d0 con 0x7f546c0e0040 2024-05-09T09:48:02.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.518+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x557fcf3e7620 2024-05-09T09:48:02.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.518+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f546c0aaa60 con 0x557fcf3e7620 2024-05-09T09:48:02.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.518+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x557fcf3de320 2024-05-09T09:48:02.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.518+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.518+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x557fcf3e2d10 2024-05-09T09:48:02.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.518+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5468076070 con 0x557fcf3e2d10 2024-05-09T09:48:02.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.518+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x557fcf3de320 2024-05-09T09:48:02.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.518+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.518+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x7f546c0e0040 2024-05-09T09:48:02.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.518+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f547000a4d0 con 0x7f546c0e0040 2024-05-09T09:48:02.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.518+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x557fcf3e7620 2024-05-09T09:48:02.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.518+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f546c0aaa60 con 0x557fcf3e7620 2024-05-09T09:48:02.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.518+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x557fcf3e7620 2024-05-09T09:48:02.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.522+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f546c0aaa60 con 0x557fcf3e7620 2024-05-09T09:48:02.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.522+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x557fcf3e2d10 2024-05-09T09:48:02.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.522+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5468076070 con 0x557fcf3e2d10 2024-05-09T09:48:02.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.522+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x557fcf3e7620 2024-05-09T09:48:02.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.522+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f546c0aaa60 con 0x557fcf3e7620 2024-05-09T09:48:02.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.522+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x557fcf3e7620 2024-05-09T09:48:02.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.522+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f546c0aaa60 con 0x557fcf3e7620 2024-05-09T09:48:02.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.522+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x557fcf3de320 2024-05-09T09:48:02.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.522+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.522+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x557fcf3de320 2024-05-09T09:48:02.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.522+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.522+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x557fcf3e2d10 2024-05-09T09:48:02.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.522+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5468076070 con 0x557fcf3e2d10 2024-05-09T09:48:02.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.522+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x557fcf3e7620 2024-05-09T09:48:02.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.522+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f546c0aaa60 con 0x557fcf3e7620 2024-05-09T09:48:02.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.522+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x7f546c0e0040 2024-05-09T09:48:02.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.522+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547000a4d0 con 0x7f546c0e0040 2024-05-09T09:48:02.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.522+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x557fcf3de320 2024-05-09T09:48:02.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.526+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.526+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x557fcf3e2d10 2024-05-09T09:48:02.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.526+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5468076070 con 0x557fcf3e2d10 2024-05-09T09:48:02.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.526+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x557fcf3e7620 2024-05-09T09:48:02.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.526+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f546c0aaa60 con 0x557fcf3e7620 2024-05-09T09:48:02.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.526+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x557fcf3e2d10 2024-05-09T09:48:02.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.526+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5468076070 con 0x557fcf3e2d10 2024-05-09T09:48:02.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.526+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x7f546c0e0040 2024-05-09T09:48:02.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.526+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547000a4d0 con 0x7f546c0e0040 2024-05-09T09:48:02.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.526+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x557fcf3e7620 2024-05-09T09:48:02.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.526+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f546c0aaa60 con 0x557fcf3e7620 2024-05-09T09:48:02.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.526+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x557fcf3e2d10 2024-05-09T09:48:02.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.526+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5468076070 con 0x557fcf3e2d10 2024-05-09T09:48:02.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.526+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x557fcf3de320 2024-05-09T09:48:02.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.526+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.526+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e1fb0 con 0x7f546c0e0040 2024-05-09T09:48:02.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.526+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547000a4d0 con 0x7f546c0e0040 2024-05-09T09:48:02.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.526+0000 7f54794b0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:48:02.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.526+0000 7f54794b0980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:48:02.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.526+0000 7f54794b0980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:48:02.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.526+0000 7f54794b0980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:48:02.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.526+0000 7f54794b0980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:48:02.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.526+0000 7f54794b0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:48:02.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.526+0000 7f54794b0980 20 rados->read ofs=0 len=0 2024-05-09T09:48:02.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.526+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e5f90 con 0x557fcf3de320 2024-05-09T09:48:02.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54794b0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:02.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54794b0980 20 rados->read ofs=0 len=0 2024-05-09T09:48:02.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e5f90 con 0x557fcf3de320 2024-05-09T09:48:02.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54794b0980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:02.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54794b0980 20 rados->read ofs=0 len=0 2024-05-09T09:48:02.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e5f90 con 0x557fcf3e7620 2024-05-09T09:48:02.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f546c0aaa60 con 0x557fcf3e7620 2024-05-09T09:48:02.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54794b0980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:48:02.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54794b0980 20 zone default found 2024-05-09T09:48:02.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54794b0980 4 Realm: () 2024-05-09T09:48:02.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54794b0980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:48:02.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54794b0980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:48:02.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54794b0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:48:02.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54794b0980 20 zonegroup default 2024-05-09T09:48:02.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54794b0980 20 rados->read ofs=0 len=0 2024-05-09T09:48:02.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3e68d0 con 0x557fcf3e2d10 2024-05-09T09:48:02.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5468076070 con 0x557fcf3e2d10 2024-05-09T09:48:02.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54794b0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:02.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54794b0980 20 rados->read ofs=0 len=0 2024-05-09T09:48:02.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3ebfb0 con 0x557fcf3e7620 2024-05-09T09:48:02.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f546c0aaa60 con 0x557fcf3e7620 2024-05-09T09:48:02.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54794b0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:02.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54794b0980 20 rados->read ofs=0 len=0 2024-05-09T09:48:02.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3ec440 con 0x557fcf3e7620 2024-05-09T09:48:02.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f546c0aaa60 con 0x557fcf3e7620 2024-05-09T09:48:02.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54794b0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:02.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54794b0980 20 started sync module instance, tier type = 2024-05-09T09:48:02.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54794b0980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:48:02.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3eb420 con 0x7f546c0e0040 2024-05-09T09:48:02.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x7f546c0e0040 2024-05-09T09:48:02.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94007426201888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3eb420 con 0x7f546c0e0040 2024-05-09T09:48:02.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.530+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3ecee0 con 0x557fcf3de320 2024-05-09T09:48:02.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.534+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94007426201888] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x7f546c0e0040 2024-05-09T09:48:02.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.534+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.534+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94007426206192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3eb420 con 0x557fcf3de320 2024-05-09T09:48:02.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.534+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3ed8f0 con 0x557fcf3e7620 2024-05-09T09:48:02.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.534+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94007426206192] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.538+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f546c0aaa60 con 0x557fcf3e7620 2024-05-09T09:48:02.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.538+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94007426199408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3eb390 con 0x557fcf3e7620 2024-05-09T09:48:02.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.538+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3ee630 con 0x7f546c0e0040 2024-05-09T09:48:02.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.538+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x7f546c0e0040 2024-05-09T09:48:02.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.538+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94007426212160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3eeed0 con 0x7f546c0e0040 2024-05-09T09:48:02.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.538+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3ef8d0 con 0x557fcf3de320 2024-05-09T09:48:02.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.538+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94007426199408] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f546c0aaa60 con 0x557fcf3e7620 2024-05-09T09:48:02.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.538+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94007426212160] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x7f546c0e0040 2024-05-09T09:48:02.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.538+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.538+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94007426210960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3ee9d0 con 0x557fcf3de320 2024-05-09T09:48:02.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.538+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3f0170 con 0x557fcf3e2d10 2024-05-09T09:48:02.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.542+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5468076070 con 0x557fcf3e2d10 2024-05-09T09:48:02.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.542+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94007426219200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3ee9d0 con 0x557fcf3e2d10 2024-05-09T09:48:02.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.542+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3f0eb0 con 0x557fcf3e2d10 2024-05-09T09:48:02.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.542+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94007426210960] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.542+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94007426219200] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5468076070 con 0x557fcf3e2d10 2024-05-09T09:48:02.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.542+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5468076070 con 0x557fcf3e2d10 2024-05-09T09:48:02.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.542+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94007426221328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3f12a0 con 0x557fcf3e2d10 2024-05-09T09:48:02.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.542+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3f1af0 con 0x557fcf3e2d10 2024-05-09T09:48:02.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.546+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94007426221328] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5468076070 con 0x557fcf3e2d10 2024-05-09T09:48:02.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.546+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5468076070 con 0x557fcf3e2d10 2024-05-09T09:48:02.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.546+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94007426225728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3f1f10 con 0x557fcf3e2d10 2024-05-09T09:48:02.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.546+0000 7f54794b0980 20 add_watcher() i=0 2024-05-09T09:48:02.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.546+0000 7f54794b0980 20 add_watcher() i=1 2024-05-09T09:48:02.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.546+0000 7f54794b0980 20 add_watcher() i=2 2024-05-09T09:48:02.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.546+0000 7f54794b0980 20 add_watcher() i=3 2024-05-09T09:48:02.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.546+0000 7f54794b0980 20 add_watcher() i=4 2024-05-09T09:48:02.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.546+0000 7f54794b0980 20 add_watcher() i=5 2024-05-09T09:48:02.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.546+0000 7f54794b0980 20 add_watcher() i=6 2024-05-09T09:48:02.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.546+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94007426225728] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5468076070 con 0x557fcf3e2d10 2024-05-09T09:48:02.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.550+0000 7f54794b0980 20 add_watcher() i=7 2024-05-09T09:48:02.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.550+0000 7f54794b0980 2 all 8 watchers are set, enabling cache 2024-05-09T09:48:02.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.550+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3f5240 con 0x557fcf3de320 2024-05-09T09:48:02.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.550+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.550+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94007426239600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3f2080 con 0x557fcf3de320 2024-05-09T09:48:02.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.550+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94007426239600] v32'335 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.550+0000 7f53277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:02.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.550+0000 7f54794b0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:48:02.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.550+0000 7f54794b0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:48:02.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.550+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3f4520 con 0x557fcf3de320 2024-05-09T09:48:02.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.554+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'80 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.554+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3fe350 con 0x557fcf3e2d10 2024-05-09T09:48:02.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.554+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'74 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5468076070 con 0x557fcf3e2d10 2024-05-09T09:48:02.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.554+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3fe350 con 0x557fcf3e7620 2024-05-09T09:48:02.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.558+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'73 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f546c0aaa60 con 0x557fcf3e7620 2024-05-09T09:48:02.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.558+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3fe7d0 con 0x557fcf3de320 2024-05-09T09:48:02.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.558+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'336 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.558+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3fed40 con 0x7f546c0e0040 2024-05-09T09:48:02.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.558+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'209 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x7f546c0e0040 2024-05-09T09:48:02.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.558+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3ff2b0 con 0x557fcf3e7620 2024-05-09T09:48:02.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.562+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'140 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f546c0aaa60 con 0x557fcf3e7620 2024-05-09T09:48:02.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.562+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3ff760 con 0x557fcf3de320 2024-05-09T09:48:02.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.562+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'75 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.562+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3fd970 con 0x557fcf3e2d10 2024-05-09T09:48:02.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.566+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'139 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5468076070 con 0x557fcf3e2d10 2024-05-09T09:48:02.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.566+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3fd970 con 0x7f546c0e0040 2024-05-09T09:48:02.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.566+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'73 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x7f546c0e0040 2024-05-09T09:48:02.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.566+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3fd970 con 0x557fcf3e7620 2024-05-09T09:48:02.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.566+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'79 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f546c0aaa60 con 0x557fcf3e7620 2024-05-09T09:48:02.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.566+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3fd970 con 0x7f546c0e0040 2024-05-09T09:48:02.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.570+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'210 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x7f546c0e0040 2024-05-09T09:48:02.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.570+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3fd970 con 0x557fcf3e2d10 2024-05-09T09:48:02.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.570+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'76 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5468076070 con 0x557fcf3e2d10 2024-05-09T09:48:02.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.570+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3fd970 con 0x7f546c0e0040 2024-05-09T09:48:02.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.574+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'73 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x7f546c0e0040 2024-05-09T09:48:02.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.574+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3fd970 con 0x557fcf3e2d10 2024-05-09T09:48:02.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.578+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'145 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5468076070 con 0x557fcf3e2d10 2024-05-09T09:48:02.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.578+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3fd970 con 0x557fcf3de320 2024-05-09T09:48:02.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.578+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'337 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.578+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3fd970 con 0x557fcf3e7620 2024-05-09T09:48:02.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.582+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'203 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f546c0aaa60 con 0x557fcf3e7620 2024-05-09T09:48:02.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.582+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3fda00 con 0x7f546c0e0040 2024-05-09T09:48:02.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.582+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'211 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x7f546c0e0040 2024-05-09T09:48:02.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.582+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3fda00 con 0x557fcf3e7620 2024-05-09T09:48:02.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.586+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'73 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f546c0aaa60 con 0x557fcf3e7620 2024-05-09T09:48:02.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.586+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3fda00 con 0x557fcf3de320 2024-05-09T09:48:02.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.586+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'81 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.586+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3fda00 con 0x557fcf3de320 2024-05-09T09:48:02.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.586+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'338 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.586+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3fda00 con 0x557fcf3e7620 2024-05-09T09:48:02.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.590+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'204 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f546c0aaa60 con 0x557fcf3e7620 2024-05-09T09:48:02.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.590+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3fda00 con 0x7f546c0e0040 2024-05-09T09:48:02.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.594+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'85 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x7f546c0e0040 2024-05-09T09:48:02.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.594+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3fda00 con 0x557fcf3e7620 2024-05-09T09:48:02.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.594+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'75 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f546c0aaa60 con 0x557fcf3e7620 2024-05-09T09:48:02.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.594+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3fda00 con 0x557fcf3e7620 2024-05-09T09:48:02.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.594+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'79 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f546c0aaa60 con 0x557fcf3e7620 2024-05-09T09:48:02.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.594+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3fda00 con 0x557fcf3e7620 2024-05-09T09:48:02.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.598+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'70 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f546c0aaa60 con 0x557fcf3e7620 2024-05-09T09:48:02.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.598+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3fda00 con 0x557fcf3e7620 2024-05-09T09:48:02.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.598+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'141 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f546c0aaa60 con 0x557fcf3e7620 2024-05-09T09:48:02.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.598+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3fda00 con 0x557fcf3e2d10 2024-05-09T09:48:02.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.602+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'75 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5468076070 con 0x557fcf3e2d10 2024-05-09T09:48:02.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.602+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3fda00 con 0x557fcf3e7620 2024-05-09T09:48:02.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.602+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'73 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f546c0aaa60 con 0x557fcf3e7620 2024-05-09T09:48:02.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.602+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3fda00 con 0x557fcf3e2d10 2024-05-09T09:48:02.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.606+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'140 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5468076070 con 0x557fcf3e2d10 2024-05-09T09:48:02.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.606+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3fda00 con 0x557fcf3e7620 2024-05-09T09:48:02.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.606+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'205 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f546c0aaa60 con 0x557fcf3e7620 2024-05-09T09:48:02.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.606+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3fda00 con 0x557fcf3e2d10 2024-05-09T09:48:02.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.610+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'146 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5468076070 con 0x557fcf3e2d10 2024-05-09T09:48:02.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.610+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3fda00 con 0x7f546c0e0040 2024-05-09T09:48:02.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.614+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'79 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x7f546c0e0040 2024-05-09T09:48:02.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.614+0000 7f53267fc640 20 reqs_thread_entry: start 2024-05-09T09:48:02.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.614+0000 7f54794b0980 20 init_complete bucket index max shards: 11 2024-05-09T09:48:02.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.614+0000 7f5297fff640 20 reqs_thread_entry: start 2024-05-09T09:48:02.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.614+0000 7f54794b0980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-09T09:48:02.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.614+0000 7f54794b0980 20 rados->read ofs=0 len=0 2024-05-09T09:48:02.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.614+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fcf41bd60 con 0x557fcf3de320 2024-05-09T09:48:02.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.614+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.614+0000 7f54794b0980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:48:02.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.614+0000 7f54794b0980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-09T09:48:02.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.614+0000 7f54794b0980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:48:02.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.614+0000 7f54794b0980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:48:02.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.614+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fcf41e040 con 0x7f546c0e0040 2024-05-09T09:48:02.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.614+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f547000a4d0 con 0x7f546c0e0040 2024-05-09T09:48:02.616 INFO:teuthology.orchestra.run.smithi157.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-05-09T09:48:02.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.618+0000 7f53277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:02.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.618+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94007426239600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf41bfe0 con 0x557fcf3de320 2024-05-09T09:48:02.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.618+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94007426239600] v32'339 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.618+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94007426201888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3f4c70 con 0x7f546c0e0040 2024-05-09T09:48:02.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.618+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94007426201888] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x7f546c0e0040 2024-05-09T09:48:02.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.618+0000 7f54794b0980 20 remove_watcher() i=0 2024-05-09T09:48:02.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.618+0000 7f54794b0980 2 removed watcher, disabling cache 2024-05-09T09:48:02.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.618+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94007426206192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3eb920 con 0x557fcf3de320 2024-05-09T09:48:02.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.622+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94007426206192] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.622+0000 7f54794b0980 20 remove_watcher() i=1 2024-05-09T09:48:02.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.622+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94007426199408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3eb920 con 0x557fcf3e7620 2024-05-09T09:48:02.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.622+0000 7f54767ca640 1 -- 172.21.15.157:0/1940645510 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94007426199408] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f546c0aaa60 con 0x557fcf3e7620 2024-05-09T09:48:02.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.622+0000 7f54794b0980 20 remove_watcher() i=2 2024-05-09T09:48:02.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.622+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94007426212160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3eaf70 con 0x7f546c0e0040 2024-05-09T09:48:02.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.626+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94007426212160] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x7f546c0e0040 2024-05-09T09:48:02.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.626+0000 7f54794b0980 20 remove_watcher() i=3 2024-05-09T09:48:02.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.626+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94007426210960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3eaf70 con 0x557fcf3de320 2024-05-09T09:48:02.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.626+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94007426210960] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f547000a4d0 con 0x557fcf3de320 2024-05-09T09:48:02.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.626+0000 7f54794b0980 20 remove_watcher() i=4 2024-05-09T09:48:02.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.626+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94007426219200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3edc90 con 0x557fcf3e2d10 2024-05-09T09:48:02.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.630+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94007426219200] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5468076070 con 0x557fcf3e2d10 2024-05-09T09:48:02.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.630+0000 7f54794b0980 20 remove_watcher() i=5 2024-05-09T09:48:02.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.630+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94007426221328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3eaf70 con 0x557fcf3e2d10 2024-05-09T09:48:02.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.630+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94007426221328] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5468076070 con 0x557fcf3e2d10 2024-05-09T09:48:02.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.630+0000 7f54794b0980 20 remove_watcher() i=6 2024-05-09T09:48:02.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.630+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94007426225728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fcf3f0510 con 0x557fcf3e2d10 2024-05-09T09:48:02.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f5476fcb640 1 -- 172.21.15.157:0/1940645510 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94007426225728] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5468076070 con 0x557fcf3e2d10 2024-05-09T09:48:02.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 20 remove_watcher() i=7 2024-05-09T09:48:02.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557fcf3e2d10 msgr2=0x557fcf3e5100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 --2- 172.21.15.157:0/1940645510 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557fcf3e2d10 0x557fcf3e5100 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557fcf3de320 msgr2=0x557fcf3e07e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 --2- 172.21.15.157:0/1940645510 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557fcf3de320 0x557fcf3e07e0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f546c0e0040 msgr2=0x7f546c0e0930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 --2- 172.21.15.157:0/1940645510 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f546c0e0040 0x7f546c0e0930 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557fcf3e7620 msgr2=0x557fcf3e9a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 --2- 172.21.15.157:0/1940645510 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557fcf3e7620 0x557fcf3e9a50 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5340034bb0 msgr2=0x7f5340037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 --2- 172.21.15.157:0/1940645510 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5340034bb0 0x7f5340037070 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f546c0aafd0 tx=0x7f546c0c1040 comp rx=0 tx=0).stop 2024-05-09T09:48:02.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf3ca4c0 msgr2=0x557fcf3d1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 --2- 172.21.15.157:0/1940645510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf3ca4c0 0x557fcf3d1840 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f54680482d0 tx=0x7f546803ef20 comp rx=0 tx=0).stop 2024-05-09T09:48:02.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 reap_dead start 2024-05-09T09:48:02.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54777cc640 1 -- 172.21.15.157:0/1940645510 reap_dead start 2024-05-09T09:48:02.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 shutdown_connections 2024-05-09T09:48:02.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 >> 172.21.15.157:0/1940645510 conn(0x557fcf3c68d0 msgr2=0x557fcf3c3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:02.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 shutdown_connections 2024-05-09T09:48:02.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 -- 172.21.15.157:0/1940645510 wait complete. 2024-05-09T09:48:02.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 -- 172.21.15.157:0/3123628937 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5350034bb0 msgr2=0x7f5350037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 --2- 172.21.15.157:0/3123628937 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5350034bb0 0x7f5350037070 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f546c01b380 tx=0x7f546c005ad0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 -- 172.21.15.157:0/3123628937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf3bd740 msgr2=0x557fcf3bdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 --2- 172.21.15.157:0/3123628937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf3bd740 0x557fcf3bdb60 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f546801cfd0 tx=0x7f5468028810 comp rx=0 tx=0).stop 2024-05-09T09:48:02.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 -- 172.21.15.157:0/3123628937 shutdown_connections 2024-05-09T09:48:02.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 --2- 172.21.15.157:0/3123628937 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5350034bb0 0x7f5350037070 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 --2- 172.21.15.157:0/3123628937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf3bd740 0x557fcf3bdb60 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 -- 172.21.15.157:0/3123628937 >> 172.21.15.157:0/3123628937 conn(0x557fcf3b2510 msgr2=0x557fcf3b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:02.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 -- 172.21.15.157:0/3123628937 shutdown_connections 2024-05-09T09:48:02.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 -- 172.21.15.157:0/3123628937 wait complete. 2024-05-09T09:48:02.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 -- 172.21.15.157:0/251901659 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557fcf390e10 msgr2=0x557fcf393200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 --2- 172.21.15.157:0/251901659 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557fcf390e10 0x557fcf393200 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 -- 172.21.15.157:0/251901659 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557fcf38c090 msgr2=0x557fcf38e4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 --2- 172.21.15.157:0/251901659 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557fcf38c090 0x557fcf38e4a0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 -- 172.21.15.157:0/251901659 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557fcf394d10 msgr2=0x557fcf397100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 --2- 172.21.15.157:0/251901659 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557fcf394d10 0x557fcf397100 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 -- 172.21.15.157:0/251901659 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f535c034c00 msgr2=0x7f535c0370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 --2- 172.21.15.157:0/251901659 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f535c034c00 0x7f535c0370c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f546c0ae000 tx=0x7f546c0a6000 comp rx=0 tx=0).stop 2024-05-09T09:48:02.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 -- 172.21.15.157:0/251901659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf296d10 msgr2=0x557fcf387110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:02.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 --2- 172.21.15.157:0/251901659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557fcf296d10 0x557fcf387110 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5468004000 tx=0x7f5468000bd0 comp rx=0 tx=0).stop 2024-05-09T09:48:02.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54777cc640 1 -- 172.21.15.157:0/251901659 reap_dead start 2024-05-09T09:48:02.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 -- 172.21.15.157:0/251901659 shutdown_connections 2024-05-09T09:48:02.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 -- 172.21.15.157:0/251901659 >> 172.21.15.157:0/251901659 conn(0x557fcf28d0d0 msgr2=0x557fcf291a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:02.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 -- 172.21.15.157:0/251901659 shutdown_connections 2024-05-09T09:48:02.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:02.634+0000 7f54794b0980 1 -- 172.21.15.157:0/251901659 wait complete. 2024-05-09T09:48:02.648 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-05-09T09:48:02.670 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-09T09:48:02.677 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-05-09T09:48:37.678 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-05-09T09:48:37.679 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-05-09T09:48:37.679 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-05-09T09:48:37.718 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:48:37.718 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:48:37.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.716+0000 7f2de4eb0980 1 Processor -- start 2024-05-09T09:48:37.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.716+0000 7f2de4eb0980 1 -- start start 2024-05-09T09:48:37.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.716+0000 7f2de4eb0980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x558088415b30 0x558088415f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:37.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.716+0000 7f2de4eb0980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5580882c9440 con 0x558088416450 2024-05-09T09:48:37.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.716+0000 7f2de4eb0980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5580882b45f0 con 0x558088415b30 2024-05-09T09:48:37.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.716+0000 7f2de29cb640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x558088415b30 0x558088415f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:37.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.716+0000 7f2de29cb640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x558088415b30 0x558088415f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59720/0 (socket says 172.21.15.157:59720) 2024-05-09T09:48:37.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.716+0000 7f2de29cb640 1 -- 172.21.15.157:0/3469092051 learned_addr learned my addr 172.21.15.157:0/3469092051 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:37.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.716+0000 7f2de29cb640 1 -- 172.21.15.157:0/3469092051 >> v1:172.21.15.110:6789/0 conn(0x558088416450 legacy=0x558088416e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:37.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.716+0000 7f2de29cb640 1 -- 172.21.15.157:0/3469092051 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580882bf990 con 0x558088415b30 2024-05-09T09:48:37.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.720+0000 7f2de29cb640 1 --2- 172.21.15.157:0/3469092051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558088415b30 0x558088415f10 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400a5c0 tx=0x7f2dd401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a1f5b3498bcd8c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:37.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.720+0000 7f2de19c9640 1 -- 172.21.15.157:0/3469092051 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dd40a6070 con 0x558088415b30 2024-05-09T09:48:37.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.720+0000 7f2de19c9640 1 -- 172.21.15.157:0/3469092051 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd40af070 con 0x558088415b30 2024-05-09T09:48:37.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.720+0000 7f2de19c9640 1 -- 172.21.15.157:0/3469092051 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dd40aa5c0 con 0x558088415b30 2024-05-09T09:48:37.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.720+0000 7f2de4eb0980 1 -- 172.21.15.157:0/3469092051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558088415b30 msgr2=0x558088415f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:37.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.720+0000 7f2de4eb0980 1 --2- 172.21.15.157:0/3469092051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558088415b30 0x558088415f10 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400a5c0 tx=0x7f2dd401b340 comp rx=0 tx=0).stop 2024-05-09T09:48:37.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.720+0000 7f2de4eb0980 1 -- 172.21.15.157:0/3469092051 shutdown_connections 2024-05-09T09:48:37.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.720+0000 7f2de4eb0980 1 --2- 172.21.15.157:0/3469092051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558088415b30 0x558088415f10 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:37.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.720+0000 7f2de4eb0980 1 -- 172.21.15.157:0/3469092051 >> 172.21.15.157:0/3469092051 conn(0x558088389250 msgr2=0x558088389660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:37.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.720+0000 7f2de4eb0980 1 -- 172.21.15.157:0/3469092051 shutdown_connections 2024-05-09T09:48:37.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.720+0000 7f2de4eb0980 1 -- 172.21.15.157:0/3469092051 wait complete. 2024-05-09T09:48:37.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.736+0000 7f2de4eb0980 1 Processor -- start 2024-05-09T09:48:37.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.736+0000 7f2de4eb0980 1 -- start start 2024-05-09T09:48:37.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.736+0000 7f2de4eb0980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558088415b30 0x5580885014a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:37.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.736+0000 7f2de4eb0980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558088316fe0 con 0x558088415b30 2024-05-09T09:48:37.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.736+0000 7f2de29cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558088415b30 0x5580885014a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:37.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.736+0000 7f2de29cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558088415b30 0x5580885014a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59732/0 (socket says 172.21.15.157:59732) 2024-05-09T09:48:37.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.736+0000 7f2de29cb640 1 -- 172.21.15.157:0/588950794 learned_addr learned my addr 172.21.15.157:0/588950794 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:37.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.736+0000 7f2de29cb640 1 -- 172.21.15.157:0/588950794 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55808829bae0 con 0x558088415b30 2024-05-09T09:48:37.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.740+0000 7f2de29cb640 1 --2- 172.21.15.157:0/588950794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558088415b30 0x5580885014a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40ac040 tx=0x7f2dd4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df2412d776152e2b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:37.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.740+0000 7f2cd0e09640 1 -- 172.21.15.157:0/588950794 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dd40aa970 con 0x558088415b30 2024-05-09T09:48:37.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.740+0000 7f2cd0e09640 1 -- 172.21.15.157:0/588950794 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd40aab10 con 0x558088415b30 2024-05-09T09:48:37.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.740+0000 7f2cd0e09640 1 -- 172.21.15.157:0/588950794 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dd40aae30 con 0x558088415b30 2024-05-09T09:48:37.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.740+0000 7f2de4eb0980 1 -- 172.21.15.157:0/588950794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558088415b30 msgr2=0x5580885014a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:37.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.740+0000 7f2de4eb0980 1 --2- 172.21.15.157:0/588950794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558088415b30 0x5580885014a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40ac040 tx=0x7f2dd4003030 comp rx=0 tx=0).stop 2024-05-09T09:48:37.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.740+0000 7f2de4eb0980 1 -- 172.21.15.157:0/588950794 shutdown_connections 2024-05-09T09:48:37.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.740+0000 7f2de4eb0980 1 --2- 172.21.15.157:0/588950794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558088415b30 0x5580885014a0 secure :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40ac040 tx=0x7f2dd4003030 comp rx=0 tx=0).stop 2024-05-09T09:48:37.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.740+0000 7f2de4eb0980 1 -- 172.21.15.157:0/588950794 >> 172.21.15.157:0/588950794 conn(0x558088389250 msgr2=0x5580884fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:37.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.740+0000 7f2de4eb0980 1 -- 172.21.15.157:0/588950794 shutdown_connections 2024-05-09T09:48:37.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.740+0000 7f2de4eb0980 1 -- 172.21.15.157:0/588950794 wait complete. 2024-05-09T09:48:37.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.740+0000 7f2de4eb0980 1 Processor -- start 2024-05-09T09:48:37.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.740+0000 7f2de4eb0980 1 -- start start 2024-05-09T09:48:37.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.740+0000 7f2de4eb0980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558088416450 0x558088508760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:37.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.740+0000 7f2de4eb0980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55808841fb70 con 0x558088416450 2024-05-09T09:48:37.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.740+0000 7f2de29cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558088416450 0x558088508760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:37.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.740+0000 7f2de29cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558088416450 0x558088508760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59738/0 (socket says 172.21.15.157:59738) 2024-05-09T09:48:37.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.740+0000 7f2de29cb640 1 -- 172.21.15.157:0/3510108107 learned_addr learned my addr 172.21.15.157:0/3510108107 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:37.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.740+0000 7f2de29cb640 1 -- 172.21.15.157:0/3510108107 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558088508ca0 con 0x558088416450 2024-05-09T09:48:37.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.740+0000 7f2de29cb640 1 --2- 172.21.15.157:0/3510108107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558088416450 0x558088508760 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4003070 tx=0x7f2dd40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:37.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.740+0000 7f2ccf606640 1 -- 172.21.15.157:0/3510108107 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dd40c6650 con 0x558088416450 2024-05-09T09:48:37.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.740+0000 7f2de4eb0980 1 -- 172.21.15.157:0/3510108107 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558088508f30 con 0x558088416450 2024-05-09T09:48:37.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.740+0000 7f2ccf606640 1 -- 172.21.15.157:0/3510108107 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd40c67f0 con 0x558088416450 2024-05-09T09:48:37.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.740+0000 7f2ccf606640 1 -- 172.21.15.157:0/3510108107 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dd40c6ad0 con 0x558088416450 2024-05-09T09:48:37.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.740+0000 7f2de4eb0980 1 -- 172.21.15.157:0/3510108107 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55808850bb70 con 0x558088416450 2024-05-09T09:48:37.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.744+0000 7f2ccf606640 1 -- 172.21.15.157:0/3510108107 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f2dd40d0400 con 0x558088416450 2024-05-09T09:48:37.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.744+0000 7f2ccf606640 1 --2- 172.21.15.157:0/3510108107 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2cc8034bb0 0x7f2cc8037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:37.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.744+0000 7f2ccf606640 1 -- 172.21.15.157:0/3510108107 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f2dd40e6100 con 0x558088416450 2024-05-09T09:48:37.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.744+0000 7f2de21ca640 1 --2- 172.21.15.157:0/3510108107 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2cc8034bb0 0x7f2cc8037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:37.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.744+0000 7f2de4eb0980 1 --2- 172.21.15.157:0/3510108107 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55808850d640 0x55808850fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:37.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.744+0000 7f2de4eb0980 1 -- 172.21.15.157:0/3510108107 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5580885100e0 con 0x55808850d640 2024-05-09T09:48:37.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.744+0000 7f2de31cc640 1 --2- 172.21.15.157:0/3510108107 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55808850d640 0x55808850fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:37.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.744+0000 7f2de21ca640 1 --2- 172.21.15.157:0/3510108107 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2cc8034bb0 0x7f2cc8037070 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc0012f0 tx=0x7f2dcc0066b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:37.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.744+0000 7f2de31cc640 1 --2- 172.21.15.157:0/3510108107 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55808850d640 0x55808850fa70 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:37.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.744+0000 7f2de31cc640 1 -- 172.21.15.157:0/3510108107 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ddc0083f0 con 0x55808850d640 2024-05-09T09:48:37.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.744+0000 7f2de4eb0980 1 -- 172.21.15.157:0/3510108107 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5580885109a0 con 0x55808850d640 2024-05-09T09:48:37.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.744+0000 7f2de31cc640 1 -- 172.21.15.157:0/3510108107 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2ddc0083f0 con 0x55808850d640 2024-05-09T09:48:37.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.744+0000 7f2de4eb0980 1 --2- 172.21.15.157:0/3510108107 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5580885122b0 0x558088514770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:37.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.744+0000 7f2de4eb0980 1 -- 172.21.15.157:0/3510108107 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558088514f00 con 0x5580885122b0 2024-05-09T09:48:37.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.744+0000 7f2de29cb640 1 --2- 172.21.15.157:0/3510108107 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5580885122b0 0x558088514770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:37.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.744+0000 7f2de29cb640 1 --2- 172.21.15.157:0/3510108107 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5580885122b0 0x558088514770 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:37.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.748+0000 7f2de29cb640 1 -- 172.21.15.157:0/3510108107 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2dd40cd020 con 0x5580885122b0 2024-05-09T09:48:37.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.748+0000 7f2de4eb0980 1 -- 172.21.15.157:0/3510108107 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5580885111f0 con 0x55808850d640 2024-05-09T09:48:37.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.748+0000 7f2de31cc640 1 -- 172.21.15.157:0/3510108107 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2ddc0083f0 con 0x55808850d640 2024-05-09T09:48:37.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.748+0000 7f2de4eb0980 1 --2- 172.21.15.157:0/3510108107 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558088516360 0x558088518750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:37.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.748+0000 7f2de4eb0980 1 -- 172.21.15.157:0/3510108107 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558088518e40 con 0x558088516360 2024-05-09T09:48:37.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.748+0000 7f2de21ca640 1 --2- 172.21.15.157:0/3510108107 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558088516360 0x558088518750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:37.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.748+0000 7f2de21ca640 1 --2- 172.21.15.157:0/3510108107 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558088516360 0x558088518750 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:37.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.748+0000 7f2de21ca640 1 -- 172.21.15.157:0/3510108107 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2dcc00f030 con 0x558088516360 2024-05-09T09:48:37.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.752+0000 7f2de4eb0980 1 Processor -- start 2024-05-09T09:48:37.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.752+0000 7f2de4eb0980 1 -- start start 2024-05-09T09:48:37.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.752+0000 7f2de4eb0980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55808853ed20 0x55808853f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:37.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.752+0000 7f2de4eb0980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55808831b020 con 0x55808853ed20 2024-05-09T09:48:37.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.752+0000 7f2de29cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55808853ed20 0x55808853f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:37.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.752+0000 7f2de29cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55808853ed20 0x55808853f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59744/0 (socket says 172.21.15.157:59744) 2024-05-09T09:48:37.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.752+0000 7f2de29cb640 1 -- 172.21.15.157:0/2561819836 learned_addr learned my addr 172.21.15.157:0/2561819836 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:37.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.752+0000 7f2de29cb640 1 -- 172.21.15.157:0/2561819836 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55808853f680 con 0x55808853ed20 2024-05-09T09:48:37.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.752+0000 7f2de29cb640 1 --2- 172.21.15.157:0/2561819836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55808853ed20 0x55808853f140 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400a400 tx=0x7f2dd40d09e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:37.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.752+0000 7f2cc77fe640 1 -- 172.21.15.157:0/2561819836 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dd40c53a0 con 0x55808853ed20 2024-05-09T09:48:37.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.752+0000 7f2cc77fe640 1 -- 172.21.15.157:0/2561819836 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd40c5540 con 0x55808853ed20 2024-05-09T09:48:37.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.752+0000 7f2de4eb0980 1 -- 172.21.15.157:0/2561819836 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558088540110 con 0x55808853ed20 2024-05-09T09:48:37.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.752+0000 7f2cc77fe640 1 -- 172.21.15.157:0/2561819836 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dd40bcbc0 con 0x55808853ed20 2024-05-09T09:48:37.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.752+0000 7f2de4eb0980 1 -- 172.21.15.157:0/2561819836 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580885405f0 con 0x55808853ed20 2024-05-09T09:48:37.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.756+0000 7f2cc77fe640 1 -- 172.21.15.157:0/2561819836 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f2dd4000ee0 con 0x55808853ed20 2024-05-09T09:48:37.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.756+0000 7f2cc77fe640 1 --2- 172.21.15.157:0/2561819836 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2cbc034bb0 0x7f2cbc037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:37.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.756+0000 7f2cc77fe640 1 -- 172.21.15.157:0/2561819836 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f2dd40efd10 con 0x55808853ed20 2024-05-09T09:48:37.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.756+0000 7f2de21ca640 1 --2- 172.21.15.157:0/2561819836 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2cbc034bb0 0x7f2cbc037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:37.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.756+0000 7f2de4eb0980 1 Processor -- start 2024-05-09T09:48:37.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.756+0000 7f2de4eb0980 1 -- start start 2024-05-09T09:48:37.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.756+0000 7f2de21ca640 1 --2- 172.21.15.157:0/2561819836 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2cbc034bb0 0x7f2cbc037070 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55808850cdd0 tx=0x7f2dcc011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:37.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.756+0000 7f2de4eb0980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55808854bb10 0x55808854bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:37.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.756+0000 7f2de4eb0980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558088501b30 con 0x55808854bb10 2024-05-09T09:48:37.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.756+0000 7f2de29cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55808854bb10 0x55808854bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:37.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.756+0000 7f2de29cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55808854bb10 0x55808854bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59746/0 (socket says 172.21.15.157:59746) 2024-05-09T09:48:37.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.756+0000 7f2de29cb640 1 -- 172.21.15.157:0/113333994 learned_addr learned my addr 172.21.15.157:0/113333994 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:37.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.756+0000 7f2de29cb640 1 -- 172.21.15.157:0/113333994 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55808854c4c0 con 0x55808854bb10 2024-05-09T09:48:37.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.756+0000 7f2de29cb640 1 --2- 172.21.15.157:0/113333994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55808854bb10 0x55808854bef0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40c6d10 tx=0x7f2dd40b3a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b82e7b4509beee server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:37.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.756+0000 7f2cc57fa640 1 -- 172.21.15.157:0/113333994 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dd40f3070 con 0x55808854bb10 2024-05-09T09:48:37.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.756+0000 7f2cc57fa640 1 -- 172.21.15.157:0/113333994 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd40b9eb0 con 0x55808854bb10 2024-05-09T09:48:37.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.756+0000 7f2cc57fa640 1 -- 172.21.15.157:0/113333994 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dd40b50b0 con 0x55808854bb10 2024-05-09T09:48:37.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.756+0000 7f2de4eb0980 1 -- 172.21.15.157:0/113333994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55808854bb10 msgr2=0x55808854bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:37.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.756+0000 7f2de4eb0980 1 --2- 172.21.15.157:0/113333994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55808854bb10 0x55808854bef0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40c6d10 tx=0x7f2dd40b3a50 comp rx=0 tx=0).stop 2024-05-09T09:48:37.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.756+0000 7f2de4eb0980 1 -- 172.21.15.157:0/113333994 shutdown_connections 2024-05-09T09:48:37.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.756+0000 7f2de4eb0980 1 --2- 172.21.15.157:0/113333994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55808854bb10 0x55808854bef0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:37.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.756+0000 7f2de4eb0980 1 -- 172.21.15.157:0/113333994 >> 172.21.15.157:0/113333994 conn(0x558088547e90 msgr2=0x558088545ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:37.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.756+0000 7f2de4eb0980 1 -- 172.21.15.157:0/113333994 shutdown_connections 2024-05-09T09:48:37.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.756+0000 7f2de4eb0980 1 -- 172.21.15.157:0/113333994 wait complete. 2024-05-09T09:48:37.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.760+0000 7f2de4eb0980 1 Processor -- start 2024-05-09T09:48:37.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.760+0000 7f2de4eb0980 1 -- start start 2024-05-09T09:48:37.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.760+0000 7f2de4eb0980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55808854bb10 0x558088552d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:37.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.760+0000 7f2de4eb0980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55808854ca50 con 0x55808854bb10 2024-05-09T09:48:37.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.760+0000 7f2de29cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55808854bb10 0x558088552d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:37.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.760+0000 7f2de29cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55808854bb10 0x558088552d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59756/0 (socket says 172.21.15.157:59756) 2024-05-09T09:48:37.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.760+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 learned_addr learned my addr 172.21.15.157:0/1065080475 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:37.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.760+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558088553270 con 0x55808854bb10 2024-05-09T09:48:37.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.760+0000 7f2de29cb640 1 --2- 172.21.15.157:0/1065080475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55808854bb10 0x558088552d30 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40af020 tx=0x7f2dd40b0ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:37.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.760+0000 7f2cb37fe640 1 -- 172.21.15.157:0/1065080475 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dd40de6e0 con 0x55808854bb10 2024-05-09T09:48:37.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.760+0000 7f2cb37fe640 1 -- 172.21.15.157:0/1065080475 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd40b50b0 con 0x55808854bb10 2024-05-09T09:48:37.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.760+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558088553270 con 0x55808854bb10 2024-05-09T09:48:37.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.760+0000 7f2cb37fe640 1 -- 172.21.15.157:0/1065080475 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dd40bce20 con 0x55808854bb10 2024-05-09T09:48:37.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.760+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558088553270 con 0x55808854bb10 2024-05-09T09:48:37.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.760+0000 7f2cb37fe640 1 -- 172.21.15.157:0/1065080475 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f2dd4113030 con 0x55808854bb10 2024-05-09T09:48:37.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.760+0000 7f2de4eb0980 20 rados->read ofs=0 len=0 2024-05-09T09:48:37.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.760+0000 7f2cb37fe640 1 --2- 172.21.15.157:0/1065080475 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2cac034b60 0x7f2cac037020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:37.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.760+0000 7f2cb37fe640 1 -- 172.21.15.157:0/1065080475 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f2dd4111070 con 0x55808854bb10 2024-05-09T09:48:37.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.760+0000 7f2de21ca640 1 --2- 172.21.15.157:0/1065080475 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2cac034b60 0x7f2cac037020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:37.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.760+0000 7f2de4eb0980 1 --2- 172.21.15.157:0/1065080475 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55808855f730 0x558088561bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:37.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.760+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558088562340 con 0x55808855f730 2024-05-09T09:48:37.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.760+0000 7f2de31cc640 1 --2- 172.21.15.157:0/1065080475 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55808855f730 0x558088561bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:37.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.760+0000 7f2de21ca640 1 --2- 172.21.15.157:0/1065080475 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2cac034b60 0x7f2cac037020 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x558088519240 tx=0x7f2dcc012000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:37.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.764+0000 7f2de31cc640 1 --2- 172.21.15.157:0/1065080475 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55808855f730 0x558088561bf0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:37.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.764+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ddc0083f0 con 0x55808855f730 2024-05-09T09:48:37.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.764+0000 7f2de4eb0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:37.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.764+0000 7f2de4eb0980 20 realm 2024-05-09T09:48:37.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.764+0000 7f2de4eb0980 20 rados->read ofs=0 len=0 2024-05-09T09:48:37.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.764+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558088562750 con 0x55808855f730 2024-05-09T09:48:37.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.764+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ddc0083f0 con 0x55808855f730 2024-05-09T09:48:37.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.764+0000 7f2de4eb0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:37.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.764+0000 7f2de4eb0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:48:37.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.764+0000 7f2de4eb0980 20 rados->read ofs=0 len=0 2024-05-09T09:48:37.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.764+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558088562ff0 con 0x55808855f730 2024-05-09T09:48:37.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.764+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ddc0083f0 con 0x55808855f730 2024-05-09T09:48:37.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.764+0000 7f2de4eb0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:37.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.764+0000 7f2de4eb0980 20 rados->read ofs=0 len=0 2024-05-09T09:48:37.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.764+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x55808855f730 2024-05-09T09:48:37.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.764+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2ddc0083f0 con 0x55808855f730 2024-05-09T09:48:37.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.764+0000 7f2de4eb0980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:37.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.764+0000 7f2de4eb0980 20 rados->read ofs=0 len=0 2024-05-09T09:48:37.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.764+0000 7f2de4eb0980 1 --2- 172.21.15.157:0/1065080475 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5580885640f0 0x5580885664e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:37.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.764+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558088566a20 con 0x5580885640f0 2024-05-09T09:48:37.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.764+0000 7f2de29cb640 1 --2- 172.21.15.157:0/1065080475 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5580885640f0 0x5580885664e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:37.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.764+0000 7f2de29cb640 1 --2- 172.21.15.157:0/1065080475 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5580885640f0 0x5580885664e0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:37.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.764+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.764+0000 7f2de4eb0980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:48:37.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.764+0000 7f2de4eb0980 20 searching for the correct realm 2024-05-09T09:48:37.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.764+0000 7f2de4eb0980 1 --2- 172.21.15.157:0/1065080475 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558088568990 0x55808856ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:37.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.764+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55808856b520 con 0x558088568990 2024-05-09T09:48:37.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.764+0000 7f2de21ca640 1 --2- 172.21.15.157:0/1065080475 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558088568990 0x55808856ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:37.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.764+0000 7f2de21ca640 1 --2- 172.21.15.157:0/1065080475 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558088568990 0x55808856ae50 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:37.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.768+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dcc021040 con 0x558088568990 2024-05-09T09:48:37.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.768+0000 7f2de21ca640 1 --2- 172.21.15.157:0/1065080475 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2dcc013040 0x7f2dcc0243c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:37.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.768+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55808856b520 con 0x7f2dcc013040 2024-05-09T09:48:37.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.768+0000 7f2de31cc640 1 --2- 172.21.15.157:0/1065080475 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2dcc013040 0x7f2dcc0243c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:37.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.768+0000 7f2de31cc640 1 --2- 172.21.15.157:0/1065080475 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2dcc013040 0x7f2dcc0243c0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:37.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.768+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ddc0083f0 con 0x7f2dcc013040 2024-05-09T09:48:37.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.768+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x5580885640f0 2024-05-09T09:48:37.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.768+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.768+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x55808855f730 2024-05-09T09:48:37.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.768+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ddc0083f0 con 0x55808855f730 2024-05-09T09:48:37.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.768+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x55808855f730 2024-05-09T09:48:37.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.768+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ddc026040 con 0x55808855f730 2024-05-09T09:48:37.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.768+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x5580885640f0 2024-05-09T09:48:37.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.768+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.768+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x5580885640f0 2024-05-09T09:48:37.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.768+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.768+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x7f2dcc013040 2024-05-09T09:48:37.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.768+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ddc026040 con 0x7f2dcc013040 2024-05-09T09:48:37.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.768+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x558088568990 2024-05-09T09:48:37.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.772+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dcc021040 con 0x558088568990 2024-05-09T09:48:37.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.772+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x55808855f730 2024-05-09T09:48:37.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.772+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ddc026040 con 0x55808855f730 2024-05-09T09:48:37.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.772+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x5580885640f0 2024-05-09T09:48:37.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.772+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.772+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x55808855f730 2024-05-09T09:48:37.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.772+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ddc026040 con 0x55808855f730 2024-05-09T09:48:37.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.772+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x7f2dcc013040 2024-05-09T09:48:37.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.772+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2ddc026040 con 0x7f2dcc013040 2024-05-09T09:48:37.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.772+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x558088568990 2024-05-09T09:48:37.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.772+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.772+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x558088568990 2024-05-09T09:48:37.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.772+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.772+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x5580885640f0 2024-05-09T09:48:37.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.772+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.772+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x558088568990 2024-05-09T09:48:37.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.772+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.772+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x558088568990 2024-05-09T09:48:37.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.772+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.772+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x55808855f730 2024-05-09T09:48:37.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.776+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ddc026040 con 0x55808855f730 2024-05-09T09:48:37.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.776+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x55808855f730 2024-05-09T09:48:37.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.776+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2ddc026040 con 0x55808855f730 2024-05-09T09:48:37.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.776+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x5580885640f0 2024-05-09T09:48:37.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.776+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.776+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x558088568990 2024-05-09T09:48:37.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.776+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.776+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x7f2dcc013040 2024-05-09T09:48:37.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.776+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ddc026040 con 0x7f2dcc013040 2024-05-09T09:48:37.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.776+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x55808855f730 2024-05-09T09:48:37.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.776+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ddc026040 con 0x55808855f730 2024-05-09T09:48:37.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.776+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x5580885640f0 2024-05-09T09:48:37.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.776+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.776+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x558088568990 2024-05-09T09:48:37.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.776+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.776+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x5580885640f0 2024-05-09T09:48:37.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x7f2dcc013040 2024-05-09T09:48:37.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ddc026040 con 0x7f2dcc013040 2024-05-09T09:48:37.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x558088568990 2024-05-09T09:48:37.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x5580885640f0 2024-05-09T09:48:37.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x55808855f730 2024-05-09T09:48:37.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2ddc026040 con 0x55808855f730 2024-05-09T09:48:37.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558088563390 con 0x7f2dcc013040 2024-05-09T09:48:37.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ddc026040 con 0x7f2dcc013040 2024-05-09T09:48:37.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de4eb0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:48:37.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de4eb0980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:48:37.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de4eb0980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:48:37.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de4eb0980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:48:37.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de4eb0980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:48:37.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de4eb0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:48:37.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de4eb0980 20 rados->read ofs=0 len=0 2024-05-09T09:48:37.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558088567270 con 0x55808855f730 2024-05-09T09:48:37.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ddc026040 con 0x55808855f730 2024-05-09T09:48:37.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de4eb0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:37.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de4eb0980 20 rados->read ofs=0 len=0 2024-05-09T09:48:37.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558088567270 con 0x55808855f730 2024-05-09T09:48:37.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2ddc026040 con 0x55808855f730 2024-05-09T09:48:37.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de4eb0980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:37.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de4eb0980 20 rados->read ofs=0 len=0 2024-05-09T09:48:37.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558088567270 con 0x558088568990 2024-05-09T09:48:37.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de4eb0980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:48:37.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de4eb0980 20 zone default found 2024-05-09T09:48:37.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de4eb0980 4 Realm: () 2024-05-09T09:48:37.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de4eb0980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:48:37.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de4eb0980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:48:37.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de4eb0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:48:37.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de4eb0980 20 zonegroup default 2024-05-09T09:48:37.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de4eb0980 20 rados->read ofs=0 len=0 2024-05-09T09:48:37.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.780+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558088567b10 con 0x5580885640f0 2024-05-09T09:48:37.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.784+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.784+0000 7f2de4eb0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:37.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.784+0000 7f2de4eb0980 20 rados->read ofs=0 len=0 2024-05-09T09:48:37.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.784+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808856d380 con 0x558088568990 2024-05-09T09:48:37.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.784+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.784+0000 7f2de4eb0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:37.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.784+0000 7f2de4eb0980 20 rados->read ofs=0 len=0 2024-05-09T09:48:37.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.784+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808856d720 con 0x558088568990 2024-05-09T09:48:37.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.784+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.784+0000 7f2de4eb0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:37.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.784+0000 7f2de4eb0980 20 started sync module instance, tier type = 2024-05-09T09:48:37.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.784+0000 7f2de4eb0980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:48:37.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.784+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55808856c820 con 0x7f2dcc013040 2024-05-09T09:48:37.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.784+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ddc026040 con 0x7f2dcc013040 2024-05-09T09:48:37.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.784+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94010531564864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55808856c820 con 0x7f2dcc013040 2024-05-09T09:48:37.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.784+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55808856e170 con 0x55808855f730 2024-05-09T09:48:37.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.788+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94010531564864] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x7f2dcc013040 2024-05-09T09:48:37.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.788+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x55808855f730 2024-05-09T09:48:37.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.788+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94010531568768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55808856c820 con 0x55808855f730 2024-05-09T09:48:37.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.788+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55808856eb80 con 0x558088568990 2024-05-09T09:48:37.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.788+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94010531568768] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x55808855f730 2024-05-09T09:48:37.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.788+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.788+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94010531562352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55808856c790 con 0x558088568990 2024-05-09T09:48:37.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.788+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55808856f8c0 con 0x7f2dcc013040 2024-05-09T09:48:37.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.792+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x7f2dcc013040 2024-05-09T09:48:37.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.792+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94010531574736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088570190 con 0x7f2dcc013040 2024-05-09T09:48:37.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.792+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088570b50 con 0x55808855f730 2024-05-09T09:48:37.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.792+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94010531562352] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.795 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.792+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94010531574736] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x7f2dcc013040 2024-05-09T09:48:37.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.792+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x55808855f730 2024-05-09T09:48:37.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.792+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94010531579552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088570100 con 0x55808855f730 2024-05-09T09:48:37.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.792+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088570ac0 con 0x5580885640f0 2024-05-09T09:48:37.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.796+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94010531579552] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x55808855f730 2024-05-09T09:48:37.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.796+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.796+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94010531577184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580885713f0 con 0x5580885640f0 2024-05-09T09:48:37.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.796+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088571c80 con 0x5580885640f0 2024-05-09T09:48:37.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.796+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94010531577184] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.796+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.796+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94010531581760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580885724d0 con 0x5580885640f0 2024-05-09T09:48:37.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.796+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088572e90 con 0x5580885640f0 2024-05-09T09:48:37.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.800+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94010531581760] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.800+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.800+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94010531588576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580885732b0 con 0x5580885640f0 2024-05-09T09:48:37.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.800+0000 7f2de4eb0980 20 add_watcher() i=0 2024-05-09T09:48:37.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.800+0000 7f2de4eb0980 20 add_watcher() i=1 2024-05-09T09:48:37.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.800+0000 7f2de4eb0980 20 add_watcher() i=2 2024-05-09T09:48:37.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.800+0000 7f2de4eb0980 20 add_watcher() i=3 2024-05-09T09:48:37.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.800+0000 7f2de4eb0980 20 add_watcher() i=4 2024-05-09T09:48:37.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.800+0000 7f2de4eb0980 20 add_watcher() i=5 2024-05-09T09:48:37.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.800+0000 7f2de4eb0980 20 add_watcher() i=6 2024-05-09T09:48:37.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.800+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94010531588576] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.804+0000 7f2de4eb0980 20 add_watcher() i=7 2024-05-09T09:48:37.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.804+0000 7f2de4eb0980 2 all 8 watchers are set, enabling cache 2024-05-09T09:48:37.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.804+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5580885765a0 con 0x55808855f730 2024-05-09T09:48:37.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.804+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2ddc036040 con 0x55808855f730 2024-05-09T09:48:37.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.804+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94010531590000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088573840 con 0x55808855f730 2024-05-09T09:48:37.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.804+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94010531590000] v32'340 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x55808855f730 2024-05-09T09:48:37.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.804+0000 7f2c987e8640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:37.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.804+0000 7f2de4eb0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:48:37.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.804+0000 7f2de4eb0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:48:37.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.804+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55808857ecd0 con 0x55808855f730 2024-05-09T09:48:37.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.808+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'81 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x55808855f730 2024-05-09T09:48:37.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.808+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55808857f240 con 0x5580885640f0 2024-05-09T09:48:37.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.808+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'75 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.808+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55808857f240 con 0x558088568990 2024-05-09T09:48:37.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.812+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'74 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.812+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55808857faf0 con 0x55808855f730 2024-05-09T09:48:37.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.812+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'341 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x55808855f730 2024-05-09T09:48:37.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.812+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088580060 con 0x7f2dcc013040 2024-05-09T09:48:37.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.812+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'212 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x7f2dcc013040 2024-05-09T09:48:37.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.812+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088580510 con 0x558088568990 2024-05-09T09:48:37.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.816+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'142 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.816+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580885808d0 con 0x55808855f730 2024-05-09T09:48:37.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.816+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'76 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x55808855f730 2024-05-09T09:48:37.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.816+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580885808d0 con 0x5580885640f0 2024-05-09T09:48:37.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.820+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'141 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.820+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580885809d0 con 0x7f2dcc013040 2024-05-09T09:48:37.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.824+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'74 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x7f2dcc013040 2024-05-09T09:48:37.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.824+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088580ea0 con 0x558088568990 2024-05-09T09:48:37.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.824+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'80 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.824+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088581350 con 0x7f2dcc013040 2024-05-09T09:48:37.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.824+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'213 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x7f2dcc013040 2024-05-09T09:48:37.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.824+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088581350 con 0x5580885640f0 2024-05-09T09:48:37.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.828+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'78 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.828+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088581350 con 0x7f2dcc013040 2024-05-09T09:48:37.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.828+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'74 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x7f2dcc013040 2024-05-09T09:48:37.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.828+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088581350 con 0x5580885640f0 2024-05-09T09:48:37.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.832+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'147 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.832+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088581350 con 0x55808855f730 2024-05-09T09:48:37.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.832+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'342 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x55808855f730 2024-05-09T09:48:37.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.832+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088581350 con 0x558088568990 2024-05-09T09:48:37.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.836+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'206 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.836+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088581350 con 0x7f2dcc013040 2024-05-09T09:48:37.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.836+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'214 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x7f2dcc013040 2024-05-09T09:48:37.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.836+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088581350 con 0x558088568990 2024-05-09T09:48:37.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.840+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'74 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.840+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580885813e0 con 0x55808855f730 2024-05-09T09:48:37.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.840+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'82 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x55808855f730 2024-05-09T09:48:37.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.840+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580885813e0 con 0x55808855f730 2024-05-09T09:48:37.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.844+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'343 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x55808855f730 2024-05-09T09:48:37.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.844+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580885813e0 con 0x558088568990 2024-05-09T09:48:37.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.844+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'207 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.844+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580885813e0 con 0x7f2dcc013040 2024-05-09T09:48:37.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.848+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'86 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x7f2dcc013040 2024-05-09T09:48:37.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.848+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088581400 con 0x558088568990 2024-05-09T09:48:37.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.848+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'76 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.848+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088581400 con 0x558088568990 2024-05-09T09:48:37.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.852+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'80 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.852+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088581400 con 0x558088568990 2024-05-09T09:48:37.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.852+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'71 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.852+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088581400 con 0x558088568990 2024-05-09T09:48:37.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.852+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'143 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.852+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088581400 con 0x5580885640f0 2024-05-09T09:48:37.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.856+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'76 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.856+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088581400 con 0x558088568990 2024-05-09T09:48:37.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.860+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'74 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.860+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088581400 con 0x5580885640f0 2024-05-09T09:48:37.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.860+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'142 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.860+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088581400 con 0x558088568990 2024-05-09T09:48:37.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.864+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'208 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.864+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088581400 con 0x5580885640f0 2024-05-09T09:48:37.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.868+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'148 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.868+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088581400 con 0x7f2dcc013040 2024-05-09T09:48:37.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.868+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'80 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x7f2dcc013040 2024-05-09T09:48:37.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.868+0000 7f2c977e6640 20 reqs_thread_entry: start 2024-05-09T09:48:37.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.868+0000 7f2de4eb0980 20 init_complete bucket index max shards: 11 2024-05-09T09:48:37.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.868+0000 7f2c957e2640 20 reqs_thread_entry: start 2024-05-09T09:48:37.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.872+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808857d1a0 con 0x55808855f730 2024-05-09T09:48:37.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.872+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x55808855f730 2024-05-09T09:48:37.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.872+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:95 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808857d1a0 con 0x7f2dcc013040 2024-05-09T09:48:37.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.872+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(95 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x7f2dcc013040 2024-05-09T09:48:37.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.872+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808857d1a0 con 0x55808855f730 2024-05-09T09:48:37.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.872+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(96 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x55808855f730 2024-05-09T09:48:37.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.872+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:97 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808857d1a0 con 0x558088568990 2024-05-09T09:48:37.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.872+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(97 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.872+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:98 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808857d1a0 con 0x558088568990 2024-05-09T09:48:37.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.872+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(98 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.872+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:99 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808857d1a0 con 0x558088568990 2024-05-09T09:48:37.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.872+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== osd_op_reply(99 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.872+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808857d1a0 con 0x55808855f730 2024-05-09T09:48:37.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.872+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(100 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x55808855f730 2024-05-09T09:48:37.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.872+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:101 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808857d1a0 con 0x55808855f730 2024-05-09T09:48:37.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.872+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(101 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x55808855f730 2024-05-09T09:48:37.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.872+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:102 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808857d1a0 con 0x558088568990 2024-05-09T09:48:37.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.872+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 30 ==== osd_op_reply(102 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.872+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:103 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808857d1a0 con 0x558088568990 2024-05-09T09:48:37.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.872+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 31 ==== osd_op_reply(103 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.872+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808857d1a0 con 0x5580885640f0 2024-05-09T09:48:37.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.876+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(104 usage.10 [call out=1378b] v0'0 uv77 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.876+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:105 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808859ea00 con 0x55808855f730 2024-05-09T09:48:37.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.876+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(105 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x55808855f730 2024-05-09T09:48:37.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.876+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:106 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808859ea00 con 0x7f2dcc013040 2024-05-09T09:48:37.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.876+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(106 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x7f2dcc013040 2024-05-09T09:48:37.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.876+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:107 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808859ea00 con 0x558088568990 2024-05-09T09:48:37.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.876+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 32 ==== osd_op_reply(107 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.876+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:108 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808859ea00 con 0x5580885640f0 2024-05-09T09:48:37.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.876+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(108 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.876+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:109 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808859ea00 con 0x5580885640f0 2024-05-09T09:48:37.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.876+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(109 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.876+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:110 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808859ea00 con 0x558088568990 2024-05-09T09:48:37.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.880+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 33 ==== osd_op_reply(110 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.880+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:111 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808859ea00 con 0x5580885640f0 2024-05-09T09:48:37.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.880+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(111 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.880+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:112 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808859ea00 con 0x55808855f730 2024-05-09T09:48:37.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.880+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(112 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x55808855f730 2024-05-09T09:48:37.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.880+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:113 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808859ea00 con 0x558088568990 2024-05-09T09:48:37.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.880+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 34 ==== osd_op_reply(113 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.880+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:114 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808859ea00 con 0x5580885640f0 2024-05-09T09:48:37.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.880+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(114 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.880+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:115 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808859ea00 con 0x7f2dcc013040 2024-05-09T09:48:37.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.880+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(115 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x7f2dcc013040 2024-05-09T09:48:37.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.880+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:116 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808859ea00 con 0x5580885640f0 2024-05-09T09:48:37.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.880+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(116 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.880+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:117 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808859ea00 con 0x55808855f730 2024-05-09T09:48:37.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.884+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(117 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x55808855f730 2024-05-09T09:48:37.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.884+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:118 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808859ea00 con 0x55808855f730 2024-05-09T09:48:37.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.884+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(118 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x55808855f730 2024-05-09T09:48:37.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.884+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:119 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808859ea00 con 0x558088568990 2024-05-09T09:48:37.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.884+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 35 ==== osd_op_reply(119 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.884+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:120 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808859ea00 con 0x55808855f730 2024-05-09T09:48:37.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.884+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(120 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x55808855f730 2024-05-09T09:48:37.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.884+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:121 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808859ea00 con 0x55808855f730 2024-05-09T09:48:37.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.884+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 36 ==== osd_op_reply(121 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x55808855f730 2024-05-09T09:48:37.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.884+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:122 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808859ea00 con 0x558088568990 2024-05-09T09:48:37.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.884+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 36 ==== osd_op_reply(122 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.884+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:123 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808859ea00 con 0x558088568990 2024-05-09T09:48:37.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.884+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 37 ==== osd_op_reply(123 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.884+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:124 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808859ea00 con 0x558088568990 2024-05-09T09:48:37.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.884+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 38 ==== osd_op_reply(124 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.884+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:125 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55808859ea00 con 0x5580885640f0 2024-05-09T09:48:37.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.884+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(125 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.888+0000 7f2c987e8640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:37.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.888+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:126 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94010531590000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55808857c8e0 con 0x55808855f730 2024-05-09T09:48:37.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.888+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 37 ==== osd_op_reply(126 data_loggenerations_metadata [watch unwatch cookie 94010531590000] v32'344 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x55808855f730 2024-05-09T09:48:37.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.888+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:127 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94010531564864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088572f70 con 0x7f2dcc013040 2024-05-09T09:48:37.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.888+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(127 notify.0 [watch unwatch cookie 94010531564864] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x7f2dcc013040 2024-05-09T09:48:37.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.888+0000 7f2de4eb0980 20 remove_watcher() i=0 2024-05-09T09:48:37.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.888+0000 7f2de4eb0980 2 removed watcher, disabling cache 2024-05-09T09:48:37.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.888+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:128 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94010531568768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088572f70 con 0x55808855f730 2024-05-09T09:48:37.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.892+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 38 ==== osd_op_reply(128 notify.1 [watch unwatch cookie 94010531568768] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x55808855f730 2024-05-09T09:48:37.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.892+0000 7f2de4eb0980 20 remove_watcher() i=1 2024-05-09T09:48:37.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.892+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:129 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94010531562352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55808856dc80 con 0x558088568990 2024-05-09T09:48:37.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.896+0000 7f2de21ca640 1 -- 172.21.15.157:0/1065080475 <== osd.3 v2:172.21.15.157:6816/2487336710 39 ==== osd_op_reply(129 notify.2 [watch unwatch cookie 94010531562352] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dcc041040 con 0x558088568990 2024-05-09T09:48:37.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.896+0000 7f2de4eb0980 20 remove_watcher() i=2 2024-05-09T09:48:37.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.896+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:130 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94010531574736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088572f70 con 0x7f2dcc013040 2024-05-09T09:48:37.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.896+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(130 notify.3 [watch unwatch cookie 94010531574736] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x7f2dcc013040 2024-05-09T09:48:37.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.896+0000 7f2de4eb0980 20 remove_watcher() i=3 2024-05-09T09:48:37.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.896+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:131 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94010531579552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55808856c370 con 0x55808855f730 2024-05-09T09:48:37.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.896+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 <== osd.1 v2:172.21.15.157:6808/3930131338 39 ==== osd_op_reply(131 notify.4 [watch unwatch cookie 94010531579552] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ddc036040 con 0x55808855f730 2024-05-09T09:48:37.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.896+0000 7f2de4eb0980 20 remove_watcher() i=4 2024-05-09T09:48:37.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.896+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:132 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94010531577184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55808856dc80 con 0x5580885640f0 2024-05-09T09:48:37.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.900+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 32 ==== osd_op_reply(132 notify.5 [watch unwatch cookie 94010531577184] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.900+0000 7f2de4eb0980 20 remove_watcher() i=5 2024-05-09T09:48:37.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.900+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:133 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94010531581760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558088572f70 con 0x5580885640f0 2024-05-09T09:48:37.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.904+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 33 ==== osd_op_reply(133 notify.6 [watch unwatch cookie 94010531581760] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.904+0000 7f2de4eb0980 20 remove_watcher() i=6 2024-05-09T09:48:37.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.904+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:134 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94010531588576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580885706a0 con 0x5580885640f0 2024-05-09T09:48:37.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.904+0000 7f2de29cb640 1 -- 172.21.15.157:0/1065080475 <== osd.0 v2:172.21.15.110:6800/231209037 34 ==== osd_op_reply(134 notify.7 [watch unwatch cookie 94010531588576] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dd40f5070 con 0x5580885640f0 2024-05-09T09:48:37.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.904+0000 7f2de4eb0980 20 remove_watcher() i=7 2024-05-09T09:48:37.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.904+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5580885640f0 msgr2=0x5580885664e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:37.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.904+0000 7f2de4eb0980 1 --2- 172.21.15.157:0/1065080475 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5580885640f0 0x5580885664e0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:37.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.904+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55808855f730 msgr2=0x558088561bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:37.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.904+0000 7f2de4eb0980 1 --2- 172.21.15.157:0/1065080475 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55808855f730 0x558088561bf0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:37.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.904+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2dcc013040 msgr2=0x7f2dcc0243c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:37.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.904+0000 7f2de4eb0980 1 --2- 172.21.15.157:0/1065080475 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2dcc013040 0x7f2dcc0243c0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:37.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.904+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558088568990 msgr2=0x55808856ae50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:37.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.904+0000 7f2de4eb0980 1 --2- 172.21.15.157:0/1065080475 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558088568990 0x55808856ae50 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:37.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.904+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2cac034b60 msgr2=0x7f2cac037020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:37.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.904+0000 7f2de4eb0980 1 --2- 172.21.15.157:0/1065080475 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2cac034b60 0x7f2cac037020 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x558088519240 tx=0x7f2dcc012000 comp rx=0 tx=0).stop 2024-05-09T09:48:37.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.904+0000 7f2de31cc640 1 -- 172.21.15.157:0/1065080475 reap_dead start 2024-05-09T09:48:37.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.904+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55808854bb10 msgr2=0x558088552d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:37.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.904+0000 7f2de4eb0980 1 --2- 172.21.15.157:0/1065080475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55808854bb10 0x558088552d30 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40af020 tx=0x7f2dd40b0ed0 comp rx=0 tx=0).stop 2024-05-09T09:48:37.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 shutdown_connections 2024-05-09T09:48:37.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de4eb0980 1 --2- 172.21.15.157:0/1065080475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55808854bb10 0x558088552d30 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:37.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 >> 172.21.15.157:0/1065080475 conn(0x558088547e90 msgr2=0x558088545ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:37.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 shutdown_connections 2024-05-09T09:48:37.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de4eb0980 1 -- 172.21.15.157:0/1065080475 wait complete. 2024-05-09T09:48:37.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de4eb0980 1 -- 172.21.15.157:0/2561819836 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2cbc034bb0 msgr2=0x7f2cbc037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:37.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de4eb0980 1 --2- 172.21.15.157:0/2561819836 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2cbc034bb0 0x7f2cbc037070 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55808850cdd0 tx=0x7f2dcc011000 comp rx=0 tx=0).stop 2024-05-09T09:48:37.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de4eb0980 1 -- 172.21.15.157:0/2561819836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55808853ed20 msgr2=0x55808853f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:37.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de4eb0980 1 --2- 172.21.15.157:0/2561819836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55808853ed20 0x55808853f140 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400a400 tx=0x7f2dd40d09e0 comp rx=0 tx=0).stop 2024-05-09T09:48:37.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de4eb0980 1 -- 172.21.15.157:0/2561819836 shutdown_connections 2024-05-09T09:48:37.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de4eb0980 1 --2- 172.21.15.157:0/2561819836 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2cbc034bb0 0x7f2cbc037070 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:37.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de4eb0980 1 --2- 172.21.15.157:0/2561819836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55808853ed20 0x55808853f140 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:37.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de4eb0980 1 -- 172.21.15.157:0/2561819836 >> 172.21.15.157:0/2561819836 conn(0x558088533af0 msgr2=0x558088534600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:37.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de4eb0980 1 -- 172.21.15.157:0/2561819836 shutdown_connections 2024-05-09T09:48:37.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de4eb0980 1 -- 172.21.15.157:0/2561819836 wait complete. 2024-05-09T09:48:37.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de4eb0980 1 -- 172.21.15.157:0/3510108107 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5580885122b0 msgr2=0x558088514770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:37.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de4eb0980 1 --2- 172.21.15.157:0/3510108107 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5580885122b0 0x558088514770 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:37.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de4eb0980 1 -- 172.21.15.157:0/3510108107 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55808850d640 msgr2=0x55808850fa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:37.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de4eb0980 1 --2- 172.21.15.157:0/3510108107 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55808850d640 0x55808850fa70 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:37.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de4eb0980 1 -- 172.21.15.157:0/3510108107 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558088516360 msgr2=0x558088518750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:37.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de4eb0980 1 --2- 172.21.15.157:0/3510108107 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558088516360 0x558088518750 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:37.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de4eb0980 1 -- 172.21.15.157:0/3510108107 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2cc8034bb0 msgr2=0x7f2cc8037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:37.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de4eb0980 1 --2- 172.21.15.157:0/3510108107 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2cc8034bb0 0x7f2cc8037070 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc0012f0 tx=0x7f2dcc0066b0 comp rx=0 tx=0).stop 2024-05-09T09:48:37.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de4eb0980 1 -- 172.21.15.157:0/3510108107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558088416450 msgr2=0x558088508760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:37.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de4eb0980 1 --2- 172.21.15.157:0/3510108107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558088416450 0x558088508760 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4003070 tx=0x7f2dd40180e0 comp rx=0 tx=0).stop 2024-05-09T09:48:37.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de31cc640 1 -- 172.21.15.157:0/3510108107 reap_dead start 2024-05-09T09:48:37.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de4eb0980 1 -- 172.21.15.157:0/3510108107 shutdown_connections 2024-05-09T09:48:37.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de4eb0980 1 -- 172.21.15.157:0/3510108107 >> 172.21.15.157:0/3510108107 conn(0x558088389250 msgr2=0x5580884fbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:37.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de4eb0980 1 -- 172.21.15.157:0/3510108107 shutdown_connections 2024-05-09T09:48:37.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.908+0000 7f2de4eb0980 1 -- 172.21.15.157:0/3510108107 wait complete. 2024-05-09T09:48:37.923 INFO:teuthology.orchestra.run.smithi157.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"anonymous","categories":[],"s3select":{}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-05-09T09:48:37.924 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-09T09:48:37.924 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-05-09T09:48:37.924 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-05-09T09:48:37.924 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-05-09T09:48:38.000 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:48:38.000 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:48:38.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.996+0000 7ff9ea1ff980 1 Processor -- start 2024-05-09T09:48:38.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.996+0000 7ff9ea1ff980 1 -- start start 2024-05-09T09:48:38.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.996+0000 7ff9ea1ff980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x558bb43fba60 0x558bb448c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.996+0000 7ff9ea1ff980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558bb433d440 con 0x558bb448cf20 2024-05-09T09:48:38.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:37.996+0000 7ff9ea1ff980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x558bb43285f0 con 0x558bb43fba60 2024-05-09T09:48:38.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.000+0000 7ff9e7d1a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x558bb43fba60 0x558bb448c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.000+0000 7ff9e7d1a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x558bb43fba60 0x558bb448c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59772/0 (socket says 172.21.15.157:59772) 2024-05-09T09:48:38.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.000+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/280115467 learned_addr learned my addr 172.21.15.157:0/280115467 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:38.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.000+0000 7ff9e7519640 1 --1- 172.21.15.157:0/280115467 >> v1:172.21.15.110:6789/0 conn(0x558bb448cf20 0x558bb448f310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:49148/0 (socket says 172.21.15.157:49148) 2024-05-09T09:48:38.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.000+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/280115467 >> v1:172.21.15.110:6789/0 conn(0x558bb448cf20 legacy=0x558bb448f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.000+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/280115467 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bb4333990 con 0x558bb43fba60 2024-05-09T09:48:38.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.004+0000 7ff9e7d1a640 1 --2- 172.21.15.157:0/280115467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb43fba60 0x558bb448c9e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff9d800a5c0 tx=0x7ff9d801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99990f943939e786 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.004+0000 7ff9e6d18640 1 -- 172.21.15.157:0/280115467 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9d80a6070 con 0x558bb43fba60 2024-05-09T09:48:38.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.004+0000 7ff9e6d18640 1 -- 172.21.15.157:0/280115467 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d80af070 con 0x558bb43fba60 2024-05-09T09:48:38.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.004+0000 7ff9e6d18640 1 -- 172.21.15.157:0/280115467 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9d80aa5c0 con 0x558bb43fba60 2024-05-09T09:48:38.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.004+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/280115467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb43fba60 msgr2=0x558bb448c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.004+0000 7ff9ea1ff980 1 --2- 172.21.15.157:0/280115467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb43fba60 0x558bb448c9e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff9d800a5c0 tx=0x7ff9d801b340 comp rx=0 tx=0).stop 2024-05-09T09:48:38.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.004+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/280115467 shutdown_connections 2024-05-09T09:48:38.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.004+0000 7ff9ea1ff980 1 --2- 172.21.15.157:0/280115467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb43fba60 0x558bb448c9e0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.004+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/280115467 >> 172.21.15.157:0/280115467 conn(0x558bb44820c0 msgr2=0x558bb44844e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:38.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.004+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/280115467 shutdown_connections 2024-05-09T09:48:38.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.004+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/280115467 wait complete. 2024-05-09T09:48:38.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.020+0000 7ff9ea1ff980 1 Processor -- start 2024-05-09T09:48:38.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.020+0000 7ff9ea1ff980 1 -- start start 2024-05-09T09:48:38.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.020+0000 7ff9ea1ff980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb43fba60 0x558bb4574cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.020+0000 7ff9ea1ff980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558bb438afe0 con 0x558bb43fba60 2024-05-09T09:48:38.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.020+0000 7ff9e7d1a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb43fba60 0x558bb4574cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.020+0000 7ff9e7d1a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb43fba60 0x558bb4574cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59786/0 (socket says 172.21.15.157:59786) 2024-05-09T09:48:38.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.020+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2396318349 learned_addr learned my addr 172.21.15.157:0/2396318349 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:38.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.020+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2396318349 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bb430fae0 con 0x558bb43fba60 2024-05-09T09:48:38.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.020+0000 7ff9e7d1a640 1 --2- 172.21.15.157:0/2396318349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb43fba60 0x558bb4574cd0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff9d80ac040 tx=0x7ff9d8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760d53db71c55149 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.020+0000 7ff8d5e0b640 1 -- 172.21.15.157:0/2396318349 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9d80aa970 con 0x558bb43fba60 2024-05-09T09:48:38.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.020+0000 7ff8d5e0b640 1 -- 172.21.15.157:0/2396318349 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d80aab10 con 0x558bb43fba60 2024-05-09T09:48:38.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.020+0000 7ff8d5e0b640 1 -- 172.21.15.157:0/2396318349 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9d80aae30 con 0x558bb43fba60 2024-05-09T09:48:38.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.020+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2396318349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb43fba60 msgr2=0x558bb4574cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.020+0000 7ff9ea1ff980 1 --2- 172.21.15.157:0/2396318349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb43fba60 0x558bb4574cd0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff9d80ac040 tx=0x7ff9d8003030 comp rx=0 tx=0).stop 2024-05-09T09:48:38.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.020+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2396318349 shutdown_connections 2024-05-09T09:48:38.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.020+0000 7ff9ea1ff980 1 --2- 172.21.15.157:0/2396318349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb43fba60 0x558bb4574cd0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.020+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2396318349 >> 172.21.15.157:0/2396318349 conn(0x558bb44820c0 msgr2=0x558bb4570860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:38.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.024+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2396318349 shutdown_connections 2024-05-09T09:48:38.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.024+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2396318349 wait complete. 2024-05-09T09:48:38.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.024+0000 7ff9ea1ff980 1 Processor -- start 2024-05-09T09:48:38.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.024+0000 7ff9ea1ff980 1 -- start start 2024-05-09T09:48:38.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.024+0000 7ff9ea1ff980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb43fba60 0x558bb457bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.024+0000 7ff9ea1ff980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558bb4493490 con 0x558bb43fba60 2024-05-09T09:48:38.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.024+0000 7ff9e7d1a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb43fba60 0x558bb457bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.024+0000 7ff9e7d1a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb43fba60 0x558bb457bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59788/0 (socket says 172.21.15.157:59788) 2024-05-09T09:48:38.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.024+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/1431951621 learned_addr learned my addr 172.21.15.157:0/1431951621 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:38.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.024+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/1431951621 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bb457c2d0 con 0x558bb43fba60 2024-05-09T09:48:38.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.024+0000 7ff9e7d1a640 1 --2- 172.21.15.157:0/1431951621 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb43fba60 0x558bb457bd90 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8003070 tx=0x7ff9d80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.024+0000 7ff8cffff640 1 -- 172.21.15.157:0/1431951621 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9d80c6690 con 0x558bb43fba60 2024-05-09T09:48:38.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.024+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/1431951621 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558bb457c560 con 0x558bb43fba60 2024-05-09T09:48:38.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.024+0000 7ff8cffff640 1 -- 172.21.15.157:0/1431951621 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d80cc070 con 0x558bb43fba60 2024-05-09T09:48:38.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.024+0000 7ff8cffff640 1 -- 172.21.15.157:0/1431951621 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9d80c6960 con 0x558bb43fba60 2024-05-09T09:48:38.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.024+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/1431951621 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bb457f1f0 con 0x558bb43fba60 2024-05-09T09:48:38.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.024+0000 7ff8cffff640 1 -- 172.21.15.157:0/1431951621 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7ff9d80c6b00 con 0x558bb43fba60 2024-05-09T09:48:38.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.024+0000 7ff8cffff640 1 --2- 172.21.15.157:0/1431951621 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff8d0034bb0 0x7ff8d0037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.024+0000 7ff8cffff640 1 -- 172.21.15.157:0/1431951621 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7ff9d80e5cd0 con 0x558bb43fba60 2024-05-09T09:48:38.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.024+0000 7ff9e7519640 1 --2- 172.21.15.157:0/1431951621 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff8d0034bb0 0x7ff8d0037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.024+0000 7ff9ea1ff980 1 --2- 172.21.15.157:0/1431951621 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558bb448cf20 0x558bb4582d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.024+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/1431951621 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb4583380 con 0x558bb448cf20 2024-05-09T09:48:38.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.028+0000 7ff9e851b640 1 --2- 172.21.15.157:0/1431951621 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558bb448cf20 0x558bb4582d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.028+0000 7ff9e7519640 1 --2- 172.21.15.157:0/1431951621 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff8d0034bb0 0x7ff8d0037070 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0000f70 tx=0x7ff9d0001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.028+0000 7ff9e851b640 1 --2- 172.21.15.157:0/1431951621 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558bb448cf20 0x558bb4582d10 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.028+0000 7ff9e851b640 1 -- 172.21.15.157:0/1431951621 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb448cf20 2024-05-09T09:48:38.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.028+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/1431951621 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb45803f0 con 0x558bb448cf20 2024-05-09T09:48:38.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.028+0000 7ff9e851b640 1 -- 172.21.15.157:0/1431951621 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb448cf20 2024-05-09T09:48:38.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.028+0000 7ff9ea1ff980 1 --2- 172.21.15.157:0/1431951621 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558bb45856b0 0x558bb4587aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.028+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/1431951621 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb4588170 con 0x558bb45856b0 2024-05-09T09:48:38.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.028+0000 7ff9e7d1a640 1 --2- 172.21.15.157:0/1431951621 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558bb45856b0 0x558bb4587aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.028+0000 7ff9e7d1a640 1 --2- 172.21.15.157:0/1431951621 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558bb45856b0 0x558bb4587aa0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.028+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/1431951621 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff9d80b5b10 con 0x558bb45856b0 2024-05-09T09:48:38.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.028+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/1431951621 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb4584550 con 0x558bb448cf20 2024-05-09T09:48:38.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.028+0000 7ff9e851b640 1 -- 172.21.15.157:0/1431951621 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb448cf20 2024-05-09T09:48:38.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.028+0000 7ff9ea1ff980 1 --2- 172.21.15.157:0/1431951621 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558bb45895d0 0x558bb458b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.028+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/1431951621 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb458c0c0 con 0x558bb45895d0 2024-05-09T09:48:38.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.028+0000 7ff9e7519640 1 --2- 172.21.15.157:0/1431951621 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558bb45895d0 0x558bb458b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.032+0000 7ff9e7519640 1 --2- 172.21.15.157:0/1431951621 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558bb45895d0 0x558bb458b9c0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.032+0000 7ff9e7519640 1 -- 172.21.15.157:0/1431951621 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff9d000f6a0 con 0x558bb45895d0 2024-05-09T09:48:38.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.036+0000 7ff9ea1ff980 1 Processor -- start 2024-05-09T09:48:38.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.036+0000 7ff9ea1ff980 1 -- start start 2024-05-09T09:48:38.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.036+0000 7ff9ea1ff980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb45b1fb0 0x558bb45b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.036+0000 7ff9ea1ff980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558bb438f020 con 0x558bb45b1fb0 2024-05-09T09:48:38.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.036+0000 7ff9e7d1a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb45b1fb0 0x558bb45b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.036+0000 7ff9e7d1a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb45b1fb0 0x558bb45b23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59790/0 (socket says 172.21.15.157:59790) 2024-05-09T09:48:38.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.036+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/949605389 learned_addr learned my addr 172.21.15.157:0/949605389 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:38.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.036+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/949605389 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bb45b2910 con 0x558bb45b1fb0 2024-05-09T09:48:38.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.036+0000 7ff9e7d1a640 1 --2- 172.21.15.157:0/949605389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb45b1fb0 0x558bb45b23d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff9d80d1fd0 tx=0x7ff9d80c5660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.036+0000 7ff8c7fff640 1 -- 172.21.15.157:0/949605389 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9d80aaed0 con 0x558bb45b1fb0 2024-05-09T09:48:38.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.036+0000 7ff8c7fff640 1 -- 172.21.15.157:0/949605389 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d80a7290 con 0x558bb45b1fb0 2024-05-09T09:48:38.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.036+0000 7ff8c7fff640 1 -- 172.21.15.157:0/949605389 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9d80a7570 con 0x558bb45b1fb0 2024-05-09T09:48:38.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.036+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/949605389 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558bb45b33a0 con 0x558bb45b1fb0 2024-05-09T09:48:38.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.036+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/949605389 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bb45b33a0 con 0x558bb45b1fb0 2024-05-09T09:48:38.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.036+0000 7ff8c7fff640 1 -- 172.21.15.157:0/949605389 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7ff9d80f5060 con 0x558bb45b1fb0 2024-05-09T09:48:38.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.036+0000 7ff8c7fff640 1 --2- 172.21.15.157:0/949605389 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff8c0034bb0 0x7ff8c0037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.036+0000 7ff8c7fff640 1 -- 172.21.15.157:0/949605389 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7ff9d80efd50 con 0x558bb45b1fb0 2024-05-09T09:48:38.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.036+0000 7ff9e7519640 1 --2- 172.21.15.157:0/949605389 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff8c0034bb0 0x7ff8c0037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.040+0000 7ff9ea1ff980 1 Processor -- start 2024-05-09T09:48:38.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.040+0000 7ff9ea1ff980 1 -- start start 2024-05-09T09:48:38.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.040+0000 7ff9ea1ff980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb45bed60 0x558bb45bf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.040+0000 7ff9e7519640 1 --2- 172.21.15.157:0/949605389 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff8c0034bb0 0x7ff8c0037070 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x558bb4583c60 tx=0x7ff9d000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.040+0000 7ff9ea1ff980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558bb4575360 con 0x558bb45bed60 2024-05-09T09:48:38.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.040+0000 7ff9e7d1a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb45bed60 0x558bb45bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.040+0000 7ff9e7d1a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb45bed60 0x558bb45bf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59806/0 (socket says 172.21.15.157:59806) 2024-05-09T09:48:38.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.040+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2915062263 learned_addr learned my addr 172.21.15.157:0/2915062263 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:38.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.040+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2915062263 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bb45bf710 con 0x558bb45bed60 2024-05-09T09:48:38.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.040+0000 7ff9e7d1a640 1 --2- 172.21.15.157:0/2915062263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb45bed60 0x558bb45bf140 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff9d80e0fd0 tx=0x7ff9d80d0930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c3fc4a38c0f42dc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.040+0000 7ff8c5ffb640 1 -- 172.21.15.157:0/2915062263 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9d8108070 con 0x558bb45bed60 2024-05-09T09:48:38.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.040+0000 7ff8c5ffb640 1 -- 172.21.15.157:0/2915062263 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d80f7450 con 0x558bb45bed60 2024-05-09T09:48:38.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.040+0000 7ff8c5ffb640 1 -- 172.21.15.157:0/2915062263 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9d80abac0 con 0x558bb45bed60 2024-05-09T09:48:38.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.040+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2915062263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb45bed60 msgr2=0x558bb45bf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.040+0000 7ff9ea1ff980 1 --2- 172.21.15.157:0/2915062263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb45bed60 0x558bb45bf140 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff9d80e0fd0 tx=0x7ff9d80d0930 comp rx=0 tx=0).stop 2024-05-09T09:48:38.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.040+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2915062263 shutdown_connections 2024-05-09T09:48:38.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.040+0000 7ff9ea1ff980 1 --2- 172.21.15.157:0/2915062263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb45bed60 0x558bb45bf140 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.040+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2915062263 >> 172.21.15.157:0/2915062263 conn(0x558bb45bb0e0 msgr2=0x558bb45b9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:38.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.040+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2915062263 shutdown_connections 2024-05-09T09:48:38.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.040+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2915062263 wait complete. 2024-05-09T09:48:38.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.040+0000 7ff9ea1ff980 1 Processor -- start 2024-05-09T09:48:38.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.040+0000 7ff9ea1ff980 1 -- start start 2024-05-09T09:48:38.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.040+0000 7ff9ea1ff980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb45bed60 0x558bb45c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.040+0000 7ff9ea1ff980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x558bb45bfe20 con 0x558bb45bed60 2024-05-09T09:48:38.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.040+0000 7ff9e7d1a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb45bed60 0x558bb45c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.040+0000 7ff9e7d1a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb45bed60 0x558bb45c6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59816/0 (socket says 172.21.15.157:59816) 2024-05-09T09:48:38.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.040+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 learned_addr learned my addr 172.21.15.157:0/2402213563 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:38.046 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.040+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bb45c66a0 con 0x558bb45bed60 2024-05-09T09:48:38.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff9e7d1a640 1 --2- 172.21.15.157:0/2402213563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb45bed60 0x558bb45c6160 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff9d80d0970 tx=0x7ff9d80c3ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff8b7fff640 1 -- 172.21.15.157:0/2402213563 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9d8112030 con 0x558bb45bed60 2024-05-09T09:48:38.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558bb45c66a0 con 0x558bb45bed60 2024-05-09T09:48:38.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff8b7fff640 1 -- 172.21.15.157:0/2402213563 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d80d0410 con 0x558bb45bed60 2024-05-09T09:48:38.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff8b7fff640 1 -- 172.21.15.157:0/2402213563 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9d8108040 con 0x558bb45bed60 2024-05-09T09:48:38.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bb45c6b20 con 0x558bb45bed60 2024-05-09T09:48:38.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff8b7fff640 1 -- 172.21.15.157:0/2402213563 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7ff9d8115030 con 0x558bb45bed60 2024-05-09T09:48:38.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff9ea1ff980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff8b7fff640 1 --2- 172.21.15.157:0/2402213563 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff8b0034b10 0x7ff8b0036fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff8b7fff640 1 -- 172.21.15.157:0/2402213563 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7ff9d8113070 con 0x558bb45bed60 2024-05-09T09:48:38.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff9e7519640 1 --2- 172.21.15.157:0/2402213563 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff8b0034b10 0x7ff8b0036fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff9ea1ff980 1 --2- 172.21.15.157:0/2402213563 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558bb45d2a80 0x558bb45d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d5670 con 0x558bb45d2a80 2024-05-09T09:48:38.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff9e851b640 1 --2- 172.21.15.157:0/2402213563 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558bb45d2a80 0x558bb45d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff9e7519640 1 --2- 172.21.15.157:0/2402213563 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff8b0034b10 0x7ff8b0036fd0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000c010 tx=0x7ff9d0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff9e851b640 1 --2- 172.21.15.157:0/2402213563 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558bb45d2a80 0x558bb45d4f20 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff9ea1ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:38.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff9ea1ff980 20 realm 2024-05-09T09:48:38.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff9ea1ff980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d5a80 con 0x558bb45d2a80 2024-05-09T09:48:38.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff9ea1ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:38.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff9ea1ff980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:48:38.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff9ea1ff980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d6320 con 0x558bb45d2a80 2024-05-09T09:48:38.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff9ea1ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:38.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff9ea1ff980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.044+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x558bb45d2a80 2024-05-09T09:48:38.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.048+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.048+0000 7ff9ea1ff980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:38.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.048+0000 7ff9ea1ff980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.048+0000 7ff9ea1ff980 1 --2- 172.21.15.157:0/2402213563 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558bb45d7420 0x558bb45d9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.048+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d9d90 con 0x558bb45d7420 2024-05-09T09:48:38.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.048+0000 7ff9e7d1a640 1 --2- 172.21.15.157:0/2402213563 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558bb45d7420 0x558bb45d9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.048+0000 7ff9e7d1a640 1 --2- 172.21.15.157:0/2402213563 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558bb45d7420 0x558bb45d9810 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.048+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.048+0000 7ff9ea1ff980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:48:38.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.048+0000 7ff9ea1ff980 20 searching for the correct realm 2024-05-09T09:48:38.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.048+0000 7ff9ea1ff980 1 --2- 172.21.15.157:0/2402213563 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558bb45dbcc0 0x558bb45de180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.048+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45de850 con 0x558bb45dbcc0 2024-05-09T09:48:38.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.048+0000 7ff9e7519640 1 --2- 172.21.15.157:0/2402213563 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558bb45dbcc0 0x558bb45de180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.048+0000 7ff9e7519640 1 --2- 172.21.15.157:0/2402213563 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558bb45dbcc0 0x558bb45de180 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.048+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9d0037040 con 0x558bb45dbcc0 2024-05-09T09:48:38.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.048+0000 7ff9e7519640 1 --2- 172.21.15.157:0/2402213563 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7ff9d001fbe0 0x7ff9d003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.048+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45de850 con 0x7ff9d001fbe0 2024-05-09T09:48:38.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.048+0000 7ff9e851b640 1 --2- 172.21.15.157:0/2402213563 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7ff9d001fbe0 0x7ff9d003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.048+0000 7ff9e851b640 1 --2- 172.21.15.157:0/2402213563 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7ff9d001fbe0 0x7ff9d003a3c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.048+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9e000a4d0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.048+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x558bb45d7420 2024-05-09T09:48:38.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.052+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.052+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x558bb45d2a80 2024-05-09T09:48:38.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.052+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.052+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x558bb45d2a80 2024-05-09T09:48:38.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.052+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.052+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x558bb45d7420 2024-05-09T09:48:38.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.052+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.052+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x558bb45d7420 2024-05-09T09:48:38.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.052+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.052+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.052+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9e000a4d0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.052+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x558bb45dbcc0 2024-05-09T09:48:38.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.052+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9d0037040 con 0x558bb45dbcc0 2024-05-09T09:48:38.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.052+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x558bb45d2a80 2024-05-09T09:48:38.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.052+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.052+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x558bb45d7420 2024-05-09T09:48:38.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.056+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.056+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x558bb45d2a80 2024-05-09T09:48:38.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.056+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.056+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.056+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff9e000a4d0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.056+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x558bb45dbcc0 2024-05-09T09:48:38.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.056+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9d0037040 con 0x558bb45dbcc0 2024-05-09T09:48:38.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.056+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x558bb45dbcc0 2024-05-09T09:48:38.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.056+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff9d0037040 con 0x558bb45dbcc0 2024-05-09T09:48:38.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.056+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x558bb45d7420 2024-05-09T09:48:38.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.056+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.056+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x558bb45dbcc0 2024-05-09T09:48:38.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.056+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9d0037040 con 0x558bb45dbcc0 2024-05-09T09:48:38.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.056+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x558bb45dbcc0 2024-05-09T09:48:38.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.056+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9d0037040 con 0x558bb45dbcc0 2024-05-09T09:48:38.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.056+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x558bb45d2a80 2024-05-09T09:48:38.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.056+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.056+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x558bb45d2a80 2024-05-09T09:48:38.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.056+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.056+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x558bb45d7420 2024-05-09T09:48:38.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.060+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.060+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x558bb45dbcc0 2024-05-09T09:48:38.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.060+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9d0037040 con 0x558bb45dbcc0 2024-05-09T09:48:38.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.060+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.060+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9e000a4d0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.060+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x558bb45d2a80 2024-05-09T09:48:38.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.060+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.060+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x558bb45d7420 2024-05-09T09:48:38.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.060+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.060+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x558bb45dbcc0 2024-05-09T09:48:38.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.060+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9d0037040 con 0x558bb45dbcc0 2024-05-09T09:48:38.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.060+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x558bb45d7420 2024-05-09T09:48:38.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.060+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.060+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.060+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9e000a4d0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.060+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x558bb45dbcc0 2024-05-09T09:48:38.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x558bb45d7420 2024-05-09T09:48:38.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x558bb45d2a80 2024-05-09T09:48:38.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558bb45d66c0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9e000a4d0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9ea1ff980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:48:38.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9ea1ff980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:48:38.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9ea1ff980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:48:38.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9ea1ff980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:48:38.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9ea1ff980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:48:38.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9ea1ff980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:48:38.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9ea1ff980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb45da5e0 con 0x558bb45d2a80 2024-05-09T09:48:38.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9ea1ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:38.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9ea1ff980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb45da5e0 con 0x558bb45d2a80 2024-05-09T09:48:38.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9ea1ff980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:38.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9ea1ff980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb45da5e0 con 0x558bb45dbcc0 2024-05-09T09:48:38.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9ea1ff980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:48:38.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9ea1ff980 20 zone default found 2024-05-09T09:48:38.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9ea1ff980 4 Realm: () 2024-05-09T09:48:38.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9ea1ff980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:48:38.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9ea1ff980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:48:38.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9ea1ff980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:48:38.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9ea1ff980 20 zonegroup default 2024-05-09T09:48:38.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9ea1ff980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb45dae80 con 0x558bb45d7420 2024-05-09T09:48:38.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9ea1ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:38.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9ea1ff980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb45e06b0 con 0x558bb45dbcc0 2024-05-09T09:48:38.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9ea1ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:38.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9ea1ff980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.064+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb45e0a50 con 0x558bb45dbcc0 2024-05-09T09:48:38.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.068+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.068+0000 7ff9ea1ff980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:38.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.068+0000 7ff9ea1ff980 20 started sync module instance, tier type = 2024-05-09T09:48:38.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.068+0000 7ff9ea1ff980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:48:38.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.068+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45dfb50 con 0x7ff9d001fbe0 2024-05-09T09:48:38.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.068+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.068+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94058514874480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45dfb50 con 0x7ff9d001fbe0 2024-05-09T09:48:38.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.068+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45e1480 con 0x558bb45d2a80 2024-05-09T09:48:38.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.068+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94058514874480] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.068+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.068+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94058514871968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45e1480 con 0x558bb45d2a80 2024-05-09T09:48:38.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.068+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45e1e40 con 0x558bb45dbcc0 2024-05-09T09:48:38.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.072+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94058514871968] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.072+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.072+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94058514878416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45e13f0 con 0x558bb45dbcc0 2024-05-09T09:48:38.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.072+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45e2be0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.072+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.072+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94058514884368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45e3480 con 0x7ff9d001fbe0 2024-05-09T09:48:38.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.072+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45e3e40 con 0x558bb45d2a80 2024-05-09T09:48:38.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.076+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94058514878416] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.076+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94058514884368] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.076+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.076+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94058514889104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45e3db0 con 0x558bb45d2a80 2024-05-09T09:48:38.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.076+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45e33e0 con 0x558bb45d7420 2024-05-09T09:48:38.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.076+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94058514889104] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.076+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.076+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94058514886448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45e46e0 con 0x558bb45d7420 2024-05-09T09:48:38.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.076+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45e4f70 con 0x558bb45d7420 2024-05-09T09:48:38.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.080+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.080+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94058514886448] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.080+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94058514893440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45e42f0 con 0x558bb45d7420 2024-05-09T09:48:38.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.080+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45e5d10 con 0x558bb45d7420 2024-05-09T09:48:38.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.084+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94058514893440] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.084+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.084+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94058514896832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45e5cd0 con 0x558bb45d7420 2024-05-09T09:48:38.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.084+0000 7ff9ea1ff980 20 add_watcher() i=0 2024-05-09T09:48:38.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.084+0000 7ff9ea1ff980 20 add_watcher() i=1 2024-05-09T09:48:38.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.084+0000 7ff9ea1ff980 20 add_watcher() i=2 2024-05-09T09:48:38.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.084+0000 7ff9ea1ff980 20 add_watcher() i=3 2024-05-09T09:48:38.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.084+0000 7ff9ea1ff980 20 add_watcher() i=4 2024-05-09T09:48:38.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.084+0000 7ff9ea1ff980 20 add_watcher() i=5 2024-05-09T09:48:38.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.084+0000 7ff9ea1ff980 20 add_watcher() i=6 2024-05-09T09:48:38.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.084+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94058514896832] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.084+0000 7ff9ea1ff980 20 add_watcher() i=7 2024-05-09T09:48:38.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.084+0000 7ff9ea1ff980 2 all 8 watchers are set, enabling cache 2024-05-09T09:48:38.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.084+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb45e9160 con 0x558bb45d2a80 2024-05-09T09:48:38.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.084+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.084+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94058514895184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45e6680 con 0x558bb45d2a80 2024-05-09T09:48:38.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.088+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94058514895184] v32'345 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.088+0000 7ff89cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:38.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.088+0000 7ff9ea1ff980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:48:38.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.088+0000 7ff9ea1ff980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:48:38.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.088+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45f17c0 con 0x558bb45d2a80 2024-05-09T09:48:38.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.088+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'82 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.088+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45f1d30 con 0x558bb45d7420 2024-05-09T09:48:38.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.092+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'76 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.092+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45f1d30 con 0x558bb45dbcc0 2024-05-09T09:48:38.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.092+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'75 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.092+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45f2640 con 0x558bb45d2a80 2024-05-09T09:48:38.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.092+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'346 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.092+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45ef830 con 0x7ff9d001fbe0 2024-05-09T09:48:38.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.096+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'215 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.096+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45ef830 con 0x558bb45dbcc0 2024-05-09T09:48:38.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.096+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'144 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.096+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45f3350 con 0x558bb45d2a80 2024-05-09T09:48:38.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.100+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'77 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.100+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45f3800 con 0x558bb45d7420 2024-05-09T09:48:38.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.100+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'143 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.100+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45f3800 con 0x7ff9d001fbe0 2024-05-09T09:48:38.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.104+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'75 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.104+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45f3800 con 0x558bb45dbcc0 2024-05-09T09:48:38.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.104+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'81 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.104+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45ee820 con 0x7ff9d001fbe0 2024-05-09T09:48:38.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.104+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'216 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.104+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45ee820 con 0x558bb45d7420 2024-05-09T09:48:38.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.108+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'79 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.108+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45ee820 con 0x7ff9d001fbe0 2024-05-09T09:48:38.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.108+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'75 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.108+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45ee110 con 0x558bb45d7420 2024-05-09T09:48:38.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.112+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'149 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.112+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45ee820 con 0x558bb45d2a80 2024-05-09T09:48:38.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.112+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'347 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.112+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45ee820 con 0x558bb45dbcc0 2024-05-09T09:48:38.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.116+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'209 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.116+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45ee820 con 0x7ff9d001fbe0 2024-05-09T09:48:38.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.116+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'217 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.116+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45ee820 con 0x558bb45dbcc0 2024-05-09T09:48:38.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.116+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'75 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.116+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45ee820 con 0x558bb45d2a80 2024-05-09T09:48:38.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.120+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'83 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.120+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45ee820 con 0x558bb45d2a80 2024-05-09T09:48:38.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.120+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'348 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.120+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45ee820 con 0x558bb45dbcc0 2024-05-09T09:48:38.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.124+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'210 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.124+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45ee8b0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.124+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'87 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.124+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45ee8b0 con 0x558bb45dbcc0 2024-05-09T09:48:38.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.124+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'77 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.124+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45ee8b0 con 0x558bb45dbcc0 2024-05-09T09:48:38.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.128+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'81 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.128+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45ee8b0 con 0x558bb45dbcc0 2024-05-09T09:48:38.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.128+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'72 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.128+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45ee8b0 con 0x558bb45dbcc0 2024-05-09T09:48:38.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.128+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'145 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.128+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45ee8b0 con 0x558bb45d7420 2024-05-09T09:48:38.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.132+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'77 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.132+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45ee8b0 con 0x558bb45dbcc0 2024-05-09T09:48:38.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.132+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'75 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.132+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45ee820 con 0x558bb45d7420 2024-05-09T09:48:38.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.136+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'144 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.136+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45ee820 con 0x558bb45dbcc0 2024-05-09T09:48:38.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.136+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'211 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.136+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45ee820 con 0x558bb45d7420 2024-05-09T09:48:38.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.140+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'150 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.140+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45ee820 con 0x7ff9d001fbe0 2024-05-09T09:48:38.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.144+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'81 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.144+0000 7ff8177fe640 20 reqs_thread_entry: start 2024-05-09T09:48:38.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.144+0000 7ff9ea1ff980 20 init_complete bucket index max shards: 11 2024-05-09T09:48:38.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.144+0000 7ff8157fa640 20 reqs_thread_entry: start 2024-05-09T09:48:38.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.144+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb46103a0 con 0x558bb45d2a80 2024-05-09T09:48:38.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.144+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.144+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:95 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb46103a0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.144+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(95 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.144+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb46103a0 con 0x558bb45d2a80 2024-05-09T09:48:38.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.144+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(96 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.144+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:97 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb46103a0 con 0x558bb45dbcc0 2024-05-09T09:48:38.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.144+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(97 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.144+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:98 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb46103a0 con 0x558bb45dbcc0 2024-05-09T09:48:38.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.144+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(98 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.144+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:99 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb46103a0 con 0x558bb45dbcc0 2024-05-09T09:48:38.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.144+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== osd_op_reply(99 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.144+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb46103a0 con 0x558bb45d2a80 2024-05-09T09:48:38.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.144+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(100 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.144+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:101 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb46103a0 con 0x558bb45d2a80 2024-05-09T09:48:38.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.144+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(101 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.144+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:102 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb46103a0 con 0x558bb45dbcc0 2024-05-09T09:48:38.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.144+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 30 ==== osd_op_reply(102 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.144+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:103 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb46103a0 con 0x558bb45dbcc0 2024-05-09T09:48:38.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.144+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 31 ==== osd_op_reply(103 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.144+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb46103a0 con 0x558bb45d7420 2024-05-09T09:48:38.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.148+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(104 usage.10 [call out=1378b] v0'0 uv77 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.148+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:105 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb4611460 con 0x558bb45d2a80 2024-05-09T09:48:38.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.148+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(105 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.148+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:106 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb4611460 con 0x7ff9d001fbe0 2024-05-09T09:48:38.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.148+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(106 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.148+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:107 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb4611460 con 0x558bb45dbcc0 2024-05-09T09:48:38.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.148+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 32 ==== osd_op_reply(107 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.148+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:108 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb4611460 con 0x558bb45d7420 2024-05-09T09:48:38.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.148+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(108 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.148+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:109 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb4611460 con 0x558bb45d7420 2024-05-09T09:48:38.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.148+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(109 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.148+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:110 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb4611460 con 0x558bb45dbcc0 2024-05-09T09:48:38.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.152+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 33 ==== osd_op_reply(110 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.152+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:111 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb4611460 con 0x558bb45d7420 2024-05-09T09:48:38.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.152+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(111 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.152+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:112 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb4611460 con 0x558bb45d2a80 2024-05-09T09:48:38.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.152+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(112 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.152+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:113 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb4611460 con 0x558bb45dbcc0 2024-05-09T09:48:38.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.152+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 34 ==== osd_op_reply(113 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.152+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:114 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb4611460 con 0x558bb45d7420 2024-05-09T09:48:38.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.152+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(114 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.152+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:115 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb4611460 con 0x7ff9d001fbe0 2024-05-09T09:48:38.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.152+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(115 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.152+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:116 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb4611460 con 0x558bb45d7420 2024-05-09T09:48:38.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.152+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(116 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.152+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:117 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb4611460 con 0x558bb45d2a80 2024-05-09T09:48:38.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.152+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(117 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.152+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:118 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb4611460 con 0x558bb45d2a80 2024-05-09T09:48:38.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.156+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(118 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.156+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:119 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb4611460 con 0x558bb45dbcc0 2024-05-09T09:48:38.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.156+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 35 ==== osd_op_reply(119 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.156+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:120 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb4611460 con 0x558bb45d2a80 2024-05-09T09:48:38.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.156+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(120 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.156+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:121 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb4611460 con 0x558bb45d2a80 2024-05-09T09:48:38.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.156+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 36 ==== osd_op_reply(121 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.156+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:122 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb4611460 con 0x558bb45dbcc0 2024-05-09T09:48:38.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.156+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 36 ==== osd_op_reply(122 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.156+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:123 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb4611460 con 0x558bb45dbcc0 2024-05-09T09:48:38.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.156+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 37 ==== osd_op_reply(123 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.156+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:124 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb4611460 con 0x558bb45dbcc0 2024-05-09T09:48:38.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.156+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 38 ==== osd_op_reply(124 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.156+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:125 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558bb4611460 con 0x558bb45d7420 2024-05-09T09:48:38.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.156+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(125 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.156+0000 7ff89cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:38.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.156+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:126 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94058514895184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45edf80 con 0x558bb45d2a80 2024-05-09T09:48:38.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.160+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 37 ==== osd_op_reply(126 data_loggenerations_metadata [watch unwatch cookie 94058514895184] v32'349 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.160+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:127 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94058514874480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45edf80 con 0x7ff9d001fbe0 2024-05-09T09:48:38.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.160+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(127 notify.0 [watch unwatch cookie 94058514874480] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.160+0000 7ff9ea1ff980 20 remove_watcher() i=0 2024-05-09T09:48:38.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.160+0000 7ff9ea1ff980 2 removed watcher, disabling cache 2024-05-09T09:48:38.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.160+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:128 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94058514871968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45e0070 con 0x558bb45d2a80 2024-05-09T09:48:38.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.164+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 38 ==== osd_op_reply(128 notify.1 [watch unwatch cookie 94058514871968] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.164+0000 7ff9ea1ff980 20 remove_watcher() i=1 2024-05-09T09:48:38.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.164+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:129 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94058514878416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45e0070 con 0x558bb45dbcc0 2024-05-09T09:48:38.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.164+0000 7ff9e7519640 1 -- 172.21.15.157:0/2402213563 <== osd.3 v2:172.21.15.157:6816/2487336710 39 ==== osd_op_reply(129 notify.2 [watch unwatch cookie 94058514878416] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9d0049040 con 0x558bb45dbcc0 2024-05-09T09:48:38.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.164+0000 7ff9ea1ff980 20 remove_watcher() i=2 2024-05-09T09:48:38.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.164+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:130 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94058514884368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45e0fd0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.168+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(130 notify.3 [watch unwatch cookie 94058514884368] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x7ff9d001fbe0 2024-05-09T09:48:38.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.168+0000 7ff9ea1ff980 20 remove_watcher() i=3 2024-05-09T09:48:38.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.168+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:131 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94058514889104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45e0070 con 0x558bb45d2a80 2024-05-09T09:48:38.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.168+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 <== osd.1 v2:172.21.15.157:6808/3930131338 39 ==== osd_op_reply(131 notify.4 [watch unwatch cookie 94058514889104] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9e000a4d0 con 0x558bb45d2a80 2024-05-09T09:48:38.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.168+0000 7ff9ea1ff980 20 remove_watcher() i=4 2024-05-09T09:48:38.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.168+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:132 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94058514886448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45e2710 con 0x558bb45d7420 2024-05-09T09:48:38.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.172+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 32 ==== osd_op_reply(132 notify.5 [watch unwatch cookie 94058514886448] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.172+0000 7ff9ea1ff980 20 remove_watcher() i=5 2024-05-09T09:48:38.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.172+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:133 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94058514893440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45e0fd0 con 0x558bb45d7420 2024-05-09T09:48:38.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.172+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 33 ==== osd_op_reply(133 notify.6 [watch unwatch cookie 94058514893440] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.172+0000 7ff9ea1ff980 20 remove_watcher() i=6 2024-05-09T09:48:38.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.172+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:134 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94058514896832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558bb45e3990 con 0x558bb45d7420 2024-05-09T09:48:38.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9e7d1a640 1 -- 172.21.15.157:0/2402213563 <== osd.0 v2:172.21.15.110:6800/231209037 34 ==== osd_op_reply(134 notify.7 [watch unwatch cookie 94058514896832] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9d810b050 con 0x558bb45d7420 2024-05-09T09:48:38.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 20 remove_watcher() i=7 2024-05-09T09:48:38.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558bb45d7420 msgr2=0x558bb45d9810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 --2- 172.21.15.157:0/2402213563 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558bb45d7420 0x558bb45d9810 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558bb45d2a80 msgr2=0x558bb45d4f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 --2- 172.21.15.157:0/2402213563 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558bb45d2a80 0x558bb45d4f20 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7ff9d001fbe0 msgr2=0x7ff9d003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 --2- 172.21.15.157:0/2402213563 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7ff9d001fbe0 0x7ff9d003a3c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558bb45dbcc0 msgr2=0x558bb45de180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 --2- 172.21.15.157:0/2402213563 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558bb45dbcc0 0x558bb45de180 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff8b0034b10 msgr2=0x7ff8b0036fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 --2- 172.21.15.157:0/2402213563 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff8b0034b10 0x7ff8b0036fd0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000c010 tx=0x7ff9d0010000 comp rx=0 tx=0).stop 2024-05-09T09:48:38.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb45bed60 msgr2=0x558bb45c6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 --2- 172.21.15.157:0/2402213563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb45bed60 0x558bb45c6160 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff9d80d0970 tx=0x7ff9d80c3ef0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 reap_dead start 2024-05-09T09:48:38.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9e851b640 1 -- 172.21.15.157:0/2402213563 reap_dead start 2024-05-09T09:48:38.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 shutdown_connections 2024-05-09T09:48:38.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 >> 172.21.15.157:0/2402213563 conn(0x558bb45bb0e0 msgr2=0x558bb45b8740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:38.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 shutdown_connections 2024-05-09T09:48:38.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/2402213563 wait complete. 2024-05-09T09:48:38.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/949605389 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff8c0034bb0 msgr2=0x7ff8c0037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 --2- 172.21.15.157:0/949605389 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff8c0034bb0 0x7ff8c0037070 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x558bb4583c60 tx=0x7ff9d000f000 comp rx=0 tx=0).stop 2024-05-09T09:48:38.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/949605389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb45b1fb0 msgr2=0x558bb45b23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 --2- 172.21.15.157:0/949605389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb45b1fb0 0x558bb45b23d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff9d80d1fd0 tx=0x7ff9d80c5660 comp rx=0 tx=0).stop 2024-05-09T09:48:38.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/949605389 shutdown_connections 2024-05-09T09:48:38.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 --2- 172.21.15.157:0/949605389 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff8c0034bb0 0x7ff8c0037070 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 --2- 172.21.15.157:0/949605389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb45b1fb0 0x558bb45b23d0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/949605389 >> 172.21.15.157:0/949605389 conn(0x558bb45a6d80 msgr2=0x558bb45a7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:38.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/949605389 shutdown_connections 2024-05-09T09:48:38.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/949605389 wait complete. 2024-05-09T09:48:38.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/1431951621 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558bb45856b0 msgr2=0x558bb4587aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 --2- 172.21.15.157:0/1431951621 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x558bb45856b0 0x558bb4587aa0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/1431951621 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558bb448cf20 msgr2=0x558bb4582d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 --2- 172.21.15.157:0/1431951621 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x558bb448cf20 0x558bb4582d10 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/1431951621 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558bb45895d0 msgr2=0x558bb458b9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 --2- 172.21.15.157:0/1431951621 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x558bb45895d0 0x558bb458b9c0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/1431951621 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff8d0034bb0 msgr2=0x7ff8d0037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 --2- 172.21.15.157:0/1431951621 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff8d0034bb0 0x7ff8d0037070 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0000f70 tx=0x7ff9d0001380 comp rx=0 tx=0).stop 2024-05-09T09:48:38.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/1431951621 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb43fba60 msgr2=0x558bb457bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 --2- 172.21.15.157:0/1431951621 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558bb43fba60 0x558bb457bd90 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8003070 tx=0x7ff9d80180e0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9e851b640 1 -- 172.21.15.157:0/1431951621 reap_dead start 2024-05-09T09:48:38.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/1431951621 shutdown_connections 2024-05-09T09:48:38.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/1431951621 >> 172.21.15.157:0/1431951621 conn(0x558bb44820c0 msgr2=0x558bb456f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:38.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/1431951621 shutdown_connections 2024-05-09T09:48:38.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.176+0000 7ff9ea1ff980 1 -- 172.21.15.157:0/1431951621 wait complete. 2024-05-09T09:48:38.192 INFO:teuthology.orchestra.run.smithi157.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-05-09T09:48:38.192 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-09T09:48:38.193 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-05-09T09:48:38.193 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-05-09T09:48:38.193 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-05-09T09:48:38.264 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:48:38.264 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:48:38.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.260+0000 7fbc3af25980 1 Processor -- start 2024-05-09T09:48:38.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.260+0000 7fbc3af25980 1 -- start start 2024-05-09T09:48:38.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.264+0000 7fbc3af25980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5604a4ab8e40 0x5604a4abb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.264+0000 7fbc3af25980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5604a496a440 con 0x5604a4ab4980 2024-05-09T09:48:38.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.264+0000 7fbc3af25980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5604a49555f0 con 0x5604a4ab8e40 2024-05-09T09:48:38.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.264+0000 7fbc3823f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5604a4ab8e40 0x5604a4abb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.264+0000 7fbc3823f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5604a4ab8e40 0x5604a4abb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59824/0 (socket says 172.21.15.157:59824) 2024-05-09T09:48:38.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.264+0000 7fbc3823f640 1 -- 172.21.15.157:0/2316884764 learned_addr learned my addr 172.21.15.157:0/2316884764 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:38.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.264+0000 7fbc3823f640 1 -- 172.21.15.157:0/2316884764 >> v1:172.21.15.110:6789/0 conn(0x5604a4ab4980 legacy=0x5604a4ab4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.264+0000 7fbc3823f640 1 -- 172.21.15.157:0/2316884764 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604a4960990 con 0x5604a4ab8e40 2024-05-09T09:48:38.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.264+0000 7fbc3823f640 1 --2- 172.21.15.157:0/2316884764 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4ab8e40 0x5604a4abb230 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00a5c0 tx=0x7fbc2c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57760bfbb042cb28 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.268+0000 7fbc37a3e640 1 -- 172.21.15.157:0/2316884764 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc2c0a6070 con 0x5604a4ab8e40 2024-05-09T09:48:38.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.268+0000 7fbc37a3e640 1 -- 172.21.15.157:0/2316884764 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc2c0af070 con 0x5604a4ab8e40 2024-05-09T09:48:38.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.268+0000 7fbc37a3e640 1 -- 172.21.15.157:0/2316884764 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc2c0aa5c0 con 0x5604a4ab8e40 2024-05-09T09:48:38.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.268+0000 7fbc3af25980 1 -- 172.21.15.157:0/2316884764 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4ab8e40 msgr2=0x5604a4abb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.268+0000 7fbc3af25980 1 --2- 172.21.15.157:0/2316884764 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4ab8e40 0x5604a4abb230 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00a5c0 tx=0x7fbc2c01b340 comp rx=0 tx=0).stop 2024-05-09T09:48:38.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.268+0000 7fbc3af25980 1 -- 172.21.15.157:0/2316884764 shutdown_connections 2024-05-09T09:48:38.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.268+0000 7fbc3af25980 1 --2- 172.21.15.157:0/2316884764 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4ab8e40 0x5604a4abb230 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.268+0000 7fbc3af25980 1 -- 172.21.15.157:0/2316884764 >> 172.21.15.157:0/2316884764 conn(0x5604a4ab0250 msgr2=0x5604a4ab2670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:38.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.268+0000 7fbc3af25980 1 -- 172.21.15.157:0/2316884764 shutdown_connections 2024-05-09T09:48:38.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.268+0000 7fbc3af25980 1 -- 172.21.15.157:0/2316884764 wait complete. 2024-05-09T09:48:38.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.284+0000 7fbc3af25980 1 Processor -- start 2024-05-09T09:48:38.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.284+0000 7fbc3af25980 1 -- start start 2024-05-09T09:48:38.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.284+0000 7fbc3af25980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4ab4980 0x5604a4b9faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.284+0000 7fbc3af25980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5604a49b7fe0 con 0x5604a4ab4980 2024-05-09T09:48:38.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.284+0000 7fbc38a40640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4ab4980 0x5604a4b9faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.284+0000 7fbc38a40640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4ab4980 0x5604a4b9faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59826/0 (socket says 172.21.15.157:59826) 2024-05-09T09:48:38.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.284+0000 7fbc38a40640 1 -- 172.21.15.157:0/2174346551 learned_addr learned my addr 172.21.15.157:0/2174346551 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:38.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.284+0000 7fbc38a40640 1 -- 172.21.15.157:0/2174346551 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604a493cae0 con 0x5604a4ab4980 2024-05-09T09:48:38.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.284+0000 7fbc38a40640 1 --2- 172.21.15.157:0/2174346551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4ab4980 0x5604a4b9faf0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fbc300016c0 tx=0x7fbc30001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed39933708fd785e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.284+0000 7fbb26e0d640 1 -- 172.21.15.157:0/2174346551 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc30016070 con 0x5604a4ab4980 2024-05-09T09:48:38.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.284+0000 7fbb26e0d640 1 -- 172.21.15.157:0/2174346551 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc3000f640 con 0x5604a4ab4980 2024-05-09T09:48:38.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.284+0000 7fbb26e0d640 1 -- 172.21.15.157:0/2174346551 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc3000f9a0 con 0x5604a4ab4980 2024-05-09T09:48:38.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.284+0000 7fbc3af25980 1 -- 172.21.15.157:0/2174346551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4ab4980 msgr2=0x5604a4b9faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.284+0000 7fbc3af25980 1 --2- 172.21.15.157:0/2174346551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4ab4980 0x5604a4b9faf0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fbc300016c0 tx=0x7fbc30001b80 comp rx=0 tx=0).stop 2024-05-09T09:48:38.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.284+0000 7fbc3af25980 1 -- 172.21.15.157:0/2174346551 shutdown_connections 2024-05-09T09:48:38.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.284+0000 7fbc3af25980 1 --2- 172.21.15.157:0/2174346551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4ab4980 0x5604a4b9faf0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.284+0000 7fbc3af25980 1 -- 172.21.15.157:0/2174346551 >> 172.21.15.157:0/2174346551 conn(0x5604a4ab0250 msgr2=0x5604a4b9b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:38.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.284+0000 7fbc3af25980 1 -- 172.21.15.157:0/2174346551 shutdown_connections 2024-05-09T09:48:38.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.284+0000 7fbc3af25980 1 -- 172.21.15.157:0/2174346551 wait complete. 2024-05-09T09:48:38.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.284+0000 7fbc3af25980 1 Processor -- start 2024-05-09T09:48:38.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.284+0000 7fbc3af25980 1 -- start start 2024-05-09T09:48:38.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.284+0000 7fbc3af25980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4ab4980 0x5604a4ba6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.284+0000 7fbc3af25980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5604a4abe260 con 0x5604a4ab4980 2024-05-09T09:48:38.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.288+0000 7fbc38a40640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4ab4980 0x5604a4ba6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.288+0000 7fbc38a40640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4ab4980 0x5604a4ba6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59840/0 (socket says 172.21.15.157:59840) 2024-05-09T09:48:38.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.288+0000 7fbc38a40640 1 -- 172.21.15.157:0/1451615250 learned_addr learned my addr 172.21.15.157:0/1451615250 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:38.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.288+0000 7fbc38a40640 1 -- 172.21.15.157:0/1451615250 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604a4ba72f0 con 0x5604a4ab4980 2024-05-09T09:48:38.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.288+0000 7fbc38a40640 1 --2- 172.21.15.157:0/1451615250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4ab4980 0x5604a4ba6db0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fbc3000f610 tx=0x7fbc30001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.288+0000 7fbb2560a640 1 -- 172.21.15.157:0/1451615250 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc30021020 con 0x5604a4ab4980 2024-05-09T09:48:38.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.288+0000 7fbb2560a640 1 -- 172.21.15.157:0/1451615250 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc30011770 con 0x5604a4ab4980 2024-05-09T09:48:38.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.288+0000 7fbc3af25980 1 -- 172.21.15.157:0/1451615250 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5604a4ba7580 con 0x5604a4ab4980 2024-05-09T09:48:38.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.288+0000 7fbb2560a640 1 -- 172.21.15.157:0/1451615250 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc30016040 con 0x5604a4ab4980 2024-05-09T09:48:38.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.288+0000 7fbc3af25980 1 -- 172.21.15.157:0/1451615250 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604a4baa210 con 0x5604a4ab4980 2024-05-09T09:48:38.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.288+0000 7fbb2560a640 1 -- 172.21.15.157:0/1451615250 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fbc30024020 con 0x5604a4ab4980 2024-05-09T09:48:38.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.288+0000 7fbb2560a640 1 --2- 172.21.15.157:0/1451615250 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb20034c00 0x7fbb200370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.288+0000 7fbb2560a640 1 -- 172.21.15.157:0/1451615250 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fbc30049fc0 con 0x5604a4ab4980 2024-05-09T09:48:38.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.288+0000 7fbc3823f640 1 --2- 172.21.15.157:0/1451615250 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb20034c00 0x7fbb200370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.288+0000 7fbc3af25980 1 --2- 172.21.15.157:0/1451615250 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5604a4ab8e40 0x5604a4badd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.288+0000 7fbc3af25980 1 -- 172.21.15.157:0/1451615250 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5604a4bae350 con 0x5604a4ab8e40 2024-05-09T09:48:38.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.288+0000 7fbc39241640 1 --2- 172.21.15.157:0/1451615250 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5604a4ab8e40 0x5604a4badd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.288+0000 7fbc3823f640 1 --2- 172.21.15.157:0/1451615250 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb20034c00 0x7fbb200370c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c0ae000 tx=0x7fbc2c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.288+0000 7fbc39241640 1 --2- 172.21.15.157:0/1451615250 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5604a4ab8e40 0x5604a4badd10 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.288+0000 7fbc39241640 1 -- 172.21.15.157:0/1451615250 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc280083f0 con 0x5604a4ab8e40 2024-05-09T09:48:38.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.288+0000 7fbc3af25980 1 -- 172.21.15.157:0/1451615250 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5604a4bab410 con 0x5604a4ab8e40 2024-05-09T09:48:38.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.292+0000 7fbc39241640 1 -- 172.21.15.157:0/1451615250 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbc280083f0 con 0x5604a4ab8e40 2024-05-09T09:48:38.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.292+0000 7fbc3af25980 1 --2- 172.21.15.157:0/1451615250 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5604a4bb0680 0x5604a4bb2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.292+0000 7fbc3af25980 1 -- 172.21.15.157:0/1451615250 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5604a4bb3140 con 0x5604a4bb0680 2024-05-09T09:48:38.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.292+0000 7fbc38a40640 1 --2- 172.21.15.157:0/1451615250 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5604a4bb0680 0x5604a4bb2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.292+0000 7fbc38a40640 1 --2- 172.21.15.157:0/1451615250 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5604a4bb0680 0x5604a4bb2a70 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.292+0000 7fbc38a40640 1 -- 172.21.15.157:0/1451615250 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbc3000f070 con 0x5604a4bb0680 2024-05-09T09:48:38.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.292+0000 7fbc3af25980 1 -- 172.21.15.157:0/1451615250 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5604a4baf520 con 0x5604a4ab8e40 2024-05-09T09:48:38.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.292+0000 7fbc39241640 1 -- 172.21.15.157:0/1451615250 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbc280083f0 con 0x5604a4ab8e40 2024-05-09T09:48:38.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.292+0000 7fbc3af25980 1 --2- 172.21.15.157:0/1451615250 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5604a4bb4580 0x5604a4bb6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.292+0000 7fbc3af25980 1 -- 172.21.15.157:0/1451615250 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5604a4bb7100 con 0x5604a4bb4580 2024-05-09T09:48:38.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.292+0000 7fbc3823f640 1 --2- 172.21.15.157:0/1451615250 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5604a4bb4580 0x5604a4bb6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.292+0000 7fbc3823f640 1 --2- 172.21.15.157:0/1451615250 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5604a4bb4580 0x5604a4bb6970 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.292+0000 7fbc3823f640 1 -- 172.21.15.157:0/1451615250 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbc2c0aaa50 con 0x5604a4bb4580 2024-05-09T09:48:38.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.296+0000 7fbc3af25980 1 Processor -- start 2024-05-09T09:48:38.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.296+0000 7fbc3af25980 1 -- start start 2024-05-09T09:48:38.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.296+0000 7fbc3af25980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4bdcf40 0x5604a4bdd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.296+0000 7fbc3af25980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5604a49bc020 con 0x5604a4bdcf40 2024-05-09T09:48:38.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.300+0000 7fbc38a40640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4bdcf40 0x5604a4bdd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.300+0000 7fbc38a40640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4bdcf40 0x5604a4bdd360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59846/0 (socket says 172.21.15.157:59846) 2024-05-09T09:48:38.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.300+0000 7fbc38a40640 1 -- 172.21.15.157:0/4143727893 learned_addr learned my addr 172.21.15.157:0/4143727893 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:38.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.300+0000 7fbc38a40640 1 -- 172.21.15.157:0/4143727893 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604a4bdd8a0 con 0x5604a4bdcf40 2024-05-09T09:48:38.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.300+0000 7fbc38a40640 1 --2- 172.21.15.157:0/4143727893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4bdcf40 0x5604a4bdd360 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fbc30048280 tx=0x7fbc30025bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.300+0000 7fbb1d39f640 1 -- 172.21.15.157:0/4143727893 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc30010cc0 con 0x5604a4bdcf40 2024-05-09T09:48:38.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.300+0000 7fbb1d39f640 1 -- 172.21.15.157:0/4143727893 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc3002d300 con 0x5604a4bdcf40 2024-05-09T09:48:38.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.300+0000 7fbb1d39f640 1 -- 172.21.15.157:0/4143727893 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc30010e60 con 0x5604a4bdcf40 2024-05-09T09:48:38.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.300+0000 7fbc3af25980 1 -- 172.21.15.157:0/4143727893 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5604a4bde330 con 0x5604a4bdcf40 2024-05-09T09:48:38.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.300+0000 7fbc3af25980 1 -- 172.21.15.157:0/4143727893 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604a4bde810 con 0x5604a4bdcf40 2024-05-09T09:48:38.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.300+0000 7fbb1d39f640 1 -- 172.21.15.157:0/4143727893 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fbc3002d5e0 con 0x5604a4bdcf40 2024-05-09T09:48:38.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.300+0000 7fbb1d39f640 1 --2- 172.21.15.157:0/4143727893 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb10034c50 0x7fbb10037110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.300+0000 7fbb1d39f640 1 -- 172.21.15.157:0/4143727893 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fbc300460e0 con 0x5604a4bdcf40 2024-05-09T09:48:38.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.300+0000 7fbc3823f640 1 --2- 172.21.15.157:0/4143727893 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb10034c50 0x7fbb10037110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.304+0000 7fbc3af25980 1 Processor -- start 2024-05-09T09:48:38.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.304+0000 7fbc3af25980 1 -- start start 2024-05-09T09:48:38.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.304+0000 7fbc3823f640 1 --2- 172.21.15.157:0/4143727893 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb10034c50 0x7fbb10037110 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c017f50 tx=0x7fbc2c005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.304+0000 7fbc3af25980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4a2afe0 0x5604a4a2b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.304+0000 7fbc3af25980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5604a4ba0240 con 0x5604a4a2afe0 2024-05-09T09:48:38.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.304+0000 7fbc38a40640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4a2afe0 0x5604a4a2b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.304+0000 7fbc38a40640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4a2afe0 0x5604a4a2b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59856/0 (socket says 172.21.15.157:59856) 2024-05-09T09:48:38.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.304+0000 7fbc38a40640 1 -- 172.21.15.157:0/3557070193 learned_addr learned my addr 172.21.15.157:0/3557070193 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:38.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.304+0000 7fbc38a40640 1 -- 172.21.15.157:0/3557070193 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604a4a29800 con 0x5604a4a2afe0 2024-05-09T09:48:38.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.304+0000 7fbc38a40640 1 --2- 172.21.15.157:0/3557070193 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4a2afe0 0x5604a4a2b400 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fbc3001cdf0 tx=0x7fbc3004dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82600948d4ae218 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.304+0000 7fbb16ffd640 1 -- 172.21.15.157:0/3557070193 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc300103a0 con 0x5604a4a2afe0 2024-05-09T09:48:38.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.304+0000 7fbb16ffd640 1 -- 172.21.15.157:0/3557070193 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc3005d070 con 0x5604a4a2afe0 2024-05-09T09:48:38.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.304+0000 7fbb16ffd640 1 -- 172.21.15.157:0/3557070193 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc3002d980 con 0x5604a4a2afe0 2024-05-09T09:48:38.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.304+0000 7fbc3af25980 1 -- 172.21.15.157:0/3557070193 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4a2afe0 msgr2=0x5604a4a2b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.304+0000 7fbc3af25980 1 --2- 172.21.15.157:0/3557070193 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4a2afe0 0x5604a4a2b400 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fbc3001cdf0 tx=0x7fbc3004dcf0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.304+0000 7fbc3af25980 1 -- 172.21.15.157:0/3557070193 shutdown_connections 2024-05-09T09:48:38.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.304+0000 7fbc3af25980 1 --2- 172.21.15.157:0/3557070193 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4a2afe0 0x5604a4a2b400 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.304+0000 7fbc3af25980 1 -- 172.21.15.157:0/3557070193 >> 172.21.15.157:0/3557070193 conn(0x5604a4be6290 msgr2=0x5604a4be42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:38.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.304+0000 7fbc3af25980 1 -- 172.21.15.157:0/3557070193 shutdown_connections 2024-05-09T09:48:38.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.304+0000 7fbc3af25980 1 -- 172.21.15.157:0/3557070193 wait complete. 2024-05-09T09:48:38.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.304+0000 7fbc3af25980 1 Processor -- start 2024-05-09T09:48:38.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.304+0000 7fbc3af25980 1 -- start start 2024-05-09T09:48:38.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.304+0000 7fbc3af25980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4a2afe0 0x5604a4bf3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.304+0000 7fbc3af25980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5604a4a29c10 con 0x5604a4a2afe0 2024-05-09T09:48:38.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.304+0000 7fbc38a40640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4a2afe0 0x5604a4bf3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.304+0000 7fbc38a40640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4a2afe0 0x5604a4bf3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59864/0 (socket says 172.21.15.157:59864) 2024-05-09T09:48:38.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.304+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 learned_addr learned my addr 172.21.15.157:0/4167096428 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:38.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.308+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604a4bf39b0 con 0x5604a4a2afe0 2024-05-09T09:48:38.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.308+0000 7fbc38a40640 1 --2- 172.21.15.157:0/4167096428 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4a2afe0 0x5604a4bf3470 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fbc3003a5d0 tx=0x7fbc30031f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.308+0000 7fbb157fa640 1 -- 172.21.15.157:0/4167096428 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc3004d600 con 0x5604a4a2afe0 2024-05-09T09:48:38.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.308+0000 7fbb157fa640 1 -- 172.21.15.157:0/4167096428 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc3004d7a0 con 0x5604a4a2afe0 2024-05-09T09:48:38.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.308+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5604a4bf39b0 con 0x5604a4a2afe0 2024-05-09T09:48:38.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.308+0000 7fbb157fa640 1 -- 172.21.15.157:0/4167096428 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc3001c530 con 0x5604a4a2afe0 2024-05-09T09:48:38.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.308+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604a4bf39b0 con 0x5604a4a2afe0 2024-05-09T09:48:38.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.308+0000 7fbb157fa640 1 -- 172.21.15.157:0/4167096428 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fbc30073060 con 0x5604a4a2afe0 2024-05-09T09:48:38.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.308+0000 7fbc3af25980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.308+0000 7fbb157fa640 1 --2- 172.21.15.157:0/4167096428 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb00034bb0 0x7fbb00037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.308+0000 7fbb157fa640 1 -- 172.21.15.157:0/4167096428 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fbc30063d90 con 0x5604a4a2afe0 2024-05-09T09:48:38.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.308+0000 7fbc3823f640 1 --2- 172.21.15.157:0/4167096428 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb00034bb0 0x7fbb00037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.308+0000 7fbc3af25980 1 --2- 172.21.15.157:0/4167096428 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5604a4c00010 0x5604a4c024d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.308+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c02c20 con 0x5604a4c00010 2024-05-09T09:48:38.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.308+0000 7fbc39241640 1 --2- 172.21.15.157:0/4167096428 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5604a4c00010 0x5604a4c024d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.308+0000 7fbc3823f640 1 --2- 172.21.15.157:0/4167096428 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb00034bb0 0x7fbb00037070 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c0ac040 tx=0x7fbc2c0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.308+0000 7fbc39241640 1 --2- 172.21.15.157:0/4167096428 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5604a4c00010 0x5604a4c024d0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.308+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc280083f0 con 0x5604a4c00010 2024-05-09T09:48:38.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.308+0000 7fbc3af25980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:38.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.308+0000 7fbc3af25980 20 realm 2024-05-09T09:48:38.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.308+0000 7fbc3af25980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.308+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03030 con 0x5604a4c00010 2024-05-09T09:48:38.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.308+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc280083f0 con 0x5604a4c00010 2024-05-09T09:48:38.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.308+0000 7fbc3af25980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:38.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.308+0000 7fbc3af25980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:48:38.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.312+0000 7fbc3af25980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.312+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c038d0 con 0x5604a4c00010 2024-05-09T09:48:38.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.312+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc280083f0 con 0x5604a4c00010 2024-05-09T09:48:38.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.312+0000 7fbc3af25980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:38.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.312+0000 7fbc3af25980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.312+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x5604a4c00010 2024-05-09T09:48:38.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.312+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbc280083f0 con 0x5604a4c00010 2024-05-09T09:48:38.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.312+0000 7fbc3af25980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:38.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.312+0000 7fbc3af25980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.312+0000 7fbc3af25980 1 --2- 172.21.15.157:0/4167096428 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5604a4c049d0 0x5604a4c06dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.312+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c07340 con 0x5604a4c049d0 2024-05-09T09:48:38.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.312+0000 7fbc38a40640 1 --2- 172.21.15.157:0/4167096428 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5604a4c049d0 0x5604a4c06dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.312+0000 7fbc38a40640 1 --2- 172.21.15.157:0/4167096428 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5604a4c049d0 0x5604a4c06dc0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.312+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbc3000f070 con 0x5604a4c049d0 2024-05-09T09:48:38.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.312+0000 7fbc3af25980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:48:38.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.312+0000 7fbc3af25980 20 searching for the correct realm 2024-05-09T09:48:38.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.312+0000 7fbc3af25980 1 --2- 172.21.15.157:0/4167096428 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5604a4c092b0 0x5604a4c0b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.312+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c0be40 con 0x5604a4c092b0 2024-05-09T09:48:38.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.312+0000 7fbc3823f640 1 --2- 172.21.15.157:0/4167096428 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5604a4c092b0 0x5604a4c0b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.312+0000 7fbc3823f640 1 --2- 172.21.15.157:0/4167096428 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5604a4c092b0 0x5604a4c0b770 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.312+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc2c0aaa50 con 0x5604a4c092b0 2024-05-09T09:48:38.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.312+0000 7fbc3823f640 1 --2- 172.21.15.157:0/4167096428 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fbc2c0e0040 0x7fbc2c0e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.312+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c0be40 con 0x7fbc2c0e0040 2024-05-09T09:48:38.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.312+0000 7fbc39241640 1 --2- 172.21.15.157:0/4167096428 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fbc2c0e0040 0x7fbc2c0e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.316+0000 7fbc39241640 1 --2- 172.21.15.157:0/4167096428 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fbc2c0e0040 0x7fbc2c0e0420 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.316+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc280083f0 con 0x7fbc2c0e0040 2024-05-09T09:48:38.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.316+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x5604a4c049d0 2024-05-09T09:48:38.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.316+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc3000f070 con 0x5604a4c049d0 2024-05-09T09:48:38.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.316+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x5604a4c00010 2024-05-09T09:48:38.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.316+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc280083f0 con 0x5604a4c00010 2024-05-09T09:48:38.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.316+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x5604a4c00010 2024-05-09T09:48:38.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.316+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc28026040 con 0x5604a4c00010 2024-05-09T09:48:38.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.316+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x5604a4c049d0 2024-05-09T09:48:38.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.316+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc3000f070 con 0x5604a4c049d0 2024-05-09T09:48:38.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.316+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x5604a4c049d0 2024-05-09T09:48:38.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.316+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc3000f070 con 0x5604a4c049d0 2024-05-09T09:48:38.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.316+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x7fbc2c0e0040 2024-05-09T09:48:38.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.316+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc28026040 con 0x7fbc2c0e0040 2024-05-09T09:48:38.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.316+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x5604a4c092b0 2024-05-09T09:48:38.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.316+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc2c0aaa50 con 0x5604a4c092b0 2024-05-09T09:48:38.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.316+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x5604a4c00010 2024-05-09T09:48:38.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.316+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc28026040 con 0x5604a4c00010 2024-05-09T09:48:38.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.316+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x5604a4c049d0 2024-05-09T09:48:38.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.320+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc3000f070 con 0x5604a4c049d0 2024-05-09T09:48:38.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.320+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x5604a4c00010 2024-05-09T09:48:38.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.320+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc28026040 con 0x5604a4c00010 2024-05-09T09:48:38.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.320+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x7fbc2c0e0040 2024-05-09T09:48:38.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.320+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbc28026040 con 0x7fbc2c0e0040 2024-05-09T09:48:38.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.320+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x5604a4c092b0 2024-05-09T09:48:38.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.320+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc2c0aaa50 con 0x5604a4c092b0 2024-05-09T09:48:38.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.320+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x5604a4c092b0 2024-05-09T09:48:38.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.320+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbc2c0aaa50 con 0x5604a4c092b0 2024-05-09T09:48:38.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.320+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x5604a4c049d0 2024-05-09T09:48:38.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.320+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc3000f070 con 0x5604a4c049d0 2024-05-09T09:48:38.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.320+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x5604a4c092b0 2024-05-09T09:48:38.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.320+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc2c0aaa50 con 0x5604a4c092b0 2024-05-09T09:48:38.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.320+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x5604a4c092b0 2024-05-09T09:48:38.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.320+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc2c0aaa50 con 0x5604a4c092b0 2024-05-09T09:48:38.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.320+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x5604a4c00010 2024-05-09T09:48:38.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.320+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc28026040 con 0x5604a4c00010 2024-05-09T09:48:38.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.320+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x5604a4c00010 2024-05-09T09:48:38.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.320+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbc28026040 con 0x5604a4c00010 2024-05-09T09:48:38.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.320+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x5604a4c049d0 2024-05-09T09:48:38.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.324+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc3000f070 con 0x5604a4c049d0 2024-05-09T09:48:38.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.324+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x5604a4c092b0 2024-05-09T09:48:38.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.324+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc2c0aaa50 con 0x5604a4c092b0 2024-05-09T09:48:38.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.324+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x7fbc2c0e0040 2024-05-09T09:48:38.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.324+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc28026040 con 0x7fbc2c0e0040 2024-05-09T09:48:38.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.324+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x5604a4c00010 2024-05-09T09:48:38.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.324+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc28026040 con 0x5604a4c00010 2024-05-09T09:48:38.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.324+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x5604a4c049d0 2024-05-09T09:48:38.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.324+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbc3000f070 con 0x5604a4c049d0 2024-05-09T09:48:38.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.324+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x5604a4c092b0 2024-05-09T09:48:38.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.324+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc2c0aaa50 con 0x5604a4c092b0 2024-05-09T09:48:38.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.324+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x5604a4c049d0 2024-05-09T09:48:38.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.324+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc3000f070 con 0x5604a4c049d0 2024-05-09T09:48:38.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.324+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x7fbc2c0e0040 2024-05-09T09:48:38.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.324+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc28026040 con 0x7fbc2c0e0040 2024-05-09T09:48:38.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.324+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x5604a4c092b0 2024-05-09T09:48:38.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.324+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc2c0aaa50 con 0x5604a4c092b0 2024-05-09T09:48:38.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.324+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x5604a4c049d0 2024-05-09T09:48:38.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc3000f070 con 0x5604a4c049d0 2024-05-09T09:48:38.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x5604a4c00010 2024-05-09T09:48:38.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbc28026040 con 0x5604a4c00010 2024-05-09T09:48:38.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c03c70 con 0x7fbc2c0e0040 2024-05-09T09:48:38.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc28026040 con 0x7fbc2c0e0040 2024-05-09T09:48:38.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:48:38.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:48:38.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:48:38.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:48:38.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:48:38.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:48:38.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c07b90 con 0x5604a4c00010 2024-05-09T09:48:38.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc28026040 con 0x5604a4c00010 2024-05-09T09:48:38.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:38.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c07b90 con 0x5604a4c00010 2024-05-09T09:48:38.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbc28026040 con 0x5604a4c00010 2024-05-09T09:48:38.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:38.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c07b90 con 0x5604a4c092b0 2024-05-09T09:48:38.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbc2c0aaa50 con 0x5604a4c092b0 2024-05-09T09:48:38.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:48:38.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 20 zone default found 2024-05-09T09:48:38.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 4 Realm: () 2024-05-09T09:48:38.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:48:38.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:48:38.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:48:38.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 20 zonegroup default 2024-05-09T09:48:38.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c08430 con 0x5604a4c049d0 2024-05-09T09:48:38.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbc3000f070 con 0x5604a4c049d0 2024-05-09T09:48:38.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:38.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c0dca0 con 0x5604a4c092b0 2024-05-09T09:48:38.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbc2c0aaa50 con 0x5604a4c092b0 2024-05-09T09:48:38.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:38.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c0e040 con 0x5604a4c092b0 2024-05-09T09:48:38.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbc2c0aaa50 con 0x5604a4c092b0 2024-05-09T09:48:38.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:38.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 20 started sync module instance, tier type = 2024-05-09T09:48:38.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:48:38.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.328+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c0d140 con 0x7fbc2c0e0040 2024-05-09T09:48:38.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.332+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc28026040 con 0x7fbc2c0e0040 2024-05-09T09:48:38.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.332+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94577943959104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c0d140 con 0x7fbc2c0e0040 2024-05-09T09:48:38.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.332+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c0ea00 con 0x5604a4c00010 2024-05-09T09:48:38.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.332+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94577943959104] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc28036040 con 0x7fbc2c0e0040 2024-05-09T09:48:38.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.332+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc28036040 con 0x5604a4c00010 2024-05-09T09:48:38.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.332+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94577943956896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c0ea00 con 0x5604a4c00010 2024-05-09T09:48:38.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.332+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c0f3c0 con 0x5604a4c092b0 2024-05-09T09:48:38.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.336+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94577943956896] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc28036040 con 0x5604a4c00010 2024-05-09T09:48:38.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.336+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc2c0aaa50 con 0x5604a4c092b0 2024-05-09T09:48:38.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.336+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94577943962960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c0e970 con 0x5604a4c092b0 2024-05-09T09:48:38.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.336+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c10120 con 0x7fbc2c0e0040 2024-05-09T09:48:38.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.336+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc28036040 con 0x7fbc2c0e0040 2024-05-09T09:48:38.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.336+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94577943968784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c109c0 con 0x7fbc2c0e0040 2024-05-09T09:48:38.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.336+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c113c0 con 0x5604a4c00010 2024-05-09T09:48:38.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.336+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94577943962960] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc2c0aaa50 con 0x5604a4c092b0 2024-05-09T09:48:38.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.340+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94577943968784] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc28036040 con 0x7fbc2c0e0040 2024-05-09T09:48:38.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.340+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc28036040 con 0x5604a4c00010 2024-05-09T09:48:38.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.340+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94577943967584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c104c0 con 0x5604a4c00010 2024-05-09T09:48:38.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.340+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c11c60 con 0x5604a4c049d0 2024-05-09T09:48:38.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.340+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc3000f070 con 0x5604a4c049d0 2024-05-09T09:48:38.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.340+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94577943975856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c104c0 con 0x5604a4c049d0 2024-05-09T09:48:38.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.340+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c12ad0 con 0x5604a4c049d0 2024-05-09T09:48:38.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.340+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94577943967584] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc28036040 con 0x5604a4c00010 2024-05-09T09:48:38.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.344+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94577943975856] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc3000f070 con 0x5604a4c049d0 2024-05-09T09:48:38.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.344+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc3000f070 con 0x5604a4c049d0 2024-05-09T09:48:38.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.344+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94577943977984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c12620 con 0x5604a4c049d0 2024-05-09T09:48:38.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.344+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c12eb0 con 0x5604a4c049d0 2024-05-09T09:48:38.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.344+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc3000f070 con 0x5604a4c049d0 2024-05-09T09:48:38.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.344+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94577943977984] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc3000f070 con 0x5604a4c049d0 2024-05-09T09:48:38.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.344+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94577943979552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c130b0 con 0x5604a4c049d0 2024-05-09T09:48:38.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.344+0000 7fbc3af25980 20 add_watcher() i=0 2024-05-09T09:48:38.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.344+0000 7fbc3af25980 20 add_watcher() i=1 2024-05-09T09:48:38.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.344+0000 7fbc3af25980 20 add_watcher() i=2 2024-05-09T09:48:38.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.344+0000 7fbc3af25980 20 add_watcher() i=3 2024-05-09T09:48:38.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.344+0000 7fbc3af25980 20 add_watcher() i=4 2024-05-09T09:48:38.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.344+0000 7fbc3af25980 20 add_watcher() i=5 2024-05-09T09:48:38.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.344+0000 7fbc3af25980 20 add_watcher() i=6 2024-05-09T09:48:38.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.348+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94577943979552] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc3000f070 con 0x5604a4c049d0 2024-05-09T09:48:38.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.348+0000 7fbc3af25980 20 add_watcher() i=7 2024-05-09T09:48:38.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.348+0000 7fbc3af25980 2 all 8 watchers are set, enabling cache 2024-05-09T09:48:38.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.348+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c164f0 con 0x5604a4c00010 2024-05-09T09:48:38.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.348+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbc28036040 con 0x5604a4c00010 2024-05-09T09:48:38.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.348+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94577943982096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c138e0 con 0x5604a4c00010 2024-05-09T09:48:38.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.348+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94577943982096] v32'350 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbc28036040 con 0x5604a4c00010 2024-05-09T09:48:38.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.348+0000 7fbaedfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:38.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.348+0000 7fbc3af25980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:48:38.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.348+0000 7fbc3af25980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:48:38.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.348+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c1e930 con 0x5604a4c00010 2024-05-09T09:48:38.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.352+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'83 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc28036040 con 0x5604a4c00010 2024-05-09T09:48:38.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.352+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c1ef40 con 0x5604a4c049d0 2024-05-09T09:48:38.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.352+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'77 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc3000f070 con 0x5604a4c049d0 2024-05-09T09:48:38.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.352+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c1ef40 con 0x5604a4c092b0 2024-05-09T09:48:38.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.356+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'76 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc2c0aaa50 con 0x5604a4c092b0 2024-05-09T09:48:38.358 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.356+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c1f3a0 con 0x5604a4c00010 2024-05-09T09:48:38.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.356+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'351 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc28036040 con 0x5604a4c00010 2024-05-09T09:48:38.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.356+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c1f910 con 0x7fbc2c0e0040 2024-05-09T09:48:38.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.356+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'218 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc28036040 con 0x7fbc2c0e0040 2024-05-09T09:48:38.361 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.356+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c1fd50 con 0x5604a4c092b0 2024-05-09T09:48:38.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.360+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'146 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc2c0aaa50 con 0x5604a4c092b0 2024-05-09T09:48:38.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.360+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c202c0 con 0x5604a4c00010 2024-05-09T09:48:38.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.360+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'78 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc28036040 con 0x5604a4c00010 2024-05-09T09:48:38.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.360+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c202c0 con 0x5604a4c049d0 2024-05-09T09:48:38.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.364+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'145 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc3000f070 con 0x5604a4c049d0 2024-05-09T09:48:38.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.364+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c20350 con 0x7fbc2c0e0040 2024-05-09T09:48:38.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.364+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'76 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc28036040 con 0x7fbc2c0e0040 2024-05-09T09:48:38.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.364+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c20350 con 0x5604a4c092b0 2024-05-09T09:48:38.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.368+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'82 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc2c0aaa50 con 0x5604a4c092b0 2024-05-09T09:48:38.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.368+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c20940 con 0x7fbc2c0e0040 2024-05-09T09:48:38.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.368+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'219 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc28036040 con 0x7fbc2c0e0040 2024-05-09T09:48:38.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.368+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c20920 con 0x5604a4c049d0 2024-05-09T09:48:38.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.372+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'80 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc3000f070 con 0x5604a4c049d0 2024-05-09T09:48:38.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.372+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c20920 con 0x7fbc2c0e0040 2024-05-09T09:48:38.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.372+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'76 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc28036040 con 0x7fbc2c0e0040 2024-05-09T09:48:38.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.372+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c20920 con 0x5604a4c049d0 2024-05-09T09:48:38.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.376+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'151 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc3000f070 con 0x5604a4c049d0 2024-05-09T09:48:38.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.376+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c20920 con 0x5604a4c00010 2024-05-09T09:48:38.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.376+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'352 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc28036040 con 0x5604a4c00010 2024-05-09T09:48:38.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.376+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c20920 con 0x5604a4c092b0 2024-05-09T09:48:38.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.380+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'212 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc2c0aaa50 con 0x5604a4c092b0 2024-05-09T09:48:38.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.380+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c209b0 con 0x7fbc2c0e0040 2024-05-09T09:48:38.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.380+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'220 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc28036040 con 0x7fbc2c0e0040 2024-05-09T09:48:38.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.380+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c209b0 con 0x5604a4c092b0 2024-05-09T09:48:38.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.380+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'76 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc2c0aaa50 con 0x5604a4c092b0 2024-05-09T09:48:38.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.380+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c20a40 con 0x5604a4c00010 2024-05-09T09:48:38.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.384+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'84 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc28036040 con 0x5604a4c00010 2024-05-09T09:48:38.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.384+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c20a40 con 0x5604a4c00010 2024-05-09T09:48:38.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.384+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'353 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc28036040 con 0x5604a4c00010 2024-05-09T09:48:38.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.384+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c20a40 con 0x5604a4c092b0 2024-05-09T09:48:38.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.388+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'213 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc2c0aaa50 con 0x5604a4c092b0 2024-05-09T09:48:38.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.388+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c20ad0 con 0x7fbc2c0e0040 2024-05-09T09:48:38.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.388+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'88 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc28036040 con 0x7fbc2c0e0040 2024-05-09T09:48:38.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.388+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c20ad0 con 0x5604a4c092b0 2024-05-09T09:48:38.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.392+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'78 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc2c0aaa50 con 0x5604a4c092b0 2024-05-09T09:48:38.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.392+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c20ad0 con 0x5604a4c092b0 2024-05-09T09:48:38.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.392+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'82 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc2c0aaa50 con 0x5604a4c092b0 2024-05-09T09:48:38.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.392+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c203e0 con 0x5604a4c092b0 2024-05-09T09:48:38.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.392+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'73 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc2c0aaa50 con 0x5604a4c092b0 2024-05-09T09:48:38.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.392+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c203e0 con 0x5604a4c092b0 2024-05-09T09:48:38.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.396+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'147 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc2c0aaa50 con 0x5604a4c092b0 2024-05-09T09:48:38.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.396+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c203e0 con 0x5604a4c049d0 2024-05-09T09:48:38.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.396+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'78 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc3000f070 con 0x5604a4c049d0 2024-05-09T09:48:38.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.396+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c203e0 con 0x5604a4c092b0 2024-05-09T09:48:38.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.400+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'76 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc2c0aaa50 con 0x5604a4c092b0 2024-05-09T09:48:38.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.400+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c20a40 con 0x5604a4c049d0 2024-05-09T09:48:38.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.400+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'146 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc3000f070 con 0x5604a4c049d0 2024-05-09T09:48:38.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.400+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c20a40 con 0x5604a4c092b0 2024-05-09T09:48:38.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.404+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'214 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc2c0aaa50 con 0x5604a4c092b0 2024-05-09T09:48:38.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.404+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c20a40 con 0x5604a4c049d0 2024-05-09T09:48:38.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.404+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'152 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc3000f070 con 0x5604a4c049d0 2024-05-09T09:48:38.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.404+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c20a40 con 0x7fbc2c0e0040 2024-05-09T09:48:38.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.408+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'82 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc28036040 con 0x7fbc2c0e0040 2024-05-09T09:48:38.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.408+0000 7fbaecfe1640 20 reqs_thread_entry: start 2024-05-09T09:48:38.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.408+0000 7fbc3af25980 20 init_complete bucket index max shards: 11 2024-05-09T09:48:38.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.408+0000 7fba667fc640 20 reqs_thread_entry: start 2024-05-09T09:48:38.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.408+0000 7fbc3af25980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.408+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c3c410 con 0x5604a4c00010 2024-05-09T09:48:38.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.408+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fbc28036040 con 0x5604a4c00010 2024-05-09T09:48:38.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.408+0000 7fbc3af25980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:48:38.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.408+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:95 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c1c560 con 0x5604a4c049d0 2024-05-09T09:48:38.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.412+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(95 usage.10 [call out=1378b] v0'0 uv77 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fbc3000f070 con 0x5604a4c049d0 2024-05-09T09:48:38.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.412+0000 7fbaedfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:38.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.412+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94577943982096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c18250 con 0x5604a4c00010 2024-05-09T09:48:38.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.412+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94577943982096] v32'354 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbc28036040 con 0x5604a4c00010 2024-05-09T09:48:38.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.412+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94577943959104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c18250 con 0x7fbc2c0e0040 2024-05-09T09:48:38.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.416+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94577943959104] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc28036040 con 0x7fbc2c0e0040 2024-05-09T09:48:38.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.416+0000 7fbc3af25980 20 remove_watcher() i=0 2024-05-09T09:48:38.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.416+0000 7fbc3af25980 2 removed watcher, disabling cache 2024-05-09T09:48:38.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.416+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94577943956896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c0d640 con 0x5604a4c00010 2024-05-09T09:48:38.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.416+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94577943956896] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc28036040 con 0x5604a4c00010 2024-05-09T09:48:38.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.416+0000 7fbc3af25980 20 remove_watcher() i=1 2024-05-09T09:48:38.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.416+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94577943962960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c0d640 con 0x5604a4c092b0 2024-05-09T09:48:38.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.420+0000 7fbc3823f640 1 -- 172.21.15.157:0/4167096428 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94577943962960] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc2c0aaa50 con 0x5604a4c092b0 2024-05-09T09:48:38.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.420+0000 7fbc3af25980 20 remove_watcher() i=2 2024-05-09T09:48:38.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.420+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94577943968784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c0d640 con 0x7fbc2c0e0040 2024-05-09T09:48:38.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.420+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94577943968784] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc28036040 con 0x7fbc2c0e0040 2024-05-09T09:48:38.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.420+0000 7fbc3af25980 20 remove_watcher() i=3 2024-05-09T09:48:38.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.420+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94577943967584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c0d640 con 0x5604a4c00010 2024-05-09T09:48:38.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.424+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94577943967584] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc28036040 con 0x5604a4c00010 2024-05-09T09:48:38.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.424+0000 7fbc3af25980 20 remove_watcher() i=4 2024-05-09T09:48:38.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.424+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94577943975856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c0f760 con 0x5604a4c049d0 2024-05-09T09:48:38.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.424+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94577943975856] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc3000f070 con 0x5604a4c049d0 2024-05-09T09:48:38.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.424+0000 7fbc3af25980 20 remove_watcher() i=5 2024-05-09T09:48:38.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.424+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94577943977984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c0d640 con 0x5604a4c049d0 2024-05-09T09:48:38.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94577943977984] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc3000f070 con 0x5604a4c049d0 2024-05-09T09:48:38.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 20 remove_watcher() i=6 2024-05-09T09:48:38.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94577943979552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5604a4c0f760 con 0x5604a4c049d0 2024-05-09T09:48:38.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc38a40640 1 -- 172.21.15.157:0/4167096428 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94577943979552] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc3000f070 con 0x5604a4c049d0 2024-05-09T09:48:38.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 20 remove_watcher() i=7 2024-05-09T09:48:38.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5604a4c049d0 msgr2=0x5604a4c06dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 1 --2- 172.21.15.157:0/4167096428 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5604a4c049d0 0x5604a4c06dc0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5604a4c00010 msgr2=0x5604a4c024d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 1 --2- 172.21.15.157:0/4167096428 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5604a4c00010 0x5604a4c024d0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fbc2c0e0040 msgr2=0x7fbc2c0e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 1 --2- 172.21.15.157:0/4167096428 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fbc2c0e0040 0x7fbc2c0e0420 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5604a4c092b0 msgr2=0x5604a4c0b770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 1 --2- 172.21.15.157:0/4167096428 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5604a4c092b0 0x5604a4c0b770 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb00034bb0 msgr2=0x7fbb00037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 1 --2- 172.21.15.157:0/4167096428 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb00034bb0 0x7fbb00037070 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c0ac040 tx=0x7fbc2c0c1040 comp rx=0 tx=0).stop 2024-05-09T09:48:38.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4a2afe0 msgr2=0x5604a4bf3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc39241640 1 -- 172.21.15.157:0/4167096428 reap_dead start 2024-05-09T09:48:38.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 1 --2- 172.21.15.157:0/4167096428 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4a2afe0 0x5604a4bf3470 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fbc3003a5d0 tx=0x7fbc30031f20 comp rx=0 tx=0).stop 2024-05-09T09:48:38.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 shutdown_connections 2024-05-09T09:48:38.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 1 --2- 172.21.15.157:0/4167096428 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4a2afe0 0x5604a4bf3470 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 >> 172.21.15.157:0/4167096428 conn(0x5604a4be6290 msgr2=0x5604a4be38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:38.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 shutdown_connections 2024-05-09T09:48:38.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 1 -- 172.21.15.157:0/4167096428 wait complete. 2024-05-09T09:48:38.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 1 -- 172.21.15.157:0/4143727893 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb10034c50 msgr2=0x7fbb10037110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 1 --2- 172.21.15.157:0/4143727893 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb10034c50 0x7fbb10037110 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c017f50 tx=0x7fbc2c005ad0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 1 -- 172.21.15.157:0/4143727893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4bdcf40 msgr2=0x5604a4bdd360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 1 --2- 172.21.15.157:0/4143727893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4bdcf40 0x5604a4bdd360 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fbc30048280 tx=0x7fbc30025bd0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 1 -- 172.21.15.157:0/4143727893 shutdown_connections 2024-05-09T09:48:38.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 1 --2- 172.21.15.157:0/4143727893 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb10034c50 0x7fbb10037110 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 1 --2- 172.21.15.157:0/4143727893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4bdcf40 0x5604a4bdd360 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 1 -- 172.21.15.157:0/4143727893 >> 172.21.15.157:0/4143727893 conn(0x5604a4bd1d10 msgr2=0x5604a4bd2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:38.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 1 -- 172.21.15.157:0/4143727893 shutdown_connections 2024-05-09T09:48:38.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.428+0000 7fbc3af25980 1 -- 172.21.15.157:0/4143727893 wait complete. 2024-05-09T09:48:38.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.432+0000 7fbc3af25980 1 -- 172.21.15.157:0/1451615250 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5604a4bb0680 msgr2=0x5604a4bb2a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.432+0000 7fbc3af25980 1 --2- 172.21.15.157:0/1451615250 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5604a4bb0680 0x5604a4bb2a70 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.432+0000 7fbc3af25980 1 -- 172.21.15.157:0/1451615250 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5604a4ab8e40 msgr2=0x5604a4badd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.432+0000 7fbc3af25980 1 --2- 172.21.15.157:0/1451615250 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5604a4ab8e40 0x5604a4badd10 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.432+0000 7fbc3af25980 1 -- 172.21.15.157:0/1451615250 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5604a4bb4580 msgr2=0x5604a4bb6970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.432+0000 7fbc3af25980 1 --2- 172.21.15.157:0/1451615250 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5604a4bb4580 0x5604a4bb6970 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.432+0000 7fbc3af25980 1 -- 172.21.15.157:0/1451615250 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb20034c00 msgr2=0x7fbb200370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.432+0000 7fbc3af25980 1 --2- 172.21.15.157:0/1451615250 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb20034c00 0x7fbb200370c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c0ae000 tx=0x7fbc2c0a6000 comp rx=0 tx=0).stop 2024-05-09T09:48:38.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.432+0000 7fbc3af25980 1 -- 172.21.15.157:0/1451615250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4ab4980 msgr2=0x5604a4ba6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.432+0000 7fbc3af25980 1 --2- 172.21.15.157:0/1451615250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5604a4ab4980 0x5604a4ba6db0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fbc3000f610 tx=0x7fbc30001260 comp rx=0 tx=0).stop 2024-05-09T09:48:38.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.432+0000 7fbc39241640 1 -- 172.21.15.157:0/1451615250 reap_dead start 2024-05-09T09:48:38.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.432+0000 7fbc3af25980 1 -- 172.21.15.157:0/1451615250 shutdown_connections 2024-05-09T09:48:38.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.432+0000 7fbc3af25980 1 -- 172.21.15.157:0/1451615250 >> 172.21.15.157:0/1451615250 conn(0x5604a4ab0250 msgr2=0x5604a4b9a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:38.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.432+0000 7fbc3af25980 1 -- 172.21.15.157:0/1451615250 shutdown_connections 2024-05-09T09:48:38.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.432+0000 7fbc3af25980 1 -- 172.21.15.157:0/1451615250 wait complete. 2024-05-09T09:48:38.446 INFO:teuthology.orchestra.run.smithi157.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-05-09T09:48:38.446 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-09T09:48:38.446 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-05-09T09:48:38.446 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-05-09T09:48:38.447 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-05-09T09:48:38.529 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:48:38.529 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:48:38.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.528+0000 7f0f7d72d980 1 Processor -- start 2024-05-09T09:48:38.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.528+0000 7f0f7d72d980 1 -- start start 2024-05-09T09:48:38.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.528+0000 7f0f7d72d980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x562cf86800e0 0x562cf86824d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.528+0000 7f0f7d72d980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562cf852f440 con 0x562cf85edac0 2024-05-09T09:48:38.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.528+0000 7f0f7d72d980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x562cf851a5f0 con 0x562cf86800e0 2024-05-09T09:48:38.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.528+0000 7f0f7aa47640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x562cf86800e0 0x562cf86824d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.528+0000 7f0f7aa47640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x562cf86800e0 0x562cf86824d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59878/0 (socket says 172.21.15.157:59878) 2024-05-09T09:48:38.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.528+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1925792144 learned_addr learned my addr 172.21.15.157:0/1925792144 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:38.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.528+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1925792144 >> v1:172.21.15.110:6789/0 conn(0x562cf85edac0 legacy=0x562cf867e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.528+0000 7f0f7a246640 1 -- 172.21.15.157:0/1925792144 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3518055949 0 0) 0x562cf852f440 con 0x562cf85edac0 2024-05-09T09:48:38.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.528+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1925792144 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cf8525990 con 0x562cf86800e0 2024-05-09T09:48:38.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.532+0000 7f0f7aa47640 1 --2- 172.21.15.157:0/1925792144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf86800e0 0x562cf86824d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400a5c0 tx=0x7f0f6401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e5f33759edbb9ec server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.532+0000 7f0f7a246640 1 -- 172.21.15.157:0/1925792144 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f640a6070 con 0x562cf86800e0 2024-05-09T09:48:38.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.532+0000 7f0f7a246640 1 -- 172.21.15.157:0/1925792144 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f640af070 con 0x562cf86800e0 2024-05-09T09:48:38.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.532+0000 7f0f7a246640 1 -- 172.21.15.157:0/1925792144 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f640aa5c0 con 0x562cf86800e0 2024-05-09T09:48:38.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.532+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1925792144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf86800e0 msgr2=0x562cf86824d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.532+0000 7f0f7d72d980 1 --2- 172.21.15.157:0/1925792144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf86800e0 0x562cf86824d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400a5c0 tx=0x7f0f6401b340 comp rx=0 tx=0).stop 2024-05-09T09:48:38.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.532+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1925792144 shutdown_connections 2024-05-09T09:48:38.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.532+0000 7f0f7d72d980 1 --2- 172.21.15.157:0/1925792144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf86800e0 0x562cf86824d0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.532+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1925792144 >> 172.21.15.157:0/1925792144 conn(0x562cf86740e0 msgr2=0x562cf8676500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:38.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.532+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1925792144 shutdown_connections 2024-05-09T09:48:38.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.532+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1925792144 wait complete. 2024-05-09T09:48:38.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.548+0000 7f0f7d72d980 1 Processor -- start 2024-05-09T09:48:38.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.548+0000 7f0f7d72d980 1 -- start start 2024-05-09T09:48:38.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.548+0000 7f0f7d72d980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf85edac0 0x562cf8766be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.548+0000 7f0f7d72d980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x562cf857cfe0 con 0x562cf85edac0 2024-05-09T09:48:38.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.548+0000 7f0f7b248640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf85edac0 0x562cf8766be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.548+0000 7f0f7b248640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf85edac0 0x562cf8766be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59886/0 (socket says 172.21.15.157:59886) 2024-05-09T09:48:38.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.548+0000 7f0f7b248640 1 -- 172.21.15.157:0/1866827543 learned_addr learned my addr 172.21.15.157:0/1866827543 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:38.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.548+0000 7f0f7b248640 1 -- 172.21.15.157:0/1866827543 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cf8501ae0 con 0x562cf85edac0 2024-05-09T09:48:38.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.548+0000 7f0f7b248640 1 --2- 172.21.15.157:0/1866827543 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf85edac0 0x562cf8766be0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c001670 tx=0x7f0f6c001b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c7ac6e46f45c099 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.548+0000 7f0e6960a640 1 -- 172.21.15.157:0/1866827543 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f6c017070 con 0x562cf85edac0 2024-05-09T09:48:38.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.548+0000 7f0e6960a640 1 -- 172.21.15.157:0/1866827543 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f6c0025d0 con 0x562cf85edac0 2024-05-09T09:48:38.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.548+0000 7f0e6960a640 1 -- 172.21.15.157:0/1866827543 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f6c002910 con 0x562cf85edac0 2024-05-09T09:48:38.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.552+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1866827543 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf85edac0 msgr2=0x562cf8766be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.552+0000 7f0f7d72d980 1 --2- 172.21.15.157:0/1866827543 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf85edac0 0x562cf8766be0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c001670 tx=0x7f0f6c001b30 comp rx=0 tx=0).stop 2024-05-09T09:48:38.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.552+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1866827543 shutdown_connections 2024-05-09T09:48:38.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.552+0000 7f0f7d72d980 1 --2- 172.21.15.157:0/1866827543 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf85edac0 0x562cf8766be0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.552+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1866827543 >> 172.21.15.157:0/1866827543 conn(0x562cf86740e0 msgr2=0x562cf8762770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:38.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.552+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1866827543 shutdown_connections 2024-05-09T09:48:38.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.552+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1866827543 wait complete. 2024-05-09T09:48:38.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.552+0000 7f0f7d72d980 1 Processor -- start 2024-05-09T09:48:38.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.552+0000 7f0f7d72d980 1 -- start start 2024-05-09T09:48:38.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.552+0000 7f0f7d72d980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf85edac0 0x562cf876dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.552+0000 7f0f7d72d980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x562cf86854d0 con 0x562cf85edac0 2024-05-09T09:48:38.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.552+0000 7f0f7b248640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf85edac0 0x562cf876dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.552+0000 7f0f7b248640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf85edac0 0x562cf876dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59896/0 (socket says 172.21.15.157:59896) 2024-05-09T09:48:38.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.552+0000 7f0f7b248640 1 -- 172.21.15.157:0/171126287 learned_addr learned my addr 172.21.15.157:0/171126287 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:38.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.552+0000 7f0f7b248640 1 -- 172.21.15.157:0/171126287 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cf876e2c0 con 0x562cf85edac0 2024-05-09T09:48:38.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.552+0000 7f0f7b248640 1 --2- 172.21.15.157:0/171126287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf85edac0 0x562cf876dd80 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c006fb0 tx=0x7f0f6c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.552+0000 7f0e67e07640 1 -- 172.21.15.157:0/171126287 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f6c022020 con 0x562cf85edac0 2024-05-09T09:48:38.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.552+0000 7f0e67e07640 1 -- 172.21.15.157:0/171126287 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f6c0126a0 con 0x562cf85edac0 2024-05-09T09:48:38.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.552+0000 7f0f7d72d980 1 -- 172.21.15.157:0/171126287 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562cf876e550 con 0x562cf85edac0 2024-05-09T09:48:38.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.552+0000 7f0e67e07640 1 -- 172.21.15.157:0/171126287 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f6c017040 con 0x562cf85edac0 2024-05-09T09:48:38.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.552+0000 7f0f7d72d980 1 -- 172.21.15.157:0/171126287 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cf8771230 con 0x562cf85edac0 2024-05-09T09:48:38.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.556+0000 7f0e67e07640 1 -- 172.21.15.157:0/171126287 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f0f6c025020 con 0x562cf85edac0 2024-05-09T09:48:38.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.556+0000 7f0e67e07640 1 --2- 172.21.15.157:0/171126287 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0e60034c00 0x7f0e600370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.556+0000 7f0e67e07640 1 -- 172.21.15.157:0/171126287 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f0f6c049ff0 con 0x562cf85edac0 2024-05-09T09:48:38.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.556+0000 7f0f7aa47640 1 --2- 172.21.15.157:0/171126287 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0e60034c00 0x7f0e600370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.556+0000 7f0f7d72d980 1 --2- 172.21.15.157:0/171126287 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x562cf86800e0 0x562cf8774e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.556+0000 7f0f7d72d980 1 -- 172.21.15.157:0/171126287 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cf87753c0 con 0x562cf86800e0 2024-05-09T09:48:38.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.556+0000 7f0f7ba49640 1 --2- 172.21.15.157:0/171126287 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x562cf86800e0 0x562cf8774e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.556+0000 7f0f7aa47640 1 --2- 172.21.15.157:0/171126287 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0e60034c00 0x7f0e600370c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0f640ae000 tx=0x7f0f640a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.556+0000 7f0f7ba49640 1 --2- 172.21.15.157:0/171126287 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x562cf86800e0 0x562cf8774e80 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.556+0000 7f0f7ba49640 1 -- 172.21.15.157:0/171126287 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f740083f0 con 0x562cf86800e0 2024-05-09T09:48:38.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.556+0000 7f0f7d72d980 1 -- 172.21.15.157:0/171126287 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cf8772450 con 0x562cf86800e0 2024-05-09T09:48:38.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.556+0000 7f0f7ba49640 1 -- 172.21.15.157:0/171126287 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0f740083f0 con 0x562cf86800e0 2024-05-09T09:48:38.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.556+0000 7f0f7d72d980 1 --2- 172.21.15.157:0/171126287 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x562cf87776d0 0x562cf8779ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.556+0000 7f0f7d72d980 1 -- 172.21.15.157:0/171126287 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cf877a190 con 0x562cf87776d0 2024-05-09T09:48:38.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.556+0000 7f0f7b248640 1 --2- 172.21.15.157:0/171126287 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x562cf87776d0 0x562cf8779ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.556+0000 7f0f7b248640 1 --2- 172.21.15.157:0/171126287 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x562cf87776d0 0x562cf8779ac0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.560+0000 7f0f7b248640 1 -- 172.21.15.157:0/171126287 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0f6c00f070 con 0x562cf87776d0 2024-05-09T09:48:38.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.560+0000 7f0f7d72d980 1 -- 172.21.15.157:0/171126287 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cf8776570 con 0x562cf86800e0 2024-05-09T09:48:38.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.560+0000 7f0f7ba49640 1 -- 172.21.15.157:0/171126287 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0f740083f0 con 0x562cf86800e0 2024-05-09T09:48:38.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.560+0000 7f0f7d72d980 1 --2- 172.21.15.157:0/171126287 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x562cf877b5d0 0x562cf877d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.560+0000 7f0f7d72d980 1 -- 172.21.15.157:0/171126287 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cf877e150 con 0x562cf877b5d0 2024-05-09T09:48:38.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.560+0000 7f0f7aa47640 1 --2- 172.21.15.157:0/171126287 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x562cf877b5d0 0x562cf877d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.560+0000 7f0f7aa47640 1 --2- 172.21.15.157:0/171126287 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x562cf877b5d0 0x562cf877d9c0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.560+0000 7f0f7aa47640 1 -- 172.21.15.157:0/171126287 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0f640aaa50 con 0x562cf877b5d0 2024-05-09T09:48:38.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.564+0000 7f0f7d72d980 1 Processor -- start 2024-05-09T09:48:38.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.564+0000 7f0f7d72d980 1 -- start start 2024-05-09T09:48:38.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.564+0000 7f0f7d72d980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf87a4000 0x562cf87a4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.564+0000 7f0f7d72d980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x562cf8581020 con 0x562cf87a4000 2024-05-09T09:48:38.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.564+0000 7f0f7b248640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf87a4000 0x562cf87a4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.564+0000 7f0f7b248640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf87a4000 0x562cf87a4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59910/0 (socket says 172.21.15.157:59910) 2024-05-09T09:48:38.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.564+0000 7f0f7b248640 1 -- 172.21.15.157:0/1435853747 learned_addr learned my addr 172.21.15.157:0/1435853747 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:38.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.564+0000 7f0f7b248640 1 -- 172.21.15.157:0/1435853747 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cf87a4960 con 0x562cf87a4000 2024-05-09T09:48:38.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.564+0000 7f0f7b248640 1 --2- 172.21.15.157:0/1435853747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf87a4000 0x562cf87a4420 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c0482e0 tx=0x7f0f6c026fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.564+0000 7f0e5ffff640 1 -- 172.21.15.157:0/1435853747 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f6c03f070 con 0x562cf87a4000 2024-05-09T09:48:38.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.564+0000 7f0e5ffff640 1 -- 172.21.15.157:0/1435853747 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f6c02e610 con 0x562cf87a4000 2024-05-09T09:48:38.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.564+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1435853747 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562cf87a53f0 con 0x562cf87a4000 2024-05-09T09:48:38.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.564+0000 7f0e5ffff640 1 -- 172.21.15.157:0/1435853747 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f6c01d360 con 0x562cf87a4000 2024-05-09T09:48:38.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.564+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1435853747 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cf87a58d0 con 0x562cf87a4000 2024-05-09T09:48:38.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.568+0000 7f0e5ffff640 1 -- 172.21.15.157:0/1435853747 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f0f6c01d500 con 0x562cf87a4000 2024-05-09T09:48:38.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.568+0000 7f0e5ffff640 1 --2- 172.21.15.157:0/1435853747 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0e54034c00 0x7f0e540370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.568+0000 7f0e5ffff640 1 -- 172.21.15.157:0/1435853747 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f0f6c04ed30 con 0x562cf87a4000 2024-05-09T09:48:38.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.568+0000 7f0f7aa47640 1 --2- 172.21.15.157:0/1435853747 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0e54034c00 0x7f0e540370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.568+0000 7f0f7d72d980 1 Processor -- start 2024-05-09T09:48:38.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.568+0000 7f0f7d72d980 1 -- start start 2024-05-09T09:48:38.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.568+0000 7f0f7d72d980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf87b1150 0x562cf87b1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.568+0000 7f0f7d72d980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x562cf8767330 con 0x562cf87b1150 2024-05-09T09:48:38.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.568+0000 7f0f7aa47640 1 --2- 172.21.15.157:0/1435853747 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0e54034c00 0x7f0e540370c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0f64017f50 tx=0x7f0f64005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.568+0000 7f0f7b248640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf87b1150 0x562cf87b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.568+0000 7f0f7b248640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf87b1150 0x562cf87b1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59922/0 (socket says 172.21.15.157:59922) 2024-05-09T09:48:38.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.568+0000 7f0f7b248640 1 -- 172.21.15.157:0/2944791503 learned_addr learned my addr 172.21.15.157:0/2944791503 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:38.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.568+0000 7f0f7b248640 1 -- 172.21.15.157:0/2944791503 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cf87b1b40 con 0x562cf87b1150 2024-05-09T09:48:38.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.568+0000 7f0f7b248640 1 --2- 172.21.15.157:0/2944791503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf87b1150 0x562cf87b1570 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c01db70 tx=0x7f0f6c027500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c19a0fefcf1fd5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.568+0000 7f0e5dffb640 1 -- 172.21.15.157:0/2944791503 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f6c041a40 con 0x562cf87b1150 2024-05-09T09:48:38.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.568+0000 7f0e5dffb640 1 -- 172.21.15.157:0/2944791503 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f6c05f070 con 0x562cf87b1150 2024-05-09T09:48:38.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.568+0000 7f0e5dffb640 1 -- 172.21.15.157:0/2944791503 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f6c041630 con 0x562cf87b1150 2024-05-09T09:48:38.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.568+0000 7f0f7d72d980 1 -- 172.21.15.157:0/2944791503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf87b1150 msgr2=0x562cf87b1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.568+0000 7f0f7d72d980 1 --2- 172.21.15.157:0/2944791503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf87b1150 0x562cf87b1570 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c01db70 tx=0x7f0f6c027500 comp rx=0 tx=0).stop 2024-05-09T09:48:38.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.568+0000 7f0f7d72d980 1 -- 172.21.15.157:0/2944791503 shutdown_connections 2024-05-09T09:48:38.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.568+0000 7f0f7d72d980 1 --2- 172.21.15.157:0/2944791503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf87b1150 0x562cf87b1570 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.568+0000 7f0f7d72d980 1 -- 172.21.15.157:0/2944791503 >> 172.21.15.157:0/2944791503 conn(0x562cf87ad4d0 msgr2=0x562cf87ab530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:38.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.568+0000 7f0f7d72d980 1 -- 172.21.15.157:0/2944791503 shutdown_connections 2024-05-09T09:48:38.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.568+0000 7f0f7d72d980 1 -- 172.21.15.157:0/2944791503 wait complete. 2024-05-09T09:48:38.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.572+0000 7f0f7d72d980 1 Processor -- start 2024-05-09T09:48:38.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.572+0000 7f0f7d72d980 1 -- start start 2024-05-09T09:48:38.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.572+0000 7f0f7d72d980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf87b1150 0x562cf87b8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.572+0000 7f0f7d72d980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x562cf87b2210 con 0x562cf87b1150 2024-05-09T09:48:38.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.572+0000 7f0f7b248640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf87b1150 0x562cf87b8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.572+0000 7f0f7b248640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf87b1150 0x562cf87b8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59930/0 (socket says 172.21.15.157:59930) 2024-05-09T09:48:38.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.572+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 learned_addr learned my addr 172.21.15.157:0/1954855466 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:38.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.572+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cf87b8950 con 0x562cf87b1150 2024-05-09T09:48:38.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.572+0000 7f0f7b248640 1 --2- 172.21.15.157:0/1954855466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf87b1150 0x562cf87b8410 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c01db70 tx=0x7f0f6c025f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.572+0000 7f0e4bfff640 1 -- 172.21.15.157:0/1954855466 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f6c034270 con 0x562cf87b1150 2024-05-09T09:48:38.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.572+0000 7f0e4bfff640 1 -- 172.21.15.157:0/1954855466 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f6c03a610 con 0x562cf87b1150 2024-05-09T09:48:38.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.572+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562cf87b8950 con 0x562cf87b1150 2024-05-09T09:48:38.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.572+0000 7f0e4bfff640 1 -- 172.21.15.157:0/1954855466 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f6c03a8f0 con 0x562cf87b1150 2024-05-09T09:48:38.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.572+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cf87b8950 con 0x562cf87b1150 2024-05-09T09:48:38.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.572+0000 7f0e4bfff640 1 -- 172.21.15.157:0/1954855466 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f0f6c059070 con 0x562cf87b1150 2024-05-09T09:48:38.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.572+0000 7f0f7d72d980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.572+0000 7f0e4bfff640 1 --2- 172.21.15.157:0/1954855466 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0e44034b10 0x7f0e44036fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.572+0000 7f0e4bfff640 1 -- 172.21.15.157:0/1954855466 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f0f6c06fd50 con 0x562cf87b1150 2024-05-09T09:48:38.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.572+0000 7f0f7aa47640 1 --2- 172.21.15.157:0/1954855466 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0e44034b10 0x7f0e44036fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.572+0000 7f0f7d72d980 1 --2- 172.21.15.157:0/1954855466 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x562cf87c4f50 0x562cf87c73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.572+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c7b30 con 0x562cf87c4f50 2024-05-09T09:48:38.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.572+0000 7f0f7ba49640 1 --2- 172.21.15.157:0/1954855466 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x562cf87c4f50 0x562cf87c73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7aa47640 1 --2- 172.21.15.157:0/1954855466 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0e44034b10 0x7f0e44036fd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0f640ac040 tx=0x7f0f640c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7ba49640 1 --2- 172.21.15.157:0/1954855466 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x562cf87c4f50 0x562cf87c73e0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f740083f0 con 0x562cf87c4f50 2024-05-09T09:48:38.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7d72d980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:38.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7d72d980 20 realm 2024-05-09T09:48:38.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7d72d980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c7f40 con 0x562cf87c4f50 2024-05-09T09:48:38.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f740083f0 con 0x562cf87c4f50 2024-05-09T09:48:38.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7d72d980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:38.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7d72d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:48:38.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7d72d980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c87e0 con 0x562cf87c4f50 2024-05-09T09:48:38.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f740083f0 con 0x562cf87c4f50 2024-05-09T09:48:38.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7d72d980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:38.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7d72d980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x562cf87c4f50 2024-05-09T09:48:38.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0f740083f0 con 0x562cf87c4f50 2024-05-09T09:48:38.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7d72d980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:38.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7d72d980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7d72d980 1 --2- 172.21.15.157:0/1954855466 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x562cf87c98e0 0x562cf87cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cf87cc250 con 0x562cf87c98e0 2024-05-09T09:48:38.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7b248640 1 --2- 172.21.15.157:0/1954855466 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x562cf87c98e0 0x562cf87cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7b248640 1 --2- 172.21.15.157:0/1954855466 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x562cf87c98e0 0x562cf87cbcd0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0f6c074020 con 0x562cf87c98e0 2024-05-09T09:48:38.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7d72d980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:48:38.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7d72d980 20 searching for the correct realm 2024-05-09T09:48:38.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7d72d980 1 --2- 172.21.15.157:0/1954855466 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x562cf87ce1c0 0x562cf87d0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d0d50 con 0x562cf87ce1c0 2024-05-09T09:48:38.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7aa47640 1 --2- 172.21.15.157:0/1954855466 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x562cf87ce1c0 0x562cf87d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.576+0000 7f0f7aa47640 1 --2- 172.21.15.157:0/1954855466 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x562cf87ce1c0 0x562cf87d0680 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.580+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f640aaa50 con 0x562cf87ce1c0 2024-05-09T09:48:38.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.580+0000 7f0f7aa47640 1 --2- 172.21.15.157:0/1954855466 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f0f640e0040 0x7f0f640e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.580+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d0d50 con 0x7f0f640e0040 2024-05-09T09:48:38.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.580+0000 7f0f7ba49640 1 --2- 172.21.15.157:0/1954855466 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f0f640e0040 0x7f0f640e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.580+0000 7f0f7ba49640 1 --2- 172.21.15.157:0/1954855466 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f0f640e0040 0x7f0f640e0420 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.580+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f740083f0 con 0x7f0f640e0040 2024-05-09T09:48:38.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.580+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x562cf87c98e0 2024-05-09T09:48:38.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.580+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f6c074020 con 0x562cf87c98e0 2024-05-09T09:48:38.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.580+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x562cf87c4f50 2024-05-09T09:48:38.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.580+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f740083f0 con 0x562cf87c4f50 2024-05-09T09:48:38.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.580+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x562cf87c4f50 2024-05-09T09:48:38.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.580+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f74026040 con 0x562cf87c4f50 2024-05-09T09:48:38.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.580+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x562cf87c98e0 2024-05-09T09:48:38.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.580+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f6c074020 con 0x562cf87c98e0 2024-05-09T09:48:38.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.580+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x562cf87c98e0 2024-05-09T09:48:38.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.580+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f6c074020 con 0x562cf87c98e0 2024-05-09T09:48:38.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.580+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x7f0f640e0040 2024-05-09T09:48:38.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.580+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f74026040 con 0x7f0f640e0040 2024-05-09T09:48:38.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.580+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x562cf87ce1c0 2024-05-09T09:48:38.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.584+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f640aaa50 con 0x562cf87ce1c0 2024-05-09T09:48:38.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.584+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x562cf87c4f50 2024-05-09T09:48:38.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.584+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f74026040 con 0x562cf87c4f50 2024-05-09T09:48:38.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.584+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x562cf87c98e0 2024-05-09T09:48:38.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.584+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f6c074020 con 0x562cf87c98e0 2024-05-09T09:48:38.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.584+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x562cf87c4f50 2024-05-09T09:48:38.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.584+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f74026040 con 0x562cf87c4f50 2024-05-09T09:48:38.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.584+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x7f0f640e0040 2024-05-09T09:48:38.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.584+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0f74026040 con 0x7f0f640e0040 2024-05-09T09:48:38.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.584+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x562cf87ce1c0 2024-05-09T09:48:38.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.584+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f640aaa50 con 0x562cf87ce1c0 2024-05-09T09:48:38.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.584+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x562cf87ce1c0 2024-05-09T09:48:38.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.584+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0f640aaa50 con 0x562cf87ce1c0 2024-05-09T09:48:38.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.584+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x562cf87c98e0 2024-05-09T09:48:38.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.584+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f6c074020 con 0x562cf87c98e0 2024-05-09T09:48:38.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.584+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x562cf87ce1c0 2024-05-09T09:48:38.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.584+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f640aaa50 con 0x562cf87ce1c0 2024-05-09T09:48:38.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.584+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x562cf87ce1c0 2024-05-09T09:48:38.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.584+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f640aaa50 con 0x562cf87ce1c0 2024-05-09T09:48:38.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.584+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x562cf87c4f50 2024-05-09T09:48:38.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.584+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f74026040 con 0x562cf87c4f50 2024-05-09T09:48:38.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.584+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x562cf87c4f50 2024-05-09T09:48:38.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.588+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0f74026040 con 0x562cf87c4f50 2024-05-09T09:48:38.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.588+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x562cf87c98e0 2024-05-09T09:48:38.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.588+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f6c074020 con 0x562cf87c98e0 2024-05-09T09:48:38.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.588+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x562cf87ce1c0 2024-05-09T09:48:38.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.588+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f640aaa50 con 0x562cf87ce1c0 2024-05-09T09:48:38.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.588+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x7f0f640e0040 2024-05-09T09:48:38.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.588+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f74026040 con 0x7f0f640e0040 2024-05-09T09:48:38.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.588+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x562cf87c4f50 2024-05-09T09:48:38.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.588+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f74026040 con 0x562cf87c4f50 2024-05-09T09:48:38.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.588+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x562cf87c98e0 2024-05-09T09:48:38.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.588+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0f6c074020 con 0x562cf87c98e0 2024-05-09T09:48:38.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.588+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x562cf87ce1c0 2024-05-09T09:48:38.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.588+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f640aaa50 con 0x562cf87ce1c0 2024-05-09T09:48:38.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.588+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x562cf87c98e0 2024-05-09T09:48:38.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.588+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f6c074020 con 0x562cf87c98e0 2024-05-09T09:48:38.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.588+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x7f0f640e0040 2024-05-09T09:48:38.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.588+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f74026040 con 0x7f0f640e0040 2024-05-09T09:48:38.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.588+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x562cf87ce1c0 2024-05-09T09:48:38.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.588+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f640aaa50 con 0x562cf87ce1c0 2024-05-09T09:48:38.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.588+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x562cf87c98e0 2024-05-09T09:48:38.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f6c074020 con 0x562cf87c98e0 2024-05-09T09:48:38.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x562cf87c4f50 2024-05-09T09:48:38.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0f74026040 con 0x562cf87c4f50 2024-05-09T09:48:38.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562cf87c8b80 con 0x7f0f640e0040 2024-05-09T09:48:38.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f74026040 con 0x7f0f640e0040 2024-05-09T09:48:38.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:48:38.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:48:38.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:48:38.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:48:38.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:48:38.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:48:38.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cf87ccaa0 con 0x562cf87c4f50 2024-05-09T09:48:38.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f74026040 con 0x562cf87c4f50 2024-05-09T09:48:38.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:38.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cf87ccaa0 con 0x562cf87c4f50 2024-05-09T09:48:38.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0f74026040 con 0x562cf87c4f50 2024-05-09T09:48:38.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:38.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cf87ccaa0 con 0x562cf87ce1c0 2024-05-09T09:48:38.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0f640aaa50 con 0x562cf87ce1c0 2024-05-09T09:48:38.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:48:38.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 20 zone default found 2024-05-09T09:48:38.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 4 Realm: () 2024-05-09T09:48:38.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:48:38.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:48:38.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:48:38.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 20 zonegroup default 2024-05-09T09:48:38.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cf87cd340 con 0x562cf87c98e0 2024-05-09T09:48:38.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0f6c074020 con 0x562cf87c98e0 2024-05-09T09:48:38.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:38.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d2bb0 con 0x562cf87ce1c0 2024-05-09T09:48:38.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0f640aaa50 con 0x562cf87ce1c0 2024-05-09T09:48:38.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:38.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d2f50 con 0x562cf87ce1c0 2024-05-09T09:48:38.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0f640aaa50 con 0x562cf87ce1c0 2024-05-09T09:48:38.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:38.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 20 started sync module instance, tier type = 2024-05-09T09:48:38.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:48:38.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.592+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d2050 con 0x7f0f640e0040 2024-05-09T09:48:38.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.596+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f74026040 con 0x7f0f640e0040 2024-05-09T09:48:38.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.596+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94751147498704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d2730 con 0x7f0f640e0040 2024-05-09T09:48:38.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.596+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d3910 con 0x562cf87c4f50 2024-05-09T09:48:38.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.596+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94751147498704] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f74036040 con 0x7f0f640e0040 2024-05-09T09:48:38.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.596+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f74036040 con 0x562cf87c4f50 2024-05-09T09:48:38.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.596+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94751147500000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d3910 con 0x562cf87c4f50 2024-05-09T09:48:38.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.596+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d4320 con 0x562cf87ce1c0 2024-05-09T09:48:38.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.600+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94751147500000] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f74036040 con 0x562cf87c4f50 2024-05-09T09:48:38.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.600+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f640aaa50 con 0x562cf87ce1c0 2024-05-09T09:48:38.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.600+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94751147504736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d3880 con 0x562cf87ce1c0 2024-05-09T09:48:38.603 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.600+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d5070 con 0x7f0f640e0040 2024-05-09T09:48:38.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.600+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f74036040 con 0x7f0f640e0040 2024-05-09T09:48:38.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.600+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94751147511024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d5910 con 0x7f0f640e0040 2024-05-09T09:48:38.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.600+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d62d0 con 0x562cf87c4f50 2024-05-09T09:48:38.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.600+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94751147504736] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f640aaa50 con 0x562cf87ce1c0 2024-05-09T09:48:38.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.600+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94751147511024] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f74036040 con 0x7f0f640e0040 2024-05-09T09:48:38.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.604+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f74036040 con 0x562cf87c4f50 2024-05-09T09:48:38.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.604+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94751147515424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d5880 con 0x562cf87c4f50 2024-05-09T09:48:38.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.604+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d6240 con 0x562cf87c98e0 2024-05-09T09:48:38.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.604+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94751147515424] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f74036040 con 0x562cf87c4f50 2024-05-09T09:48:38.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.604+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f6c074020 con 0x562cf87c98e0 2024-05-09T09:48:38.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.604+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94751147513056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d6ba0 con 0x562cf87c98e0 2024-05-09T09:48:38.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.604+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d73f0 con 0x562cf87c98e0 2024-05-09T09:48:38.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.608+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f6c074020 con 0x562cf87c98e0 2024-05-09T09:48:38.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.608+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94751147521936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d8060 con 0x562cf87c98e0 2024-05-09T09:48:38.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.608+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d8ad0 con 0x562cf87c98e0 2024-05-09T09:48:38.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.608+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94751147513056] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f6c074020 con 0x562cf87c98e0 2024-05-09T09:48:38.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.608+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f6c074020 con 0x562cf87c98e0 2024-05-09T09:48:38.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.608+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94751147525536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d8d70 con 0x562cf87c98e0 2024-05-09T09:48:38.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.608+0000 7f0f7d72d980 20 add_watcher() i=0 2024-05-09T09:48:38.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.608+0000 7f0f7d72d980 20 add_watcher() i=1 2024-05-09T09:48:38.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.608+0000 7f0f7d72d980 20 add_watcher() i=2 2024-05-09T09:48:38.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.608+0000 7f0f7d72d980 20 add_watcher() i=3 2024-05-09T09:48:38.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.608+0000 7f0f7d72d980 20 add_watcher() i=4 2024-05-09T09:48:38.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.608+0000 7f0f7d72d980 20 add_watcher() i=5 2024-05-09T09:48:38.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.612+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94751147521936] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f6c074020 con 0x562cf87c98e0 2024-05-09T09:48:38.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.612+0000 7f0f7d72d980 20 add_watcher() i=6 2024-05-09T09:48:38.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.612+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94751147525536] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f6c074020 con 0x562cf87c98e0 2024-05-09T09:48:38.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.612+0000 7f0f7d72d980 20 add_watcher() i=7 2024-05-09T09:48:38.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.612+0000 7f0f7d72d980 2 all 8 watchers are set, enabling cache 2024-05-09T09:48:38.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.612+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d7bb0 con 0x562cf87c4f50 2024-05-09T09:48:38.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.612+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0f74036040 con 0x562cf87c4f50 2024-05-09T09:48:38.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.612+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94751147522992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d9350 con 0x562cf87c4f50 2024-05-09T09:48:38.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.612+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94751147522992] v32'355 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0f74036040 con 0x562cf87c4f50 2024-05-09T09:48:38.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.612+0000 7f0e30fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:38.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.612+0000 7f0f7d72d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:48:38.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.612+0000 7f0f7d72d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:48:38.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.612+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e43e0 con 0x562cf87c4f50 2024-05-09T09:48:38.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.616+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'84 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f74036040 con 0x562cf87c4f50 2024-05-09T09:48:38.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.616+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e4950 con 0x562cf87c98e0 2024-05-09T09:48:38.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.620+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'78 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f6c074020 con 0x562cf87c98e0 2024-05-09T09:48:38.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.620+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e4950 con 0x562cf87ce1c0 2024-05-09T09:48:38.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.620+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'77 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f640aaa50 con 0x562cf87ce1c0 2024-05-09T09:48:38.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.620+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e4f40 con 0x562cf87c4f50 2024-05-09T09:48:38.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.620+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'356 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f74036040 con 0x562cf87c4f50 2024-05-09T09:48:38.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.620+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e53f0 con 0x7f0f640e0040 2024-05-09T09:48:38.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.624+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'221 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f74036040 con 0x7f0f640e0040 2024-05-09T09:48:38.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.624+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e24f0 con 0x562cf87ce1c0 2024-05-09T09:48:38.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.624+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'148 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f640aaa50 con 0x562cf87ce1c0 2024-05-09T09:48:38.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.624+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e24f0 con 0x562cf87c4f50 2024-05-09T09:48:38.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.624+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'79 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f74036040 con 0x562cf87c4f50 2024-05-09T09:48:38.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.624+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e5f50 con 0x562cf87c98e0 2024-05-09T09:48:38.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.628+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'147 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f6c074020 con 0x562cf87c98e0 2024-05-09T09:48:38.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.628+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e5f50 con 0x7f0f640e0040 2024-05-09T09:48:38.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.628+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'77 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f74036040 con 0x7f0f640e0040 2024-05-09T09:48:38.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.628+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e5f50 con 0x562cf87ce1c0 2024-05-09T09:48:38.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.632+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'83 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f640aaa50 con 0x562cf87ce1c0 2024-05-09T09:48:38.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.632+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e6400 con 0x7f0f640e0040 2024-05-09T09:48:38.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.632+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'222 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f74036040 con 0x7f0f640e0040 2024-05-09T09:48:38.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.632+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e6400 con 0x562cf87c98e0 2024-05-09T09:48:38.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.636+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'81 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f6c074020 con 0x562cf87c98e0 2024-05-09T09:48:38.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.636+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e6400 con 0x7f0f640e0040 2024-05-09T09:48:38.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.636+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'77 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f74036040 con 0x7f0f640e0040 2024-05-09T09:48:38.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.636+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e6400 con 0x562cf87c98e0 2024-05-09T09:48:38.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.640+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'153 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f6c074020 con 0x562cf87c98e0 2024-05-09T09:48:38.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.640+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e6400 con 0x562cf87c4f50 2024-05-09T09:48:38.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.640+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'357 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f74036040 con 0x562cf87c4f50 2024-05-09T09:48:38.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.640+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e6400 con 0x562cf87ce1c0 2024-05-09T09:48:38.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.644+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'215 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f640aaa50 con 0x562cf87ce1c0 2024-05-09T09:48:38.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.644+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e6400 con 0x7f0f640e0040 2024-05-09T09:48:38.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.644+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'223 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f74036040 con 0x7f0f640e0040 2024-05-09T09:48:38.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.644+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e6400 con 0x562cf87ce1c0 2024-05-09T09:48:38.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.644+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'77 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f640aaa50 con 0x562cf87ce1c0 2024-05-09T09:48:38.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.644+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e6490 con 0x562cf87c4f50 2024-05-09T09:48:38.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.648+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'85 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f74036040 con 0x562cf87c4f50 2024-05-09T09:48:38.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.648+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e6490 con 0x562cf87c4f50 2024-05-09T09:48:38.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.652+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'358 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f74036040 con 0x562cf87c4f50 2024-05-09T09:48:38.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.652+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e6490 con 0x562cf87ce1c0 2024-05-09T09:48:38.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.652+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'216 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f640aaa50 con 0x562cf87ce1c0 2024-05-09T09:48:38.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.652+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e6490 con 0x7f0f640e0040 2024-05-09T09:48:38.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.656+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'89 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f74036040 con 0x7f0f640e0040 2024-05-09T09:48:38.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.656+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e6400 con 0x562cf87ce1c0 2024-05-09T09:48:38.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.656+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'79 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f640aaa50 con 0x562cf87ce1c0 2024-05-09T09:48:38.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.656+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e6400 con 0x562cf87ce1c0 2024-05-09T09:48:38.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.656+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'83 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f640aaa50 con 0x562cf87ce1c0 2024-05-09T09:48:38.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.660+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e6400 con 0x562cf87ce1c0 2024-05-09T09:48:38.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.660+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'74 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f640aaa50 con 0x562cf87ce1c0 2024-05-09T09:48:38.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.660+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e6400 con 0x562cf87ce1c0 2024-05-09T09:48:38.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.660+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'149 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f640aaa50 con 0x562cf87ce1c0 2024-05-09T09:48:38.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.664+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e6400 con 0x562cf87c98e0 2024-05-09T09:48:38.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.664+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'79 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f6c074020 con 0x562cf87c98e0 2024-05-09T09:48:38.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.664+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e6400 con 0x562cf87ce1c0 2024-05-09T09:48:38.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.668+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'77 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f640aaa50 con 0x562cf87ce1c0 2024-05-09T09:48:38.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.668+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e6400 con 0x562cf87c98e0 2024-05-09T09:48:38.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.668+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'148 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f6c074020 con 0x562cf87c98e0 2024-05-09T09:48:38.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.668+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e6400 con 0x562cf87ce1c0 2024-05-09T09:48:38.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.672+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'217 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f640aaa50 con 0x562cf87ce1c0 2024-05-09T09:48:38.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.672+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e6400 con 0x562cf87c98e0 2024-05-09T09:48:38.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.676+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'154 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f6c074020 con 0x562cf87c98e0 2024-05-09T09:48:38.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.676+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e6400 con 0x7f0f640e0040 2024-05-09T09:48:38.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.676+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'83 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f74036040 con 0x7f0f640e0040 2024-05-09T09:48:38.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.676+0000 7f0dab7fe640 20 reqs_thread_entry: start 2024-05-09T09:48:38.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.676+0000 7f0f7d72d980 20 init_complete bucket index max shards: 11 2024-05-09T09:48:38.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.680+0000 7f0da97fa640 20 reqs_thread_entry: start 2024-05-09T09:48:38.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.680+0000 7f0f7d72d980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.680+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cf8801ed0 con 0x562cf87c4f50 2024-05-09T09:48:38.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.680+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0f74036040 con 0x562cf87c4f50 2024-05-09T09:48:38.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.680+0000 7f0f7d72d980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:48:38.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.680+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:95 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e0dd0 con 0x562cf87c98e0 2024-05-09T09:48:38.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.680+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(95 usage.10 [call out=1378b] v0'0 uv77 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f0f6c074020 con 0x562cf87c98e0 2024-05-09T09:48:38.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.680+0000 7f0e30fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:38.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.680+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94751147522992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87e4f40 con 0x562cf87c4f50 2024-05-09T09:48:38.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.684+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94751147522992] v32'359 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0f74036040 con 0x562cf87c4f50 2024-05-09T09:48:38.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.684+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94751147498704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d7bb0 con 0x7f0f640e0040 2024-05-09T09:48:38.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.684+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94751147498704] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f74036040 con 0x7f0f640e0040 2024-05-09T09:48:38.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.684+0000 7f0f7d72d980 20 remove_watcher() i=0 2024-05-09T09:48:38.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.684+0000 7f0f7d72d980 2 removed watcher, disabling cache 2024-05-09T09:48:38.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.684+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94751147500000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d7bb0 con 0x562cf87c4f50 2024-05-09T09:48:38.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.688+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94751147500000] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f74036040 con 0x562cf87c4f50 2024-05-09T09:48:38.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.688+0000 7f0f7d72d980 20 remove_watcher() i=1 2024-05-09T09:48:38.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.688+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94751147504736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d7bb0 con 0x562cf87ce1c0 2024-05-09T09:48:38.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.688+0000 7f0f7aa47640 1 -- 172.21.15.157:0/1954855466 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94751147504736] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f640aaa50 con 0x562cf87ce1c0 2024-05-09T09:48:38.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.688+0000 7f0f7d72d980 20 remove_watcher() i=2 2024-05-09T09:48:38.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.688+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94751147511024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d3460 con 0x7f0f640e0040 2024-05-09T09:48:38.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.692+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94751147511024] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f74036040 con 0x7f0f640e0040 2024-05-09T09:48:38.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.692+0000 7f0f7d72d980 20 remove_watcher() i=3 2024-05-09T09:48:38.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.692+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94751147515424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d3460 con 0x562cf87c4f50 2024-05-09T09:48:38.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.692+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94751147515424] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f74036040 con 0x562cf87c4f50 2024-05-09T09:48:38.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.692+0000 7f0f7d72d980 20 remove_watcher() i=4 2024-05-09T09:48:38.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.692+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94751147513056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d3460 con 0x562cf87c98e0 2024-05-09T09:48:38.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.696+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94751147513056] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f6c074020 con 0x562cf87c98e0 2024-05-09T09:48:38.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.696+0000 7f0f7d72d980 20 remove_watcher() i=5 2024-05-09T09:48:38.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.696+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94751147521936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d54e0 con 0x562cf87c98e0 2024-05-09T09:48:38.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.696+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94751147521936] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f6c074020 con 0x562cf87c98e0 2024-05-09T09:48:38.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.696+0000 7f0f7d72d980 20 remove_watcher() i=6 2024-05-09T09:48:38.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.696+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94751147525536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562cf87d3460 con 0x562cf87c98e0 2024-05-09T09:48:38.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.700+0000 7f0f7b248640 1 -- 172.21.15.157:0/1954855466 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94751147525536] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f6c074020 con 0x562cf87c98e0 2024-05-09T09:48:38.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.700+0000 7f0f7d72d980 20 remove_watcher() i=7 2024-05-09T09:48:38.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.700+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x562cf87c98e0 msgr2=0x562cf87cbcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.700+0000 7f0f7d72d980 1 --2- 172.21.15.157:0/1954855466 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x562cf87c98e0 0x562cf87cbcd0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.700+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x562cf87c4f50 msgr2=0x562cf87c73e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.700+0000 7f0f7d72d980 1 --2- 172.21.15.157:0/1954855466 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x562cf87c4f50 0x562cf87c73e0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.700+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f0f640e0040 msgr2=0x7f0f640e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.700+0000 7f0f7d72d980 1 --2- 172.21.15.157:0/1954855466 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f0f640e0040 0x7f0f640e0420 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.700+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x562cf87ce1c0 msgr2=0x562cf87d0680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.700+0000 7f0f7d72d980 1 --2- 172.21.15.157:0/1954855466 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x562cf87ce1c0 0x562cf87d0680 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.700+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0e44034b10 msgr2=0x7f0e44036fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.700+0000 7f0f7d72d980 1 --2- 172.21.15.157:0/1954855466 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0e44034b10 0x7f0e44036fd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0f640ac040 tx=0x7f0f640c1040 comp rx=0 tx=0).stop 2024-05-09T09:48:38.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.700+0000 7f0f7ba49640 1 -- 172.21.15.157:0/1954855466 reap_dead start 2024-05-09T09:48:38.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.700+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf87b1150 msgr2=0x562cf87b8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.700+0000 7f0f7d72d980 1 --2- 172.21.15.157:0/1954855466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf87b1150 0x562cf87b8410 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c01db70 tx=0x7f0f6c025f20 comp rx=0 tx=0).stop 2024-05-09T09:48:38.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.700+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 shutdown_connections 2024-05-09T09:48:38.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.700+0000 7f0f7d72d980 1 --2- 172.21.15.157:0/1954855466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf87b1150 0x562cf87b8410 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.700+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 >> 172.21.15.157:0/1954855466 conn(0x562cf87ad4d0 msgr2=0x562cf87aab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:38.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.700+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 shutdown_connections 2024-05-09T09:48:38.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.700+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1954855466 wait complete. 2024-05-09T09:48:38.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.700+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1435853747 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0e54034c00 msgr2=0x7f0e540370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.700+0000 7f0f7d72d980 1 --2- 172.21.15.157:0/1435853747 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0e54034c00 0x7f0e540370c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0f64017f50 tx=0x7f0f64005ad0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.700+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1435853747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf87a4000 msgr2=0x562cf87a4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.700+0000 7f0f7d72d980 1 --2- 172.21.15.157:0/1435853747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf87a4000 0x562cf87a4420 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c0482e0 tx=0x7f0f6c026fa0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.700+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1435853747 shutdown_connections 2024-05-09T09:48:38.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.700+0000 7f0f7d72d980 1 --2- 172.21.15.157:0/1435853747 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0e54034c00 0x7f0e540370c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.700+0000 7f0f7d72d980 1 --2- 172.21.15.157:0/1435853747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf87a4000 0x562cf87a4420 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.700+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1435853747 >> 172.21.15.157:0/1435853747 conn(0x562cf8798dd0 msgr2=0x562cf87998e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:38.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.704+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1435853747 shutdown_connections 2024-05-09T09:48:38.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.704+0000 7f0f7d72d980 1 -- 172.21.15.157:0/1435853747 wait complete. 2024-05-09T09:48:38.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.704+0000 7f0f7d72d980 1 -- 172.21.15.157:0/171126287 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x562cf87776d0 msgr2=0x562cf8779ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.704+0000 7f0f7d72d980 1 --2- 172.21.15.157:0/171126287 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x562cf87776d0 0x562cf8779ac0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.704+0000 7f0f7d72d980 1 -- 172.21.15.157:0/171126287 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x562cf86800e0 msgr2=0x562cf8774e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.704+0000 7f0f7d72d980 1 --2- 172.21.15.157:0/171126287 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x562cf86800e0 0x562cf8774e80 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.704+0000 7f0f7d72d980 1 -- 172.21.15.157:0/171126287 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x562cf877b5d0 msgr2=0x562cf877d9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.704+0000 7f0f7d72d980 1 --2- 172.21.15.157:0/171126287 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x562cf877b5d0 0x562cf877d9c0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.704+0000 7f0f7d72d980 1 -- 172.21.15.157:0/171126287 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0e60034c00 msgr2=0x7f0e600370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.704+0000 7f0f7d72d980 1 --2- 172.21.15.157:0/171126287 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0e60034c00 0x7f0e600370c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0f640ae000 tx=0x7f0f640a6000 comp rx=0 tx=0).stop 2024-05-09T09:48:38.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.704+0000 7f0f7d72d980 1 -- 172.21.15.157:0/171126287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf85edac0 msgr2=0x562cf876dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.704+0000 7f0f7d72d980 1 --2- 172.21.15.157:0/171126287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562cf85edac0 0x562cf876dd80 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c006fb0 tx=0x7f0f6c001260 comp rx=0 tx=0).stop 2024-05-09T09:48:38.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.704+0000 7f0f7ba49640 1 -- 172.21.15.157:0/171126287 reap_dead start 2024-05-09T09:48:38.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.704+0000 7f0f7d72d980 1 -- 172.21.15.157:0/171126287 shutdown_connections 2024-05-09T09:48:38.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.704+0000 7f0f7d72d980 1 -- 172.21.15.157:0/171126287 >> 172.21.15.157:0/171126287 conn(0x562cf86740e0 msgr2=0x562cf8761280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:38.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.704+0000 7f0f7d72d980 1 -- 172.21.15.157:0/171126287 shutdown_connections 2024-05-09T09:48:38.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.704+0000 7f0f7d72d980 1 -- 172.21.15.157:0/171126287 wait complete. 2024-05-09T09:48:38.718 INFO:teuthology.orchestra.run.smithi157.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}],"s3select":{}},{"bucket":"myfoo2","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8,"bytes_processed":0,"bytes_returned":0}}]} 2024-05-09T09:48:38.719 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-09T09:48:38.719 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-05-09T09:48:38.719 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-05-09T09:48:38.719 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-05-09T09:48:38.799 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:48:38.799 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:48:38.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.796+0000 7fbc7af69980 1 Processor -- start 2024-05-09T09:48:38.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.796+0000 7fbc7af69980 1 -- start start 2024-05-09T09:48:38.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.796+0000 7fbc7af69980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x56288f6a0b40 0x56288f6a0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.796+0000 7fbc7af69980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56288f554440 con 0x56288f6a1460 2024-05-09T09:48:38.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.796+0000 7fbc7af69980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x56288f53f5f0 con 0x56288f6a0b40 2024-05-09T09:48:38.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.796+0000 7fbc78a84640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x56288f6a0b40 0x56288f6a0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.796+0000 7fbc78a84640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x56288f6a0b40 0x56288f6a0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59938/0 (socket says 172.21.15.157:59938) 2024-05-09T09:48:38.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.796+0000 7fbc78a84640 1 -- 172.21.15.157:0/97875782 learned_addr learned my addr 172.21.15.157:0/97875782 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:38.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.796+0000 7fbc78a84640 1 -- 172.21.15.157:0/97875782 >> v1:172.21.15.110:6789/0 conn(0x56288f6a1460 legacy=0x56288f6a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.800+0000 7fbc78a84640 1 -- 172.21.15.157:0/97875782 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56288f54a990 con 0x56288f6a0b40 2024-05-09T09:48:38.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.800+0000 7fbc78a84640 1 --2- 172.21.15.157:0/97875782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f6a0b40 0x56288f6a0f20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbc6800a5c0 tx=0x7fbc6801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27811eb07e439c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.804+0000 7fbc77a82640 1 -- 172.21.15.157:0/97875782 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc680a6070 con 0x56288f6a0b40 2024-05-09T09:48:38.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.804+0000 7fbc77a82640 1 -- 172.21.15.157:0/97875782 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc680af070 con 0x56288f6a0b40 2024-05-09T09:48:38.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.804+0000 7fbc77a82640 1 -- 172.21.15.157:0/97875782 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc680aa5c0 con 0x56288f6a0b40 2024-05-09T09:48:38.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.804+0000 7fbc7af69980 1 -- 172.21.15.157:0/97875782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f6a0b40 msgr2=0x56288f6a0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.804+0000 7fbc7af69980 1 --2- 172.21.15.157:0/97875782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f6a0b40 0x56288f6a0f20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbc6800a5c0 tx=0x7fbc6801b340 comp rx=0 tx=0).stop 2024-05-09T09:48:38.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.804+0000 7fbc7af69980 1 -- 172.21.15.157:0/97875782 shutdown_connections 2024-05-09T09:48:38.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.804+0000 7fbc7af69980 1 --2- 172.21.15.157:0/97875782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f6a0b40 0x56288f6a0f20 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.804+0000 7fbc7af69980 1 -- 172.21.15.157:0/97875782 >> 172.21.15.157:0/97875782 conn(0x56288f614260 msgr2=0x56288f614670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:38.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.804+0000 7fbc7af69980 1 -- 172.21.15.157:0/97875782 shutdown_connections 2024-05-09T09:48:38.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.804+0000 7fbc7af69980 1 -- 172.21.15.157:0/97875782 wait complete. 2024-05-09T09:48:38.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.820+0000 7fbc7af69980 1 Processor -- start 2024-05-09T09:48:38.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.820+0000 7fbc7af69980 1 -- start start 2024-05-09T09:48:38.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.820+0000 7fbc7af69980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f6a0b40 0x56288f78c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.820+0000 7fbc7af69980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56288f5a1fe0 con 0x56288f6a0b40 2024-05-09T09:48:38.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.820+0000 7fbc78a84640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f6a0b40 0x56288f78c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.820+0000 7fbc78a84640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f6a0b40 0x56288f78c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59942/0 (socket says 172.21.15.157:59942) 2024-05-09T09:48:38.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.820+0000 7fbc78a84640 1 -- 172.21.15.157:0/2831704186 learned_addr learned my addr 172.21.15.157:0/2831704186 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:38.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.820+0000 7fbc78a84640 1 -- 172.21.15.157:0/2831704186 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56288f526ae0 con 0x56288f6a0b40 2024-05-09T09:48:38.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.820+0000 7fbc78a84640 1 --2- 172.21.15.157:0/2831704186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f6a0b40 0x56288f78c4b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fbc680ac040 tx=0x7fbc68003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bcf10e07f7e2092 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.820+0000 7fbb66614640 1 -- 172.21.15.157:0/2831704186 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc680aa970 con 0x56288f6a0b40 2024-05-09T09:48:38.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.820+0000 7fbb66614640 1 -- 172.21.15.157:0/2831704186 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc680aab10 con 0x56288f6a0b40 2024-05-09T09:48:38.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.820+0000 7fbb66614640 1 -- 172.21.15.157:0/2831704186 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc680aae30 con 0x56288f6a0b40 2024-05-09T09:48:38.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.820+0000 7fbc7af69980 1 -- 172.21.15.157:0/2831704186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f6a0b40 msgr2=0x56288f78c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.820+0000 7fbc7af69980 1 --2- 172.21.15.157:0/2831704186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f6a0b40 0x56288f78c4b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fbc680ac040 tx=0x7fbc68003030 comp rx=0 tx=0).stop 2024-05-09T09:48:38.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.820+0000 7fbc7af69980 1 -- 172.21.15.157:0/2831704186 shutdown_connections 2024-05-09T09:48:38.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.820+0000 7fbc7af69980 1 --2- 172.21.15.157:0/2831704186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f6a0b40 0x56288f78c4b0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.820+0000 7fbc7af69980 1 -- 172.21.15.157:0/2831704186 >> 172.21.15.157:0/2831704186 conn(0x56288f614260 msgr2=0x56288f788040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:38.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.820+0000 7fbc7af69980 1 -- 172.21.15.157:0/2831704186 shutdown_connections 2024-05-09T09:48:38.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.820+0000 7fbc7af69980 1 -- 172.21.15.157:0/2831704186 wait complete. 2024-05-09T09:48:38.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.820+0000 7fbc7af69980 1 Processor -- start 2024-05-09T09:48:38.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.824+0000 7fbc7af69980 1 -- start start 2024-05-09T09:48:38.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.824+0000 7fbc7af69980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f6a0b40 0x56288f793480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.824+0000 7fbc7af69980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56288f6aab80 con 0x56288f6a0b40 2024-05-09T09:48:38.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.824+0000 7fbc78a84640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f6a0b40 0x56288f793480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.824+0000 7fbc78a84640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f6a0b40 0x56288f793480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59950/0 (socket says 172.21.15.157:59950) 2024-05-09T09:48:38.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.824+0000 7fbc78a84640 1 -- 172.21.15.157:0/3246771418 learned_addr learned my addr 172.21.15.157:0/3246771418 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:38.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.824+0000 7fbc78a84640 1 -- 172.21.15.157:0/3246771418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56288f7939c0 con 0x56288f6a0b40 2024-05-09T09:48:38.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.824+0000 7fbc78a84640 1 --2- 172.21.15.157:0/3246771418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f6a0b40 0x56288f793480 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fbc68003070 tx=0x7fbc680180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.824+0000 7fbb64e11640 1 -- 172.21.15.157:0/3246771418 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc680c6690 con 0x56288f6a0b40 2024-05-09T09:48:38.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.824+0000 7fbc7af69980 1 -- 172.21.15.157:0/3246771418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56288f793c50 con 0x56288f6a0b40 2024-05-09T09:48:38.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.824+0000 7fbb64e11640 1 -- 172.21.15.157:0/3246771418 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc680cc070 con 0x56288f6a0b40 2024-05-09T09:48:38.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.824+0000 7fbb64e11640 1 -- 172.21.15.157:0/3246771418 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc680c6960 con 0x56288f6a0b40 2024-05-09T09:48:38.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.824+0000 7fbc7af69980 1 -- 172.21.15.157:0/3246771418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56288f7968e0 con 0x56288f6a0b40 2024-05-09T09:48:38.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.824+0000 7fbb64e11640 1 -- 172.21.15.157:0/3246771418 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fbc680c6b00 con 0x56288f6a0b40 2024-05-09T09:48:38.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.824+0000 7fbb64e11640 1 --2- 172.21.15.157:0/3246771418 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb60034bb0 0x7fbb60037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.824+0000 7fbb64e11640 1 -- 172.21.15.157:0/3246771418 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fbc680e5cb0 con 0x56288f6a0b40 2024-05-09T09:48:38.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.824+0000 7fbc78283640 1 --2- 172.21.15.157:0/3246771418 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb60034bb0 0x7fbb60037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.824+0000 7fbc7af69980 1 --2- 172.21.15.157:0/3246771418 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56288f6a1460 0x56288f79a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.824+0000 7fbc7af69980 1 -- 172.21.15.157:0/3246771418 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56288f79aa70 con 0x56288f6a1460 2024-05-09T09:48:38.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.824+0000 7fbc79285640 1 --2- 172.21.15.157:0/3246771418 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56288f6a1460 0x56288f79a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.824+0000 7fbc78283640 1 --2- 172.21.15.157:0/3246771418 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb60034bb0 0x7fbb60037070 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbc640012f0 tx=0x7fbc640066b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.828+0000 7fbc79285640 1 --2- 172.21.15.157:0/3246771418 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56288f6a1460 0x56288f79a530 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.828+0000 7fbc79285640 1 -- 172.21.15.157:0/3246771418 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc700083f0 con 0x56288f6a1460 2024-05-09T09:48:38.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.828+0000 7fbc7af69980 1 -- 172.21.15.157:0/3246771418 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56288f79b360 con 0x56288f6a1460 2024-05-09T09:48:38.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.828+0000 7fbc79285640 1 -- 172.21.15.157:0/3246771418 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbc700083f0 con 0x56288f6a1460 2024-05-09T09:48:38.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.828+0000 7fbc7af69980 1 --2- 172.21.15.157:0/3246771418 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56288f79ccb0 0x56288f79f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.828+0000 7fbc7af69980 1 -- 172.21.15.157:0/3246771418 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56288f79f8d0 con 0x56288f79ccb0 2024-05-09T09:48:38.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.828+0000 7fbc78a84640 1 --2- 172.21.15.157:0/3246771418 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56288f79ccb0 0x56288f79f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.828+0000 7fbc78a84640 1 --2- 172.21.15.157:0/3246771418 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56288f79ccb0 0x56288f79f140 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.828+0000 7fbc78a84640 1 -- 172.21.15.157:0/3246771418 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbc680c0bb0 con 0x56288f79ccb0 2024-05-09T09:48:38.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.828+0000 7fbc7af69980 1 -- 172.21.15.157:0/3246771418 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56288f79bbb0 con 0x56288f6a1460 2024-05-09T09:48:38.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.828+0000 7fbc79285640 1 -- 172.21.15.157:0/3246771418 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbc700083f0 con 0x56288f6a1460 2024-05-09T09:48:38.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.828+0000 7fbc7af69980 1 --2- 172.21.15.157:0/3246771418 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56288f7a0d30 0x56288f7a3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.828+0000 7fbc7af69980 1 -- 172.21.15.157:0/3246771418 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56288f7a3860 con 0x56288f7a0d30 2024-05-09T09:48:38.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.828+0000 7fbc78283640 1 --2- 172.21.15.157:0/3246771418 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56288f7a0d30 0x56288f7a3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.828+0000 7fbc78283640 1 --2- 172.21.15.157:0/3246771418 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56288f7a0d30 0x56288f7a3120 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.828+0000 7fbc78283640 1 -- 172.21.15.157:0/3246771418 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbc6400f030 con 0x56288f7a0d30 2024-05-09T09:48:38.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.832+0000 7fbc7af69980 1 Processor -- start 2024-05-09T09:48:38.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.832+0000 7fbc7af69980 1 -- start start 2024-05-09T09:48:38.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.832+0000 7fbc7af69980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f7c9710 0x56288f7c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.832+0000 7fbc7af69980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56288f5a6020 con 0x56288f7c9710 2024-05-09T09:48:38.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.836+0000 7fbc78a84640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f7c9710 0x56288f7c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.836+0000 7fbc78a84640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f7c9710 0x56288f7c9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59958/0 (socket says 172.21.15.157:59958) 2024-05-09T09:48:38.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.836+0000 7fbc78a84640 1 -- 172.21.15.157:0/171490232 learned_addr learned my addr 172.21.15.157:0/171490232 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:38.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.836+0000 7fbc78a84640 1 -- 172.21.15.157:0/171490232 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56288f7ca070 con 0x56288f7c9710 2024-05-09T09:48:38.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.836+0000 7fbc78a84640 1 --2- 172.21.15.157:0/171490232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f7c9710 0x56288f7c9b30 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fbc680bc970 tx=0x7fbc680c5ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.836+0000 7fbb5cb9e640 1 -- 172.21.15.157:0/171490232 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc680bc9e0 con 0x56288f7c9710 2024-05-09T09:48:38.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.836+0000 7fbb5cb9e640 1 -- 172.21.15.157:0/171490232 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc680bcb80 con 0x56288f7c9710 2024-05-09T09:48:38.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.836+0000 7fbb5cb9e640 1 -- 172.21.15.157:0/171490232 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc680bcd70 con 0x56288f7c9710 2024-05-09T09:48:38.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.836+0000 7fbc7af69980 1 -- 172.21.15.157:0/171490232 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56288f7cab00 con 0x56288f7c9710 2024-05-09T09:48:38.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.836+0000 7fbc7af69980 1 -- 172.21.15.157:0/171490232 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56288f7cab00 con 0x56288f7c9710 2024-05-09T09:48:38.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.836+0000 7fbb5cb9e640 1 -- 172.21.15.157:0/171490232 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fbc680d0410 con 0x56288f7c9710 2024-05-09T09:48:38.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.836+0000 7fbb5cb9e640 1 --2- 172.21.15.157:0/171490232 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb50034c00 0x7fbb500370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.836+0000 7fbb5cb9e640 1 -- 172.21.15.157:0/171490232 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fbc680ca680 con 0x56288f7c9710 2024-05-09T09:48:38.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.836+0000 7fbc78283640 1 --2- 172.21.15.157:0/171490232 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb50034c00 0x7fbb500370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.836+0000 7fbc7af69980 1 Processor -- start 2024-05-09T09:48:38.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.836+0000 7fbc7af69980 1 -- start start 2024-05-09T09:48:38.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.836+0000 7fbc7af69980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f7d64e0 0x56288f7d6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.836+0000 7fbc7af69980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56288f78cb40 con 0x56288f7d64e0 2024-05-09T09:48:38.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.836+0000 7fbc78283640 1 --2- 172.21.15.157:0/171490232 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb50034c00 0x7fbb500370c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x56288f797c60 tx=0x7fbc64011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.840+0000 7fbc78a84640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f7d64e0 0x56288f7d6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.840+0000 7fbc78a84640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f7d64e0 0x56288f7d6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59970/0 (socket says 172.21.15.157:59970) 2024-05-09T09:48:38.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.840+0000 7fbc78a84640 1 -- 172.21.15.157:0/1009379730 learned_addr learned my addr 172.21.15.157:0/1009379730 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:38.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.840+0000 7fbc78a84640 1 -- 172.21.15.157:0/1009379730 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56288f7d6ed0 con 0x56288f7d64e0 2024-05-09T09:48:38.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.840+0000 7fbc78a84640 1 --2- 172.21.15.157:0/1009379730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f7d64e0 0x56288f7d6900 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fbc680ca330 tx=0x7fbc680c09d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=123191cc9ff1a8e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.840+0000 7fbb567fc640 1 -- 172.21.15.157:0/1009379730 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc68107070 con 0x56288f7d64e0 2024-05-09T09:48:38.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.840+0000 7fbb567fc640 1 -- 172.21.15.157:0/1009379730 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc680fb070 con 0x56288f7d64e0 2024-05-09T09:48:38.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.840+0000 7fbb567fc640 1 -- 172.21.15.157:0/1009379730 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc680d4e90 con 0x56288f7d64e0 2024-05-09T09:48:38.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.840+0000 7fbc7af69980 1 -- 172.21.15.157:0/1009379730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f7d64e0 msgr2=0x56288f7d6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.840+0000 7fbc7af69980 1 --2- 172.21.15.157:0/1009379730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f7d64e0 0x56288f7d6900 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fbc680ca330 tx=0x7fbc680c09d0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.840+0000 7fbc7af69980 1 -- 172.21.15.157:0/1009379730 shutdown_connections 2024-05-09T09:48:38.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.840+0000 7fbc7af69980 1 --2- 172.21.15.157:0/1009379730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f7d64e0 0x56288f7d6900 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.840+0000 7fbc7af69980 1 -- 172.21.15.157:0/1009379730 >> 172.21.15.157:0/1009379730 conn(0x56288f7d2860 msgr2=0x56288f7d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:38.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.840+0000 7fbc7af69980 1 -- 172.21.15.157:0/1009379730 shutdown_connections 2024-05-09T09:48:38.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.840+0000 7fbc7af69980 1 -- 172.21.15.157:0/1009379730 wait complete. 2024-05-09T09:48:38.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.840+0000 7fbc7af69980 1 Processor -- start 2024-05-09T09:48:38.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.840+0000 7fbc7af69980 1 -- start start 2024-05-09T09:48:38.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.840+0000 7fbc7af69980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f7d64e0 0x56288f7dd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.840+0000 7fbc7af69980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56288f7d75a0 con 0x56288f7d64e0 2024-05-09T09:48:38.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.840+0000 7fbc78a84640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f7d64e0 0x56288f7dd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.840+0000 7fbc78a84640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f7d64e0 0x56288f7dd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59972/0 (socket says 172.21.15.157:59972) 2024-05-09T09:48:38.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.840+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 learned_addr learned my addr 172.21.15.157:0/2895195201 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:38.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.840+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56288f7ddce0 con 0x56288f7d64e0 2024-05-09T09:48:38.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.840+0000 7fbc78a84640 1 --2- 172.21.15.157:0/2895195201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f7d64e0 0x56288f7dd7a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fbc680bf040 tx=0x7fbc680ca2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbb54ff9640 1 -- 172.21.15.157:0/2895195201 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc68112020 con 0x56288f7d64e0 2024-05-09T09:48:38.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56288f7ddce0 con 0x56288f7d64e0 2024-05-09T09:48:38.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbb54ff9640 1 -- 172.21.15.157:0/2895195201 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc680ab230 con 0x56288f7d64e0 2024-05-09T09:48:38.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbb54ff9640 1 -- 172.21.15.157:0/2895195201 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc68107040 con 0x56288f7d64e0 2024-05-09T09:48:38.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56288f7ddce0 con 0x56288f7d64e0 2024-05-09T09:48:38.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbb54ff9640 1 -- 172.21.15.157:0/2895195201 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fbc68115020 con 0x56288f7d64e0 2024-05-09T09:48:38.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbc7af69980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbb54ff9640 1 --2- 172.21.15.157:0/2895195201 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb40034bb0 0x7fbb40037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbb54ff9640 1 -- 172.21.15.157:0/2895195201 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fbc68118d20 con 0x56288f7d64e0 2024-05-09T09:48:38.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbc78283640 1 --2- 172.21.15.157:0/2895195201 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb40034bb0 0x7fbb40037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbc7af69980 1 --2- 172.21.15.157:0/2895195201 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56288f7ea1c0 0x56288f7ec680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ecdd0 con 0x56288f7ea1c0 2024-05-09T09:48:38.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbc79285640 1 --2- 172.21.15.157:0/2895195201 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56288f7ea1c0 0x56288f7ec680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbc78283640 1 --2- 172.21.15.157:0/2895195201 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb40034bb0 0x7fbb40037070 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x56288f7a3c40 tx=0x7fbc64012000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbc79285640 1 --2- 172.21.15.157:0/2895195201 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56288f7ea1c0 0x56288f7ec680 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc700083f0 con 0x56288f7ea1c0 2024-05-09T09:48:38.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbc7af69980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:38.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbc7af69980 20 realm 2024-05-09T09:48:38.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbc7af69980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ed1e0 con 0x56288f7ea1c0 2024-05-09T09:48:38.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc700083f0 con 0x56288f7ea1c0 2024-05-09T09:48:38.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbc7af69980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:38.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbc7af69980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:48:38.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbc7af69980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56288f7eda80 con 0x56288f7ea1c0 2024-05-09T09:48:38.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc700083f0 con 0x56288f7ea1c0 2024-05-09T09:48:38.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbc7af69980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:38.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbc7af69980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x56288f7ea1c0 2024-05-09T09:48:38.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbc700083f0 con 0x56288f7ea1c0 2024-05-09T09:48:38.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbc7af69980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:38.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbc7af69980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbc7af69980 1 --2- 172.21.15.157:0/2895195201 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56288f7eeb80 0x56288f7f0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.844+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56288f7f14b0 con 0x56288f7eeb80 2024-05-09T09:48:38.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.848+0000 7fbc78a84640 1 --2- 172.21.15.157:0/2895195201 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56288f7eeb80 0x56288f7f0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.848+0000 7fbc78a84640 1 --2- 172.21.15.157:0/2895195201 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56288f7eeb80 0x56288f7f0f70 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.848+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbc6810a040 con 0x56288f7eeb80 2024-05-09T09:48:38.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.848+0000 7fbc7af69980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:48:38.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.848+0000 7fbc7af69980 20 searching for the correct realm 2024-05-09T09:48:38.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.848+0000 7fbc7af69980 1 --2- 172.21.15.157:0/2895195201 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56288f7f3420 0x56288f7f58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.848+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7f5fb0 con 0x56288f7f3420 2024-05-09T09:48:38.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.848+0000 7fbc78283640 1 --2- 172.21.15.157:0/2895195201 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56288f7f3420 0x56288f7f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.848+0000 7fbc78283640 1 --2- 172.21.15.157:0/2895195201 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56288f7f3420 0x56288f7f58e0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.848+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc64021040 con 0x56288f7f3420 2024-05-09T09:48:38.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.848+0000 7fbc78283640 1 --2- 172.21.15.157:0/2895195201 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fbc64013040 0x7fbc640243c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:38.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.848+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7f5fb0 con 0x7fbc64013040 2024-05-09T09:48:38.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.848+0000 7fbc79285640 1 --2- 172.21.15.157:0/2895195201 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fbc64013040 0x7fbc640243c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:38.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.848+0000 7fbc79285640 1 --2- 172.21.15.157:0/2895195201 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fbc64013040 0x7fbc640243c0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:38.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.848+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc700083f0 con 0x7fbc64013040 2024-05-09T09:48:38.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.848+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x56288f7eeb80 2024-05-09T09:48:38.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.852+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc6810a040 con 0x56288f7eeb80 2024-05-09T09:48:38.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.852+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x56288f7ea1c0 2024-05-09T09:48:38.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.852+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc700083f0 con 0x56288f7ea1c0 2024-05-09T09:48:38.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.852+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x56288f7ea1c0 2024-05-09T09:48:38.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.852+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc70026040 con 0x56288f7ea1c0 2024-05-09T09:48:38.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.852+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x56288f7eeb80 2024-05-09T09:48:38.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.852+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc6810a040 con 0x56288f7eeb80 2024-05-09T09:48:38.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.852+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x56288f7eeb80 2024-05-09T09:48:38.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.852+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc6810a040 con 0x56288f7eeb80 2024-05-09T09:48:38.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.852+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x7fbc64013040 2024-05-09T09:48:38.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.852+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc70026040 con 0x7fbc64013040 2024-05-09T09:48:38.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.852+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x56288f7f3420 2024-05-09T09:48:38.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.852+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc64021040 con 0x56288f7f3420 2024-05-09T09:48:38.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.852+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x56288f7ea1c0 2024-05-09T09:48:38.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.852+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc70026040 con 0x56288f7ea1c0 2024-05-09T09:48:38.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.852+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x56288f7eeb80 2024-05-09T09:48:38.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.852+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc6810a040 con 0x56288f7eeb80 2024-05-09T09:48:38.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.852+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x56288f7ea1c0 2024-05-09T09:48:38.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.852+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc70026040 con 0x56288f7ea1c0 2024-05-09T09:48:38.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.856+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x7fbc64013040 2024-05-09T09:48:38.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.856+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbc70026040 con 0x7fbc64013040 2024-05-09T09:48:38.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.856+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x56288f7f3420 2024-05-09T09:48:38.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.856+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc64041040 con 0x56288f7f3420 2024-05-09T09:48:38.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.856+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x56288f7f3420 2024-05-09T09:48:38.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.856+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbc64041040 con 0x56288f7f3420 2024-05-09T09:48:38.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.856+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x56288f7eeb80 2024-05-09T09:48:38.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.856+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc6810a040 con 0x56288f7eeb80 2024-05-09T09:48:38.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.856+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x56288f7f3420 2024-05-09T09:48:38.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.856+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc64041040 con 0x56288f7f3420 2024-05-09T09:48:38.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.856+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x56288f7f3420 2024-05-09T09:48:38.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.856+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc64041040 con 0x56288f7f3420 2024-05-09T09:48:38.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.856+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x56288f7ea1c0 2024-05-09T09:48:38.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.856+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc70026040 con 0x56288f7ea1c0 2024-05-09T09:48:38.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.856+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x56288f7ea1c0 2024-05-09T09:48:38.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.856+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbc70026040 con 0x56288f7ea1c0 2024-05-09T09:48:38.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.856+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x56288f7eeb80 2024-05-09T09:48:38.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.856+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc6810a040 con 0x56288f7eeb80 2024-05-09T09:48:38.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.856+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x56288f7f3420 2024-05-09T09:48:38.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.856+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc64041040 con 0x56288f7f3420 2024-05-09T09:48:38.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.856+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x7fbc64013040 2024-05-09T09:48:38.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.860+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc70026040 con 0x7fbc64013040 2024-05-09T09:48:38.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.860+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x56288f7ea1c0 2024-05-09T09:48:38.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.860+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc70026040 con 0x56288f7ea1c0 2024-05-09T09:48:38.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.860+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x56288f7eeb80 2024-05-09T09:48:38.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.860+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbc6810a040 con 0x56288f7eeb80 2024-05-09T09:48:38.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.860+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x56288f7f3420 2024-05-09T09:48:38.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.860+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc64041040 con 0x56288f7f3420 2024-05-09T09:48:38.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.860+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x56288f7eeb80 2024-05-09T09:48:38.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.860+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc6810a040 con 0x56288f7eeb80 2024-05-09T09:48:38.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.860+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x7fbc64013040 2024-05-09T09:48:38.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.860+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc70026040 con 0x7fbc64013040 2024-05-09T09:48:38.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.860+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x56288f7f3420 2024-05-09T09:48:38.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.860+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc64041040 con 0x56288f7f3420 2024-05-09T09:48:38.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.860+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x56288f7eeb80 2024-05-09T09:48:38.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.860+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc6810a040 con 0x56288f7eeb80 2024-05-09T09:48:38.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.860+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x56288f7ea1c0 2024-05-09T09:48:38.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbc70026040 con 0x56288f7ea1c0 2024-05-09T09:48:38.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56288f7ede20 con 0x7fbc64013040 2024-05-09T09:48:38.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc70026040 con 0x7fbc64013040 2024-05-09T09:48:38.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:48:38.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:48:38.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:48:38.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:48:38.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:48:38.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:48:38.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56288f7f1d00 con 0x56288f7ea1c0 2024-05-09T09:48:38.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc70026040 con 0x56288f7ea1c0 2024-05-09T09:48:38.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:38.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56288f7f1d00 con 0x56288f7ea1c0 2024-05-09T09:48:38.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbc70026040 con 0x56288f7ea1c0 2024-05-09T09:48:38.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:38.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56288f7f1d00 con 0x56288f7f3420 2024-05-09T09:48:38.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbc64041040 con 0x56288f7f3420 2024-05-09T09:48:38.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:48:38.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 20 zone default found 2024-05-09T09:48:38.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 4 Realm: () 2024-05-09T09:48:38.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:48:38.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:48:38.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:48:38.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 20 zonegroup default 2024-05-09T09:48:38.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56288f7f25a0 con 0x56288f7eeb80 2024-05-09T09:48:38.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbc6810a040 con 0x56288f7eeb80 2024-05-09T09:48:38.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:38.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56288f7f7e10 con 0x56288f7f3420 2024-05-09T09:48:38.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbc64041040 con 0x56288f7f3420 2024-05-09T09:48:38.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:38.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56288f7f81b0 con 0x56288f7f3420 2024-05-09T09:48:38.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbc64041040 con 0x56288f7f3420 2024-05-09T09:48:38.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:38.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 20 started sync module instance, tier type = 2024-05-09T09:48:38.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:48:38.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.864+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f7f72b0 con 0x7fbc64013040 2024-05-09T09:48:38.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.868+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc70026040 con 0x7fbc64013040 2024-05-09T09:48:38.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.868+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94732206176256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f7f72b0 con 0x7fbc64013040 2024-05-09T09:48:38.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.868+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f7f8c50 con 0x56288f7ea1c0 2024-05-09T09:48:38.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.868+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94732206176256] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc70036040 con 0x7fbc64013040 2024-05-09T09:48:38.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.868+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc70036040 con 0x56288f7ea1c0 2024-05-09T09:48:38.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.868+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94732206180160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f7f72b0 con 0x56288f7ea1c0 2024-05-09T09:48:38.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.868+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f7f9690 con 0x56288f7f3420 2024-05-09T09:48:38.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.872+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94732206180160] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc70036040 con 0x56288f7ea1c0 2024-05-09T09:48:38.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.872+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc64041040 con 0x56288f7f3420 2024-05-09T09:48:38.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.872+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94732206173696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f7f7220 con 0x56288f7f3420 2024-05-09T09:48:38.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.872+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f7fa390 con 0x7fbc64013040 2024-05-09T09:48:38.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.872+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc70036040 con 0x7fbc64013040 2024-05-09T09:48:38.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.872+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94732206186512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f7fac30 con 0x7fbc64013040 2024-05-09T09:48:38.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.872+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f7fb5f0 con 0x56288f7ea1c0 2024-05-09T09:48:38.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.872+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94732206173696] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc64041040 con 0x56288f7f3420 2024-05-09T09:48:38.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.872+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94732206186512] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc70036040 con 0x7fbc64013040 2024-05-09T09:48:38.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.876+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc70036040 con 0x56288f7ea1c0 2024-05-09T09:48:38.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.876+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94732206190912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f7fab80 con 0x56288f7ea1c0 2024-05-09T09:48:38.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.876+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f7fb560 con 0x56288f7eeb80 2024-05-09T09:48:38.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.876+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94732206190912] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc70036040 con 0x56288f7ea1c0 2024-05-09T09:48:38.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.876+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc6810a040 con 0x56288f7eeb80 2024-05-09T09:48:38.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.876+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94732206188240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f7fbec0 con 0x56288f7eeb80 2024-05-09T09:48:38.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.876+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f7fc710 con 0x56288f7eeb80 2024-05-09T09:48:38.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.880+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94732206188240] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc6810a040 con 0x56288f7eeb80 2024-05-09T09:48:38.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.880+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc6810a040 con 0x56288f7eeb80 2024-05-09T09:48:38.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.880+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94732206193440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f7fc570 con 0x56288f7eeb80 2024-05-09T09:48:38.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.880+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f7fd090 con 0x56288f7eeb80 2024-05-09T09:48:38.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.880+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94732206193440] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc6810a040 con 0x56288f7eeb80 2024-05-09T09:48:38.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.880+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc6810a040 con 0x56288f7eeb80 2024-05-09T09:48:38.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.880+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94732206197600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f7fd050 con 0x56288f7eeb80 2024-05-09T09:48:38.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.880+0000 7fbc7af69980 20 add_watcher() i=0 2024-05-09T09:48:38.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.880+0000 7fbc7af69980 20 add_watcher() i=1 2024-05-09T09:48:38.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.880+0000 7fbc7af69980 20 add_watcher() i=2 2024-05-09T09:48:38.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.880+0000 7fbc7af69980 20 add_watcher() i=3 2024-05-09T09:48:38.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.880+0000 7fbc7af69980 20 add_watcher() i=4 2024-05-09T09:48:38.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.880+0000 7fbc7af69980 20 add_watcher() i=5 2024-05-09T09:48:38.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.880+0000 7fbc7af69980 20 add_watcher() i=6 2024-05-09T09:48:38.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.884+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94732206197600] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc6810a040 con 0x56288f7eeb80 2024-05-09T09:48:38.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.884+0000 7fbc7af69980 20 add_watcher() i=7 2024-05-09T09:48:38.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.884+0000 7fbc7af69980 2 all 8 watchers are set, enabling cache 2024-05-09T09:48:38.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.884+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56288f8004e0 con 0x56288f7ea1c0 2024-05-09T09:48:38.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.884+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbc70036040 con 0x56288f7ea1c0 2024-05-09T09:48:38.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.884+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94732206194624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f7fda00 con 0x56288f7ea1c0 2024-05-09T09:48:38.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.884+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94732206194624] v32'360 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbc70036040 con 0x56288f7ea1c0 2024-05-09T09:48:38.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.884+0000 7fbb2d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:38.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.884+0000 7fbc7af69980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:48:38.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.884+0000 7fbc7af69980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:48:38.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.884+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f7fffd0 con 0x56288f7ea1c0 2024-05-09T09:48:38.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.888+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'85 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc70036040 con 0x56288f7ea1c0 2024-05-09T09:48:38.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.888+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f7fff40 con 0x56288f7eeb80 2024-05-09T09:48:38.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.888+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'79 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc6810a040 con 0x56288f7eeb80 2024-05-09T09:48:38.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.888+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f7fff40 con 0x56288f7f3420 2024-05-09T09:48:38.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.892+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'78 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc64041040 con 0x56288f7f3420 2024-05-09T09:48:38.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.892+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f809bd0 con 0x56288f7ea1c0 2024-05-09T09:48:38.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.892+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'361 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc70036040 con 0x56288f7ea1c0 2024-05-09T09:48:38.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.892+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f808bc0 con 0x7fbc64013040 2024-05-09T09:48:38.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.892+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'224 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc70036040 con 0x7fbc64013040 2024-05-09T09:48:38.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.892+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f808bc0 con 0x56288f7f3420 2024-05-09T09:48:38.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.896+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'150 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc64041040 con 0x56288f7f3420 2024-05-09T09:48:38.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.896+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f80a900 con 0x56288f7ea1c0 2024-05-09T09:48:38.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.896+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'80 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc70036040 con 0x56288f7ea1c0 2024-05-09T09:48:38.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.896+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f808d90 con 0x56288f7eeb80 2024-05-09T09:48:38.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.900+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'149 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc6810a040 con 0x56288f7eeb80 2024-05-09T09:48:38.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.900+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f808d90 con 0x7fbc64013040 2024-05-09T09:48:38.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.900+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'78 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc70036040 con 0x7fbc64013040 2024-05-09T09:48:38.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.900+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f808bc0 con 0x56288f7f3420 2024-05-09T09:48:38.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.904+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'84 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc64041040 con 0x56288f7f3420 2024-05-09T09:48:38.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.904+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f80af90 con 0x7fbc64013040 2024-05-09T09:48:38.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.904+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'225 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc70036040 con 0x7fbc64013040 2024-05-09T09:48:38.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.904+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f80af10 con 0x56288f7eeb80 2024-05-09T09:48:38.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.908+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'82 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc6810a040 con 0x56288f7eeb80 2024-05-09T09:48:38.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.908+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f80af10 con 0x7fbc64013040 2024-05-09T09:48:38.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.908+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'78 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc70036040 con 0x7fbc64013040 2024-05-09T09:48:38.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.908+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f80b0e0 con 0x56288f7eeb80 2024-05-09T09:48:38.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.912+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'155 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc6810a040 con 0x56288f7eeb80 2024-05-09T09:48:38.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.912+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f80b0e0 con 0x56288f7ea1c0 2024-05-09T09:48:38.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.912+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'362 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc70036040 con 0x56288f7ea1c0 2024-05-09T09:48:38.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.912+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f80b0e0 con 0x56288f7f3420 2024-05-09T09:48:38.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.916+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'218 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc64041040 con 0x56288f7f3420 2024-05-09T09:48:38.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.916+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f80b0e0 con 0x7fbc64013040 2024-05-09T09:48:38.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.916+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'226 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc70036040 con 0x7fbc64013040 2024-05-09T09:48:38.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.916+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f80b0e0 con 0x56288f7f3420 2024-05-09T09:48:38.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.916+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'78 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc64041040 con 0x56288f7f3420 2024-05-09T09:48:38.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.916+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f80b0e0 con 0x56288f7ea1c0 2024-05-09T09:48:38.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.920+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'86 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc70036040 con 0x56288f7ea1c0 2024-05-09T09:48:38.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.920+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f80b0e0 con 0x56288f7ea1c0 2024-05-09T09:48:38.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.920+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'363 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc70036040 con 0x56288f7ea1c0 2024-05-09T09:48:38.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.920+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f80b0e0 con 0x56288f7f3420 2024-05-09T09:48:38.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.924+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'219 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc64041040 con 0x56288f7f3420 2024-05-09T09:48:38.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.924+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f80b0e0 con 0x7fbc64013040 2024-05-09T09:48:38.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.924+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'90 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc70036040 con 0x7fbc64013040 2024-05-09T09:48:38.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.924+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f80b0e0 con 0x56288f7f3420 2024-05-09T09:48:38.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.924+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'80 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc64041040 con 0x56288f7f3420 2024-05-09T09:48:38.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.924+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f80b0e0 con 0x56288f7f3420 2024-05-09T09:48:38.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.928+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'84 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc64041040 con 0x56288f7f3420 2024-05-09T09:48:38.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.928+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f80b0e0 con 0x56288f7f3420 2024-05-09T09:48:38.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.928+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'75 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc64041040 con 0x56288f7f3420 2024-05-09T09:48:38.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.928+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f80b0e0 con 0x56288f7f3420 2024-05-09T09:48:38.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.932+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'151 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc64041040 con 0x56288f7f3420 2024-05-09T09:48:38.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.932+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f80b0e0 con 0x56288f7eeb80 2024-05-09T09:48:38.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.932+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'80 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc6810a040 con 0x56288f7eeb80 2024-05-09T09:48:38.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.932+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f80af10 con 0x56288f7f3420 2024-05-09T09:48:38.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.936+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'78 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc64041040 con 0x56288f7f3420 2024-05-09T09:48:38.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.936+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f80af10 con 0x56288f7eeb80 2024-05-09T09:48:38.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.936+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'150 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc6810a040 con 0x56288f7eeb80 2024-05-09T09:48:38.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.936+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f80af10 con 0x56288f7f3420 2024-05-09T09:48:38.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.940+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'220 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc64041040 con 0x56288f7f3420 2024-05-09T09:48:38.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.940+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f80af10 con 0x56288f7eeb80 2024-05-09T09:48:38.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.944+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'156 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc6810a040 con 0x56288f7eeb80 2024-05-09T09:48:38.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.944+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f80af10 con 0x7fbc64013040 2024-05-09T09:48:38.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.944+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'84 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc70036040 con 0x7fbc64013040 2024-05-09T09:48:38.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.944+0000 7fbaa7fff640 20 reqs_thread_entry: start 2024-05-09T09:48:38.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.948+0000 7fbc7af69980 20 init_complete bucket index max shards: 11 2024-05-09T09:48:38.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.948+0000 7fbaa5ffb640 20 reqs_thread_entry: start 2024-05-09T09:48:38.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.948+0000 7fbc7af69980 20 rados->read ofs=0 len=0 2024-05-09T09:48:38.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.948+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56288f808190 con 0x56288f7ea1c0 2024-05-09T09:48:38.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.948+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fbc70036040 con 0x56288f7ea1c0 2024-05-09T09:48:38.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.948+0000 7fbc7af69980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:48:38.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.948+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:95 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56288f8283e0 con 0x56288f7eeb80 2024-05-09T09:48:38.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.948+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(95 usage.10 [call out=1378b] v0'0 uv77 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fbc6810a040 con 0x56288f7eeb80 2024-05-09T09:48:38.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.952+0000 7fbb2d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:38.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.952+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94732206194624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f800d70 con 0x56288f7ea1c0 2024-05-09T09:48:38.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.952+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94732206194624] v32'364 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbc70036040 con 0x56288f7ea1c0 2024-05-09T09:48:38.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.952+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94732206176256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f7fbfc0 con 0x7fbc64013040 2024-05-09T09:48:38.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.952+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94732206176256] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc70036040 con 0x7fbc64013040 2024-05-09T09:48:38.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.952+0000 7fbc7af69980 20 remove_watcher() i=0 2024-05-09T09:48:38.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.952+0000 7fbc7af69980 2 removed watcher, disabling cache 2024-05-09T09:48:38.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.952+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94732206180160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f7f7800 con 0x56288f7ea1c0 2024-05-09T09:48:38.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.956+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94732206180160] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc70036040 con 0x56288f7ea1c0 2024-05-09T09:48:38.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.956+0000 7fbc7af69980 20 remove_watcher() i=1 2024-05-09T09:48:38.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.956+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94732206173696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f7f7800 con 0x56288f7f3420 2024-05-09T09:48:38.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.960+0000 7fbc78283640 1 -- 172.21.15.157:0/2895195201 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94732206173696] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc64041040 con 0x56288f7f3420 2024-05-09T09:48:38.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.960+0000 7fbc7af69980 20 remove_watcher() i=2 2024-05-09T09:48:38.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.960+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94732206186512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f7f7800 con 0x7fbc64013040 2024-05-09T09:48:38.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.960+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94732206186512] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc70036040 con 0x7fbc64013040 2024-05-09T09:48:38.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.960+0000 7fbc7af69980 20 remove_watcher() i=3 2024-05-09T09:48:38.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.960+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94732206190912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f7fa010 con 0x56288f7ea1c0 2024-05-09T09:48:38.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.964+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94732206190912] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc70036040 con 0x56288f7ea1c0 2024-05-09T09:48:38.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.964+0000 7fbc7af69980 20 remove_watcher() i=4 2024-05-09T09:48:38.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.964+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94732206188240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f7f7800 con 0x56288f7eeb80 2024-05-09T09:48:38.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.964+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94732206188240] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc6810a040 con 0x56288f7eeb80 2024-05-09T09:48:38.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.964+0000 7fbc7af69980 20 remove_watcher() i=5 2024-05-09T09:48:38.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.964+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94732206193440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f7fb140 con 0x56288f7eeb80 2024-05-09T09:48:38.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.968+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94732206193440] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc6810a040 con 0x56288f7eeb80 2024-05-09T09:48:38.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.968+0000 7fbc7af69980 20 remove_watcher() i=6 2024-05-09T09:48:38.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.968+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94732206197600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56288f7fa010 con 0x56288f7eeb80 2024-05-09T09:48:38.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.968+0000 7fbc78a84640 1 -- 172.21.15.157:0/2895195201 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94732206197600] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc6810a040 con 0x56288f7eeb80 2024-05-09T09:48:38.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.968+0000 7fbc7af69980 20 remove_watcher() i=7 2024-05-09T09:48:38.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.968+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56288f7eeb80 msgr2=0x56288f7f0f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.968+0000 7fbc7af69980 1 --2- 172.21.15.157:0/2895195201 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56288f7eeb80 0x56288f7f0f70 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.968+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56288f7ea1c0 msgr2=0x56288f7ec680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.968+0000 7fbc7af69980 1 --2- 172.21.15.157:0/2895195201 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56288f7ea1c0 0x56288f7ec680 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.968+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fbc64013040 msgr2=0x7fbc640243c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.968+0000 7fbc7af69980 1 --2- 172.21.15.157:0/2895195201 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fbc64013040 0x7fbc640243c0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.968+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56288f7f3420 msgr2=0x56288f7f58e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.968+0000 7fbc7af69980 1 --2- 172.21.15.157:0/2895195201 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56288f7f3420 0x56288f7f58e0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.968+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb40034bb0 msgr2=0x7fbb40037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.968+0000 7fbc7af69980 1 --2- 172.21.15.157:0/2895195201 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb40034bb0 0x7fbb40037070 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x56288f7a3c40 tx=0x7fbc64012000 comp rx=0 tx=0).stop 2024-05-09T09:48:38.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.968+0000 7fbc79285640 1 -- 172.21.15.157:0/2895195201 reap_dead start 2024-05-09T09:48:38.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.968+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f7d64e0 msgr2=0x56288f7dd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.968+0000 7fbc7af69980 1 --2- 172.21.15.157:0/2895195201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f7d64e0 0x56288f7dd7a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fbc680bf040 tx=0x7fbc680ca2c0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.968+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 shutdown_connections 2024-05-09T09:48:38.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.968+0000 7fbc7af69980 1 --2- 172.21.15.157:0/2895195201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f7d64e0 0x56288f7dd7a0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.968+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 >> 172.21.15.157:0/2895195201 conn(0x56288f7d2860 msgr2=0x56288f7d0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:38.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.968+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 shutdown_connections 2024-05-09T09:48:38.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.968+0000 7fbc7af69980 1 -- 172.21.15.157:0/2895195201 wait complete. 2024-05-09T09:48:38.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.972+0000 7fbc7af69980 1 -- 172.21.15.157:0/171490232 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb50034c00 msgr2=0x7fbb500370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.972+0000 7fbc7af69980 1 --2- 172.21.15.157:0/171490232 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb50034c00 0x7fbb500370c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x56288f797c60 tx=0x7fbc64011000 comp rx=0 tx=0).stop 2024-05-09T09:48:38.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.972+0000 7fbc7af69980 1 -- 172.21.15.157:0/171490232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f7c9710 msgr2=0x56288f7c9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.972+0000 7fbc7af69980 1 --2- 172.21.15.157:0/171490232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f7c9710 0x56288f7c9b30 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fbc680bc970 tx=0x7fbc680c5ba0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.972+0000 7fbc7af69980 1 -- 172.21.15.157:0/171490232 shutdown_connections 2024-05-09T09:48:38.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.972+0000 7fbc7af69980 1 --2- 172.21.15.157:0/171490232 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb50034c00 0x7fbb500370c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.972+0000 7fbc7af69980 1 --2- 172.21.15.157:0/171490232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f7c9710 0x56288f7c9b30 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.972+0000 7fbc7af69980 1 -- 172.21.15.157:0/171490232 >> 172.21.15.157:0/171490232 conn(0x56288f7be4e0 msgr2=0x56288f7beff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:38.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.972+0000 7fbc7af69980 1 -- 172.21.15.157:0/171490232 shutdown_connections 2024-05-09T09:48:38.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.972+0000 7fbc7af69980 1 -- 172.21.15.157:0/171490232 wait complete. 2024-05-09T09:48:38.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.972+0000 7fbc7af69980 1 -- 172.21.15.157:0/3246771418 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56288f79ccb0 msgr2=0x56288f79f140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.972+0000 7fbc7af69980 1 --2- 172.21.15.157:0/3246771418 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56288f79ccb0 0x56288f79f140 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.972+0000 7fbc7af69980 1 -- 172.21.15.157:0/3246771418 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56288f6a1460 msgr2=0x56288f79a530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.972+0000 7fbc7af69980 1 --2- 172.21.15.157:0/3246771418 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56288f6a1460 0x56288f79a530 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.972+0000 7fbc7af69980 1 -- 172.21.15.157:0/3246771418 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56288f7a0d30 msgr2=0x56288f7a3120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.972+0000 7fbc7af69980 1 --2- 172.21.15.157:0/3246771418 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56288f7a0d30 0x56288f7a3120 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.972+0000 7fbc7af69980 1 -- 172.21.15.157:0/3246771418 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb60034bb0 msgr2=0x7fbb60037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.972+0000 7fbc7af69980 1 --2- 172.21.15.157:0/3246771418 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb60034bb0 0x7fbb60037070 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbc640012f0 tx=0x7fbc640066b0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.972+0000 7fbc7af69980 1 -- 172.21.15.157:0/3246771418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f6a0b40 msgr2=0x56288f793480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:38.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.972+0000 7fbc7af69980 1 --2- 172.21.15.157:0/3246771418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56288f6a0b40 0x56288f793480 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fbc68003070 tx=0x7fbc680180e0 comp rx=0 tx=0).stop 2024-05-09T09:48:38.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.972+0000 7fbc79285640 1 -- 172.21.15.157:0/3246771418 reap_dead start 2024-05-09T09:48:38.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.972+0000 7fbc7af69980 1 -- 172.21.15.157:0/3246771418 shutdown_connections 2024-05-09T09:48:38.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.972+0000 7fbc7af69980 1 -- 172.21.15.157:0/3246771418 >> 172.21.15.157:0/3246771418 conn(0x56288f614260 msgr2=0x56288f786b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:38.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.972+0000 7fbc7af69980 1 -- 172.21.15.157:0/3246771418 shutdown_connections 2024-05-09T09:48:38.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:38.972+0000 7fbc7af69980 1 -- 172.21.15.157:0/3246771418 wait complete. 2024-05-09T09:48:38.987 INFO:teuthology.orchestra.run.smithi157.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{}},{"bucket":"myfoo2","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11,"bytes_processed":0,"bytes_returned":0}}]} 2024-05-09T09:48:38.988 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-09T09:48:38.988 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-05-09T09:48:38.988 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-05-09T09:48:38.988 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-05-09T09:48:39.069 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:48:39.070 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:48:39.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.068+0000 7f2b677c9980 1 Processor -- start 2024-05-09T09:48:39.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.068+0000 7f2b677c9980 1 -- start start 2024-05-09T09:48:39.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.068+0000 7f2b677c9980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x565104893f10 0x5651048942f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.068+0000 7f2b677c9980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x565104747440 con 0x565104894dd0 2024-05-09T09:48:39.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.068+0000 7f2b677c9980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5651047325f0 con 0x565104893f10 2024-05-09T09:48:39.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.068+0000 7f2b652e4640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x565104893f10 0x5651048942f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.068+0000 7f2b652e4640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x565104893f10 0x5651048942f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59980/0 (socket says 172.21.15.157:59980) 2024-05-09T09:48:39.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.068+0000 7f2b652e4640 1 -- 172.21.15.157:0/1562441027 learned_addr learned my addr 172.21.15.157:0/1562441027 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:39.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.068+0000 7f2b652e4640 1 -- 172.21.15.157:0/1562441027 >> v1:172.21.15.110:6789/0 conn(0x565104894dd0 legacy=0x5651048951e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.068+0000 7f2b652e4640 1 -- 172.21.15.157:0/1562441027 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56510473d990 con 0x565104893f10 2024-05-09T09:48:39.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.072+0000 7f2b652e4640 1 --2- 172.21.15.157:0/1562441027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565104893f10 0x5651048942f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2b5800a4e0 tx=0x7f2b5801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b202ff8afda5465 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.072+0000 7f2b57fff640 1 -- 172.21.15.157:0/1562441027 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b580aa540 con 0x565104893f10 2024-05-09T09:48:39.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.072+0000 7f2b57fff640 1 -- 172.21.15.157:0/1562441027 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b580aa6e0 con 0x565104893f10 2024-05-09T09:48:39.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.072+0000 7f2b57fff640 1 -- 172.21.15.157:0/1562441027 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b580aaa40 con 0x565104893f10 2024-05-09T09:48:39.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.072+0000 7f2b677c9980 1 -- 172.21.15.157:0/1562441027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565104893f10 msgr2=0x5651048942f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.072+0000 7f2b677c9980 1 --2- 172.21.15.157:0/1562441027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565104893f10 0x5651048942f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2b5800a4e0 tx=0x7f2b5801b090 comp rx=0 tx=0).stop 2024-05-09T09:48:39.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.072+0000 7f2b677c9980 1 -- 172.21.15.157:0/1562441027 shutdown_connections 2024-05-09T09:48:39.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.072+0000 7f2b677c9980 1 --2- 172.21.15.157:0/1562441027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565104893f10 0x5651048942f0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.072+0000 7f2b677c9980 1 -- 172.21.15.157:0/1562441027 >> 172.21.15.157:0/1562441027 conn(0x5651048072b0 msgr2=0x5651048076c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:39.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.072+0000 7f2b677c9980 1 -- 172.21.15.157:0/1562441027 shutdown_connections 2024-05-09T09:48:39.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.072+0000 7f2b677c9980 1 -- 172.21.15.157:0/1562441027 wait complete. 2024-05-09T09:48:39.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.088+0000 7f2b677c9980 1 Processor -- start 2024-05-09T09:48:39.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.088+0000 7f2b677c9980 1 -- start start 2024-05-09T09:48:39.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.088+0000 7f2b677c9980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565104893f10 0x56510497f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.088+0000 7f2b677c9980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x565104794fe0 con 0x565104893f10 2024-05-09T09:48:39.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.088+0000 7f2b652e4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565104893f10 0x56510497f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.088+0000 7f2b652e4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565104893f10 0x56510497f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59986/0 (socket says 172.21.15.157:59986) 2024-05-09T09:48:39.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.088+0000 7f2b652e4640 1 -- 172.21.15.157:0/3853024657 learned_addr learned my addr 172.21.15.157:0/3853024657 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:39.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.088+0000 7f2b652e4640 1 -- 172.21.15.157:0/3853024657 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565104719ae0 con 0x565104893f10 2024-05-09T09:48:39.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.092+0000 7f2b652e4640 1 --2- 172.21.15.157:0/3853024657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565104893f10 0x56510497f320 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f2b580ac040 tx=0x7f2b580033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3845278b273a8dd8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.092+0000 7f2a53606640 1 -- 172.21.15.157:0/3853024657 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b580b9030 con 0x565104893f10 2024-05-09T09:48:39.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.092+0000 7f2a53606640 1 -- 172.21.15.157:0/3853024657 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b580aa890 con 0x565104893f10 2024-05-09T09:48:39.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.092+0000 7f2a53606640 1 -- 172.21.15.157:0/3853024657 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b580aab70 con 0x565104893f10 2024-05-09T09:48:39.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.092+0000 7f2b677c9980 1 -- 172.21.15.157:0/3853024657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565104893f10 msgr2=0x56510497f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.092+0000 7f2b677c9980 1 --2- 172.21.15.157:0/3853024657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565104893f10 0x56510497f320 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f2b580ac040 tx=0x7f2b580033b0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.092+0000 7f2b677c9980 1 -- 172.21.15.157:0/3853024657 shutdown_connections 2024-05-09T09:48:39.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.092+0000 7f2b677c9980 1 --2- 172.21.15.157:0/3853024657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565104893f10 0x56510497f320 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.092+0000 7f2b677c9980 1 -- 172.21.15.157:0/3853024657 >> 172.21.15.157:0/3853024657 conn(0x5651048072b0 msgr2=0x56510497aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:39.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.092+0000 7f2b677c9980 1 -- 172.21.15.157:0/3853024657 shutdown_connections 2024-05-09T09:48:39.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.092+0000 7f2b677c9980 1 -- 172.21.15.157:0/3853024657 wait complete. 2024-05-09T09:48:39.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.092+0000 7f2b677c9980 1 Processor -- start 2024-05-09T09:48:39.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.092+0000 7f2b677c9980 1 -- start start 2024-05-09T09:48:39.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.092+0000 7f2b677c9980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565104893f10 0x5651049862b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.092+0000 7f2b677c9980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56510489db40 con 0x565104893f10 2024-05-09T09:48:39.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.092+0000 7f2b652e4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565104893f10 0x5651049862b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.092+0000 7f2b652e4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565104893f10 0x5651049862b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59992/0 (socket says 172.21.15.157:59992) 2024-05-09T09:48:39.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.092+0000 7f2b652e4640 1 -- 172.21.15.157:0/2386018455 learned_addr learned my addr 172.21.15.157:0/2386018455 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:39.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.092+0000 7f2b652e4640 1 -- 172.21.15.157:0/2386018455 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651049867f0 con 0x565104893f10 2024-05-09T09:48:39.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.092+0000 7f2b652e4640 1 --2- 172.21.15.157:0/2386018455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565104893f10 0x5651049862b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f2b5801b0d0 tx=0x7f2b58017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.092+0000 7f2a51e03640 1 -- 172.21.15.157:0/2386018455 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b580b9070 con 0x565104893f10 2024-05-09T09:48:39.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.092+0000 7f2b677c9980 1 -- 172.21.15.157:0/2386018455 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565104986a80 con 0x565104893f10 2024-05-09T09:48:39.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.092+0000 7f2a51e03640 1 -- 172.21.15.157:0/2386018455 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b580b5a00 con 0x565104893f10 2024-05-09T09:48:39.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.092+0000 7f2a51e03640 1 -- 172.21.15.157:0/2386018455 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b580b5ce0 con 0x565104893f10 2024-05-09T09:48:39.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.092+0000 7f2b677c9980 1 -- 172.21.15.157:0/2386018455 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565104989710 con 0x565104893f10 2024-05-09T09:48:39.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.096+0000 7f2a51e03640 1 -- 172.21.15.157:0/2386018455 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f2b580b3040 con 0x565104893f10 2024-05-09T09:48:39.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.096+0000 7f2a51e03640 1 --2- 172.21.15.157:0/2386018455 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2a4c034c00 0x7f2a4c0370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.096+0000 7f2a51e03640 1 -- 172.21.15.157:0/2386018455 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f2b580ba070 con 0x565104893f10 2024-05-09T09:48:39.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.096+0000 7f2b64ae3640 1 --2- 172.21.15.157:0/2386018455 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2a4c034c00 0x7f2a4c0370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.096+0000 7f2b677c9980 1 --2- 172.21.15.157:0/2386018455 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x565104894dd0 0x56510498d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.096+0000 7f2b677c9980 1 -- 172.21.15.157:0/2386018455 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56510498d8a0 con 0x565104894dd0 2024-05-09T09:48:39.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.096+0000 7f2b65ae5640 1 --2- 172.21.15.157:0/2386018455 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x565104894dd0 0x56510498d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.096+0000 7f2b64ae3640 1 --2- 172.21.15.157:0/2386018455 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2a4c034c00 0x7f2a4c0370c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c000f70 tx=0x7f2b5c001420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.096+0000 7f2b65ae5640 1 --2- 172.21.15.157:0/2386018455 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x565104894dd0 0x56510498d360 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.096+0000 7f2b65ae5640 1 -- 172.21.15.157:0/2386018455 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b600083f0 con 0x565104894dd0 2024-05-09T09:48:39.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.096+0000 7f2b677c9980 1 -- 172.21.15.157:0/2386018455 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56510498e170 con 0x565104894dd0 2024-05-09T09:48:39.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.096+0000 7f2b65ae5640 1 -- 172.21.15.157:0/2386018455 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2b600083f0 con 0x565104894dd0 2024-05-09T09:48:39.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.096+0000 7f2b677c9980 1 --2- 172.21.15.157:0/2386018455 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56510498fa80 0x565104991f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.096+0000 7f2b677c9980 1 -- 172.21.15.157:0/2386018455 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651049926d0 con 0x56510498fa80 2024-05-09T09:48:39.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.096+0000 7f2b652e4640 1 --2- 172.21.15.157:0/2386018455 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56510498fa80 0x565104991f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.096+0000 7f2b652e4640 1 --2- 172.21.15.157:0/2386018455 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56510498fa80 0x565104991f40 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.100+0000 7f2b652e4640 1 -- 172.21.15.157:0/2386018455 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2b580b43a0 con 0x56510498fa80 2024-05-09T09:48:39.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.100+0000 7f2b677c9980 1 -- 172.21.15.157:0/2386018455 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56510498e9c0 con 0x565104894dd0 2024-05-09T09:48:39.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.100+0000 7f2b65ae5640 1 -- 172.21.15.157:0/2386018455 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2b600083f0 con 0x565104894dd0 2024-05-09T09:48:39.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.100+0000 7f2b677c9980 1 --2- 172.21.15.157:0/2386018455 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x565104993b30 0x565104995f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.100+0000 7f2b677c9980 1 -- 172.21.15.157:0/2386018455 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565104996610 con 0x565104993b30 2024-05-09T09:48:39.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.100+0000 7f2b64ae3640 1 --2- 172.21.15.157:0/2386018455 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x565104993b30 0x565104995f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.100+0000 7f2b64ae3640 1 --2- 172.21.15.157:0/2386018455 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x565104993b30 0x565104995f20 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.100+0000 7f2b64ae3640 1 -- 172.21.15.157:0/2386018455 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2b5c00d040 con 0x565104993b30 2024-05-09T09:48:39.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.104+0000 7f2b677c9980 1 Processor -- start 2024-05-09T09:48:39.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.104+0000 7f2b677c9980 1 -- start start 2024-05-09T09:48:39.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.104+0000 7f2b677c9980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5651049bc690 0x5651049bcab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.104+0000 7f2b677c9980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x565104799020 con 0x5651049bc690 2024-05-09T09:48:39.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.104+0000 7f2b652e4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5651049bc690 0x5651049bcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.104+0000 7f2b652e4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5651049bc690 0x5651049bcab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:59998/0 (socket says 172.21.15.157:59998) 2024-05-09T09:48:39.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.104+0000 7f2b652e4640 1 -- 172.21.15.157:0/304753376 learned_addr learned my addr 172.21.15.157:0/304753376 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:39.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.104+0000 7f2b652e4640 1 -- 172.21.15.157:0/304753376 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651049bcff0 con 0x5651049bc690 2024-05-09T09:48:39.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.104+0000 7f2b652e4640 1 --2- 172.21.15.157:0/304753376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5651049bc690 0x5651049bcab0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f2b580e35e0 tx=0x7f2b580ce850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.104+0000 7f2a49ba0640 1 -- 172.21.15.157:0/304753376 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b580a9cd0 con 0x5651049bc690 2024-05-09T09:48:39.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.104+0000 7f2b677c9980 1 -- 172.21.15.157:0/304753376 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651049bda80 con 0x5651049bc690 2024-05-09T09:48:39.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.104+0000 7f2a49ba0640 1 -- 172.21.15.157:0/304753376 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b580a9e70 con 0x5651049bc690 2024-05-09T09:48:39.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.104+0000 7f2a49ba0640 1 -- 172.21.15.157:0/304753376 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b580b47d0 con 0x5651049bc690 2024-05-09T09:48:39.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.104+0000 7f2b677c9980 1 -- 172.21.15.157:0/304753376 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651049bdf60 con 0x5651049bc690 2024-05-09T09:48:39.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.108+0000 7f2a49ba0640 1 -- 172.21.15.157:0/304753376 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f2b580b4970 con 0x5651049bc690 2024-05-09T09:48:39.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.108+0000 7f2a49ba0640 1 --2- 172.21.15.157:0/304753376 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2a3c034bb0 0x7f2a3c037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.108+0000 7f2a49ba0640 1 -- 172.21.15.157:0/304753376 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f2b580dd070 con 0x5651049bc690 2024-05-09T09:48:39.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.108+0000 7f2b64ae3640 1 --2- 172.21.15.157:0/304753376 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2a3c034bb0 0x7f2a3c037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.108+0000 7f2b677c9980 1 Processor -- start 2024-05-09T09:48:39.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.108+0000 7f2b677c9980 1 -- start start 2024-05-09T09:48:39.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.108+0000 7f2b64ae3640 1 --2- 172.21.15.157:0/304753376 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2a3c034bb0 0x7f2a3c037070 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x56510498a970 tx=0x7f2b5c006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.108+0000 7f2b677c9980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5651049c96e0 0x5651049c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.108+0000 7f2b677c9980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56510497f9b0 con 0x5651049c96e0 2024-05-09T09:48:39.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.108+0000 7f2b652e4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5651049c96e0 0x5651049c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.108+0000 7f2b652e4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5651049c96e0 0x5651049c9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:60010/0 (socket says 172.21.15.157:60010) 2024-05-09T09:48:39.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.108+0000 7f2b652e4640 1 -- 172.21.15.157:0/133264691 learned_addr learned my addr 172.21.15.157:0/133264691 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:39.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.108+0000 7f2b652e4640 1 -- 172.21.15.157:0/133264691 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651049ca0d0 con 0x5651049c96e0 2024-05-09T09:48:39.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.108+0000 7f2b652e4640 1 --2- 172.21.15.157:0/133264691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5651049c96e0 0x5651049c9b00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2b580cea80 tx=0x7f2b580ee600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b91a1fc2dfd0c26d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.108+0000 7f2a437fe640 1 -- 172.21.15.157:0/133264691 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b580be920 con 0x5651049c96e0 2024-05-09T09:48:39.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.108+0000 7f2a437fe640 1 -- 172.21.15.157:0/133264691 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b580be400 con 0x5651049c96e0 2024-05-09T09:48:39.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.108+0000 7f2a437fe640 1 -- 172.21.15.157:0/133264691 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b580beac0 con 0x5651049c96e0 2024-05-09T09:48:39.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.108+0000 7f2b677c9980 1 -- 172.21.15.157:0/133264691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5651049c96e0 msgr2=0x5651049c9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.108+0000 7f2b677c9980 1 --2- 172.21.15.157:0/133264691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5651049c96e0 0x5651049c9b00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2b580cea80 tx=0x7f2b580ee600 comp rx=0 tx=0).stop 2024-05-09T09:48:39.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.108+0000 7f2b677c9980 1 -- 172.21.15.157:0/133264691 shutdown_connections 2024-05-09T09:48:39.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.108+0000 7f2b677c9980 1 --2- 172.21.15.157:0/133264691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5651049c96e0 0x5651049c9b00 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.108+0000 7f2b677c9980 1 -- 172.21.15.157:0/133264691 >> 172.21.15.157:0/133264691 conn(0x5651049c5a60 msgr2=0x5651049c3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:39.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.108+0000 7f2b677c9980 1 -- 172.21.15.157:0/133264691 shutdown_connections 2024-05-09T09:48:39.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.108+0000 7f2b677c9980 1 -- 172.21.15.157:0/133264691 wait complete. 2024-05-09T09:48:39.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.112+0000 7f2b677c9980 1 Processor -- start 2024-05-09T09:48:39.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.112+0000 7f2b677c9980 1 -- start start 2024-05-09T09:48:39.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.112+0000 7f2b677c9980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5651049c96e0 0x5651049d0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.112+0000 7f2b677c9980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5651049ca650 con 0x5651049c96e0 2024-05-09T09:48:39.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.112+0000 7f2b652e4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5651049c96e0 0x5651049d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.112+0000 7f2b652e4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5651049c96e0 0x5651049d0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:60026/0 (socket says 172.21.15.157:60026) 2024-05-09T09:48:39.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.112+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 learned_addr learned my addr 172.21.15.157:0/577814631 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:39.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.112+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651049d0fb0 con 0x5651049c96e0 2024-05-09T09:48:39.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.112+0000 7f2b652e4640 1 --2- 172.21.15.157:0/577814631 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5651049c96e0 0x5651049d0a70 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f2b580f7000 tx=0x7f2b580bdeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.112+0000 7f2a41ffb640 1 -- 172.21.15.157:0/577814631 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b580dba10 con 0x5651049c96e0 2024-05-09T09:48:39.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.112+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651049d0fb0 con 0x5651049c96e0 2024-05-09T09:48:39.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.112+0000 7f2a41ffb640 1 -- 172.21.15.157:0/577814631 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b580dbbb0 con 0x5651049c96e0 2024-05-09T09:48:39.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.112+0000 7f2a41ffb640 1 -- 172.21.15.157:0/577814631 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b580e0780 con 0x5651049c96e0 2024-05-09T09:48:39.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.112+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651049d1430 con 0x5651049c96e0 2024-05-09T09:48:39.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.112+0000 7f2a41ffb640 1 -- 172.21.15.157:0/577814631 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f2b580e3a30 con 0x5651049c96e0 2024-05-09T09:48:39.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.112+0000 7f2b677c9980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.112+0000 7f2a41ffb640 1 --2- 172.21.15.157:0/577814631 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2a34034bb0 0x7f2a34037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.112+0000 7f2a41ffb640 1 -- 172.21.15.157:0/577814631 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f2b5810cd50 con 0x5651049c96e0 2024-05-09T09:48:39.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.112+0000 7f2b64ae3640 1 --2- 172.21.15.157:0/577814631 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2a34034bb0 0x7f2a34037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.112+0000 7f2b677c9980 1 --2- 172.21.15.157:0/577814631 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5651049dd430 0x5651049df8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.112+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651049e0020 con 0x5651049dd430 2024-05-09T09:48:39.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.112+0000 7f2b65ae5640 1 --2- 172.21.15.157:0/577814631 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5651049dd430 0x5651049df8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b64ae3640 1 --2- 172.21.15.157:0/577814631 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2a34034bb0 0x7f2a34037070 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x565104996a10 tx=0x7f2b5c011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b65ae5640 1 --2- 172.21.15.157:0/577814631 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5651049dd430 0x5651049df8d0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b600083f0 con 0x5651049dd430 2024-05-09T09:48:39.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b677c9980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b677c9980 20 realm 2024-05-09T09:48:39.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b677c9980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651049e0430 con 0x5651049dd430 2024-05-09T09:48:39.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b600083f0 con 0x5651049dd430 2024-05-09T09:48:39.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b677c9980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b677c9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:48:39.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b677c9980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651049e0cd0 con 0x5651049dd430 2024-05-09T09:48:39.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b600083f0 con 0x5651049dd430 2024-05-09T09:48:39.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b677c9980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b677c9980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x5651049dd430 2024-05-09T09:48:39.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2b600083f0 con 0x5651049dd430 2024-05-09T09:48:39.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b677c9980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:39.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b677c9980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b677c9980 1 --2- 172.21.15.157:0/577814631 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5651049e1ba0 0x5651049e3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651049e46d0 con 0x5651049e1ba0 2024-05-09T09:48:39.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b652e4640 1 --2- 172.21.15.157:0/577814631 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5651049e1ba0 0x5651049e3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b652e4640 1 --2- 172.21.15.157:0/577814631 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5651049e1ba0 0x5651049e3f90 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2b58111020 con 0x5651049e1ba0 2024-05-09T09:48:39.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b677c9980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:48:39.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b677c9980 20 searching for the correct realm 2024-05-09T09:48:39.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b677c9980 1 --2- 172.21.15.157:0/577814631 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5651049e6670 0x5651049e8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e91e0 con 0x5651049e6670 2024-05-09T09:48:39.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b64ae3640 1 --2- 172.21.15.157:0/577814631 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5651049e6670 0x5651049e8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.116+0000 7f2b64ae3640 1 --2- 172.21.15.157:0/577814631 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5651049e6670 0x5651049e8b10 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.120+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b5c036040 con 0x5651049e6670 2024-05-09T09:48:39.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.120+0000 7f2b64ae3640 1 --2- 172.21.15.157:0/577814631 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2b5c00f3d0 0x7f2b5c00f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.120+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e91e0 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.120+0000 7f2b65ae5640 1 --2- 172.21.15.157:0/577814631 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2b5c00f3d0 0x7f2b5c00f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.120+0000 7f2b65ae5640 1 --2- 172.21.15.157:0/577814631 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2b5c00f3d0 0x7f2b5c00f7f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.120+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b600083f0 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.120+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x5651049e1ba0 2024-05-09T09:48:39.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.120+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b58111020 con 0x5651049e1ba0 2024-05-09T09:48:39.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.120+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x5651049dd430 2024-05-09T09:48:39.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.120+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b600083f0 con 0x5651049dd430 2024-05-09T09:48:39.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.120+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x5651049dd430 2024-05-09T09:48:39.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.120+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b60026040 con 0x5651049dd430 2024-05-09T09:48:39.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.120+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x5651049e1ba0 2024-05-09T09:48:39.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.120+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b58111020 con 0x5651049e1ba0 2024-05-09T09:48:39.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.120+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x5651049e1ba0 2024-05-09T09:48:39.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.124+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b58111020 con 0x5651049e1ba0 2024-05-09T09:48:39.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.124+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.124+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b60026040 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.124+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x5651049e6670 2024-05-09T09:48:39.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.124+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b5c036040 con 0x5651049e6670 2024-05-09T09:48:39.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.124+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x5651049dd430 2024-05-09T09:48:39.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.124+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b60026040 con 0x5651049dd430 2024-05-09T09:48:39.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.124+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x5651049e1ba0 2024-05-09T09:48:39.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.124+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b58111020 con 0x5651049e1ba0 2024-05-09T09:48:39.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.124+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x5651049dd430 2024-05-09T09:48:39.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.124+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b60026040 con 0x5651049dd430 2024-05-09T09:48:39.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.124+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.124+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2b60026040 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.124+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x5651049e6670 2024-05-09T09:48:39.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.124+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b5c036040 con 0x5651049e6670 2024-05-09T09:48:39.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.124+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x5651049e6670 2024-05-09T09:48:39.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.124+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2b5c036040 con 0x5651049e6670 2024-05-09T09:48:39.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.124+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x5651049e1ba0 2024-05-09T09:48:39.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.124+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b58111020 con 0x5651049e1ba0 2024-05-09T09:48:39.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.124+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x5651049e6670 2024-05-09T09:48:39.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.128+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b5c036040 con 0x5651049e6670 2024-05-09T09:48:39.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.128+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x5651049e6670 2024-05-09T09:48:39.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.128+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b5c036040 con 0x5651049e6670 2024-05-09T09:48:39.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.128+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x5651049dd430 2024-05-09T09:48:39.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.128+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b60026040 con 0x5651049dd430 2024-05-09T09:48:39.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.128+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x5651049dd430 2024-05-09T09:48:39.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.128+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2b60026040 con 0x5651049dd430 2024-05-09T09:48:39.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.128+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x5651049e1ba0 2024-05-09T09:48:39.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.128+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b58111020 con 0x5651049e1ba0 2024-05-09T09:48:39.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.128+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x5651049e6670 2024-05-09T09:48:39.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.128+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b5c036040 con 0x5651049e6670 2024-05-09T09:48:39.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.128+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.128+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b60026040 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.128+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x5651049dd430 2024-05-09T09:48:39.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.128+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b60026040 con 0x5651049dd430 2024-05-09T09:48:39.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.128+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x5651049e1ba0 2024-05-09T09:48:39.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.128+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2b58111020 con 0x5651049e1ba0 2024-05-09T09:48:39.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.128+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x5651049e6670 2024-05-09T09:48:39.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.128+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b5c036040 con 0x5651049e6670 2024-05-09T09:48:39.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.128+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x5651049e1ba0 2024-05-09T09:48:39.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b58111020 con 0x5651049e1ba0 2024-05-09T09:48:39.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b60026040 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x5651049e6670 2024-05-09T09:48:39.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b5c048040 con 0x5651049e6670 2024-05-09T09:48:39.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x5651049e1ba0 2024-05-09T09:48:39.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b58111020 con 0x5651049e1ba0 2024-05-09T09:48:39.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x5651049dd430 2024-05-09T09:48:39.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2b60026040 con 0x5651049dd430 2024-05-09T09:48:39.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651049e1070 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b60026040 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b677c9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:48:39.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b677c9980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:48:39.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b677c9980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:48:39.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b677c9980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:48:39.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b677c9980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:48:39.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b677c9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:48:39.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b677c9980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651049e4f90 con 0x5651049dd430 2024-05-09T09:48:39.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b60026040 con 0x5651049dd430 2024-05-09T09:48:39.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b677c9980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b677c9980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651049e4f90 con 0x5651049dd430 2024-05-09T09:48:39.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2b60026040 con 0x5651049dd430 2024-05-09T09:48:39.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b677c9980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:39.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b677c9980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651049e4f90 con 0x5651049e6670 2024-05-09T09:48:39.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2b5c048040 con 0x5651049e6670 2024-05-09T09:48:39.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b677c9980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:48:39.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b677c9980 20 zone default found 2024-05-09T09:48:39.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b677c9980 4 Realm: () 2024-05-09T09:48:39.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b677c9980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:48:39.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b677c9980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:48:39.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b677c9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:48:39.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b677c9980 20 zonegroup default 2024-05-09T09:48:39.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b677c9980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.132+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651049e5830 con 0x5651049e1ba0 2024-05-09T09:48:39.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.136+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2b58111020 con 0x5651049e1ba0 2024-05-09T09:48:39.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.136+0000 7f2b677c9980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.136+0000 7f2b677c9980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.136+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651049eb040 con 0x5651049e6670 2024-05-09T09:48:39.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.136+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2b5c048040 con 0x5651049e6670 2024-05-09T09:48:39.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.136+0000 7f2b677c9980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.136+0000 7f2b677c9980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.136+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651049eb3e0 con 0x5651049e6670 2024-05-09T09:48:39.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.136+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2b5c048040 con 0x5651049e6670 2024-05-09T09:48:39.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.136+0000 7f2b677c9980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.136+0000 7f2b677c9980 20 started sync module instance, tier type = 2024-05-09T09:48:39.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.136+0000 7f2b677c9980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:48:39.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.136+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049ea4e0 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.136+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b60026040 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.136+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94905969846752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049ea4e0 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.136+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049ebe00 con 0x5651049dd430 2024-05-09T09:48:39.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.140+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94905969846752] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b60036040 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.140+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b60036040 con 0x5651049dd430 2024-05-09T09:48:39.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.140+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94905969850608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049ea4e0 con 0x5651049dd430 2024-05-09T09:48:39.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.140+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049ec840 con 0x5651049e6670 2024-05-09T09:48:39.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.140+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b5c048040 con 0x5651049e6670 2024-05-09T09:48:39.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.140+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94905969853328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049ed0e0 con 0x5651049e6670 2024-05-09T09:48:39.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.140+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049edb00 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.140+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94905969850608] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b60036040 con 0x5651049dd430 2024-05-09T09:48:39.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.144+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b60036040 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.144+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94905969858032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049edac0 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.144+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049ee510 con 0x5651049dd430 2024-05-09T09:48:39.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.144+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94905969853328] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b5c048040 con 0x5651049e6670 2024-05-09T09:48:39.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.144+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94905969858032] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b60036040 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.144+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b60036040 con 0x5651049dd430 2024-05-09T09:48:39.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.144+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94905969844272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049ee060 con 0x5651049dd430 2024-05-09T09:48:39.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.144+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049ee8b0 con 0x5651049e1ba0 2024-05-09T09:48:39.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.148+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94905969844272] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b60036040 con 0x5651049dd430 2024-05-09T09:48:39.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.148+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b58111020 con 0x5651049e1ba0 2024-05-09T09:48:39.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.148+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94905969860704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049ee480 con 0x5651049e1ba0 2024-05-09T09:48:39.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.148+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049ef5b0 con 0x5651049e1ba0 2024-05-09T09:48:39.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.148+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b58111020 con 0x5651049e1ba0 2024-05-09T09:48:39.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.148+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94905969867088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049f0220 con 0x5651049e1ba0 2024-05-09T09:48:39.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.148+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049f0c90 con 0x5651049e1ba0 2024-05-09T09:48:39.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.148+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94905969860704] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b58111020 con 0x5651049e1ba0 2024-05-09T09:48:39.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.152+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94905969867088] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b58111020 con 0x5651049e1ba0 2024-05-09T09:48:39.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.152+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b58111020 con 0x5651049e1ba0 2024-05-09T09:48:39.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.152+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94905969868144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049eec50 con 0x5651049e1ba0 2024-05-09T09:48:39.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.152+0000 7f2b677c9980 20 add_watcher() i=0 2024-05-09T09:48:39.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.152+0000 7f2b677c9980 20 add_watcher() i=1 2024-05-09T09:48:39.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.152+0000 7f2b677c9980 20 add_watcher() i=2 2024-05-09T09:48:39.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.152+0000 7f2b677c9980 20 add_watcher() i=3 2024-05-09T09:48:39.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.152+0000 7f2b677c9980 20 add_watcher() i=4 2024-05-09T09:48:39.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.152+0000 7f2b677c9980 20 add_watcher() i=5 2024-05-09T09:48:39.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.152+0000 7f2b677c9980 20 add_watcher() i=6 2024-05-09T09:48:39.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.152+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94905969868144] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b58111020 con 0x5651049e1ba0 2024-05-09T09:48:39.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.152+0000 7f2b677c9980 20 add_watcher() i=7 2024-05-09T09:48:39.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.152+0000 7f2b677c9980 2 all 8 watchers are set, enabling cache 2024-05-09T09:48:39.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.152+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651049f3f00 con 0x5651049dd430 2024-05-09T09:48:39.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.152+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2b60036040 con 0x5651049dd430 2024-05-09T09:48:39.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.152+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94905969870688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049f1450 con 0x5651049dd430 2024-05-09T09:48:39.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.156+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94905969870688] v32'365 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2b60036040 con 0x5651049dd430 2024-05-09T09:48:39.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.156+0000 7f2a1a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:39.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.156+0000 7f2b677c9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:48:39.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.156+0000 7f2b677c9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:48:39.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.156+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049fc540 con 0x5651049dd430 2024-05-09T09:48:39.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.156+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'86 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b60036040 con 0x5651049dd430 2024-05-09T09:48:39.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.156+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049fcad0 con 0x5651049e1ba0 2024-05-09T09:48:39.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.160+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'80 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b58111020 con 0x5651049e1ba0 2024-05-09T09:48:39.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.160+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049fcad0 con 0x5651049e6670 2024-05-09T09:48:39.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.160+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'79 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b5c048040 con 0x5651049e6670 2024-05-09T09:48:39.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.160+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049fd0c0 con 0x5651049dd430 2024-05-09T09:48:39.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.160+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'366 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b60036040 con 0x5651049dd430 2024-05-09T09:48:39.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.160+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049fd630 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.164+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'227 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b60036040 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.164+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049fd630 con 0x5651049e6670 2024-05-09T09:48:39.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.164+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'152 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b5c048040 con 0x5651049e6670 2024-05-09T09:48:39.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.164+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049fddd0 con 0x5651049dd430 2024-05-09T09:48:39.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.168+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'81 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b60036040 con 0x5651049dd430 2024-05-09T09:48:39.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.168+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049fde60 con 0x5651049e1ba0 2024-05-09T09:48:39.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.168+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'151 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b58111020 con 0x5651049e1ba0 2024-05-09T09:48:39.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.168+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049fe030 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.172+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'79 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b60036040 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.172+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049fe030 con 0x5651049e6670 2024-05-09T09:48:39.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.172+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'85 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2b5c048040 con 0x5651049e6670 2024-05-09T09:48:39.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.172+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049fe5e0 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.172+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'228 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b60036040 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.172+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049fe5e0 con 0x5651049e1ba0 2024-05-09T09:48:39.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.176+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'83 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b58111020 con 0x5651049e1ba0 2024-05-09T09:48:39.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.176+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049fe5e0 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.176+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'79 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b60036040 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.176+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049fe5e0 con 0x5651049e1ba0 2024-05-09T09:48:39.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.180+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'157 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b58111020 con 0x5651049e1ba0 2024-05-09T09:48:39.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.180+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049fe5e0 con 0x5651049dd430 2024-05-09T09:48:39.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.180+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'367 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b60036040 con 0x5651049dd430 2024-05-09T09:48:39.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.180+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049fe5e0 con 0x5651049e6670 2024-05-09T09:48:39.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.184+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'221 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b5c048040 con 0x5651049e6670 2024-05-09T09:48:39.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.184+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049febb0 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.184+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'229 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b60036040 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.184+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049feb90 con 0x5651049e6670 2024-05-09T09:48:39.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.188+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'79 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b5c048040 con 0x5651049e6670 2024-05-09T09:48:39.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.188+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049feb90 con 0x5651049dd430 2024-05-09T09:48:39.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.188+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'87 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b60036040 con 0x5651049dd430 2024-05-09T09:48:39.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.188+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049feb70 con 0x5651049dd430 2024-05-09T09:48:39.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.192+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'368 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b60036040 con 0x5651049dd430 2024-05-09T09:48:39.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.192+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049feb70 con 0x5651049e6670 2024-05-09T09:48:39.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.192+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'222 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b5c048040 con 0x5651049e6670 2024-05-09T09:48:39.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.192+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049feb70 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.196+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'91 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b60036040 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.196+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049feb70 con 0x5651049e6670 2024-05-09T09:48:39.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.196+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'81 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b5c048040 con 0x5651049e6670 2024-05-09T09:48:39.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.196+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049feb70 con 0x5651049e6670 2024-05-09T09:48:39.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.196+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'85 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b5c048040 con 0x5651049e6670 2024-05-09T09:48:39.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.196+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049feb70 con 0x5651049e6670 2024-05-09T09:48:39.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.196+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'76 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b5c048040 con 0x5651049e6670 2024-05-09T09:48:39.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.196+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049feb70 con 0x5651049e6670 2024-05-09T09:48:39.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.200+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'153 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b5c048040 con 0x5651049e6670 2024-05-09T09:48:39.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.200+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049feb70 con 0x5651049e1ba0 2024-05-09T09:48:39.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.200+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'81 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b58111020 con 0x5651049e1ba0 2024-05-09T09:48:39.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.200+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049feb70 con 0x5651049e6670 2024-05-09T09:48:39.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.204+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'79 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b5c048040 con 0x5651049e6670 2024-05-09T09:48:39.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.204+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049feb70 con 0x5651049e1ba0 2024-05-09T09:48:39.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.204+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'152 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b58111020 con 0x5651049e1ba0 2024-05-09T09:48:39.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.204+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049feba0 con 0x5651049e6670 2024-05-09T09:48:39.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.208+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'223 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b5c048040 con 0x5651049e6670 2024-05-09T09:48:39.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.208+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049feba0 con 0x5651049e1ba0 2024-05-09T09:48:39.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.212+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'158 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b58111020 con 0x5651049e1ba0 2024-05-09T09:48:39.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.212+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049feb70 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.212+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'85 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2b60036040 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.212+0000 7f2a197e2640 20 reqs_thread_entry: start 2024-05-09T09:48:39.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.216+0000 7f2b677c9980 20 init_complete bucket index max shards: 11 2024-05-09T09:48:39.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.216+0000 7f298affd640 20 reqs_thread_entry: start 2024-05-09T09:48:39.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.216+0000 7f2b677c9980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.216+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651049fab00 con 0x5651049dd430 2024-05-09T09:48:39.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.216+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2b60036040 con 0x5651049dd430 2024-05-09T09:48:39.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.216+0000 7f2b677c9980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:48:39.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.216+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:95 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565104a1bb70 con 0x5651049e1ba0 2024-05-09T09:48:39.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.216+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(95 usage.10 [call out=1378b] v0'0 uv77 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f2b58111020 con 0x5651049e1ba0 2024-05-09T09:48:39.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.216+0000 7f2a1a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:39.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.216+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94905969870688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049f6310 con 0x5651049dd430 2024-05-09T09:48:39.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.220+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94905969870688] v32'369 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2b60036040 con 0x5651049dd430 2024-05-09T09:48:39.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.220+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94905969846752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049f0760 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.220+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94905969846752] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b60036040 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.220+0000 7f2b677c9980 20 remove_watcher() i=0 2024-05-09T09:48:39.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.220+0000 7f2b677c9980 2 removed watcher, disabling cache 2024-05-09T09:48:39.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.220+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94905969850608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049ea9e0 con 0x5651049dd430 2024-05-09T09:48:39.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.224+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94905969850608] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b60036040 con 0x5651049dd430 2024-05-09T09:48:39.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.224+0000 7f2b677c9980 20 remove_watcher() i=1 2024-05-09T09:48:39.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.224+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94905969853328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049ea9e0 con 0x5651049e6670 2024-05-09T09:48:39.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.224+0000 7f2b64ae3640 1 -- 172.21.15.157:0/577814631 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94905969853328] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b5c048040 con 0x5651049e6670 2024-05-09T09:48:39.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.224+0000 7f2b677c9980 20 remove_watcher() i=2 2024-05-09T09:48:39.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.224+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94905969858032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049ea9e0 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.228+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94905969858032] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b60036040 con 0x7f2b5c00f3d0 2024-05-09T09:48:39.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.228+0000 7f2b677c9980 20 remove_watcher() i=3 2024-05-09T09:48:39.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.228+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94905969844272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049ea9e0 con 0x5651049dd430 2024-05-09T09:48:39.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.228+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94905969844272] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b60036040 con 0x5651049dd430 2024-05-09T09:48:39.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.228+0000 7f2b677c9980 20 remove_watcher() i=4 2024-05-09T09:48:39.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.228+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94905969860704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049ea9e0 con 0x5651049e1ba0 2024-05-09T09:48:39.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.232+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94905969860704] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b58111020 con 0x5651049e1ba0 2024-05-09T09:48:39.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.232+0000 7f2b677c9980 20 remove_watcher() i=5 2024-05-09T09:48:39.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.232+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94905969867088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049ee060 con 0x5651049e1ba0 2024-05-09T09:48:39.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94905969867088] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b58111020 con 0x5651049e1ba0 2024-05-09T09:48:39.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 20 remove_watcher() i=6 2024-05-09T09:48:39.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94905969868144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651049ea9e0 con 0x5651049e1ba0 2024-05-09T09:48:39.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b652e4640 1 -- 172.21.15.157:0/577814631 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94905969868144] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b58111020 con 0x5651049e1ba0 2024-05-09T09:48:39.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 20 remove_watcher() i=7 2024-05-09T09:48:39.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5651049e1ba0 msgr2=0x5651049e3f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 --2- 172.21.15.157:0/577814631 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5651049e1ba0 0x5651049e3f90 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5651049dd430 msgr2=0x5651049df8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 --2- 172.21.15.157:0/577814631 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5651049dd430 0x5651049df8d0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2b5c00f3d0 msgr2=0x7f2b5c00f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 --2- 172.21.15.157:0/577814631 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2b5c00f3d0 0x7f2b5c00f7f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5651049e6670 msgr2=0x5651049e8b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 --2- 172.21.15.157:0/577814631 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5651049e6670 0x5651049e8b10 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2a34034bb0 msgr2=0x7f2a34037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 --2- 172.21.15.157:0/577814631 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2a34034bb0 0x7f2a34037070 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x565104996a10 tx=0x7f2b5c011000 comp rx=0 tx=0).stop 2024-05-09T09:48:39.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b65ae5640 1 -- 172.21.15.157:0/577814631 reap_dead start 2024-05-09T09:48:39.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5651049c96e0 msgr2=0x5651049d0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 --2- 172.21.15.157:0/577814631 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5651049c96e0 0x5651049d0a70 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f2b580f7000 tx=0x7f2b580bdeb0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 shutdown_connections 2024-05-09T09:48:39.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 --2- 172.21.15.157:0/577814631 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5651049c96e0 0x5651049d0a70 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 >> 172.21.15.157:0/577814631 conn(0x5651049c5a60 msgr2=0x5651049c30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:39.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 shutdown_connections 2024-05-09T09:48:39.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 -- 172.21.15.157:0/577814631 wait complete. 2024-05-09T09:48:39.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 -- 172.21.15.157:0/304753376 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2a3c034bb0 msgr2=0x7f2a3c037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 --2- 172.21.15.157:0/304753376 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2a3c034bb0 0x7f2a3c037070 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x56510498a970 tx=0x7f2b5c006000 comp rx=0 tx=0).stop 2024-05-09T09:48:39.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 -- 172.21.15.157:0/304753376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5651049bc690 msgr2=0x5651049bcab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 --2- 172.21.15.157:0/304753376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5651049bc690 0x5651049bcab0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f2b580e35e0 tx=0x7f2b580ce850 comp rx=0 tx=0).stop 2024-05-09T09:48:39.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 -- 172.21.15.157:0/304753376 shutdown_connections 2024-05-09T09:48:39.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 --2- 172.21.15.157:0/304753376 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2a3c034bb0 0x7f2a3c037070 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 --2- 172.21.15.157:0/304753376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5651049bc690 0x5651049bcab0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 -- 172.21.15.157:0/304753376 >> 172.21.15.157:0/304753376 conn(0x5651049b1460 msgr2=0x5651049b1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:39.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 -- 172.21.15.157:0/304753376 shutdown_connections 2024-05-09T09:48:39.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 -- 172.21.15.157:0/304753376 wait complete. 2024-05-09T09:48:39.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 -- 172.21.15.157:0/2386018455 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56510498fa80 msgr2=0x565104991f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 --2- 172.21.15.157:0/2386018455 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56510498fa80 0x565104991f40 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 -- 172.21.15.157:0/2386018455 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x565104894dd0 msgr2=0x56510498d360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 --2- 172.21.15.157:0/2386018455 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x565104894dd0 0x56510498d360 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 -- 172.21.15.157:0/2386018455 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x565104993b30 msgr2=0x565104995f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 --2- 172.21.15.157:0/2386018455 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x565104993b30 0x565104995f20 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 -- 172.21.15.157:0/2386018455 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2a4c034c00 msgr2=0x7f2a4c0370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 --2- 172.21.15.157:0/2386018455 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2a4c034c00 0x7f2a4c0370c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c000f70 tx=0x7f2b5c001420 comp rx=0 tx=0).stop 2024-05-09T09:48:39.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 -- 172.21.15.157:0/2386018455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565104893f10 msgr2=0x5651049862b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 --2- 172.21.15.157:0/2386018455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565104893f10 0x5651049862b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f2b5801b0d0 tx=0x7f2b58017e30 comp rx=0 tx=0).stop 2024-05-09T09:48:39.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b65ae5640 1 -- 172.21.15.157:0/2386018455 reap_dead start 2024-05-09T09:48:39.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 -- 172.21.15.157:0/2386018455 shutdown_connections 2024-05-09T09:48:39.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.236+0000 7f2b677c9980 1 -- 172.21.15.157:0/2386018455 >> 172.21.15.157:0/2386018455 conn(0x5651048072b0 msgr2=0x5651049799c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:39.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.240+0000 7f2b677c9980 1 -- 172.21.15.157:0/2386018455 shutdown_connections 2024-05-09T09:48:39.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.240+0000 7f2b677c9980 1 -- 172.21.15.157:0/2386018455 wait complete. 2024-05-09T09:48:39.258 INFO:teuthology.orchestra.run.smithi157.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-05-09T09:48:39.259 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-09T09:48:39.259 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-05-09T09:48:39.259 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-05-09T09:48:39.259 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-05-09T09:48:39.340 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:48:39.340 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:48:39.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.336+0000 7fa3b36f7980 1 Processor -- start 2024-05-09T09:48:39.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.336+0000 7fa3b36f7980 1 -- start start 2024-05-09T09:48:39.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.336+0000 7fa3b36f7980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55f5ae4cfe60 0x55f5ae4d2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.336+0000 7fa3b36f7980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f5ae381440 con 0x55f5ae4cb950 2024-05-09T09:48:39.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.336+0000 7fa3b36f7980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55f5ae36c5f0 con 0x55f5ae4cfe60 2024-05-09T09:48:39.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.340+0000 7fa3b0a11640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55f5ae4cfe60 0x55f5ae4d2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.340+0000 7fa3b1212640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x55f5ae4cb950 0x55f5ae4cbd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:49186/0 (socket says 172.21.15.157:49186) 2024-05-09T09:48:39.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.340+0000 7fa3b1212640 1 -- 172.21.15.157:0/4146275939 learned_addr learned my addr 172.21.15.157:0/4146275939 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:48:39.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.340+0000 7fa3b0a11640 1 --2- 172.21.15.157:0/4146275939 >> v2:172.21.15.110:3300/0 conn(0x55f5ae4cfe60 0x55f5ae4d2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:60038/0 (socket says 172.21.15.157:60038) 2024-05-09T09:48:39.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.340+0000 7fa3b0a11640 1 -- 172.21.15.157:0/4146275939 >> v1:172.21.15.110:6789/0 conn(0x55f5ae4cb950 legacy=0x55f5ae4cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.340+0000 7fa3b0a11640 1 -- 172.21.15.157:0/4146275939 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5ae377990 con 0x55f5ae4cfe60 2024-05-09T09:48:39.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.340+0000 7fa3b0a11640 1 --2- 172.21.15.157:0/4146275939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae4cfe60 0x55f5ae4d2250 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa3a800a480 tx=0x7fa3a801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4837378f21a18ec server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.340+0000 7fa3a3fff640 1 -- 172.21.15.157:0/4146275939 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3a80b0070 con 0x55f5ae4cfe60 2024-05-09T09:48:39.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.340+0000 7fa3a3fff640 1 -- 172.21.15.157:0/4146275939 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3a80ab540 con 0x55f5ae4cfe60 2024-05-09T09:48:39.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.340+0000 7fa3a3fff640 1 -- 172.21.15.157:0/4146275939 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3a80ab840 con 0x55f5ae4cfe60 2024-05-09T09:48:39.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.344+0000 7fa3b36f7980 1 -- 172.21.15.157:0/4146275939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae4cfe60 msgr2=0x55f5ae4d2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.344+0000 7fa3b36f7980 1 --2- 172.21.15.157:0/4146275939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae4cfe60 0x55f5ae4d2250 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa3a800a480 tx=0x7fa3a801b280 comp rx=0 tx=0).stop 2024-05-09T09:48:39.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.344+0000 7fa3b36f7980 1 -- 172.21.15.157:0/4146275939 shutdown_connections 2024-05-09T09:48:39.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.344+0000 7fa3b36f7980 1 --2- 172.21.15.157:0/4146275939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae4cfe60 0x55f5ae4d2250 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.344+0000 7fa3b36f7980 1 -- 172.21.15.157:0/4146275939 >> 172.21.15.157:0/4146275939 conn(0x55f5ae4c7220 msgr2=0x55f5ae4c9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:39.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.344+0000 7fa3b36f7980 1 -- 172.21.15.157:0/4146275939 shutdown_connections 2024-05-09T09:48:39.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.344+0000 7fa3b36f7980 1 -- 172.21.15.157:0/4146275939 wait complete. 2024-05-09T09:48:39.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.356+0000 7fa3b36f7980 1 Processor -- start 2024-05-09T09:48:39.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.360+0000 7fa3b36f7980 1 -- start start 2024-05-09T09:48:39.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.360+0000 7fa3b36f7980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae4cb950 0x55f5ae5b6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.360+0000 7fa3b36f7980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f5ae3cefe0 con 0x55f5ae4cb950 2024-05-09T09:48:39.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.360+0000 7fa3b1212640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae4cb950 0x55f5ae5b6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.360+0000 7fa3b1212640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae4cb950 0x55f5ae5b6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:60054/0 (socket says 172.21.15.157:60054) 2024-05-09T09:48:39.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.360+0000 7fa3b1212640 1 -- 172.21.15.157:0/941690727 learned_addr learned my addr 172.21.15.157:0/941690727 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:39.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.360+0000 7fa3b1212640 1 -- 172.21.15.157:0/941690727 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5ae353ae0 con 0x55f5ae4cb950 2024-05-09T09:48:39.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.360+0000 7fa3b1212640 1 --2- 172.21.15.157:0/941690727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae4cb950 0x55f5ae5b6b60 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0015f0 tx=0x7fa3ac001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939dbb0de2529f02 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.360+0000 7fa29f606640 1 -- 172.21.15.157:0/941690727 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3ac004530 con 0x55f5ae4cb950 2024-05-09T09:48:39.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.360+0000 7fa29f606640 1 -- 172.21.15.157:0/941690727 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3ac0046f0 con 0x55f5ae4cb950 2024-05-09T09:48:39.364 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.360+0000 7fa29f606640 1 -- 172.21.15.157:0/941690727 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3ac004a90 con 0x55f5ae4cb950 2024-05-09T09:48:39.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.360+0000 7fa3b36f7980 1 -- 172.21.15.157:0/941690727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae4cb950 msgr2=0x55f5ae5b6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.360+0000 7fa3b36f7980 1 --2- 172.21.15.157:0/941690727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae4cb950 0x55f5ae5b6b60 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0015f0 tx=0x7fa3ac001ab0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.360+0000 7fa3b36f7980 1 -- 172.21.15.157:0/941690727 shutdown_connections 2024-05-09T09:48:39.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.360+0000 7fa3b36f7980 1 --2- 172.21.15.157:0/941690727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae4cb950 0x55f5ae5b6b60 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.360+0000 7fa3b36f7980 1 -- 172.21.15.157:0/941690727 >> 172.21.15.157:0/941690727 conn(0x55f5ae4c7220 msgr2=0x55f5ae5b26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:39.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.360+0000 7fa3b36f7980 1 -- 172.21.15.157:0/941690727 shutdown_connections 2024-05-09T09:48:39.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.360+0000 7fa3b36f7980 1 -- 172.21.15.157:0/941690727 wait complete. 2024-05-09T09:48:39.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.360+0000 7fa3b36f7980 1 Processor -- start 2024-05-09T09:48:39.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.360+0000 7fa3b36f7980 1 -- start start 2024-05-09T09:48:39.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.360+0000 7fa3b36f7980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae4cb950 0x55f5ae5bdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.360+0000 7fa3b36f7980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f5ae4d5280 con 0x55f5ae4cb950 2024-05-09T09:48:39.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.360+0000 7fa3b1212640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae4cb950 0x55f5ae5bdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.360+0000 7fa3b1212640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae4cb950 0x55f5ae5bdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:60066/0 (socket says 172.21.15.157:60066) 2024-05-09T09:48:39.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.360+0000 7fa3b1212640 1 -- 172.21.15.157:0/2265407902 learned_addr learned my addr 172.21.15.157:0/2265407902 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:39.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.364+0000 7fa3b1212640 1 -- 172.21.15.157:0/2265407902 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5ae5be320 con 0x55f5ae4cb950 2024-05-09T09:48:39.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.364+0000 7fa3b1212640 1 --2- 172.21.15.157:0/2265407902 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae4cb950 0x55f5ae5bdde0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x55f5ae5b79f0 tx=0x7fa3ac000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.364+0000 7fa29de03640 1 -- 172.21.15.157:0/2265407902 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3ac013760 con 0x55f5ae4cb950 2024-05-09T09:48:39.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.364+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2265407902 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f5ae5be5b0 con 0x55f5ae4cb950 2024-05-09T09:48:39.368 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.364+0000 7fa29de03640 1 -- 172.21.15.157:0/2265407902 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3ac013900 con 0x55f5ae4cb950 2024-05-09T09:48:39.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.364+0000 7fa29de03640 1 -- 172.21.15.157:0/2265407902 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3ac013be0 con 0x55f5ae4cb950 2024-05-09T09:48:39.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.364+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2265407902 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5ae5c1240 con 0x55f5ae4cb950 2024-05-09T09:48:39.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.364+0000 7fa29de03640 1 -- 172.21.15.157:0/2265407902 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fa3ac010070 con 0x55f5ae4cb950 2024-05-09T09:48:39.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.364+0000 7fa29de03640 1 --2- 172.21.15.157:0/2265407902 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa298034bb0 0x7fa298037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.364+0000 7fa29de03640 1 -- 172.21.15.157:0/2265407902 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fa3ac018070 con 0x55f5ae4cb950 2024-05-09T09:48:39.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.364+0000 7fa3b0a11640 1 --2- 172.21.15.157:0/2265407902 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa298034bb0 0x7fa298037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.364+0000 7fa3b36f7980 1 --2- 172.21.15.157:0/2265407902 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f5ae4cfe60 0x55f5ae5c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.364+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2265407902 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae5c53d0 con 0x55f5ae4cfe60 2024-05-09T09:48:39.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.364+0000 7fa3b1a13640 1 --2- 172.21.15.157:0/2265407902 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f5ae4cfe60 0x55f5ae5c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.364+0000 7fa3b0a11640 1 --2- 172.21.15.157:0/2265407902 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa298034bb0 0x7fa298037070 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa3a80ad000 tx=0x7fa3a80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.364+0000 7fa3b1a13640 1 --2- 172.21.15.157:0/2265407902 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f5ae4cfe60 0x55f5ae5c4d60 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.364+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2265407902 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa3a40083f0 con 0x55f5ae4cfe60 2024-05-09T09:48:39.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.364+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2265407902 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae5c2460 con 0x55f5ae4cfe60 2024-05-09T09:48:39.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.364+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2265407902 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa3a40083f0 con 0x55f5ae4cfe60 2024-05-09T09:48:39.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.364+0000 7fa3b36f7980 1 --2- 172.21.15.157:0/2265407902 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f5ae5c7720 0x55f5ae5c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.364+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2265407902 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae5ca1e0 con 0x55f5ae5c7720 2024-05-09T09:48:39.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.368+0000 7fa3b1212640 1 --2- 172.21.15.157:0/2265407902 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f5ae5c7720 0x55f5ae5c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.368+0000 7fa3b1212640 1 --2- 172.21.15.157:0/2265407902 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f5ae5c7720 0x55f5ae5c9b10 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.368+0000 7fa3b1212640 1 -- 172.21.15.157:0/2265407902 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa3ac01b030 con 0x55f5ae5c7720 2024-05-09T09:48:39.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.368+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2265407902 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae5c65c0 con 0x55f5ae4cfe60 2024-05-09T09:48:39.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.368+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2265407902 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa3a40083f0 con 0x55f5ae4cfe60 2024-05-09T09:48:39.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.368+0000 7fa3b36f7980 1 --2- 172.21.15.157:0/2265407902 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f5ae5cb620 0x55f5ae5cda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.368+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2265407902 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae5ce1a0 con 0x55f5ae5cb620 2024-05-09T09:48:39.372 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.368+0000 7fa3b0a11640 1 --2- 172.21.15.157:0/2265407902 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f5ae5cb620 0x55f5ae5cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.368+0000 7fa3b0a11640 1 --2- 172.21.15.157:0/2265407902 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f5ae5cb620 0x55f5ae5cda10 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.368+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2265407902 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa3a80b3040 con 0x55f5ae5cb620 2024-05-09T09:48:39.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.372+0000 7fa3b36f7980 1 Processor -- start 2024-05-09T09:48:39.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.372+0000 7fa3b36f7980 1 -- start start 2024-05-09T09:48:39.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.372+0000 7fa3b36f7980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae5f3fe0 0x55f5ae5f4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.372+0000 7fa3b36f7980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f5ae3d3020 con 0x55f5ae5f3fe0 2024-05-09T09:48:39.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.372+0000 7fa3b1212640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae5f3fe0 0x55f5ae5f4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.372+0000 7fa3b1212640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae5f3fe0 0x55f5ae5f4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:60082/0 (socket says 172.21.15.157:60082) 2024-05-09T09:48:39.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.372+0000 7fa3b1212640 1 -- 172.21.15.157:0/3931758074 learned_addr learned my addr 172.21.15.157:0/3931758074 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:39.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.372+0000 7fa3b1212640 1 -- 172.21.15.157:0/3931758074 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5ae5f4940 con 0x55f5ae5f3fe0 2024-05-09T09:48:39.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.376+0000 7fa3b1212640 1 --2- 172.21.15.157:0/3931758074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae5f3fe0 0x55f5ae5f4400 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac048c40 tx=0x7fa3ac010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.376+0000 7fa295ba0640 1 -- 172.21.15.157:0/3931758074 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3ac038070 con 0x55f5ae5f3fe0 2024-05-09T09:48:39.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.376+0000 7fa3b36f7980 1 -- 172.21.15.157:0/3931758074 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f5ae5f53d0 con 0x55f5ae5f3fe0 2024-05-09T09:48:39.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.376+0000 7fa295ba0640 1 -- 172.21.15.157:0/3931758074 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3ac029470 con 0x55f5ae5f3fe0 2024-05-09T09:48:39.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.376+0000 7fa295ba0640 1 -- 172.21.15.157:0/3931758074 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3ac04f060 con 0x55f5ae5f3fe0 2024-05-09T09:48:39.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.376+0000 7fa3b36f7980 1 -- 172.21.15.157:0/3931758074 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5ae5f58b0 con 0x55f5ae5f3fe0 2024-05-09T09:48:39.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.376+0000 7fa295ba0640 1 -- 172.21.15.157:0/3931758074 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fa3ac029660 con 0x55f5ae5f3fe0 2024-05-09T09:48:39.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.376+0000 7fa295ba0640 1 --2- 172.21.15.157:0/3931758074 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa288034bb0 0x7fa288037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.376+0000 7fa295ba0640 1 -- 172.21.15.157:0/3931758074 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fa3ac03c020 con 0x55f5ae5f3fe0 2024-05-09T09:48:39.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.376+0000 7fa3b0a11640 1 --2- 172.21.15.157:0/3931758074 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa288034bb0 0x7fa288037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.376+0000 7fa3b36f7980 1 Processor -- start 2024-05-09T09:48:39.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.376+0000 7fa3b36f7980 1 -- start start 2024-05-09T09:48:39.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.376+0000 7fa3b0a11640 1 --2- 172.21.15.157:0/3931758074 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa288034bb0 0x7fa288037070 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa3a801b2c0 tx=0x7fa3a8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.376+0000 7fa3b36f7980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae441760 0x55f5ae441b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.376+0000 7fa3b36f7980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f5ae5b72b0 con 0x55f5ae441760 2024-05-09T09:48:39.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.376+0000 7fa3b1212640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae441760 0x55f5ae441b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.376+0000 7fa3b1212640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae441760 0x55f5ae441b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:60092/0 (socket says 172.21.15.157:60092) 2024-05-09T09:48:39.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.376+0000 7fa3b1212640 1 -- 172.21.15.157:0/2642327081 learned_addr learned my addr 172.21.15.157:0/2642327081 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:39.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.376+0000 7fa3b1212640 1 -- 172.21.15.157:0/2642327081 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5ae43ff80 con 0x55f5ae441760 2024-05-09T09:48:39.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.376+0000 7fa3b1212640 1 --2- 172.21.15.157:0/2642327081 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae441760 0x55f5ae441b80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00c010 tx=0x7fa3ac033600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c396746a87d6a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.376+0000 7fa28f7fe640 1 -- 172.21.15.157:0/2642327081 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3ac034d60 con 0x55f5ae441760 2024-05-09T09:48:39.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.376+0000 7fa28f7fe640 1 -- 172.21.15.157:0/2642327081 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3ac04a580 con 0x55f5ae441760 2024-05-09T09:48:39.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.376+0000 7fa28f7fe640 1 -- 172.21.15.157:0/2642327081 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3ac0425f0 con 0x55f5ae441760 2024-05-09T09:48:39.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.380+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2642327081 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae441760 msgr2=0x55f5ae441b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.380+0000 7fa3b36f7980 1 --2- 172.21.15.157:0/2642327081 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae441760 0x55f5ae441b80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00c010 tx=0x7fa3ac033600 comp rx=0 tx=0).stop 2024-05-09T09:48:39.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.380+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2642327081 shutdown_connections 2024-05-09T09:48:39.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.380+0000 7fa3b36f7980 1 --2- 172.21.15.157:0/2642327081 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae441760 0x55f5ae441b80 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.380+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2642327081 >> 172.21.15.157:0/2642327081 conn(0x55f5ae5fd330 msgr2=0x55f5ae5fb390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:39.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.380+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2642327081 shutdown_connections 2024-05-09T09:48:39.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.380+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2642327081 wait complete. 2024-05-09T09:48:39.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.380+0000 7fa3b36f7980 1 Processor -- start 2024-05-09T09:48:39.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.380+0000 7fa3b36f7980 1 -- start start 2024-05-09T09:48:39.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.380+0000 7fa3b36f7980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae441760 0x55f5ae60a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.380+0000 7fa3b36f7980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f5ae440330 con 0x55f5ae441760 2024-05-09T09:48:39.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.380+0000 7fa3b1212640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae441760 0x55f5ae60a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.380+0000 7fa3b1212640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae441760 0x55f5ae60a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:60096/0 (socket says 172.21.15.157:60096) 2024-05-09T09:48:39.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.380+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 learned_addr learned my addr 172.21.15.157:0/2350269263 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:39.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.380+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5ae60aa30 con 0x55f5ae441760 2024-05-09T09:48:39.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.380+0000 7fa3b1212640 1 --2- 172.21.15.157:0/2350269263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae441760 0x55f5ae60a4f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac047a60 tx=0x7fa3ac042ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.380+0000 7fa28dffb640 1 -- 172.21.15.157:0/2350269263 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3ac06f020 con 0x55f5ae441760 2024-05-09T09:48:39.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.380+0000 7fa28dffb640 1 -- 172.21.15.157:0/2350269263 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3ac042730 con 0x55f5ae441760 2024-05-09T09:48:39.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.380+0000 7fa28dffb640 1 -- 172.21.15.157:0/2350269263 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3ac04d2b0 con 0x55f5ae441760 2024-05-09T09:48:39.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.380+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f5ae60aa30 con 0x55f5ae441760 2024-05-09T09:48:39.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.380+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5ae60aa30 con 0x55f5ae441760 2024-05-09T09:48:39.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa28dffb640 1 -- 172.21.15.157:0/2350269263 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fa3ac072020 con 0x55f5ae441760 2024-05-09T09:48:39.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa3b36f7980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa28dffb640 1 --2- 172.21.15.157:0/2350269263 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa280034b10 0x7fa280036fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa28dffb640 1 -- 172.21.15.157:0/2350269263 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fa3ac065030 con 0x55f5ae441760 2024-05-09T09:48:39.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa3b0a11640 1 --2- 172.21.15.157:0/2350269263 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa280034b10 0x7fa280036fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa3b36f7980 1 --2- 172.21.15.157:0/2350269263 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f5ae617070 0x55f5ae619530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae619c80 con 0x55f5ae617070 2024-05-09T09:48:39.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa3b1a13640 1 --2- 172.21.15.157:0/2350269263 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f5ae617070 0x55f5ae619530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa3b0a11640 1 --2- 172.21.15.157:0/2350269263 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa280034b10 0x7fa280036fd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa3a80abfd0 tx=0x7fa3a80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa3b1a13640 1 --2- 172.21.15.157:0/2350269263 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f5ae617070 0x55f5ae619530 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa3a40083f0 con 0x55f5ae617070 2024-05-09T09:48:39.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa3b36f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa3b36f7980 20 realm 2024-05-09T09:48:39.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa3b36f7980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae61a090 con 0x55f5ae617070 2024-05-09T09:48:39.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa3a40083f0 con 0x55f5ae617070 2024-05-09T09:48:39.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa3b36f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa3b36f7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:48:39.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa3b36f7980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae61a930 con 0x55f5ae617070 2024-05-09T09:48:39.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa3a40083f0 con 0x55f5ae617070 2024-05-09T09:48:39.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa3b36f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa3b36f7980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae61acd0 con 0x55f5ae617070 2024-05-09T09:48:39.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa3a40083f0 con 0x55f5ae617070 2024-05-09T09:48:39.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa3b36f7980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:39.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa3b36f7980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa3b36f7980 1 --2- 172.21.15.157:0/2350269263 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f5ae61ba30 0x55f5ae61de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae61e3a0 con 0x55f5ae61ba30 2024-05-09T09:48:39.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.384+0000 7fa3b1212640 1 --2- 172.21.15.157:0/2350269263 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f5ae61ba30 0x55f5ae61de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.388+0000 7fa3b1212640 1 --2- 172.21.15.157:0/2350269263 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f5ae61ba30 0x55f5ae61de20 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.388+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa3ac068070 con 0x55f5ae61ba30 2024-05-09T09:48:39.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.388+0000 7fa3b36f7980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:48:39.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.388+0000 7fa3b36f7980 20 searching for the correct realm 2024-05-09T09:48:39.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.388+0000 7fa3b36f7980 1 --2- 172.21.15.157:0/2350269263 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f5ae620310 0x55f5ae6227d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.388+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae622ea0 con 0x55f5ae620310 2024-05-09T09:48:39.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.388+0000 7fa3b0a11640 1 --2- 172.21.15.157:0/2350269263 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f5ae620310 0x55f5ae6227d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.388+0000 7fa3b0a11640 1 --2- 172.21.15.157:0/2350269263 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f5ae620310 0x55f5ae6227d0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.388+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a80d9070 con 0x55f5ae620310 2024-05-09T09:48:39.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.388+0000 7fa3b0a11640 1 --2- 172.21.15.157:0/2350269263 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa3a80ce040 0x7fa3a80db410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.388+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae622ea0 con 0x7fa3a80ce040 2024-05-09T09:48:39.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.388+0000 7fa3b1a13640 1 --2- 172.21.15.157:0/2350269263 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa3a80ce040 0x7fa3a80db410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.388+0000 7fa3b1a13640 1 --2- 172.21.15.157:0/2350269263 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa3a80ce040 0x7fa3a80db410 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.388+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a40083f0 con 0x7fa3a80ce040 2024-05-09T09:48:39.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.388+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae61acd0 con 0x55f5ae61ba30 2024-05-09T09:48:39.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.388+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3ac068070 con 0x55f5ae61ba30 2024-05-09T09:48:39.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.388+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae61acd0 con 0x55f5ae617070 2024-05-09T09:48:39.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.392+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a40083f0 con 0x55f5ae617070 2024-05-09T09:48:39.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.392+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae61acd0 con 0x55f5ae617070 2024-05-09T09:48:39.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.392+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a4026040 con 0x55f5ae617070 2024-05-09T09:48:39.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.392+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae61acd0 con 0x55f5ae61ba30 2024-05-09T09:48:39.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.392+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3ac068070 con 0x55f5ae61ba30 2024-05-09T09:48:39.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.392+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae61acd0 con 0x55f5ae61ba30 2024-05-09T09:48:39.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.392+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3ac068070 con 0x55f5ae61ba30 2024-05-09T09:48:39.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.392+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae61acd0 con 0x7fa3a80ce040 2024-05-09T09:48:39.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.392+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a4026040 con 0x7fa3a80ce040 2024-05-09T09:48:39.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.392+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae61acd0 con 0x55f5ae620310 2024-05-09T09:48:39.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.392+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a80d9070 con 0x55f5ae620310 2024-05-09T09:48:39.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.392+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae61acd0 con 0x55f5ae617070 2024-05-09T09:48:39.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.392+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a4026040 con 0x55f5ae617070 2024-05-09T09:48:39.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.392+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae61acd0 con 0x55f5ae61ba30 2024-05-09T09:48:39.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.392+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3ac068070 con 0x55f5ae61ba30 2024-05-09T09:48:39.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.392+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae61acd0 con 0x55f5ae617070 2024-05-09T09:48:39.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.392+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a4026040 con 0x55f5ae617070 2024-05-09T09:48:39.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.392+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae61acd0 con 0x7fa3a80ce040 2024-05-09T09:48:39.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.396+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa3a4026040 con 0x7fa3a80ce040 2024-05-09T09:48:39.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.396+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae61acd0 con 0x55f5ae620310 2024-05-09T09:48:39.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.396+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a80d9070 con 0x55f5ae620310 2024-05-09T09:48:39.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.396+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa3a80e8040 con 0x55f5ae620310 2024-05-09T09:48:39.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.396+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa3a80d9070 con 0x55f5ae620310 2024-05-09T09:48:39.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.396+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa3a80e8040 con 0x55f5ae61ba30 2024-05-09T09:48:39.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.396+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3ac068070 con 0x55f5ae61ba30 2024-05-09T09:48:39.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.396+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa3a80e8040 con 0x55f5ae620310 2024-05-09T09:48:39.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.396+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a80d9070 con 0x55f5ae620310 2024-05-09T09:48:39.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.396+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa3a80e8040 con 0x55f5ae620310 2024-05-09T09:48:39.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.396+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a80d9070 con 0x55f5ae620310 2024-05-09T09:48:39.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.396+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa3a80e8040 con 0x55f5ae617070 2024-05-09T09:48:39.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.396+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a4026040 con 0x55f5ae617070 2024-05-09T09:48:39.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.396+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa3a80e8040 con 0x55f5ae617070 2024-05-09T09:48:39.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.396+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa3a4026040 con 0x55f5ae617070 2024-05-09T09:48:39.401 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.396+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa3a80e8040 con 0x55f5ae61ba30 2024-05-09T09:48:39.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.396+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3ac068070 con 0x55f5ae61ba30 2024-05-09T09:48:39.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.396+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa3a80e8040 con 0x55f5ae620310 2024-05-09T09:48:39.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.396+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a80d9070 con 0x55f5ae620310 2024-05-09T09:48:39.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.396+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa3a80e8040 con 0x7fa3a80ce040 2024-05-09T09:48:39.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.400+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a4026040 con 0x7fa3a80ce040 2024-05-09T09:48:39.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.400+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa3a80e8040 con 0x55f5ae617070 2024-05-09T09:48:39.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.400+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a4026040 con 0x55f5ae617070 2024-05-09T09:48:39.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.400+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa3a80e8040 con 0x55f5ae61ba30 2024-05-09T09:48:39.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.400+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa3ac068070 con 0x55f5ae61ba30 2024-05-09T09:48:39.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.400+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa3a80e8040 con 0x55f5ae620310 2024-05-09T09:48:39.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.400+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a80d9070 con 0x55f5ae620310 2024-05-09T09:48:39.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.400+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa3a80e8040 con 0x55f5ae61ba30 2024-05-09T09:48:39.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.400+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3ac068070 con 0x55f5ae61ba30 2024-05-09T09:48:39.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.400+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa3a80e8040 con 0x7fa3a80ce040 2024-05-09T09:48:39.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.400+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a4026040 con 0x7fa3a80ce040 2024-05-09T09:48:39.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.400+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa3a80e8040 con 0x55f5ae620310 2024-05-09T09:48:39.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.400+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a80d9070 con 0x55f5ae620310 2024-05-09T09:48:39.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.400+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa3a80e8040 con 0x55f5ae61ba30 2024-05-09T09:48:39.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.400+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3ac068070 con 0x55f5ae61ba30 2024-05-09T09:48:39.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.400+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa3a80e8040 con 0x55f5ae617070 2024-05-09T09:48:39.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa3a4026040 con 0x55f5ae617070 2024-05-09T09:48:39.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa3a80e8040 con 0x7fa3a80ce040 2024-05-09T09:48:39.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a4026040 con 0x7fa3a80ce040 2024-05-09T09:48:39.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:48:39.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:48:39.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:48:39.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:48:39.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:48:39.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:48:39.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae61ebf0 con 0x55f5ae617070 2024-05-09T09:48:39.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa3a4026040 con 0x55f5ae617070 2024-05-09T09:48:39.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae61ebf0 con 0x55f5ae617070 2024-05-09T09:48:39.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa3a4026040 con 0x55f5ae617070 2024-05-09T09:48:39.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:39.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae61ebf0 con 0x55f5ae620310 2024-05-09T09:48:39.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa3a80d9070 con 0x55f5ae620310 2024-05-09T09:48:39.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:48:39.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 20 zone default found 2024-05-09T09:48:39.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 4 Realm: () 2024-05-09T09:48:39.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:48:39.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:48:39.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:48:39.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 20 zonegroup default 2024-05-09T09:48:39.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae61f490 con 0x55f5ae61ba30 2024-05-09T09:48:39.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa3ac068070 con 0x55f5ae61ba30 2024-05-09T09:48:39.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae624d00 con 0x55f5ae620310 2024-05-09T09:48:39.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa3a80d9070 con 0x55f5ae620310 2024-05-09T09:48:39.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6250a0 con 0x55f5ae620310 2024-05-09T09:48:39.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa3a80d9070 con 0x55f5ae620310 2024-05-09T09:48:39.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 20 started sync module instance, tier type = 2024-05-09T09:48:39.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:48:39.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.404+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6241a0 con 0x7fa3a80ce040 2024-05-09T09:48:39.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.408+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a4026040 con 0x7fa3a80ce040 2024-05-09T09:48:39.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.408+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94513681024752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6241a0 con 0x7fa3a80ce040 2024-05-09T09:48:39.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.408+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae625a60 con 0x55f5ae617070 2024-05-09T09:48:39.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.408+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94513681024752] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a4036040 con 0x7fa3a80ce040 2024-05-09T09:48:39.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.408+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a4036040 con 0x55f5ae617070 2024-05-09T09:48:39.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.408+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94513681028800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6241a0 con 0x55f5ae617070 2024-05-09T09:48:39.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.408+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae626470 con 0x55f5ae620310 2024-05-09T09:48:39.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.412+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a80d9070 con 0x55f5ae620310 2024-05-09T09:48:39.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.412+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94513681031104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae626cc0 con 0x55f5ae620310 2024-05-09T09:48:39.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.412+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae627680 con 0x7fa3a80ce040 2024-05-09T09:48:39.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.412+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94513681028800] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a4036040 con 0x55f5ae617070 2024-05-09T09:48:39.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.412+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a4036040 con 0x7fa3a80ce040 2024-05-09T09:48:39.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.412+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94513681022192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae627680 con 0x7fa3a80ce040 2024-05-09T09:48:39.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.412+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae628090 con 0x55f5ae617070 2024-05-09T09:48:39.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.412+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94513681031104] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a80d9070 con 0x55f5ae620310 2024-05-09T09:48:39.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.412+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94513681022192] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a4036040 con 0x7fa3a80ce040 2024-05-09T09:48:39.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.416+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a4036040 con 0x55f5ae617070 2024-05-09T09:48:39.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.416+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94513681035728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6275f0 con 0x55f5ae617070 2024-05-09T09:48:39.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.416+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae628540 con 0x55f5ae61ba30 2024-05-09T09:48:39.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.416+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94513681035728] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a4036040 con 0x55f5ae617070 2024-05-09T09:48:39.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.416+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3ac068070 con 0x55f5ae61ba30 2024-05-09T09:48:39.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.416+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94513681038304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6288e0 con 0x55f5ae61ba30 2024-05-09T09:48:39.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.416+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae629130 con 0x55f5ae61ba30 2024-05-09T09:48:39.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.420+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3ac068070 con 0x55f5ae61ba30 2024-05-09T09:48:39.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.420+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94513681043040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6298b0 con 0x55f5ae61ba30 2024-05-09T09:48:39.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.420+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae62a3d0 con 0x55f5ae61ba30 2024-05-09T09:48:39.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.420+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94513681038304] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3ac068070 con 0x55f5ae61ba30 2024-05-09T09:48:39.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.420+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94513681043040] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3ac068070 con 0x55f5ae61ba30 2024-05-09T09:48:39.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.420+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3ac068070 con 0x55f5ae61ba30 2024-05-09T09:48:39.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.420+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94513681047200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae629300 con 0x55f5ae61ba30 2024-05-09T09:48:39.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.420+0000 7fa3b36f7980 20 add_watcher() i=0 2024-05-09T09:48:39.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.420+0000 7fa3b36f7980 20 add_watcher() i=1 2024-05-09T09:48:39.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.420+0000 7fa3b36f7980 20 add_watcher() i=2 2024-05-09T09:48:39.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.420+0000 7fa3b36f7980 20 add_watcher() i=3 2024-05-09T09:48:39.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.420+0000 7fa3b36f7980 20 add_watcher() i=4 2024-05-09T09:48:39.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.420+0000 7fa3b36f7980 20 add_watcher() i=5 2024-05-09T09:48:39.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.420+0000 7fa3b36f7980 20 add_watcher() i=6 2024-05-09T09:48:39.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.424+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94513681047200] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3ac068070 con 0x55f5ae61ba30 2024-05-09T09:48:39.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.424+0000 7fa3b36f7980 20 add_watcher() i=7 2024-05-09T09:48:39.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.424+0000 7fa3b36f7980 2 all 8 watchers are set, enabling cache 2024-05-09T09:48:39.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.424+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae62d3c0 con 0x55f5ae617070 2024-05-09T09:48:39.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.424+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa3a4036040 con 0x55f5ae617070 2024-05-09T09:48:39.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.424+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94513681039360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae62a870 con 0x55f5ae617070 2024-05-09T09:48:39.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.424+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94513681039360] v32'370 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa3a4036040 con 0x55f5ae617070 2024-05-09T09:48:39.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.424+0000 7fa2667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:39.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.424+0000 7fa3b36f7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:48:39.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.424+0000 7fa3b36f7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:48:39.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.424+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae635940 con 0x55f5ae617070 2024-05-09T09:48:39.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.428+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'87 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa3a4036040 con 0x55f5ae617070 2024-05-09T09:48:39.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.428+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae635ef0 con 0x55f5ae61ba30 2024-05-09T09:48:39.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.432+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'81 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa3ac068070 con 0x55f5ae61ba30 2024-05-09T09:48:39.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.432+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae635ef0 con 0x55f5ae620310 2024-05-09T09:48:39.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.432+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'80 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa3a80d9070 con 0x55f5ae620310 2024-05-09T09:48:39.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.432+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6364e0 con 0x55f5ae617070 2024-05-09T09:48:39.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.432+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'371 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa3a4036040 con 0x55f5ae617070 2024-05-09T09:48:39.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.432+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae636990 con 0x7fa3a80ce040 2024-05-09T09:48:39.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.436+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'230 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa3a4036040 con 0x7fa3a80ce040 2024-05-09T09:48:39.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.436+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6339b0 con 0x55f5ae620310 2024-05-09T09:48:39.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.436+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'154 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa3a80d9070 con 0x55f5ae620310 2024-05-09T09:48:39.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.436+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6339b0 con 0x55f5ae617070 2024-05-09T09:48:39.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.440+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'82 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa3a4036040 con 0x55f5ae617070 2024-05-09T09:48:39.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.440+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6374f0 con 0x55f5ae61ba30 2024-05-09T09:48:39.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.440+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'153 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa3ac068070 con 0x55f5ae61ba30 2024-05-09T09:48:39.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.440+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6374f0 con 0x7fa3a80ce040 2024-05-09T09:48:39.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.444+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'80 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa3a4036040 con 0x7fa3a80ce040 2024-05-09T09:48:39.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.444+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6374f0 con 0x55f5ae620310 2024-05-09T09:48:39.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.444+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'86 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa3a80d9070 con 0x55f5ae620310 2024-05-09T09:48:39.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.444+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6379a0 con 0x7fa3a80ce040 2024-05-09T09:48:39.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.444+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'231 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3a4036040 con 0x7fa3a80ce040 2024-05-09T09:48:39.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.444+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6379a0 con 0x55f5ae61ba30 2024-05-09T09:48:39.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.448+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'84 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3ac068070 con 0x55f5ae61ba30 2024-05-09T09:48:39.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.448+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6379a0 con 0x7fa3a80ce040 2024-05-09T09:48:39.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.448+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'80 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3a4036040 con 0x7fa3a80ce040 2024-05-09T09:48:39.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.448+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6379a0 con 0x55f5ae61ba30 2024-05-09T09:48:39.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.452+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'159 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3ac068070 con 0x55f5ae61ba30 2024-05-09T09:48:39.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.452+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6379a0 con 0x55f5ae617070 2024-05-09T09:48:39.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.456+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'372 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3a4036040 con 0x55f5ae617070 2024-05-09T09:48:39.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.456+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6379a0 con 0x55f5ae620310 2024-05-09T09:48:39.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.456+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'224 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3a80d9070 con 0x55f5ae620310 2024-05-09T09:48:39.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.456+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6379a0 con 0x7fa3a80ce040 2024-05-09T09:48:39.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.460+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'232 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3a4036040 con 0x7fa3a80ce040 2024-05-09T09:48:39.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.460+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6379a0 con 0x55f5ae620310 2024-05-09T09:48:39.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.460+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'80 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3a80d9070 con 0x55f5ae620310 2024-05-09T09:48:39.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.460+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6379a0 con 0x55f5ae617070 2024-05-09T09:48:39.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.460+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'88 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3a4036040 con 0x55f5ae617070 2024-05-09T09:48:39.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.460+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6379a0 con 0x55f5ae617070 2024-05-09T09:48:39.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.464+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'373 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3a4036040 con 0x55f5ae617070 2024-05-09T09:48:39.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.464+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6379a0 con 0x55f5ae620310 2024-05-09T09:48:39.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.464+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'225 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3a80d9070 con 0x55f5ae620310 2024-05-09T09:48:39.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.464+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6379a0 con 0x7fa3a80ce040 2024-05-09T09:48:39.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.468+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'92 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3a4036040 con 0x7fa3a80ce040 2024-05-09T09:48:39.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.468+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6379a0 con 0x55f5ae620310 2024-05-09T09:48:39.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.468+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'82 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3a80d9070 con 0x55f5ae620310 2024-05-09T09:48:39.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.468+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6379a0 con 0x55f5ae620310 2024-05-09T09:48:39.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.468+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'86 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3a80d9070 con 0x55f5ae620310 2024-05-09T09:48:39.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.468+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6379a0 con 0x55f5ae620310 2024-05-09T09:48:39.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.472+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'77 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3a80d9070 con 0x55f5ae620310 2024-05-09T09:48:39.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.472+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6379a0 con 0x55f5ae620310 2024-05-09T09:48:39.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.472+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'155 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3a80d9070 con 0x55f5ae620310 2024-05-09T09:48:39.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.472+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6379a0 con 0x55f5ae61ba30 2024-05-09T09:48:39.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.476+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'82 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3ac068070 con 0x55f5ae61ba30 2024-05-09T09:48:39.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.476+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6379a0 con 0x55f5ae620310 2024-05-09T09:48:39.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.476+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'80 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3a80d9070 con 0x55f5ae620310 2024-05-09T09:48:39.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.476+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6379a0 con 0x55f5ae61ba30 2024-05-09T09:48:39.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.480+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'154 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3ac068070 con 0x55f5ae61ba30 2024-05-09T09:48:39.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.480+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6379a0 con 0x55f5ae620310 2024-05-09T09:48:39.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.480+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'226 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3a80d9070 con 0x55f5ae620310 2024-05-09T09:48:39.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.480+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6379a0 con 0x55f5ae61ba30 2024-05-09T09:48:39.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.484+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'160 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3ac068070 con 0x55f5ae61ba30 2024-05-09T09:48:39.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.484+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6379a0 con 0x7fa3a80ce040 2024-05-09T09:48:39.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.488+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'86 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3a4036040 con 0x7fa3a80ce040 2024-05-09T09:48:39.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.488+0000 7fa2657e2640 20 reqs_thread_entry: start 2024-05-09T09:48:39.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.488+0000 7fa3b36f7980 20 init_complete bucket index max shards: 11 2024-05-09T09:48:39.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.488+0000 7fa1d6ffd640 20 reqs_thread_entry: start 2024-05-09T09:48:39.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.488+0000 7fa3b36f7980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.488+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae653430 con 0x55f5ae617070 2024-05-09T09:48:39.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.488+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa3a4036040 con 0x55f5ae617070 2024-05-09T09:48:39.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.488+0000 7fa3b36f7980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:48:39.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.488+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:95 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae632500 con 0x55f5ae61ba30 2024-05-09T09:48:39.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.492+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(95 usage.10 [call out=1378b] v0'0 uv77 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fa3ac068070 con 0x55f5ae61ba30 2024-05-09T09:48:39.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.492+0000 7fa2667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:39.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.492+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94513681039360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6364e0 con 0x55f5ae617070 2024-05-09T09:48:39.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.492+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94513681039360] v32'374 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa3a4036040 con 0x55f5ae617070 2024-05-09T09:48:39.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.492+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94513681024752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae628000 con 0x7fa3a80ce040 2024-05-09T09:48:39.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.496+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94513681024752] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a4036040 con 0x7fa3a80ce040 2024-05-09T09:48:39.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.496+0000 7fa3b36f7980 20 remove_watcher() i=0 2024-05-09T09:48:39.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.496+0000 7fa3b36f7980 2 removed watcher, disabling cache 2024-05-09T09:48:39.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.496+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94513681028800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae628000 con 0x55f5ae617070 2024-05-09T09:48:39.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.496+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94513681028800] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a4036040 con 0x55f5ae617070 2024-05-09T09:48:39.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.496+0000 7fa3b36f7980 20 remove_watcher() i=1 2024-05-09T09:48:39.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.496+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94513681031104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6256c0 con 0x55f5ae620310 2024-05-09T09:48:39.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.500+0000 7fa3b0a11640 1 -- 172.21.15.157:0/2350269263 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94513681031104] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a80d9070 con 0x55f5ae620310 2024-05-09T09:48:39.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.500+0000 7fa3b36f7980 20 remove_watcher() i=2 2024-05-09T09:48:39.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.500+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94513681022192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae628000 con 0x7fa3a80ce040 2024-05-09T09:48:39.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.500+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94513681022192] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a4036040 con 0x7fa3a80ce040 2024-05-09T09:48:39.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.500+0000 7fa3b36f7980 20 remove_watcher() i=3 2024-05-09T09:48:39.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.500+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94513681035728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae625fc0 con 0x55f5ae617070 2024-05-09T09:48:39.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.504+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94513681035728] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a4036040 con 0x55f5ae617070 2024-05-09T09:48:39.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.504+0000 7fa3b36f7980 20 remove_watcher() i=4 2024-05-09T09:48:39.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.504+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94513681038304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae628000 con 0x55f5ae61ba30 2024-05-09T09:48:39.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.508+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94513681038304] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3ac068070 con 0x55f5ae61ba30 2024-05-09T09:48:39.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.508+0000 7fa3b36f7980 20 remove_watcher() i=5 2024-05-09T09:48:39.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.508+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94513681043040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae6271d0 con 0x55f5ae61ba30 2024-05-09T09:48:39.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.508+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94513681043040] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3ac068070 con 0x55f5ae61ba30 2024-05-09T09:48:39.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.508+0000 7fa3b36f7980 20 remove_watcher() i=6 2024-05-09T09:48:39.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.508+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94513681047200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5ae625fc0 con 0x55f5ae61ba30 2024-05-09T09:48:39.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b1212640 1 -- 172.21.15.157:0/2350269263 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94513681047200] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3ac068070 con 0x55f5ae61ba30 2024-05-09T09:48:39.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 20 remove_watcher() i=7 2024-05-09T09:48:39.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f5ae61ba30 msgr2=0x55f5ae61de20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 --2- 172.21.15.157:0/2350269263 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f5ae61ba30 0x55f5ae61de20 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f5ae617070 msgr2=0x55f5ae619530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 --2- 172.21.15.157:0/2350269263 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f5ae617070 0x55f5ae619530 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa3a80ce040 msgr2=0x7fa3a80db410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 --2- 172.21.15.157:0/2350269263 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa3a80ce040 0x7fa3a80db410 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f5ae620310 msgr2=0x55f5ae6227d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 --2- 172.21.15.157:0/2350269263 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f5ae620310 0x55f5ae6227d0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa280034b10 msgr2=0x7fa280036fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 --2- 172.21.15.157:0/2350269263 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa280034b10 0x7fa280036fd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa3a80abfd0 tx=0x7fa3a80a6000 comp rx=0 tx=0).stop 2024-05-09T09:48:39.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2350269263 reap_dead start 2024-05-09T09:48:39.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae441760 msgr2=0x55f5ae60a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 --2- 172.21.15.157:0/2350269263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae441760 0x55f5ae60a4f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac047a60 tx=0x7fa3ac042ec0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 shutdown_connections 2024-05-09T09:48:39.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 --2- 172.21.15.157:0/2350269263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae441760 0x55f5ae60a4f0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 >> 172.21.15.157:0/2350269263 conn(0x55f5ae5fd330 msgr2=0x55f5ae5fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:39.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 shutdown_connections 2024-05-09T09:48:39.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2350269263 wait complete. 2024-05-09T09:48:39.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 -- 172.21.15.157:0/3931758074 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa288034bb0 msgr2=0x7fa288037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 --2- 172.21.15.157:0/3931758074 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa288034bb0 0x7fa288037070 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa3a801b2c0 tx=0x7fa3a8005a10 comp rx=0 tx=0).stop 2024-05-09T09:48:39.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 -- 172.21.15.157:0/3931758074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae5f3fe0 msgr2=0x55f5ae5f4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 --2- 172.21.15.157:0/3931758074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae5f3fe0 0x55f5ae5f4400 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac048c40 tx=0x7fa3ac010d50 comp rx=0 tx=0).stop 2024-05-09T09:48:39.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 -- 172.21.15.157:0/3931758074 shutdown_connections 2024-05-09T09:48:39.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 --2- 172.21.15.157:0/3931758074 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa288034bb0 0x7fa288037070 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 --2- 172.21.15.157:0/3931758074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae5f3fe0 0x55f5ae5f4400 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 -- 172.21.15.157:0/3931758074 >> 172.21.15.157:0/3931758074 conn(0x55f5ae5e8db0 msgr2=0x55f5ae5e98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:39.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 -- 172.21.15.157:0/3931758074 shutdown_connections 2024-05-09T09:48:39.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 -- 172.21.15.157:0/3931758074 wait complete. 2024-05-09T09:48:39.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2265407902 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f5ae5c7720 msgr2=0x55f5ae5c9b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 --2- 172.21.15.157:0/2265407902 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f5ae5c7720 0x55f5ae5c9b10 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2265407902 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f5ae4cfe60 msgr2=0x55f5ae5c4d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 --2- 172.21.15.157:0/2265407902 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f5ae4cfe60 0x55f5ae5c4d60 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2265407902 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f5ae5cb620 msgr2=0x55f5ae5cda10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 --2- 172.21.15.157:0/2265407902 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f5ae5cb620 0x55f5ae5cda10 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2265407902 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa298034bb0 msgr2=0x7fa298037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 --2- 172.21.15.157:0/2265407902 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa298034bb0 0x7fa298037070 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa3a80ad000 tx=0x7fa3a80a5040 comp rx=0 tx=0).stop 2024-05-09T09:48:39.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2265407902 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae4cb950 msgr2=0x55f5ae5bdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 --2- 172.21.15.157:0/2265407902 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f5ae4cb950 0x55f5ae5bdde0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x55f5ae5b79f0 tx=0x7fa3ac000f50 comp rx=0 tx=0).stop 2024-05-09T09:48:39.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b1a13640 1 -- 172.21.15.157:0/2265407902 reap_dead start 2024-05-09T09:48:39.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2265407902 shutdown_connections 2024-05-09T09:48:39.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2265407902 >> 172.21.15.157:0/2265407902 conn(0x55f5ae4c7220 msgr2=0x55f5ae5b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:39.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2265407902 shutdown_connections 2024-05-09T09:48:39.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.512+0000 7fa3b36f7980 1 -- 172.21.15.157:0/2265407902 wait complete. 2024-05-09T09:48:39.529 INFO:teuthology.orchestra.run.smithi157.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo2","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-05-09T09:00:00.000000Z","epoch":1715245200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-05-09T09:48:39.529 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-09T09:48:39.529 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-05-09T09:48:39.529 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-05-09T09:48:39.529 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-05-09T09:48:39.620 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:48:39.620 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:48:39.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.616+0000 7ff35d2e6980 1 Processor -- start 2024-05-09T09:48:39.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.616+0000 7ff35d2e6980 1 -- start start 2024-05-09T09:48:39.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.616+0000 7ff35d2e6980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x561be8b4e980 0x561be8b4ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.620+0000 7ff35d2e6980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561be8a04440 con 0x561be8b4f2a0 2024-05-09T09:48:39.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.620+0000 7ff35d2e6980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x561be89ef5f0 con 0x561be8b4e980 2024-05-09T09:48:39.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.620+0000 7ff35ae01640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x561be8b4e980 0x561be8b4ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.620+0000 7ff35a600640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x561be8b4f2a0 0x561be8b4fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:49190/0 (socket says 172.21.15.157:49190) 2024-05-09T09:48:39.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.620+0000 7ff35ae01640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x561be8b4e980 0x561be8b4ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:60110/0 (socket says 172.21.15.157:60110) 2024-05-09T09:48:39.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.620+0000 7ff35a600640 1 -- 172.21.15.157:0/2070276075 learned_addr learned my addr 172.21.15.157:0/2070276075 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:48:39.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.620+0000 7ff35ae01640 1 -- 172.21.15.157:0/2070276075 >> v1:172.21.15.110:6789/0 conn(0x561be8b4f2a0 legacy=0x561be8b4fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.620+0000 7ff35ae01640 1 -- 172.21.15.157:0/2070276075 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561be89fa990 con 0x561be8b4e980 2024-05-09T09:48:39.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.620+0000 7ff35ae01640 1 --2- 172.21.15.157:0/2070276075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8b4e980 0x561be8b4ed60 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ff35400a420 tx=0x7ff35401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ed552d77335844 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.620+0000 7ff359dff640 1 -- 172.21.15.157:0/2070276075 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3540af070 con 0x561be8b4e980 2024-05-09T09:48:39.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.620+0000 7ff359dff640 1 -- 172.21.15.157:0/2070276075 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3540aa530 con 0x561be8b4e980 2024-05-09T09:48:39.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.620+0000 7ff359dff640 1 -- 172.21.15.157:0/2070276075 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3540aa850 con 0x561be8b4e980 2024-05-09T09:48:39.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.624+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2070276075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8b4e980 msgr2=0x561be8b4ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.624+0000 7ff35d2e6980 1 --2- 172.21.15.157:0/2070276075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8b4e980 0x561be8b4ed60 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ff35400a420 tx=0x7ff35401afd0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.624+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2070276075 shutdown_connections 2024-05-09T09:48:39.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.624+0000 7ff35d2e6980 1 --2- 172.21.15.157:0/2070276075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8b4e980 0x561be8b4ed60 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.624+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2070276075 >> 172.21.15.157:0/2070276075 conn(0x561be8b4a250 msgr2=0x561be8b4c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:39.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.624+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2070276075 shutdown_connections 2024-05-09T09:48:39.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.624+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2070276075 wait complete. 2024-05-09T09:48:39.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.636+0000 7ff35d2e6980 1 Processor -- start 2024-05-09T09:48:39.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.636+0000 7ff35d2e6980 1 -- start start 2024-05-09T09:48:39.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.640+0000 7ff35d2e6980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8b4e980 0x561be8c3a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.640+0000 7ff35d2e6980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561be8a51fe0 con 0x561be8b4e980 2024-05-09T09:48:39.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.640+0000 7ff35ae01640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8b4e980 0x561be8c3a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.640+0000 7ff35ae01640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8b4e980 0x561be8c3a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:60118/0 (socket says 172.21.15.157:60118) 2024-05-09T09:48:39.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.640+0000 7ff35ae01640 1 -- 172.21.15.157:0/2993176720 learned_addr learned my addr 172.21.15.157:0/2993176720 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:39.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.640+0000 7ff35ae01640 1 -- 172.21.15.157:0/2993176720 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561be89d6ae0 con 0x561be8b4e980 2024-05-09T09:48:39.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.640+0000 7ff35ae01640 1 --2- 172.21.15.157:0/2993176720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8b4e980 0x561be8c3a370 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ff354018c00 tx=0x7ff3540033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1258d119c0ad13fd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.640+0000 7ff248e09640 1 -- 172.21.15.157:0/2993176720 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3540af050 con 0x561be8b4e980 2024-05-09T09:48:39.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.640+0000 7ff248e09640 1 -- 172.21.15.157:0/2993176720 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3540b0040 con 0x561be8b4e980 2024-05-09T09:48:39.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.640+0000 7ff248e09640 1 -- 172.21.15.157:0/2993176720 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3540aabb0 con 0x561be8b4e980 2024-05-09T09:48:39.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.640+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2993176720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8b4e980 msgr2=0x561be8c3a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.640+0000 7ff35d2e6980 1 --2- 172.21.15.157:0/2993176720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8b4e980 0x561be8c3a370 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ff354018c00 tx=0x7ff3540033b0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.640+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2993176720 shutdown_connections 2024-05-09T09:48:39.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.640+0000 7ff35d2e6980 1 --2- 172.21.15.157:0/2993176720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8b4e980 0x561be8c3a370 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.640+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2993176720 >> 172.21.15.157:0/2993176720 conn(0x561be8b4a250 msgr2=0x561be8c35f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:39.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.640+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2993176720 shutdown_connections 2024-05-09T09:48:39.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.640+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2993176720 wait complete. 2024-05-09T09:48:39.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.640+0000 7ff35d2e6980 1 Processor -- start 2024-05-09T09:48:39.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.640+0000 7ff35d2e6980 1 -- start start 2024-05-09T09:48:39.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.640+0000 7ff35d2e6980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8b4e980 0x561be8c41410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.640+0000 7ff35d2e6980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561be8b589d0 con 0x561be8b4e980 2024-05-09T09:48:39.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.640+0000 7ff35ae01640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8b4e980 0x561be8c41410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.640+0000 7ff35ae01640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8b4e980 0x561be8c41410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:60124/0 (socket says 172.21.15.157:60124) 2024-05-09T09:48:39.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.640+0000 7ff35ae01640 1 -- 172.21.15.157:0/2842835085 learned_addr learned my addr 172.21.15.157:0/2842835085 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:39.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.644+0000 7ff35ae01640 1 -- 172.21.15.157:0/2842835085 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561be8c41950 con 0x561be8b4e980 2024-05-09T09:48:39.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.644+0000 7ff35ae01640 1 --2- 172.21.15.157:0/2842835085 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8b4e980 0x561be8c41410 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ff354019680 tx=0x7ff354019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.644+0000 7ff247606640 1 -- 172.21.15.157:0/2842835085 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3540c5070 con 0x561be8b4e980 2024-05-09T09:48:39.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.644+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2842835085 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561be8c41be0 con 0x561be8b4e980 2024-05-09T09:48:39.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.644+0000 7ff247606640 1 -- 172.21.15.157:0/2842835085 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3540b6c60 con 0x561be8b4e980 2024-05-09T09:48:39.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.644+0000 7ff247606640 1 -- 172.21.15.157:0/2842835085 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3540c1480 con 0x561be8b4e980 2024-05-09T09:48:39.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.644+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2842835085 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561be8c44870 con 0x561be8b4e980 2024-05-09T09:48:39.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.644+0000 7ff247606640 1 -- 172.21.15.157:0/2842835085 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7ff3540c8070 con 0x561be8b4e980 2024-05-09T09:48:39.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.644+0000 7ff247606640 1 --2- 172.21.15.157:0/2842835085 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff240034bb0 0x7ff240037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.644+0000 7ff247606640 1 -- 172.21.15.157:0/2842835085 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7ff3540bb070 con 0x561be8b4e980 2024-05-09T09:48:39.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.644+0000 7ff35a600640 1 --2- 172.21.15.157:0/2842835085 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff240034bb0 0x7ff240037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.644+0000 7ff35d2e6980 1 --2- 172.21.15.157:0/2842835085 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561be8b4f2a0 0x561be8c48350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.644+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2842835085 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be8c489a0 con 0x561be8b4f2a0 2024-05-09T09:48:39.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.644+0000 7ff35b602640 1 --2- 172.21.15.157:0/2842835085 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561be8b4f2a0 0x561be8c48350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.644+0000 7ff35a600640 1 --2- 172.21.15.157:0/2842835085 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff240034bb0 0x7ff240037070 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff350000f70 tx=0x7ff3500012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.644+0000 7ff35b602640 1 --2- 172.21.15.157:0/2842835085 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561be8b4f2a0 0x561be8c48350 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.644+0000 7ff35b602640 1 -- 172.21.15.157:0/2842835085 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff34c0083f0 con 0x561be8b4f2a0 2024-05-09T09:48:39.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.644+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2842835085 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be8c45a90 con 0x561be8b4f2a0 2024-05-09T09:48:39.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.644+0000 7ff35b602640 1 -- 172.21.15.157:0/2842835085 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff34c0083f0 con 0x561be8b4f2a0 2024-05-09T09:48:39.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.648+0000 7ff35d2e6980 1 --2- 172.21.15.157:0/2842835085 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561be8c4ad40 0x561be8c4d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.648+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2842835085 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be8c4d800 con 0x561be8c4ad40 2024-05-09T09:48:39.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.648+0000 7ff35ae01640 1 --2- 172.21.15.157:0/2842835085 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561be8c4ad40 0x561be8c4d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.648+0000 7ff35ae01640 1 --2- 172.21.15.157:0/2842835085 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561be8c4ad40 0x561be8c4d130 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.648+0000 7ff35ae01640 1 -- 172.21.15.157:0/2842835085 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff3540d1070 con 0x561be8c4ad40 2024-05-09T09:48:39.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.648+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2842835085 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be8c49be0 con 0x561be8b4f2a0 2024-05-09T09:48:39.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.648+0000 7ff35b602640 1 -- 172.21.15.157:0/2842835085 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff34c0083f0 con 0x561be8b4f2a0 2024-05-09T09:48:39.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.648+0000 7ff35d2e6980 1 --2- 172.21.15.157:0/2842835085 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561be8c4ec60 0x561be8c51050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.648+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2842835085 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be8c51750 con 0x561be8c4ec60 2024-05-09T09:48:39.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.648+0000 7ff35a600640 1 --2- 172.21.15.157:0/2842835085 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561be8c4ec60 0x561be8c51050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.648+0000 7ff35a600640 1 --2- 172.21.15.157:0/2842835085 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561be8c4ec60 0x561be8c51050 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.648+0000 7ff35a600640 1 -- 172.21.15.157:0/2842835085 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff35000e620 con 0x561be8c4ec60 2024-05-09T09:48:39.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.652+0000 7ff35d2e6980 1 Processor -- start 2024-05-09T09:48:39.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.652+0000 7ff35d2e6980 1 -- start start 2024-05-09T09:48:39.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.652+0000 7ff35d2e6980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8c799c0 0x561be8c79de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.652+0000 7ff35d2e6980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561be8a56020 con 0x561be8c799c0 2024-05-09T09:48:39.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.652+0000 7ff35ae01640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8c799c0 0x561be8c79de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.652+0000 7ff35ae01640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8c799c0 0x561be8c79de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:60138/0 (socket says 172.21.15.157:60138) 2024-05-09T09:48:39.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.652+0000 7ff35ae01640 1 -- 172.21.15.157:0/2266749642 learned_addr learned my addr 172.21.15.157:0/2266749642 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:39.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.652+0000 7ff35ae01640 1 -- 172.21.15.157:0/2266749642 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561be8c7a320 con 0x561be8c799c0 2024-05-09T09:48:39.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.656+0000 7ff35ae01640 1 --2- 172.21.15.157:0/2266749642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8c799c0 0x561be8c79de0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff3540e5010 tx=0x7ff354007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.656+0000 7ff23f7fe640 1 -- 172.21.15.157:0/2266749642 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3540ea070 con 0x561be8c799c0 2024-05-09T09:48:39.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.656+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2266749642 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561be8c7adb0 con 0x561be8c799c0 2024-05-09T09:48:39.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.656+0000 7ff23f7fe640 1 -- 172.21.15.157:0/2266749642 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3540e3e50 con 0x561be8c799c0 2024-05-09T09:48:39.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.656+0000 7ff23f7fe640 1 -- 172.21.15.157:0/2266749642 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3540e5c10 con 0x561be8c799c0 2024-05-09T09:48:39.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.656+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2266749642 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561be8c7b290 con 0x561be8c799c0 2024-05-09T09:48:39.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.656+0000 7ff23f7fe640 1 -- 172.21.15.157:0/2266749642 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7ff3540ed070 con 0x561be8c799c0 2024-05-09T09:48:39.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.656+0000 7ff23f7fe640 1 --2- 172.21.15.157:0/2266749642 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff234034bb0 0x7ff234037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.656+0000 7ff23f7fe640 1 -- 172.21.15.157:0/2266749642 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7ff3540de050 con 0x561be8c799c0 2024-05-09T09:48:39.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.656+0000 7ff35a600640 1 --2- 172.21.15.157:0/2266749642 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff234034bb0 0x7ff234037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.656+0000 7ff35d2e6980 1 Processor -- start 2024-05-09T09:48:39.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.656+0000 7ff35d2e6980 1 -- start start 2024-05-09T09:48:39.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.656+0000 7ff35a600640 1 --2- 172.21.15.157:0/2266749642 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff234034bb0 0x7ff234037070 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff35000bf60 tx=0x7ff35000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.656+0000 7ff35d2e6980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8c86990 0x561be8c86d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.656+0000 7ff35d2e6980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561be8c3aa00 con 0x561be8c86990 2024-05-09T09:48:39.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.656+0000 7ff35ae01640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8c86990 0x561be8c86d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.656+0000 7ff35ae01640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8c86990 0x561be8c86d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:60150/0 (socket says 172.21.15.157:60150) 2024-05-09T09:48:39.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.656+0000 7ff35ae01640 1 -- 172.21.15.157:0/1023834666 learned_addr learned my addr 172.21.15.157:0/1023834666 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:39.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.656+0000 7ff35ae01640 1 -- 172.21.15.157:0/1023834666 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561be8c87360 con 0x561be8c86990 2024-05-09T09:48:39.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.656+0000 7ff35ae01640 1 --2- 172.21.15.157:0/1023834666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8c86990 0x561be8c86d90 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff3540bff90 tx=0x7ff3540e5f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfdd3e47ccd63e85 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.656+0000 7ff23d7fa640 1 -- 172.21.15.157:0/1023834666 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3540e5710 con 0x561be8c86990 2024-05-09T09:48:39.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.656+0000 7ff23d7fa640 1 -- 172.21.15.157:0/1023834666 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3540bf370 con 0x561be8c86990 2024-05-09T09:48:39.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.660+0000 7ff23d7fa640 1 -- 172.21.15.157:0/1023834666 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3540bfa10 con 0x561be8c86990 2024-05-09T09:48:39.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.660+0000 7ff35d2e6980 1 -- 172.21.15.157:0/1023834666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8c86990 msgr2=0x561be8c86d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.660+0000 7ff35d2e6980 1 --2- 172.21.15.157:0/1023834666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8c86990 0x561be8c86d90 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff3540bff90 tx=0x7ff3540e5f20 comp rx=0 tx=0).stop 2024-05-09T09:48:39.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.660+0000 7ff35d2e6980 1 -- 172.21.15.157:0/1023834666 shutdown_connections 2024-05-09T09:48:39.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.660+0000 7ff35d2e6980 1 --2- 172.21.15.157:0/1023834666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8c86990 0x561be8c86d90 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.660+0000 7ff35d2e6980 1 -- 172.21.15.157:0/1023834666 >> 172.21.15.157:0/1023834666 conn(0x561be8c82d10 msgr2=0x561be8c80d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:39.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.660+0000 7ff35d2e6980 1 -- 172.21.15.157:0/1023834666 shutdown_connections 2024-05-09T09:48:39.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.660+0000 7ff35d2e6980 1 -- 172.21.15.157:0/1023834666 wait complete. 2024-05-09T09:48:39.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.660+0000 7ff35d2e6980 1 Processor -- start 2024-05-09T09:48:39.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.660+0000 7ff35d2e6980 1 -- start start 2024-05-09T09:48:39.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.660+0000 7ff35d2e6980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8c86990 0x561be8c8dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.660+0000 7ff35d2e6980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561be8c87a50 con 0x561be8c86990 2024-05-09T09:48:39.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.660+0000 7ff35ae01640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8c86990 0x561be8c8dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.660+0000 7ff35ae01640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8c86990 0x561be8c8dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:60162/0 (socket says 172.21.15.157:60162) 2024-05-09T09:48:39.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.660+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 learned_addr learned my addr 172.21.15.157:0/3982519256 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:39.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.660+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561be8c8e260 con 0x561be8c86990 2024-05-09T09:48:39.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.660+0000 7ff35ae01640 1 --2- 172.21.15.157:0/3982519256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8c86990 0x561be8c8dd20 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ff3540e2450 tx=0x7ff3540c4f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.660+0000 7ff22b7fe640 1 -- 172.21.15.157:0/3982519256 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff35410f020 con 0x561be8c86990 2024-05-09T09:48:39.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.660+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561be8c8e260 con 0x561be8c86990 2024-05-09T09:48:39.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.660+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561be8c8e260 con 0x561be8c86990 2024-05-09T09:48:39.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.660+0000 7ff22b7fe640 1 -- 172.21.15.157:0/3982519256 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3540c0a90 con 0x561be8c86990 2024-05-09T09:48:39.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.660+0000 7ff22b7fe640 1 -- 172.21.15.157:0/3982519256 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3540c0c40 con 0x561be8c86990 2024-05-09T09:48:39.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff22b7fe640 1 -- 172.21.15.157:0/3982519256 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7ff354112020 con 0x561be8c86990 2024-05-09T09:48:39.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff22b7fe640 1 --2- 172.21.15.157:0/3982519256 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff224034bb0 0x7ff224037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff22b7fe640 1 -- 172.21.15.157:0/3982519256 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7ff354118a40 con 0x561be8c86990 2024-05-09T09:48:39.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff35a600640 1 --2- 172.21.15.157:0/3982519256 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff224034bb0 0x7ff224037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff35d2e6980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff35d2e6980 1 --2- 172.21.15.157:0/3982519256 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561be8c9a880 0x561be8c9cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9d490 con 0x561be8c9a880 2024-05-09T09:48:39.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff35b602640 1 --2- 172.21.15.157:0/3982519256 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561be8c9a880 0x561be8c9cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff35a600640 1 --2- 172.21.15.157:0/3982519256 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff224034bb0 0x7ff224037070 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x561be8c492f0 tx=0x7ff350010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff35b602640 1 --2- 172.21.15.157:0/3982519256 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561be8c9a880 0x561be8c9cd40 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff34c0083f0 con 0x561be8c9a880 2024-05-09T09:48:39.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff35d2e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff35d2e6980 20 realm 2024-05-09T09:48:39.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff35d2e6980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9d8a0 con 0x561be8c9a880 2024-05-09T09:48:39.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff34c0083f0 con 0x561be8c9a880 2024-05-09T09:48:39.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff35d2e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff35d2e6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:48:39.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff35d2e6980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e170 con 0x561be8c9a880 2024-05-09T09:48:39.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff34c0083f0 con 0x561be8c9a880 2024-05-09T09:48:39.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff35d2e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff35d2e6980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x561be8c9a880 2024-05-09T09:48:39.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff34c0083f0 con 0x561be8c9a880 2024-05-09T09:48:39.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff35d2e6980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:39.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff35d2e6980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff35d2e6980 1 --2- 172.21.15.157:0/3982519256 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561be8c9f270 0x561be8ca1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be8ca1c70 con 0x561be8c9f270 2024-05-09T09:48:39.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff35ae01640 1 --2- 172.21.15.157:0/3982519256 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561be8c9f270 0x561be8ca1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.664+0000 7ff35ae01640 1 --2- 172.21.15.157:0/3982519256 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561be8c9f270 0x561be8ca1660 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.668+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.668+0000 7ff35d2e6980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:48:39.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.668+0000 7ff35d2e6980 20 searching for the correct realm 2024-05-09T09:48:39.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.668+0000 7ff35d2e6980 1 --2- 172.21.15.157:0/3982519256 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561be8ca3bc0 0x561be8ca5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.668+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8ca66a0 con 0x561be8ca3bc0 2024-05-09T09:48:39.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.668+0000 7ff35a600640 1 --2- 172.21.15.157:0/3982519256 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561be8ca3bc0 0x561be8ca5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.668+0000 7ff35a600640 1 --2- 172.21.15.157:0/3982519256 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561be8ca3bc0 0x561be8ca5fd0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.668+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35000e620 con 0x561be8ca3bc0 2024-05-09T09:48:39.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.668+0000 7ff35a600640 1 --2- 172.21.15.157:0/3982519256 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7ff350037040 0x7ff350036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.668+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8ca66a0 con 0x7ff350037040 2024-05-09T09:48:39.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.668+0000 7ff35b602640 1 --2- 172.21.15.157:0/3982519256 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7ff350037040 0x7ff350036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.668+0000 7ff35b602640 1 --2- 172.21.15.157:0/3982519256 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7ff350037040 0x7ff350036410 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.668+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34c0083f0 con 0x7ff350037040 2024-05-09T09:48:39.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.668+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x561be8c9f270 2024-05-09T09:48:39.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.668+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.668+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x561be8c9a880 2024-05-09T09:48:39.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.668+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34c0083f0 con 0x561be8c9a880 2024-05-09T09:48:39.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.668+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x561be8c9a880 2024-05-09T09:48:39.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.668+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34c026040 con 0x561be8c9a880 2024-05-09T09:48:39.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.668+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x561be8c9f270 2024-05-09T09:48:39.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.672+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.672+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x561be8c9f270 2024-05-09T09:48:39.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.672+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.672+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x7ff350037040 2024-05-09T09:48:39.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.672+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34c026040 con 0x7ff350037040 2024-05-09T09:48:39.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.672+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x561be8ca3bc0 2024-05-09T09:48:39.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.672+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35000e620 con 0x561be8ca3bc0 2024-05-09T09:48:39.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.672+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x561be8c9a880 2024-05-09T09:48:39.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.672+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34c026040 con 0x561be8c9a880 2024-05-09T09:48:39.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.672+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x561be8c9f270 2024-05-09T09:48:39.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.672+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.672+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x561be8c9a880 2024-05-09T09:48:39.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.672+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34c026040 con 0x561be8c9a880 2024-05-09T09:48:39.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.672+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x7ff350037040 2024-05-09T09:48:39.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.672+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff34c026040 con 0x7ff350037040 2024-05-09T09:48:39.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.672+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x561be8ca3bc0 2024-05-09T09:48:39.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.676+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35000e620 con 0x561be8ca3bc0 2024-05-09T09:48:39.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.676+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x561be8ca3bc0 2024-05-09T09:48:39.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.676+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff35000e620 con 0x561be8ca3bc0 2024-05-09T09:48:39.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.676+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x561be8c9f270 2024-05-09T09:48:39.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.676+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.676+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x561be8ca3bc0 2024-05-09T09:48:39.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.676+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35000e620 con 0x561be8ca3bc0 2024-05-09T09:48:39.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.676+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x561be8ca3bc0 2024-05-09T09:48:39.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.676+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35000e620 con 0x561be8ca3bc0 2024-05-09T09:48:39.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.676+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x561be8c9a880 2024-05-09T09:48:39.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.676+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34c026040 con 0x561be8c9a880 2024-05-09T09:48:39.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.676+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x561be8c9a880 2024-05-09T09:48:39.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.676+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff34c026040 con 0x561be8c9a880 2024-05-09T09:48:39.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.676+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x561be8c9f270 2024-05-09T09:48:39.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.676+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.676+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x561be8ca3bc0 2024-05-09T09:48:39.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.676+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35000e620 con 0x561be8ca3bc0 2024-05-09T09:48:39.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.676+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x7ff350037040 2024-05-09T09:48:39.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.680+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34c026040 con 0x7ff350037040 2024-05-09T09:48:39.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.680+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x561be8c9a880 2024-05-09T09:48:39.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.680+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34c026040 con 0x561be8c9a880 2024-05-09T09:48:39.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.680+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x561be8c9f270 2024-05-09T09:48:39.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.680+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.680+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x561be8ca3bc0 2024-05-09T09:48:39.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.680+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35000e620 con 0x561be8ca3bc0 2024-05-09T09:48:39.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.680+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x561be8c9f270 2024-05-09T09:48:39.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.680+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.680+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x7ff350037040 2024-05-09T09:48:39.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.680+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34c026040 con 0x7ff350037040 2024-05-09T09:48:39.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.680+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x561be8ca3bc0 2024-05-09T09:48:39.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.680+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35000e620 con 0x561be8ca3bc0 2024-05-09T09:48:39.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.680+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x561be8c9f270 2024-05-09T09:48:39.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.680+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.680+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x561be8c9a880 2024-05-09T09:48:39.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff34c026040 con 0x561be8c9a880 2024-05-09T09:48:39.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be8c9e510 con 0x7ff350037040 2024-05-09T09:48:39.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34c026040 con 0x7ff350037040 2024-05-09T09:48:39.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:48:39.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:48:39.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:48:39.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:48:39.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:48:39.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:48:39.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be8ca2530 con 0x561be8c9a880 2024-05-09T09:48:39.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff34c026040 con 0x561be8c9a880 2024-05-09T09:48:39.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be8ca2530 con 0x561be8c9a880 2024-05-09T09:48:39.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff34c026040 con 0x561be8c9a880 2024-05-09T09:48:39.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:39.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be8ca2530 con 0x561be8ca3bc0 2024-05-09T09:48:39.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff35000e620 con 0x561be8ca3bc0 2024-05-09T09:48:39.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:48:39.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 20 zone default found 2024-05-09T09:48:39.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 4 Realm: () 2024-05-09T09:48:39.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:48:39.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:48:39.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:48:39.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 20 zonegroup default 2024-05-09T09:48:39.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be8ca2f30 con 0x561be8c9f270 2024-05-09T09:48:39.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be8ca2ac0 con 0x561be8ca3bc0 2024-05-09T09:48:39.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff35000e620 con 0x561be8ca3bc0 2024-05-09T09:48:39.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be8ca8a80 con 0x561be8ca3bc0 2024-05-09T09:48:39.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff35000e620 con 0x561be8ca3bc0 2024-05-09T09:48:39.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 20 started sync module instance, tier type = 2024-05-09T09:48:39.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:48:39.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.684+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8ca7e40 con 0x7ff350037040 2024-05-09T09:48:39.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.688+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34c026040 con 0x7ff350037040 2024-05-09T09:48:39.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.688+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94677869691744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8ca7e40 con 0x7ff350037040 2024-05-09T09:48:39.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.688+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8ca9560 con 0x561be8c9a880 2024-05-09T09:48:39.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.688+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94677869691744] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34c036040 con 0x7ff350037040 2024-05-09T09:48:39.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.688+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34c036040 con 0x561be8c9a880 2024-05-09T09:48:39.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.688+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94677869695056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8ca7e40 con 0x561be8c9a880 2024-05-09T09:48:39.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.688+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8ca9fa0 con 0x561be8ca3bc0 2024-05-09T09:48:39.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.692+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35000e620 con 0x561be8ca3bc0 2024-05-09T09:48:39.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.692+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94677869695056] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34c036040 con 0x561be8c9a880 2024-05-09T09:48:39.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.692+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94677869689232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8ca7db0 con 0x561be8ca3bc0 2024-05-09T09:48:39.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.692+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8caad50 con 0x7ff350037040 2024-05-09T09:48:39.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.692+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34c036040 con 0x7ff350037040 2024-05-09T09:48:39.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.692+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94677869701184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cab5f0 con 0x7ff350037040 2024-05-09T09:48:39.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.692+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cabff0 con 0x561be8c9a880 2024-05-09T09:48:39.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.692+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94677869689232] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35000e620 con 0x561be8ca3bc0 2024-05-09T09:48:39.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.692+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94677869701184] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34c036040 con 0x7ff350037040 2024-05-09T09:48:39.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.696+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34c036040 con 0x561be8c9a880 2024-05-09T09:48:39.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.696+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94677869699984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cab0c0 con 0x561be8c9a880 2024-05-09T09:48:39.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.696+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cac890 con 0x561be8c9f270 2024-05-09T09:48:39.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.696+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94677869699984] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34c036040 con 0x561be8c9a880 2024-05-09T09:48:39.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.696+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.696+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94677869708256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cab0c0 con 0x561be8c9f270 2024-05-09T09:48:39.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.696+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cad0e0 con 0x561be8c9f270 2024-05-09T09:48:39.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.700+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.700+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94677869712512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cadd50 con 0x561be8c9f270 2024-05-09T09:48:39.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.700+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cae710 con 0x561be8c9f270 2024-05-09T09:48:39.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.700+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94677869708256] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.700+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.700+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94677869705984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cae710 con 0x561be8c9f270 2024-05-09T09:48:39.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.700+0000 7ff35d2e6980 20 add_watcher() i=0 2024-05-09T09:48:39.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.700+0000 7ff35d2e6980 20 add_watcher() i=1 2024-05-09T09:48:39.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.700+0000 7ff35d2e6980 20 add_watcher() i=2 2024-05-09T09:48:39.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.700+0000 7ff35d2e6980 20 add_watcher() i=3 2024-05-09T09:48:39.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.700+0000 7ff35d2e6980 20 add_watcher() i=4 2024-05-09T09:48:39.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.700+0000 7ff35d2e6980 20 add_watcher() i=5 2024-05-09T09:48:39.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.700+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94677869712512] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.700+0000 7ff35d2e6980 20 add_watcher() i=6 2024-05-09T09:48:39.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.704+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94677869705984] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.704+0000 7ff35d2e6980 20 add_watcher() i=7 2024-05-09T09:48:39.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.704+0000 7ff35d2e6980 2 all 8 watchers are set, enabling cache 2024-05-09T09:48:39.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.704+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be8cad8a0 con 0x561be8c9a880 2024-05-09T09:48:39.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.704+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff34c036040 con 0x561be8c9a880 2024-05-09T09:48:39.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.704+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94677869713568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8caeb80 con 0x561be8c9a880 2024-05-09T09:48:39.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.704+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94677869713568] v32'375 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff34c036040 con 0x561be8c9a880 2024-05-09T09:48:39.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.704+0000 7ff20b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:39.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.704+0000 7ff35d2e6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:48:39.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.704+0000 7ff35d2e6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:48:39.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.704+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cb9fb0 con 0x561be8c9a880 2024-05-09T09:48:39.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.708+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'88 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff34c036040 con 0x561be8c9a880 2024-05-09T09:48:39.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.708+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cba600 con 0x561be8c9f270 2024-05-09T09:48:39.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.708+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'82 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.708+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cba600 con 0x561be8ca3bc0 2024-05-09T09:48:39.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.712+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'81 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff35000e620 con 0x561be8ca3bc0 2024-05-09T09:48:39.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.712+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cbac30 con 0x561be8c9a880 2024-05-09T09:48:39.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.712+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'376 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff34c036040 con 0x561be8c9a880 2024-05-09T09:48:39.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.712+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cbb0e0 con 0x7ff350037040 2024-05-09T09:48:39.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.712+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'233 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff34c036040 con 0x7ff350037040 2024-05-09T09:48:39.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.712+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cb7f10 con 0x561be8ca3bc0 2024-05-09T09:48:39.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.716+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'156 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff35000e620 con 0x561be8ca3bc0 2024-05-09T09:48:39.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.716+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cb7f10 con 0x561be8c9a880 2024-05-09T09:48:39.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.716+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'83 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff34c036040 con 0x561be8c9a880 2024-05-09T09:48:39.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.716+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cbbc40 con 0x561be8c9f270 2024-05-09T09:48:39.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.720+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'155 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.720+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cbbc40 con 0x7ff350037040 2024-05-09T09:48:39.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.720+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'81 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff34c036040 con 0x7ff350037040 2024-05-09T09:48:39.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.720+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cbbc40 con 0x561be8ca3bc0 2024-05-09T09:48:39.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.724+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'87 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff35000e620 con 0x561be8ca3bc0 2024-05-09T09:48:39.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.724+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cbc0f0 con 0x7ff350037040 2024-05-09T09:48:39.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.724+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'234 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff34c036040 con 0x7ff350037040 2024-05-09T09:48:39.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.724+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cbc0f0 con 0x561be8c9f270 2024-05-09T09:48:39.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.728+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'85 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.728+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cbc0f0 con 0x7ff350037040 2024-05-09T09:48:39.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.728+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'81 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff34c036040 con 0x7ff350037040 2024-05-09T09:48:39.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.728+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cbc0f0 con 0x561be8c9f270 2024-05-09T09:48:39.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.732+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'161 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.732+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cbc0f0 con 0x561be8c9a880 2024-05-09T09:48:39.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.732+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'377 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff34c036040 con 0x561be8c9a880 2024-05-09T09:48:39.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.732+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cbc0f0 con 0x561be8ca3bc0 2024-05-09T09:48:39.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.736+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'227 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff35000e620 con 0x561be8ca3bc0 2024-05-09T09:48:39.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.736+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cbc0f0 con 0x7ff350037040 2024-05-09T09:48:39.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.736+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'235 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff34c036040 con 0x7ff350037040 2024-05-09T09:48:39.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.736+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cbc0f0 con 0x561be8ca3bc0 2024-05-09T09:48:39.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.740+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'81 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff35000e620 con 0x561be8ca3bc0 2024-05-09T09:48:39.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.740+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cbc0f0 con 0x561be8c9a880 2024-05-09T09:48:39.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.740+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'89 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff34c036040 con 0x561be8c9a880 2024-05-09T09:48:39.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.740+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cbc0f0 con 0x561be8c9a880 2024-05-09T09:48:39.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.744+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'378 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff34c036040 con 0x561be8c9a880 2024-05-09T09:48:39.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.744+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cbc0f0 con 0x561be8ca3bc0 2024-05-09T09:48:39.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.744+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'228 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff35000e620 con 0x561be8ca3bc0 2024-05-09T09:48:39.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.744+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cbc180 con 0x7ff350037040 2024-05-09T09:48:39.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.748+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'93 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff34c036040 con 0x7ff350037040 2024-05-09T09:48:39.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.748+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cbc180 con 0x561be8ca3bc0 2024-05-09T09:48:39.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.748+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'83 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff35000e620 con 0x561be8ca3bc0 2024-05-09T09:48:39.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.748+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cbc180 con 0x561be8ca3bc0 2024-05-09T09:48:39.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.748+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'87 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff35000e620 con 0x561be8ca3bc0 2024-05-09T09:48:39.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.748+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cbc180 con 0x561be8ca3bc0 2024-05-09T09:48:39.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.752+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'78 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff35000e620 con 0x561be8ca3bc0 2024-05-09T09:48:39.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.752+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cbc180 con 0x561be8ca3bc0 2024-05-09T09:48:39.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.752+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'157 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff35000e620 con 0x561be8ca3bc0 2024-05-09T09:48:39.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.752+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cbc180 con 0x561be8c9f270 2024-05-09T09:48:39.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.756+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'83 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.756+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cbc180 con 0x561be8ca3bc0 2024-05-09T09:48:39.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.756+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'81 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff35000e620 con 0x561be8ca3bc0 2024-05-09T09:48:39.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.756+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cbc1c0 con 0x561be8c9f270 2024-05-09T09:48:39.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.760+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'156 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.760+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cbc180 con 0x561be8ca3bc0 2024-05-09T09:48:39.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.760+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'229 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff35000e620 con 0x561be8ca3bc0 2024-05-09T09:48:39.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.760+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cbc180 con 0x561be8c9f270 2024-05-09T09:48:39.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.764+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'162 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.764+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cbc180 con 0x7ff350037040 2024-05-09T09:48:39.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.768+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'87 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff34c036040 con 0x7ff350037040 2024-05-09T09:48:39.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.768+0000 7ff20a7fc640 20 reqs_thread_entry: start 2024-05-09T09:48:39.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.768+0000 7ff35d2e6980 20 init_complete bucket index max shards: 11 2024-05-09T09:48:39.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.768+0000 7ff17bfff640 20 reqs_thread_entry: start 2024-05-09T09:48:39.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.768+0000 7ff35d2e6980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-05-09T09:48:39.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.768+0000 7ff35d2e6980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.768+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be8cd7cf0 con 0x561be8c9f270 2024-05-09T09:48:39.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.768+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.768+0000 7ff35d2e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.768+0000 7ff35d2e6980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-05-09T09:48:39.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.768+0000 7ff35d2e6980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-05-09T09:48:39.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.768+0000 7ff35d2e6980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-05-09T09:48:39.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.768+0000 7ff35d2e6980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.768+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be8cb64d0 con 0x561be8c9a880 2024-05-09T09:48:39.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.772+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(95 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7ff34c036040 con 0x561be8c9a880 2024-05-09T09:48:39.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.772+0000 7ff35d2e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.772+0000 7ff35d2e6980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-05-09T09:48:39.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.772+0000 7ff35d2e6980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-09T09:48:39.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.772+0000 7ff35d2e6980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-05-09T09:48:39.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.772+0000 7ff35d2e6980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-05-09T09:48:39.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.772+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:96 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cb6d70 con 0x561be8c9f270 2024-05-09T09:48:39.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.772+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(96 bar [delete,create,call,writefull 0~380] v32'4 uv4 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.772+0000 7ff35d2e6980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-05-09T09:48:39.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.772+0000 7ff35d2e6980 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-05-09T09:48:39.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.772+0000 7ff35d2e6980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-05-09T09:48:39.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.772+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:97 7.9 7:93e5b521:::notify.7:head [notify cookie 94677869750464 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be8cdb220 con 0x561be8c9f270 2024-05-09T09:48:39.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.776+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== watch-notify(notify (1) cookie 94677869705984 notify 137438953503 ret 0) ==== 598+0+0 (crc 0 0 0) 0x561be8cd7a50 con 0x561be8c9f270 2024-05-09T09:48:39.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.776+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(97 notify.7 [notify cookie 94677869750464 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.776+0000 7ff23d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953503 cookie 94677869705984 notifier 4733 bl.length()=556 2024-05-09T09:48:39.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.776+0000 7ff23d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-05-09T09:48:39.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.776+0000 7ff23d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-05-09T09:48:39.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.776+0000 7ff23d7fa640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7ff21c0056c0 con 0x561be8c9f270 2024-05-09T09:48:39.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.776+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(98 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.776+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== watch-notify(notify_complete (2) cookie 94677869750464 notify 137438953503 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561be8c7a320 con 0x561be8c9f270 2024-05-09T09:48:39.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.776+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:99 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cb6d40 con 0x561be8c9a880 2024-05-09T09:48:39.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.776+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(99 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7ff34c036040 con 0x561be8c9a880 2024-05-09T09:48:39.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.776+0000 7ff35d2e6980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-05-09T09:48:39.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.776+0000 7ff35d2e6980 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-09T09:48:39.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.776+0000 7ff35d2e6980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-05-09T09:48:39.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.776+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [notify cookie 94677869750416 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be8cb6cb0 con 0x561be8c9f270 2024-05-09T09:48:39.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.780+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== watch-notify(notify (1) cookie 94677869708256 notify 137438953504 ret 0) ==== 219+0+0 (crc 0 0 0) 0x561be8c7a320 con 0x561be8c9f270 2024-05-09T09:48:39.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.780+0000 7ff23d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953504 cookie 94677869708256 notifier 4733 bl.length()=177 2024-05-09T09:48:39.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.780+0000 7ff23d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-05-09T09:48:39.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.780+0000 7ff23d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-09T09:48:39.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.780+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 32 ==== osd_op_reply(100 notify.5 [notify cookie 94677869750416 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.780+0000 7ff23d7fa640 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7ff21c0056c0 con 0x561be8c9f270 2024-05-09T09:48:39.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.780+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 33 ==== osd_op_reply(101 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.780+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 34 ==== watch-notify(notify_complete (2) cookie 94677869750416 notify 137438953504 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561be8c44870 con 0x561be8c9f270 2024-05-09T09:48:39.783 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-05-09T09:48:39.776600Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:48:39.776575Z","tags":[],"group_ids":[]} 2024-05-09T09:48:39.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.780+0000 7ff20b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:39.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.780+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94677869713568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cb6ca0 con 0x561be8c9a880 2024-05-09T09:48:39.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.784+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(102 data_loggenerations_metadata [watch unwatch cookie 94677869713568] v32'379 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff34c036040 con 0x561be8c9a880 2024-05-09T09:48:39.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.784+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:103 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94677869691744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cb6ca0 con 0x7ff350037040 2024-05-09T09:48:39.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.784+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(103 notify.0 [watch unwatch cookie 94677869691744] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34c036040 con 0x7ff350037040 2024-05-09T09:48:39.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.784+0000 7ff35d2e6980 20 remove_watcher() i=0 2024-05-09T09:48:39.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.784+0000 7ff35d2e6980 2 removed watcher, disabling cache 2024-05-09T09:48:39.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.784+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:104 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94677869695056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cb6ca0 con 0x561be8c9a880 2024-05-09T09:48:39.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.788+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(104 notify.1 [watch unwatch cookie 94677869695056] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34c036040 con 0x561be8c9a880 2024-05-09T09:48:39.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.788+0000 7ff35d2e6980 20 remove_watcher() i=1 2024-05-09T09:48:39.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.788+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:105 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94677869689232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cb6ca0 con 0x561be8ca3bc0 2024-05-09T09:48:39.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.788+0000 7ff35a600640 1 -- 172.21.15.157:0/3982519256 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(105 notify.2 [watch unwatch cookie 94677869689232] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35000e620 con 0x561be8ca3bc0 2024-05-09T09:48:39.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.788+0000 7ff35d2e6980 20 remove_watcher() i=2 2024-05-09T09:48:39.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.788+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:106 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94677869701184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cb6ca0 con 0x7ff350037040 2024-05-09T09:48:39.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.792+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(106 notify.3 [watch unwatch cookie 94677869701184] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34c036040 con 0x7ff350037040 2024-05-09T09:48:39.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.792+0000 7ff35d2e6980 20 remove_watcher() i=3 2024-05-09T09:48:39.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.792+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94677869699984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cb6ca0 con 0x561be8c9a880 2024-05-09T09:48:39.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.792+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(107 notify.4 [watch unwatch cookie 94677869699984] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34c036040 con 0x561be8c9a880 2024-05-09T09:48:39.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.792+0000 7ff35d2e6980 20 remove_watcher() i=4 2024-05-09T09:48:39.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.792+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:108 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94677869708256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cb6ca0 con 0x561be8c9f270 2024-05-09T09:48:39.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.796+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 35 ==== osd_op_reply(108 notify.5 [watch unwatch cookie 94677869708256] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.796+0000 7ff35d2e6980 20 remove_watcher() i=5 2024-05-09T09:48:39.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.796+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:109 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94677869712512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cb6ca0 con 0x561be8c9f270 2024-05-09T09:48:39.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.796+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 36 ==== osd_op_reply(109 notify.6 [watch unwatch cookie 94677869712512] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.796+0000 7ff35d2e6980 20 remove_watcher() i=6 2024-05-09T09:48:39.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.796+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:110 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94677869705984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be8cb6ca0 con 0x561be8c9f270 2024-05-09T09:48:39.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35ae01640 1 -- 172.21.15.157:0/3982519256 <== osd.0 v2:172.21.15.110:6800/231209037 37 ==== osd_op_reply(110 notify.7 [watch unwatch cookie 94677869705984] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35411d040 con 0x561be8c9f270 2024-05-09T09:48:39.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35d2e6980 20 remove_watcher() i=7 2024-05-09T09:48:39.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561be8c9f270 msgr2=0x561be8ca1660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35d2e6980 1 --2- 172.21.15.157:0/3982519256 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561be8c9f270 0x561be8ca1660 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561be8c9a880 msgr2=0x561be8c9cd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35d2e6980 1 --2- 172.21.15.157:0/3982519256 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561be8c9a880 0x561be8c9cd40 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7ff350037040 msgr2=0x7ff350036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35d2e6980 1 --2- 172.21.15.157:0/3982519256 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7ff350037040 0x7ff350036410 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561be8ca3bc0 msgr2=0x561be8ca5fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35d2e6980 1 --2- 172.21.15.157:0/3982519256 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561be8ca3bc0 0x561be8ca5fd0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff224034bb0 msgr2=0x7ff224037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35d2e6980 1 --2- 172.21.15.157:0/3982519256 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff224034bb0 0x7ff224037070 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x561be8c492f0 tx=0x7ff350010000 comp rx=0 tx=0).stop 2024-05-09T09:48:39.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8c86990 msgr2=0x561be8c8dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35d2e6980 1 --2- 172.21.15.157:0/3982519256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8c86990 0x561be8c8dd20 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ff3540e2450 tx=0x7ff3540c4f60 comp rx=0 tx=0).stop 2024-05-09T09:48:39.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35b602640 1 -- 172.21.15.157:0/3982519256 reap_dead start 2024-05-09T09:48:39.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 shutdown_connections 2024-05-09T09:48:39.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35d2e6980 1 --2- 172.21.15.157:0/3982519256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8c86990 0x561be8c8dd20 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 >> 172.21.15.157:0/3982519256 conn(0x561be8c82d10 msgr2=0x561be8c80370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:39.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 shutdown_connections 2024-05-09T09:48:39.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35d2e6980 1 -- 172.21.15.157:0/3982519256 wait complete. 2024-05-09T09:48:39.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2266749642 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff234034bb0 msgr2=0x7ff234037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35d2e6980 1 --2- 172.21.15.157:0/2266749642 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff234034bb0 0x7ff234037070 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff35000bf60 tx=0x7ff35000f000 comp rx=0 tx=0).stop 2024-05-09T09:48:39.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2266749642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8c799c0 msgr2=0x561be8c79de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35d2e6980 1 --2- 172.21.15.157:0/2266749642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8c799c0 0x561be8c79de0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff3540e5010 tx=0x7ff354007b00 comp rx=0 tx=0).stop 2024-05-09T09:48:39.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2266749642 shutdown_connections 2024-05-09T09:48:39.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35d2e6980 1 --2- 172.21.15.157:0/2266749642 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff234034bb0 0x7ff234037070 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35d2e6980 1 --2- 172.21.15.157:0/2266749642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8c799c0 0x561be8c79de0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2266749642 >> 172.21.15.157:0/2266749642 conn(0x561be8ac3550 msgr2=0x561be8ac3950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:39.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2266749642 shutdown_connections 2024-05-09T09:48:39.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.800+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2266749642 wait complete. 2024-05-09T09:48:39.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.804+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2842835085 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561be8c4ad40 msgr2=0x561be8c4d130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.804+0000 7ff35d2e6980 1 --2- 172.21.15.157:0/2842835085 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561be8c4ad40 0x561be8c4d130 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.804+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2842835085 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561be8b4f2a0 msgr2=0x561be8c48350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.804+0000 7ff35d2e6980 1 --2- 172.21.15.157:0/2842835085 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561be8b4f2a0 0x561be8c48350 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.804+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2842835085 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561be8c4ec60 msgr2=0x561be8c51050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.804+0000 7ff35d2e6980 1 --2- 172.21.15.157:0/2842835085 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561be8c4ec60 0x561be8c51050 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.804+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2842835085 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff240034bb0 msgr2=0x7ff240037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.804+0000 7ff35d2e6980 1 --2- 172.21.15.157:0/2842835085 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff240034bb0 0x7ff240037070 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff350000f70 tx=0x7ff3500012c0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.804+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2842835085 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8b4e980 msgr2=0x561be8c41410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.804+0000 7ff35d2e6980 1 --2- 172.21.15.157:0/2842835085 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561be8b4e980 0x561be8c41410 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ff354019680 tx=0x7ff354019810 comp rx=0 tx=0).stop 2024-05-09T09:48:39.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.804+0000 7ff35b602640 1 -- 172.21.15.157:0/2842835085 reap_dead start 2024-05-09T09:48:39.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.804+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2842835085 shutdown_connections 2024-05-09T09:48:39.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.804+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2842835085 >> 172.21.15.157:0/2842835085 conn(0x561be8b4a250 msgr2=0x561be8c34a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:39.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.804+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2842835085 shutdown_connections 2024-05-09T09:48:39.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.804+0000 7ff35d2e6980 1 -- 172.21.15.157:0/2842835085 wait complete. 2024-05-09T09:48:39.818 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-05-09T09:48:39.776600Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:48:39.776575Z', 'tags': [], 'group_ids': []} 2024-05-09T09:48:39.836 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-05-09T09:48:39.845 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-05-09T09:48:39.845 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-05-09T09:48:39.845 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-05-09T09:48:39.845 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-05-09T09:48:39.882 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:48:39.883 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:48:39.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.880+0000 7f54c0012980 1 Processor -- start 2024-05-09T09:48:39.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.880+0000 7f54c0012980 1 -- start start 2024-05-09T09:48:39.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.880+0000 7f54c0012980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x555ab2b1fac0 0x555ab2bae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.880+0000 7f54c0012980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555ab2a61440 con 0x555ab2baeb00 2024-05-09T09:48:39.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.880+0000 7f54c0012980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x555ab2a4c5f0 con 0x555ab2b1fac0 2024-05-09T09:48:39.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.880+0000 7f54bdb2d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x555ab2b1fac0 0x555ab2bae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.880+0000 7f54bd32c640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x555ab2baeb00 0x555ab2bb0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:49196/0 (socket says 172.21.15.157:49196) 2024-05-09T09:48:39.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.880+0000 7f54bd32c640 1 -- 172.21.15.157:0/782301047 learned_addr learned my addr 172.21.15.157:0/782301047 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:48:39.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.880+0000 7f54bdb2d640 1 -- 172.21.15.157:0/782301047 >> v1:172.21.15.110:6789/0 conn(0x555ab2baeb00 legacy=0x555ab2bb0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.880+0000 7f54bdb2d640 1 -- 172.21.15.157:0/782301047 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ab2a57990 con 0x555ab2b1fac0 2024-05-09T09:48:39.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.884+0000 7f54bdb2d640 1 --2- 172.21.15.157:0/782301047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2b1fac0 0x555ab2bae5c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f54b000a420 tx=0x7f54b001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378066113f5931ca server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.884+0000 7f54bcb2b640 1 -- 172.21.15.157:0/782301047 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54b00af070 con 0x555ab2b1fac0 2024-05-09T09:48:39.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.884+0000 7f54bcb2b640 1 -- 172.21.15.157:0/782301047 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54b00aa530 con 0x555ab2b1fac0 2024-05-09T09:48:39.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.884+0000 7f54bcb2b640 1 -- 172.21.15.157:0/782301047 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54b00aa850 con 0x555ab2b1fac0 2024-05-09T09:48:39.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.884+0000 7f54c0012980 1 -- 172.21.15.157:0/782301047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2b1fac0 msgr2=0x555ab2bae5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.884+0000 7f54c0012980 1 --2- 172.21.15.157:0/782301047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2b1fac0 0x555ab2bae5c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f54b000a420 tx=0x7f54b001afd0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.884+0000 7f54c0012980 1 -- 172.21.15.157:0/782301047 shutdown_connections 2024-05-09T09:48:39.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.884+0000 7f54c0012980 1 --2- 172.21.15.157:0/782301047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2b1fac0 0x555ab2bae5c0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.884+0000 7f54c0012980 1 -- 172.21.15.157:0/782301047 >> 172.21.15.157:0/782301047 conn(0x555ab2ba60e0 msgr2=0x555ab2ba8500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:39.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.884+0000 7f54c0012980 1 -- 172.21.15.157:0/782301047 shutdown_connections 2024-05-09T09:48:39.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.884+0000 7f54c0012980 1 -- 172.21.15.157:0/782301047 wait complete. 2024-05-09T09:48:39.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.900+0000 7f54c0012980 1 Processor -- start 2024-05-09T09:48:39.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.900+0000 7f54c0012980 1 -- start start 2024-05-09T09:48:39.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.900+0000 7f54c0012980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2b1fac0 0x555ab2c96b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.900+0000 7f54c0012980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x555ab2aaefe0 con 0x555ab2b1fac0 2024-05-09T09:48:39.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.900+0000 7f54bdb2d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2b1fac0 0x555ab2c96b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.900+0000 7f54bdb2d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2b1fac0 0x555ab2c96b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:60184/0 (socket says 172.21.15.157:60184) 2024-05-09T09:48:39.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.900+0000 7f54bdb2d640 1 -- 172.21.15.157:0/345178340 learned_addr learned my addr 172.21.15.157:0/345178340 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:39.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.900+0000 7f54bdb2d640 1 -- 172.21.15.157:0/345178340 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ab2a33ae0 con 0x555ab2b1fac0 2024-05-09T09:48:39.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.904+0000 7f54bdb2d640 1 --2- 172.21.15.157:0/345178340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2b1fac0 0x555ab2c96b60 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f54b00ad040 tx=0x7f54b00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d18ea95294660b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.904+0000 7f53abe07640 1 -- 172.21.15.157:0/345178340 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54b00af050 con 0x555ab2b1fac0 2024-05-09T09:48:39.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.904+0000 7f53abe07640 1 -- 172.21.15.157:0/345178340 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54b00b0040 con 0x555ab2b1fac0 2024-05-09T09:48:39.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.904+0000 7f53abe07640 1 -- 172.21.15.157:0/345178340 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54b00aaad0 con 0x555ab2b1fac0 2024-05-09T09:48:39.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.904+0000 7f54c0012980 1 -- 172.21.15.157:0/345178340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2b1fac0 msgr2=0x555ab2c96b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.904+0000 7f54c0012980 1 --2- 172.21.15.157:0/345178340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2b1fac0 0x555ab2c96b60 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f54b00ad040 tx=0x7f54b00033b0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.904+0000 7f54c0012980 1 -- 172.21.15.157:0/345178340 shutdown_connections 2024-05-09T09:48:39.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.904+0000 7f54c0012980 1 --2- 172.21.15.157:0/345178340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2b1fac0 0x555ab2c96b60 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.904+0000 7f54c0012980 1 -- 172.21.15.157:0/345178340 >> 172.21.15.157:0/345178340 conn(0x555ab2ba60e0 msgr2=0x555ab2c926f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:39.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.904+0000 7f54c0012980 1 -- 172.21.15.157:0/345178340 shutdown_connections 2024-05-09T09:48:39.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.904+0000 7f54c0012980 1 -- 172.21.15.157:0/345178340 wait complete. 2024-05-09T09:48:39.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.904+0000 7f54c0012980 1 Processor -- start 2024-05-09T09:48:39.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.904+0000 7f54c0012980 1 -- start start 2024-05-09T09:48:39.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.904+0000 7f54c0012980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2b1fac0 0x555ab2c9dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.904+0000 7f54c0012980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x555ab2bb3120 con 0x555ab2b1fac0 2024-05-09T09:48:39.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.904+0000 7f54bdb2d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2b1fac0 0x555ab2c9dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.904+0000 7f54bdb2d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2b1fac0 0x555ab2c9dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:60194/0 (socket says 172.21.15.157:60194) 2024-05-09T09:48:39.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.904+0000 7f54bdb2d640 1 -- 172.21.15.157:0/901331196 learned_addr learned my addr 172.21.15.157:0/901331196 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:39.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.904+0000 7f54bdb2d640 1 -- 172.21.15.157:0/901331196 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ab2c9e100 con 0x555ab2b1fac0 2024-05-09T09:48:39.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.904+0000 7f54bdb2d640 1 --2- 172.21.15.157:0/901331196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2b1fac0 0x555ab2c9dbc0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f54b0000f90 tx=0x7f54b0019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.904+0000 7f53aa604640 1 -- 172.21.15.157:0/901331196 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54b00c5070 con 0x555ab2b1fac0 2024-05-09T09:48:39.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.904+0000 7f54c0012980 1 -- 172.21.15.157:0/901331196 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555ab2c9e390 con 0x555ab2b1fac0 2024-05-09T09:48:39.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.904+0000 7f53aa604640 1 -- 172.21.15.157:0/901331196 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54b00b6b50 con 0x555ab2b1fac0 2024-05-09T09:48:39.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.904+0000 7f53aa604640 1 -- 172.21.15.157:0/901331196 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54b00b6e30 con 0x555ab2b1fac0 2024-05-09T09:48:39.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.904+0000 7f54c0012980 1 -- 172.21.15.157:0/901331196 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ab2ca1020 con 0x555ab2b1fac0 2024-05-09T09:48:39.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.908+0000 7f53aa604640 1 -- 172.21.15.157:0/901331196 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f54b00c1510 con 0x555ab2b1fac0 2024-05-09T09:48:39.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.908+0000 7f53aa604640 1 --2- 172.21.15.157:0/901331196 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f53a4034c00 0x7f53a40370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.908+0000 7f53aa604640 1 -- 172.21.15.157:0/901331196 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f54b00bb070 con 0x555ab2b1fac0 2024-05-09T09:48:39.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.908+0000 7f54bd32c640 1 --2- 172.21.15.157:0/901331196 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f53a4034c00 0x7f53a40370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.908+0000 7f54c0012980 1 --2- 172.21.15.157:0/901331196 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555ab2baeb00 0x555ab2ca4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.908+0000 7f54c0012980 1 -- 172.21.15.157:0/901331196 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2ca51f0 con 0x555ab2baeb00 2024-05-09T09:48:39.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.908+0000 7f54be32e640 1 --2- 172.21.15.157:0/901331196 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555ab2baeb00 0x555ab2ca4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.908+0000 7f54bd32c640 1 --2- 172.21.15.157:0/901331196 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f53a4034c00 0x7f53a40370c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f54a8000f70 tx=0x7f54a80012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.908+0000 7f54be32e640 1 --2- 172.21.15.157:0/901331196 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555ab2baeb00 0x555ab2ca4c70 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.908+0000 7f54be32e640 1 -- 172.21.15.157:0/901331196 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54b80083f0 con 0x555ab2baeb00 2024-05-09T09:48:39.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.908+0000 7f54c0012980 1 -- 172.21.15.157:0/901331196 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2ca2220 con 0x555ab2baeb00 2024-05-09T09:48:39.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.908+0000 7f54be32e640 1 -- 172.21.15.157:0/901331196 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f54b80083f0 con 0x555ab2baeb00 2024-05-09T09:48:39.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.908+0000 7f54c0012980 1 --2- 172.21.15.157:0/901331196 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555ab2ca7550 0x555ab2ca9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.908+0000 7f54c0012980 1 -- 172.21.15.157:0/901331196 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2caa010 con 0x555ab2ca7550 2024-05-09T09:48:39.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.908+0000 7f54bdb2d640 1 --2- 172.21.15.157:0/901331196 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555ab2ca7550 0x555ab2ca9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.908+0000 7f54bdb2d640 1 --2- 172.21.15.157:0/901331196 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555ab2ca7550 0x555ab2ca9940 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.912+0000 7f54bdb2d640 1 -- 172.21.15.157:0/901331196 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f54b00d0070 con 0x555ab2ca7550 2024-05-09T09:48:39.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.912+0000 7f54c0012980 1 -- 172.21.15.157:0/901331196 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2ca63f0 con 0x555ab2baeb00 2024-05-09T09:48:39.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.912+0000 7f54be32e640 1 -- 172.21.15.157:0/901331196 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f54b80083f0 con 0x555ab2baeb00 2024-05-09T09:48:39.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.912+0000 7f54c0012980 1 --2- 172.21.15.157:0/901331196 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555ab2cab470 0x555ab2cad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.912+0000 7f54c0012980 1 -- 172.21.15.157:0/901331196 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cadf50 con 0x555ab2cab470 2024-05-09T09:48:39.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.912+0000 7f54bd32c640 1 --2- 172.21.15.157:0/901331196 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555ab2cab470 0x555ab2cad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.912+0000 7f54bd32c640 1 --2- 172.21.15.157:0/901331196 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555ab2cab470 0x555ab2cad860 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.912+0000 7f54bd32c640 1 -- 172.21.15.157:0/901331196 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cab470 2024-05-09T09:48:39.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.916+0000 7f54c0012980 1 Processor -- start 2024-05-09T09:48:39.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.916+0000 7f54c0012980 1 -- start start 2024-05-09T09:48:39.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.916+0000 7f54c0012980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2cd3fd0 0x555ab2cd43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.916+0000 7f54c0012980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x555ab2ab3020 con 0x555ab2cd3fd0 2024-05-09T09:48:39.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.916+0000 7f54bdb2d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2cd3fd0 0x555ab2cd43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.916+0000 7f54bdb2d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2cd3fd0 0x555ab2cd43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:60208/0 (socket says 172.21.15.157:60208) 2024-05-09T09:48:39.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.916+0000 7f54bdb2d640 1 -- 172.21.15.157:0/4251991937 learned_addr learned my addr 172.21.15.157:0/4251991937 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:39.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.916+0000 7f54bdb2d640 1 -- 172.21.15.157:0/4251991937 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ab2cd4930 con 0x555ab2cd3fd0 2024-05-09T09:48:39.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.916+0000 7f54bdb2d640 1 --2- 172.21.15.157:0/4251991937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2cd3fd0 0x555ab2cd43f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f54b00e3b90 tx=0x7f54b00a9460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.916+0000 7f53a23a1640 1 -- 172.21.15.157:0/4251991937 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54b00a9a70 con 0x555ab2cd3fd0 2024-05-09T09:48:39.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.916+0000 7f53a23a1640 1 -- 172.21.15.157:0/4251991937 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54b00c2a90 con 0x555ab2cd3fd0 2024-05-09T09:48:39.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.916+0000 7f54c0012980 1 -- 172.21.15.157:0/4251991937 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555ab2cd53c0 con 0x555ab2cd3fd0 2024-05-09T09:48:39.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.916+0000 7f53a23a1640 1 -- 172.21.15.157:0/4251991937 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54b00c2db0 con 0x555ab2cd3fd0 2024-05-09T09:48:39.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.916+0000 7f54c0012980 1 -- 172.21.15.157:0/4251991937 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ab2cd53c0 con 0x555ab2cd3fd0 2024-05-09T09:48:39.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.920+0000 7f53a23a1640 1 -- 172.21.15.157:0/4251991937 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f54b00dd070 con 0x555ab2cd3fd0 2024-05-09T09:48:39.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.920+0000 7f53a23a1640 1 --2- 172.21.15.157:0/4251991937 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5398034c00 0x7f53980370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.920+0000 7f53a23a1640 1 -- 172.21.15.157:0/4251991937 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f54b00d4040 con 0x555ab2cd3fd0 2024-05-09T09:48:39.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.920+0000 7f54bd32c640 1 --2- 172.21.15.157:0/4251991937 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5398034c00 0x7f53980370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.920+0000 7f54c0012980 1 Processor -- start 2024-05-09T09:48:39.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.920+0000 7f54c0012980 1 -- start start 2024-05-09T09:48:39.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.920+0000 7f54c0012980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2ce0e80 0x555ab2ce1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.920+0000 7f54bd32c640 1 --2- 172.21.15.157:0/4251991937 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5398034c00 0x7f53980370c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x555ab2ca5b00 tx=0x7f54a800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.920+0000 7f54c0012980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x555ab2c971f0 con 0x555ab2ce0e80 2024-05-09T09:48:39.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.920+0000 7f54bdb2d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2ce0e80 0x555ab2ce1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.920+0000 7f54bdb2d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2ce0e80 0x555ab2ce1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:60212/0 (socket says 172.21.15.157:60212) 2024-05-09T09:48:39.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.920+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2562997242 learned_addr learned my addr 172.21.15.157:0/2562997242 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:39.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.920+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2562997242 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ab2ce1850 con 0x555ab2ce0e80 2024-05-09T09:48:39.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.920+0000 7f54bdb2d640 1 --2- 172.21.15.157:0/2562997242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2ce0e80 0x555ab2ce1280 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f54b00a9040 tx=0x7f54b00eeaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8414dab5d9f46bfd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.920+0000 7f538ffff640 1 -- 172.21.15.157:0/2562997242 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54b00e26e0 con 0x555ab2ce0e80 2024-05-09T09:48:39.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.920+0000 7f538ffff640 1 -- 172.21.15.157:0/2562997242 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54b00fc070 con 0x555ab2ce0e80 2024-05-09T09:48:39.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.920+0000 7f538ffff640 1 -- 172.21.15.157:0/2562997242 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54b00e22f0 con 0x555ab2ce0e80 2024-05-09T09:48:39.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.920+0000 7f54c0012980 1 -- 172.21.15.157:0/2562997242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2ce0e80 msgr2=0x555ab2ce1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:39.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.920+0000 7f54c0012980 1 --2- 172.21.15.157:0/2562997242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2ce0e80 0x555ab2ce1280 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f54b00a9040 tx=0x7f54b00eeaa0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.920+0000 7f54c0012980 1 -- 172.21.15.157:0/2562997242 shutdown_connections 2024-05-09T09:48:39.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.920+0000 7f54c0012980 1 --2- 172.21.15.157:0/2562997242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2ce0e80 0x555ab2ce1280 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:39.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.920+0000 7f54c0012980 1 -- 172.21.15.157:0/2562997242 >> 172.21.15.157:0/2562997242 conn(0x555ab2cdd200 msgr2=0x555ab2cdb260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:39.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.920+0000 7f54c0012980 1 -- 172.21.15.157:0/2562997242 shutdown_connections 2024-05-09T09:48:39.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.920+0000 7f54c0012980 1 -- 172.21.15.157:0/2562997242 wait complete. 2024-05-09T09:48:39.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.920+0000 7f54c0012980 1 Processor -- start 2024-05-09T09:48:39.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.924+0000 7f54c0012980 1 -- start start 2024-05-09T09:48:39.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.924+0000 7f54c0012980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2ce0e80 0x555ab2ce81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.924+0000 7f54c0012980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x555ab2ce1f40 con 0x555ab2ce0e80 2024-05-09T09:48:39.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.924+0000 7f54bdb2d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2ce0e80 0x555ab2ce81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.924+0000 7f54bdb2d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2ce0e80 0x555ab2ce81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:60218/0 (socket says 172.21.15.157:60218) 2024-05-09T09:48:39.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.924+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 learned_addr learned my addr 172.21.15.157:0/2694897254 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:39.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.924+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ab2ce8720 con 0x555ab2ce0e80 2024-05-09T09:48:39.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.924+0000 7f54bdb2d640 1 --2- 172.21.15.157:0/2694897254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2ce0e80 0x555ab2ce81e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f54b00e8000 tx=0x7f54b00ecfe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.924+0000 7f538e7fc640 1 -- 172.21.15.157:0/2694897254 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54b0106070 con 0x555ab2ce0e80 2024-05-09T09:48:39.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.924+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555ab2ce8720 con 0x555ab2ce0e80 2024-05-09T09:48:39.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.924+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ab2ce8720 con 0x555ab2ce0e80 2024-05-09T09:48:39.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.924+0000 7f538e7fc640 1 -- 172.21.15.157:0/2694897254 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54b00bfe20 con 0x555ab2ce0e80 2024-05-09T09:48:39.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.924+0000 7f538e7fc640 1 -- 172.21.15.157:0/2694897254 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54b00de530 con 0x555ab2ce0e80 2024-05-09T09:48:39.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.924+0000 7f538e7fc640 1 -- 172.21.15.157:0/2694897254 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f54b0111060 con 0x555ab2ce0e80 2024-05-09T09:48:39.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.924+0000 7f538e7fc640 1 --2- 172.21.15.157:0/2694897254 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5388034bb0 0x7f5388037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.924+0000 7f538e7fc640 1 -- 172.21.15.157:0/2694897254 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f54b0105170 con 0x555ab2ce0e80 2024-05-09T09:48:39.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.924+0000 7f54bd32c640 1 --2- 172.21.15.157:0/2694897254 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5388034bb0 0x7f5388037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.924+0000 7f54c0012980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.924+0000 7f54c0012980 1 --2- 172.21.15.157:0/2694897254 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555ab2cf4d50 0x555ab2cf7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.924+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf7960 con 0x555ab2cf4d50 2024-05-09T09:48:39.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.924+0000 7f54be32e640 1 --2- 172.21.15.157:0/2694897254 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555ab2cf4d50 0x555ab2cf7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54bd32c640 1 --2- 172.21.15.157:0/2694897254 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5388034bb0 0x7f5388037070 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f54a800bf60 tx=0x7f54a8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54be32e640 1 --2- 172.21.15.157:0/2694897254 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555ab2cf4d50 0x555ab2cf7210 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54b80083f0 con 0x555ab2cf4d50 2024-05-09T09:48:39.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54c0012980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54c0012980 20 realm 2024-05-09T09:48:39.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54c0012980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf7d70 con 0x555ab2cf4d50 2024-05-09T09:48:39.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54b80083f0 con 0x555ab2cf4d50 2024-05-09T09:48:39.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54c0012980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54c0012980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:48:39.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54c0012980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf8640 con 0x555ab2cf4d50 2024-05-09T09:48:39.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54b80083f0 con 0x555ab2cf4d50 2024-05-09T09:48:39.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54c0012980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54c0012980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x555ab2cf4d50 2024-05-09T09:48:39.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f54b80083f0 con 0x555ab2cf4d50 2024-05-09T09:48:39.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54c0012980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:39.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54c0012980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54c0012980 1 --2- 172.21.15.157:0/2694897254 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555ab2cf9740 0x555ab2cfbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cfc140 con 0x555ab2cf9740 2024-05-09T09:48:39.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54bdb2d640 1 --2- 172.21.15.157:0/2694897254 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555ab2cf9740 0x555ab2cfbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54bdb2d640 1 --2- 172.21.15.157:0/2694897254 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555ab2cf9740 0x555ab2cfbb30 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:39.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54c0012980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:48:39.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54c0012980 20 searching for the correct realm 2024-05-09T09:48:39.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54c0012980 1 --2- 172.21.15.157:0/2694897254 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555ab2cfe020 0x555ab2d00450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d00ad0 con 0x555ab2cfe020 2024-05-09T09:48:39.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54bd32c640 1 --2- 172.21.15.157:0/2694897254 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555ab2cfe020 0x555ab2d00450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.928+0000 7f54bd32c640 1 --2- 172.21.15.157:0/2694897254 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555ab2cfe020 0x555ab2d00450 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.932+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:39.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.932+0000 7f54bd32c640 1 --2- 172.21.15.157:0/2694897254 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f54a8037040 0x7f54a8036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:39.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.932+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d00ad0 con 0x7f54a8037040 2024-05-09T09:48:39.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.932+0000 7f54be32e640 1 --2- 172.21.15.157:0/2694897254 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f54a8037040 0x7f54a8036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:39.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.932+0000 7f54be32e640 1 --2- 172.21.15.157:0/2694897254 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f54a8037040 0x7f54a8036410 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:39.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.932+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b80083f0 con 0x7f54a8037040 2024-05-09T09:48:39.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.932+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x555ab2cf9740 2024-05-09T09:48:39.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.932+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:39.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.932+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x555ab2cf4d50 2024-05-09T09:48:39.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.932+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b80083f0 con 0x555ab2cf4d50 2024-05-09T09:48:39.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.932+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x555ab2cf4d50 2024-05-09T09:48:39.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.932+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b8026040 con 0x555ab2cf4d50 2024-05-09T09:48:39.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.932+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x555ab2cf9740 2024-05-09T09:48:39.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.932+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:39.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.932+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x555ab2cf9740 2024-05-09T09:48:39.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.932+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:39.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.932+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x7f54a8037040 2024-05-09T09:48:39.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.932+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b8026040 con 0x7f54a8037040 2024-05-09T09:48:39.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.932+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x555ab2cfe020 2024-05-09T09:48:39.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.936+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:39.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.936+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x555ab2cf4d50 2024-05-09T09:48:39.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.936+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b8026040 con 0x555ab2cf4d50 2024-05-09T09:48:39.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.936+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x555ab2cf9740 2024-05-09T09:48:39.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.936+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:39.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.936+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x555ab2cf4d50 2024-05-09T09:48:39.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.936+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b8026040 con 0x555ab2cf4d50 2024-05-09T09:48:39.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.936+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x7f54a8037040 2024-05-09T09:48:39.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.936+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f54b8026040 con 0x7f54a8037040 2024-05-09T09:48:39.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.936+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x555ab2cfe020 2024-05-09T09:48:39.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.936+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:39.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.936+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x555ab2cfe020 2024-05-09T09:48:39.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.936+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:39.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.936+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x555ab2cf9740 2024-05-09T09:48:39.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.936+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:39.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.936+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x555ab2cfe020 2024-05-09T09:48:39.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.936+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:39.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.936+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x555ab2cfe020 2024-05-09T09:48:39.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.936+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:39.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.936+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x555ab2cf4d50 2024-05-09T09:48:39.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.940+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b8026040 con 0x555ab2cf4d50 2024-05-09T09:48:39.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.940+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x555ab2cf4d50 2024-05-09T09:48:39.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.940+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f54b8026040 con 0x555ab2cf4d50 2024-05-09T09:48:39.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.940+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x555ab2cf9740 2024-05-09T09:48:39.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.940+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:39.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.940+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x555ab2cfe020 2024-05-09T09:48:39.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.940+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:39.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.940+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x7f54a8037040 2024-05-09T09:48:39.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.940+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b8026040 con 0x7f54a8037040 2024-05-09T09:48:39.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.940+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x555ab2cf4d50 2024-05-09T09:48:39.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.940+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b8026040 con 0x555ab2cf4d50 2024-05-09T09:48:39.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.940+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x555ab2cf9740 2024-05-09T09:48:39.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.940+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:39.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.940+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x555ab2cfe020 2024-05-09T09:48:39.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.940+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:39.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.940+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x555ab2cf9740 2024-05-09T09:48:39.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.940+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:39.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.940+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x7f54a8037040 2024-05-09T09:48:39.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b8026040 con 0x7f54a8037040 2024-05-09T09:48:39.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x555ab2cfe020 2024-05-09T09:48:39.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:39.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x555ab2cf9740 2024-05-09T09:48:39.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:39.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x555ab2cf4d50 2024-05-09T09:48:39.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f54b8026040 con 0x555ab2cf4d50 2024-05-09T09:48:39.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cf89e0 con 0x7f54a8037040 2024-05-09T09:48:39.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54b8026040 con 0x7f54a8037040 2024-05-09T09:48:39.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54c0012980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:48:39.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54c0012980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:48:39.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54c0012980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:48:39.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54c0012980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:48:39.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54c0012980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:48:39.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54c0012980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:48:39.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54c0012980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cfc990 con 0x555ab2cf4d50 2024-05-09T09:48:39.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54b8026040 con 0x555ab2cf4d50 2024-05-09T09:48:39.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54c0012980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54c0012980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cfc990 con 0x555ab2cf4d50 2024-05-09T09:48:39.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f54b8026040 con 0x555ab2cf4d50 2024-05-09T09:48:39.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54c0012980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:39.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54c0012980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cfc990 con 0x555ab2cfe020 2024-05-09T09:48:39.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:39.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54c0012980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:48:39.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54c0012980 20 zone default found 2024-05-09T09:48:39.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54c0012980 4 Realm: () 2024-05-09T09:48:39.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54c0012980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:48:39.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54c0012980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:48:39.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54c0012980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:48:39.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54c0012980 20 zonegroup default 2024-05-09T09:48:39.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54c0012980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2cfd3a0 con 0x555ab2cf9740 2024-05-09T09:48:39.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:39.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54c0012980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54c0012980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d02de0 con 0x555ab2cfe020 2024-05-09T09:48:39.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:39.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54c0012980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54c0012980 20 rados->read ofs=0 len=0 2024-05-09T09:48:39.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.944+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d03180 con 0x555ab2cfe020 2024-05-09T09:48:39.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.948+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:39.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.948+0000 7f54c0012980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:39.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.948+0000 7f54c0012980 20 started sync module instance, tier type = 2024-05-09T09:48:39.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.948+0000 7f54c0012980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:48:39.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.948+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d02220 con 0x7f54a8037040 2024-05-09T09:48:39.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.948+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b8026040 con 0x7f54a8037040 2024-05-09T09:48:39.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.948+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93848035403328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d02220 con 0x7f54a8037040 2024-05-09T09:48:39.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.948+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d03a30 con 0x555ab2cf4d50 2024-05-09T09:48:39.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.948+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93848035403328] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x7f54a8037040 2024-05-09T09:48:39.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.948+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x555ab2cf4d50 2024-05-09T09:48:39.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.948+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93848035407136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d02220 con 0x555ab2cf4d50 2024-05-09T09:48:39.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.948+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d04440 con 0x555ab2cfe020 2024-05-09T09:48:39.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.952+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93848035407136] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x555ab2cf4d50 2024-05-09T09:48:39.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.952+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:39.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.952+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93848035401072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d02190 con 0x555ab2cfe020 2024-05-09T09:48:39.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.952+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d05190 con 0x7f54a8037040 2024-05-09T09:48:39.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.952+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x7f54a8037040 2024-05-09T09:48:39.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.952+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93848035413520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d05a30 con 0x7f54a8037040 2024-05-09T09:48:39.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.952+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d06430 con 0x555ab2cf4d50 2024-05-09T09:48:39.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.956+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93848035401072] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:39.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.956+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93848035413520] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x7f54a8037040 2024-05-09T09:48:39.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.956+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x555ab2cf4d50 2024-05-09T09:48:39.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.956+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93848035412016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d05510 con 0x555ab2cf4d50 2024-05-09T09:48:39.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.956+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d06cd0 con 0x555ab2cf9740 2024-05-09T09:48:39.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.956+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93848035412016] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x555ab2cf4d50 2024-05-09T09:48:39.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.960+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:39.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.960+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93848035420192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d05510 con 0x555ab2cf9740 2024-05-09T09:48:39.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.960+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d07520 con 0x555ab2cf9740 2024-05-09T09:48:39.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.960+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93848035420192] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:39.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.960+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:39.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.960+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93848035417920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d07d70 con 0x555ab2cf9740 2024-05-09T09:48:39.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.960+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d08730 con 0x555ab2cf9740 2024-05-09T09:48:39.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.964+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:39.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.964+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93848035417920] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:39.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.964+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93848035426944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d08b50 con 0x555ab2cf9740 2024-05-09T09:48:39.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.964+0000 7f54c0012980 20 add_watcher() i=0 2024-05-09T09:48:39.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.964+0000 7f54c0012980 20 add_watcher() i=1 2024-05-09T09:48:39.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.964+0000 7f54c0012980 20 add_watcher() i=2 2024-05-09T09:48:39.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.964+0000 7f54c0012980 20 add_watcher() i=3 2024-05-09T09:48:39.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.964+0000 7f54c0012980 20 add_watcher() i=4 2024-05-09T09:48:39.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.964+0000 7f54c0012980 20 add_watcher() i=5 2024-05-09T09:48:39.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.964+0000 7f54c0012980 20 add_watcher() i=6 2024-05-09T09:48:39.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.964+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93848035426944] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:39.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.964+0000 7f54c0012980 20 add_watcher() i=7 2024-05-09T09:48:39.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.964+0000 7f54c0012980 2 all 8 watchers are set, enabling cache 2024-05-09T09:48:39.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.964+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d0bb80 con 0x555ab2cf4d50 2024-05-09T09:48:39.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.964+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f54b8036040 con 0x555ab2cf4d50 2024-05-09T09:48:39.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.964+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93848035428000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d08fe0 con 0x555ab2cf4d50 2024-05-09T09:48:39.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.964+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93848035428000] v32'380 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x555ab2cf4d50 2024-05-09T09:48:39.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.964+0000 7f53737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:39.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.964+0000 7f54c0012980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:48:39.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.964+0000 7f54c0012980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:48:39.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.964+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d14400 con 0x555ab2cf4d50 2024-05-09T09:48:39.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.968+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'89 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x555ab2cf4d50 2024-05-09T09:48:39.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.968+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d14a50 con 0x555ab2cf9740 2024-05-09T09:48:39.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.968+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'83 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:39.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.968+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d14a50 con 0x555ab2cfe020 2024-05-09T09:48:39.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.972+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'82 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:39.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.972+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d15080 con 0x555ab2cf4d50 2024-05-09T09:48:39.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.972+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'381 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x555ab2cf4d50 2024-05-09T09:48:39.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.972+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d15530 con 0x7f54a8037040 2024-05-09T09:48:39.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.976+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'236 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x7f54a8037040 2024-05-09T09:48:39.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.976+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d15950 con 0x555ab2cfe020 2024-05-09T09:48:39.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.976+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'158 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:39.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.976+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d15ec0 con 0x555ab2cf4d50 2024-05-09T09:48:39.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.976+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'84 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x555ab2cf4d50 2024-05-09T09:48:39.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.976+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d15f50 con 0x555ab2cf9740 2024-05-09T09:48:39.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.980+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'157 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:39.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.980+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d15f50 con 0x7f54a8037040 2024-05-09T09:48:39.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.984+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'82 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x7f54a8037040 2024-05-09T09:48:39.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.984+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d16350 con 0x555ab2cfe020 2024-05-09T09:48:39.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.984+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'88 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:39.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.984+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d16350 con 0x7f54a8037040 2024-05-09T09:48:39.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.984+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'237 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x7f54a8037040 2024-05-09T09:48:39.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.984+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d16350 con 0x555ab2cf9740 2024-05-09T09:48:39.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.988+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'86 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:39.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.988+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d16350 con 0x7f54a8037040 2024-05-09T09:48:39.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.988+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'82 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x7f54a8037040 2024-05-09T09:48:39.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.988+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d16350 con 0x555ab2cf9740 2024-05-09T09:48:39.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.992+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'163 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:39.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.992+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d16410 con 0x555ab2cf4d50 2024-05-09T09:48:39.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.992+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'382 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x555ab2cf4d50 2024-05-09T09:48:39.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.992+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d16410 con 0x555ab2cfe020 2024-05-09T09:48:39.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.996+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'230 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:39.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.996+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d16470 con 0x7f54a8037040 2024-05-09T09:48:39.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.996+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'238 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x7f54a8037040 2024-05-09T09:48:39.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.996+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d16470 con 0x555ab2cfe020 2024-05-09T09:48:40.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.996+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'82 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:40.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:39.996+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d16530 con 0x555ab2cf4d50 2024-05-09T09:48:40.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.000+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'90 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x555ab2cf4d50 2024-05-09T09:48:40.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.000+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d16530 con 0x555ab2cf4d50 2024-05-09T09:48:40.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.000+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'383 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x555ab2cf4d50 2024-05-09T09:48:40.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.000+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d16500 con 0x555ab2cfe020 2024-05-09T09:48:40.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.004+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'231 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:40.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.004+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d16500 con 0x7f54a8037040 2024-05-09T09:48:40.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.004+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'94 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x7f54a8037040 2024-05-09T09:48:40.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.004+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d16470 con 0x555ab2cfe020 2024-05-09T09:48:40.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.004+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'84 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:40.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.004+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d16470 con 0x555ab2cfe020 2024-05-09T09:48:40.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.008+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'88 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:40.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.008+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d16470 con 0x555ab2cfe020 2024-05-09T09:48:40.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.008+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'79 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:40.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.008+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d16470 con 0x555ab2cfe020 2024-05-09T09:48:40.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.008+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'159 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:40.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.008+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d16470 con 0x555ab2cf9740 2024-05-09T09:48:40.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.012+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'84 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:40.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.012+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d16470 con 0x555ab2cfe020 2024-05-09T09:48:40.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.012+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'82 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:40.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.012+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d16470 con 0x555ab2cf9740 2024-05-09T09:48:40.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.016+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'158 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:40.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.016+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d16470 con 0x555ab2cfe020 2024-05-09T09:48:40.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.020+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'232 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:40.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.020+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d16470 con 0x555ab2cf9740 2024-05-09T09:48:40.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.020+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'164 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:40.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.020+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d16470 con 0x7f54a8037040 2024-05-09T09:48:40.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.024+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'88 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x7f54a8037040 2024-05-09T09:48:40.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.024+0000 7f53727e4640 20 reqs_thread_entry: start 2024-05-09T09:48:40.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.024+0000 7f54c0012980 20 init_complete bucket index max shards: 11 2024-05-09T09:48:40.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.024+0000 7f54c0012980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-05-09T09:48:40.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.024+0000 7f536b7fe640 20 reqs_thread_entry: start 2024-05-09T09:48:40.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.024+0000 7f54c0012980 20 rados->read ofs=0 len=0 2024-05-09T09:48:40.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.024+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d121f0 con 0x555ab2cf9740 2024-05-09T09:48:40.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.028+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(94 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:40.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.028+0000 7f54c0012980 20 rados_obj.operate() r=0 bl.length=380 2024-05-09T09:48:40.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.028+0000 7f54c0012980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-05-09T09:48:40.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.028+0000 7f54c0012980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-05-09T09:48:40.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.028+0000 7f54c0012980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:48:40.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.028+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:95 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d36310 con 0x7f54a8037040 2024-05-09T09:48:40.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.028+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(95 bud [create,call,writefull 0~206] v32'1 uv1 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x7f54a8037040 2024-05-09T09:48:40.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.028+0000 7f54c0012980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-05-09T09:48:40.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.028+0000 7f54c0012980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-05-09T09:48:40.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.028+0000 7f54c0012980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-05-09T09:48:40.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.028+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify cookie 93848035614240 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d36f10 con 0x555ab2cf9740 2024-05-09T09:48:40.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.028+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== watch-notify(notify (1) cookie 93848035420192 notify 137438953505 ret 0) ==== 424+0+0 (crc 0 0 0) 0x555ab2d15950 con 0x555ab2cf9740 2024-05-09T09:48:40.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.028+0000 7f538ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953505 cookie 93848035420192 notifier 4740 bl.length()=382 2024-05-09T09:48:40.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.028+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(96 notify.5 [notify cookie 93848035614240 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:40.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.028+0000 7f538ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-05-09T09:48:40.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.028+0000 7f538ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-05-09T09:48:40.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.028+0000 7f538ffff640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f53800056c0 con 0x555ab2cf9740 2024-05-09T09:48:40.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.028+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(97 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:40.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.032+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== watch-notify(notify_complete (2) cookie 93848035614240 notify 137438953505 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f54b00d9040 con 0x555ab2cf9740 2024-05-09T09:48:40.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.032+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d35e20 con 0x555ab2cf4d50 2024-05-09T09:48:40.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.032+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(98 bar.buckets [call out=184b] v0'0 uv11 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f54b8036040 con 0x555ab2cf4d50 2024-05-09T09:48:40.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.032+0000 7f54c0012980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 : miss 2024-05-09T09:48:40.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.032+0000 7f54c0012980 20 rados->read ofs=0 len=0 2024-05-09T09:48:40.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.032+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 8.9 8:903c066b:root::.bucket.meta.myfoo6%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d34150 con 0x7f54a8037040 2024-05-09T09:48:40.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.032+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(99 .bucket.meta.myfoo6:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=218b] v0'0 uv44 ondisk = 0) ==== 333+0+662 (crc 0 0 0) 0x7f54b8036040 con 0x7f54a8037040 2024-05-09T09:48:40.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.032+0000 7f54c0012980 20 rados_obj.operate() r=0 bl.length=380 2024-05-09T09:48:40.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.032+0000 7f54c0012980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 info.flags=0x17 2024-05-09T09:48:40.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.032+0000 7f54c0012980 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 to cache LRU end 2024-05-09T09:48:40.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.032+0000 7f54c0012980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:48:40.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.032+0000 7f54c0012980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-09T09:48:40.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.032+0000 7f54c0012980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 2024-05-09T09:48:40.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.032+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:100 8.9 8:903c066b:root::.bucket.meta.myfoo6%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d3dc00 con 0x7f54a8037040 2024-05-09T09:48:40.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.032+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(100 .bucket.meta.myfoo6:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v32'45 uv45 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x7f54a8037040 2024-05-09T09:48:40.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.036+0000 7f54c0012980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 info.flags=0x17 2024-05-09T09:48:40.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.036+0000 7f54c0012980 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 to cache LRU end 2024-05-09T09:48:40.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.036+0000 7f54c0012980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-05-09T09:48:40.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.036+0000 7f54c0012980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9, ofs0, ns] 2024-05-09T09:48:40.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.036+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:101 7.0 7:05bf5b68:::notify.1:head [notify cookie 93848035601552 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d38350 con 0x555ab2cf4d50 2024-05-09T09:48:40.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.036+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== watch-notify(notify (1) cookie 93848035407136 notify 137438953497 ret 0) ==== 790+0+0 (crc 0 0 0) 0x555ab2d37120 con 0x555ab2cf4d50 2024-05-09T09:48:40.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.036+0000 7f538ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953497 cookie 93848035407136 notifier 4740 bl.length()=748 2024-05-09T09:48:40.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.036+0000 7f538ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 info.flags=0x17 2024-05-09T09:48:40.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.036+0000 7f538ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 to cache LRU end 2024-05-09T09:48:40.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.036+0000 7f538ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-05-09T09:48:40.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.036+0000 7f538ffff640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f53800056c0 con 0x555ab2cf4d50 2024-05-09T09:48:40.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.036+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(101 notify.1 [notify cookie 93848035601552 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f54b8036040 con 0x555ab2cf4d50 2024-05-09T09:48:40.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.036+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(102 notify.1 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x555ab2cf4d50 2024-05-09T09:48:40.039 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.036+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== watch-notify(notify_complete (2) cookie 93848035601552 notify 137438953497 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555ab2d13d60 con 0x555ab2cf4d50 2024-05-09T09:48:40.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.036+0000 7f54c0012980 20 handle_bi_update(): bucket=:myfoo6[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9]): orig_sources= new_sources= 2024-05-09T09:48:40.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.036+0000 7f54c0012980 20 handle_bi_update(): bucket=:myfoo6[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9]): potential sources added=[] removed=[] 2024-05-09T09:48:40.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.036+0000 7f54c0012980 20 handle_bi_update(): bucket=:myfoo6[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9]): orig_dests= new_dests= 2024-05-09T09:48:40.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.036+0000 7f54c0012980 20 handle_bi_update(): bucket=:myfoo6[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9]): potential dests added=[] removed=[] 2024-05-09T09:48:40.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.036+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d32c90 con 0x555ab2cf4d50 2024-05-09T09:48:40.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.036+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(103 bud.buckets [call] v32'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x555ab2cf4d50 2024-05-09T09:48:40.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.036+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:104 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d32c90 con 0x555ab2cf4d50 2024-05-09T09:48:40.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.040+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(104 bud.buckets [call] v32'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x555ab2cf4d50 2024-05-09T09:48:40.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.040+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:105 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d32c90 con 0x555ab2cf4d50 2024-05-09T09:48:40.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.040+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(105 myfoo6 [delete,create,call,writefull 0~166] v32'21 uv21 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x555ab2cf4d50 2024-05-09T09:48:40.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.040+0000 7f54c0012980 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-05-09T09:48:40.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.040+0000 7f54c0012980 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-05-09T09:48:40.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.040+0000 7f54c0012980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-05-09T09:48:40.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.040+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:106 7.e 7:7759931f:::notify.3:head [notify cookie 93848035644528 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d38350 con 0x7f54a8037040 2024-05-09T09:48:40.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.040+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== watch-notify(notify (1) cookie 93848035413520 notify 137438953487 ret 0) ==== 358+0+0 (crc 0 0 0) 0x555ab2d13d60 con 0x7f54a8037040 2024-05-09T09:48:40.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.040+0000 7f538f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953487 cookie 93848035413520 notifier 4740 bl.length()=316 2024-05-09T09:48:40.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.040+0000 7f538f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-05-09T09:48:40.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.040+0000 7f538f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-05-09T09:48:40.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.040+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(106 notify.3 [notify cookie 93848035644528 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f54b8036040 con 0x7f54a8037040 2024-05-09T09:48:40.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.040+0000 7f538f7fe640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f52e4003a70 con 0x7f54a8037040 2024-05-09T09:48:40.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.040+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 23 ==== osd_op_reply(107 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x7f54a8037040 2024-05-09T09:48:40.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.040+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 24 ==== watch-notify(notify_complete (2) cookie 93848035644528 notify 137438953487 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555ab2d14c20 con 0x7f54a8037040 2024-05-09T09:48:40.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.040+0000 7f54c0012980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 : hit (requested=0x17, cached=0x17) 2024-05-09T09:48:40.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.040+0000 7f54c0012980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 2024-05-09T09:48:40.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.040+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:108 8.9 8:903c066b:root::.bucket.meta.myfoo6%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d3b830 con 0x7f54a8037040 2024-05-09T09:48:40.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.044+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 25 ==== osd_op_reply(108 .bucket.meta.myfoo6:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v32'46 uv46 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x7f54a8037040 2024-05-09T09:48:40.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.044+0000 7f54c0012980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 info.flags=0x17 2024-05-09T09:48:40.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.044+0000 7f54c0012980 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 to cache LRU end 2024-05-09T09:48:40.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.044+0000 7f54c0012980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-05-09T09:48:40.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.044+0000 7f54c0012980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9, ofs0, ns] 2024-05-09T09:48:40.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.044+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:109 7.0 7:05bf5b68:::notify.1:head [notify cookie 93848035605664 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d38800 con 0x555ab2cf4d50 2024-05-09T09:48:40.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.044+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== watch-notify(notify (1) cookie 93848035407136 notify 137438953498 ret 0) ==== 790+0+0 (crc 0 0 0) 0x555ab2d14c20 con 0x555ab2cf4d50 2024-05-09T09:48:40.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.044+0000 7f538f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953498 cookie 93848035407136 notifier 4740 bl.length()=748 2024-05-09T09:48:40.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.044+0000 7f538f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 info.flags=0x17 2024-05-09T09:48:40.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.044+0000 7f538f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 to cache LRU end 2024-05-09T09:48:40.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.044+0000 7f538f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-05-09T09:48:40.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.044+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 36 ==== osd_op_reply(109 notify.1 [notify cookie 93848035605664 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f54b8036040 con 0x555ab2cf4d50 2024-05-09T09:48:40.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.044+0000 7f538f7fe640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:110 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f52e4005000 con 0x555ab2cf4d50 2024-05-09T09:48:40.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.044+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 37 ==== osd_op_reply(110 notify.1 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b8036040 con 0x555ab2cf4d50 2024-05-09T09:48:40.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.044+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 38 ==== watch-notify(notify_complete (2) cookie 93848035605664 notify 137438953498 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555ab2d14a50 con 0x555ab2cf4d50 2024-05-09T09:48:40.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.044+0000 7f54c0012980 20 handle_bi_update(): bucket=:myfoo6[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9]): orig_sources= new_sources= 2024-05-09T09:48:40.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.044+0000 7f54c0012980 20 handle_bi_update(): bucket=:myfoo6[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9]): potential sources added=[] removed=[] 2024-05-09T09:48:40.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.044+0000 7f54c0012980 20 handle_bi_update(): bucket=:myfoo6[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9]): orig_dests= new_dests= 2024-05-09T09:48:40.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.044+0000 7f54c0012980 20 handle_bi_update(): bucket=:myfoo6[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9]): potential dests added=[] removed=[] 2024-05-09T09:48:40.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.044+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:111 4.29 4:973212f7:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d33ca0 con 0x555ab2cfe020 2024-05-09T09:48:40.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.044+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(111 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:40.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.044+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:112 4.31 4:8ff91c31:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d33ca0 con 0x555ab2cf4d50 2024-05-09T09:48:40.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.044+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 39 ==== osd_op_reply(112 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.1 [call out=85b] v0'0 uv8 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f54b8036040 con 0x555ab2cf4d50 2024-05-09T09:48:40.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.044+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:113 4.17 4:e95774a5:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d33ca0 con 0x555ab2cf9740 2024-05-09T09:48:40.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.048+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(113 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:40.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.048+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:114 4.17 4:e9b509e3:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d33ca0 con 0x555ab2cf9740 2024-05-09T09:48:40.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.048+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(114 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.3 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:40.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.048+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:115 4.b 4:d0bb5411:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d33ca0 con 0x7f54a8037040 2024-05-09T09:48:40.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.048+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 26 ==== osd_op_reply(115 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f54b8036040 con 0x7f54a8037040 2024-05-09T09:48:40.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.048+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:116 4.1a 4:5ab4a268:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d33ca0 con 0x7f54a8037040 2024-05-09T09:48:40.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.048+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 27 ==== osd_op_reply(116 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.5 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f54b8036040 con 0x7f54a8037040 2024-05-09T09:48:40.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.048+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:117 4.28 4:17427c01:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d33ca0 con 0x555ab2cf4d50 2024-05-09T09:48:40.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.048+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 40 ==== osd_op_reply(117 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f54b8036040 con 0x555ab2cf4d50 2024-05-09T09:48:40.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.048+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:118 4.16 4:6aa2cc25:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d33ca0 con 0x7f54a8037040 2024-05-09T09:48:40.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.052+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 28 ==== osd_op_reply(118 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f54b804e060 con 0x7f54a8037040 2024-05-09T09:48:40.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.052+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:119 4.25 4:a5d40d9a:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d33ca0 con 0x555ab2cfe020 2024-05-09T09:48:40.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.052+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(119 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.8 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:40.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.052+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:120 4.26 4:66693406:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d33ca0 con 0x555ab2cf9740 2024-05-09T09:48:40.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.052+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 32 ==== osd_op_reply(120 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.9 [call out=377b] v0'0 uv7 ondisk = 0) ==== 194+0+377 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:40.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.052+0000 7f54c0012980 10 cls_bucket_list_unordered: got thirteen 2024-05-09T09:48:40.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.052+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:121 4.3d 4:bd59d60b:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d33ca0 con 0x555ab2cfe020 2024-05-09T09:48:40.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.052+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== osd_op_reply(121 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:40.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.052+0000 7f54c0012980 20 get_obj_state: octx=0x555ab2d36140 obj=myfoo6:thirteen state=0x555ab2d32e78 s->prefetch_data=0 2024-05-09T09:48:40.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.052+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:122 3.3ds0 3:bf808594:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d33ca0 con 0x555ab2cfe020 2024-05-09T09:48:40.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.052+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 30 ==== osd_op_reply(122 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9_thirteen [getxattrs out=854b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 238+0+870 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:40.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.052+0000 7f54c0012980 10 manifest: total_size = 8 2024-05-09T09:48:40.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.052+0000 7f54c0012980 20 get_obj_state: setting s->obj_tag to b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.8564387176598856582 2024-05-09T09:48:40.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.052+0000 7f54c0012980 20 Read xattr rgw_rados: user.rgw.acl 2024-05-09T09:48:40.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.052+0000 7f54c0012980 20 Read xattr rgw_rados: user.rgw.content_type 2024-05-09T09:48:40.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.052+0000 7f54c0012980 20 Read xattr rgw_rados: user.rgw.etag 2024-05-09T09:48:40.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.052+0000 7f54c0012980 20 Read xattr rgw_rados: user.rgw.idtag 2024-05-09T09:48:40.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.052+0000 7f54c0012980 20 Read xattr rgw_rados: user.rgw.manifest 2024-05-09T09:48:40.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.052+0000 7f54c0012980 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-05-09T09:48:40.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.052+0000 7f54c0012980 20 Read xattr rgw_rados: user.rgw.source_zone 2024-05-09T09:48:40.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.052+0000 7f54c0012980 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-05-09T09:48:40.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.052+0000 7f54c0012980 20 get_obj_state: octx=0x555ab2d36140 obj=myfoo6:thirteen state=0x555ab2d32e78 s->prefetch_data=0 2024-05-09T09:48:40.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.052+0000 7f54c0012980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 : hit (requested=0x17, cached=0x17) 2024-05-09T09:48:40.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.052+0000 7f54c0012980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 2024-05-09T09:48:40.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.052+0000 7f54c0012980 20 bucket index object: :.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.9 2024-05-09T09:48:40.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.052+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:123 4.26 4:66693406:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d3cfe0 con 0x555ab2cf9740 2024-05-09T09:48:40.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.056+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 33 ==== osd_op_reply(123 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.9 [stat,call,call] v32'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:40.060 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.056+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:124 3.3ds0 3:bf808594:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9_thirteen:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=76b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d3f2f0 con 0x555ab2cfe020 2024-05-09T09:48:40.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.060+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 31 ==== osd_op_reply(124 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9_thirteen [cmpxattr (62) op 1 mode 1,setxattr (117),setxattr (33)] v32'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:40.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.060+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:125 4.26 4:66693406:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=267b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d40b80 con 0x555ab2cf9740 2024-05-09T09:48:40.062 INFO:teuthology.orchestra.run.smithi157.stderr:1 objects processed in :myfoo6[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9]). Next marker thirteen 2024-05-09T09:48:40.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.060+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:126 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d36960 con 0x7f54a8037040 2024-05-09T09:48:40.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.060+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 29 ==== osd_op_reply(126 bud [delete,create,call,writefull 0~380] v32'2 uv2 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f54b804e060 con 0x7f54a8037040 2024-05-09T09:48:40.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.060+0000 7f54c0012980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-05-09T09:48:40.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.060+0000 7f54c0012980 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-05-09T09:48:40.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.060+0000 7f54c0012980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-05-09T09:48:40.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.060+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:127 7.3 7:c609908c:::notify.5:head [notify cookie 93848035640416 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d36960 con 0x555ab2cf9740 2024-05-09T09:48:40.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.060+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 34 ==== osd_op_reply(125 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.9 [stat,call,call] v32'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:40.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.060+0000 7f538ffff640 20 handle_completion(): completion ok for obj=thirteen 2024-05-09T09:48:40.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.060+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 35 ==== watch-notify(notify (1) cookie 93848035420192 notify 137438953506 ret 0) ==== 598+0+0 (crc 0 0 0) 0x7f54b00d9040 con 0x555ab2cf9740 2024-05-09T09:48:40.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.060+0000 7f538f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953506 cookie 93848035420192 notifier 4740 bl.length()=556 2024-05-09T09:48:40.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.060+0000 7f538f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-05-09T09:48:40.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.060+0000 7f538f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-05-09T09:48:40.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.060+0000 7f538f7fe640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:128 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f52e4005000 con 0x555ab2cf9740 2024-05-09T09:48:40.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.060+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 36 ==== osd_op_reply(127 notify.5 [notify cookie 93848035640416 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:40.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.060+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 37 ==== osd_op_reply(128 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:40.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.064+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 38 ==== watch-notify(notify_complete (2) cookie 93848035640416 notify 137438953506 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555ab2ca1020 con 0x555ab2cf9740 2024-05-09T09:48:40.066 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.064+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:129 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d36900 con 0x555ab2cf4d50 2024-05-09T09:48:40.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.064+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 41 ==== osd_op_reply(129 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v32'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f54b804e060 con 0x555ab2cf4d50 2024-05-09T09:48:40.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.064+0000 7f54c0012980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-05-09T09:48:40.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.064+0000 7f54c0012980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-09T09:48:40.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.064+0000 7f54c0012980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-05-09T09:48:40.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.064+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:130 7.3 7:c609908c:::notify.5:head [notify cookie 93848035640416 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d36900 con 0x555ab2cf9740 2024-05-09T09:48:40.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.064+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 39 ==== watch-notify(notify (1) cookie 93848035420192 notify 137438953507 ret 0) ==== 219+0+0 (crc 0 0 0) 0x555ab2ca1020 con 0x555ab2cf9740 2024-05-09T09:48:40.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.064+0000 7f538ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953507 cookie 93848035420192 notifier 4740 bl.length()=177 2024-05-09T09:48:40.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.064+0000 7f538ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-05-09T09:48:40.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.064+0000 7f538ffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-09T09:48:40.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.064+0000 7f538ffff640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:131 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f53800056c0 con 0x555ab2cf9740 2024-05-09T09:48:40.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.064+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 40 ==== osd_op_reply(130 notify.5 [notify cookie 93848035640416 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:40.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.064+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 41 ==== osd_op_reply(131 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:40.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.064+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 42 ==== watch-notify(notify_complete (2) cookie 93848035640416 notify 137438953507 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555ab2c9e390 con 0x555ab2cf9740 2024-05-09T09:48:40.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.064+0000 7f54c0012980 10 removing user index: bar 2024-05-09T09:48:40.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.064+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:132 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d36900 con 0x555ab2cf9740 2024-05-09T09:48:40.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.068+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 43 ==== osd_op_reply(132 bar [delete] v32'5 uv5 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:40.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.068+0000 7f54c0012980 10 removing default.rgw.meta+users.uid+bar from cache 2024-05-09T09:48:40.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.068+0000 7f54c0012980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-05-09T09:48:40.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.068+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:133 7.9 7:93e5b521:::notify.7:head [notify cookie 93848035640416 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d36900 con 0x555ab2cf9740 2024-05-09T09:48:40.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.068+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 44 ==== watch-notify(notify (1) cookie 93848035426944 notify 137438953508 ret 0) ==== 194+0+0 (crc 0 0 0) 0x555ab2c9e390 con 0x555ab2cf9740 2024-05-09T09:48:40.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.068+0000 7f538f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953508 cookie 93848035426944 notifier 4740 bl.length()=152 2024-05-09T09:48:40.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.068+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 45 ==== osd_op_reply(133 notify.7 [notify cookie 93848035640416 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:40.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.068+0000 7f538f7fe640 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:134 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f52e4005000 con 0x555ab2cf9740 2024-05-09T09:48:40.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.068+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 46 ==== osd_op_reply(134 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:40.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.068+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 47 ==== watch-notify(notify_complete (2) cookie 93848035640416 notify 137438953508 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555ab2c9e100 con 0x555ab2cf9740 2024-05-09T09:48:40.073 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-05-09T09:48:39.776600Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:48:39.776575Z","tags":[],"group_ids":[]} 2024-05-09T09:48:40.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.072+0000 7f53737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:40.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.072+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:135 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93848035428000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d36900 con 0x555ab2cf4d50 2024-05-09T09:48:40.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.072+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 42 ==== osd_op_reply(135 data_loggenerations_metadata [watch unwatch cookie 93848035428000] v32'384 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f54b804e060 con 0x555ab2cf4d50 2024-05-09T09:48:40.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.072+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:136 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93848035403328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d36900 con 0x7f54a8037040 2024-05-09T09:48:40.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.076+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 30 ==== osd_op_reply(136 notify.0 [watch unwatch cookie 93848035403328] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b804e060 con 0x7f54a8037040 2024-05-09T09:48:40.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.076+0000 7f54c0012980 20 remove_watcher() i=0 2024-05-09T09:48:40.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.076+0000 7f54c0012980 2 removed watcher, disabling cache 2024-05-09T09:48:40.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.076+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:137 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93848035407136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d086a0 con 0x555ab2cf4d50 2024-05-09T09:48:40.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.076+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 43 ==== osd_op_reply(137 notify.1 [watch unwatch cookie 93848035407136] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b804e060 con 0x555ab2cf4d50 2024-05-09T09:48:40.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.076+0000 7f54c0012980 20 remove_watcher() i=1 2024-05-09T09:48:40.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.076+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:138 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93848035401072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d086a0 con 0x555ab2cfe020 2024-05-09T09:48:40.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.080+0000 7f54bd32c640 1 -- 172.21.15.157:0/2694897254 <== osd.3 v2:172.21.15.157:6816/2487336710 32 ==== osd_op_reply(138 notify.2 [watch unwatch cookie 93848035401072] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54a800e620 con 0x555ab2cfe020 2024-05-09T09:48:40.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.080+0000 7f54c0012980 20 remove_watcher() i=2 2024-05-09T09:48:40.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.080+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:139 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93848035413520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d01d70 con 0x7f54a8037040 2024-05-09T09:48:40.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.080+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.2 v2:172.21.15.157:6800/354455204 31 ==== osd_op_reply(139 notify.3 [watch unwatch cookie 93848035413520] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b804e060 con 0x7f54a8037040 2024-05-09T09:48:40.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.080+0000 7f54c0012980 20 remove_watcher() i=3 2024-05-09T09:48:40.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.080+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:140 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93848035412016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d086a0 con 0x555ab2cf4d50 2024-05-09T09:48:40.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.084+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 <== osd.1 v2:172.21.15.157:6808/3930131338 44 ==== osd_op_reply(140 notify.4 [watch unwatch cookie 93848035412016] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b804e060 con 0x555ab2cf4d50 2024-05-09T09:48:40.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.084+0000 7f54c0012980 20 remove_watcher() i=4 2024-05-09T09:48:40.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.084+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:141 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93848035420192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d01d70 con 0x555ab2cf9740 2024-05-09T09:48:40.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.084+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 48 ==== osd_op_reply(141 notify.5 [watch unwatch cookie 93848035420192] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:40.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.084+0000 7f54c0012980 20 remove_watcher() i=5 2024-05-09T09:48:40.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.084+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:142 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93848035417920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d04830 con 0x555ab2cf9740 2024-05-09T09:48:40.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.088+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 49 ==== osd_op_reply(142 notify.6 [watch unwatch cookie 93848035417920] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:40.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.088+0000 7f54c0012980 20 remove_watcher() i=6 2024-05-09T09:48:40.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.088+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:143 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93848035426944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555ab2d086a0 con 0x555ab2cf9740 2024-05-09T09:48:40.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.088+0000 7f54bdb2d640 1 -- 172.21.15.157:0/2694897254 <== osd.0 v2:172.21.15.110:6800/231209037 50 ==== osd_op_reply(143 notify.7 [watch unwatch cookie 93848035426944] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54b00f5030 con 0x555ab2cf9740 2024-05-09T09:48:40.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.088+0000 7f54c0012980 20 remove_watcher() i=7 2024-05-09T09:48:40.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.088+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555ab2cf9740 msgr2=0x555ab2cfbb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:40.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.088+0000 7f54c0012980 1 --2- 172.21.15.157:0/2694897254 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555ab2cf9740 0x555ab2cfbb30 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:40.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.088+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555ab2cf4d50 msgr2=0x555ab2cf7210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:40.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.088+0000 7f54c0012980 1 --2- 172.21.15.157:0/2694897254 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555ab2cf4d50 0x555ab2cf7210 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:40.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.088+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f54a8037040 msgr2=0x7f54a8036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:40.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.088+0000 7f54c0012980 1 --2- 172.21.15.157:0/2694897254 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f54a8037040 0x7f54a8036410 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:40.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.088+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555ab2cfe020 msgr2=0x555ab2d00450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:40.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.088+0000 7f54c0012980 1 --2- 172.21.15.157:0/2694897254 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555ab2cfe020 0x555ab2d00450 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:40.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.088+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5388034bb0 msgr2=0x7f5388037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:40.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.088+0000 7f54c0012980 1 --2- 172.21.15.157:0/2694897254 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5388034bb0 0x7f5388037070 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f54a800bf60 tx=0x7f54a8010000 comp rx=0 tx=0).stop 2024-05-09T09:48:40.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.088+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2ce0e80 msgr2=0x555ab2ce81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:40.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.088+0000 7f54be32e640 1 -- 172.21.15.157:0/2694897254 reap_dead start 2024-05-09T09:48:40.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.088+0000 7f54c0012980 1 --2- 172.21.15.157:0/2694897254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2ce0e80 0x555ab2ce81e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f54b00e8000 tx=0x7f54b00ecfe0 comp rx=0 tx=0).stop 2024-05-09T09:48:40.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.088+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 shutdown_connections 2024-05-09T09:48:40.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.088+0000 7f54c0012980 1 --2- 172.21.15.157:0/2694897254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2ce0e80 0x555ab2ce81e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:40.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.088+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 >> 172.21.15.157:0/2694897254 conn(0x555ab2cdd200 msgr2=0x555ab2ce26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:40.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.088+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 shutdown_connections 2024-05-09T09:48:40.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.088+0000 7f54c0012980 1 -- 172.21.15.157:0/2694897254 wait complete. 2024-05-09T09:48:40.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.092+0000 7f54c0012980 1 -- 172.21.15.157:0/4251991937 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5398034c00 msgr2=0x7f53980370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:40.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.092+0000 7f54c0012980 1 --2- 172.21.15.157:0/4251991937 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5398034c00 0x7f53980370c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x555ab2ca5b00 tx=0x7f54a800f000 comp rx=0 tx=0).stop 2024-05-09T09:48:40.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.092+0000 7f54c0012980 1 -- 172.21.15.157:0/4251991937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2cd3fd0 msgr2=0x555ab2cd43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:40.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.092+0000 7f54c0012980 1 --2- 172.21.15.157:0/4251991937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2cd3fd0 0x555ab2cd43f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f54b00e3b90 tx=0x7f54b00a9460 comp rx=0 tx=0).stop 2024-05-09T09:48:40.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.092+0000 7f54c0012980 1 -- 172.21.15.157:0/4251991937 shutdown_connections 2024-05-09T09:48:40.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.092+0000 7f54c0012980 1 --2- 172.21.15.157:0/4251991937 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5398034c00 0x7f53980370c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:40.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.092+0000 7f54c0012980 1 --2- 172.21.15.157:0/4251991937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2cd3fd0 0x555ab2cd43f0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:40.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.092+0000 7f54c0012980 1 -- 172.21.15.157:0/4251991937 >> 172.21.15.157:0/4251991937 conn(0x555ab2cc8da0 msgr2=0x555ab2cc98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:40.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.092+0000 7f54c0012980 1 -- 172.21.15.157:0/4251991937 shutdown_connections 2024-05-09T09:48:40.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.092+0000 7f54c0012980 1 -- 172.21.15.157:0/4251991937 wait complete. 2024-05-09T09:48:40.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.092+0000 7f54c0012980 1 -- 172.21.15.157:0/901331196 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555ab2ca7550 msgr2=0x555ab2ca9940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:40.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.092+0000 7f54c0012980 1 --2- 172.21.15.157:0/901331196 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x555ab2ca7550 0x555ab2ca9940 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:40.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.092+0000 7f54c0012980 1 -- 172.21.15.157:0/901331196 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555ab2baeb00 msgr2=0x555ab2ca4c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:40.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.092+0000 7f54c0012980 1 --2- 172.21.15.157:0/901331196 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x555ab2baeb00 0x555ab2ca4c70 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:40.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.092+0000 7f54c0012980 1 -- 172.21.15.157:0/901331196 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555ab2cab470 msgr2=0x555ab2cad860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:40.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.092+0000 7f54c0012980 1 --2- 172.21.15.157:0/901331196 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x555ab2cab470 0x555ab2cad860 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:40.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.092+0000 7f54c0012980 1 -- 172.21.15.157:0/901331196 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f53a4034c00 msgr2=0x7f53a40370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:40.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.092+0000 7f54c0012980 1 --2- 172.21.15.157:0/901331196 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f53a4034c00 0x7f53a40370c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f54a8000f70 tx=0x7f54a80012c0 comp rx=0 tx=0).stop 2024-05-09T09:48:40.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.092+0000 7f54c0012980 1 -- 172.21.15.157:0/901331196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2b1fac0 msgr2=0x555ab2c9dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:40.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.092+0000 7f54c0012980 1 --2- 172.21.15.157:0/901331196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x555ab2b1fac0 0x555ab2c9dbc0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f54b0000f90 tx=0x7f54b0019810 comp rx=0 tx=0).stop 2024-05-09T09:48:40.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.092+0000 7f54be32e640 1 -- 172.21.15.157:0/901331196 reap_dead start 2024-05-09T09:48:40.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.092+0000 7f54c0012980 1 -- 172.21.15.157:0/901331196 shutdown_connections 2024-05-09T09:48:40.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.092+0000 7f54c0012980 1 -- 172.21.15.157:0/901331196 >> 172.21.15.157:0/901331196 conn(0x555ab2ba60e0 msgr2=0x555ab2c91200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:40.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.092+0000 7f54c0012980 1 -- 172.21.15.157:0/901331196 shutdown_connections 2024-05-09T09:48:40.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:40.092+0000 7f54c0012980 1 -- 172.21.15.157:0/901331196 wait complete. 2024-05-09T09:48:40.108 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-05-09T09:48:39.776600Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:48:39.776575Z', 'tags': [], 'group_ids': []} 2024-05-09T09:48:45.121 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-05-09T09:48:45.122 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-05-09T09:48:45.122 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-05-09T09:48:45.122 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-05-09T09:48:45.122 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-05-09T09:48:45.170 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:48:45.170 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:48:45.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.168+0000 7f8fae568980 1 Processor -- start 2024-05-09T09:48:45.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.168+0000 7f8fae568980 1 -- start start 2024-05-09T09:48:45.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.168+0000 7f8fae568980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5598b2e57af0 0x5598b2ee43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.168+0000 7f8fae568980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5598b2d99440 con 0x5598b2ee4920 2024-05-09T09:48:45.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.168+0000 7f8fae568980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5598b2d845f0 con 0x5598b2e57af0 2024-05-09T09:48:45.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.168+0000 7f8fac083640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5598b2e57af0 0x5598b2ee43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.168+0000 7f8fab882640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x5598b2ee4920 0x5598b2ee6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:49200/0 (socket says 172.21.15.157:49200) 2024-05-09T09:48:45.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.168+0000 7f8fab882640 1 -- 172.21.15.157:0/2464963383 learned_addr learned my addr 172.21.15.157:0/2464963383 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:48:45.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.168+0000 7f8fac083640 1 -- 172.21.15.157:0/2464963383 >> v1:172.21.15.110:6789/0 conn(0x5598b2ee4920 legacy=0x5598b2ee6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.168+0000 7f8fac083640 1 -- 172.21.15.157:0/2464963383 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598b2d8f990 con 0x5598b2e57af0 2024-05-09T09:48:45.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.172+0000 7f8fac083640 1 --2- 172.21.15.157:0/2464963383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b2e57af0 0x5598b2ee43e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00a420 tx=0x7f8f9c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33574bba83275b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.172+0000 7f8fab081640 1 -- 172.21.15.157:0/2464963383 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c0af070 con 0x5598b2e57af0 2024-05-09T09:48:45.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.172+0000 7f8fab081640 1 -- 172.21.15.157:0/2464963383 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9c0aa530 con 0x5598b2e57af0 2024-05-09T09:48:45.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.172+0000 7f8fab081640 1 -- 172.21.15.157:0/2464963383 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c0aa850 con 0x5598b2e57af0 2024-05-09T09:48:45.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.172+0000 7f8fae568980 1 -- 172.21.15.157:0/2464963383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b2e57af0 msgr2=0x5598b2ee43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.172+0000 7f8fae568980 1 --2- 172.21.15.157:0/2464963383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b2e57af0 0x5598b2ee43e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00a420 tx=0x7f8f9c01afd0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.172+0000 7f8fae568980 1 -- 172.21.15.157:0/2464963383 shutdown_connections 2024-05-09T09:48:45.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.172+0000 7f8fae568980 1 --2- 172.21.15.157:0/2464963383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b2e57af0 0x5598b2ee43e0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.172+0000 7f8fae568980 1 -- 172.21.15.157:0/2464963383 >> 172.21.15.157:0/2464963383 conn(0x5598b2ede110 msgr2=0x5598b2ee0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:45.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.172+0000 7f8fae568980 1 -- 172.21.15.157:0/2464963383 shutdown_connections 2024-05-09T09:48:45.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.172+0000 7f8fae568980 1 -- 172.21.15.157:0/2464963383 wait complete. 2024-05-09T09:48:45.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.188+0000 7f8fae568980 1 Processor -- start 2024-05-09T09:48:45.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.188+0000 7f8fae568980 1 -- start start 2024-05-09T09:48:45.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.188+0000 7f8fae568980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b2e57af0 0x5598b2fd56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.188+0000 7f8fae568980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5598b2de6fe0 con 0x5598b2e57af0 2024-05-09T09:48:45.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.188+0000 7f8fac083640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b2e57af0 0x5598b2fd56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.188+0000 7f8fac083640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b2e57af0 0x5598b2fd56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:60238/0 (socket says 172.21.15.157:60238) 2024-05-09T09:48:45.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.188+0000 7f8fac083640 1 -- 172.21.15.157:0/1882471838 learned_addr learned my addr 172.21.15.157:0/1882471838 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:45.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.188+0000 7f8fac083640 1 -- 172.21.15.157:0/1882471838 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598b2d6bae0 con 0x5598b2e57af0 2024-05-09T09:48:45.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.192+0000 7f8fac083640 1 --2- 172.21.15.157:0/1882471838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b2e57af0 0x5598b2fd56b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c018c00 tx=0x7f8f9c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1aa78b77749732 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.192+0000 7f8e9a60c640 1 -- 172.21.15.157:0/1882471838 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c0af050 con 0x5598b2e57af0 2024-05-09T09:48:45.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.192+0000 7f8e9a60c640 1 -- 172.21.15.157:0/1882471838 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9c0b0040 con 0x5598b2e57af0 2024-05-09T09:48:45.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.192+0000 7f8e9a60c640 1 -- 172.21.15.157:0/1882471838 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c0aabb0 con 0x5598b2e57af0 2024-05-09T09:48:45.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.192+0000 7f8fae568980 1 -- 172.21.15.157:0/1882471838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b2e57af0 msgr2=0x5598b2fd56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.192+0000 7f8fae568980 1 --2- 172.21.15.157:0/1882471838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b2e57af0 0x5598b2fd56b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c018c00 tx=0x7f8f9c0033b0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.192+0000 7f8fae568980 1 -- 172.21.15.157:0/1882471838 shutdown_connections 2024-05-09T09:48:45.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.192+0000 7f8fae568980 1 --2- 172.21.15.157:0/1882471838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b2e57af0 0x5598b2fd56b0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.192+0000 7f8fae568980 1 -- 172.21.15.157:0/1882471838 >> 172.21.15.157:0/1882471838 conn(0x5598b2ede110 msgr2=0x5598b2fd1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:45.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.192+0000 7f8fae568980 1 -- 172.21.15.157:0/1882471838 shutdown_connections 2024-05-09T09:48:45.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.192+0000 7f8fae568980 1 -- 172.21.15.157:0/1882471838 wait complete. 2024-05-09T09:48:45.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.192+0000 7f8fae568980 1 Processor -- start 2024-05-09T09:48:45.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.192+0000 7f8fae568980 1 -- start start 2024-05-09T09:48:45.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.192+0000 7f8fae568980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b2e57af0 0x5598b2fdc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.192+0000 7f8fae568980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5598b2ef3d20 con 0x5598b2e57af0 2024-05-09T09:48:45.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.192+0000 7f8fac083640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b2e57af0 0x5598b2fdc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.192+0000 7f8fac083640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b2e57af0 0x5598b2fdc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:60242/0 (socket says 172.21.15.157:60242) 2024-05-09T09:48:45.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.192+0000 7f8fac083640 1 -- 172.21.15.157:0/2976045424 learned_addr learned my addr 172.21.15.157:0/2976045424 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:45.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.192+0000 7f8fac083640 1 -- 172.21.15.157:0/2976045424 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598b2fdcd40 con 0x5598b2e57af0 2024-05-09T09:48:45.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.192+0000 7f8fac083640 1 --2- 172.21.15.157:0/2976045424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b2e57af0 0x5598b2fdc800 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0b8040 tx=0x7f8f9c019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.192+0000 7f8e98e09640 1 -- 172.21.15.157:0/2976045424 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c0c5070 con 0x5598b2e57af0 2024-05-09T09:48:45.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.192+0000 7f8e98e09640 1 -- 172.21.15.157:0/2976045424 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9c0b6a40 con 0x5598b2e57af0 2024-05-09T09:48:45.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.192+0000 7f8e98e09640 1 -- 172.21.15.157:0/2976045424 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c0b6d60 con 0x5598b2e57af0 2024-05-09T09:48:45.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.196+0000 7f8fae568980 1 -- 172.21.15.157:0/2976045424 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598b2fdcfd0 con 0x5598b2e57af0 2024-05-09T09:48:45.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.196+0000 7f8fae568980 1 -- 172.21.15.157:0/2976045424 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598b2fdfc60 con 0x5598b2e57af0 2024-05-09T09:48:45.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.196+0000 7f8e98e09640 1 -- 172.21.15.157:0/2976045424 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f8f9c0c8070 con 0x5598b2e57af0 2024-05-09T09:48:45.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.196+0000 7f8e98e09640 1 --2- 172.21.15.157:0/2976045424 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8e94034bb0 0x7f8e94037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.196+0000 7f8e98e09640 1 -- 172.21.15.157:0/2976045424 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f8f9c0bb070 con 0x5598b2e57af0 2024-05-09T09:48:45.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.196+0000 7f8fab882640 1 --2- 172.21.15.157:0/2976045424 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8e94034bb0 0x7f8e94037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.196+0000 7f8fae568980 1 --2- 172.21.15.157:0/2976045424 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5598b2ee4920 0x5598b2fe3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.196+0000 7f8fae568980 1 -- 172.21.15.157:0/2976045424 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598b2fe3d90 con 0x5598b2ee4920 2024-05-09T09:48:45.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.196+0000 7f8fac884640 1 --2- 172.21.15.157:0/2976045424 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5598b2ee4920 0x5598b2fe3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.196+0000 7f8fab882640 1 --2- 172.21.15.157:0/2976045424 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8e94034bb0 0x7f8e94037070 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8f94000f70 tx=0x7f8f940012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.196+0000 7f8fac884640 1 --2- 172.21.15.157:0/2976045424 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5598b2ee4920 0x5598b2fe3740 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.196+0000 7f8fac884640 1 -- 172.21.15.157:0/2976045424 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fa40083f0 con 0x5598b2ee4920 2024-05-09T09:48:45.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.196+0000 7f8fae568980 1 -- 172.21.15.157:0/2976045424 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598b2fe0e60 con 0x5598b2ee4920 2024-05-09T09:48:45.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.196+0000 7f8fac884640 1 -- 172.21.15.157:0/2976045424 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8fa40083f0 con 0x5598b2ee4920 2024-05-09T09:48:45.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.196+0000 7f8fae568980 1 --2- 172.21.15.157:0/2976045424 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5598b2fe60f0 0x5598b2fe84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.196+0000 7f8fae568980 1 -- 172.21.15.157:0/2976045424 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598b2fe8bb0 con 0x5598b2fe60f0 2024-05-09T09:48:45.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.196+0000 7f8fac083640 1 --2- 172.21.15.157:0/2976045424 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5598b2fe60f0 0x5598b2fe84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.200+0000 7f8fac083640 1 --2- 172.21.15.157:0/2976045424 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5598b2fe60f0 0x5598b2fe84e0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.200+0000 7f8fac083640 1 -- 172.21.15.157:0/2976045424 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8f9c0d1070 con 0x5598b2fe60f0 2024-05-09T09:48:45.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.200+0000 7f8fae568980 1 -- 172.21.15.157:0/2976045424 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598b2fe4f90 con 0x5598b2ee4920 2024-05-09T09:48:45.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.200+0000 7f8fac884640 1 -- 172.21.15.157:0/2976045424 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8fa40083f0 con 0x5598b2ee4920 2024-05-09T09:48:45.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.200+0000 7f8fae568980 1 --2- 172.21.15.157:0/2976045424 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5598b2fea010 0x5598b2fec400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.200+0000 7f8fae568980 1 -- 172.21.15.157:0/2976045424 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598b2fecb00 con 0x5598b2fea010 2024-05-09T09:48:45.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.200+0000 7f8fab882640 1 --2- 172.21.15.157:0/2976045424 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5598b2fea010 0x5598b2fec400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.200+0000 7f8fab882640 1 --2- 172.21.15.157:0/2976045424 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5598b2fea010 0x5598b2fec400 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.200+0000 7f8fab882640 1 -- 172.21.15.157:0/2976045424 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b2fea010 2024-05-09T09:48:45.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.204+0000 7f8fae568980 1 Processor -- start 2024-05-09T09:48:45.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.204+0000 7f8fae568980 1 -- start start 2024-05-09T09:48:45.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.204+0000 7f8fae568980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b3012b80 0x5598b3012fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.204+0000 7f8fae568980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5598b2deb020 con 0x5598b3012b80 2024-05-09T09:48:45.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.204+0000 7f8fac083640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b3012b80 0x5598b3012fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.204+0000 7f8fac083640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b3012b80 0x5598b3012fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:60246/0 (socket says 172.21.15.157:60246) 2024-05-09T09:48:45.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.204+0000 7f8fac083640 1 -- 172.21.15.157:0/3009291186 learned_addr learned my addr 172.21.15.157:0/3009291186 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:45.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.204+0000 7f8fac083640 1 -- 172.21.15.157:0/3009291186 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598b30134e0 con 0x5598b3012b80 2024-05-09T09:48:45.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.204+0000 7f8fac083640 1 --2- 172.21.15.157:0/3009291186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b3012b80 0x5598b3012fa0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0e3a10 tx=0x7f8f9c0cbe30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.204+0000 7f8e90b9e640 1 -- 172.21.15.157:0/3009291186 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c0ea070 con 0x5598b3012b80 2024-05-09T09:48:45.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.204+0000 7f8e90b9e640 1 -- 172.21.15.157:0/3009291186 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9c0e2610 con 0x5598b3012b80 2024-05-09T09:48:45.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.204+0000 7f8fae568980 1 -- 172.21.15.157:0/3009291186 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598b3013f70 con 0x5598b3012b80 2024-05-09T09:48:45.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.204+0000 7f8e90b9e640 1 -- 172.21.15.157:0/3009291186 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c0c8ac0 con 0x5598b3012b80 2024-05-09T09:48:45.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.204+0000 7f8fae568980 1 -- 172.21.15.157:0/3009291186 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598b3014450 con 0x5598b3012b80 2024-05-09T09:48:45.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.208+0000 7f8e90b9e640 1 -- 172.21.15.157:0/3009291186 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f8f9c0ed070 con 0x5598b3012b80 2024-05-09T09:48:45.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.208+0000 7f8e90b9e640 1 --2- 172.21.15.157:0/3009291186 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8e84034bb0 0x7f8e84037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.208+0000 7f8e90b9e640 1 -- 172.21.15.157:0/3009291186 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f8f9c0e1030 con 0x5598b3012b80 2024-05-09T09:48:45.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.208+0000 7f8fab882640 1 --2- 172.21.15.157:0/3009291186 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8e84034bb0 0x7f8e84037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.208+0000 7f8fae568980 1 Processor -- start 2024-05-09T09:48:45.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.208+0000 7f8fae568980 1 -- start start 2024-05-09T09:48:45.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.208+0000 7f8fae568980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b301fb80 0x5598b301ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.208+0000 7f8fae568980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5598b2fd5d40 con 0x5598b301fb80 2024-05-09T09:48:45.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.208+0000 7f8fab882640 1 --2- 172.21.15.157:0/3009291186 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8e84034bb0 0x7f8e84037070 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400bf60 tx=0x7f8f9400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.208+0000 7f8fac083640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b301fb80 0x5598b301ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.208+0000 7f8fac083640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b301fb80 0x5598b301ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:60258/0 (socket says 172.21.15.157:60258) 2024-05-09T09:48:45.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.208+0000 7f8fac083640 1 -- 172.21.15.157:0/4052229508 learned_addr learned my addr 172.21.15.157:0/4052229508 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:45.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.208+0000 7f8fac083640 1 -- 172.21.15.157:0/4052229508 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598b3020570 con 0x5598b301fb80 2024-05-09T09:48:45.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.208+0000 7f8fac083640 1 --2- 172.21.15.157:0/4052229508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b301fb80 0x5598b301ffa0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0c2fd0 tx=0x7f8f9c0cb790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e484dc080b0be54 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.208+0000 7f8e8a7fc640 1 -- 172.21.15.157:0/4052229508 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c0c4e70 con 0x5598b301fb80 2024-05-09T09:48:45.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.208+0000 7f8e8a7fc640 1 -- 172.21.15.157:0/4052229508 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9c0c0df0 con 0x5598b301fb80 2024-05-09T09:48:45.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.208+0000 7f8e8a7fc640 1 -- 172.21.15.157:0/4052229508 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c0bfe20 con 0x5598b301fb80 2024-05-09T09:48:45.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.208+0000 7f8fae568980 1 -- 172.21.15.157:0/4052229508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b301fb80 msgr2=0x5598b301ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.208+0000 7f8fae568980 1 --2- 172.21.15.157:0/4052229508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b301fb80 0x5598b301ffa0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0c2fd0 tx=0x7f8f9c0cb790 comp rx=0 tx=0).stop 2024-05-09T09:48:45.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.208+0000 7f8fae568980 1 -- 172.21.15.157:0/4052229508 shutdown_connections 2024-05-09T09:48:45.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.208+0000 7f8fae568980 1 --2- 172.21.15.157:0/4052229508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b301fb80 0x5598b301ffa0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.208+0000 7f8fae568980 1 -- 172.21.15.157:0/4052229508 >> 172.21.15.157:0/4052229508 conn(0x5598b301bf00 msgr2=0x5598b3019f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:45.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.208+0000 7f8fae568980 1 -- 172.21.15.157:0/4052229508 shutdown_connections 2024-05-09T09:48:45.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.208+0000 7f8fae568980 1 -- 172.21.15.157:0/4052229508 wait complete. 2024-05-09T09:48:45.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.208+0000 7f8fae568980 1 Processor -- start 2024-05-09T09:48:45.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.212+0000 7f8fae568980 1 -- start start 2024-05-09T09:48:45.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.212+0000 7f8fae568980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b301fb80 0x5598b3026ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.212+0000 7f8fae568980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5598b3020c40 con 0x5598b301fb80 2024-05-09T09:48:45.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.212+0000 7f8fac083640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b301fb80 0x5598b3026ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.212+0000 7f8fac083640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b301fb80 0x5598b3026ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:60264/0 (socket says 172.21.15.157:60264) 2024-05-09T09:48:45.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.212+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 learned_addr learned my addr 172.21.15.157:0/4248022641 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:45.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.212+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598b3027430 con 0x5598b301fb80 2024-05-09T09:48:45.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.212+0000 7f8fac083640 1 --2- 172.21.15.157:0/4248022641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b301fb80 0x5598b3026ef0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0d9990 tx=0x7f8f9c0e5e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.212+0000 7f8e88ff9640 1 -- 172.21.15.157:0/4248022641 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c10c070 con 0x5598b301fb80 2024-05-09T09:48:45.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.212+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598b3027430 con 0x5598b301fb80 2024-05-09T09:48:45.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.212+0000 7f8e88ff9640 1 -- 172.21.15.157:0/4248022641 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9c0e50d0 con 0x5598b301fb80 2024-05-09T09:48:45.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.212+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598b30278b0 con 0x5598b301fb80 2024-05-09T09:48:45.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.212+0000 7f8e88ff9640 1 -- 172.21.15.157:0/4248022641 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f9c0bfe20 con 0x5598b301fb80 2024-05-09T09:48:45.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.212+0000 7f8e88ff9640 1 -- 172.21.15.157:0/4248022641 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f8f9c105040 con 0x5598b301fb80 2024-05-09T09:48:45.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.212+0000 7f8e88ff9640 1 --2- 172.21.15.157:0/4248022641 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8e74034bb0 0x7f8e74037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.212+0000 7f8e88ff9640 1 -- 172.21.15.157:0/4248022641 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f8f9c0fa070 con 0x5598b301fb80 2024-05-09T09:48:45.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.212+0000 7f8fae568980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.212+0000 7f8fab882640 1 --2- 172.21.15.157:0/4248022641 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8e74034bb0 0x7f8e74037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.212+0000 7f8fae568980 1 --2- 172.21.15.157:0/4248022641 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5598b3033aa0 0x5598b3035f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.212+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598b30366b0 con 0x5598b3033aa0 2024-05-09T09:48:45.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fac884640 1 --2- 172.21.15.157:0/4248022641 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5598b3033aa0 0x5598b3035f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fab882640 1 --2- 172.21.15.157:0/4248022641 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8e74034bb0 0x7f8e74037070 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x5598b2fe46a0 tx=0x7f8f94010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fac884640 1 --2- 172.21.15.157:0/4248022641 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5598b3033aa0 0x5598b3035f60 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fa40083f0 con 0x5598b3033aa0 2024-05-09T09:48:45.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fae568980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:45.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fae568980 20 realm 2024-05-09T09:48:45.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fae568980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598b3036ac0 con 0x5598b3033aa0 2024-05-09T09:48:45.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fa40083f0 con 0x5598b3033aa0 2024-05-09T09:48:45.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fae568980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:45.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fae568980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:48:45.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fae568980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037390 con 0x5598b3033aa0 2024-05-09T09:48:45.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fa40083f0 con 0x5598b3033aa0 2024-05-09T09:48:45.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fae568980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:45.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fae568980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x5598b3033aa0 2024-05-09T09:48:45.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8fa40083f0 con 0x5598b3033aa0 2024-05-09T09:48:45.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fae568980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:45.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fae568980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fae568980 1 --2- 172.21.15.157:0/4248022641 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5598b3038490 0x5598b303a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598b303ae90 con 0x5598b3038490 2024-05-09T09:48:45.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fac083640 1 --2- 172.21.15.157:0/4248022641 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5598b3038490 0x5598b303a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fac083640 1 --2- 172.21.15.157:0/4248022641 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5598b3038490 0x5598b303a880 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fae568980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:48:45.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fae568980 20 searching for the correct realm 2024-05-09T09:48:45.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fae568980 1 --2- 172.21.15.157:0/4248022641 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5598b303cde0 0x5598b303f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b303f890 con 0x5598b303cde0 2024-05-09T09:48:45.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fab882640 1 --2- 172.21.15.157:0/4248022641 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5598b303cde0 0x5598b303f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.216+0000 7f8fab882640 1 --2- 172.21.15.157:0/4248022641 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5598b303cde0 0x5598b303f210 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.220+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b303cde0 2024-05-09T09:48:45.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.220+0000 7f8fab882640 1 --2- 172.21.15.157:0/4248022641 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f8f94037040 0x7f8f94036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.220+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b303f890 con 0x7f8f94037040 2024-05-09T09:48:45.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.220+0000 7f8fac884640 1 --2- 172.21.15.157:0/4248022641 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f8f94037040 0x7f8f94036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.220+0000 7f8fac884640 1 --2- 172.21.15.157:0/4248022641 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f8f94037040 0x7f8f94036410 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.220+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa40083f0 con 0x7f8f94037040 2024-05-09T09:48:45.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.220+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x5598b3038490 2024-05-09T09:48:45.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.220+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.220+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x5598b3033aa0 2024-05-09T09:48:45.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.220+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa40083f0 con 0x5598b3033aa0 2024-05-09T09:48:45.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.220+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x5598b3033aa0 2024-05-09T09:48:45.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.220+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa4026040 con 0x5598b3033aa0 2024-05-09T09:48:45.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.220+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x5598b3038490 2024-05-09T09:48:45.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.220+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.220+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x5598b3038490 2024-05-09T09:48:45.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.220+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.220+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x7f8f94037040 2024-05-09T09:48:45.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.224+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa4026040 con 0x7f8f94037040 2024-05-09T09:48:45.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.224+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x5598b303cde0 2024-05-09T09:48:45.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.224+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b303cde0 2024-05-09T09:48:45.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.224+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x5598b3033aa0 2024-05-09T09:48:45.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.224+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa4026040 con 0x5598b3033aa0 2024-05-09T09:48:45.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.224+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x5598b3038490 2024-05-09T09:48:45.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.224+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.224+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x5598b3033aa0 2024-05-09T09:48:45.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.224+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa4026040 con 0x5598b3033aa0 2024-05-09T09:48:45.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.224+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x7f8f94037040 2024-05-09T09:48:45.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.224+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8fa4026040 con 0x7f8f94037040 2024-05-09T09:48:45.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.224+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x5598b303cde0 2024-05-09T09:48:45.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.224+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b303cde0 2024-05-09T09:48:45.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.224+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x5598b303cde0 2024-05-09T09:48:45.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.224+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b303cde0 2024-05-09T09:48:45.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.224+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x5598b3038490 2024-05-09T09:48:45.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.224+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.224+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x5598b303cde0 2024-05-09T09:48:45.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.224+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b303cde0 2024-05-09T09:48:45.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.224+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x5598b303cde0 2024-05-09T09:48:45.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.224+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b303cde0 2024-05-09T09:48:45.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.224+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x5598b3033aa0 2024-05-09T09:48:45.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.228+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa4026040 con 0x5598b3033aa0 2024-05-09T09:48:45.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.228+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x5598b3033aa0 2024-05-09T09:48:45.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.228+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8fa4026040 con 0x5598b3033aa0 2024-05-09T09:48:45.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.228+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x5598b3038490 2024-05-09T09:48:45.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.228+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.228+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x5598b303cde0 2024-05-09T09:48:45.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.228+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b303cde0 2024-05-09T09:48:45.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.228+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x7f8f94037040 2024-05-09T09:48:45.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.228+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa4026040 con 0x7f8f94037040 2024-05-09T09:48:45.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.228+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x5598b3033aa0 2024-05-09T09:48:45.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.228+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa4026040 con 0x5598b3033aa0 2024-05-09T09:48:45.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.228+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x5598b3038490 2024-05-09T09:48:45.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.228+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.228+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x5598b303cde0 2024-05-09T09:48:45.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.228+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b303cde0 2024-05-09T09:48:45.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.228+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x5598b3038490 2024-05-09T09:48:45.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.228+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x7f8f94037040 2024-05-09T09:48:45.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa4026040 con 0x7f8f94037040 2024-05-09T09:48:45.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x5598b303cde0 2024-05-09T09:48:45.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b303cde0 2024-05-09T09:48:45.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x5598b3038490 2024-05-09T09:48:45.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x5598b3033aa0 2024-05-09T09:48:45.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8fa4026040 con 0x5598b3033aa0 2024-05-09T09:48:45.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598b3037730 con 0x7f8f94037040 2024-05-09T09:48:45.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa4026040 con 0x7f8f94037040 2024-05-09T09:48:45.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fae568980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:48:45.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fae568980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:48:45.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fae568980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:48:45.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fae568980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:48:45.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fae568980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:48:45.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fae568980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:48:45.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fae568980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598b303b750 con 0x5598b3033aa0 2024-05-09T09:48:45.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fa4026040 con 0x5598b3033aa0 2024-05-09T09:48:45.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fae568980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:45.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fae568980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598b303b750 con 0x5598b3033aa0 2024-05-09T09:48:45.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8fa4026040 con 0x5598b3033aa0 2024-05-09T09:48:45.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fae568980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:45.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fae568980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598b303b750 con 0x5598b303cde0 2024-05-09T09:48:45.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b303cde0 2024-05-09T09:48:45.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fae568980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:48:45.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fae568980 20 zone default found 2024-05-09T09:48:45.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fae568980 4 Realm: () 2024-05-09T09:48:45.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fae568980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:48:45.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fae568980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:48:45.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fae568980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:48:45.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fae568980 20 zonegroup default 2024-05-09T09:48:45.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fae568980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598b303c160 con 0x5598b3038490 2024-05-09T09:48:45.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fae568980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:45.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fae568980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598b3041ba0 con 0x5598b303cde0 2024-05-09T09:48:45.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.232+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b303cde0 2024-05-09T09:48:45.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.236+0000 7f8fae568980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:45.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.236+0000 7f8fae568980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.236+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598b3041f40 con 0x5598b303cde0 2024-05-09T09:48:45.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.236+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b303cde0 2024-05-09T09:48:45.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.236+0000 7f8fae568980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:45.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.236+0000 7f8fae568980 20 started sync module instance, tier type = 2024-05-09T09:48:45.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.236+0000 7f8fae568980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:48:45.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.236+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3040fe0 con 0x7f8f94037040 2024-05-09T09:48:45.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.236+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa4026040 con 0x7f8f94037040 2024-05-09T09:48:45.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.236+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94114326778880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3040fe0 con 0x7f8f94037040 2024-05-09T09:48:45.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.236+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3042810 con 0x5598b3033aa0 2024-05-09T09:48:45.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.236+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94114326778880] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa4036040 con 0x7f8f94037040 2024-05-09T09:48:45.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.240+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa4036040 con 0x5598b3033aa0 2024-05-09T09:48:45.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.240+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94114326782688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3040fe0 con 0x5598b3033aa0 2024-05-09T09:48:45.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.240+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3043220 con 0x5598b303cde0 2024-05-09T09:48:45.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.240+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94114326782688] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa4036040 con 0x5598b3033aa0 2024-05-09T09:48:45.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.240+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b303cde0 2024-05-09T09:48:45.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.240+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94114326776624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3040f50 con 0x5598b303cde0 2024-05-09T09:48:45.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.240+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3043f70 con 0x7f8f94037040 2024-05-09T09:48:45.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.244+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa4036040 con 0x7f8f94037040 2024-05-09T09:48:45.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.244+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94114326789104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3044810 con 0x7f8f94037040 2024-05-09T09:48:45.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.244+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b30451d0 con 0x5598b3033aa0 2024-05-09T09:48:45.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.244+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94114326776624] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b303cde0 2024-05-09T09:48:45.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.244+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94114326789104] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa4036040 con 0x7f8f94037040 2024-05-09T09:48:45.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.244+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa4036040 con 0x5598b3033aa0 2024-05-09T09:48:45.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.244+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94114326793504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3044780 con 0x5598b3033aa0 2024-05-09T09:48:45.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.244+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3045140 con 0x5598b3038490 2024-05-09T09:48:45.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.248+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94114326793504] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa4036040 con 0x5598b3033aa0 2024-05-09T09:48:45.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.248+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.248+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94114326791136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3045aa0 con 0x5598b3038490 2024-05-09T09:48:45.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.248+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b30462f0 con 0x5598b3038490 2024-05-09T09:48:45.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.248+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94114326791136] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.248+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.248+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94114326795760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3046b40 con 0x5598b3038490 2024-05-09T09:48:45.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.248+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3047500 con 0x5598b3038490 2024-05-09T09:48:45.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.252+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94114326795760] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.252+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.252+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94114326800288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3047500 con 0x5598b3038490 2024-05-09T09:48:45.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.252+0000 7f8fae568980 20 add_watcher() i=0 2024-05-09T09:48:45.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.252+0000 7f8fae568980 20 add_watcher() i=1 2024-05-09T09:48:45.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.252+0000 7f8fae568980 20 add_watcher() i=2 2024-05-09T09:48:45.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.252+0000 7f8fae568980 20 add_watcher() i=3 2024-05-09T09:48:45.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.252+0000 7f8fae568980 20 add_watcher() i=4 2024-05-09T09:48:45.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.252+0000 7f8fae568980 20 add_watcher() i=5 2024-05-09T09:48:45.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.252+0000 7f8fae568980 20 add_watcher() i=6 2024-05-09T09:48:45.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.252+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94114326800288] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.252+0000 7f8fae568980 20 add_watcher() i=7 2024-05-09T09:48:45.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.252+0000 7f8fae568980 2 all 8 watchers are set, enabling cache 2024-05-09T09:48:45.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.252+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598b304a7f0 con 0x5598b3033aa0 2024-05-09T09:48:45.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.256+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8fa4036040 con 0x5598b3033aa0 2024-05-09T09:48:45.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.256+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94114326802880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3047a90 con 0x5598b3033aa0 2024-05-09T09:48:45.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.256+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94114326802880] v32'385 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8fa4036040 con 0x5598b3033aa0 2024-05-09T09:48:45.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.256+0000 7f8e61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:45.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.256+0000 7f8fae568980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:48:45.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.256+0000 7f8fae568980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:48:45.260 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.256+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3049fd0 con 0x5598b3033aa0 2024-05-09T09:48:45.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.260+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'90 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8fa4036040 con 0x5598b3033aa0 2024-05-09T09:48:45.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.260+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b30538b0 con 0x5598b3038490 2024-05-09T09:48:45.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.260+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'84 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.260+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b30538b0 con 0x5598b303cde0 2024-05-09T09:48:45.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.264+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'83 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b303cde0 2024-05-09T09:48:45.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.264+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b30538b0 con 0x5598b3033aa0 2024-05-09T09:48:45.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.264+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'386 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8fa4036040 con 0x5598b3033aa0 2024-05-09T09:48:45.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.264+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3054310 con 0x7f8f94037040 2024-05-09T09:48:45.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.264+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'239 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8fa4036040 con 0x7f8f94037040 2024-05-09T09:48:45.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.264+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3052010 con 0x5598b303cde0 2024-05-09T09:48:45.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.268+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'160 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b303cde0 2024-05-09T09:48:45.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.268+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3052010 con 0x5598b3033aa0 2024-05-09T09:48:45.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.268+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'85 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8fa4036040 con 0x5598b3033aa0 2024-05-09T09:48:45.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.268+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3054e70 con 0x5598b3038490 2024-05-09T09:48:45.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.272+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'159 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.272+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3054e70 con 0x7f8f94037040 2024-05-09T09:48:45.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.276+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'83 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8fa4036040 con 0x7f8f94037040 2024-05-09T09:48:45.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.276+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3054e70 con 0x5598b303cde0 2024-05-09T09:48:45.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.276+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'89 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b303cde0 2024-05-09T09:48:45.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.276+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3055420 con 0x7f8f94037040 2024-05-09T09:48:45.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.276+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'240 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fa4036040 con 0x7f8f94037040 2024-05-09T09:48:45.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.276+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b30553b0 con 0x5598b3038490 2024-05-09T09:48:45.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.280+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'87 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.280+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b30553b0 con 0x7f8f94037040 2024-05-09T09:48:45.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.280+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'83 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fa4036040 con 0x7f8f94037040 2024-05-09T09:48:45.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.280+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b30553b0 con 0x5598b3038490 2024-05-09T09:48:45.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.284+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'165 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.284+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b30553b0 con 0x5598b3033aa0 2024-05-09T09:48:45.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.284+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'387 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fa4036040 con 0x5598b3033aa0 2024-05-09T09:48:45.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.284+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b30553b0 con 0x5598b303cde0 2024-05-09T09:48:45.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.288+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'233 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b303cde0 2024-05-09T09:48:45.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.288+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b30553b0 con 0x7f8f94037040 2024-05-09T09:48:45.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.288+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'241 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fa4036040 con 0x7f8f94037040 2024-05-09T09:48:45.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.288+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b30553b0 con 0x5598b303cde0 2024-05-09T09:48:45.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.292+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'83 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b303cde0 2024-05-09T09:48:45.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.292+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b30553b0 con 0x5598b3033aa0 2024-05-09T09:48:45.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.292+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'91 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fa4036040 con 0x5598b3033aa0 2024-05-09T09:48:45.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.292+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b30553b0 con 0x5598b3033aa0 2024-05-09T09:48:45.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.292+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'388 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fa4036040 con 0x5598b3033aa0 2024-05-09T09:48:45.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.296+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b30553b0 con 0x5598b303cde0 2024-05-09T09:48:45.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.296+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'234 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b303cde0 2024-05-09T09:48:45.300 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.296+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3055b90 con 0x7f8f94037040 2024-05-09T09:48:45.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.296+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'95 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fa4036040 con 0x7f8f94037040 2024-05-09T09:48:45.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.296+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3055b90 con 0x5598b303cde0 2024-05-09T09:48:45.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.300+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'85 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b303cde0 2024-05-09T09:48:45.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.300+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3055b90 con 0x5598b303cde0 2024-05-09T09:48:45.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.300+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'89 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b303cde0 2024-05-09T09:48:45.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.300+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3055b90 con 0x5598b303cde0 2024-05-09T09:48:45.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.300+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'80 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b303cde0 2024-05-09T09:48:45.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.304+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3055b90 con 0x5598b303cde0 2024-05-09T09:48:45.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.304+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'161 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b303cde0 2024-05-09T09:48:45.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.304+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3055b90 con 0x5598b3038490 2024-05-09T09:48:45.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.304+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'85 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.308+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3055b90 con 0x5598b303cde0 2024-05-09T09:48:45.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.308+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'83 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b303cde0 2024-05-09T09:48:45.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.308+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3055b90 con 0x5598b3038490 2024-05-09T09:48:45.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.312+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'160 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.312+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3055b90 con 0x5598b303cde0 2024-05-09T09:48:45.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.312+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'235 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b303cde0 2024-05-09T09:48:45.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.312+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3055b90 con 0x5598b3038490 2024-05-09T09:48:45.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.316+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'166 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.316+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3055b90 con 0x7f8f94037040 2024-05-09T09:48:45.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.316+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'89 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fa4036040 con 0x7f8f94037040 2024-05-09T09:48:45.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.316+0000 7f8e60fe1640 20 reqs_thread_entry: start 2024-05-09T09:48:45.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.320+0000 7f8fae568980 20 init_complete bucket index max shards: 11 2024-05-09T09:48:45.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.320+0000 7f8e59ffb640 20 reqs_thread_entry: start 2024-05-09T09:48:45.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.320+0000 7f8fae568980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-09T09:48:45.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.320+0000 7f8fae568980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.320+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598b3071210 con 0x5598b3038490 2024-05-09T09:48:45.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.320+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.320+0000 7f8fae568980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:45.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.320+0000 7f8fae568980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-05-09T09:48:45.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.320+0000 7f8fae568980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-09T09:48:45.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.320+0000 7f8fae568980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-05-09T09:48:45.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.320+0000 7f8fae568980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.320+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:95 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598b3050600 con 0x5598b3038490 2024-05-09T09:48:45.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.320+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(95 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.320+0000 7f8fae568980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:45.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.320+0000 7f8fae568980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-05-09T09:48:45.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.320+0000 7f8fae568980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-09T09:48:45.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.320+0000 7f8fae568980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-09T09:48:45.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.320+0000 7f8fae568980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-09T09:48:45.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.320+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:96 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3050ef0 con 0x5598b3038490 2024-05-09T09:48:45.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.324+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(96 fud [delete,create,call,writefull 0~380] v32'6 uv6 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.324+0000 7f8fae568980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-05-09T09:48:45.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.324+0000 7f8fae568980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-05-09T09:48:45.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.324+0000 7f8fae568980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-05-09T09:48:45.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.324+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94114326841920 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598b30747b0 con 0x5598b3038490 2024-05-09T09:48:45.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.324+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== watch-notify(notify (1) cookie 94114326791136 notify 137438953509 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5598b3070bf0 con 0x5598b3038490 2024-05-09T09:48:45.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.324+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(97 notify.5 [notify cookie 94114326841920 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.324+0000 7f8e8a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953509 cookie 94114326791136 notifier 4747 bl.length()=556 2024-05-09T09:48:45.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.324+0000 7f8e8a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-05-09T09:48:45.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.324+0000 7f8e8a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-05-09T09:48:45.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.324+0000 7f8e8a7fc640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f8e700056c0 con 0x5598b3038490 2024-05-09T09:48:45.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.324+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.324+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== watch-notify(notify_complete (2) cookie 94114326841920 notify 137438953509 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5598b30134e0 con 0x5598b3038490 2024-05-09T09:48:45.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.324+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:99 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3050ea0 con 0x5598b3038490 2024-05-09T09:48:45.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.328+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 32 ==== osd_op_reply(99 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.328+0000 7f8fae568980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-09T09:48:45.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.328+0000 7f8fae568980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-09T09:48:45.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.328+0000 7f8fae568980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-09T09:48:45.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.328+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:100 7.15 7:a93a5511:::notify.2:head [notify cookie 94114326841840 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598b3074780 con 0x5598b303cde0 2024-05-09T09:48:45.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.328+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== watch-notify(notify (1) cookie 94114326776624 notify 137438953478 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5598b3055790 con 0x5598b303cde0 2024-05-09T09:48:45.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.328+0000 7f8e8a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 94114326776624 notifier 4747 bl.length()=177 2024-05-09T09:48:45.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.328+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(100 notify.2 [notify cookie 94114326841840 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b303cde0 2024-05-09T09:48:45.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.328+0000 7f8e8a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-09T09:48:45.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.328+0000 7f8e8a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-09T09:48:45.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.328+0000 7f8e8a7fc640 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f8e700056c0 con 0x5598b303cde0 2024-05-09T09:48:45.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.328+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== osd_op_reply(101 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b303cde0 2024-05-09T09:48:45.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.328+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 30 ==== watch-notify(notify_complete (2) cookie 94114326841840 notify 137438953478 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5598b30523b0 con 0x5598b303cde0 2024-05-09T09:48:45.333 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-09T09:48:45.325848Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:48:45.325822Z","tags":[],"group_ids":[]} 2024-05-09T09:48:45.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.328+0000 7f8e61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:45.333 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.328+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94114326802880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3050fa0 con 0x5598b3033aa0 2024-05-09T09:48:45.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.332+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(102 data_loggenerations_metadata [watch unwatch cookie 94114326802880] v32'389 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8fa4036040 con 0x5598b3033aa0 2024-05-09T09:48:45.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.332+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:103 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94114326778880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b30471c0 con 0x7f8f94037040 2024-05-09T09:48:45.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.332+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(103 notify.0 [watch unwatch cookie 94114326778880] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa4036040 con 0x7f8f94037040 2024-05-09T09:48:45.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.332+0000 7f8fae568980 20 remove_watcher() i=0 2024-05-09T09:48:45.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.332+0000 7f8fae568980 2 removed watcher, disabling cache 2024-05-09T09:48:45.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.332+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:104 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94114326782688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b30471c0 con 0x5598b3033aa0 2024-05-09T09:48:45.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.336+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(104 notify.1 [watch unwatch cookie 94114326782688] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa4036040 con 0x5598b3033aa0 2024-05-09T09:48:45.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.336+0000 7f8fae568980 20 remove_watcher() i=1 2024-05-09T09:48:45.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.336+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:105 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94114326776624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b30471c0 con 0x5598b303cde0 2024-05-09T09:48:45.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.336+0000 7f8fab882640 1 -- 172.21.15.157:0/4248022641 <== osd.3 v2:172.21.15.157:6816/2487336710 31 ==== osd_op_reply(105 notify.2 [watch unwatch cookie 94114326776624] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9400e620 con 0x5598b303cde0 2024-05-09T09:48:45.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.336+0000 7f8fae568980 20 remove_watcher() i=2 2024-05-09T09:48:45.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.336+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:106 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94114326789104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3040b30 con 0x7f8f94037040 2024-05-09T09:48:45.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.340+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(106 notify.3 [watch unwatch cookie 94114326789104] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa4036040 con 0x7f8f94037040 2024-05-09T09:48:45.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.340+0000 7f8fae568980 20 remove_watcher() i=3 2024-05-09T09:48:45.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.340+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94114326793504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b30471c0 con 0x5598b3033aa0 2024-05-09T09:48:45.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.340+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(107 notify.4 [watch unwatch cookie 94114326793504] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa4036040 con 0x5598b3033aa0 2024-05-09T09:48:45.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.340+0000 7f8fae568980 20 remove_watcher() i=4 2024-05-09T09:48:45.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.340+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:108 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94114326791136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b3044d20 con 0x5598b3038490 2024-05-09T09:48:45.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.344+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 33 ==== osd_op_reply(108 notify.5 [watch unwatch cookie 94114326791136] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.344+0000 7f8fae568980 20 remove_watcher() i=5 2024-05-09T09:48:45.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.344+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:109 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94114326795760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b30471c0 con 0x5598b3038490 2024-05-09T09:48:45.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.344+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 34 ==== osd_op_reply(109 notify.6 [watch unwatch cookie 94114326795760] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.344+0000 7f8fae568980 20 remove_watcher() i=6 2024-05-09T09:48:45.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.344+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:110 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94114326800288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598b30443e0 con 0x5598b3038490 2024-05-09T09:48:45.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fac083640 1 -- 172.21.15.157:0/4248022641 <== osd.0 v2:172.21.15.110:6800/231209037 35 ==== osd_op_reply(110 notify.7 [watch unwatch cookie 94114326800288] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9c0ec030 con 0x5598b3038490 2024-05-09T09:48:45.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 20 remove_watcher() i=7 2024-05-09T09:48:45.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5598b3038490 msgr2=0x5598b303a880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 --2- 172.21.15.157:0/4248022641 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5598b3038490 0x5598b303a880 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5598b3033aa0 msgr2=0x5598b3035f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 --2- 172.21.15.157:0/4248022641 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5598b3033aa0 0x5598b3035f60 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f8f94037040 msgr2=0x7f8f94036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 --2- 172.21.15.157:0/4248022641 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f8f94037040 0x7f8f94036410 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5598b303cde0 msgr2=0x5598b303f210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 --2- 172.21.15.157:0/4248022641 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5598b303cde0 0x5598b303f210 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8e74034bb0 msgr2=0x7f8e74037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 --2- 172.21.15.157:0/4248022641 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8e74034bb0 0x7f8e74037070 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x5598b2fe46a0 tx=0x7f8f94010000 comp rx=0 tx=0).stop 2024-05-09T09:48:45.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b301fb80 msgr2=0x5598b3026ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fac884640 1 -- 172.21.15.157:0/4248022641 reap_dead start 2024-05-09T09:48:45.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 --2- 172.21.15.157:0/4248022641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b301fb80 0x5598b3026ef0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0d9990 tx=0x7f8f9c0e5e90 comp rx=0 tx=0).stop 2024-05-09T09:48:45.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 shutdown_connections 2024-05-09T09:48:45.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 --2- 172.21.15.157:0/4248022641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b301fb80 0x5598b3026ef0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 >> 172.21.15.157:0/4248022641 conn(0x5598b301bf00 msgr2=0x5598b3019560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:45.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 shutdown_connections 2024-05-09T09:48:45.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 -- 172.21.15.157:0/4248022641 wait complete. 2024-05-09T09:48:45.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 -- 172.21.15.157:0/3009291186 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8e84034bb0 msgr2=0x7f8e84037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 --2- 172.21.15.157:0/3009291186 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8e84034bb0 0x7f8e84037070 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400bf60 tx=0x7f8f9400f000 comp rx=0 tx=0).stop 2024-05-09T09:48:45.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 -- 172.21.15.157:0/3009291186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b3012b80 msgr2=0x5598b3012fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 --2- 172.21.15.157:0/3009291186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b3012b80 0x5598b3012fa0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0e3a10 tx=0x7f8f9c0cbe30 comp rx=0 tx=0).stop 2024-05-09T09:48:45.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 -- 172.21.15.157:0/3009291186 shutdown_connections 2024-05-09T09:48:45.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 --2- 172.21.15.157:0/3009291186 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8e84034bb0 0x7f8e84037070 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 --2- 172.21.15.157:0/3009291186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b3012b80 0x5598b3012fa0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 -- 172.21.15.157:0/3009291186 >> 172.21.15.157:0/3009291186 conn(0x5598b3007950 msgr2=0x5598b3008460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:45.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 -- 172.21.15.157:0/3009291186 shutdown_connections 2024-05-09T09:48:45.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 -- 172.21.15.157:0/3009291186 wait complete. 2024-05-09T09:48:45.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 -- 172.21.15.157:0/2976045424 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5598b2fe60f0 msgr2=0x5598b2fe84e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 --2- 172.21.15.157:0/2976045424 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5598b2fe60f0 0x5598b2fe84e0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 -- 172.21.15.157:0/2976045424 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5598b2ee4920 msgr2=0x5598b2fe3740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 --2- 172.21.15.157:0/2976045424 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5598b2ee4920 0x5598b2fe3740 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 -- 172.21.15.157:0/2976045424 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5598b2fea010 msgr2=0x5598b2fec400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 --2- 172.21.15.157:0/2976045424 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5598b2fea010 0x5598b2fec400 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 -- 172.21.15.157:0/2976045424 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8e94034bb0 msgr2=0x7f8e94037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 --2- 172.21.15.157:0/2976045424 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8e94034bb0 0x7f8e94037070 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8f94000f70 tx=0x7f8f940012c0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 -- 172.21.15.157:0/2976045424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b2e57af0 msgr2=0x5598b2fdc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fae568980 1 --2- 172.21.15.157:0/2976045424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5598b2e57af0 0x5598b2fdc800 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0b8040 tx=0x7f8f9c019810 comp rx=0 tx=0).stop 2024-05-09T09:48:45.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.348+0000 7f8fac884640 1 -- 172.21.15.157:0/2976045424 reap_dead start 2024-05-09T09:48:45.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.352+0000 7f8fae568980 1 -- 172.21.15.157:0/2976045424 shutdown_connections 2024-05-09T09:48:45.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.352+0000 7f8fae568980 1 -- 172.21.15.157:0/2976045424 >> 172.21.15.157:0/2976045424 conn(0x5598b2ede110 msgr2=0x5598b2fcfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:45.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.352+0000 7f8fae568980 1 -- 172.21.15.157:0/2976045424 shutdown_connections 2024-05-09T09:48:45.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.352+0000 7f8fae568980 1 -- 172.21.15.157:0/2976045424 wait complete. 2024-05-09T09:48:45.366 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-09T09:48:45.325848Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:48:45.325822Z', 'tags': [], 'group_ids': []} 2024-05-09T09:48:45.383 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-05-09T09:48:45.391 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-05-09T09:48:45.391 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-05-09T09:48:45.391 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-05-09T09:48:45.391 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-05-09T09:48:45.426 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:48:45.426 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:48:45.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.424+0000 7f5fb3d2f980 1 Processor -- start 2024-05-09T09:48:45.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.424+0000 7f5fb3d2f980 1 -- start start 2024-05-09T09:48:45.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.424+0000 7f5fb3d2f980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x557b63a55b40 0x557b63a55f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.424+0000 7f5fb3d2f980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557b63909440 con 0x557b63a56460 2024-05-09T09:48:45.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.424+0000 7f5fb3d2f980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x557b638f45f0 con 0x557b63a55b40 2024-05-09T09:48:45.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.424+0000 7f5fb184a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x557b63a55b40 0x557b63a55f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.424+0000 7f5fb1049640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x557b63a56460 0x557b63a56e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:51216/0 (socket says 172.21.15.157:51216) 2024-05-09T09:48:45.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.424+0000 7f5fb184a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x557b63a55b40 0x557b63a55f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:43722/0 (socket says 172.21.15.157:43722) 2024-05-09T09:48:45.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.424+0000 7f5fb1049640 1 -- 172.21.15.157:0/1764288892 learned_addr learned my addr 172.21.15.157:0/1764288892 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:48:45.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.424+0000 7f5fb184a640 1 -- 172.21.15.157:0/1764288892 >> v1:172.21.15.110:6789/0 conn(0x557b63a56460 legacy=0x557b63a56e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.424+0000 7f5fb184a640 1 -- 172.21.15.157:0/1764288892 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b638ff990 con 0x557b63a55b40 2024-05-09T09:48:45.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.428+0000 7f5fb184a640 1 --2- 172.21.15.157:0/1764288892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63a55b40 0x557b63a55f20 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400a480 tx=0x7f5fa401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be9a9b6c3652930 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.428+0000 7f5fb0848640 1 -- 172.21.15.157:0/1764288892 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fa40b0070 con 0x557b63a55b40 2024-05-09T09:48:45.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.428+0000 7f5fb0848640 1 -- 172.21.15.157:0/1764288892 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fa40ab540 con 0x557b63a55b40 2024-05-09T09:48:45.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.428+0000 7f5fb0848640 1 -- 172.21.15.157:0/1764288892 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fa40ab840 con 0x557b63a55b40 2024-05-09T09:48:45.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.428+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/1764288892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63a55b40 msgr2=0x557b63a55f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.428+0000 7f5fb3d2f980 1 --2- 172.21.15.157:0/1764288892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63a55b40 0x557b63a55f20 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400a480 tx=0x7f5fa401b280 comp rx=0 tx=0).stop 2024-05-09T09:48:45.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.428+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/1764288892 shutdown_connections 2024-05-09T09:48:45.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.428+0000 7f5fb3d2f980 1 --2- 172.21.15.157:0/1764288892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63a55b40 0x557b63a55f20 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.428+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/1764288892 >> 172.21.15.157:0/1764288892 conn(0x557b639c9260 msgr2=0x557b639c9670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:45.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.428+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/1764288892 shutdown_connections 2024-05-09T09:48:45.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.428+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/1764288892 wait complete. 2024-05-09T09:48:45.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.444+0000 7f5fb3d2f980 1 Processor -- start 2024-05-09T09:48:45.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.444+0000 7f5fb3d2f980 1 -- start start 2024-05-09T09:48:45.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.444+0000 7f5fb3d2f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63a55b40 0x557b63b414d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.444+0000 7f5fb3d2f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557b63956fe0 con 0x557b63a55b40 2024-05-09T09:48:45.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.444+0000 7f5fb184a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63a55b40 0x557b63b414d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.444+0000 7f5fb184a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63a55b40 0x557b63b414d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:43730/0 (socket says 172.21.15.157:43730) 2024-05-09T09:48:45.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.444+0000 7f5fb184a640 1 -- 172.21.15.157:0/2996901326 learned_addr learned my addr 172.21.15.157:0/2996901326 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:45.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.444+0000 7f5fb184a640 1 -- 172.21.15.157:0/2996901326 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b638dbae0 con 0x557b63a55b40 2024-05-09T09:48:45.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.444+0000 7f5fb184a640 1 --2- 172.21.15.157:0/2996901326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63a55b40 0x557b63b414d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f5fa40ae040 tx=0x7f5fa4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70b07084dcccf07 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.444+0000 7f5e9fe07640 1 -- 172.21.15.157:0/2996901326 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fa40b0040 con 0x557b63a55b40 2024-05-09T09:48:45.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.444+0000 7f5e9fe07640 1 -- 172.21.15.157:0/2996901326 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fa400a300 con 0x557b63a55b40 2024-05-09T09:48:45.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.444+0000 7f5e9fe07640 1 -- 172.21.15.157:0/2996901326 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fa40ab820 con 0x557b63a55b40 2024-05-09T09:48:45.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.448+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/2996901326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63a55b40 msgr2=0x557b63b414d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.448+0000 7f5fb3d2f980 1 --2- 172.21.15.157:0/2996901326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63a55b40 0x557b63b414d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f5fa40ae040 tx=0x7f5fa4003030 comp rx=0 tx=0).stop 2024-05-09T09:48:45.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.448+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/2996901326 shutdown_connections 2024-05-09T09:48:45.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.448+0000 7f5fb3d2f980 1 --2- 172.21.15.157:0/2996901326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63a55b40 0x557b63b414d0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.448+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/2996901326 >> 172.21.15.157:0/2996901326 conn(0x557b639c9260 msgr2=0x557b63b3d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:45.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.448+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/2996901326 shutdown_connections 2024-05-09T09:48:45.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.448+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/2996901326 wait complete. 2024-05-09T09:48:45.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.448+0000 7f5fb3d2f980 1 Processor -- start 2024-05-09T09:48:45.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.448+0000 7f5fb3d2f980 1 -- start start 2024-05-09T09:48:45.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.448+0000 7f5fb3d2f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63a55b40 0x557b63b484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.448+0000 7f5fb3d2f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557b63a5fb80 con 0x557b63a55b40 2024-05-09T09:48:45.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.448+0000 7f5fb184a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63a55b40 0x557b63b484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.448+0000 7f5fb184a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63a55b40 0x557b63b484f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:43738/0 (socket says 172.21.15.157:43738) 2024-05-09T09:48:45.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.448+0000 7f5fb184a640 1 -- 172.21.15.157:0/1518901804 learned_addr learned my addr 172.21.15.157:0/1518901804 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:45.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.448+0000 7f5fb184a640 1 -- 172.21.15.157:0/1518901804 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b63b48a30 con 0x557b63a55b40 2024-05-09T09:48:45.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.448+0000 7f5fb184a640 1 --2- 172.21.15.157:0/1518901804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63a55b40 0x557b63b484f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4019930 tx=0x7f5fa4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.448+0000 7f5e9e604640 1 -- 172.21.15.157:0/1518901804 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fa40b0040 con 0x557b63a55b40 2024-05-09T09:48:45.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.448+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/1518901804 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b63b48cc0 con 0x557b63a55b40 2024-05-09T09:48:45.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.448+0000 7f5e9e604640 1 -- 172.21.15.157:0/1518901804 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fa40c0870 con 0x557b63a55b40 2024-05-09T09:48:45.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.448+0000 7f5e9e604640 1 -- 172.21.15.157:0/1518901804 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fa40c0b50 con 0x557b63a55b40 2024-05-09T09:48:45.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.448+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/1518901804 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b63b4b950 con 0x557b63a55b40 2024-05-09T09:48:45.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.448+0000 7f5e9e604640 1 -- 172.21.15.157:0/1518901804 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f5fa4009420 con 0x557b63a55b40 2024-05-09T09:48:45.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.448+0000 7f5e9e604640 1 --2- 172.21.15.157:0/1518901804 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5e98034bb0 0x7f5e98037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.448+0000 7f5e9e604640 1 -- 172.21.15.157:0/1518901804 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f5fa40bb070 con 0x557b63a55b40 2024-05-09T09:48:45.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.452+0000 7f5fb1049640 1 --2- 172.21.15.157:0/1518901804 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5e98034bb0 0x7f5e98037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.452+0000 7f5fb3d2f980 1 --2- 172.21.15.157:0/1518901804 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557b63a56460 0x557b63b4f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.452+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/1518901804 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b63b4fa70 con 0x557b63a56460 2024-05-09T09:48:45.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.452+0000 7f5fb204b640 1 --2- 172.21.15.157:0/1518901804 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557b63a56460 0x557b63b4f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.452+0000 7f5fb1049640 1 --2- 172.21.15.157:0/1518901804 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5e98034bb0 0x7f5e98037070 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8000f70 tx=0x7f5fa80012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.452+0000 7f5fb204b640 1 --2- 172.21.15.157:0/1518901804 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557b63a56460 0x557b63b4f430 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.452+0000 7f5fb204b640 1 -- 172.21.15.157:0/1518901804 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63a56460 2024-05-09T09:48:45.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.452+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/1518901804 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b63b4cb50 con 0x557b63a56460 2024-05-09T09:48:45.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.452+0000 7f5fb204b640 1 -- 172.21.15.157:0/1518901804 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63a56460 2024-05-09T09:48:45.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.452+0000 7f5fb3d2f980 1 --2- 172.21.15.157:0/1518901804 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557b63b51da0 0x557b63b54190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.452+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/1518901804 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b63b54860 con 0x557b63b51da0 2024-05-09T09:48:45.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.452+0000 7f5fb184a640 1 --2- 172.21.15.157:0/1518901804 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557b63b51da0 0x557b63b54190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.452+0000 7f5fb184a640 1 --2- 172.21.15.157:0/1518901804 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557b63b51da0 0x557b63b54190 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.452+0000 7f5fb184a640 1 -- 172.21.15.157:0/1518901804 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5fa40b3040 con 0x557b63b51da0 2024-05-09T09:48:45.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.452+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/1518901804 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b63b50c40 con 0x557b63a56460 2024-05-09T09:48:45.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.452+0000 7f5fb204b640 1 -- 172.21.15.157:0/1518901804 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63a56460 2024-05-09T09:48:45.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.452+0000 7f5fb3d2f980 1 --2- 172.21.15.157:0/1518901804 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557b63b55ca0 0x557b63b58090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.452+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/1518901804 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b63b58820 con 0x557b63b55ca0 2024-05-09T09:48:45.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.452+0000 7f5fb1049640 1 --2- 172.21.15.157:0/1518901804 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557b63b55ca0 0x557b63b58090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.456+0000 7f5fb1049640 1 --2- 172.21.15.157:0/1518901804 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557b63b55ca0 0x557b63b58090 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.456+0000 7f5fb1049640 1 -- 172.21.15.157:0/1518901804 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5fa800e620 con 0x557b63b55ca0 2024-05-09T09:48:45.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.460+0000 7f5fb3d2f980 1 Processor -- start 2024-05-09T09:48:45.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.460+0000 7f5fb3d2f980 1 -- start start 2024-05-09T09:48:45.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.460+0000 7f5fb3d2f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63b7e860 0x557b63b7ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.460+0000 7f5fb3d2f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557b6395b020 con 0x557b63b7e860 2024-05-09T09:48:45.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.460+0000 7f5fb184a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63b7e860 0x557b63b7ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.460+0000 7f5fb184a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63b7e860 0x557b63b7ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:43740/0 (socket says 172.21.15.157:43740) 2024-05-09T09:48:45.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.460+0000 7f5fb184a640 1 -- 172.21.15.157:0/3088047107 learned_addr learned my addr 172.21.15.157:0/3088047107 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:45.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.460+0000 7f5fb184a640 1 -- 172.21.15.157:0/3088047107 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b63b7f1c0 con 0x557b63b7e860 2024-05-09T09:48:45.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.460+0000 7f5fb184a640 1 --2- 172.21.15.157:0/3088047107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63b7e860 0x557b63b7ec80 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f5fa401b2c0 tx=0x7f5fa40c0f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.460+0000 7f5e963a1640 1 -- 172.21.15.157:0/3088047107 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fa40e3c00 con 0x557b63b7e860 2024-05-09T09:48:45.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.460+0000 7f5e963a1640 1 -- 172.21.15.157:0/3088047107 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fa40e3da0 con 0x557b63b7e860 2024-05-09T09:48:45.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.460+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3088047107 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b63b7fc50 con 0x557b63b7e860 2024-05-09T09:48:45.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.460+0000 7f5e963a1640 1 -- 172.21.15.157:0/3088047107 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fa40e51a0 con 0x557b63b7e860 2024-05-09T09:48:45.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.460+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3088047107 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b63b7fc50 con 0x557b63b7e860 2024-05-09T09:48:45.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.460+0000 7f5e963a1640 1 -- 172.21.15.157:0/3088047107 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f5fa40ad070 con 0x557b63b7e860 2024-05-09T09:48:45.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.460+0000 7f5e963a1640 1 --2- 172.21.15.157:0/3088047107 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5e8c034c00 0x7f5e8c0370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.460+0000 7f5e963a1640 1 -- 172.21.15.157:0/3088047107 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f5fa40a8070 con 0x557b63b7e860 2024-05-09T09:48:45.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.460+0000 7f5fb1049640 1 --2- 172.21.15.157:0/3088047107 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5e8c034c00 0x7f5e8c0370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.460+0000 7f5fb3d2f980 1 Processor -- start 2024-05-09T09:48:45.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.460+0000 7f5fb3d2f980 1 -- start start 2024-05-09T09:48:45.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.460+0000 7f5fb1049640 1 --2- 172.21.15.157:0/3088047107 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5e8c034c00 0x7f5e8c0370c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800bf60 tx=0x7f5fa800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.464+0000 7f5fb3d2f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63b8b610 0x557b63b8ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.464+0000 7f5fb3d2f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557b63b41b60 con 0x557b63b8b610 2024-05-09T09:48:45.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.464+0000 7f5fb184a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63b8b610 0x557b63b8ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.464+0000 7f5fb184a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63b8b610 0x557b63b8ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:43756/0 (socket says 172.21.15.157:43756) 2024-05-09T09:48:45.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.464+0000 7f5fb184a640 1 -- 172.21.15.157:0/4137163119 learned_addr learned my addr 172.21.15.157:0/4137163119 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:45.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.464+0000 7f5fb184a640 1 -- 172.21.15.157:0/4137163119 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b63b8c000 con 0x557b63b8b610 2024-05-09T09:48:45.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.464+0000 7f5fb184a640 1 --2- 172.21.15.157:0/4137163119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63b8b610 0x557b63b8ba30 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5fa40b4680 tx=0x7f5fa40d2410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22cae576e2129ebd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.464+0000 7f5e83fff640 1 -- 172.21.15.157:0/4137163119 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fa40f2070 con 0x557b63b8b610 2024-05-09T09:48:45.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.464+0000 7f5e83fff640 1 -- 172.21.15.157:0/4137163119 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fa40ace20 con 0x557b63b8b610 2024-05-09T09:48:45.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.464+0000 7f5e83fff640 1 -- 172.21.15.157:0/4137163119 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fa4009ae0 con 0x557b63b8b610 2024-05-09T09:48:45.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.464+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/4137163119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63b8b610 msgr2=0x557b63b8ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.464+0000 7f5fb3d2f980 1 --2- 172.21.15.157:0/4137163119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63b8b610 0x557b63b8ba30 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5fa40b4680 tx=0x7f5fa40d2410 comp rx=0 tx=0).stop 2024-05-09T09:48:45.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.464+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/4137163119 shutdown_connections 2024-05-09T09:48:45.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.464+0000 7f5fb3d2f980 1 --2- 172.21.15.157:0/4137163119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63b8b610 0x557b63b8ba30 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.464+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/4137163119 >> 172.21.15.157:0/4137163119 conn(0x557b63b87990 msgr2=0x557b63b859f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:45.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.464+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/4137163119 shutdown_connections 2024-05-09T09:48:45.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.464+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/4137163119 wait complete. 2024-05-09T09:48:45.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.464+0000 7f5fb3d2f980 1 Processor -- start 2024-05-09T09:48:45.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.464+0000 7f5fb3d2f980 1 -- start start 2024-05-09T09:48:45.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.464+0000 7f5fb3d2f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63b8b610 0x557b63b92990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.464+0000 7f5fb3d2f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557b63b8c6d0 con 0x557b63b8b610 2024-05-09T09:48:45.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.464+0000 7f5fb184a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63b8b610 0x557b63b92990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.464+0000 7f5fb184a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63b8b610 0x557b63b92990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:43768/0 (socket says 172.21.15.157:43768) 2024-05-09T09:48:45.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.464+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 learned_addr learned my addr 172.21.15.157:0/3184680261 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:45.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.464+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b63b92ed0 con 0x557b63b8b610 2024-05-09T09:48:45.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5fb184a640 1 --2- 172.21.15.157:0/3184680261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63b8b610 0x557b63b92990 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f5fa40c5e20 tx=0x7f5fa40c9ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5e827fc640 1 -- 172.21.15.157:0/3184680261 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fa4109070 con 0x557b63b8b610 2024-05-09T09:48:45.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b63b92ed0 con 0x557b63b8b610 2024-05-09T09:48:45.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5e827fc640 1 -- 172.21.15.157:0/3184680261 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fa40b6470 con 0x557b63b8b610 2024-05-09T09:48:45.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5e827fc640 1 -- 172.21.15.157:0/3184680261 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fa40d2c60 con 0x557b63b8b610 2024-05-09T09:48:45.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b63b93350 con 0x557b63b8b610 2024-05-09T09:48:45.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5e827fc640 1 -- 172.21.15.157:0/3184680261 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f5fa410c070 con 0x557b63b8b610 2024-05-09T09:48:45.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5e827fc640 1 --2- 172.21.15.157:0/3184680261 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5e7c034bb0 0x7f5e7c037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5e827fc640 1 -- 172.21.15.157:0/3184680261 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f5fa40f5020 con 0x557b63b8b610 2024-05-09T09:48:45.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5fb1049640 1 --2- 172.21.15.157:0/3184680261 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5e7c034bb0 0x7f5e7c037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5fb3d2f980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5fb3d2f980 1 --2- 172.21.15.157:0/3184680261 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557b63b9f350 0x557b63ba1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba1f60 con 0x557b63b9f350 2024-05-09T09:48:45.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5fb204b640 1 --2- 172.21.15.157:0/3184680261 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557b63b9f350 0x557b63ba1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5fb1049640 1 --2- 172.21.15.157:0/3184680261 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5e7c034bb0 0x7f5e7c037070 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x557b63b58c20 tx=0x7f5fa8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5fb204b640 1 --2- 172.21.15.157:0/3184680261 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557b63b9f350 0x557b63ba1810 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63b9f350 2024-05-09T09:48:45.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5fb3d2f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:45.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5fb3d2f980 20 realm 2024-05-09T09:48:45.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5fb3d2f980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2370 con 0x557b63b9f350 2024-05-09T09:48:45.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63b9f350 2024-05-09T09:48:45.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5fb3d2f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:45.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5fb3d2f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:48:45.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5fb3d2f980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2c40 con 0x557b63b9f350 2024-05-09T09:48:45.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63b9f350 2024-05-09T09:48:45.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5fb3d2f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:45.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5fb3d2f980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.468+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x557b63b9f350 2024-05-09T09:48:45.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.472+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63b9f350 2024-05-09T09:48:45.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.472+0000 7f5fb3d2f980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:45.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.472+0000 7f5fb3d2f980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.472+0000 7f5fb3d2f980 1 --2- 172.21.15.157:0/3184680261 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557b63ba3d40 0x557b63ba6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.472+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba6740 con 0x557b63ba3d40 2024-05-09T09:48:45.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.472+0000 7f5fb184a640 1 --2- 172.21.15.157:0/3184680261 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557b63ba3d40 0x557b63ba6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.472+0000 7f5fb184a640 1 --2- 172.21.15.157:0/3184680261 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557b63ba3d40 0x557b63ba6130 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.472+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5fa410b030 con 0x557b63ba3d40 2024-05-09T09:48:45.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.472+0000 7f5fb3d2f980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:48:45.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.472+0000 7f5fb3d2f980 20 searching for the correct realm 2024-05-09T09:48:45.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.472+0000 7f5fb3d2f980 1 --2- 172.21.15.157:0/3184680261 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557b63ba8620 0x557b63baaa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.472+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63bab110 con 0x557b63ba8620 2024-05-09T09:48:45.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.472+0000 7f5fb1049640 1 --2- 172.21.15.157:0/3184680261 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557b63ba8620 0x557b63baaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.472+0000 7f5fb1049640 1 --2- 172.21.15.157:0/3184680261 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557b63ba8620 0x557b63baaa90 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.472+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa800e620 con 0x557b63ba8620 2024-05-09T09:48:45.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.472+0000 7f5fb1049640 1 --2- 172.21.15.157:0/3184680261 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f5fa8037040 0x7f5fa8036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.472+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63bab110 con 0x7f5fa8037040 2024-05-09T09:48:45.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.472+0000 7f5fb204b640 1 --2- 172.21.15.157:0/3184680261 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f5fa8037040 0x7f5fa8036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.472+0000 7f5fb204b640 1 --2- 172.21.15.157:0/3184680261 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f5fa8037040 0x7f5fa8036410 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.472+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fac00a4d0 con 0x7f5fa8037040 2024-05-09T09:48:45.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.472+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x557b63ba3d40 2024-05-09T09:48:45.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.476+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa410b030 con 0x557b63ba3d40 2024-05-09T09:48:45.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.476+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x557b63b9f350 2024-05-09T09:48:45.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.476+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63b9f350 2024-05-09T09:48:45.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.476+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x557b63b9f350 2024-05-09T09:48:45.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.476+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63b9f350 2024-05-09T09:48:45.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.476+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x557b63ba3d40 2024-05-09T09:48:45.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.476+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa410b030 con 0x557b63ba3d40 2024-05-09T09:48:45.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.476+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x557b63ba3d40 2024-05-09T09:48:45.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.476+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa410b030 con 0x557b63ba3d40 2024-05-09T09:48:45.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.476+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x7f5fa8037040 2024-05-09T09:48:45.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.476+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fac00a4d0 con 0x7f5fa8037040 2024-05-09T09:48:45.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.476+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x557b63ba8620 2024-05-09T09:48:45.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.476+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa800e620 con 0x557b63ba8620 2024-05-09T09:48:45.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.476+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x557b63b9f350 2024-05-09T09:48:45.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.476+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63b9f350 2024-05-09T09:48:45.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.476+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x557b63ba3d40 2024-05-09T09:48:45.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.480+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa410b030 con 0x557b63ba3d40 2024-05-09T09:48:45.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.480+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x557b63b9f350 2024-05-09T09:48:45.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.480+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63b9f350 2024-05-09T09:48:45.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.480+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x7f5fa8037040 2024-05-09T09:48:45.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.480+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5fac00a4d0 con 0x7f5fa8037040 2024-05-09T09:48:45.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.480+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x557b63ba8620 2024-05-09T09:48:45.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.480+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa800e620 con 0x557b63ba8620 2024-05-09T09:48:45.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.480+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x557b63ba8620 2024-05-09T09:48:45.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.480+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5fa800e620 con 0x557b63ba8620 2024-05-09T09:48:45.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.480+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x557b63ba3d40 2024-05-09T09:48:45.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.480+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa410b030 con 0x557b63ba3d40 2024-05-09T09:48:45.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.480+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x557b63ba8620 2024-05-09T09:48:45.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.480+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa800e620 con 0x557b63ba8620 2024-05-09T09:48:45.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.480+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x557b63ba8620 2024-05-09T09:48:45.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.480+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa800e620 con 0x557b63ba8620 2024-05-09T09:48:45.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.480+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x557b63b9f350 2024-05-09T09:48:45.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.480+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63b9f350 2024-05-09T09:48:45.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.480+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x557b63b9f350 2024-05-09T09:48:45.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.480+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63b9f350 2024-05-09T09:48:45.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.480+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x557b63ba3d40 2024-05-09T09:48:45.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.484+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa410b030 con 0x557b63ba3d40 2024-05-09T09:48:45.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.484+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x557b63ba8620 2024-05-09T09:48:45.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.484+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa800e620 con 0x557b63ba8620 2024-05-09T09:48:45.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.484+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x7f5fa8037040 2024-05-09T09:48:45.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.484+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fac00a4d0 con 0x7f5fa8037040 2024-05-09T09:48:45.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.484+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x557b63b9f350 2024-05-09T09:48:45.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.484+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63b9f350 2024-05-09T09:48:45.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.484+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x557b63ba3d40 2024-05-09T09:48:45.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.484+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5fa410b030 con 0x557b63ba3d40 2024-05-09T09:48:45.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.484+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x557b63ba8620 2024-05-09T09:48:45.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.484+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa800e620 con 0x557b63ba8620 2024-05-09T09:48:45.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.484+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x557b63ba3d40 2024-05-09T09:48:45.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.484+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa410b030 con 0x557b63ba3d40 2024-05-09T09:48:45.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.484+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x7f5fa8037040 2024-05-09T09:48:45.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.484+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fac00a4d0 con 0x7f5fa8037040 2024-05-09T09:48:45.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.484+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x557b63ba8620 2024-05-09T09:48:45.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.484+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa800e620 con 0x557b63ba8620 2024-05-09T09:48:45.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.484+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x557b63ba3d40 2024-05-09T09:48:45.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fa410b030 con 0x557b63ba3d40 2024-05-09T09:48:45.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x557b63b9f350 2024-05-09T09:48:45.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63b9f350 2024-05-09T09:48:45.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba2fe0 con 0x7f5fa8037040 2024-05-09T09:48:45.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fac00a4d0 con 0x7f5fa8037040 2024-05-09T09:48:45.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:48:45.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:48:45.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:48:45.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:48:45.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:48:45.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:48:45.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba6f90 con 0x557b63b9f350 2024-05-09T09:48:45.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63b9f350 2024-05-09T09:48:45.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:45.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba6f90 con 0x557b63b9f350 2024-05-09T09:48:45.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63b9f350 2024-05-09T09:48:45.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:45.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba6f90 con 0x557b63ba8620 2024-05-09T09:48:45.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5fa800e620 con 0x557b63ba8620 2024-05-09T09:48:45.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:48:45.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 20 zone default found 2024-05-09T09:48:45.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 4 Realm: () 2024-05-09T09:48:45.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:48:45.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:48:45.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:48:45.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 20 zonegroup default 2024-05-09T09:48:45.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b63ba7930 con 0x557b63ba3d40 2024-05-09T09:48:45.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5fa410b030 con 0x557b63ba3d40 2024-05-09T09:48:45.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:45.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b63bacff0 con 0x557b63ba8620 2024-05-09T09:48:45.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5fa800e620 con 0x557b63ba8620 2024-05-09T09:48:45.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:45.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b63bad450 con 0x557b63ba8620 2024-05-09T09:48:45.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5fa800e620 con 0x557b63ba8620 2024-05-09T09:48:45.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:45.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 20 started sync module instance, tier type = 2024-05-09T09:48:45.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:48:45.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.488+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bac410 con 0x7f5fa8037040 2024-05-09T09:48:45.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.492+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x7f5fa8037040 2024-05-09T09:48:45.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.492+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93988442523952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bac410 con 0x7f5fa8037040 2024-05-09T09:48:45.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.492+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63badf60 con 0x557b63b9f350 2024-05-09T09:48:45.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.492+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93988442523952] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x7f5fa8037040 2024-05-09T09:48:45.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.492+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63b9f350 2024-05-09T09:48:45.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.492+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93988442528304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bac410 con 0x557b63b9f350 2024-05-09T09:48:45.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.492+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bae970 con 0x557b63ba8620 2024-05-09T09:48:45.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.496+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa800e620 con 0x557b63ba8620 2024-05-09T09:48:45.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.496+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93988442531008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63baf210 con 0x557b63ba8620 2024-05-09T09:48:45.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.496+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bafc10 con 0x7f5fa8037040 2024-05-09T09:48:45.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.496+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93988442528304] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63b9f350 2024-05-09T09:48:45.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.496+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x7f5fa8037040 2024-05-09T09:48:45.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.496+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93988442521440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bb0000 con 0x7f5fa8037040 2024-05-09T09:48:45.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.496+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bb09c0 con 0x557b63b9f350 2024-05-09T09:48:45.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.496+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93988442521440] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x7f5fa8037040 2024-05-09T09:48:45.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.496+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93988442531008] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa800e620 con 0x557b63ba8620 2024-05-09T09:48:45.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.500+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63b9f350 2024-05-09T09:48:45.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.500+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93988442533216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bb0510 con 0x557b63b9f350 2024-05-09T09:48:45.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.500+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bb0d60 con 0x557b63ba3d40 2024-05-09T09:48:45.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.500+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93988442533216] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63b9f350 2024-05-09T09:48:45.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.500+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa410b030 con 0x557b63ba3d40 2024-05-09T09:48:45.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.500+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93988442539280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bb0930 con 0x557b63ba3d40 2024-05-09T09:48:45.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.500+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bb1a60 con 0x557b63ba3d40 2024-05-09T09:48:45.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.504+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93988442539280] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa410b030 con 0x557b63ba3d40 2024-05-09T09:48:45.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.504+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa410b030 con 0x557b63ba3d40 2024-05-09T09:48:45.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.504+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93988442542608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bb1c20 con 0x557b63ba3d40 2024-05-09T09:48:45.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.504+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bb2740 con 0x557b63ba3d40 2024-05-09T09:48:45.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.504+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93988442542608] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa410b030 con 0x557b63ba3d40 2024-05-09T09:48:45.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.504+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa410b030 con 0x557b63ba3d40 2024-05-09T09:48:45.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.504+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93988442546704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bb2700 con 0x557b63ba3d40 2024-05-09T09:48:45.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.504+0000 7f5fb3d2f980 20 add_watcher() i=0 2024-05-09T09:48:45.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.504+0000 7f5fb3d2f980 20 add_watcher() i=1 2024-05-09T09:48:45.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.504+0000 7f5fb3d2f980 20 add_watcher() i=2 2024-05-09T09:48:45.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.504+0000 7f5fb3d2f980 20 add_watcher() i=3 2024-05-09T09:48:45.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.504+0000 7f5fb3d2f980 20 add_watcher() i=4 2024-05-09T09:48:45.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.504+0000 7f5fb3d2f980 20 add_watcher() i=5 2024-05-09T09:48:45.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.504+0000 7f5fb3d2f980 20 add_watcher() i=6 2024-05-09T09:48:45.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.508+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93988442546704] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa410b030 con 0x557b63ba3d40 2024-05-09T09:48:45.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.508+0000 7f5fb3d2f980 20 add_watcher() i=7 2024-05-09T09:48:45.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.508+0000 7f5fb3d2f980 2 all 8 watchers are set, enabling cache 2024-05-09T09:48:45.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.508+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b63bb5b90 con 0x557b63b9f350 2024-05-09T09:48:45.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.508+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63b9f350 2024-05-09T09:48:45.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.508+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93988442543728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bb30b0 con 0x557b63b9f350 2024-05-09T09:48:45.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.508+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93988442543728] v32'390 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63b9f350 2024-05-09T09:48:45.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.508+0000 7f5e66fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:45.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.508+0000 7f5fb3d2f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:48:45.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.508+0000 7f5fb3d2f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:48:45.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.508+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bb58f0 con 0x557b63b9f350 2024-05-09T09:48:45.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.512+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'91 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63b9f350 2024-05-09T09:48:45.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.512+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bbec00 con 0x557b63ba3d40 2024-05-09T09:48:45.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.516+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'85 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5fa410b030 con 0x557b63ba3d40 2024-05-09T09:48:45.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.516+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bbec00 con 0x557b63ba8620 2024-05-09T09:48:45.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.516+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'84 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5fa800e620 con 0x557b63ba8620 2024-05-09T09:48:45.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.516+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bbec00 con 0x557b63b9f350 2024-05-09T09:48:45.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.516+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'391 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63b9f350 2024-05-09T09:48:45.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.516+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bbf700 con 0x7f5fa8037040 2024-05-09T09:48:45.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.520+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'242 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x7f5fa8037040 2024-05-09T09:48:45.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.520+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bbd2f0 con 0x557b63ba8620 2024-05-09T09:48:45.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.520+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'162 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5fa800e620 con 0x557b63ba8620 2024-05-09T09:48:45.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.520+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bbd2f0 con 0x557b63b9f350 2024-05-09T09:48:45.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.520+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'86 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63b9f350 2024-05-09T09:48:45.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.520+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bc0260 con 0x557b63ba3d40 2024-05-09T09:48:45.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.524+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'161 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5fa410b030 con 0x557b63ba3d40 2024-05-09T09:48:45.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.524+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bc0260 con 0x7f5fa8037040 2024-05-09T09:48:45.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.524+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'84 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x7f5fa8037040 2024-05-09T09:48:45.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.524+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bc0260 con 0x557b63ba8620 2024-05-09T09:48:45.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.528+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'90 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5fa800e620 con 0x557b63ba8620 2024-05-09T09:48:45.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.528+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bc0710 con 0x7f5fa8037040 2024-05-09T09:48:45.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.528+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'243 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x7f5fa8037040 2024-05-09T09:48:45.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.528+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bc0710 con 0x557b63ba3d40 2024-05-09T09:48:45.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.532+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'88 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fa410b030 con 0x557b63ba3d40 2024-05-09T09:48:45.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.532+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bc0710 con 0x7f5fa8037040 2024-05-09T09:48:45.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.532+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'84 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x7f5fa8037040 2024-05-09T09:48:45.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.532+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bc0710 con 0x557b63ba3d40 2024-05-09T09:48:45.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.536+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'167 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fa410b030 con 0x557b63ba3d40 2024-05-09T09:48:45.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.536+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bc0710 con 0x557b63b9f350 2024-05-09T09:48:45.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.536+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'392 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63b9f350 2024-05-09T09:48:45.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.536+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bc0710 con 0x557b63ba8620 2024-05-09T09:48:45.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.540+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'236 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fa800e620 con 0x557b63ba8620 2024-05-09T09:48:45.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.540+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bc0710 con 0x7f5fa8037040 2024-05-09T09:48:45.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.540+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'244 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x7f5fa8037040 2024-05-09T09:48:45.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.540+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bc0710 con 0x557b63ba8620 2024-05-09T09:48:45.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.540+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'84 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fa800e620 con 0x557b63ba8620 2024-05-09T09:48:45.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.540+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bc0710 con 0x557b63b9f350 2024-05-09T09:48:45.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.544+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'92 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63b9f350 2024-05-09T09:48:45.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.544+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bc0710 con 0x557b63b9f350 2024-05-09T09:48:45.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.544+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'393 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63b9f350 2024-05-09T09:48:45.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.544+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bc0710 con 0x557b63ba8620 2024-05-09T09:48:45.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.548+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'237 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fa800e620 con 0x557b63ba8620 2024-05-09T09:48:45.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.548+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bc0710 con 0x7f5fa8037040 2024-05-09T09:48:45.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.548+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'96 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x7f5fa8037040 2024-05-09T09:48:45.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.548+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bc0710 con 0x557b63ba8620 2024-05-09T09:48:45.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.548+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'86 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fa800e620 con 0x557b63ba8620 2024-05-09T09:48:45.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.552+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bc0710 con 0x557b63ba8620 2024-05-09T09:48:45.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.552+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'90 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fa800e620 con 0x557b63ba8620 2024-05-09T09:48:45.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.552+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bc0710 con 0x557b63ba8620 2024-05-09T09:48:45.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.552+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'81 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fa800e620 con 0x557b63ba8620 2024-05-09T09:48:45.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.552+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bc0710 con 0x557b63ba8620 2024-05-09T09:48:45.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.556+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'163 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fa800e620 con 0x557b63ba8620 2024-05-09T09:48:45.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.556+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bc0710 con 0x557b63ba3d40 2024-05-09T09:48:45.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.556+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'86 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fa410b030 con 0x557b63ba3d40 2024-05-09T09:48:45.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.560+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bc0710 con 0x557b63ba8620 2024-05-09T09:48:45.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.560+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'84 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fa800e620 con 0x557b63ba8620 2024-05-09T09:48:45.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.560+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bc0710 con 0x557b63ba3d40 2024-05-09T09:48:45.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.560+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'162 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fa410b030 con 0x557b63ba3d40 2024-05-09T09:48:45.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.564+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bc0710 con 0x557b63ba8620 2024-05-09T09:48:45.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.564+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'238 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fa800e620 con 0x557b63ba8620 2024-05-09T09:48:45.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.564+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bc0710 con 0x557b63ba3d40 2024-05-09T09:48:45.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.568+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'168 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fa410b030 con 0x557b63ba3d40 2024-05-09T09:48:45.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.568+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bc0710 con 0x7f5fa8037040 2024-05-09T09:48:45.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.572+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'90 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x7f5fa8037040 2024-05-09T09:48:45.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.572+0000 7f5e65fe3640 20 reqs_thread_entry: start 2024-05-09T09:48:45.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.572+0000 7f5fb3d2f980 20 init_complete bucket index max shards: 11 2024-05-09T09:48:45.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.572+0000 7f5dd77fe640 20 reqs_thread_entry: start 2024-05-09T09:48:45.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.572+0000 7f5fb3d2f980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-05-09T09:48:45.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.572+0000 7f5fb3d2f980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.572+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557b63bdc620 con 0x7f5fa8037040 2024-05-09T09:48:45.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.572+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f5fac00a4d0 con 0x7f5fa8037040 2024-05-09T09:48:45.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.572+0000 7f5fb3d2f980 20 rados_obj.operate() r=0 bl.length=380 2024-05-09T09:48:45.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.572+0000 7f5fb3d2f980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-05-09T09:48:45.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.572+0000 7f5fb3d2f980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-05-09T09:48:45.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.572+0000 7f5fb3d2f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:48:45.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.572+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:95 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63be06a0 con 0x557b63ba3d40 2024-05-09T09:48:45.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.572+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(95 fud [create,call,writefull 0~206] v32'7 uv6 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7f5fa410b030 con 0x557b63ba3d40 2024-05-09T09:48:45.577 INFO:teuthology.orchestra.run.smithi157.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-05-09T09:48:45.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.576+0000 7f5e66fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:45.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.576+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93988442543728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bbe200 con 0x557b63b9f350 2024-05-09T09:48:45.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.576+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 93988442543728] v32'394 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63b9f350 2024-05-09T09:48:45.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.576+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93988442523952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bbe200 con 0x7f5fa8037040 2024-05-09T09:48:45.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.576+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 93988442523952] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x7f5fa8037040 2024-05-09T09:48:45.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.576+0000 7f5fb3d2f980 20 remove_watcher() i=0 2024-05-09T09:48:45.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.576+0000 7f5fb3d2f980 2 removed watcher, disabling cache 2024-05-09T09:48:45.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.576+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93988442528304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bbe200 con 0x557b63b9f350 2024-05-09T09:48:45.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.580+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 93988442528304] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63b9f350 2024-05-09T09:48:45.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.580+0000 7f5fb3d2f980 20 remove_watcher() i=1 2024-05-09T09:48:45.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.580+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93988442531008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bbe200 con 0x557b63ba8620 2024-05-09T09:48:45.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.580+0000 7f5fb1049640 1 -- 172.21.15.157:0/3184680261 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 93988442531008] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa800e620 con 0x557b63ba8620 2024-05-09T09:48:45.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.580+0000 7f5fb3d2f980 20 remove_watcher() i=2 2024-05-09T09:48:45.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.580+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93988442521440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bbe200 con 0x7f5fa8037040 2024-05-09T09:48:45.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.584+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 93988442521440] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x7f5fa8037040 2024-05-09T09:48:45.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.584+0000 7f5fb3d2f980 20 remove_watcher() i=3 2024-05-09T09:48:45.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.584+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93988442533216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bbe200 con 0x557b63b9f350 2024-05-09T09:48:45.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.584+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 93988442533216] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fac00a4d0 con 0x557b63b9f350 2024-05-09T09:48:45.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.584+0000 7f5fb3d2f980 20 remove_watcher() i=4 2024-05-09T09:48:45.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.584+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93988442539280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bbe200 con 0x557b63ba3d40 2024-05-09T09:48:45.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.588+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 93988442539280] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa410b030 con 0x557b63ba3d40 2024-05-09T09:48:45.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.588+0000 7f5fb3d2f980 20 remove_watcher() i=5 2024-05-09T09:48:45.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.588+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93988442542608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bbe200 con 0x557b63ba3d40 2024-05-09T09:48:45.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.588+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 93988442542608] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa410b030 con 0x557b63ba3d40 2024-05-09T09:48:45.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.588+0000 7f5fb3d2f980 20 remove_watcher() i=6 2024-05-09T09:48:45.593 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.588+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93988442546704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557b63bbe200 con 0x557b63ba3d40 2024-05-09T09:48:45.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.592+0000 7f5fb184a640 1 -- 172.21.15.157:0/3184680261 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 93988442546704] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fa410b030 con 0x557b63ba3d40 2024-05-09T09:48:45.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.592+0000 7f5fb3d2f980 20 remove_watcher() i=7 2024-05-09T09:48:45.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.592+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557b63ba3d40 msgr2=0x557b63ba6130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.592+0000 7f5fb3d2f980 1 --2- 172.21.15.157:0/3184680261 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557b63ba3d40 0x557b63ba6130 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.592+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557b63b9f350 msgr2=0x557b63ba1810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.592+0000 7f5fb3d2f980 1 --2- 172.21.15.157:0/3184680261 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557b63b9f350 0x557b63ba1810 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.592+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f5fa8037040 msgr2=0x7f5fa8036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.592+0000 7f5fb3d2f980 1 --2- 172.21.15.157:0/3184680261 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f5fa8037040 0x7f5fa8036410 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.592+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557b63ba8620 msgr2=0x557b63baaa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.592+0000 7f5fb3d2f980 1 --2- 172.21.15.157:0/3184680261 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557b63ba8620 0x557b63baaa90 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.592+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5e7c034bb0 msgr2=0x7f5e7c037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.592+0000 7f5fb3d2f980 1 --2- 172.21.15.157:0/3184680261 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5e7c034bb0 0x7f5e7c037070 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x557b63b58c20 tx=0x7f5fa8010000 comp rx=0 tx=0).stop 2024-05-09T09:48:45.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.592+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63b8b610 msgr2=0x557b63b92990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.592+0000 7f5fb3d2f980 1 --2- 172.21.15.157:0/3184680261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63b8b610 0x557b63b92990 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f5fa40c5e20 tx=0x7f5fa40c9ef0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.592+0000 7f5fb204b640 1 -- 172.21.15.157:0/3184680261 reap_dead start 2024-05-09T09:48:45.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.592+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 shutdown_connections 2024-05-09T09:48:45.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.592+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 >> 172.21.15.157:0/3184680261 conn(0x557b63b87990 msgr2=0x557b63b84ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:45.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.592+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 shutdown_connections 2024-05-09T09:48:45.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.592+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3184680261 wait complete. 2024-05-09T09:48:45.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.592+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3088047107 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5e8c034c00 msgr2=0x7f5e8c0370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.592+0000 7f5fb3d2f980 1 --2- 172.21.15.157:0/3088047107 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5e8c034c00 0x7f5e8c0370c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800bf60 tx=0x7f5fa800f000 comp rx=0 tx=0).stop 2024-05-09T09:48:45.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.592+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3088047107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63b7e860 msgr2=0x557b63b7ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.592+0000 7f5fb3d2f980 1 --2- 172.21.15.157:0/3088047107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63b7e860 0x557b63b7ec80 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f5fa401b2c0 tx=0x7f5fa40c0f10 comp rx=0 tx=0).stop 2024-05-09T09:48:45.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.592+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3088047107 shutdown_connections 2024-05-09T09:48:45.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.592+0000 7f5fb3d2f980 1 --2- 172.21.15.157:0/3088047107 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5e8c034c00 0x7f5e8c0370c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.592+0000 7f5fb3d2f980 1 --2- 172.21.15.157:0/3088047107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63b7e860 0x557b63b7ec80 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.592+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3088047107 >> 172.21.15.157:0/3088047107 conn(0x557b63b73630 msgr2=0x557b63b74140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:45.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.592+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3088047107 shutdown_connections 2024-05-09T09:48:45.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.592+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/3088047107 wait complete. 2024-05-09T09:48:45.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.596+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/1518901804 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557b63b51da0 msgr2=0x557b63b54190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.596+0000 7f5fb3d2f980 1 --2- 172.21.15.157:0/1518901804 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557b63b51da0 0x557b63b54190 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.596+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/1518901804 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557b63a56460 msgr2=0x557b63b4f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.596+0000 7f5fb3d2f980 1 --2- 172.21.15.157:0/1518901804 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557b63a56460 0x557b63b4f430 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.596+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/1518901804 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557b63b55ca0 msgr2=0x557b63b58090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.596+0000 7f5fb3d2f980 1 --2- 172.21.15.157:0/1518901804 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557b63b55ca0 0x557b63b58090 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.600 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.596+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/1518901804 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5e98034bb0 msgr2=0x7f5e98037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.596+0000 7f5fb3d2f980 1 --2- 172.21.15.157:0/1518901804 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5e98034bb0 0x7f5e98037070 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8000f70 tx=0x7f5fa80012c0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.596+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/1518901804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63a55b40 msgr2=0x557b63b484f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.596+0000 7f5fb3d2f980 1 --2- 172.21.15.157:0/1518901804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557b63a55b40 0x557b63b484f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4019930 tx=0x7f5fa4018020 comp rx=0 tx=0).stop 2024-05-09T09:48:45.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.596+0000 7f5fb204b640 1 -- 172.21.15.157:0/1518901804 reap_dead start 2024-05-09T09:48:45.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.596+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/1518901804 shutdown_connections 2024-05-09T09:48:45.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.596+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/1518901804 >> 172.21.15.157:0/1518901804 conn(0x557b639c9260 msgr2=0x557b63b3bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:45.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.596+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/1518901804 shutdown_connections 2024-05-09T09:48:45.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.596+0000 7f5fb3d2f980 1 -- 172.21.15.157:0/1518901804 wait complete. 2024-05-09T09:48:45.609 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-05-09T09:48:45.616 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-05-09T09:48:45.616 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-05-09T09:48:45.624 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-05-09T09:48:45.624 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-05-09T09:48:45.624 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-05-09T09:48:45.624 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-05-09T09:48:45.625 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-05-09T09:48:45.687 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:48:45.687 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:48:45.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.684+0000 7fede7476980 1 Processor -- start 2024-05-09T09:48:45.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.684+0000 7fede7476980 1 -- start start 2024-05-09T09:48:45.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.684+0000 7fede7476980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55cd0bc17040 0x55cd0bc19430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.684+0000 7fede7476980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cd0bac6440 con 0x55cd0bc12b40 2024-05-09T09:48:45.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.684+0000 7fede7476980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55cd0bab15f0 con 0x55cd0bc17040 2024-05-09T09:48:45.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.684+0000 7fede4790640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55cd0bc17040 0x55cd0bc19430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.684+0000 7fede4790640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55cd0bc17040 0x55cd0bc19430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:43780/0 (socket says 172.21.15.157:43780) 2024-05-09T09:48:45.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.684+0000 7fede4790640 1 -- 172.21.15.157:0/135337555 learned_addr learned my addr 172.21.15.157:0/135337555 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:45.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.684+0000 7fede4f91640 1 --1- 172.21.15.157:0/135337555 >> v1:172.21.15.110:6789/0 conn(0x55cd0bc12b40 0x55cd0bc12f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:51218/0 (socket says 172.21.15.157:51218) 2024-05-09T09:48:45.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.688+0000 7fede4790640 1 -- 172.21.15.157:0/135337555 >> v1:172.21.15.110:6789/0 conn(0x55cd0bc12b40 legacy=0x55cd0bc12f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.688+0000 7fede4790640 1 -- 172.21.15.157:0/135337555 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd0babc990 con 0x55cd0bc17040 2024-05-09T09:48:45.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.688+0000 7fede4790640 1 --2- 172.21.15.157:0/135337555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bc17040 0x55cd0bc19430 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fedd800a5c0 tx=0x7fedd801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5fad73096a36116 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.688+0000 7fede3f8f640 1 -- 172.21.15.157:0/135337555 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedd80a6070 con 0x55cd0bc17040 2024-05-09T09:48:45.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.688+0000 7fede3f8f640 1 -- 172.21.15.157:0/135337555 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedd80af070 con 0x55cd0bc17040 2024-05-09T09:48:45.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.688+0000 7fede3f8f640 1 -- 172.21.15.157:0/135337555 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedd80aa5c0 con 0x55cd0bc17040 2024-05-09T09:48:45.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.688+0000 7fede7476980 1 -- 172.21.15.157:0/135337555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bc17040 msgr2=0x55cd0bc19430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.688+0000 7fede7476980 1 --2- 172.21.15.157:0/135337555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bc17040 0x55cd0bc19430 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fedd800a5c0 tx=0x7fedd801b340 comp rx=0 tx=0).stop 2024-05-09T09:48:45.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.688+0000 7fede7476980 1 -- 172.21.15.157:0/135337555 shutdown_connections 2024-05-09T09:48:45.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.688+0000 7fede7476980 1 --2- 172.21.15.157:0/135337555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bc17040 0x55cd0bc19430 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.688+0000 7fede7476980 1 -- 172.21.15.157:0/135337555 >> 172.21.15.157:0/135337555 conn(0x55cd0bb86260 msgr2=0x55cd0bb86670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:45.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.688+0000 7fede7476980 1 -- 172.21.15.157:0/135337555 shutdown_connections 2024-05-09T09:48:45.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.688+0000 7fede7476980 1 -- 172.21.15.157:0/135337555 wait complete. 2024-05-09T09:48:45.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.704+0000 7fede7476980 1 Processor -- start 2024-05-09T09:48:45.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.704+0000 7fede7476980 1 -- start start 2024-05-09T09:48:45.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.704+0000 7fede7476980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bc12b40 0x55cd0bcfdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.704+0000 7fede7476980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55cd0bb13fe0 con 0x55cd0bc12b40 2024-05-09T09:48:45.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.704+0000 7fede4f91640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bc12b40 0x55cd0bcfdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.708+0000 7fede4f91640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bc12b40 0x55cd0bcfdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:43786/0 (socket says 172.21.15.157:43786) 2024-05-09T09:48:45.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.708+0000 7fede4f91640 1 -- 172.21.15.157:0/2828732244 learned_addr learned my addr 172.21.15.157:0/2828732244 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:45.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.708+0000 7fede4f91640 1 -- 172.21.15.157:0/2828732244 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd0ba98ae0 con 0x55cd0bc12b40 2024-05-09T09:48:45.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.708+0000 7fede4f91640 1 --2- 172.21.15.157:0/2828732244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bc12b40 0x55cd0bcfdd40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fedd4001e50 tx=0x7fedd4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc1c25ba078574e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.708+0000 7fecd2e0d640 1 -- 172.21.15.157:0/2828732244 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedd400e5d0 con 0x55cd0bc12b40 2024-05-09T09:48:45.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.708+0000 7fecd2e0d640 1 -- 172.21.15.157:0/2828732244 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedd400e770 con 0x55cd0bc12b40 2024-05-09T09:48:45.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.708+0000 7fecd2e0d640 1 -- 172.21.15.157:0/2828732244 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedd400eab0 con 0x55cd0bc12b40 2024-05-09T09:48:45.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.708+0000 7fede7476980 1 -- 172.21.15.157:0/2828732244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bc12b40 msgr2=0x55cd0bcfdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.708+0000 7fede7476980 1 --2- 172.21.15.157:0/2828732244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bc12b40 0x55cd0bcfdd40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fedd4001e50 tx=0x7fedd4001e80 comp rx=0 tx=0).stop 2024-05-09T09:48:45.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.708+0000 7fede7476980 1 -- 172.21.15.157:0/2828732244 shutdown_connections 2024-05-09T09:48:45.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.708+0000 7fede7476980 1 --2- 172.21.15.157:0/2828732244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bc12b40 0x55cd0bcfdd40 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.708+0000 7fede7476980 1 -- 172.21.15.157:0/2828732244 >> 172.21.15.157:0/2828732244 conn(0x55cd0bb86260 msgr2=0x55cd0bcf98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:45.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.708+0000 7fede7476980 1 -- 172.21.15.157:0/2828732244 shutdown_connections 2024-05-09T09:48:45.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.708+0000 7fede7476980 1 -- 172.21.15.157:0/2828732244 wait complete. 2024-05-09T09:48:45.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.708+0000 7fede7476980 1 Processor -- start 2024-05-09T09:48:45.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.708+0000 7fede7476980 1 -- start start 2024-05-09T09:48:45.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.708+0000 7fede7476980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bc12b40 0x55cd0bd04f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.708+0000 7fede7476980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55cd0bc1c460 con 0x55cd0bc12b40 2024-05-09T09:48:45.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.708+0000 7fede4f91640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bc12b40 0x55cd0bd04f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.708+0000 7fede4f91640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bc12b40 0x55cd0bd04f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:43798/0 (socket says 172.21.15.157:43798) 2024-05-09T09:48:45.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.708+0000 7fede4f91640 1 -- 172.21.15.157:0/4044865443 learned_addr learned my addr 172.21.15.157:0/4044865443 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:45.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.708+0000 7fede4f91640 1 -- 172.21.15.157:0/4044865443 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd0bd054a0 con 0x55cd0bc12b40 2024-05-09T09:48:45.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.708+0000 7fede4f91640 1 --2- 172.21.15.157:0/4044865443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bc12b40 0x55cd0bd04f60 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x55cd0bcfebd0 tx=0x7fedd4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.712+0000 7fecd160a640 1 -- 172.21.15.157:0/4044865443 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedd4001260 con 0x55cd0bc12b40 2024-05-09T09:48:45.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.712+0000 7fecd160a640 1 -- 172.21.15.157:0/4044865443 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedd400fa40 con 0x55cd0bc12b40 2024-05-09T09:48:45.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.712+0000 7fecd160a640 1 -- 172.21.15.157:0/4044865443 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedd400fd80 con 0x55cd0bc12b40 2024-05-09T09:48:45.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.712+0000 7fede7476980 1 -- 172.21.15.157:0/4044865443 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cd0bd05730 con 0x55cd0bc12b40 2024-05-09T09:48:45.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.712+0000 7fede7476980 1 -- 172.21.15.157:0/4044865443 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd0bd083c0 con 0x55cd0bc12b40 2024-05-09T09:48:45.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.712+0000 7fecd160a640 1 -- 172.21.15.157:0/4044865443 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fedd4017070 con 0x55cd0bc12b40 2024-05-09T09:48:45.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.712+0000 7fecd160a640 1 --2- 172.21.15.157:0/4044865443 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7feccc034bb0 0x7feccc037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.712+0000 7fecd160a640 1 -- 172.21.15.157:0/4044865443 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fedd4015020 con 0x55cd0bc12b40 2024-05-09T09:48:45.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.712+0000 7fede4790640 1 --2- 172.21.15.157:0/4044865443 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7feccc034bb0 0x7feccc037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.712+0000 7fede7476980 1 --2- 172.21.15.157:0/4044865443 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cd0bc17040 0x55cd0bd0bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.712+0000 7fede7476980 1 -- 172.21.15.157:0/4044865443 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd0c550 con 0x55cd0bc17040 2024-05-09T09:48:45.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.712+0000 7fede5792640 1 --2- 172.21.15.157:0/4044865443 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cd0bc17040 0x55cd0bd0bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.712+0000 7fede4790640 1 --2- 172.21.15.157:0/4044865443 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7feccc034bb0 0x7feccc037070 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fedd80ae000 tx=0x7fedd80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.712+0000 7fede5792640 1 --2- 172.21.15.157:0/4044865443 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cd0bc17040 0x55cd0bd0bee0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.712+0000 7fede5792640 1 -- 172.21.15.157:0/4044865443 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bc17040 2024-05-09T09:48:45.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.712+0000 7fede7476980 1 -- 172.21.15.157:0/4044865443 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd095e0 con 0x55cd0bc17040 2024-05-09T09:48:45.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.712+0000 7fede5792640 1 -- 172.21.15.157:0/4044865443 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bc17040 2024-05-09T09:48:45.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.712+0000 7fede7476980 1 --2- 172.21.15.157:0/4044865443 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cd0bd0e8a0 0x55cd0bd10c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.712+0000 7fede7476980 1 -- 172.21.15.157:0/4044865443 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd11380 con 0x55cd0bd0e8a0 2024-05-09T09:48:45.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.712+0000 7fede4f91640 1 --2- 172.21.15.157:0/4044865443 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cd0bd0e8a0 0x55cd0bd10c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.716+0000 7fede4f91640 1 --2- 172.21.15.157:0/4044865443 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cd0bd0e8a0 0x55cd0bd10c90 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.716+0000 7fede4f91640 1 -- 172.21.15.157:0/4044865443 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fedd402e070 con 0x55cd0bd0e8a0 2024-05-09T09:48:45.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.716+0000 7fede7476980 1 -- 172.21.15.157:0/4044865443 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd0d740 con 0x55cd0bc17040 2024-05-09T09:48:45.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.716+0000 7fede5792640 1 -- 172.21.15.157:0/4044865443 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bc17040 2024-05-09T09:48:45.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.716+0000 7fede7476980 1 --2- 172.21.15.157:0/4044865443 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cd0bd127e0 0x55cd0bd14bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.716+0000 7fede7476980 1 -- 172.21.15.157:0/4044865443 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd15310 con 0x55cd0bd127e0 2024-05-09T09:48:45.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.716+0000 7fede4790640 1 --2- 172.21.15.157:0/4044865443 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cd0bd127e0 0x55cd0bd14bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.716+0000 7fede4790640 1 --2- 172.21.15.157:0/4044865443 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cd0bd127e0 0x55cd0bd14bd0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.716+0000 7fede4790640 1 -- 172.21.15.157:0/4044865443 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd127e0 2024-05-09T09:48:45.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.720+0000 7fede7476980 1 Processor -- start 2024-05-09T09:48:45.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.720+0000 7fede7476980 1 -- start start 2024-05-09T09:48:45.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.720+0000 7fede7476980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bd3b190 0x55cd0bd3b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.720+0000 7fede7476980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55cd0bb18020 con 0x55cd0bd3b190 2024-05-09T09:48:45.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.720+0000 7fede4f91640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bd3b190 0x55cd0bd3b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.720+0000 7fede4f91640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bd3b190 0x55cd0bd3b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:43812/0 (socket says 172.21.15.157:43812) 2024-05-09T09:48:45.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.720+0000 7fede4f91640 1 -- 172.21.15.157:0/437841118 learned_addr learned my addr 172.21.15.157:0/437841118 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:45.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.720+0000 7fede4f91640 1 -- 172.21.15.157:0/437841118 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd0bd3baf0 con 0x55cd0bd3b190 2024-05-09T09:48:45.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.720+0000 7fede4f91640 1 --2- 172.21.15.157:0/437841118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bd3b190 0x55cd0bd3b5b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fedd4049570 tx=0x7fedd404b130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.720+0000 7fecc939f640 1 -- 172.21.15.157:0/437841118 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedd401a5b0 con 0x55cd0bd3b190 2024-05-09T09:48:45.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.720+0000 7fecc939f640 1 -- 172.21.15.157:0/437841118 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedd401a750 con 0x55cd0bd3b190 2024-05-09T09:48:45.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.720+0000 7fede7476980 1 -- 172.21.15.157:0/437841118 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cd0bd3c580 con 0x55cd0bd3b190 2024-05-09T09:48:45.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.720+0000 7fecc939f640 1 -- 172.21.15.157:0/437841118 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedd4042ba0 con 0x55cd0bd3b190 2024-05-09T09:48:45.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.724+0000 7fede7476980 1 -- 172.21.15.157:0/437841118 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd0bd3c580 con 0x55cd0bd3b190 2024-05-09T09:48:45.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.724+0000 7fecc939f640 1 -- 172.21.15.157:0/437841118 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fedd403a070 con 0x55cd0bd3b190 2024-05-09T09:48:45.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.724+0000 7fecc939f640 1 --2- 172.21.15.157:0/437841118 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fecbc034c00 0x7fecbc0370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.724+0000 7fecc939f640 1 -- 172.21.15.157:0/437841118 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fedd4051ac0 con 0x55cd0bd3b190 2024-05-09T09:48:45.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.724+0000 7fede4790640 1 --2- 172.21.15.157:0/437841118 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fecbc034c00 0x7fecbc0370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.724+0000 7fede7476980 1 Processor -- start 2024-05-09T09:48:45.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.724+0000 7fede7476980 1 -- start start 2024-05-09T09:48:45.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.724+0000 7fede4790640 1 --2- 172.21.15.157:0/437841118 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fecbc034c00 0x7fecbc0370c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55cd0bd0ca20 tx=0x7fedd8005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.724+0000 7fede7476980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bd47fa0 0x55cd0bd48380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.724+0000 7fede7476980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55cd0bcfe490 con 0x55cd0bd47fa0 2024-05-09T09:48:45.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.724+0000 7fede4f91640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bd47fa0 0x55cd0bd48380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.724+0000 7fede4f91640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bd47fa0 0x55cd0bd48380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:43816/0 (socket says 172.21.15.157:43816) 2024-05-09T09:48:45.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.724+0000 7fede4f91640 1 -- 172.21.15.157:0/3656184820 learned_addr learned my addr 172.21.15.157:0/3656184820 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:45.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.724+0000 7fede4f91640 1 -- 172.21.15.157:0/3656184820 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd0bd48950 con 0x55cd0bd47fa0 2024-05-09T09:48:45.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.724+0000 7fede4f91640 1 --2- 172.21.15.157:0/3656184820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bd47fa0 0x55cd0bd48380 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fedd40289b0 tx=0x7fedd40313f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380e940fa9fbb96d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.724+0000 7fecc2ffd640 1 -- 172.21.15.157:0/3656184820 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedd404c400 con 0x55cd0bd47fa0 2024-05-09T09:48:45.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.724+0000 7fecc2ffd640 1 -- 172.21.15.157:0/3656184820 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedd4060070 con 0x55cd0bd47fa0 2024-05-09T09:48:45.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.724+0000 7fecc2ffd640 1 -- 172.21.15.157:0/3656184820 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedd4019d80 con 0x55cd0bd47fa0 2024-05-09T09:48:45.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.728+0000 7fede7476980 1 -- 172.21.15.157:0/3656184820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bd47fa0 msgr2=0x55cd0bd48380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.728+0000 7fede7476980 1 --2- 172.21.15.157:0/3656184820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bd47fa0 0x55cd0bd48380 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fedd40289b0 tx=0x7fedd40313f0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.728+0000 7fede7476980 1 -- 172.21.15.157:0/3656184820 shutdown_connections 2024-05-09T09:48:45.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.728+0000 7fede7476980 1 --2- 172.21.15.157:0/3656184820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bd47fa0 0x55cd0bd48380 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.728+0000 7fede7476980 1 -- 172.21.15.157:0/3656184820 >> 172.21.15.157:0/3656184820 conn(0x55cd0bd44320 msgr2=0x55cd0bd42380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:45.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.728+0000 7fede7476980 1 -- 172.21.15.157:0/3656184820 shutdown_connections 2024-05-09T09:48:45.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.728+0000 7fede7476980 1 -- 172.21.15.157:0/3656184820 wait complete. 2024-05-09T09:48:45.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.728+0000 7fede7476980 1 Processor -- start 2024-05-09T09:48:45.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.728+0000 7fede7476980 1 -- start start 2024-05-09T09:48:45.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.728+0000 7fede7476980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bd47fa0 0x55cd0bd4f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.728+0000 7fede7476980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55cd0bd49060 con 0x55cd0bd47fa0 2024-05-09T09:48:45.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.728+0000 7fede4f91640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bd47fa0 0x55cd0bd4f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.728+0000 7fede4f91640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bd47fa0 0x55cd0bd4f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:43818/0 (socket says 172.21.15.157:43818) 2024-05-09T09:48:45.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.728+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 learned_addr learned my addr 172.21.15.157:0/3551666513 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:45.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.728+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd0bd4f840 con 0x55cd0bd47fa0 2024-05-09T09:48:45.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.728+0000 7fede4f91640 1 --2- 172.21.15.157:0/3551666513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bd47fa0 0x55cd0bd4f300 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fedd4049fd0 tx=0x7fedd4009fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.728+0000 7fecc17fa640 1 -- 172.21.15.157:0/3551666513 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedd4073070 con 0x55cd0bd47fa0 2024-05-09T09:48:45.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.728+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cd0bd4f840 con 0x55cd0bd47fa0 2024-05-09T09:48:45.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.728+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd0bd4f840 con 0x55cd0bd47fa0 2024-05-09T09:48:45.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.728+0000 7fecc17fa640 1 -- 172.21.15.157:0/3551666513 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedd403b780 con 0x55cd0bd47fa0 2024-05-09T09:48:45.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.728+0000 7fecc17fa640 1 -- 172.21.15.157:0/3551666513 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedd403ba60 con 0x55cd0bd47fa0 2024-05-09T09:48:45.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fecc17fa640 1 -- 172.21.15.157:0/3551666513 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fedd4076070 con 0x55cd0bd47fa0 2024-05-09T09:48:45.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fecc17fa640 1 --2- 172.21.15.157:0/3551666513 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fecac034b60 0x7fecac037020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fecc17fa640 1 -- 172.21.15.157:0/3551666513 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fedd4079d60 con 0x55cd0bd47fa0 2024-05-09T09:48:45.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fede4790640 1 --2- 172.21.15.157:0/3551666513 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fecac034b60 0x7fecac037020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fede7476980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fede7476980 1 --2- 172.21.15.157:0/3551666513 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cd0bd5bef0 0x55cd0bd5e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5eb00 con 0x55cd0bd5bef0 2024-05-09T09:48:45.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fede5792640 1 --2- 172.21.15.157:0/3551666513 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cd0bd5bef0 0x55cd0bd5e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fede4790640 1 --2- 172.21.15.157:0/3551666513 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fecac034b60 0x7fecac037020 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55cd0bd15710 tx=0x7fedd80c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fede5792640 1 --2- 172.21.15.157:0/3551666513 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cd0bd5bef0 0x55cd0bd5e3b0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fede7476980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:45.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fede7476980 20 realm 2024-05-09T09:48:45.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fede7476980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5ef10 con 0x55cd0bd5bef0 2024-05-09T09:48:45.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fede7476980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:45.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fede7476980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:48:45.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fede7476980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5f7e0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fede7476980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:45.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fede7476980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x55cd0bd5bef0 2024-05-09T09:48:45.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fede7476980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:45.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fede7476980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fede7476980 1 --2- 172.21.15.157:0/3551666513 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cd0bd608e0 0x55cd0bd62cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd632e0 con 0x55cd0bd608e0 2024-05-09T09:48:45.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fede4f91640 1 --2- 172.21.15.157:0/3551666513 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cd0bd608e0 0x55cd0bd62cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.732+0000 7fede4f91640 1 --2- 172.21.15.157:0/3551666513 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cd0bd608e0 0x55cd0bd62cd0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.736+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.736+0000 7fede7476980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:48:45.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.736+0000 7fede7476980 20 searching for the correct realm 2024-05-09T09:48:45.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.736+0000 7fede7476980 1 --2- 172.21.15.157:0/3551666513 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cd0bd65230 0x55cd0bd67680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.736+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd67d50 con 0x55cd0bd65230 2024-05-09T09:48:45.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.736+0000 7fede4790640 1 --2- 172.21.15.157:0/3551666513 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cd0bd65230 0x55cd0bd67680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.736+0000 7fede4790640 1 --2- 172.21.15.157:0/3551666513 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cd0bd65230 0x55cd0bd67680 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.736+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.736+0000 7fede4790640 1 --2- 172.21.15.157:0/3551666513 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fedd80e0040 0x7fedd80e0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.736+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd67d50 con 0x7fedd80e0040 2024-05-09T09:48:45.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.736+0000 7fede5792640 1 --2- 172.21.15.157:0/3551666513 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fedd80e0040 0x7fedd80e0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.736+0000 7fede5792640 1 --2- 172.21.15.157:0/3551666513 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fedd80e0040 0x7fedd80e0930 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.736+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feddc00a4d0 con 0x7fedd80e0040 2024-05-09T09:48:45.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.736+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x55cd0bd608e0 2024-05-09T09:48:45.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.736+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.736+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x55cd0bd5bef0 2024-05-09T09:48:45.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.736+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.736+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x55cd0bd5bef0 2024-05-09T09:48:45.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.736+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.736+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x55cd0bd608e0 2024-05-09T09:48:45.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.740+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.740+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x55cd0bd608e0 2024-05-09T09:48:45.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.740+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.740+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x7fedd80e0040 2024-05-09T09:48:45.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.740+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feddc00a4d0 con 0x7fedd80e0040 2024-05-09T09:48:45.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.740+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x55cd0bd65230 2024-05-09T09:48:45.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.740+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.740+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x55cd0bd5bef0 2024-05-09T09:48:45.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.740+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.740+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x55cd0bd608e0 2024-05-09T09:48:45.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.740+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.740+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x55cd0bd5bef0 2024-05-09T09:48:45.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.740+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.740+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x7fedd80e0040 2024-05-09T09:48:45.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.740+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7feddc00a4d0 con 0x7fedd80e0040 2024-05-09T09:48:45.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.740+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x55cd0bd65230 2024-05-09T09:48:45.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.740+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.740+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x55cd0bd65230 2024-05-09T09:48:45.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.740+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.740+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x55cd0bd608e0 2024-05-09T09:48:45.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.744+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.744+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x55cd0bd65230 2024-05-09T09:48:45.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.744+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.744+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x55cd0bd65230 2024-05-09T09:48:45.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.744+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.744+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x55cd0bd5bef0 2024-05-09T09:48:45.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.744+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.744+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x55cd0bd5bef0 2024-05-09T09:48:45.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.744+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.744+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x55cd0bd608e0 2024-05-09T09:48:45.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.744+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.744+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x55cd0bd65230 2024-05-09T09:48:45.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.744+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.744+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x7fedd80e0040 2024-05-09T09:48:45.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.744+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feddc00a4d0 con 0x7fedd80e0040 2024-05-09T09:48:45.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.744+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x55cd0bd5bef0 2024-05-09T09:48:45.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.744+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.744+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x55cd0bd608e0 2024-05-09T09:48:45.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.744+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x55cd0bd65230 2024-05-09T09:48:45.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x55cd0bd608e0 2024-05-09T09:48:45.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x7fedd80e0040 2024-05-09T09:48:45.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feddc00a4d0 con 0x7fedd80e0040 2024-05-09T09:48:45.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x55cd0bd65230 2024-05-09T09:48:45.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x55cd0bd608e0 2024-05-09T09:48:45.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x55cd0bd5bef0 2024-05-09T09:48:45.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd5fb80 con 0x7fedd80e0040 2024-05-09T09:48:45.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feddc00a4d0 con 0x7fedd80e0040 2024-05-09T09:48:45.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede7476980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:48:45.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede7476980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:48:45.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede7476980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:48:45.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede7476980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:48:45.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede7476980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:48:45.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede7476980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:48:45.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede7476980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd63ba0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede7476980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:45.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede7476980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd63ba0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede7476980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:45.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede7476980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd63ba0 con 0x55cd0bd65230 2024-05-09T09:48:45.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede7476980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:48:45.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede7476980 20 zone default found 2024-05-09T09:48:45.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede7476980 4 Realm: () 2024-05-09T09:48:45.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede7476980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:48:45.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede7476980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:48:45.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede7476980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:48:45.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede7476980 20 zonegroup default 2024-05-09T09:48:45.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede7476980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.748+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd64590 con 0x55cd0bd608e0 2024-05-09T09:48:45.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.752+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.752+0000 7fede7476980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:45.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.752+0000 7fede7476980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.752+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd64140 con 0x55cd0bd65230 2024-05-09T09:48:45.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.752+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.752+0000 7fede7476980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:45.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.752+0000 7fede7476980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.752+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd6a110 con 0x55cd0bd65230 2024-05-09T09:48:45.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.752+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.752+0000 7fede7476980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:45.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.752+0000 7fede7476980 20 started sync module instance, tier type = 2024-05-09T09:48:45.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.752+0000 7fede7476980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:48:45.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.752+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd694f0 con 0x7fedd80e0040 2024-05-09T09:48:45.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.752+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feddc00a4d0 con 0x7fedd80e0040 2024-05-09T09:48:45.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.752+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94339155270160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd694f0 con 0x7fedd80e0040 2024-05-09T09:48:45.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.752+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd6ac20 con 0x55cd0bd5bef0 2024-05-09T09:48:45.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.752+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94339155270160] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feddc00a4d0 con 0x7fedd80e0040 2024-05-09T09:48:45.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.756+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.756+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94339155273488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd694f0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.756+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd6b630 con 0x55cd0bd65230 2024-05-09T09:48:45.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.756+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94339155273488] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.756+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.756+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94339155267648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd69460 con 0x55cd0bd65230 2024-05-09T09:48:45.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.756+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd6c3c0 con 0x7fedd80e0040 2024-05-09T09:48:45.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.760+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feddc00a4d0 con 0x7fedd80e0040 2024-05-09T09:48:45.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.760+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94339155279568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd6cc60 con 0x7fedd80e0040 2024-05-09T09:48:45.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.760+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd6d620 con 0x55cd0bd5bef0 2024-05-09T09:48:45.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.760+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94339155267648] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.760+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94339155279568] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feddc00a4d0 con 0x7fedd80e0040 2024-05-09T09:48:45.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.760+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.760+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94339155284336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd6cbc0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.760+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd6d590 con 0x55cd0bd608e0 2024-05-09T09:48:45.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.764+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94339155284336] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.764+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.764+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94339155281680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd6def0 con 0x55cd0bd608e0 2024-05-09T09:48:45.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.764+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd6e740 con 0x55cd0bd608e0 2024-05-09T09:48:45.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.764+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94339155281680] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.764+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.764+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94339155286592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd6ef90 con 0x55cd0bd608e0 2024-05-09T09:48:45.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.764+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd6f7e0 con 0x55cd0bd608e0 2024-05-09T09:48:45.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.768+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.768+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94339155293520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd6ffe0 con 0x55cd0bd608e0 2024-05-09T09:48:45.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.768+0000 7fede7476980 20 add_watcher() i=0 2024-05-09T09:48:45.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.768+0000 7fede7476980 20 add_watcher() i=1 2024-05-09T09:48:45.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.768+0000 7fede7476980 20 add_watcher() i=2 2024-05-09T09:48:45.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.768+0000 7fede7476980 20 add_watcher() i=3 2024-05-09T09:48:45.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.768+0000 7fede7476980 20 add_watcher() i=4 2024-05-09T09:48:45.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.768+0000 7fede7476980 20 add_watcher() i=5 2024-05-09T09:48:45.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.768+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94339155286592] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.768+0000 7fede7476980 20 add_watcher() i=6 2024-05-09T09:48:45.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.768+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94339155293520] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.768+0000 7fede7476980 20 add_watcher() i=7 2024-05-09T09:48:45.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.768+0000 7fede7476980 2 all 8 watchers are set, enabling cache 2024-05-09T09:48:45.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.768+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd6eae0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.772+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.774 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.772+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94339155290848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd70530 con 0x55cd0bd5bef0 2024-05-09T09:48:45.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.772+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94339155290848] v32'395 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.772+0000 7fec99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:45.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.772+0000 7fede7476980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:48:45.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.772+0000 7fede7476980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:48:45.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.772+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7ba30 con 0x55cd0bd5bef0 2024-05-09T09:48:45.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.772+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'92 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.772+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7c080 con 0x55cd0bd608e0 2024-05-09T09:48:45.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.776+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'86 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.776+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7c080 con 0x55cd0bd65230 2024-05-09T09:48:45.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.776+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'85 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.776+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7c690 con 0x55cd0bd5bef0 2024-05-09T09:48:45.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.780+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'396 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.780+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7cb40 con 0x7fedd80e0040 2024-05-09T09:48:45.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.780+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'245 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feddc00a4d0 con 0x7fedd80e0040 2024-05-09T09:48:45.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.780+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7d0b0 con 0x55cd0bd65230 2024-05-09T09:48:45.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.780+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'164 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.780+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7d560 con 0x55cd0bd5bef0 2024-05-09T09:48:45.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.784+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'87 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.784+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7d560 con 0x55cd0bd608e0 2024-05-09T09:48:45.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.784+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'163 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.784+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7d5f0 con 0x7fedd80e0040 2024-05-09T09:48:45.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.788+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'85 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feddc00a4d0 con 0x7fedd80e0040 2024-05-09T09:48:45.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.788+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7d740 con 0x55cd0bd65230 2024-05-09T09:48:45.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.788+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'91 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.788+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7db80 con 0x7fedd80e0040 2024-05-09T09:48:45.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.792+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'246 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feddc00a4d0 con 0x7fedd80e0040 2024-05-09T09:48:45.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.792+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7db80 con 0x55cd0bd608e0 2024-05-09T09:48:45.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.792+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'89 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.792+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7db80 con 0x7fedd80e0040 2024-05-09T09:48:45.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.792+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'85 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feddc00a4d0 con 0x7fedd80e0040 2024-05-09T09:48:45.797 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.792+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7db80 con 0x55cd0bd608e0 2024-05-09T09:48:45.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.796+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'169 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.796+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7db80 con 0x55cd0bd5bef0 2024-05-09T09:48:45.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.796+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'397 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.796+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7db80 con 0x55cd0bd65230 2024-05-09T09:48:45.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.800+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'239 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.800+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7dc10 con 0x7fedd80e0040 2024-05-09T09:48:45.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.800+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'247 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feddc00a4d0 con 0x7fedd80e0040 2024-05-09T09:48:45.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.800+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7dc10 con 0x55cd0bd65230 2024-05-09T09:48:45.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.804+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'85 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.804+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7dd00 con 0x55cd0bd5bef0 2024-05-09T09:48:45.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.804+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'93 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.808 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.804+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7dd00 con 0x55cd0bd5bef0 2024-05-09T09:48:45.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.808+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'398 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.808+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7dca0 con 0x55cd0bd65230 2024-05-09T09:48:45.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.808+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'240 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.808+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7dca0 con 0x7fedd80e0040 2024-05-09T09:48:45.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.812+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'97 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feddc00a4d0 con 0x7fedd80e0040 2024-05-09T09:48:45.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.812+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7e1a0 con 0x55cd0bd65230 2024-05-09T09:48:45.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.812+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'87 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.812+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7e1a0 con 0x55cd0bd65230 2024-05-09T09:48:45.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.812+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'91 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.812+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7e1a0 con 0x55cd0bd65230 2024-05-09T09:48:45.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.816+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'82 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.816+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7e1a0 con 0x55cd0bd65230 2024-05-09T09:48:45.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.816+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'165 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.816+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7e1a0 con 0x55cd0bd608e0 2024-05-09T09:48:45.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.820+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'87 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.820+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7e1a0 con 0x55cd0bd65230 2024-05-09T09:48:45.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.820+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'85 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.823 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.820+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7e1a0 con 0x55cd0bd608e0 2024-05-09T09:48:45.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.820+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'164 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.820+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7e1a0 con 0x55cd0bd65230 2024-05-09T09:48:45.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.824+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'241 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.824+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7e1a0 con 0x55cd0bd608e0 2024-05-09T09:48:45.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.824+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'170 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.824+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7e1a0 con 0x7fedd80e0040 2024-05-09T09:48:45.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.828+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'91 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feddc00a4d0 con 0x7fedd80e0040 2024-05-09T09:48:45.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.828+0000 7fec98fe1640 20 reqs_thread_entry: start 2024-05-09T09:48:45.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.828+0000 7fede7476980 20 init_complete bucket index max shards: 11 2024-05-09T09:48:45.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.828+0000 7fec127fc640 20 reqs_thread_entry: start 2024-05-09T09:48:45.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.828+0000 7fede7476980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-05-09T09:48:45.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.828+0000 7fede7476980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.828+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd99680 con 0x7fedd80e0040 2024-05-09T09:48:45.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.828+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7feddc00a4d0 con 0x7fedd80e0040 2024-05-09T09:48:45.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.828+0000 7fede7476980 20 rados_obj.operate() r=0 bl.length=380 2024-05-09T09:48:45.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.828+0000 7fede7476980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-05-09T09:48:45.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.828+0000 7fede7476980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-05-09T09:48:45.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.828+0000 7fede7476980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:48:45.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.828+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd9c070 con 0x55cd0bd5bef0 2024-05-09T09:48:45.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.832+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.832+0000 7fede7476980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 : miss 2024-05-09T09:48:45.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.832+0000 7fede7476980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.832+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:96 8.9 8:903c066b:root::.bucket.meta.myfoo6%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd9bdc0 con 0x7fedd80e0040 2024-05-09T09:48:45.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.832+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(96 .bucket.meta.myfoo6:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=212b] v0'0 uv46 ondisk = 0) ==== 333+0+656 (crc 0 0 0) 0x7feddc00a4d0 con 0x7fedd80e0040 2024-05-09T09:48:45.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.832+0000 7fede7476980 20 rados_obj.operate() r=0 bl.length=380 2024-05-09T09:48:45.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.832+0000 7fede7476980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 info.flags=0x17 2024-05-09T09:48:45.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.832+0000 7fede7476980 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 to cache LRU end 2024-05-09T09:48:45.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.832+0000 7fede7476980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:48:45.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.832+0000 7fede7476980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-05-09T09:48:45.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.832+0000 7fede7476980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 2024-05-09T09:48:45.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.832+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:97 4.29 4:973212f7:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0be192f0 con 0x55cd0bd65230 2024-05-09T09:48:45.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.832+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(97 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.832+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 4.31 4:8ff91c31:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0be192f0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.832+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(98 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.1 [call out=85b] v0'0 uv8 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.832+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:99 4.17 4:e95774a5:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0be192f0 con 0x55cd0bd608e0 2024-05-09T09:48:45.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.832+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(99 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.832+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:100 4.17 4:e9b509e3:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0be19330 con 0x55cd0bd608e0 2024-05-09T09:48:45.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.832+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(100 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.3 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.832+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:101 4.b 4:d0bb5411:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0be19330 con 0x7fedd80e0040 2024-05-09T09:48:45.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.836+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(101 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7feddc00a4d0 con 0x7fedd80e0040 2024-05-09T09:48:45.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.836+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:102 4.1a 4:5ab4a268:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0be19330 con 0x7fedd80e0040 2024-05-09T09:48:45.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.836+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(102 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.5 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7feddc00a4d0 con 0x7fedd80e0040 2024-05-09T09:48:45.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.836+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 4.28 4:17427c01:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0be19330 con 0x55cd0bd5bef0 2024-05-09T09:48:45.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.836+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(103 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.836+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:104 4.16 4:6aa2cc25:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0be19330 con 0x7fedd80e0040 2024-05-09T09:48:45.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.836+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(104 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7feddc00a4d0 con 0x7fedd80e0040 2024-05-09T09:48:45.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.836+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:105 4.25 4:a5d40d9a:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0be19330 con 0x55cd0bd65230 2024-05-09T09:48:45.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.836+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(105 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.8 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.836+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:106 4.26 4:66693406:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0be19330 con 0x55cd0bd608e0 2024-05-09T09:48:45.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.836+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(106 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.9 [call out=289b] v0'0 uv9 ondisk = 0) ==== 194+0+289 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.836+0000 7fede7476980 10 cls_bucket_list_unordered: got thirteen 2024-05-09T09:48:45.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.836+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:107 4.3d 4:bd59d60b:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0be19330 con 0x55cd0bd65230 2024-05-09T09:48:45.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.836+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== osd_op_reply(107 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.836+0000 7fede7476980 20 get_obj_state: octx=0x7feddc00aae0 obj=myfoo6:thirteen state=0x55cd0be173b8 s->prefetch_data=0 2024-05-09T09:48:45.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.836+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:108 3.3ds0 3:bf808594:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0be181e0 con 0x55cd0bd65230 2024-05-09T09:48:45.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.840+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 30 ==== osd_op_reply(108 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9_thirteen [getxattrs out=819b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 238+0+835 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.840+0000 7fede7476980 10 manifest: total_size = 8 2024-05-09T09:48:45.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.840+0000 7fede7476980 20 get_obj_state: setting s->obj_tag to _GZ0Vz_gREGoJLyhBjQXxHnb0mQ1NAWL 2024-05-09T09:48:45.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.840+0000 7fede7476980 20 get_obj_state: octx=0x7feddc00aae0 obj=myfoo6:thirteen state=0x55cd0be173b8 s->prefetch_data=0 2024-05-09T09:48:45.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.840+0000 7fede7476980 20 prepare_atomic_modification: state is not atomic. state=0x55cd0be173b8 2024-05-09T09:48:45.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.840+0000 7fede7476980 20 bucket index object: :.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.9 2024-05-09T09:48:45.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.840+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:109 4.26 4:66693406:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0be18aa0 con 0x55cd0bd608e0 2024-05-09T09:48:45.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.840+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(109 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.9 [stat,call,call] v32'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.840+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:110 3.3ds0 3:bf808594:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0be18aa0 con 0x55cd0bd65230 2024-05-09T09:48:45.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.844+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 31 ==== osd_op_reply(110 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9_thirteen [call] v32'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.844+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:111 4.26 4:66693406:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bda0970 con 0x55cd0bd608e0 2024-05-09T09:48:45.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.844+0000 7fede7476980 20 list_objects_ordered: starting attempt 1 2024-05-09T09:48:45.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.844+0000 7fede7476980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-09T09:48:45.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.844+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:112 4.29 4:973212f7:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bda0970 con 0x55cd0bd65230 2024-05-09T09:48:45.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.844+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:113 4.31 4:8ff91c31:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bda4c40 con 0x55cd0bd5bef0 2024-05-09T09:48:45.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.844+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:114 4.17 4:e95774a5:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bda75a0 con 0x55cd0bd608e0 2024-05-09T09:48:45.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.844+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:115 4.17 4:e9b509e3:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bdaa010 con 0x55cd0bd608e0 2024-05-09T09:48:45.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.844+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:116 4.b 4:d0bb5411:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bdacbc0 con 0x7fedd80e0040 2024-05-09T09:48:45.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.844+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:117 4.1a 4:5ab4a268:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bdaf4b0 con 0x7fedd80e0040 2024-05-09T09:48:45.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.844+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:118 4.28 4:17427c01:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bdb1e10 con 0x55cd0bd5bef0 2024-05-09T09:48:45.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.844+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:119 4.16 4:6aa2cc25:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bdb49a0 con 0x7fedd80e0040 2024-05-09T09:48:45.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.844+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:120 4.25 4:a5d40d9a:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bdb7820 con 0x55cd0bd65230 2024-05-09T09:48:45.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.844+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:121 4.26 4:66693406:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bdba650 con 0x55cd0bd608e0 2024-05-09T09:48:45.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.844+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:122 4.3d 4:bd59d60b:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bdbd4d0 con 0x55cd0bd65230 2024-05-09T09:48:45.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.844+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 32 ==== osd_op_reply(112 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.844+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(113 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.1 [call out=85b] v0'0 uv8 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.844+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(118 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7feddc00a4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.844+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(114 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.844+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 33 ==== osd_op_reply(120 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.8 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.844+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 34 ==== osd_op_reply(122 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.844+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 23 ==== osd_op_reply(116 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7feddc00a4d0 con 0x7fedd80e0040 2024-05-09T09:48:45.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.844+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 24 ==== osd_op_reply(119 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7feddc00a4d0 con 0x7fedd80e0040 2024-05-09T09:48:45.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.844+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 25 ==== osd_op_reply(117 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.5 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7feddc00a4d0 con 0x7fedd80e0040 2024-05-09T09:48:45.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.844+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(115 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.3 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.844+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(111 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.9 [stat,call,call] v32'11 uv11 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.844+0000 7fecc2ffd640 20 handle_completion(): completion ok for obj=thirteen 2024-05-09T09:48:45.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 32 ==== osd_op_reply(121 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.9 [call out=124b] v0'0 uv11 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede7476980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-09T09:48:45.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede7476980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-09T09:48:45.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede7476980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-09T09:48:45.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede7476980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-09T09:48:45.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede7476980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9])"; uploads.size()=0; is_truncated=0 2024-05-09T09:48:45.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:123 4.29 4:973212f7:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bda7620 con 0x55cd0bd65230 2024-05-09T09:48:45.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:124 4.31 4:8ff91c31:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bdba650 con 0x55cd0bd5bef0 2024-05-09T09:48:45.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:125 4.17 4:e95774a5:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bdbd4d0 con 0x55cd0bd608e0 2024-05-09T09:48:45.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:126 4.17 4:e9b509e3:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bdb7820 con 0x55cd0bd608e0 2024-05-09T09:48:45.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:127 4.b 4:d0bb5411:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bda7620 con 0x7fedd80e0040 2024-05-09T09:48:45.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:128 4.1a 4:5ab4a268:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bdba650 con 0x7fedd80e0040 2024-05-09T09:48:45.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:129 4.28 4:17427c01:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bdbd4d0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:130 4.16 4:6aa2cc25:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bda7620 con 0x7fedd80e0040 2024-05-09T09:48:45.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:131 4.25 4:a5d40d9a:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bdb7820 con 0x55cd0bd65230 2024-05-09T09:48:45.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:132 4.26 4:66693406:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bdba650 con 0x55cd0bd608e0 2024-05-09T09:48:45.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:133 4.3d 4:bd59d60b:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bda7620 con 0x55cd0bd65230 2024-05-09T09:48:45.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(124 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.1 [call out=85b] v0'0 uv8 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7feddc051040 con 0x55cd0bd5bef0 2024-05-09T09:48:45.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(129 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7feddc051040 con 0x55cd0bd5bef0 2024-05-09T09:48:45.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 26 ==== osd_op_reply(127 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7feddc051040 con 0x7fedd80e0040 2024-05-09T09:48:45.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 35 ==== osd_op_reply(123 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 36 ==== osd_op_reply(131 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.8 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 33 ==== osd_op_reply(125 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 37 ==== osd_op_reply(133 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 27 ==== osd_op_reply(128 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.5 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7feddc051040 con 0x7fedd80e0040 2024-05-09T09:48:45.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 34 ==== osd_op_reply(132 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.9 [call out=124b] v0'0 uv11 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 28 ==== osd_op_reply(130 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7feddc051040 con 0x7fedd80e0040 2024-05-09T09:48:45.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 35 ==== osd_op_reply(126 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.3 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bdba650 con 0x55cd0bd5bef0 2024-05-09T09:48:45.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(134 bud.buckets [call] v32'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7feddc051040 con 0x55cd0bd5bef0 2024-05-09T09:48:45.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede7476980 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-05-09T09:48:45.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede7476980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bda7620 con 0x55cd0bd5bef0 2024-05-09T09:48:45.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv21 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7feddc051040 con 0x55cd0bd5bef0 2024-05-09T09:48:45.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede7476980 20 rados_obj.operate() r=0 bl.length=166 2024-05-09T09:48:45.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede7476980 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-05-09T09:48:45.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede7476980 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-05-09T09:48:45.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.848+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bdba650 con 0x55cd0bd5bef0 2024-05-09T09:48:45.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.852+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 36 ==== osd_op_reply(136 myfoo6 [call,call,delete] v32'22 uv22 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7feddc051040 con 0x55cd0bd5bef0 2024-05-09T09:48:45.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.852+0000 7fede7476980 10 removing default.rgw.meta+root+myfoo6 from cache 2024-05-09T09:48:45.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.852+0000 7fede7476980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-05-09T09:48:45.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.852+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94339155589152 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bda7620 con 0x7fedd80e0040 2024-05-09T09:48:45.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.852+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 29 ==== watch-notify(notify (1) cookie 94339155279568 notify 137438953489 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55cd0bd9b370 con 0x7fedd80e0040 2024-05-09T09:48:45.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.852+0000 7fecc2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953489 cookie 94339155279568 notifier 4761 bl.length()=150 2024-05-09T09:48:45.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.852+0000 7fecc2ffd640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7feca8005580 con 0x7fedd80e0040 2024-05-09T09:48:45.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.852+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 30 ==== osd_op_reply(137 notify.3 [notify cookie 94339155589152 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7feddc051040 con 0x7fedd80e0040 2024-05-09T09:48:45.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.852+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 31 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feddc051040 con 0x7fedd80e0040 2024-05-09T09:48:45.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.852+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 32 ==== watch-notify(notify_complete (2) cookie 94339155589152 notify 137438953489 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cd0bd7cee0 con 0x7fedd80e0040 2024-05-09T09:48:45.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.852+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:139 8.9 8:903c066b:root::.bucket.meta.myfoo6%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bdba650 con 0x7fedd80e0040 2024-05-09T09:48:45.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.856+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 33 ==== osd_op_reply(139 .bucket.meta.myfoo6:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 [call,call,delete] v32'48 uv48 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7feddc051040 con 0x7fedd80e0040 2024-05-09T09:48:45.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.856+0000 7fede7476980 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 from cache 2024-05-09T09:48:45.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.856+0000 7fede7476980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9, ofs0, ns] 2024-05-09T09:48:45.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.856+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:140 7.0 7:05bf5b68:::notify.1:head [notify cookie 94339155589152 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bda7620 con 0x55cd0bd5bef0 2024-05-09T09:48:45.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.856+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 37 ==== watch-notify(notify (1) cookie 94339155273488 notify 137438953500 ret 0) ==== 249+0+0 (crc 0 0 0) 0x55cd0bd7cee0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.856+0000 7fecc27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953500 cookie 94339155273488 notifier 4761 bl.length()=207 2024-05-09T09:48:45.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.856+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 38 ==== osd_op_reply(140 notify.1 [notify cookie 94339155589152 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7feddc051040 con 0x55cd0bd5bef0 2024-05-09T09:48:45.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.856+0000 7fecc27fc640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:141 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fec18003990 con 0x55cd0bd5bef0 2024-05-09T09:48:45.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.856+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 39 ==== watch-notify(notify_complete (2) cookie 94339155589152 notify 137438953500 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cd0bd7b3e0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.856+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 40 ==== osd_op_reply(141 notify.1 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feddc051040 con 0x55cd0bd5bef0 2024-05-09T09:48:45.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.856+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:142 4.29 4:973212f7:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bdba650 con 0x55cd0bd65230 2024-05-09T09:48:45.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.856+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:143 4.31 4:8ff91c31:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bda7620 con 0x55cd0bd5bef0 2024-05-09T09:48:45.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.856+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:144 4.17 4:e95774a5:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bdb7820 con 0x55cd0bd608e0 2024-05-09T09:48:45.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.856+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:145 4.17 4:e9b509e3:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bdba650 con 0x55cd0bd608e0 2024-05-09T09:48:45.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.856+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:146 4.b 4:d0bb5411:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bda7620 con 0x7fedd80e0040 2024-05-09T09:48:45.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.856+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:147 4.1a 4:5ab4a268:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bdbab70 con 0x7fedd80e0040 2024-05-09T09:48:45.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.856+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:148 4.28 4:17427c01:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bdb7820 con 0x55cd0bd5bef0 2024-05-09T09:48:45.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.856+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:149 4.16 4:6aa2cc25:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bdba650 con 0x7fedd80e0040 2024-05-09T09:48:45.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.856+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:150 4.25 4:a5d40d9a:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bdb81a0 con 0x55cd0bd65230 2024-05-09T09:48:45.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.856+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:151 4.26 4:66693406:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bdb8e10 con 0x55cd0bd608e0 2024-05-09T09:48:45.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.856+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:152 4.3d 4:bd59d60b:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bdb9800 con 0x55cd0bd65230 2024-05-09T09:48:45.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.856+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 41 ==== osd_op_reply(143 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.1 [delete] v32'9 uv9 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7feddc051040 con 0x55cd0bd5bef0 2024-05-09T09:48:45.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.856+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 38 ==== osd_op_reply(142 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.0 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.860+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 36 ==== osd_op_reply(144 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.2 [delete] v32'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.860+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 39 ==== osd_op_reply(152 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.10 [delete] v32'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.860+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 34 ==== osd_op_reply(146 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.4 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7feddc051040 con 0x7fedd80e0040 2024-05-09T09:48:45.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.860+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 40 ==== osd_op_reply(150 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.8 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.860+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 37 ==== osd_op_reply(151 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.9 [delete] v32'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.860+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 38 ==== osd_op_reply(145 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.3 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.860+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 42 ==== osd_op_reply(148 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.6 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7feddc051040 con 0x55cd0bd5bef0 2024-05-09T09:48:45.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.860+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 35 ==== osd_op_reply(149 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.7 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7feddc051040 con 0x7fedd80e0040 2024-05-09T09:48:45.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.860+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 36 ==== osd_op_reply(147 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9.5 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7feddc051040 con 0x7fedd80e0040 2024-05-09T09:48:45.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.860+0000 7fede7476980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 : miss 2024-05-09T09:48:45.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.860+0000 7fede7476980 20 rados->read ofs=0 len=0 2024-05-09T09:48:45.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.860+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:153 6.b 6:d0244877:::pubsub..bucket.myfoo6%2fb73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bda75c0 con 0x55cd0bd65230 2024-05-09T09:48:45.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.860+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 41 ==== osd_op_reply(153 pubsub..bucket.myfoo6/b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.860+0000 7fede7476980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:45.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.860+0000 7fede7476980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 info.flags=0x0 2024-05-09T09:48:45.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.860+0000 7fede7476980 10 adding default.rgw.log++pubsub..bucket.myfoo6/b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 to cache LRU end 2024-05-09T09:48:45.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.860+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:154 6.b 6:d0244877:::pubsub..bucket.myfoo6%2fb73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bda75c0 con 0x55cd0bd65230 2024-05-09T09:48:45.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.860+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 42 ==== osd_op_reply(154 pubsub..bucket.myfoo6/b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9 [delete] v32'86 uv65 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.860+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bda75c0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.864+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 43 ==== osd_op_reply(155 bud.buckets [call] v32'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7feddc051040 con 0x55cd0bd5bef0 2024-05-09T09:48:45.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.864+0000 7fede7476980 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-05-09T09:48:45.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.864+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bda75c0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.864+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 44 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v32'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7feddc051040 con 0x55cd0bd5bef0 2024-05-09T09:48:45.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.864+0000 7fede7476980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-05-09T09:48:45.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.864+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94339155589152 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bda75c0 con 0x55cd0bd608e0 2024-05-09T09:48:45.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.864+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 39 ==== watch-notify(notify (1) cookie 94339155281680 notify 137438953510 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55cd0bd7d790 con 0x55cd0bd608e0 2024-05-09T09:48:45.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.864+0000 7fecc2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953510 cookie 94339155281680 notifier 4761 bl.length()=170 2024-05-09T09:48:45.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.864+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 40 ==== osd_op_reply(157 notify.5 [notify cookie 94339155589152 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.864+0000 7fecc2ffd640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7feca8005580 con 0x55cd0bd608e0 2024-05-09T09:48:45.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.864+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 41 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.864+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 42 ==== watch-notify(notify_complete (2) cookie 94339155589152 notify 137438953510 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cd0bd083c0 con 0x55cd0bd608e0 2024-05-09T09:48:45.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.864+0000 7fede7476980 10 removing email index: 2024-05-09T09:48:45.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.864+0000 7fede7476980 10 removing user buckets index 2024-05-09T09:48:45.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.864+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bda75c0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.868+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 45 ==== osd_op_reply(159 bud.buckets [delete] v32'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7feddc051040 con 0x55cd0bd5bef0 2024-05-09T09:48:45.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.868+0000 7fede7476980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-05-09T09:48:45.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.868+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94339155589152 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bda75c0 con 0x55cd0bd608e0 2024-05-09T09:48:45.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.868+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 43 ==== watch-notify(notify (1) cookie 94339155286592 notify 137438953511 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55cd0bd083c0 con 0x55cd0bd608e0 2024-05-09T09:48:45.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.868+0000 7fecc27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953511 cookie 94339155286592 notifier 4761 bl.length()=160 2024-05-09T09:48:45.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.868+0000 7fecc27fc640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fec18003930 con 0x55cd0bd608e0 2024-05-09T09:48:45.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.868+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 44 ==== osd_op_reply(160 notify.6 [notify cookie 94339155589152 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.868+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 45 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.868+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 46 ==== watch-notify(notify_complete (2) cookie 94339155589152 notify 137438953511 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cd0bd05730 con 0x55cd0bd608e0 2024-05-09T09:48:45.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.868+0000 7fede7476980 10 removing user index: bud 2024-05-09T09:48:45.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.868+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bda75c0 con 0x7fedd80e0040 2024-05-09T09:48:45.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.872+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 37 ==== osd_op_reply(162 bud [call,call,delete] v32'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7feddc051040 con 0x7fedd80e0040 2024-05-09T09:48:45.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.872+0000 7fede7476980 10 removing default.rgw.meta+users.uid+bud from cache 2024-05-09T09:48:45.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.872+0000 7fede7476980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-05-09T09:48:45.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.872+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94339155589152 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bda75c0 con 0x55cd0bd608e0 2024-05-09T09:48:45.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.872+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 47 ==== watch-notify(notify (1) cookie 94339155281680 notify 137438953512 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55cd0bd05730 con 0x55cd0bd608e0 2024-05-09T09:48:45.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.872+0000 7fecc2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953512 cookie 94339155281680 notifier 4761 bl.length()=152 2024-05-09T09:48:45.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.872+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 48 ==== osd_op_reply(163 notify.5 [notify cookie 94339155589152 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.872+0000 7fecc2ffd640 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7feca8005580 con 0x55cd0bd608e0 2024-05-09T09:48:45.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.872+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 49 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.872+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 50 ==== watch-notify(notify_complete (2) cookie 94339155589152 notify 137438953512 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cd0bd054a0 con 0x55cd0bd608e0 2024-05-09T09:48:45.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.872+0000 7fec99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:45.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.872+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94339155290848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bda75c0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.876+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 46 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94339155290848] v32'399 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feddc051040 con 0x55cd0bd5bef0 2024-05-09T09:48:45.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.876+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94339155270160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bda75c0 con 0x7fedd80e0040 2024-05-09T09:48:45.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.876+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 38 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94339155270160] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feddc051040 con 0x7fedd80e0040 2024-05-09T09:48:45.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.876+0000 7fede7476980 20 remove_watcher() i=0 2024-05-09T09:48:45.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.876+0000 7fede7476980 2 removed watcher, disabling cache 2024-05-09T09:48:45.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.876+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94339155273488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bda75c0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.876+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 47 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94339155273488] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feddc051040 con 0x55cd0bd5bef0 2024-05-09T09:48:45.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.876+0000 7fede7476980 20 remove_watcher() i=1 2024-05-09T09:48:45.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.876+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94339155267648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bda75c0 con 0x55cd0bd65230 2024-05-09T09:48:45.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.880+0000 7fede4790640 1 -- 172.21.15.157:0/3551666513 <== osd.3 v2:172.21.15.157:6816/2487336710 43 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94339155267648] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedd80aaa60 con 0x55cd0bd65230 2024-05-09T09:48:45.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.880+0000 7fede7476980 20 remove_watcher() i=2 2024-05-09T09:48:45.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.880+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94339155279568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bda75c0 con 0x7fedd80e0040 2024-05-09T09:48:45.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.880+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.2 v2:172.21.15.157:6800/354455204 39 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94339155279568] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feddc051040 con 0x7fedd80e0040 2024-05-09T09:48:45.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.880+0000 7fede7476980 20 remove_watcher() i=3 2024-05-09T09:48:45.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.880+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94339155284336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bda75c0 con 0x55cd0bd5bef0 2024-05-09T09:48:45.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.884+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 <== osd.1 v2:172.21.15.157:6808/3930131338 48 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94339155284336] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feddc051040 con 0x55cd0bd5bef0 2024-05-09T09:48:45.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.884+0000 7fede7476980 20 remove_watcher() i=4 2024-05-09T09:48:45.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.884+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94339155281680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bda75c0 con 0x55cd0bd608e0 2024-05-09T09:48:45.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.884+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 51 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94339155281680] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.884+0000 7fede7476980 20 remove_watcher() i=5 2024-05-09T09:48:45.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.884+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94339155286592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7aa50 con 0x55cd0bd608e0 2024-05-09T09:48:45.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.888+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 52 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94339155286592] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.888+0000 7fede7476980 20 remove_watcher() i=6 2024-05-09T09:48:45.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.888+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94339155293520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0bd7aa50 con 0x55cd0bd608e0 2024-05-09T09:48:45.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede4f91640 1 -- 172.21.15.157:0/3551666513 <== osd.0 v2:172.21.15.110:6800/231209037 53 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94339155293520] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedd4075030 con 0x55cd0bd608e0 2024-05-09T09:48:45.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 20 remove_watcher() i=7 2024-05-09T09:48:45.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cd0bd608e0 msgr2=0x55cd0bd62cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 --2- 172.21.15.157:0/3551666513 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cd0bd608e0 0x55cd0bd62cd0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cd0bd5bef0 msgr2=0x55cd0bd5e3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 --2- 172.21.15.157:0/3551666513 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cd0bd5bef0 0x55cd0bd5e3b0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fedd80e0040 msgr2=0x7fedd80e0930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 --2- 172.21.15.157:0/3551666513 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fedd80e0040 0x7fedd80e0930 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cd0bd65230 msgr2=0x55cd0bd67680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 --2- 172.21.15.157:0/3551666513 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cd0bd65230 0x55cd0bd67680 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fecac034b60 msgr2=0x7fecac037020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 --2- 172.21.15.157:0/3551666513 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fecac034b60 0x7fecac037020 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55cd0bd15710 tx=0x7fedd80c1040 comp rx=0 tx=0).stop 2024-05-09T09:48:45.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede5792640 1 -- 172.21.15.157:0/3551666513 reap_dead start 2024-05-09T09:48:45.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bd47fa0 msgr2=0x55cd0bd4f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 --2- 172.21.15.157:0/3551666513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bd47fa0 0x55cd0bd4f300 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fedd4049fd0 tx=0x7fedd4009fa0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 shutdown_connections 2024-05-09T09:48:45.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 --2- 172.21.15.157:0/3551666513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bd47fa0 0x55cd0bd4f300 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 >> 172.21.15.157:0/3551666513 conn(0x55cd0bd44320 msgr2=0x55cd0bd41980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:45.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 shutdown_connections 2024-05-09T09:48:45.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 -- 172.21.15.157:0/3551666513 wait complete. 2024-05-09T09:48:45.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 -- 172.21.15.157:0/437841118 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fecbc034c00 msgr2=0x7fecbc0370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 --2- 172.21.15.157:0/437841118 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fecbc034c00 0x7fecbc0370c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55cd0bd0ca20 tx=0x7fedd8005ad0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 -- 172.21.15.157:0/437841118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bd3b190 msgr2=0x55cd0bd3b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 --2- 172.21.15.157:0/437841118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bd3b190 0x55cd0bd3b5b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fedd4049570 tx=0x7fedd404b130 comp rx=0 tx=0).stop 2024-05-09T09:48:45.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 -- 172.21.15.157:0/437841118 shutdown_connections 2024-05-09T09:48:45.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 --2- 172.21.15.157:0/437841118 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fecbc034c00 0x7fecbc0370c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 --2- 172.21.15.157:0/437841118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bd3b190 0x55cd0bd3b5b0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 -- 172.21.15.157:0/437841118 >> 172.21.15.157:0/437841118 conn(0x55cd0bd2ff60 msgr2=0x55cd0bd30a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:45.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 -- 172.21.15.157:0/437841118 shutdown_connections 2024-05-09T09:48:45.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 -- 172.21.15.157:0/437841118 wait complete. 2024-05-09T09:48:45.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 -- 172.21.15.157:0/4044865443 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cd0bd0e8a0 msgr2=0x55cd0bd10c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 --2- 172.21.15.157:0/4044865443 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55cd0bd0e8a0 0x55cd0bd10c90 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 -- 172.21.15.157:0/4044865443 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cd0bc17040 msgr2=0x55cd0bd0bee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 --2- 172.21.15.157:0/4044865443 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55cd0bc17040 0x55cd0bd0bee0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 -- 172.21.15.157:0/4044865443 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cd0bd127e0 msgr2=0x55cd0bd14bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 --2- 172.21.15.157:0/4044865443 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55cd0bd127e0 0x55cd0bd14bd0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 -- 172.21.15.157:0/4044865443 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7feccc034bb0 msgr2=0x7feccc037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 --2- 172.21.15.157:0/4044865443 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7feccc034bb0 0x7feccc037070 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fedd80ae000 tx=0x7fedd80a6000 comp rx=0 tx=0).stop 2024-05-09T09:48:45.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 -- 172.21.15.157:0/4044865443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bc12b40 msgr2=0x55cd0bd04f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 --2- 172.21.15.157:0/4044865443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55cd0bc12b40 0x55cd0bd04f60 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x55cd0bcfebd0 tx=0x7fedd4000bd0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede5792640 1 -- 172.21.15.157:0/4044865443 reap_dead start 2024-05-09T09:48:45.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 -- 172.21.15.157:0/4044865443 shutdown_connections 2024-05-09T09:48:45.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 -- 172.21.15.157:0/4044865443 >> 172.21.15.157:0/4044865443 conn(0x55cd0bb86260 msgr2=0x55cd0bcf83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:45.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 -- 172.21.15.157:0/4044865443 shutdown_connections 2024-05-09T09:48:45.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.892+0000 7fede7476980 1 -- 172.21.15.157:0/4044865443 wait complete. 2024-05-09T09:48:45.908 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-05-09T09:48:45.908 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-05-09T09:48:45.909 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-05-09T09:48:45.987 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:48:45.987 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:48:45.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.984+0000 7fa0d4eae980 1 Processor -- start 2024-05-09T09:48:45.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.984+0000 7fa0d4eae980 1 -- start start 2024-05-09T09:48:45.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.984+0000 7fa0d4eae980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x560f176bfac0 0x560f1774e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:45.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.984+0000 7fa0d4eae980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560f17601440 con 0x560f1774eb00 2024-05-09T09:48:45.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.984+0000 7fa0d4eae980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x560f175ec5f0 con 0x560f176bfac0 2024-05-09T09:48:45.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.984+0000 7fa0d29c9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x560f176bfac0 0x560f1774e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:45.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.984+0000 7fa0d29c9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x560f176bfac0 0x560f1774e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:43832/0 (socket says 172.21.15.157:43832) 2024-05-09T09:48:45.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.984+0000 7fa0d29c9640 1 -- 172.21.15.157:0/4270860929 learned_addr learned my addr 172.21.15.157:0/4270860929 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:45.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.984+0000 7fa0d21c8640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x560f1774eb00 0x560f17750ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:51234/0 (socket says 172.21.15.157:51234) 2024-05-09T09:48:45.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.984+0000 7fa0d29c9640 1 -- 172.21.15.157:0/4270860929 >> v1:172.21.15.110:6789/0 conn(0x560f1774eb00 legacy=0x560f17750ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.984+0000 7fa0d29c9640 1 -- 172.21.15.157:0/4270860929 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f175f7990 con 0x560f176bfac0 2024-05-09T09:48:45.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.988+0000 7fa0d29c9640 1 --2- 172.21.15.157:0/4270860929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f176bfac0 0x560f1774e5c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa0c400a5c0 tx=0x7fa0c401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57478a38566a3df5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:45.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.988+0000 7fa0d19c7640 1 -- 172.21.15.157:0/4270860929 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0c40a6070 con 0x560f176bfac0 2024-05-09T09:48:45.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.988+0000 7fa0d19c7640 1 -- 172.21.15.157:0/4270860929 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0c40af070 con 0x560f176bfac0 2024-05-09T09:48:45.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.988+0000 7fa0d19c7640 1 -- 172.21.15.157:0/4270860929 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0c40aa5c0 con 0x560f176bfac0 2024-05-09T09:48:45.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.988+0000 7fa0d4eae980 1 -- 172.21.15.157:0/4270860929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f176bfac0 msgr2=0x560f1774e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:45.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.988+0000 7fa0d4eae980 1 --2- 172.21.15.157:0/4270860929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f176bfac0 0x560f1774e5c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa0c400a5c0 tx=0x7fa0c401b340 comp rx=0 tx=0).stop 2024-05-09T09:48:45.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.988+0000 7fa0d4eae980 1 -- 172.21.15.157:0/4270860929 shutdown_connections 2024-05-09T09:48:45.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.988+0000 7fa0d4eae980 1 --2- 172.21.15.157:0/4270860929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f176bfac0 0x560f1774e5c0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:45.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.988+0000 7fa0d4eae980 1 -- 172.21.15.157:0/4270860929 >> 172.21.15.157:0/4270860929 conn(0x560f177460e0 msgr2=0x560f17748500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:45.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.988+0000 7fa0d4eae980 1 -- 172.21.15.157:0/4270860929 shutdown_connections 2024-05-09T09:48:45.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:45.988+0000 7fa0d4eae980 1 -- 172.21.15.157:0/4270860929 wait complete. 2024-05-09T09:48:46.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.004+0000 7fa0d4eae980 1 Processor -- start 2024-05-09T09:48:46.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.004+0000 7fa0d4eae980 1 -- start start 2024-05-09T09:48:46.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.004+0000 7fa0d4eae980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f176bfac0 0x560f17836b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:46.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.004+0000 7fa0d4eae980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560f1764efe0 con 0x560f176bfac0 2024-05-09T09:48:46.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.008+0000 7fa0d29c9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f176bfac0 0x560f17836b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:46.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.008+0000 7fa0d29c9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f176bfac0 0x560f17836b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:43836/0 (socket says 172.21.15.157:43836) 2024-05-09T09:48:46.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.008+0000 7fa0d29c9640 1 -- 172.21.15.157:0/2710943321 learned_addr learned my addr 172.21.15.157:0/2710943321 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:46.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.008+0000 7fa0d29c9640 1 -- 172.21.15.157:0/2710943321 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f175d3ae0 con 0x560f176bfac0 2024-05-09T09:48:46.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.008+0000 7fa0d29c9640 1 --2- 172.21.15.157:0/2710943321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f176bfac0 0x560f17836b60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40ac040 tx=0x7fa0c4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921521750a3cec35 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:46.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.008+0000 7f9fc0e09640 1 -- 172.21.15.157:0/2710943321 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0c40aa970 con 0x560f176bfac0 2024-05-09T09:48:46.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.008+0000 7f9fc0e09640 1 -- 172.21.15.157:0/2710943321 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0c40aab10 con 0x560f176bfac0 2024-05-09T09:48:46.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.008+0000 7f9fc0e09640 1 -- 172.21.15.157:0/2710943321 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0c40aae30 con 0x560f176bfac0 2024-05-09T09:48:46.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.008+0000 7fa0d4eae980 1 -- 172.21.15.157:0/2710943321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f176bfac0 msgr2=0x560f17836b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:46.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.008+0000 7fa0d4eae980 1 --2- 172.21.15.157:0/2710943321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f176bfac0 0x560f17836b60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40ac040 tx=0x7fa0c4003030 comp rx=0 tx=0).stop 2024-05-09T09:48:46.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.008+0000 7fa0d4eae980 1 -- 172.21.15.157:0/2710943321 shutdown_connections 2024-05-09T09:48:46.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.008+0000 7fa0d4eae980 1 --2- 172.21.15.157:0/2710943321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f176bfac0 0x560f17836b60 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:46.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.008+0000 7fa0d4eae980 1 -- 172.21.15.157:0/2710943321 >> 172.21.15.157:0/2710943321 conn(0x560f177460e0 msgr2=0x560f178326f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:46.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.008+0000 7fa0d4eae980 1 -- 172.21.15.157:0/2710943321 shutdown_connections 2024-05-09T09:48:46.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.008+0000 7fa0d4eae980 1 -- 172.21.15.157:0/2710943321 wait complete. 2024-05-09T09:48:46.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.008+0000 7fa0d4eae980 1 Processor -- start 2024-05-09T09:48:46.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.008+0000 7fa0d4eae980 1 -- start start 2024-05-09T09:48:46.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.008+0000 7fa0d4eae980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f176bfac0 0x560f1783db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:46.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.008+0000 7fa0d4eae980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560f17753120 con 0x560f176bfac0 2024-05-09T09:48:46.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.008+0000 7fa0d29c9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f176bfac0 0x560f1783db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:46.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.008+0000 7fa0d29c9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f176bfac0 0x560f1783db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:43850/0 (socket says 172.21.15.157:43850) 2024-05-09T09:48:46.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.008+0000 7fa0d29c9640 1 -- 172.21.15.157:0/392127414 learned_addr learned my addr 172.21.15.157:0/392127414 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:46.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.008+0000 7fa0d29c9640 1 -- 172.21.15.157:0/392127414 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f1783e090 con 0x560f176bfac0 2024-05-09T09:48:46.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.012+0000 7fa0d29c9640 1 --2- 172.21.15.157:0/392127414 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f176bfac0 0x560f1783db50 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4003070 tx=0x7fa0c40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:46.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.012+0000 7f9fbf606640 1 -- 172.21.15.157:0/392127414 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0c40c6690 con 0x560f176bfac0 2024-05-09T09:48:46.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.012+0000 7f9fbf606640 1 -- 172.21.15.157:0/392127414 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0c40cc070 con 0x560f176bfac0 2024-05-09T09:48:46.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.012+0000 7fa0d4eae980 1 -- 172.21.15.157:0/392127414 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f1783e320 con 0x560f176bfac0 2024-05-09T09:48:46.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.012+0000 7f9fbf606640 1 -- 172.21.15.157:0/392127414 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0c40c6960 con 0x560f176bfac0 2024-05-09T09:48:46.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.012+0000 7fa0d4eae980 1 -- 172.21.15.157:0/392127414 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f17840fb0 con 0x560f176bfac0 2024-05-09T09:48:46.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.012+0000 7f9fbf606640 1 -- 172.21.15.157:0/392127414 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fa0c40c6b00 con 0x560f176bfac0 2024-05-09T09:48:46.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.012+0000 7f9fbf606640 1 --2- 172.21.15.157:0/392127414 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9fb8034c00 0x7f9fb80370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:46.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.012+0000 7f9fbf606640 1 -- 172.21.15.157:0/392127414 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fa0c40e5c60 con 0x560f176bfac0 2024-05-09T09:48:46.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.012+0000 7fa0d21c8640 1 --2- 172.21.15.157:0/392127414 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9fb8034c00 0x7f9fb80370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:46.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.012+0000 7fa0d4eae980 1 --2- 172.21.15.157:0/392127414 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560f1774eb00 0x560f17844a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:46.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.012+0000 7fa0d4eae980 1 -- 172.21.15.157:0/392127414 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178450e0 con 0x560f1774eb00 2024-05-09T09:48:46.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.012+0000 7fa0d31ca640 1 --2- 172.21.15.157:0/392127414 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560f1774eb00 0x560f17844a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:46.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.012+0000 7fa0d21c8640 1 --2- 172.21.15.157:0/392127414 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9fb8034c00 0x7f9fb80370c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8001e50 tx=0x7fa0c80013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:46.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.012+0000 7fa0d31ca640 1 --2- 172.21.15.157:0/392127414 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560f1774eb00 0x560f17844a90 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:46.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.012+0000 7fa0d31ca640 1 -- 172.21.15.157:0/392127414 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f1774eb00 2024-05-09T09:48:46.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.012+0000 7fa0d4eae980 1 -- 172.21.15.157:0/392127414 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178459d0 con 0x560f1774eb00 2024-05-09T09:48:46.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.012+0000 7fa0d31ca640 1 -- 172.21.15.157:0/392127414 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f1774eb00 2024-05-09T09:48:46.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.012+0000 7fa0d4eae980 1 --2- 172.21.15.157:0/392127414 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560f178472e0 0x560f178497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:46.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.012+0000 7fa0d4eae980 1 -- 172.21.15.157:0/392127414 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f17849f30 con 0x560f178472e0 2024-05-09T09:48:46.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.012+0000 7fa0d29c9640 1 --2- 172.21.15.157:0/392127414 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560f178472e0 0x560f178497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:46.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.016+0000 7fa0d29c9640 1 --2- 172.21.15.157:0/392127414 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560f178472e0 0x560f178497a0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:46.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.016+0000 7fa0d29c9640 1 -- 172.21.15.157:0/392127414 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa0c40d0c60 con 0x560f178472e0 2024-05-09T09:48:46.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.016+0000 7fa0d4eae980 1 -- 172.21.15.157:0/392127414 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f17846220 con 0x560f1774eb00 2024-05-09T09:48:46.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.016+0000 7fa0d31ca640 1 -- 172.21.15.157:0/392127414 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f1774eb00 2024-05-09T09:48:46.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.016+0000 7fa0d4eae980 1 --2- 172.21.15.157:0/392127414 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560f1784b390 0x560f1784d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:46.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.016+0000 7fa0d4eae980 1 -- 172.21.15.157:0/392127414 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f1784de70 con 0x560f1784b390 2024-05-09T09:48:46.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.016+0000 7fa0d21c8640 1 --2- 172.21.15.157:0/392127414 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560f1784b390 0x560f1784d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:46.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.016+0000 7fa0d21c8640 1 --2- 172.21.15.157:0/392127414 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560f1784b390 0x560f1784d780 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:46.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.016+0000 7fa0d21c8640 1 -- 172.21.15.157:0/392127414 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa0c800f700 con 0x560f1784b390 2024-05-09T09:48:46.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.020+0000 7fa0d4eae980 1 Processor -- start 2024-05-09T09:48:46.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.020+0000 7fa0d4eae980 1 -- start start 2024-05-09T09:48:46.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.020+0000 7fa0d4eae980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f17873d60 0x560f17874180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:46.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.020+0000 7fa0d4eae980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560f17653020 con 0x560f17873d60 2024-05-09T09:48:46.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.020+0000 7fa0d29c9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f17873d60 0x560f17874180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:46.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.020+0000 7fa0d29c9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f17873d60 0x560f17874180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:43858/0 (socket says 172.21.15.157:43858) 2024-05-09T09:48:46.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.020+0000 7fa0d29c9640 1 -- 172.21.15.157:0/995022065 learned_addr learned my addr 172.21.15.157:0/995022065 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:46.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.020+0000 7fa0d29c9640 1 -- 172.21.15.157:0/995022065 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f178746c0 con 0x560f17873d60 2024-05-09T09:48:46.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.020+0000 7fa0d29c9640 1 --2- 172.21.15.157:0/995022065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f17873d60 0x560f17874180 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40bdf70 tx=0x7fa0c40c5a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:46.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.020+0000 7f9fb77fe640 1 -- 172.21.15.157:0/995022065 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0c40aaf90 con 0x560f17873d60 2024-05-09T09:48:46.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.024+0000 7f9fb77fe640 1 -- 172.21.15.157:0/995022065 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0c40a7290 con 0x560f17873d60 2024-05-09T09:48:46.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.024+0000 7fa0d4eae980 1 -- 172.21.15.157:0/995022065 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f17875150 con 0x560f17873d60 2024-05-09T09:48:46.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.024+0000 7f9fb77fe640 1 -- 172.21.15.157:0/995022065 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0c40a75b0 con 0x560f17873d60 2024-05-09T09:48:46.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.024+0000 7fa0d4eae980 1 -- 172.21.15.157:0/995022065 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f17875630 con 0x560f17873d60 2024-05-09T09:48:46.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.024+0000 7f9fb77fe640 1 -- 172.21.15.157:0/995022065 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fa0c40d0410 con 0x560f17873d60 2024-05-09T09:48:46.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.024+0000 7f9fb77fe640 1 --2- 172.21.15.157:0/995022065 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9fac034c50 0x7f9fac037110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:46.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.024+0000 7f9fb77fe640 1 -- 172.21.15.157:0/995022065 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fa0c40f0d10 con 0x560f17873d60 2024-05-09T09:48:46.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.024+0000 7fa0d21c8640 1 --2- 172.21.15.157:0/995022065 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9fac034c50 0x7f9fac037110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:46.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.024+0000 7fa0d4eae980 1 Processor -- start 2024-05-09T09:48:46.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.024+0000 7fa0d4eae980 1 -- start start 2024-05-09T09:48:46.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.024+0000 7fa0d4eae980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f1774bb80 0x560f1774bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:46.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.024+0000 7fa0d4eae980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560f178371f0 con 0x560f1774bb80 2024-05-09T09:48:46.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.024+0000 7fa0d21c8640 1 --2- 172.21.15.157:0/995022065 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9fac034c50 0x7f9fac037110 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x560f17842210 tx=0x7fa0c800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:46.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.024+0000 7fa0d29c9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f1774bb80 0x560f1774bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:46.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.024+0000 7fa0d29c9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f1774bb80 0x560f1774bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:43872/0 (socket says 172.21.15.157:43872) 2024-05-09T09:48:46.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.024+0000 7fa0d29c9640 1 -- 172.21.15.157:0/2561138619 learned_addr learned my addr 172.21.15.157:0/2561138619 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:46.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.024+0000 7fa0d29c9640 1 -- 172.21.15.157:0/2561138619 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f1774a3a0 con 0x560f1774bb80 2024-05-09T09:48:46.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.024+0000 7fa0d29c9640 1 --2- 172.21.15.157:0/2561138619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f1774bb80 0x560f1774bf60 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40aaa90 tx=0x7fa0c40ab5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d02c87ac764fe363 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:46.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.024+0000 7f9fb57fa640 1 -- 172.21.15.157:0/2561138619 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0c4107070 con 0x560f1774bb80 2024-05-09T09:48:46.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.024+0000 7f9fb57fa640 1 -- 172.21.15.157:0/2561138619 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0c40c73f0 con 0x560f1774bb80 2024-05-09T09:48:46.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.024+0000 7f9fb57fa640 1 -- 172.21.15.157:0/2561138619 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0c40f4070 con 0x560f1774bb80 2024-05-09T09:48:46.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.028+0000 7fa0d4eae980 1 -- 172.21.15.157:0/2561138619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f1774bb80 msgr2=0x560f1774bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:46.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.028+0000 7fa0d4eae980 1 --2- 172.21.15.157:0/2561138619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f1774bb80 0x560f1774bf60 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40aaa90 tx=0x7fa0c40ab5f0 comp rx=0 tx=0).stop 2024-05-09T09:48:46.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.028+0000 7fa0d4eae980 1 -- 172.21.15.157:0/2561138619 shutdown_connections 2024-05-09T09:48:46.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.028+0000 7fa0d4eae980 1 --2- 172.21.15.157:0/2561138619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f1774bb80 0x560f1774bf60 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:46.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.028+0000 7fa0d4eae980 1 -- 172.21.15.157:0/2561138619 >> 172.21.15.157:0/2561138619 conn(0x560f1787d0b0 msgr2=0x560f1787b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:46.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.028+0000 7fa0d4eae980 1 -- 172.21.15.157:0/2561138619 shutdown_connections 2024-05-09T09:48:46.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.028+0000 7fa0d4eae980 1 -- 172.21.15.157:0/2561138619 wait complete. 2024-05-09T09:48:46.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.028+0000 7fa0d4eae980 1 Processor -- start 2024-05-09T09:48:46.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.028+0000 7fa0d4eae980 1 -- start start 2024-05-09T09:48:46.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.028+0000 7fa0d4eae980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f1774bb80 0x560f1788a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:46.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.028+0000 7fa0d4eae980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560f1774a7b0 con 0x560f1774bb80 2024-05-09T09:48:46.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.028+0000 7fa0d29c9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f1774bb80 0x560f1788a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:46.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.028+0000 7fa0d29c9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f1774bb80 0x560f1788a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:43880/0 (socket says 172.21.15.157:43880) 2024-05-09T09:48:46.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.028+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 learned_addr learned my addr 172.21.15.157:0/1899292100 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:48:46.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.028+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f1788a780 con 0x560f1774bb80 2024-05-09T09:48:46.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.028+0000 7fa0d29c9640 1 --2- 172.21.15.157:0/1899292100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f1774bb80 0x560f1788a240 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40aaa90 tx=0x7fa0c40b1f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:46.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.028+0000 7f9fa37fe640 1 -- 172.21.15.157:0/1899292100 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0c410f070 con 0x560f1774bb80 2024-05-09T09:48:46.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.028+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f1788a780 con 0x560f1774bb80 2024-05-09T09:48:46.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.028+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f1788a780 con 0x560f1774bb80 2024-05-09T09:48:46.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.028+0000 7f9fa37fe640 1 -- 172.21.15.157:0/1899292100 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0c40a7880 con 0x560f1774bb80 2024-05-09T09:48:46.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.028+0000 7f9fa37fe640 1 -- 172.21.15.157:0/1899292100 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0c4107040 con 0x560f1774bb80 2024-05-09T09:48:46.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.028+0000 7f9fa37fe640 1 -- 172.21.15.157:0/1899292100 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fa0c4112070 con 0x560f1774bb80 2024-05-09T09:48:46.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7f9fa37fe640 1 --2- 172.21.15.157:0/1899292100 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9f9c034b10 0x7f9f9c036fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:46.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7f9fa37fe640 1 -- 172.21.15.157:0/1899292100 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fa0c40ff070 con 0x560f1774bb80 2024-05-09T09:48:46.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d21c8640 1 --2- 172.21.15.157:0/1899292100 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9f9c034b10 0x7f9f9c036fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:46.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d4eae980 20 rados->read ofs=0 len=0 2024-05-09T09:48:46.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d4eae980 1 --2- 172.21.15.157:0/1899292100 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560f17896bf0 0x560f178990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:46.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f17899800 con 0x560f17896bf0 2024-05-09T09:48:46.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d31ca640 1 --2- 172.21.15.157:0/1899292100 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560f17896bf0 0x560f178990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:46.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d21c8640 1 --2- 172.21.15.157:0/1899292100 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9f9c034b10 0x7f9f9c036fd0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x560f1784e270 tx=0x7fa0c8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:46.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d31ca640 1 --2- 172.21.15.157:0/1899292100 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560f17896bf0 0x560f178990b0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:46.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d4eae980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:46.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d4eae980 20 realm 2024-05-09T09:48:46.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d4eae980 20 rados->read ofs=0 len=0 2024-05-09T09:48:46.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f17899c10 con 0x560f17896bf0 2024-05-09T09:48:46.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d4eae980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:46.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d4eae980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:48:46.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d4eae980 20 rados->read ofs=0 len=0 2024-05-09T09:48:46.037 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a4e0 con 0x560f17896bf0 2024-05-09T09:48:46.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d4eae980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:46.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d4eae980 20 rados->read ofs=0 len=0 2024-05-09T09:48:46.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x560f17896bf0 2024-05-09T09:48:46.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d4eae980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:46.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d4eae980 20 rados->read ofs=0 len=0 2024-05-09T09:48:46.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d4eae980 1 --2- 172.21.15.157:0/1899292100 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560f1789b5e0 0x560f1789d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:46.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f1789dfe0 con 0x560f1789b5e0 2024-05-09T09:48:46.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d29c9640 1 --2- 172.21.15.157:0/1899292100 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560f1789b5e0 0x560f1789d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:46.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d29c9640 1 --2- 172.21.15.157:0/1899292100 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560f1789b5e0 0x560f1789d9d0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:46.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d4eae980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:48:46.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.032+0000 7fa0d4eae980 20 searching for the correct realm 2024-05-09T09:48:46.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.036+0000 7fa0d4eae980 1 --2- 172.21.15.157:0/1899292100 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560f1789ff30 0x560f178a2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:46.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.036+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f178a2a10 con 0x560f1789ff30 2024-05-09T09:48:46.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.036+0000 7fa0d21c8640 1 --2- 172.21.15.157:0/1899292100 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560f1789ff30 0x560f178a2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:46.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.036+0000 7fa0d21c8640 1 --2- 172.21.15.157:0/1899292100 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560f1789ff30 0x560f178a2340 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:46.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.036+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0c8037040 con 0x560f1789ff30 2024-05-09T09:48:46.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.036+0000 7fa0d21c8640 1 --2- 172.21.15.157:0/1899292100 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa0c801fbe0 0x7fa0c803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:48:46.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.036+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f178a2a10 con 0x7fa0c801fbe0 2024-05-09T09:48:46.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.036+0000 7fa0d31ca640 1 --2- 172.21.15.157:0/1899292100 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa0c801fbe0 0x7fa0c803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:48:46.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.036+0000 7fa0d31ca640 1 --2- 172.21.15.157:0/1899292100 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa0c801fbe0 0x7fa0c803a3c0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:48:46.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.036+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.036+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x560f1789b5e0 2024-05-09T09:48:46.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.036+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.036+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x560f17896bf0 2024-05-09T09:48:46.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.036+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.036+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x560f17896bf0 2024-05-09T09:48:46.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.036+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.036+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x560f1789b5e0 2024-05-09T09:48:46.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.036+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.036+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x560f1789b5e0 2024-05-09T09:48:46.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.040+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.040+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x7fa0c801fbe0 2024-05-09T09:48:46.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.040+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.040+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x560f1789ff30 2024-05-09T09:48:46.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.040+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0c8037040 con 0x560f1789ff30 2024-05-09T09:48:46.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.040+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x560f17896bf0 2024-05-09T09:48:46.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.040+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.040+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x560f1789b5e0 2024-05-09T09:48:46.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.040+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.040+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x560f17896bf0 2024-05-09T09:48:46.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.040+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.040+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x7fa0c801fbe0 2024-05-09T09:48:46.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.040+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.040+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x560f1789ff30 2024-05-09T09:48:46.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.040+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0c8037040 con 0x560f1789ff30 2024-05-09T09:48:46.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.040+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x560f1789ff30 2024-05-09T09:48:46.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.040+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa0c8037040 con 0x560f1789ff30 2024-05-09T09:48:46.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.040+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x560f1789b5e0 2024-05-09T09:48:46.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.040+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.040+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x560f1789ff30 2024-05-09T09:48:46.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.040+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0c8037040 con 0x560f1789ff30 2024-05-09T09:48:46.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.040+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x560f1789ff30 2024-05-09T09:48:46.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.040+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0c8037040 con 0x560f1789ff30 2024-05-09T09:48:46.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.040+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x560f17896bf0 2024-05-09T09:48:46.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.044+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.044+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x560f17896bf0 2024-05-09T09:48:46.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.044+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.044+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x560f1789b5e0 2024-05-09T09:48:46.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.044+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.044+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x560f1789ff30 2024-05-09T09:48:46.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.044+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0c8037040 con 0x560f1789ff30 2024-05-09T09:48:46.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.044+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x7fa0c801fbe0 2024-05-09T09:48:46.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.044+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.044+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x560f17896bf0 2024-05-09T09:48:46.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.044+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.048 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.044+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x560f1789b5e0 2024-05-09T09:48:46.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.044+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.044+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x560f1789ff30 2024-05-09T09:48:46.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.044+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0c8037040 con 0x560f1789ff30 2024-05-09T09:48:46.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.044+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x560f1789b5e0 2024-05-09T09:48:46.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.044+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.044+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x7fa0c801fbe0 2024-05-09T09:48:46.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.044+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.044+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x560f1789ff30 2024-05-09T09:48:46.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.044+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0c8049040 con 0x560f1789ff30 2024-05-09T09:48:46.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.044+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x560f1789b5e0 2024-05-09T09:48:46.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x560f17896bf0 2024-05-09T09:48:46.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.053 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1789a880 con 0x7fa0c801fbe0 2024-05-09T09:48:46.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:48:46.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:48:46.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:48:46.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:48:46.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:48:46.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:48:46.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 20 rados->read ofs=0 len=0 2024-05-09T09:48:46.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f1789e8a0 con 0x560f17896bf0 2024-05-09T09:48:46.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:46.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 20 rados->read ofs=0 len=0 2024-05-09T09:48:46.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f1789e8a0 con 0x560f17896bf0 2024-05-09T09:48:46.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:48:46.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 20 rados->read ofs=0 len=0 2024-05-09T09:48:46.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f1789e8a0 con 0x560f1789ff30 2024-05-09T09:48:46.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa0c8049040 con 0x560f1789ff30 2024-05-09T09:48:46.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:48:46.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 20 zone default found 2024-05-09T09:48:46.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 4 Realm: () 2024-05-09T09:48:46.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:48:46.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:48:46.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:48:46.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 20 zonegroup default 2024-05-09T09:48:46.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 20 rados->read ofs=0 len=0 2024-05-09T09:48:46.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f1789f2a0 con 0x560f1789b5e0 2024-05-09T09:48:46.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:46.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 20 rados->read ofs=0 len=0 2024-05-09T09:48:46.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f1789ee30 con 0x560f1789ff30 2024-05-09T09:48:46.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa0c8049040 con 0x560f1789ff30 2024-05-09T09:48:46.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:46.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 20 rados->read ofs=0 len=0 2024-05-09T09:48:46.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178a4dc0 con 0x560f1789ff30 2024-05-09T09:48:46.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa0c8049040 con 0x560f1789ff30 2024-05-09T09:48:46.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:46.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 20 started sync module instance, tier type = 2024-05-09T09:48:46.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:48:46.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.048+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178a41b0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.052+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.052+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94622819436208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178a41b0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.052+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178a5920 con 0x560f17896bf0 2024-05-09T09:48:46.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.052+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94622819436208] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.052+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.052+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94622819439600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178a41b0 con 0x560f17896bf0 2024-05-09T09:48:46.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.052+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178a6330 con 0x560f1789ff30 2024-05-09T09:48:46.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.056+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94622819439600] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.056+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0c8049040 con 0x560f1789ff30 2024-05-09T09:48:46.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.056+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94622819433728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178a4120 con 0x560f1789ff30 2024-05-09T09:48:46.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.056+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178a7030 con 0x7fa0c801fbe0 2024-05-09T09:48:46.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.056+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.056+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94622819445936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178a78d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.056+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178a82d0 con 0x560f17896bf0 2024-05-09T09:48:46.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.056+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94622819433728] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0c8049040 con 0x560f1789ff30 2024-05-09T09:48:46.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.060+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94622819445936] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.060+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.060+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94622819444432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178a73b0 con 0x560f17896bf0 2024-05-09T09:48:46.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.060+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178a8b70 con 0x560f1789b5e0 2024-05-09T09:48:46.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.060+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94622819444432] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.060+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.060+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94622819452608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178a73b0 con 0x560f1789b5e0 2024-05-09T09:48:46.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.060+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178a93c0 con 0x560f1789b5e0 2024-05-09T09:48:46.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.064+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94622819452608] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.064+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.064+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94622819454736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178a97e0 con 0x560f1789b5e0 2024-05-09T09:48:46.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.064+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178aa1a0 con 0x560f1789b5e0 2024-05-09T09:48:46.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.068+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.068+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94622819458288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178aa5c0 con 0x560f1789b5e0 2024-05-09T09:48:46.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.068+0000 7fa0d4eae980 20 add_watcher() i=0 2024-05-09T09:48:46.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.068+0000 7fa0d4eae980 20 add_watcher() i=1 2024-05-09T09:48:46.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.068+0000 7fa0d4eae980 20 add_watcher() i=2 2024-05-09T09:48:46.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.068+0000 7fa0d4eae980 20 add_watcher() i=3 2024-05-09T09:48:46.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.068+0000 7fa0d4eae980 20 add_watcher() i=4 2024-05-09T09:48:46.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.068+0000 7fa0d4eae980 20 add_watcher() i=5 2024-05-09T09:48:46.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.068+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94622819454736] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.068+0000 7fa0d4eae980 20 add_watcher() i=6 2024-05-09T09:48:46.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.068+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94622819458288] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.068+0000 7fa0d4eae980 20 add_watcher() i=7 2024-05-09T09:48:46.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.068+0000 7fa0d4eae980 2 all 8 watchers are set, enabling cache 2024-05-09T09:48:46.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.068+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178aa5c0 con 0x560f17896bf0 2024-05-09T09:48:46.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.068+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.068+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94622819459344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178aa530 con 0x560f17896bf0 2024-05-09T09:48:46.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.072+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94622819459344] v32'400 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.072+0000 7f9f837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:46.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.072+0000 7fa0d4eae980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:48:46.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.072+0000 7fa0d4eae980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:48:46.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.072+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b5f40 con 0x560f17896bf0 2024-05-09T09:48:46.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.072+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'93 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.072+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b6590 con 0x560f1789b5e0 2024-05-09T09:48:46.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.076+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'87 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.076+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b6590 con 0x560f1789ff30 2024-05-09T09:48:46.079 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.076+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'87 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa0c8049040 con 0x560f1789ff30 2024-05-09T09:48:46.080 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.076+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b7090 con 0x560f17896bf0 2024-05-09T09:48:46.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.076+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'401 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.076+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b3d40 con 0x7fa0c801fbe0 2024-05-09T09:48:46.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.080+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'248 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.082 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.080+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b3d40 con 0x560f1789ff30 2024-05-09T09:48:46.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.080+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'166 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa0c8049040 con 0x560f1789ff30 2024-05-09T09:48:46.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.080+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b7dc0 con 0x560f17896bf0 2024-05-09T09:48:46.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.080+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'88 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.086 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.084+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b7e50 con 0x560f1789b5e0 2024-05-09T09:48:46.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.084+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'165 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.088 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.084+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b7f20 con 0x7fa0c801fbe0 2024-05-09T09:48:46.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.088+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'86 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.088+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b7fe0 con 0x560f1789ff30 2024-05-09T09:48:46.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.088+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'92 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa0c8049040 con 0x560f1789ff30 2024-05-09T09:48:46.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.088+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b83e0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.088+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'249 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.088+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b83e0 con 0x560f1789b5e0 2024-05-09T09:48:46.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.092+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'90 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.092+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b8470 con 0x7fa0c801fbe0 2024-05-09T09:48:46.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.092+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'86 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.092+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b8470 con 0x560f1789b5e0 2024-05-09T09:48:46.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.096+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'171 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.096+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b8500 con 0x560f17896bf0 2024-05-09T09:48:46.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.096+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'402 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.096+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b8500 con 0x560f1789ff30 2024-05-09T09:48:46.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.096+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'242 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0c8049040 con 0x560f1789ff30 2024-05-09T09:48:46.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.100+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b8590 con 0x7fa0c801fbe0 2024-05-09T09:48:46.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.100+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'250 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.100+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b8590 con 0x560f1789ff30 2024-05-09T09:48:46.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.100+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'86 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0c8049040 con 0x560f1789ff30 2024-05-09T09:48:46.104 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.100+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b89b0 con 0x560f17896bf0 2024-05-09T09:48:46.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.104+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'94 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.104+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b89b0 con 0x560f17896bf0 2024-05-09T09:48:46.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.104+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'403 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.104+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b89b0 con 0x560f1789ff30 2024-05-09T09:48:46.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.108+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'243 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0c8049040 con 0x560f1789ff30 2024-05-09T09:48:46.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.108+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b89b0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.108+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'98 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.108+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b89b0 con 0x560f1789ff30 2024-05-09T09:48:46.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.108+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'88 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0c8049040 con 0x560f1789ff30 2024-05-09T09:48:46.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.108+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b89b0 con 0x560f1789ff30 2024-05-09T09:48:46.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.112+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'92 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0c8049040 con 0x560f1789ff30 2024-05-09T09:48:46.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.112+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b89b0 con 0x560f1789ff30 2024-05-09T09:48:46.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.112+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'83 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0c8049040 con 0x560f1789ff30 2024-05-09T09:48:46.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.112+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b89b0 con 0x560f1789ff30 2024-05-09T09:48:46.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.112+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'167 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0c8049040 con 0x560f1789ff30 2024-05-09T09:48:46.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.112+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b89b0 con 0x560f1789b5e0 2024-05-09T09:48:46.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.116+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'88 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.116+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b89b0 con 0x560f1789ff30 2024-05-09T09:48:46.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.116+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'86 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0c8049040 con 0x560f1789ff30 2024-05-09T09:48:46.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.116+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b89b0 con 0x560f1789b5e0 2024-05-09T09:48:46.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.120+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'166 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.120+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b89b0 con 0x560f1789ff30 2024-05-09T09:48:46.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.120+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'244 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0c8049040 con 0x560f1789ff30 2024-05-09T09:48:46.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.120+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b89b0 con 0x560f1789b5e0 2024-05-09T09:48:46.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.124+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'172 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.124+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178b89b0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.124+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'92 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.124+0000 7f9f827fc640 20 reqs_thread_entry: start 2024-05-09T09:48:46.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.124+0000 7fa0d4eae980 20 init_complete bucket index max shards: 11 2024-05-09T09:48:46.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.124+0000 7f9ef3fff640 20 reqs_thread_entry: start 2024-05-09T09:48:46.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.124+0000 7fa0d4eae980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-09T09:48:46.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.124+0000 7fa0d4eae980 20 rados->read ofs=0 len=0 2024-05-09T09:48:46.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.124+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178b2f20 con 0x560f1789b5e0 2024-05-09T09:48:46.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.128+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.128+0000 7fa0d4eae980 20 rados_obj.operate() r=0 bl.length=380 2024-05-09T09:48:46.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.128+0000 7fa0d4eae980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-09T09:48:46.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.128+0000 7fa0d4eae980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-09T09:48:46.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.128+0000 7fa0d4eae980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:48:46.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.128+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178d6a10 con 0x560f1789b5e0 2024-05-09T09:48:46.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.128+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv7 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.128+0000 7fa0d4eae980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10 : miss 2024-05-09T09:48:46.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.128+0000 7fa0d4eae980 20 rados->read ofs=0 len=0 2024-05-09T09:48:46.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.128+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:96 8.15 8:a941c2c1:root::.bucket.meta.myfoo7%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178d68b0 con 0x560f1789ff30 2024-05-09T09:48:46.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.128+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(96 .bucket.meta.myfoo7:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10 [call out=48b,stat out=16b,read 0~382 out=382b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 334+0+664 (crc 0 0 0) 0x7fa0c8049040 con 0x560f1789ff30 2024-05-09T09:48:46.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.128+0000 7fa0d4eae980 20 rados_obj.operate() r=0 bl.length=382 2024-05-09T09:48:46.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.128+0000 7fa0d4eae980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10 info.flags=0x17 2024-05-09T09:48:46.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.128+0000 7fa0d4eae980 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10 to cache LRU end 2024-05-09T09:48:46.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.128+0000 7fa0d4eae980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:48:46.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.128+0000 7fa0d4eae980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-09T09:48:46.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.128+0000 7fa0d4eae980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10 2024-05-09T09:48:46.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.128+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 4.35 4:ae5c5f47:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f17953dc0 con 0x560f17896bf0 2024-05-09T09:48:46.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.128+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(97 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.128+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:98 4.1 4:81682f07:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f17953e00 con 0x7fa0c801fbe0 2024-05-09T09:48:46.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.128+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(98 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.1 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.128+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:99 4.38 4:1e66fb07:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f17953e00 con 0x560f17896bf0 2024-05-09T09:48:46.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.128+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(99 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.132+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:100 4.1f 4:fbe0c5e3:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f17953e40 con 0x560f1789ff30 2024-05-09T09:48:46.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.132+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(100 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0c8049040 con 0x560f1789ff30 2024-05-09T09:48:46.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.132+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:101 4.e 4:70734c7c:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f17953e40 con 0x7fa0c801fbe0 2024-05-09T09:48:46.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.132+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(101 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.132+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 4.27 4:e4f3711e:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f17953e40 con 0x560f17896bf0 2024-05-09T09:48:46.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.132+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(102 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.5 [call out=378b] v0'0 uv3 ondisk = 0) ==== 195+0+378 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.132+0000 7fa0d4eae980 10 cls_bucket_list_unordered: got fourteen 2024-05-09T09:48:46.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.132+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 4.1e 4:7b0402c9:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f17953e80 con 0x560f1789b5e0 2024-05-09T09:48:46.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.132+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(103 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.132+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:104 4.3b 4:dd6e2294:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f17953e80 con 0x7fa0c801fbe0 2024-05-09T09:48:46.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.132+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(104 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.132+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:105 4.c 4:3328b921:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f17954570 con 0x560f17896bf0 2024-05-09T09:48:46.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.132+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(105 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.132+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:106 4.32 4:4fa67170:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f17954570 con 0x560f17896bf0 2024-05-09T09:48:46.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.132+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(106 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.9 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.132+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:107 4.2 4:42e9e2ae:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f17954570 con 0x560f17896bf0 2024-05-09T09:48:46.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.132+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(107 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.132+0000 7fa0d4eae980 20 get_obj_state: octx=0x7fa0cc00ab00 obj=myfoo7:fourteen state=0x560f17952038 s->prefetch_data=0 2024-05-09T09:48:46.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.132+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:108 3.1s0 3:83d7cbf8:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f17952e60 con 0x560f1789b5e0 2024-05-09T09:48:46.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.136+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(108 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10_fourteen [getxattrs out=858b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+874 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.136+0000 7fa0d4eae980 10 manifest: total_size = 8 2024-05-09T09:48:46.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.136+0000 7fa0d4eae980 20 get_obj_state: setting s->obj_tag to b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.17088100975937965220 2024-05-09T09:48:46.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.136+0000 7fa0d4eae980 20 get_obj_state: octx=0x7fa0cc00ab00 obj=myfoo7:fourteen state=0x560f17952038 s->prefetch_data=0 2024-05-09T09:48:46.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.136+0000 7fa0d4eae980 20 prepare_atomic_modification: state is not atomic. state=0x560f17952038 2024-05-09T09:48:46.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.136+0000 7fa0d4eae980 20 bucket index object: :.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.5 2024-05-09T09:48:46.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.136+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:109 4.27 4:e4f3711e:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f179537e0 con 0x560f17896bf0 2024-05-09T09:48:46.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.136+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(109 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.5 [stat,call,call] v32'4 uv4 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.136+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:110 3.1s0 3:83d7cbf8:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f179537e0 con 0x560f1789b5e0 2024-05-09T09:48:46.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.140+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(110 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10_fourteen [call] v32'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.140+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:111 4.27 4:e4f3711e:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178db660 con 0x560f17896bf0 2024-05-09T09:48:46.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.140+0000 7fa0d4eae980 20 list_objects_ordered: starting attempt 1 2024-05-09T09:48:46.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.140+0000 7fa0d4eae980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-09T09:48:46.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.140+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:112 4.35 4:ae5c5f47:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178db660 con 0x560f17896bf0 2024-05-09T09:48:46.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.140+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:113 4.1 4:81682f07:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178df8f0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.140+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:114 4.38 4:1e66fb07:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178db660 con 0x560f17896bf0 2024-05-09T09:48:46.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.140+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:115 4.1f 4:fbe0c5e3:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178df8f0 con 0x560f1789ff30 2024-05-09T09:48:46.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.140+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:116 4.e 4:70734c7c:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178e6c90 con 0x7fa0c801fbe0 2024-05-09T09:48:46.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.140+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:117 4.27 4:e4f3711e:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178e9740 con 0x560f17896bf0 2024-05-09T09:48:46.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.140+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:118 4.1e 4:7b0402c9:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178ec320 con 0x560f1789b5e0 2024-05-09T09:48:46.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.140+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:119 4.3b 4:dd6e2294:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178eec30 con 0x7fa0c801fbe0 2024-05-09T09:48:46.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.140+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:120 4.c 4:3328b921:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178f1740 con 0x560f17896bf0 2024-05-09T09:48:46.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.140+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:121 4.32 4:4fa67170:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178f45c0 con 0x560f17896bf0 2024-05-09T09:48:46.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.140+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== osd_op_reply(115 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0c8049040 con 0x560f1789ff30 2024-05-09T09:48:46.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.140+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:122 4.2 4:42e9e2ae:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178e2830 con 0x560f17896bf0 2024-05-09T09:48:46.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.140+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(112 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.140+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(114 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.140+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(113 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.1 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.140+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(116 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.140+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 36 ==== osd_op_reply(121 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.9 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.140+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 37 ==== osd_op_reply(120 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.140+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(118 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.140+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 23 ==== osd_op_reply(119 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.140+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 38 ==== osd_op_reply(122 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.140+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 39 ==== osd_op_reply(111 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.5 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.140+0000 7f9fb4ff9640 20 handle_completion(): completion ok for obj=fourteen 2024-05-09T09:48:46.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.144+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 40 ==== osd_op_reply(117 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.144+0000 7fa0d4eae980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-09T09:48:46.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.144+0000 7fa0d4eae980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-09T09:48:46.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.144+0000 7fa0d4eae980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-09T09:48:46.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.144+0000 7fa0d4eae980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-09T09:48:46.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.144+0000 7fa0d4eae980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10])"; uploads.size()=0; is_truncated=0 2024-05-09T09:48:46.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.144+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:123 4.35 4:ae5c5f47:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178db110 con 0x560f17896bf0 2024-05-09T09:48:46.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.144+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:124 4.1 4:81682f07:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178e4200 con 0x7fa0c801fbe0 2024-05-09T09:48:46.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.144+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:125 4.38 4:1e66fb07:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178f4420 con 0x560f17896bf0 2024-05-09T09:48:46.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.144+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:126 4.1f 4:fbe0c5e3:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178ec740 con 0x560f1789ff30 2024-05-09T09:48:46.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.144+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:127 4.e 4:70734c7c:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178eebf0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.144+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:128 4.27 4:e4f3711e:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178db110 con 0x560f17896bf0 2024-05-09T09:48:46.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.144+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:129 4.1e 4:7b0402c9:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178f15f0 con 0x560f1789b5e0 2024-05-09T09:48:46.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.144+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:130 4.3b 4:dd6e2294:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178f4420 con 0x7fa0c801fbe0 2024-05-09T09:48:46.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.144+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:131 4.c 4:3328b921:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178db110 con 0x560f17896bf0 2024-05-09T09:48:46.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.144+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:132 4.32 4:4fa67170:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178ec740 con 0x560f17896bf0 2024-05-09T09:48:46.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.144+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:133 4.2 4:42e9e2ae:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178eebf0 con 0x560f17896bf0 2024-05-09T09:48:46.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.144+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 41 ==== osd_op_reply(125 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.144+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 30 ==== osd_op_reply(126 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0c8049040 con 0x560f1789ff30 2024-05-09T09:48:46.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.144+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 42 ==== osd_op_reply(123 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.144+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 43 ==== osd_op_reply(128 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.144+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 44 ==== osd_op_reply(131 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.144+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(129 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.144+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 45 ==== osd_op_reply(132 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.9 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.144+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 46 ==== osd_op_reply(133 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.144+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 24 ==== osd_op_reply(124 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.1 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.144+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 25 ==== osd_op_reply(127 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.144+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 26 ==== osd_op_reply(130 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.144+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178ec740 con 0x560f1789b5e0 2024-05-09T09:48:46.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.148+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 32 ==== osd_op_reply(134 fud.buckets [call] v32'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.148+0000 7fa0d4eae980 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-05-09T09:48:46.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.148+0000 7fa0d4eae980 20 rados->read ofs=0 len=0 2024-05-09T09:48:46.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.148+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178ec740 con 0x7fa0c801fbe0 2024-05-09T09:48:46.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.148+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 27 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv47 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.148+0000 7fa0d4eae980 20 rados_obj.operate() r=0 bl.length=168 2024-05-09T09:48:46.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.148+0000 7fa0d4eae980 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-05-09T09:48:46.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.148+0000 7fa0d4eae980 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-05-09T09:48:46.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.148+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178ec740 con 0x7fa0c801fbe0 2024-05-09T09:48:46.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.148+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 28 ==== osd_op_reply(136 myfoo7 [call,call,delete] v32'49 uv49 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.148+0000 7fa0d4eae980 10 removing default.rgw.meta+root+myfoo7 from cache 2024-05-09T09:48:46.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.148+0000 7fa0d4eae980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-05-09T09:48:46.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.148+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94622819731264 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178f3e60 con 0x7fa0c801fbe0 2024-05-09T09:48:46.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.148+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 29 ==== watch-notify(notify (1) cookie 94622819445936 notify 137438953490 ret 0) ==== 192+0+0 (crc 0 0 0) 0x560f178b8590 con 0x7fa0c801fbe0 2024-05-09T09:48:46.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.148+0000 7f9fb4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 94622819445936 notifier 4768 bl.length()=150 2024-05-09T09:48:46.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.148+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 30 ==== osd_op_reply(137 notify.3 [notify cookie 94622819731264 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.148+0000 7f9fb4ff9640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9efc003930 con 0x7fa0c801fbe0 2024-05-09T09:48:46.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.148+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 31 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.148+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 32 ==== watch-notify(notify_complete (2) cookie 94622819731264 notify 137438953490 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560f178b40e0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.148+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:139 8.15 8:a941c2c1:root::.bucket.meta.myfoo7%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f179537e0 con 0x560f1789ff30 2024-05-09T09:48:46.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.152+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 31 ==== osd_op_reply(139 .bucket.meta.myfoo7:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10 [call,call,delete] v32'6 uv6 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7fa0c8049040 con 0x560f1789ff30 2024-05-09T09:48:46.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.152+0000 7fa0d4eae980 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10 from cache 2024-05-09T09:48:46.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.152+0000 7fa0d4eae980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10, ofs0, ns] 2024-05-09T09:48:46.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.152+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:140 7.d 7:b4812045:::notify.4:head [notify cookie 94622819731264 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f179537e0 con 0x560f17896bf0 2024-05-09T09:48:46.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.152+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 47 ==== watch-notify(notify (1) cookie 94622819444432 notify 137438953501 ret 0) ==== 250+0+0 (crc 0 0 0) 0x560f178b40e0 con 0x560f17896bf0 2024-05-09T09:48:46.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.152+0000 7f9fb4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953501 cookie 94622819444432 notifier 4768 bl.length()=208 2024-05-09T09:48:46.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.152+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 48 ==== osd_op_reply(140 notify.4 [notify cookie 94622819731264 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.152+0000 7f9fb4ff9640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:141 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9efc003930 con 0x560f17896bf0 2024-05-09T09:48:46.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.152+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 49 ==== osd_op_reply(141 notify.4 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.152+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 50 ==== watch-notify(notify_complete (2) cookie 94622819731264 notify 137438953501 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560f178b36c0 con 0x560f17896bf0 2024-05-09T09:48:46.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.152+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:142 4.35 4:ae5c5f47:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f179537e0 con 0x560f17896bf0 2024-05-09T09:48:46.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.152+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:143 4.1 4:81682f07:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178ec740 con 0x7fa0c801fbe0 2024-05-09T09:48:46.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.152+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:144 4.38 4:1e66fb07:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178d5050 con 0x560f17896bf0 2024-05-09T09:48:46.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.152+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:145 4.1f 4:fbe0c5e3:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178d5920 con 0x560f1789ff30 2024-05-09T09:48:46.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.152+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:146 4.e 4:70734c7c:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f17951df0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.152+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:147 4.27 4:e4f3711e:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178e2d40 con 0x560f17896bf0 2024-05-09T09:48:46.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.152+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:148 4.1e 4:7b0402c9:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178e3690 con 0x560f1789b5e0 2024-05-09T09:48:46.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.152+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:149 4.3b 4:dd6e2294:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f179537e0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.152+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:150 4.c 4:3328b921:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178d5050 con 0x560f17896bf0 2024-05-09T09:48:46.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.152+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:151 4.32 4:4fa67170:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178e2d40 con 0x560f17896bf0 2024-05-09T09:48:46.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.152+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:152 4.2 4:42e9e2ae:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178d5920 con 0x560f17896bf0 2024-05-09T09:48:46.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.152+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 33 ==== osd_op_reply(143 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.1 [delete] v32'12 uv12 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.156+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 34 ==== osd_op_reply(146 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.4 [delete] v32'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.156+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 32 ==== osd_op_reply(145 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.3 [delete] v32'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa0c8049040 con 0x560f1789ff30 2024-05-09T09:48:46.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.156+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 51 ==== osd_op_reply(151 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.9 [delete] v32'5 uv5 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.156+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 52 ==== osd_op_reply(144 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.2 [delete] v32'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.156+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 53 ==== osd_op_reply(152 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.10 [delete] v32'2 uv2 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.156+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 54 ==== osd_op_reply(150 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.8 [delete] v32'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.156+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 55 ==== osd_op_reply(147 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.5 [delete] v32'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.156+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 35 ==== osd_op_reply(149 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.7 [delete] v32'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.156+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 33 ==== osd_op_reply(148 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.6 [delete] v32'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.156+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 56 ==== osd_op_reply(142 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10.0 [delete] v32'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.156+0000 7fa0d4eae980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10 : miss 2024-05-09T09:48:46.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.156+0000 7fa0d4eae980 20 rados->read ofs=0 len=0 2024-05-09T09:48:46.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.156+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:153 6.18 6:1acde2aa:::pubsub..bucket.myfoo7%2fb73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178ec740 con 0x560f1789b5e0 2024-05-09T09:48:46.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.156+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 34 ==== osd_op_reply(153 pubsub..bucket.myfoo7/b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.156+0000 7fa0d4eae980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:48:46.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.156+0000 7fa0d4eae980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10 info.flags=0x0 2024-05-09T09:48:46.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.156+0000 7fa0d4eae980 10 adding default.rgw.log++pubsub..bucket.myfoo7/b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10 to cache LRU end 2024-05-09T09:48:46.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.156+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:154 6.18 6:1acde2aa:::pubsub..bucket.myfoo7%2fb73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178ec740 con 0x560f1789b5e0 2024-05-09T09:48:46.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.156+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 35 ==== osd_op_reply(154 pubsub..bucket.myfoo7/b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10 [delete] v32'88 uv66 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.156+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178ec740 con 0x560f1789b5e0 2024-05-09T09:48:46.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.160+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 36 ==== osd_op_reply(155 fud.buckets [call] v32'9 uv9 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.160+0000 7fa0d4eae980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-05-09T09:48:46.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.160+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178ec740 con 0x560f1789b5e0 2024-05-09T09:48:46.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.164+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 37 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v32'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.164+0000 7fa0d4eae980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-09T09:48:46.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.164+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94622819641376 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178ec740 con 0x560f1789ff30 2024-05-09T09:48:46.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.164+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 33 ==== watch-notify(notify (1) cookie 94622819433728 notify 137438953479 ret 0) ==== 212+0+0 (crc 0 0 0) 0x560f178b2e20 con 0x560f1789ff30 2024-05-09T09:48:46.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.164+0000 7f9fb4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 94622819433728 notifier 4768 bl.length()=170 2024-05-09T09:48:46.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.164+0000 7f9fb4ff9640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9efc003930 con 0x560f1789ff30 2024-05-09T09:48:46.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.164+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 34 ==== osd_op_reply(157 notify.2 [notify cookie 94622819641376 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa0c8049040 con 0x560f1789ff30 2024-05-09T09:48:46.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.164+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 35 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0c8049040 con 0x560f1789ff30 2024-05-09T09:48:46.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.164+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 36 ==== watch-notify(notify_complete (2) cookie 94622819641376 notify 137438953479 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560f178b7bf0 con 0x560f1789ff30 2024-05-09T09:48:46.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.164+0000 7fa0d4eae980 10 removing email index: 2024-05-09T09:48:46.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.164+0000 7fa0d4eae980 10 removing user buckets index 2024-05-09T09:48:46.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.164+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178ec740 con 0x560f1789b5e0 2024-05-09T09:48:46.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.164+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 38 ==== osd_op_reply(159 fud.buckets [delete] v32'10 uv10 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.164+0000 7fa0d4eae980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-05-09T09:48:46.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.164+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94622819641376 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178ec740 con 0x560f1789b5e0 2024-05-09T09:48:46.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.168+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 39 ==== watch-notify(notify (1) cookie 94622819454736 notify 137438953513 ret 0) ==== 202+0+0 (crc 0 0 0) 0x560f178b7f20 con 0x560f1789b5e0 2024-05-09T09:48:46.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.168+0000 7f9fb57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953513 cookie 94622819454736 notifier 4768 bl.length()=160 2024-05-09T09:48:46.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.168+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 40 ==== osd_op_reply(160 notify.6 [notify cookie 94622819641376 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.170 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.168+0000 7f9fb57fa640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9f94005550 con 0x560f1789b5e0 2024-05-09T09:48:46.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.168+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 41 ==== watch-notify(notify_complete (2) cookie 94622819641376 notify 137438953513 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560f178746c0 con 0x560f1789b5e0 2024-05-09T09:48:46.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.168+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 42 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.168+0000 7fa0d4eae980 10 removing user index: fud 2024-05-09T09:48:46.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.168+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178ec740 con 0x560f1789b5e0 2024-05-09T09:48:46.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.168+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 43 ==== osd_op_reply(162 fud [call,call,delete] v32'8 uv8 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.168+0000 7fa0d4eae980 10 removing default.rgw.meta+users.uid+fud from cache 2024-05-09T09:48:46.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.168+0000 7fa0d4eae980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-05-09T09:48:46.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.168+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94622819641376 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f178ec740 con 0x560f1789b5e0 2024-05-09T09:48:46.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.172+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 44 ==== watch-notify(notify (1) cookie 94622819452608 notify 137438953514 ret 0) ==== 194+0+0 (crc 0 0 0) 0x560f178746c0 con 0x560f1789b5e0 2024-05-09T09:48:46.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.172+0000 7f9fb57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953514 cookie 94622819452608 notifier 4768 bl.length()=152 2024-05-09T09:48:46.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.172+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 45 ==== osd_op_reply(163 notify.5 [notify cookie 94622819641376 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.172+0000 7f9fb57fa640 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9f94005550 con 0x560f1789b5e0 2024-05-09T09:48:46.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.172+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 46 ==== watch-notify(notify_complete (2) cookie 94622819641376 notify 137438953514 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560f17840fb0 con 0x560f1789b5e0 2024-05-09T09:48:46.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.172+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 47 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.172+0000 7f9f837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:48:46.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.172+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94622819459344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178ec740 con 0x560f17896bf0 2024-05-09T09:48:46.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.172+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 57 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94622819459344] v32'404 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.172+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94622819436208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178ec740 con 0x7fa0c801fbe0 2024-05-09T09:48:46.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.176+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 36 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94622819436208] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.176+0000 7fa0d4eae980 20 remove_watcher() i=0 2024-05-09T09:48:46.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.176+0000 7fa0d4eae980 2 removed watcher, disabling cache 2024-05-09T09:48:46.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.176+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94622819439600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178ec740 con 0x560f17896bf0 2024-05-09T09:48:46.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.176+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 58 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94622819439600] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.176+0000 7fa0d4eae980 20 remove_watcher() i=1 2024-05-09T09:48:46.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.176+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94622819433728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178ec740 con 0x560f1789ff30 2024-05-09T09:48:46.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.180+0000 7fa0d21c8640 1 -- 172.21.15.157:0/1899292100 <== osd.3 v2:172.21.15.157:6816/2487336710 37 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94622819433728] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0c8049040 con 0x560f1789ff30 2024-05-09T09:48:46.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.180+0000 7fa0d4eae980 20 remove_watcher() i=2 2024-05-09T09:48:46.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.180+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94622819445936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178ec740 con 0x7fa0c801fbe0 2024-05-09T09:48:46.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.180+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.2 v2:172.21.15.157:6800/354455204 37 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94622819445936] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x7fa0c801fbe0 2024-05-09T09:48:46.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.180+0000 7fa0d4eae980 20 remove_watcher() i=3 2024-05-09T09:48:46.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.180+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94622819444432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178ec740 con 0x560f17896bf0 2024-05-09T09:48:46.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.184+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 <== osd.1 v2:172.21.15.157:6808/3930131338 59 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94622819444432] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0cc00a4d0 con 0x560f17896bf0 2024-05-09T09:48:46.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.184+0000 7fa0d4eae980 20 remove_watcher() i=4 2024-05-09T09:48:46.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.184+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94622819452608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178ec740 con 0x560f1789b5e0 2024-05-09T09:48:46.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.184+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 48 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94622819452608] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.184+0000 7fa0d4eae980 20 remove_watcher() i=5 2024-05-09T09:48:46.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.184+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94622819454736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178ec740 con 0x560f1789b5e0 2024-05-09T09:48:46.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.188+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 49 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94622819454736] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.188+0000 7fa0d4eae980 20 remove_watcher() i=6 2024-05-09T09:48:46.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.188+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94622819458288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f178ec740 con 0x560f1789b5e0 2024-05-09T09:48:46.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.188+0000 7fa0d29c9640 1 -- 172.21.15.157:0/1899292100 <== osd.0 v2:172.21.15.110:6800/231209037 50 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94622819458288] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0c4111030 con 0x560f1789b5e0 2024-05-09T09:48:46.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.188+0000 7fa0d4eae980 20 remove_watcher() i=7 2024-05-09T09:48:46.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.188+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560f1789b5e0 msgr2=0x560f1789d9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:46.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.188+0000 7fa0d4eae980 1 --2- 172.21.15.157:0/1899292100 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560f1789b5e0 0x560f1789d9d0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:46.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.188+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560f17896bf0 msgr2=0x560f178990b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:46.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.188+0000 7fa0d4eae980 1 --2- 172.21.15.157:0/1899292100 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560f17896bf0 0x560f178990b0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:46.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.188+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa0c801fbe0 msgr2=0x7fa0c803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:46.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.188+0000 7fa0d4eae980 1 --2- 172.21.15.157:0/1899292100 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa0c801fbe0 0x7fa0c803a3c0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:46.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.188+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560f1789ff30 msgr2=0x560f178a2340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:46.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.188+0000 7fa0d4eae980 1 --2- 172.21.15.157:0/1899292100 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560f1789ff30 0x560f178a2340 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:46.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.188+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9f9c034b10 msgr2=0x7f9f9c036fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:46.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.188+0000 7fa0d4eae980 1 --2- 172.21.15.157:0/1899292100 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9f9c034b10 0x7f9f9c036fd0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x560f1784e270 tx=0x7fa0c8010000 comp rx=0 tx=0).stop 2024-05-09T09:48:46.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.188+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f1774bb80 msgr2=0x560f1788a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:46.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.188+0000 7fa0d4eae980 1 --2- 172.21.15.157:0/1899292100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f1774bb80 0x560f1788a240 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40aaa90 tx=0x7fa0c40b1f40 comp rx=0 tx=0).stop 2024-05-09T09:48:46.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.188+0000 7fa0d31ca640 1 -- 172.21.15.157:0/1899292100 reap_dead start 2024-05-09T09:48:46.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.188+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 shutdown_connections 2024-05-09T09:48:46.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.188+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 >> 172.21.15.157:0/1899292100 conn(0x560f1787d0b0 msgr2=0x560f1787a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:46.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.188+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 shutdown_connections 2024-05-09T09:48:46.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.188+0000 7fa0d4eae980 1 -- 172.21.15.157:0/1899292100 wait complete. 2024-05-09T09:48:46.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.192+0000 7fa0d4eae980 1 -- 172.21.15.157:0/995022065 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9fac034c50 msgr2=0x7f9fac037110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:46.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.192+0000 7fa0d4eae980 1 --2- 172.21.15.157:0/995022065 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9fac034c50 0x7f9fac037110 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x560f17842210 tx=0x7fa0c800f000 comp rx=0 tx=0).stop 2024-05-09T09:48:46.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.192+0000 7fa0d4eae980 1 -- 172.21.15.157:0/995022065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f17873d60 msgr2=0x560f17874180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:46.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.192+0000 7fa0d4eae980 1 --2- 172.21.15.157:0/995022065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f17873d60 0x560f17874180 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40bdf70 tx=0x7fa0c40c5a80 comp rx=0 tx=0).stop 2024-05-09T09:48:46.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.192+0000 7fa0d4eae980 1 -- 172.21.15.157:0/995022065 shutdown_connections 2024-05-09T09:48:46.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.192+0000 7fa0d4eae980 1 --2- 172.21.15.157:0/995022065 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9fac034c50 0x7f9fac037110 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:46.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.192+0000 7fa0d4eae980 1 --2- 172.21.15.157:0/995022065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f17873d60 0x560f17874180 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:46.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.192+0000 7fa0d4eae980 1 -- 172.21.15.157:0/995022065 >> 172.21.15.157:0/995022065 conn(0x560f17868b30 msgr2=0x560f17869640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:46.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.192+0000 7fa0d4eae980 1 -- 172.21.15.157:0/995022065 shutdown_connections 2024-05-09T09:48:46.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.192+0000 7fa0d4eae980 1 -- 172.21.15.157:0/995022065 wait complete. 2024-05-09T09:48:46.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.192+0000 7fa0d4eae980 1 -- 172.21.15.157:0/392127414 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560f178472e0 msgr2=0x560f178497a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:46.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.192+0000 7fa0d4eae980 1 --2- 172.21.15.157:0/392127414 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560f178472e0 0x560f178497a0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:46.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.192+0000 7fa0d4eae980 1 -- 172.21.15.157:0/392127414 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560f1774eb00 msgr2=0x560f17844a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:46.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.192+0000 7fa0d4eae980 1 --2- 172.21.15.157:0/392127414 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560f1774eb00 0x560f17844a90 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:46.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.192+0000 7fa0d4eae980 1 -- 172.21.15.157:0/392127414 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560f1784b390 msgr2=0x560f1784d780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:46.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.192+0000 7fa0d4eae980 1 --2- 172.21.15.157:0/392127414 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x560f1784b390 0x560f1784d780 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:48:46.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.192+0000 7fa0d4eae980 1 -- 172.21.15.157:0/392127414 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9fb8034c00 msgr2=0x7f9fb80370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:46.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.192+0000 7fa0d4eae980 1 --2- 172.21.15.157:0/392127414 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9fb8034c00 0x7f9fb80370c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8001e50 tx=0x7fa0c80013b0 comp rx=0 tx=0).stop 2024-05-09T09:48:46.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.192+0000 7fa0d4eae980 1 -- 172.21.15.157:0/392127414 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f176bfac0 msgr2=0x560f1783db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:48:46.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.192+0000 7fa0d4eae980 1 --2- 172.21.15.157:0/392127414 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560f176bfac0 0x560f1783db50 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4003070 tx=0x7fa0c40180e0 comp rx=0 tx=0).stop 2024-05-09T09:48:46.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.192+0000 7fa0d31ca640 1 -- 172.21.15.157:0/392127414 reap_dead start 2024-05-09T09:48:46.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.192+0000 7fa0d4eae980 1 -- 172.21.15.157:0/392127414 shutdown_connections 2024-05-09T09:48:46.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.192+0000 7fa0d4eae980 1 -- 172.21.15.157:0/392127414 >> 172.21.15.157:0/392127414 conn(0x560f177460e0 msgr2=0x560f17831200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:48:46.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.192+0000 7fa0d4eae980 1 -- 172.21.15.157:0/392127414 shutdown_connections 2024-05-09T09:48:46.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:48:46.192+0000 7fa0d4eae980 1 -- 172.21.15.157:0/392127414 wait complete. 2024-05-09T09:49:26.209 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-05-09T09:49:26.209 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-05-09T09:49:26.210 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-05-09T09:49:26.250 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:49:26.250 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:49:26.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.251+0000 7f10a948c980 1 Processor -- start 2024-05-09T09:49:26.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.251+0000 7f10a948c980 1 -- start start 2024-05-09T09:49:26.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.251+0000 7f10a948c980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5626ec298030 0x5626ec29a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.251+0000 7f10a948c980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5626ec147440 con 0x5626ec293b30 2024-05-09T09:49:26.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.251+0000 7f10a948c980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5626ec1325f0 con 0x5626ec298030 2024-05-09T09:49:26.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.251+0000 7f10a67a6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5626ec298030 0x5626ec29a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.251+0000 7f10a6fa7640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x5626ec293b30 0x5626ec293f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:45494/0 (socket says 172.21.15.157:45494) 2024-05-09T09:49:26.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.251+0000 7f10a67a6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5626ec298030 0x5626ec29a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38538/0 (socket says 172.21.15.157:38538) 2024-05-09T09:49:26.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.251+0000 7f10a6fa7640 1 -- 172.21.15.157:0/314885549 learned_addr learned my addr 172.21.15.157:0/314885549 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:49:26.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.251+0000 7f10a5fa5640 1 -- 172.21.15.157:0/314885549 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2357284576 0 0) 0x5626ec147440 con 0x5626ec293b30 2024-05-09T09:49:26.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.251+0000 7f10a5fa5640 1 -- 172.21.15.157:0/314885549 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1094001e20 con 0x5626ec293b30 2024-05-09T09:49:26.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.251+0000 7f10a67a6640 1 -- 172.21.15.157:0/314885549 >> v1:172.21.15.110:6789/0 conn(0x5626ec293b30 legacy=0x5626ec293f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.251+0000 7f10a67a6640 1 -- 172.21.15.157:0/314885549 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626ec13d990 con 0x5626ec298030 2024-05-09T09:49:26.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.255+0000 7f10a67a6640 1 --2- 172.21.15.157:0/314885549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec298030 0x5626ec29a420 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f109000a420 tx=0x7f109001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bf0cd714cc06cc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.255+0000 7f10a5fa5640 1 -- 172.21.15.157:0/314885549 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10900af070 con 0x5626ec298030 2024-05-09T09:49:26.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.255+0000 7f10a5fa5640 1 -- 172.21.15.157:0/314885549 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10900aa530 con 0x5626ec298030 2024-05-09T09:49:26.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.255+0000 7f10a5fa5640 1 -- 172.21.15.157:0/314885549 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10900aa850 con 0x5626ec298030 2024-05-09T09:49:26.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.255+0000 7f10a948c980 1 -- 172.21.15.157:0/314885549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec298030 msgr2=0x5626ec29a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.255+0000 7f10a948c980 1 --2- 172.21.15.157:0/314885549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec298030 0x5626ec29a420 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f109000a420 tx=0x7f109001afd0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.255+0000 7f10a948c980 1 -- 172.21.15.157:0/314885549 shutdown_connections 2024-05-09T09:49:26.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.255+0000 7f10a948c980 1 --2- 172.21.15.157:0/314885549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec298030 0x5626ec29a420 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.255+0000 7f10a948c980 1 -- 172.21.15.157:0/314885549 >> 172.21.15.157:0/314885549 conn(0x5626ec207250 msgr2=0x5626ec207660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:26.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.255+0000 7f10a948c980 1 -- 172.21.15.157:0/314885549 shutdown_connections 2024-05-09T09:49:26.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.255+0000 7f10a948c980 1 -- 172.21.15.157:0/314885549 wait complete. 2024-05-09T09:49:26.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.271+0000 7f10a948c980 1 Processor -- start 2024-05-09T09:49:26.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.271+0000 7f10a948c980 1 -- start start 2024-05-09T09:49:26.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.271+0000 7f10a948c980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec293b30 0x5626ec37eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.271+0000 7f10a948c980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5626ec194fe0 con 0x5626ec293b30 2024-05-09T09:49:26.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.271+0000 7f10a6fa7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec293b30 0x5626ec37eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.271+0000 7f10a6fa7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec293b30 0x5626ec37eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38546/0 (socket says 172.21.15.157:38546) 2024-05-09T09:49:26.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.271+0000 7f10a6fa7640 1 -- 172.21.15.157:0/2422856366 learned_addr learned my addr 172.21.15.157:0/2422856366 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:26.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.271+0000 7f10a6fa7640 1 -- 172.21.15.157:0/2422856366 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626ec119ae0 con 0x5626ec293b30 2024-05-09T09:49:26.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.271+0000 7f10a6fa7640 1 --2- 172.21.15.157:0/2422856366 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec293b30 0x5626ec37eb00 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f1098001dc0 tx=0x7f109800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eafa533a051794a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.271+0000 7f0f94e09640 1 -- 172.21.15.157:0/2422856366 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1098012020 con 0x5626ec293b30 2024-05-09T09:49:26.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.271+0000 7f0f94e09640 1 -- 172.21.15.157:0/2422856366 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f109800e7c0 con 0x5626ec293b30 2024-05-09T09:49:26.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.271+0000 7f0f94e09640 1 -- 172.21.15.157:0/2422856366 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f109800eb40 con 0x5626ec293b30 2024-05-09T09:49:26.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.275+0000 7f10a948c980 1 -- 172.21.15.157:0/2422856366 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec293b30 msgr2=0x5626ec37eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.275+0000 7f10a948c980 1 --2- 172.21.15.157:0/2422856366 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec293b30 0x5626ec37eb00 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f1098001dc0 tx=0x7f109800b6d0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.275+0000 7f10a948c980 1 -- 172.21.15.157:0/2422856366 shutdown_connections 2024-05-09T09:49:26.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.275+0000 7f10a948c980 1 --2- 172.21.15.157:0/2422856366 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec293b30 0x5626ec37eb00 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.275+0000 7f10a948c980 1 -- 172.21.15.157:0/2422856366 >> 172.21.15.157:0/2422856366 conn(0x5626ec207250 msgr2=0x5626ec37a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:26.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.275+0000 7f10a948c980 1 -- 172.21.15.157:0/2422856366 shutdown_connections 2024-05-09T09:49:26.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.275+0000 7f10a948c980 1 -- 172.21.15.157:0/2422856366 wait complete. 2024-05-09T09:49:26.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.275+0000 7f10a948c980 1 Processor -- start 2024-05-09T09:49:26.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.275+0000 7f10a948c980 1 -- start start 2024-05-09T09:49:26.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.275+0000 7f10a948c980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec293b30 0x5626ec385ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.275+0000 7f10a948c980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5626ec29d450 con 0x5626ec293b30 2024-05-09T09:49:26.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.275+0000 7f10a6fa7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec293b30 0x5626ec385ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.275+0000 7f10a6fa7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec293b30 0x5626ec385ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38552/0 (socket says 172.21.15.157:38552) 2024-05-09T09:49:26.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.275+0000 7f10a6fa7640 1 -- 172.21.15.157:0/3285833418 learned_addr learned my addr 172.21.15.157:0/3285833418 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:26.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.275+0000 7f10a6fa7640 1 -- 172.21.15.157:0/3285833418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626ec3861e0 con 0x5626ec293b30 2024-05-09T09:49:26.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.275+0000 7f10a6fa7640 1 --2- 172.21.15.157:0/3285833418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec293b30 0x5626ec385ca0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f1098004180 tx=0x7f1098000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.275+0000 7f0f93606640 1 -- 172.21.15.157:0/3285833418 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1098012030 con 0x5626ec293b30 2024-05-09T09:49:26.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.275+0000 7f0f93606640 1 -- 172.21.15.157:0/3285833418 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1098001440 con 0x5626ec293b30 2024-05-09T09:49:26.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.275+0000 7f0f93606640 1 -- 172.21.15.157:0/3285833418 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f109801aaa0 con 0x5626ec293b30 2024-05-09T09:49:26.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.275+0000 7f10a948c980 1 -- 172.21.15.157:0/3285833418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626ec386470 con 0x5626ec293b30 2024-05-09T09:49:26.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.275+0000 7f10a948c980 1 -- 172.21.15.157:0/3285833418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626ec389100 con 0x5626ec293b30 2024-05-09T09:49:26.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.279+0000 7f0f93606640 1 -- 172.21.15.157:0/3285833418 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f1098015020 con 0x5626ec293b30 2024-05-09T09:49:26.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.279+0000 7f0f93606640 1 --2- 172.21.15.157:0/3285833418 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0f8c034c00 0x7f0f8c0370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.279+0000 7f0f93606640 1 -- 172.21.15.157:0/3285833418 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f1098020030 con 0x5626ec293b30 2024-05-09T09:49:26.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.279+0000 7f10a67a6640 1 --2- 172.21.15.157:0/3285833418 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0f8c034c00 0x7f0f8c0370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.279+0000 7f10a948c980 1 --2- 172.21.15.157:0/3285833418 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5626ec298030 0x5626ec38cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.279+0000 7f10a948c980 1 -- 172.21.15.157:0/3285833418 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5626ec38d200 con 0x5626ec298030 2024-05-09T09:49:26.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.279+0000 7f10a77a8640 1 --2- 172.21.15.157:0/3285833418 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5626ec298030 0x5626ec38cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.279+0000 7f10a67a6640 1 --2- 172.21.15.157:0/3285833418 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0f8c034c00 0x7f0f8c0370c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f10900ac000 tx=0x7f10900a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.279+0000 7f10a77a8640 1 --2- 172.21.15.157:0/3285833418 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5626ec298030 0x5626ec38cbe0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.279+0000 7f10a77a8640 1 -- 172.21.15.157:0/3285833418 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f10a00083f0 con 0x5626ec298030 2024-05-09T09:49:26.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.279+0000 7f10a948c980 1 -- 172.21.15.157:0/3285833418 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5626ec38db10 con 0x5626ec298030 2024-05-09T09:49:26.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.279+0000 7f10a77a8640 1 -- 172.21.15.157:0/3285833418 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f10a00083f0 con 0x5626ec298030 2024-05-09T09:49:26.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.279+0000 7f10a948c980 1 --2- 172.21.15.157:0/3285833418 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5626ec38f460 0x5626ec3918f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.279+0000 7f10a948c980 1 -- 172.21.15.157:0/3285833418 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5626ec392080 con 0x5626ec38f460 2024-05-09T09:49:26.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.279+0000 7f10a6fa7640 1 --2- 172.21.15.157:0/3285833418 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5626ec38f460 0x5626ec3918f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.279+0000 7f10a6fa7640 1 --2- 172.21.15.157:0/3285833418 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5626ec38f460 0x5626ec3918f0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.283+0000 7f10a6fa7640 1 -- 172.21.15.157:0/3285833418 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1098008030 con 0x5626ec38f460 2024-05-09T09:49:26.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.283+0000 7f10a948c980 1 -- 172.21.15.157:0/3285833418 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5626ec38e360 con 0x5626ec298030 2024-05-09T09:49:26.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.283+0000 7f10a77a8640 1 -- 172.21.15.157:0/3285833418 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f10a00083f0 con 0x5626ec298030 2024-05-09T09:49:26.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.283+0000 7f10a948c980 1 --2- 172.21.15.157:0/3285833418 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5626ec3934e0 0x5626ec3958d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.283+0000 7f10a948c980 1 -- 172.21.15.157:0/3285833418 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5626ec396010 con 0x5626ec3934e0 2024-05-09T09:49:26.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.283+0000 7f10a67a6640 1 --2- 172.21.15.157:0/3285833418 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5626ec3934e0 0x5626ec3958d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.283+0000 7f10a67a6640 1 --2- 172.21.15.157:0/3285833418 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5626ec3934e0 0x5626ec3958d0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.283+0000 7f10a67a6640 1 -- 172.21.15.157:0/3285833418 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f10900b2070 con 0x5626ec3934e0 2024-05-09T09:49:26.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.287+0000 7f10a948c980 1 Processor -- start 2024-05-09T09:49:26.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.287+0000 7f10a948c980 1 -- start start 2024-05-09T09:49:26.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.287+0000 7f10a948c980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec3bbe80 0x5626ec3bc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.287+0000 7f10a948c980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5626ec199020 con 0x5626ec3bbe80 2024-05-09T09:49:26.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.287+0000 7f10a6fa7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec3bbe80 0x5626ec3bc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.287+0000 7f10a6fa7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec3bbe80 0x5626ec3bc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38566/0 (socket says 172.21.15.157:38566) 2024-05-09T09:49:26.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.287+0000 7f10a6fa7640 1 -- 172.21.15.157:0/3959972430 learned_addr learned my addr 172.21.15.157:0/3959972430 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:26.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.287+0000 7f10a6fa7640 1 -- 172.21.15.157:0/3959972430 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626ec3bc7e0 con 0x5626ec3bbe80 2024-05-09T09:49:26.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.287+0000 7f10a6fa7640 1 --2- 172.21.15.157:0/3959972430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec3bbe80 0x5626ec3bc2a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f1098048bc0 tx=0x7f109800db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.287+0000 7f0f8b7fe640 1 -- 172.21.15.157:0/3959972430 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1098042a80 con 0x5626ec3bbe80 2024-05-09T09:49:26.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.287+0000 7f0f8b7fe640 1 -- 172.21.15.157:0/3959972430 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f109803e070 con 0x5626ec3bbe80 2024-05-09T09:49:26.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.287+0000 7f10a948c980 1 -- 172.21.15.157:0/3959972430 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626ec3bd270 con 0x5626ec3bbe80 2024-05-09T09:49:26.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.287+0000 7f0f8b7fe640 1 -- 172.21.15.157:0/3959972430 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1098042d90 con 0x5626ec3bbe80 2024-05-09T09:49:26.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.287+0000 7f10a948c980 1 -- 172.21.15.157:0/3959972430 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626ec3bd270 con 0x5626ec3bbe80 2024-05-09T09:49:26.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.291+0000 7f0f8b7fe640 1 -- 172.21.15.157:0/3959972430 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f1098009070 con 0x5626ec3bbe80 2024-05-09T09:49:26.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.291+0000 7f0f8b7fe640 1 --2- 172.21.15.157:0/3959972430 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0f80034bb0 0x7f0f80037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.291+0000 7f0f8b7fe640 1 -- 172.21.15.157:0/3959972430 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f1098005050 con 0x5626ec3bbe80 2024-05-09T09:49:26.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.291+0000 7f10a67a6640 1 --2- 172.21.15.157:0/3959972430 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0f80034bb0 0x7f0f80037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.291+0000 7f10a948c980 1 Processor -- start 2024-05-09T09:49:26.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.291+0000 7f10a948c980 1 -- start start 2024-05-09T09:49:26.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.291+0000 7f10a67a6640 1 --2- 172.21.15.157:0/3959972430 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0f80034bb0 0x7f0f80037070 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x5626ec38a480 tx=0x7f1090005d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.291+0000 7f10a948c980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec3c8c10 0x5626ec3c9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.291+0000 7f10a948c980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5626ec37f250 con 0x5626ec3c8c10 2024-05-09T09:49:26.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.291+0000 7f10a6fa7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec3c8c10 0x5626ec3c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.291+0000 7f10a6fa7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec3c8c10 0x5626ec3c9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38568/0 (socket says 172.21.15.157:38568) 2024-05-09T09:49:26.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.291+0000 7f10a6fa7640 1 -- 172.21.15.157:0/3263141844 learned_addr learned my addr 172.21.15.157:0/3263141844 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:26.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.291+0000 7f10a6fa7640 1 -- 172.21.15.157:0/3263141844 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626ec3c95e0 con 0x5626ec3c8c10 2024-05-09T09:49:26.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.291+0000 7f10a6fa7640 1 --2- 172.21.15.157:0/3263141844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec3c8c10 0x5626ec3c9010 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f1098042fd0 tx=0x7f1098038b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d88be02e2c4d297 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.291+0000 7f0f897fa640 1 -- 172.21.15.157:0/3263141844 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1098038c40 con 0x5626ec3c8c10 2024-05-09T09:49:26.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.291+0000 7f0f897fa640 1 -- 172.21.15.157:0/3263141844 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10980383b0 con 0x5626ec3c8c10 2024-05-09T09:49:26.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.291+0000 7f0f897fa640 1 -- 172.21.15.157:0/3263141844 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1098039450 con 0x5626ec3c8c10 2024-05-09T09:49:26.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.291+0000 7f10a948c980 1 -- 172.21.15.157:0/3263141844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec3c8c10 msgr2=0x5626ec3c9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.291+0000 7f10a948c980 1 --2- 172.21.15.157:0/3263141844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec3c8c10 0x5626ec3c9010 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f1098042fd0 tx=0x7f1098038b00 comp rx=0 tx=0).stop 2024-05-09T09:49:26.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.291+0000 7f10a948c980 1 -- 172.21.15.157:0/3263141844 shutdown_connections 2024-05-09T09:49:26.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.291+0000 7f10a948c980 1 --2- 172.21.15.157:0/3263141844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec3c8c10 0x5626ec3c9010 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.291+0000 7f10a948c980 1 -- 172.21.15.157:0/3263141844 >> 172.21.15.157:0/3263141844 conn(0x5626ec3c4fe0 msgr2=0x5626ec3c3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:26.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.291+0000 7f10a948c980 1 -- 172.21.15.157:0/3263141844 shutdown_connections 2024-05-09T09:49:26.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.291+0000 7f10a948c980 1 -- 172.21.15.157:0/3263141844 wait complete. 2024-05-09T09:49:26.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.295+0000 7f10a948c980 1 Processor -- start 2024-05-09T09:49:26.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.295+0000 7f10a948c980 1 -- start start 2024-05-09T09:49:26.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.295+0000 7f10a948c980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec3c8c10 0x5626ec3d0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.295+0000 7f10a948c980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5626ec3c9ba0 con 0x5626ec3c8c10 2024-05-09T09:49:26.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.295+0000 7f10a6fa7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec3c8c10 0x5626ec3d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.295+0000 7f10a6fa7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec3c8c10 0x5626ec3d0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38574/0 (socket says 172.21.15.157:38574) 2024-05-09T09:49:26.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.295+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 learned_addr learned my addr 172.21.15.157:0/1868488844 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:26.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.295+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626ec3d05b0 con 0x5626ec3c8c10 2024-05-09T09:49:26.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.295+0000 7f10a6fa7640 1 --2- 172.21.15.157:0/1868488844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec3c8c10 0x5626ec3d0070 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f109801bfd0 tx=0x7f109800b020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.295+0000 7f0f777fe640 1 -- 172.21.15.157:0/1868488844 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f109806f070 con 0x5626ec3c8c10 2024-05-09T09:49:26.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.295+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626ec3d05b0 con 0x5626ec3c8c10 2024-05-09T09:49:26.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.295+0000 7f0f777fe640 1 -- 172.21.15.157:0/1868488844 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f109804ab80 con 0x5626ec3c8c10 2024-05-09T09:49:26.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.295+0000 7f0f777fe640 1 -- 172.21.15.157:0/1868488844 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1098038c40 con 0x5626ec3c8c10 2024-05-09T09:49:26.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.295+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626ec3d0a30 con 0x5626ec3c8c10 2024-05-09T09:49:26.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.295+0000 7f0f777fe640 1 -- 172.21.15.157:0/1868488844 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f1098072070 con 0x5626ec3c8c10 2024-05-09T09:49:26.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.295+0000 7f0f777fe640 1 --2- 172.21.15.157:0/1868488844 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0f70034bb0 0x7f0f70037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.295+0000 7f0f777fe640 1 -- 172.21.15.157:0/1868488844 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f1098067070 con 0x5626ec3c8c10 2024-05-09T09:49:26.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.295+0000 7f10a948c980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.295+0000 7f10a67a6640 1 --2- 172.21.15.157:0/1868488844 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0f70034bb0 0x7f0f70037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.295+0000 7f10a948c980 1 --2- 172.21.15.157:0/1868488844 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5626ec3dcb30 0x5626ec3deff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.295+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3df740 con 0x5626ec3dcb30 2024-05-09T09:49:26.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a77a8640 1 --2- 172.21.15.157:0/1868488844 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5626ec3dcb30 0x5626ec3deff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a67a6640 1 --2- 172.21.15.157:0/1868488844 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0f70034bb0 0x7f0f70037070 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x5626ec3963f0 tx=0x7f10900a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a77a8640 1 --2- 172.21.15.157:0/1868488844 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5626ec3dcb30 0x5626ec3deff0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f10a00083f0 con 0x5626ec3dcb30 2024-05-09T09:49:26.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a948c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:26.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a948c980 20 realm 2024-05-09T09:49:26.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a948c980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3dfb50 con 0x5626ec3dcb30 2024-05-09T09:49:26.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f10a00083f0 con 0x5626ec3dcb30 2024-05-09T09:49:26.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a948c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:26.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a948c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:49:26.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a948c980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e0420 con 0x5626ec3dcb30 2024-05-09T09:49:26.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f10a00083f0 con 0x5626ec3dcb30 2024-05-09T09:49:26.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a948c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:26.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a948c980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x5626ec3dcb30 2024-05-09T09:49:26.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f10a00083f0 con 0x5626ec3dcb30 2024-05-09T09:49:26.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a948c980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:26.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a948c980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a948c980 1 --2- 172.21.15.157:0/1868488844 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5626ec3e1520 0x5626ec3e3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e3f20 con 0x5626ec3e1520 2024-05-09T09:49:26.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a6fa7640 1 --2- 172.21.15.157:0/1868488844 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5626ec3e1520 0x5626ec3e3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a6fa7640 1 --2- 172.21.15.157:0/1868488844 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5626ec3e1520 0x5626ec3e3910 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1098071030 con 0x5626ec3e1520 2024-05-09T09:49:26.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a948c980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:49:26.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a948c980 20 searching for the correct realm 2024-05-09T09:49:26.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a948c980 1 --2- 172.21.15.157:0/1868488844 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5626ec3e5e00 0x5626ec3e8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e88f0 con 0x5626ec3e5e00 2024-05-09T09:49:26.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.299+0000 7f10a67a6640 1 --2- 172.21.15.157:0/1868488844 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5626ec3e5e00 0x5626ec3e8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.303+0000 7f10a67a6640 1 --2- 172.21.15.157:0/1868488844 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5626ec3e5e00 0x5626ec3e8270 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.303+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10900c9070 con 0x5626ec3e5e00 2024-05-09T09:49:26.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.303+0000 7f10a67a6640 1 --2- 172.21.15.157:0/1868488844 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f10900da040 0x7f10900da420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.303+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e88f0 con 0x7f10900da040 2024-05-09T09:49:26.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.303+0000 7f10a77a8640 1 --2- 172.21.15.157:0/1868488844 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f10900da040 0x7f10900da420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.303+0000 7f10a77a8640 1 --2- 172.21.15.157:0/1868488844 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f10900da040 0x7f10900da420 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.303+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10a00083f0 con 0x7f10900da040 2024-05-09T09:49:26.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.303+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x5626ec3e1520 2024-05-09T09:49:26.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.303+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1098071030 con 0x5626ec3e1520 2024-05-09T09:49:26.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.303+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x5626ec3dcb30 2024-05-09T09:49:26.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.303+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10a00083f0 con 0x5626ec3dcb30 2024-05-09T09:49:26.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.303+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x5626ec3dcb30 2024-05-09T09:49:26.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.303+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10a0026040 con 0x5626ec3dcb30 2024-05-09T09:49:26.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.303+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x5626ec3e1520 2024-05-09T09:49:26.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.303+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1098071030 con 0x5626ec3e1520 2024-05-09T09:49:26.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.303+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x5626ec3e1520 2024-05-09T09:49:26.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.307+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1098071030 con 0x5626ec3e1520 2024-05-09T09:49:26.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.307+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x7f10900da040 2024-05-09T09:49:26.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.307+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10a0026040 con 0x7f10900da040 2024-05-09T09:49:26.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.307+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x5626ec3e5e00 2024-05-09T09:49:26.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.307+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10900c9070 con 0x5626ec3e5e00 2024-05-09T09:49:26.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.307+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x5626ec3dcb30 2024-05-09T09:49:26.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.307+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10a0026040 con 0x5626ec3dcb30 2024-05-09T09:49:26.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.307+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x5626ec3e1520 2024-05-09T09:49:26.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.307+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1098071030 con 0x5626ec3e1520 2024-05-09T09:49:26.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.307+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x5626ec3dcb30 2024-05-09T09:49:26.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.307+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10a0026040 con 0x5626ec3dcb30 2024-05-09T09:49:26.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.307+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x7f10900da040 2024-05-09T09:49:26.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.307+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f10a0026040 con 0x7f10900da040 2024-05-09T09:49:26.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.307+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x5626ec3e5e00 2024-05-09T09:49:26.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.307+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10900c9070 con 0x5626ec3e5e00 2024-05-09T09:49:26.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.307+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x5626ec3e5e00 2024-05-09T09:49:26.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.307+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f10900c9070 con 0x5626ec3e5e00 2024-05-09T09:49:26.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.307+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x5626ec3e1520 2024-05-09T09:49:26.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.311+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1098071030 con 0x5626ec3e1520 2024-05-09T09:49:26.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.311+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x5626ec3e5e00 2024-05-09T09:49:26.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.311+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10900c9070 con 0x5626ec3e5e00 2024-05-09T09:49:26.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.311+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x5626ec3e5e00 2024-05-09T09:49:26.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.311+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10900c9070 con 0x5626ec3e5e00 2024-05-09T09:49:26.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.311+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x5626ec3dcb30 2024-05-09T09:49:26.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.311+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10a0026040 con 0x5626ec3dcb30 2024-05-09T09:49:26.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.311+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x5626ec3dcb30 2024-05-09T09:49:26.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.311+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f10a0026040 con 0x5626ec3dcb30 2024-05-09T09:49:26.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.311+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x5626ec3e1520 2024-05-09T09:49:26.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.311+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1098071030 con 0x5626ec3e1520 2024-05-09T09:49:26.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.311+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x5626ec3e5e00 2024-05-09T09:49:26.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.311+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10900c9070 con 0x5626ec3e5e00 2024-05-09T09:49:26.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.311+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x7f10900da040 2024-05-09T09:49:26.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.311+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10a0026040 con 0x7f10900da040 2024-05-09T09:49:26.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.311+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x5626ec3dcb30 2024-05-09T09:49:26.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.311+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10a0026040 con 0x5626ec3dcb30 2024-05-09T09:49:26.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.311+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x5626ec3e1520 2024-05-09T09:49:26.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.311+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1098071030 con 0x5626ec3e1520 2024-05-09T09:49:26.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.311+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x5626ec3e5e00 2024-05-09T09:49:26.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.315+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10900c9070 con 0x5626ec3e5e00 2024-05-09T09:49:26.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.315+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x5626ec3e1520 2024-05-09T09:49:26.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.315+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1098071030 con 0x5626ec3e1520 2024-05-09T09:49:26.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.315+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x7f10900da040 2024-05-09T09:49:26.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.315+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10a0026040 con 0x7f10900da040 2024-05-09T09:49:26.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.315+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x5626ec3e5e00 2024-05-09T09:49:26.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.315+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10900c9070 con 0x5626ec3e5e00 2024-05-09T09:49:26.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.315+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x5626ec3e1520 2024-05-09T09:49:26.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.315+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1098071030 con 0x5626ec3e1520 2024-05-09T09:49:26.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.315+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x5626ec3dcb30 2024-05-09T09:49:26.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.315+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f10a0026040 con 0x5626ec3dcb30 2024-05-09T09:49:26.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.315+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e07c0 con 0x7f10900da040 2024-05-09T09:49:26.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.315+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f10a0026040 con 0x7f10900da040 2024-05-09T09:49:26.320 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.315+0000 7f10a948c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:49:26.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.315+0000 7f10a948c980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:49:26.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.315+0000 7f10a948c980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:49:26.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.315+0000 7f10a948c980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:49:26.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.315+0000 7f10a948c980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:49:26.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.315+0000 7f10a948c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:49:26.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.315+0000 7f10a948c980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.315+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e4770 con 0x5626ec3dcb30 2024-05-09T09:49:26.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.315+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f10a0026040 con 0x5626ec3dcb30 2024-05-09T09:49:26.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.315+0000 7f10a948c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:26.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.315+0000 7f10a948c980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.315+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e4770 con 0x5626ec3dcb30 2024-05-09T09:49:26.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.315+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f10a0026040 con 0x5626ec3dcb30 2024-05-09T09:49:26.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.315+0000 7f10a948c980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:26.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.315+0000 7f10a948c980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.315+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e4770 con 0x5626ec3e5e00 2024-05-09T09:49:26.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.319+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f10900c9070 con 0x5626ec3e5e00 2024-05-09T09:49:26.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.319+0000 7f10a948c980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:49:26.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.319+0000 7f10a948c980 20 zone default found 2024-05-09T09:49:26.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.319+0000 7f10a948c980 4 Realm: () 2024-05-09T09:49:26.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.319+0000 7f10a948c980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:49:26.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.319+0000 7f10a948c980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:49:26.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.319+0000 7f10a948c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:49:26.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.319+0000 7f10a948c980 20 zonegroup default 2024-05-09T09:49:26.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.319+0000 7f10a948c980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.319+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e51a0 con 0x5626ec3e1520 2024-05-09T09:49:26.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.319+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1098071030 con 0x5626ec3e1520 2024-05-09T09:49:26.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.319+0000 7f10a948c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:26.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.319+0000 7f10a948c980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.319+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3eac00 con 0x5626ec3e5e00 2024-05-09T09:49:26.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.319+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f10900c9070 con 0x5626ec3e5e00 2024-05-09T09:49:26.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.319+0000 7f10a948c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:26.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.319+0000 7f10a948c980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.319+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3eafa0 con 0x5626ec3e5e00 2024-05-09T09:49:26.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.319+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f10900c9070 con 0x5626ec3e5e00 2024-05-09T09:49:26.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.319+0000 7f10a948c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:26.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.319+0000 7f10a948c980 20 started sync module instance, tier type = 2024-05-09T09:49:26.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.319+0000 7f10a948c980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:49:26.323 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.319+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3ea040 con 0x7f10900da040 2024-05-09T09:49:26.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.319+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10a0026040 con 0x7f10900da040 2024-05-09T09:49:26.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.319+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94725172274224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3ea040 con 0x7f10900da040 2024-05-09T09:49:26.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.319+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3eb7f0 con 0x5626ec3dcb30 2024-05-09T09:49:26.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.323+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94725172274224] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10a0036040 con 0x7f10900da040 2024-05-09T09:49:26.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.323+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10a0036040 con 0x5626ec3dcb30 2024-05-09T09:49:26.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.323+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94725172278352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3ea040 con 0x5626ec3dcb30 2024-05-09T09:49:26.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.323+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3ec200 con 0x5626ec3e5e00 2024-05-09T09:49:26.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.323+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10900c9070 con 0x5626ec3e5e00 2024-05-09T09:49:26.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.323+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94725172278352] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10a0036040 con 0x5626ec3dcb30 2024-05-09T09:49:26.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.323+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94725172272016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e9fb0 con 0x5626ec3e5e00 2024-05-09T09:49:26.326 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.323+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3ecf90 con 0x7f10900da040 2024-05-09T09:49:26.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.327+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10a0036040 con 0x7f10900da040 2024-05-09T09:49:26.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.327+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94725172284064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3ed830 con 0x7f10900da040 2024-05-09T09:49:26.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.327+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3ee1f0 con 0x5626ec3dcb30 2024-05-09T09:49:26.328 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.327+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94725172272016] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10900c9070 con 0x5626ec3e5e00 2024-05-09T09:49:26.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.327+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94725172284064] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10a0036040 con 0x7f10900da040 2024-05-09T09:49:26.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.327+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10a0036040 con 0x5626ec3dcb30 2024-05-09T09:49:26.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.327+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94725172288832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3ee160 con 0x5626ec3dcb30 2024-05-09T09:49:26.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.327+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3ed780 con 0x5626ec3e1520 2024-05-09T09:49:26.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.331+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94725172288832] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10a0036040 con 0x5626ec3dcb30 2024-05-09T09:49:26.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.331+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1098071030 con 0x5626ec3e1520 2024-05-09T09:49:26.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.331+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94725172286160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3eea90 con 0x5626ec3e1520 2024-05-09T09:49:26.332 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.331+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3ef2e0 con 0x5626ec3e1520 2024-05-09T09:49:26.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.331+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94725172286160] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1098071030 con 0x5626ec3e1520 2024-05-09T09:49:26.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.331+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1098071030 con 0x5626ec3e1520 2024-05-09T09:49:26.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.331+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94725172293168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3ef700 con 0x5626ec3e1520 2024-05-09T09:49:26.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.335+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3f00c0 con 0x5626ec3e1520 2024-05-09T09:49:26.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.335+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94725172293168] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1098071030 con 0x5626ec3e1520 2024-05-09T09:49:26.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.335+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1098071030 con 0x5626ec3e1520 2024-05-09T09:49:26.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.335+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94725172294704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3f00c0 con 0x5626ec3e1520 2024-05-09T09:49:26.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.335+0000 7f10a948c980 20 add_watcher() i=0 2024-05-09T09:49:26.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.335+0000 7f10a948c980 20 add_watcher() i=1 2024-05-09T09:49:26.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.335+0000 7f10a948c980 20 add_watcher() i=2 2024-05-09T09:49:26.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.335+0000 7f10a948c980 20 add_watcher() i=3 2024-05-09T09:49:26.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.335+0000 7f10a948c980 20 add_watcher() i=4 2024-05-09T09:49:26.337 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.335+0000 7f10a948c980 20 add_watcher() i=5 2024-05-09T09:49:26.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.335+0000 7f10a948c980 20 add_watcher() i=6 2024-05-09T09:49:26.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.339+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94725172294704] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1098071030 con 0x5626ec3e1520 2024-05-09T09:49:26.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.339+0000 7f10a948c980 20 add_watcher() i=7 2024-05-09T09:49:26.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.339+0000 7f10a948c980 2 all 8 watchers are set, enabling cache 2024-05-09T09:49:26.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.339+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3f3430 con 0x5626ec3dcb30 2024-05-09T09:49:26.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.339+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f10a0036040 con 0x5626ec3dcb30 2024-05-09T09:49:26.340 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.339+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94725172309536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3f0230 con 0x5626ec3dcb30 2024-05-09T09:49:26.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.339+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94725172309536] v32'405 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f10a0036040 con 0x5626ec3dcb30 2024-05-09T09:49:26.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.339+0000 7f0f577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:26.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.339+0000 7f10a948c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:49:26.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.339+0000 7f10a948c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:49:26.342 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.339+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3f27d0 con 0x5626ec3dcb30 2024-05-09T09:49:26.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.343+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'94 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f10a0036040 con 0x5626ec3dcb30 2024-05-09T09:49:26.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.343+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fc570 con 0x5626ec3e1520 2024-05-09T09:49:26.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.343+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'89 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1098071030 con 0x5626ec3e1520 2024-05-09T09:49:26.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.343+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fc570 con 0x5626ec3e5e00 2024-05-09T09:49:26.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.347+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'88 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f10900c9070 con 0x5626ec3e5e00 2024-05-09T09:49:26.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.347+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fcf90 con 0x5626ec3dcb30 2024-05-09T09:49:26.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.347+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'406 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f10a0036040 con 0x5626ec3dcb30 2024-05-09T09:49:26.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.347+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fbb60 con 0x7f10900da040 2024-05-09T09:49:26.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.347+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'251 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f10a0036040 con 0x7f10900da040 2024-05-09T09:49:26.350 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.347+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fbb60 con 0x5626ec3e5e00 2024-05-09T09:49:26.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.351+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'168 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f10900c9070 con 0x5626ec3e5e00 2024-05-09T09:49:26.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.351+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fdcc0 con 0x5626ec3dcb30 2024-05-09T09:49:26.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.351+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'89 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f10a0036040 con 0x5626ec3dcb30 2024-05-09T09:49:26.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.351+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fbd30 con 0x5626ec3e1520 2024-05-09T09:49:26.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.355+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'167 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1098071030 con 0x5626ec3e1520 2024-05-09T09:49:26.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.355+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fbd30 con 0x7f10900da040 2024-05-09T09:49:26.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.355+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'87 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f10a0036040 con 0x7f10900da040 2024-05-09T09:49:26.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.355+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fbd30 con 0x5626ec3e5e00 2024-05-09T09:49:26.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.359+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'93 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f10900c9070 con 0x5626ec3e5e00 2024-05-09T09:49:26.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.359+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fe0a0 con 0x7f10900da040 2024-05-09T09:49:26.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.359+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'252 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f10a0036040 con 0x7f10900da040 2024-05-09T09:49:26.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.359+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fe0a0 con 0x5626ec3e1520 2024-05-09T09:49:26.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.359+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'91 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1098071030 con 0x5626ec3e1520 2024-05-09T09:49:26.362 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.363+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fe0a0 con 0x7f10900da040 2024-05-09T09:49:26.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.363+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'87 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f10a0036040 con 0x7f10900da040 2024-05-09T09:49:26.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.363+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fe0a0 con 0x5626ec3e1520 2024-05-09T09:49:26.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.363+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'173 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1098071030 con 0x5626ec3e1520 2024-05-09T09:49:26.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.363+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fe480 con 0x5626ec3dcb30 2024-05-09T09:49:26.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.367+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'407 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f10a0036040 con 0x5626ec3dcb30 2024-05-09T09:49:26.367 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.367+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fe190 con 0x5626ec3e5e00 2024-05-09T09:49:26.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.367+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'245 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f10900c9070 con 0x5626ec3e5e00 2024-05-09T09:49:26.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.367+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fe130 con 0x7f10900da040 2024-05-09T09:49:26.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.371+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'253 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f10a0036040 con 0x7f10900da040 2024-05-09T09:49:26.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.371+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fe130 con 0x5626ec3e5e00 2024-05-09T09:49:26.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.371+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'87 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f10900c9070 con 0x5626ec3e5e00 2024-05-09T09:49:26.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.371+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fe130 con 0x5626ec3dcb30 2024-05-09T09:49:26.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.375+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'95 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f10a0036040 con 0x5626ec3dcb30 2024-05-09T09:49:26.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.375+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fe160 con 0x5626ec3dcb30 2024-05-09T09:49:26.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.375+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'408 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f10a0036040 con 0x5626ec3dcb30 2024-05-09T09:49:26.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.375+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fe5c0 con 0x5626ec3e5e00 2024-05-09T09:49:26.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.379+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'246 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f10900c9070 con 0x5626ec3e5e00 2024-05-09T09:49:26.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.379+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fe4b0 con 0x7f10900da040 2024-05-09T09:49:26.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.379+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'99 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f10a0036040 con 0x7f10900da040 2024-05-09T09:49:26.380 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.379+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fe4b0 con 0x5626ec3e5e00 2024-05-09T09:49:26.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.379+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'89 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f10900c9070 con 0x5626ec3e5e00 2024-05-09T09:49:26.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.379+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fe4b0 con 0x5626ec3e5e00 2024-05-09T09:49:26.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.383+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'93 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f10900c9070 con 0x5626ec3e5e00 2024-05-09T09:49:26.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.383+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fe4b0 con 0x5626ec3e5e00 2024-05-09T09:49:26.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.383+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'84 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f10900c9070 con 0x5626ec3e5e00 2024-05-09T09:49:26.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.383+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fe540 con 0x5626ec3e5e00 2024-05-09T09:49:26.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.383+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'169 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f10900c9070 con 0x5626ec3e5e00 2024-05-09T09:49:26.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.387+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fe540 con 0x5626ec3e1520 2024-05-09T09:49:26.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.387+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'89 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1098071030 con 0x5626ec3e1520 2024-05-09T09:49:26.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.387+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fe540 con 0x5626ec3e5e00 2024-05-09T09:49:26.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.387+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'88 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f10900c9070 con 0x5626ec3e5e00 2024-05-09T09:49:26.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.387+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fe540 con 0x5626ec3e1520 2024-05-09T09:49:26.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.391+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'168 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1098071030 con 0x5626ec3e1520 2024-05-09T09:49:26.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.391+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fe540 con 0x5626ec3e5e00 2024-05-09T09:49:26.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.395+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'247 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f10900c9070 con 0x5626ec3e5e00 2024-05-09T09:49:26.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.395+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fe540 con 0x5626ec3e1520 2024-05-09T09:49:26.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.395+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'174 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1098071030 con 0x5626ec3e1520 2024-05-09T09:49:26.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.395+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3fe540 con 0x7f10900da040 2024-05-09T09:49:26.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.399+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'93 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f10a0036040 con 0x7f10900da040 2024-05-09T09:49:26.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.399+0000 7f0f567fc640 20 reqs_thread_entry: start 2024-05-09T09:49:26.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.399+0000 7f10a948c980 20 init_complete bucket index max shards: 11 2024-05-09T09:49:26.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.399+0000 7f0ec7fff640 20 reqs_thread_entry: start 2024-05-09T09:49:26.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.399+0000 7f10a948c980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-09T09:49:26.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.399+0000 7f10a948c980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.399+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5626ec41a040 con 0x5626ec3dcb30 2024-05-09T09:49:26.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.399+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f10a0036040 con 0x5626ec3dcb30 2024-05-09T09:49:26.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.399+0000 7f10a948c980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:49:26.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.399+0000 7f10a948c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-09T09:49:26.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.399+0000 7f10a948c980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:49:26.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.399+0000 7f10a948c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:49:26.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.399+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:95 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec41c2e0 con 0x5626ec3e1520 2024-05-09T09:49:26.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.403+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(95 usage.10 [call] v32'92 uv92 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1098071030 con 0x5626ec3e1520 2024-05-09T09:49:26.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.403+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:96 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec41c2a0 con 0x5626ec3e1520 2024-05-09T09:49:26.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.407+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(96 usage.10 [call] v32'93 uv92 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7f1098071030 con 0x5626ec3e1520 2024-05-09T09:49:26.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.407+0000 7f0f577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:26.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.407+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94725172309536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3f3d30 con 0x5626ec3dcb30 2024-05-09T09:49:26.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.407+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(97 data_loggenerations_metadata [watch unwatch cookie 94725172309536] v32'409 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f10a0036040 con 0x5626ec3dcb30 2024-05-09T09:49:26.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.407+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:98 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94725172274224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3f2e20 con 0x7f10900da040 2024-05-09T09:49:26.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.411+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(98 notify.0 [watch unwatch cookie 94725172274224] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10a0036040 con 0x7f10900da040 2024-05-09T09:49:26.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.411+0000 7f10a948c980 20 remove_watcher() i=0 2024-05-09T09:49:26.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.411+0000 7f10a948c980 2 removed watcher, disabling cache 2024-05-09T09:49:26.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.411+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:99 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94725172278352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3ea430 con 0x5626ec3dcb30 2024-05-09T09:49:26.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.411+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(99 notify.1 [watch unwatch cookie 94725172278352] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10a0036040 con 0x5626ec3dcb30 2024-05-09T09:49:26.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.411+0000 7f10a948c980 20 remove_watcher() i=1 2024-05-09T09:49:26.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.411+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:100 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94725172272016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3eb450 con 0x5626ec3e5e00 2024-05-09T09:49:26.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.415+0000 7f10a67a6640 1 -- 172.21.15.157:0/1868488844 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(100 notify.2 [watch unwatch cookie 94725172272016] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10900c9070 con 0x5626ec3e5e00 2024-05-09T09:49:26.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.415+0000 7f10a948c980 20 remove_watcher() i=2 2024-05-09T09:49:26.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.415+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:101 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94725172284064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e9b90 con 0x7f10900da040 2024-05-09T09:49:26.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.415+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(101 notify.3 [watch unwatch cookie 94725172284064] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10a0036040 con 0x7f10900da040 2024-05-09T09:49:26.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.415+0000 7f10a948c980 20 remove_watcher() i=3 2024-05-09T09:49:26.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.415+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94725172288832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e9b90 con 0x5626ec3dcb30 2024-05-09T09:49:26.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.419+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(102 notify.4 [watch unwatch cookie 94725172288832] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f10a0036040 con 0x5626ec3dcb30 2024-05-09T09:49:26.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.419+0000 7f10a948c980 20 remove_watcher() i=4 2024-05-09T09:49:26.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.419+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94725172286160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e9b90 con 0x5626ec3e1520 2024-05-09T09:49:26.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.419+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(103 notify.5 [watch unwatch cookie 94725172286160] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1098071030 con 0x5626ec3e1520 2024-05-09T09:49:26.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.419+0000 7f10a948c980 20 remove_watcher() i=5 2024-05-09T09:49:26.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.419+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94725172293168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3ed2d0 con 0x5626ec3e1520 2024-05-09T09:49:26.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.423+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(104 notify.6 [watch unwatch cookie 94725172293168] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1098071030 con 0x5626ec3e1520 2024-05-09T09:49:26.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.423+0000 7f10a948c980 20 remove_watcher() i=6 2024-05-09T09:49:26.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.423+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:105 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94725172294704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5626ec3e9b90 con 0x5626ec3e1520 2024-05-09T09:49:26.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a6fa7640 1 -- 172.21.15.157:0/1868488844 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(105 notify.7 [watch unwatch cookie 94725172294704] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1098071030 con 0x5626ec3e1520 2024-05-09T09:49:26.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 20 remove_watcher() i=7 2024-05-09T09:49:26.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5626ec3e1520 msgr2=0x5626ec3e3910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 --2- 172.21.15.157:0/1868488844 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5626ec3e1520 0x5626ec3e3910 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5626ec3dcb30 msgr2=0x5626ec3deff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 --2- 172.21.15.157:0/1868488844 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5626ec3dcb30 0x5626ec3deff0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f10900da040 msgr2=0x7f10900da420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 --2- 172.21.15.157:0/1868488844 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f10900da040 0x7f10900da420 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5626ec3e5e00 msgr2=0x5626ec3e8270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 --2- 172.21.15.157:0/1868488844 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5626ec3e5e00 0x5626ec3e8270 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0f70034bb0 msgr2=0x7f0f70037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 --2- 172.21.15.157:0/1868488844 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0f70034bb0 0x7f0f70037070 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x5626ec3963f0 tx=0x7f10900a7000 comp rx=0 tx=0).stop 2024-05-09T09:49:26.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a77a8640 1 -- 172.21.15.157:0/1868488844 reap_dead start 2024-05-09T09:49:26.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec3c8c10 msgr2=0x5626ec3d0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 --2- 172.21.15.157:0/1868488844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec3c8c10 0x5626ec3d0070 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f109801bfd0 tx=0x7f109800b020 comp rx=0 tx=0).stop 2024-05-09T09:49:26.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 shutdown_connections 2024-05-09T09:49:26.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 --2- 172.21.15.157:0/1868488844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec3c8c10 0x5626ec3d0070 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 >> 172.21.15.157:0/1868488844 conn(0x5626ec3c4fe0 msgr2=0x5626ec3c2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:26.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 shutdown_connections 2024-05-09T09:49:26.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 -- 172.21.15.157:0/1868488844 wait complete. 2024-05-09T09:49:26.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 -- 172.21.15.157:0/3959972430 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0f80034bb0 msgr2=0x7f0f80037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 --2- 172.21.15.157:0/3959972430 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0f80034bb0 0x7f0f80037070 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x5626ec38a480 tx=0x7f1090005d90 comp rx=0 tx=0).stop 2024-05-09T09:49:26.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 -- 172.21.15.157:0/3959972430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec3bbe80 msgr2=0x5626ec3bc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 --2- 172.21.15.157:0/3959972430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec3bbe80 0x5626ec3bc2a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f1098048bc0 tx=0x7f109800db30 comp rx=0 tx=0).stop 2024-05-09T09:49:26.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 -- 172.21.15.157:0/3959972430 shutdown_connections 2024-05-09T09:49:26.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 --2- 172.21.15.157:0/3959972430 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0f80034bb0 0x7f0f80037070 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 --2- 172.21.15.157:0/3959972430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec3bbe80 0x5626ec3bc2a0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 -- 172.21.15.157:0/3959972430 >> 172.21.15.157:0/3959972430 conn(0x5626ec3b0c50 msgr2=0x5626ec3b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:26.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 -- 172.21.15.157:0/3959972430 shutdown_connections 2024-05-09T09:49:26.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 -- 172.21.15.157:0/3959972430 wait complete. 2024-05-09T09:49:26.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 -- 172.21.15.157:0/3285833418 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5626ec38f460 msgr2=0x5626ec3918f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 --2- 172.21.15.157:0/3285833418 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5626ec38f460 0x5626ec3918f0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 -- 172.21.15.157:0/3285833418 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5626ec298030 msgr2=0x5626ec38cbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 --2- 172.21.15.157:0/3285833418 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5626ec298030 0x5626ec38cbe0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 -- 172.21.15.157:0/3285833418 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5626ec3934e0 msgr2=0x5626ec3958d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 --2- 172.21.15.157:0/3285833418 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5626ec3934e0 0x5626ec3958d0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 -- 172.21.15.157:0/3285833418 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0f8c034c00 msgr2=0x7f0f8c0370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 --2- 172.21.15.157:0/3285833418 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0f8c034c00 0x7f0f8c0370c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f10900ac000 tx=0x7f10900a5000 comp rx=0 tx=0).stop 2024-05-09T09:49:26.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 -- 172.21.15.157:0/3285833418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec293b30 msgr2=0x5626ec385ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 --2- 172.21.15.157:0/3285833418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5626ec293b30 0x5626ec385ca0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f1098004180 tx=0x7f1098000bd0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a77a8640 1 -- 172.21.15.157:0/3285833418 reap_dead start 2024-05-09T09:49:26.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 -- 172.21.15.157:0/3285833418 shutdown_connections 2024-05-09T09:49:26.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 -- 172.21.15.157:0/3285833418 >> 172.21.15.157:0/3285833418 conn(0x5626ec207250 msgr2=0x5626ec3791a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:26.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 -- 172.21.15.157:0/3285833418 shutdown_connections 2024-05-09T09:49:26.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.427+0000 7f10a948c980 1 -- 172.21.15.157:0/3285833418 wait complete. 2024-05-09T09:49:26.441 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-05-09T09:49:26.441 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-05-09T09:49:26.441 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-05-09T09:49:26.519 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:49:26.519 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:49:26.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.519+0000 7fbcc2ab3980 1 Processor -- start 2024-05-09T09:49:26.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.519+0000 7fbcc2ab3980 1 -- start start 2024-05-09T09:49:26.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.519+0000 7fbcc2ab3980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55e0d0989090 0x55e0d0a1c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.519+0000 7fbcc2ab3980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e0d08c9440 con 0x55e0d098a380 2024-05-09T09:49:26.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.519+0000 7fbcc2ab3980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55e0d08b45f0 con 0x55e0d0989090 2024-05-09T09:49:26.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.519+0000 7fbcbfdcd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55e0d0989090 0x55e0d0a1c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.519+0000 7fbcc05ce640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x55e0d098a380 0x55e0d0988980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:45500/0 (socket says 172.21.15.157:45500) 2024-05-09T09:49:26.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.519+0000 7fbcc05ce640 1 -- 172.21.15.157:0/2517678180 learned_addr learned my addr 172.21.15.157:0/2517678180 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:49:26.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.519+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/2517678180 >> v1:172.21.15.110:6789/0 conn(0x55e0d098a380 legacy=0x55e0d0988980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.519+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/2517678180 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0d08bf990 con 0x55e0d0989090 2024-05-09T09:49:26.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.523+0000 7fbcbfdcd640 1 --2- 172.21.15.157:0/2517678180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0989090 0x55e0d0a1c990 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400a480 tx=0x7fbcb401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a8c54a07c1346 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.523+0000 7fbcbf5cc640 1 -- 172.21.15.157:0/2517678180 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb40b0070 con 0x55e0d0989090 2024-05-09T09:49:26.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.523+0000 7fbcbf5cc640 1 -- 172.21.15.157:0/2517678180 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb40ab540 con 0x55e0d0989090 2024-05-09T09:49:26.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.523+0000 7fbcbf5cc640 1 -- 172.21.15.157:0/2517678180 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb40ab840 con 0x55e0d0989090 2024-05-09T09:49:26.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.523+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2517678180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0989090 msgr2=0x55e0d0a1c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.523+0000 7fbcc2ab3980 1 --2- 172.21.15.157:0/2517678180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0989090 0x55e0d0a1c990 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400a480 tx=0x7fbcb401b280 comp rx=0 tx=0).stop 2024-05-09T09:49:26.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.523+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2517678180 shutdown_connections 2024-05-09T09:49:26.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.523+0000 7fbcc2ab3980 1 --2- 172.21.15.157:0/2517678180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0989090 0x55e0d0a1c990 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.523+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2517678180 >> 172.21.15.157:0/2517678180 conn(0x55e0d0a0f250 msgr2=0x55e0d0a11670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:26.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.523+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2517678180 shutdown_connections 2024-05-09T09:49:26.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.523+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2517678180 wait complete. 2024-05-09T09:49:26.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.539+0000 7fbcc2ab3980 1 Processor -- start 2024-05-09T09:49:26.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.539+0000 7fbcc2ab3980 1 -- start start 2024-05-09T09:49:26.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.539+0000 7fbcc2ab3980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0989090 0x55e0d0b01250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.539+0000 7fbcc2ab3980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55e0d0916fe0 con 0x55e0d0989090 2024-05-09T09:49:26.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.539+0000 7fbcc05ce640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0989090 0x55e0d0b01250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.539+0000 7fbcc05ce640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0989090 0x55e0d0b01250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38594/0 (socket says 172.21.15.157:38594) 2024-05-09T09:49:26.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.539+0000 7fbcc05ce640 1 -- 172.21.15.157:0/2347344810 learned_addr learned my addr 172.21.15.157:0/2347344810 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:26.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.543+0000 7fbcc05ce640 1 -- 172.21.15.157:0/2347344810 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0d089bae0 con 0x55e0d0989090 2024-05-09T09:49:26.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.543+0000 7fbcc05ce640 1 --2- 172.21.15.157:0/2347344810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0989090 0x55e0d0b01250 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0001e20 tx=0x7fbcb000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8cda52d26fad268 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.543+0000 7fbbae60c640 1 -- 172.21.15.157:0/2347344810 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb0012020 con 0x55e0d0989090 2024-05-09T09:49:26.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.543+0000 7fbbae60c640 1 -- 172.21.15.157:0/2347344810 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb000e7c0 con 0x55e0d0989090 2024-05-09T09:49:26.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.543+0000 7fbbae60c640 1 -- 172.21.15.157:0/2347344810 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb000eb00 con 0x55e0d0989090 2024-05-09T09:49:26.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.543+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2347344810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0989090 msgr2=0x55e0d0b01250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.543+0000 7fbcc2ab3980 1 --2- 172.21.15.157:0/2347344810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0989090 0x55e0d0b01250 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0001e20 tx=0x7fbcb000b790 comp rx=0 tx=0).stop 2024-05-09T09:49:26.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.543+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2347344810 shutdown_connections 2024-05-09T09:49:26.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.543+0000 7fbcc2ab3980 1 --2- 172.21.15.157:0/2347344810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0989090 0x55e0d0b01250 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.543+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2347344810 >> 172.21.15.157:0/2347344810 conn(0x55e0d0a0f250 msgr2=0x55e0d0afcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:26.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.543+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2347344810 shutdown_connections 2024-05-09T09:49:26.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.543+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2347344810 wait complete. 2024-05-09T09:49:26.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.543+0000 7fbcc2ab3980 1 Processor -- start 2024-05-09T09:49:26.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.543+0000 7fbcc2ab3980 1 -- start start 2024-05-09T09:49:26.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.543+0000 7fbcc2ab3980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0989090 0x55e0d0b084d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.543+0000 7fbcc2ab3980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55e0d0a1f990 con 0x55e0d0989090 2024-05-09T09:49:26.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.543+0000 7fbcc05ce640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0989090 0x55e0d0b084d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.543+0000 7fbcc05ce640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0989090 0x55e0d0b084d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38610/0 (socket says 172.21.15.157:38610) 2024-05-09T09:49:26.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.543+0000 7fbcc05ce640 1 -- 172.21.15.157:0/2568547406 learned_addr learned my addr 172.21.15.157:0/2568547406 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:26.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.543+0000 7fbcc05ce640 1 -- 172.21.15.157:0/2568547406 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0d0b08a10 con 0x55e0d0989090 2024-05-09T09:49:26.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.543+0000 7fbcc05ce640 1 --2- 172.21.15.157:0/2568547406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0989090 0x55e0d0b084d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0001e20 tx=0x7fbcb0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.543+0000 7fbbace09640 1 -- 172.21.15.157:0/2568547406 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb0012030 con 0x55e0d0989090 2024-05-09T09:49:26.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.547+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2568547406 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e0d0b08ca0 con 0x55e0d0989090 2024-05-09T09:49:26.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.547+0000 7fbbace09640 1 -- 172.21.15.157:0/2568547406 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb0001480 con 0x55e0d0989090 2024-05-09T09:49:26.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.547+0000 7fbbace09640 1 -- 172.21.15.157:0/2568547406 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb001a940 con 0x55e0d0989090 2024-05-09T09:49:26.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.547+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2568547406 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0d0b0b930 con 0x55e0d0989090 2024-05-09T09:49:26.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.547+0000 7fbbace09640 1 -- 172.21.15.157:0/2568547406 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fbcb0015020 con 0x55e0d0989090 2024-05-09T09:49:26.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.547+0000 7fbbace09640 1 --2- 172.21.15.157:0/2568547406 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbba8034bb0 0x7fbba8037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.547+0000 7fbbace09640 1 -- 172.21.15.157:0/2568547406 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fbcb0020030 con 0x55e0d0989090 2024-05-09T09:49:26.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.547+0000 7fbcbfdcd640 1 --2- 172.21.15.157:0/2568547406 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbba8034bb0 0x7fbba8037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.547+0000 7fbcc2ab3980 1 --2- 172.21.15.157:0/2568547406 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e0d098a380 0x55e0d0b0f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.547+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2568547406 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b0fac0 con 0x55e0d098a380 2024-05-09T09:49:26.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.547+0000 7fbcc0dcf640 1 --2- 172.21.15.157:0/2568547406 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e0d098a380 0x55e0d0b0f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.547+0000 7fbcbfdcd640 1 --2- 172.21.15.157:0/2568547406 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbba8034bb0 0x7fbba8037070 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbcb40ad000 tx=0x7fbcb40a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.547+0000 7fbcc0dcf640 1 --2- 172.21.15.157:0/2568547406 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e0d098a380 0x55e0d0b0f450 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.547+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/2568547406 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d098a380 2024-05-09T09:49:26.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.547+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2568547406 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b0cb30 con 0x55e0d098a380 2024-05-09T09:49:26.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.547+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/2568547406 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d098a380 2024-05-09T09:49:26.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.547+0000 7fbcc2ab3980 1 --2- 172.21.15.157:0/2568547406 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e0d0b11df0 0x55e0d0b141e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.547+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2568547406 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b148b0 con 0x55e0d0b11df0 2024-05-09T09:49:26.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.547+0000 7fbcc05ce640 1 --2- 172.21.15.157:0/2568547406 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e0d0b11df0 0x55e0d0b141e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.551+0000 7fbcc05ce640 1 --2- 172.21.15.157:0/2568547406 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e0d0b11df0 0x55e0d0b141e0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.551+0000 7fbcc05ce640 1 -- 172.21.15.157:0/2568547406 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbcb0008030 con 0x55e0d0b11df0 2024-05-09T09:49:26.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.551+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2568547406 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b10c90 con 0x55e0d098a380 2024-05-09T09:49:26.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.551+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/2568547406 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d098a380 2024-05-09T09:49:26.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.551+0000 7fbcc2ab3980 1 --2- 172.21.15.157:0/2568547406 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e0d0b15d10 0x55e0d0b18100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.551+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2568547406 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b18800 con 0x55e0d0b15d10 2024-05-09T09:49:26.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.551+0000 7fbcbfdcd640 1 --2- 172.21.15.157:0/2568547406 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e0d0b15d10 0x55e0d0b18100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.551+0000 7fbcbfdcd640 1 --2- 172.21.15.157:0/2568547406 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e0d0b15d10 0x55e0d0b18100 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.551+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/2568547406 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbcb40b3040 con 0x55e0d0b15d10 2024-05-09T09:49:26.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.555+0000 7fbcc2ab3980 1 Processor -- start 2024-05-09T09:49:26.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.555+0000 7fbcc2ab3980 1 -- start start 2024-05-09T09:49:26.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.555+0000 7fbcc2ab3980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0b3e650 0x55e0d0b3ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.555+0000 7fbcc2ab3980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55e0d091b020 con 0x55e0d0b3e650 2024-05-09T09:49:26.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.555+0000 7fbcc05ce640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0b3e650 0x55e0d0b3ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.555+0000 7fbcc05ce640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0b3e650 0x55e0d0b3ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38618/0 (socket says 172.21.15.157:38618) 2024-05-09T09:49:26.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.555+0000 7fbcc05ce640 1 -- 172.21.15.157:0/2087758430 learned_addr learned my addr 172.21.15.157:0/2087758430 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:26.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.555+0000 7fbcc05ce640 1 -- 172.21.15.157:0/2087758430 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0d0b3efb0 con 0x55e0d0b3e650 2024-05-09T09:49:26.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.559+0000 7fbcc05ce640 1 --2- 172.21.15.157:0/2087758430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0b3e650 0x55e0d0b3ea70 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0048c30 tx=0x7fbcb000db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.559+0000 7fbba4b9e640 1 -- 172.21.15.157:0/2087758430 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb0042390 con 0x55e0d0b3e650 2024-05-09T09:49:26.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.559+0000 7fbba4b9e640 1 -- 172.21.15.157:0/2087758430 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb0042530 con 0x55e0d0b3e650 2024-05-09T09:49:26.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.559+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2087758430 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e0d0b3fa40 con 0x55e0d0b3e650 2024-05-09T09:49:26.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.559+0000 7fbba4b9e640 1 -- 172.21.15.157:0/2087758430 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb004a0c0 con 0x55e0d0b3e650 2024-05-09T09:49:26.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.559+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2087758430 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0d0b3fa40 con 0x55e0d0b3e650 2024-05-09T09:49:26.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.559+0000 7fbba4b9e640 1 -- 172.21.15.157:0/2087758430 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fbcb0048d10 con 0x55e0d0b3e650 2024-05-09T09:49:26.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.559+0000 7fbba4b9e640 1 --2- 172.21.15.157:0/2087758430 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb98034bb0 0x7fbb98037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.559+0000 7fbba4b9e640 1 -- 172.21.15.157:0/2087758430 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fbcb0005050 con 0x55e0d0b3e650 2024-05-09T09:49:26.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.559+0000 7fbcbfdcd640 1 --2- 172.21.15.157:0/2087758430 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb98034bb0 0x7fbb98037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.559+0000 7fbcc2ab3980 1 Processor -- start 2024-05-09T09:49:26.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.559+0000 7fbcc2ab3980 1 -- start start 2024-05-09T09:49:26.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.559+0000 7fbcbfdcd640 1 --2- 172.21.15.157:0/2087758430 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb98034bb0 0x7fbb98037070 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbcb40ae040 tx=0x7fbcb4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.559+0000 7fbcc2ab3980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0b4b460 0x55e0d0b4b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.559+0000 7fbcc2ab3980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55e0d0b019a0 con 0x55e0d0b4b460 2024-05-09T09:49:26.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.559+0000 7fbcc05ce640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0b4b460 0x55e0d0b4b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.559+0000 7fbcc05ce640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0b4b460 0x55e0d0b4b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38628/0 (socket says 172.21.15.157:38628) 2024-05-09T09:49:26.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.559+0000 7fbcc05ce640 1 -- 172.21.15.157:0/3552659693 learned_addr learned my addr 172.21.15.157:0/3552659693 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:26.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.559+0000 7fbcc05ce640 1 -- 172.21.15.157:0/3552659693 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0d0b4be50 con 0x55e0d0b4b460 2024-05-09T09:49:26.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.559+0000 7fbcc05ce640 1 --2- 172.21.15.157:0/3552659693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0b4b460 0x55e0d0b4b880 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0048b30 tx=0x7fbcb0038b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f22c651ab8b666c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.559+0000 7fbb9e7fc640 1 -- 172.21.15.157:0/3552659693 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb005c070 con 0x55e0d0b4b460 2024-05-09T09:49:26.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.559+0000 7fbb9e7fc640 1 -- 172.21.15.157:0/3552659693 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb0047830 con 0x55e0d0b4b460 2024-05-09T09:49:26.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.559+0000 7fbb9e7fc640 1 -- 172.21.15.157:0/3552659693 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb004a3f0 con 0x55e0d0b4b460 2024-05-09T09:49:26.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.563+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/3552659693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0b4b460 msgr2=0x55e0d0b4b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.563+0000 7fbcc2ab3980 1 --2- 172.21.15.157:0/3552659693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0b4b460 0x55e0d0b4b880 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0048b30 tx=0x7fbcb0038b30 comp rx=0 tx=0).stop 2024-05-09T09:49:26.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.563+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/3552659693 shutdown_connections 2024-05-09T09:49:26.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.563+0000 7fbcc2ab3980 1 --2- 172.21.15.157:0/3552659693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0b4b460 0x55e0d0b4b880 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.563+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/3552659693 >> 172.21.15.157:0/3552659693 conn(0x55e0d0b477e0 msgr2=0x55e0d0b45840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:26.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.563+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/3552659693 shutdown_connections 2024-05-09T09:49:26.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.563+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/3552659693 wait complete. 2024-05-09T09:49:26.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.563+0000 7fbcc2ab3980 1 Processor -- start 2024-05-09T09:49:26.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.563+0000 7fbcc2ab3980 1 -- start start 2024-05-09T09:49:26.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.563+0000 7fbcc2ab3980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0b4b460 0x55e0d0b526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.563+0000 7fbcc2ab3980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55e0d0b4c3d0 con 0x55e0d0b4b460 2024-05-09T09:49:26.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.563+0000 7fbcc05ce640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0b4b460 0x55e0d0b526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.563+0000 7fbcc05ce640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0b4b460 0x55e0d0b526f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38634/0 (socket says 172.21.15.157:38634) 2024-05-09T09:49:26.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.563+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 learned_addr learned my addr 172.21.15.157:0/1384038180 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:26.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.563+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0d0b52c30 con 0x55e0d0b4b460 2024-05-09T09:49:26.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.563+0000 7fbcc05ce640 1 --2- 172.21.15.157:0/1384038180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0b4b460 0x55e0d0b526f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0048b30 tx=0x7fbcb003ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.563+0000 7fbb9cff9640 1 -- 172.21.15.157:0/1384038180 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb0070070 con 0x55e0d0b4b460 2024-05-09T09:49:26.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.563+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e0d0b52c30 con 0x55e0d0b4b460 2024-05-09T09:49:26.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.563+0000 7fbb9cff9640 1 -- 172.21.15.157:0/1384038180 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb004abb0 con 0x55e0d0b4b460 2024-05-09T09:49:26.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.563+0000 7fbb9cff9640 1 -- 172.21.15.157:0/1384038180 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb005c050 con 0x55e0d0b4b460 2024-05-09T09:49:26.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.563+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0d0b52c30 con 0x55e0d0b4b460 2024-05-09T09:49:26.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.563+0000 7fbb9cff9640 1 -- 172.21.15.157:0/1384038180 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fbcb0073070 con 0x55e0d0b4b460 2024-05-09T09:49:26.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.563+0000 7fbcc2ab3980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbb9cff9640 1 --2- 172.21.15.157:0/1384038180 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb88034bb0 0x7fbb88037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbb9cff9640 1 -- 172.21.15.157:0/1384038180 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fbcb0067030 con 0x55e0d0b4b460 2024-05-09T09:49:26.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcbfdcd640 1 --2- 172.21.15.157:0/1384038180 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb88034bb0 0x7fbb88037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc2ab3980 1 --2- 172.21.15.157:0/1384038180 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e0d0b5f1b0 0x55e0d0b61640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b61d90 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc0dcf640 1 --2- 172.21.15.157:0/1384038180 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e0d0b5f1b0 0x55e0d0b61640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcbfdcd640 1 --2- 172.21.15.157:0/1384038180 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb88034bb0 0x7fbb88037070 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4000c10 tx=0x7fbcb40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc0dcf640 1 --2- 172.21.15.157:0/1384038180 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e0d0b5f1b0 0x55e0d0b61640 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc2ab3980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:26.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc2ab3980 20 realm 2024-05-09T09:49:26.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc2ab3980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b621a0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc2ab3980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:26.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc2ab3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:49:26.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc2ab3980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b62a40 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc2ab3980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:26.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc2ab3980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b62de0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc2ab3980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:26.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc2ab3980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc2ab3980 1 --2- 172.21.15.157:0/1384038180 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e0d0b63b40 0x55e0d0b65f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b664b0 con 0x55e0d0b63b40 2024-05-09T09:49:26.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc05ce640 1 --2- 172.21.15.157:0/1384038180 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e0d0b63b40 0x55e0d0b65f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc05ce640 1 --2- 172.21.15.157:0/1384038180 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e0d0b63b40 0x55e0d0b65f30 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbcb0072030 con 0x55e0d0b63b40 2024-05-09T09:49:26.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc2ab3980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:49:26.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc2ab3980 20 searching for the correct realm 2024-05-09T09:49:26.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc2ab3980 1 --2- 172.21.15.157:0/1384038180 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e0d0b683e0 0x55e0d0b6a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.567+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b6af70 con 0x55e0d0b683e0 2024-05-09T09:49:26.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.571+0000 7fbcbfdcd640 1 --2- 172.21.15.157:0/1384038180 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e0d0b683e0 0x55e0d0b6a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.571+0000 7fbcbfdcd640 1 --2- 172.21.15.157:0/1384038180 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e0d0b683e0 0x55e0d0b6a8a0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.571+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb40d9070 con 0x55e0d0b683e0 2024-05-09T09:49:26.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.571+0000 7fbcbfdcd640 1 --2- 172.21.15.157:0/1384038180 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fbcb40ce040 0x7fbcb40db410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.571+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b6af70 con 0x7fbcb40ce040 2024-05-09T09:49:26.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.571+0000 7fbcc0dcf640 1 --2- 172.21.15.157:0/1384038180 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fbcb40ce040 0x7fbcb40db410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.571+0000 7fbcc0dcf640 1 --2- 172.21.15.157:0/1384038180 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fbcb40ce040 0x7fbcb40db410 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.571+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb800a4d0 con 0x7fbcb40ce040 2024-05-09T09:49:26.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.571+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b62de0 con 0x55e0d0b63b40 2024-05-09T09:49:26.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.571+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb0072030 con 0x55e0d0b63b40 2024-05-09T09:49:26.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.571+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b62de0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.571+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.571+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b62de0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.571+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.571+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b62de0 con 0x55e0d0b63b40 2024-05-09T09:49:26.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.571+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb0072030 con 0x55e0d0b63b40 2024-05-09T09:49:26.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.571+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b62de0 con 0x55e0d0b63b40 2024-05-09T09:49:26.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.575+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb0072030 con 0x55e0d0b63b40 2024-05-09T09:49:26.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.575+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b62de0 con 0x7fbcb40ce040 2024-05-09T09:49:26.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.575+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb800a4d0 con 0x7fbcb40ce040 2024-05-09T09:49:26.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.575+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b62de0 con 0x55e0d0b683e0 2024-05-09T09:49:26.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.575+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb40d9070 con 0x55e0d0b683e0 2024-05-09T09:49:26.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.575+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b62de0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.575+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.575+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b62de0 con 0x55e0d0b63b40 2024-05-09T09:49:26.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.575+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb0072030 con 0x55e0d0b63b40 2024-05-09T09:49:26.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.575+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b62de0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.575+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.575+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b62de0 con 0x7fbcb40ce040 2024-05-09T09:49:26.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.575+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbcb800a4d0 con 0x7fbcb40ce040 2024-05-09T09:49:26.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.575+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b62de0 con 0x55e0d0b683e0 2024-05-09T09:49:26.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.575+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb40d9070 con 0x55e0d0b683e0 2024-05-09T09:49:26.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.575+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbcb40e8040 con 0x55e0d0b683e0 2024-05-09T09:49:26.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.575+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbcb40d9070 con 0x55e0d0b683e0 2024-05-09T09:49:26.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.575+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbcb40e8040 con 0x55e0d0b63b40 2024-05-09T09:49:26.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.579+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb0072030 con 0x55e0d0b63b40 2024-05-09T09:49:26.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.579+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbcb40e8040 con 0x55e0d0b683e0 2024-05-09T09:49:26.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.579+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb40d9070 con 0x55e0d0b683e0 2024-05-09T09:49:26.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.579+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbcb40e8040 con 0x55e0d0b683e0 2024-05-09T09:49:26.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.579+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb40d9070 con 0x55e0d0b683e0 2024-05-09T09:49:26.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.579+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbcb40e8040 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.579+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.579+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbcb40e8040 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.579+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.579+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbcb40e8040 con 0x55e0d0b63b40 2024-05-09T09:49:26.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.579+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb0072030 con 0x55e0d0b63b40 2024-05-09T09:49:26.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.579+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbcb40e8040 con 0x55e0d0b683e0 2024-05-09T09:49:26.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.579+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb40d9070 con 0x55e0d0b683e0 2024-05-09T09:49:26.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.579+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbcb40e8040 con 0x7fbcb40ce040 2024-05-09T09:49:26.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.579+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb800a4d0 con 0x7fbcb40ce040 2024-05-09T09:49:26.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.579+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbcb40e8040 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.579+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.579+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbcb40e8040 con 0x55e0d0b63b40 2024-05-09T09:49:26.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.579+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbcb0072030 con 0x55e0d0b63b40 2024-05-09T09:49:26.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.579+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbcb40e8040 con 0x55e0d0b683e0 2024-05-09T09:49:26.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.583+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb40d9070 con 0x55e0d0b683e0 2024-05-09T09:49:26.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.583+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbcb40e8040 con 0x55e0d0b63b40 2024-05-09T09:49:26.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.583+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb0072030 con 0x55e0d0b63b40 2024-05-09T09:49:26.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.583+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbcb40e8040 con 0x7fbcb40ce040 2024-05-09T09:49:26.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.583+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb800a4d0 con 0x7fbcb40ce040 2024-05-09T09:49:26.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.583+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbcb40e8040 con 0x55e0d0b683e0 2024-05-09T09:49:26.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.583+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb40d9070 con 0x55e0d0b683e0 2024-05-09T09:49:26.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.583+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbcb40e8040 con 0x55e0d0b63b40 2024-05-09T09:49:26.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.583+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb0072030 con 0x55e0d0b63b40 2024-05-09T09:49:26.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.583+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbcb40e8040 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.583+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.583+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbcb40e8040 con 0x7fbcb40ce040 2024-05-09T09:49:26.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.583+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcb800a4d0 con 0x7fbcb40ce040 2024-05-09T09:49:26.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.583+0000 7fbcc2ab3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:49:26.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.583+0000 7fbcc2ab3980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:49:26.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.583+0000 7fbcc2ab3980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:49:26.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.583+0000 7fbcc2ab3980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:49:26.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.583+0000 7fbcc2ab3980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:49:26.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.583+0000 7fbcc2ab3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:49:26.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.583+0000 7fbcc2ab3980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.583+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b66d00 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.583+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.583+0000 7fbcc2ab3980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:26.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.583+0000 7fbcc2ab3980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.583+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b66d00 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.583+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.583+0000 7fbcc2ab3980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:26.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.583+0000 7fbcc2ab3980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.583+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b66d00 con 0x55e0d0b683e0 2024-05-09T09:49:26.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.587+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbcb40d9070 con 0x55e0d0b683e0 2024-05-09T09:49:26.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.587+0000 7fbcc2ab3980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:49:26.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.587+0000 7fbcc2ab3980 20 zone default found 2024-05-09T09:49:26.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.587+0000 7fbcc2ab3980 4 Realm: () 2024-05-09T09:49:26.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.587+0000 7fbcc2ab3980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:49:26.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.587+0000 7fbcc2ab3980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:49:26.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.587+0000 7fbcc2ab3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:49:26.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.587+0000 7fbcc2ab3980 20 zonegroup default 2024-05-09T09:49:26.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.587+0000 7fbcc2ab3980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.587+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b675a0 con 0x55e0d0b63b40 2024-05-09T09:49:26.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.587+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbcb0072030 con 0x55e0d0b63b40 2024-05-09T09:49:26.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.587+0000 7fbcc2ab3980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:26.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.587+0000 7fbcc2ab3980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.587+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b6cdd0 con 0x55e0d0b683e0 2024-05-09T09:49:26.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.587+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbcb40d9070 con 0x55e0d0b683e0 2024-05-09T09:49:26.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.587+0000 7fbcc2ab3980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:26.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.587+0000 7fbcc2ab3980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.587+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b6d170 con 0x55e0d0b683e0 2024-05-09T09:49:26.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.587+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbcb40d9070 con 0x55e0d0b683e0 2024-05-09T09:49:26.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.587+0000 7fbcc2ab3980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:26.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.587+0000 7fbcc2ab3980 20 started sync module instance, tier type = 2024-05-09T09:49:26.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.587+0000 7fbcc2ab3980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:49:26.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.587+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b6c270 con 0x7fbcb40ce040 2024-05-09T09:49:26.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.587+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x7fbcb40ce040 2024-05-09T09:49:26.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.587+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94424062674832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b6c270 con 0x7fbcb40ce040 2024-05-09T09:49:26.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.587+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b6db30 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.591+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94424062674832] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x7fbcb40ce040 2024-05-09T09:49:26.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.591+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.591+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94424062678928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b6c270 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.591+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b6e540 con 0x55e0d0b683e0 2024-05-09T09:49:26.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.591+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94424062678928] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.591+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb40d9070 con 0x55e0d0b683e0 2024-05-09T09:49:26.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.591+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94424062672320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b6c1e0 con 0x55e0d0b683e0 2024-05-09T09:49:26.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.591+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b6f280 con 0x7fbcb40ce040 2024-05-09T09:49:26.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.595+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x7fbcb40ce040 2024-05-09T09:49:26.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.595+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94424062684560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b6f1b0 con 0x7fbcb40ce040 2024-05-09T09:49:26.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.595+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b70140 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.595+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94424062672320] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb40d9070 con 0x55e0d0b683e0 2024-05-09T09:49:26.596 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.595+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94424062684560] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x7fbcb40ce040 2024-05-09T09:49:26.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.595+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.595+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94424062683360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b6fc90 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.597 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.595+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b709e0 con 0x55e0d0b63b40 2024-05-09T09:49:26.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.599+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94424062683360] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.599+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb0072030 con 0x55e0d0b63b40 2024-05-09T09:49:26.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.599+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94424062690608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b6fc90 con 0x55e0d0b63b40 2024-05-09T09:49:26.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.599+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b71230 con 0x55e0d0b63b40 2024-05-09T09:49:26.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.599+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb0072030 con 0x55e0d0b63b40 2024-05-09T09:49:26.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.599+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94424062693008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b719a0 con 0x55e0d0b63b40 2024-05-09T09:49:26.601 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.599+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b724c0 con 0x55e0d0b63b40 2024-05-09T09:49:26.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.599+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94424062690608] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb0072030 con 0x55e0d0b63b40 2024-05-09T09:49:26.605 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.603+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94424062693008] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb0072030 con 0x55e0d0b63b40 2024-05-09T09:49:26.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.603+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb0072030 con 0x55e0d0b63b40 2024-05-09T09:49:26.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.603+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94424062697360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b713f0 con 0x55e0d0b63b40 2024-05-09T09:49:26.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.603+0000 7fbcc2ab3980 20 add_watcher() i=0 2024-05-09T09:49:26.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.603+0000 7fbcc2ab3980 20 add_watcher() i=1 2024-05-09T09:49:26.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.603+0000 7fbcc2ab3980 20 add_watcher() i=2 2024-05-09T09:49:26.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.603+0000 7fbcc2ab3980 20 add_watcher() i=3 2024-05-09T09:49:26.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.603+0000 7fbcc2ab3980 20 add_watcher() i=4 2024-05-09T09:49:26.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.603+0000 7fbcc2ab3980 20 add_watcher() i=5 2024-05-09T09:49:26.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.603+0000 7fbcc2ab3980 20 add_watcher() i=6 2024-05-09T09:49:26.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.603+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94424062697360] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb0072030 con 0x55e0d0b63b40 2024-05-09T09:49:26.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.603+0000 7fbcc2ab3980 20 add_watcher() i=7 2024-05-09T09:49:26.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.603+0000 7fbcc2ab3980 2 all 8 watchers are set, enabling cache 2024-05-09T09:49:26.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.603+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b754b0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.607+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.607 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.607+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94424062686720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b72960 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.607+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94424062686720] v32'410 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.607+0000 7fbb757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:26.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.607+0000 7fbcc2ab3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:49:26.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.607+0000 7fbcc2ab3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:49:26.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.607+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7da50 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.611+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'95 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.611+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7dfc0 con 0x55e0d0b63b40 2024-05-09T09:49:26.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.611+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'90 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbcb0072030 con 0x55e0d0b63b40 2024-05-09T09:49:26.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.611+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7dfc0 con 0x55e0d0b683e0 2024-05-09T09:49:26.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.611+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'89 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbcb40d9070 con 0x55e0d0b683e0 2024-05-09T09:49:26.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.611+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7e590 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.615+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'411 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.615 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.615+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7ea40 con 0x7fbcb40ce040 2024-05-09T09:49:26.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.615+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'254 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x7fbcb40ce040 2024-05-09T09:49:26.616 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.615+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7ba30 con 0x55e0d0b683e0 2024-05-09T09:49:26.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.615+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'170 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbcb40d9070 con 0x55e0d0b683e0 2024-05-09T09:49:26.618 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.615+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7ba30 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.619+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'90 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.620 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.619+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7ba30 con 0x55e0d0b63b40 2024-05-09T09:49:26.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.623+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'169 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbcb0072030 con 0x55e0d0b63b40 2024-05-09T09:49:26.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.623+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7ba30 con 0x7fbcb40ce040 2024-05-09T09:49:26.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.623+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'88 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x7fbcb40ce040 2024-05-09T09:49:26.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.623+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7ba30 con 0x55e0d0b683e0 2024-05-09T09:49:26.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.627+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'94 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbcb40d9070 con 0x55e0d0b683e0 2024-05-09T09:49:26.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.627+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7fa20 con 0x7fbcb40ce040 2024-05-09T09:49:26.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.627+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'255 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x7fbcb40ce040 2024-05-09T09:49:26.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.627+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7fa20 con 0x55e0d0b63b40 2024-05-09T09:49:26.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.631+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'94 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcb0072030 con 0x55e0d0b63b40 2024-05-09T09:49:26.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.631+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7fa20 con 0x7fbcb40ce040 2024-05-09T09:49:26.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.631+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'88 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x7fbcb40ce040 2024-05-09T09:49:26.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.631+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7fa20 con 0x55e0d0b63b40 2024-05-09T09:49:26.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.635+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'175 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcb0072030 con 0x55e0d0b63b40 2024-05-09T09:49:26.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.635+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7fa20 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.635+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'412 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.637 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.635+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7fa20 con 0x55e0d0b683e0 2024-05-09T09:49:26.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.639+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'248 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcb40d9070 con 0x55e0d0b683e0 2024-05-09T09:49:26.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.639+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7fa20 con 0x7fbcb40ce040 2024-05-09T09:49:26.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.639+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'256 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x7fbcb40ce040 2024-05-09T09:49:26.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.639+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7fae0 con 0x55e0d0b683e0 2024-05-09T09:49:26.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.639+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'88 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcb40d9070 con 0x55e0d0b683e0 2024-05-09T09:49:26.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.639+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7fae0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.643+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'96 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.643+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7fab0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.643+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'413 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.643+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7fa20 con 0x55e0d0b683e0 2024-05-09T09:49:26.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.647+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'249 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcb40d9070 con 0x55e0d0b683e0 2024-05-09T09:49:26.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.647+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7fa20 con 0x7fbcb40ce040 2024-05-09T09:49:26.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.647+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'100 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x7fbcb40ce040 2024-05-09T09:49:26.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.647+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7fa20 con 0x55e0d0b683e0 2024-05-09T09:49:26.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.647+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'90 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcb40d9070 con 0x55e0d0b683e0 2024-05-09T09:49:26.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.647+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7fa20 con 0x55e0d0b683e0 2024-05-09T09:49:26.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.651+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'94 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcb40d9070 con 0x55e0d0b683e0 2024-05-09T09:49:26.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.651+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7fa20 con 0x55e0d0b683e0 2024-05-09T09:49:26.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.651+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'85 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcb40d9070 con 0x55e0d0b683e0 2024-05-09T09:49:26.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.651+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7fa20 con 0x55e0d0b683e0 2024-05-09T09:49:26.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.651+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'171 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcb40d9070 con 0x55e0d0b683e0 2024-05-09T09:49:26.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.651+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7fa20 con 0x55e0d0b63b40 2024-05-09T09:49:26.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.655+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'90 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcb0072030 con 0x55e0d0b63b40 2024-05-09T09:49:26.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.655+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7fa20 con 0x55e0d0b683e0 2024-05-09T09:49:26.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.655+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'89 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcb40d9070 con 0x55e0d0b683e0 2024-05-09T09:49:26.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.655+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7fa20 con 0x55e0d0b63b40 2024-05-09T09:49:26.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.659+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'170 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcb0072030 con 0x55e0d0b63b40 2024-05-09T09:49:26.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.659+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7fa20 con 0x55e0d0b683e0 2024-05-09T09:49:26.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.663+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'250 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcb40d9070 con 0x55e0d0b683e0 2024-05-09T09:49:26.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.663+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7fa20 con 0x55e0d0b63b40 2024-05-09T09:49:26.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.663+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'176 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcb0072030 con 0x55e0d0b63b40 2024-05-09T09:49:26.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.663+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7fa20 con 0x7fbcb40ce040 2024-05-09T09:49:26.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.667+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'94 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x7fbcb40ce040 2024-05-09T09:49:26.668 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.667+0000 7fbaeffff640 20 reqs_thread_entry: start 2024-05-09T09:49:26.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.667+0000 7fbcc2ab3980 20 init_complete bucket index max shards: 11 2024-05-09T09:49:26.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.667+0000 7fbaedffb640 20 reqs_thread_entry: start 2024-05-09T09:49:26.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.667+0000 7fbcc2ab3980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.667+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b9b730 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.667+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.667+0000 7fbcc2ab3980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:49:26.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.667+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:95 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7a590 con 0x55e0d0b63b40 2024-05-09T09:49:26.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.671+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(95 usage.10 [call out=15b] v0'0 uv92 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7fbcb0072030 con 0x55e0d0b63b40 2024-05-09T09:49:26.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.671+0000 7fbb757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:26.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.671+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94424062686720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b7a590 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.675+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94424062686720] v32'414 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.675+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94424062674832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b6f600 con 0x7fbcb40ce040 2024-05-09T09:49:26.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.675+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94424062674832] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x7fbcb40ce040 2024-05-09T09:49:26.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.675+0000 7fbcc2ab3980 20 remove_watcher() i=0 2024-05-09T09:49:26.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.675+0000 7fbcc2ab3980 2 removed watcher, disabling cache 2024-05-09T09:49:26.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.675+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94424062678928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b6c790 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.675+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94424062678928] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.675+0000 7fbcc2ab3980 20 remove_watcher() i=1 2024-05-09T09:49:26.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.675+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94424062672320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b6c790 con 0x55e0d0b683e0 2024-05-09T09:49:26.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.679+0000 7fbcbfdcd640 1 -- 172.21.15.157:0/1384038180 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94424062672320] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb40d9070 con 0x55e0d0b683e0 2024-05-09T09:49:26.680 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.679+0000 7fbcc2ab3980 20 remove_watcher() i=2 2024-05-09T09:49:26.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.679+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94424062684560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b6c790 con 0x7fbcb40ce040 2024-05-09T09:49:26.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.679+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94424062684560] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x7fbcb40ce040 2024-05-09T09:49:26.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.679+0000 7fbcc2ab3980 20 remove_watcher() i=3 2024-05-09T09:49:26.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.679+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94424062683360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b6c790 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.683+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94424062683360] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb800a4d0 con 0x55e0d0b5f1b0 2024-05-09T09:49:26.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.683+0000 7fbcc2ab3980 20 remove_watcher() i=4 2024-05-09T09:49:26.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.683+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94424062690608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b6e8e0 con 0x55e0d0b63b40 2024-05-09T09:49:26.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.687+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94424062690608] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb0072030 con 0x55e0d0b63b40 2024-05-09T09:49:26.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.687+0000 7fbcc2ab3980 20 remove_watcher() i=5 2024-05-09T09:49:26.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.687+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94424062693008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b6c790 con 0x55e0d0b63b40 2024-05-09T09:49:26.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.687+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94424062693008] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb0072030 con 0x55e0d0b63b40 2024-05-09T09:49:26.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.687+0000 7fbcc2ab3980 20 remove_watcher() i=6 2024-05-09T09:49:26.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.687+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94424062697360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0d0b6c790 con 0x55e0d0b63b40 2024-05-09T09:49:26.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc05ce640 1 -- 172.21.15.157:0/1384038180 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94424062697360] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcb0072030 con 0x55e0d0b63b40 2024-05-09T09:49:26.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 20 remove_watcher() i=7 2024-05-09T09:49:26.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e0d0b63b40 msgr2=0x55e0d0b65f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 --2- 172.21.15.157:0/1384038180 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e0d0b63b40 0x55e0d0b65f30 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e0d0b5f1b0 msgr2=0x55e0d0b61640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 --2- 172.21.15.157:0/1384038180 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e0d0b5f1b0 0x55e0d0b61640 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fbcb40ce040 msgr2=0x7fbcb40db410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 --2- 172.21.15.157:0/1384038180 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fbcb40ce040 0x7fbcb40db410 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e0d0b683e0 msgr2=0x55e0d0b6a8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 --2- 172.21.15.157:0/1384038180 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e0d0b683e0 0x55e0d0b6a8a0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb88034bb0 msgr2=0x7fbb88037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 --2- 172.21.15.157:0/1384038180 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb88034bb0 0x7fbb88037070 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4000c10 tx=0x7fbcb40a6000 comp rx=0 tx=0).stop 2024-05-09T09:49:26.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0b4b460 msgr2=0x55e0d0b526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/1384038180 reap_dead start 2024-05-09T09:49:26.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 --2- 172.21.15.157:0/1384038180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0b4b460 0x55e0d0b526f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0048b30 tx=0x7fbcb003ef50 comp rx=0 tx=0).stop 2024-05-09T09:49:26.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 shutdown_connections 2024-05-09T09:49:26.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 --2- 172.21.15.157:0/1384038180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0b4b460 0x55e0d0b526f0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 >> 172.21.15.157:0/1384038180 conn(0x55e0d0b477e0 msgr2=0x55e0d0b44e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:26.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 shutdown_connections 2024-05-09T09:49:26.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/1384038180 wait complete. 2024-05-09T09:49:26.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2087758430 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb98034bb0 msgr2=0x7fbb98037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 --2- 172.21.15.157:0/2087758430 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb98034bb0 0x7fbb98037070 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbcb40ae040 tx=0x7fbcb4005a10 comp rx=0 tx=0).stop 2024-05-09T09:49:26.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2087758430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0b3e650 msgr2=0x55e0d0b3ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 --2- 172.21.15.157:0/2087758430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0b3e650 0x55e0d0b3ea70 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0048c30 tx=0x7fbcb000db30 comp rx=0 tx=0).stop 2024-05-09T09:49:26.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2087758430 shutdown_connections 2024-05-09T09:49:26.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 --2- 172.21.15.157:0/2087758430 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb98034bb0 0x7fbb98037070 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 --2- 172.21.15.157:0/2087758430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0b3e650 0x55e0d0b3ea70 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2087758430 >> 172.21.15.157:0/2087758430 conn(0x55e0d0b33420 msgr2=0x55e0d0b33f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:26.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2087758430 shutdown_connections 2024-05-09T09:49:26.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2087758430 wait complete. 2024-05-09T09:49:26.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2568547406 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e0d0b11df0 msgr2=0x55e0d0b141e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 --2- 172.21.15.157:0/2568547406 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55e0d0b11df0 0x55e0d0b141e0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2568547406 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e0d098a380 msgr2=0x55e0d0b0f450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 --2- 172.21.15.157:0/2568547406 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55e0d098a380 0x55e0d0b0f450 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2568547406 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e0d0b15d10 msgr2=0x55e0d0b18100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 --2- 172.21.15.157:0/2568547406 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55e0d0b15d10 0x55e0d0b18100 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2568547406 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbba8034bb0 msgr2=0x7fbba8037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 --2- 172.21.15.157:0/2568547406 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbba8034bb0 0x7fbba8037070 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbcb40ad000 tx=0x7fbcb40a5040 comp rx=0 tx=0).stop 2024-05-09T09:49:26.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2568547406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0989090 msgr2=0x55e0d0b084d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 --2- 172.21.15.157:0/2568547406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e0d0989090 0x55e0d0b084d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0001e20 tx=0x7fbcb0000ee0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc0dcf640 1 -- 172.21.15.157:0/2568547406 reap_dead start 2024-05-09T09:49:26.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2568547406 shutdown_connections 2024-05-09T09:49:26.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2568547406 >> 172.21.15.157:0/2568547406 conn(0x55e0d0a0f250 msgr2=0x55e0d0afb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:26.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2568547406 shutdown_connections 2024-05-09T09:49:26.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.691+0000 7fbcc2ab3980 1 -- 172.21.15.157:0/2568547406 wait complete. 2024-05-09T09:49:26.706 INFO:teuthology.orchestra.run.smithi157.stdout:{"entries":[],"summary":[]} 2024-05-09T09:49:26.706 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-05-09T09:49:26.707 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-05-09T09:49:26.707 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-05-09T09:49:26.707 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-05-09T09:49:26.788 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:49:26.788 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:49:26.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.787+0000 7f6c48b38980 1 Processor -- start 2024-05-09T09:49:26.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.787+0000 7f6c48b38980 1 -- start start 2024-05-09T09:49:26.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.787+0000 7f6c48b38980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5611e6cd0990 0x5611e6cd0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.787+0000 7f6c48b38980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5611e6b86440 con 0x5611e6cd12b0 2024-05-09T09:49:26.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.787+0000 7f6c48b38980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5611e6b715f0 con 0x5611e6cd0990 2024-05-09T09:49:26.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.787+0000 7f6c46653640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5611e6cd0990 0x5611e6cd0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.787+0000 7f6c46653640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5611e6cd0990 0x5611e6cd0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38638/0 (socket says 172.21.15.157:38638) 2024-05-09T09:49:26.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.787+0000 7f6c46653640 1 -- 172.21.15.157:0/789567750 learned_addr learned my addr 172.21.15.157:0/789567750 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:26.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.787+0000 7f6c46653640 1 -- 172.21.15.157:0/789567750 >> v1:172.21.15.110:6789/0 conn(0x5611e6cd12b0 legacy=0x5611e6cd1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T09:49:26.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.787+0000 7f6c46653640 1 -- 172.21.15.157:0/789567750 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611e6b7c990 con 0x5611e6cd0990 2024-05-09T09:49:26.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.791+0000 7f6c46653640 1 --2- 172.21.15.157:0/789567750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6cd0990 0x5611e6cd0d70 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000a4e0 tx=0x7f6c4001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da7e914ded07553 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.791+0000 7f6c45651640 1 -- 172.21.15.157:0/789567750 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c400aa540 con 0x5611e6cd0990 2024-05-09T09:49:26.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.791+0000 7f6c45651640 1 -- 172.21.15.157:0/789567750 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c400aa6e0 con 0x5611e6cd0990 2024-05-09T09:49:26.793 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.791+0000 7f6c45651640 1 -- 172.21.15.157:0/789567750 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c400aaa40 con 0x5611e6cd0990 2024-05-09T09:49:26.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.791+0000 7f6c48b38980 1 -- 172.21.15.157:0/789567750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6cd0990 msgr2=0x5611e6cd0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.791+0000 7f6c48b38980 1 --2- 172.21.15.157:0/789567750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6cd0990 0x5611e6cd0d70 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000a4e0 tx=0x7f6c4001b090 comp rx=0 tx=0).stop 2024-05-09T09:49:26.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.791+0000 7f6c48b38980 1 -- 172.21.15.157:0/789567750 shutdown_connections 2024-05-09T09:49:26.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.791+0000 7f6c48b38980 1 --2- 172.21.15.157:0/789567750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6cd0990 0x5611e6cd0d70 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.791+0000 7f6c48b38980 1 -- 172.21.15.157:0/789567750 >> 172.21.15.157:0/789567750 conn(0x5611e6ccc260 msgr2=0x5611e6cce680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:26.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.791+0000 7f6c48b38980 1 -- 172.21.15.157:0/789567750 shutdown_connections 2024-05-09T09:49:26.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.791+0000 7f6c48b38980 1 -- 172.21.15.157:0/789567750 wait complete. 2024-05-09T09:49:26.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.807+0000 7f6c48b38980 1 Processor -- start 2024-05-09T09:49:26.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.807+0000 7f6c48b38980 1 -- start start 2024-05-09T09:49:26.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.807+0000 7f6c48b38980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6cd0990 0x5611e6c47190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.807+0000 7f6c48b38980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5611e6bd3fe0 con 0x5611e6cd0990 2024-05-09T09:49:26.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.807+0000 7f6c46653640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6cd0990 0x5611e6c47190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.807+0000 7f6c46653640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6cd0990 0x5611e6c47190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38652/0 (socket says 172.21.15.157:38652) 2024-05-09T09:49:26.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.807+0000 7f6c46653640 1 -- 172.21.15.157:0/1716865103 learned_addr learned my addr 172.21.15.157:0/1716865103 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:26.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.811+0000 7f6c46653640 1 -- 172.21.15.157:0/1716865103 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611e6b58ae0 con 0x5611e6cd0990 2024-05-09T09:49:26.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.811+0000 7f6c46653640 1 --2- 172.21.15.157:0/1716865103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6cd0990 0x5611e6c47190 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f6c40018cc0 tx=0x7f6c400033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2415d8e39c4dc493 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.811+0000 7f6b34608640 1 -- 172.21.15.157:0/1716865103 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c400b9070 con 0x5611e6cd0990 2024-05-09T09:49:26.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.811+0000 7f6b34608640 1 -- 172.21.15.157:0/1716865103 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c400aaa80 con 0x5611e6cd0990 2024-05-09T09:49:26.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.811+0000 7f6b34608640 1 -- 172.21.15.157:0/1716865103 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c400aad60 con 0x5611e6cd0990 2024-05-09T09:49:26.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.811+0000 7f6c48b38980 1 -- 172.21.15.157:0/1716865103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6cd0990 msgr2=0x5611e6c47190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.811+0000 7f6c48b38980 1 --2- 172.21.15.157:0/1716865103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6cd0990 0x5611e6c47190 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f6c40018cc0 tx=0x7f6c400033b0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.811+0000 7f6c48b38980 1 -- 172.21.15.157:0/1716865103 shutdown_connections 2024-05-09T09:49:26.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.811+0000 7f6c48b38980 1 --2- 172.21.15.157:0/1716865103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6cd0990 0x5611e6c47190 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.811+0000 7f6c48b38980 1 -- 172.21.15.157:0/1716865103 >> 172.21.15.157:0/1716865103 conn(0x5611e6ccc260 msgr2=0x5611e6db7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:26.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.811+0000 7f6c48b38980 1 -- 172.21.15.157:0/1716865103 shutdown_connections 2024-05-09T09:49:26.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.811+0000 7f6c48b38980 1 -- 172.21.15.157:0/1716865103 wait complete. 2024-05-09T09:49:26.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.811+0000 7f6c48b38980 1 Processor -- start 2024-05-09T09:49:26.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.811+0000 7f6c48b38980 1 -- start start 2024-05-09T09:49:26.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.811+0000 7f6c48b38980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6cd0990 0x5611e6dc5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.811+0000 7f6c48b38980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5611e6cda990 con 0x5611e6cd0990 2024-05-09T09:49:26.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.811+0000 7f6c46653640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6cd0990 0x5611e6dc5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.811+0000 7f6c46653640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6cd0990 0x5611e6dc5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38658/0 (socket says 172.21.15.157:38658) 2024-05-09T09:49:26.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.811+0000 7f6c46653640 1 -- 172.21.15.157:0/3879457698 learned_addr learned my addr 172.21.15.157:0/3879457698 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:26.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.811+0000 7f6c46653640 1 -- 172.21.15.157:0/3879457698 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611e6dc5aa0 con 0x5611e6cd0990 2024-05-09T09:49:26.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.815+0000 7f6c46653640 1 --2- 172.21.15.157:0/3879457698 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6cd0990 0x5611e6dc5560 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f6c4001b0d0 tx=0x7f6c40017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.815+0000 7f6b32e05640 1 -- 172.21.15.157:0/3879457698 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c400b9070 con 0x5611e6cd0990 2024-05-09T09:49:26.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.815+0000 7f6b32e05640 1 -- 172.21.15.157:0/3879457698 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c400c7410 con 0x5611e6cd0990 2024-05-09T09:49:26.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.815+0000 7f6c48b38980 1 -- 172.21.15.157:0/3879457698 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5611e6dc5d30 con 0x5611e6cd0990 2024-05-09T09:49:26.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.815+0000 7f6b32e05640 1 -- 172.21.15.157:0/3879457698 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c400c76f0 con 0x5611e6cd0990 2024-05-09T09:49:26.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.815+0000 7f6c48b38980 1 -- 172.21.15.157:0/3879457698 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611e6dc8970 con 0x5611e6cd0990 2024-05-09T09:49:26.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.815+0000 7f6b32e05640 1 -- 172.21.15.157:0/3879457698 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f6c400b3040 con 0x5611e6cd0990 2024-05-09T09:49:26.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.815+0000 7f6b32e05640 1 --2- 172.21.15.157:0/3879457698 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6b2c034c50 0x7f6b2c037110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.815+0000 7f6b32e05640 1 -- 172.21.15.157:0/3879457698 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f6c400c4070 con 0x5611e6cd0990 2024-05-09T09:49:26.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.815+0000 7f6c45e52640 1 --2- 172.21.15.157:0/3879457698 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6b2c034c50 0x7f6b2c037110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.815+0000 7f6c48b38980 1 --2- 172.21.15.157:0/3879457698 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5611e6cd12b0 0x5611e6dcc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.815+0000 7f6c48b38980 1 -- 172.21.15.157:0/3879457698 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6dccb40 con 0x5611e6cd12b0 2024-05-09T09:49:26.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.815+0000 7f6c46e54640 1 --2- 172.21.15.157:0/3879457698 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5611e6cd12b0 0x5611e6dcc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.815+0000 7f6c45e52640 1 --2- 172.21.15.157:0/3879457698 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6b2c034c50 0x7f6b2c037110 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c000f70 tx=0x7f6c3c001420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.815+0000 7f6c46e54640 1 --2- 172.21.15.157:0/3879457698 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5611e6cd12b0 0x5611e6dcc5c0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.815+0000 7f6c46e54640 1 -- 172.21.15.157:0/3879457698 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c380083f0 con 0x5611e6cd12b0 2024-05-09T09:49:26.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.815+0000 7f6c48b38980 1 -- 172.21.15.157:0/3879457698 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6dc9b90 con 0x5611e6cd12b0 2024-05-09T09:49:26.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.815+0000 7f6c46e54640 1 -- 172.21.15.157:0/3879457698 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c380083f0 con 0x5611e6cd12b0 2024-05-09T09:49:26.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.815+0000 7f6c48b38980 1 --2- 172.21.15.157:0/3879457698 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5611e6dcee70 0x5611e6dd1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.815+0000 7f6c48b38980 1 -- 172.21.15.157:0/3879457698 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6dd1950 con 0x5611e6dcee70 2024-05-09T09:49:26.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.815+0000 7f6c46653640 1 --2- 172.21.15.157:0/3879457698 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5611e6dcee70 0x5611e6dd1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.819+0000 7f6c46653640 1 --2- 172.21.15.157:0/3879457698 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5611e6dcee70 0x5611e6dd1260 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.819+0000 7f6c46653640 1 -- 172.21.15.157:0/3879457698 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6c400cd060 con 0x5611e6dcee70 2024-05-09T09:49:26.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.819+0000 7f6c48b38980 1 -- 172.21.15.157:0/3879457698 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6dcdd10 con 0x5611e6cd12b0 2024-05-09T09:49:26.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.819+0000 7f6c46e54640 1 -- 172.21.15.157:0/3879457698 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6c380083f0 con 0x5611e6cd12b0 2024-05-09T09:49:26.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.819+0000 7f6c48b38980 1 --2- 172.21.15.157:0/3879457698 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5611e6dd2db0 0x5611e6dd51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.819+0000 7f6c48b38980 1 -- 172.21.15.157:0/3879457698 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6dd58e0 con 0x5611e6dd2db0 2024-05-09T09:49:26.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.819+0000 7f6c45e52640 1 --2- 172.21.15.157:0/3879457698 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5611e6dd2db0 0x5611e6dd51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.819+0000 7f6c45e52640 1 --2- 172.21.15.157:0/3879457698 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5611e6dd2db0 0x5611e6dd51a0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.819+0000 7f6c45e52640 1 -- 172.21.15.157:0/3879457698 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6c3c00d040 con 0x5611e6dd2db0 2024-05-09T09:49:26.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.823+0000 7f6c48b38980 1 Processor -- start 2024-05-09T09:49:26.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.823+0000 7f6c48b38980 1 -- start start 2024-05-09T09:49:26.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.823+0000 7f6c48b38980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6dfb960 0x5611e6dfbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.823+0000 7f6c48b38980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5611e6bd8020 con 0x5611e6dfb960 2024-05-09T09:49:26.825 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.823+0000 7f6c46653640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6dfb960 0x5611e6dfbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.823+0000 7f6c46653640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6dfb960 0x5611e6dfbd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38668/0 (socket says 172.21.15.157:38668) 2024-05-09T09:49:26.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.823+0000 7f6c46653640 1 -- 172.21.15.157:0/2217305346 learned_addr learned my addr 172.21.15.157:0/2217305346 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:26.826 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.823+0000 7f6c46653640 1 -- 172.21.15.157:0/2217305346 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611e6dfc2c0 con 0x5611e6dfb960 2024-05-09T09:49:26.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.823+0000 7f6c46653640 1 --2- 172.21.15.157:0/2217305346 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6dfb960 0x5611e6dfbd80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6c400b2900 tx=0x7f6c400b2c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.827+0000 7f6b2aba2640 1 -- 172.21.15.157:0/2217305346 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c400c66b0 con 0x5611e6dfb960 2024-05-09T09:49:26.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.827+0000 7f6b2aba2640 1 -- 172.21.15.157:0/2217305346 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c400c6850 con 0x5611e6dfb960 2024-05-09T09:49:26.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.827+0000 7f6c48b38980 1 -- 172.21.15.157:0/2217305346 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5611e6dfcd50 con 0x5611e6dfb960 2024-05-09T09:49:26.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.827+0000 7f6b2aba2640 1 -- 172.21.15.157:0/2217305346 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c400c79c0 con 0x5611e6dfb960 2024-05-09T09:49:26.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.827+0000 7f6c48b38980 1 -- 172.21.15.157:0/2217305346 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611e6dfcd50 con 0x5611e6dfb960 2024-05-09T09:49:26.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.827+0000 7f6b2aba2640 1 -- 172.21.15.157:0/2217305346 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f6c400c7b60 con 0x5611e6dfb960 2024-05-09T09:49:26.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.827+0000 7f6b2aba2640 1 --2- 172.21.15.157:0/2217305346 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6b20034c50 0x7f6b20037110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.827+0000 7f6b2aba2640 1 -- 172.21.15.157:0/2217305346 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f6c400eed50 con 0x5611e6dfb960 2024-05-09T09:49:26.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.827+0000 7f6c45e52640 1 --2- 172.21.15.157:0/2217305346 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6b20034c50 0x7f6b20037110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.827+0000 7f6c48b38980 1 Processor -- start 2024-05-09T09:49:26.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.827+0000 7f6c48b38980 1 -- start start 2024-05-09T09:49:26.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.827+0000 7f6c45e52640 1 --2- 172.21.15.157:0/2217305346 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6b20034c50 0x7f6b20037110 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x5611e6dccff0 tx=0x7f6c3c006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.827+0000 7f6c48b38980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6e08710 0x5611e6e08af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.827+0000 7f6c48b38980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5611e6c47820 con 0x5611e6e08710 2024-05-09T09:49:26.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.827+0000 7f6c46653640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6e08710 0x5611e6e08af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.827+0000 7f6c46653640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6e08710 0x5611e6e08af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38680/0 (socket says 172.21.15.157:38680) 2024-05-09T09:49:26.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.827+0000 7f6c46653640 1 -- 172.21.15.157:0/2318986803 learned_addr learned my addr 172.21.15.157:0/2318986803 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:26.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.827+0000 7f6c46653640 1 -- 172.21.15.157:0/2318986803 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611e6e090c0 con 0x5611e6e08710 2024-05-09T09:49:26.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.827+0000 7f6c46653640 1 --2- 172.21.15.157:0/2318986803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6e08710 0x5611e6e08af0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6c400b1fd0 tx=0x7f6c400ceab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=434008f7b51a899f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.827+0000 7f6b28b9e640 1 -- 172.21.15.157:0/2318986803 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c400bc520 con 0x5611e6e08710 2024-05-09T09:49:26.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.827+0000 7f6b28b9e640 1 -- 172.21.15.157:0/2318986803 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c400fe070 con 0x5611e6e08710 2024-05-09T09:49:26.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.827+0000 7f6b28b9e640 1 -- 172.21.15.157:0/2318986803 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c400bd400 con 0x5611e6e08710 2024-05-09T09:49:26.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.831+0000 7f6c48b38980 1 -- 172.21.15.157:0/2318986803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6e08710 msgr2=0x5611e6e08af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:26.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.831+0000 7f6c48b38980 1 --2- 172.21.15.157:0/2318986803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6e08710 0x5611e6e08af0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6c400b1fd0 tx=0x7f6c400ceab0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.831+0000 7f6c48b38980 1 -- 172.21.15.157:0/2318986803 shutdown_connections 2024-05-09T09:49:26.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.831+0000 7f6c48b38980 1 --2- 172.21.15.157:0/2318986803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6e08710 0x5611e6e08af0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:26.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.831+0000 7f6c48b38980 1 -- 172.21.15.157:0/2318986803 >> 172.21.15.157:0/2318986803 conn(0x5611e6e04a50 msgr2=0x5611e6e02b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:26.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.831+0000 7f6c48b38980 1 -- 172.21.15.157:0/2318986803 shutdown_connections 2024-05-09T09:49:26.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.831+0000 7f6c48b38980 1 -- 172.21.15.157:0/2318986803 wait complete. 2024-05-09T09:49:26.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.831+0000 7f6c48b38980 1 Processor -- start 2024-05-09T09:49:26.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.831+0000 7f6c48b38980 1 -- start start 2024-05-09T09:49:26.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.831+0000 7f6c48b38980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6e08710 0x5611e6e0fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.831+0000 7f6c48b38980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5611e6e09740 con 0x5611e6e08710 2024-05-09T09:49:26.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.831+0000 7f6c46653640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6e08710 0x5611e6e0fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.831+0000 7f6c46653640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6e08710 0x5611e6e0fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38686/0 (socket says 172.21.15.157:38686) 2024-05-09T09:49:26.833 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.831+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 learned_addr learned my addr 172.21.15.157:0/4012295186 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:26.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.831+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611e6e0ffd0 con 0x5611e6e08710 2024-05-09T09:49:26.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.831+0000 7f6c46653640 1 --2- 172.21.15.157:0/4012295186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6e08710 0x5611e6e0fa90 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f6c400dcbe0 tx=0x7f6c400cdf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.831+0000 7f6b16ffd640 1 -- 172.21.15.157:0/4012295186 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c400ce480 con 0x5611e6e08710 2024-05-09T09:49:26.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.831+0000 7f6b16ffd640 1 -- 172.21.15.157:0/4012295186 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c400ec3e0 con 0x5611e6e08710 2024-05-09T09:49:26.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.831+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5611e6e0ffd0 con 0x5611e6e08710 2024-05-09T09:49:26.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.831+0000 7f6b16ffd640 1 -- 172.21.15.157:0/4012295186 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c400dcc50 con 0x5611e6e08710 2024-05-09T09:49:26.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.831+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611e6e0ffd0 con 0x5611e6e08710 2024-05-09T09:49:26.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6b16ffd640 1 -- 172.21.15.157:0/4012295186 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f6c40114060 con 0x5611e6e08710 2024-05-09T09:49:26.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6b16ffd640 1 --2- 172.21.15.157:0/4012295186 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6b10034bb0 0x7f6b10037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6b16ffd640 1 -- 172.21.15.157:0/4012295186 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f6c400f4040 con 0x5611e6e08710 2024-05-09T09:49:26.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6c45e52640 1 --2- 172.21.15.157:0/4012295186 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6b10034bb0 0x7f6b10037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6c48b38980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6c48b38980 1 --2- 172.21.15.157:0/4012295186 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5611e6e1c5d0 0x5611e6e1ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e1f1e0 con 0x5611e6e1c5d0 2024-05-09T09:49:26.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6c46e54640 1 --2- 172.21.15.157:0/4012295186 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5611e6e1c5d0 0x5611e6e1ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6c45e52640 1 --2- 172.21.15.157:0/4012295186 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6b10034bb0 0x7f6b10037070 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c010fd0 tx=0x7f6c3c011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6c46e54640 1 --2- 172.21.15.157:0/4012295186 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5611e6e1c5d0 0x5611e6e1ea90 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c380083f0 con 0x5611e6e1c5d0 2024-05-09T09:49:26.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6c48b38980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:26.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6c48b38980 20 realm 2024-05-09T09:49:26.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6c48b38980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e1f5f0 con 0x5611e6e1c5d0 2024-05-09T09:49:26.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c380083f0 con 0x5611e6e1c5d0 2024-05-09T09:49:26.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6c48b38980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:26.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6c48b38980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:49:26.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6c48b38980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e1fec0 con 0x5611e6e1c5d0 2024-05-09T09:49:26.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c380083f0 con 0x5611e6e1c5d0 2024-05-09T09:49:26.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6c48b38980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:26.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6c48b38980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x5611e6e1c5d0 2024-05-09T09:49:26.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c380083f0 con 0x5611e6e1c5d0 2024-05-09T09:49:26.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6c48b38980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:26.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6c48b38980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6c48b38980 1 --2- 172.21.15.157:0/4012295186 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5611e6e20fc0 0x5611e6e233b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e23980 con 0x5611e6e20fc0 2024-05-09T09:49:26.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6c46653640 1 --2- 172.21.15.157:0/4012295186 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5611e6e20fc0 0x5611e6e233b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.835+0000 7f6c46653640 1 --2- 172.21.15.157:0/4012295186 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5611e6e20fc0 0x5611e6e233b0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.839+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.839+0000 7f6c48b38980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:49:26.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.839+0000 7f6c48b38980 20 searching for the correct realm 2024-05-09T09:49:26.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.839+0000 7f6c48b38980 1 --2- 172.21.15.157:0/4012295186 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5611e6e258d0 0x5611e6e27d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.839+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e283d0 con 0x5611e6e258d0 2024-05-09T09:49:26.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.839+0000 7f6c45e52640 1 --2- 172.21.15.157:0/4012295186 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5611e6e258d0 0x5611e6e27d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.839+0000 7f6c45e52640 1 --2- 172.21.15.157:0/4012295186 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5611e6e258d0 0x5611e6e27d00 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.839+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3c036040 con 0x5611e6e258d0 2024-05-09T09:49:26.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.839+0000 7f6c45e52640 1 --2- 172.21.15.157:0/4012295186 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f6c3c00f3d0 0x7f6c3c00f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:26.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.839+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e283d0 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.839+0000 7f6c46e54640 1 --2- 172.21.15.157:0/4012295186 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f6c3c00f3d0 0x7f6c3c00f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:26.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.839+0000 7f6c46e54640 1 --2- 172.21.15.157:0/4012295186 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f6c3c00f3d0 0x7f6c3c00f7f0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:26.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.839+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c380083f0 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.839+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x5611e6e20fc0 2024-05-09T09:49:26.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.839+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.839+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x5611e6e1c5d0 2024-05-09T09:49:26.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.843+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c380083f0 con 0x5611e6e1c5d0 2024-05-09T09:49:26.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.843+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x5611e6e1c5d0 2024-05-09T09:49:26.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.843+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c380083f0 con 0x5611e6e1c5d0 2024-05-09T09:49:26.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.843+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x5611e6e20fc0 2024-05-09T09:49:26.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.843+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.843+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x5611e6e20fc0 2024-05-09T09:49:26.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.843+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.843+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.843+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c380083f0 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.843+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x5611e6e258d0 2024-05-09T09:49:26.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.843+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3c036040 con 0x5611e6e258d0 2024-05-09T09:49:26.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.843+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x5611e6e1c5d0 2024-05-09T09:49:26.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.847+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c380083f0 con 0x5611e6e1c5d0 2024-05-09T09:49:26.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.847+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x5611e6e20fc0 2024-05-09T09:49:26.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.847+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.847+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x5611e6e1c5d0 2024-05-09T09:49:26.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.847+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c380083f0 con 0x5611e6e1c5d0 2024-05-09T09:49:26.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.847+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.847+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6c380083f0 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.847+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x5611e6e258d0 2024-05-09T09:49:26.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.847+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3c036040 con 0x5611e6e258d0 2024-05-09T09:49:26.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.847+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x5611e6e258d0 2024-05-09T09:49:26.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.847+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6c3c036040 con 0x5611e6e258d0 2024-05-09T09:49:26.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.847+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x5611e6e20fc0 2024-05-09T09:49:26.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.847+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.847+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x5611e6e258d0 2024-05-09T09:49:26.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.847+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3c036040 con 0x5611e6e258d0 2024-05-09T09:49:26.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.847+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x5611e6e258d0 2024-05-09T09:49:26.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.847+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3c036040 con 0x5611e6e258d0 2024-05-09T09:49:26.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.847+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x5611e6e1c5d0 2024-05-09T09:49:26.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.847+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c380083f0 con 0x5611e6e1c5d0 2024-05-09T09:49:26.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.847+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x5611e6e1c5d0 2024-05-09T09:49:26.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.847+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6c380083f0 con 0x5611e6e1c5d0 2024-05-09T09:49:26.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.847+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x5611e6e20fc0 2024-05-09T09:49:26.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.851+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.851+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x5611e6e258d0 2024-05-09T09:49:26.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.851+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3c036040 con 0x5611e6e258d0 2024-05-09T09:49:26.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.851+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.851+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c380083f0 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.851+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x5611e6e1c5d0 2024-05-09T09:49:26.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.851+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c380083f0 con 0x5611e6e1c5d0 2024-05-09T09:49:26.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.851+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x5611e6e20fc0 2024-05-09T09:49:26.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.851+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.851+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x5611e6e258d0 2024-05-09T09:49:26.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.851+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3c036040 con 0x5611e6e258d0 2024-05-09T09:49:26.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.851+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x5611e6e20fc0 2024-05-09T09:49:26.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.851+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.851+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.851+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c380083f0 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.851+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x5611e6e258d0 2024-05-09T09:49:26.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3c048040 con 0x5611e6e258d0 2024-05-09T09:49:26.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x5611e6e20fc0 2024-05-09T09:49:26.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x5611e6e1c5d0 2024-05-09T09:49:26.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6c380083f0 con 0x5611e6e1c5d0 2024-05-09T09:49:26.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e20260 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c380083f0 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c48b38980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:49:26.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c48b38980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:49:26.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c48b38980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:49:26.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c48b38980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:49:26.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c48b38980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:49:26.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c48b38980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:49:26.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c48b38980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e24240 con 0x5611e6e1c5d0 2024-05-09T09:49:26.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c380083f0 con 0x5611e6e1c5d0 2024-05-09T09:49:26.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c48b38980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:26.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c48b38980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e24240 con 0x5611e6e1c5d0 2024-05-09T09:49:26.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6c380083f0 con 0x5611e6e1c5d0 2024-05-09T09:49:26.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c48b38980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:26.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c48b38980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e24240 con 0x5611e6e258d0 2024-05-09T09:49:26.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6c3c048040 con 0x5611e6e258d0 2024-05-09T09:49:26.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c48b38980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:49:26.859 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c48b38980 20 zone default found 2024-05-09T09:49:26.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c48b38980 4 Realm: () 2024-05-09T09:49:26.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c48b38980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:49:26.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c48b38980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:49:26.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c48b38980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:49:26.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c48b38980 20 zonegroup default 2024-05-09T09:49:26.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c48b38980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e24c40 con 0x5611e6e20fc0 2024-05-09T09:49:26.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c48b38980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:26.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c48b38980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e24880 con 0x5611e6e258d0 2024-05-09T09:49:26.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c3c048040 con 0x5611e6e258d0 2024-05-09T09:49:26.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c48b38980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:26.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c48b38980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.855+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e2a7d0 con 0x5611e6e258d0 2024-05-09T09:49:26.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.859+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c3c048040 con 0x5611e6e258d0 2024-05-09T09:49:26.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.859+0000 7f6c48b38980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:26.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.859+0000 7f6c48b38980 20 started sync module instance, tier type = 2024-05-09T09:49:26.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.859+0000 7f6c48b38980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:49:26.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.859+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e29b70 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.859+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c380083f0 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.859+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94634888044688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e29b70 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.859+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e2b290 con 0x5611e6e1c5d0 2024-05-09T09:49:26.862 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.859+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94634888044688] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c38035040 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.859+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c38035040 con 0x5611e6e1c5d0 2024-05-09T09:49:26.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.859+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94634888048032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e29b70 con 0x5611e6e1c5d0 2024-05-09T09:49:26.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.859+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e2bca0 con 0x5611e6e258d0 2024-05-09T09:49:26.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.863+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94634888048032] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c38035040 con 0x5611e6e1c5d0 2024-05-09T09:49:26.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.863+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3c048040 con 0x5611e6e258d0 2024-05-09T09:49:26.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.863+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94634888042176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e29ae0 con 0x5611e6e258d0 2024-05-09T09:49:26.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.863+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e2ca30 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.863+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c38035040 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.863+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94634888054080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e2c960 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.863+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e2d8f0 con 0x5611e6e1c5d0 2024-05-09T09:49:26.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.867+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94634888042176] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3c048040 con 0x5611e6e258d0 2024-05-09T09:49:26.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.867+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94634888054080] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c38035040 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.867+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c38035040 con 0x5611e6e1c5d0 2024-05-09T09:49:26.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.867+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94634888052880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e2d440 con 0x5611e6e1c5d0 2024-05-09T09:49:26.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.867+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e2e190 con 0x5611e6e20fc0 2024-05-09T09:49:26.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.867+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94634888052880] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c38035040 con 0x5611e6e1c5d0 2024-05-09T09:49:26.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.867+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.867+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94634888060128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e2d440 con 0x5611e6e20fc0 2024-05-09T09:49:26.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.867+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e2e9e0 con 0x5611e6e20fc0 2024-05-09T09:49:26.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.871+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.871+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94634888064384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e2f650 con 0x5611e6e20fc0 2024-05-09T09:49:26.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.871+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e30050 con 0x5611e6e20fc0 2024-05-09T09:49:26.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.871+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94634888060128] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.871+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94634888064384] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.875+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.875+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94634888056272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e2f1a0 con 0x5611e6e20fc0 2024-05-09T09:49:26.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.875+0000 7f6c48b38980 20 add_watcher() i=0 2024-05-09T09:49:26.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.875+0000 7f6c48b38980 20 add_watcher() i=1 2024-05-09T09:49:26.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.875+0000 7f6c48b38980 20 add_watcher() i=2 2024-05-09T09:49:26.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.875+0000 7f6c48b38980 20 add_watcher() i=3 2024-05-09T09:49:26.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.875+0000 7f6c48b38980 20 add_watcher() i=4 2024-05-09T09:49:26.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.875+0000 7f6c48b38980 20 add_watcher() i=5 2024-05-09T09:49:26.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.875+0000 7f6c48b38980 20 add_watcher() i=6 2024-05-09T09:49:26.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.875+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94634888056272] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.875+0000 7f6c48b38980 20 add_watcher() i=7 2024-05-09T09:49:26.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.875+0000 7f6c48b38980 2 all 8 watchers are set, enabling cache 2024-05-09T09:49:26.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.875+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e33150 con 0x5611e6e1c5d0 2024-05-09T09:49:26.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.875+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6c38035040 con 0x5611e6e1c5d0 2024-05-09T09:49:26.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.875+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94634888067936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e305d0 con 0x5611e6e1c5d0 2024-05-09T09:49:26.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.879+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94634888067936] v32'415 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c38035040 con 0x5611e6e1c5d0 2024-05-09T09:49:26.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.879+0000 7f6afbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:26.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.879+0000 7f6c48b38980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:49:26.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.879+0000 7f6c48b38980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:49:26.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.879+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3b890 con 0x5611e6e1c5d0 2024-05-09T09:49:26.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.879+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'96 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c38035040 con 0x5611e6e1c5d0 2024-05-09T09:49:26.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.879+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3bf60 con 0x5611e6e20fc0 2024-05-09T09:49:26.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.883+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'91 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.883+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3bf60 con 0x5611e6e258d0 2024-05-09T09:49:26.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.883+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'90 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c3c048040 con 0x5611e6e258d0 2024-05-09T09:49:26.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.883+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3c550 con 0x5611e6e1c5d0 2024-05-09T09:49:26.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.887+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'416 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c38035040 con 0x5611e6e1c5d0 2024-05-09T09:49:26.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.887+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3c910 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.887+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'257 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c38035040 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.887+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3cd50 con 0x5611e6e258d0 2024-05-09T09:49:26.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.887+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'172 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c3c048040 con 0x5611e6e258d0 2024-05-09T09:49:26.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.887+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3d2c0 con 0x5611e6e1c5d0 2024-05-09T09:49:26.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.891+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'91 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c38035040 con 0x5611e6e1c5d0 2024-05-09T09:49:26.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.891+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3d350 con 0x5611e6e20fc0 2024-05-09T09:49:26.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.891+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'171 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.891+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3d770 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.895+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'89 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c38035040 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.895+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3d770 con 0x5611e6e258d0 2024-05-09T09:49:26.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.895+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'95 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c3c048040 con 0x5611e6e258d0 2024-05-09T09:49:26.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.895+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3d770 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.895+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'258 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c38035040 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.895+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3d770 con 0x5611e6e20fc0 2024-05-09T09:49:26.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.899+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'95 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.899+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3d870 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.899+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'89 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c38035040 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.899+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3d870 con 0x5611e6e20fc0 2024-05-09T09:49:26.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.903+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'177 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.903+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3d870 con 0x5611e6e1c5d0 2024-05-09T09:49:26.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.903+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'417 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c38035040 con 0x5611e6e1c5d0 2024-05-09T09:49:26.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.903+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3d870 con 0x5611e6e258d0 2024-05-09T09:49:26.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.907+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'251 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c3c048040 con 0x5611e6e258d0 2024-05-09T09:49:26.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.907+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3df10 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.907+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'259 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c38035040 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.907+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3def0 con 0x5611e6e258d0 2024-05-09T09:49:26.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.911+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'89 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c3c048040 con 0x5611e6e258d0 2024-05-09T09:49:26.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.911+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3def0 con 0x5611e6e1c5d0 2024-05-09T09:49:26.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.911+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'97 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c38035040 con 0x5611e6e1c5d0 2024-05-09T09:49:26.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.911+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3dd20 con 0x5611e6e1c5d0 2024-05-09T09:49:26.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.915+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'418 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c38035040 con 0x5611e6e1c5d0 2024-05-09T09:49:26.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.915+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3dd20 con 0x5611e6e258d0 2024-05-09T09:49:26.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.915+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'252 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c3c048040 con 0x5611e6e258d0 2024-05-09T09:49:26.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.915+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3dd20 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.919+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'101 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c38035040 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.919+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3dd20 con 0x5611e6e258d0 2024-05-09T09:49:26.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.919+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'91 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c3c048040 con 0x5611e6e258d0 2024-05-09T09:49:26.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.919+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3dd20 con 0x5611e6e258d0 2024-05-09T09:49:26.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.919+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'95 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c3c048040 con 0x5611e6e258d0 2024-05-09T09:49:26.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.923+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3dd20 con 0x5611e6e258d0 2024-05-09T09:49:26.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.923+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'86 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c3c048040 con 0x5611e6e258d0 2024-05-09T09:49:26.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.923+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3dd20 con 0x5611e6e258d0 2024-05-09T09:49:26.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.923+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'173 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c3c048040 con 0x5611e6e258d0 2024-05-09T09:49:26.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.923+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3dd20 con 0x5611e6e20fc0 2024-05-09T09:49:26.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.927+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'91 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.927+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3dd20 con 0x5611e6e258d0 2024-05-09T09:49:26.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.927+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'90 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c3c048040 con 0x5611e6e258d0 2024-05-09T09:49:26.929 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.927+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3dd20 con 0x5611e6e20fc0 2024-05-09T09:49:26.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.931+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'172 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.931+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3dd20 con 0x5611e6e258d0 2024-05-09T09:49:26.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.935+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'253 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c3c048040 con 0x5611e6e258d0 2024-05-09T09:49:26.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.935+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3dd20 con 0x5611e6e20fc0 2024-05-09T09:49:26.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.935+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'178 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.935+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e3dd20 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.939+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'95 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c38035040 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.939+0000 7f6afafe5640 20 reqs_thread_entry: start 2024-05-09T09:49:26.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.939+0000 7f6c48b38980 20 init_complete bucket index max shards: 11 2024-05-09T09:49:26.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.939+0000 7f6af8fe1640 20 reqs_thread_entry: start 2024-05-09T09:49:26.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.939+0000 7f6c48b38980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-09T09:49:26.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.939+0000 7f6c48b38980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.939+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e597b0 con 0x5611e6e1c5d0 2024-05-09T09:49:26.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.939+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6c38035040 con 0x5611e6e1c5d0 2024-05-09T09:49:26.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.939+0000 7f6c48b38980 20 rados_obj.operate() r=0 bl.length=391 2024-05-09T09:49:26.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.939+0000 7f6c48b38980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-09T09:49:26.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.939+0000 7f6c48b38980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-09T09:49:26.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.939+0000 7f6c48b38980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:49:26.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.939+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e5bb00 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.939+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f6c38035040 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.939+0000 7f6c48b38980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7 : miss 2024-05-09T09:49:26.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.939+0000 7f6c48b38980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.939+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:96 8.e 8:744485c8:root::.bucket.meta.myfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e5bef0 con 0x5611e6e20fc0 2024-05-09T09:49:26.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.943+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(96 .bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.943+0000 7f6c48b38980 20 rados_obj.operate() r=0 bl.length=379 2024-05-09T09:49:26.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.943+0000 7f6c48b38980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7 info.flags=0x17 2024-05-09T09:49:26.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.943+0000 7f6c48b38980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7 to cache LRU end 2024-05-09T09:49:26.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.943+0000 7f6c48b38980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:49:26.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.943+0000 7f6c48b38980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-09T09:49:26.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.943+0000 7f6c48b38980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7 2024-05-09T09:49:26.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.943+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:97 4.1e 4:794093ee:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6ed9290 con 0x5611e6e20fc0 2024-05-09T09:49:26.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.943+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(97 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.943+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 4.36 4:6e27934f:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6ed9290 con 0x5611e6e1c5d0 2024-05-09T09:49:26.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.943+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(98 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.1 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6c38035040 con 0x5611e6e1c5d0 2024-05-09T09:49:26.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.943+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 4.3e 4:7f41edb8:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6ed9290 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.943+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(99 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6c38035040 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.943+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:100 4.33 4:cde13f3f:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6ed9290 con 0x5611e6e20fc0 2024-05-09T09:49:26.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.947+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(100 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.3 [call out=85b] v0'0 uv11 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.947+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:101 4.3f 4:fc3573c1:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6ed9310 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.947+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(101 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.4 [call out=425b] v0'0 uv3 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f6c38035040 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.947+0000 7f6c48b38980 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-05-09T09:49:26.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.947+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 4.12 4:49207d62:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6ed9310 con 0x5611e6e1c5d0 2024-05-09T09:49:26.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.947+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(102 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6c38035040 con 0x5611e6e1c5d0 2024-05-09T09:49:26.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.947+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 4.12 4:499c250e:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6ed9920 con 0x5611e6e1c5d0 2024-05-09T09:49:26.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.947+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(103 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.6 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6c38035040 con 0x5611e6e1c5d0 2024-05-09T09:49:26.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.947+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:104 4.f 4:f02fbd0a:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6ed9920 con 0x5611e6e1c5d0 2024-05-09T09:49:26.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.947+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(104 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6c38035040 con 0x5611e6e1c5d0 2024-05-09T09:49:26.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.947+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:105 4.32 4:4e0437e2:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6ed9920 con 0x5611e6e1c5d0 2024-05-09T09:49:26.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.947+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(105 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6c38035040 con 0x5611e6e1c5d0 2024-05-09T09:49:26.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.947+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:106 4.31 4:8dbb3e8b:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6ed9920 con 0x5611e6e1c5d0 2024-05-09T09:49:26.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.947+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(106 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.9 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6c38047060 con 0x5611e6e1c5d0 2024-05-09T09:49:26.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.947+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:107 4.1e 4:78d7a7bc:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6ed9920 con 0x5611e6e20fc0 2024-05-09T09:49:26.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.951+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(107 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.10 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.951+0000 7f6c48b38980 20 get_obj_state: octx=0x7f6c38008c50 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x5611e6ed7528 s->prefetch_data=0 2024-05-09T09:49:26.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.951+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:108 3.2fs0 3:f70c6127:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6ed8410 con 0x5611e6e258d0 2024-05-09T09:49:26.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.951+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(108 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f6c3c048040 con 0x5611e6e258d0 2024-05-09T09:49:26.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.951+0000 7f6c48b38980 10 manifest: total_size = 6 2024-05-09T09:49:26.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.951+0000 7f6c48b38980 20 get_obj_state: setting s->obj_tag to b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.9206151883561382189 2024-05-09T09:49:26.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.951+0000 7f6c48b38980 20 get_obj_state: octx=0x7f6c38008c50 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x5611e6ed7528 s->prefetch_data=0 2024-05-09T09:49:26.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.951+0000 7f6c48b38980 20 prepare_atomic_modification: state is not atomic. state=0x5611e6ed7528 2024-05-09T09:49:26.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.951+0000 7f6c48b38980 20 bucket index object: :.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.4 2024-05-09T09:49:26.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.951+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:109 4.3f 4:fc3573c1:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60460 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.951+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(109 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.4 [stat,call,call] v32'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f6c38047060 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.951+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:110 3.2fs0 3:f70c6127:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e5e440 con 0x5611e6e258d0 2024-05-09T09:49:26.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.955+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(110 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7_15f6f8dc036519d7fe15b39338f6e5db [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f6c3c048040 con 0x5611e6e258d0 2024-05-09T09:49:26.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.955+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:111 4.3f 4:fc3573c1:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.955+0000 7f6c48b38980 20 list_objects_ordered: starting attempt 1 2024-05-09T09:49:26.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.955+0000 7f6c48b38980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-09T09:49:26.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.955+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:112 4.1e 4:794093ee:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e62870 con 0x5611e6e20fc0 2024-05-09T09:49:26.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.955+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:113 4.36 4:6e27934f:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e64c70 con 0x5611e6e1c5d0 2024-05-09T09:49:26.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.955+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:114 4.3e 4:7f41edb8:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e62870 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.955+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:115 4.33 4:cde13f3f:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e64c70 con 0x5611e6e20fc0 2024-05-09T09:49:26.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.955+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:116 4.3f 4:fc3573c1:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e64c70 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.955+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:117 4.12 4:49207d62:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e6e610 con 0x5611e6e1c5d0 2024-05-09T09:49:26.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.955+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(113 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.1 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6c38047060 con 0x5611e6e1c5d0 2024-05-09T09:49:26.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.955+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(115 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.3 [call out=85b] v0'0 uv11 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.955+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(112 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.955+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:118 4.12 4:499c250e:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e71440 con 0x5611e6e1c5d0 2024-05-09T09:49:26.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.955+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:119 4.f 4:f02fbd0a:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e69720 con 0x5611e6e1c5d0 2024-05-09T09:49:26.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.955+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(117 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6c38047060 con 0x5611e6e1c5d0 2024-05-09T09:49:26.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.955+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:120 4.32 4:4e0437e2:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e67a40 con 0x5611e6e1c5d0 2024-05-09T09:49:26.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.955+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(114 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6c38047060 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.955+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:121 4.31 4:8dbb3e8b:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e6d150 con 0x5611e6e1c5d0 2024-05-09T09:49:26.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.955+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:122 4.1e 4:78d7a7bc:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e71440 con 0x5611e6e20fc0 2024-05-09T09:49:26.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.955+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 23 ==== osd_op_reply(111 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.4 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f6c38047060 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.955+0000 7f6b28b9e640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-05-09T09:49:26.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 24 ==== osd_op_reply(116 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.4 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f6c38047060 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 36 ==== osd_op_reply(121 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.9 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6c38047060 con 0x5611e6e1c5d0 2024-05-09T09:49:26.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 37 ==== osd_op_reply(120 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6c38047060 con 0x5611e6e1c5d0 2024-05-09T09:49:26.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 38 ==== osd_op_reply(118 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.6 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6c38047060 con 0x5611e6e1c5d0 2024-05-09T09:49:26.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 39 ==== osd_op_reply(119 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6c38047060 con 0x5611e6e1c5d0 2024-05-09T09:49:26.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(122 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.10 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c48b38980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-09T09:49:26.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c48b38980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-09T09:49:26.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c48b38980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-09T09:49:26.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c48b38980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-09T09:49:26.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c48b38980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7])"; uploads.size()=0; is_truncated=0 2024-05-09T09:49:26.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:123 4.1e 4:794093ee:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x5611e6e20fc0 2024-05-09T09:49:26.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:124 4.36 4:6e27934f:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e6e5e0 con 0x5611e6e1c5d0 2024-05-09T09:49:26.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:125 4.3e 4:7f41edb8:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e6ef30 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:126 4.33 4:cde13f3f:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e71390 con 0x5611e6e20fc0 2024-05-09T09:49:26.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:127 4.3f 4:fc3573c1:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e67570 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:128 4.12 4:49207d62:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e6e5e0 con 0x5611e6e1c5d0 2024-05-09T09:49:26.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:129 4.12 4:499c250e:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e71390 con 0x5611e6e1c5d0 2024-05-09T09:49:26.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:130 4.f 4:f02fbd0a:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e67570 con 0x5611e6e1c5d0 2024-05-09T09:49:26.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:131 4.32 4:4e0437e2:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e71390 con 0x5611e6e1c5d0 2024-05-09T09:49:26.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:132 4.31 4:8dbb3e8b:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e6ef30 con 0x5611e6e1c5d0 2024-05-09T09:49:26.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:133 4.1e 4:78d7a7bc:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e6d110 con 0x5611e6e20fc0 2024-05-09T09:49:26.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 40 ==== osd_op_reply(128 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6c38047060 con 0x5611e6e1c5d0 2024-05-09T09:49:26.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 41 ==== osd_op_reply(130 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6c38047060 con 0x5611e6e1c5d0 2024-05-09T09:49:26.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 42 ==== osd_op_reply(131 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6c38047060 con 0x5611e6e1c5d0 2024-05-09T09:49:26.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 43 ==== osd_op_reply(124 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.1 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6c38047060 con 0x5611e6e1c5d0 2024-05-09T09:49:26.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 44 ==== osd_op_reply(129 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.6 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6c38047060 con 0x5611e6e1c5d0 2024-05-09T09:49:26.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 25 ==== osd_op_reply(125 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6c38047060 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 26 ==== osd_op_reply(127 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.4 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f6c38047060 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 32 ==== osd_op_reply(126 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.3 [call out=85b] v0'0 uv11 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 33 ==== osd_op_reply(123 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 45 ==== osd_op_reply(132 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.9 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6c38047060 con 0x5611e6e1c5d0 2024-05-09T09:49:26.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 34 ==== osd_op_reply(133 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.10 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.959+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.963+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 27 ==== osd_op_reply(134 foo.buckets [call] v32'50 uv50 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6c38047060 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.963+0000 7f6c48b38980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-09T09:49:26.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.963+0000 7f6c48b38980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.963+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.963+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 28 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f6c38047060 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.963+0000 7f6c48b38980 20 rados_obj.operate() r=0 bl.length=165 2024-05-09T09:49:26.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.963+0000 7f6c48b38980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-09T09:49:26.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.963+0000 7f6c48b38980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-09T09:49:26.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.963+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.963+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 29 ==== osd_op_reply(136 myfoo [call,call,delete] v32'51 uv51 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f6c38047060 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.963+0000 7f6c48b38980 10 removing default.rgw.meta+root+myfoo from cache 2024-05-09T09:49:26.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.963+0000 7f6c48b38980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-09T09:49:26.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.963+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94634888759504 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e6ea80 con 0x5611e6e20fc0 2024-05-09T09:49:26.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.963+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 35 ==== watch-notify(notify (1) cookie 94634888064384 notify 137438953515 ret 0) ==== 191+0+0 (crc 0 0 0) 0x5611e6e5b0a0 con 0x5611e6e20fc0 2024-05-09T09:49:26.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.963+0000 7f6b28b9e640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953515 cookie 94634888064384 notifier 4789 bl.length()=149 2024-05-09T09:49:26.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.963+0000 7f6b28b9e640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6b08005580 con 0x5611e6e20fc0 2024-05-09T09:49:26.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.963+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 36 ==== osd_op_reply(137 notify.6 [notify cookie 94634888759504 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.967+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 37 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.967+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 38 ==== watch-notify(notify_complete (2) cookie 94634888759504 notify 137438953515 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6c400d5040 con 0x5611e6e20fc0 2024-05-09T09:49:26.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.967+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:139 8.e 8:744485c8:root::.bucket.meta.myfoo%3ab73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x5611e6e20fc0 2024-05-09T09:49:26.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.967+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 39 ==== osd_op_reply(139 .bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7 [call,call,delete] v32'9 uv9 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f6c400ea070 con 0x5611e6e20fc0 2024-05-09T09:49:26.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.967+0000 7f6c48b38980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7 from cache 2024-05-09T09:49:26.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.967+0000 7f6c48b38980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7, ofs0, ns] 2024-05-09T09:49:26.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.967+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:140 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94634888759504 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x5611e6e20fc0 2024-05-09T09:49:26.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.971+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 40 ==== watch-notify(notify (1) cookie 94634888064384 notify 137438953516 ret 0) ==== 248+0+0 (crc 0 0 0) 0x7f6c400d5040 con 0x5611e6e20fc0 2024-05-09T09:49:26.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.971+0000 7f6b17fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953516 cookie 94634888064384 notifier 4789 bl.length()=206 2024-05-09T09:49:26.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.971+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 41 ==== osd_op_reply(140 notify.6 [notify cookie 94634888759504 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6c40136020 con 0x5611e6e20fc0 2024-05-09T09:49:26.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.971+0000 7f6b17fff640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:141 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6a6c003930 con 0x5611e6e20fc0 2024-05-09T09:49:26.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.971+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 42 ==== osd_op_reply(141 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c40136020 con 0x5611e6e20fc0 2024-05-09T09:49:26.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.971+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 43 ==== watch-notify(notify_complete (2) cookie 94634888759504 notify 137438953516 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5611e6dc8970 con 0x5611e6e20fc0 2024-05-09T09:49:26.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.971+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:142 4.1e 4:794093ee:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x5611e6e20fc0 2024-05-09T09:49:26.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.971+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:143 4.36 4:6e27934f:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6ed72e0 con 0x5611e6e1c5d0 2024-05-09T09:49:26.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.971+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:144 4.3e 4:7f41edb8:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e613b0 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.971+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:145 4.33 4:cde13f3f:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x5611e6e20fc0 2024-05-09T09:49:26.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.971+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:146 4.3f 4:fc3573c1:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6ed72e0 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.971+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:147 4.12 4:49207d62:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e5a320 con 0x5611e6e1c5d0 2024-05-09T09:49:26.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.971+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:148 4.12 4:499c250e:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e613b0 con 0x5611e6e1c5d0 2024-05-09T09:49:26.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.971+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:149 4.f 4:f02fbd0a:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x5611e6e1c5d0 2024-05-09T09:49:26.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.971+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:150 4.32 4:4e0437e2:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6ed72e0 con 0x5611e6e1c5d0 2024-05-09T09:49:26.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.971+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:151 4.31 4:8dbb3e8b:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e5a320 con 0x5611e6e1c5d0 2024-05-09T09:49:26.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.971+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:152 4.1e 4:78d7a7bc:::.dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e613b0 con 0x5611e6e20fc0 2024-05-09T09:49:26.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.975+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 30 ==== osd_op_reply(146 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.4 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6c38047060 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.975+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 44 ==== osd_op_reply(142 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.0 [delete] v32'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6c40136020 con 0x5611e6e20fc0 2024-05-09T09:49:26.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.975+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 46 ==== osd_op_reply(150 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.8 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6c38047060 con 0x5611e6e1c5d0 2024-05-09T09:49:26.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.975+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 47 ==== osd_op_reply(151 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.9 [delete] v32'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6c38047060 con 0x5611e6e1c5d0 2024-05-09T09:49:26.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.975+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 48 ==== osd_op_reply(149 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.7 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6c38047060 con 0x5611e6e1c5d0 2024-05-09T09:49:26.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.975+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 49 ==== osd_op_reply(143 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.1 [delete] v32'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6c38047060 con 0x5611e6e1c5d0 2024-05-09T09:49:26.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.975+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 50 ==== osd_op_reply(147 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.5 [delete] v32'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6c38047060 con 0x5611e6e1c5d0 2024-05-09T09:49:26.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.975+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 51 ==== osd_op_reply(148 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.6 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6c38047060 con 0x5611e6e1c5d0 2024-05-09T09:49:26.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.975+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 45 ==== osd_op_reply(145 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.3 [delete] v32'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6c40136020 con 0x5611e6e20fc0 2024-05-09T09:49:26.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.975+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 31 ==== osd_op_reply(144 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.2 [delete] v32'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6c38047060 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.975+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 46 ==== osd_op_reply(152 .dir.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7.10 [delete] v32'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f6c40136020 con 0x5611e6e20fc0 2024-05-09T09:49:26.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.975+0000 7f6c48b38980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7 : miss 2024-05-09T09:49:26.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.975+0000 7f6c48b38980 20 rados->read ofs=0 len=0 2024-05-09T09:49:26.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.975+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:153 6.5 6:a0e77537:::pubsub..bucket.myfoo%2fb73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.975+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 32 ==== osd_op_reply(153 pubsub..bucket.myfoo/b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f6c38047060 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.975+0000 7f6c48b38980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:26.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.975+0000 7f6c48b38980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7 info.flags=0x0 2024-05-09T09:49:26.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.975+0000 7f6c48b38980 10 adding default.rgw.log++pubsub..bucket.myfoo/b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7 to cache LRU end 2024-05-09T09:49:26.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.975+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:154 6.5 6:a0e77537:::pubsub..bucket.myfoo%2fb73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.975+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 33 ==== osd_op_reply(154 pubsub..bucket.myfoo/b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.7 [delete] v32'16 uv15 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f6c38047060 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.975+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.979+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 34 ==== osd_op_reply(155 foo.buckets [call] v32'52 uv52 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6c38047060 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.979+0000 7f6c48b38980 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-05-09T09:49:26.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.979+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x5611e6e20fc0 2024-05-09T09:49:26.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.983+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 47 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v32'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f6c40136020 con 0x5611e6e20fc0 2024-05-09T09:49:26.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.983+0000 7f6c48b38980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-05-09T09:49:26.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.983+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94634888759504 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.983+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 35 ==== watch-notify(notify (1) cookie 94634888054080 notify 137438953491 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5611e6e3c720 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.983+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 36 ==== osd_op_reply(157 notify.3 [notify cookie 94634888759504 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6c38047060 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.983+0000 7f6b28b9e640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953491 cookie 94634888054080 notifier 4789 bl.length()=170 2024-05-09T09:49:26.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.983+0000 7f6b28b9e640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6b08005580 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.983+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 37 ==== watch-notify(notify_complete (2) cookie 94634888759504 notify 137438953491 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5611e6e3c550 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.983+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 38 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c38047060 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.983+0000 7f6c48b38980 10 removing email index: foo@foo.com 2024-05-09T09:49:26.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.983+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x5611e6e1c5d0 2024-05-09T09:49:26.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.987+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 52 ==== osd_op_reply(159 foo@foo.com [delete] v32'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6c38047060 con 0x5611e6e1c5d0 2024-05-09T09:49:26.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.987+0000 7f6c48b38980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-05-09T09:49:26.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.987+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94634888759504 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.987+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 39 ==== watch-notify(notify (1) cookie 94634888054080 notify 137438953492 ret 0) ==== 204+0+0 (crc 0 0 0) 0x5611e6e3c550 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.987+0000 7f6b28b9e640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953492 cookie 94634888054080 notifier 4789 bl.length()=162 2024-05-09T09:49:26.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.987+0000 7f6b28b9e640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6b08005580 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.987+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 40 ==== osd_op_reply(160 notify.3 [notify cookie 94634888759504 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6c38047060 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.987+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 41 ==== watch-notify(notify_complete (2) cookie 94634888759504 notify 137438953492 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5611e6e3c180 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.987+0000 7f6c48b38980 10 removing user buckets index 2024-05-09T09:49:26.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.987+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 42 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c38047060 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.987+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.987+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 43 ==== osd_op_reply(162 foo.buckets [delete] v32'53 uv53 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6c38047060 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.987+0000 7f6c48b38980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-05-09T09:49:26.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.987+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94634888759504 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x5611e6e20fc0 2024-05-09T09:49:26.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.991+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 48 ==== watch-notify(notify (1) cookie 94634888060128 notify 137438953517 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5611e6dc8970 con 0x5611e6e20fc0 2024-05-09T09:49:26.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.991+0000 7f6b17fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953517 cookie 94634888060128 notifier 4789 bl.length()=160 2024-05-09T09:49:26.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.991+0000 7f6b17fff640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6a6c0038d0 con 0x5611e6e20fc0 2024-05-09T09:49:26.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.991+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 49 ==== osd_op_reply(163 notify.5 [notify cookie 94634888759504 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6c40136020 con 0x5611e6e20fc0 2024-05-09T09:49:26.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.991+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 50 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c40136020 con 0x5611e6e20fc0 2024-05-09T09:49:26.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.991+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 51 ==== watch-notify(notify_complete (2) cookie 94634888759504 notify 137438953517 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5611e6dc5d30 con 0x5611e6e20fc0 2024-05-09T09:49:26.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.991+0000 7f6c48b38980 10 removing user index: foo 2024-05-09T09:49:26.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.991+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x5611e6e1c5d0 2024-05-09T09:49:26.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.991+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 53 ==== osd_op_reply(165 foo [call,call,delete] v32'23 uv23 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f6c38047060 con 0x5611e6e1c5d0 2024-05-09T09:49:26.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.991+0000 7f6c48b38980 10 removing default.rgw.meta+users.uid+foo from cache 2024-05-09T09:49:26.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.991+0000 7f6c48b38980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-09T09:49:26.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.991+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94634888759504 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x5611e6e1c5d0 2024-05-09T09:49:26.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.991+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 54 ==== watch-notify(notify (1) cookie 94634888052880 notify 137438953502 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5611e6e3c180 con 0x5611e6e1c5d0 2024-05-09T09:49:26.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.991+0000 7f6b28b9e640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953502 cookie 94634888052880 notifier 4789 bl.length()=152 2024-05-09T09:49:26.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.991+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 55 ==== osd_op_reply(166 notify.4 [notify cookie 94634888759504 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6c38047060 con 0x5611e6e1c5d0 2024-05-09T09:49:26.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.991+0000 7f6b28b9e640 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6b08005580 con 0x5611e6e1c5d0 2024-05-09T09:49:26.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.995+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 56 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c38047060 con 0x5611e6e1c5d0 2024-05-09T09:49:26.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.995+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 57 ==== watch-notify(notify_complete (2) cookie 94634888759504 notify 137438953502 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5611e6e3bfb0 con 0x5611e6e1c5d0 2024-05-09T09:49:26.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.995+0000 7f6afbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:26.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.995+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94634888067936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x5611e6e1c5d0 2024-05-09T09:49:26.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.995+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 58 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94634888067936] v32'419 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c38047060 con 0x5611e6e1c5d0 2024-05-09T09:49:26.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.995+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94634888044688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.999+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 44 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94634888044688] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c38047060 con 0x7f6c3c00f3d0 2024-05-09T09:49:26.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.999+0000 7f6c48b38980 20 remove_watcher() i=0 2024-05-09T09:49:27.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.999+0000 7f6c48b38980 2 removed watcher, disabling cache 2024-05-09T09:49:27.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.999+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94634888048032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x5611e6e1c5d0 2024-05-09T09:49:27.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.999+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 59 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94634888048032] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c38047060 con 0x5611e6e1c5d0 2024-05-09T09:49:27.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.999+0000 7f6c48b38980 20 remove_watcher() i=1 2024-05-09T09:49:27.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:26.999+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94634888042176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x5611e6e258d0 2024-05-09T09:49:27.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.003+0000 7f6c45e52640 1 -- 172.21.15.157:0/4012295186 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94634888042176] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3c048040 con 0x5611e6e258d0 2024-05-09T09:49:27.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.003+0000 7f6c48b38980 20 remove_watcher() i=2 2024-05-09T09:49:27.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.003+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94634888054080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x7f6c3c00f3d0 2024-05-09T09:49:27.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.003+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.2 v2:172.21.15.157:6800/354455204 45 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94634888054080] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c38047060 con 0x7f6c3c00f3d0 2024-05-09T09:49:27.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.003+0000 7f6c48b38980 20 remove_watcher() i=3 2024-05-09T09:49:27.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.003+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94634888052880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x5611e6e1c5d0 2024-05-09T09:49:27.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.007+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 <== osd.1 v2:172.21.15.157:6808/3930131338 60 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94634888052880] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3805b040 con 0x5611e6e1c5d0 2024-05-09T09:49:27.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.007+0000 7f6c48b38980 20 remove_watcher() i=4 2024-05-09T09:49:27.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.007+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94634888060128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x5611e6e20fc0 2024-05-09T09:49:27.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.007+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 52 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94634888060128] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c40136020 con 0x5611e6e20fc0 2024-05-09T09:49:27.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.007+0000 7f6c48b38980 20 remove_watcher() i=5 2024-05-09T09:49:27.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.007+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94634888064384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x5611e6e20fc0 2024-05-09T09:49:27.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.011+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 53 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94634888064384] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c40136020 con 0x5611e6e20fc0 2024-05-09T09:49:27.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.011+0000 7f6c48b38980 20 remove_watcher() i=6 2024-05-09T09:49:27.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.011+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94634888056272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611e6e60a40 con 0x5611e6e20fc0 2024-05-09T09:49:27.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c46653640 1 -- 172.21.15.157:0/4012295186 <== osd.0 v2:172.21.15.110:6800/231209037 54 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94634888056272] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c40136020 con 0x5611e6e20fc0 2024-05-09T09:49:27.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 20 remove_watcher() i=7 2024-05-09T09:49:27.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5611e6e20fc0 msgr2=0x5611e6e233b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 --2- 172.21.15.157:0/4012295186 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5611e6e20fc0 0x5611e6e233b0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5611e6e1c5d0 msgr2=0x5611e6e1ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 --2- 172.21.15.157:0/4012295186 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5611e6e1c5d0 0x5611e6e1ea90 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f6c3c00f3d0 msgr2=0x7f6c3c00f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 --2- 172.21.15.157:0/4012295186 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f6c3c00f3d0 0x7f6c3c00f7f0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5611e6e258d0 msgr2=0x5611e6e27d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 --2- 172.21.15.157:0/4012295186 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5611e6e258d0 0x5611e6e27d00 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6b10034bb0 msgr2=0x7f6b10037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 --2- 172.21.15.157:0/4012295186 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6b10034bb0 0x7f6b10037070 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c010fd0 tx=0x7f6c3c011000 comp rx=0 tx=0).stop 2024-05-09T09:49:27.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6e08710 msgr2=0x5611e6e0fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 --2- 172.21.15.157:0/4012295186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6e08710 0x5611e6e0fa90 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f6c400dcbe0 tx=0x7f6c400cdf00 comp rx=0 tx=0).stop 2024-05-09T09:49:27.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c46e54640 1 -- 172.21.15.157:0/4012295186 reap_dead start 2024-05-09T09:49:27.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 shutdown_connections 2024-05-09T09:49:27.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 --2- 172.21.15.157:0/4012295186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6e08710 0x5611e6e0fa90 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 >> 172.21.15.157:0/4012295186 conn(0x5611e6e04a50 msgr2=0x5611e6e02150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 shutdown_connections 2024-05-09T09:49:27.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 -- 172.21.15.157:0/4012295186 wait complete. 2024-05-09T09:49:27.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 -- 172.21.15.157:0/2217305346 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6b20034c50 msgr2=0x7f6b20037110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 --2- 172.21.15.157:0/2217305346 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6b20034c50 0x7f6b20037110 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x5611e6dccff0 tx=0x7f6c3c006000 comp rx=0 tx=0).stop 2024-05-09T09:49:27.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 -- 172.21.15.157:0/2217305346 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6dfb960 msgr2=0x5611e6dfbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 --2- 172.21.15.157:0/2217305346 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6dfb960 0x5611e6dfbd80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6c400b2900 tx=0x7f6c400b2c60 comp rx=0 tx=0).stop 2024-05-09T09:49:27.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 -- 172.21.15.157:0/2217305346 shutdown_connections 2024-05-09T09:49:27.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 --2- 172.21.15.157:0/2217305346 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6b20034c50 0x7f6b20037110 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 --2- 172.21.15.157:0/2217305346 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6dfb960 0x5611e6dfbd80 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 -- 172.21.15.157:0/2217305346 >> 172.21.15.157:0/2217305346 conn(0x5611e6df0730 msgr2=0x5611e6df1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 -- 172.21.15.157:0/2217305346 shutdown_connections 2024-05-09T09:49:27.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 -- 172.21.15.157:0/2217305346 wait complete. 2024-05-09T09:49:27.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 -- 172.21.15.157:0/3879457698 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5611e6dcee70 msgr2=0x5611e6dd1260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 --2- 172.21.15.157:0/3879457698 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5611e6dcee70 0x5611e6dd1260 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 -- 172.21.15.157:0/3879457698 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5611e6cd12b0 msgr2=0x5611e6dcc5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 --2- 172.21.15.157:0/3879457698 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5611e6cd12b0 0x5611e6dcc5c0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 -- 172.21.15.157:0/3879457698 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5611e6dd2db0 msgr2=0x5611e6dd51a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 --2- 172.21.15.157:0/3879457698 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5611e6dd2db0 0x5611e6dd51a0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 -- 172.21.15.157:0/3879457698 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6b2c034c50 msgr2=0x7f6b2c037110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 --2- 172.21.15.157:0/3879457698 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6b2c034c50 0x7f6b2c037110 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c000f70 tx=0x7f6c3c001420 comp rx=0 tx=0).stop 2024-05-09T09:49:27.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 -- 172.21.15.157:0/3879457698 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6cd0990 msgr2=0x5611e6dc5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 --2- 172.21.15.157:0/3879457698 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5611e6cd0990 0x5611e6dc5560 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f6c4001b0d0 tx=0x7f6c40017e30 comp rx=0 tx=0).stop 2024-05-09T09:49:27.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c46e54640 1 -- 172.21.15.157:0/3879457698 reap_dead start 2024-05-09T09:49:27.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 -- 172.21.15.157:0/3879457698 shutdown_connections 2024-05-09T09:49:27.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 -- 172.21.15.157:0/3879457698 >> 172.21.15.157:0/3879457698 conn(0x5611e6ccc260 msgr2=0x5611e6c45c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 -- 172.21.15.157:0/3879457698 shutdown_connections 2024-05-09T09:49:27.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.015+0000 7f6c48b38980 1 -- 172.21.15.157:0/3879457698 wait complete. 2024-05-09T09:49:27.032 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-09T09:49:27.032 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-09T09:49:27.032 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-09T09:49:27.114 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:49:27.114 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:49:27.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.115+0000 7f1e5cd2e980 1 Processor -- start 2024-05-09T09:49:27.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.115+0000 7f1e5cd2e980 1 -- start start 2024-05-09T09:49:27.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.115+0000 7f1e5cd2e980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55b5ed4e0030 0x55b5ed4e2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.115+0000 7f1e5cd2e980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b5ed38f440 con 0x55b5ed4dbb30 2024-05-09T09:49:27.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.115+0000 7f1e5cd2e980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55b5ed37a5f0 con 0x55b5ed4e0030 2024-05-09T09:49:27.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.115+0000 7f1e5a048640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55b5ed4e0030 0x55b5ed4e2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.115+0000 7f1e5a048640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55b5ed4e0030 0x55b5ed4e2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38696/0 (socket says 172.21.15.157:38696) 2024-05-09T09:49:27.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.115+0000 7f1e5a048640 1 -- 172.21.15.157:0/994873531 learned_addr learned my addr 172.21.15.157:0/994873531 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.115+0000 7f1e5a048640 1 -- 172.21.15.157:0/994873531 >> v1:172.21.15.110:6789/0 conn(0x55b5ed4dbb30 legacy=0x55b5ed4dbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.115+0000 7f1e5a048640 1 -- 172.21.15.157:0/994873531 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5ed385990 con 0x55b5ed4e0030 2024-05-09T09:49:27.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.115+0000 7f1e59847640 1 -- 172.21.15.157:0/994873531 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3045562157 0 0) 0x55b5ed38f440 con 0x55b5ed4dbb30 2024-05-09T09:49:27.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.119+0000 7f1e5a048640 1 --2- 172.21.15.157:0/994873531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed4e0030 0x55b5ed4e2420 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f1e5000a5c0 tx=0x7f1e5001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d975ce3e249b091e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.119+0000 7f1e59847640 1 -- 172.21.15.157:0/994873531 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e500a6070 con 0x55b5ed4e0030 2024-05-09T09:49:27.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.119+0000 7f1e59847640 1 -- 172.21.15.157:0/994873531 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e500af070 con 0x55b5ed4e0030 2024-05-09T09:49:27.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.119+0000 7f1e59847640 1 -- 172.21.15.157:0/994873531 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e500aa5c0 con 0x55b5ed4e0030 2024-05-09T09:49:27.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.119+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/994873531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed4e0030 msgr2=0x55b5ed4e2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.119+0000 7f1e5cd2e980 1 --2- 172.21.15.157:0/994873531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed4e0030 0x55b5ed4e2420 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f1e5000a5c0 tx=0x7f1e5001b340 comp rx=0 tx=0).stop 2024-05-09T09:49:27.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.119+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/994873531 shutdown_connections 2024-05-09T09:49:27.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.119+0000 7f1e5cd2e980 1 --2- 172.21.15.157:0/994873531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed4e0030 0x55b5ed4e2420 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.119+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/994873531 >> 172.21.15.157:0/994873531 conn(0x55b5ed44f250 msgr2=0x55b5ed44f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.119+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/994873531 shutdown_connections 2024-05-09T09:49:27.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.119+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/994873531 wait complete. 2024-05-09T09:49:27.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.135+0000 7f1e5cd2e980 1 Processor -- start 2024-05-09T09:49:27.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.135+0000 7f1e5cd2e980 1 -- start start 2024-05-09T09:49:27.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.135+0000 7f1e5cd2e980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed4dbb30 0x55b5ed5c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.135+0000 7f1e5cd2e980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b5ed3dcfe0 con 0x55b5ed4dbb30 2024-05-09T09:49:27.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.135+0000 7f1e5a849640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed4dbb30 0x55b5ed5c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.135+0000 7f1e5a849640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed4dbb30 0x55b5ed5c6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38702/0 (socket says 172.21.15.157:38702) 2024-05-09T09:49:27.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.135+0000 7f1e5a849640 1 -- 172.21.15.157:0/2960332327 learned_addr learned my addr 172.21.15.157:0/2960332327 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.135+0000 7f1e5a849640 1 -- 172.21.15.157:0/2960332327 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5ed361ae0 con 0x55b5ed4dbb30 2024-05-09T09:49:27.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.135+0000 7f1e5a849640 1 --2- 172.21.15.157:0/2960332327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed4dbb30 0x55b5ed5c6b00 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00b200 tx=0x7f1e4c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572e1b154b3134bd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.135+0000 7f1d48e09640 1 -- 172.21.15.157:0/2960332327 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e4c016070 con 0x55b5ed4dbb30 2024-05-09T09:49:27.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.135+0000 7f1d48e09640 1 -- 172.21.15.157:0/2960332327 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e4c00d5f0 con 0x55b5ed4dbb30 2024-05-09T09:49:27.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.135+0000 7f1d48e09640 1 -- 172.21.15.157:0/2960332327 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e4c00d950 con 0x55b5ed4dbb30 2024-05-09T09:49:27.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.139+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2960332327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed4dbb30 msgr2=0x55b5ed5c6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.139+0000 7f1e5cd2e980 1 --2- 172.21.15.157:0/2960332327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed4dbb30 0x55b5ed5c6b00 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00b200 tx=0x7f1e4c00b6c0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.139+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2960332327 shutdown_connections 2024-05-09T09:49:27.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.139+0000 7f1e5cd2e980 1 --2- 172.21.15.157:0/2960332327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed4dbb30 0x55b5ed5c6b00 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.139+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2960332327 >> 172.21.15.157:0/2960332327 conn(0x55b5ed44f250 msgr2=0x55b5ed5c2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.139+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2960332327 shutdown_connections 2024-05-09T09:49:27.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.139+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2960332327 wait complete. 2024-05-09T09:49:27.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.139+0000 7f1e5cd2e980 1 Processor -- start 2024-05-09T09:49:27.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.139+0000 7f1e5cd2e980 1 -- start start 2024-05-09T09:49:27.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.139+0000 7f1e5cd2e980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed4dbb30 0x55b5ed5cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.139+0000 7f1e5cd2e980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b5ed4e5450 con 0x55b5ed4dbb30 2024-05-09T09:49:27.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.139+0000 7f1e5a849640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed4dbb30 0x55b5ed5cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.139+0000 7f1e5a849640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed4dbb30 0x55b5ed5cdce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38704/0 (socket says 172.21.15.157:38704) 2024-05-09T09:49:27.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.139+0000 7f1e5a849640 1 -- 172.21.15.157:0/3559502053 learned_addr learned my addr 172.21.15.157:0/3559502053 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.139+0000 7f1e5a849640 1 -- 172.21.15.157:0/3559502053 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5ed5ce220 con 0x55b5ed4dbb30 2024-05-09T09:49:27.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.139+0000 7f1e5a849640 1 --2- 172.21.15.157:0/3559502053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed4dbb30 0x55b5ed5cdce0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00c010 tx=0x7f1e4c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.139+0000 7f1d47606640 1 -- 172.21.15.157:0/3559502053 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e4c016070 con 0x55b5ed4dbb30 2024-05-09T09:49:27.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.139+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/3559502053 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b5ed5ce4b0 con 0x55b5ed4dbb30 2024-05-09T09:49:27.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.139+0000 7f1d47606640 1 -- 172.21.15.157:0/3559502053 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e4c023070 con 0x55b5ed4dbb30 2024-05-09T09:49:27.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.139+0000 7f1d47606640 1 -- 172.21.15.157:0/3559502053 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e4c0012e0 con 0x55b5ed4dbb30 2024-05-09T09:49:27.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.139+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/3559502053 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5ed5d1190 con 0x55b5ed4dbb30 2024-05-09T09:49:27.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.139+0000 7f1d47606640 1 -- 172.21.15.157:0/3559502053 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f1e4c011a40 con 0x55b5ed4dbb30 2024-05-09T09:49:27.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.143+0000 7f1d47606640 1 --2- 172.21.15.157:0/3559502053 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1d40034bb0 0x7f1d40037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.143+0000 7f1d47606640 1 -- 172.21.15.157:0/3559502053 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f1e4c009030 con 0x55b5ed4dbb30 2024-05-09T09:49:27.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.143+0000 7f1e5a048640 1 --2- 172.21.15.157:0/3559502053 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1d40034bb0 0x7f1d40037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.143+0000 7f1e5cd2e980 1 --2- 172.21.15.157:0/3559502053 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b5ed4e0030 0x55b5ed5d4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.143+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/3559502053 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed5d5320 con 0x55b5ed4e0030 2024-05-09T09:49:27.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.143+0000 7f1e5b04a640 1 --2- 172.21.15.157:0/3559502053 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b5ed4e0030 0x55b5ed5d4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.143+0000 7f1e5a048640 1 --2- 172.21.15.157:0/3559502053 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1d40034bb0 0x7f1d40037070 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1e500ae000 tx=0x7f1e500a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.143+0000 7f1e5b04a640 1 --2- 172.21.15.157:0/3559502053 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b5ed4e0030 0x55b5ed5d4cb0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.143+0000 7f1e5b04a640 1 -- 172.21.15.157:0/3559502053 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed4e0030 2024-05-09T09:49:27.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.143+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/3559502053 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed5d23b0 con 0x55b5ed4e0030 2024-05-09T09:49:27.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.143+0000 7f1e5b04a640 1 -- 172.21.15.157:0/3559502053 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed4e0030 2024-05-09T09:49:27.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.143+0000 7f1e5cd2e980 1 --2- 172.21.15.157:0/3559502053 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b5ed5d7650 0x55b5ed5d9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.143+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/3559502053 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed5da110 con 0x55b5ed5d7650 2024-05-09T09:49:27.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.143+0000 7f1e5a849640 1 --2- 172.21.15.157:0/3559502053 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b5ed5d7650 0x55b5ed5d9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.143+0000 7f1e5a849640 1 --2- 172.21.15.157:0/3559502053 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b5ed5d7650 0x55b5ed5d9a40 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.143+0000 7f1e5a849640 1 -- 172.21.15.157:0/3559502053 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1e4c0470d0 con 0x55b5ed5d7650 2024-05-09T09:49:27.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.143+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/3559502053 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed5d64f0 con 0x55b5ed4e0030 2024-05-09T09:49:27.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.143+0000 7f1e5b04a640 1 -- 172.21.15.157:0/3559502053 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed4e0030 2024-05-09T09:49:27.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.143+0000 7f1e5cd2e980 1 --2- 172.21.15.157:0/3559502053 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b5ed5db570 0x55b5ed5dd960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.143+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/3559502053 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed5de060 con 0x55b5ed5db570 2024-05-09T09:49:27.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.147+0000 7f1e5a048640 1 --2- 172.21.15.157:0/3559502053 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b5ed5db570 0x55b5ed5dd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.147+0000 7f1e5a048640 1 --2- 172.21.15.157:0/3559502053 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b5ed5db570 0x55b5ed5dd960 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.147+0000 7f1e5a048640 1 -- 172.21.15.157:0/3559502053 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1e500aaa50 con 0x55b5ed5db570 2024-05-09T09:49:27.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.151+0000 7f1e5cd2e980 1 Processor -- start 2024-05-09T09:49:27.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.151+0000 7f1e5cd2e980 1 -- start start 2024-05-09T09:49:27.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.151+0000 7f1e5cd2e980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed603f50 0x55b5ed604370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.151+0000 7f1e5cd2e980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b5ed3e1020 con 0x55b5ed603f50 2024-05-09T09:49:27.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.151+0000 7f1e5a849640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed603f50 0x55b5ed604370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.151+0000 7f1e5a849640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed603f50 0x55b5ed604370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38720/0 (socket says 172.21.15.157:38720) 2024-05-09T09:49:27.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.151+0000 7f1e5a849640 1 -- 172.21.15.157:0/2313517011 learned_addr learned my addr 172.21.15.157:0/2313517011 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.151+0000 7f1e5a849640 1 -- 172.21.15.157:0/2313517011 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5ed6048b0 con 0x55b5ed603f50 2024-05-09T09:49:27.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.151+0000 7f1e5a849640 1 --2- 172.21.15.157:0/2313517011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed603f50 0x55b5ed604370 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00e920 tx=0x7f1e4c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.151+0000 7f1d3f7fe640 1 -- 172.21.15.157:0/2313517011 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e4c029e40 con 0x55b5ed603f50 2024-05-09T09:49:27.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.151+0000 7f1d3f7fe640 1 -- 172.21.15.157:0/2313517011 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e4c017040 con 0x55b5ed603f50 2024-05-09T09:49:27.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.151+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2313517011 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b5ed605340 con 0x55b5ed603f50 2024-05-09T09:49:27.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.151+0000 7f1d3f7fe640 1 -- 172.21.15.157:0/2313517011 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e4c011120 con 0x55b5ed603f50 2024-05-09T09:49:27.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.151+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2313517011 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5ed605820 con 0x55b5ed603f50 2024-05-09T09:49:27.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.151+0000 7f1d3f7fe640 1 -- 172.21.15.157:0/2313517011 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f1e4c03c030 con 0x55b5ed603f50 2024-05-09T09:49:27.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.151+0000 7f1d3f7fe640 1 --2- 172.21.15.157:0/2313517011 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1d34034bb0 0x7f1d34037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.151+0000 7f1d3f7fe640 1 -- 172.21.15.157:0/2313517011 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f1e4c03a070 con 0x55b5ed603f50 2024-05-09T09:49:27.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.151+0000 7f1e5a048640 1 --2- 172.21.15.157:0/2313517011 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1d34034bb0 0x7f1d34037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.155+0000 7f1e5cd2e980 1 Processor -- start 2024-05-09T09:49:27.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.155+0000 7f1e5cd2e980 1 -- start start 2024-05-09T09:49:27.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.155+0000 7f1e5cd2e980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed6110d0 0x55b5ed6114b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.155+0000 7f1e5cd2e980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b5ed5c7250 con 0x55b5ed6110d0 2024-05-09T09:49:27.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.155+0000 7f1e5a048640 1 --2- 172.21.15.157:0/2313517011 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1d34034bb0 0x7f1d34037070 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55b5ed5d5c00 tx=0x7f1e50005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.155+0000 7f1e5a849640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed6110d0 0x55b5ed6114b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.155+0000 7f1e5a849640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed6110d0 0x55b5ed6114b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38722/0 (socket says 172.21.15.157:38722) 2024-05-09T09:49:27.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.155+0000 7f1e5a849640 1 -- 172.21.15.157:0/4175335302 learned_addr learned my addr 172.21.15.157:0/4175335302 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.155+0000 7f1e5a849640 1 -- 172.21.15.157:0/4175335302 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5ed611a80 con 0x55b5ed6110d0 2024-05-09T09:49:27.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.155+0000 7f1e5a849640 1 --2- 172.21.15.157:0/4175335302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed6110d0 0x55b5ed6114b0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c026830 tx=0x7f1e4c027db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ce9ac010e9b704 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.155+0000 7f1d3d7fa640 1 -- 172.21.15.157:0/4175335302 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e4c027560 con 0x55b5ed6110d0 2024-05-09T09:49:27.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.155+0000 7f1d3d7fa640 1 -- 172.21.15.157:0/4175335302 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e4c01d890 con 0x55b5ed6110d0 2024-05-09T09:49:27.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.155+0000 7f1d3d7fa640 1 -- 172.21.15.157:0/4175335302 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e4c002070 con 0x55b5ed6110d0 2024-05-09T09:49:27.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.155+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/4175335302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed6110d0 msgr2=0x55b5ed6114b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.155+0000 7f1e5cd2e980 1 --2- 172.21.15.157:0/4175335302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed6110d0 0x55b5ed6114b0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c026830 tx=0x7f1e4c027db0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.155+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/4175335302 shutdown_connections 2024-05-09T09:49:27.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.155+0000 7f1e5cd2e980 1 --2- 172.21.15.157:0/4175335302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed6110d0 0x55b5ed6114b0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.155+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/4175335302 >> 172.21.15.157:0/4175335302 conn(0x55b5ed60d450 msgr2=0x55b5ed60b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.155+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/4175335302 shutdown_connections 2024-05-09T09:49:27.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.155+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/4175335302 wait complete. 2024-05-09T09:49:27.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.155+0000 7f1e5cd2e980 1 Processor -- start 2024-05-09T09:49:27.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.155+0000 7f1e5cd2e980 1 -- start start 2024-05-09T09:49:27.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.155+0000 7f1e5cd2e980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed6110d0 0x55b5ed618450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.155+0000 7f1e5cd2e980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b5ed612190 con 0x55b5ed6110d0 2024-05-09T09:49:27.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.155+0000 7f1e5a849640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed6110d0 0x55b5ed618450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.155+0000 7f1e5a849640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed6110d0 0x55b5ed618450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38734/0 (socket says 172.21.15.157:38734) 2024-05-09T09:49:27.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.155+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 learned_addr learned my addr 172.21.15.157:0/2351846322 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.159+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5ed618990 con 0x55b5ed6110d0 2024-05-09T09:49:27.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.159+0000 7f1e5a849640 1 --2- 172.21.15.157:0/2351846322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed6110d0 0x55b5ed618450 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c0474d0 tx=0x7f1e4c040e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.159+0000 7f1d2b7fe640 1 -- 172.21.15.157:0/2351846322 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e4c06c070 con 0x55b5ed6110d0 2024-05-09T09:49:27.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.159+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b5ed618990 con 0x55b5ed6110d0 2024-05-09T09:49:27.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.159+0000 7f1d2b7fe640 1 -- 172.21.15.157:0/2351846322 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e4c03fe50 con 0x55b5ed6110d0 2024-05-09T09:49:27.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.159+0000 7f1d2b7fe640 1 -- 172.21.15.157:0/2351846322 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e4c048e60 con 0x55b5ed6110d0 2024-05-09T09:49:27.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.159+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5ed618e10 con 0x55b5ed6110d0 2024-05-09T09:49:27.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.159+0000 7f1e5cd2e980 20 rados->read ofs=0 len=0 2024-05-09T09:49:27.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.159+0000 7f1d2b7fe640 1 -- 172.21.15.157:0/2351846322 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f1e4c06f070 con 0x55b5ed6110d0 2024-05-09T09:49:27.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.159+0000 7f1d2b7fe640 1 --2- 172.21.15.157:0/2351846322 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1d24034bb0 0x7f1d24037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.159+0000 7f1d2b7fe640 1 -- 172.21.15.157:0/2351846322 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f1e4c063030 con 0x55b5ed6110d0 2024-05-09T09:49:27.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.159+0000 7f1e5a048640 1 --2- 172.21.15.157:0/2351846322 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1d24034bb0 0x7f1d24037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.159+0000 7f1e5cd2e980 1 --2- 172.21.15.157:0/2351846322 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b5ed624fc0 0x55b5ed627480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.159+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed627bd0 con 0x55b5ed624fc0 2024-05-09T09:49:27.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.159+0000 7f1e5b04a640 1 --2- 172.21.15.157:0/2351846322 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b5ed624fc0 0x55b5ed627480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.159+0000 7f1e5a048640 1 --2- 172.21.15.157:0/2351846322 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1d24034bb0 0x7f1d24037070 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1e50018f70 tx=0x7f1e500c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.159+0000 7f1e5b04a640 1 --2- 172.21.15.157:0/2351846322 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b5ed624fc0 0x55b5ed627480 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.159+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.159+0000 7f1e5cd2e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:27.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.159+0000 7f1e5cd2e980 20 realm 2024-05-09T09:49:27.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.159+0000 7f1e5cd2e980 20 rados->read ofs=0 len=0 2024-05-09T09:49:27.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.159+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed627fe0 con 0x55b5ed624fc0 2024-05-09T09:49:27.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.159+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.159+0000 7f1e5cd2e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:27.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.159+0000 7f1e5cd2e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:49:27.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.159+0000 7f1e5cd2e980 20 rados->read ofs=0 len=0 2024-05-09T09:49:27.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.159+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628880 con 0x55b5ed624fc0 2024-05-09T09:49:27.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.163+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.163+0000 7f1e5cd2e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:27.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.163+0000 7f1e5cd2e980 20 rados->read ofs=0 len=0 2024-05-09T09:49:27.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.163+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x55b5ed624fc0 2024-05-09T09:49:27.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.163+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.163+0000 7f1e5cd2e980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:27.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.163+0000 7f1e5cd2e980 20 rados->read ofs=0 len=0 2024-05-09T09:49:27.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.163+0000 7f1e5cd2e980 1 --2- 172.21.15.157:0/2351846322 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b5ed629980 0x55b5ed62bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.163+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed62c2f0 con 0x55b5ed629980 2024-05-09T09:49:27.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.163+0000 7f1e5a849640 1 --2- 172.21.15.157:0/2351846322 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b5ed629980 0x55b5ed62bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.163+0000 7f1e5a849640 1 --2- 172.21.15.157:0/2351846322 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b5ed629980 0x55b5ed62bd70 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.163+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1e4c06e030 con 0x55b5ed629980 2024-05-09T09:49:27.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.163+0000 7f1e5cd2e980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:49:27.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.163+0000 7f1e5cd2e980 20 searching for the correct realm 2024-05-09T09:49:27.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.163+0000 7f1e5cd2e980 1 --2- 172.21.15.157:0/2351846322 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b5ed62e220 0x55b5ed6306e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.163+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed630db0 con 0x55b5ed62e220 2024-05-09T09:49:27.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.163+0000 7f1e5a048640 1 --2- 172.21.15.157:0/2351846322 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b5ed62e220 0x55b5ed6306e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.163+0000 7f1e5a048640 1 --2- 172.21.15.157:0/2351846322 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b5ed62e220 0x55b5ed6306e0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.163+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e500aaa50 con 0x55b5ed62e220 2024-05-09T09:49:27.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.163+0000 7f1e5a048640 1 --2- 172.21.15.157:0/2351846322 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f1e500e0040 0x7f1e500e0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.163+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed630db0 con 0x7f1e500e0040 2024-05-09T09:49:27.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.163+0000 7f1e5b04a640 1 --2- 172.21.15.157:0/2351846322 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f1e500e0040 0x7f1e500e0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.163+0000 7f1e5b04a640 1 --2- 172.21.15.157:0/2351846322 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f1e500e0040 0x7f1e500e0930 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.167+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e5400a4d0 con 0x7f1e500e0040 2024-05-09T09:49:27.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.167+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x55b5ed629980 2024-05-09T09:49:27.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.167+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e4c06e030 con 0x55b5ed629980 2024-05-09T09:49:27.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.167+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x55b5ed624fc0 2024-05-09T09:49:27.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.167+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.167+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x55b5ed624fc0 2024-05-09T09:49:27.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.167+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.167+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x55b5ed629980 2024-05-09T09:49:27.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.167+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e4c06e030 con 0x55b5ed629980 2024-05-09T09:49:27.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.167+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x55b5ed629980 2024-05-09T09:49:27.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.167+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e4c06e030 con 0x55b5ed629980 2024-05-09T09:49:27.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.167+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x7f1e500e0040 2024-05-09T09:49:27.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.167+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e5400a4d0 con 0x7f1e500e0040 2024-05-09T09:49:27.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.167+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x55b5ed62e220 2024-05-09T09:49:27.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.167+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e500aaa50 con 0x55b5ed62e220 2024-05-09T09:49:27.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.167+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x55b5ed624fc0 2024-05-09T09:49:27.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.167+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.167+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x55b5ed629980 2024-05-09T09:49:27.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.171+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e4c06e030 con 0x55b5ed629980 2024-05-09T09:49:27.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.171+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x55b5ed624fc0 2024-05-09T09:49:27.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.171+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.171+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x7f1e500e0040 2024-05-09T09:49:27.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.171+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1e5400a4d0 con 0x7f1e500e0040 2024-05-09T09:49:27.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.171+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x55b5ed62e220 2024-05-09T09:49:27.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.171+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e500aaa50 con 0x55b5ed62e220 2024-05-09T09:49:27.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.171+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x55b5ed62e220 2024-05-09T09:49:27.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.171+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1e500aaa50 con 0x55b5ed62e220 2024-05-09T09:49:27.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.171+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x55b5ed629980 2024-05-09T09:49:27.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.171+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e4c06e030 con 0x55b5ed629980 2024-05-09T09:49:27.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.171+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x55b5ed62e220 2024-05-09T09:49:27.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.171+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e500aaa50 con 0x55b5ed62e220 2024-05-09T09:49:27.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.171+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x55b5ed62e220 2024-05-09T09:49:27.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.171+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e500aaa50 con 0x55b5ed62e220 2024-05-09T09:49:27.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.171+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x55b5ed624fc0 2024-05-09T09:49:27.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.171+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.171+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x55b5ed624fc0 2024-05-09T09:49:27.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.171+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.171+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x55b5ed629980 2024-05-09T09:49:27.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.175+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e4c06e030 con 0x55b5ed629980 2024-05-09T09:49:27.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.175+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x55b5ed62e220 2024-05-09T09:49:27.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.175+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e500aaa50 con 0x55b5ed62e220 2024-05-09T09:49:27.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.175+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x7f1e500e0040 2024-05-09T09:49:27.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.175+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e5400a4d0 con 0x7f1e500e0040 2024-05-09T09:49:27.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.175+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x55b5ed624fc0 2024-05-09T09:49:27.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.175+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.175+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x55b5ed629980 2024-05-09T09:49:27.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.175+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1e4c06e030 con 0x55b5ed629980 2024-05-09T09:49:27.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.175+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x55b5ed62e220 2024-05-09T09:49:27.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.175+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e500aaa50 con 0x55b5ed62e220 2024-05-09T09:49:27.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.175+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x55b5ed629980 2024-05-09T09:49:27.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.175+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e4c06e030 con 0x55b5ed629980 2024-05-09T09:49:27.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.175+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x7f1e500e0040 2024-05-09T09:49:27.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.175+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e5400a4d0 con 0x7f1e500e0040 2024-05-09T09:49:27.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.175+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x55b5ed62e220 2024-05-09T09:49:27.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.175+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e500aaa50 con 0x55b5ed62e220 2024-05-09T09:49:27.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.175+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x55b5ed629980 2024-05-09T09:49:27.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e4c06e030 con 0x55b5ed629980 2024-05-09T09:49:27.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x55b5ed624fc0 2024-05-09T09:49:27.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed628c20 con 0x7f1e500e0040 2024-05-09T09:49:27.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e5400a4d0 con 0x7f1e500e0040 2024-05-09T09:49:27.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:49:27.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:49:27.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:49:27.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:49:27.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:49:27.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:49:27.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 20 rados->read ofs=0 len=0 2024-05-09T09:49:27.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed62cb40 con 0x55b5ed624fc0 2024-05-09T09:49:27.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:27.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 20 rados->read ofs=0 len=0 2024-05-09T09:49:27.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed62cb40 con 0x55b5ed624fc0 2024-05-09T09:49:27.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:27.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 20 rados->read ofs=0 len=0 2024-05-09T09:49:27.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed62cb40 con 0x55b5ed62e220 2024-05-09T09:49:27.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1e500aaa50 con 0x55b5ed62e220 2024-05-09T09:49:27.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:49:27.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 20 zone default found 2024-05-09T09:49:27.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 4 Realm: () 2024-05-09T09:49:27.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:49:27.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:49:27.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:49:27.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 20 zonegroup default 2024-05-09T09:49:27.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 20 rados->read ofs=0 len=0 2024-05-09T09:49:27.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed62d3e0 con 0x55b5ed629980 2024-05-09T09:49:27.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1e4c06e030 con 0x55b5ed629980 2024-05-09T09:49:27.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:27.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 20 rados->read ofs=0 len=0 2024-05-09T09:49:27.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed632c10 con 0x55b5ed62e220 2024-05-09T09:49:27.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1e500aaa50 con 0x55b5ed62e220 2024-05-09T09:49:27.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:27.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 20 rados->read ofs=0 len=0 2024-05-09T09:49:27.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed632fb0 con 0x55b5ed62e220 2024-05-09T09:49:27.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1e500aaa50 con 0x55b5ed62e220 2024-05-09T09:49:27.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:27.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 20 started sync module instance, tier type = 2024-05-09T09:49:27.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:49:27.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.179+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed6320b0 con 0x7f1e500e0040 2024-05-09T09:49:27.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.183+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x7f1e500e0040 2024-05-09T09:49:27.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.183+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94239860139440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed6320b0 con 0x7f1e500e0040 2024-05-09T09:49:27.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.183+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed6339b0 con 0x55b5ed624fc0 2024-05-09T09:49:27.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.183+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94239860139440] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x7f1e500e0040 2024-05-09T09:49:27.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.183+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.183+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94239860143296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed6320b0 con 0x55b5ed624fc0 2024-05-09T09:49:27.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.183+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed6343c0 con 0x55b5ed62e220 2024-05-09T09:49:27.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.187+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e500aaa50 con 0x55b5ed62e220 2024-05-09T09:49:27.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.187+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94239860145936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed634c10 con 0x55b5ed62e220 2024-05-09T09:49:27.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.187+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed635650 con 0x7f1e500e0040 2024-05-09T09:49:27.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.187+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94239860143296] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.187+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x7f1e500e0040 2024-05-09T09:49:27.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.187+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94239860150560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed635a40 con 0x7f1e500e0040 2024-05-09T09:49:27.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.187+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed636400 con 0x55b5ed624fc0 2024-05-09T09:49:27.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.187+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94239860145936] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e500aaa50 con 0x55b5ed62e220 2024-05-09T09:49:27.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.191+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94239860150560] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x7f1e500e0040 2024-05-09T09:49:27.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.191+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.191+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94239860136960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed635f50 con 0x55b5ed624fc0 2024-05-09T09:49:27.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.191+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed6367a0 con 0x55b5ed629980 2024-05-09T09:49:27.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.191+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94239860136960] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.191+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e4c06e030 con 0x55b5ed629980 2024-05-09T09:49:27.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.191+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94239860154192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed636370 con 0x55b5ed629980 2024-05-09T09:49:27.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.191+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed6374a0 con 0x55b5ed629980 2024-05-09T09:49:27.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.195+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94239860154192] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e4c06e030 con 0x55b5ed629980 2024-05-09T09:49:27.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.195+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e4c06e030 con 0x55b5ed629980 2024-05-09T09:49:27.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.195+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94239860157520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed637660 con 0x55b5ed629980 2024-05-09T09:49:27.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.195+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed638180 con 0x55b5ed629980 2024-05-09T09:49:27.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.195+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e4c06e030 con 0x55b5ed629980 2024-05-09T09:49:27.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.195+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94239860157520] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e4c06e030 con 0x55b5ed629980 2024-05-09T09:49:27.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.195+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94239860161616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed6385f0 con 0x55b5ed629980 2024-05-09T09:49:27.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.195+0000 7f1e5cd2e980 20 add_watcher() i=0 2024-05-09T09:49:27.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.195+0000 7f1e5cd2e980 20 add_watcher() i=1 2024-05-09T09:49:27.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.195+0000 7f1e5cd2e980 20 add_watcher() i=2 2024-05-09T09:49:27.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.195+0000 7f1e5cd2e980 20 add_watcher() i=3 2024-05-09T09:49:27.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.195+0000 7f1e5cd2e980 20 add_watcher() i=4 2024-05-09T09:49:27.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.195+0000 7f1e5cd2e980 20 add_watcher() i=5 2024-05-09T09:49:27.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.195+0000 7f1e5cd2e980 20 add_watcher() i=6 2024-05-09T09:49:27.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.199+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94239860161616] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e4c06e030 con 0x55b5ed629980 2024-05-09T09:49:27.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.199+0000 7f1e5cd2e980 20 add_watcher() i=7 2024-05-09T09:49:27.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.199+0000 7f1e5cd2e980 2 all 8 watchers are set, enabling cache 2024-05-09T09:49:27.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.199+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed6385f0 con 0x55b5ed624fc0 2024-05-09T09:49:27.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.199+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.199+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94239860162880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed638e90 con 0x55b5ed624fc0 2024-05-09T09:49:27.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.199+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94239860162880] v32'420 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.199+0000 7f1d0b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:27.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.199+0000 7f1e5cd2e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:49:27.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.199+0000 7f1e5cd2e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:49:27.202 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.199+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed643ca0 con 0x55b5ed624fc0 2024-05-09T09:49:27.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.203+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'97 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.203+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed644260 con 0x55b5ed629980 2024-05-09T09:49:27.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.207+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'92 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1e4c06e030 con 0x55b5ed629980 2024-05-09T09:49:27.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.207+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed644260 con 0x55b5ed62e220 2024-05-09T09:49:27.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.207+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'91 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1e500aaa50 con 0x55b5ed62e220 2024-05-09T09:49:27.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.207+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed644810 con 0x55b5ed624fc0 2024-05-09T09:49:27.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.207+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'421 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.207+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed644bd0 con 0x7f1e500e0040 2024-05-09T09:49:27.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.211+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'260 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x7f1e500e0040 2024-05-09T09:49:27.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.211+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed645140 con 0x55b5ed62e220 2024-05-09T09:49:27.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.211+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'174 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1e500aaa50 con 0x55b5ed62e220 2024-05-09T09:49:27.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.211+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed645640 con 0x55b5ed624fc0 2024-05-09T09:49:27.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.215+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'92 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.215+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed641c80 con 0x55b5ed629980 2024-05-09T09:49:27.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.215+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'173 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1e4c06e030 con 0x55b5ed629980 2024-05-09T09:49:27.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.215+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed641c80 con 0x7f1e500e0040 2024-05-09T09:49:27.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.219+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'90 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x7f1e500e0040 2024-05-09T09:49:27.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.219+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed641c80 con 0x55b5ed62e220 2024-05-09T09:49:27.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.219+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'96 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1e500aaa50 con 0x55b5ed62e220 2024-05-09T09:49:27.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.219+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed641c80 con 0x7f1e500e0040 2024-05-09T09:49:27.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.223+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'261 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x7f1e500e0040 2024-05-09T09:49:27.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.223+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed641c80 con 0x55b5ed629980 2024-05-09T09:49:27.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.223+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'96 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e4c06e030 con 0x55b5ed629980 2024-05-09T09:49:27.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.223+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed6461a0 con 0x7f1e500e0040 2024-05-09T09:49:27.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.227+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'90 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x7f1e500e0040 2024-05-09T09:49:27.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.227+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed6461a0 con 0x55b5ed629980 2024-05-09T09:49:27.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.227+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'179 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e4c06e030 con 0x55b5ed629980 2024-05-09T09:49:27.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.227+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed6461a0 con 0x55b5ed624fc0 2024-05-09T09:49:27.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.231+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'422 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.231+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed6461a0 con 0x55b5ed62e220 2024-05-09T09:49:27.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.231+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'254 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e500aaa50 con 0x55b5ed62e220 2024-05-09T09:49:27.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.231+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed6461a0 con 0x7f1e500e0040 2024-05-09T09:49:27.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.235+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'262 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x7f1e500e0040 2024-05-09T09:49:27.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.235+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed6461a0 con 0x55b5ed62e220 2024-05-09T09:49:27.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.235+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'90 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e500aaa50 con 0x55b5ed62e220 2024-05-09T09:49:27.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.235+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed6461a0 con 0x55b5ed624fc0 2024-05-09T09:49:27.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.235+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'98 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.235+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed6461a0 con 0x55b5ed624fc0 2024-05-09T09:49:27.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.239+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'423 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.239+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed6461a0 con 0x55b5ed62e220 2024-05-09T09:49:27.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.239+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'255 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e500aaa50 con 0x55b5ed62e220 2024-05-09T09:49:27.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.239+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed646230 con 0x7f1e500e0040 2024-05-09T09:49:27.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.243+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'102 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x7f1e500e0040 2024-05-09T09:49:27.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.243+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed646230 con 0x55b5ed62e220 2024-05-09T09:49:27.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.243+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'92 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e500aaa50 con 0x55b5ed62e220 2024-05-09T09:49:27.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.243+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed646340 con 0x55b5ed62e220 2024-05-09T09:49:27.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.247+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'96 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e500aaa50 con 0x55b5ed62e220 2024-05-09T09:49:27.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.247+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed646340 con 0x55b5ed62e220 2024-05-09T09:49:27.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.247+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'87 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e500aaa50 con 0x55b5ed62e220 2024-05-09T09:49:27.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.247+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed646340 con 0x55b5ed62e220 2024-05-09T09:49:27.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.247+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'175 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e500aaa50 con 0x55b5ed62e220 2024-05-09T09:49:27.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.251+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed646340 con 0x55b5ed629980 2024-05-09T09:49:27.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.251+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'92 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e4c06e030 con 0x55b5ed629980 2024-05-09T09:49:27.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.251+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed646340 con 0x55b5ed62e220 2024-05-09T09:49:27.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.255+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'91 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e500aaa50 con 0x55b5ed62e220 2024-05-09T09:49:27.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.255+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed646340 con 0x55b5ed629980 2024-05-09T09:49:27.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.255+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'174 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e4c06e030 con 0x55b5ed629980 2024-05-09T09:49:27.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.255+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed646340 con 0x55b5ed62e220 2024-05-09T09:49:27.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.259+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'256 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e500aaa50 con 0x55b5ed62e220 2024-05-09T09:49:27.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.259+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed646340 con 0x55b5ed629980 2024-05-09T09:49:27.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.259+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'180 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e4c06e030 con 0x55b5ed629980 2024-05-09T09:49:27.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.259+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed646340 con 0x7f1e500e0040 2024-05-09T09:49:27.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.263+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'96 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x7f1e500e0040 2024-05-09T09:49:27.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.263+0000 7f1d0a7fc640 20 reqs_thread_entry: start 2024-05-09T09:49:27.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.263+0000 7f1e5cd2e980 20 init_complete bucket index max shards: 11 2024-05-09T09:49:27.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.263+0000 7f1c7bfff640 20 reqs_thread_entry: start 2024-05-09T09:49:27.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.263+0000 7f1e5cd2e980 20 rados->read ofs=0 len=0 2024-05-09T09:49:27.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.263+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed661d80 con 0x55b5ed624fc0 2024-05-09T09:49:27.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.263+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.263+0000 7f1e5cd2e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:27.267 INFO:teuthology.orchestra.run.smithi157.stderr:could not fetch user info: no user info saved 2024-05-09T09:49:27.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.267+0000 7f1d0b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:27.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.267+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94239860162880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed640a30 con 0x55b5ed624fc0 2024-05-09T09:49:27.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.267+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94239860162880] v32'424 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.267+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94239860139440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed638140 con 0x7f1e500e0040 2024-05-09T09:49:27.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.271+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94239860139440] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x7f1e500e0040 2024-05-09T09:49:27.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.271+0000 7f1e5cd2e980 20 remove_watcher() i=0 2024-05-09T09:49:27.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.271+0000 7f1e5cd2e980 2 removed watcher, disabling cache 2024-05-09T09:49:27.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.271+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94239860143296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed6325b0 con 0x55b5ed624fc0 2024-05-09T09:49:27.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.271+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94239860143296] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.271+0000 7f1e5cd2e980 20 remove_watcher() i=1 2024-05-09T09:49:27.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.271+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94239860145936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed6325b0 con 0x55b5ed62e220 2024-05-09T09:49:27.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.275+0000 7f1e5a048640 1 -- 172.21.15.157:0/2351846322 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94239860145936] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e500aaa50 con 0x55b5ed62e220 2024-05-09T09:49:27.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.275+0000 7f1e5cd2e980 20 remove_watcher() i=2 2024-05-09T09:49:27.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.275+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94239860150560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed6325b0 con 0x7f1e500e0040 2024-05-09T09:49:27.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.275+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94239860150560] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x7f1e500e0040 2024-05-09T09:49:27.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.275+0000 7f1e5cd2e980 20 remove_watcher() i=3 2024-05-09T09:49:27.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.275+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94239860136960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed635120 con 0x55b5ed624fc0 2024-05-09T09:49:27.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.279+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94239860136960] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e5400a4d0 con 0x55b5ed624fc0 2024-05-09T09:49:27.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.279+0000 7f1e5cd2e980 20 remove_watcher() i=4 2024-05-09T09:49:27.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.279+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94239860154192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed6325b0 con 0x55b5ed629980 2024-05-09T09:49:27.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.279+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94239860154192] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e4c06e030 con 0x55b5ed629980 2024-05-09T09:49:27.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.279+0000 7f1e5cd2e980 20 remove_watcher() i=5 2024-05-09T09:49:27.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.283+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94239860157520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed631c00 con 0x55b5ed629980 2024-05-09T09:49:27.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.283+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94239860157520] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e4c06e030 con 0x55b5ed629980 2024-05-09T09:49:27.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.283+0000 7f1e5cd2e980 20 remove_watcher() i=6 2024-05-09T09:49:27.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.283+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94239860161616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5ed635120 con 0x55b5ed629980 2024-05-09T09:49:27.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5a849640 1 -- 172.21.15.157:0/2351846322 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94239860161616] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e4c06e030 con 0x55b5ed629980 2024-05-09T09:49:27.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 20 remove_watcher() i=7 2024-05-09T09:49:27.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b5ed629980 msgr2=0x55b5ed62bd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 --2- 172.21.15.157:0/2351846322 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b5ed629980 0x55b5ed62bd70 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b5ed624fc0 msgr2=0x55b5ed627480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 --2- 172.21.15.157:0/2351846322 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b5ed624fc0 0x55b5ed627480 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f1e500e0040 msgr2=0x7f1e500e0930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 --2- 172.21.15.157:0/2351846322 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f1e500e0040 0x7f1e500e0930 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b5ed62e220 msgr2=0x55b5ed6306e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 --2- 172.21.15.157:0/2351846322 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b5ed62e220 0x55b5ed6306e0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1d24034bb0 msgr2=0x7f1d24037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 --2- 172.21.15.157:0/2351846322 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1d24034bb0 0x7f1d24037070 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1e50018f70 tx=0x7f1e500c1040 comp rx=0 tx=0).stop 2024-05-09T09:49:27.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed6110d0 msgr2=0x55b5ed618450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5b04a640 1 -- 172.21.15.157:0/2351846322 reap_dead start 2024-05-09T09:49:27.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 --2- 172.21.15.157:0/2351846322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed6110d0 0x55b5ed618450 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c0474d0 tx=0x7f1e4c040e70 comp rx=0 tx=0).stop 2024-05-09T09:49:27.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 shutdown_connections 2024-05-09T09:49:27.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 --2- 172.21.15.157:0/2351846322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed6110d0 0x55b5ed618450 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 >> 172.21.15.157:0/2351846322 conn(0x55b5ed60d450 msgr2=0x55b5ed60aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 shutdown_connections 2024-05-09T09:49:27.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2351846322 wait complete. 2024-05-09T09:49:27.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2313517011 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1d34034bb0 msgr2=0x7f1d34037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 --2- 172.21.15.157:0/2313517011 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1d34034bb0 0x7f1d34037070 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55b5ed5d5c00 tx=0x7f1e50005ad0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2313517011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed603f50 msgr2=0x55b5ed604370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 --2- 172.21.15.157:0/2313517011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed603f50 0x55b5ed604370 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00e920 tx=0x7f1e4c00ed60 comp rx=0 tx=0).stop 2024-05-09T09:49:27.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2313517011 shutdown_connections 2024-05-09T09:49:27.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 --2- 172.21.15.157:0/2313517011 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1d34034bb0 0x7f1d34037070 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 --2- 172.21.15.157:0/2313517011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed603f50 0x55b5ed604370 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2313517011 >> 172.21.15.157:0/2313517011 conn(0x55b5ed5f8d20 msgr2=0x55b5ed5f9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2313517011 shutdown_connections 2024-05-09T09:49:27.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/2313517011 wait complete. 2024-05-09T09:49:27.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/3559502053 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b5ed5d7650 msgr2=0x55b5ed5d9a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 --2- 172.21.15.157:0/3559502053 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55b5ed5d7650 0x55b5ed5d9a40 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/3559502053 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b5ed4e0030 msgr2=0x55b5ed5d4cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 --2- 172.21.15.157:0/3559502053 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55b5ed4e0030 0x55b5ed5d4cb0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/3559502053 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b5ed5db570 msgr2=0x55b5ed5dd960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 --2- 172.21.15.157:0/3559502053 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55b5ed5db570 0x55b5ed5dd960 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/3559502053 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1d40034bb0 msgr2=0x7f1d40037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 --2- 172.21.15.157:0/3559502053 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f1d40034bb0 0x7f1d40037070 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1e500ae000 tx=0x7f1e500a6000 comp rx=0 tx=0).stop 2024-05-09T09:49:27.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/3559502053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed4dbb30 msgr2=0x55b5ed5cdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 --2- 172.21.15.157:0/3559502053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b5ed4dbb30 0x55b5ed5cdce0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00c010 tx=0x7f1e4c000ee0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5b04a640 1 -- 172.21.15.157:0/3559502053 reap_dead start 2024-05-09T09:49:27.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/3559502053 shutdown_connections 2024-05-09T09:49:27.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/3559502053 >> 172.21.15.157:0/3559502053 conn(0x55b5ed44f250 msgr2=0x55b5ed5c11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/3559502053 shutdown_connections 2024-05-09T09:49:27.293 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.287+0000 7f1e5cd2e980 1 -- 172.21.15.157:0/3559502053 wait complete. 2024-05-09T09:49:27.303 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-09T09:49:27.303 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-05-09T09:49:27.304 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-05-09T09:49:27.304 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-05-09T09:49:27.381 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:49:27.381 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:49:27.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.383+0000 7fe76ae98980 1 Processor -- start 2024-05-09T09:49:27.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.383+0000 7fe76ae98980 1 -- start start 2024-05-09T09:49:27.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.383+0000 7fe76ae98980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55ac1f34b0d0 0x55ac1f34d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.383+0000 7fe76ae98980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ac1f1fa440 con 0x55ac1f347000 2024-05-09T09:49:27.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.383+0000 7fe76ae98980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55ac1f1e55f0 con 0x55ac1f34b0d0 2024-05-09T09:49:27.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.383+0000 7fe7681b2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55ac1f34b0d0 0x55ac1f34d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.383+0000 7fe7681b2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55ac1f34b0d0 0x55ac1f34d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38748/0 (socket says 172.21.15.157:38748) 2024-05-09T09:49:27.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.383+0000 7fe7689b3640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x55ac1f347000 0x55ac1f3473e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:45530/0 (socket says 172.21.15.157:45530) 2024-05-09T09:49:27.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.383+0000 7fe7681b2640 1 -- 172.21.15.157:0/3226443353 learned_addr learned my addr 172.21.15.157:0/3226443353 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.383+0000 7fe7681b2640 1 -- 172.21.15.157:0/3226443353 >> v1:172.21.15.110:6789/0 conn(0x55ac1f347000 legacy=0x55ac1f3473e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.383+0000 7fe7679b1640 1 -- 172.21.15.157:0/3226443353 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1230478558 0 0) 0x55ac1f1fa440 con 0x55ac1f347000 2024-05-09T09:49:27.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.383+0000 7fe7681b2640 1 -- 172.21.15.157:0/3226443353 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac1f1f0990 con 0x55ac1f34b0d0 2024-05-09T09:49:27.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.387+0000 7fe7681b2640 1 --2- 172.21.15.157:0/3226443353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f34b0d0 0x55ac1f34d4c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe75000a5c0 tx=0x7fe75001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf6f02b2247af0a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.387+0000 7fe7679b1640 1 -- 172.21.15.157:0/3226443353 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7500a6070 con 0x55ac1f34b0d0 2024-05-09T09:49:27.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.387+0000 7fe7679b1640 1 -- 172.21.15.157:0/3226443353 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7500af070 con 0x55ac1f34b0d0 2024-05-09T09:49:27.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.387+0000 7fe7679b1640 1 -- 172.21.15.157:0/3226443353 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7500aa5c0 con 0x55ac1f34b0d0 2024-05-09T09:49:27.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.387+0000 7fe76ae98980 1 -- 172.21.15.157:0/3226443353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f34b0d0 msgr2=0x55ac1f34d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.387+0000 7fe76ae98980 1 --2- 172.21.15.157:0/3226443353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f34b0d0 0x55ac1f34d4c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe75000a5c0 tx=0x7fe75001b340 comp rx=0 tx=0).stop 2024-05-09T09:49:27.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.387+0000 7fe76ae98980 1 -- 172.21.15.157:0/3226443353 shutdown_connections 2024-05-09T09:49:27.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.387+0000 7fe76ae98980 1 --2- 172.21.15.157:0/3226443353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f34b0d0 0x55ac1f34d4c0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.387+0000 7fe76ae98980 1 -- 172.21.15.157:0/3226443353 >> 172.21.15.157:0/3226443353 conn(0x55ac1f2ba2c0 msgr2=0x55ac1f2ba6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.387+0000 7fe76ae98980 1 -- 172.21.15.157:0/3226443353 shutdown_connections 2024-05-09T09:49:27.388 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.387+0000 7fe76ae98980 1 -- 172.21.15.157:0/3226443353 wait complete. 2024-05-09T09:49:27.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.403+0000 7fe76ae98980 1 Processor -- start 2024-05-09T09:49:27.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.403+0000 7fe76ae98980 1 -- start start 2024-05-09T09:49:27.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.403+0000 7fe76ae98980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f347000 0x55ac1f431c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.403+0000 7fe76ae98980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ac1f247fe0 con 0x55ac1f347000 2024-05-09T09:49:27.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.403+0000 7fe7689b3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f347000 0x55ac1f431c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.403+0000 7fe7689b3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f347000 0x55ac1f431c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38764/0 (socket says 172.21.15.157:38764) 2024-05-09T09:49:27.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.403+0000 7fe7689b3640 1 -- 172.21.15.157:0/569441880 learned_addr learned my addr 172.21.15.157:0/569441880 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.403+0000 7fe7689b3640 1 -- 172.21.15.157:0/569441880 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac1f1ccae0 con 0x55ac1f347000 2024-05-09T09:49:27.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.403+0000 7fe7689b3640 1 --2- 172.21.15.157:0/569441880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f347000 0x55ac1f431c10 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe760001740 tx=0x7fe760001c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ecef80fd1010c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.403+0000 7fe656e0d640 1 -- 172.21.15.157:0/569441880 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe760003460 con 0x55ac1f347000 2024-05-09T09:49:27.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.403+0000 7fe656e0d640 1 -- 172.21.15.157:0/569441880 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe760003620 con 0x55ac1f347000 2024-05-09T09:49:27.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.403+0000 7fe656e0d640 1 -- 172.21.15.157:0/569441880 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe760003940 con 0x55ac1f347000 2024-05-09T09:49:27.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.403+0000 7fe76ae98980 1 -- 172.21.15.157:0/569441880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f347000 msgr2=0x55ac1f431c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.403+0000 7fe76ae98980 1 --2- 172.21.15.157:0/569441880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f347000 0x55ac1f431c10 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe760001740 tx=0x7fe760001c00 comp rx=0 tx=0).stop 2024-05-09T09:49:27.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.403+0000 7fe76ae98980 1 -- 172.21.15.157:0/569441880 shutdown_connections 2024-05-09T09:49:27.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.403+0000 7fe76ae98980 1 --2- 172.21.15.157:0/569441880 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f347000 0x55ac1f431c10 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.403+0000 7fe76ae98980 1 -- 172.21.15.157:0/569441880 >> 172.21.15.157:0/569441880 conn(0x55ac1f2ba2c0 msgr2=0x55ac1f42d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.403+0000 7fe76ae98980 1 -- 172.21.15.157:0/569441880 shutdown_connections 2024-05-09T09:49:27.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.403+0000 7fe76ae98980 1 -- 172.21.15.157:0/569441880 wait complete. 2024-05-09T09:49:27.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.407+0000 7fe76ae98980 1 Processor -- start 2024-05-09T09:49:27.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.407+0000 7fe76ae98980 1 -- start start 2024-05-09T09:49:27.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.407+0000 7fe76ae98980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f347000 0x55ac1f438e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.407+0000 7fe76ae98980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ac1f3504f0 con 0x55ac1f347000 2024-05-09T09:49:27.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.407+0000 7fe7689b3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f347000 0x55ac1f438e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.407+0000 7fe7689b3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f347000 0x55ac1f438e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38766/0 (socket says 172.21.15.157:38766) 2024-05-09T09:49:27.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.407+0000 7fe7689b3640 1 -- 172.21.15.157:0/924961664 learned_addr learned my addr 172.21.15.157:0/924961664 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.407+0000 7fe7689b3640 1 -- 172.21.15.157:0/924961664 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac1f439380 con 0x55ac1f347000 2024-05-09T09:49:27.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.407+0000 7fe7689b3640 1 --2- 172.21.15.157:0/924961664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f347000 0x55ac1f438e40 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fe760001c40 tx=0x7fe760001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.407+0000 7fe65560a640 1 -- 172.21.15.157:0/924961664 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe760013760 con 0x55ac1f347000 2024-05-09T09:49:27.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.407+0000 7fe76ae98980 1 -- 172.21.15.157:0/924961664 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac1f439610 con 0x55ac1f347000 2024-05-09T09:49:27.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.407+0000 7fe65560a640 1 -- 172.21.15.157:0/924961664 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe760013900 con 0x55ac1f347000 2024-05-09T09:49:27.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.407+0000 7fe65560a640 1 -- 172.21.15.157:0/924961664 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe760013c00 con 0x55ac1f347000 2024-05-09T09:49:27.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.407+0000 7fe76ae98980 1 -- 172.21.15.157:0/924961664 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac1f43c2f0 con 0x55ac1f347000 2024-05-09T09:49:27.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.407+0000 7fe65560a640 1 -- 172.21.15.157:0/924961664 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fe760010070 con 0x55ac1f347000 2024-05-09T09:49:27.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.407+0000 7fe65560a640 1 --2- 172.21.15.157:0/924961664 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe650034bb0 0x7fe650037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.411+0000 7fe65560a640 1 -- 172.21.15.157:0/924961664 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fe760018070 con 0x55ac1f347000 2024-05-09T09:49:27.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.411+0000 7fe7681b2640 1 --2- 172.21.15.157:0/924961664 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe650034bb0 0x7fe650037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.411+0000 7fe7681b2640 1 --2- 172.21.15.157:0/924961664 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe650034bb0 0x7fe650037070 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe7500ae000 tx=0x7fe7500a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.411+0000 7fe76ae98980 1 Processor -- start 2024-05-09T09:49:27.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.411+0000 7fe76ae98980 1 -- start start 2024-05-09T09:49:27.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.411+0000 7fe76ae98980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f45dfd0 0x55ac1f45e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.411+0000 7fe76ae98980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ac1f24c020 con 0x55ac1f45dfd0 2024-05-09T09:49:27.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.411+0000 7fe7689b3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f45dfd0 0x55ac1f45e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.411+0000 7fe7689b3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f45dfd0 0x55ac1f45e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38776/0 (socket says 172.21.15.157:38776) 2024-05-09T09:49:27.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.411+0000 7fe7689b3640 1 -- 172.21.15.157:0/1312417752 learned_addr learned my addr 172.21.15.157:0/1312417752 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.411+0000 7fe7689b3640 1 -- 172.21.15.157:0/1312417752 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac1f45e930 con 0x55ac1f45dfd0 2024-05-09T09:49:27.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.411+0000 7fe7689b3640 1 --2- 172.21.15.157:0/1312417752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f45dfd0 0x55ac1f45e3f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fe760048ba0 tx=0x7fe760010420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cde6395454001b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.415+0000 7fe64dba0640 1 -- 172.21.15.157:0/1312417752 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe760038070 con 0x55ac1f45dfd0 2024-05-09T09:49:27.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.415+0000 7fe64dba0640 1 -- 172.21.15.157:0/1312417752 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe760010c70 con 0x55ac1f45dfd0 2024-05-09T09:49:27.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.415+0000 7fe64dba0640 1 -- 172.21.15.157:0/1312417752 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe760042960 con 0x55ac1f45dfd0 2024-05-09T09:49:27.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.415+0000 7fe76ae98980 1 -- 172.21.15.157:0/1312417752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f45dfd0 msgr2=0x55ac1f45e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.415+0000 7fe76ae98980 1 --2- 172.21.15.157:0/1312417752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f45dfd0 0x55ac1f45e3f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fe760048ba0 tx=0x7fe760010420 comp rx=0 tx=0).stop 2024-05-09T09:49:27.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.415+0000 7fe76ae98980 1 -- 172.21.15.157:0/1312417752 shutdown_connections 2024-05-09T09:49:27.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.415+0000 7fe76ae98980 1 --2- 172.21.15.157:0/1312417752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f45dfd0 0x55ac1f45e3f0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.415+0000 7fe76ae98980 1 -- 172.21.15.157:0/1312417752 >> 172.21.15.157:0/1312417752 conn(0x55ac1f34b0d0 msgr2=0x55ac1f459410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.415+0000 7fe76ae98980 1 -- 172.21.15.157:0/1312417752 shutdown_connections 2024-05-09T09:49:27.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.415+0000 7fe76ae98980 1 -- 172.21.15.157:0/1312417752 wait complete. 2024-05-09T09:49:27.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.415+0000 7fe76ae98980 1 Processor -- start 2024-05-09T09:49:27.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.415+0000 7fe76ae98980 1 -- start start 2024-05-09T09:49:27.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.415+0000 7fe76ae98980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f45dfd0 0x55ac1f4655a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.415+0000 7fe76ae98980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ac1f45f2e0 con 0x55ac1f45dfd0 2024-05-09T09:49:27.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.415+0000 7fe7689b3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f45dfd0 0x55ac1f4655a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.415+0000 7fe7689b3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f45dfd0 0x55ac1f4655a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38790/0 (socket says 172.21.15.157:38790) 2024-05-09T09:49:27.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.415+0000 7fe7689b3640 1 -- 172.21.15.157:0/43725733 learned_addr learned my addr 172.21.15.157:0/43725733 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.415+0000 7fe7689b3640 1 -- 172.21.15.157:0/43725733 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac1f465ae0 con 0x55ac1f45dfd0 2024-05-09T09:49:27.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.415+0000 7fe7689b3640 1 --2- 172.21.15.157:0/43725733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f45dfd0 0x55ac1f4655a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe76002e040 tx=0x7fe760048b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.415+0000 7fe647fff640 1 -- 172.21.15.157:0/43725733 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe76004f070 con 0x55ac1f45dfd0 2024-05-09T09:49:27.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.415+0000 7fe647fff640 1 -- 172.21.15.157:0/43725733 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe760010e20 con 0x55ac1f45dfd0 2024-05-09T09:49:27.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.415+0000 7fe76ae98980 1 -- 172.21.15.157:0/43725733 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac1f465d70 con 0x55ac1f45dfd0 2024-05-09T09:49:27.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.415+0000 7fe647fff640 1 -- 172.21.15.157:0/43725733 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe760038040 con 0x55ac1f45dfd0 2024-05-09T09:49:27.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.415+0000 7fe76ae98980 1 -- 172.21.15.157:0/43725733 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac1f468a40 con 0x55ac1f45dfd0 2024-05-09T09:49:27.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.419+0000 7fe647fff640 1 -- 172.21.15.157:0/43725733 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fe760052070 con 0x55ac1f45dfd0 2024-05-09T09:49:27.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.419+0000 7fe76ae98980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:49:27.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.419+0000 7fe76ae98980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:49:27.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.419+0000 7fe647fff640 1 --2- 172.21.15.157:0/43725733 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe640034b60 0x7fe640037020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.419+0000 7fe647fff640 1 -- 172.21.15.157:0/43725733 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fe760055d60 con 0x55ac1f45dfd0 2024-05-09T09:49:27.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.419+0000 7fe7681b2640 1 --2- 172.21.15.157:0/43725733 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe640034b60 0x7fe640037020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.419+0000 7fe76ae98980 1 Processor -- start 2024-05-09T09:49:27.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.419+0000 7fe76ae98980 1 -- start start 2024-05-09T09:49:27.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.419+0000 7fe76ae98980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f480d70 0x55ac1f481190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.419+0000 7fe76ae98980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55ac1f432360 con 0x55ac1f480d70 2024-05-09T09:49:27.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.419+0000 7fe7681b2640 1 --2- 172.21.15.157:0/43725733 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe640034b60 0x7fe640037020 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe750000c10 tx=0x7fe750005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.419+0000 7fe7689b3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f480d70 0x55ac1f481190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.419+0000 7fe7689b3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f480d70 0x55ac1f481190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38800/0 (socket says 172.21.15.157:38800) 2024-05-09T09:49:27.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.419+0000 7fe7689b3640 1 -- 172.21.15.157:0/1752504873 learned_addr learned my addr 172.21.15.157:0/1752504873 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.419+0000 7fe7689b3640 1 -- 172.21.15.157:0/1752504873 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac1f4816d0 con 0x55ac1f480d70 2024-05-09T09:49:27.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.419+0000 7fe7689b3640 1 --2- 172.21.15.157:0/1752504873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f480d70 0x55ac1f481190 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe76001e540 tx=0x7fe76003f910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.419+0000 7fe62cfe1640 1 -- 172.21.15.157:0/1752504873 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe760068070 con 0x55ac1f480d70 2024-05-09T09:49:27.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.419+0000 7fe62cfe1640 1 -- 172.21.15.157:0/1752504873 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe76003fc40 con 0x55ac1f480d70 2024-05-09T09:49:27.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.419+0000 7fe76ae98980 1 -- 172.21.15.157:0/1752504873 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac1f4816d0 con 0x55ac1f480d70 2024-05-09T09:49:27.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.419+0000 7fe62cfe1640 1 -- 172.21.15.157:0/1752504873 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe76003f420 con 0x55ac1f480d70 2024-05-09T09:49:27.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.419+0000 7fe76ae98980 1 -- 172.21.15.157:0/1752504873 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac1f4816d0 con 0x55ac1f480d70 2024-05-09T09:49:27.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.423+0000 7fe62cfe1640 1 -- 172.21.15.157:0/1752504873 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fe76006b070 con 0x55ac1f480d70 2024-05-09T09:49:27.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.423+0000 7fe62cfe1640 1 --2- 172.21.15.157:0/1752504873 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe5a0034b60 0x7fe5a0037020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.423+0000 7fe62cfe1640 1 -- 172.21.15.157:0/1752504873 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fe76006ed60 con 0x55ac1f480d70 2024-05-09T09:49:27.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.423+0000 7fe7681b2640 1 --2- 172.21.15.157:0/1752504873 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe5a0034b60 0x7fe5a0037020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.423+0000 7fe6267fc640 20 reqs_thread_entry: start 2024-05-09T09:49:27.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.423+0000 7fe76ae98980 1 --2- 172.21.15.157:0/924961664 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ac1f486810 0x55ac1f488cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.423+0000 7fe76ae98980 1 -- 172.21.15.157:0/924961664 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac1f4893a0 con 0x55ac1f486810 2024-05-09T09:49:27.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.423+0000 7fe7691b4640 1 --2- 172.21.15.157:0/924961664 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ac1f486810 0x55ac1f488cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.423+0000 7fe7681b2640 1 --2- 172.21.15.157:0/1752504873 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe5a0034b60 0x7fe5a0037020 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe750018f70 tx=0x7fe7500b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.423+0000 7fe7691b4640 1 --2- 172.21.15.157:0/924961664 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ac1f486810 0x55ac1f488cd0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.423+0000 7fe7691b4640 1 -- 172.21.15.157:0/924961664 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe75800a4f0 con 0x55ac1f486810 2024-05-09T09:49:27.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.423+0000 7fe76ae98980 1 --2- 172.21.15.157:0/924961664 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ac1f48b1c0 0x55ac1f48d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.423+0000 7fe76ae98980 1 -- 172.21.15.157:0/924961664 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:2 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac1f48dc80 con 0x55ac1f48b1c0 2024-05-09T09:49:27.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.423+0000 7fe7689b3640 1 --2- 172.21.15.157:0/924961664 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ac1f48b1c0 0x55ac1f48d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.423+0000 7fe7689b3640 1 --2- 172.21.15.157:0/924961664 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ac1f48b1c0 0x55ac1f48d5b0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.423+0000 7fe7689b3640 1 -- 172.21.15.157:0/924961664 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(2 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe76006a030 con 0x55ac1f48b1c0 2024-05-09T09:49:27.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 -- 172.21.15.157:0/43725733 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe640034b60 msgr2=0x7fe640037020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 --2- 172.21.15.157:0/43725733 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe640034b60 0x7fe640037020 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe750000c10 tx=0x7fe750005ad0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 -- 172.21.15.157:0/43725733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f45dfd0 msgr2=0x55ac1f4655a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 --2- 172.21.15.157:0/43725733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f45dfd0 0x55ac1f4655a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe76002e040 tx=0x7fe760048b00 comp rx=0 tx=0).stop 2024-05-09T09:49:27.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 -- 172.21.15.157:0/43725733 shutdown_connections 2024-05-09T09:49:27.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 --2- 172.21.15.157:0/43725733 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe640034b60 0x7fe640037020 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 --2- 172.21.15.157:0/43725733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f45dfd0 0x55ac1f4655a0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 -- 172.21.15.157:0/43725733 >> 172.21.15.157:0/43725733 conn(0x55ac1f34b0d0 msgr2=0x55ac1f458210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 -- 172.21.15.157:0/43725733 shutdown_connections 2024-05-09T09:49:27.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 -- 172.21.15.157:0/43725733 wait complete. 2024-05-09T09:49:27.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 -- 172.21.15.157:0/1752504873 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe5a0034b60 msgr2=0x7fe5a0037020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 --2- 172.21.15.157:0/1752504873 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe5a0034b60 0x7fe5a0037020 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe750018f70 tx=0x7fe7500b5040 comp rx=0 tx=0).stop 2024-05-09T09:49:27.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 -- 172.21.15.157:0/1752504873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f480d70 msgr2=0x55ac1f481190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 --2- 172.21.15.157:0/1752504873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f480d70 0x55ac1f481190 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe76001e540 tx=0x7fe76003f910 comp rx=0 tx=0).stop 2024-05-09T09:49:27.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 -- 172.21.15.157:0/1752504873 shutdown_connections 2024-05-09T09:49:27.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 --2- 172.21.15.157:0/1752504873 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe5a0034b60 0x7fe5a0037020 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 --2- 172.21.15.157:0/1752504873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f480d70 0x55ac1f481190 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 -- 172.21.15.157:0/1752504873 >> 172.21.15.157:0/1752504873 conn(0x55ac1f475980 msgr2=0x55ac1f4762a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 -- 172.21.15.157:0/1752504873 shutdown_connections 2024-05-09T09:49:27.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 -- 172.21.15.157:0/1752504873 wait complete. 2024-05-09T09:49:27.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 -- 172.21.15.157:0/924961664 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ac1f48b1c0 msgr2=0x55ac1f48d5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 --2- 172.21.15.157:0/924961664 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ac1f48b1c0 0x55ac1f48d5b0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 -- 172.21.15.157:0/924961664 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ac1f486810 msgr2=0x55ac1f488cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 --2- 172.21.15.157:0/924961664 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ac1f486810 0x55ac1f488cd0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 -- 172.21.15.157:0/924961664 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe650034bb0 msgr2=0x7fe650037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 --2- 172.21.15.157:0/924961664 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe650034bb0 0x7fe650037070 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe7500ae000 tx=0x7fe7500a6000 comp rx=0 tx=0).stop 2024-05-09T09:49:27.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 -- 172.21.15.157:0/924961664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f347000 msgr2=0x55ac1f438e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 --2- 172.21.15.157:0/924961664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f347000 0x55ac1f438e40 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fe760001c40 tx=0x7fe760001260 comp rx=0 tx=0).stop 2024-05-09T09:49:27.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 -- 172.21.15.157:0/924961664 shutdown_connections 2024-05-09T09:49:27.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 --2- 172.21.15.157:0/924961664 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55ac1f48b1c0 0x55ac1f48d5b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 --2- 172.21.15.157:0/924961664 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55ac1f486810 0x55ac1f488cd0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 --2- 172.21.15.157:0/924961664 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe650034bb0 0x7fe650037070 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 --2- 172.21.15.157:0/924961664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ac1f347000 0x55ac1f438e40 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 -- 172.21.15.157:0/924961664 >> 172.21.15.157:0/924961664 conn(0x55ac1f2ba2c0 msgr2=0x55ac1f42c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 -- 172.21.15.157:0/924961664 shutdown_connections 2024-05-09T09:49:27.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.427+0000 7fe76ae98980 1 -- 172.21.15.157:0/924961664 wait complete. 2024-05-09T09:49:27.439 INFO:teuthology.orchestra.run.smithi157.stdout:{"id":"b73385e6-4d12-4d8e-98d6-6f8ed75f5b82","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-05-09T09:49:27.439 DEBUG:tasks.util.rgw: json result: {'id': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-05-09T09:49:27.440 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-05-09T09:49:27.440 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-05-09T09:49:27.440 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-05-09T09:49:27.512 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:49:27.512 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:49:27.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.511+0000 7fa660503980 1 Processor -- start 2024-05-09T09:49:27.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.511+0000 7fa660503980 1 -- start start 2024-05-09T09:49:27.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.511+0000 7fa660503980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55976b135d50 0x55976b138140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.511+0000 7fa660503980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55976afe8440 con 0x55976b1317f0 2024-05-09T09:49:27.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.511+0000 7fa660503980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55976afd35f0 con 0x55976b135d50 2024-05-09T09:49:27.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.511+0000 7fa65d81d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55976b135d50 0x55976b138140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.511+0000 7fa65d81d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55976b135d50 0x55976b138140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38806/0 (socket says 172.21.15.157:38806) 2024-05-09T09:49:27.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.511+0000 7fa65d81d640 1 -- 172.21.15.157:0/1251230517 learned_addr learned my addr 172.21.15.157:0/1251230517 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.511+0000 7fa65e01e640 1 --1- 172.21.15.157:0/1251230517 >> v1:172.21.15.110:6789/0 conn(0x55976b1317f0 0x55976b131bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:45538/0 (socket says 172.21.15.157:45538) 2024-05-09T09:49:27.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.515+0000 7fa65d81d640 1 -- 172.21.15.157:0/1251230517 >> v1:172.21.15.110:6789/0 conn(0x55976b1317f0 legacy=0x55976b131bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.515+0000 7fa65d81d640 1 -- 172.21.15.157:0/1251230517 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55976afde990 con 0x55976b135d50 2024-05-09T09:49:27.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.515+0000 7fa65d81d640 1 --2- 172.21.15.157:0/1251230517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b135d50 0x55976b138140 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa65400a5c0 tx=0x7fa65401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e7ecee19488d7b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.515+0000 7fa65d01c640 1 -- 172.21.15.157:0/1251230517 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6540a6070 con 0x55976b135d50 2024-05-09T09:49:27.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.515+0000 7fa65d01c640 1 -- 172.21.15.157:0/1251230517 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6540af070 con 0x55976b135d50 2024-05-09T09:49:27.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.515+0000 7fa65d01c640 1 -- 172.21.15.157:0/1251230517 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6540aa5c0 con 0x55976b135d50 2024-05-09T09:49:27.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.515+0000 7fa660503980 1 -- 172.21.15.157:0/1251230517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b135d50 msgr2=0x55976b138140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.515+0000 7fa660503980 1 --2- 172.21.15.157:0/1251230517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b135d50 0x55976b138140 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa65400a5c0 tx=0x7fa65401b340 comp rx=0 tx=0).stop 2024-05-09T09:49:27.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.515+0000 7fa660503980 1 -- 172.21.15.157:0/1251230517 shutdown_connections 2024-05-09T09:49:27.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.515+0000 7fa660503980 1 --2- 172.21.15.157:0/1251230517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b135d50 0x55976b138140 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.515+0000 7fa660503980 1 -- 172.21.15.157:0/1251230517 >> 172.21.15.157:0/1251230517 conn(0x55976b12d0c0 msgr2=0x55976b12f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.519+0000 7fa660503980 1 -- 172.21.15.157:0/1251230517 shutdown_connections 2024-05-09T09:49:27.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.519+0000 7fa660503980 1 -- 172.21.15.157:0/1251230517 wait complete. 2024-05-09T09:49:27.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.531+0000 7fa660503980 1 Processor -- start 2024-05-09T09:49:27.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.531+0000 7fa660503980 1 -- start start 2024-05-09T09:49:27.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.531+0000 7fa660503980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b1317f0 0x55976b21db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.531+0000 7fa660503980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55976b035fe0 con 0x55976b1317f0 2024-05-09T09:49:27.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.531+0000 7fa65e01e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b1317f0 0x55976b21db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.535+0000 7fa65e01e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b1317f0 0x55976b21db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38818/0 (socket says 172.21.15.157:38818) 2024-05-09T09:49:27.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.535+0000 7fa65e01e640 1 -- 172.21.15.157:0/2967800456 learned_addr learned my addr 172.21.15.157:0/2967800456 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.535+0000 7fa65e01e640 1 -- 172.21.15.157:0/2967800456 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55976afbaae0 con 0x55976b1317f0 2024-05-09T09:49:27.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.535+0000 7fa65e01e640 1 --2- 172.21.15.157:0/2967800456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b1317f0 0x55976b21db80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa650001e50 tx=0x7fa650001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd30cc7748bf625c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.535+0000 7fa54c608640 1 -- 172.21.15.157:0/2967800456 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa65000e5d0 con 0x55976b1317f0 2024-05-09T09:49:27.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.535+0000 7fa54c608640 1 -- 172.21.15.157:0/2967800456 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa65000e770 con 0x55976b1317f0 2024-05-09T09:49:27.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.535+0000 7fa54c608640 1 -- 172.21.15.157:0/2967800456 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa65000eab0 con 0x55976b1317f0 2024-05-09T09:49:27.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.535+0000 7fa660503980 1 -- 172.21.15.157:0/2967800456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b1317f0 msgr2=0x55976b21db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.535+0000 7fa660503980 1 --2- 172.21.15.157:0/2967800456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b1317f0 0x55976b21db80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa650001e50 tx=0x7fa650001e80 comp rx=0 tx=0).stop 2024-05-09T09:49:27.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.535+0000 7fa660503980 1 -- 172.21.15.157:0/2967800456 shutdown_connections 2024-05-09T09:49:27.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.535+0000 7fa660503980 1 --2- 172.21.15.157:0/2967800456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b1317f0 0x55976b21db80 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.535+0000 7fa660503980 1 -- 172.21.15.157:0/2967800456 >> 172.21.15.157:0/2967800456 conn(0x55976b12d0c0 msgr2=0x55976b0a63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.535+0000 7fa660503980 1 -- 172.21.15.157:0/2967800456 shutdown_connections 2024-05-09T09:49:27.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.535+0000 7fa660503980 1 -- 172.21.15.157:0/2967800456 wait complete. 2024-05-09T09:49:27.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.535+0000 7fa660503980 1 Processor -- start 2024-05-09T09:49:27.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.535+0000 7fa660503980 1 -- start start 2024-05-09T09:49:27.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.535+0000 7fa660503980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b1317f0 0x55976b224d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.535+0000 7fa660503980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55976b13b170 con 0x55976b1317f0 2024-05-09T09:49:27.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.535+0000 7fa65e01e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b1317f0 0x55976b224d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.535+0000 7fa65e01e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b1317f0 0x55976b224d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38834/0 (socket says 172.21.15.157:38834) 2024-05-09T09:49:27.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.535+0000 7fa65e01e640 1 -- 172.21.15.157:0/1549632707 learned_addr learned my addr 172.21.15.157:0/1549632707 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.535+0000 7fa65e01e640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55976b225280 con 0x55976b1317f0 2024-05-09T09:49:27.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.539+0000 7fa65e01e640 1 --2- 172.21.15.157:0/1549632707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b1317f0 0x55976b224d40 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x55976b21e9e0 tx=0x7fa650000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.539+0000 7fa54ae05640 1 -- 172.21.15.157:0/1549632707 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa650001260 con 0x55976b1317f0 2024-05-09T09:49:27.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.539+0000 7fa660503980 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55976b225510 con 0x55976b1317f0 2024-05-09T09:49:27.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.539+0000 7fa54ae05640 1 -- 172.21.15.157:0/1549632707 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa65000fa40 con 0x55976b1317f0 2024-05-09T09:49:27.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.539+0000 7fa54ae05640 1 -- 172.21.15.157:0/1549632707 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa65000fd80 con 0x55976b1317f0 2024-05-09T09:49:27.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.539+0000 7fa660503980 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55976b2281f0 con 0x55976b1317f0 2024-05-09T09:49:27.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.539+0000 7fa54ae05640 1 -- 172.21.15.157:0/1549632707 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fa650017070 con 0x55976b1317f0 2024-05-09T09:49:27.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.539+0000 7fa54ae05640 1 --2- 172.21.15.157:0/1549632707 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa544034bb0 0x7fa544037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.539+0000 7fa54ae05640 1 -- 172.21.15.157:0/1549632707 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fa650015020 con 0x55976b1317f0 2024-05-09T09:49:27.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.539+0000 7fa65d81d640 1 --2- 172.21.15.157:0/1549632707 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa544034bb0 0x7fa544037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.541 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.539+0000 7fa65d81d640 1 --2- 172.21.15.157:0/1549632707 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa544034bb0 0x7fa544037070 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa6540ae000 tx=0x7fa6540a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.543+0000 7fa660503980 1 Processor -- start 2024-05-09T09:49:27.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.543+0000 7fa660503980 1 -- start start 2024-05-09T09:49:27.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.543+0000 7fa660503980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b249f80 0x55976b24a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.543+0000 7fa660503980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55976b03a020 con 0x55976b249f80 2024-05-09T09:49:27.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.543+0000 7fa65e01e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b249f80 0x55976b24a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.543+0000 7fa65e01e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b249f80 0x55976b24a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38844/0 (socket says 172.21.15.157:38844) 2024-05-09T09:49:27.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.543+0000 7fa65e01e640 1 -- 172.21.15.157:0/597477222 learned_addr learned my addr 172.21.15.157:0/597477222 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.543+0000 7fa65e01e640 1 -- 172.21.15.157:0/597477222 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55976b24a8e0 con 0x55976b249f80 2024-05-09T09:49:27.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.543+0000 7fa65e01e640 1 --2- 172.21.15.157:0/597477222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b249f80 0x55976b24a3a0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fa650049510 tx=0x7fa65001b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f666e8386297d8b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.543+0000 7fa548e01640 1 -- 172.21.15.157:0/597477222 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa650019660 con 0x55976b249f80 2024-05-09T09:49:27.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.543+0000 7fa548e01640 1 -- 172.21.15.157:0/597477222 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa65001ad20 con 0x55976b249f80 2024-05-09T09:49:27.545 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.543+0000 7fa548e01640 1 -- 172.21.15.157:0/597477222 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa65001bb20 con 0x55976b249f80 2024-05-09T09:49:27.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.543+0000 7fa660503980 1 -- 172.21.15.157:0/597477222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b249f80 msgr2=0x55976b24a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.543+0000 7fa660503980 1 --2- 172.21.15.157:0/597477222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b249f80 0x55976b24a3a0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fa650049510 tx=0x7fa65001b960 comp rx=0 tx=0).stop 2024-05-09T09:49:27.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.543+0000 7fa660503980 1 -- 172.21.15.157:0/597477222 shutdown_connections 2024-05-09T09:49:27.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.543+0000 7fa660503980 1 --2- 172.21.15.157:0/597477222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b249f80 0x55976b24a3a0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.543+0000 7fa660503980 1 -- 172.21.15.157:0/597477222 >> 172.21.15.157:0/597477222 conn(0x55976b135d50 msgr2=0x55976b2453c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.543+0000 7fa660503980 1 -- 172.21.15.157:0/597477222 shutdown_connections 2024-05-09T09:49:27.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.543+0000 7fa660503980 1 -- 172.21.15.157:0/597477222 wait complete. 2024-05-09T09:49:27.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.543+0000 7fa660503980 1 Processor -- start 2024-05-09T09:49:27.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.543+0000 7fa660503980 1 -- start start 2024-05-09T09:49:27.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.543+0000 7fa660503980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b249f80 0x55976b251530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.543+0000 7fa660503980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55976b24b290 con 0x55976b249f80 2024-05-09T09:49:27.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.547+0000 7fa65e01e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b249f80 0x55976b251530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.547+0000 7fa65e01e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b249f80 0x55976b251530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38860/0 (socket says 172.21.15.157:38860) 2024-05-09T09:49:27.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.547+0000 7fa65e01e640 1 -- 172.21.15.157:0/1216951996 learned_addr learned my addr 172.21.15.157:0/1216951996 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.547+0000 7fa65e01e640 1 -- 172.21.15.157:0/1216951996 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55976b251a70 con 0x55976b249f80 2024-05-09T09:49:27.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.547+0000 7fa65e01e640 1 --2- 172.21.15.157:0/1216951996 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b249f80 0x55976b251530 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fa65001bab0 tx=0x7fa6500494a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.547+0000 7fa541ba0640 1 -- 172.21.15.157:0/1216951996 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa650052070 con 0x55976b249f80 2024-05-09T09:49:27.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.547+0000 7fa660503980 1 -- 172.21.15.157:0/1216951996 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55976b251a70 con 0x55976b249f80 2024-05-09T09:49:27.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.547+0000 7fa541ba0640 1 -- 172.21.15.157:0/1216951996 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa650019660 con 0x55976b249f80 2024-05-09T09:49:27.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.547+0000 7fa541ba0640 1 -- 172.21.15.157:0/1216951996 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa650017750 con 0x55976b249f80 2024-05-09T09:49:27.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.547+0000 7fa660503980 1 -- 172.21.15.157:0/1216951996 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55976b251a70 con 0x55976b249f80 2024-05-09T09:49:27.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.547+0000 7fa541ba0640 1 -- 172.21.15.157:0/1216951996 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fa650055070 con 0x55976b249f80 2024-05-09T09:49:27.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.547+0000 7fa660503980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:49:27.550 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.547+0000 7fa660503980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:49:27.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.547+0000 7fa541ba0640 1 --2- 172.21.15.157:0/1216951996 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa538034b10 0x7fa538036fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.547+0000 7fa541ba0640 1 -- 172.21.15.157:0/1216951996 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fa65004ed30 con 0x55976b249f80 2024-05-09T09:49:27.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.547+0000 7fa660503980 1 Processor -- start 2024-05-09T09:49:27.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.547+0000 7fa65e81f640 1 --2- 172.21.15.157:0/1216951996 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa538034b10 0x7fa538036fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.547+0000 7fa660503980 1 -- start start 2024-05-09T09:49:27.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.547+0000 7fa660503980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b219e50 0x55976b2182e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.547+0000 7fa660503980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55976b21e2d0 con 0x55976b219e50 2024-05-09T09:49:27.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.547+0000 7fa65e81f640 1 --2- 172.21.15.157:0/1216951996 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa538034b10 0x7fa538036fd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x55976b246000 tx=0x7fa658005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.551+0000 7fa65e01e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b219e50 0x55976b2182e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.551+0000 7fa65e01e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b219e50 0x55976b2182e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38864/0 (socket says 172.21.15.157:38864) 2024-05-09T09:49:27.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.551+0000 7fa65e01e640 1 -- 172.21.15.157:0/239885943 learned_addr learned my addr 172.21.15.157:0/239885943 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.551+0000 7fa65e01e640 1 -- 172.21.15.157:0/239885943 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55976b218820 con 0x55976b219e50 2024-05-09T09:49:27.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.551+0000 7fa65e01e640 1 --2- 172.21.15.157:0/239885943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b219e50 0x55976b2182e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fa650057fa0 tx=0x7fa65001aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.551+0000 7fa521fe3640 1 -- 172.21.15.157:0/239885943 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa65006a070 con 0x55976b219e50 2024-05-09T09:49:27.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.551+0000 7fa521fe3640 1 -- 172.21.15.157:0/239885943 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa650031e00 con 0x55976b219e50 2024-05-09T09:49:27.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.551+0000 7fa521fe3640 1 -- 172.21.15.157:0/239885943 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa65003a5a0 con 0x55976b219e50 2024-05-09T09:49:27.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.551+0000 7fa660503980 1 -- 172.21.15.157:0/239885943 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55976b218820 con 0x55976b219e50 2024-05-09T09:49:27.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.551+0000 7fa660503980 1 -- 172.21.15.157:0/239885943 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55976b218820 con 0x55976b219e50 2024-05-09T09:49:27.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.551+0000 7fa521fe3640 1 -- 172.21.15.157:0/239885943 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fa65006d070 con 0x55976b219e50 2024-05-09T09:49:27.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.551+0000 7fa521fe3640 1 --2- 172.21.15.157:0/239885943 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa4a0034bb0 0x7fa4a0037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.551+0000 7fa521fe3640 1 -- 172.21.15.157:0/239885943 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fa650062070 con 0x55976b219e50 2024-05-09T09:49:27.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.551+0000 7fa65d81d640 1 --2- 172.21.15.157:0/239885943 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa4a0034bb0 0x7fa4a0037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.551+0000 7fa49b7fe640 20 reqs_thread_entry: start 2024-05-09T09:49:27.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.551+0000 7fa660503980 1 --2- 172.21.15.157:0/1549632707 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55976b274520 0x55976b276950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.551+0000 7fa660503980 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55976b276fd0 con 0x55976b274520 2024-05-09T09:49:27.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.551+0000 7fa65d81d640 1 --2- 172.21.15.157:0/239885943 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa4a0034bb0 0x7fa4a0037070 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa654000c10 tx=0x7fa654005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.551+0000 7fa65e81f640 1 --2- 172.21.15.157:0/1549632707 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55976b274520 0x55976b276950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.551+0000 7fa65e81f640 1 --2- 172.21.15.157:0/1549632707 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55976b274520 0x55976b276950 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.555+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa65800e070 con 0x55976b274520 2024-05-09T09:49:27.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.555+0000 7fa660503980 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55976b277880 con 0x55976b274520 2024-05-09T09:49:27.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.555+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa65800e070 con 0x55976b274520 2024-05-09T09:49:27.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.555+0000 7fa660503980 1 --2- 172.21.15.157:0/1549632707 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55976b2792b0 0x55976b27b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.555+0000 7fa660503980 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55976b27be50 con 0x55976b2792b0 2024-05-09T09:49:27.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.555+0000 7fa65e01e640 1 --2- 172.21.15.157:0/1549632707 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55976b2792b0 0x55976b27b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.555+0000 7fa65e01e640 1 --2- 172.21.15.157:0/1549632707 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55976b2792b0 0x55976b27b6c0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.555+0000 7fa65e01e640 1 -- 172.21.15.157:0/1549632707 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa65006c030 con 0x55976b2792b0 2024-05-09T09:49:27.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.555+0000 7fa660503980 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55976b282990 con 0x55976b274520 2024-05-09T09:49:27.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.555+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa65800e070 con 0x55976b274520 2024-05-09T09:49:27.557 INFO:teuthology.orchestra.run.smithi157.stderr:NOTICE: set zone's realm_id= 2024-05-09T09:49:27.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.555+0000 7fa660503980 1 --2- 172.21.15.157:0/1549632707 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55976b2869f0 0x55976b282e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.555+0000 7fa660503980 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x55976b2869f0 2024-05-09T09:49:27.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.555+0000 7fa65d81d640 1 --2- 172.21.15.157:0/1549632707 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55976b2869f0 0x55976b282e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.555+0000 7fa65d81d640 1 --2- 172.21.15.157:0/1549632707 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55976b2869f0 0x55976b282e10 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.555+0000 7fa65d81d640 1 -- 172.21.15.157:0/1549632707 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6540bf750 con 0x55976b2869f0 2024-05-09T09:49:27.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.555+0000 7fa65d81d640 1 --2- 172.21.15.157:0/1549632707 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa654009040 0x7fa6540cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.555+0000 7fa65d81d640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x7fa654009040 2024-05-09T09:49:27.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.559+0000 7fa65e81f640 1 --2- 172.21.15.157:0/1549632707 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa654009040 0x7fa6540cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.559+0000 7fa65e81f640 1 --2- 172.21.15.157:0/1549632707 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa654009040 0x7fa6540cb920 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.559+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa65800e070 con 0x7fa654009040 2024-05-09T09:49:27.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.559+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x55976b2792b0 2024-05-09T09:49:27.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.559+0000 7fa65e01e640 1 -- 172.21.15.157:0/1549632707 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa65006c030 con 0x55976b2792b0 2024-05-09T09:49:27.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.559+0000 7fa65e01e640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x55976b274520 2024-05-09T09:49:27.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.559+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa65800e070 con 0x55976b274520 2024-05-09T09:49:27.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.559+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x55976b274520 2024-05-09T09:49:27.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.559+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa65800e070 con 0x55976b274520 2024-05-09T09:49:27.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.559+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x55976b2792b0 2024-05-09T09:49:27.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.559+0000 7fa65e01e640 1 -- 172.21.15.157:0/1549632707 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa65006c030 con 0x55976b2792b0 2024-05-09T09:49:27.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.559+0000 7fa65e01e640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x55976b2792b0 2024-05-09T09:49:27.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.559+0000 7fa65e01e640 1 -- 172.21.15.157:0/1549632707 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa65006c030 con 0x55976b2792b0 2024-05-09T09:49:27.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.559+0000 7fa65e01e640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x7fa654009040 2024-05-09T09:49:27.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.559+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa65800e070 con 0x7fa654009040 2024-05-09T09:49:27.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.559+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x55976b2869f0 2024-05-09T09:49:27.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.563+0000 7fa65d81d640 1 -- 172.21.15.157:0/1549632707 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6540bf750 con 0x55976b2869f0 2024-05-09T09:49:27.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.563+0000 7fa65d81d640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x55976b274520 2024-05-09T09:49:27.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.563+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa65800e070 con 0x55976b274520 2024-05-09T09:49:27.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.563+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x55976b2792b0 2024-05-09T09:49:27.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.563+0000 7fa65e01e640 1 -- 172.21.15.157:0/1549632707 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa65006c030 con 0x55976b2792b0 2024-05-09T09:49:27.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.563+0000 7fa65e01e640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x55976b274520 2024-05-09T09:49:27.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.563+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa65800e070 con 0x55976b274520 2024-05-09T09:49:27.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.563+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x7fa654009040 2024-05-09T09:49:27.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.563+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(17 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa65802f040 con 0x7fa654009040 2024-05-09T09:49:27.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.563+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x55976b2869f0 2024-05-09T09:49:27.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.563+0000 7fa65d81d640 1 -- 172.21.15.157:0/1549632707 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6540bf750 con 0x55976b2869f0 2024-05-09T09:49:27.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.563+0000 7fa65d81d640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x55976b2869f0 2024-05-09T09:49:27.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.563+0000 7fa65d81d640 1 -- 172.21.15.157:0/1549632707 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa6540bf750 con 0x55976b2869f0 2024-05-09T09:49:27.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.563+0000 7fa65d81d640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x55976b2792b0 2024-05-09T09:49:27.566 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.563+0000 7fa65e01e640 1 -- 172.21.15.157:0/1549632707 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa65006c030 con 0x55976b2792b0 2024-05-09T09:49:27.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.563+0000 7fa65e01e640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x55976b2869f0 2024-05-09T09:49:27.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.563+0000 7fa65d81d640 1 -- 172.21.15.157:0/1549632707 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6540bf750 con 0x55976b2869f0 2024-05-09T09:49:27.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.563+0000 7fa65d81d640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x55976b2869f0 2024-05-09T09:49:27.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.563+0000 7fa65d81d640 1 -- 172.21.15.157:0/1549632707 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6540bf750 con 0x55976b2869f0 2024-05-09T09:49:27.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.563+0000 7fa65d81d640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x55976b274520 2024-05-09T09:49:27.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.567+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa65802f040 con 0x55976b274520 2024-05-09T09:49:27.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.567+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x55976b274520 2024-05-09T09:49:27.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.567+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa65802f040 con 0x55976b274520 2024-05-09T09:49:27.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.567+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x55976b2792b0 2024-05-09T09:49:27.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.567+0000 7fa65e01e640 1 -- 172.21.15.157:0/1549632707 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa65006c030 con 0x55976b2792b0 2024-05-09T09:49:27.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.567+0000 7fa65e01e640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x55976b2869f0 2024-05-09T09:49:27.568 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.567+0000 7fa65d81d640 1 -- 172.21.15.157:0/1549632707 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6540bf750 con 0x55976b2869f0 2024-05-09T09:49:27.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.567+0000 7fa65d81d640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x7fa654009040 2024-05-09T09:49:27.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.567+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa65802f040 con 0x7fa654009040 2024-05-09T09:49:27.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.567+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x55976b274520 2024-05-09T09:49:27.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.567+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa65802f040 con 0x55976b274520 2024-05-09T09:49:27.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.567+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x55976b2792b0 2024-05-09T09:49:27.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.567+0000 7fa65e01e640 1 -- 172.21.15.157:0/1549632707 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa65006c030 con 0x55976b2792b0 2024-05-09T09:49:27.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.567+0000 7fa65e01e640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x55976b2869f0 2024-05-09T09:49:27.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.567+0000 7fa65d81d640 1 -- 172.21.15.157:0/1549632707 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6540bf750 con 0x55976b2869f0 2024-05-09T09:49:27.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.567+0000 7fa65d81d640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x55976b2792b0 2024-05-09T09:49:27.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.567+0000 7fa65e01e640 1 -- 172.21.15.157:0/1549632707 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa65006c030 con 0x55976b2792b0 2024-05-09T09:49:27.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.567+0000 7fa65e01e640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x7fa654009040 2024-05-09T09:49:27.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.571+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa65802f040 con 0x7fa654009040 2024-05-09T09:49:27.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.571+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x55976b2869f0 2024-05-09T09:49:27.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.571+0000 7fa65d81d640 1 -- 172.21.15.157:0/1549632707 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6540bf750 con 0x55976b2869f0 2024-05-09T09:49:27.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.571+0000 7fa65d81d640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x55976b2792b0 2024-05-09T09:49:27.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.571+0000 7fa65e01e640 1 -- 172.21.15.157:0/1549632707 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa65006c030 con 0x55976b2792b0 2024-05-09T09:49:27.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.571+0000 7fa65e01e640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x55976b274520 2024-05-09T09:49:27.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.571+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(35 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa65802f040 con 0x55976b274520 2024-05-09T09:49:27.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.571+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55976b282220 con 0x7fa654009040 2024-05-09T09:49:27.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.571+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(36 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa65802f040 con 0x7fa654009040 2024-05-09T09:49:27.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.571+0000 7fa660503980 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55976b283fc0 con 0x55976b274520 2024-05-09T09:49:27.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.571+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa65802f040 con 0x55976b274520 2024-05-09T09:49:27.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.571+0000 7fa660503980 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:38 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55976b284840 con 0x55976b2792b0 2024-05-09T09:49:27.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.571+0000 7fa65e01e640 1 -- 172.21.15.157:0/1549632707 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(38 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa65006c030 con 0x55976b2792b0 2024-05-09T09:49:27.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.571+0000 7fa660503980 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:39 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55976b284be0 con 0x55976b2792b0 2024-05-09T09:49:27.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.575+0000 7fa65e01e640 1 -- 172.21.15.157:0/1549632707 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(39 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [create,call,writefull 0~1155] v32'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7fa65006c030 con 0x55976b2792b0 2024-05-09T09:49:27.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.575+0000 7fa660503980 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55976b2814e0 con 0x55976b274520 2024-05-09T09:49:27.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.579+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v32'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7fa65802f040 con 0x55976b274520 2024-05-09T09:49:27.579 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.579+0000 7fa660503980 1 -- 172.21.15.157:0/1549632707 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55976b287440 con 0x55976b274520 2024-05-09T09:49:27.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.579+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v32'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7fa65802f040 con 0x55976b274520 2024-05-09T09:49:27.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.579+0000 7fa660503980 1 -- 172.21.15.157:0/1216951996 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa538034b10 msgr2=0x7fa538036fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.579+0000 7fa660503980 1 --2- 172.21.15.157:0/1216951996 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa538034b10 0x7fa538036fd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x55976b246000 tx=0x7fa658005850 comp rx=0 tx=0).stop 2024-05-09T09:49:27.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.579+0000 7fa660503980 1 -- 172.21.15.157:0/1216951996 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b249f80 msgr2=0x55976b251530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.579+0000 7fa660503980 1 --2- 172.21.15.157:0/1216951996 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b249f80 0x55976b251530 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fa65001bab0 tx=0x7fa6500494a0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.579+0000 7fa660503980 1 -- 172.21.15.157:0/1216951996 shutdown_connections 2024-05-09T09:49:27.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.579+0000 7fa660503980 1 --2- 172.21.15.157:0/1216951996 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa538034b10 0x7fa538036fd0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.579+0000 7fa660503980 1 --2- 172.21.15.157:0/1216951996 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b249f80 0x55976b251530 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.579+0000 7fa660503980 1 -- 172.21.15.157:0/1216951996 >> 172.21.15.157:0/1216951996 conn(0x55976b135d50 msgr2=0x55976b2441c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.579+0000 7fa660503980 1 -- 172.21.15.157:0/1216951996 shutdown_connections 2024-05-09T09:49:27.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.579+0000 7fa660503980 1 -- 172.21.15.157:0/1216951996 wait complete. 2024-05-09T09:49:27.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.579+0000 7fa660503980 1 -- 172.21.15.157:0/239885943 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa4a0034bb0 msgr2=0x7fa4a0037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.579+0000 7fa660503980 1 --2- 172.21.15.157:0/239885943 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa4a0034bb0 0x7fa4a0037070 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa654000c10 tx=0x7fa654005ad0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.579+0000 7fa660503980 1 -- 172.21.15.157:0/239885943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b219e50 msgr2=0x55976b2182e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.579+0000 7fa660503980 1 --2- 172.21.15.157:0/239885943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b219e50 0x55976b2182e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fa650057fa0 tx=0x7fa65001aa60 comp rx=0 tx=0).stop 2024-05-09T09:49:27.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.579+0000 7fa660503980 1 -- 172.21.15.157:0/239885943 shutdown_connections 2024-05-09T09:49:27.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.579+0000 7fa660503980 1 --2- 172.21.15.157:0/239885943 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa4a0034bb0 0x7fa4a0037070 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.579+0000 7fa660503980 1 --2- 172.21.15.157:0/239885943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b219e50 0x55976b2182e0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.579+0000 7fa660503980 1 -- 172.21.15.157:0/239885943 >> 172.21.15.157:0/239885943 conn(0x55976b2614f0 msgr2=0x55976b261f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.579+0000 7fa660503980 1 -- 172.21.15.157:0/239885943 shutdown_connections 2024-05-09T09:49:27.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.579+0000 7fa660503980 1 -- 172.21.15.157:0/239885943 wait complete. 2024-05-09T09:49:27.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.583+0000 7fa660503980 1 -- 172.21.15.157:0/1549632707 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55976b2792b0 msgr2=0x55976b27b6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.583+0000 7fa660503980 1 --2- 172.21.15.157:0/1549632707 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55976b2792b0 0x55976b27b6c0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.583+0000 7fa660503980 1 -- 172.21.15.157:0/1549632707 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55976b274520 msgr2=0x55976b276950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.583+0000 7fa660503980 1 --2- 172.21.15.157:0/1549632707 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55976b274520 0x55976b276950 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.583+0000 7fa660503980 1 -- 172.21.15.157:0/1549632707 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa654009040 msgr2=0x7fa6540cb920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.583+0000 7fa660503980 1 --2- 172.21.15.157:0/1549632707 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa654009040 0x7fa6540cb920 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.583+0000 7fa660503980 1 -- 172.21.15.157:0/1549632707 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55976b2869f0 msgr2=0x55976b282e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.583+0000 7fa660503980 1 --2- 172.21.15.157:0/1549632707 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55976b2869f0 0x55976b282e10 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.583+0000 7fa660503980 1 -- 172.21.15.157:0/1549632707 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa544034bb0 msgr2=0x7fa544037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.583+0000 7fa660503980 1 --2- 172.21.15.157:0/1549632707 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa544034bb0 0x7fa544037070 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa6540ae000 tx=0x7fa6540a6000 comp rx=0 tx=0).stop 2024-05-09T09:49:27.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.583+0000 7fa660503980 1 -- 172.21.15.157:0/1549632707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b1317f0 msgr2=0x55976b224d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.583+0000 7fa660503980 1 --2- 172.21.15.157:0/1549632707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55976b1317f0 0x55976b224d40 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x55976b21e9e0 tx=0x7fa650000bd0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.583+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 reap_dead start 2024-05-09T09:49:27.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.583+0000 7fa65e81f640 1 -- 172.21.15.157:0/1549632707 reap_dead start 2024-05-09T09:49:27.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.583+0000 7fa660503980 1 -- 172.21.15.157:0/1549632707 shutdown_connections 2024-05-09T09:49:27.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.583+0000 7fa660503980 1 -- 172.21.15.157:0/1549632707 >> 172.21.15.157:0/1549632707 conn(0x55976b12d0c0 msgr2=0x55976b217130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.583+0000 7fa660503980 1 -- 172.21.15.157:0/1549632707 shutdown_connections 2024-05-09T09:49:27.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.583+0000 7fa660503980 1 -- 172.21.15.157:0/1549632707 wait complete. 2024-05-09T09:49:27.594 INFO:teuthology.orchestra.run.smithi157.stdout:{"id":"b73385e6-4d12-4d8e-98d6-6f8ed75f5b82","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-05-09T09:49:27.594 DEBUG:tasks.util.rgw: json result: {'id': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-05-09T09:49:27.594 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-05-09T09:49:27.594 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-05-09T09:49:27.594 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-05-09T09:49:27.671 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:49:27.671 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:49:27.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.671+0000 7f1612627980 1 Processor -- start 2024-05-09T09:49:27.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.671+0000 7f1612627980 1 -- start start 2024-05-09T09:49:27.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.671+0000 7f1612627980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x560c4effab20 0x560c4effaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.671+0000 7f1612627980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560c4eeae440 con 0x560c4effb440 2024-05-09T09:49:27.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.671+0000 7f1612627980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x560c4ee995f0 con 0x560c4effab20 2024-05-09T09:49:27.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.671+0000 7f1610142640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x560c4effab20 0x560c4effaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.671+0000 7f1610142640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x560c4effab20 0x560c4effaf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38866/0 (socket says 172.21.15.157:38866) 2024-05-09T09:49:27.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.671+0000 7f160f941640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x560c4effb440 0x560c4effbdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:45546/0 (socket says 172.21.15.157:45546) 2024-05-09T09:49:27.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.671+0000 7f1610142640 1 -- 172.21.15.157:0/970930953 learned_addr learned my addr 172.21.15.157:0/970930953 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.671+0000 7f1610142640 1 -- 172.21.15.157:0/970930953 >> v1:172.21.15.110:6789/0 conn(0x560c4effb440 legacy=0x560c4effbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.671+0000 7f1610142640 1 -- 172.21.15.157:0/970930953 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c4eea4990 con 0x560c4effab20 2024-05-09T09:49:27.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.675+0000 7f1610142640 1 --2- 172.21.15.157:0/970930953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4effab20 0x560c4effaf00 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f160000a5c0 tx=0x7f160001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60120c0981620209 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.675+0000 7f160f140640 1 -- 172.21.15.157:0/970930953 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16000a6070 con 0x560c4effab20 2024-05-09T09:49:27.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.675+0000 7f160f140640 1 -- 172.21.15.157:0/970930953 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16000af070 con 0x560c4effab20 2024-05-09T09:49:27.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.675+0000 7f160f140640 1 -- 172.21.15.157:0/970930953 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16000aa5c0 con 0x560c4effab20 2024-05-09T09:49:27.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.675+0000 7f1612627980 1 -- 172.21.15.157:0/970930953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4effab20 msgr2=0x560c4effaf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.675+0000 7f1612627980 1 --2- 172.21.15.157:0/970930953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4effab20 0x560c4effaf00 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f160000a5c0 tx=0x7f160001b340 comp rx=0 tx=0).stop 2024-05-09T09:49:27.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.675+0000 7f1612627980 1 -- 172.21.15.157:0/970930953 shutdown_connections 2024-05-09T09:49:27.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.675+0000 7f1612627980 1 --2- 172.21.15.157:0/970930953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4effab20 0x560c4effaf00 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.675+0000 7f1612627980 1 -- 172.21.15.157:0/970930953 >> 172.21.15.157:0/970930953 conn(0x560c4ef6e240 msgr2=0x560c4ef6e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.675+0000 7f1612627980 1 -- 172.21.15.157:0/970930953 shutdown_connections 2024-05-09T09:49:27.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.675+0000 7f1612627980 1 -- 172.21.15.157:0/970930953 wait complete. 2024-05-09T09:49:27.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.691+0000 7f1612627980 1 Processor -- start 2024-05-09T09:49:27.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.691+0000 7f1612627980 1 -- start start 2024-05-09T09:49:27.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.691+0000 7f1612627980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4effab20 0x560c4f0e6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.691+0000 7f1612627980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560c4eefbfe0 con 0x560c4effab20 2024-05-09T09:49:27.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.695+0000 7f1610142640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4effab20 0x560c4f0e6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.695+0000 7f1610142640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4effab20 0x560c4f0e6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38870/0 (socket says 172.21.15.157:38870) 2024-05-09T09:49:27.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.695+0000 7f1610142640 1 -- 172.21.15.157:0/2178928052 learned_addr learned my addr 172.21.15.157:0/2178928052 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.695+0000 7f1610142640 1 -- 172.21.15.157:0/2178928052 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c4ee80ae0 con 0x560c4effab20 2024-05-09T09:49:27.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.695+0000 7f1610142640 1 --2- 172.21.15.157:0/2178928052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4effab20 0x560c4f0e6410 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f16000ac040 tx=0x7f1600003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99acb90b4ea0c900 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.695+0000 7f14fe60c640 1 -- 172.21.15.157:0/2178928052 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16000aa970 con 0x560c4effab20 2024-05-09T09:49:27.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.695+0000 7f14fe60c640 1 -- 172.21.15.157:0/2178928052 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16000aab10 con 0x560c4effab20 2024-05-09T09:49:27.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.695+0000 7f14fe60c640 1 -- 172.21.15.157:0/2178928052 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16000aae30 con 0x560c4effab20 2024-05-09T09:49:27.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.695+0000 7f1612627980 1 -- 172.21.15.157:0/2178928052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4effab20 msgr2=0x560c4f0e6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.695+0000 7f1612627980 1 --2- 172.21.15.157:0/2178928052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4effab20 0x560c4f0e6410 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f16000ac040 tx=0x7f1600003030 comp rx=0 tx=0).stop 2024-05-09T09:49:27.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.695+0000 7f1612627980 1 -- 172.21.15.157:0/2178928052 shutdown_connections 2024-05-09T09:49:27.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.695+0000 7f1612627980 1 --2- 172.21.15.157:0/2178928052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4effab20 0x560c4f0e6410 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.695+0000 7f1612627980 1 -- 172.21.15.157:0/2178928052 >> 172.21.15.157:0/2178928052 conn(0x560c4ef6e240 msgr2=0x560c4f0e1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.695+0000 7f1612627980 1 -- 172.21.15.157:0/2178928052 shutdown_connections 2024-05-09T09:49:27.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.699+0000 7f1612627980 1 -- 172.21.15.157:0/2178928052 wait complete. 2024-05-09T09:49:27.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.699+0000 7f1612627980 1 Processor -- start 2024-05-09T09:49:27.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.699+0000 7f1612627980 1 -- start start 2024-05-09T09:49:27.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.699+0000 7f1612627980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4effab20 0x560c4f0ed470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.699+0000 7f1612627980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560c4f004b60 con 0x560c4effab20 2024-05-09T09:49:27.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.699+0000 7f1610142640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4effab20 0x560c4f0ed470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.699+0000 7f1610142640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4effab20 0x560c4f0ed470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38886/0 (socket says 172.21.15.157:38886) 2024-05-09T09:49:27.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.699+0000 7f1610142640 1 -- 172.21.15.157:0/558443399 learned_addr learned my addr 172.21.15.157:0/558443399 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.699+0000 7f1610142640 1 -- 172.21.15.157:0/558443399 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c4f0ed9b0 con 0x560c4effab20 2024-05-09T09:49:27.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.703+0000 7f1610142640 1 --2- 172.21.15.157:0/558443399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4effab20 0x560c4f0ed470 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f1600003070 tx=0x7f16000180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.703+0000 7f14fce09640 1 -- 172.21.15.157:0/558443399 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16000c6710 con 0x560c4effab20 2024-05-09T09:49:27.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.703+0000 7f14fce09640 1 -- 172.21.15.157:0/558443399 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16000c68b0 con 0x560c4effab20 2024-05-09T09:49:27.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.703+0000 7f1612627980 1 -- 172.21.15.157:0/558443399 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c4f0edc40 con 0x560c4effab20 2024-05-09T09:49:27.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.703+0000 7f14fce09640 1 -- 172.21.15.157:0/558443399 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16000c6b90 con 0x560c4effab20 2024-05-09T09:49:27.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.703+0000 7f1612627980 1 -- 172.21.15.157:0/558443399 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c4f0f08d0 con 0x560c4effab20 2024-05-09T09:49:27.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.703+0000 7f14fce09640 1 -- 172.21.15.157:0/558443399 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f16000d0400 con 0x560c4effab20 2024-05-09T09:49:27.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.703+0000 7f14fce09640 1 --2- 172.21.15.157:0/558443399 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f14f8034c50 0x7f14f8037110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.703+0000 7f14fce09640 1 -- 172.21.15.157:0/558443399 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f16000e61d0 con 0x560c4effab20 2024-05-09T09:49:27.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.703+0000 7f160f941640 1 --2- 172.21.15.157:0/558443399 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f14f8034c50 0x7f14f8037110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.703+0000 7f160f941640 1 --2- 172.21.15.157:0/558443399 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f14f8034c50 0x7f14f8037110 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1604001e50 tx=0x7f16040013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.707+0000 7f1612627980 1 Processor -- start 2024-05-09T09:49:27.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.707+0000 7f1612627980 1 -- start start 2024-05-09T09:49:27.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.707+0000 7f1612627980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4f1125d0 0x560c4f1129f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.707+0000 7f1612627980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560c4ef00020 con 0x560c4f1125d0 2024-05-09T09:49:27.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.707+0000 7f1610142640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4f1125d0 0x560c4f1129f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.707+0000 7f1610142640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4f1125d0 0x560c4f1129f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38896/0 (socket says 172.21.15.157:38896) 2024-05-09T09:49:27.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.707+0000 7f1610142640 1 -- 172.21.15.157:0/4070453395 learned_addr learned my addr 172.21.15.157:0/4070453395 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.707+0000 7f1610142640 1 -- 172.21.15.157:0/4070453395 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c4f112f30 con 0x560c4f1125d0 2024-05-09T09:49:27.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.707+0000 7f1610142640 1 --2- 172.21.15.157:0/4070453395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4f1125d0 0x560c4f1129f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f16000bca90 tx=0x7f16000bcac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9e0935026672a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.707+0000 7f14f539f640 1 -- 172.21.15.157:0/4070453395 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16000c53a0 con 0x560c4f1125d0 2024-05-09T09:49:27.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.707+0000 7f14f539f640 1 -- 172.21.15.157:0/4070453395 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16000c5540 con 0x560c4f1125d0 2024-05-09T09:49:27.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.707+0000 7f14f539f640 1 -- 172.21.15.157:0/4070453395 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16000b51e0 con 0x560c4f1125d0 2024-05-09T09:49:27.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.707+0000 7f1612627980 1 -- 172.21.15.157:0/4070453395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4f1125d0 msgr2=0x560c4f1129f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.707+0000 7f1612627980 1 --2- 172.21.15.157:0/4070453395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4f1125d0 0x560c4f1129f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f16000bca90 tx=0x7f16000bcac0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.707+0000 7f1612627980 1 -- 172.21.15.157:0/4070453395 shutdown_connections 2024-05-09T09:49:27.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.707+0000 7f1612627980 1 --2- 172.21.15.157:0/4070453395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4f1125d0 0x560c4f1129f0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.707+0000 7f1612627980 1 -- 172.21.15.157:0/4070453395 >> 172.21.15.157:0/4070453395 conn(0x560c4effb440 msgr2=0x560c4f10da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.707+0000 7f1612627980 1 -- 172.21.15.157:0/4070453395 shutdown_connections 2024-05-09T09:49:27.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.707+0000 7f1612627980 1 -- 172.21.15.157:0/4070453395 wait complete. 2024-05-09T09:49:27.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.711+0000 7f1612627980 1 Processor -- start 2024-05-09T09:49:27.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.711+0000 7f1612627980 1 -- start start 2024-05-09T09:49:27.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.711+0000 7f1612627980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4f1125d0 0x560c4f119b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.711+0000 7f1612627980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560c4f1138e0 con 0x560c4f1125d0 2024-05-09T09:49:27.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.711+0000 7f1610142640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4f1125d0 0x560c4f119b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.711+0000 7f1610142640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4f1125d0 0x560c4f119b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38900/0 (socket says 172.21.15.157:38900) 2024-05-09T09:49:27.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.711+0000 7f1610142640 1 -- 172.21.15.157:0/4169506985 learned_addr learned my addr 172.21.15.157:0/4169506985 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.711+0000 7f1610142640 1 -- 172.21.15.157:0/4169506985 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c4f11a0c0 con 0x560c4f1125d0 2024-05-09T09:49:27.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.711+0000 7f1610142640 1 --2- 172.21.15.157:0/4169506985 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4f1125d0 0x560c4f119b80 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f16000b1040 tx=0x7f16000e45b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.711+0000 7f14ef7fe640 1 -- 172.21.15.157:0/4169506985 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16000b3b80 con 0x560c4f1125d0 2024-05-09T09:49:27.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.711+0000 7f14ef7fe640 1 -- 172.21.15.157:0/4169506985 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16000b3d40 con 0x560c4f1125d0 2024-05-09T09:49:27.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.711+0000 7f1612627980 1 -- 172.21.15.157:0/4169506985 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c4f11a0c0 con 0x560c4f1125d0 2024-05-09T09:49:27.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.711+0000 7f14ef7fe640 1 -- 172.21.15.157:0/4169506985 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16000e41a0 con 0x560c4f1125d0 2024-05-09T09:49:27.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.711+0000 7f1612627980 1 -- 172.21.15.157:0/4169506985 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c4f11a0c0 con 0x560c4f1125d0 2024-05-09T09:49:27.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.711+0000 7f14ef7fe640 1 -- 172.21.15.157:0/4169506985 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f16000b33f0 con 0x560c4f1125d0 2024-05-09T09:49:27.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.711+0000 7f1612627980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:49:27.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.711+0000 7f1612627980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:49:27.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.711+0000 7f14ef7fe640 1 --2- 172.21.15.157:0/4169506985 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f14e8034b60 0x7f14e8037020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.711+0000 7f14ef7fe640 1 -- 172.21.15.157:0/4169506985 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f16000ee070 con 0x560c4f1125d0 2024-05-09T09:49:27.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.711+0000 7f160f941640 1 --2- 172.21.15.157:0/4169506985 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f14e8034b60 0x7f14e8037020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.711+0000 7f1612627980 1 Processor -- start 2024-05-09T09:49:27.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.715+0000 7f1612627980 1 -- start start 2024-05-09T09:49:27.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.715+0000 7f1612627980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4f134e00 0x560c4f135220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.715+0000 7f1612627980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560c4f0e6aa0 con 0x560c4f134e00 2024-05-09T09:49:27.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.715+0000 7f160f941640 1 --2- 172.21.15.157:0/4169506985 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f14e8034b60 0x7f14e8037020 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1604000f70 tx=0x7f160400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.715+0000 7f1610142640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4f134e00 0x560c4f135220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.715+0000 7f1610142640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4f134e00 0x560c4f135220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38902/0 (socket says 172.21.15.157:38902) 2024-05-09T09:49:27.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.715+0000 7f1610142640 1 -- 172.21.15.157:0/3711072315 learned_addr learned my addr 172.21.15.157:0/3711072315 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.715+0000 7f1610142640 1 -- 172.21.15.157:0/3711072315 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c4f135760 con 0x560c4f134e00 2024-05-09T09:49:27.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.715+0000 7f1610142640 1 --2- 172.21.15.157:0/3711072315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4f134e00 0x560c4f135220 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f16000c54d0 tx=0x7f16000b5d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.715+0000 7f14d3fe7640 1 -- 172.21.15.157:0/3711072315 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f160010a070 con 0x560c4f134e00 2024-05-09T09:49:27.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.715+0000 7f14d3fe7640 1 -- 172.21.15.157:0/3711072315 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16000d06f0 con 0x560c4f134e00 2024-05-09T09:49:27.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.715+0000 7f14d3fe7640 1 -- 172.21.15.157:0/3711072315 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16000b54b0 con 0x560c4f134e00 2024-05-09T09:49:27.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.715+0000 7f1612627980 1 -- 172.21.15.157:0/3711072315 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c4f135760 con 0x560c4f134e00 2024-05-09T09:49:27.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.715+0000 7f1612627980 1 -- 172.21.15.157:0/3711072315 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c4f135760 con 0x560c4f134e00 2024-05-09T09:49:27.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.715+0000 7f14d3fe7640 1 -- 172.21.15.157:0/3711072315 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f160010d070 con 0x560c4f134e00 2024-05-09T09:49:27.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.715+0000 7f14d3fe7640 1 --2- 172.21.15.157:0/3711072315 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f144c034c00 0x7f144c0370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.715+0000 7f14d3fe7640 1 -- 172.21.15.157:0/3711072315 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f1600110d60 con 0x560c4f134e00 2024-05-09T09:49:27.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.715+0000 7f160f941640 1 --2- 172.21.15.157:0/3711072315 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f144c034c00 0x7f144c0370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.719+0000 7f14d1fe3640 20 reqs_thread_entry: start 2024-05-09T09:49:27.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.719+0000 7f1612627980 1 --2- 172.21.15.157:0/558443399 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560c4f13a7f0 0x560c4f13cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.719+0000 7f160f941640 1 --2- 172.21.15.157:0/3711072315 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f144c034c00 0x7f144c0370c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f160400ffd0 tx=0x7f1604006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.719+0000 7f1612627980 1 -- 172.21.15.157:0/558443399 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c4f13d160 con 0x560c4f13a7f0 2024-05-09T09:49:27.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.719+0000 7f1610943640 1 --2- 172.21.15.157:0/558443399 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560c4f13a7f0 0x560c4f13cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.719+0000 7f1610943640 1 --2- 172.21.15.157:0/558443399 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560c4f13a7f0 0x560c4f13cbe0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.719+0000 7f1610943640 1 -- 172.21.15.157:0/558443399 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f160800a420 con 0x560c4f13a7f0 2024-05-09T09:49:27.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.719+0000 7f1612627980 1 -- 172.21.15.157:0/558443399 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c4f139dd0 con 0x560c4f13a7f0 2024-05-09T09:49:27.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.719+0000 7f1610943640 1 -- 172.21.15.157:0/558443399 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f160800a420 con 0x560c4f13a7f0 2024-05-09T09:49:27.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.719+0000 7f1612627980 1 --2- 172.21.15.157:0/558443399 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560c4f13f490 0x560c4f141880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.719+0000 7f1612627980 1 -- 172.21.15.157:0/558443399 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c4f141f50 con 0x560c4f13f490 2024-05-09T09:49:27.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.719+0000 7f1610142640 1 --2- 172.21.15.157:0/558443399 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560c4f13f490 0x560c4f141880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.719+0000 7f1610142640 1 --2- 172.21.15.157:0/558443399 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560c4f13f490 0x560c4f141880 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.719+0000 7f1610142640 1 -- 172.21.15.157:0/558443399 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f160010c030 con 0x560c4f13f490 2024-05-09T09:49:27.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 -- 172.21.15.157:0/4169506985 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f14e8034b60 msgr2=0x7f14e8037020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 --2- 172.21.15.157:0/4169506985 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f14e8034b60 0x7f14e8037020 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1604000f70 tx=0x7f160400f000 comp rx=0 tx=0).stop 2024-05-09T09:49:27.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 -- 172.21.15.157:0/4169506985 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4f1125d0 msgr2=0x560c4f119b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 --2- 172.21.15.157:0/4169506985 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4f1125d0 0x560c4f119b80 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f16000b1040 tx=0x7f16000e45b0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 -- 172.21.15.157:0/4169506985 shutdown_connections 2024-05-09T09:49:27.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 --2- 172.21.15.157:0/4169506985 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f14e8034b60 0x7f14e8037020 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 --2- 172.21.15.157:0/4169506985 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4f1125d0 0x560c4f119b80 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 -- 172.21.15.157:0/4169506985 >> 172.21.15.157:0/4169506985 conn(0x560c4effb440 msgr2=0x560c4f10c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 -- 172.21.15.157:0/4169506985 shutdown_connections 2024-05-09T09:49:27.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 -- 172.21.15.157:0/4169506985 wait complete. 2024-05-09T09:49:27.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 -- 172.21.15.157:0/3711072315 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f144c034c00 msgr2=0x7f144c0370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 --2- 172.21.15.157:0/3711072315 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f144c034c00 0x7f144c0370c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f160400ffd0 tx=0x7f1604006000 comp rx=0 tx=0).stop 2024-05-09T09:49:27.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 -- 172.21.15.157:0/3711072315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4f134e00 msgr2=0x560c4f135220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 --2- 172.21.15.157:0/3711072315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4f134e00 0x560c4f135220 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f16000c54d0 tx=0x7f16000b5d40 comp rx=0 tx=0).stop 2024-05-09T09:49:27.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 -- 172.21.15.157:0/3711072315 shutdown_connections 2024-05-09T09:49:27.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 --2- 172.21.15.157:0/3711072315 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f144c034c00 0x7f144c0370c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 --2- 172.21.15.157:0/3711072315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4f134e00 0x560c4f135220 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 -- 172.21.15.157:0/3711072315 >> 172.21.15.157:0/3711072315 conn(0x560c4f1299b0 msgr2=0x560c4f12a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 -- 172.21.15.157:0/3711072315 shutdown_connections 2024-05-09T09:49:27.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 -- 172.21.15.157:0/3711072315 wait complete. 2024-05-09T09:49:27.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 -- 172.21.15.157:0/558443399 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560c4f13f490 msgr2=0x560c4f141880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 --2- 172.21.15.157:0/558443399 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560c4f13f490 0x560c4f141880 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 -- 172.21.15.157:0/558443399 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560c4f13a7f0 msgr2=0x560c4f13cbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 --2- 172.21.15.157:0/558443399 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560c4f13a7f0 0x560c4f13cbe0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 -- 172.21.15.157:0/558443399 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f14f8034c50 msgr2=0x7f14f8037110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 --2- 172.21.15.157:0/558443399 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f14f8034c50 0x7f14f8037110 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1604001e50 tx=0x7f16040013b0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 -- 172.21.15.157:0/558443399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4effab20 msgr2=0x560c4f0ed470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 --2- 172.21.15.157:0/558443399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4effab20 0x560c4f0ed470 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f1600003070 tx=0x7f16000180e0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 -- 172.21.15.157:0/558443399 shutdown_connections 2024-05-09T09:49:27.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 --2- 172.21.15.157:0/558443399 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x560c4f13f490 0x560c4f141880 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 --2- 172.21.15.157:0/558443399 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560c4f13a7f0 0x560c4f13cbe0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 --2- 172.21.15.157:0/558443399 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f14f8034c50 0x7f14f8037110 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 --2- 172.21.15.157:0/558443399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c4effab20 0x560c4f0ed470 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 -- 172.21.15.157:0/558443399 >> 172.21.15.157:0/558443399 conn(0x560c4ef6e240 msgr2=0x560c4f0e0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 -- 172.21.15.157:0/558443399 shutdown_connections 2024-05-09T09:49:27.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.723+0000 7f1612627980 1 -- 172.21.15.157:0/558443399 wait complete. 2024-05-09T09:49:27.735 INFO:teuthology.orchestra.run.smithi157.stdout:{"id":"b73385e6-4d12-4d8e-98d6-6f8ed75f5b82","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-05-09T09:49:27.735 DEBUG:tasks.util.rgw: json result: {'id': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-05-09T09:49:27.735 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-05-09T09:49:27.735 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-05-09T09:49:27.735 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-05-09T09:49:27.815 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:49:27.815 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:49:27.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.815+0000 7f50a4b77980 1 Processor -- start 2024-05-09T09:49:27.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.815+0000 7f50a4b77980 1 -- start start 2024-05-09T09:49:27.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.815+0000 7f50a4b77980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5653590b0cd0 0x5653590b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.815+0000 7f50a4b77980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x565358f62440 con 0x565359020ba0 2024-05-09T09:49:27.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.815+0000 7f50a4b77980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x565358f4d5f0 con 0x5653590b0cd0 2024-05-09T09:49:27.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.815+0000 7f50a1e91640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5653590b0cd0 0x5653590b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.815+0000 7f50a2692640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x565359020ba0 0x5653590af5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:45556/0 (socket says 172.21.15.157:45556) 2024-05-09T09:49:27.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.815+0000 7f50a2692640 1 -- 172.21.15.157:0/2647751936 learned_addr learned my addr 172.21.15.157:0/2647751936 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:49:27.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.815+0000 7f50a1e91640 1 -- 172.21.15.157:0/2647751936 >> v1:172.21.15.110:6789/0 conn(0x565359020ba0 legacy=0x5653590af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.815+0000 7f50a1e91640 1 -- 172.21.15.157:0/2647751936 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x565358f58990 con 0x5653590b0cd0 2024-05-09T09:49:27.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.819+0000 7f50a1e91640 1 --2- 172.21.15.157:0/2647751936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653590b0cd0 0x5653590b30c0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f509400a480 tx=0x7f509401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f211cdfe15924fdc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.819+0000 7f50a1690640 1 -- 172.21.15.157:0/2647751936 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50940b0070 con 0x5653590b0cd0 2024-05-09T09:49:27.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.819+0000 7f50a1690640 1 -- 172.21.15.157:0/2647751936 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50940ab540 con 0x5653590b0cd0 2024-05-09T09:49:27.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.819+0000 7f50a1690640 1 -- 172.21.15.157:0/2647751936 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50940ab840 con 0x5653590b0cd0 2024-05-09T09:49:27.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.819+0000 7f50a4b77980 1 -- 172.21.15.157:0/2647751936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653590b0cd0 msgr2=0x5653590b30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.819+0000 7f50a4b77980 1 --2- 172.21.15.157:0/2647751936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653590b0cd0 0x5653590b30c0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f509400a480 tx=0x7f509401b280 comp rx=0 tx=0).stop 2024-05-09T09:49:27.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.819+0000 7f50a4b77980 1 -- 172.21.15.157:0/2647751936 shutdown_connections 2024-05-09T09:49:27.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.819+0000 7f50a4b77980 1 --2- 172.21.15.157:0/2647751936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653590b0cd0 0x5653590b30c0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.819+0000 7f50a4b77980 1 -- 172.21.15.157:0/2647751936 >> 172.21.15.157:0/2647751936 conn(0x5653590a70d0 msgr2=0x5653590a94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.819+0000 7f50a4b77980 1 -- 172.21.15.157:0/2647751936 shutdown_connections 2024-05-09T09:49:27.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.819+0000 7f50a4b77980 1 -- 172.21.15.157:0/2647751936 wait complete. 2024-05-09T09:49:27.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.835+0000 7f50a4b77980 1 Processor -- start 2024-05-09T09:49:27.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.835+0000 7f50a4b77980 1 -- start start 2024-05-09T09:49:27.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.835+0000 7f50a4b77980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565359020ba0 0x5653590acd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.835+0000 7f50a4b77980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x565358faffe0 con 0x565359020ba0 2024-05-09T09:49:27.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.835+0000 7f50a2692640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565359020ba0 0x5653590acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.835+0000 7f50a2692640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565359020ba0 0x5653590acd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38912/0 (socket says 172.21.15.157:38912) 2024-05-09T09:49:27.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.835+0000 7f50a2692640 1 -- 172.21.15.157:0/820648974 learned_addr learned my addr 172.21.15.157:0/820648974 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.835+0000 7f50a2692640 1 -- 172.21.15.157:0/820648974 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565358f34ae0 con 0x565359020ba0 2024-05-09T09:49:27.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.835+0000 7f50a2692640 1 --2- 172.21.15.157:0/820648974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565359020ba0 0x5653590acd10 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f508c0017b0 tx=0x7f508c001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a369b5acd4887e2c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.835+0000 7f4f90608640 1 -- 172.21.15.157:0/820648974 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f508c016070 con 0x565359020ba0 2024-05-09T09:49:27.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.835+0000 7f4f90608640 1 -- 172.21.15.157:0/820648974 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f508c004530 con 0x565359020ba0 2024-05-09T09:49:27.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.835+0000 7f4f90608640 1 -- 172.21.15.157:0/820648974 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f508c004870 con 0x565359020ba0 2024-05-09T09:49:27.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.835+0000 7f50a4b77980 1 -- 172.21.15.157:0/820648974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565359020ba0 msgr2=0x5653590acd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.835+0000 7f50a4b77980 1 --2- 172.21.15.157:0/820648974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565359020ba0 0x5653590acd10 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f508c0017b0 tx=0x7f508c001c70 comp rx=0 tx=0).stop 2024-05-09T09:49:27.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.835+0000 7f50a4b77980 1 -- 172.21.15.157:0/820648974 shutdown_connections 2024-05-09T09:49:27.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.835+0000 7f50a4b77980 1 --2- 172.21.15.157:0/820648974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565359020ba0 0x5653590acd10 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.835+0000 7f50a4b77980 1 -- 172.21.15.157:0/820648974 >> 172.21.15.157:0/820648974 conn(0x5653590a70d0 msgr2=0x5653591937c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.835+0000 7f50a4b77980 1 -- 172.21.15.157:0/820648974 shutdown_connections 2024-05-09T09:49:27.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.835+0000 7f50a4b77980 1 -- 172.21.15.157:0/820648974 wait complete. 2024-05-09T09:49:27.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.839+0000 7f50a4b77980 1 Processor -- start 2024-05-09T09:49:27.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.839+0000 7f50a4b77980 1 -- start start 2024-05-09T09:49:27.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.839+0000 7f50a4b77980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565359020ba0 0x5653591a1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.839+0000 7f50a4b77980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5653590b41a0 con 0x565359020ba0 2024-05-09T09:49:27.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.839+0000 7f50a2692640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565359020ba0 0x5653591a1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.839+0000 7f50a2692640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565359020ba0 0x5653591a1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38914/0 (socket says 172.21.15.157:38914) 2024-05-09T09:49:27.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.839+0000 7f50a2692640 1 -- 172.21.15.157:0/207521873 learned_addr learned my addr 172.21.15.157:0/207521873 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.839+0000 7f50a2692640 1 -- 172.21.15.157:0/207521873 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653591a15a0 con 0x565359020ba0 2024-05-09T09:49:27.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.839+0000 7f50a2692640 1 --2- 172.21.15.157:0/207521873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565359020ba0 0x5653591a1060 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f508c000f90 tx=0x7f508c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.839+0000 7f4f8ee05640 1 -- 172.21.15.157:0/207521873 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f508c020070 con 0x565359020ba0 2024-05-09T09:49:27.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.839+0000 7f50a4b77980 1 -- 172.21.15.157:0/207521873 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653591a1830 con 0x565359020ba0 2024-05-09T09:49:27.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.839+0000 7f4f8ee05640 1 -- 172.21.15.157:0/207521873 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f508c011400 con 0x565359020ba0 2024-05-09T09:49:27.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.839+0000 7f4f8ee05640 1 -- 172.21.15.157:0/207521873 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f508c016040 con 0x565359020ba0 2024-05-09T09:49:27.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.839+0000 7f50a4b77980 1 -- 172.21.15.157:0/207521873 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653591a44c0 con 0x565359020ba0 2024-05-09T09:49:27.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.839+0000 7f4f8ee05640 1 -- 172.21.15.157:0/207521873 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f508c023070 con 0x565359020ba0 2024-05-09T09:49:27.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.839+0000 7f4f8ee05640 1 --2- 172.21.15.157:0/207521873 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4f88034bb0 0x7f4f88037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.839+0000 7f4f8ee05640 1 -- 172.21.15.157:0/207521873 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f508c0499b0 con 0x565359020ba0 2024-05-09T09:49:27.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.843+0000 7f50a1e91640 1 --2- 172.21.15.157:0/207521873 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4f88034bb0 0x7f4f88037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.843+0000 7f50a1e91640 1 --2- 172.21.15.157:0/207521873 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4f88034bb0 0x7f4f88037070 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f50940ad000 tx=0x7f50940a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.843+0000 7f50a4b77980 1 Processor -- start 2024-05-09T09:49:27.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.843+0000 7f50a4b77980 1 -- start start 2024-05-09T09:49:27.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.843+0000 7f50a4b77980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653591c6180 0x5653591c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.843+0000 7f50a4b77980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x565358fb4020 con 0x5653591c6180 2024-05-09T09:49:27.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.843+0000 7f50a2692640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653591c6180 0x5653591c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.843+0000 7f50a2692640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653591c6180 0x5653591c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38930/0 (socket says 172.21.15.157:38930) 2024-05-09T09:49:27.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.843+0000 7f50a2692640 1 -- 172.21.15.157:0/2575844634 learned_addr learned my addr 172.21.15.157:0/2575844634 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.843+0000 7f50a2692640 1 -- 172.21.15.157:0/2575844634 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653591c6ae0 con 0x5653591c6180 2024-05-09T09:49:27.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.843+0000 7f50a2692640 1 --2- 172.21.15.157:0/2575844634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653591c6180 0x5653591c65a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f508c047d00 tx=0x7f508c024fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d90f1c537a060c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.843+0000 7f4f8ce01640 1 -- 172.21.15.157:0/2575844634 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f508c02a040 con 0x5653591c6180 2024-05-09T09:49:27.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.843+0000 7f4f8ce01640 1 -- 172.21.15.157:0/2575844634 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f508c034070 con 0x5653591c6180 2024-05-09T09:49:27.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.843+0000 7f4f8ce01640 1 -- 172.21.15.157:0/2575844634 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f508c0234b0 con 0x5653591c6180 2024-05-09T09:49:27.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.847+0000 7f50a4b77980 1 -- 172.21.15.157:0/2575844634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653591c6180 msgr2=0x5653591c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.847+0000 7f50a4b77980 1 --2- 172.21.15.157:0/2575844634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653591c6180 0x5653591c65a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f508c047d00 tx=0x7f508c024fa0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.847+0000 7f50a4b77980 1 -- 172.21.15.157:0/2575844634 shutdown_connections 2024-05-09T09:49:27.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.847+0000 7f50a4b77980 1 --2- 172.21.15.157:0/2575844634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653591c6180 0x5653591c65a0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.847+0000 7f50a4b77980 1 -- 172.21.15.157:0/2575844634 >> 172.21.15.157:0/2575844634 conn(0x5653590b0cd0 msgr2=0x5653591c15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.847+0000 7f50a4b77980 1 -- 172.21.15.157:0/2575844634 shutdown_connections 2024-05-09T09:49:27.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.847+0000 7f50a4b77980 1 -- 172.21.15.157:0/2575844634 wait complete. 2024-05-09T09:49:27.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.847+0000 7f50a4b77980 1 Processor -- start 2024-05-09T09:49:27.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.847+0000 7f50a4b77980 1 -- start start 2024-05-09T09:49:27.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.847+0000 7f50a4b77980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653591c6180 0x5653591cd730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.847+0000 7f50a4b77980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5653591c7490 con 0x5653591c6180 2024-05-09T09:49:27.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.847+0000 7f50a2692640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653591c6180 0x5653591cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.847+0000 7f50a2692640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653591c6180 0x5653591cd730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38932/0 (socket says 172.21.15.157:38932) 2024-05-09T09:49:27.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.847+0000 7f50a2692640 1 -- 172.21.15.157:0/41753378 learned_addr learned my addr 172.21.15.157:0/41753378 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.847+0000 7f50a2692640 1 -- 172.21.15.157:0/41753378 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653591cdc70 con 0x5653591c6180 2024-05-09T09:49:27.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.847+0000 7f50a2692640 1 --2- 172.21.15.157:0/41753378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653591c6180 0x5653591cd730 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f508c044010 tx=0x7f508c047c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.847+0000 7f4f85ba0640 1 -- 172.21.15.157:0/41753378 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f508c02a040 con 0x5653591c6180 2024-05-09T09:49:27.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.847+0000 7f50a4b77980 1 -- 172.21.15.157:0/41753378 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653591cdf00 con 0x5653591c6180 2024-05-09T09:49:27.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.847+0000 7f4f85ba0640 1 -- 172.21.15.157:0/41753378 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f508c01ba30 con 0x5653591c6180 2024-05-09T09:49:27.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.847+0000 7f4f85ba0640 1 -- 172.21.15.157:0/41753378 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f508c01bbe0 con 0x5653591c6180 2024-05-09T09:49:27.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.847+0000 7f50a4b77980 1 -- 172.21.15.157:0/41753378 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653591cdf00 con 0x5653591c6180 2024-05-09T09:49:27.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.851+0000 7f4f85ba0640 1 -- 172.21.15.157:0/41753378 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f508c0116e0 con 0x5653591c6180 2024-05-09T09:49:27.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.851+0000 7f50a4b77980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:49:27.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.851+0000 7f50a4b77980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:49:27.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.851+0000 7f4f85ba0640 1 --2- 172.21.15.157:0/41753378 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4f7c034bb0 0x7f4f7c037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.851+0000 7f4f85ba0640 1 -- 172.21.15.157:0/41753378 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f508c031220 con 0x5653591c6180 2024-05-09T09:49:27.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.851+0000 7f50a4b77980 1 Processor -- start 2024-05-09T09:49:27.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.851+0000 7f50a2e93640 1 --2- 172.21.15.157:0/41753378 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4f7c034bb0 0x7f4f7c037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.851+0000 7f50a4b77980 1 -- start start 2024-05-09T09:49:27.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.851+0000 7f50a4b77980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653591e8d10 0x5653591e90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.851+0000 7f50a4b77980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5653590ab440 con 0x5653591e8d10 2024-05-09T09:49:27.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.851+0000 7f50a2e93640 1 --2- 172.21.15.157:0/41753378 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4f7c034bb0 0x7f4f7c037070 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x5653591c2200 tx=0x7f509c0054d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.851+0000 7f50a2692640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653591e8d10 0x5653591e90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.851+0000 7f50a2692640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653591e8d10 0x5653591e90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38934/0 (socket says 172.21.15.157:38934) 2024-05-09T09:49:27.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.851+0000 7f50a2692640 1 -- 172.21.15.157:0/1402484247 learned_addr learned my addr 172.21.15.157:0/1402484247 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.851+0000 7f50a2692640 1 -- 172.21.15.157:0/1402484247 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653591e9630 con 0x5653591e8d10 2024-05-09T09:49:27.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.851+0000 7f50a2692640 1 --2- 172.21.15.157:0/1402484247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653591e8d10 0x5653591e90f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f508c025f90 tx=0x7f508c025dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.851+0000 7f4f65fe3640 1 -- 172.21.15.157:0/1402484247 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f508c027e00 con 0x5653591e8d10 2024-05-09T09:49:27.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.851+0000 7f4f65fe3640 1 -- 172.21.15.157:0/1402484247 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f508c057070 con 0x5653591e8d10 2024-05-09T09:49:27.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.851+0000 7f4f65fe3640 1 -- 172.21.15.157:0/1402484247 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f508c011b20 con 0x5653591e8d10 2024-05-09T09:49:27.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.851+0000 7f50a4b77980 1 -- 172.21.15.157:0/1402484247 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653591e98c0 con 0x5653591e8d10 2024-05-09T09:49:27.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.851+0000 7f50a4b77980 1 -- 172.21.15.157:0/1402484247 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653591e98c0 con 0x5653591e8d10 2024-05-09T09:49:27.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.851+0000 7f4f65fe3640 1 -- 172.21.15.157:0/1402484247 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f508c045150 con 0x5653591e8d10 2024-05-09T09:49:27.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.855+0000 7f4f65fe3640 1 --2- 172.21.15.157:0/1402484247 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4ee4034b60 0x7f4ee4037020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.855+0000 7f4f65fe3640 1 -- 172.21.15.157:0/1402484247 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f508c003460 con 0x5653591e8d10 2024-05-09T09:49:27.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.855+0000 7f50a1e91640 1 --2- 172.21.15.157:0/1402484247 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4ee4034b60 0x7f4ee4037020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.855+0000 7f4edf7fe640 20 reqs_thread_entry: start 2024-05-09T09:49:27.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.855+0000 7f50a4b77980 1 --2- 172.21.15.157:0/207521873 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5653591ee700 0x5653591f0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.855+0000 7f50a4b77980 1 -- 172.21.15.157:0/207521873 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653591f1250 con 0x5653591ee700 2024-05-09T09:49:27.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.855+0000 7f50a1e91640 1 --2- 172.21.15.157:0/1402484247 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4ee4034b60 0x7f4ee4037020 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f509401b2c0 tx=0x7f5094005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.856 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.855+0000 7f50a2e93640 1 --2- 172.21.15.157:0/207521873 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5653591ee700 0x5653591f0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.855+0000 7f50a2e93640 1 --2- 172.21.15.157:0/207521873 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5653591ee700 0x5653591f0b80 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.855+0000 7f50a2e93640 1 -- 172.21.15.157:0/207521873 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f509c008860 con 0x5653591ee700 2024-05-09T09:49:27.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.855+0000 7f50a4b77980 1 --2- 172.21.15.157:0/207521873 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5653591f3070 0x5653591f5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.855+0000 7f50a4b77980 1 -- 172.21.15.157:0/207521873 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:2 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653591f5ba0 con 0x5653591f3070 2024-05-09T09:49:27.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.855+0000 7f50a2692640 1 --2- 172.21.15.157:0/207521873 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5653591f3070 0x5653591f5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.855+0000 7f50a2692640 1 --2- 172.21.15.157:0/207521873 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5653591f3070 0x5653591f5460 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.855+0000 7f50a2692640 1 -- 172.21.15.157:0/207521873 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(2 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f508c04f060 con 0x5653591f3070 2024-05-09T09:49:27.858 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.855+0000 7f50a4b77980 1 -- 172.21.15.157:0/207521873 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653591f2520 con 0x5653591f3070 2024-05-09T09:49:27.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a2692640 1 -- 172.21.15.157:0/207521873 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [stat,call,call,writefull 0~993] v32'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f508c04f060 con 0x5653591f3070 2024-05-09T09:49:27.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 -- 172.21.15.157:0/41753378 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4f7c034bb0 msgr2=0x7f4f7c037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 --2- 172.21.15.157:0/41753378 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4f7c034bb0 0x7f4f7c037070 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x5653591c2200 tx=0x7f509c0054d0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 -- 172.21.15.157:0/41753378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653591c6180 msgr2=0x5653591cd730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 --2- 172.21.15.157:0/41753378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653591c6180 0x5653591cd730 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f508c044010 tx=0x7f508c047c90 comp rx=0 tx=0).stop 2024-05-09T09:49:27.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 -- 172.21.15.157:0/41753378 shutdown_connections 2024-05-09T09:49:27.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 --2- 172.21.15.157:0/41753378 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4f7c034bb0 0x7f4f7c037070 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 --2- 172.21.15.157:0/41753378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653591c6180 0x5653591cd730 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.863 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 -- 172.21.15.157:0/41753378 >> 172.21.15.157:0/41753378 conn(0x5653590b0cd0 msgr2=0x5653591c03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 -- 172.21.15.157:0/41753378 shutdown_connections 2024-05-09T09:49:27.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 -- 172.21.15.157:0/41753378 wait complete. 2024-05-09T09:49:27.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 -- 172.21.15.157:0/1402484247 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4ee4034b60 msgr2=0x7f4ee4037020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 --2- 172.21.15.157:0/1402484247 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4ee4034b60 0x7f4ee4037020 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f509401b2c0 tx=0x7f5094005a10 comp rx=0 tx=0).stop 2024-05-09T09:49:27.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 -- 172.21.15.157:0/1402484247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653591e8d10 msgr2=0x5653591e90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 --2- 172.21.15.157:0/1402484247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653591e8d10 0x5653591e90f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f508c025f90 tx=0x7f508c025dd0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 -- 172.21.15.157:0/1402484247 shutdown_connections 2024-05-09T09:49:27.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 --2- 172.21.15.157:0/1402484247 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4ee4034b60 0x7f4ee4037020 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 --2- 172.21.15.157:0/1402484247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653591e8d10 0x5653591e90f0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 -- 172.21.15.157:0/1402484247 >> 172.21.15.157:0/1402484247 conn(0x5653591dd930 msgr2=0x5653591de350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 -- 172.21.15.157:0/1402484247 shutdown_connections 2024-05-09T09:49:27.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 -- 172.21.15.157:0/1402484247 wait complete. 2024-05-09T09:49:27.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 -- 172.21.15.157:0/207521873 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5653591f3070 msgr2=0x5653591f5460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 --2- 172.21.15.157:0/207521873 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5653591f3070 0x5653591f5460 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 -- 172.21.15.157:0/207521873 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5653591ee700 msgr2=0x5653591f0b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 --2- 172.21.15.157:0/207521873 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5653591ee700 0x5653591f0b80 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 -- 172.21.15.157:0/207521873 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4f88034bb0 msgr2=0x7f4f88037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 --2- 172.21.15.157:0/207521873 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4f88034bb0 0x7f4f88037070 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f50940ad000 tx=0x7f50940a5040 comp rx=0 tx=0).stop 2024-05-09T09:49:27.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 -- 172.21.15.157:0/207521873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565359020ba0 msgr2=0x5653591a1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 --2- 172.21.15.157:0/207521873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565359020ba0 0x5653591a1060 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f508c000f90 tx=0x7f508c001260 comp rx=0 tx=0).stop 2024-05-09T09:49:27.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 -- 172.21.15.157:0/207521873 shutdown_connections 2024-05-09T09:49:27.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 --2- 172.21.15.157:0/207521873 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5653591f3070 0x5653591f5460 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 --2- 172.21.15.157:0/207521873 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5653591ee700 0x5653591f0b80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 --2- 172.21.15.157:0/207521873 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4f88034bb0 0x7f4f88037070 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 --2- 172.21.15.157:0/207521873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x565359020ba0 0x5653591a1060 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 -- 172.21.15.157:0/207521873 >> 172.21.15.157:0/207521873 conn(0x5653590a70d0 msgr2=0x5653590ab9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 -- 172.21.15.157:0/207521873 shutdown_connections 2024-05-09T09:49:27.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.859+0000 7f50a4b77980 1 -- 172.21.15.157:0/207521873 wait complete. 2024-05-09T09:49:27.873 INFO:teuthology.orchestra.run.smithi157.stdout:{"id":"b73385e6-4d12-4d8e-98d6-6f8ed75f5b82","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-05-09T09:49:27.873 DEBUG:tasks.util.rgw: json result: {'id': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-05-09T09:49:27.873 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-05-09T09:49:27.873 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-05-09T09:49:27.873 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-05-09T09:49:27.948 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:49:27.948 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:49:27.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.947+0000 7f6eb65fd980 1 Processor -- start 2024-05-09T09:49:27.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.947+0000 7f6eb65fd980 1 -- start start 2024-05-09T09:49:27.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.947+0000 7f6eb65fd980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x564da33d5a60 0x564da33d5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.947+0000 7f6eb65fd980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564da3312440 con 0x564da33d3560 2024-05-09T09:49:27.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.947+0000 7f6eb65fd980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x564da32fd5f0 con 0x564da33d5a60 2024-05-09T09:49:27.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.947+0000 7f6eb3917640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x564da33d5a60 0x564da33d5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.947+0000 7f6eb3917640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x564da33d5a60 0x564da33d5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38936/0 (socket says 172.21.15.157:38936) 2024-05-09T09:49:27.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.947+0000 7f6eb3917640 1 -- 172.21.15.157:0/3563606070 learned_addr learned my addr 172.21.15.157:0/3563606070 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.947+0000 7f6eb4118640 1 --1- 172.21.15.157:0/3563606070 >> v1:172.21.15.110:6789/0 conn(0x564da33d3560 0x564da33d3940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:45560/0 (socket says 172.21.15.157:45560) 2024-05-09T09:49:27.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.951+0000 7f6eb3917640 1 -- 172.21.15.157:0/3563606070 >> v1:172.21.15.110:6789/0 conn(0x564da33d3560 legacy=0x564da33d3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.951+0000 7f6eb3917640 1 -- 172.21.15.157:0/3563606070 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564da3308990 con 0x564da33d5a60 2024-05-09T09:49:27.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.951+0000 7f6eb3917640 1 --2- 172.21.15.157:0/3563606070 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da33d5a60 0x564da33d5e70 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400a5c0 tx=0x7f6ea401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9244ca2dfb5a5ce0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.951+0000 7f6eb3116640 1 -- 172.21.15.157:0/3563606070 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ea40a6070 con 0x564da33d5a60 2024-05-09T09:49:27.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.951+0000 7f6eb3116640 1 -- 172.21.15.157:0/3563606070 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ea40af070 con 0x564da33d5a60 2024-05-09T09:49:27.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.951+0000 7f6eb3116640 1 -- 172.21.15.157:0/3563606070 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ea40aa5c0 con 0x564da33d5a60 2024-05-09T09:49:27.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.955+0000 7f6eb65fd980 1 -- 172.21.15.157:0/3563606070 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da33d5a60 msgr2=0x564da33d5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.955+0000 7f6eb65fd980 1 --2- 172.21.15.157:0/3563606070 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da33d5a60 0x564da33d5e70 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400a5c0 tx=0x7f6ea401b340 comp rx=0 tx=0).stop 2024-05-09T09:49:27.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.955+0000 7f6eb65fd980 1 -- 172.21.15.157:0/3563606070 shutdown_connections 2024-05-09T09:49:27.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.955+0000 7f6eb65fd980 1 --2- 172.21.15.157:0/3563606070 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da33d5a60 0x564da33d5e70 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.955+0000 7f6eb65fd980 1 -- 172.21.15.157:0/3563606070 >> 172.21.15.157:0/3563606070 conn(0x564da33d2240 msgr2=0x564da33d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.955+0000 7f6eb65fd980 1 -- 172.21.15.157:0/3563606070 shutdown_connections 2024-05-09T09:49:27.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.955+0000 7f6eb65fd980 1 -- 172.21.15.157:0/3563606070 wait complete. 2024-05-09T09:49:27.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.967+0000 7f6eb65fd980 1 Processor -- start 2024-05-09T09:49:27.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.967+0000 7f6eb65fd980 1 -- start start 2024-05-09T09:49:27.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.967+0000 7f6eb65fd980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da33d3560 0x564da354e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.967+0000 7f6eb65fd980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x564da335ffe0 con 0x564da33d3560 2024-05-09T09:49:27.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.971+0000 7f6eb4118640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da33d3560 0x564da354e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.971+0000 7f6eb4118640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da33d3560 0x564da354e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38940/0 (socket says 172.21.15.157:38940) 2024-05-09T09:49:27.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.971+0000 7f6eb4118640 1 -- 172.21.15.157:0/927090532 learned_addr learned my addr 172.21.15.157:0/927090532 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.971+0000 7f6eb4118640 1 -- 172.21.15.157:0/927090532 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564da32e4ae0 con 0x564da33d3560 2024-05-09T09:49:27.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.971+0000 7f6eb4118640 1 --2- 172.21.15.157:0/927090532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da33d3560 0x564da354e370 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c001e50 tx=0x7f6e9c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce47ef30706e0c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.971+0000 7f6da260c640 1 -- 172.21.15.157:0/927090532 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e9c00e5d0 con 0x564da33d3560 2024-05-09T09:49:27.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.971+0000 7f6da260c640 1 -- 172.21.15.157:0/927090532 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e9c00e770 con 0x564da33d3560 2024-05-09T09:49:27.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.971+0000 7f6da260c640 1 -- 172.21.15.157:0/927090532 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e9c00eab0 con 0x564da33d3560 2024-05-09T09:49:27.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.971+0000 7f6eb65fd980 1 -- 172.21.15.157:0/927090532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da33d3560 msgr2=0x564da354e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.971+0000 7f6eb65fd980 1 --2- 172.21.15.157:0/927090532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da33d3560 0x564da354e370 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c001e50 tx=0x7f6e9c001e80 comp rx=0 tx=0).stop 2024-05-09T09:49:27.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.971+0000 7f6eb65fd980 1 -- 172.21.15.157:0/927090532 shutdown_connections 2024-05-09T09:49:27.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.971+0000 7f6eb65fd980 1 --2- 172.21.15.157:0/927090532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da33d3560 0x564da354e370 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.971+0000 7f6eb65fd980 1 -- 172.21.15.157:0/927090532 >> 172.21.15.157:0/927090532 conn(0x564da33d2240 msgr2=0x564da3549f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.971+0000 7f6eb65fd980 1 -- 172.21.15.157:0/927090532 shutdown_connections 2024-05-09T09:49:27.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.971+0000 7f6eb65fd980 1 -- 172.21.15.157:0/927090532 wait complete. 2024-05-09T09:49:27.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.971+0000 7f6eb65fd980 1 Processor -- start 2024-05-09T09:49:27.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.971+0000 7f6eb65fd980 1 -- start start 2024-05-09T09:49:27.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.971+0000 7f6eb65fd980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da33d3560 0x564da3555550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.971+0000 7f6eb65fd980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x564da33d6e60 con 0x564da33d3560 2024-05-09T09:49:27.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.971+0000 7f6eb4118640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da33d3560 0x564da3555550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.971+0000 7f6eb4118640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da33d3560 0x564da3555550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38950/0 (socket says 172.21.15.157:38950) 2024-05-09T09:49:27.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.971+0000 7f6eb4118640 1 -- 172.21.15.157:0/1769883482 learned_addr learned my addr 172.21.15.157:0/1769883482 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.975+0000 7f6eb4118640 1 -- 172.21.15.157:0/1769883482 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564da3555a90 con 0x564da33d3560 2024-05-09T09:49:27.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.975+0000 7f6eb4118640 1 --2- 172.21.15.157:0/1769883482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da33d3560 0x564da3555550 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x564da354f200 tx=0x7f6e9c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.975+0000 7f6da0e09640 1 -- 172.21.15.157:0/1769883482 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e9c001260 con 0x564da33d3560 2024-05-09T09:49:27.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.975+0000 7f6da0e09640 1 -- 172.21.15.157:0/1769883482 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e9c00fa40 con 0x564da33d3560 2024-05-09T09:49:27.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.975+0000 7f6eb65fd980 1 -- 172.21.15.157:0/1769883482 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564da3555d20 con 0x564da33d3560 2024-05-09T09:49:27.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.975+0000 7f6da0e09640 1 -- 172.21.15.157:0/1769883482 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e9c00fd80 con 0x564da33d3560 2024-05-09T09:49:27.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.975+0000 7f6eb65fd980 1 -- 172.21.15.157:0/1769883482 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564da35589b0 con 0x564da33d3560 2024-05-09T09:49:27.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.975+0000 7f6da0e09640 1 -- 172.21.15.157:0/1769883482 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f6e9c017070 con 0x564da33d3560 2024-05-09T09:49:27.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.975+0000 7f6da0e09640 1 --2- 172.21.15.157:0/1769883482 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6d9c034bb0 0x7f6d9c037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.975+0000 7f6da0e09640 1 -- 172.21.15.157:0/1769883482 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f6e9c015020 con 0x564da33d3560 2024-05-09T09:49:27.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.975+0000 7f6eb3917640 1 --2- 172.21.15.157:0/1769883482 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6d9c034bb0 0x7f6d9c037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.975+0000 7f6eb3917640 1 --2- 172.21.15.157:0/1769883482 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6d9c034bb0 0x7f6d9c037070 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6ea40ae000 tx=0x7f6ea40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.979+0000 7f6eb65fd980 1 Processor -- start 2024-05-09T09:49:27.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.979+0000 7f6eb65fd980 1 -- start start 2024-05-09T09:49:27.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.979+0000 7f6eb65fd980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da357a6d0 0x564da357aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.979+0000 7f6eb65fd980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x564da3364020 con 0x564da357a6d0 2024-05-09T09:49:27.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.979+0000 7f6eb4118640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da357a6d0 0x564da357aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.979+0000 7f6eb4118640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da357a6d0 0x564da357aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38956/0 (socket says 172.21.15.157:38956) 2024-05-09T09:49:27.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.979+0000 7f6eb4118640 1 -- 172.21.15.157:0/2254787619 learned_addr learned my addr 172.21.15.157:0/2254787619 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.979+0000 7f6eb4118640 1 -- 172.21.15.157:0/2254787619 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564da357b030 con 0x564da357a6d0 2024-05-09T09:49:27.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.979+0000 7f6eb4118640 1 --2- 172.21.15.157:0/2254787619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da357a6d0 0x564da357aaf0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c049510 tx=0x7f6e9c01b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfc856fc946fc01c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.979+0000 7f6d9939f640 1 -- 172.21.15.157:0/2254787619 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e9c04b070 con 0x564da357a6d0 2024-05-09T09:49:27.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.979+0000 7f6d9939f640 1 -- 172.21.15.157:0/2254787619 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e9c0195a0 con 0x564da357a6d0 2024-05-09T09:49:27.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.979+0000 7f6d9939f640 1 -- 172.21.15.157:0/2254787619 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e9c01ae50 con 0x564da357a6d0 2024-05-09T09:49:27.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.983+0000 7f6eb65fd980 1 -- 172.21.15.157:0/2254787619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da357a6d0 msgr2=0x564da357aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.983+0000 7f6eb65fd980 1 --2- 172.21.15.157:0/2254787619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da357a6d0 0x564da357aaf0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c049510 tx=0x7f6e9c01b960 comp rx=0 tx=0).stop 2024-05-09T09:49:27.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.983+0000 7f6eb65fd980 1 -- 172.21.15.157:0/2254787619 shutdown_connections 2024-05-09T09:49:27.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.983+0000 7f6eb65fd980 1 --2- 172.21.15.157:0/2254787619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da357a6d0 0x564da357aaf0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.983+0000 7f6eb65fd980 1 -- 172.21.15.157:0/2254787619 >> 172.21.15.157:0/2254787619 conn(0x564da33d5a60 msgr2=0x564da3575b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.983+0000 7f6eb65fd980 1 -- 172.21.15.157:0/2254787619 shutdown_connections 2024-05-09T09:49:27.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.983+0000 7f6eb65fd980 1 -- 172.21.15.157:0/2254787619 wait complete. 2024-05-09T09:49:27.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.983+0000 7f6eb65fd980 1 Processor -- start 2024-05-09T09:49:27.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.983+0000 7f6eb65fd980 1 -- start start 2024-05-09T09:49:27.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.983+0000 7f6eb65fd980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da357a6d0 0x564da3581c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.983+0000 7f6eb65fd980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x564da357b9e0 con 0x564da357a6d0 2024-05-09T09:49:27.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.983+0000 7f6eb4118640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da357a6d0 0x564da3581c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.983+0000 7f6eb4118640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da357a6d0 0x564da3581c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38970/0 (socket says 172.21.15.157:38970) 2024-05-09T09:49:27.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.983+0000 7f6eb4118640 1 -- 172.21.15.157:0/3918419314 learned_addr learned my addr 172.21.15.157:0/3918419314 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.983+0000 7f6eb4118640 1 -- 172.21.15.157:0/3918419314 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564da35821c0 con 0x564da357a6d0 2024-05-09T09:49:27.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.983+0000 7f6eb4118640 1 --2- 172.21.15.157:0/3918419314 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da357a6d0 0x564da3581c80 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c017910 tx=0x7f6e9c0494a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.983+0000 7f6d937fe640 1 -- 172.21.15.157:0/3918419314 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e9c01c450 con 0x564da357a6d0 2024-05-09T09:49:27.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.983+0000 7f6d937fe640 1 -- 172.21.15.157:0/3918419314 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e9c049710 con 0x564da357a6d0 2024-05-09T09:49:27.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.983+0000 7f6d937fe640 1 -- 172.21.15.157:0/3918419314 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e9c017750 con 0x564da357a6d0 2024-05-09T09:49:27.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.983+0000 7f6eb65fd980 1 -- 172.21.15.157:0/3918419314 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564da35821c0 con 0x564da357a6d0 2024-05-09T09:49:27.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.983+0000 7f6eb65fd980 1 -- 172.21.15.157:0/3918419314 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564da35821c0 con 0x564da357a6d0 2024-05-09T09:49:27.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.983+0000 7f6d937fe640 1 -- 172.21.15.157:0/3918419314 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f6e9c053030 con 0x564da357a6d0 2024-05-09T09:49:27.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.983+0000 7f6eb65fd980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:49:27.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.983+0000 7f6eb65fd980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:49:27.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.983+0000 7f6d937fe640 1 --2- 172.21.15.157:0/3918419314 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6d8c034bb0 0x7f6d8c037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.983+0000 7f6d937fe640 1 -- 172.21.15.157:0/3918419314 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f6e9c051070 con 0x564da357a6d0 2024-05-09T09:49:27.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.983+0000 7f6eb65fd980 1 Processor -- start 2024-05-09T09:49:27.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.983+0000 7f6eb4919640 1 --2- 172.21.15.157:0/3918419314 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6d8c034bb0 0x7f6d8c037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.987+0000 7f6eb65fd980 1 -- start start 2024-05-09T09:49:27.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.987+0000 7f6eb65fd980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da359d0b0 0x564da359d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.987+0000 7f6eb65fd980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x564da354eac0 con 0x564da359d0b0 2024-05-09T09:49:27.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.987+0000 7f6eb4919640 1 --2- 172.21.15.157:0/3918419314 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6d8c034bb0 0x7f6d8c037070 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x564da3576750 tx=0x7f6eac005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.987+0000 7f6eb4118640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da359d0b0 0x564da359d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.987+0000 7f6eb4118640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da359d0b0 0x564da359d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38984/0 (socket says 172.21.15.157:38984) 2024-05-09T09:49:27.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.987+0000 7f6eb4118640 1 -- 172.21.15.157:0/4211159216 learned_addr learned my addr 172.21.15.157:0/4211159216 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:27.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.987+0000 7f6eb4118640 1 -- 172.21.15.157:0/4211159216 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564da359d9f0 con 0x564da359d0b0 2024-05-09T09:49:27.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.987+0000 7f6eb4118640 1 --2- 172.21.15.157:0/4211159216 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da359d0b0 0x564da359d4b0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c055fd0 tx=0x7f6e9c045540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.987+0000 7f6d777e6640 1 -- 172.21.15.157:0/4211159216 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e9c065070 con 0x564da359d0b0 2024-05-09T09:49:27.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.987+0000 7f6eb65fd980 1 -- 172.21.15.157:0/4211159216 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564da359dc20 con 0x564da359d0b0 2024-05-09T09:49:27.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.987+0000 7f6d777e6640 1 -- 172.21.15.157:0/4211159216 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e9c023240 con 0x564da359d0b0 2024-05-09T09:49:27.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.987+0000 7f6d777e6640 1 -- 172.21.15.157:0/4211159216 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e9c055410 con 0x564da359d0b0 2024-05-09T09:49:27.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.987+0000 7f6eb65fd980 1 -- 172.21.15.157:0/4211159216 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564da359e680 con 0x564da359d0b0 2024-05-09T09:49:27.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.987+0000 7f6d777e6640 1 -- 172.21.15.157:0/4211159216 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f6e9c068070 con 0x564da359d0b0 2024-05-09T09:49:27.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.987+0000 7f6d777e6640 1 --2- 172.21.15.157:0/4211159216 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6cf4034bb0 0x7f6cf4037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.987+0000 7f6d777e6640 1 -- 172.21.15.157:0/4211159216 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f6e9c06bd70 con 0x564da359d0b0 2024-05-09T09:49:27.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.987+0000 7f6eb3917640 1 --2- 172.21.15.157:0/4211159216 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6cf4034bb0 0x7f6cf4037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.987+0000 7f6d757e2640 20 reqs_thread_entry: start 2024-05-09T09:49:27.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.987+0000 7f6eb65fd980 1 --2- 172.21.15.157:0/1769883482 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x564da35a2c80 0x564da35a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.987+0000 7f6eb65fd980 1 -- 172.21.15.157:0/1769883482 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564da35a55b0 con 0x564da35a2c80 2024-05-09T09:49:27.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.987+0000 7f6eb4919640 1 --2- 172.21.15.157:0/1769883482 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x564da35a2c80 0x564da35a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.987+0000 7f6eb3917640 1 --2- 172.21.15.157:0/4211159216 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6cf4034bb0 0x7f6cf4037070 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4000c10 tx=0x7f6ea4005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb4919640 1 --2- 172.21.15.157:0/1769883482 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x564da35a2c80 0x564da35a5070 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb4919640 1 -- 172.21.15.157:0/1769883482 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6eac00e070 con 0x564da35a2c80 2024-05-09T09:49:27.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 -- 172.21.15.157:0/1769883482 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564da35a5e80 con 0x564da35a2c80 2024-05-09T09:49:27.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb4919640 1 -- 172.21.15.157:0/1769883482 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6eac00e070 con 0x564da35a2c80 2024-05-09T09:49:27.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 --2- 172.21.15.157:0/1769883482 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x564da35a78b0 0x564da35a9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:27.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 -- 172.21.15.157:0/1769883482 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:3 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564da35aa490 con 0x564da35a78b0 2024-05-09T09:49:27.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb4118640 1 --2- 172.21.15.157:0/1769883482 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x564da35a78b0 0x564da35a9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:27.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb4118640 1 --2- 172.21.15.157:0/1769883482 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x564da35a78b0 0x564da35a9d00 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:27.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb4118640 1 -- 172.21.15.157:0/1769883482 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(3 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6e9c067030 con 0x564da35a78b0 2024-05-09T09:49:27.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 -- 172.21.15.157:0/3918419314 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6d8c034bb0 msgr2=0x7f6d8c037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 --2- 172.21.15.157:0/3918419314 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6d8c034bb0 0x7f6d8c037070 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x564da3576750 tx=0x7f6eac005850 comp rx=0 tx=0).stop 2024-05-09T09:49:27.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 -- 172.21.15.157:0/3918419314 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da357a6d0 msgr2=0x564da3581c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 --2- 172.21.15.157:0/3918419314 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da357a6d0 0x564da3581c80 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c017910 tx=0x7f6e9c0494a0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 -- 172.21.15.157:0/3918419314 shutdown_connections 2024-05-09T09:49:27.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 --2- 172.21.15.157:0/3918419314 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6d8c034bb0 0x7f6d8c037070 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 --2- 172.21.15.157:0/3918419314 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da357a6d0 0x564da3581c80 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 -- 172.21.15.157:0/3918419314 >> 172.21.15.157:0/3918419314 conn(0x564da33d5a60 msgr2=0x564da3574910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 -- 172.21.15.157:0/3918419314 shutdown_connections 2024-05-09T09:49:27.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 -- 172.21.15.157:0/3918419314 wait complete. 2024-05-09T09:49:27.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 -- 172.21.15.157:0/4211159216 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6cf4034bb0 msgr2=0x7f6cf4037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 --2- 172.21.15.157:0/4211159216 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6cf4034bb0 0x7f6cf4037070 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4000c10 tx=0x7f6ea4005ad0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 -- 172.21.15.157:0/4211159216 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da359d0b0 msgr2=0x564da359d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 --2- 172.21.15.157:0/4211159216 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da359d0b0 0x564da359d4b0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c055fd0 tx=0x7f6e9c045540 comp rx=0 tx=0).stop 2024-05-09T09:49:27.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 -- 172.21.15.157:0/4211159216 shutdown_connections 2024-05-09T09:49:27.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 --2- 172.21.15.157:0/4211159216 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6cf4034bb0 0x7f6cf4037070 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 --2- 172.21.15.157:0/4211159216 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da359d0b0 0x564da359d4b0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 -- 172.21.15.157:0/4211159216 >> 172.21.15.157:0/4211159216 conn(0x564da3591c30 msgr2=0x564da3592650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 -- 172.21.15.157:0/4211159216 shutdown_connections 2024-05-09T09:49:27.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 -- 172.21.15.157:0/4211159216 wait complete. 2024-05-09T09:49:27.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 -- 172.21.15.157:0/1769883482 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x564da35a2c80 msgr2=0x564da35a5070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 --2- 172.21.15.157:0/1769883482 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x564da35a2c80 0x564da35a5070 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 -- 172.21.15.157:0/1769883482 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x564da35a78b0 msgr2=0x564da35a9d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 --2- 172.21.15.157:0/1769883482 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x564da35a78b0 0x564da35a9d00 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 -- 172.21.15.157:0/1769883482 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6d9c034bb0 msgr2=0x7f6d9c037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 --2- 172.21.15.157:0/1769883482 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6d9c034bb0 0x7f6d9c037070 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6ea40ae000 tx=0x7f6ea40a6000 comp rx=0 tx=0).stop 2024-05-09T09:49:27.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 -- 172.21.15.157:0/1769883482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da33d3560 msgr2=0x564da3555550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:27.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 --2- 172.21.15.157:0/1769883482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da33d3560 0x564da3555550 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x564da354f200 tx=0x7f6e9c000bd0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 -- 172.21.15.157:0/1769883482 shutdown_connections 2024-05-09T09:49:27.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 --2- 172.21.15.157:0/1769883482 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x564da35a78b0 0x564da35a9d00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 --2- 172.21.15.157:0/1769883482 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x564da35a2c80 0x564da35a5070 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 --2- 172.21.15.157:0/1769883482 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f6d9c034bb0 0x7f6d9c037070 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 --2- 172.21.15.157:0/1769883482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564da33d3560 0x564da3555550 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:27.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 -- 172.21.15.157:0/1769883482 >> 172.21.15.157:0/1769883482 conn(0x564da33d2240 msgr2=0x564da3548a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:27.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 -- 172.21.15.157:0/1769883482 shutdown_connections 2024-05-09T09:49:27.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:27.991+0000 7f6eb65fd980 1 -- 172.21.15.157:0/1769883482 wait complete. 2024-05-09T09:49:28.004 INFO:teuthology.orchestra.run.smithi157.stdout:{"id":"69d0cd00-5979-46bf-b012-5813947e658a","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"b73385e6-4d12-4d8e-98d6-6f8ed75f5b82","zones":[{"id":"b73385e6-4d12-4d8e-98d6-6f8ed75f5b82","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-05-09T09:49:28.005 DEBUG:tasks.util.rgw: json result: {'id': '69d0cd00-5979-46bf-b012-5813947e658a', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82', 'zones': [{'id': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-05-09T09:49:28.007 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-05-09T09:49:28.051 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-05-09T09:49:28.052 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-05-09T09:49:28.052 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-05-09T09:49:28.095 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:49:28.095 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:49:28.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.095+0000 7fa2bd6f4980 1 Processor -- start 2024-05-09T09:49:28.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.095+0000 7fa2bd6f4980 1 -- start start 2024-05-09T09:49:28.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.095+0000 7fa2bd6f4980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x56500ab450b0 0x56500ab474a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.095+0000 7fa2bd6f4980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56500a9f4440 con 0x56500aab2a10 2024-05-09T09:49:28.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.095+0000 7fa2bd6f4980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x56500a9df5f0 con 0x56500ab450b0 2024-05-09T09:49:28.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.095+0000 7fa2baa0e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x56500ab450b0 0x56500ab474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.095+0000 7fa2bb20f640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x56500aab2a10 0x56500ab43990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:45568/0 (socket says 172.21.15.157:45568) 2024-05-09T09:49:28.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.095+0000 7fa2bb20f640 1 -- 172.21.15.157:0/3766729543 learned_addr learned my addr 172.21.15.157:0/3766729543 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:49:28.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.095+0000 7fa2baa0e640 1 -- 172.21.15.157:0/3766729543 >> v1:172.21.15.110:6789/0 conn(0x56500aab2a10 legacy=0x56500ab43990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.095+0000 7fa2baa0e640 1 -- 172.21.15.157:0/3766729543 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56500a9ea990 con 0x56500ab450b0 2024-05-09T09:49:28.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.095+0000 7fa2ba20d640 1 -- 172.21.15.157:0/3766729543 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3255433513 0 0) 0x56500a9f4440 con 0x56500aab2a10 2024-05-09T09:49:28.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.099+0000 7fa2baa0e640 1 --2- 172.21.15.157:0/3766729543 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500ab450b0 0x56500ab474a0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa2a400a480 tx=0x7fa2a401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8741321575ac8a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.099+0000 7fa2ba20d640 1 -- 172.21.15.157:0/3766729543 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2a40b0070 con 0x56500ab450b0 2024-05-09T09:49:28.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.099+0000 7fa2ba20d640 1 -- 172.21.15.157:0/3766729543 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2a40ab540 con 0x56500ab450b0 2024-05-09T09:49:28.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.099+0000 7fa2ba20d640 1 -- 172.21.15.157:0/3766729543 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2a40ab840 con 0x56500ab450b0 2024-05-09T09:49:28.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.099+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/3766729543 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500ab450b0 msgr2=0x56500ab474a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.099+0000 7fa2bd6f4980 1 --2- 172.21.15.157:0/3766729543 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500ab450b0 0x56500ab474a0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa2a400a480 tx=0x7fa2a401b280 comp rx=0 tx=0).stop 2024-05-09T09:49:28.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.099+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/3766729543 shutdown_connections 2024-05-09T09:49:28.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.099+0000 7fa2bd6f4980 1 --2- 172.21.15.157:0/3766729543 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500ab450b0 0x56500ab474a0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.099+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/3766729543 >> 172.21.15.157:0/3766729543 conn(0x56500ab39070 msgr2=0x56500ab3b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:28.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.099+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/3766729543 shutdown_connections 2024-05-09T09:49:28.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.099+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/3766729543 wait complete. 2024-05-09T09:49:28.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.115+0000 7fa2bd6f4980 1 Processor -- start 2024-05-09T09:49:28.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.115+0000 7fa2bd6f4980 1 -- start start 2024-05-09T09:49:28.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.115+0000 7fa2bd6f4980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500aab2a10 0x56500ac2bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.115+0000 7fa2bd6f4980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56500aa41fe0 con 0x56500aab2a10 2024-05-09T09:49:28.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.115+0000 7fa2bb20f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500aab2a10 0x56500ac2bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.115+0000 7fa2bb20f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500aab2a10 0x56500ac2bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:38996/0 (socket says 172.21.15.157:38996) 2024-05-09T09:49:28.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.115+0000 7fa2bb20f640 1 -- 172.21.15.157:0/1488741533 learned_addr learned my addr 172.21.15.157:0/1488741533 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:28.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.115+0000 7fa2bb20f640 1 -- 172.21.15.157:0/1488741533 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56500a9c6ae0 con 0x56500aab2a10 2024-05-09T09:49:28.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.115+0000 7fa2bb20f640 1 --2- 172.21.15.157:0/1488741533 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500aab2a10 0x56500ac2bc50 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0016c0 tx=0x7fa2ac001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9326c3235f39732 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.115+0000 7fa1a960a640 1 -- 172.21.15.157:0/1488741533 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2ac003460 con 0x56500aab2a10 2024-05-09T09:49:28.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.115+0000 7fa1a960a640 1 -- 172.21.15.157:0/1488741533 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2ac003600 con 0x56500aab2a10 2024-05-09T09:49:28.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.115+0000 7fa1a960a640 1 -- 172.21.15.157:0/1488741533 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2ac003920 con 0x56500aab2a10 2024-05-09T09:49:28.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.115+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/1488741533 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500aab2a10 msgr2=0x56500ac2bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.115+0000 7fa2bd6f4980 1 --2- 172.21.15.157:0/1488741533 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500aab2a10 0x56500ac2bc50 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0016c0 tx=0x7fa2ac001b80 comp rx=0 tx=0).stop 2024-05-09T09:49:28.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.115+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/1488741533 shutdown_connections 2024-05-09T09:49:28.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.115+0000 7fa2bd6f4980 1 --2- 172.21.15.157:0/1488741533 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500aab2a10 0x56500ac2bc50 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.115+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/1488741533 >> 172.21.15.157:0/1488741533 conn(0x56500ab39070 msgr2=0x56500ac277e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:28.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.119+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/1488741533 shutdown_connections 2024-05-09T09:49:28.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.119+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/1488741533 wait complete. 2024-05-09T09:49:28.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.119+0000 7fa2bd6f4980 1 Processor -- start 2024-05-09T09:49:28.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.119+0000 7fa2bd6f4980 1 -- start start 2024-05-09T09:49:28.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.119+0000 7fa2bd6f4980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500aab2a10 0x56500ac32e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.119+0000 7fa2bd6f4980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56500ab4a440 con 0x56500aab2a10 2024-05-09T09:49:28.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.119+0000 7fa2bb20f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500aab2a10 0x56500ac32e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.119+0000 7fa2bb20f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500aab2a10 0x56500ac32e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39006/0 (socket says 172.21.15.157:39006) 2024-05-09T09:49:28.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.119+0000 7fa2bb20f640 1 -- 172.21.15.157:0/2569210892 learned_addr learned my addr 172.21.15.157:0/2569210892 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:28.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.119+0000 7fa2bb20f640 1 -- 172.21.15.157:0/2569210892 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56500ac33380 con 0x56500aab2a10 2024-05-09T09:49:28.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.119+0000 7fa2bb20f640 1 --2- 172.21.15.157:0/2569210892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500aab2a10 0x56500ac32e40 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0012f0 tx=0x7fa2ac001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.119+0000 7fa1a7e07640 1 -- 172.21.15.157:0/2569210892 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2ac013760 con 0x56500aab2a10 2024-05-09T09:49:28.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.119+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/2569210892 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56500ac33610 con 0x56500aab2a10 2024-05-09T09:49:28.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.119+0000 7fa1a7e07640 1 -- 172.21.15.157:0/2569210892 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2ac023070 con 0x56500aab2a10 2024-05-09T09:49:28.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.119+0000 7fa1a7e07640 1 -- 172.21.15.157:0/2569210892 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2ac013a30 con 0x56500aab2a10 2024-05-09T09:49:28.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.119+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/2569210892 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56500ac362f0 con 0x56500aab2a10 2024-05-09T09:49:28.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.119+0000 7fa1a7e07640 1 -- 172.21.15.157:0/2569210892 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fa2ac010070 con 0x56500aab2a10 2024-05-09T09:49:28.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.119+0000 7fa1a7e07640 1 --2- 172.21.15.157:0/2569210892 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa1a0034bb0 0x7fa1a0037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.119+0000 7fa1a7e07640 1 -- 172.21.15.157:0/2569210892 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fa2ac04a4c0 con 0x56500aab2a10 2024-05-09T09:49:28.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.119+0000 7fa2baa0e640 1 --2- 172.21.15.157:0/2569210892 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa1a0034bb0 0x7fa1a0037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.123+0000 7fa2bd6f4980 1 --2- 172.21.15.157:0/2569210892 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56500ab450b0 0x56500ac39e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.123+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/2569210892 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56500ac3a450 con 0x56500ab450b0 2024-05-09T09:49:28.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.123+0000 7fa2bba10640 1 --2- 172.21.15.157:0/2569210892 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56500ab450b0 0x56500ac39e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.123+0000 7fa2baa0e640 1 --2- 172.21.15.157:0/2569210892 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa1a0034bb0 0x7fa1a0037070 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40ad000 tx=0x7fa2a40a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.123+0000 7fa2bba10640 1 --2- 172.21.15.157:0/2569210892 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56500ab450b0 0x56500ac39e30 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.123+0000 7fa2bba10640 1 -- 172.21.15.157:0/2569210892 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2b40083f0 con 0x56500ab450b0 2024-05-09T09:49:28.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.123+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/2569210892 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56500ac37510 con 0x56500ab450b0 2024-05-09T09:49:28.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.123+0000 7fa2bba10640 1 -- 172.21.15.157:0/2569210892 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa2b40083f0 con 0x56500ab450b0 2024-05-09T09:49:28.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.123+0000 7fa2bd6f4980 1 --2- 172.21.15.157:0/2569210892 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56500ac3c7a0 0x56500ac3eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.123+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/2569210892 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56500ac3f260 con 0x56500ac3c7a0 2024-05-09T09:49:28.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.123+0000 7fa2bb20f640 1 --2- 172.21.15.157:0/2569210892 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56500ac3c7a0 0x56500ac3eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.123+0000 7fa2bb20f640 1 --2- 172.21.15.157:0/2569210892 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56500ac3c7a0 0x56500ac3eb90 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.123+0000 7fa2bb20f640 1 -- 172.21.15.157:0/2569210892 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa2ac00f030 con 0x56500ac3c7a0 2024-05-09T09:49:28.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.123+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/2569210892 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56500ac3b640 con 0x56500ab450b0 2024-05-09T09:49:28.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.123+0000 7fa2bba10640 1 -- 172.21.15.157:0/2569210892 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa2b40083f0 con 0x56500ab450b0 2024-05-09T09:49:28.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.123+0000 7fa2bd6f4980 1 --2- 172.21.15.157:0/2569210892 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56500ac406a0 0x56500ac42a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.123+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/2569210892 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56500ac43220 con 0x56500ac406a0 2024-05-09T09:49:28.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.123+0000 7fa2baa0e640 1 --2- 172.21.15.157:0/2569210892 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56500ac406a0 0x56500ac42a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.123+0000 7fa2baa0e640 1 --2- 172.21.15.157:0/2569210892 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56500ac406a0 0x56500ac42a90 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.127+0000 7fa2baa0e640 1 -- 172.21.15.157:0/2569210892 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa2a40b3040 con 0x56500ac406a0 2024-05-09T09:49:28.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.127+0000 7fa2bd6f4980 1 Processor -- start 2024-05-09T09:49:28.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.127+0000 7fa2bd6f4980 1 -- start start 2024-05-09T09:49:28.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.127+0000 7fa2bd6f4980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500ac690d0 0x56500ac694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.127+0000 7fa2bd6f4980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56500aa46020 con 0x56500ac690d0 2024-05-09T09:49:28.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.127+0000 7fa2bb20f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500ac690d0 0x56500ac694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.131+0000 7fa2bb20f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500ac690d0 0x56500ac694f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39010/0 (socket says 172.21.15.157:39010) 2024-05-09T09:49:28.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.131+0000 7fa2bb20f640 1 -- 172.21.15.157:0/602574245 learned_addr learned my addr 172.21.15.157:0/602574245 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:28.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.131+0000 7fa2bb20f640 1 -- 172.21.15.157:0/602574245 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56500ac69a30 con 0x56500ac690d0 2024-05-09T09:49:28.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.131+0000 7fa2bb20f640 1 --2- 172.21.15.157:0/602574245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500ac690d0 0x56500ac694f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0066a0 tx=0x7fa2ac0116a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.131+0000 7fa19ffff640 1 -- 172.21.15.157:0/602574245 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2ac012e40 con 0x56500ac690d0 2024-05-09T09:49:28.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.131+0000 7fa19ffff640 1 -- 172.21.15.157:0/602574245 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2ac019040 con 0x56500ac690d0 2024-05-09T09:49:28.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.131+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/602574245 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56500ac6a4c0 con 0x56500ac690d0 2024-05-09T09:49:28.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.131+0000 7fa19ffff640 1 -- 172.21.15.157:0/602574245 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2ac047130 con 0x56500ac690d0 2024-05-09T09:49:28.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.131+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/602574245 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56500ac6a9a0 con 0x56500ac690d0 2024-05-09T09:49:28.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.131+0000 7fa19ffff640 1 -- 172.21.15.157:0/602574245 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fa2ac0472d0 con 0x56500ac690d0 2024-05-09T09:49:28.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.131+0000 7fa19ffff640 1 --2- 172.21.15.157:0/602574245 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa194034bb0 0x7fa194037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.131+0000 7fa19ffff640 1 -- 172.21.15.157:0/602574245 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fa2ac03cd10 con 0x56500ac690d0 2024-05-09T09:49:28.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.131+0000 7fa2baa0e640 1 --2- 172.21.15.157:0/602574245 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa194034bb0 0x7fa194037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.131+0000 7fa2bd6f4980 1 Processor -- start 2024-05-09T09:49:28.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.131+0000 7fa2bd6f4980 1 -- start start 2024-05-09T09:49:28.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.131+0000 7fa2bd6f4980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500ac762a0 0x56500ac766a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.131+0000 7fa2bd6f4980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56500ac2c3a0 con 0x56500ac762a0 2024-05-09T09:49:28.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.131+0000 7fa2baa0e640 1 --2- 172.21.15.157:0/602574245 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa194034bb0 0x7fa194037070 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40ae040 tx=0x7fa2a4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.131+0000 7fa2bb20f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500ac762a0 0x56500ac766a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.131+0000 7fa2bb20f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500ac762a0 0x56500ac766a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39012/0 (socket says 172.21.15.157:39012) 2024-05-09T09:49:28.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.131+0000 7fa2bb20f640 1 -- 172.21.15.157:0/2637099925 learned_addr learned my addr 172.21.15.157:0/2637099925 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:28.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.131+0000 7fa2bb20f640 1 -- 172.21.15.157:0/2637099925 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56500ac76c70 con 0x56500ac762a0 2024-05-09T09:49:28.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.135+0000 7fa2bb20f640 1 --2- 172.21.15.157:0/2637099925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500ac762a0 0x56500ac766a0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac031fd0 tx=0x7fa2ac041fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d24ce51e2384b4f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.135+0000 7fa19dffb640 1 -- 172.21.15.157:0/2637099925 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2ac05a070 con 0x56500ac762a0 2024-05-09T09:49:28.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.135+0000 7fa19dffb640 1 -- 172.21.15.157:0/2637099925 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2ac033e80 con 0x56500ac762a0 2024-05-09T09:49:28.135 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.135+0000 7fa19dffb640 1 -- 172.21.15.157:0/2637099925 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2ac012ad0 con 0x56500ac762a0 2024-05-09T09:49:28.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.135+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/2637099925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500ac762a0 msgr2=0x56500ac766a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.135+0000 7fa2bd6f4980 1 --2- 172.21.15.157:0/2637099925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500ac762a0 0x56500ac766a0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac031fd0 tx=0x7fa2ac041fc0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.135+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/2637099925 shutdown_connections 2024-05-09T09:49:28.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.135+0000 7fa2bd6f4980 1 --2- 172.21.15.157:0/2637099925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500ac762a0 0x56500ac766a0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.135+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/2637099925 >> 172.21.15.157:0/2637099925 conn(0x56500ac725d0 msgr2=0x56500ac70630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:28.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.135+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/2637099925 shutdown_connections 2024-05-09T09:49:28.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.135+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/2637099925 wait complete. 2024-05-09T09:49:28.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.135+0000 7fa2bd6f4980 1 Processor -- start 2024-05-09T09:49:28.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.135+0000 7fa2bd6f4980 1 -- start start 2024-05-09T09:49:28.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.135+0000 7fa2bd6f4980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500ac762a0 0x56500ac7d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.135+0000 7fa2bd6f4980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56500ac77340 con 0x56500ac762a0 2024-05-09T09:49:28.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.135+0000 7fa2bb20f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500ac762a0 0x56500ac7d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.135+0000 7fa2bb20f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500ac762a0 0x56500ac7d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39018/0 (socket says 172.21.15.157:39018) 2024-05-09T09:49:28.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.135+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 learned_addr learned my addr 172.21.15.157:0/4249681849 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:28.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.135+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56500ac7daf0 con 0x56500ac762a0 2024-05-09T09:49:28.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.135+0000 7fa2bb20f640 1 --2- 172.21.15.157:0/4249681849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500ac762a0 0x56500ac7d5b0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac047640 tx=0x7fa2ac014610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.135+0000 7fa18bfff640 1 -- 172.21.15.157:0/4249681849 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2ac06f070 con 0x56500ac762a0 2024-05-09T09:49:28.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.135+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56500ac7daf0 con 0x56500ac762a0 2024-05-09T09:49:28.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.135+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56500ac7daf0 con 0x56500ac762a0 2024-05-09T09:49:28.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.135+0000 7fa18bfff640 1 -- 172.21.15.157:0/4249681849 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2ac012ad0 con 0x56500ac762a0 2024-05-09T09:49:28.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.135+0000 7fa18bfff640 1 -- 172.21.15.157:0/4249681849 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2ac042600 con 0x56500ac762a0 2024-05-09T09:49:28.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa18bfff640 1 -- 172.21.15.157:0/4249681849 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fa2ac072070 con 0x56500ac762a0 2024-05-09T09:49:28.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa18bfff640 1 --2- 172.21.15.157:0/4249681849 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa184034bb0 0x7fa184037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa18bfff640 1 -- 172.21.15.157:0/4249681849 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fa2ac067070 con 0x56500ac762a0 2024-05-09T09:49:28.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa2baa0e640 1 --2- 172.21.15.157:0/4249681849 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa184034bb0 0x7fa184037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa2bd6f4980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa2bd6f4980 1 --2- 172.21.15.157:0/4249681849 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56500ac8a120 0x56500ac8c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56500ac8cd30 con 0x56500ac8a120 2024-05-09T09:49:28.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa2bba10640 1 --2- 172.21.15.157:0/4249681849 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56500ac8a120 0x56500ac8c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa2baa0e640 1 --2- 172.21.15.157:0/4249681849 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa184034bb0 0x7fa184037070 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4000c10 tx=0x7fa2a40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa2bba10640 1 --2- 172.21.15.157:0/4249681849 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56500ac8a120 0x56500ac8c5e0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2b40083f0 con 0x56500ac8a120 2024-05-09T09:49:28.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa2bd6f4980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa2bd6f4980 20 realm 2024-05-09T09:49:28.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa2bd6f4980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56500ac8d140 con 0x56500ac8a120 2024-05-09T09:49:28.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2b40083f0 con 0x56500ac8a120 2024-05-09T09:49:28.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa2bd6f4980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa2bd6f4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:49:28.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa2bd6f4980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56500ac8da10 con 0x56500ac8a120 2024-05-09T09:49:28.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2b40083f0 con 0x56500ac8a120 2024-05-09T09:49:28.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa2bd6f4980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa2bd6f4980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56500ac8ddb0 con 0x56500ac8a120 2024-05-09T09:49:28.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa2b40083f0 con 0x56500ac8a120 2024-05-09T09:49:28.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa2bd6f4980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:28.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa2bd6f4980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa2bd6f4980 1 --2- 172.21.15.157:0/4249681849 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56500ac8eb10 0x56500ac90f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56500ac914c0 con 0x56500ac8eb10 2024-05-09T09:49:28.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa2bb20f640 1 --2- 172.21.15.157:0/4249681849 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56500ac8eb10 0x56500ac90f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.139+0000 7fa2bb20f640 1 --2- 172.21.15.157:0/4249681849 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56500ac8eb10 0x56500ac90f00 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.143+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa2ac071030 con 0x56500ac8eb10 2024-05-09T09:49:28.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.143+0000 7fa2bd6f4980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:49:28.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.143+0000 7fa2bd6f4980 20 searching for the correct realm 2024-05-09T09:49:28.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.143+0000 7fa2bd6f4980 1 --2- 172.21.15.157:0/4249681849 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56500ac93410 0x56500ac95820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.143+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56500ac95ef0 con 0x56500ac93410 2024-05-09T09:49:28.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.143+0000 7fa2baa0e640 1 --2- 172.21.15.157:0/4249681849 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56500ac93410 0x56500ac95820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.143+0000 7fa2baa0e640 1 --2- 172.21.15.157:0/4249681849 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56500ac93410 0x56500ac95820 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.143+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2a40d9070 con 0x56500ac93410 2024-05-09T09:49:28.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.143+0000 7fa2baa0e640 1 --2- 172.21.15.157:0/4249681849 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa2a40ce040 0x7fa2a40db410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.143+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56500ac95ef0 con 0x7fa2a40ce040 2024-05-09T09:49:28.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.143+0000 7fa2bba10640 1 --2- 172.21.15.157:0/4249681849 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa2a40ce040 0x7fa2a40db410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.143+0000 7fa2bba10640 1 --2- 172.21.15.157:0/4249681849 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa2a40ce040 0x7fa2a40db410 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.143+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2b40083f0 con 0x7fa2a40ce040 2024-05-09T09:49:28.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.143+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56500ac8ddb0 con 0x56500ac8eb10 2024-05-09T09:49:28.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.143+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2ac071030 con 0x56500ac8eb10 2024-05-09T09:49:28.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.143+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56500ac8ddb0 con 0x56500ac8a120 2024-05-09T09:49:28.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.143+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2b40083f0 con 0x56500ac8a120 2024-05-09T09:49:28.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.143+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56500ac8ddb0 con 0x56500ac8a120 2024-05-09T09:49:28.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.143+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2b4026040 con 0x56500ac8a120 2024-05-09T09:49:28.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.143+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56500ac8ddb0 con 0x56500ac8eb10 2024-05-09T09:49:28.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.143+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2ac071030 con 0x56500ac8eb10 2024-05-09T09:49:28.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.143+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56500ac8ddb0 con 0x56500ac8eb10 2024-05-09T09:49:28.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.147+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2ac071030 con 0x56500ac8eb10 2024-05-09T09:49:28.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.147+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56500ac8ddb0 con 0x7fa2a40ce040 2024-05-09T09:49:28.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.147+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2b4026040 con 0x7fa2a40ce040 2024-05-09T09:49:28.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.147+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56500ac8ddb0 con 0x56500ac93410 2024-05-09T09:49:28.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.147+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2a40d9070 con 0x56500ac93410 2024-05-09T09:49:28.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.147+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56500ac8ddb0 con 0x56500ac8a120 2024-05-09T09:49:28.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.147+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2b4026040 con 0x56500ac8a120 2024-05-09T09:49:28.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.147+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56500ac8ddb0 con 0x56500ac8eb10 2024-05-09T09:49:28.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.147+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2ac071030 con 0x56500ac8eb10 2024-05-09T09:49:28.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.147+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56500ac8ddb0 con 0x56500ac8a120 2024-05-09T09:49:28.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.147+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2b4026040 con 0x56500ac8a120 2024-05-09T09:49:28.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.147+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56500ac8ddb0 con 0x7fa2a40ce040 2024-05-09T09:49:28.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.147+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa2b4026040 con 0x7fa2a40ce040 2024-05-09T09:49:28.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.147+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56500ac8ddb0 con 0x56500ac93410 2024-05-09T09:49:28.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.147+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2a40d9070 con 0x56500ac93410 2024-05-09T09:49:28.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.147+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2a40e8040 con 0x56500ac93410 2024-05-09T09:49:28.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.147+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa2a40d9070 con 0x56500ac93410 2024-05-09T09:49:28.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.147+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2a40e8040 con 0x56500ac8eb10 2024-05-09T09:49:28.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.147+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2ac071030 con 0x56500ac8eb10 2024-05-09T09:49:28.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.147+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2a40e8040 con 0x56500ac93410 2024-05-09T09:49:28.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.147+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2a40d9070 con 0x56500ac93410 2024-05-09T09:49:28.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.147+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2a40e8040 con 0x56500ac93410 2024-05-09T09:49:28.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.147+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2a40d9070 con 0x56500ac93410 2024-05-09T09:49:28.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.147+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2a40e8040 con 0x56500ac8a120 2024-05-09T09:49:28.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.151+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2b4026040 con 0x56500ac8a120 2024-05-09T09:49:28.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.151+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2a40e8040 con 0x56500ac8a120 2024-05-09T09:49:28.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.151+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa2b4026040 con 0x56500ac8a120 2024-05-09T09:49:28.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.151+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2a40e8040 con 0x56500ac8eb10 2024-05-09T09:49:28.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.151+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2ac071030 con 0x56500ac8eb10 2024-05-09T09:49:28.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.151+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2a40e8040 con 0x56500ac93410 2024-05-09T09:49:28.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.151+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2a40d9070 con 0x56500ac93410 2024-05-09T09:49:28.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.151+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2a40e8040 con 0x7fa2a40ce040 2024-05-09T09:49:28.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.151+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2b4026040 con 0x7fa2a40ce040 2024-05-09T09:49:28.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.151+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2a40e8040 con 0x56500ac8a120 2024-05-09T09:49:28.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.151+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2b4026040 con 0x56500ac8a120 2024-05-09T09:49:28.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.151+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2a40e8040 con 0x56500ac8eb10 2024-05-09T09:49:28.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.151+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa2ac071030 con 0x56500ac8eb10 2024-05-09T09:49:28.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.151+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2a40e8040 con 0x56500ac93410 2024-05-09T09:49:28.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.151+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2a40d9070 con 0x56500ac93410 2024-05-09T09:49:28.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.151+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2a40e8040 con 0x56500ac8eb10 2024-05-09T09:49:28.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.151+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2ac071030 con 0x56500ac8eb10 2024-05-09T09:49:28.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.151+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2a40e8040 con 0x7fa2a40ce040 2024-05-09T09:49:28.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.151+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2b4026040 con 0x7fa2a40ce040 2024-05-09T09:49:28.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.151+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2a40e8040 con 0x56500ac93410 2024-05-09T09:49:28.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.151+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2a40d9070 con 0x56500ac93410 2024-05-09T09:49:28.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.151+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2a40e8040 con 0x56500ac8eb10 2024-05-09T09:49:28.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2ac071030 con 0x56500ac8eb10 2024-05-09T09:49:28.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2a40e8040 con 0x56500ac8a120 2024-05-09T09:49:28.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa2b4026040 con 0x56500ac8a120 2024-05-09T09:49:28.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa2a40e8040 con 0x7fa2a40ce040 2024-05-09T09:49:28.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2b4026040 con 0x7fa2a40ce040 2024-05-09T09:49:28.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:49:28.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:49:28.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:49:28.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:49:28.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:49:28.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:49:28.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56500ac91d80 con 0x56500ac8a120 2024-05-09T09:49:28.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2b4026040 con 0x56500ac8a120 2024-05-09T09:49:28.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56500ac91d80 con 0x56500ac8a120 2024-05-09T09:49:28.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa2b4026040 con 0x56500ac8a120 2024-05-09T09:49:28.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:28.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56500ac91d80 con 0x56500ac93410 2024-05-09T09:49:28.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa2a40d9070 con 0x56500ac93410 2024-05-09T09:49:28.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:49:28.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 20 zone default found 2024-05-09T09:49:28.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 4 Realm: () 2024-05-09T09:49:28.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:49:28.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:49:28.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:49:28.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 20 zonegroup default 2024-05-09T09:49:28.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56500ac92760 con 0x56500ac8eb10 2024-05-09T09:49:28.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa2ac071030 con 0x56500ac8eb10 2024-05-09T09:49:28.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56500ac922f0 con 0x56500ac93410 2024-05-09T09:49:28.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa2a40d9070 con 0x56500ac93410 2024-05-09T09:49:28.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56500ac98280 con 0x56500ac93410 2024-05-09T09:49:28.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa2a40d9070 con 0x56500ac93410 2024-05-09T09:49:28.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 20 started sync module instance, tier type = 2024-05-09T09:49:28.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:49:28.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.155+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500ac97690 con 0x7fa2a40ce040 2024-05-09T09:49:28.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.159+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2b4026040 con 0x7fa2a40ce040 2024-05-09T09:49:28.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.159+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94901778348944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500ac97690 con 0x7fa2a40ce040 2024-05-09T09:49:28.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.159+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500ac98dc0 con 0x56500ac8a120 2024-05-09T09:49:28.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.159+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94901778348944] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2b4036040 con 0x7fa2a40ce040 2024-05-09T09:49:28.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.159+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2b4036040 con 0x56500ac8a120 2024-05-09T09:49:28.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.159+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94901778352304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500ac97690 con 0x56500ac8a120 2024-05-09T09:49:28.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.159+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500ac99800 con 0x56500ac93410 2024-05-09T09:49:28.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.163+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94901778352304] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2b4036040 con 0x56500ac8a120 2024-05-09T09:49:28.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.163+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2a40d9070 con 0x56500ac93410 2024-05-09T09:49:28.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.163+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94901778346464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500ac97600 con 0x56500ac93410 2024-05-09T09:49:28.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.163+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500ac9a590 con 0x7fa2a40ce040 2024-05-09T09:49:28.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.163+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2b4036040 con 0x7fa2a40ce040 2024-05-09T09:49:28.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.163+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94901778358432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500ac9a4c0 con 0x7fa2a40ce040 2024-05-09T09:49:28.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.163+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500ac9b450 con 0x56500ac8a120 2024-05-09T09:49:28.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.163+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94901778346464] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2a40d9070 con 0x56500ac93410 2024-05-09T09:49:28.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.163+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94901778358432] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2b4036040 con 0x7fa2a40ce040 2024-05-09T09:49:28.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.167+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2b4036040 con 0x56500ac8a120 2024-05-09T09:49:28.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.167+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94901778357232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500ac9afa0 con 0x56500ac8a120 2024-05-09T09:49:28.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.167+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500ac9bcf0 con 0x56500ac8eb10 2024-05-09T09:49:28.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.167+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94901778357232] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2b4036040 con 0x56500ac8a120 2024-05-09T09:49:28.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.167+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2ac071030 con 0x56500ac8eb10 2024-05-09T09:49:28.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.167+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94901778364480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500ac9afa0 con 0x56500ac8eb10 2024-05-09T09:49:28.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.167+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500ac9c540 con 0x56500ac8eb10 2024-05-09T09:49:28.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.171+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94901778364480] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2ac071030 con 0x56500ac8eb10 2024-05-09T09:49:28.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.171+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2ac071030 con 0x56500ac8eb10 2024-05-09T09:49:28.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.171+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94901778366608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500ac9c960 con 0x56500ac8eb10 2024-05-09T09:49:28.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.171+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500ac9d320 con 0x56500ac8eb10 2024-05-09T09:49:28.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.171+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2ac071030 con 0x56500ac8eb10 2024-05-09T09:49:28.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.171+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94901778370160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500ac9d740 con 0x56500ac8eb10 2024-05-09T09:49:28.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.171+0000 7fa2bd6f4980 20 add_watcher() i=0 2024-05-09T09:49:28.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.171+0000 7fa2bd6f4980 20 add_watcher() i=1 2024-05-09T09:49:28.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.171+0000 7fa2bd6f4980 20 add_watcher() i=2 2024-05-09T09:49:28.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.171+0000 7fa2bd6f4980 20 add_watcher() i=3 2024-05-09T09:49:28.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.171+0000 7fa2bd6f4980 20 add_watcher() i=4 2024-05-09T09:49:28.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.171+0000 7fa2bd6f4980 20 add_watcher() i=5 2024-05-09T09:49:28.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.171+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94901778366608] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2ac071030 con 0x56500ac8eb10 2024-05-09T09:49:28.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.171+0000 7fa2bd6f4980 20 add_watcher() i=6 2024-05-09T09:49:28.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.175+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94901778370160] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2ac071030 con 0x56500ac8eb10 2024-05-09T09:49:28.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.175+0000 7fa2bd6f4980 20 add_watcher() i=7 2024-05-09T09:49:28.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.175+0000 7fa2bd6f4980 2 all 8 watchers are set, enabling cache 2024-05-09T09:49:28.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.175+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56500ac9d740 con 0x56500ac8a120 2024-05-09T09:49:28.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.175+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa2b4036040 con 0x56500ac8a120 2024-05-09T09:49:28.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.175+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94901778371216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500ac9d6b0 con 0x56500ac8a120 2024-05-09T09:49:28.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.175+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94901778371216] v32'425 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa2b4036040 con 0x56500ac8a120 2024-05-09T09:49:28.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.175+0000 7fa170fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:28.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.175+0000 7fa2bd6f4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:49:28.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.175+0000 7fa2bd6f4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:49:28.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.175+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500aca9080 con 0x56500ac8a120 2024-05-09T09:49:28.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.179+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'98 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2b4036040 con 0x56500ac8a120 2024-05-09T09:49:28.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.179+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500aca96d0 con 0x56500ac8eb10 2024-05-09T09:49:28.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.179+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'93 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2ac071030 con 0x56500ac8eb10 2024-05-09T09:49:28.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.179+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500aca96d0 con 0x56500ac93410 2024-05-09T09:49:28.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.183+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'92 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2a40d9070 con 0x56500ac93410 2024-05-09T09:49:28.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.183+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500aca9ce0 con 0x56500ac8a120 2024-05-09T09:49:28.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.183+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'426 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2b4036040 con 0x56500ac8a120 2024-05-09T09:49:28.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.183+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500acaa190 con 0x7fa2a40ce040 2024-05-09T09:49:28.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.183+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'263 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2b4036040 con 0x7fa2a40ce040 2024-05-09T09:49:28.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.183+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500acaa700 con 0x56500ac93410 2024-05-09T09:49:28.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.183+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'176 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2a40d9070 con 0x56500ac93410 2024-05-09T09:49:28.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.183+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500acaabb0 con 0x56500ac8a120 2024-05-09T09:49:28.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.187+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'93 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2b4036040 con 0x56500ac8a120 2024-05-09T09:49:28.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.187+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500acaaa70 con 0x56500ac8eb10 2024-05-09T09:49:28.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.187+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'175 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2ac071030 con 0x56500ac8eb10 2024-05-09T09:49:28.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.187+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500acaab00 con 0x7fa2a40ce040 2024-05-09T09:49:28.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.191+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'91 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2b4036040 con 0x7fa2a40ce040 2024-05-09T09:49:28.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.191+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500acaab00 con 0x56500ac93410 2024-05-09T09:49:28.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.191+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'97 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2a40d9070 con 0x56500ac93410 2024-05-09T09:49:28.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.191+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500acaafb0 con 0x7fa2a40ce040 2024-05-09T09:49:28.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.191+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'264 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2b4036040 con 0x7fa2a40ce040 2024-05-09T09:49:28.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.191+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500acaafb0 con 0x56500ac8eb10 2024-05-09T09:49:28.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.195+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'97 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2ac071030 con 0x56500ac8eb10 2024-05-09T09:49:28.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.195+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500acaafb0 con 0x7fa2a40ce040 2024-05-09T09:49:28.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.195+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'91 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2b4036040 con 0x7fa2a40ce040 2024-05-09T09:49:28.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.195+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500acaafb0 con 0x56500ac8eb10 2024-05-09T09:49:28.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.199+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'181 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2ac071030 con 0x56500ac8eb10 2024-05-09T09:49:28.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.199+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500acaafb0 con 0x56500ac8a120 2024-05-09T09:49:28.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.199+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'427 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2b4036040 con 0x56500ac8a120 2024-05-09T09:49:28.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.199+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500acaafb0 con 0x56500ac93410 2024-05-09T09:49:28.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.203+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'257 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2a40d9070 con 0x56500ac93410 2024-05-09T09:49:28.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.203+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500acaafb0 con 0x7fa2a40ce040 2024-05-09T09:49:28.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.203+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'265 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2b4036040 con 0x7fa2a40ce040 2024-05-09T09:49:28.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.203+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500acaafb0 con 0x56500ac93410 2024-05-09T09:49:28.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.203+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'91 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2a40d9070 con 0x56500ac93410 2024-05-09T09:49:28.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.203+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500acaafb0 con 0x56500ac8a120 2024-05-09T09:49:28.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.207+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'99 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2b4036040 con 0x56500ac8a120 2024-05-09T09:49:28.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.207+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500acab040 con 0x56500ac8a120 2024-05-09T09:49:28.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.207+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'428 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2b4036040 con 0x56500ac8a120 2024-05-09T09:49:28.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.207+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500acab040 con 0x56500ac93410 2024-05-09T09:49:28.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.211+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'258 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2a40d9070 con 0x56500ac93410 2024-05-09T09:49:28.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.211+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500acab040 con 0x7fa2a40ce040 2024-05-09T09:49:28.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.211+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'103 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2b4036040 con 0x7fa2a40ce040 2024-05-09T09:49:28.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.211+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500acab040 con 0x56500ac93410 2024-05-09T09:49:28.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.211+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'93 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2a40d9070 con 0x56500ac93410 2024-05-09T09:49:28.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.211+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500acab0c0 con 0x56500ac93410 2024-05-09T09:49:28.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.215+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'97 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2a40d9070 con 0x56500ac93410 2024-05-09T09:49:28.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.215+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500acab0c0 con 0x56500ac93410 2024-05-09T09:49:28.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.215+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'88 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2a40d9070 con 0x56500ac93410 2024-05-09T09:49:28.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.215+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500acab0c0 con 0x56500ac93410 2024-05-09T09:49:28.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.215+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'177 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2a40d9070 con 0x56500ac93410 2024-05-09T09:49:28.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.215+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500acaabc0 con 0x56500ac8eb10 2024-05-09T09:49:28.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.219+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'93 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2ac071030 con 0x56500ac8eb10 2024-05-09T09:49:28.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.219+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500acaabc0 con 0x56500ac93410 2024-05-09T09:49:28.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.219+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'92 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2a40d9070 con 0x56500ac93410 2024-05-09T09:49:28.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.219+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500acab0c0 con 0x56500ac8eb10 2024-05-09T09:49:28.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.223+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'176 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2ac071030 con 0x56500ac8eb10 2024-05-09T09:49:28.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.223+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500acab0c0 con 0x56500ac93410 2024-05-09T09:49:28.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.223+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'259 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2a40d9070 con 0x56500ac93410 2024-05-09T09:49:28.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.223+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500acab0c0 con 0x56500ac8eb10 2024-05-09T09:49:28.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.227+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'182 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2ac071030 con 0x56500ac8eb10 2024-05-09T09:49:28.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.227+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500acab0c0 con 0x7fa2a40ce040 2024-05-09T09:49:28.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.227+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'97 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2b4036040 con 0x7fa2a40ce040 2024-05-09T09:49:28.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.227+0000 7fa0eb7fe640 20 reqs_thread_entry: start 2024-05-09T09:49:28.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.227+0000 7fa2bd6f4980 20 init_complete bucket index max shards: 11 2024-05-09T09:49:28.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.231+0000 7fa0e97fa640 20 reqs_thread_entry: start 2024-05-09T09:49:28.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.231+0000 7fa2bd6f4980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-09T09:49:28.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.231+0000 7fa2bd6f4980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.231+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:94 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56500acc6b30 con 0x56500ac8eb10 2024-05-09T09:49:28.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.231+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(94 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fa2ac071030 con 0x56500ac8eb10 2024-05-09T09:49:28.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.231+0000 7fa2bd6f4980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.231+0000 7fa2bd6f4980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-05-09T09:49:28.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.231+0000 7fa2bd6f4980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:28.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.231+0000 7fa2bd6f4980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-05-09T09:49:28.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.231+0000 7fa2bd6f4980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.231+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:95 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56500aca6500 con 0x56500ac8a120 2024-05-09T09:49:28.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.231+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(95 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fa2b4036040 con 0x56500ac8a120 2024-05-09T09:49:28.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.231+0000 7fa2bd6f4980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.231+0000 7fa2bd6f4980 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-05-09T09:49:28.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.231+0000 7fa2bd6f4980 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-05-09T09:49:28.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.231+0000 7fa2bd6f4980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-05-09T09:49:28.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.231+0000 7fa2bd6f4980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-05-09T09:49:28.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.231+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:96 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500aca6df0 con 0x56500ac8eb10 2024-05-09T09:49:28.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.235+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(96 ada [delete,create,call,writefull 0~473] v32'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fa2ac071030 con 0x56500ac8eb10 2024-05-09T09:49:28.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.235+0000 7fa2bd6f4980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-09T09:49:28.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.235+0000 7fa2bd6f4980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:28.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.235+0000 7fa2bd6f4980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-09T09:49:28.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.235+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.d 7:b4812045:::notify.4:head [notify cookie 94901778409792 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56500acca080 con 0x56500ac8a120 2024-05-09T09:49:28.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.235+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== watch-notify(notify (1) cookie 94901778357232 notify 137438953503 ret 0) ==== 691+0+0 (crc 0 0 0) 0x56500acaa080 con 0x56500ac8a120 2024-05-09T09:49:28.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.235+0000 7fa19dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953503 cookie 94901778357232 notifier 4838 bl.length()=649 2024-05-09T09:49:28.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.235+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(97 notify.4 [notify cookie 94901778409792 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa2b4036040 con 0x56500ac8a120 2024-05-09T09:49:28.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.235+0000 7fa19dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-09T09:49:28.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.235+0000 7fa19dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:28.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.235+0000 7fa19dffb640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa1800056c0 con 0x56500ac8a120 2024-05-09T09:49:28.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.235+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== watch-notify(notify_complete (2) cookie 94901778409792 notify 137438953503 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56500aca89f0 con 0x56500ac8a120 2024-05-09T09:49:28.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.235+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:99 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500aca6df0 con 0x56500ac8a120 2024-05-09T09:49:28.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.235+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(98 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2b4036040 con 0x56500ac8a120 2024-05-09T09:49:28.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.235+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(99 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v32'24 uv24 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fa2b4036040 con 0x56500ac8a120 2024-05-09T09:49:28.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.235+0000 7fa2bd6f4980 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-05-09T09:49:28.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.235+0000 7fa2bd6f4980 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-05-09T09:49:28.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.235+0000 7fa2bd6f4980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-05-09T09:49:28.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.235+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:100 7.15 7:a93a5511:::notify.2:head [notify cookie 94901778409792 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56500acca470 con 0x56500ac93410 2024-05-09T09:49:28.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.235+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== watch-notify(notify (1) cookie 94901778346464 notify 137438953480 ret 0) ==== 219+0+0 (crc 0 0 0) 0x56500aca9eb0 con 0x56500ac93410 2024-05-09T09:49:28.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.235+0000 7fa19dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94901778346464 notifier 4838 bl.length()=177 2024-05-09T09:49:28.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.235+0000 7fa19dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-05-09T09:49:28.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.235+0000 7fa19dffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-05-09T09:49:28.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.235+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(100 notify.2 [notify cookie 94901778409792 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa2a40d9070 con 0x56500ac93410 2024-05-09T09:49:28.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.235+0000 7fa19dffb640 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa1800056c0 con 0x56500ac93410 2024-05-09T09:49:28.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.235+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== watch-notify(notify_complete (2) cookie 94901778409792 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56500acaa360 con 0x56500ac93410 2024-05-09T09:49:28.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.235+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 30 ==== osd_op_reply(101 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2a40d9070 con 0x56500ac93410 2024-05-09T09:49:28.238 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-09T09:49:28.233198Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:49:28.233178Z","tags":[],"group_ids":[]} 2024-05-09T09:49:28.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.235+0000 7fa170fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:28.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.235+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94901778371216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500aca5b00 con 0x56500ac8a120 2024-05-09T09:49:28.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.239+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(102 data_loggenerations_metadata [watch unwatch cookie 94901778371216] v32'429 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa2b4036040 con 0x56500ac8a120 2024-05-09T09:49:28.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.239+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:103 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94901778348944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500ac9d290 con 0x7fa2a40ce040 2024-05-09T09:49:28.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.239+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(103 notify.0 [watch unwatch cookie 94901778348944] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2b4036040 con 0x7fa2a40ce040 2024-05-09T09:49:28.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.239+0000 7fa2bd6f4980 20 remove_watcher() i=0 2024-05-09T09:49:28.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.239+0000 7fa2bd6f4980 2 removed watcher, disabling cache 2024-05-09T09:49:28.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.239+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:104 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94901778352304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500ac9d290 con 0x56500ac8a120 2024-05-09T09:49:28.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.243+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(104 notify.1 [watch unwatch cookie 94901778352304] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2b4036040 con 0x56500ac8a120 2024-05-09T09:49:28.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.243+0000 7fa2bd6f4980 20 remove_watcher() i=1 2024-05-09T09:49:28.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.243+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:105 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94901778346464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500ac9d290 con 0x56500ac93410 2024-05-09T09:49:28.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.243+0000 7fa2baa0e640 1 -- 172.21.15.157:0/4249681849 <== osd.3 v2:172.21.15.157:6816/2487336710 31 ==== osd_op_reply(105 notify.2 [watch unwatch cookie 94901778346464] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2a40d9070 con 0x56500ac93410 2024-05-09T09:49:28.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.243+0000 7fa2bd6f4980 20 remove_watcher() i=2 2024-05-09T09:49:28.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.243+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:106 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94901778358432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500ac971e0 con 0x7fa2a40ce040 2024-05-09T09:49:28.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.243+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(106 notify.3 [watch unwatch cookie 94901778358432] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2b4036040 con 0x7fa2a40ce040 2024-05-09T09:49:28.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.243+0000 7fa2bd6f4980 20 remove_watcher() i=3 2024-05-09T09:49:28.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.243+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94901778357232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500ac9d290 con 0x56500ac8a120 2024-05-09T09:49:28.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.247+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(107 notify.4 [watch unwatch cookie 94901778357232] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2b4036040 con 0x56500ac8a120 2024-05-09T09:49:28.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.247+0000 7fa2bd6f4980 20 remove_watcher() i=4 2024-05-09T09:49:28.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.247+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:108 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94901778364480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500ac971e0 con 0x56500ac8eb10 2024-05-09T09:49:28.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.247+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(108 notify.5 [watch unwatch cookie 94901778364480] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2ac071030 con 0x56500ac8eb10 2024-05-09T09:49:28.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.247+0000 7fa2bd6f4980 20 remove_watcher() i=5 2024-05-09T09:49:28.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.247+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:109 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94901778366608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500ac9d290 con 0x56500ac8eb10 2024-05-09T09:49:28.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.251+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(109 notify.6 [watch unwatch cookie 94901778366608] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2ac071030 con 0x56500ac8eb10 2024-05-09T09:49:28.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.251+0000 7fa2bd6f4980 20 remove_watcher() i=6 2024-05-09T09:49:28.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.251+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:110 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94901778370160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56500ac971e0 con 0x56500ac8eb10 2024-05-09T09:49:28.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.251+0000 7fa2bb20f640 1 -- 172.21.15.157:0/4249681849 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(110 notify.7 [watch unwatch cookie 94901778370160] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2ac071030 con 0x56500ac8eb10 2024-05-09T09:49:28.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.251+0000 7fa2bd6f4980 20 remove_watcher() i=7 2024-05-09T09:49:28.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.251+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56500ac8eb10 msgr2=0x56500ac90f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.251+0000 7fa2bd6f4980 1 --2- 172.21.15.157:0/4249681849 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56500ac8eb10 0x56500ac90f00 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.251+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56500ac8a120 msgr2=0x56500ac8c5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.251+0000 7fa2bd6f4980 1 --2- 172.21.15.157:0/4249681849 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56500ac8a120 0x56500ac8c5e0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.251+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa2a40ce040 msgr2=0x7fa2a40db410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.251+0000 7fa2bd6f4980 1 --2- 172.21.15.157:0/4249681849 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fa2a40ce040 0x7fa2a40db410 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.251+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56500ac93410 msgr2=0x56500ac95820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.251+0000 7fa2bd6f4980 1 --2- 172.21.15.157:0/4249681849 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56500ac93410 0x56500ac95820 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.251+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa184034bb0 msgr2=0x7fa184037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.251+0000 7fa2bd6f4980 1 --2- 172.21.15.157:0/4249681849 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa184034bb0 0x7fa184037070 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4000c10 tx=0x7fa2a40a6000 comp rx=0 tx=0).stop 2024-05-09T09:49:28.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.251+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500ac762a0 msgr2=0x56500ac7d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.251+0000 7fa2bba10640 1 -- 172.21.15.157:0/4249681849 reap_dead start 2024-05-09T09:49:28.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.251+0000 7fa2bd6f4980 1 --2- 172.21.15.157:0/4249681849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500ac762a0 0x56500ac7d5b0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac047640 tx=0x7fa2ac014610 comp rx=0 tx=0).stop 2024-05-09T09:49:28.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 shutdown_connections 2024-05-09T09:49:28.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bd6f4980 1 --2- 172.21.15.157:0/4249681849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500ac762a0 0x56500ac7d5b0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 >> 172.21.15.157:0/4249681849 conn(0x56500ac725d0 msgr2=0x56500ac70600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:28.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 shutdown_connections 2024-05-09T09:49:28.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/4249681849 wait complete. 2024-05-09T09:49:28.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/602574245 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa194034bb0 msgr2=0x7fa194037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bd6f4980 1 --2- 172.21.15.157:0/602574245 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa194034bb0 0x7fa194037070 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40ae040 tx=0x7fa2a4005a10 comp rx=0 tx=0).stop 2024-05-09T09:49:28.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/602574245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500ac690d0 msgr2=0x56500ac694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bd6f4980 1 --2- 172.21.15.157:0/602574245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500ac690d0 0x56500ac694f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0066a0 tx=0x7fa2ac0116a0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/602574245 shutdown_connections 2024-05-09T09:49:28.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bd6f4980 1 --2- 172.21.15.157:0/602574245 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa194034bb0 0x7fa194037070 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bd6f4980 1 --2- 172.21.15.157:0/602574245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500ac690d0 0x56500ac694f0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/602574245 >> 172.21.15.157:0/602574245 conn(0x56500ac5dea0 msgr2=0x56500ac5e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:28.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/602574245 shutdown_connections 2024-05-09T09:49:28.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/602574245 wait complete. 2024-05-09T09:49:28.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/2569210892 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56500ac3c7a0 msgr2=0x56500ac3eb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bd6f4980 1 --2- 172.21.15.157:0/2569210892 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56500ac3c7a0 0x56500ac3eb90 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/2569210892 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56500ab450b0 msgr2=0x56500ac39e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bd6f4980 1 --2- 172.21.15.157:0/2569210892 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56500ab450b0 0x56500ac39e30 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/2569210892 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56500ac406a0 msgr2=0x56500ac42a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bd6f4980 1 --2- 172.21.15.157:0/2569210892 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56500ac406a0 0x56500ac42a90 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/2569210892 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa1a0034bb0 msgr2=0x7fa1a0037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bd6f4980 1 --2- 172.21.15.157:0/2569210892 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa1a0034bb0 0x7fa1a0037070 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40ad000 tx=0x7fa2a40a5040 comp rx=0 tx=0).stop 2024-05-09T09:49:28.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/2569210892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500aab2a10 msgr2=0x56500ac32e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bd6f4980 1 --2- 172.21.15.157:0/2569210892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56500aab2a10 0x56500ac32e40 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0012f0 tx=0x7fa2ac001260 comp rx=0 tx=0).stop 2024-05-09T09:49:28.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bba10640 1 -- 172.21.15.157:0/2569210892 reap_dead start 2024-05-09T09:49:28.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/2569210892 shutdown_connections 2024-05-09T09:49:28.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/2569210892 >> 172.21.15.157:0/2569210892 conn(0x56500ab39070 msgr2=0x56500ac262f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:28.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/2569210892 shutdown_connections 2024-05-09T09:49:28.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.255+0000 7fa2bd6f4980 1 -- 172.21.15.157:0/2569210892 wait complete. 2024-05-09T09:49:28.266 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-09T09:49:28.233198Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:49:28.233178Z', 'tags': [], 'group_ids': []} 2024-05-09T09:49:28.266 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-09T09:49:28.233198Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:49:28.233178Z', 'tags': [], 'group_ids': []} 2024-05-09T09:49:28.266 ERROR:root:0 2024-05-09T09:49:28.267 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-09T09:49:28.273 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000006b505a09238a18-00663c9c28-4238-default', 'HostId': '4238-default-default'} 2024-05-09T09:49:28.273 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-05-09T09:49:28.286 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-09T09:49:28.286 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-05-09T09:49:28.304 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-05-09T09:49:28.304 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-05-09T09:49:28.325 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-05-09T09:49:28.326 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-05-09T09:49:28.337 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-05-09T09:49:28.337 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-09T09:49:28.341 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-09T09:49:28.342 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-05-09T09:49:28.346 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-09T09:49:28.347 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-09T09:49:28.347 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-09T09:49:28.347 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-05-09T09:49:28.381 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:49:28.381 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:49:28.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.379+0000 7f4e0ef99980 1 Processor -- start 2024-05-09T09:49:28.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.379+0000 7f4e0ef99980 1 -- start start 2024-05-09T09:49:28.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.379+0000 7f4e0ef99980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x563c5d58a990 0x563c5d58ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.379+0000 7f4e0ef99980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563c5d440440 con 0x563c5d58b2b0 2024-05-09T09:49:28.382 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.379+0000 7f4e0ef99980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x563c5d42b5f0 con 0x563c5d58a990 2024-05-09T09:49:28.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.383+0000 7f4e0c2b3640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x563c5d58b2b0 0x563c5d58bc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:45576/0 (socket says 172.21.15.157:45576) 2024-05-09T09:49:28.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.383+0000 7f4e0cab4640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x563c5d58a990 0x563c5d58ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.383+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/2724642004 learned_addr learned my addr 172.21.15.157:0/2724642004 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:49:28.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.383+0000 7f4e0bab2640 1 -- 172.21.15.157:0/2724642004 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2067419519 0 0) 0x563c5d440440 con 0x563c5d58b2b0 2024-05-09T09:49:28.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.383+0000 7f4e0bab2640 1 -- 172.21.15.157:0/2724642004 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4df8001e20 con 0x563c5d58b2b0 2024-05-09T09:49:28.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.383+0000 7f4e0cab4640 1 -- 172.21.15.157:0/2724642004 >> v1:172.21.15.110:6789/0 conn(0x563c5d58b2b0 legacy=0x563c5d58bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.384 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.383+0000 7f4e0cab4640 1 -- 172.21.15.157:0/2724642004 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c5d436990 con 0x563c5d58a990 2024-05-09T09:49:28.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.383+0000 7f4e0cab4640 1 --2- 172.21.15.157:0/2724642004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d58a990 0x563c5d58ad70 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4df400a480 tx=0x7f4df401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ef68d237d9662c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.383+0000 7f4e0bab2640 1 -- 172.21.15.157:0/2724642004 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df40b0070 con 0x563c5d58a990 2024-05-09T09:49:28.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.383+0000 7f4e0bab2640 1 -- 172.21.15.157:0/2724642004 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df40ab540 con 0x563c5d58a990 2024-05-09T09:49:28.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.383+0000 7f4e0bab2640 1 -- 172.21.15.157:0/2724642004 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df40ab820 con 0x563c5d58a990 2024-05-09T09:49:28.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.383+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2724642004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d58a990 msgr2=0x563c5d58ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.383+0000 7f4e0ef99980 1 --2- 172.21.15.157:0/2724642004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d58a990 0x563c5d58ad70 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4df400a480 tx=0x7f4df401b280 comp rx=0 tx=0).stop 2024-05-09T09:49:28.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.383+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2724642004 shutdown_connections 2024-05-09T09:49:28.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.383+0000 7f4e0ef99980 1 --2- 172.21.15.157:0/2724642004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d58a990 0x563c5d58ad70 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.383+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2724642004 >> 172.21.15.157:0/2724642004 conn(0x563c5d586260 msgr2=0x563c5d588680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:28.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.383+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2724642004 shutdown_connections 2024-05-09T09:49:28.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.383+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2724642004 wait complete. 2024-05-09T09:49:28.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.399+0000 7f4e0ef99980 1 Processor -- start 2024-05-09T09:49:28.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.399+0000 7f4e0ef99980 1 -- start start 2024-05-09T09:49:28.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.399+0000 7f4e0ef99980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d58a990 0x563c5d676030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.399+0000 7f4e0ef99980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563c5d48dfe0 con 0x563c5d58a990 2024-05-09T09:49:28.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.399+0000 7f4e0cab4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d58a990 0x563c5d676030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.399+0000 7f4e0cab4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d58a990 0x563c5d676030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39040/0 (socket says 172.21.15.157:39040) 2024-05-09T09:49:28.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.399+0000 7f4e0cab4640 1 -- 172.21.15.157:0/4218648267 learned_addr learned my addr 172.21.15.157:0/4218648267 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:28.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.399+0000 7f4e0cab4640 1 -- 172.21.15.157:0/4218648267 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c5d412ae0 con 0x563c5d58a990 2024-05-09T09:49:28.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.399+0000 7f4e0cab4640 1 --2- 172.21.15.157:0/4218648267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d58a990 0x563c5d676030 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f4df4018eb0 tx=0x7f4df4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8daff904814da5ae server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.399+0000 7f4cfae0d640 1 -- 172.21.15.157:0/4218648267 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df40b0040 con 0x563c5d58a990 2024-05-09T09:49:28.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.399+0000 7f4cfae0d640 1 -- 172.21.15.157:0/4218648267 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df40bc070 con 0x563c5d58a990 2024-05-09T09:49:28.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.399+0000 7f4cfae0d640 1 -- 172.21.15.157:0/4218648267 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df40acb10 con 0x563c5d58a990 2024-05-09T09:49:28.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.399+0000 7f4e0ef99980 1 -- 172.21.15.157:0/4218648267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d58a990 msgr2=0x563c5d676030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.403 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.399+0000 7f4e0ef99980 1 --2- 172.21.15.157:0/4218648267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d58a990 0x563c5d676030 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f4df4018eb0 tx=0x7f4df4003030 comp rx=0 tx=0).stop 2024-05-09T09:49:28.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.399+0000 7f4e0ef99980 1 -- 172.21.15.157:0/4218648267 shutdown_connections 2024-05-09T09:49:28.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.399+0000 7f4e0ef99980 1 --2- 172.21.15.157:0/4218648267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d58a990 0x563c5d676030 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.399+0000 7f4e0ef99980 1 -- 172.21.15.157:0/4218648267 >> 172.21.15.157:0/4218648267 conn(0x563c5d586260 msgr2=0x563c5d671bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:28.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.399+0000 7f4e0ef99980 1 -- 172.21.15.157:0/4218648267 shutdown_connections 2024-05-09T09:49:28.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.399+0000 7f4e0ef99980 1 -- 172.21.15.157:0/4218648267 wait complete. 2024-05-09T09:49:28.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.399+0000 7f4e0ef99980 1 Processor -- start 2024-05-09T09:49:28.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.399+0000 7f4e0ef99980 1 -- start start 2024-05-09T09:49:28.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.403+0000 7f4e0ef99980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d58a990 0x563c5d67d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.403+0000 7f4e0ef99980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563c5d594990 con 0x563c5d58a990 2024-05-09T09:49:28.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.403+0000 7f4e0cab4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d58a990 0x563c5d67d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.403+0000 7f4e0cab4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d58a990 0x563c5d67d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39042/0 (socket says 172.21.15.157:39042) 2024-05-09T09:49:28.404 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.403+0000 7f4e0cab4640 1 -- 172.21.15.157:0/2033215394 learned_addr learned my addr 172.21.15.157:0/2033215394 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:28.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.403+0000 7f4e0cab4640 1 -- 172.21.15.157:0/2033215394 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c5d67d670 con 0x563c5d58a990 2024-05-09T09:49:28.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.403+0000 7f4e0cab4640 1 --2- 172.21.15.157:0/2033215394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d58a990 0x563c5d67d130 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f4df4018eb0 tx=0x7f4df4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.403+0000 7f4cf960a640 1 -- 172.21.15.157:0/2033215394 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df40b0040 con 0x563c5d58a990 2024-05-09T09:49:28.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.403+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2033215394 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563c5d67d900 con 0x563c5d58a990 2024-05-09T09:49:28.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.403+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2033215394 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c5d680590 con 0x563c5d58a990 2024-05-09T09:49:28.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.403+0000 7f4cf960a640 1 -- 172.21.15.157:0/2033215394 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df40b6870 con 0x563c5d58a990 2024-05-09T09:49:28.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.403+0000 7f4cf960a640 1 -- 172.21.15.157:0/2033215394 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df40b6b50 con 0x563c5d58a990 2024-05-09T09:49:28.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.403+0000 7f4cf960a640 1 -- 172.21.15.157:0/2033215394 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f4df40c8020 con 0x563c5d58a990 2024-05-09T09:49:28.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.403+0000 7f4cf960a640 1 --2- 172.21.15.157:0/2033215394 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4cf4034bb0 0x7f4cf4037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.403+0000 7f4cf960a640 1 -- 172.21.15.157:0/2033215394 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f4df40a8070 con 0x563c5d58a990 2024-05-09T09:49:28.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.403+0000 7f4e0c2b3640 1 --2- 172.21.15.157:0/2033215394 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4cf4034bb0 0x7f4cf4037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.403+0000 7f4e0ef99980 1 --2- 172.21.15.157:0/2033215394 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563c5d58b2b0 0x563c5d684070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.403+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2033215394 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6846b0 con 0x563c5d58b2b0 2024-05-09T09:49:28.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.403+0000 7f4e0d2b5640 1 --2- 172.21.15.157:0/2033215394 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563c5d58b2b0 0x563c5d684070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.403+0000 7f4e0c2b3640 1 --2- 172.21.15.157:0/2033215394 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4cf4034bb0 0x7f4cf4037070 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0012f0 tx=0x7f4dfc001430 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.403+0000 7f4e0d2b5640 1 --2- 172.21.15.157:0/2033215394 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563c5d58b2b0 0x563c5d684070 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.403+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/2033215394 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e040083f0 con 0x563c5d58b2b0 2024-05-09T09:49:28.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.403+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2033215394 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c5d681790 con 0x563c5d58b2b0 2024-05-09T09:49:28.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.407+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/2033215394 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4e040083f0 con 0x563c5d58b2b0 2024-05-09T09:49:28.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.407+0000 7f4e0ef99980 1 --2- 172.21.15.157:0/2033215394 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563c5d6869e0 0x563c5d688dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.407+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2033215394 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6894a0 con 0x563c5d6869e0 2024-05-09T09:49:28.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.407+0000 7f4e0cab4640 1 --2- 172.21.15.157:0/2033215394 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563c5d6869e0 0x563c5d688dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.407+0000 7f4e0cab4640 1 --2- 172.21.15.157:0/2033215394 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563c5d6869e0 0x563c5d688dd0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.407+0000 7f4e0cab4640 1 -- 172.21.15.157:0/2033215394 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4df40b3040 con 0x563c5d6869e0 2024-05-09T09:49:28.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.407+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2033215394 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c5d685880 con 0x563c5d58b2b0 2024-05-09T09:49:28.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.407+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/2033215394 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4e040083f0 con 0x563c5d58b2b0 2024-05-09T09:49:28.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.407+0000 7f4e0ef99980 1 --2- 172.21.15.157:0/2033215394 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563c5d68a8e0 0x563c5d68ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.407+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2033215394 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c5d68d460 con 0x563c5d68a8e0 2024-05-09T09:49:28.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.407+0000 7f4e0c2b3640 1 --2- 172.21.15.157:0/2033215394 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563c5d68a8e0 0x563c5d68ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.407+0000 7f4e0c2b3640 1 --2- 172.21.15.157:0/2033215394 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563c5d68a8e0 0x563c5d68ccd0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.407+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/2033215394 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4dfc00f070 con 0x563c5d68a8e0 2024-05-09T09:49:28.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.411+0000 7f4e0ef99980 1 Processor -- start 2024-05-09T09:49:28.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.411+0000 7f4e0ef99980 1 -- start start 2024-05-09T09:49:28.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.411+0000 7f4e0ef99980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d6b34a0 0x563c5d6b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.411+0000 7f4e0ef99980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563c5d492020 con 0x563c5d6b34a0 2024-05-09T09:49:28.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.411+0000 7f4e0cab4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d6b34a0 0x563c5d6b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.411+0000 7f4e0cab4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d6b34a0 0x563c5d6b38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39050/0 (socket says 172.21.15.157:39050) 2024-05-09T09:49:28.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.411+0000 7f4e0cab4640 1 -- 172.21.15.157:0/2832999535 learned_addr learned my addr 172.21.15.157:0/2832999535 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:28.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.411+0000 7f4e0cab4640 1 -- 172.21.15.157:0/2832999535 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c5d6b3e00 con 0x563c5d6b34a0 2024-05-09T09:49:28.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.411+0000 7f4e0cab4640 1 --2- 172.21.15.157:0/2832999535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d6b34a0 0x563c5d6b38c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f4df40e3790 tx=0x7f4df40a6db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.411+0000 7f4cf139f640 1 -- 172.21.15.157:0/2832999535 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df40ea070 con 0x563c5d6b34a0 2024-05-09T09:49:28.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.411+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2832999535 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563c5d6b4890 con 0x563c5d6b34a0 2024-05-09T09:49:28.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.411+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2832999535 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c5d6b4d70 con 0x563c5d6b34a0 2024-05-09T09:49:28.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.411+0000 7f4cf139f640 1 -- 172.21.15.157:0/2832999535 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df40e3870 con 0x563c5d6b34a0 2024-05-09T09:49:28.415 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.411+0000 7f4cf139f640 1 -- 172.21.15.157:0/2832999535 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df40e3b50 con 0x563c5d6b34a0 2024-05-09T09:49:28.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.415+0000 7f4cf139f640 1 -- 172.21.15.157:0/2832999535 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f4df40ed070 con 0x563c5d6b34a0 2024-05-09T09:49:28.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.415+0000 7f4cf139f640 1 --2- 172.21.15.157:0/2832999535 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4ce4034bb0 0x7f4ce4037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.415+0000 7f4cf139f640 1 -- 172.21.15.157:0/2832999535 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f4df40e1030 con 0x563c5d6b34a0 2024-05-09T09:49:28.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.415+0000 7f4e0c2b3640 1 --2- 172.21.15.157:0/2832999535 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4ce4034bb0 0x7f4ce4037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.415+0000 7f4e0ef99980 1 Processor -- start 2024-05-09T09:49:28.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.415+0000 7f4e0ef99980 1 -- start start 2024-05-09T09:49:28.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.415+0000 7f4e0ef99980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d6c04f0 0x563c5d6c0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.415+0000 7f4e0ef99980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563c5d6766c0 con 0x563c5d6c04f0 2024-05-09T09:49:28.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.415+0000 7f4e0c2b3640 1 --2- 172.21.15.157:0/2832999535 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4ce4034bb0 0x7f4ce4037070 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc006300 tx=0x7f4dfc00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.415+0000 7f4e0cab4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d6c04f0 0x563c5d6c0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.415+0000 7f4e0cab4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d6c04f0 0x563c5d6c0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39062/0 (socket says 172.21.15.157:39062) 2024-05-09T09:49:28.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.415+0000 7f4e0cab4640 1 -- 172.21.15.157:0/2384556756 learned_addr learned my addr 172.21.15.157:0/2384556756 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:28.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.415+0000 7f4e0cab4640 1 -- 172.21.15.157:0/2384556756 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c5d6c0ee0 con 0x563c5d6c04f0 2024-05-09T09:49:28.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.415+0000 7f4e0cab4640 1 --2- 172.21.15.157:0/2384556756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d6c04f0 0x563c5d6c0910 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4df40defd0 tx=0x7f4df40ee650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=343d15225b7bcb4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.415+0000 7f4ceaffd640 1 -- 172.21.15.157:0/2384556756 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df40c20d0 con 0x563c5d6c04f0 2024-05-09T09:49:28.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.415+0000 7f4ceaffd640 1 -- 172.21.15.157:0/2384556756 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df40bf590 con 0x563c5d6c04f0 2024-05-09T09:49:28.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.415+0000 7f4ceaffd640 1 -- 172.21.15.157:0/2384556756 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df40d29f0 con 0x563c5d6c04f0 2024-05-09T09:49:28.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.415+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2384556756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d6c04f0 msgr2=0x563c5d6c0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.415+0000 7f4e0ef99980 1 --2- 172.21.15.157:0/2384556756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d6c04f0 0x563c5d6c0910 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4df40defd0 tx=0x7f4df40ee650 comp rx=0 tx=0).stop 2024-05-09T09:49:28.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.415+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2384556756 shutdown_connections 2024-05-09T09:49:28.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.415+0000 7f4e0ef99980 1 --2- 172.21.15.157:0/2384556756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d6c04f0 0x563c5d6c0910 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.415+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2384556756 >> 172.21.15.157:0/2384556756 conn(0x563c5d6bc8c0 msgr2=0x563c5d6ba920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:28.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.415+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2384556756 shutdown_connections 2024-05-09T09:49:28.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.415+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2384556756 wait complete. 2024-05-09T09:49:28.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.419+0000 7f4e0ef99980 1 Processor -- start 2024-05-09T09:49:28.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.419+0000 7f4e0ef99980 1 -- start start 2024-05-09T09:49:28.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.419+0000 7f4e0ef99980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d6c04f0 0x563c5d6c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.419+0000 7f4e0ef99980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x563c5d6c0ee0 con 0x563c5d6c04f0 2024-05-09T09:49:28.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.419+0000 7f4e0cab4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d6c04f0 0x563c5d6c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.419+0000 7f4e0cab4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d6c04f0 0x563c5d6c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39074/0 (socket says 172.21.15.157:39074) 2024-05-09T09:49:28.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.419+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 learned_addr learned my addr 172.21.15.157:0/3754536629 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:28.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.419+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c5d6c7c50 con 0x563c5d6c04f0 2024-05-09T09:49:28.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.419+0000 7f4e0cab4640 1 --2- 172.21.15.157:0/3754536629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d6c04f0 0x563c5d6c7710 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f4df40d8fd0 tx=0x7f4df40dfeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.419+0000 7f4ce97fa640 1 -- 172.21.15.157:0/3754536629 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df410b070 con 0x563c5d6c04f0 2024-05-09T09:49:28.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.419+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563c5d6c7c50 con 0x563c5d6c04f0 2024-05-09T09:49:28.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.419+0000 7f4ce97fa640 1 -- 172.21.15.157:0/3754536629 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df40c0d00 con 0x563c5d6c04f0 2024-05-09T09:49:28.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.419+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c5d6c80d0 con 0x563c5d6c04f0 2024-05-09T09:49:28.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.419+0000 7f4ce97fa640 1 -- 172.21.15.157:0/3754536629 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df40d36e0 con 0x563c5d6c04f0 2024-05-09T09:49:28.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.419+0000 7f4ce97fa640 1 -- 172.21.15.157:0/3754536629 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f4df4104040 con 0x563c5d6c04f0 2024-05-09T09:49:28.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.419+0000 7f4ce97fa640 1 --2- 172.21.15.157:0/3754536629 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4cd4034bb0 0x7f4cd4037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.419+0000 7f4e0c2b3640 1 --2- 172.21.15.157:0/3754536629 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4cd4034bb0 0x7f4cd4037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.419+0000 7f4ce97fa640 1 -- 172.21.15.157:0/3754536629 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f4df40efd40 con 0x563c5d6c04f0 2024-05-09T09:49:28.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.419+0000 7f4e0ef99980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.419+0000 7f4e0ef99980 1 --2- 172.21.15.157:0/3754536629 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563c5d6d4150 0x563c5d6d6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.419+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d6d60 con 0x563c5d6d4150 2024-05-09T09:49:28.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.419+0000 7f4e0d2b5640 1 --2- 172.21.15.157:0/3754536629 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563c5d6d4150 0x563c5d6d6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.419+0000 7f4e0c2b3640 1 --2- 172.21.15.157:0/3754536629 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4cd4034bb0 0x7f4cd4037070 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x563c5d68d860 tx=0x7f4dfc010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.419+0000 7f4e0d2b5640 1 --2- 172.21.15.157:0/3754536629 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563c5d6d4150 0x563c5d6d6610 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.419+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e040083f0 con 0x563c5d6d4150 2024-05-09T09:49:28.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0ef99980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0ef99980 20 realm 2024-05-09T09:49:28.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0ef99980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7170 con 0x563c5d6d4150 2024-05-09T09:49:28.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e040083f0 con 0x563c5d6d4150 2024-05-09T09:49:28.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0ef99980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0ef99980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:49:28.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0ef99980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7a40 con 0x563c5d6d4150 2024-05-09T09:49:28.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e040083f0 con 0x563c5d6d4150 2024-05-09T09:49:28.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0ef99980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0ef99980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x563c5d6d4150 2024-05-09T09:49:28.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4e040083f0 con 0x563c5d6d4150 2024-05-09T09:49:28.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0ef99980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:28.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0ef99980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0ef99980 1 --2- 172.21.15.157:0/3754536629 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563c5d6d8b40 0x563c5d6daf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6db540 con 0x563c5d6d8b40 2024-05-09T09:49:28.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0cab4640 1 --2- 172.21.15.157:0/3754536629 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563c5d6d8b40 0x563c5d6daf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0cab4640 1 --2- 172.21.15.157:0/3754536629 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563c5d6d8b40 0x563c5d6daf30 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4df40fa070 con 0x563c5d6d8b40 2024-05-09T09:49:28.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0ef99980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:49:28.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0ef99980 20 searching for the correct realm 2024-05-09T09:49:28.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0ef99980 1 --2- 172.21.15.157:0/3754536629 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563c5d6dd490 0x563c5d6df8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6dffb0 con 0x563c5d6dd490 2024-05-09T09:49:28.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0c2b3640 1 --2- 172.21.15.157:0/3754536629 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563c5d6dd490 0x563c5d6df8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0c2b3640 1 --2- 172.21.15.157:0/3754536629 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563c5d6dd490 0x563c5d6df8e0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dfc00f070 con 0x563c5d6dd490 2024-05-09T09:49:28.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0c2b3640 1 --2- 172.21.15.157:0/3754536629 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f4dfc024070 0x7f4dfc031460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6dffb0 con 0x7f4dfc024070 2024-05-09T09:49:28.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0d2b5640 1 --2- 172.21.15.157:0/3754536629 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f4dfc024070 0x7f4dfc031460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0d2b5640 1 --2- 172.21.15.157:0/3754536629 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f4dfc024070 0x7f4dfc031460 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e040083f0 con 0x7f4dfc024070 2024-05-09T09:49:28.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.423+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x563c5d6d8b40 2024-05-09T09:49:28.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.427+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df40fa070 con 0x563c5d6d8b40 2024-05-09T09:49:28.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.427+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x563c5d6d4150 2024-05-09T09:49:28.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.427+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e040083f0 con 0x563c5d6d4150 2024-05-09T09:49:28.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.427+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x563c5d6d4150 2024-05-09T09:49:28.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.427+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e04026040 con 0x563c5d6d4150 2024-05-09T09:49:28.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.427+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x563c5d6d8b40 2024-05-09T09:49:28.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.427+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df40fa070 con 0x563c5d6d8b40 2024-05-09T09:49:28.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.427+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x563c5d6d8b40 2024-05-09T09:49:28.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.427+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df40fa070 con 0x563c5d6d8b40 2024-05-09T09:49:28.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.427+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x7f4dfc024070 2024-05-09T09:49:28.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.427+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e04026040 con 0x7f4dfc024070 2024-05-09T09:49:28.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.427+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x563c5d6dd490 2024-05-09T09:49:28.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.427+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dfc00f070 con 0x563c5d6dd490 2024-05-09T09:49:28.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.427+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x563c5d6d4150 2024-05-09T09:49:28.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.427+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e04026040 con 0x563c5d6d4150 2024-05-09T09:49:28.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.427+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x563c5d6d8b40 2024-05-09T09:49:28.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.427+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df40fa070 con 0x563c5d6d8b40 2024-05-09T09:49:28.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.427+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x563c5d6d4150 2024-05-09T09:49:28.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.427+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e04026040 con 0x563c5d6d4150 2024-05-09T09:49:28.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.427+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x7f4dfc024070 2024-05-09T09:49:28.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.431+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4e04026040 con 0x7f4dfc024070 2024-05-09T09:49:28.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.431+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x563c5d6dd490 2024-05-09T09:49:28.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.431+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dfc040040 con 0x563c5d6dd490 2024-05-09T09:49:28.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.431+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x563c5d6dd490 2024-05-09T09:49:28.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.431+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4dfc040040 con 0x563c5d6dd490 2024-05-09T09:49:28.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.431+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x563c5d6d8b40 2024-05-09T09:49:28.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.431+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df40fa070 con 0x563c5d6d8b40 2024-05-09T09:49:28.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.431+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x563c5d6dd490 2024-05-09T09:49:28.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.431+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dfc040040 con 0x563c5d6dd490 2024-05-09T09:49:28.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.431+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x563c5d6dd490 2024-05-09T09:49:28.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.431+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dfc040040 con 0x563c5d6dd490 2024-05-09T09:49:28.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.431+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x563c5d6d4150 2024-05-09T09:49:28.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.431+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e04026040 con 0x563c5d6d4150 2024-05-09T09:49:28.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.431+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x563c5d6d4150 2024-05-09T09:49:28.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.431+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4e04026040 con 0x563c5d6d4150 2024-05-09T09:49:28.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.431+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x563c5d6d8b40 2024-05-09T09:49:28.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.431+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df40fa070 con 0x563c5d6d8b40 2024-05-09T09:49:28.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.431+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x563c5d6dd490 2024-05-09T09:49:28.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.431+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dfc040040 con 0x563c5d6dd490 2024-05-09T09:49:28.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.431+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x7f4dfc024070 2024-05-09T09:49:28.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.431+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e04026040 con 0x7f4dfc024070 2024-05-09T09:49:28.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.431+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x563c5d6d4150 2024-05-09T09:49:28.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.431+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e04026040 con 0x563c5d6d4150 2024-05-09T09:49:28.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.431+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x563c5d6d8b40 2024-05-09T09:49:28.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4df40fa070 con 0x563c5d6d8b40 2024-05-09T09:49:28.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x563c5d6dd490 2024-05-09T09:49:28.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dfc040040 con 0x563c5d6dd490 2024-05-09T09:49:28.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x563c5d6d8b40 2024-05-09T09:49:28.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df40fa070 con 0x563c5d6d8b40 2024-05-09T09:49:28.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x7f4dfc024070 2024-05-09T09:49:28.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e04026040 con 0x7f4dfc024070 2024-05-09T09:49:28.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x563c5d6dd490 2024-05-09T09:49:28.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dfc040040 con 0x563c5d6dd490 2024-05-09T09:49:28.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x563c5d6d8b40 2024-05-09T09:49:28.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df40fa070 con 0x563c5d6d8b40 2024-05-09T09:49:28.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x563c5d6d4150 2024-05-09T09:49:28.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4e04026040 con 0x563c5d6d4150 2024-05-09T09:49:28.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6d7de0 con 0x7f4dfc024070 2024-05-09T09:49:28.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e04026040 con 0x7f4dfc024070 2024-05-09T09:49:28.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0ef99980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:49:28.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0ef99980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:49:28.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0ef99980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:49:28.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0ef99980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:49:28.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0ef99980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:49:28.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0ef99980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:49:28.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0ef99980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6dbe00 con 0x563c5d6d4150 2024-05-09T09:49:28.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e04026040 con 0x563c5d6d4150 2024-05-09T09:49:28.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0ef99980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0ef99980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6dbe00 con 0x563c5d6d4150 2024-05-09T09:49:28.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4e04026040 con 0x563c5d6d4150 2024-05-09T09:49:28.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0ef99980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:28.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0ef99980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6dbe00 con 0x563c5d6dd490 2024-05-09T09:49:28.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.435+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4dfc040040 con 0x563c5d6dd490 2024-05-09T09:49:28.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.439+0000 7f4e0ef99980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:49:28.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.439+0000 7f4e0ef99980 20 zone default found 2024-05-09T09:49:28.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.439+0000 7f4e0ef99980 4 Realm: () 2024-05-09T09:49:28.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.439+0000 7f4e0ef99980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:49:28.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.439+0000 7f4e0ef99980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:49:28.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.439+0000 7f4e0ef99980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:49:28.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.439+0000 7f4e0ef99980 20 zonegroup default 2024-05-09T09:49:28.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.439+0000 7f4e0ef99980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.439+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6dc820 con 0x563c5d6d8b40 2024-05-09T09:49:28.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.439+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4df40fa070 con 0x563c5d6d8b40 2024-05-09T09:49:28.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.439+0000 7f4e0ef99980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.439+0000 7f4e0ef99980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.439+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6e22c0 con 0x563c5d6dd490 2024-05-09T09:49:28.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.439+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4dfc040040 con 0x563c5d6dd490 2024-05-09T09:49:28.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.439+0000 7f4e0ef99980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.439+0000 7f4e0ef99980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.439+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6e2660 con 0x563c5d6dd490 2024-05-09T09:49:28.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.439+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4dfc040040 con 0x563c5d6dd490 2024-05-09T09:49:28.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.439+0000 7f4e0ef99980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.452 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.439+0000 7f4e0ef99980 20 started sync module instance, tier type = 2024-05-09T09:49:28.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.439+0000 7f4e0ef99980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:49:28.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.439+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6e1700 con 0x7f4dfc024070 2024-05-09T09:49:28.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.439+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e04026040 con 0x7f4dfc024070 2024-05-09T09:49:28.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.439+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94817265523712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6e1700 con 0x7f4dfc024070 2024-05-09T09:49:28.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.439+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6e2f30 con 0x563c5d6d4150 2024-05-09T09:49:28.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.439+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94817265523712] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e04036040 con 0x7f4dfc024070 2024-05-09T09:49:28.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.443+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e04036040 con 0x563c5d6d4150 2024-05-09T09:49:28.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.443+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94817265527296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6e1700 con 0x563c5d6d4150 2024-05-09T09:49:28.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.443+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6e3940 con 0x563c5d6dd490 2024-05-09T09:49:28.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.443+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dfc040040 con 0x563c5d6dd490 2024-05-09T09:49:28.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.443+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94817265530000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6e41e0 con 0x563c5d6dd490 2024-05-09T09:49:28.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.443+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6e4c00 con 0x7f4dfc024070 2024-05-09T09:49:28.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.443+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94817265527296] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e04036040 con 0x563c5d6d4150 2024-05-09T09:49:28.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.443+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e04036040 con 0x7f4dfc024070 2024-05-09T09:49:28.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.443+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94817265534704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6e4ff0 con 0x7f4dfc024070 2024-05-09T09:49:28.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.443+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6e59b0 con 0x563c5d6d4150 2024-05-09T09:49:28.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.447+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94817265530000] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dfc040040 con 0x563c5d6dd490 2024-05-09T09:49:28.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.447+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94817265534704] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e04036040 con 0x7f4dfc024070 2024-05-09T09:49:28.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.447+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e04036040 con 0x563c5d6d4150 2024-05-09T09:49:28.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.447+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94817265521232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6e5500 con 0x563c5d6d4150 2024-05-09T09:49:28.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.447+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6e5d50 con 0x563c5d6d8b40 2024-05-09T09:49:28.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.447+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94817265521232] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e04036040 con 0x563c5d6d4150 2024-05-09T09:49:28.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.447+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df40fa070 con 0x563c5d6d8b40 2024-05-09T09:49:28.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.447+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94817265538304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6e5920 con 0x563c5d6d8b40 2024-05-09T09:49:28.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.447+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6e6a50 con 0x563c5d6d8b40 2024-05-09T09:49:28.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.451+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94817265538304] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df40fa070 con 0x563c5d6d8b40 2024-05-09T09:49:28.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.451+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df40fa070 con 0x563c5d6d8b40 2024-05-09T09:49:28.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.451+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94817265541840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6e6e40 con 0x563c5d6d8b40 2024-05-09T09:49:28.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.451+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6e7880 con 0x563c5d6d8b40 2024-05-09T09:49:28.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.455+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94817265541840] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df40fa070 con 0x563c5d6d8b40 2024-05-09T09:49:28.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.455+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df40fa070 con 0x563c5d6d8b40 2024-05-09T09:49:28.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.455+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94817265546064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6e7840 con 0x563c5d6d8b40 2024-05-09T09:49:28.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.455+0000 7f4e0ef99980 20 add_watcher() i=0 2024-05-09T09:49:28.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.455+0000 7f4e0ef99980 20 add_watcher() i=1 2024-05-09T09:49:28.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.455+0000 7f4e0ef99980 20 add_watcher() i=2 2024-05-09T09:49:28.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.455+0000 7f4e0ef99980 20 add_watcher() i=3 2024-05-09T09:49:28.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.455+0000 7f4e0ef99980 20 add_watcher() i=4 2024-05-09T09:49:28.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.455+0000 7f4e0ef99980 20 add_watcher() i=5 2024-05-09T09:49:28.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.455+0000 7f4e0ef99980 20 add_watcher() i=6 2024-05-09T09:49:28.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.455+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94817265546064] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df40fa070 con 0x563c5d6d8b40 2024-05-09T09:49:28.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.455+0000 7f4e0ef99980 20 add_watcher() i=7 2024-05-09T09:49:28.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.455+0000 7f4e0ef99980 2 all 8 watchers are set, enabling cache 2024-05-09T09:49:28.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.455+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6ead60 con 0x563c5d6d4150 2024-05-09T09:49:28.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.455+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4e04036040 con 0x563c5d6d4150 2024-05-09T09:49:28.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.455+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94817265542992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6e8220 con 0x563c5d6d4150 2024-05-09T09:49:28.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.459+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94817265542992] v32'430 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4e04036040 con 0x563c5d6d4150 2024-05-09T09:49:28.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.459+0000 7f4cc1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:28.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.459+0000 7f4e0ef99980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:49:28.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.459+0000 7f4e0ef99980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:49:28.460 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.459+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6eab10 con 0x563c5d6d4150 2024-05-09T09:49:28.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.459+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'99 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4e04036040 con 0x563c5d6d4150 2024-05-09T09:49:28.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.459+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6eab10 con 0x563c5d6d8b40 2024-05-09T09:49:28.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.463+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'94 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4df40fa070 con 0x563c5d6d8b40 2024-05-09T09:49:28.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.463+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f61a0 con 0x563c5d6dd490 2024-05-09T09:49:28.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.463+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'93 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4dfc040040 con 0x563c5d6dd490 2024-05-09T09:49:28.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.463+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f69f0 con 0x563c5d6d4150 2024-05-09T09:49:28.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.463+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'431 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4e04036040 con 0x563c5d6d4150 2024-05-09T09:49:28.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.463+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f5810 con 0x7f4dfc024070 2024-05-09T09:49:28.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.463+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'266 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4e04036040 con 0x7f4dfc024070 2024-05-09T09:49:28.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.467+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f5810 con 0x563c5d6dd490 2024-05-09T09:49:28.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.467+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'178 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4dfc040040 con 0x563c5d6dd490 2024-05-09T09:49:28.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.467+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f7720 con 0x563c5d6d4150 2024-05-09T09:49:28.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.467+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'94 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4e04036040 con 0x563c5d6d4150 2024-05-09T09:49:28.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.467+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f7720 con 0x563c5d6d8b40 2024-05-09T09:49:28.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.471+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'177 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4df40fa070 con 0x563c5d6d8b40 2024-05-09T09:49:28.472 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.471+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f7720 con 0x7f4dfc024070 2024-05-09T09:49:28.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.471+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'92 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4e04036040 con 0x7f4dfc024070 2024-05-09T09:49:28.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.471+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f7720 con 0x563c5d6dd490 2024-05-09T09:49:28.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.471+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'98 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4dfc040040 con 0x563c5d6dd490 2024-05-09T09:49:28.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.475+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f7a00 con 0x7f4dfc024070 2024-05-09T09:49:28.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.475+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'267 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e04036040 con 0x7f4dfc024070 2024-05-09T09:49:28.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.475+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f7a00 con 0x563c5d6d8b40 2024-05-09T09:49:28.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.475+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'98 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4df40fa070 con 0x563c5d6d8b40 2024-05-09T09:49:28.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.475+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f7a00 con 0x7f4dfc024070 2024-05-09T09:49:28.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.479+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'92 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e04036040 con 0x7f4dfc024070 2024-05-09T09:49:28.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.479+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f7a00 con 0x563c5d6d8b40 2024-05-09T09:49:28.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.479+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'183 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4df40fa070 con 0x563c5d6d8b40 2024-05-09T09:49:28.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.479+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f7a00 con 0x563c5d6d4150 2024-05-09T09:49:28.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.483+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'432 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e04036040 con 0x563c5d6d4150 2024-05-09T09:49:28.483 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.483+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f7a00 con 0x563c5d6dd490 2024-05-09T09:49:28.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.483+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'260 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dfc040040 con 0x563c5d6dd490 2024-05-09T09:49:28.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.483+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f7a00 con 0x7f4dfc024070 2024-05-09T09:49:28.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.483+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'268 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e04036040 con 0x7f4dfc024070 2024-05-09T09:49:28.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.483+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f7a00 con 0x563c5d6dd490 2024-05-09T09:49:28.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.487+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'92 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dfc040040 con 0x563c5d6dd490 2024-05-09T09:49:28.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.487+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f7a90 con 0x563c5d6d4150 2024-05-09T09:49:28.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.487+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'100 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e04036040 con 0x563c5d6d4150 2024-05-09T09:49:28.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.487+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f7a90 con 0x563c5d6d4150 2024-05-09T09:49:28.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.487+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'433 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e04036040 con 0x563c5d6d4150 2024-05-09T09:49:28.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.487+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f7a90 con 0x563c5d6dd490 2024-05-09T09:49:28.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.491+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'261 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dfc040040 con 0x563c5d6dd490 2024-05-09T09:49:28.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.491+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f7a90 con 0x7f4dfc024070 2024-05-09T09:49:28.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.491+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'104 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e04036040 con 0x7f4dfc024070 2024-05-09T09:49:28.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.491+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f7a00 con 0x563c5d6dd490 2024-05-09T09:49:28.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.495+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'94 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dfc040040 con 0x563c5d6dd490 2024-05-09T09:49:28.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.495+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f7a00 con 0x563c5d6dd490 2024-05-09T09:49:28.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.495+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'98 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dfc040040 con 0x563c5d6dd490 2024-05-09T09:49:28.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.495+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f7a00 con 0x563c5d6dd490 2024-05-09T09:49:28.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.495+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'89 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dfc040040 con 0x563c5d6dd490 2024-05-09T09:49:28.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.495+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f7a00 con 0x563c5d6dd490 2024-05-09T09:49:28.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.495+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'179 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dfc040040 con 0x563c5d6dd490 2024-05-09T09:49:28.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.499+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f7a00 con 0x563c5d6d8b40 2024-05-09T09:49:28.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.499+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'94 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4df40fa070 con 0x563c5d6d8b40 2024-05-09T09:49:28.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.499+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f7a00 con 0x563c5d6dd490 2024-05-09T09:49:28.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.499+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'93 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dfc040040 con 0x563c5d6dd490 2024-05-09T09:49:28.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.499+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f7a00 con 0x563c5d6d8b40 2024-05-09T09:49:28.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.503+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'178 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4df40fa070 con 0x563c5d6d8b40 2024-05-09T09:49:28.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.503+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f7a00 con 0x563c5d6dd490 2024-05-09T09:49:28.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.503+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'262 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dfc040040 con 0x563c5d6dd490 2024-05-09T09:49:28.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.507+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f7a00 con 0x563c5d6d8b40 2024-05-09T09:49:28.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.507+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'184 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4df40fa070 con 0x563c5d6d8b40 2024-05-09T09:49:28.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.507+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f7a00 con 0x7f4dfc024070 2024-05-09T09:49:28.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.511+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'98 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4e04036040 con 0x7f4dfc024070 2024-05-09T09:49:28.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.511+0000 7f4cc0fe1640 20 reqs_thread_entry: start 2024-05-09T09:49:28.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.511+0000 7f4e0ef99980 20 init_complete bucket index max shards: 11 2024-05-09T09:49:28.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.511+0000 7f4c3a7fc640 20 reqs_thread_entry: start 2024-05-09T09:49:28.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.511+0000 7f4e0ef99980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-09T09:49:28.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.511+0000 7f4e0ef99980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.511+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:94 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c5d7136a0 con 0x563c5d6d8b40 2024-05-09T09:49:28.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.511+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(94 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f4df40fa070 con 0x563c5d6d8b40 2024-05-09T09:49:28.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.511+0000 7f4e0ef99980 20 rados_obj.operate() r=0 bl.length=473 2024-05-09T09:49:28.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.511+0000 7f4e0ef99980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-09T09:49:28.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.511+0000 7f4e0ef99980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:28.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.511+0000 7f4e0ef99980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:49:28.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.511+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:95 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d719c40 con 0x563c5d6d8b40 2024-05-09T09:49:28.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.515+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(95 ada [delete,create,call,call,writefull 0~460] v32'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f4df40fa070 con 0x563c5d6d8b40 2024-05-09T09:49:28.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.515+0000 7f4e0ef99980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-09T09:49:28.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.515+0000 7f4e0ef99980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:28.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.515+0000 7f4e0ef99980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-09T09:49:28.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.515+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 7.d 7:b4812045:::notify.4:head [notify cookie 94817265751728 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563c5d7152f0 con 0x563c5d6d4150 2024-05-09T09:49:28.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.515+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== watch-notify(notify (1) cookie 94817265521232 notify 137438953505 ret 0) ==== 678+0+0 (crc 0 0 0) 0x563c5d6f5530 con 0x563c5d6d4150 2024-05-09T09:49:28.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.515+0000 7f4ceaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953505 cookie 94817265521232 notifier 4845 bl.length()=636 2024-05-09T09:49:28.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.515+0000 7f4ceaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-09T09:49:28.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.515+0000 7f4ceaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:28.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.515+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(96 notify.4 [notify cookie 94817265751728 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4e04036040 con 0x563c5d6d4150 2024-05-09T09:49:28.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.515+0000 7f4ceaffd640 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4cd00056c0 con 0x563c5d6d4150 2024-05-09T09:49:28.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.515+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(97 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e04036040 con 0x563c5d6d4150 2024-05-09T09:49:28.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.515+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== watch-notify(notify_complete (2) cookie 94817265751728 notify 137438953505 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563c5d6f5190 con 0x563c5d6d4150 2024-05-09T09:49:28.518 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-09T09:49:28.233198Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:49:28.233178Z","tags":[],"group_ids":[]} 2024-05-09T09:49:28.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.515+0000 7f4cc1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:28.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.515+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94817265542992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6f3330 con 0x563c5d6d4150 2024-05-09T09:49:28.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.519+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(98 data_loggenerations_metadata [watch unwatch cookie 94817265542992] v32'434 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4e04036040 con 0x563c5d6d4150 2024-05-09T09:49:28.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.519+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94817265523712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6e6750 con 0x7f4dfc024070 2024-05-09T09:49:28.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.519+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(99 notify.0 [watch unwatch cookie 94817265523712] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e04036040 con 0x7f4dfc024070 2024-05-09T09:49:28.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.519+0000 7f4e0ef99980 20 remove_watcher() i=0 2024-05-09T09:49:28.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.519+0000 7f4e0ef99980 2 removed watcher, disabling cache 2024-05-09T09:49:28.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.519+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94817265527296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6e6750 con 0x563c5d6d4150 2024-05-09T09:49:28.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.519+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(100 notify.1 [watch unwatch cookie 94817265527296] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e04036040 con 0x563c5d6d4150 2024-05-09T09:49:28.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.519+0000 7f4e0ef99980 20 remove_watcher() i=1 2024-05-09T09:49:28.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.519+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94817265530000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6e6750 con 0x563c5d6dd490 2024-05-09T09:49:28.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.523+0000 7f4e0c2b3640 1 -- 172.21.15.157:0/3754536629 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(101 notify.2 [watch unwatch cookie 94817265530000] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dfc040040 con 0x563c5d6dd490 2024-05-09T09:49:28.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.523+0000 7f4e0ef99980 20 remove_watcher() i=2 2024-05-09T09:49:28.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.523+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:102 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94817265534704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6e6750 con 0x7f4dfc024070 2024-05-09T09:49:28.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.523+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(102 notify.3 [watch unwatch cookie 94817265534704] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e04036040 con 0x7f4dfc024070 2024-05-09T09:49:28.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.523+0000 7f4e0ef99980 20 remove_watcher() i=3 2024-05-09T09:49:28.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.523+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94817265521232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6e46f0 con 0x563c5d6d4150 2024-05-09T09:49:28.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.527+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(103 notify.4 [watch unwatch cookie 94817265521232] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e04036040 con 0x563c5d6d4150 2024-05-09T09:49:28.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.527+0000 7f4e0ef99980 20 remove_watcher() i=4 2024-05-09T09:49:28.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.527+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94817265538304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6e6750 con 0x563c5d6d8b40 2024-05-09T09:49:28.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.527+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(104 notify.5 [watch unwatch cookie 94817265538304] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df40fa070 con 0x563c5d6d8b40 2024-05-09T09:49:28.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.527+0000 7f4e0ef99980 20 remove_watcher() i=5 2024-05-09T09:49:28.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.527+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:105 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94817265541840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6e1250 con 0x563c5d6d8b40 2024-05-09T09:49:28.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.531+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(105 notify.6 [watch unwatch cookie 94817265541840] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df40fa070 con 0x563c5d6d8b40 2024-05-09T09:49:28.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.531+0000 7f4e0ef99980 20 remove_watcher() i=6 2024-05-09T09:49:28.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.531+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:106 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94817265546064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563c5d6e5500 con 0x563c5d6d8b40 2024-05-09T09:49:28.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.531+0000 7f4e0cab4640 1 -- 172.21.15.157:0/3754536629 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(106 notify.7 [watch unwatch cookie 94817265546064] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df40fa070 con 0x563c5d6d8b40 2024-05-09T09:49:28.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.531+0000 7f4e0ef99980 20 remove_watcher() i=7 2024-05-09T09:49:28.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.531+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563c5d6d8b40 msgr2=0x563c5d6daf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.531+0000 7f4e0ef99980 1 --2- 172.21.15.157:0/3754536629 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563c5d6d8b40 0x563c5d6daf30 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.531+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563c5d6d4150 msgr2=0x563c5d6d6610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.531+0000 7f4e0ef99980 1 --2- 172.21.15.157:0/3754536629 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563c5d6d4150 0x563c5d6d6610 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.531+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f4dfc024070 msgr2=0x7f4dfc031460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.531+0000 7f4e0ef99980 1 --2- 172.21.15.157:0/3754536629 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f4dfc024070 0x7f4dfc031460 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.531+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563c5d6dd490 msgr2=0x563c5d6df8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.531+0000 7f4e0ef99980 1 --2- 172.21.15.157:0/3754536629 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563c5d6dd490 0x563c5d6df8e0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.531+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4cd4034bb0 msgr2=0x7f4cd4037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.531+0000 7f4e0ef99980 1 --2- 172.21.15.157:0/3754536629 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4cd4034bb0 0x7f4cd4037070 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x563c5d68d860 tx=0x7f4dfc010000 comp rx=0 tx=0).stop 2024-05-09T09:49:28.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.531+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/3754536629 reap_dead start 2024-05-09T09:49:28.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.531+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d6c04f0 msgr2=0x563c5d6c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.531+0000 7f4e0ef99980 1 --2- 172.21.15.157:0/3754536629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d6c04f0 0x563c5d6c7710 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f4df40d8fd0 tx=0x7f4df40dfeb0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.531+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 shutdown_connections 2024-05-09T09:49:28.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.531+0000 7f4e0ef99980 1 --2- 172.21.15.157:0/3754536629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d6c04f0 0x563c5d6c7710 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.531+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 >> 172.21.15.157:0/3754536629 conn(0x563c5d6bc8c0 msgr2=0x563c5d6b9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:28.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.535+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 shutdown_connections 2024-05-09T09:49:28.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.535+0000 7f4e0ef99980 1 -- 172.21.15.157:0/3754536629 wait complete. 2024-05-09T09:49:28.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.535+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2832999535 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4ce4034bb0 msgr2=0x7f4ce4037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.535+0000 7f4e0ef99980 1 --2- 172.21.15.157:0/2832999535 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4ce4034bb0 0x7f4ce4037070 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc006300 tx=0x7f4dfc00f000 comp rx=0 tx=0).stop 2024-05-09T09:49:28.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.535+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2832999535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d6b34a0 msgr2=0x563c5d6b38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.535+0000 7f4e0ef99980 1 --2- 172.21.15.157:0/2832999535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d6b34a0 0x563c5d6b38c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f4df40e3790 tx=0x7f4df40a6db0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.535+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2832999535 shutdown_connections 2024-05-09T09:49:28.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.535+0000 7f4e0ef99980 1 --2- 172.21.15.157:0/2832999535 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4ce4034bb0 0x7f4ce4037070 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.535+0000 7f4e0ef99980 1 --2- 172.21.15.157:0/2832999535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d6b34a0 0x563c5d6b38c0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.535+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2832999535 >> 172.21.15.157:0/2832999535 conn(0x563c5d6a8270 msgr2=0x563c5d6a8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:28.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.535+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2832999535 shutdown_connections 2024-05-09T09:49:28.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.535+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2832999535 wait complete. 2024-05-09T09:49:28.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.535+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2033215394 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563c5d6869e0 msgr2=0x563c5d688dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.535+0000 7f4e0ef99980 1 --2- 172.21.15.157:0/2033215394 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x563c5d6869e0 0x563c5d688dd0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.535+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2033215394 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563c5d58b2b0 msgr2=0x563c5d684070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.535+0000 7f4e0ef99980 1 --2- 172.21.15.157:0/2033215394 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x563c5d58b2b0 0x563c5d684070 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.535+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2033215394 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563c5d68a8e0 msgr2=0x563c5d68ccd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.535+0000 7f4e0ef99980 1 --2- 172.21.15.157:0/2033215394 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x563c5d68a8e0 0x563c5d68ccd0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.535+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2033215394 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4cf4034bb0 msgr2=0x7f4cf4037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.535+0000 7f4e0ef99980 1 --2- 172.21.15.157:0/2033215394 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f4cf4034bb0 0x7f4cf4037070 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0012f0 tx=0x7f4dfc001430 comp rx=0 tx=0).stop 2024-05-09T09:49:28.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.535+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2033215394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d58a990 msgr2=0x563c5d67d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.535+0000 7f4e0ef99980 1 --2- 172.21.15.157:0/2033215394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x563c5d58a990 0x563c5d67d130 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f4df4018eb0 tx=0x7f4df4018020 comp rx=0 tx=0).stop 2024-05-09T09:49:28.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.535+0000 7f4e0d2b5640 1 -- 172.21.15.157:0/2033215394 reap_dead start 2024-05-09T09:49:28.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.535+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2033215394 shutdown_connections 2024-05-09T09:49:28.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.535+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2033215394 >> 172.21.15.157:0/2033215394 conn(0x563c5d586260 msgr2=0x563c5d6706d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:28.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.535+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2033215394 shutdown_connections 2024-05-09T09:49:28.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.535+0000 7f4e0ef99980 1 -- 172.21.15.157:0/2033215394 wait complete. 2024-05-09T09:49:28.545 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-09T09:49:28.233198Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:49:28.233178Z', 'tags': [], 'group_ids': []} 2024-05-09T09:49:28.545 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-09T09:49:28.233198Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:49:28.233178Z', 'tags': [], 'group_ids': []} 2024-05-09T09:49:28.545 ERROR:root:0 2024-05-09T09:49:28.546 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-05-09T09:49:28.546 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-05-09T09:49:28.546 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-05-09T09:49:28.622 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:49:28.622 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:49:28.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.623+0000 7fab3667f980 1 Processor -- start 2024-05-09T09:49:28.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.623+0000 7fab3667f980 1 -- start start 2024-05-09T09:49:28.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.623+0000 7fab3667f980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x56196693bad0 0x56196693beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.623+0000 7fab3667f980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5619667ef440 con 0x56196693c3f0 2024-05-09T09:49:28.623 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.623+0000 7fab3667f980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5619667da5f0 con 0x56196693bad0 2024-05-09T09:49:28.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.623+0000 7fab3419a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x56196693bad0 0x56196693beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.623+0000 7fab3419a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x56196693bad0 0x56196693beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39076/0 (socket says 172.21.15.157:39076) 2024-05-09T09:49:28.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.623+0000 7fab3419a640 1 -- 172.21.15.157:0/1127070316 learned_addr learned my addr 172.21.15.157:0/1127070316 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:28.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.623+0000 7fab33999640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x56196693c3f0 0x56196693cda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:45592/0 (socket says 172.21.15.157:45592) 2024-05-09T09:49:28.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.623+0000 7fab3419a640 1 -- 172.21.15.157:0/1127070316 >> v1:172.21.15.110:6789/0 conn(0x56196693c3f0 legacy=0x56196693cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.623+0000 7fab3419a640 1 -- 172.21.15.157:0/1127070316 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619667e5990 con 0x56196693bad0 2024-05-09T09:49:28.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.627+0000 7fab3419a640 1 --2- 172.21.15.157:0/1127070316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56196693bad0 0x56196693beb0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fab2c00a4e0 tx=0x7fab2c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd1460401539d86 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.627+0000 7fab33198640 1 -- 172.21.15.157:0/1127070316 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab2c0aa540 con 0x56196693bad0 2024-05-09T09:49:28.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.627+0000 7fab33198640 1 -- 172.21.15.157:0/1127070316 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab2c0aa6e0 con 0x56196693bad0 2024-05-09T09:49:28.627 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.627+0000 7fab33198640 1 -- 172.21.15.157:0/1127070316 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab2c0aaa40 con 0x56196693bad0 2024-05-09T09:49:28.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.627+0000 7fab3667f980 1 -- 172.21.15.157:0/1127070316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56196693bad0 msgr2=0x56196693beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.627+0000 7fab3667f980 1 --2- 172.21.15.157:0/1127070316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56196693bad0 0x56196693beb0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fab2c00a4e0 tx=0x7fab2c01b090 comp rx=0 tx=0).stop 2024-05-09T09:49:28.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.627+0000 7fab3667f980 1 -- 172.21.15.157:0/1127070316 shutdown_connections 2024-05-09T09:49:28.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.627+0000 7fab3667f980 1 --2- 172.21.15.157:0/1127070316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56196693bad0 0x56196693beb0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.627+0000 7fab3667f980 1 -- 172.21.15.157:0/1127070316 >> 172.21.15.157:0/1127070316 conn(0x5619668af1f0 msgr2=0x5619668af600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:28.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.627+0000 7fab3667f980 1 -- 172.21.15.157:0/1127070316 shutdown_connections 2024-05-09T09:49:28.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.627+0000 7fab3667f980 1 -- 172.21.15.157:0/1127070316 wait complete. 2024-05-09T09:49:28.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.639+0000 7fab3667f980 1 Processor -- start 2024-05-09T09:49:28.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.639+0000 7fab3667f980 1 -- start start 2024-05-09T09:49:28.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.639+0000 7fab3667f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56196693bad0 0x561966a273d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.639+0000 7fab3667f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56196683cfe0 con 0x56196693bad0 2024-05-09T09:49:28.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.639+0000 7fab3419a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56196693bad0 0x561966a273d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.639+0000 7fab3419a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56196693bad0 0x561966a273d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39092/0 (socket says 172.21.15.157:39092) 2024-05-09T09:49:28.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.639+0000 7fab3419a640 1 -- 172.21.15.157:0/1602940355 learned_addr learned my addr 172.21.15.157:0/1602940355 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:28.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.639+0000 7fab3419a640 1 -- 172.21.15.157:0/1602940355 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619667c1ae0 con 0x56196693bad0 2024-05-09T09:49:28.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.639+0000 7fab3419a640 1 --2- 172.21.15.157:0/1602940355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56196693bad0 0x561966a273d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fab2c0ac040 tx=0x7fab2c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6feff54fa5e6528b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.639+0000 7faa2260c640 1 -- 172.21.15.157:0/1602940355 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab2c0b9030 con 0x56196693bad0 2024-05-09T09:49:28.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.639+0000 7faa2260c640 1 -- 172.21.15.157:0/1602940355 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab2c0aaa40 con 0x56196693bad0 2024-05-09T09:49:28.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.639+0000 7faa2260c640 1 -- 172.21.15.157:0/1602940355 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab2c0aad20 con 0x56196693bad0 2024-05-09T09:49:28.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.643+0000 7fab3667f980 1 -- 172.21.15.157:0/1602940355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56196693bad0 msgr2=0x561966a273d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.643+0000 7fab3667f980 1 --2- 172.21.15.157:0/1602940355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56196693bad0 0x561966a273d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fab2c0ac040 tx=0x7fab2c0033b0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.643+0000 7fab3667f980 1 -- 172.21.15.157:0/1602940355 shutdown_connections 2024-05-09T09:49:28.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.643+0000 7fab3667f980 1 --2- 172.21.15.157:0/1602940355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56196693bad0 0x561966a273d0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.643+0000 7fab3667f980 1 -- 172.21.15.157:0/1602940355 >> 172.21.15.157:0/1602940355 conn(0x5619668af1f0 msgr2=0x561966a22f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:28.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.643+0000 7fab3667f980 1 -- 172.21.15.157:0/1602940355 shutdown_connections 2024-05-09T09:49:28.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.643+0000 7fab3667f980 1 -- 172.21.15.157:0/1602940355 wait complete. 2024-05-09T09:49:28.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.643+0000 7fab3667f980 1 Processor -- start 2024-05-09T09:49:28.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.643+0000 7fab3667f980 1 -- start start 2024-05-09T09:49:28.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.643+0000 7fab3667f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56196693bad0 0x561966a2e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.643+0000 7fab3667f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561966945b10 con 0x56196693bad0 2024-05-09T09:49:28.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.643+0000 7fab3419a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56196693bad0 0x561966a2e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.643+0000 7fab3419a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56196693bad0 0x561966a2e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39108/0 (socket says 172.21.15.157:39108) 2024-05-09T09:49:28.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.643+0000 7fab3419a640 1 -- 172.21.15.157:0/4054417564 learned_addr learned my addr 172.21.15.157:0/4054417564 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:28.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.643+0000 7fab3419a640 1 -- 172.21.15.157:0/4054417564 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561966a2e970 con 0x56196693bad0 2024-05-09T09:49:28.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.643+0000 7fab3419a640 1 --2- 172.21.15.157:0/4054417564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56196693bad0 0x561966a2e430 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fab2c000f90 tx=0x7fab2c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.643+0000 7faa20e09640 1 -- 172.21.15.157:0/4054417564 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab2c0b9030 con 0x56196693bad0 2024-05-09T09:49:28.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.643+0000 7fab3667f980 1 -- 172.21.15.157:0/4054417564 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561966a2ec00 con 0x56196693bad0 2024-05-09T09:49:28.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.643+0000 7faa20e09640 1 -- 172.21.15.157:0/4054417564 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab2c0c2070 con 0x56196693bad0 2024-05-09T09:49:28.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.643+0000 7faa20e09640 1 -- 172.21.15.157:0/4054417564 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab2c0cb060 con 0x56196693bad0 2024-05-09T09:49:28.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.643+0000 7fab3667f980 1 -- 172.21.15.157:0/4054417564 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561966a31890 con 0x56196693bad0 2024-05-09T09:49:28.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.643+0000 7faa20e09640 1 -- 172.21.15.157:0/4054417564 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fab2c0c4030 con 0x56196693bad0 2024-05-09T09:49:28.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.647+0000 7faa20e09640 1 --2- 172.21.15.157:0/4054417564 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7faa1c034bb0 0x7faa1c037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.647+0000 7faa20e09640 1 -- 172.21.15.157:0/4054417564 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fab2c0ba070 con 0x56196693bad0 2024-05-09T09:49:28.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.647+0000 7fab33999640 1 --2- 172.21.15.157:0/4054417564 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7faa1c034bb0 0x7faa1c037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.647+0000 7fab3667f980 1 --2- 172.21.15.157:0/4054417564 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56196693c3f0 0x561966a35370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.647+0000 7fab3667f980 1 -- 172.21.15.157:0/4054417564 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561966a35990 con 0x56196693c3f0 2024-05-09T09:49:28.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.647+0000 7fab3499b640 1 --2- 172.21.15.157:0/4054417564 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56196693c3f0 0x561966a35370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.647+0000 7fab33999640 1 --2- 172.21.15.157:0/4054417564 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7faa1c034bb0 0x7faa1c037070 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fab28001e50 tx=0x7fab280013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.647+0000 7fab3499b640 1 --2- 172.21.15.157:0/4054417564 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56196693c3f0 0x561966a35370 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.647+0000 7fab3499b640 1 -- 172.21.15.157:0/4054417564 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab240083f0 con 0x56196693c3f0 2024-05-09T09:49:28.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.647+0000 7fab3667f980 1 -- 172.21.15.157:0/4054417564 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561966a36270 con 0x56196693c3f0 2024-05-09T09:49:28.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.647+0000 7fab3499b640 1 -- 172.21.15.157:0/4054417564 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab240083f0 con 0x56196693c3f0 2024-05-09T09:49:28.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.647+0000 7fab3667f980 1 --2- 172.21.15.157:0/4054417564 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561966a37bc0 0x561966a3a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.647+0000 7fab3667f980 1 -- 172.21.15.157:0/4054417564 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561966a3a7e0 con 0x561966a37bc0 2024-05-09T09:49:28.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.647+0000 7fab3419a640 1 --2- 172.21.15.157:0/4054417564 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561966a37bc0 0x561966a3a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.647+0000 7fab3419a640 1 --2- 172.21.15.157:0/4054417564 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561966a37bc0 0x561966a3a050 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.647+0000 7fab3419a640 1 -- 172.21.15.157:0/4054417564 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fab2c0cfd30 con 0x561966a37bc0 2024-05-09T09:49:28.651 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.647+0000 7fab3667f980 1 -- 172.21.15.157:0/4054417564 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561966a36ac0 con 0x56196693c3f0 2024-05-09T09:49:28.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.647+0000 7fab3499b640 1 -- 172.21.15.157:0/4054417564 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab240083f0 con 0x56196693c3f0 2024-05-09T09:49:28.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.647+0000 7fab3667f980 1 --2- 172.21.15.157:0/4054417564 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561966a3bc40 0x561966a3e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.647+0000 7fab3667f980 1 -- 172.21.15.157:0/4054417564 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561966a3e770 con 0x561966a3bc40 2024-05-09T09:49:28.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.647+0000 7fab33999640 1 --2- 172.21.15.157:0/4054417564 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561966a3bc40 0x561966a3e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.651+0000 7fab33999640 1 --2- 172.21.15.157:0/4054417564 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561966a3bc40 0x561966a3e030 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.651+0000 7fab33999640 1 -- 172.21.15.157:0/4054417564 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fab2800f700 con 0x561966a3bc40 2024-05-09T09:49:28.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.651+0000 7fab3667f980 1 Processor -- start 2024-05-09T09:49:28.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.651+0000 7fab3667f980 1 -- start start 2024-05-09T09:49:28.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.651+0000 7fab3667f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561966a64630 0x561966a64a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.651+0000 7fab3667f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561966841020 con 0x561966a64630 2024-05-09T09:49:28.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.655+0000 7fab3419a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561966a64630 0x561966a64a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.655+0000 7fab3419a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561966a64630 0x561966a64a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39120/0 (socket says 172.21.15.157:39120) 2024-05-09T09:49:28.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.655+0000 7fab3419a640 1 -- 172.21.15.157:0/3060898474 learned_addr learned my addr 172.21.15.157:0/3060898474 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:28.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.655+0000 7fab3419a640 1 -- 172.21.15.157:0/3060898474 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561966a64f90 con 0x561966a64630 2024-05-09T09:49:28.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.655+0000 7fab3419a640 1 --2- 172.21.15.157:0/3060898474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561966a64630 0x561966a64a50 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fab2c0e3bc0 tx=0x7fab2c0b4d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.655+0000 7faa18b9e640 1 -- 172.21.15.157:0/3060898474 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab2c005440 con 0x561966a64630 2024-05-09T09:49:28.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.655+0000 7fab3667f980 1 -- 172.21.15.157:0/3060898474 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561966a65a20 con 0x561966a64630 2024-05-09T09:49:28.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.655+0000 7faa18b9e640 1 -- 172.21.15.157:0/3060898474 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab2c0b43a0 con 0x561966a64630 2024-05-09T09:49:28.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.655+0000 7fab3667f980 1 -- 172.21.15.157:0/3060898474 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561966a65f00 con 0x561966a64630 2024-05-09T09:49:28.657 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.655+0000 7faa18b9e640 1 -- 172.21.15.157:0/3060898474 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab2c0b4680 con 0x561966a64630 2024-05-09T09:49:28.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.655+0000 7faa18b9e640 1 -- 172.21.15.157:0/3060898474 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fab2c0b3040 con 0x561966a64630 2024-05-09T09:49:28.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.655+0000 7faa18b9e640 1 --2- 172.21.15.157:0/3060898474 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7faa0c034bb0 0x7faa0c037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.655+0000 7faa18b9e640 1 -- 172.21.15.157:0/3060898474 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fab2c0dad60 con 0x561966a64630 2024-05-09T09:49:28.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.655+0000 7fab33999640 1 --2- 172.21.15.157:0/3060898474 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7faa0c034bb0 0x7faa0c037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.655+0000 7fab3667f980 1 Processor -- start 2024-05-09T09:49:28.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.655+0000 7fab3667f980 1 -- start start 2024-05-09T09:49:28.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.655+0000 7fab3667f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561966a71660 0x561966a71a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.655+0000 7fab3667f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561966a27a60 con 0x561966a71660 2024-05-09T09:49:28.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.655+0000 7fab33999640 1 --2- 172.21.15.157:0/3060898474 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7faa0c034bb0 0x7faa0c037070 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x561966a32c10 tx=0x7fab2800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.655+0000 7fab3419a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561966a71660 0x561966a71a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.655+0000 7fab3419a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561966a71660 0x561966a71a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39134/0 (socket says 172.21.15.157:39134) 2024-05-09T09:49:28.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.655+0000 7fab3419a640 1 -- 172.21.15.157:0/3357312333 learned_addr learned my addr 172.21.15.157:0/3357312333 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:28.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.659+0000 7fab3419a640 1 -- 172.21.15.157:0/3357312333 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561966a72050 con 0x561966a71660 2024-05-09T09:49:28.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.659+0000 7fab3419a640 1 --2- 172.21.15.157:0/3357312333 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561966a71660 0x561966a71a80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fab2c0c8970 tx=0x7fab2c0e5040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=232a6acedeeb328f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.659+0000 7faa127fc640 1 -- 172.21.15.157:0/3357312333 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab2c0ddcc0 con 0x561966a71660 2024-05-09T09:49:28.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.659+0000 7faa127fc640 1 -- 172.21.15.157:0/3357312333 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab2c0f4070 con 0x561966a71660 2024-05-09T09:49:28.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.659+0000 7faa127fc640 1 -- 172.21.15.157:0/3357312333 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab2c0e91b0 con 0x561966a71660 2024-05-09T09:49:28.662 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.659+0000 7fab3667f980 1 -- 172.21.15.157:0/3357312333 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561966a71660 msgr2=0x561966a71a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.659+0000 7fab3667f980 1 --2- 172.21.15.157:0/3357312333 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561966a71660 0x561966a71a80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fab2c0c8970 tx=0x7fab2c0e5040 comp rx=0 tx=0).stop 2024-05-09T09:49:28.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.659+0000 7fab3667f980 1 -- 172.21.15.157:0/3357312333 shutdown_connections 2024-05-09T09:49:28.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.659+0000 7fab3667f980 1 --2- 172.21.15.157:0/3357312333 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561966a71660 0x561966a71a80 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.659+0000 7fab3667f980 1 -- 172.21.15.157:0/3357312333 >> 172.21.15.157:0/3357312333 conn(0x561966a6d9e0 msgr2=0x561966a6ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:28.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.659+0000 7fab3667f980 1 -- 172.21.15.157:0/3357312333 shutdown_connections 2024-05-09T09:49:28.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.659+0000 7fab3667f980 1 -- 172.21.15.157:0/3357312333 wait complete. 2024-05-09T09:49:28.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.659+0000 7fab3667f980 1 Processor -- start 2024-05-09T09:49:28.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.659+0000 7fab3667f980 1 -- start start 2024-05-09T09:49:28.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.659+0000 7fab3667f980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561966a71660 0x561966a789c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.659+0000 7fab3667f980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561966a72720 con 0x561966a71660 2024-05-09T09:49:28.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.659+0000 7fab3419a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561966a71660 0x561966a789c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.659+0000 7fab3419a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561966a71660 0x561966a789c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39150/0 (socket says 172.21.15.157:39150) 2024-05-09T09:49:28.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.659+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 learned_addr learned my addr 172.21.15.157:0/3858139984 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:28.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.659+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561966a78f00 con 0x561966a71660 2024-05-09T09:49:28.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.659+0000 7fab3419a640 1 --2- 172.21.15.157:0/3858139984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561966a71660 0x561966a789c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fab2c0e5140 tx=0x7fab2c0db1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.659+0000 7faa10ff9640 1 -- 172.21.15.157:0/3858139984 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab2c109070 con 0x561966a71660 2024-05-09T09:49:28.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.659+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561966a78f00 con 0x561966a71660 2024-05-09T09:49:28.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.659+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561966a78f00 con 0x561966a71660 2024-05-09T09:49:28.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.659+0000 7faa10ff9640 1 -- 172.21.15.157:0/3858139984 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab2c004dd0 con 0x561966a71660 2024-05-09T09:49:28.664 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.659+0000 7faa10ff9640 1 -- 172.21.15.157:0/3858139984 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab2c0b8b80 con 0x561966a71660 2024-05-09T09:49:28.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7faa10ff9640 1 -- 172.21.15.157:0/3858139984 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fab2c10c070 con 0x561966a71660 2024-05-09T09:49:28.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7faa10ff9640 1 --2- 172.21.15.157:0/3858139984 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa9fc034c00 0x7fa9fc0370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7faa10ff9640 1 -- 172.21.15.157:0/3858139984 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fab2c112370 con 0x561966a71660 2024-05-09T09:49:28.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7fab33999640 1 --2- 172.21.15.157:0/3858139984 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa9fc034c00 0x7fa9fc0370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7fab3667f980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7fab3667f980 1 --2- 172.21.15.157:0/3858139984 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561966a853d0 0x561966a87890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561966a87fe0 con 0x561966a853d0 2024-05-09T09:49:28.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7fab3499b640 1 --2- 172.21.15.157:0/3858139984 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561966a853d0 0x561966a87890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7fab33999640 1 --2- 172.21.15.157:0/3858139984 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa9fc034c00 0x7fa9fc0370c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x561966a3eb50 tx=0x7fab28010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7fab3499b640 1 --2- 172.21.15.157:0/3858139984 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561966a853d0 0x561966a87890 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab240083f0 con 0x561966a853d0 2024-05-09T09:49:28.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7fab3667f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7fab3667f980 20 realm 2024-05-09T09:49:28.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7fab3667f980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561966a883f0 con 0x561966a853d0 2024-05-09T09:49:28.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab240083f0 con 0x561966a853d0 2024-05-09T09:49:28.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7fab3667f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7fab3667f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:49:28.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7fab3667f980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561966a88cc0 con 0x561966a853d0 2024-05-09T09:49:28.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab240083f0 con 0x561966a853d0 2024-05-09T09:49:28.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7fab3667f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7fab3667f980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x561966a853d0 2024-05-09T09:49:28.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab240083f0 con 0x561966a853d0 2024-05-09T09:49:28.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7fab3667f980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:28.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7fab3667f980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7fab3667f980 1 --2- 172.21.15.157:0/3858139984 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561966a89dc0 0x561966a8c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561966a8c780 con 0x561966a89dc0 2024-05-09T09:49:28.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7fab3419a640 1 --2- 172.21.15.157:0/3858139984 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561966a89dc0 0x561966a8c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.663+0000 7fab3419a640 1 --2- 172.21.15.157:0/3858139984 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561966a89dc0 0x561966a8c1b0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.667+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fab2c10b030 con 0x561966a89dc0 2024-05-09T09:49:28.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.667+0000 7fab3667f980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:49:28.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.667+0000 7fab3667f980 20 searching for the correct realm 2024-05-09T09:49:28.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.667+0000 7fab3667f980 1 --2- 172.21.15.157:0/3858139984 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561966a8e6d0 0x561966a90b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.667+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a911d0 con 0x561966a8e6d0 2024-05-09T09:49:28.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.667+0000 7fab33999640 1 --2- 172.21.15.157:0/3858139984 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561966a8e6d0 0x561966a90b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.667+0000 7fab33999640 1 --2- 172.21.15.157:0/3858139984 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561966a8e6d0 0x561966a90b00 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.667+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab28037040 con 0x561966a8e6d0 2024-05-09T09:49:28.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.667+0000 7fab33999640 1 --2- 172.21.15.157:0/3858139984 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fab2801fc60 0x7fab2803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.667+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a911d0 con 0x7fab2801fc60 2024-05-09T09:49:28.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.667+0000 7fab3499b640 1 --2- 172.21.15.157:0/3858139984 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fab2801fc60 0x7fab2803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.667+0000 7fab3499b640 1 --2- 172.21.15.157:0/3858139984 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fab2801fc60 0x7fab2803a3c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.667+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab240083f0 con 0x7fab2801fc60 2024-05-09T09:49:28.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.667+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x561966a89dc0 2024-05-09T09:49:28.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.667+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab2c10b030 con 0x561966a89dc0 2024-05-09T09:49:28.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.667+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x561966a853d0 2024-05-09T09:49:28.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.667+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab240083f0 con 0x561966a853d0 2024-05-09T09:49:28.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.667+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x561966a853d0 2024-05-09T09:49:28.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.667+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab24026040 con 0x561966a853d0 2024-05-09T09:49:28.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.667+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x561966a89dc0 2024-05-09T09:49:28.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.667+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab2c10b030 con 0x561966a89dc0 2024-05-09T09:49:28.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.667+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x561966a89dc0 2024-05-09T09:49:28.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.671+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab2c10b030 con 0x561966a89dc0 2024-05-09T09:49:28.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.671+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x7fab2801fc60 2024-05-09T09:49:28.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.671+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab24026040 con 0x7fab2801fc60 2024-05-09T09:49:28.683 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.671+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x561966a8e6d0 2024-05-09T09:49:28.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.671+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab28037040 con 0x561966a8e6d0 2024-05-09T09:49:28.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.671+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x561966a853d0 2024-05-09T09:49:28.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.671+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab24026040 con 0x561966a853d0 2024-05-09T09:49:28.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.671+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x561966a89dc0 2024-05-09T09:49:28.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.671+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab2c10b030 con 0x561966a89dc0 2024-05-09T09:49:28.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.671+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x561966a853d0 2024-05-09T09:49:28.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.671+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab24026040 con 0x561966a853d0 2024-05-09T09:49:28.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.671+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x7fab2801fc60 2024-05-09T09:49:28.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.671+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fab24026040 con 0x7fab2801fc60 2024-05-09T09:49:28.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.671+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x561966a8e6d0 2024-05-09T09:49:28.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.671+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab28037040 con 0x561966a8e6d0 2024-05-09T09:49:28.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.671+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x561966a8e6d0 2024-05-09T09:49:28.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.671+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fab28037040 con 0x561966a8e6d0 2024-05-09T09:49:28.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.671+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x561966a89dc0 2024-05-09T09:49:28.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.671+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab2c10b030 con 0x561966a89dc0 2024-05-09T09:49:28.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.671+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x561966a8e6d0 2024-05-09T09:49:28.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.671+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab28037040 con 0x561966a8e6d0 2024-05-09T09:49:28.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.671+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x561966a8e6d0 2024-05-09T09:49:28.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.671+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab28037040 con 0x561966a8e6d0 2024-05-09T09:49:28.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.671+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x561966a853d0 2024-05-09T09:49:28.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.671+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab24026040 con 0x561966a853d0 2024-05-09T09:49:28.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.671+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x561966a853d0 2024-05-09T09:49:28.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.675+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fab24026040 con 0x561966a853d0 2024-05-09T09:49:28.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.675+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x561966a89dc0 2024-05-09T09:49:28.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.675+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab2c10b030 con 0x561966a89dc0 2024-05-09T09:49:28.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.675+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x561966a8e6d0 2024-05-09T09:49:28.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.675+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab28037040 con 0x561966a8e6d0 2024-05-09T09:49:28.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.675+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x7fab2801fc60 2024-05-09T09:49:28.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.675+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab24026040 con 0x7fab2801fc60 2024-05-09T09:49:28.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.675+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x561966a853d0 2024-05-09T09:49:28.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.675+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab24026040 con 0x561966a853d0 2024-05-09T09:49:28.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.675+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x561966a89dc0 2024-05-09T09:49:28.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.675+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fab2c10b030 con 0x561966a89dc0 2024-05-09T09:49:28.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.675+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x561966a8e6d0 2024-05-09T09:49:28.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.675+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab28037040 con 0x561966a8e6d0 2024-05-09T09:49:28.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.675+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x561966a89dc0 2024-05-09T09:49:28.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.675+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab2c10b030 con 0x561966a89dc0 2024-05-09T09:49:28.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.675+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x7fab2801fc60 2024-05-09T09:49:28.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.675+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab24026040 con 0x7fab2801fc60 2024-05-09T09:49:28.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.675+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x561966a8e6d0 2024-05-09T09:49:28.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.675+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab2804a040 con 0x561966a8e6d0 2024-05-09T09:49:28.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.675+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x561966a89dc0 2024-05-09T09:49:28.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab2c10b030 con 0x561966a89dc0 2024-05-09T09:49:28.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x561966a853d0 2024-05-09T09:49:28.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fab24026040 con 0x561966a853d0 2024-05-09T09:49:28.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561966a89060 con 0x7fab2801fc60 2024-05-09T09:49:28.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab24026040 con 0x7fab2801fc60 2024-05-09T09:49:28.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:49:28.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:49:28.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:49:28.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:49:28.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:49:28.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:49:28.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561966a8d040 con 0x561966a853d0 2024-05-09T09:49:28.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab24026040 con 0x561966a853d0 2024-05-09T09:49:28.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561966a8d040 con 0x561966a853d0 2024-05-09T09:49:28.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab24026040 con 0x561966a853d0 2024-05-09T09:49:28.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:28.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561966a8d040 con 0x561966a8e6d0 2024-05-09T09:49:28.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fab2804a040 con 0x561966a8e6d0 2024-05-09T09:49:28.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:49:28.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 20 zone default found 2024-05-09T09:49:28.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 4 Realm: () 2024-05-09T09:49:28.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:49:28.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:49:28.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:49:28.689 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 20 zonegroup default 2024-05-09T09:49:28.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561966a8da60 con 0x561966a89dc0 2024-05-09T09:49:28.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fab2c10b030 con 0x561966a89dc0 2024-05-09T09:49:28.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561966a934e0 con 0x561966a8e6d0 2024-05-09T09:49:28.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab2804a040 con 0x561966a8e6d0 2024-05-09T09:49:28.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561966a93880 con 0x561966a8e6d0 2024-05-09T09:49:28.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab2804a040 con 0x561966a8e6d0 2024-05-09T09:49:28.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 20 started sync module instance, tier type = 2024-05-09T09:49:28.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:49:28.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966a92920 con 0x7fab2801fc60 2024-05-09T09:49:28.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab24026040 con 0x7fab2801fc60 2024-05-09T09:49:28.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.679+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94667096534288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966a92920 con 0x7fab2801fc60 2024-05-09T09:49:28.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.683+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966a940d0 con 0x561966a853d0 2024-05-09T09:49:28.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.683+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94667096534288] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab24036040 con 0x7fab2801fc60 2024-05-09T09:49:28.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.683+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab24036040 con 0x561966a853d0 2024-05-09T09:49:28.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.683+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94667096532352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966a940d0 con 0x561966a853d0 2024-05-09T09:49:28.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.683+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966a94a90 con 0x561966a8e6d0 2024-05-09T09:49:28.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.687+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab2804a040 con 0x561966a8e6d0 2024-05-09T09:49:28.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.687+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94667096532352] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab24036040 con 0x561966a853d0 2024-05-09T09:49:28.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.687+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94667096538144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966a94e80 con 0x561966a8e6d0 2024-05-09T09:49:28.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.687+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966a95840 con 0x7fab2801fc60 2024-05-09T09:49:28.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.687+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab24036040 con 0x7fab2801fc60 2024-05-09T09:49:28.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.687+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94667096544416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966a95f30 con 0x7fab2801fc60 2024-05-09T09:49:28.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.687+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966a96a50 con 0x561966a853d0 2024-05-09T09:49:28.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.687+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94667096538144] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab2804a040 con 0x561966a8e6d0 2024-05-09T09:49:28.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.687+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94667096544416] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab24036040 con 0x7fab2801fc60 2024-05-09T09:49:28.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.687+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab24036040 con 0x561966a853d0 2024-05-09T09:49:28.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.687+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94667096548640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966a96a10 con 0x561966a853d0 2024-05-09T09:49:28.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.687+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966a96e40 con 0x561966a89dc0 2024-05-09T09:49:28.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.691+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94667096548640] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab24036040 con 0x561966a853d0 2024-05-09T09:49:28.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.691+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab2c10b030 con 0x561966a89dc0 2024-05-09T09:49:28.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.691+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94667096545664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966a97230 con 0x561966a89dc0 2024-05-09T09:49:28.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.691+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966a97ac0 con 0x561966a89dc0 2024-05-09T09:49:28.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.695+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94667096545664] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab2c10b030 con 0x561966a89dc0 2024-05-09T09:49:28.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.695+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab2c10b030 con 0x561966a89dc0 2024-05-09T09:49:28.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.695+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94667096540640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966a976f0 con 0x561966a89dc0 2024-05-09T09:49:28.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.695+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966a98880 con 0x561966a89dc0 2024-05-09T09:49:28.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.695+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94667096540640] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab2c10b030 con 0x561966a89dc0 2024-05-09T09:49:28.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.695+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab2c10b030 con 0x561966a89dc0 2024-05-09T09:49:28.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.695+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94667096556400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966a98840 con 0x561966a89dc0 2024-05-09T09:49:28.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.695+0000 7fab3667f980 20 add_watcher() i=0 2024-05-09T09:49:28.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.695+0000 7fab3667f980 20 add_watcher() i=1 2024-05-09T09:49:28.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.695+0000 7fab3667f980 20 add_watcher() i=2 2024-05-09T09:49:28.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.695+0000 7fab3667f980 20 add_watcher() i=3 2024-05-09T09:49:28.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.695+0000 7fab3667f980 20 add_watcher() i=4 2024-05-09T09:49:28.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.695+0000 7fab3667f980 20 add_watcher() i=5 2024-05-09T09:49:28.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.695+0000 7fab3667f980 20 add_watcher() i=6 2024-05-09T09:49:28.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.699+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94667096556400] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab2c10b030 con 0x561966a89dc0 2024-05-09T09:49:28.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.699+0000 7fab3667f980 20 add_watcher() i=7 2024-05-09T09:49:28.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.699+0000 7fab3667f980 2 all 8 watchers are set, enabling cache 2024-05-09T09:49:28.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.699+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561966a9bcd0 con 0x561966a853d0 2024-05-09T09:49:28.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.699+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fab24036040 con 0x561966a853d0 2024-05-09T09:49:28.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.699+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94667096554656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966a99180 con 0x561966a853d0 2024-05-09T09:49:28.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.699+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94667096554656] v32'435 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fab24036040 con 0x561966a853d0 2024-05-09T09:49:28.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.699+0000 7fa9e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:28.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.699+0000 7fab3667f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:49:28.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.699+0000 7fab3667f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:49:28.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.699+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966a9ba40 con 0x561966a853d0 2024-05-09T09:49:28.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.703+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'100 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fab24036040 con 0x561966a853d0 2024-05-09T09:49:28.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.703+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa4d70 con 0x561966a89dc0 2024-05-09T09:49:28.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.703+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'95 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fab2c10b030 con 0x561966a89dc0 2024-05-09T09:49:28.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.703+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa4d70 con 0x561966a8e6d0 2024-05-09T09:49:28.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.703+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'94 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fab2804a040 con 0x561966a8e6d0 2024-05-09T09:49:28.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.703+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa5620 con 0x561966a853d0 2024-05-09T09:49:28.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.707+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'436 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fab24036040 con 0x561966a853d0 2024-05-09T09:49:28.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.707+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa5b90 con 0x7fab2801fc60 2024-05-09T09:49:28.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.707+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'269 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fab24036040 con 0x7fab2801fc60 2024-05-09T09:49:28.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.707+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa6100 con 0x561966a8e6d0 2024-05-09T09:49:28.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.707+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'180 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fab2804a040 con 0x561966a8e6d0 2024-05-09T09:49:28.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.707+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa65b0 con 0x561966a853d0 2024-05-09T09:49:28.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.711+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'95 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fab24036040 con 0x561966a853d0 2024-05-09T09:49:28.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.711+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa6390 con 0x561966a89dc0 2024-05-09T09:49:28.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.711+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'179 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fab2c10b030 con 0x561966a89dc0 2024-05-09T09:49:28.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.711+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa6420 con 0x7fab2801fc60 2024-05-09T09:49:28.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.715+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'93 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fab24036040 con 0x7fab2801fc60 2024-05-09T09:49:28.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.715+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa6420 con 0x561966a8e6d0 2024-05-09T09:49:28.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.715+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'99 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fab2804a040 con 0x561966a8e6d0 2024-05-09T09:49:28.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.715+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa68d0 con 0x7fab2801fc60 2024-05-09T09:49:28.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.715+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'270 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fab24036040 con 0x7fab2801fc60 2024-05-09T09:49:28.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.715+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa68d0 con 0x561966a89dc0 2024-05-09T09:49:28.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.719+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'99 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fab2c10b030 con 0x561966a89dc0 2024-05-09T09:49:28.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.719+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa6990 con 0x7fab2801fc60 2024-05-09T09:49:28.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.719+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'93 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fab24036040 con 0x7fab2801fc60 2024-05-09T09:49:28.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.719+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa6990 con 0x561966a89dc0 2024-05-09T09:49:28.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.723+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'185 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fab2c10b030 con 0x561966a89dc0 2024-05-09T09:49:28.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.723+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa6960 con 0x561966a853d0 2024-05-09T09:49:28.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.723+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'437 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fab24036040 con 0x561966a853d0 2024-05-09T09:49:28.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.723+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa6960 con 0x561966a8e6d0 2024-05-09T09:49:28.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.727+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'263 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fab2804a040 con 0x561966a8e6d0 2024-05-09T09:49:28.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.727+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa6960 con 0x7fab2801fc60 2024-05-09T09:49:28.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.727+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'271 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fab24036040 con 0x7fab2801fc60 2024-05-09T09:49:28.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.727+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa6960 con 0x561966a8e6d0 2024-05-09T09:49:28.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.727+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'93 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fab2804a040 con 0x561966a8e6d0 2024-05-09T09:49:28.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.727+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa6dd0 con 0x561966a853d0 2024-05-09T09:49:28.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.731+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'101 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fab24036040 con 0x561966a853d0 2024-05-09T09:49:28.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.731+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa6dd0 con 0x561966a853d0 2024-05-09T09:49:28.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.731+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'438 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fab24036040 con 0x561966a853d0 2024-05-09T09:49:28.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.731+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa6dd0 con 0x561966a8e6d0 2024-05-09T09:49:28.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.735+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'264 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fab2804a040 con 0x561966a8e6d0 2024-05-09T09:49:28.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.735+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa6dd0 con 0x7fab2801fc60 2024-05-09T09:49:28.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.735+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'105 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fab24036040 con 0x7fab2801fc60 2024-05-09T09:49:28.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.735+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa6dd0 con 0x561966a8e6d0 2024-05-09T09:49:28.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.739+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'95 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fab2804a040 con 0x561966a8e6d0 2024-05-09T09:49:28.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.739+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa6dd0 con 0x561966a8e6d0 2024-05-09T09:49:28.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.739+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'99 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fab2804a040 con 0x561966a8e6d0 2024-05-09T09:49:28.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.739+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa6dd0 con 0x561966a8e6d0 2024-05-09T09:49:28.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.739+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'90 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fab2804a040 con 0x561966a8e6d0 2024-05-09T09:49:28.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.739+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa6dd0 con 0x561966a8e6d0 2024-05-09T09:49:28.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.743+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'181 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fab2804a040 con 0x561966a8e6d0 2024-05-09T09:49:28.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.743+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa6dd0 con 0x561966a89dc0 2024-05-09T09:49:28.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.743+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'95 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fab2c10b030 con 0x561966a89dc0 2024-05-09T09:49:28.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.743+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa6dd0 con 0x561966a8e6d0 2024-05-09T09:49:28.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.747+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'94 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fab2804a040 con 0x561966a8e6d0 2024-05-09T09:49:28.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.747+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa6dd0 con 0x561966a89dc0 2024-05-09T09:49:28.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.747+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'180 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fab2c10b030 con 0x561966a89dc0 2024-05-09T09:49:28.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.747+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa6dd0 con 0x561966a8e6d0 2024-05-09T09:49:28.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.751+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'265 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fab2804a040 con 0x561966a8e6d0 2024-05-09T09:49:28.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.751+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa6dd0 con 0x561966a89dc0 2024-05-09T09:49:28.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.751+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'186 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fab2c10b030 con 0x561966a89dc0 2024-05-09T09:49:28.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.751+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa6dd0 con 0x7fab2801fc60 2024-05-09T09:49:28.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.755+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'99 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fab24036040 con 0x7fab2801fc60 2024-05-09T09:49:28.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.755+0000 7fa9e8fe1640 20 reqs_thread_entry: start 2024-05-09T09:49:28.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.755+0000 7fab3667f980 20 init_complete bucket index max shards: 11 2024-05-09T09:49:28.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.755+0000 7fa9e1ffb640 20 reqs_thread_entry: start 2024-05-09T09:49:28.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.755+0000 7fab3667f980 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-05-09T09:49:28.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.755+0000 7fab3667f980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.755+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561966ac27a0 con 0x561966a89dc0 2024-05-09T09:49:28.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.755+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(94 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7fab2c10b030 con 0x561966a89dc0 2024-05-09T09:49:28.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.755+0000 7fab3667f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.755+0000 7fab3667f980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-05-09T09:49:28.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.755+0000 7fab3667f980 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-05-09T09:49:28.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.755+0000 7fab3667f980 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-05-09T09:49:28.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.755+0000 7fab3667f980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.755+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:95 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561966ac27a0 con 0x561966a8e6d0 2024-05-09T09:49:28.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.755+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(95 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7fab2804a040 con 0x561966a8e6d0 2024-05-09T09:49:28.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.755+0000 7fab3667f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.755+0000 7fab3667f980 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-05-09T09:49:28.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.755+0000 7fab3667f980 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-05-09T09:49:28.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.755+0000 7fab3667f980 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-05-09T09:49:28.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.755+0000 7fab3667f980 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-05-09T09:49:28.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.755+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:96 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966ac5170 con 0x561966a89dc0 2024-05-09T09:49:28.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.759+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(96 system_user [delete,create,call,writefull 0~349] v32'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7fab2c10b030 con 0x561966a89dc0 2024-05-09T09:49:28.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.759+0000 7fab3667f980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-05-09T09:49:28.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.759+0000 7fab3667f980 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-05-09T09:49:28.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.759+0000 7fab3667f980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-05-09T09:49:28.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.759+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94667096734896 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561966ac5810 con 0x7fab2801fc60 2024-05-09T09:49:28.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.759+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== watch-notify(notify (1) cookie 94667096534288 notify 137438953495 ret 0) ==== 575+0+0 (crc 0 0 0) 0x561966aa54f0 con 0x7fab2801fc60 2024-05-09T09:49:28.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.759+0000 7faa127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 94667096534288 notifier 4852 bl.length()=533 2024-05-09T09:49:28.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.759+0000 7faa127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-05-09T09:49:28.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.759+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(97 notify.0 [notify cookie 94667096734896 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fab24036040 con 0x7fab2801fc60 2024-05-09T09:49:28.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.759+0000 7faa127fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-05-09T09:49:28.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.759+0000 7faa127fc640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:98 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa9f80056c0 con 0x7fab2801fc60 2024-05-09T09:49:28.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.759+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== watch-notify(notify_complete (2) cookie 94667096734896 notify 137438953495 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561966aa5150 con 0x7fab2801fc60 2024-05-09T09:49:28.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.759+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(98 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab24036040 con 0x7fab2801fc60 2024-05-09T09:49:28.762 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.759+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:99 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966ac5780 con 0x561966a8e6d0 2024-05-09T09:49:28.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.763+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(99 system_akey [delete,create,writefull 0~15] v32'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fab2804a040 con 0x561966a8e6d0 2024-05-09T09:49:28.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.763+0000 7fab3667f980 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-05-09T09:49:28.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.763+0000 7fab3667f980 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-05-09T09:49:28.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.763+0000 7fab3667f980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-05-09T09:49:28.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.763+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.0 7:05bf5b68:::notify.1:head [notify cookie 94667096741760 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561966ac5c40 con 0x561966a853d0 2024-05-09T09:49:28.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.763+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== watch-notify(notify (1) cookie 94667096532352 notify 137438953506 ret 0) ==== 218+0+0 (crc 0 0 0) 0x561966aa5150 con 0x561966a853d0 2024-05-09T09:49:28.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.763+0000 7faa127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953506 cookie 94667096532352 notifier 4852 bl.length()=176 2024-05-09T09:49:28.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.763+0000 7faa127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-05-09T09:49:28.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.763+0000 7faa127fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-05-09T09:49:28.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.763+0000 7faa127fc640 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:101 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa9f80056c0 con 0x561966a853d0 2024-05-09T09:49:28.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.763+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(100 notify.1 [notify cookie 94667096741760 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fab24036040 con 0x561966a853d0 2024-05-09T09:49:28.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.763+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== watch-notify(notify_complete (2) cookie 94667096741760 notify 137438953506 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561966aa59c0 con 0x561966a853d0 2024-05-09T09:49:28.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.763+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(101 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab24036040 con 0x561966a853d0 2024-05-09T09:49:28.765 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-05-09T09:49:28.759689Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:49:28.759661Z","tags":[],"group_ids":[]} 2024-05-09T09:49:28.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.763+0000 7fa9e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:28.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.763+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94667096554656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966aa3360 con 0x561966a853d0 2024-05-09T09:49:28.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.763+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(102 data_loggenerations_metadata [watch unwatch cookie 94667096554656] v32'439 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fab24036040 con 0x561966a853d0 2024-05-09T09:49:28.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.763+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:103 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94667096534288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966a97ca0 con 0x7fab2801fc60 2024-05-09T09:49:28.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.767+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(103 notify.0 [watch unwatch cookie 94667096534288] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab24036040 con 0x7fab2801fc60 2024-05-09T09:49:28.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.767+0000 7fab3667f980 20 remove_watcher() i=0 2024-05-09T09:49:28.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.767+0000 7fab3667f980 2 removed watcher, disabling cache 2024-05-09T09:49:28.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.767+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:104 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94667096532352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966a97ca0 con 0x561966a853d0 2024-05-09T09:49:28.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.767+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(104 notify.1 [watch unwatch cookie 94667096532352] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab24036040 con 0x561966a853d0 2024-05-09T09:49:28.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.767+0000 7fab3667f980 20 remove_watcher() i=1 2024-05-09T09:49:28.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.767+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:105 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94667096538144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966a92580 con 0x561966a8e6d0 2024-05-09T09:49:28.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.771+0000 7fab33999640 1 -- 172.21.15.157:0/3858139984 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== osd_op_reply(105 notify.2 [watch unwatch cookie 94667096538144] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab2804a040 con 0x561966a8e6d0 2024-05-09T09:49:28.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.771+0000 7fab3667f980 20 remove_watcher() i=2 2024-05-09T09:49:28.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.771+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:106 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94667096544416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966a97ca0 con 0x7fab2801fc60 2024-05-09T09:49:28.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.771+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.2 v2:172.21.15.157:6800/354455204 23 ==== osd_op_reply(106 notify.3 [watch unwatch cookie 94667096544416] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab24036040 con 0x7fab2801fc60 2024-05-09T09:49:28.772 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.771+0000 7fab3667f980 20 remove_watcher() i=3 2024-05-09T09:49:28.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.771+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94667096548640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966a93c20 con 0x561966a853d0 2024-05-09T09:49:28.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.775+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(107 notify.4 [watch unwatch cookie 94667096548640] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab24036040 con 0x561966a853d0 2024-05-09T09:49:28.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.775+0000 7fab3667f980 20 remove_watcher() i=4 2024-05-09T09:49:28.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.775+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:108 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94667096545664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966a92580 con 0x561966a89dc0 2024-05-09T09:49:28.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.775+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(108 notify.5 [watch unwatch cookie 94667096545664] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab2c10b030 con 0x561966a89dc0 2024-05-09T09:49:28.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.775+0000 7fab3667f980 20 remove_watcher() i=5 2024-05-09T09:49:28.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.775+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:109 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94667096540640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966a97ca0 con 0x561966a89dc0 2024-05-09T09:49:28.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(109 notify.6 [watch unwatch cookie 94667096540640] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab2c10b030 con 0x561966a89dc0 2024-05-09T09:49:28.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 20 remove_watcher() i=6 2024-05-09T09:49:28.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:110 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94667096556400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561966a96520 con 0x561966a89dc0 2024-05-09T09:49:28.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3419a640 1 -- 172.21.15.157:0/3858139984 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(110 notify.7 [watch unwatch cookie 94667096556400] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab2c10b030 con 0x561966a89dc0 2024-05-09T09:49:28.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 20 remove_watcher() i=7 2024-05-09T09:49:28.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561966a89dc0 msgr2=0x561966a8c1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 1 --2- 172.21.15.157:0/3858139984 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561966a89dc0 0x561966a8c1b0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561966a853d0 msgr2=0x561966a87890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 1 --2- 172.21.15.157:0/3858139984 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561966a853d0 0x561966a87890 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fab2801fc60 msgr2=0x7fab2803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 1 --2- 172.21.15.157:0/3858139984 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fab2801fc60 0x7fab2803a3c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561966a8e6d0 msgr2=0x561966a90b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 1 --2- 172.21.15.157:0/3858139984 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561966a8e6d0 0x561966a90b00 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa9fc034c00 msgr2=0x7fa9fc0370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 1 --2- 172.21.15.157:0/3858139984 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa9fc034c00 0x7fa9fc0370c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x561966a3eb50 tx=0x7fab28010000 comp rx=0 tx=0).stop 2024-05-09T09:49:28.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561966a71660 msgr2=0x561966a789c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3499b640 1 -- 172.21.15.157:0/3858139984 reap_dead start 2024-05-09T09:49:28.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 1 --2- 172.21.15.157:0/3858139984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561966a71660 0x561966a789c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fab2c0e5140 tx=0x7fab2c0db1c0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 shutdown_connections 2024-05-09T09:49:28.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 1 --2- 172.21.15.157:0/3858139984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561966a71660 0x561966a789c0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 >> 172.21.15.157:0/3858139984 conn(0x561966a6d9e0 msgr2=0x561966a6b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:28.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 shutdown_connections 2024-05-09T09:49:28.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 1 -- 172.21.15.157:0/3858139984 wait complete. 2024-05-09T09:49:28.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 1 -- 172.21.15.157:0/3060898474 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7faa0c034bb0 msgr2=0x7faa0c037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 1 --2- 172.21.15.157:0/3060898474 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7faa0c034bb0 0x7faa0c037070 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x561966a32c10 tx=0x7fab2800f000 comp rx=0 tx=0).stop 2024-05-09T09:49:28.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 1 -- 172.21.15.157:0/3060898474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561966a64630 msgr2=0x561966a64a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 1 --2- 172.21.15.157:0/3060898474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561966a64630 0x561966a64a50 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fab2c0e3bc0 tx=0x7fab2c0b4d30 comp rx=0 tx=0).stop 2024-05-09T09:49:28.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 1 -- 172.21.15.157:0/3060898474 shutdown_connections 2024-05-09T09:49:28.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 1 --2- 172.21.15.157:0/3060898474 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7faa0c034bb0 0x7faa0c037070 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 1 --2- 172.21.15.157:0/3060898474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561966a64630 0x561966a64a50 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 1 -- 172.21.15.157:0/3060898474 >> 172.21.15.157:0/3060898474 conn(0x561966a59400 msgr2=0x561966a59f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:28.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 1 -- 172.21.15.157:0/3060898474 shutdown_connections 2024-05-09T09:49:28.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.779+0000 7fab3667f980 1 -- 172.21.15.157:0/3060898474 wait complete. 2024-05-09T09:49:28.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.783+0000 7fab3667f980 1 -- 172.21.15.157:0/4054417564 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561966a37bc0 msgr2=0x561966a3a050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.783+0000 7fab3667f980 1 --2- 172.21.15.157:0/4054417564 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561966a37bc0 0x561966a3a050 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.783+0000 7fab3667f980 1 -- 172.21.15.157:0/4054417564 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56196693c3f0 msgr2=0x561966a35370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.783+0000 7fab3667f980 1 --2- 172.21.15.157:0/4054417564 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56196693c3f0 0x561966a35370 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.783+0000 7fab3667f980 1 -- 172.21.15.157:0/4054417564 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561966a3bc40 msgr2=0x561966a3e030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.783+0000 7fab3667f980 1 --2- 172.21.15.157:0/4054417564 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561966a3bc40 0x561966a3e030 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.783+0000 7fab3667f980 1 -- 172.21.15.157:0/4054417564 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7faa1c034bb0 msgr2=0x7faa1c037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.783+0000 7fab3667f980 1 --2- 172.21.15.157:0/4054417564 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7faa1c034bb0 0x7faa1c037070 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fab28001e50 tx=0x7fab280013b0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.783+0000 7fab3667f980 1 -- 172.21.15.157:0/4054417564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56196693bad0 msgr2=0x561966a2e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.783+0000 7fab3667f980 1 --2- 172.21.15.157:0/4054417564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56196693bad0 0x561966a2e430 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fab2c000f90 tx=0x7fab2c017e30 comp rx=0 tx=0).stop 2024-05-09T09:49:28.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.783+0000 7fab3499b640 1 -- 172.21.15.157:0/4054417564 reap_dead start 2024-05-09T09:49:28.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.783+0000 7fab3667f980 1 -- 172.21.15.157:0/4054417564 shutdown_connections 2024-05-09T09:49:28.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.783+0000 7fab3667f980 1 -- 172.21.15.157:0/4054417564 >> 172.21.15.157:0/4054417564 conn(0x5619668af1f0 msgr2=0x561966a21a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:28.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.783+0000 7fab3667f980 1 -- 172.21.15.157:0/4054417564 shutdown_connections 2024-05-09T09:49:28.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.783+0000 7fab3667f980 1 -- 172.21.15.157:0/4054417564 wait complete. 2024-05-09T09:49:28.793 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-05-09T09:49:28.759689Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:49:28.759661Z', 'tags': [], 'group_ids': []} 2024-05-09T09:49:28.793 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-05-09T09:49:28.759689Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:49:28.759661Z', 'tags': [], 'group_ids': []} 2024-05-09T09:49:28.793 ERROR:root:0 2024-05-09T09:49:28.794 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-09T09:49:28.798 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-09T09:49:28.799 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-05-09T09:49:28.799 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-05-09T09:49:28.799 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-05-09T09:49:28.866 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:49:28.866 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:49:28.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.867+0000 7f1014060980 1 Processor -- start 2024-05-09T09:49:28.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.867+0000 7f1014060980 1 -- start start 2024-05-09T09:49:28.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.867+0000 7f1014060980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55a63eb69800 0x55a63eb69be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.867+0000 7f1014060980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a63ea20440 con 0x55a63eb6a120 2024-05-09T09:49:28.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.867+0000 7f1014060980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55a63ea0b5f0 con 0x55a63eb69800 2024-05-09T09:49:28.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.867+0000 7f1011b7b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55a63eb69800 0x55a63eb69be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.867+0000 7f1011b7b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55a63eb69800 0x55a63eb69be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39162/0 (socket says 172.21.15.157:39162) 2024-05-09T09:49:28.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.867+0000 7f1011b7b640 1 -- 172.21.15.157:0/1957740843 learned_addr learned my addr 172.21.15.157:0/1957740843 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:28.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.867+0000 7f1011b7b640 1 -- 172.21.15.157:0/1957740843 >> v1:172.21.15.110:6789/0 conn(0x55a63eb6a120 legacy=0x55a63eb6ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.867+0000 7f1011b7b640 1 -- 172.21.15.157:0/1957740843 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a63ea16990 con 0x55a63eb69800 2024-05-09T09:49:28.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.871+0000 7f1011b7b640 1 --2- 172.21.15.157:0/1957740843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eb69800 0x55a63eb69be0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f100c00a750 tx=0x7f100c01d200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65962316315c16ce server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.871+0000 7f1010b79640 1 -- 172.21.15.157:0/1957740843 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f100c0b1070 con 0x55a63eb69800 2024-05-09T09:49:28.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.871+0000 7f1010b79640 1 -- 172.21.15.157:0/1957740843 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f100c0a5e50 con 0x55a63eb69800 2024-05-09T09:49:28.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.871+0000 7f1010b79640 1 -- 172.21.15.157:0/1957740843 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f100c00a350 con 0x55a63eb69800 2024-05-09T09:49:28.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.871+0000 7f1014060980 1 -- 172.21.15.157:0/1957740843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eb69800 msgr2=0x55a63eb69be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.871+0000 7f1014060980 1 --2- 172.21.15.157:0/1957740843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eb69800 0x55a63eb69be0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f100c00a750 tx=0x7f100c01d200 comp rx=0 tx=0).stop 2024-05-09T09:49:28.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.871+0000 7f1014060980 1 -- 172.21.15.157:0/1957740843 shutdown_connections 2024-05-09T09:49:28.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.871+0000 7f1014060980 1 --2- 172.21.15.157:0/1957740843 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eb69800 0x55a63eb69be0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.871+0000 7f1014060980 1 -- 172.21.15.157:0/1957740843 >> 172.21.15.157:0/1957740843 conn(0x55a63eb650d0 msgr2=0x55a63eb674f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:28.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.871+0000 7f1014060980 1 -- 172.21.15.157:0/1957740843 shutdown_connections 2024-05-09T09:49:28.872 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.871+0000 7f1014060980 1 -- 172.21.15.157:0/1957740843 wait complete. 2024-05-09T09:49:28.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.883+0000 7f1014060980 1 Processor -- start 2024-05-09T09:49:28.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.883+0000 7f1014060980 1 -- start start 2024-05-09T09:49:28.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.883+0000 7f1014060980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eb69800 0x55a63ec58550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.883+0000 7f1014060980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55a63ea6dfe0 con 0x55a63eb69800 2024-05-09T09:49:28.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.883+0000 7f1011b7b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eb69800 0x55a63ec58550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.883+0000 7f1011b7b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eb69800 0x55a63ec58550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39176/0 (socket says 172.21.15.157:39176) 2024-05-09T09:49:28.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.883+0000 7f1011b7b640 1 -- 172.21.15.157:0/1360735183 learned_addr learned my addr 172.21.15.157:0/1360735183 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:28.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.887+0000 7f1011b7b640 1 -- 172.21.15.157:0/1360735183 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a63e9f2ae0 con 0x55a63eb69800 2024-05-09T09:49:28.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.887+0000 7f1011b7b640 1 --2- 172.21.15.157:0/1360735183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eb69800 0x55a63ec58550 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f100c0af040 tx=0x7f100c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dff907ad2d00b29 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.887+0000 7f0effe07640 1 -- 172.21.15.157:0/1360735183 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f100c0ba070 con 0x55a63eb69800 2024-05-09T09:49:28.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.887+0000 7f0effe07640 1 -- 172.21.15.157:0/1360735183 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f100c0b5440 con 0x55a63eb69800 2024-05-09T09:49:28.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.887+0000 7f0effe07640 1 -- 172.21.15.157:0/1360735183 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f100c0b1040 con 0x55a63eb69800 2024-05-09T09:49:28.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.887+0000 7f1014060980 1 -- 172.21.15.157:0/1360735183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eb69800 msgr2=0x55a63ec58550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.887+0000 7f1014060980 1 --2- 172.21.15.157:0/1360735183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eb69800 0x55a63ec58550 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f100c0af040 tx=0x7f100c003030 comp rx=0 tx=0).stop 2024-05-09T09:49:28.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.887+0000 7f1014060980 1 -- 172.21.15.157:0/1360735183 shutdown_connections 2024-05-09T09:49:28.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.887+0000 7f1014060980 1 --2- 172.21.15.157:0/1360735183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eb69800 0x55a63ec58550 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.887+0000 7f1014060980 1 -- 172.21.15.157:0/1360735183 >> 172.21.15.157:0/1360735183 conn(0x55a63eb650d0 msgr2=0x55a63ec4fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:28.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.887+0000 7f1014060980 1 -- 172.21.15.157:0/1360735183 shutdown_connections 2024-05-09T09:49:28.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.887+0000 7f1014060980 1 -- 172.21.15.157:0/1360735183 wait complete. 2024-05-09T09:49:28.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.887+0000 7f1014060980 1 Processor -- start 2024-05-09T09:49:28.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.887+0000 7f1014060980 1 -- start start 2024-05-09T09:49:28.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.887+0000 7f1014060980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eb69800 0x55a63ec5f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.887+0000 7f1014060980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55a63eade970 con 0x55a63eb69800 2024-05-09T09:49:28.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.887+0000 7f1011b7b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eb69800 0x55a63ec5f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.887+0000 7f1011b7b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eb69800 0x55a63ec5f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39180/0 (socket says 172.21.15.157:39180) 2024-05-09T09:49:28.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.887+0000 7f1011b7b640 1 -- 172.21.15.157:0/1640001690 learned_addr learned my addr 172.21.15.157:0/1640001690 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:28.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.887+0000 7f1011b7b640 1 -- 172.21.15.157:0/1640001690 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a63ec5fb40 con 0x55a63eb69800 2024-05-09T09:49:28.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.887+0000 7f1011b7b640 1 --2- 172.21.15.157:0/1640001690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eb69800 0x55a63ec5f600 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f100c01daa0 tx=0x7f100c019fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.891+0000 7f0efe604640 1 -- 172.21.15.157:0/1640001690 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f100c0b1050 con 0x55a63eb69800 2024-05-09T09:49:28.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.891+0000 7f0efe604640 1 -- 172.21.15.157:0/1640001690 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f100c0be430 con 0x55a63eb69800 2024-05-09T09:49:28.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.891+0000 7f1014060980 1 -- 172.21.15.157:0/1640001690 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a63ec5fdd0 con 0x55a63eb69800 2024-05-09T09:49:28.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.891+0000 7f1014060980 1 -- 172.21.15.157:0/1640001690 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a63ec62ab0 con 0x55a63eb69800 2024-05-09T09:49:28.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.891+0000 7f0efe604640 1 -- 172.21.15.157:0/1640001690 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f100c0ba040 con 0x55a63eb69800 2024-05-09T09:49:28.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.891+0000 7f0efe604640 1 -- 172.21.15.157:0/1640001690 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f100c0be710 con 0x55a63eb69800 2024-05-09T09:49:28.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.891+0000 7f0efe604640 1 --2- 172.21.15.157:0/1640001690 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0ef8034bb0 0x7f0ef8037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.891+0000 7f0efe604640 1 -- 172.21.15.157:0/1640001690 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f100c0e4860 con 0x55a63eb69800 2024-05-09T09:49:28.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.891+0000 7f101137a640 1 --2- 172.21.15.157:0/1640001690 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0ef8034bb0 0x7f0ef8037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.891+0000 7f1014060980 1 --2- 172.21.15.157:0/1640001690 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55a63eb6a120 0x55a63ec66590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.891+0000 7f1014060980 1 -- 172.21.15.157:0/1640001690 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a63ec66c00 con 0x55a63eb6a120 2024-05-09T09:49:28.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.891+0000 7f101237c640 1 --2- 172.21.15.157:0/1640001690 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55a63eb6a120 0x55a63ec66590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.891+0000 7f101137a640 1 --2- 172.21.15.157:0/1640001690 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0ef8034bb0 0x7f0ef8037070 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc001e20 tx=0x7f0ffc0013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.891+0000 7f101237c640 1 --2- 172.21.15.157:0/1640001690 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55a63eb6a120 0x55a63ec66590 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.891+0000 7f101237c640 1 -- 172.21.15.157:0/1640001690 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63eb6a120 2024-05-09T09:49:28.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.891+0000 7f1014060980 1 -- 172.21.15.157:0/1640001690 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a63ec63cd0 con 0x55a63eb6a120 2024-05-09T09:49:28.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.895+0000 7f101237c640 1 -- 172.21.15.157:0/1640001690 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63eb6a120 2024-05-09T09:49:28.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.895+0000 7f1014060980 1 --2- 172.21.15.157:0/1640001690 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55a63ec68f50 0x55a63ec6b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.895+0000 7f1014060980 1 -- 172.21.15.157:0/1640001690 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a63ec6ba10 con 0x55a63ec68f50 2024-05-09T09:49:28.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.895+0000 7f1011b7b640 1 --2- 172.21.15.157:0/1640001690 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55a63ec68f50 0x55a63ec6b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.895+0000 7f1011b7b640 1 --2- 172.21.15.157:0/1640001690 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55a63ec68f50 0x55a63ec6b340 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.895+0000 7f1011b7b640 1 -- 172.21.15.157:0/1640001690 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ec68f50 2024-05-09T09:49:28.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.895+0000 7f1014060980 1 -- 172.21.15.157:0/1640001690 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a63ec67df0 con 0x55a63eb6a120 2024-05-09T09:49:28.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.895+0000 7f101237c640 1 -- 172.21.15.157:0/1640001690 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63eb6a120 2024-05-09T09:49:28.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.895+0000 7f1014060980 1 --2- 172.21.15.157:0/1640001690 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55a63ec6ce70 0x55a63ec6f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.895+0000 7f1014060980 1 -- 172.21.15.157:0/1640001690 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a63ec6f9a0 con 0x55a63ec6ce70 2024-05-09T09:49:28.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.895+0000 7f101137a640 1 --2- 172.21.15.157:0/1640001690 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55a63ec6ce70 0x55a63ec6f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.895+0000 7f101137a640 1 --2- 172.21.15.157:0/1640001690 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55a63ec6ce70 0x55a63ec6f260 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.895+0000 7f101137a640 1 -- 172.21.15.157:0/1640001690 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0ffc00d040 con 0x55a63ec6ce70 2024-05-09T09:49:28.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.899+0000 7f1014060980 1 Processor -- start 2024-05-09T09:49:28.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.899+0000 7f1014060980 1 -- start start 2024-05-09T09:49:28.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.899+0000 7f1014060980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63ec95830 0x55a63ec95c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.899+0000 7f1014060980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55a63ea72020 con 0x55a63ec95830 2024-05-09T09:49:28.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.899+0000 7f1011b7b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63ec95830 0x55a63ec95c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.899+0000 7f1011b7b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63ec95830 0x55a63ec95c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39188/0 (socket says 172.21.15.157:39188) 2024-05-09T09:49:28.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.899+0000 7f1011b7b640 1 -- 172.21.15.157:0/131405517 learned_addr learned my addr 172.21.15.157:0/131405517 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:28.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.899+0000 7f1011b7b640 1 -- 172.21.15.157:0/131405517 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a63ec96190 con 0x55a63ec95830 2024-05-09T09:49:28.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.899+0000 7f1011b7b640 1 --2- 172.21.15.157:0/131405517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63ec95830 0x55a63ec95c50 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f100c0e2bb0 tx=0x7f100c0c9e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.903+0000 7f0ef63a1640 1 -- 172.21.15.157:0/131405517 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f100c0c7c50 con 0x55a63ec95830 2024-05-09T09:49:28.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.903+0000 7f1014060980 1 -- 172.21.15.157:0/131405517 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a63ec96c20 con 0x55a63ec95830 2024-05-09T09:49:28.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.903+0000 7f1014060980 1 -- 172.21.15.157:0/131405517 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a63ec96c20 con 0x55a63ec95830 2024-05-09T09:49:28.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.903+0000 7f0ef63a1640 1 -- 172.21.15.157:0/131405517 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f100c0c7df0 con 0x55a63ec95830 2024-05-09T09:49:28.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.903+0000 7f0ef63a1640 1 -- 172.21.15.157:0/131405517 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f100c0c6850 con 0x55a63ec95830 2024-05-09T09:49:28.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.903+0000 7f0ef63a1640 1 -- 172.21.15.157:0/131405517 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f100c0e1460 con 0x55a63ec95830 2024-05-09T09:49:28.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.903+0000 7f0ef63a1640 1 --2- 172.21.15.157:0/131405517 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0eec034bb0 0x7f0eec037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.903+0000 7f0ef63a1640 1 -- 172.21.15.157:0/131405517 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f100c0dd070 con 0x55a63ec95830 2024-05-09T09:49:28.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.903+0000 7f101137a640 1 --2- 172.21.15.157:0/131405517 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0eec034bb0 0x7f0eec037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.903+0000 7f1014060980 1 Processor -- start 2024-05-09T09:49:28.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.903+0000 7f1014060980 1 -- start start 2024-05-09T09:49:28.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.903+0000 7f101137a640 1 --2- 172.21.15.157:0/131405517 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0eec034bb0 0x7f0eec037070 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55a63ec67500 tx=0x7f0ffc006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.903+0000 7f1014060980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eca2680 0x55a63eca2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.903+0000 7f1014060980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55a63ec58c40 con 0x55a63eca2680 2024-05-09T09:49:28.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.903+0000 7f1011b7b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eca2680 0x55a63eca2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.903+0000 7f1011b7b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eca2680 0x55a63eca2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39202/0 (socket says 172.21.15.157:39202) 2024-05-09T09:49:28.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.903+0000 7f1011b7b640 1 -- 172.21.15.157:0/452135547 learned_addr learned my addr 172.21.15.157:0/452135547 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:28.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.903+0000 7f1011b7b640 1 -- 172.21.15.157:0/452135547 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a63eca3030 con 0x55a63eca2680 2024-05-09T09:49:28.907 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.903+0000 7f1011b7b640 1 --2- 172.21.15.157:0/452135547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eca2680 0x55a63eca2a60 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f100c0bdc40 tx=0x7f100c0c55f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a6cf77d264d833 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.903+0000 7f0ee3fff640 1 -- 172.21.15.157:0/452135547 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f100c0c5950 con 0x55a63eca2680 2024-05-09T09:49:28.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.903+0000 7f0ee3fff640 1 -- 172.21.15.157:0/452135547 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f100c0e4050 con 0x55a63eca2680 2024-05-09T09:49:28.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.903+0000 7f0ee3fff640 1 -- 172.21.15.157:0/452135547 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f100c0beaa0 con 0x55a63eca2680 2024-05-09T09:49:28.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f1014060980 1 -- 172.21.15.157:0/452135547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eca2680 msgr2=0x55a63eca2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:28.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f1014060980 1 --2- 172.21.15.157:0/452135547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eca2680 0x55a63eca2a60 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f100c0bdc40 tx=0x7f100c0c55f0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f1014060980 1 -- 172.21.15.157:0/452135547 shutdown_connections 2024-05-09T09:49:28.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f1014060980 1 --2- 172.21.15.157:0/452135547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eca2680 0x55a63eca2a60 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:28.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f1014060980 1 -- 172.21.15.157:0/452135547 >> 172.21.15.157:0/452135547 conn(0x55a63ec9ea00 msgr2=0x55a63ec9ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:28.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f1014060980 1 -- 172.21.15.157:0/452135547 shutdown_connections 2024-05-09T09:49:28.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f1014060980 1 -- 172.21.15.157:0/452135547 wait complete. 2024-05-09T09:49:28.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f1014060980 1 Processor -- start 2024-05-09T09:49:28.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f1014060980 1 -- start start 2024-05-09T09:49:28.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f1014060980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eca2680 0x55a63eca99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f1014060980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55a63eca3740 con 0x55a63eca2680 2024-05-09T09:49:28.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f1011b7b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eca2680 0x55a63eca99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f1011b7b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eca2680 0x55a63eca99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39218/0 (socket says 172.21.15.157:39218) 2024-05-09T09:49:28.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 learned_addr learned my addr 172.21.15.157:0/2385230208 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:28.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a63eca9f30 con 0x55a63eca2680 2024-05-09T09:49:28.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f1011b7b640 1 --2- 172.21.15.157:0/2385230208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eca2680 0x55a63eca99f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f100c0acc40 tx=0x7f100c0cad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f0ee27fc640 1 -- 172.21.15.157:0/2385230208 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f100c0b43a0 con 0x55a63eca2680 2024-05-09T09:49:28.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a63eca9f30 con 0x55a63eca2680 2024-05-09T09:49:28.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a63ecaa3b0 con 0x55a63eca2680 2024-05-09T09:49:28.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f0ee27fc640 1 -- 172.21.15.157:0/2385230208 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f100c0b4540 con 0x55a63eca2680 2024-05-09T09:49:28.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f0ee27fc640 1 -- 172.21.15.157:0/2385230208 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f100c0d5860 con 0x55a63eca2680 2024-05-09T09:49:28.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f0ee27fc640 1 -- 172.21.15.157:0/2385230208 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f100c0d5a00 con 0x55a63eca2680 2024-05-09T09:49:28.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f0ee27fc640 1 --2- 172.21.15.157:0/2385230208 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0edc034bb0 0x7f0edc037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f0ee27fc640 1 -- 172.21.15.157:0/2385230208 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f100c0fd070 con 0x55a63eca2680 2024-05-09T09:49:28.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f101137a640 1 --2- 172.21.15.157:0/2385230208 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0edc034bb0 0x7f0edc037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f1014060980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f1014060980 1 --2- 172.21.15.157:0/2385230208 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55a63ecb63c0 0x55a63ecb8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecb8fd0 con 0x55a63ecb63c0 2024-05-09T09:49:28.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f101237c640 1 --2- 172.21.15.157:0/2385230208 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55a63ecb63c0 0x55a63ecb8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.907+0000 7f101137a640 1 --2- 172.21.15.157:0/2385230208 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0edc034bb0 0x7f0edc037070 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x55a63ec68190 tx=0x7f0ffc011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f101237c640 1 --2- 172.21.15.157:0/2385230208 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55a63ecb63c0 0x55a63ecb8880 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:28.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f1014060980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f1014060980 20 realm 2024-05-09T09:49:28.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f1014060980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecb93e0 con 0x55a63ecb63c0 2024-05-09T09:49:28.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:28.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f1014060980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f1014060980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:49:28.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f1014060980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecb9cb0 con 0x55a63ecb63c0 2024-05-09T09:49:28.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:28.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f1014060980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f1014060980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x55a63ecb63c0 2024-05-09T09:49:28.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:28.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f1014060980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:28.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f1014060980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f1014060980 1 --2- 172.21.15.157:0/2385230208 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55a63ecbadb0 0x55a63ecbd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecbd7b0 con 0x55a63ecbadb0 2024-05-09T09:49:28.915 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f1011b7b640 1 --2- 172.21.15.157:0/2385230208 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55a63ecbadb0 0x55a63ecbd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f1011b7b640 1 --2- 172.21.15.157:0/2385230208 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55a63ecbadb0 0x55a63ecbd1a0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:28.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f1014060980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:49:28.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f1014060980 20 searching for the correct realm 2024-05-09T09:49:28.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f1014060980 1 --2- 172.21.15.157:0/2385230208 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55a63ecbf690 0x55a63ecc1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecc2140 con 0x55a63ecbf690 2024-05-09T09:49:28.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f101137a640 1 --2- 172.21.15.157:0/2385230208 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55a63ecbf690 0x55a63ecc1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f101137a640 1 --2- 172.21.15.157:0/2385230208 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55a63ecbf690 0x55a63ecc1ac0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ffc036040 con 0x55a63ecbf690 2024-05-09T09:49:28.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f101137a640 1 --2- 172.21.15.157:0/2385230208 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f0ffc00f3d0 0x7f0ffc00f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:28.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecc2140 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.911+0000 7f101237c640 1 --2- 172.21.15.157:0/2385230208 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f0ffc00f3d0 0x7f0ffc00f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:28.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.915+0000 7f101237c640 1 --2- 172.21.15.157:0/2385230208 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f0ffc00f3d0 0x7f0ffc00f7f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:28.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.915+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f100400a4d0 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.915+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x55a63ecbadb0 2024-05-09T09:49:28.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.915+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:28.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.915+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x55a63ecb63c0 2024-05-09T09:49:28.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.915+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:28.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.915+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x55a63ecb63c0 2024-05-09T09:49:28.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.915+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:28.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.915+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x55a63ecbadb0 2024-05-09T09:49:28.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.915+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:28.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.915+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x55a63ecbadb0 2024-05-09T09:49:28.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.915+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:28.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.915+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.915+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f100400a4d0 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.915+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x55a63ecbf690 2024-05-09T09:49:28.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.915+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ffc036040 con 0x55a63ecbf690 2024-05-09T09:49:28.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.915+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x55a63ecb63c0 2024-05-09T09:49:28.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.915+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:28.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.915+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x55a63ecbadb0 2024-05-09T09:49:28.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.919+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:28.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.919+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x55a63ecb63c0 2024-05-09T09:49:28.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.919+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:28.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.919+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.919+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f100400a4d0 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.919+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x55a63ecbf690 2024-05-09T09:49:28.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.919+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ffc036040 con 0x55a63ecbf690 2024-05-09T09:49:28.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.919+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x55a63ecbf690 2024-05-09T09:49:28.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.919+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0ffc036040 con 0x55a63ecbf690 2024-05-09T09:49:28.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.919+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x55a63ecbadb0 2024-05-09T09:49:28.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.919+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:28.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.919+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x55a63ecbf690 2024-05-09T09:49:28.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.919+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ffc036040 con 0x55a63ecbf690 2024-05-09T09:49:28.925 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.919+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x55a63ecbf690 2024-05-09T09:49:28.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.919+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ffc036040 con 0x55a63ecbf690 2024-05-09T09:49:28.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.919+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x55a63ecb63c0 2024-05-09T09:49:28.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.919+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:28.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.919+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x55a63ecb63c0 2024-05-09T09:49:28.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.919+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:28.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.919+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x55a63ecbadb0 2024-05-09T09:49:28.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.919+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:28.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.919+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x55a63ecbf690 2024-05-09T09:49:28.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.919+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ffc036040 con 0x55a63ecbf690 2024-05-09T09:49:28.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.919+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f100400a4d0 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x55a63ecb63c0 2024-05-09T09:49:28.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:28.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x55a63ecbadb0 2024-05-09T09:49:28.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:28.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x55a63ecbf690 2024-05-09T09:49:28.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ffc036040 con 0x55a63ecbf690 2024-05-09T09:49:28.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x55a63ecbadb0 2024-05-09T09:49:28.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:28.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f100400a4d0 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x55a63ecbf690 2024-05-09T09:49:28.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ffc048040 con 0x55a63ecbf690 2024-05-09T09:49:28.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x55a63ecbadb0 2024-05-09T09:49:28.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:28.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x55a63ecb63c0 2024-05-09T09:49:28.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:28.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecba050 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f100400a4d0 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f1014060980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:49:28.931 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f1014060980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:49:28.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f1014060980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:49:28.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f1014060980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:49:28.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f1014060980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:49:28.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f1014060980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:49:28.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f1014060980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecbe000 con 0x55a63ecb63c0 2024-05-09T09:49:28.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:28.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f1014060980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f1014060980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.923+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecbe000 con 0x55a63ecb63c0 2024-05-09T09:49:28.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:28.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f1014060980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:28.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f1014060980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecbe000 con 0x55a63ecbf690 2024-05-09T09:49:28.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0ffc048040 con 0x55a63ecbf690 2024-05-09T09:49:28.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f1014060980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:49:28.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f1014060980 20 zone default found 2024-05-09T09:49:28.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f1014060980 4 Realm: () 2024-05-09T09:49:28.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f1014060980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:49:28.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f1014060980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:49:28.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f1014060980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:49:28.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f1014060980 20 zonegroup default 2024-05-09T09:49:28.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f1014060980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecbe9a0 con 0x55a63ecbadb0 2024-05-09T09:49:28.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:28.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f1014060980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f1014060980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecc4020 con 0x55a63ecbf690 2024-05-09T09:49:28.933 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0ffc048040 con 0x55a63ecbf690 2024-05-09T09:49:28.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f1014060980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f1014060980 20 rados->read ofs=0 len=0 2024-05-09T09:49:28.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecc4510 con 0x55a63ecbf690 2024-05-09T09:49:28.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0ffc048040 con 0x55a63ecbf690 2024-05-09T09:49:28.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f1014060980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:28.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f1014060980 20 started sync module instance, tier type = 2024-05-09T09:49:28.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f1014060980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:49:28.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecc3440 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94172506503488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecc3440 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.927+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecc5050 con 0x55a63ecb63c0 2024-05-09T09:49:28.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.931+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94172506503488] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.931+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:28.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.931+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94172506508096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecc3440 con 0x55a63ecb63c0 2024-05-09T09:49:28.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.931+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecc5a60 con 0x55a63ecbf690 2024-05-09T09:49:28.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.931+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ffc048040 con 0x55a63ecbf690 2024-05-09T09:49:28.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.931+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94172506510768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecc6300 con 0x55a63ecbf690 2024-05-09T09:49:28.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.931+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecc6d20 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.935+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94172506508096] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:28.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.935+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.935+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94172506515472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecc6ce0 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.935+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecc7730 con 0x55a63ecb63c0 2024-05-09T09:49:28.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.935+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94172506510768] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ffc048040 con 0x55a63ecbf690 2024-05-09T09:49:28.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.935+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94172506515472] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.935+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:28.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.935+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94172506501008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecc7280 con 0x55a63ecb63c0 2024-05-09T09:49:28.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.935+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecc7ad0 con 0x55a63ecbadb0 2024-05-09T09:49:28.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.939+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94172506501008] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:28.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.939+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:28.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.939+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94172506518144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecc76a0 con 0x55a63ecbadb0 2024-05-09T09:49:28.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.939+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecc87d0 con 0x55a63ecbadb0 2024-05-09T09:49:28.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.939+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:28.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.939+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94172506524528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecc9440 con 0x55a63ecbadb0 2024-05-09T09:49:28.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.939+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecc9eb0 con 0x55a63ecbadb0 2024-05-09T09:49:28.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.939+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94172506518144] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:28.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.943+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94172506524528] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:28.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.943+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:28.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.943+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94172506528128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecc8f90 con 0x55a63ecbadb0 2024-05-09T09:49:28.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.943+0000 7f1014060980 20 add_watcher() i=0 2024-05-09T09:49:28.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.943+0000 7f1014060980 20 add_watcher() i=1 2024-05-09T09:49:28.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.943+0000 7f1014060980 20 add_watcher() i=2 2024-05-09T09:49:28.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.943+0000 7f1014060980 20 add_watcher() i=3 2024-05-09T09:49:28.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.943+0000 7f1014060980 20 add_watcher() i=4 2024-05-09T09:49:28.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.943+0000 7f1014060980 20 add_watcher() i=5 2024-05-09T09:49:28.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.943+0000 7f1014060980 20 add_watcher() i=6 2024-05-09T09:49:28.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.943+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94172506528128] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:28.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.943+0000 7f1014060980 20 add_watcher() i=7 2024-05-09T09:49:28.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.943+0000 7f1014060980 2 all 8 watchers are set, enabling cache 2024-05-09T09:49:28.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.943+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecccfb0 con 0x55a63ecb63c0 2024-05-09T09:49:28.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.943+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:28.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.943+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94172506521200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecca430 con 0x55a63ecb63c0 2024-05-09T09:49:28.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.947+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94172506521200] v32'440 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:28.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.947+0000 7f0ec6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:28.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.947+0000 7f1014060980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:49:28.947 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.947+0000 7f1014060980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:49:28.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.947+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd5790 con 0x55a63ecb63c0 2024-05-09T09:49:28.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.947+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'101 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:28.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.947+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd5e60 con 0x55a63ecbadb0 2024-05-09T09:49:28.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.951+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'96 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:28.951 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.951+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd5e60 con 0x55a63ecbf690 2024-05-09T09:49:28.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.951+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'95 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0ffc048040 con 0x55a63ecbf690 2024-05-09T09:49:28.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.951+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd6450 con 0x55a63ecb63c0 2024-05-09T09:49:28.953 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.951+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'441 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:28.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.951+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd6900 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.955+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'272 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.955 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.955+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd6e70 con 0x55a63ecbf690 2024-05-09T09:49:28.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.955+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'182 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0ffc048040 con 0x55a63ecbf690 2024-05-09T09:49:28.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.955+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd7320 con 0x55a63ecb63c0 2024-05-09T09:49:28.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.955+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'96 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:28.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.955+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd7320 con 0x55a63ecbadb0 2024-05-09T09:49:28.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.959+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'181 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:28.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.959+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd7320 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.963+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'94 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.963+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd7450 con 0x55a63ecbf690 2024-05-09T09:49:28.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.963+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'100 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0ffc048040 con 0x55a63ecbf690 2024-05-09T09:49:28.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.963+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd7a80 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.963+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'273 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.963+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd7a80 con 0x55a63ecbadb0 2024-05-09T09:49:28.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.967+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'100 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:28.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.967+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd7a80 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.967+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'94 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.967+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd7a80 con 0x55a63ecbadb0 2024-05-09T09:49:28.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.967+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'187 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:28.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.967+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd7a80 con 0x55a63ecb63c0 2024-05-09T09:49:28.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.971+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'442 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:28.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.971+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd7a80 con 0x55a63ecbf690 2024-05-09T09:49:28.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.971+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'266 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ffc048040 con 0x55a63ecbf690 2024-05-09T09:49:28.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.971+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd7d60 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.975+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'274 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.975+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd7d60 con 0x55a63ecbf690 2024-05-09T09:49:28.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.975+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'94 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ffc048040 con 0x55a63ecbf690 2024-05-09T09:49:28.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.975+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd7d60 con 0x55a63ecb63c0 2024-05-09T09:49:28.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.979+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'102 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:28.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.979+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd7d60 con 0x55a63ecb63c0 2024-05-09T09:49:28.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.979+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'443 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:28.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.979+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd7d60 con 0x55a63ecbf690 2024-05-09T09:49:28.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.979+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'267 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ffc048040 con 0x55a63ecbf690 2024-05-09T09:49:28.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.983+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd7d60 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.983+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'106 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x7f0ffc00f3d0 2024-05-09T09:49:28.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.983+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd7d60 con 0x55a63ecbf690 2024-05-09T09:49:28.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.983+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'96 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ffc048040 con 0x55a63ecbf690 2024-05-09T09:49:28.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.983+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd7d60 con 0x55a63ecbf690 2024-05-09T09:49:28.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.983+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'100 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ffc048040 con 0x55a63ecbf690 2024-05-09T09:49:28.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.983+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd7d60 con 0x55a63ecbf690 2024-05-09T09:49:28.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.987+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'91 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ffc048040 con 0x55a63ecbf690 2024-05-09T09:49:28.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.987+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd7d60 con 0x55a63ecbf690 2024-05-09T09:49:28.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.987+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'183 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ffc048040 con 0x55a63ecbf690 2024-05-09T09:49:28.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.987+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd7d60 con 0x55a63ecbadb0 2024-05-09T09:49:28.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.991+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'96 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:28.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.991+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd7d60 con 0x55a63ecbf690 2024-05-09T09:49:28.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.991+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'95 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ffc048040 con 0x55a63ecbf690 2024-05-09T09:49:28.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.991+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd7d60 con 0x55a63ecbadb0 2024-05-09T09:49:28.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.995+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'182 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:28.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.995+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd7d60 con 0x55a63ecbf690 2024-05-09T09:49:28.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.995+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'268 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ffc048040 con 0x55a63ecbf690 2024-05-09T09:49:28.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.995+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd7d60 con 0x55a63ecbadb0 2024-05-09T09:49:28.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.999+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'188 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:28.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.999+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecd7d60 con 0x7f0ffc00f3d0 2024-05-09T09:49:29.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.999+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'100 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x7f0ffc00f3d0 2024-05-09T09:49:29.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.999+0000 7f0ec5fe3640 20 reqs_thread_entry: start 2024-05-09T09:49:29.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.999+0000 7f1014060980 20 init_complete bucket index max shards: 11 2024-05-09T09:49:29.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.999+0000 7f0e377fe640 20 reqs_thread_entry: start 2024-05-09T09:49:29.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.999+0000 7f1014060980 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-05-09T09:49:29.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:28.999+0000 7f1014060980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.003+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecf3800 con 0x55a63ecbadb0 2024-05-09T09:49:29.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.003+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:29.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.003+0000 7f1014060980 20 rados_obj.operate() r=0 bl.length=349 2024-05-09T09:49:29.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.003+0000 7f1014060980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-05-09T09:49:29.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.003+0000 7f1014060980 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-05-09T09:49:29.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.003+0000 7f1014060980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:49:29.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.003+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecf5b30 con 0x55a63ecbadb0 2024-05-09T09:49:29.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.003+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:29.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.003+0000 7f1014060980 10 removing key index: system_akey 2024-05-09T09:49:29.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.003+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecf5b30 con 0x55a63ecbf690 2024-05-09T09:49:29.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.003+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(96 system_akey [delete] v32'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0ffc048040 con 0x55a63ecbf690 2024-05-09T09:49:29.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.003+0000 7f1014060980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-05-09T09:49:29.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.003+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94172506703424 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecf63d0 con 0x55a63ecb63c0 2024-05-09T09:49:29.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.003+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== watch-notify(notify (1) cookie 94172506508096 notify 137438953507 ret 0) ==== 203+0+0 (crc 0 0 0) 0x55a63ecd67f0 con 0x55a63ecb63c0 2024-05-09T09:49:29.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.003+0000 7f0ee3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953507 cookie 94172506508096 notifier 4859 bl.length()=161 2024-05-09T09:49:29.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.003+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(97 notify.1 [notify cookie 94172506703424 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:29.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.003+0000 7f0ee3fff640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0ed4005580 con 0x55a63ecb63c0 2024-05-09T09:49:29.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.007+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:29.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.007+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== watch-notify(notify_complete (2) cookie 94172506703424 notify 137438953507 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a63ecd6ca0 con 0x55a63ecb63c0 2024-05-09T09:49:29.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.007+0000 7f1014060980 10 removing email index: 2024-05-09T09:49:29.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.007+0000 7f1014060980 10 removing user buckets index 2024-05-09T09:49:29.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.007+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecf3ae0 con 0x55a63ecbadb0 2024-05-09T09:49:29.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.007+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(99 system_user.buckets [delete] v32'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:29.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.007+0000 7f1014060980 10 removing user index: system_user 2024-05-09T09:49:29.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.007+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecf4f40 con 0x55a63ecbadb0 2024-05-09T09:49:29.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.011+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(100 system_user [call,call,delete] v32'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:29.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.011+0000 7f1014060980 10 removing default.rgw.meta+users.uid+system_user from cache 2024-05-09T09:49:29.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.011+0000 7f1014060980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-05-09T09:49:29.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.011+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94172506707168 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecf4f10 con 0x7f0ffc00f3d0 2024-05-09T09:49:29.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.011+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== watch-notify(notify (1) cookie 94172506503488 notify 137438953496 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55a63ecd6ca0 con 0x7f0ffc00f3d0 2024-05-09T09:49:29.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.011+0000 7f0ee3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953496 cookie 94172506503488 notifier 4859 bl.length()=160 2024-05-09T09:49:29.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.011+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(101 notify.0 [notify cookie 94172506707168 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f100400a4d0 con 0x7f0ffc00f3d0 2024-05-09T09:49:29.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.011+0000 7f0ee3fff640 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0ed4005580 con 0x7f0ffc00f3d0 2024-05-09T09:49:29.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.011+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x7f0ffc00f3d0 2024-05-09T09:49:29.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.011+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== watch-notify(notify_complete (2) cookie 94172506707168 notify 137438953496 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a63ecd5140 con 0x7f0ffc00f3d0 2024-05-09T09:49:29.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.011+0000 7f0ec6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:29.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.011+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94172506521200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecf54e0 con 0x55a63ecb63c0 2024-05-09T09:49:29.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.011+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94172506521200] v32'444 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:29.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.011+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94172506503488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecc7e70 con 0x7f0ffc00f3d0 2024-05-09T09:49:29.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.015+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94172506503488] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x7f0ffc00f3d0 2024-05-09T09:49:29.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.015+0000 7f1014060980 20 remove_watcher() i=0 2024-05-09T09:49:29.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.015+0000 7f1014060980 2 removed watcher, disabling cache 2024-05-09T09:49:29.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.015+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94172506508096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecc7e70 con 0x55a63ecb63c0 2024-05-09T09:49:29.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.015+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94172506508096] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:29.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.015+0000 7f1014060980 20 remove_watcher() i=1 2024-05-09T09:49:29.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.015+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94172506510768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecc4b40 con 0x55a63ecbf690 2024-05-09T09:49:29.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.019+0000 7f101137a640 1 -- 172.21.15.157:0/2385230208 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94172506510768] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ffc048040 con 0x55a63ecbf690 2024-05-09T09:49:29.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.019+0000 7f1014060980 20 remove_watcher() i=2 2024-05-09T09:49:29.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.019+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94172506515472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecc7e70 con 0x7f0ffc00f3d0 2024-05-09T09:49:29.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.019+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.2 v2:172.21.15.157:6800/354455204 23 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94172506515472] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x7f0ffc00f3d0 2024-05-09T09:49:29.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.019+0000 7f1014060980 20 remove_watcher() i=3 2024-05-09T09:49:29.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.019+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94172506501008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecc4b40 con 0x55a63ecb63c0 2024-05-09T09:49:29.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.019+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94172506501008] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100400a4d0 con 0x55a63ecb63c0 2024-05-09T09:49:29.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.019+0000 7f1014060980 20 remove_watcher() i=4 2024-05-09T09:49:29.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.019+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94172506518144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecc7e70 con 0x55a63ecbadb0 2024-05-09T09:49:29.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.023+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94172506518144] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:29.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.023+0000 7f1014060980 20 remove_watcher() i=5 2024-05-09T09:49:29.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.023+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94172506524528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecc4b40 con 0x55a63ecbadb0 2024-05-09T09:49:29.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94172506524528] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:29.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 20 remove_watcher() i=6 2024-05-09T09:49:29.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94172506528128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a63ecc7280 con 0x55a63ecbadb0 2024-05-09T09:49:29.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1011b7b640 1 -- 172.21.15.157:0/2385230208 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94172506528128] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f100c0c4020 con 0x55a63ecbadb0 2024-05-09T09:49:29.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 20 remove_watcher() i=7 2024-05-09T09:49:29.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55a63ecbadb0 msgr2=0x55a63ecbd1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 --2- 172.21.15.157:0/2385230208 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55a63ecbadb0 0x55a63ecbd1a0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55a63ecb63c0 msgr2=0x55a63ecb8880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.031 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 --2- 172.21.15.157:0/2385230208 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55a63ecb63c0 0x55a63ecb8880 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f0ffc00f3d0 msgr2=0x7f0ffc00f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 --2- 172.21.15.157:0/2385230208 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f0ffc00f3d0 0x7f0ffc00f7f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55a63ecbf690 msgr2=0x55a63ecc1ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 --2- 172.21.15.157:0/2385230208 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55a63ecbf690 0x55a63ecc1ac0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0edc034bb0 msgr2=0x7f0edc037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 --2- 172.21.15.157:0/2385230208 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0edc034bb0 0x7f0edc037070 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x55a63ec68190 tx=0x7f0ffc011000 comp rx=0 tx=0).stop 2024-05-09T09:49:29.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f101237c640 1 -- 172.21.15.157:0/2385230208 reap_dead start 2024-05-09T09:49:29.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eca2680 msgr2=0x55a63eca99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 --2- 172.21.15.157:0/2385230208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eca2680 0x55a63eca99f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f100c0acc40 tx=0x7f100c0cad00 comp rx=0 tx=0).stop 2024-05-09T09:49:29.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 shutdown_connections 2024-05-09T09:49:29.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 --2- 172.21.15.157:0/2385230208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eca2680 0x55a63eca99f0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 >> 172.21.15.157:0/2385230208 conn(0x55a63ec9ea00 msgr2=0x55a63eca3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:29.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 shutdown_connections 2024-05-09T09:49:29.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 -- 172.21.15.157:0/2385230208 wait complete. 2024-05-09T09:49:29.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 -- 172.21.15.157:0/131405517 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0eec034bb0 msgr2=0x7f0eec037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 --2- 172.21.15.157:0/131405517 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0eec034bb0 0x7f0eec037070 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55a63ec67500 tx=0x7f0ffc006000 comp rx=0 tx=0).stop 2024-05-09T09:49:29.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 -- 172.21.15.157:0/131405517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63ec95830 msgr2=0x55a63ec95c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 --2- 172.21.15.157:0/131405517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63ec95830 0x55a63ec95c50 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f100c0e2bb0 tx=0x7f100c0c9e70 comp rx=0 tx=0).stop 2024-05-09T09:49:29.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 -- 172.21.15.157:0/131405517 shutdown_connections 2024-05-09T09:49:29.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 --2- 172.21.15.157:0/131405517 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0eec034bb0 0x7f0eec037070 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 --2- 172.21.15.157:0/131405517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63ec95830 0x55a63ec95c50 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 -- 172.21.15.157:0/131405517 >> 172.21.15.157:0/131405517 conn(0x55a63ec8a600 msgr2=0x55a63ec8b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:29.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 -- 172.21.15.157:0/131405517 shutdown_connections 2024-05-09T09:49:29.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 -- 172.21.15.157:0/131405517 wait complete. 2024-05-09T09:49:29.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 -- 172.21.15.157:0/1640001690 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55a63ec68f50 msgr2=0x55a63ec6b340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 --2- 172.21.15.157:0/1640001690 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55a63ec68f50 0x55a63ec6b340 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 -- 172.21.15.157:0/1640001690 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55a63eb6a120 msgr2=0x55a63ec66590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 --2- 172.21.15.157:0/1640001690 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55a63eb6a120 0x55a63ec66590 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 -- 172.21.15.157:0/1640001690 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55a63ec6ce70 msgr2=0x55a63ec6f260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 --2- 172.21.15.157:0/1640001690 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55a63ec6ce70 0x55a63ec6f260 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 -- 172.21.15.157:0/1640001690 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0ef8034bb0 msgr2=0x7f0ef8037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 --2- 172.21.15.157:0/1640001690 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0ef8034bb0 0x7f0ef8037070 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc001e20 tx=0x7f0ffc0013a0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 -- 172.21.15.157:0/1640001690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eb69800 msgr2=0x55a63ec5f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f1014060980 1 --2- 172.21.15.157:0/1640001690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55a63eb69800 0x55a63ec5f600 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f100c01daa0 tx=0x7f100c019fa0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.027+0000 7f101237c640 1 -- 172.21.15.157:0/1640001690 reap_dead start 2024-05-09T09:49:29.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.031+0000 7f1014060980 1 -- 172.21.15.157:0/1640001690 shutdown_connections 2024-05-09T09:49:29.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.031+0000 7f1014060980 1 -- 172.21.15.157:0/1640001690 >> 172.21.15.157:0/1640001690 conn(0x55a63eb650d0 msgr2=0x55a63ec4e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:29.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.031+0000 7f1014060980 1 -- 172.21.15.157:0/1640001690 shutdown_connections 2024-05-09T09:49:29.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.031+0000 7f1014060980 1 -- 172.21.15.157:0/1640001690 wait complete. 2024-05-09T09:49:29.040 ERROR:root:None 2024-05-09T09:49:29.040 ERROR:root:0 2024-05-09T09:49:29.041 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-05-09T09:49:29.041 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-05-09T09:49:29.041 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-05-09T09:49:29.127 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:49:29.127 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:49:29.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.127+0000 7fdc4e654980 1 Processor -- start 2024-05-09T09:49:29.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.127+0000 7fdc4e654980 1 -- start start 2024-05-09T09:49:29.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.127+0000 7fdc4e654980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5630b34f6fd0 0x5630b34f93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.127+0000 7fdc4e654980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5630b33a6440 con 0x5630b34f2ad0 2024-05-09T09:49:29.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.127+0000 7fdc4e654980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5630b33915f0 con 0x5630b34f6fd0 2024-05-09T09:49:29.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.127+0000 7fdc4b96e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5630b34f6fd0 0x5630b34f93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.127+0000 7fdc4c16f640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x5630b34f2ad0 0x5630b34f2eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:45598/0 (socket says 172.21.15.157:45598) 2024-05-09T09:49:29.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.127+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3716473965 learned_addr learned my addr 172.21.15.157:0/3716473965 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:49:29.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.127+0000 7fdc4b96e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5630b34f6fd0 0x5630b34f93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39224/0 (socket says 172.21.15.157:39224) 2024-05-09T09:49:29.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.127+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3716473965 >> v1:172.21.15.110:6789/0 conn(0x5630b34f2ad0 legacy=0x5630b34f2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.127+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3716473965 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630b339c990 con 0x5630b34f6fd0 2024-05-09T09:49:29.130 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.127+0000 7fdc4b96e640 1 --2- 172.21.15.157:0/3716473965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b34f6fd0 0x5630b34f93c0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fdc4000a480 tx=0x7fdc4001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be93b4622c035ca6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.131+0000 7fdc4b16d640 1 -- 172.21.15.157:0/3716473965 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc400b0070 con 0x5630b34f6fd0 2024-05-09T09:49:29.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.131+0000 7fdc4b16d640 1 -- 172.21.15.157:0/3716473965 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc400ab540 con 0x5630b34f6fd0 2024-05-09T09:49:29.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.131+0000 7fdc4b16d640 1 -- 172.21.15.157:0/3716473965 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc400ab840 con 0x5630b34f6fd0 2024-05-09T09:49:29.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.131+0000 7fdc4e654980 1 -- 172.21.15.157:0/3716473965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b34f6fd0 msgr2=0x5630b34f93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.131+0000 7fdc4e654980 1 --2- 172.21.15.157:0/3716473965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b34f6fd0 0x5630b34f93c0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fdc4000a480 tx=0x7fdc4001b280 comp rx=0 tx=0).stop 2024-05-09T09:49:29.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.131+0000 7fdc4e654980 1 -- 172.21.15.157:0/3716473965 shutdown_connections 2024-05-09T09:49:29.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.131+0000 7fdc4e654980 1 --2- 172.21.15.157:0/3716473965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b34f6fd0 0x5630b34f93c0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.131+0000 7fdc4e654980 1 -- 172.21.15.157:0/3716473965 >> 172.21.15.157:0/3716473965 conn(0x5630b34661f0 msgr2=0x5630b3466600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:29.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.131+0000 7fdc4e654980 1 -- 172.21.15.157:0/3716473965 shutdown_connections 2024-05-09T09:49:29.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.131+0000 7fdc4e654980 1 -- 172.21.15.157:0/3716473965 wait complete. 2024-05-09T09:49:29.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.143+0000 7fdc4e654980 1 Processor -- start 2024-05-09T09:49:29.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.143+0000 7fdc4e654980 1 -- start start 2024-05-09T09:49:29.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.143+0000 7fdc4e654980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b34f2ad0 0x5630b35dde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.143+0000 7fdc4e654980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5630b33f3fe0 con 0x5630b34f2ad0 2024-05-09T09:49:29.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.143+0000 7fdc4c16f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b34f2ad0 0x5630b35dde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.143+0000 7fdc4c16f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b34f2ad0 0x5630b35dde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39230/0 (socket says 172.21.15.157:39230) 2024-05-09T09:49:29.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.143+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3192152152 learned_addr learned my addr 172.21.15.157:0/3192152152 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:29.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.143+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3192152152 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630b3378ae0 con 0x5630b34f2ad0 2024-05-09T09:49:29.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.143+0000 7fdc4c16f640 1 --2- 172.21.15.157:0/3192152152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b34f2ad0 0x5630b35dde60 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0015f0 tx=0x7fdc3c001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe7c1c33128311d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.143+0000 7fdb3a60c640 1 -- 172.21.15.157:0/3192152152 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc3c004530 con 0x5630b34f2ad0 2024-05-09T09:49:29.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.143+0000 7fdb3a60c640 1 -- 172.21.15.157:0/3192152152 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc3c0046f0 con 0x5630b34f2ad0 2024-05-09T09:49:29.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.143+0000 7fdb3a60c640 1 -- 172.21.15.157:0/3192152152 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc3c004a90 con 0x5630b34f2ad0 2024-05-09T09:49:29.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.147+0000 7fdc4e654980 1 -- 172.21.15.157:0/3192152152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b34f2ad0 msgr2=0x5630b35dde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.147+0000 7fdc4e654980 1 --2- 172.21.15.157:0/3192152152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b34f2ad0 0x5630b35dde60 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0015f0 tx=0x7fdc3c001ab0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.147+0000 7fdc4e654980 1 -- 172.21.15.157:0/3192152152 shutdown_connections 2024-05-09T09:49:29.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.147+0000 7fdc4e654980 1 --2- 172.21.15.157:0/3192152152 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b34f2ad0 0x5630b35dde60 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.147+0000 7fdc4e654980 1 -- 172.21.15.157:0/3192152152 >> 172.21.15.157:0/3192152152 conn(0x5630b34661f0 msgr2=0x5630b35d9950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:29.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.147+0000 7fdc4e654980 1 -- 172.21.15.157:0/3192152152 shutdown_connections 2024-05-09T09:49:29.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.147+0000 7fdc4e654980 1 -- 172.21.15.157:0/3192152152 wait complete. 2024-05-09T09:49:29.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.147+0000 7fdc4e654980 1 Processor -- start 2024-05-09T09:49:29.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.147+0000 7fdc4e654980 1 -- start start 2024-05-09T09:49:29.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.147+0000 7fdc4e654980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b35e51f0 0x5630b35e5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.147+0000 7fdc4e654980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5630b34fc3f0 con 0x5630b35e51f0 2024-05-09T09:49:29.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.147+0000 7fdc4c16f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b35e51f0 0x5630b35e5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.147+0000 7fdc4c16f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b35e51f0 0x5630b35e5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39240/0 (socket says 172.21.15.157:39240) 2024-05-09T09:49:29.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.147+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3713115565 learned_addr learned my addr 172.21.15.157:0/3713115565 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:29.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.147+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3713115565 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630b35e5b50 con 0x5630b35e51f0 2024-05-09T09:49:29.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.147+0000 7fdc4c16f640 1 --2- 172.21.15.157:0/3713115565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b35e51f0 0x5630b35e5610 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c00f000 tx=0x7fdc3c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.147+0000 7fdb38e09640 1 -- 172.21.15.157:0/3713115565 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc3c013760 con 0x5630b35e51f0 2024-05-09T09:49:29.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.147+0000 7fdb38e09640 1 -- 172.21.15.157:0/3713115565 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc3c013900 con 0x5630b35e51f0 2024-05-09T09:49:29.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.147+0000 7fdc4e654980 1 -- 172.21.15.157:0/3713115565 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630b35e5de0 con 0x5630b35e51f0 2024-05-09T09:49:29.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.147+0000 7fdb38e09640 1 -- 172.21.15.157:0/3713115565 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc3c013be0 con 0x5630b35e51f0 2024-05-09T09:49:29.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.147+0000 7fdc4e654980 1 -- 172.21.15.157:0/3713115565 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630b35e88c0 con 0x5630b35e51f0 2024-05-09T09:49:29.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.151+0000 7fdb38e09640 1 -- 172.21.15.157:0/3713115565 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fdc3c010070 con 0x5630b35e51f0 2024-05-09T09:49:29.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.151+0000 7fdb38e09640 1 --2- 172.21.15.157:0/3713115565 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdb34034bb0 0x7fdb34037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.151+0000 7fdb38e09640 1 -- 172.21.15.157:0/3713115565 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fdc3c018070 con 0x5630b35e51f0 2024-05-09T09:49:29.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.151+0000 7fdc4b96e640 1 --2- 172.21.15.157:0/3713115565 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdb34034bb0 0x7fdb34037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.151+0000 7fdc4e654980 1 --2- 172.21.15.157:0/3713115565 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5630b35ea5b0 0x5630b35ec9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.151+0000 7fdc4e654980 1 -- 172.21.15.157:0/3713115565 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5630b35ed000 con 0x5630b35ea5b0 2024-05-09T09:49:29.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.151+0000 7fdc4c970640 1 --2- 172.21.15.157:0/3713115565 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5630b35ea5b0 0x5630b35ec9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.151+0000 7fdc4b96e640 1 --2- 172.21.15.157:0/3713115565 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdb34034bb0 0x7fdb34037070 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdc400ad000 tx=0x7fdc400a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.151+0000 7fdc4c970640 1 --2- 172.21.15.157:0/3713115565 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5630b35ea5b0 0x5630b35ec9e0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.151+0000 7fdc4c970640 1 -- 172.21.15.157:0/3713115565 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc440083f0 con 0x5630b35ea5b0 2024-05-09T09:49:29.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.151+0000 7fdc4e654980 1 -- 172.21.15.157:0/3713115565 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5630b35e9b70 con 0x5630b35ea5b0 2024-05-09T09:49:29.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.151+0000 7fdc4c970640 1 -- 172.21.15.157:0/3713115565 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdc440083f0 con 0x5630b35ea5b0 2024-05-09T09:49:29.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.151+0000 7fdc4e654980 1 --2- 172.21.15.157:0/3713115565 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5630b35ef330 0x5630b35f1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.151+0000 7fdc4e654980 1 -- 172.21.15.157:0/3713115565 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5630b35f1df0 con 0x5630b35ef330 2024-05-09T09:49:29.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.151+0000 7fdc4c16f640 1 --2- 172.21.15.157:0/3713115565 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5630b35ef330 0x5630b35f1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.151+0000 7fdc4c16f640 1 --2- 172.21.15.157:0/3713115565 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5630b35ef330 0x5630b35f1720 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.155+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3713115565 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdc3c048d70 con 0x5630b35ef330 2024-05-09T09:49:29.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.155+0000 7fdc4e654980 1 -- 172.21.15.157:0/3713115565 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5630b35ee1d0 con 0x5630b35ea5b0 2024-05-09T09:49:29.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.155+0000 7fdc4c970640 1 -- 172.21.15.157:0/3713115565 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdc440083f0 con 0x5630b35ea5b0 2024-05-09T09:49:29.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.155+0000 7fdc4e654980 1 --2- 172.21.15.157:0/3713115565 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5630b35f3250 0x5630b35f5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.155+0000 7fdc4e654980 1 -- 172.21.15.157:0/3713115565 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5630b35f5d40 con 0x5630b35f3250 2024-05-09T09:49:29.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.155+0000 7fdc4b96e640 1 --2- 172.21.15.157:0/3713115565 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5630b35f3250 0x5630b35f5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.155+0000 7fdc4b96e640 1 --2- 172.21.15.157:0/3713115565 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5630b35f3250 0x5630b35f5640 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.157 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.155+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3713115565 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdc400b3040 con 0x5630b35f3250 2024-05-09T09:49:29.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.159+0000 7fdc4e654980 1 Processor -- start 2024-05-09T09:49:29.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.159+0000 7fdc4e654980 1 -- start start 2024-05-09T09:49:29.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.159+0000 7fdc4e654980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b361bbf0 0x5630b361c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.159+0000 7fdc4e654980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5630b33f8020 con 0x5630b361bbf0 2024-05-09T09:49:29.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.159+0000 7fdc4c16f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b361bbf0 0x5630b361c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.159+0000 7fdc4c16f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b361bbf0 0x5630b361c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39248/0 (socket says 172.21.15.157:39248) 2024-05-09T09:49:29.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.159+0000 7fdc4c16f640 1 -- 172.21.15.157:0/1657758544 learned_addr learned my addr 172.21.15.157:0/1657758544 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:29.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.159+0000 7fdc4c16f640 1 -- 172.21.15.157:0/1657758544 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630b361c550 con 0x5630b361bbf0 2024-05-09T09:49:29.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.159+0000 7fdc4c16f640 1 --2- 172.21.15.157:0/1657758544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b361bbf0 0x5630b361c010 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c001af0 tx=0x7fdc3c04a3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.159+0000 7fdb30b9e640 1 -- 172.21.15.157:0/1657758544 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc3c04a510 con 0x5630b361bbf0 2024-05-09T09:49:29.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.159+0000 7fdb30b9e640 1 -- 172.21.15.157:0/1657758544 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc3c012870 con 0x5630b361bbf0 2024-05-09T09:49:29.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.159+0000 7fdc4e654980 1 -- 172.21.15.157:0/1657758544 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630b361cfe0 con 0x5630b361bbf0 2024-05-09T09:49:29.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.159+0000 7fdb30b9e640 1 -- 172.21.15.157:0/1657758544 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc3c010a70 con 0x5630b361bbf0 2024-05-09T09:49:29.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.159+0000 7fdc4e654980 1 -- 172.21.15.157:0/1657758544 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630b361d4c0 con 0x5630b361bbf0 2024-05-09T09:49:29.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.159+0000 7fdb30b9e640 1 -- 172.21.15.157:0/1657758544 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fdc3c029d10 con 0x5630b361bbf0 2024-05-09T09:49:29.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdb30b9e640 1 --2- 172.21.15.157:0/1657758544 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdb24034b10 0x7fdb24036fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdb30b9e640 1 -- 172.21.15.157:0/1657758544 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fdc3c03b030 con 0x5630b361bbf0 2024-05-09T09:49:29.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdc4b96e640 1 --2- 172.21.15.157:0/1657758544 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdb24034b10 0x7fdb24036fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdc4e654980 1 Processor -- start 2024-05-09T09:49:29.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdc4e654980 1 -- start start 2024-05-09T09:49:29.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdc4e654980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b3628bb0 0x5630b3628fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdc4b96e640 1 --2- 172.21.15.157:0/1657758544 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdb24034b10 0x7fdb24036fd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdc4001b2c0 tx=0x7fdc40005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdc4e654980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5630b35de5b0 con 0x5630b3628bb0 2024-05-09T09:49:29.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdc4c16f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b3628bb0 0x5630b3628fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdc4c16f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b3628bb0 0x5630b3628fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39256/0 (socket says 172.21.15.157:39256) 2024-05-09T09:49:29.164 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3407404910 learned_addr learned my addr 172.21.15.157:0/3407404910 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:29.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3407404910 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630b3629580 con 0x5630b3628bb0 2024-05-09T09:49:29.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdc4c16f640 1 --2- 172.21.15.157:0/3407404910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b3628bb0 0x5630b3628fb0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c012a40 tx=0x7fdc3c033800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323b81d4f8a43d65 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdb2a7fc640 1 -- 172.21.15.157:0/3407404910 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc3c020df0 con 0x5630b3628bb0 2024-05-09T09:49:29.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdb2a7fc640 1 -- 172.21.15.157:0/3407404910 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc3c01da00 con 0x5630b3628bb0 2024-05-09T09:49:29.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdb2a7fc640 1 -- 172.21.15.157:0/3407404910 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc3c047230 con 0x5630b3628bb0 2024-05-09T09:49:29.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdc4e654980 1 -- 172.21.15.157:0/3407404910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b3628bb0 msgr2=0x5630b3628fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdc4e654980 1 --2- 172.21.15.157:0/3407404910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b3628bb0 0x5630b3628fb0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c012a40 tx=0x7fdc3c033800 comp rx=0 tx=0).stop 2024-05-09T09:49:29.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdc4e654980 1 -- 172.21.15.157:0/3407404910 shutdown_connections 2024-05-09T09:49:29.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdc4e654980 1 --2- 172.21.15.157:0/3407404910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b3628bb0 0x5630b3628fb0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdc4e654980 1 -- 172.21.15.157:0/3407404910 >> 172.21.15.157:0/3407404910 conn(0x5630b3624ee0 msgr2=0x5630b3622f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:29.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdc4e654980 1 -- 172.21.15.157:0/3407404910 shutdown_connections 2024-05-09T09:49:29.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdc4e654980 1 -- 172.21.15.157:0/3407404910 wait complete. 2024-05-09T09:49:29.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdc4e654980 1 Processor -- start 2024-05-09T09:49:29.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdc4e654980 1 -- start start 2024-05-09T09:49:29.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdc4e654980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b3628bb0 0x5630b362ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdc4e654980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5630b3629c50 con 0x5630b3628bb0 2024-05-09T09:49:29.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdc4c16f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b3628bb0 0x5630b362ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdc4c16f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b3628bb0 0x5630b362ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39272/0 (socket says 172.21.15.157:39272) 2024-05-09T09:49:29.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.163+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 learned_addr learned my addr 172.21.15.157:0/3297264366 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:29.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630b3630470 con 0x5630b3628bb0 2024-05-09T09:49:29.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4c16f640 1 --2- 172.21.15.157:0/3297264366 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b3628bb0 0x5630b362ff30 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c028fd0 tx=0x7fdc3c00ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdb28ff9640 1 -- 172.21.15.157:0/3297264366 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc3c06f070 con 0x5630b3628bb0 2024-05-09T09:49:29.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630b3630470 con 0x5630b3628bb0 2024-05-09T09:49:29.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdb28ff9640 1 -- 172.21.15.157:0/3297264366 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc3c047210 con 0x5630b3628bb0 2024-05-09T09:49:29.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630b3630950 con 0x5630b3628bb0 2024-05-09T09:49:29.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdb28ff9640 1 -- 172.21.15.157:0/3297264366 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc3c0116d0 con 0x5630b3628bb0 2024-05-09T09:49:29.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdb28ff9640 1 -- 172.21.15.157:0/3297264366 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fdc3c010c10 con 0x5630b3628bb0 2024-05-09T09:49:29.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4e654980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdb28ff9640 1 --2- 172.21.15.157:0/3297264366 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdb14034bb0 0x7fdb14037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdb28ff9640 1 -- 172.21.15.157:0/3297264366 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fdc3c074d10 con 0x5630b3628bb0 2024-05-09T09:49:29.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4b96e640 1 --2- 172.21.15.157:0/3297264366 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdb14034bb0 0x7fdb14037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4e654980 1 --2- 172.21.15.157:0/3297264366 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5630b363cac0 0x5630b363ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5630b363f6a0 con 0x5630b363cac0 2024-05-09T09:49:29.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4c970640 1 --2- 172.21.15.157:0/3297264366 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5630b363cac0 0x5630b363ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4b96e640 1 --2- 172.21.15.157:0/3297264366 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdb14034bb0 0x7fdb14037070 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x5630b35f6140 tx=0x7fdc400a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4c970640 1 --2- 172.21.15.157:0/3297264366 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5630b363cac0 0x5630b363ef50 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc440083f0 con 0x5630b363cac0 2024-05-09T09:49:29.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4e654980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4e654980 20 realm 2024-05-09T09:49:29.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4e654980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5630b363fab0 con 0x5630b363cac0 2024-05-09T09:49:29.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc440083f0 con 0x5630b363cac0 2024-05-09T09:49:29.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4e654980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4e654980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:49:29.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4e654980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5630b3640350 con 0x5630b363cac0 2024-05-09T09:49:29.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc440083f0 con 0x5630b363cac0 2024-05-09T09:49:29.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4e654980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4e654980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5630b36406f0 con 0x5630b363cac0 2024-05-09T09:49:29.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdc440083f0 con 0x5630b363cac0 2024-05-09T09:49:29.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4e654980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:29.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4e654980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4e654980 1 --2- 172.21.15.157:0/3297264366 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5630b3641450 0x5630b3643840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.167+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5630b3643e90 con 0x5630b3641450 2024-05-09T09:49:29.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.171+0000 7fdc4c16f640 1 --2- 172.21.15.157:0/3297264366 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5630b3641450 0x5630b3643840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.171+0000 7fdc4c16f640 1 --2- 172.21.15.157:0/3297264366 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5630b3641450 0x5630b3643840 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.171+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdc3c068070 con 0x5630b3641450 2024-05-09T09:49:29.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.171+0000 7fdc4e654980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:49:29.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.171+0000 7fdc4e654980 20 searching for the correct realm 2024-05-09T09:49:29.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.171+0000 7fdc4e654980 1 --2- 172.21.15.157:0/3297264366 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5630b3645d70 0x5630b36481e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.171+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5630b3648860 con 0x5630b3645d70 2024-05-09T09:49:29.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.171+0000 7fdc4b96e640 1 --2- 172.21.15.157:0/3297264366 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5630b3645d70 0x5630b36481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.171+0000 7fdc4b96e640 1 --2- 172.21.15.157:0/3297264366 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5630b3645d70 0x5630b36481e0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.171+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.171+0000 7fdc4b96e640 1 --2- 172.21.15.157:0/3297264366 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fdc400ce040 0x7fdc400db410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.171+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5630b3648860 con 0x7fdc400ce040 2024-05-09T09:49:29.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.171+0000 7fdc4c970640 1 --2- 172.21.15.157:0/3297264366 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fdc400ce040 0x7fdc400db410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.171+0000 7fdc4c970640 1 --2- 172.21.15.157:0/3297264366 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fdc400ce040 0x7fdc400db410 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.171+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc440083f0 con 0x7fdc400ce040 2024-05-09T09:49:29.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.171+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5630b36406f0 con 0x5630b3641450 2024-05-09T09:49:29.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.175+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3c068070 con 0x5630b3641450 2024-05-09T09:49:29.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.175+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5630b36406f0 con 0x5630b363cac0 2024-05-09T09:49:29.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.175+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc440083f0 con 0x5630b363cac0 2024-05-09T09:49:29.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.175+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5630b36406f0 con 0x5630b363cac0 2024-05-09T09:49:29.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.175+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc44026040 con 0x5630b363cac0 2024-05-09T09:49:29.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.175+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5630b36406f0 con 0x5630b3641450 2024-05-09T09:49:29.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.175+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3c068070 con 0x5630b3641450 2024-05-09T09:49:29.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.175+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5630b36406f0 con 0x5630b3641450 2024-05-09T09:49:29.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.175+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3c068070 con 0x5630b3641450 2024-05-09T09:49:29.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.175+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5630b36406f0 con 0x7fdc400ce040 2024-05-09T09:49:29.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.175+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc44026040 con 0x7fdc400ce040 2024-05-09T09:49:29.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.175+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5630b36406f0 con 0x5630b3645d70 2024-05-09T09:49:29.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.175+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.175+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5630b36406f0 con 0x5630b363cac0 2024-05-09T09:49:29.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.175+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc44026040 con 0x5630b363cac0 2024-05-09T09:49:29.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.175+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5630b36406f0 con 0x5630b3641450 2024-05-09T09:49:29.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.175+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3c068070 con 0x5630b3641450 2024-05-09T09:49:29.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.175+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5630b36406f0 con 0x5630b363cac0 2024-05-09T09:49:29.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.175+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc44026040 con 0x5630b363cac0 2024-05-09T09:49:29.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.175+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5630b36406f0 con 0x7fdc400ce040 2024-05-09T09:49:29.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.175+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdc44026040 con 0x7fdc400ce040 2024-05-09T09:49:29.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.175+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5630b36406f0 con 0x5630b3645d70 2024-05-09T09:49:29.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.179+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.179+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc400e8040 con 0x5630b3645d70 2024-05-09T09:49:29.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.179+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.179+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc400e8040 con 0x5630b3641450 2024-05-09T09:49:29.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.179+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3c068070 con 0x5630b3641450 2024-05-09T09:49:29.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.179+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc400e8040 con 0x5630b3645d70 2024-05-09T09:49:29.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.179+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.179+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc400e8040 con 0x5630b3645d70 2024-05-09T09:49:29.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.179+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.179+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc400e8040 con 0x5630b363cac0 2024-05-09T09:49:29.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.179+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc44026040 con 0x5630b363cac0 2024-05-09T09:49:29.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.179+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc400e8040 con 0x5630b363cac0 2024-05-09T09:49:29.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.179+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdc44026040 con 0x5630b363cac0 2024-05-09T09:49:29.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.179+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc400e8040 con 0x5630b3641450 2024-05-09T09:49:29.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.179+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3c068070 con 0x5630b3641450 2024-05-09T09:49:29.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.179+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc400e8040 con 0x5630b3645d70 2024-05-09T09:49:29.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.179+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.179+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc400e8040 con 0x7fdc400ce040 2024-05-09T09:49:29.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.179+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc44026040 con 0x7fdc400ce040 2024-05-09T09:49:29.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.179+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc400e8040 con 0x5630b363cac0 2024-05-09T09:49:29.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.179+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc44026040 con 0x5630b363cac0 2024-05-09T09:49:29.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.179+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc400e8040 con 0x5630b3641450 2024-05-09T09:49:29.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdc3c068070 con 0x5630b3641450 2024-05-09T09:49:29.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc400e8040 con 0x5630b3645d70 2024-05-09T09:49:29.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc400e8040 con 0x5630b3641450 2024-05-09T09:49:29.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3c068070 con 0x5630b3641450 2024-05-09T09:49:29.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc400e8040 con 0x7fdc400ce040 2024-05-09T09:49:29.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc44026040 con 0x7fdc400ce040 2024-05-09T09:49:29.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc400e8040 con 0x5630b3645d70 2024-05-09T09:49:29.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc400e8040 con 0x5630b3641450 2024-05-09T09:49:29.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3c068070 con 0x5630b3641450 2024-05-09T09:49:29.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc400e8040 con 0x5630b363cac0 2024-05-09T09:49:29.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdc44026040 con 0x5630b363cac0 2024-05-09T09:49:29.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fdc400e8040 con 0x7fdc400ce040 2024-05-09T09:49:29.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc44026040 con 0x7fdc400ce040 2024-05-09T09:49:29.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4e654980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:49:29.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4e654980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:49:29.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4e654980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:49:29.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4e654980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:49:29.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4e654980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:49:29.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4e654980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:49:29.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4e654980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5630b36446e0 con 0x5630b363cac0 2024-05-09T09:49:29.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc44026040 con 0x5630b363cac0 2024-05-09T09:49:29.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4e654980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4e654980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5630b36446e0 con 0x5630b363cac0 2024-05-09T09:49:29.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdc44026040 con 0x5630b363cac0 2024-05-09T09:49:29.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4e654980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:29.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4e654980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5630b36446e0 con 0x5630b3645d70 2024-05-09T09:49:29.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4e654980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:49:29.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4e654980 20 zone default found 2024-05-09T09:49:29.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4e654980 4 Realm: () 2024-05-09T09:49:29.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4e654980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:49:29.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4e654980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:49:29.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4e654980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:49:29.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4e654980 20 zonegroup default 2024-05-09T09:49:29.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4e654980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5630b36450e0 con 0x5630b3641450 2024-05-09T09:49:29.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdc3c068070 con 0x5630b3641450 2024-05-09T09:49:29.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4e654980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4e654980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.183+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5630b3644cb0 con 0x5630b3645d70 2024-05-09T09:49:29.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.187+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.187+0000 7fdc4e654980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.187+0000 7fdc4e654980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.187+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5630b364ac40 con 0x5630b3645d70 2024-05-09T09:49:29.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.187+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.187+0000 7fdc4e654980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.187+0000 7fdc4e654980 20 started sync module instance, tier type = 2024-05-09T09:49:29.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.187+0000 7fdc4e654980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:49:29.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.187+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b364a000 con 0x7fdc400ce040 2024-05-09T09:49:29.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.187+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc44026040 con 0x7fdc400ce040 2024-05-09T09:49:29.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.187+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94767168136448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b364a000 con 0x7fdc400ce040 2024-05-09T09:49:29.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.187+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b364b720 con 0x5630b363cac0 2024-05-09T09:49:29.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.187+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94767168136448] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc44036040 con 0x7fdc400ce040 2024-05-09T09:49:29.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.187+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc44036040 con 0x5630b363cac0 2024-05-09T09:49:29.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.187+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94767168139792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b364a000 con 0x5630b363cac0 2024-05-09T09:49:29.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.187+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b364c160 con 0x5630b3645d70 2024-05-09T09:49:29.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.191+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94767168139792] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc44036040 con 0x5630b363cac0 2024-05-09T09:49:29.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.191+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.191+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94767168133968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b3649f70 con 0x5630b3645d70 2024-05-09T09:49:29.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.191+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b364cea0 con 0x7fdc400ce040 2024-05-09T09:49:29.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.191+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc44036040 con 0x7fdc400ce040 2024-05-09T09:49:29.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.191+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94767168145840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b364cdd0 con 0x7fdc400ce040 2024-05-09T09:49:29.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.191+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b364dda0 con 0x5630b363cac0 2024-05-09T09:49:29.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.195+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94767168133968] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.195+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94767168145840] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc44036040 con 0x7fdc400ce040 2024-05-09T09:49:29.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.195+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc44036040 con 0x5630b363cac0 2024-05-09T09:49:29.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.195+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94767168144640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b364d8b0 con 0x5630b363cac0 2024-05-09T09:49:29.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.195+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b364e640 con 0x5630b3641450 2024-05-09T09:49:29.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.195+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94767168144640] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc44036040 con 0x5630b363cac0 2024-05-09T09:49:29.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.195+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3c068070 con 0x5630b3641450 2024-05-09T09:49:29.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.195+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94767168151952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b364d8b0 con 0x5630b3641450 2024-05-09T09:49:29.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.195+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b364ee90 con 0x5630b3641450 2024-05-09T09:49:29.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.199+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94767168151952] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3c068070 con 0x5630b3641450 2024-05-09T09:49:29.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.199+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3c068070 con 0x5630b3641450 2024-05-09T09:49:29.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.199+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94767168154080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b364f2b0 con 0x5630b3641450 2024-05-09T09:49:29.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.199+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b364fc70 con 0x5630b3641450 2024-05-09T09:49:29.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.203+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94767168154080] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3c068070 con 0x5630b3641450 2024-05-09T09:49:29.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.203+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3c068070 con 0x5630b3641450 2024-05-09T09:49:29.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.203+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94767168155408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b364fc70 con 0x5630b3641450 2024-05-09T09:49:29.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.203+0000 7fdc4e654980 20 add_watcher() i=0 2024-05-09T09:49:29.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.203+0000 7fdc4e654980 20 add_watcher() i=1 2024-05-09T09:49:29.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.203+0000 7fdc4e654980 20 add_watcher() i=2 2024-05-09T09:49:29.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.203+0000 7fdc4e654980 20 add_watcher() i=3 2024-05-09T09:49:29.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.203+0000 7fdc4e654980 20 add_watcher() i=4 2024-05-09T09:49:29.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.203+0000 7fdc4e654980 20 add_watcher() i=5 2024-05-09T09:49:29.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.203+0000 7fdc4e654980 20 add_watcher() i=6 2024-05-09T09:49:29.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.203+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94767168155408] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3c068070 con 0x5630b3641450 2024-05-09T09:49:29.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.203+0000 7fdc4e654980 20 add_watcher() i=7 2024-05-09T09:49:29.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.203+0000 7fdc4e654980 2 all 8 watchers are set, enabling cache 2024-05-09T09:49:29.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.203+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5630b3652fb0 con 0x5630b363cac0 2024-05-09T09:49:29.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.203+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdc44036040 con 0x5630b363cac0 2024-05-09T09:49:29.206 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.203+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94767168170448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b364fde0 con 0x5630b363cac0 2024-05-09T09:49:29.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.207+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94767168170448] v32'445 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdc44036040 con 0x5630b363cac0 2024-05-09T09:49:29.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.207+0000 7fdb017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:29.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.207+0000 7fdc4e654980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:49:29.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.207+0000 7fdc4e654980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:49:29.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.207+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b3652250 con 0x5630b363cac0 2024-05-09T09:49:29.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.207+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'102 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc44036040 con 0x5630b363cac0 2024-05-09T09:49:29.209 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.207+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365c070 con 0x5630b3641450 2024-05-09T09:49:29.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.211+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'97 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc3c068070 con 0x5630b3641450 2024-05-09T09:49:29.211 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.211+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365c070 con 0x5630b3645d70 2024-05-09T09:49:29.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.211+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'96 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.211+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365c070 con 0x5630b363cac0 2024-05-09T09:49:29.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.211+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'446 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc44036040 con 0x5630b363cac0 2024-05-09T09:49:29.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.211+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365c070 con 0x7fdc400ce040 2024-05-09T09:49:29.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.215+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'275 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc44036040 con 0x7fdc400ce040 2024-05-09T09:49:29.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.215+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365cfe0 con 0x5630b3645d70 2024-05-09T09:49:29.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.215+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'184 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.215+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365a6d0 con 0x5630b363cac0 2024-05-09T09:49:29.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.215+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'97 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc44036040 con 0x5630b363cac0 2024-05-09T09:49:29.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.215+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365a6d0 con 0x5630b3641450 2024-05-09T09:49:29.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.219+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'183 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc3c068070 con 0x5630b3641450 2024-05-09T09:49:29.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.219+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365a6d0 con 0x7fdc400ce040 2024-05-09T09:49:29.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.219+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'95 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc44036040 con 0x7fdc400ce040 2024-05-09T09:49:29.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.219+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365a6d0 con 0x5630b3645d70 2024-05-09T09:49:29.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.223+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'101 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.223+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365a8a0 con 0x7fdc400ce040 2024-05-09T09:49:29.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.223+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'276 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc44036040 con 0x7fdc400ce040 2024-05-09T09:49:29.223 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.223+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365a8a0 con 0x5630b3641450 2024-05-09T09:49:29.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.223+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'101 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc3c068070 con 0x5630b3641450 2024-05-09T09:49:29.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.223+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365a8a0 con 0x7fdc400ce040 2024-05-09T09:49:29.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.227+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'95 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc44036040 con 0x7fdc400ce040 2024-05-09T09:49:29.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.227+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365a8a0 con 0x5630b3641450 2024-05-09T09:49:29.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.227+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'189 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc3c068070 con 0x5630b3641450 2024-05-09T09:49:29.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.227+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365a8a0 con 0x5630b363cac0 2024-05-09T09:49:29.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.227+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'447 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc44036040 con 0x5630b363cac0 2024-05-09T09:49:29.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.227+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365a8a0 con 0x5630b3645d70 2024-05-09T09:49:29.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.231+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'269 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.232 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.231+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365a8a0 con 0x7fdc400ce040 2024-05-09T09:49:29.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.231+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'277 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc44036040 con 0x7fdc400ce040 2024-05-09T09:49:29.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.231+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365a8a0 con 0x5630b3645d70 2024-05-09T09:49:29.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.231+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'95 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.235+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365a8a0 con 0x5630b363cac0 2024-05-09T09:49:29.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.235+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'103 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc44036040 con 0x5630b363cac0 2024-05-09T09:49:29.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.235+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365a8a0 con 0x5630b363cac0 2024-05-09T09:49:29.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.235+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'448 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc44036040 con 0x5630b363cac0 2024-05-09T09:49:29.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.235+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365a8a0 con 0x5630b3645d70 2024-05-09T09:49:29.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.239+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'270 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.239+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365a8a0 con 0x7fdc400ce040 2024-05-09T09:49:29.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.239+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'107 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc44036040 con 0x7fdc400ce040 2024-05-09T09:49:29.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.239+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365a8a0 con 0x5630b3645d70 2024-05-09T09:49:29.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.243+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'97 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.243+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365a8a0 con 0x5630b3645d70 2024-05-09T09:49:29.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.243+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'101 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.243+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365a8a0 con 0x5630b3645d70 2024-05-09T09:49:29.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.243+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'92 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.243+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365a8a0 con 0x5630b3645d70 2024-05-09T09:49:29.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.243+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'185 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.247+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365a8a0 con 0x5630b3641450 2024-05-09T09:49:29.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.247+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'97 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc3c068070 con 0x5630b3641450 2024-05-09T09:49:29.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.247+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365a8a0 con 0x5630b3645d70 2024-05-09T09:49:29.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.247+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'96 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.247+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365a8a0 con 0x5630b3641450 2024-05-09T09:49:29.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.251+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'184 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc3c068070 con 0x5630b3641450 2024-05-09T09:49:29.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.251+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365a8a0 con 0x5630b3645d70 2024-05-09T09:49:29.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.255+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'271 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.255+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365a6d0 con 0x5630b3641450 2024-05-09T09:49:29.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.255+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'190 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc3c068070 con 0x5630b3641450 2024-05-09T09:49:29.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.255+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b365a6d0 con 0x7fdc400ce040 2024-05-09T09:49:29.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.259+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'101 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdc44036040 con 0x7fdc400ce040 2024-05-09T09:49:29.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.259+0000 7fda7bfff640 20 reqs_thread_entry: start 2024-05-09T09:49:29.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.259+0000 7fdc4e654980 20 init_complete bucket index max shards: 11 2024-05-09T09:49:29.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.259+0000 7fda79ffb640 20 reqs_thread_entry: start 2024-05-09T09:49:29.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.259+0000 7fdc4e654980 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-05-09T09:49:29.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.259+0000 7fdc4e654980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.259+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5630b3679480 con 0x5630b3645d70 2024-05-09T09:49:29.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.259+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(94 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.259+0000 7fdc4e654980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.259+0000 7fdc4e654980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-05-09T09:49:29.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.259+0000 7fdc4e654980 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-05-09T09:49:29.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.259+0000 7fdc4e654980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-05-09T09:49:29.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.259+0000 7fdc4e654980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.259+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:95 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5630b3679480 con 0x5630b3645d70 2024-05-09T09:49:29.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.259+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(95 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.259+0000 7fdc4e654980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.259+0000 7fdc4e654980 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-05-09T09:49:29.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.259+0000 7fdc4e654980 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-05-09T09:49:29.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.259+0000 7fdc4e654980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-05-09T09:49:29.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.259+0000 7fdc4e654980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-05-09T09:49:29.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.259+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:96 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b367be30 con 0x5630b3645d70 2024-05-09T09:49:29.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.263+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== osd_op_reply(96 a_user [delete,create,call,writefull 0~363] v32'1 uv1 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.263+0000 7fdc4e654980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-05-09T09:49:29.265 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.263+0000 7fdc4e654980 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-05-09T09:49:29.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.263+0000 7fdc4e654980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-05-09T09:49:29.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.263+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94767168339504 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5630b367c8e0 con 0x5630b3645d70 2024-05-09T09:49:29.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.263+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 30 ==== watch-notify(notify (1) cookie 94767168133968 notify 137438953481 ret 0) ==== 584+0+0 (crc 0 0 0) 0x5630b3679530 con 0x5630b3645d70 2024-05-09T09:49:29.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.263+0000 7fdb2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94767168133968 notifier 4866 bl.length()=542 2024-05-09T09:49:29.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.263+0000 7fdb2a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-05-09T09:49:29.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.263+0000 7fdb2a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-05-09T09:49:29.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.263+0000 7fdb2a7fc640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fdb100056c0 con 0x5630b3645d70 2024-05-09T09:49:29.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.263+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 31 ==== osd_op_reply(97 notify.2 [notify cookie 94767168339504 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.263+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 32 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.263+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 33 ==== watch-notify(notify_complete (2) cookie 94767168339504 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5630b365c240 con 0x5630b3645d70 2024-05-09T09:49:29.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.263+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:99 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b367be30 con 0x5630b3645d70 2024-05-09T09:49:29.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.263+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 34 ==== osd_op_reply(99 true_admin_akey [delete,create,writefull 0~10] v32'7 uv7 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.263+0000 7fdc4e654980 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-05-09T09:49:29.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.263+0000 7fdc4e654980 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-05-09T09:49:29.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.263+0000 7fdc4e654980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-05-09T09:49:29.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.263+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [notify cookie 94767168339504 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5630b367c8e0 con 0x5630b3641450 2024-05-09T09:49:29.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.263+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== watch-notify(notify (1) cookie 94767168151952 notify 137438953518 ret 0) ==== 217+0+0 (crc 0 0 0) 0x5630b365dd70 con 0x5630b3641450 2024-05-09T09:49:29.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.263+0000 7fdb29ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953518 cookie 94767168151952 notifier 4866 bl.length()=175 2024-05-09T09:49:29.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.263+0000 7fdb29ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-05-09T09:49:29.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.263+0000 7fdb29ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-05-09T09:49:29.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.263+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(100 notify.5 [notify cookie 94767168339504 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdc3c068070 con 0x5630b3641450 2024-05-09T09:49:29.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.263+0000 7fdb29ffb640 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fda80003a70 con 0x5630b3641450 2024-05-09T09:49:29.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.267+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== watch-notify(notify_complete (2) cookie 94767168339504 notify 137438953518 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5630b361c550 con 0x5630b3641450 2024-05-09T09:49:29.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.267+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(101 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3c068070 con 0x5630b3641450 2024-05-09T09:49:29.269 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-05-09T09:49:29.262971Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:49:29.262950Z","tags":[],"group_ids":[]} 2024-05-09T09:49:29.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.267+0000 7fdb017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:29.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.267+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:102 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94767168170448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b36598f0 con 0x5630b363cac0 2024-05-09T09:49:29.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.267+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(102 data_loggenerations_metadata [watch unwatch cookie 94767168170448] v32'449 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdc44036040 con 0x5630b363cac0 2024-05-09T09:49:29.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.267+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:103 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94767168136448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b36529d0 con 0x7fdc400ce040 2024-05-09T09:49:29.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.267+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(103 notify.0 [watch unwatch cookie 94767168136448] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc44036040 con 0x7fdc400ce040 2024-05-09T09:49:29.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.267+0000 7fdc4e654980 20 remove_watcher() i=0 2024-05-09T09:49:29.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.267+0000 7fdc4e654980 2 removed watcher, disabling cache 2024-05-09T09:49:29.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.267+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:104 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94767168139792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b364a500 con 0x5630b363cac0 2024-05-09T09:49:29.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.271+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(104 notify.1 [watch unwatch cookie 94767168139792] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc44036040 con 0x5630b363cac0 2024-05-09T09:49:29.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.271+0000 7fdc4e654980 20 remove_watcher() i=1 2024-05-09T09:49:29.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.271+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:105 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94767168133968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b364a500 con 0x5630b3645d70 2024-05-09T09:49:29.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.271+0000 7fdc4b96e640 1 -- 172.21.15.157:0/3297264366 <== osd.3 v2:172.21.15.157:6816/2487336710 35 ==== osd_op_reply(105 notify.2 [watch unwatch cookie 94767168133968] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc400d9070 con 0x5630b3645d70 2024-05-09T09:49:29.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.271+0000 7fdc4e654980 20 remove_watcher() i=2 2024-05-09T09:49:29.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.271+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:106 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94767168145840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b364a500 con 0x7fdc400ce040 2024-05-09T09:49:29.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.275+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(106 notify.3 [watch unwatch cookie 94767168145840] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc44036040 con 0x7fdc400ce040 2024-05-09T09:49:29.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.275+0000 7fdc4e654980 20 remove_watcher() i=3 2024-05-09T09:49:29.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.275+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94767168144640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b364c9b0 con 0x5630b363cac0 2024-05-09T09:49:29.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.275+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(107 notify.4 [watch unwatch cookie 94767168144640] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc44036040 con 0x5630b363cac0 2024-05-09T09:49:29.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.275+0000 7fdc4e654980 20 remove_watcher() i=4 2024-05-09T09:49:29.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.275+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:108 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94767168151952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b364a500 con 0x5630b3641450 2024-05-09T09:49:29.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.279+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(108 notify.5 [watch unwatch cookie 94767168151952] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3c068070 con 0x5630b3641450 2024-05-09T09:49:29.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.279+0000 7fdc4e654980 20 remove_watcher() i=5 2024-05-09T09:49:29.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.279+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:109 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94767168154080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b364c500 con 0x5630b3641450 2024-05-09T09:49:29.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.279+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(109 notify.6 [watch unwatch cookie 94767168154080] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3c068070 con 0x5630b3641450 2024-05-09T09:49:29.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.279+0000 7fdc4e654980 20 remove_watcher() i=6 2024-05-09T09:49:29.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.279+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:110 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94767168155408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5630b364a500 con 0x5630b3641450 2024-05-09T09:49:29.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4c16f640 1 -- 172.21.15.157:0/3297264366 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(110 notify.7 [watch unwatch cookie 94767168155408] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3c068070 con 0x5630b3641450 2024-05-09T09:49:29.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 20 remove_watcher() i=7 2024-05-09T09:49:29.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5630b3641450 msgr2=0x5630b3643840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 --2- 172.21.15.157:0/3297264366 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5630b3641450 0x5630b3643840 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5630b363cac0 msgr2=0x5630b363ef50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 --2- 172.21.15.157:0/3297264366 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5630b363cac0 0x5630b363ef50 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fdc400ce040 msgr2=0x7fdc400db410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 --2- 172.21.15.157:0/3297264366 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fdc400ce040 0x7fdc400db410 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5630b3645d70 msgr2=0x5630b36481e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 --2- 172.21.15.157:0/3297264366 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5630b3645d70 0x5630b36481e0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdb14034bb0 msgr2=0x7fdb14037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 --2- 172.21.15.157:0/3297264366 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdb14034bb0 0x7fdb14037070 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x5630b35f6140 tx=0x7fdc400a6000 comp rx=0 tx=0).stop 2024-05-09T09:49:29.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b3628bb0 msgr2=0x5630b362ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 --2- 172.21.15.157:0/3297264366 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b3628bb0 0x5630b362ff30 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c028fd0 tx=0x7fdc3c00ad80 comp rx=0 tx=0).stop 2024-05-09T09:49:29.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4c970640 1 -- 172.21.15.157:0/3297264366 reap_dead start 2024-05-09T09:49:29.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 shutdown_connections 2024-05-09T09:49:29.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 --2- 172.21.15.157:0/3297264366 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b3628bb0 0x5630b362ff30 secure :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c028fd0 tx=0x7fdc3c00ad80 comp rx=0 tx=0).stop 2024-05-09T09:49:29.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 >> 172.21.15.157:0/3297264366 conn(0x5630b3624ee0 msgr2=0x5630b3622f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:29.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 shutdown_connections 2024-05-09T09:49:29.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 -- 172.21.15.157:0/3297264366 wait complete. 2024-05-09T09:49:29.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 -- 172.21.15.157:0/1657758544 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdb24034b10 msgr2=0x7fdb24036fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 --2- 172.21.15.157:0/1657758544 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdb24034b10 0x7fdb24036fd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdc4001b2c0 tx=0x7fdc40005a10 comp rx=0 tx=0).stop 2024-05-09T09:49:29.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 -- 172.21.15.157:0/1657758544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b361bbf0 msgr2=0x5630b361c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 --2- 172.21.15.157:0/1657758544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b361bbf0 0x5630b361c010 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c001af0 tx=0x7fdc3c04a3e0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 -- 172.21.15.157:0/1657758544 shutdown_connections 2024-05-09T09:49:29.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 --2- 172.21.15.157:0/1657758544 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdb24034b10 0x7fdb24036fd0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 --2- 172.21.15.157:0/1657758544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b361bbf0 0x5630b361c010 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 -- 172.21.15.157:0/1657758544 >> 172.21.15.157:0/1657758544 conn(0x5630b36109c0 msgr2=0x5630b36114d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:29.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 -- 172.21.15.157:0/1657758544 shutdown_connections 2024-05-09T09:49:29.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 -- 172.21.15.157:0/1657758544 wait complete. 2024-05-09T09:49:29.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 -- 172.21.15.157:0/3713115565 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5630b35ef330 msgr2=0x5630b35f1720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 --2- 172.21.15.157:0/3713115565 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5630b35ef330 0x5630b35f1720 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 -- 172.21.15.157:0/3713115565 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5630b35ea5b0 msgr2=0x5630b35ec9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 --2- 172.21.15.157:0/3713115565 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5630b35ea5b0 0x5630b35ec9e0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 -- 172.21.15.157:0/3713115565 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5630b35f3250 msgr2=0x5630b35f5640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 --2- 172.21.15.157:0/3713115565 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5630b35f3250 0x5630b35f5640 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 -- 172.21.15.157:0/3713115565 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdb34034bb0 msgr2=0x7fdb34037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 --2- 172.21.15.157:0/3713115565 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fdb34034bb0 0x7fdb34037070 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdc400ad000 tx=0x7fdc400a5040 comp rx=0 tx=0).stop 2024-05-09T09:49:29.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 -- 172.21.15.157:0/3713115565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b35e51f0 msgr2=0x5630b35e5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 --2- 172.21.15.157:0/3713115565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5630b35e51f0 0x5630b35e5610 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c00f000 tx=0x7fdc3c000f50 comp rx=0 tx=0).stop 2024-05-09T09:49:29.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4c970640 1 -- 172.21.15.157:0/3713115565 reap_dead start 2024-05-09T09:49:29.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 -- 172.21.15.157:0/3713115565 shutdown_connections 2024-05-09T09:49:29.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 -- 172.21.15.157:0/3713115565 >> 172.21.15.157:0/3713115565 conn(0x5630b34661f0 msgr2=0x5630b35d8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:29.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 -- 172.21.15.157:0/3713115565 shutdown_connections 2024-05-09T09:49:29.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.283+0000 7fdc4e654980 1 -- 172.21.15.157:0/3713115565 wait complete. 2024-05-09T09:49:29.295 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-05-09T09:49:29.262971Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:49:29.262950Z', 'tags': [], 'group_ids': []} 2024-05-09T09:49:29.295 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-05-09T09:49:29.262971Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:49:29.262950Z', 'tags': [], 'group_ids': []} 2024-05-09T09:49:29.295 ERROR:root:0 2024-05-09T09:49:29.295 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-09T09:49:29.300 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-09T09:49:29.300 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-05-09T09:49:29.300 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-05-09T09:49:29.301 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-05-09T09:49:29.372 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:49:29.373 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:49:29.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.371+0000 7f311e597980 1 Processor -- start 2024-05-09T09:49:29.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.371+0000 7f311e597980 1 -- start start 2024-05-09T09:49:29.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.371+0000 7f311e597980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x561b5c004a70 0x561b5c0935f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.371+0000 7f311e597980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561b5bf46440 con 0x561b5c093b30 2024-05-09T09:49:29.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.371+0000 7f311e597980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x561b5bf315f0 con 0x561b5c004a70 2024-05-09T09:49:29.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.375+0000 7f311c0b2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x561b5c004a70 0x561b5c0935f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.375+0000 7f311b8b1640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x561b5c093b30 0x561b5c095f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:45610/0 (socket says 172.21.15.157:45610) 2024-05-09T09:49:29.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.375+0000 7f311b8b1640 1 -- 172.21.15.157:0/2450025774 learned_addr learned my addr 172.21.15.157:0/2450025774 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:49:29.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.375+0000 7f311c0b2640 1 -- 172.21.15.157:0/2450025774 >> v1:172.21.15.110:6789/0 conn(0x561b5c093b30 legacy=0x561b5c095f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.375+0000 7f311c0b2640 1 -- 172.21.15.157:0/2450025774 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b5bf3c990 con 0x561b5c004a70 2024-05-09T09:49:29.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.375+0000 7f311c0b2640 1 --2- 172.21.15.157:0/2450025774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c004a70 0x561b5c0935f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f310c00a420 tx=0x7f310c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cde30f62b49c106 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.375+0000 7f311b0b0640 1 -- 172.21.15.157:0/2450025774 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f310c0af070 con 0x561b5c004a70 2024-05-09T09:49:29.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.375+0000 7f311b0b0640 1 -- 172.21.15.157:0/2450025774 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f310c0aa530 con 0x561b5c004a70 2024-05-09T09:49:29.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.375+0000 7f311b0b0640 1 -- 172.21.15.157:0/2450025774 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f310c0aa850 con 0x561b5c004a70 2024-05-09T09:49:29.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.375+0000 7f311e597980 1 -- 172.21.15.157:0/2450025774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c004a70 msgr2=0x561b5c0935f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.375+0000 7f311e597980 1 --2- 172.21.15.157:0/2450025774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c004a70 0x561b5c0935f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f310c00a420 tx=0x7f310c01afd0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.375+0000 7f311e597980 1 -- 172.21.15.157:0/2450025774 shutdown_connections 2024-05-09T09:49:29.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.375+0000 7f311e597980 1 --2- 172.21.15.157:0/2450025774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c004a70 0x561b5c0935f0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.375+0000 7f311e597980 1 -- 172.21.15.157:0/2450025774 >> 172.21.15.157:0/2450025774 conn(0x561b5c08b0d0 msgr2=0x561b5c08d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:29.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.379+0000 7f311e597980 1 -- 172.21.15.157:0/2450025774 shutdown_connections 2024-05-09T09:49:29.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.379+0000 7f311e597980 1 -- 172.21.15.157:0/2450025774 wait complete. 2024-05-09T09:49:29.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.391+0000 7f311e597980 1 Processor -- start 2024-05-09T09:49:29.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.391+0000 7f311e597980 1 -- start start 2024-05-09T09:49:29.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.391+0000 7f311e597980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c004a70 0x561b5c17bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.391+0000 7f311e597980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561b5bf93fe0 con 0x561b5c004a70 2024-05-09T09:49:29.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.391+0000 7f311c0b2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c004a70 0x561b5c17bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.391+0000 7f311c0b2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c004a70 0x561b5c17bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39290/0 (socket says 172.21.15.157:39290) 2024-05-09T09:49:29.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.391+0000 7f311c0b2640 1 -- 172.21.15.157:0/3445186413 learned_addr learned my addr 172.21.15.157:0/3445186413 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:29.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.391+0000 7f311c0b2640 1 -- 172.21.15.157:0/3445186413 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b5bf18ae0 con 0x561b5c004a70 2024-05-09T09:49:29.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.391+0000 7f311c0b2640 1 --2- 172.21.15.157:0/3445186413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c004a70 0x561b5c17bb90 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f310c018c00 tx=0x7f310c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e75fe9f276747711 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.391+0000 7f300a60c640 1 -- 172.21.15.157:0/3445186413 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f310c0af050 con 0x561b5c004a70 2024-05-09T09:49:29.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.391+0000 7f300a60c640 1 -- 172.21.15.157:0/3445186413 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f310c0b0040 con 0x561b5c004a70 2024-05-09T09:49:29.394 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.391+0000 7f300a60c640 1 -- 172.21.15.157:0/3445186413 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f310c0aabb0 con 0x561b5c004a70 2024-05-09T09:49:29.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.391+0000 7f311e597980 1 -- 172.21.15.157:0/3445186413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c004a70 msgr2=0x561b5c17bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.391+0000 7f311e597980 1 --2- 172.21.15.157:0/3445186413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c004a70 0x561b5c17bb90 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f310c018c00 tx=0x7f310c0033b0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.391+0000 7f311e597980 1 -- 172.21.15.157:0/3445186413 shutdown_connections 2024-05-09T09:49:29.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.391+0000 7f311e597980 1 --2- 172.21.15.157:0/3445186413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c004a70 0x561b5c17bb90 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.391+0000 7f311e597980 1 -- 172.21.15.157:0/3445186413 >> 172.21.15.157:0/3445186413 conn(0x561b5c08b0d0 msgr2=0x561b5c177720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:29.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.391+0000 7f311e597980 1 -- 172.21.15.157:0/3445186413 shutdown_connections 2024-05-09T09:49:29.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.391+0000 7f311e597980 1 -- 172.21.15.157:0/3445186413 wait complete. 2024-05-09T09:49:29.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.391+0000 7f311e597980 1 Processor -- start 2024-05-09T09:49:29.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.395+0000 7f311e597980 1 -- start start 2024-05-09T09:49:29.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.395+0000 7f311e597980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c004a70 0x561b5c090ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.395+0000 7f311e597980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561b5c098150 con 0x561b5c004a70 2024-05-09T09:49:29.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.395+0000 7f311c0b2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c004a70 0x561b5c090ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.395+0000 7f311c0b2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c004a70 0x561b5c090ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39298/0 (socket says 172.21.15.157:39298) 2024-05-09T09:49:29.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.395+0000 7f311c0b2640 1 -- 172.21.15.157:0/751618947 learned_addr learned my addr 172.21.15.157:0/751618947 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:29.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.395+0000 7f311c0b2640 1 -- 172.21.15.157:0/751618947 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b5c0913e0 con 0x561b5c004a70 2024-05-09T09:49:29.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.395+0000 7f311c0b2640 1 --2- 172.21.15.157:0/751618947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c004a70 0x561b5c090ea0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f310c019680 tx=0x7f310c019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.395+0000 7f3008e09640 1 -- 172.21.15.157:0/751618947 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f310c0c5070 con 0x561b5c004a70 2024-05-09T09:49:29.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.395+0000 7f3008e09640 1 -- 172.21.15.157:0/751618947 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f310c0b6c60 con 0x561b5c004a70 2024-05-09T09:49:29.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.395+0000 7f311e597980 1 -- 172.21.15.157:0/751618947 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561b5c08f610 con 0x561b5c004a70 2024-05-09T09:49:29.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.395+0000 7f3008e09640 1 -- 172.21.15.157:0/751618947 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f310c0cf060 con 0x561b5c004a70 2024-05-09T09:49:29.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.395+0000 7f311e597980 1 -- 172.21.15.157:0/751618947 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b5c08fb00 con 0x561b5c004a70 2024-05-09T09:49:29.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.395+0000 7f3008e09640 1 -- 172.21.15.157:0/751618947 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f310c0c8070 con 0x561b5c004a70 2024-05-09T09:49:29.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.395+0000 7f3008e09640 1 --2- 172.21.15.157:0/751618947 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3004034bb0 0x7f3004037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.395+0000 7f3008e09640 1 -- 172.21.15.157:0/751618947 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f310c0bb070 con 0x561b5c004a70 2024-05-09T09:49:29.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.395+0000 7f311b8b1640 1 --2- 172.21.15.157:0/751618947 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3004034bb0 0x7f3004037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.395+0000 7f311e597980 1 --2- 172.21.15.157:0/751618947 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561b5c093b30 0x561b5c18c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.395+0000 7f311e597980 1 -- 172.21.15.157:0/751618947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561b5c18c570 con 0x561b5c093b30 2024-05-09T09:49:29.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.395+0000 7f311c8b3640 1 --2- 172.21.15.157:0/751618947 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561b5c093b30 0x561b5c18c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.395+0000 7f311b8b1640 1 --2- 172.21.15.157:0/751618947 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3004034bb0 0x7f3004037070 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3104000f70 tx=0x7f31040012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.395+0000 7f311c8b3640 1 --2- 172.21.15.157:0/751618947 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561b5c093b30 0x561b5c18c030 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.399+0000 7f311c8b3640 1 -- 172.21.15.157:0/751618947 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31140083f0 con 0x561b5c093b30 2024-05-09T09:49:29.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.399+0000 7f311e597980 1 -- 172.21.15.157:0/751618947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561b5c18c910 con 0x561b5c093b30 2024-05-09T09:49:29.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.399+0000 7f311c8b3640 1 -- 172.21.15.157:0/751618947 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f31140083f0 con 0x561b5c093b30 2024-05-09T09:49:29.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.399+0000 7f311e597980 1 --2- 172.21.15.157:0/751618947 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561b5c18e700 0x561b5c190af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.399+0000 7f311e597980 1 -- 172.21.15.157:0/751618947 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1911c0 con 0x561b5c18e700 2024-05-09T09:49:29.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.399+0000 7f311c0b2640 1 --2- 172.21.15.157:0/751618947 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561b5c18e700 0x561b5c190af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.399+0000 7f311c0b2640 1 --2- 172.21.15.157:0/751618947 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561b5c18e700 0x561b5c190af0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.399+0000 7f311c0b2640 1 -- 172.21.15.157:0/751618947 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f310c0c7030 con 0x561b5c18e700 2024-05-09T09:49:29.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.399+0000 7f311e597980 1 -- 172.21.15.157:0/751618947 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561b5c18d5a0 con 0x561b5c093b30 2024-05-09T09:49:29.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.399+0000 7f311c8b3640 1 -- 172.21.15.157:0/751618947 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f31140083f0 con 0x561b5c093b30 2024-05-09T09:49:29.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.399+0000 7f311e597980 1 --2- 172.21.15.157:0/751618947 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561b5c192600 0x561b5c1949f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.399+0000 7f311e597980 1 -- 172.21.15.157:0/751618947 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561b5c195130 con 0x561b5c192600 2024-05-09T09:49:29.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.399+0000 7f311b8b1640 1 --2- 172.21.15.157:0/751618947 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561b5c192600 0x561b5c1949f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.399+0000 7f311b8b1640 1 --2- 172.21.15.157:0/751618947 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561b5c192600 0x561b5c1949f0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.402 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.399+0000 7f311b8b1640 1 -- 172.21.15.157:0/751618947 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f310400e620 con 0x561b5c192600 2024-05-09T09:49:29.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.403+0000 7f311e597980 1 Processor -- start 2024-05-09T09:49:29.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.403+0000 7f311e597980 1 -- start start 2024-05-09T09:49:29.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.403+0000 7f311e597980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c1bb180 0x561b5c1bb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.403+0000 7f311e597980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561b5bf98020 con 0x561b5c1bb180 2024-05-09T09:49:29.405 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.403+0000 7f311c0b2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c1bb180 0x561b5c1bb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.403+0000 7f311c0b2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c1bb180 0x561b5c1bb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39310/0 (socket says 172.21.15.157:39310) 2024-05-09T09:49:29.406 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.403+0000 7f311c0b2640 1 -- 172.21.15.157:0/2323995358 learned_addr learned my addr 172.21.15.157:0/2323995358 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:29.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.403+0000 7f311c0b2640 1 -- 172.21.15.157:0/2323995358 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b5c1bbae0 con 0x561b5c1bb180 2024-05-09T09:49:29.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.403+0000 7f311c0b2640 1 --2- 172.21.15.157:0/2323995358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c1bb180 0x561b5c1bb5a0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f310c0c1f70 tx=0x7f310c0c0750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.407+0000 7f3000b9e640 1 -- 172.21.15.157:0/2323995358 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f310c0c0cd0 con 0x561b5c1bb180 2024-05-09T09:49:29.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.407+0000 7f3000b9e640 1 -- 172.21.15.157:0/2323995358 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f310c0c2ab0 con 0x561b5c1bb180 2024-05-09T09:49:29.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.407+0000 7f311e597980 1 -- 172.21.15.157:0/2323995358 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561b5c1bbae0 con 0x561b5c1bb180 2024-05-09T09:49:29.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.407+0000 7f3000b9e640 1 -- 172.21.15.157:0/2323995358 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f310c0c2db0 con 0x561b5c1bb180 2024-05-09T09:49:29.407 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.407+0000 7f311e597980 1 -- 172.21.15.157:0/2323995358 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b5c1bbae0 con 0x561b5c1bb180 2024-05-09T09:49:29.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.407+0000 7f3000b9e640 1 -- 172.21.15.157:0/2323995358 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f310c0c1660 con 0x561b5c1bb180 2024-05-09T09:49:29.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.407+0000 7f3000b9e640 1 --2- 172.21.15.157:0/2323995358 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2ff4034b60 0x7f2ff4037020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.407+0000 7f3000b9e640 1 -- 172.21.15.157:0/2323995358 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f310c0f3ac0 con 0x561b5c1bb180 2024-05-09T09:49:29.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.407+0000 7f311b8b1640 1 --2- 172.21.15.157:0/2323995358 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2ff4034b60 0x7f2ff4037020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.407+0000 7f311e597980 1 Processor -- start 2024-05-09T09:49:29.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.407+0000 7f311e597980 1 -- start start 2024-05-09T09:49:29.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.407+0000 7f311b8b1640 1 --2- 172.21.15.157:0/2323995358 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2ff4034b60 0x7f2ff4037020 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f310400bf60 tx=0x7f310400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.407+0000 7f311e597980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c1c7d50 0x561b5c1c8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.407+0000 7f311e597980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561b5c17c220 con 0x561b5c1c7d50 2024-05-09T09:49:29.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.407+0000 7f311c0b2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c1c7d50 0x561b5c1c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.407+0000 7f311c0b2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c1c7d50 0x561b5c1c8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39320/0 (socket says 172.21.15.157:39320) 2024-05-09T09:49:29.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.407+0000 7f311c0b2640 1 -- 172.21.15.157:0/3758399066 learned_addr learned my addr 172.21.15.157:0/3758399066 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:29.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.407+0000 7f311c0b2640 1 -- 172.21.15.157:0/3758399066 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b5c1c8720 con 0x561b5c1c7d50 2024-05-09T09:49:29.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.407+0000 7f311c0b2640 1 --2- 172.21.15.157:0/3758399066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c1c7d50 0x561b5c1c8150 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f310c0bf410 tx=0x7f310c0c1a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450553c6ad6a1846 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.407+0000 7f2ffa7fc640 1 -- 172.21.15.157:0/3758399066 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f310c100070 con 0x561b5c1c7d50 2024-05-09T09:49:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.407+0000 7f2ffa7fc640 1 -- 172.21.15.157:0/3758399066 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f310c0dba20 con 0x561b5c1c7d50 2024-05-09T09:49:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.407+0000 7f2ffa7fc640 1 -- 172.21.15.157:0/3758399066 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f310c0b4c60 con 0x561b5c1c7d50 2024-05-09T09:49:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.411+0000 7f311e597980 1 -- 172.21.15.157:0/3758399066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c1c7d50 msgr2=0x561b5c1c8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.411+0000 7f311e597980 1 --2- 172.21.15.157:0/3758399066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c1c7d50 0x561b5c1c8150 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f310c0bf410 tx=0x7f310c0c1a60 comp rx=0 tx=0).stop 2024-05-09T09:49:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.411+0000 7f311e597980 1 -- 172.21.15.157:0/3758399066 shutdown_connections 2024-05-09T09:49:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.411+0000 7f311e597980 1 --2- 172.21.15.157:0/3758399066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c1c7d50 0x561b5c1c8150 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.411+0000 7f311e597980 1 -- 172.21.15.157:0/3758399066 >> 172.21.15.157:0/3758399066 conn(0x561b5c1c40d0 msgr2=0x561b5c1c2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.411+0000 7f311e597980 1 -- 172.21.15.157:0/3758399066 shutdown_connections 2024-05-09T09:49:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.411+0000 7f311e597980 1 -- 172.21.15.157:0/3758399066 wait complete. 2024-05-09T09:49:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.411+0000 7f311e597980 1 Processor -- start 2024-05-09T09:49:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.411+0000 7f311e597980 1 -- start start 2024-05-09T09:49:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.411+0000 7f311e597980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c1c7d50 0x561b5c1cf090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.411+0000 7f311e597980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561b5c1c8e10 con 0x561b5c1c7d50 2024-05-09T09:49:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.411+0000 7f311c0b2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c1c7d50 0x561b5c1cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.411+0000 7f311c0b2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c1c7d50 0x561b5c1cf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39330/0 (socket says 172.21.15.157:39330) 2024-05-09T09:49:29.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.411+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 learned_addr learned my addr 172.21.15.157:0/3119595052 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:29.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.411+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b5c1cf5d0 con 0x561b5c1c7d50 2024-05-09T09:49:29.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.411+0000 7f311c0b2640 1 --2- 172.21.15.157:0/3119595052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c1c7d50 0x561b5c1cf090 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f310c0bf410 tx=0x7f310c0bef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.411+0000 7f2ff8ff9640 1 -- 172.21.15.157:0/3119595052 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f310c115070 con 0x561b5c1c7d50 2024-05-09T09:49:29.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.411+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561b5c1cf5d0 con 0x561b5c1c7d50 2024-05-09T09:49:29.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.411+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b5c1cf5d0 con 0x561b5c1c7d50 2024-05-09T09:49:29.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.411+0000 7f2ff8ff9640 1 -- 172.21.15.157:0/3119595052 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f310c0d4560 con 0x561b5c1c7d50 2024-05-09T09:49:29.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.411+0000 7f2ff8ff9640 1 -- 172.21.15.157:0/3119595052 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f310c100040 con 0x561b5c1c7d50 2024-05-09T09:49:29.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.411+0000 7f2ff8ff9640 1 -- 172.21.15.157:0/3119595052 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f310c118070 con 0x561b5c1c7d50 2024-05-09T09:49:29.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.411+0000 7f2ff8ff9640 1 --2- 172.21.15.157:0/3119595052 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2fe4034bb0 0x7f2fe4037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.411+0000 7f2ff8ff9640 1 -- 172.21.15.157:0/3119595052 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f310c10b030 con 0x561b5c1c7d50 2024-05-09T09:49:29.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.411+0000 7f311b8b1640 1 --2- 172.21.15.157:0/3119595052 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2fe4034bb0 0x7f2fe4037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.411+0000 7f311e597980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.411+0000 7f311e597980 1 --2- 172.21.15.157:0/3119595052 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561b5c1dbc50 0x561b5c1de110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.411+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1de860 con 0x561b5c1dbc50 2024-05-09T09:49:29.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.411+0000 7f311c8b3640 1 --2- 172.21.15.157:0/3119595052 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561b5c1dbc50 0x561b5c1de110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311b8b1640 1 --2- 172.21.15.157:0/3119595052 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2fe4034bb0 0x7f2fe4037070 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x561b5c08fde0 tx=0x7f3104010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311c8b3640 1 --2- 172.21.15.157:0/3119595052 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561b5c1dbc50 0x561b5c1de110 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31140083f0 con 0x561b5c1dbc50 2024-05-09T09:49:29.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311e597980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311e597980 20 realm 2024-05-09T09:49:29.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311e597980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1dec70 con 0x561b5c1dbc50 2024-05-09T09:49:29.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31140083f0 con 0x561b5c1dbc50 2024-05-09T09:49:29.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311e597980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311e597980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:49:29.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311e597980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df540 con 0x561b5c1dbc50 2024-05-09T09:49:29.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31140083f0 con 0x561b5c1dbc50 2024-05-09T09:49:29.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311e597980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311e597980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x561b5c1dbc50 2024-05-09T09:49:29.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f31140083f0 con 0x561b5c1dbc50 2024-05-09T09:49:29.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311e597980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:29.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311e597980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311e597980 1 --2- 172.21.15.157:0/3119595052 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561b5c1e0640 0x561b5c1e2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1e2ff0 con 0x561b5c1e0640 2024-05-09T09:49:29.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311c0b2640 1 --2- 172.21.15.157:0/3119595052 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561b5c1e0640 0x561b5c1e2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311c0b2640 1 --2- 172.21.15.157:0/3119595052 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561b5c1e0640 0x561b5c1e2a30 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f310c117030 con 0x561b5c1e0640 2024-05-09T09:49:29.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311e597980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:49:29.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311e597980 20 searching for the correct realm 2024-05-09T09:49:29.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311e597980 1 --2- 172.21.15.157:0/3119595052 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561b5c1e4f40 0x561b5c1e7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1e7a20 con 0x561b5c1e4f40 2024-05-09T09:49:29.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311b8b1640 1 --2- 172.21.15.157:0/3119595052 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561b5c1e4f40 0x561b5c1e7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311b8b1640 1 --2- 172.21.15.157:0/3119595052 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561b5c1e4f40 0x561b5c1e7350 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311b8b1640 1 --2- 172.21.15.157:0/3119595052 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f3104037040 0x7f3104036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1e7a20 con 0x7f3104037040 2024-05-09T09:49:29.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.415+0000 7f311c8b3640 1 --2- 172.21.15.157:0/3119595052 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f3104037040 0x7f3104036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.419+0000 7f311c8b3640 1 --2- 172.21.15.157:0/3119595052 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f3104037040 0x7f3104036410 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.419+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31140083f0 con 0x7f3104037040 2024-05-09T09:49:29.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.419+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x561b5c1e0640 2024-05-09T09:49:29.425 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.419+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f310c117030 con 0x561b5c1e0640 2024-05-09T09:49:29.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.419+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x561b5c1dbc50 2024-05-09T09:49:29.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.419+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31140083f0 con 0x561b5c1dbc50 2024-05-09T09:49:29.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.419+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x561b5c1dbc50 2024-05-09T09:49:29.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.419+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3114026040 con 0x561b5c1dbc50 2024-05-09T09:49:29.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.419+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x561b5c1e0640 2024-05-09T09:49:29.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.419+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f310c117030 con 0x561b5c1e0640 2024-05-09T09:49:29.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.419+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x561b5c1e0640 2024-05-09T09:49:29.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.419+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f310c117030 con 0x561b5c1e0640 2024-05-09T09:49:29.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.419+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x7f3104037040 2024-05-09T09:49:29.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.419+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3114026040 con 0x7f3104037040 2024-05-09T09:49:29.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.419+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x561b5c1e4f40 2024-05-09T09:49:29.426 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.419+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.419+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x561b5c1dbc50 2024-05-09T09:49:29.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.419+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3114026040 con 0x561b5c1dbc50 2024-05-09T09:49:29.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.419+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x561b5c1e0640 2024-05-09T09:49:29.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.423+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f310c117030 con 0x561b5c1e0640 2024-05-09T09:49:29.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.423+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x561b5c1dbc50 2024-05-09T09:49:29.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.423+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3114026040 con 0x561b5c1dbc50 2024-05-09T09:49:29.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.423+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x7f3104037040 2024-05-09T09:49:29.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.423+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3114026040 con 0x7f3104037040 2024-05-09T09:49:29.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.423+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x561b5c1e4f40 2024-05-09T09:49:29.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.423+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.423+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x561b5c1e4f40 2024-05-09T09:49:29.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.423+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.423+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x561b5c1e0640 2024-05-09T09:49:29.427 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.423+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f310c117030 con 0x561b5c1e0640 2024-05-09T09:49:29.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.423+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x561b5c1e4f40 2024-05-09T09:49:29.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.423+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.423+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x561b5c1e4f40 2024-05-09T09:49:29.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.423+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.423+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x561b5c1dbc50 2024-05-09T09:49:29.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.423+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3114026040 con 0x561b5c1dbc50 2024-05-09T09:49:29.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.423+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x561b5c1dbc50 2024-05-09T09:49:29.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.423+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3114026040 con 0x561b5c1dbc50 2024-05-09T09:49:29.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.423+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x561b5c1e0640 2024-05-09T09:49:29.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.423+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f310c117030 con 0x561b5c1e0640 2024-05-09T09:49:29.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.423+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x561b5c1e4f40 2024-05-09T09:49:29.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.427+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.427+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x7f3104037040 2024-05-09T09:49:29.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.427+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3114026040 con 0x7f3104037040 2024-05-09T09:49:29.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.427+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x561b5c1dbc50 2024-05-09T09:49:29.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.427+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3114026040 con 0x561b5c1dbc50 2024-05-09T09:49:29.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.427+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x561b5c1e0640 2024-05-09T09:49:29.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.427+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f310c117030 con 0x561b5c1e0640 2024-05-09T09:49:29.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.427+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x561b5c1e4f40 2024-05-09T09:49:29.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.427+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.427+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x561b5c1e0640 2024-05-09T09:49:29.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.427+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f310c117030 con 0x561b5c1e0640 2024-05-09T09:49:29.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.427+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x7f3104037040 2024-05-09T09:49:29.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.427+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3114026040 con 0x7f3104037040 2024-05-09T09:49:29.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.427+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x561b5c1e4f40 2024-05-09T09:49:29.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.427+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.427+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x561b5c1e0640 2024-05-09T09:49:29.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.427+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f310c117030 con 0x561b5c1e0640 2024-05-09T09:49:29.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.427+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x561b5c1dbc50 2024-05-09T09:49:29.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.427+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3114026040 con 0x561b5c1dbc50 2024-05-09T09:49:29.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.427+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1df8e0 con 0x7f3104037040 2024-05-09T09:49:29.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3114026040 con 0x7f3104037040 2024-05-09T09:49:29.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:49:29.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:49:29.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:49:29.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:49:29.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:49:29.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:49:29.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1e38b0 con 0x561b5c1dbc50 2024-05-09T09:49:29.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3114026040 con 0x561b5c1dbc50 2024-05-09T09:49:29.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1e38b0 con 0x561b5c1dbc50 2024-05-09T09:49:29.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3114026040 con 0x561b5c1dbc50 2024-05-09T09:49:29.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:29.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1e38b0 con 0x561b5c1e4f40 2024-05-09T09:49:29.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:49:29.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 20 zone default found 2024-05-09T09:49:29.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 4 Realm: () 2024-05-09T09:49:29.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:49:29.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:49:29.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:49:29.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 20 zonegroup default 2024-05-09T09:49:29.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1e42a0 con 0x561b5c1e0640 2024-05-09T09:49:29.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f310c117030 con 0x561b5c1e0640 2024-05-09T09:49:29.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1e9d30 con 0x561b5c1e4f40 2024-05-09T09:49:29.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1ea0d0 con 0x561b5c1e4f40 2024-05-09T09:49:29.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 20 started sync module instance, tier type = 2024-05-09T09:49:29.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:49:29.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1e9170 con 0x7f3104037040 2024-05-09T09:49:29.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3114026040 con 0x7f3104037040 2024-05-09T09:49:29.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94675509613968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1e9170 con 0x7f3104037040 2024-05-09T09:49:29.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.431+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1ea920 con 0x561b5c1dbc50 2024-05-09T09:49:29.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.435+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94675509613968] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3114036040 con 0x7f3104037040 2024-05-09T09:49:29.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.435+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3114036040 con 0x561b5c1dbc50 2024-05-09T09:49:29.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.435+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94675509618048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1e9170 con 0x561b5c1dbc50 2024-05-09T09:49:29.438 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.435+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1eb330 con 0x561b5c1e4f40 2024-05-09T09:49:29.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.439+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.439+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94675509620352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1ebb80 con 0x561b5c1e4f40 2024-05-09T09:49:29.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.439+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1ec540 con 0x7f3104037040 2024-05-09T09:49:29.439 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.439+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94675509618048] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3114036040 con 0x561b5c1dbc50 2024-05-09T09:49:29.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.439+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3114036040 con 0x7f3104037040 2024-05-09T09:49:29.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.439+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94675509624976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1ec4b0 con 0x7f3104037040 2024-05-09T09:49:29.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.439+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1ed2c0 con 0x561b5c1dbc50 2024-05-09T09:49:29.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.439+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94675509620352] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.439+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94675509624976] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3114036040 con 0x7f3104037040 2024-05-09T09:49:29.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.439+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3114036040 con 0x561b5c1dbc50 2024-05-09T09:49:29.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.439+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94675509622480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1ecd80 con 0x561b5c1dbc50 2024-05-09T09:49:29.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.439+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1ed610 con 0x561b5c1e0640 2024-05-09T09:49:29.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.443+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94675509622480] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3114036040 con 0x561b5c1dbc50 2024-05-09T09:49:29.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.443+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f310c117030 con 0x561b5c1e0640 2024-05-09T09:49:29.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.443+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94675509627360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1eda30 con 0x561b5c1e0640 2024-05-09T09:49:29.444 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.443+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1ee2c0 con 0x561b5c1e0640 2024-05-09T09:49:29.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.443+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f310c117030 con 0x561b5c1e0640 2024-05-09T09:49:29.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.443+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94675509634656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1eef30 con 0x561b5c1e0640 2024-05-09T09:49:29.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.443+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1efa20 con 0x561b5c1e0640 2024-05-09T09:49:29.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.443+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94675509627360] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f310c117030 con 0x561b5c1e0640 2024-05-09T09:49:29.447 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.447+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94675509634656] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f310c117030 con 0x561b5c1e0640 2024-05-09T09:49:29.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.447+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f310c117030 con 0x561b5c1e0640 2024-05-09T09:49:29.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.447+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94675509638384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1eea80 con 0x561b5c1e0640 2024-05-09T09:49:29.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.447+0000 7f311e597980 20 add_watcher() i=0 2024-05-09T09:49:29.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.447+0000 7f311e597980 20 add_watcher() i=1 2024-05-09T09:49:29.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.447+0000 7f311e597980 20 add_watcher() i=2 2024-05-09T09:49:29.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.447+0000 7f311e597980 20 add_watcher() i=3 2024-05-09T09:49:29.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.447+0000 7f311e597980 20 add_watcher() i=4 2024-05-09T09:49:29.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.447+0000 7f311e597980 20 add_watcher() i=5 2024-05-09T09:49:29.448 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.447+0000 7f311e597980 20 add_watcher() i=6 2024-05-09T09:49:29.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.447+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94675509638384] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f310c117030 con 0x561b5c1e0640 2024-05-09T09:49:29.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.447+0000 7f311e597980 20 add_watcher() i=7 2024-05-09T09:49:29.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.447+0000 7f311e597980 2 all 8 watchers are set, enabling cache 2024-05-09T09:49:29.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.447+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1f2b20 con 0x561b5c1dbc50 2024-05-09T09:49:29.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.447+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3114036040 con 0x561b5c1dbc50 2024-05-09T09:49:29.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.447+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94675509628480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1effa0 con 0x561b5c1dbc50 2024-05-09T09:49:29.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.451+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94675509628480] v32'450 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3114036040 con 0x561b5c1dbc50 2024-05-09T09:49:29.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.451+0000 7f2fd17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:29.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.451+0000 7f311e597980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:49:29.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.451+0000 7f311e597980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:49:29.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.451+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fb250 con 0x561b5c1dbc50 2024-05-09T09:49:29.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.451+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'103 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3114036040 con 0x561b5c1dbc50 2024-05-09T09:49:29.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.451+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fb920 con 0x561b5c1e0640 2024-05-09T09:49:29.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.455+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'98 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f310c117030 con 0x561b5c1e0640 2024-05-09T09:49:29.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.455+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fbd40 con 0x561b5c1e4f40 2024-05-09T09:49:29.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.455+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'97 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.455+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fc130 con 0x561b5c1dbc50 2024-05-09T09:49:29.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.455+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'451 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3114036040 con 0x561b5c1dbc50 2024-05-09T09:49:29.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.455+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fc520 con 0x7f3104037040 2024-05-09T09:49:29.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.455+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'278 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3114036040 con 0x7f3104037040 2024-05-09T09:49:29.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.455+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fc940 con 0x561b5c1e4f40 2024-05-09T09:49:29.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.459+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'186 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.459 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.459+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fceb0 con 0x561b5c1dbc50 2024-05-09T09:49:29.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.459+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'98 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3114036040 con 0x561b5c1dbc50 2024-05-09T09:49:29.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.459+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fceb0 con 0x561b5c1e0640 2024-05-09T09:49:29.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.463+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'185 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f310c117030 con 0x561b5c1e0640 2024-05-09T09:49:29.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.463+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fceb0 con 0x7f3104037040 2024-05-09T09:49:29.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.463+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'96 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3114036040 con 0x7f3104037040 2024-05-09T09:49:29.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.463+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fceb0 con 0x561b5c1e4f40 2024-05-09T09:49:29.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.463+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'102 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.463+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fd2d0 con 0x7f3104037040 2024-05-09T09:49:29.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.467+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'279 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3114036040 con 0x7f3104037040 2024-05-09T09:49:29.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.467+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fd2d0 con 0x561b5c1e0640 2024-05-09T09:49:29.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.467+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'102 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f310c117030 con 0x561b5c1e0640 2024-05-09T09:49:29.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.467+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fd2d0 con 0x7f3104037040 2024-05-09T09:49:29.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.471+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'96 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3114036040 con 0x7f3104037040 2024-05-09T09:49:29.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.471+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fd2d0 con 0x561b5c1e0640 2024-05-09T09:49:29.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.471+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'191 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f310c117030 con 0x561b5c1e0640 2024-05-09T09:49:29.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.471+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fd2d0 con 0x561b5c1dbc50 2024-05-09T09:49:29.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.475+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'452 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3114036040 con 0x561b5c1dbc50 2024-05-09T09:49:29.474 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.475+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fd2d0 con 0x561b5c1e4f40 2024-05-09T09:49:29.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.475+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'272 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.477 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.475+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fd360 con 0x7f3104037040 2024-05-09T09:49:29.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.475+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'280 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3114036040 con 0x7f3104037040 2024-05-09T09:49:29.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.475+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fd360 con 0x561b5c1e4f40 2024-05-09T09:49:29.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.479+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'96 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.479+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fd360 con 0x561b5c1dbc50 2024-05-09T09:49:29.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.479+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'104 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3114036040 con 0x561b5c1dbc50 2024-05-09T09:49:29.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.479+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fd360 con 0x561b5c1dbc50 2024-05-09T09:49:29.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.479+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'453 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3114036040 con 0x561b5c1dbc50 2024-05-09T09:49:29.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.479+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fd360 con 0x561b5c1e4f40 2024-05-09T09:49:29.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.483+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'273 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.483+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fd360 con 0x7f3104037040 2024-05-09T09:49:29.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.483+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'108 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3114036040 con 0x7f3104037040 2024-05-09T09:49:29.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.483+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fd950 con 0x561b5c1e4f40 2024-05-09T09:49:29.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.487+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'98 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.487+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fd950 con 0x561b5c1e4f40 2024-05-09T09:49:29.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.487+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'102 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.487+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fd950 con 0x561b5c1e4f40 2024-05-09T09:49:29.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.487+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'93 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.487+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fd950 con 0x561b5c1e4f40 2024-05-09T09:49:29.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.487+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'187 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.487+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fd950 con 0x561b5c1e0640 2024-05-09T09:49:29.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.491+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'98 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f310c117030 con 0x561b5c1e0640 2024-05-09T09:49:29.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.491+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fd950 con 0x561b5c1e4f40 2024-05-09T09:49:29.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.491+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'97 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.491+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fd950 con 0x561b5c1e0640 2024-05-09T09:49:29.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.495+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'186 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f310c117030 con 0x561b5c1e0640 2024-05-09T09:49:29.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.495+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fd950 con 0x561b5c1e4f40 2024-05-09T09:49:29.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.495+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'274 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.495+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fd950 con 0x561b5c1e0640 2024-05-09T09:49:29.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.499+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'192 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f310c117030 con 0x561b5c1e0640 2024-05-09T09:49:29.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.499+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1fd950 con 0x7f3104037040 2024-05-09T09:49:29.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.499+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'102 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3114036040 con 0x7f3104037040 2024-05-09T09:49:29.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.499+0000 7f2f4bfff640 20 reqs_thread_entry: start 2024-05-09T09:49:29.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.499+0000 7f311e597980 20 init_complete bucket index max shards: 11 2024-05-09T09:49:29.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.499+0000 7f2f49ffb640 20 reqs_thread_entry: start 2024-05-09T09:49:29.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.499+0000 7f311e597980 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-05-09T09:49:29.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.499+0000 7f311e597980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.499+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1f8f20 con 0x561b5c1e4f40 2024-05-09T09:49:29.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.503+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.503+0000 7f311e597980 20 rados_obj.operate() r=0 bl.length=363 2024-05-09T09:49:29.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.503+0000 7f311e597980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-05-09T09:49:29.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.503+0000 7f311e597980 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-05-09T09:49:29.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.503+0000 7f311e597980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:49:29.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.503+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1f8ee0 con 0x561b5c1e4f40 2024-05-09T09:49:29.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.503+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.503+0000 7f311e597980 10 removing key index: true_admin_akey 2024-05-09T09:49:29.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.503+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1f8ee0 con 0x561b5c1e4f40 2024-05-09T09:49:29.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.503+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== osd_op_reply(96 true_admin_akey [delete] v32'8 uv8 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.503+0000 7f311e597980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-05-09T09:49:29.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.503+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94675509676592 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561b5c21c0b0 con 0x561b5c1e0640 2024-05-09T09:49:29.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.503+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== watch-notify(notify (1) cookie 94675509627360 notify 137438953519 ret 0) ==== 207+0+0 (crc 0 0 0) 0x561b5c1fced0 con 0x561b5c1e0640 2024-05-09T09:49:29.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.503+0000 7f2ffa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953519 cookie 94675509627360 notifier 4873 bl.length()=165 2024-05-09T09:49:29.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.503+0000 7f2ffa7fc640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2fe0005580 con 0x561b5c1e0640 2024-05-09T09:49:29.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.503+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(97 notify.5 [notify cookie 94675509676592 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f310c117030 con 0x561b5c1e0640 2024-05-09T09:49:29.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.503+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f310c117030 con 0x561b5c1e0640 2024-05-09T09:49:29.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.503+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== watch-notify(notify_complete (2) cookie 94675509676592 notify 137438953519 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f310c0db420 con 0x561b5c1e0640 2024-05-09T09:49:29.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.503+0000 7f311e597980 10 removing email index: 2024-05-09T09:49:29.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.503+0000 7f311e597980 10 removing user buckets index 2024-05-09T09:49:29.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.507+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1f8a10 con 0x561b5c1e4f40 2024-05-09T09:49:29.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.507+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 30 ==== osd_op_reply(99 a_user.buckets [delete] v32'3 uv2 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.507+0000 7f311e597980 10 removing user index: a_user 2024-05-09T09:49:29.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.507+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1f8a10 con 0x561b5c1e4f40 2024-05-09T09:49:29.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.507+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 31 ==== osd_op_reply(100 a_user [call,call,delete] v32'2 uv2 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.507+0000 7f311e597980 10 removing default.rgw.meta+users.uid+a_user from cache 2024-05-09T09:49:29.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.507+0000 7f311e597980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-05-09T09:49:29.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.507+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94675509812192 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1f8a10 con 0x561b5c1e4f40 2024-05-09T09:49:29.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.507+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 32 ==== watch-notify(notify (1) cookie 94675509620352 notify 137438953482 ret 0) ==== 197+0+0 (crc 0 0 0) 0x561b5c1fc940 con 0x561b5c1e4f40 2024-05-09T09:49:29.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.507+0000 7f2ff9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953482 cookie 94675509620352 notifier 4873 bl.length()=155 2024-05-09T09:49:29.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.507+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 33 ==== osd_op_reply(101 notify.2 [notify cookie 94675509812192 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.507+0000 7f2ff9ffb640 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2f50003930 con 0x561b5c1e4f40 2024-05-09T09:49:29.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.507+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 34 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.507+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 35 ==== watch-notify(notify_complete (2) cookie 94675509812192 notify 137438953482 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561b5c1fcce0 con 0x561b5c1e4f40 2024-05-09T09:49:29.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.507+0000 7f2fd17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:29.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.507+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94675509628480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1f89b0 con 0x561b5c1dbc50 2024-05-09T09:49:29.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.511+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94675509628480] v32'454 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3114036040 con 0x561b5c1dbc50 2024-05-09T09:49:29.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.511+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94675509613968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1ece40 con 0x7f3104037040 2024-05-09T09:49:29.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.511+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94675509613968] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3114036040 con 0x7f3104037040 2024-05-09T09:49:29.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.511+0000 7f311e597980 20 remove_watcher() i=0 2024-05-09T09:49:29.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.511+0000 7f311e597980 2 removed watcher, disabling cache 2024-05-09T09:49:29.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.511+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94675509618048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1ece40 con 0x561b5c1dbc50 2024-05-09T09:49:29.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.511+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94675509618048] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3114036040 con 0x561b5c1dbc50 2024-05-09T09:49:29.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.511+0000 7f311e597980 20 remove_watcher() i=1 2024-05-09T09:49:29.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.511+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94675509620352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1ece40 con 0x561b5c1e4f40 2024-05-09T09:49:29.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.515+0000 7f311b8b1640 1 -- 172.21.15.157:0/3119595052 <== osd.3 v2:172.21.15.157:6816/2487336710 36 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94675509620352] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f310400e620 con 0x561b5c1e4f40 2024-05-09T09:49:29.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.515+0000 7f311e597980 20 remove_watcher() i=2 2024-05-09T09:49:29.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.515+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94675509624976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1ece40 con 0x7f3104037040 2024-05-09T09:49:29.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.515+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94675509624976] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3114036040 con 0x7f3104037040 2024-05-09T09:49:29.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.515+0000 7f311e597980 20 remove_watcher() i=3 2024-05-09T09:49:29.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.515+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94675509622480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1ec090 con 0x561b5c1dbc50 2024-05-09T09:49:29.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.519+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94675509622480] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3114036040 con 0x561b5c1dbc50 2024-05-09T09:49:29.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.519+0000 7f311e597980 20 remove_watcher() i=4 2024-05-09T09:49:29.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.519+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94675509627360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1ece40 con 0x561b5c1e0640 2024-05-09T09:49:29.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.519+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94675509627360] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f310c117030 con 0x561b5c1e0640 2024-05-09T09:49:29.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.519+0000 7f311e597980 20 remove_watcher() i=5 2024-05-09T09:49:29.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.519+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94675509634656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1eb6d0 con 0x561b5c1e0640 2024-05-09T09:49:29.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.523+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94675509634656] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f310c117030 con 0x561b5c1e0640 2024-05-09T09:49:29.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.523+0000 7f311e597980 20 remove_watcher() i=6 2024-05-09T09:49:29.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.523+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94675509638384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561b5c1ece90 con 0x561b5c1e0640 2024-05-09T09:49:29.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.523+0000 7f311c0b2640 1 -- 172.21.15.157:0/3119595052 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94675509638384] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f310c117030 con 0x561b5c1e0640 2024-05-09T09:49:29.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.523+0000 7f311e597980 20 remove_watcher() i=7 2024-05-09T09:49:29.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.523+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561b5c1e0640 msgr2=0x561b5c1e2a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.523+0000 7f311e597980 1 --2- 172.21.15.157:0/3119595052 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561b5c1e0640 0x561b5c1e2a30 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.523+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561b5c1dbc50 msgr2=0x561b5c1de110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.523+0000 7f311e597980 1 --2- 172.21.15.157:0/3119595052 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561b5c1dbc50 0x561b5c1de110 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.523+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f3104037040 msgr2=0x7f3104036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.523+0000 7f311e597980 1 --2- 172.21.15.157:0/3119595052 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f3104037040 0x7f3104036410 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.523+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561b5c1e4f40 msgr2=0x561b5c1e7350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.523+0000 7f311e597980 1 --2- 172.21.15.157:0/3119595052 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561b5c1e4f40 0x561b5c1e7350 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.523+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2fe4034bb0 msgr2=0x7f2fe4037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.523+0000 7f311e597980 1 --2- 172.21.15.157:0/3119595052 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2fe4034bb0 0x7f2fe4037070 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x561b5c08fde0 tx=0x7f3104010000 comp rx=0 tx=0).stop 2024-05-09T09:49:29.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.523+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c1c7d50 msgr2=0x561b5c1cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.523+0000 7f311c8b3640 1 -- 172.21.15.157:0/3119595052 reap_dead start 2024-05-09T09:49:29.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.523+0000 7f311e597980 1 --2- 172.21.15.157:0/3119595052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c1c7d50 0x561b5c1cf090 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f310c0bf410 tx=0x7f310c0bef60 comp rx=0 tx=0).stop 2024-05-09T09:49:29.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.523+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 shutdown_connections 2024-05-09T09:49:29.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.523+0000 7f311e597980 1 --2- 172.21.15.157:0/3119595052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c1c7d50 0x561b5c1cf090 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.523+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 >> 172.21.15.157:0/3119595052 conn(0x561b5c1c40d0 msgr2=0x561b5c1c1730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:29.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.523+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 shutdown_connections 2024-05-09T09:49:29.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.523+0000 7f311e597980 1 -- 172.21.15.157:0/3119595052 wait complete. 2024-05-09T09:49:29.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.527+0000 7f311e597980 1 -- 172.21.15.157:0/2323995358 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2ff4034b60 msgr2=0x7f2ff4037020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.527+0000 7f311e597980 1 --2- 172.21.15.157:0/2323995358 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2ff4034b60 0x7f2ff4037020 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f310400bf60 tx=0x7f310400f000 comp rx=0 tx=0).stop 2024-05-09T09:49:29.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.527+0000 7f311e597980 1 -- 172.21.15.157:0/2323995358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c1bb180 msgr2=0x561b5c1bb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.527+0000 7f311e597980 1 --2- 172.21.15.157:0/2323995358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c1bb180 0x561b5c1bb5a0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f310c0c1f70 tx=0x7f310c0c0750 comp rx=0 tx=0).stop 2024-05-09T09:49:29.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.527+0000 7f311e597980 1 -- 172.21.15.157:0/2323995358 shutdown_connections 2024-05-09T09:49:29.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.527+0000 7f311e597980 1 --2- 172.21.15.157:0/2323995358 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2ff4034b60 0x7f2ff4037020 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.527+0000 7f311e597980 1 --2- 172.21.15.157:0/2323995358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c1bb180 0x561b5c1bb5a0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.527+0000 7f311e597980 1 -- 172.21.15.157:0/2323995358 >> 172.21.15.157:0/2323995358 conn(0x561b5c1aff50 msgr2=0x561b5c1b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:29.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.527+0000 7f311e597980 1 -- 172.21.15.157:0/2323995358 shutdown_connections 2024-05-09T09:49:29.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.527+0000 7f311e597980 1 -- 172.21.15.157:0/2323995358 wait complete. 2024-05-09T09:49:29.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.527+0000 7f311e597980 1 -- 172.21.15.157:0/751618947 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561b5c18e700 msgr2=0x561b5c190af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.527+0000 7f311e597980 1 --2- 172.21.15.157:0/751618947 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561b5c18e700 0x561b5c190af0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.527+0000 7f311e597980 1 -- 172.21.15.157:0/751618947 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561b5c093b30 msgr2=0x561b5c18c030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.527+0000 7f311e597980 1 --2- 172.21.15.157:0/751618947 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x561b5c093b30 0x561b5c18c030 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.527+0000 7f311e597980 1 -- 172.21.15.157:0/751618947 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561b5c192600 msgr2=0x561b5c1949f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.527+0000 7f311e597980 1 --2- 172.21.15.157:0/751618947 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x561b5c192600 0x561b5c1949f0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.527+0000 7f311e597980 1 -- 172.21.15.157:0/751618947 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3004034bb0 msgr2=0x7f3004037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.527+0000 7f311e597980 1 --2- 172.21.15.157:0/751618947 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f3004034bb0 0x7f3004037070 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3104000f70 tx=0x7f31040012c0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.527+0000 7f311e597980 1 -- 172.21.15.157:0/751618947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c004a70 msgr2=0x561b5c090ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.527+0000 7f311e597980 1 --2- 172.21.15.157:0/751618947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561b5c004a70 0x561b5c090ea0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f310c019680 tx=0x7f310c019810 comp rx=0 tx=0).stop 2024-05-09T09:49:29.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.527+0000 7f311c8b3640 1 -- 172.21.15.157:0/751618947 reap_dead start 2024-05-09T09:49:29.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.527+0000 7f311e597980 1 -- 172.21.15.157:0/751618947 shutdown_connections 2024-05-09T09:49:29.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.527+0000 7f311e597980 1 -- 172.21.15.157:0/751618947 >> 172.21.15.157:0/751618947 conn(0x561b5c08b0d0 msgr2=0x561b5c176230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:29.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.527+0000 7f311e597980 1 -- 172.21.15.157:0/751618947 shutdown_connections 2024-05-09T09:49:29.531 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.527+0000 7f311e597980 1 -- 172.21.15.157:0/751618947 wait complete. 2024-05-09T09:49:29.536 ERROR:root:None 2024-05-09T09:49:29.536 ERROR:root:0 2024-05-09T09:49:29.537 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-05-09T09:49:29.537 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-05-09T09:49:29.537 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-05-09T09:49:29.607 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:49:29.607 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:49:29.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.607+0000 7f0246e93980 1 Processor -- start 2024-05-09T09:49:29.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.607+0000 7f0246e93980 1 -- start start 2024-05-09T09:49:29.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.607+0000 7f0246e93980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x56028864e040 0x560288650430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.607+0000 7f0246e93980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5602884fd440 con 0x560288649b40 2024-05-09T09:49:29.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.607+0000 7f0246e93980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5602884e85f0 con 0x56028864e040 2024-05-09T09:49:29.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.607+0000 7f02441ad640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x56028864e040 0x560288650430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.607+0000 7f02441ad640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x56028864e040 0x560288650430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39340/0 (socket says 172.21.15.157:39340) 2024-05-09T09:49:29.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.607+0000 7f02441ad640 1 -- 172.21.15.157:0/3459380882 learned_addr learned my addr 172.21.15.157:0/3459380882 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:29.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.607+0000 7f02449ae640 1 --1- 172.21.15.157:0/3459380882 >> v1:172.21.15.110:6789/0 conn(0x560288649b40 0x560288649f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:45620/0 (socket says 172.21.15.157:45620) 2024-05-09T09:49:29.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.607+0000 7f02441ad640 1 -- 172.21.15.157:0/3459380882 >> v1:172.21.15.110:6789/0 conn(0x560288649b40 legacy=0x560288649f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.609 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.607+0000 7f02441ad640 1 -- 172.21.15.157:0/3459380882 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602884f3990 con 0x56028864e040 2024-05-09T09:49:29.611 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.611+0000 7f02441ad640 1 --2- 172.21.15.157:0/3459380882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56028864e040 0x560288650430 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f023800a4e0 tx=0x7f023801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e1b941e90cad3a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.611+0000 7f02439ac640 1 -- 172.21.15.157:0/3459380882 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02380aa540 con 0x56028864e040 2024-05-09T09:49:29.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.611+0000 7f02439ac640 1 -- 172.21.15.157:0/3459380882 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02380aa6e0 con 0x56028864e040 2024-05-09T09:49:29.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.611+0000 7f02439ac640 1 -- 172.21.15.157:0/3459380882 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02380aaa40 con 0x56028864e040 2024-05-09T09:49:29.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.611+0000 7f0246e93980 1 -- 172.21.15.157:0/3459380882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56028864e040 msgr2=0x560288650430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.611+0000 7f0246e93980 1 --2- 172.21.15.157:0/3459380882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56028864e040 0x560288650430 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f023800a4e0 tx=0x7f023801b090 comp rx=0 tx=0).stop 2024-05-09T09:49:29.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.611+0000 7f0246e93980 1 -- 172.21.15.157:0/3459380882 shutdown_connections 2024-05-09T09:49:29.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.611+0000 7f0246e93980 1 --2- 172.21.15.157:0/3459380882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56028864e040 0x560288650430 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.611+0000 7f0246e93980 1 -- 172.21.15.157:0/3459380882 >> 172.21.15.157:0/3459380882 conn(0x5602885bd260 msgr2=0x5602885bd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:29.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.611+0000 7f0246e93980 1 -- 172.21.15.157:0/3459380882 shutdown_connections 2024-05-09T09:49:29.613 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.611+0000 7f0246e93980 1 -- 172.21.15.157:0/3459380882 wait complete. 2024-05-09T09:49:29.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.623+0000 7f0246e93980 1 Processor -- start 2024-05-09T09:49:29.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.623+0000 7f0246e93980 1 -- start start 2024-05-09T09:49:29.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.623+0000 7f0246e93980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560288649b40 0x560288734da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.623+0000 7f0246e93980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56028854afe0 con 0x560288649b40 2024-05-09T09:49:29.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.623+0000 7f02449ae640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560288649b40 0x560288734da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.623+0000 7f02449ae640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560288649b40 0x560288734da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39350/0 (socket says 172.21.15.157:39350) 2024-05-09T09:49:29.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.623+0000 7f02449ae640 1 -- 172.21.15.157:0/1968226610 learned_addr learned my addr 172.21.15.157:0/1968226610 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:29.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.623+0000 7f02449ae640 1 -- 172.21.15.157:0/1968226610 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602884cfae0 con 0x560288649b40 2024-05-09T09:49:29.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.623+0000 7f02449ae640 1 --2- 172.21.15.157:0/1968226610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560288649b40 0x560288734da0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f023400b240 tx=0x7f023400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5738dd31502a54 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.627+0000 7f0132e0d640 1 -- 172.21.15.157:0/1968226610 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f023400e700 con 0x560288649b40 2024-05-09T09:49:29.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.627+0000 7f0132e0d640 1 -- 172.21.15.157:0/1968226610 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f023400e8a0 con 0x560288649b40 2024-05-09T09:49:29.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.627+0000 7f0132e0d640 1 -- 172.21.15.157:0/1968226610 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f023400eb80 con 0x560288649b40 2024-05-09T09:49:29.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.627+0000 7f0246e93980 1 -- 172.21.15.157:0/1968226610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560288649b40 msgr2=0x560288734da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.628 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.627+0000 7f0246e93980 1 --2- 172.21.15.157:0/1968226610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560288649b40 0x560288734da0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f023400b240 tx=0x7f023400b700 comp rx=0 tx=0).stop 2024-05-09T09:49:29.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.627+0000 7f0246e93980 1 -- 172.21.15.157:0/1968226610 shutdown_connections 2024-05-09T09:49:29.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.627+0000 7f0246e93980 1 --2- 172.21.15.157:0/1968226610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560288649b40 0x560288734da0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.627+0000 7f0246e93980 1 -- 172.21.15.157:0/1968226610 >> 172.21.15.157:0/1968226610 conn(0x5602885bd260 msgr2=0x560288730930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:29.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.627+0000 7f0246e93980 1 -- 172.21.15.157:0/1968226610 shutdown_connections 2024-05-09T09:49:29.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.627+0000 7f0246e93980 1 -- 172.21.15.157:0/1968226610 wait complete. 2024-05-09T09:49:29.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.627+0000 7f0246e93980 1 Processor -- start 2024-05-09T09:49:29.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.627+0000 7f0246e93980 1 -- start start 2024-05-09T09:49:29.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.627+0000 7f0246e93980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560288649b40 0x56028873bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.627+0000 7f0246e93980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560288653460 con 0x560288649b40 2024-05-09T09:49:29.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.627+0000 7f02449ae640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560288649b40 0x56028873bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.627+0000 7f02449ae640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560288649b40 0x56028873bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39366/0 (socket says 172.21.15.157:39366) 2024-05-09T09:49:29.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.627+0000 7f02449ae640 1 -- 172.21.15.157:0/2675409835 learned_addr learned my addr 172.21.15.157:0/2675409835 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:29.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.627+0000 7f02449ae640 1 -- 172.21.15.157:0/2675409835 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56028873c500 con 0x560288649b40 2024-05-09T09:49:29.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.627+0000 7f02449ae640 1 --2- 172.21.15.157:0/2675409835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560288649b40 0x56028873bfc0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f0234000c10 tx=0x7f0234000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.627+0000 7f013160a640 1 -- 172.21.15.157:0/2675409835 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f023400fa90 con 0x560288649b40 2024-05-09T09:49:29.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.627+0000 7f0246e93980 1 -- 172.21.15.157:0/2675409835 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56028873c790 con 0x560288649b40 2024-05-09T09:49:29.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.627+0000 7f013160a640 1 -- 172.21.15.157:0/2675409835 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f023400fc50 con 0x560288649b40 2024-05-09T09:49:29.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.627+0000 7f013160a640 1 -- 172.21.15.157:0/2675409835 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f023402c060 con 0x560288649b40 2024-05-09T09:49:29.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.627+0000 7f0246e93980 1 -- 172.21.15.157:0/2675409835 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56028873f420 con 0x560288649b40 2024-05-09T09:49:29.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.631+0000 7f013160a640 1 -- 172.21.15.157:0/2675409835 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f0234017070 con 0x560288649b40 2024-05-09T09:49:29.632 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.631+0000 7f013160a640 1 --2- 172.21.15.157:0/2675409835 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f012c034bb0 0x7f012c037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.631+0000 7f013160a640 1 -- 172.21.15.157:0/2675409835 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f0234015020 con 0x560288649b40 2024-05-09T09:49:29.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.631+0000 7f02441ad640 1 --2- 172.21.15.157:0/2675409835 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f012c034bb0 0x7f012c037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.631+0000 7f0246e93980 1 --2- 172.21.15.157:0/2675409835 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56028864e040 0x560288742f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.631+0000 7f0246e93980 1 -- 172.21.15.157:0/2675409835 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5602887435a0 con 0x56028864e040 2024-05-09T09:49:29.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.631+0000 7f02451af640 1 --2- 172.21.15.157:0/2675409835 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56028864e040 0x560288742f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.631+0000 7f02441ad640 1 --2- 172.21.15.157:0/2675409835 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f012c034bb0 0x7f012c037070 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f02380ab000 tx=0x7f02380a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.631+0000 7f02451af640 1 --2- 172.21.15.157:0/2675409835 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56028864e040 0x560288742f60 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.631+0000 7f02451af640 1 -- 172.21.15.157:0/2675409835 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f023c0083f0 con 0x56028864e040 2024-05-09T09:49:29.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.631+0000 7f0246e93980 1 -- 172.21.15.157:0/2675409835 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560288740620 con 0x56028864e040 2024-05-09T09:49:29.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.631+0000 7f02451af640 1 -- 172.21.15.157:0/2675409835 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f023c0083f0 con 0x56028864e040 2024-05-09T09:49:29.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.631+0000 7f0246e93980 1 --2- 172.21.15.157:0/2675409835 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602887458d0 0x560288747cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.631+0000 7f0246e93980 1 -- 172.21.15.157:0/2675409835 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560288748390 con 0x5602887458d0 2024-05-09T09:49:29.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.631+0000 7f02449ae640 1 --2- 172.21.15.157:0/2675409835 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602887458d0 0x560288747cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.631+0000 7f02449ae640 1 --2- 172.21.15.157:0/2675409835 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602887458d0 0x560288747cc0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.631+0000 7f02449ae640 1 -- 172.21.15.157:0/2675409835 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f023402e070 con 0x5602887458d0 2024-05-09T09:49:29.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.631+0000 7f0246e93980 1 -- 172.21.15.157:0/2675409835 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560288744770 con 0x56028864e040 2024-05-09T09:49:29.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.631+0000 7f02451af640 1 -- 172.21.15.157:0/2675409835 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f023c0083f0 con 0x56028864e040 2024-05-09T09:49:29.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.631+0000 7f0246e93980 1 --2- 172.21.15.157:0/2675409835 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5602887497d0 0x56028874bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.631+0000 7f0246e93980 1 -- 172.21.15.157:0/2675409835 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56028874c350 con 0x5602887497d0 2024-05-09T09:49:29.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.631+0000 7f02441ad640 1 --2- 172.21.15.157:0/2675409835 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5602887497d0 0x56028874bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.631+0000 7f02441ad640 1 --2- 172.21.15.157:0/2675409835 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5602887497d0 0x56028874bbc0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.635+0000 7f02441ad640 1 -- 172.21.15.157:0/2675409835 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f02380aab10 con 0x5602887497d0 2024-05-09T09:49:29.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.635+0000 7f0246e93980 1 Processor -- start 2024-05-09T09:49:29.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.635+0000 7f0246e93980 1 -- start start 2024-05-09T09:49:29.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.635+0000 7f0246e93980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560288772130 0x560288772550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.635+0000 7f0246e93980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56028854f020 con 0x560288772130 2024-05-09T09:49:29.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.635+0000 7f02449ae640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560288772130 0x560288772550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.635+0000 7f02449ae640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560288772130 0x560288772550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39378/0 (socket says 172.21.15.157:39378) 2024-05-09T09:49:29.638 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.635+0000 7f02449ae640 1 -- 172.21.15.157:0/1815275997 learned_addr learned my addr 172.21.15.157:0/1815275997 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:29.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.639+0000 7f02449ae640 1 -- 172.21.15.157:0/1815275997 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560288772a90 con 0x560288772130 2024-05-09T09:49:29.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.639+0000 7f02449ae640 1 --2- 172.21.15.157:0/1815275997 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560288772130 0x560288772550 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f023401c760 tx=0x7f0234027ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.639+0000 7f012939f640 1 -- 172.21.15.157:0/1815275997 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0234042f00 con 0x560288772130 2024-05-09T09:49:29.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.639+0000 7f012939f640 1 -- 172.21.15.157:0/1815275997 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02340430a0 con 0x560288772130 2024-05-09T09:49:29.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.639+0000 7f0246e93980 1 -- 172.21.15.157:0/1815275997 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560288773520 con 0x560288772130 2024-05-09T09:49:29.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.639+0000 7f012939f640 1 -- 172.21.15.157:0/1815275997 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f023401a5b0 con 0x560288772130 2024-05-09T09:49:29.640 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.639+0000 7f0246e93980 1 -- 172.21.15.157:0/1815275997 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560288773520 con 0x560288772130 2024-05-09T09:49:29.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.639+0000 7f012939f640 1 -- 172.21.15.157:0/1815275997 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f023401a750 con 0x560288772130 2024-05-09T09:49:29.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.639+0000 7f012939f640 1 --2- 172.21.15.157:0/1815275997 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f011c034bb0 0x7f011c037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.639+0000 7f012939f640 1 -- 172.21.15.157:0/1815275997 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f023401e040 con 0x560288772130 2024-05-09T09:49:29.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.639+0000 7f02441ad640 1 --2- 172.21.15.157:0/1815275997 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f011c034bb0 0x7f011c037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.639+0000 7f0246e93980 1 Processor -- start 2024-05-09T09:49:29.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.639+0000 7f0246e93980 1 -- start start 2024-05-09T09:49:29.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.639+0000 7f0246e93980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56028877efa0 0x56028877f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.639+0000 7f0246e93980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5602887354f0 con 0x56028877efa0 2024-05-09T09:49:29.641 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.639+0000 7f02441ad640 1 --2- 172.21.15.157:0/1815275997 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f011c034bb0 0x7f011c037070 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0238000f90 tx=0x7f0238005e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.643+0000 7f02449ae640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56028877efa0 0x56028877f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.643+0000 7f02449ae640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56028877efa0 0x56028877f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39390/0 (socket says 172.21.15.157:39390) 2024-05-09T09:49:29.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.643+0000 7f02449ae640 1 -- 172.21.15.157:0/152047472 learned_addr learned my addr 172.21.15.157:0/152047472 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:29.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.643+0000 7f02449ae640 1 -- 172.21.15.157:0/152047472 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56028877f990 con 0x56028877efa0 2024-05-09T09:49:29.645 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.643+0000 7f02449ae640 1 --2- 172.21.15.157:0/152047472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56028877efa0 0x56028877f3c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f0234027f90 tx=0x7f023404b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71194e4a24623ba5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.643+0000 7f0122ffd640 1 -- 172.21.15.157:0/152047472 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0234049cf0 con 0x56028877efa0 2024-05-09T09:49:29.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.643+0000 7f0122ffd640 1 -- 172.21.15.157:0/152047472 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f023401d7c0 con 0x56028877efa0 2024-05-09T09:49:29.646 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.643+0000 7f0122ffd640 1 -- 172.21.15.157:0/152047472 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0234019740 con 0x56028877efa0 2024-05-09T09:49:29.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.643+0000 7f0246e93980 1 -- 172.21.15.157:0/152047472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56028877efa0 msgr2=0x56028877f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.643+0000 7f0246e93980 1 --2- 172.21.15.157:0/152047472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56028877efa0 0x56028877f3c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f0234027f90 tx=0x7f023404b660 comp rx=0 tx=0).stop 2024-05-09T09:49:29.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.643+0000 7f0246e93980 1 -- 172.21.15.157:0/152047472 shutdown_connections 2024-05-09T09:49:29.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.643+0000 7f0246e93980 1 --2- 172.21.15.157:0/152047472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56028877efa0 0x56028877f3c0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.643+0000 7f0246e93980 1 -- 172.21.15.157:0/152047472 >> 172.21.15.157:0/152047472 conn(0x56028877b320 msgr2=0x560288779380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:29.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.643+0000 7f0246e93980 1 -- 172.21.15.157:0/152047472 shutdown_connections 2024-05-09T09:49:29.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.643+0000 7f0246e93980 1 -- 172.21.15.157:0/152047472 wait complete. 2024-05-09T09:49:29.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.647+0000 7f0246e93980 1 Processor -- start 2024-05-09T09:49:29.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.647+0000 7f0246e93980 1 -- start start 2024-05-09T09:49:29.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.647+0000 7f0246e93980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56028877efa0 0x5602887862e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.647+0000 7f0246e93980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x560288780060 con 0x56028877efa0 2024-05-09T09:49:29.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.647+0000 7f02449ae640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56028877efa0 0x5602887862e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.647+0000 7f02449ae640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56028877efa0 0x5602887862e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39406/0 (socket says 172.21.15.157:39406) 2024-05-09T09:49:29.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.647+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 learned_addr learned my addr 172.21.15.157:0/1198917897 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:29.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.647+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560288786820 con 0x56028877efa0 2024-05-09T09:49:29.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.647+0000 7f02449ae640 1 --2- 172.21.15.157:0/1198917897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56028877efa0 0x5602887862e0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f023404bfd0 tx=0x7f023403cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.647+0000 7f01217fa640 1 -- 172.21.15.157:0/1198917897 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f023400b040 con 0x56028877efa0 2024-05-09T09:49:29.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.647+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560288786820 con 0x56028877efa0 2024-05-09T09:49:29.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.647+0000 7f01217fa640 1 -- 172.21.15.157:0/1198917897 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0234032620 con 0x56028877efa0 2024-05-09T09:49:29.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.647+0000 7f01217fa640 1 -- 172.21.15.157:0/1198917897 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0234032900 con 0x56028877efa0 2024-05-09T09:49:29.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.647+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560288786ca0 con 0x56028877efa0 2024-05-09T09:49:29.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.647+0000 7f01217fa640 1 -- 172.21.15.157:0/1198917897 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f023402a120 con 0x56028877efa0 2024-05-09T09:49:29.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.647+0000 7f01217fa640 1 --2- 172.21.15.157:0/1198917897 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f010c034bb0 0x7f010c037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.647+0000 7f01217fa640 1 -- 172.21.15.157:0/1198917897 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f0234036c00 con 0x56028877efa0 2024-05-09T09:49:29.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.647+0000 7f0246e93980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.647+0000 7f02441ad640 1 --2- 172.21.15.157:0/1198917897 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f010c034bb0 0x7f010c037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.647+0000 7f0246e93980 1 --2- 172.21.15.157:0/1198917897 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560288792db0 0x560288795270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.647+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5602887959c0 con 0x560288792db0 2024-05-09T09:49:29.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.647+0000 7f02451af640 1 --2- 172.21.15.157:0/1198917897 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560288792db0 0x560288795270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.647+0000 7f02441ad640 1 --2- 172.21.15.157:0/1198917897 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f010c034bb0 0x7f010c037070 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x56028874c750 tx=0x7f02380a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.647+0000 7f02451af640 1 --2- 172.21.15.157:0/1198917897 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560288792db0 0x560288795270 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f023c0083f0 con 0x560288792db0 2024-05-09T09:49:29.653 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f0246e93980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f0246e93980 20 realm 2024-05-09T09:49:29.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f0246e93980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560288795dd0 con 0x560288792db0 2024-05-09T09:49:29.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f023c0083f0 con 0x560288792db0 2024-05-09T09:49:29.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f0246e93980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f0246e93980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:49:29.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f0246e93980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5602887966a0 con 0x560288792db0 2024-05-09T09:49:29.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f023c0083f0 con 0x560288792db0 2024-05-09T09:49:29.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f0246e93980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f0246e93980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560288796a40 con 0x560288792db0 2024-05-09T09:49:29.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f023c0083f0 con 0x560288792db0 2024-05-09T09:49:29.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f0246e93980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:29.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f0246e93980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f0246e93980 1 --2- 172.21.15.157:0/1198917897 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602887977a0 0x560288799b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56028879a1a0 con 0x5602887977a0 2024-05-09T09:49:29.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f02449ae640 1 --2- 172.21.15.157:0/1198917897 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602887977a0 0x560288799b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.655 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f02449ae640 1 --2- 172.21.15.157:0/1198917897 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602887977a0 0x560288799b90 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0234075070 con 0x5602887977a0 2024-05-09T09:49:29.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f0246e93980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:49:29.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f0246e93980 20 searching for the correct realm 2024-05-09T09:49:29.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f0246e93980 1 --2- 172.21.15.157:0/1198917897 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56028879c0f0 0x56028879e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56028879ebd0 con 0x56028879c0f0 2024-05-09T09:49:29.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f02441ad640 1 --2- 172.21.15.157:0/1198917897 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56028879c0f0 0x56028879e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f02441ad640 1 --2- 172.21.15.157:0/1198917897 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56028879c0f0 0x56028879e500 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.659 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02380d9070 con 0x56028879c0f0 2024-05-09T09:49:29.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f02441ad640 1 --2- 172.21.15.157:0/1198917897 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f02380ce040 0x7f02380db920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56028879ebd0 con 0x7f02380ce040 2024-05-09T09:49:29.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.651+0000 7f02451af640 1 --2- 172.21.15.157:0/1198917897 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f02380ce040 0x7f02380db920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.655+0000 7f02451af640 1 --2- 172.21.15.157:0/1198917897 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f02380ce040 0x7f02380db920 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.655+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f023c0083f0 con 0x7f02380ce040 2024-05-09T09:49:29.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.655+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560288796a40 con 0x5602887977a0 2024-05-09T09:49:29.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.655+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0234075070 con 0x5602887977a0 2024-05-09T09:49:29.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.655+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560288796a40 con 0x560288792db0 2024-05-09T09:49:29.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.655+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f023c0083f0 con 0x560288792db0 2024-05-09T09:49:29.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.655+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560288796a40 con 0x560288792db0 2024-05-09T09:49:29.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.655+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f023c026040 con 0x560288792db0 2024-05-09T09:49:29.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.655+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560288796a40 con 0x5602887977a0 2024-05-09T09:49:29.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.655+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0234075070 con 0x5602887977a0 2024-05-09T09:49:29.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.655+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560288796a40 con 0x5602887977a0 2024-05-09T09:49:29.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.655+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0234075070 con 0x5602887977a0 2024-05-09T09:49:29.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.655+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560288796a40 con 0x7f02380ce040 2024-05-09T09:49:29.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.655+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f023c026040 con 0x7f02380ce040 2024-05-09T09:49:29.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.655+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560288796a40 con 0x56028879c0f0 2024-05-09T09:49:29.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.655+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02380d9070 con 0x56028879c0f0 2024-05-09T09:49:29.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.655+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560288796a40 con 0x560288792db0 2024-05-09T09:49:29.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.655+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f023c026040 con 0x560288792db0 2024-05-09T09:49:29.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.655+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560288796a40 con 0x5602887977a0 2024-05-09T09:49:29.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.659+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0234075070 con 0x5602887977a0 2024-05-09T09:49:29.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.659+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560288796a40 con 0x560288792db0 2024-05-09T09:49:29.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.659+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f023c026040 con 0x560288792db0 2024-05-09T09:49:29.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.659+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560288796a40 con 0x7f02380ce040 2024-05-09T09:49:29.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.659+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f023c026040 con 0x7f02380ce040 2024-05-09T09:49:29.661 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.659+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560288796a40 con 0x56028879c0f0 2024-05-09T09:49:29.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.659+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02380d9070 con 0x56028879c0f0 2024-05-09T09:49:29.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.659+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f02380e8040 con 0x56028879c0f0 2024-05-09T09:49:29.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.659+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f02380d9070 con 0x56028879c0f0 2024-05-09T09:49:29.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.659+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f02380e8040 con 0x5602887977a0 2024-05-09T09:49:29.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.659+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0234075070 con 0x5602887977a0 2024-05-09T09:49:29.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.659+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f02380e8040 con 0x56028879c0f0 2024-05-09T09:49:29.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.659+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02380d9070 con 0x56028879c0f0 2024-05-09T09:49:29.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.659+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f02380e8040 con 0x56028879c0f0 2024-05-09T09:49:29.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.659+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02380d9070 con 0x56028879c0f0 2024-05-09T09:49:29.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.659+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f02380e8040 con 0x560288792db0 2024-05-09T09:49:29.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.659+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f023c026040 con 0x560288792db0 2024-05-09T09:49:29.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.659+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f02380e8040 con 0x560288792db0 2024-05-09T09:49:29.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.659+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f023c026040 con 0x560288792db0 2024-05-09T09:49:29.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.659+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f02380e8040 con 0x5602887977a0 2024-05-09T09:49:29.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.659+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0234075070 con 0x5602887977a0 2024-05-09T09:49:29.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.659+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f02380e8040 con 0x56028879c0f0 2024-05-09T09:49:29.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.663+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02380d9070 con 0x56028879c0f0 2024-05-09T09:49:29.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.663+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f02380e8040 con 0x7f02380ce040 2024-05-09T09:49:29.666 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.663+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f023c026040 con 0x7f02380ce040 2024-05-09T09:49:29.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.663+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f02380e8040 con 0x560288792db0 2024-05-09T09:49:29.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.663+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f023c026040 con 0x560288792db0 2024-05-09T09:49:29.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.663+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f02380e8040 con 0x5602887977a0 2024-05-09T09:49:29.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.663+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0234075070 con 0x5602887977a0 2024-05-09T09:49:29.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.663+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f02380e8040 con 0x56028879c0f0 2024-05-09T09:49:29.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.663+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02380d9070 con 0x56028879c0f0 2024-05-09T09:49:29.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.663+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f02380e8040 con 0x5602887977a0 2024-05-09T09:49:29.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.663+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0234075070 con 0x5602887977a0 2024-05-09T09:49:29.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.663+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f02380e8040 con 0x7f02380ce040 2024-05-09T09:49:29.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.663+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f023c026040 con 0x7f02380ce040 2024-05-09T09:49:29.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.663+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f02380e8040 con 0x56028879c0f0 2024-05-09T09:49:29.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.663+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02380d9070 con 0x56028879c0f0 2024-05-09T09:49:29.667 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.663+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f02380e8040 con 0x5602887977a0 2024-05-09T09:49:29.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.663+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0234075070 con 0x5602887977a0 2024-05-09T09:49:29.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.663+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f02380e8040 con 0x560288792db0 2024-05-09T09:49:29.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.663+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f023c026040 con 0x560288792db0 2024-05-09T09:49:29.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.663+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f02380e8040 con 0x7f02380ce040 2024-05-09T09:49:29.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.663+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f023c026040 con 0x7f02380ce040 2024-05-09T09:49:29.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.663+0000 7f0246e93980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:49:29.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.663+0000 7f0246e93980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:49:29.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.663+0000 7f0246e93980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:49:29.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.663+0000 7f0246e93980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:49:29.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.663+0000 7f0246e93980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:49:29.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.663+0000 7f0246e93980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:49:29.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.663+0000 7f0246e93980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56028879aa60 con 0x560288792db0 2024-05-09T09:49:29.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f023c026040 con 0x560288792db0 2024-05-09T09:49:29.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f0246e93980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f0246e93980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56028879aa60 con 0x560288792db0 2024-05-09T09:49:29.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f023c026040 con 0x560288792db0 2024-05-09T09:49:29.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f0246e93980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:29.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f0246e93980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56028879aa60 con 0x56028879c0f0 2024-05-09T09:49:29.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f02380d9070 con 0x56028879c0f0 2024-05-09T09:49:29.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f0246e93980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:49:29.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f0246e93980 20 zone default found 2024-05-09T09:49:29.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f0246e93980 4 Realm: () 2024-05-09T09:49:29.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f0246e93980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:49:29.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f0246e93980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:49:29.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f0246e93980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:49:29.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f0246e93980 20 zonegroup default 2024-05-09T09:49:29.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f0246e93980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56028879b430 con 0x5602887977a0 2024-05-09T09:49:29.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0234075070 con 0x5602887977a0 2024-05-09T09:49:29.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f0246e93980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f0246e93980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56028879af90 con 0x56028879c0f0 2024-05-09T09:49:29.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f02380d9070 con 0x56028879c0f0 2024-05-09T09:49:29.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f0246e93980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f0246e93980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5602887a0f80 con 0x56028879c0f0 2024-05-09T09:49:29.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f02380d9070 con 0x56028879c0f0 2024-05-09T09:49:29.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f0246e93980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f0246e93980 20 started sync module instance, tier type = 2024-05-09T09:49:29.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f0246e93980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:49:29.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887a0370 con 0x7f02380ce040 2024-05-09T09:49:29.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f023c026040 con 0x7f02380ce040 2024-05-09T09:49:29.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94568879622256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887a0370 con 0x7f02380ce040 2024-05-09T09:49:29.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.667+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887a19e0 con 0x560288792db0 2024-05-09T09:49:29.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.671+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94568879622256] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f023c036040 con 0x7f02380ce040 2024-05-09T09:49:29.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.671+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f023c036040 con 0x560288792db0 2024-05-09T09:49:29.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.671+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94568879625792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887a0370 con 0x560288792db0 2024-05-09T09:49:29.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.671+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887a23f0 con 0x56028879c0f0 2024-05-09T09:49:29.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.671+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02380d9070 con 0x56028879c0f0 2024-05-09T09:49:29.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.671+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94568879628096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887a2c90 con 0x56028879c0f0 2024-05-09T09:49:29.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.671+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887a36b0 con 0x7f02380ce040 2024-05-09T09:49:29.676 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.671+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94568879625792] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f023c036040 con 0x560288792db0 2024-05-09T09:49:29.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.675+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f023c036040 con 0x7f02380ce040 2024-05-09T09:49:29.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.675+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94568879632800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887a3aa0 con 0x7f02380ce040 2024-05-09T09:49:29.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.675+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887a4460 con 0x560288792db0 2024-05-09T09:49:29.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.675+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94568879628096] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02380d9070 con 0x56028879c0f0 2024-05-09T09:49:29.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.675+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94568879632800] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f023c036040 con 0x7f02380ce040 2024-05-09T09:49:29.677 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.675+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f023c036040 con 0x560288792db0 2024-05-09T09:49:29.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.675+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94568879619776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887a3fb0 con 0x560288792db0 2024-05-09T09:49:29.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.675+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887a4800 con 0x5602887977a0 2024-05-09T09:49:29.678 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.679+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94568879619776] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f023c036040 con 0x560288792db0 2024-05-09T09:49:29.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.679+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0234075070 con 0x5602887977a0 2024-05-09T09:49:29.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.679+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94568879636400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887a43d0 con 0x5602887977a0 2024-05-09T09:49:29.679 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.679+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887a5500 con 0x5602887977a0 2024-05-09T09:49:29.681 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.679+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0234075070 con 0x5602887977a0 2024-05-09T09:49:29.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.679+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94568879642784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887a6170 con 0x5602887977a0 2024-05-09T09:49:29.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.679+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887a6b90 con 0x5602887977a0 2024-05-09T09:49:29.682 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.679+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94568879636400] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0234075070 con 0x5602887977a0 2024-05-09T09:49:29.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.683+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94568879642784] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0234075070 con 0x5602887977a0 2024-05-09T09:49:29.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.683+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0234075070 con 0x5602887977a0 2024-05-09T09:49:29.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.683+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94568879646336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887a5d00 con 0x5602887977a0 2024-05-09T09:49:29.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.683+0000 7f0246e93980 20 add_watcher() i=0 2024-05-09T09:49:29.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.683+0000 7f0246e93980 20 add_watcher() i=1 2024-05-09T09:49:29.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.683+0000 7f0246e93980 20 add_watcher() i=2 2024-05-09T09:49:29.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.683+0000 7f0246e93980 20 add_watcher() i=3 2024-05-09T09:49:29.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.683+0000 7f0246e93980 20 add_watcher() i=4 2024-05-09T09:49:29.684 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.683+0000 7f0246e93980 20 add_watcher() i=5 2024-05-09T09:49:29.685 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.683+0000 7f0246e93980 20 add_watcher() i=6 2024-05-09T09:49:29.686 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.683+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94568879646336] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0234075070 con 0x5602887977a0 2024-05-09T09:49:29.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.683+0000 7f0246e93980 20 add_watcher() i=7 2024-05-09T09:49:29.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.683+0000 7f0246e93980 2 all 8 watchers are set, enabling cache 2024-05-09T09:49:29.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.683+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5602887a9c90 con 0x560288792db0 2024-05-09T09:49:29.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.687+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f023c036040 con 0x560288792db0 2024-05-09T09:49:29.687 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.687+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94568879639456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887a7110 con 0x560288792db0 2024-05-09T09:49:29.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.687+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94568879639456] v32'455 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f023c036040 con 0x560288792db0 2024-05-09T09:49:29.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.687+0000 7f00f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:29.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.687+0000 7f0246e93980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:49:29.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.687+0000 7f0246e93980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:49:29.688 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.687+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b2390 con 0x560288792db0 2024-05-09T09:49:29.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.687+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'104 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f023c036040 con 0x560288792db0 2024-05-09T09:49:29.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.687+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b29e0 con 0x5602887977a0 2024-05-09T09:49:29.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.691+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'99 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0234075070 con 0x5602887977a0 2024-05-09T09:49:29.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.691+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b29e0 con 0x56028879c0f0 2024-05-09T09:49:29.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.691+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'98 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f02380d9070 con 0x56028879c0f0 2024-05-09T09:49:29.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.691+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b3010 con 0x560288792db0 2024-05-09T09:49:29.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.695+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'456 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f023c036040 con 0x560288792db0 2024-05-09T09:49:29.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.695+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b33f0 con 0x7f02380ce040 2024-05-09T09:49:29.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.695+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'281 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f023c036040 con 0x7f02380ce040 2024-05-09T09:49:29.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.695+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b3960 con 0x56028879c0f0 2024-05-09T09:49:29.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.695+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'188 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f02380d9070 con 0x56028879c0f0 2024-05-09T09:49:29.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.695+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b3e10 con 0x560288792db0 2024-05-09T09:49:29.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.699+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'99 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f023c036040 con 0x560288792db0 2024-05-09T09:49:29.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.699+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b3c40 con 0x5602887977a0 2024-05-09T09:49:29.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.699+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'187 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0234075070 con 0x5602887977a0 2024-05-09T09:49:29.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.699+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b3de0 con 0x7f02380ce040 2024-05-09T09:49:29.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.703+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'97 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f023c036040 con 0x7f02380ce040 2024-05-09T09:49:29.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.703+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b3de0 con 0x56028879c0f0 2024-05-09T09:49:29.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.703+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'103 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f02380d9070 con 0x56028879c0f0 2024-05-09T09:49:29.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.703+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b4230 con 0x7f02380ce040 2024-05-09T09:49:29.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.703+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'282 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f023c036040 con 0x7f02380ce040 2024-05-09T09:49:29.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.703+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b4230 con 0x5602887977a0 2024-05-09T09:49:29.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.707+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'103 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0234075070 con 0x5602887977a0 2024-05-09T09:49:29.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.707+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b4230 con 0x7f02380ce040 2024-05-09T09:49:29.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.707+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'97 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f023c036040 con 0x7f02380ce040 2024-05-09T09:49:29.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.707+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b4230 con 0x5602887977a0 2024-05-09T09:49:29.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.711+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'193 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0234075070 con 0x5602887977a0 2024-05-09T09:49:29.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.711+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b4230 con 0x560288792db0 2024-05-09T09:49:29.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.711+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'457 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f023c036040 con 0x560288792db0 2024-05-09T09:49:29.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.711+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b4230 con 0x56028879c0f0 2024-05-09T09:49:29.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.715+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'275 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02380d9070 con 0x56028879c0f0 2024-05-09T09:49:29.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.715+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b42f0 con 0x7f02380ce040 2024-05-09T09:49:29.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.715+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'283 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f023c036040 con 0x7f02380ce040 2024-05-09T09:49:29.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.715+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b42f0 con 0x56028879c0f0 2024-05-09T09:49:29.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.715+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'97 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02380d9070 con 0x56028879c0f0 2024-05-09T09:49:29.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.715+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b43b0 con 0x560288792db0 2024-05-09T09:49:29.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.719+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'105 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f023c036040 con 0x560288792db0 2024-05-09T09:49:29.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.719+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b43b0 con 0x560288792db0 2024-05-09T09:49:29.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.719+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'458 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f023c036040 con 0x560288792db0 2024-05-09T09:49:29.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.719+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b4350 con 0x56028879c0f0 2024-05-09T09:49:29.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.723+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'276 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02380d9070 con 0x56028879c0f0 2024-05-09T09:49:29.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.723+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b4350 con 0x7f02380ce040 2024-05-09T09:49:29.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.723+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'109 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f023c036040 con 0x7f02380ce040 2024-05-09T09:49:29.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.723+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b42c0 con 0x56028879c0f0 2024-05-09T09:49:29.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.723+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'99 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02380d9070 con 0x56028879c0f0 2024-05-09T09:49:29.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.723+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b42c0 con 0x56028879c0f0 2024-05-09T09:49:29.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.727+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'103 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02380d9070 con 0x56028879c0f0 2024-05-09T09:49:29.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.727+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b42c0 con 0x56028879c0f0 2024-05-09T09:49:29.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.727+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'94 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02380d9070 con 0x56028879c0f0 2024-05-09T09:49:29.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.727+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b42c0 con 0x56028879c0f0 2024-05-09T09:49:29.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.727+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'189 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02380d9070 con 0x56028879c0f0 2024-05-09T09:49:29.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.727+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b42c0 con 0x5602887977a0 2024-05-09T09:49:29.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.731+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'99 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0234075070 con 0x5602887977a0 2024-05-09T09:49:29.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.731+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b42c0 con 0x56028879c0f0 2024-05-09T09:49:29.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.731+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'98 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02380d9070 con 0x56028879c0f0 2024-05-09T09:49:29.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.731+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b4230 con 0x5602887977a0 2024-05-09T09:49:29.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.735+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'188 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0234075070 con 0x5602887977a0 2024-05-09T09:49:29.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.735+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b4230 con 0x56028879c0f0 2024-05-09T09:49:29.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.735+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'277 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f02380d9070 con 0x56028879c0f0 2024-05-09T09:49:29.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.735+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b4230 con 0x5602887977a0 2024-05-09T09:49:29.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.739+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'194 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0234075070 con 0x5602887977a0 2024-05-09T09:49:29.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.739+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887b4230 con 0x7f02380ce040 2024-05-09T09:49:29.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.739+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'103 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f023c036040 con 0x7f02380ce040 2024-05-09T09:49:29.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.743+0000 7f00f8fe1640 20 reqs_thread_entry: start 2024-05-09T09:49:29.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.743+0000 7f0246e93980 20 init_complete bucket index max shards: 11 2024-05-09T09:49:29.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.743+0000 7f00727fc640 20 reqs_thread_entry: start 2024-05-09T09:49:29.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.743+0000 7f0246e93980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-09T09:49:29.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.743+0000 7f0246e93980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.743+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:94 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5602887b00f0 con 0x5602887977a0 2024-05-09T09:49:29.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.743+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(94 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f0234075070 con 0x5602887977a0 2024-05-09T09:49:29.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.743+0000 7f0246e93980 20 rados_obj.operate() r=0 bl.length=460 2024-05-09T09:49:29.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.743+0000 7f0246e93980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-09T09:49:29.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.743+0000 7f0246e93980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:29.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.743+0000 7f0246e93980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:49:29.745 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.743+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:95 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887d64e0 con 0x5602887977a0 2024-05-09T09:49:29.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.747+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(95 ada [delete,create,call,call,writefull 0~490] v32'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0234075070 con 0x5602887977a0 2024-05-09T09:49:29.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.747+0000 7f0246e93980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-09T09:49:29.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.747+0000 7f0246e93980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:29.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.747+0000 7f0246e93980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-09T09:49:29.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.747+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 7.d 7:b4812045:::notify.4:head [notify cookie 94568879841232 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5602887d1fd0 con 0x560288792db0 2024-05-09T09:49:29.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.747+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== watch-notify(notify (1) cookie 94568879619776 notify 137438953508 ret 0) ==== 708+0+0 (crc 0 0 0) 0x5602887b1f40 con 0x560288792db0 2024-05-09T09:49:29.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.747+0000 7f0122ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953508 cookie 94568879619776 notifier 4880 bl.length()=666 2024-05-09T09:49:29.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.747+0000 7f0122ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-09T09:49:29.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.747+0000 7f0122ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:29.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.747+0000 7f0122ffd640 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f01080056c0 con 0x560288792db0 2024-05-09T09:49:29.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.747+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(96 notify.4 [notify cookie 94568879841232 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f023c036040 con 0x560288792db0 2024-05-09T09:49:29.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.747+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(97 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f023c036040 con 0x560288792db0 2024-05-09T09:49:29.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.747+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== watch-notify(notify_complete (2) cookie 94568879841232 notify 137438953508 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5602887b3010 con 0x560288792db0 2024-05-09T09:49:29.749 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-09T09:49:28.233198Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:49:28.233178Z","tags":[],"group_ids":[]} 2024-05-09T09:49:29.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.747+0000 7f00f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:29.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.747+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94568879639456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887af200 con 0x560288792db0 2024-05-09T09:49:29.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.747+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(98 data_loggenerations_metadata [watch unwatch cookie 94568879639456] v32'459 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f023c036040 con 0x560288792db0 2024-05-09T09:49:29.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.747+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94568879622256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887a4ba0 con 0x7f02380ce040 2024-05-09T09:49:29.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.751+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(99 notify.0 [watch unwatch cookie 94568879622256] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f023c036040 con 0x7f02380ce040 2024-05-09T09:49:29.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.751+0000 7f0246e93980 20 remove_watcher() i=0 2024-05-09T09:49:29.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.751+0000 7f0246e93980 2 removed watcher, disabling cache 2024-05-09T09:49:29.751 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.751+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94568879625792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887a4ba0 con 0x560288792db0 2024-05-09T09:49:29.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.751+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(100 notify.1 [watch unwatch cookie 94568879625792] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f023c036040 con 0x560288792db0 2024-05-09T09:49:29.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.751+0000 7f0246e93980 20 remove_watcher() i=1 2024-05-09T09:49:29.754 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.751+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94568879628096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887a4ba0 con 0x56028879c0f0 2024-05-09T09:49:29.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.755+0000 7f02441ad640 1 -- 172.21.15.157:0/1198917897 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(101 notify.2 [watch unwatch cookie 94568879628096] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02380d9070 con 0x56028879c0f0 2024-05-09T09:49:29.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.755+0000 7f0246e93980 20 remove_watcher() i=2 2024-05-09T09:49:29.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.755+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:102 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94568879632800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887a4ba0 con 0x7f02380ce040 2024-05-09T09:49:29.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.755+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(102 notify.3 [watch unwatch cookie 94568879632800] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f023c036040 con 0x7f02380ce040 2024-05-09T09:49:29.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.755+0000 7f0246e93980 20 remove_watcher() i=3 2024-05-09T09:49:29.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.755+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94568879619776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887a31a0 con 0x560288792db0 2024-05-09T09:49:29.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.759+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(103 notify.4 [watch unwatch cookie 94568879619776] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f023c036040 con 0x560288792db0 2024-05-09T09:49:29.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.759+0000 7f0246e93980 20 remove_watcher() i=4 2024-05-09T09:49:29.759 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.759+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94568879636400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887a4ba0 con 0x5602887977a0 2024-05-09T09:49:29.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.759+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(104 notify.5 [watch unwatch cookie 94568879636400] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0234075070 con 0x5602887977a0 2024-05-09T09:49:29.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.759+0000 7f0246e93980 20 remove_watcher() i=5 2024-05-09T09:49:29.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.759+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:105 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94568879642784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56028879fec0 con 0x5602887977a0 2024-05-09T09:49:29.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(105 notify.6 [watch unwatch cookie 94568879642784] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0234075070 con 0x5602887977a0 2024-05-09T09:49:29.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 20 remove_watcher() i=6 2024-05-09T09:49:29.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:106 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94568879646336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5602887a3fb0 con 0x5602887977a0 2024-05-09T09:49:29.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f02449ae640 1 -- 172.21.15.157:0/1198917897 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(106 notify.7 [watch unwatch cookie 94568879646336] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0234075070 con 0x5602887977a0 2024-05-09T09:49:29.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 20 remove_watcher() i=7 2024-05-09T09:49:29.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602887977a0 msgr2=0x560288799b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 1 --2- 172.21.15.157:0/1198917897 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602887977a0 0x560288799b90 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560288792db0 msgr2=0x560288795270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 1 --2- 172.21.15.157:0/1198917897 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x560288792db0 0x560288795270 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f02380ce040 msgr2=0x7f02380db920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 1 --2- 172.21.15.157:0/1198917897 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f02380ce040 0x7f02380db920 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56028879c0f0 msgr2=0x56028879e500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 1 --2- 172.21.15.157:0/1198917897 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56028879c0f0 0x56028879e500 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f010c034bb0 msgr2=0x7f010c037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 1 --2- 172.21.15.157:0/1198917897 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f010c034bb0 0x7f010c037070 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x56028874c750 tx=0x7f02380a6000 comp rx=0 tx=0).stop 2024-05-09T09:49:29.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56028877efa0 msgr2=0x5602887862e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f02451af640 1 -- 172.21.15.157:0/1198917897 reap_dead start 2024-05-09T09:49:29.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 1 --2- 172.21.15.157:0/1198917897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56028877efa0 0x5602887862e0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f023404bfd0 tx=0x7f023403cf40 comp rx=0 tx=0).stop 2024-05-09T09:49:29.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 shutdown_connections 2024-05-09T09:49:29.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 1 --2- 172.21.15.157:0/1198917897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56028877efa0 0x5602887862e0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 >> 172.21.15.157:0/1198917897 conn(0x56028877b320 msgr2=0x560288778980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:29.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 shutdown_connections 2024-05-09T09:49:29.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 1 -- 172.21.15.157:0/1198917897 wait complete. 2024-05-09T09:49:29.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 1 -- 172.21.15.157:0/1815275997 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f011c034bb0 msgr2=0x7f011c037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 1 --2- 172.21.15.157:0/1815275997 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f011c034bb0 0x7f011c037070 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0238000f90 tx=0x7f0238005e50 comp rx=0 tx=0).stop 2024-05-09T09:49:29.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 1 -- 172.21.15.157:0/1815275997 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560288772130 msgr2=0x560288772550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 1 --2- 172.21.15.157:0/1815275997 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560288772130 0x560288772550 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f023401c760 tx=0x7f0234027ec0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 1 -- 172.21.15.157:0/1815275997 shutdown_connections 2024-05-09T09:49:29.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 1 --2- 172.21.15.157:0/1815275997 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f011c034bb0 0x7f011c037070 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 1 --2- 172.21.15.157:0/1815275997 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560288772130 0x560288772550 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.769 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 1 -- 172.21.15.157:0/1815275997 >> 172.21.15.157:0/1815275997 conn(0x560288766f00 msgr2=0x560288767a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:29.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 1 -- 172.21.15.157:0/1815275997 shutdown_connections 2024-05-09T09:49:29.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.763+0000 7f0246e93980 1 -- 172.21.15.157:0/1815275997 wait complete. 2024-05-09T09:49:29.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.767+0000 7f0246e93980 1 -- 172.21.15.157:0/2675409835 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602887458d0 msgr2=0x560288747cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.767+0000 7f0246e93980 1 --2- 172.21.15.157:0/2675409835 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5602887458d0 0x560288747cc0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.767+0000 7f0246e93980 1 -- 172.21.15.157:0/2675409835 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56028864e040 msgr2=0x560288742f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.767+0000 7f0246e93980 1 --2- 172.21.15.157:0/2675409835 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56028864e040 0x560288742f60 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.767+0000 7f0246e93980 1 -- 172.21.15.157:0/2675409835 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5602887497d0 msgr2=0x56028874bbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.767+0000 7f0246e93980 1 --2- 172.21.15.157:0/2675409835 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5602887497d0 0x56028874bbc0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.767+0000 7f0246e93980 1 -- 172.21.15.157:0/2675409835 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f012c034bb0 msgr2=0x7f012c037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.767+0000 7f0246e93980 1 --2- 172.21.15.157:0/2675409835 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f012c034bb0 0x7f012c037070 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f02380ab000 tx=0x7f02380a5000 comp rx=0 tx=0).stop 2024-05-09T09:49:29.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.767+0000 7f0246e93980 1 -- 172.21.15.157:0/2675409835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560288649b40 msgr2=0x56028873bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.767+0000 7f0246e93980 1 --2- 172.21.15.157:0/2675409835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560288649b40 0x56028873bfc0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f0234000c10 tx=0x7f0234000ee0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.770 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.767+0000 7f02451af640 1 -- 172.21.15.157:0/2675409835 reap_dead start 2024-05-09T09:49:29.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.767+0000 7f0246e93980 1 -- 172.21.15.157:0/2675409835 shutdown_connections 2024-05-09T09:49:29.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.767+0000 7f0246e93980 1 -- 172.21.15.157:0/2675409835 >> 172.21.15.157:0/2675409835 conn(0x5602885bd260 msgr2=0x56028872f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:29.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.767+0000 7f0246e93980 1 -- 172.21.15.157:0/2675409835 shutdown_connections 2024-05-09T09:49:29.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.767+0000 7f0246e93980 1 -- 172.21.15.157:0/2675409835 wait complete. 2024-05-09T09:49:29.776 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-09T09:49:28.233198Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:49:28.233178Z', 'tags': [], 'group_ids': []} 2024-05-09T09:49:29.776 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-09T09:49:28.233198Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:49:28.233178Z', 'tags': [], 'group_ids': []} 2024-05-09T09:49:29.776 ERROR:root:0 2024-05-09T09:49:29.776 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-09T09:49:29.782 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-09T09:49:29.782 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-05-09T09:49:29.782 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-05-09T09:49:29.783 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-05-09T09:49:29.848 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:49:29.848 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:49:29.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.847+0000 7fbc551a4980 1 Processor -- start 2024-05-09T09:49:29.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.847+0000 7fbc551a4980 1 -- start start 2024-05-09T09:49:29.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.847+0000 7fbc551a4980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x56114022ab40 0x56114022af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.847+0000 7fbc551a4980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5611400de440 con 0x56114022b460 2024-05-09T09:49:29.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.847+0000 7fbc551a4980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5611400c95f0 con 0x56114022ab40 2024-05-09T09:49:29.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.847+0000 7fbc52cbf640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x56114022ab40 0x56114022af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.847+0000 7fbc52cbf640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x56114022ab40 0x56114022af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39412/0 (socket says 172.21.15.157:39412) 2024-05-09T09:49:29.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.847+0000 7fbc52cbf640 1 -- 172.21.15.157:0/793024145 learned_addr learned my addr 172.21.15.157:0/793024145 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:29.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.847+0000 7fbc524be640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x56114022b460 0x56114022be10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:45624/0 (socket says 172.21.15.157:45624) 2024-05-09T09:49:29.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.851+0000 7fbc52cbf640 1 -- 172.21.15.157:0/793024145 >> v1:172.21.15.110:6789/0 conn(0x56114022b460 legacy=0x56114022be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.851+0000 7fbc52cbf640 1 -- 172.21.15.157:0/793024145 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611400d4990 con 0x56114022ab40 2024-05-09T09:49:29.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.851+0000 7fbc52cbf640 1 --2- 172.21.15.157:0/793024145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56114022ab40 0x56114022af20 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fbc4400a5c0 tx=0x7fbc4401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2680d2748cef1df8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.851+0000 7fbc51cbd640 1 -- 172.21.15.157:0/793024145 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc440a6070 con 0x56114022ab40 2024-05-09T09:49:29.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.851+0000 7fbc51cbd640 1 -- 172.21.15.157:0/793024145 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc440af070 con 0x56114022ab40 2024-05-09T09:49:29.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.851+0000 7fbc51cbd640 1 -- 172.21.15.157:0/793024145 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc440aa5c0 con 0x56114022ab40 2024-05-09T09:49:29.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.851+0000 7fbc551a4980 1 -- 172.21.15.157:0/793024145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56114022ab40 msgr2=0x56114022af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.851+0000 7fbc551a4980 1 --2- 172.21.15.157:0/793024145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56114022ab40 0x56114022af20 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fbc4400a5c0 tx=0x7fbc4401b340 comp rx=0 tx=0).stop 2024-05-09T09:49:29.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.851+0000 7fbc551a4980 1 -- 172.21.15.157:0/793024145 shutdown_connections 2024-05-09T09:49:29.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.851+0000 7fbc551a4980 1 --2- 172.21.15.157:0/793024145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56114022ab40 0x56114022af20 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.851+0000 7fbc551a4980 1 -- 172.21.15.157:0/793024145 >> 172.21.15.157:0/793024145 conn(0x56114019e260 msgr2=0x56114019e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:29.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.851+0000 7fbc551a4980 1 -- 172.21.15.157:0/793024145 shutdown_connections 2024-05-09T09:49:29.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.851+0000 7fbc551a4980 1 -- 172.21.15.157:0/793024145 wait complete. 2024-05-09T09:49:29.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.867+0000 7fbc551a4980 1 Processor -- start 2024-05-09T09:49:29.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.867+0000 7fbc551a4980 1 -- start start 2024-05-09T09:49:29.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.867+0000 7fbc551a4980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56114022ab40 0x561140316440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.867 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.867+0000 7fbc551a4980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x56114012bfe0 con 0x56114022ab40 2024-05-09T09:49:29.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.867+0000 7fbc52cbf640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56114022ab40 0x561140316440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.867+0000 7fbc52cbf640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56114022ab40 0x561140316440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39418/0 (socket says 172.21.15.157:39418) 2024-05-09T09:49:29.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.867+0000 7fbc52cbf640 1 -- 172.21.15.157:0/2844019515 learned_addr learned my addr 172.21.15.157:0/2844019515 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:29.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.867+0000 7fbc52cbf640 1 -- 172.21.15.157:0/2844019515 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611400b0ae0 con 0x56114022ab40 2024-05-09T09:49:29.868 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.867+0000 7fbc52cbf640 1 --2- 172.21.15.157:0/2844019515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56114022ab40 0x561140316440 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fbc44018f70 tx=0x7fbc44003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5175e4f3603e230b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.867+0000 7fbb40e09640 1 -- 172.21.15.157:0/2844019515 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc440aa9e0 con 0x56114022ab40 2024-05-09T09:49:29.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.867+0000 7fbb40e09640 1 -- 172.21.15.157:0/2844019515 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc440aab80 con 0x56114022ab40 2024-05-09T09:49:29.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.867+0000 7fbb40e09640 1 -- 172.21.15.157:0/2844019515 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc440aae60 con 0x56114022ab40 2024-05-09T09:49:29.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.867+0000 7fbc551a4980 1 -- 172.21.15.157:0/2844019515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56114022ab40 msgr2=0x561140316440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.867+0000 7fbc551a4980 1 --2- 172.21.15.157:0/2844019515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56114022ab40 0x561140316440 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fbc44018f70 tx=0x7fbc44003030 comp rx=0 tx=0).stop 2024-05-09T09:49:29.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.867+0000 7fbc551a4980 1 -- 172.21.15.157:0/2844019515 shutdown_connections 2024-05-09T09:49:29.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.867+0000 7fbc551a4980 1 --2- 172.21.15.157:0/2844019515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56114022ab40 0x561140316440 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.867+0000 7fbc551a4980 1 -- 172.21.15.157:0/2844019515 >> 172.21.15.157:0/2844019515 conn(0x56114019e260 msgr2=0x561140311fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:29.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.867+0000 7fbc551a4980 1 -- 172.21.15.157:0/2844019515 shutdown_connections 2024-05-09T09:49:29.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.867+0000 7fbc551a4980 1 -- 172.21.15.157:0/2844019515 wait complete. 2024-05-09T09:49:29.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.867+0000 7fbc551a4980 1 Processor -- start 2024-05-09T09:49:29.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.867+0000 7fbc551a4980 1 -- start start 2024-05-09T09:49:29.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.867+0000 7fbc551a4980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56114022ab40 0x56114031d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.867+0000 7fbc551a4980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561140234b80 con 0x56114022ab40 2024-05-09T09:49:29.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.867+0000 7fbc52cbf640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56114022ab40 0x56114031d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.867+0000 7fbc52cbf640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56114022ab40 0x56114031d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39420/0 (socket says 172.21.15.157:39420) 2024-05-09T09:49:29.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.867+0000 7fbc52cbf640 1 -- 172.21.15.157:0/1870140394 learned_addr learned my addr 172.21.15.157:0/1870140394 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:29.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.871+0000 7fbc52cbf640 1 -- 172.21.15.157:0/1870140394 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56114031d990 con 0x56114022ab40 2024-05-09T09:49:29.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.871+0000 7fbc52cbf640 1 --2- 172.21.15.157:0/1870140394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56114022ab40 0x56114031d450 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fbc4401b170 tx=0x7fbc440180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.871+0000 7fbb3f606640 1 -- 172.21.15.157:0/1870140394 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc440bd7c0 con 0x56114022ab40 2024-05-09T09:49:29.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.871+0000 7fbb3f606640 1 -- 172.21.15.157:0/1870140394 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc440bd960 con 0x56114022ab40 2024-05-09T09:49:29.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.871+0000 7fbc551a4980 1 -- 172.21.15.157:0/1870140394 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56114031dc20 con 0x56114022ab40 2024-05-09T09:49:29.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.871+0000 7fbb3f606640 1 -- 172.21.15.157:0/1870140394 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc440bdc40 con 0x56114022ab40 2024-05-09T09:49:29.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.871+0000 7fbc551a4980 1 -- 172.21.15.157:0/1870140394 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611403208b0 con 0x56114022ab40 2024-05-09T09:49:29.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.871+0000 7fbb3f606640 1 -- 172.21.15.157:0/1870140394 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fbc440ce030 con 0x56114022ab40 2024-05-09T09:49:29.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.871+0000 7fbb3f606640 1 --2- 172.21.15.157:0/1870140394 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb38034bb0 0x7fbb38037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.871+0000 7fbb3f606640 1 -- 172.21.15.157:0/1870140394 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fbc440cc020 con 0x56114022ab40 2024-05-09T09:49:29.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.871+0000 7fbc524be640 1 --2- 172.21.15.157:0/1870140394 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb38034bb0 0x7fbb38037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.871+0000 7fbc551a4980 1 --2- 172.21.15.157:0/1870140394 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56114022b460 0x5611403243f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.871+0000 7fbc551a4980 1 -- 172.21.15.157:0/1870140394 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561140324a30 con 0x56114022b460 2024-05-09T09:49:29.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.871+0000 7fbc534c0640 1 --2- 172.21.15.157:0/1870140394 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56114022b460 0x5611403243f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.871+0000 7fbc524be640 1 --2- 172.21.15.157:0/1870140394 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb38034bb0 0x7fbb38037070 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbc48001e50 tx=0x7fbc480013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.871+0000 7fbc534c0640 1 --2- 172.21.15.157:0/1870140394 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56114022b460 0x5611403243f0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.871+0000 7fbc534c0640 1 -- 172.21.15.157:0/1870140394 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x56114022b460 2024-05-09T09:49:29.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.871+0000 7fbc551a4980 1 -- 172.21.15.157:0/1870140394 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561140321ab0 con 0x56114022b460 2024-05-09T09:49:29.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.871+0000 7fbc534c0640 1 -- 172.21.15.157:0/1870140394 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x56114022b460 2024-05-09T09:49:29.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.871+0000 7fbc551a4980 1 --2- 172.21.15.157:0/1870140394 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561140326d60 0x561140329150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.871+0000 7fbc551a4980 1 -- 172.21.15.157:0/1870140394 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561140329820 con 0x561140326d60 2024-05-09T09:49:29.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.875+0000 7fbc52cbf640 1 --2- 172.21.15.157:0/1870140394 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561140326d60 0x561140329150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.875+0000 7fbc52cbf640 1 --2- 172.21.15.157:0/1870140394 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561140326d60 0x561140329150 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.875+0000 7fbc52cbf640 1 -- 172.21.15.157:0/1870140394 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140326d60 2024-05-09T09:49:29.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.875+0000 7fbc551a4980 1 -- 172.21.15.157:0/1870140394 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561140325c00 con 0x56114022b460 2024-05-09T09:49:29.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.875+0000 7fbc534c0640 1 -- 172.21.15.157:0/1870140394 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x56114022b460 2024-05-09T09:49:29.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.875+0000 7fbc551a4980 1 --2- 172.21.15.157:0/1870140394 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56114032ac60 0x56114032d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.875+0000 7fbc551a4980 1 -- 172.21.15.157:0/1870140394 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56114032d7e0 con 0x56114032ac60 2024-05-09T09:49:29.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.875+0000 7fbc524be640 1 --2- 172.21.15.157:0/1870140394 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56114032ac60 0x56114032d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.875+0000 7fbc524be640 1 --2- 172.21.15.157:0/1870140394 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56114032ac60 0x56114032d050 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.875+0000 7fbc524be640 1 -- 172.21.15.157:0/1870140394 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbc4800f700 con 0x56114032ac60 2024-05-09T09:49:29.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.879+0000 7fbc551a4980 1 Processor -- start 2024-05-09T09:49:29.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.879+0000 7fbc551a4980 1 -- start start 2024-05-09T09:49:29.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.879+0000 7fbc551a4980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561140353690 0x561140353ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.879+0000 7fbc551a4980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561140130020 con 0x561140353690 2024-05-09T09:49:29.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.879+0000 7fbc52cbf640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561140353690 0x561140353ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.879+0000 7fbc52cbf640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561140353690 0x561140353ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39434/0 (socket says 172.21.15.157:39434) 2024-05-09T09:49:29.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.879+0000 7fbc52cbf640 1 -- 172.21.15.157:0/863853576 learned_addr learned my addr 172.21.15.157:0/863853576 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:29.881 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.879+0000 7fbc52cbf640 1 -- 172.21.15.157:0/863853576 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561140353ff0 con 0x561140353690 2024-05-09T09:49:29.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.879+0000 7fbc52cbf640 1 --2- 172.21.15.157:0/863853576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561140353690 0x561140353ab0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fbc440e3f70 tx=0x7fbc440c9d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.879+0000 7fbb377fe640 1 -- 172.21.15.157:0/863853576 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc440cf9c0 con 0x561140353690 2024-05-09T09:49:29.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.879+0000 7fbb377fe640 1 -- 172.21.15.157:0/863853576 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc440cfb60 con 0x561140353690 2024-05-09T09:49:29.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.879+0000 7fbb377fe640 1 -- 172.21.15.157:0/863853576 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc440cfe80 con 0x561140353690 2024-05-09T09:49:29.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.883+0000 7fbc551a4980 1 -- 172.21.15.157:0/863853576 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561140354a80 con 0x561140353690 2024-05-09T09:49:29.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.883+0000 7fbc551a4980 1 -- 172.21.15.157:0/863853576 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561140354f60 con 0x561140353690 2024-05-09T09:49:29.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.883+0000 7fbb377fe640 1 -- 172.21.15.157:0/863853576 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fbc440c6480 con 0x561140353690 2024-05-09T09:49:29.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.883+0000 7fbb377fe640 1 --2- 172.21.15.157:0/863853576 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb2c034c00 0x7fbb2c0370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.883+0000 7fbb377fe640 1 -- 172.21.15.157:0/863853576 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fbc440efd50 con 0x561140353690 2024-05-09T09:49:29.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.883+0000 7fbc524be640 1 --2- 172.21.15.157:0/863853576 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb2c034c00 0x7fbb2c0370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.883+0000 7fbc551a4980 1 Processor -- start 2024-05-09T09:49:29.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.883+0000 7fbc551a4980 1 -- start start 2024-05-09T09:49:29.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.883+0000 7fbc551a4980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561140360650 0x561140360a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.883+0000 7fbc524be640 1 --2- 172.21.15.157:0/863853576 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb2c034c00 0x7fbb2c0370c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x56114032dbe0 tx=0x7fbc4800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.885 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.883+0000 7fbc551a4980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561140316ad0 con 0x561140360650 2024-05-09T09:49:29.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.883+0000 7fbc52cbf640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561140360650 0x561140360a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.883+0000 7fbc52cbf640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561140360650 0x561140360a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39444/0 (socket says 172.21.15.157:39444) 2024-05-09T09:49:29.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.883+0000 7fbc52cbf640 1 -- 172.21.15.157:0/618838833 learned_addr learned my addr 172.21.15.157:0/618838833 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:29.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.883+0000 7fbc52cbf640 1 -- 172.21.15.157:0/618838833 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561140361000 con 0x561140360650 2024-05-09T09:49:29.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.883+0000 7fbc52cbf640 1 --2- 172.21.15.157:0/618838833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561140360650 0x561140360a30 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fbc440a7a40 tx=0x7fbc440a7880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5551bc3f7d32071 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.883+0000 7fbb357fa640 1 -- 172.21.15.157:0/618838833 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc440de490 con 0x561140360650 2024-05-09T09:49:29.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.883+0000 7fbb357fa640 1 -- 172.21.15.157:0/618838833 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc440c7e10 con 0x561140360650 2024-05-09T09:49:29.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.883+0000 7fbb357fa640 1 -- 172.21.15.157:0/618838833 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc440a7ab0 con 0x561140360650 2024-05-09T09:49:29.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.887+0000 7fbc551a4980 1 -- 172.21.15.157:0/618838833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561140360650 msgr2=0x561140360a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:29.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.887+0000 7fbc551a4980 1 --2- 172.21.15.157:0/618838833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561140360650 0x561140360a30 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fbc440a7a40 tx=0x7fbc440a7880 comp rx=0 tx=0).stop 2024-05-09T09:49:29.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.887+0000 7fbc551a4980 1 -- 172.21.15.157:0/618838833 shutdown_connections 2024-05-09T09:49:29.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.887+0000 7fbc551a4980 1 --2- 172.21.15.157:0/618838833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561140360650 0x561140360a30 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:29.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.887+0000 7fbc551a4980 1 -- 172.21.15.157:0/618838833 >> 172.21.15.157:0/618838833 conn(0x56114035c9d0 msgr2=0x56114035aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:29.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.887+0000 7fbc551a4980 1 -- 172.21.15.157:0/618838833 shutdown_connections 2024-05-09T09:49:29.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.887+0000 7fbc551a4980 1 -- 172.21.15.157:0/618838833 wait complete. 2024-05-09T09:49:29.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.887+0000 7fbc551a4980 1 Processor -- start 2024-05-09T09:49:29.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.887+0000 7fbc551a4980 1 -- start start 2024-05-09T09:49:29.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.887+0000 7fbc551a4980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561140360650 0x5611403679e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.887+0000 7fbc551a4980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x561140361710 con 0x561140360650 2024-05-09T09:49:29.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.887+0000 7fbc52cbf640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561140360650 0x5611403679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.887+0000 7fbc52cbf640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561140360650 0x5611403679e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39460/0 (socket says 172.21.15.157:39460) 2024-05-09T09:49:29.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.887+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 learned_addr learned my addr 172.21.15.157:0/991457840 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:29.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.887+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561140367f20 con 0x561140360650 2024-05-09T09:49:29.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.887+0000 7fbc52cbf640 1 --2- 172.21.15.157:0/991457840 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561140360650 0x5611403679e0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fbc440a7a40 tx=0x7fbc440a8f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.887+0000 7fbb237fe640 1 -- 172.21.15.157:0/991457840 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc440e50f0 con 0x561140360650 2024-05-09T09:49:29.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.887+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561140367f20 con 0x561140360650 2024-05-09T09:49:29.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.887+0000 7fbb237fe640 1 -- 172.21.15.157:0/991457840 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc440b4dd0 con 0x561140360650 2024-05-09T09:49:29.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.887+0000 7fbb237fe640 1 -- 172.21.15.157:0/991457840 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc440debe0 con 0x561140360650 2024-05-09T09:49:29.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.887+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611403683a0 con 0x561140360650 2024-05-09T09:49:29.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.887+0000 7fbb237fe640 1 -- 172.21.15.157:0/991457840 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fbc44114020 con 0x561140360650 2024-05-09T09:49:29.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.887+0000 7fbb237fe640 1 --2- 172.21.15.157:0/991457840 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb1c034bb0 0x7fbb1c037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.887+0000 7fbb237fe640 1 -- 172.21.15.157:0/991457840 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fbc44112020 con 0x561140360650 2024-05-09T09:49:29.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.887+0000 7fbc551a4980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.887+0000 7fbc524be640 1 --2- 172.21.15.157:0/991457840 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb1c034bb0 0x7fbb1c037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc551a4980 1 --2- 172.21.15.157:0/991457840 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5611403743e0 0x5611403768a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561140376ff0 con 0x5611403743e0 2024-05-09T09:49:29.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc534c0640 1 --2- 172.21.15.157:0/991457840 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5611403743e0 0x5611403768a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc524be640 1 --2- 172.21.15.157:0/991457840 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb1c034bb0 0x7fbb1c037070 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbc4800baa0 tx=0x7fbc48010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc534c0640 1 --2- 172.21.15.157:0/991457840 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5611403743e0 0x5611403768a0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:29.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc551a4980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc551a4980 20 realm 2024-05-09T09:49:29.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc551a4980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561140377400 con 0x5611403743e0 2024-05-09T09:49:29.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:29.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc551a4980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc551a4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:49:29.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc551a4980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561140377cd0 con 0x5611403743e0 2024-05-09T09:49:29.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:29.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc551a4980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc551a4980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x5611403743e0 2024-05-09T09:49:29.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:29.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc551a4980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:29.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc551a4980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc551a4980 1 --2- 172.21.15.157:0/991457840 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561140378dd0 0x56114037b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56114037b7d0 con 0x561140378dd0 2024-05-09T09:49:29.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc52cbf640 1 --2- 172.21.15.157:0/991457840 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561140378dd0 0x56114037b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc52cbf640 1 --2- 172.21.15.157:0/991457840 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561140378dd0 0x56114037b1c0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140378dd0 2024-05-09T09:49:29.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc551a4980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:49:29.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc551a4980 20 searching for the correct realm 2024-05-09T09:49:29.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc551a4980 1 --2- 172.21.15.157:0/991457840 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56114037d6b0 0x56114037fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611403801a0 con 0x56114037d6b0 2024-05-09T09:49:29.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.891+0000 7fbc524be640 1 --2- 172.21.15.157:0/991457840 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56114037d6b0 0x56114037fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.896 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.895+0000 7fbc524be640 1 --2- 172.21.15.157:0/991457840 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56114037d6b0 0x56114037fb20 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.895+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc48037040 con 0x56114037d6b0 2024-05-09T09:49:29.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.895+0000 7fbc524be640 1 --2- 172.21.15.157:0/991457840 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fbc4803a3c0 0x7fbc4803a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:29.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.895+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611403801a0 con 0x7fbc4803a3c0 2024-05-09T09:49:29.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.895+0000 7fbc534c0640 1 --2- 172.21.15.157:0/991457840 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fbc4803a3c0 0x7fbc4803a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:29.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.895+0000 7fbc534c0640 1 --2- 172.21.15.157:0/991457840 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fbc4803a3c0 0x7fbc4803a800 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:29.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.895+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x7fbc4803a3c0 2024-05-09T09:49:29.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.895+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x561140378dd0 2024-05-09T09:49:29.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.895+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140378dd0 2024-05-09T09:49:29.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.895+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x5611403743e0 2024-05-09T09:49:29.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.895+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:29.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.895+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x5611403743e0 2024-05-09T09:49:29.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.895+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:29.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.895+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x561140378dd0 2024-05-09T09:49:29.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.895+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140378dd0 2024-05-09T09:49:29.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.895+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x561140378dd0 2024-05-09T09:49:29.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.895+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140378dd0 2024-05-09T09:49:29.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.895+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x7fbc4803a3c0 2024-05-09T09:49:29.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.895+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x7fbc4803a3c0 2024-05-09T09:49:29.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.895+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x56114037d6b0 2024-05-09T09:49:29.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.899+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc48037040 con 0x56114037d6b0 2024-05-09T09:49:29.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.899+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x5611403743e0 2024-05-09T09:49:29.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.899+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:29.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.899+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x561140378dd0 2024-05-09T09:49:29.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.899+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140378dd0 2024-05-09T09:49:29.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.899+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x5611403743e0 2024-05-09T09:49:29.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.899+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:29.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.899+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x7fbc4803a3c0 2024-05-09T09:49:29.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.899+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x7fbc4803a3c0 2024-05-09T09:49:29.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.899+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x56114037d6b0 2024-05-09T09:49:29.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.899+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc48037040 con 0x56114037d6b0 2024-05-09T09:49:29.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.899+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x56114037d6b0 2024-05-09T09:49:29.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.899+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbc48037040 con 0x56114037d6b0 2024-05-09T09:49:29.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.899+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x561140378dd0 2024-05-09T09:49:29.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.899+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140378dd0 2024-05-09T09:49:29.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.899+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x56114037d6b0 2024-05-09T09:49:29.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.899+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc48037040 con 0x56114037d6b0 2024-05-09T09:49:29.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.899+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x56114037d6b0 2024-05-09T09:49:29.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.899+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc48037040 con 0x56114037d6b0 2024-05-09T09:49:29.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.899+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x5611403743e0 2024-05-09T09:49:29.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.899+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:29.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.899+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x5611403743e0 2024-05-09T09:49:29.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.899+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:29.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.899+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x561140378dd0 2024-05-09T09:49:29.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.903+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140378dd0 2024-05-09T09:49:29.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.903+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x56114037d6b0 2024-05-09T09:49:29.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.903+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc48037040 con 0x56114037d6b0 2024-05-09T09:49:29.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.903+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x7fbc4803a3c0 2024-05-09T09:49:29.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.903+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x7fbc4803a3c0 2024-05-09T09:49:29.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.903+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x5611403743e0 2024-05-09T09:49:29.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.903+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:29.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.903+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x561140378dd0 2024-05-09T09:49:29.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.903+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140378dd0 2024-05-09T09:49:29.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.903+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x56114037d6b0 2024-05-09T09:49:29.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.903+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc48037040 con 0x56114037d6b0 2024-05-09T09:49:29.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.903+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x561140378dd0 2024-05-09T09:49:29.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.903+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140378dd0 2024-05-09T09:49:29.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.903+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x7fbc4803a3c0 2024-05-09T09:49:29.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.903+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x7fbc4803a3c0 2024-05-09T09:49:29.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.903+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x56114037d6b0 2024-05-09T09:49:29.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.903+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc48049040 con 0x56114037d6b0 2024-05-09T09:49:29.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.903+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x561140378dd0 2024-05-09T09:49:29.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140378dd0 2024-05-09T09:49:29.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x5611403743e0 2024-05-09T09:49:29.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:29.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561140378070 con 0x7fbc4803a3c0 2024-05-09T09:49:29.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x7fbc4803a3c0 2024-05-09T09:49:29.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:49:29.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:49:29.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:49:29.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:49:29.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:49:29.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:49:29.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56114037c020 con 0x5611403743e0 2024-05-09T09:49:29.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:29.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56114037c020 con 0x5611403743e0 2024-05-09T09:49:29.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:29.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:29.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56114037c020 con 0x56114037d6b0 2024-05-09T09:49:29.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbc48049040 con 0x56114037d6b0 2024-05-09T09:49:29.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:49:29.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 20 zone default found 2024-05-09T09:49:29.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 4 Realm: () 2024-05-09T09:49:29.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:49:29.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:49:29.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:49:29.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 20 zonegroup default 2024-05-09T09:49:29.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56114037ca30 con 0x561140378dd0 2024-05-09T09:49:29.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140378dd0 2024-05-09T09:49:29.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611403824b0 con 0x56114037d6b0 2024-05-09T09:49:29.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbc48049040 con 0x56114037d6b0 2024-05-09T09:49:29.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561140382850 con 0x56114037d6b0 2024-05-09T09:49:29.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbc48049040 con 0x56114037d6b0 2024-05-09T09:49:29.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:29.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 20 started sync module instance, tier type = 2024-05-09T09:49:29.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:49:29.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.907+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403818f0 con 0x7fbc4803a3c0 2024-05-09T09:49:29.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.911+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x7fbc4803a3c0 2024-05-09T09:49:29.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.911+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94632091852000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403818f0 con 0x7fbc4803a3c0 2024-05-09T09:49:29.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.911+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403830a0 con 0x5611403743e0 2024-05-09T09:49:29.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.911+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94632091852000] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x7fbc4803a3c0 2024-05-09T09:49:29.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.911+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:29.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.911+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94632091849792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403830a0 con 0x5611403743e0 2024-05-09T09:49:29.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.911+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561140383a60 con 0x56114037d6b0 2024-05-09T09:49:29.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.915+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc48049040 con 0x56114037d6b0 2024-05-09T09:49:29.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.915+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94632091858352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561140384300 con 0x56114037d6b0 2024-05-09T09:49:29.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.915+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561140384d20 con 0x7fbc4803a3c0 2024-05-09T09:49:29.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.915+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94632091849792] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:29.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.915+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x7fbc4803a3c0 2024-05-09T09:49:29.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.915+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94632091863056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561140385110 con 0x7fbc4803a3c0 2024-05-09T09:49:29.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.915+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561140385ad0 con 0x5611403743e0 2024-05-09T09:49:29.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.915+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94632091858352] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc48049040 con 0x56114037d6b0 2024-05-09T09:49:29.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.915+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94632091863056] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x7fbc4803a3c0 2024-05-09T09:49:29.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.919+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:29.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.919+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94632091855856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561140385620 con 0x5611403743e0 2024-05-09T09:49:29.920 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.919+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561140385e70 con 0x561140378dd0 2024-05-09T09:49:29.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.919+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94632091855856] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:29.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.919+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140378dd0 2024-05-09T09:49:29.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.919+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94632091866656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561140385a40 con 0x561140378dd0 2024-05-09T09:49:29.922 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.919+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561140386b70 con 0x561140378dd0 2024-05-09T09:49:29.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.923+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94632091866656] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140378dd0 2024-05-09T09:49:29.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.923+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140378dd0 2024-05-09T09:49:29.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.923+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94632091870224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403873c0 con 0x561140378dd0 2024-05-09T09:49:29.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.923+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561140387d80 con 0x561140378dd0 2024-05-09T09:49:29.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.923+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140378dd0 2024-05-09T09:49:29.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.923+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94632091875536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403881a0 con 0x561140378dd0 2024-05-09T09:49:29.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.923+0000 7fbc551a4980 20 add_watcher() i=0 2024-05-09T09:49:29.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.923+0000 7fbc551a4980 20 add_watcher() i=1 2024-05-09T09:49:29.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.923+0000 7fbc551a4980 20 add_watcher() i=2 2024-05-09T09:49:29.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.923+0000 7fbc551a4980 20 add_watcher() i=3 2024-05-09T09:49:29.926 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.923+0000 7fbc551a4980 20 add_watcher() i=4 2024-05-09T09:49:29.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.923+0000 7fbc551a4980 20 add_watcher() i=5 2024-05-09T09:49:29.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.923+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94632091870224] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140378dd0 2024-05-09T09:49:29.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.923+0000 7fbc551a4980 20 add_watcher() i=6 2024-05-09T09:49:29.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.927+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94632091875536] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140378dd0 2024-05-09T09:49:29.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.927+0000 7fbc551a4980 20 add_watcher() i=7 2024-05-09T09:49:29.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.927+0000 7fbc551a4980 2 all 8 watchers are set, enabling cache 2024-05-09T09:49:29.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.927+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611403881a0 con 0x5611403743e0 2024-05-09T09:49:29.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.927+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:29.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.927+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94632091876592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561140388110 con 0x5611403743e0 2024-05-09T09:49:29.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.927+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94632091876592] v32'460 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:29.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.927+0000 7fbb037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:29.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.927+0000 7fbc551a4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:49:29.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.927+0000 7fbc551a4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:49:29.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.927+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561140393aa0 con 0x5611403743e0 2024-05-09T09:49:29.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.931+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'105 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:29.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.931+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561140394170 con 0x561140378dd0 2024-05-09T09:49:29.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.931+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'100 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140378dd0 2024-05-09T09:49:29.934 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.931+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561140394170 con 0x56114037d6b0 2024-05-09T09:49:29.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.935+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'99 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc48049040 con 0x56114037d6b0 2024-05-09T09:49:29.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.935+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561140394ac0 con 0x5611403743e0 2024-05-09T09:49:29.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.935+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'461 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:29.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.935+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561140391940 con 0x7fbc4803a3c0 2024-05-09T09:49:29.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.935+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'284 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x7fbc4803a3c0 2024-05-09T09:49:29.938 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.935+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561140391940 con 0x56114037d6b0 2024-05-09T09:49:29.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.938+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'190 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc48049040 con 0x56114037d6b0 2024-05-09T09:49:29.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.938+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403957d0 con 0x5611403743e0 2024-05-09T09:49:29.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.938+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'100 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:29.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.938+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561140395c80 con 0x561140378dd0 2024-05-09T09:49:29.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.942+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'189 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140378dd0 2024-05-09T09:49:29.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.942+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561140395c80 con 0x7fbc4803a3c0 2024-05-09T09:49:29.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.946+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'98 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x7fbc4803a3c0 2024-05-09T09:49:29.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.946+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561140395c80 con 0x56114037d6b0 2024-05-09T09:49:29.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.946+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'104 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc48049040 con 0x56114037d6b0 2024-05-09T09:49:29.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.946+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403961f0 con 0x7fbc4803a3c0 2024-05-09T09:49:29.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.946+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'285 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x7fbc4803a3c0 2024-05-09T09:49:29.949 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.946+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403961f0 con 0x561140378dd0 2024-05-09T09:49:29.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.950+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'104 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140378dd0 2024-05-09T09:49:29.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.950+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403961f0 con 0x7fbc4803a3c0 2024-05-09T09:49:29.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.950+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'98 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x7fbc4803a3c0 2024-05-09T09:49:29.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.950+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403961f0 con 0x561140378dd0 2024-05-09T09:49:29.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.954+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'195 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140378dd0 2024-05-09T09:49:29.957 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.954+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403961f0 con 0x5611403743e0 2024-05-09T09:49:29.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.958+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'462 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:29.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.958+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403961f0 con 0x56114037d6b0 2024-05-09T09:49:29.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.958+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'278 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc48049040 con 0x56114037d6b0 2024-05-09T09:49:29.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.958+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403964a0 con 0x7fbc4803a3c0 2024-05-09T09:49:29.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.962+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'286 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x7fbc4803a3c0 2024-05-09T09:49:29.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.962+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403964a0 con 0x56114037d6b0 2024-05-09T09:49:29.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.962+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'98 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc48049040 con 0x56114037d6b0 2024-05-09T09:49:29.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.962+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403964a0 con 0x5611403743e0 2024-05-09T09:49:29.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.966+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'106 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:29.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.966+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403964a0 con 0x5611403743e0 2024-05-09T09:49:29.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.966+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'463 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:29.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.966+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403964a0 con 0x56114037d6b0 2024-05-09T09:49:29.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.970+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'279 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc48049040 con 0x56114037d6b0 2024-05-09T09:49:29.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.970+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403964a0 con 0x7fbc4803a3c0 2024-05-09T09:49:29.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.970+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'110 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x7fbc4803a3c0 2024-05-09T09:49:29.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.970+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403964a0 con 0x56114037d6b0 2024-05-09T09:49:29.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.974+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'100 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc48049040 con 0x56114037d6b0 2024-05-09T09:49:29.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.974+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403964a0 con 0x56114037d6b0 2024-05-09T09:49:29.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.974+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'104 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc48049040 con 0x56114037d6b0 2024-05-09T09:49:29.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.974+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403964a0 con 0x56114037d6b0 2024-05-09T09:49:29.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.978+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'95 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc48049040 con 0x56114037d6b0 2024-05-09T09:49:29.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.978+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403964a0 con 0x56114037d6b0 2024-05-09T09:49:29.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.978+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'191 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc48049040 con 0x56114037d6b0 2024-05-09T09:49:29.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.978+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403964a0 con 0x561140378dd0 2024-05-09T09:49:29.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.982+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'100 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140378dd0 2024-05-09T09:49:29.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.982+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403964a0 con 0x56114037d6b0 2024-05-09T09:49:29.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.982+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'99 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc48049040 con 0x56114037d6b0 2024-05-09T09:49:29.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.982+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403964a0 con 0x561140378dd0 2024-05-09T09:49:29.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.986+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'190 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140378dd0 2024-05-09T09:49:29.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.986+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403964a0 con 0x56114037d6b0 2024-05-09T09:49:29.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.990+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'280 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc48049040 con 0x56114037d6b0 2024-05-09T09:49:29.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.990+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403964a0 con 0x561140378dd0 2024-05-09T09:49:29.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.990+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'196 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140378dd0 2024-05-09T09:49:29.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.990+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403964a0 con 0x7fbc4803a3c0 2024-05-09T09:49:29.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.994+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'104 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x7fbc4803a3c0 2024-05-09T09:49:29.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.994+0000 7fbb027fc640 20 reqs_thread_entry: start 2024-05-09T09:49:29.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.994+0000 7fbc551a4980 20 init_complete bucket index max shards: 11 2024-05-09T09:49:29.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.994+0000 7fbc551a4980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-09T09:49:29.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.994+0000 7fbc551a4980 20 rados->read ofs=0 len=0 2024-05-09T09:49:29.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.994+0000 7fba73fff640 20 reqs_thread_entry: start 2024-05-09T09:49:29.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.994+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:94 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611403b1f50 con 0x561140378dd0 2024-05-09T09:49:29.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.994+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(94 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140378dd0 2024-05-09T09:49:29.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.994+0000 7fbc551a4980 20 rados_obj.operate() r=0 bl.length=490 2024-05-09T09:49:29.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.994+0000 7fbc551a4980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-09T09:49:29.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.994+0000 7fbc551a4980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:29.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.994+0000 7fbc551a4980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:49:29.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.994+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:95 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403b85b0 con 0x561140378dd0 2024-05-09T09:49:30.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.998+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(95 ada [delete,create,call,call,writefull 0~490] v32'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140378dd0 2024-05-09T09:49:30.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.998+0000 7fbc551a4980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-09T09:49:30.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.998+0000 7fbc551a4980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:30.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.998+0000 7fbc551a4980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-09T09:49:30.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.998+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 7.d 7:b4812045:::notify.4:head [notify cookie 94632092074016 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611403b3c40 con 0x5611403743e0 2024-05-09T09:49:30.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.998+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== watch-notify(notify (1) cookie 94632091855856 notify 137438953509 ret 0) ==== 708+0+0 (crc 0 0 0) 0x5611403913f0 con 0x5611403743e0 2024-05-09T09:49:30.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.998+0000 7fbb357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953509 cookie 94632091855856 notifier 4887 bl.length()=666 2024-05-09T09:49:30.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.998+0000 7fbb357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-09T09:49:30.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.998+0000 7fbb357fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:30.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.998+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(96 notify.4 [notify cookie 94632092074016 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:30.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.998+0000 7fbb357fa640 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fbb140056c0 con 0x5611403743e0 2024-05-09T09:49:30.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.998+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(97 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:30.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:29.998+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== watch-notify(notify_complete (2) cookie 94632092074016 notify 137438953509 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561140391ce0 con 0x5611403743e0 2024-05-09T09:49:30.003 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-09T09:49:28.233198Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:49:28.233178Z","tags":[],"group_ids":[]} 2024-05-09T09:49:30.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.002+0000 7fbb037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:30.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.002+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94632091876592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403948f0 con 0x5611403743e0 2024-05-09T09:49:30.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.002+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(98 data_loggenerations_metadata [watch unwatch cookie 94632091876592] v32'464 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:30.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.002+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94632091852000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403948f0 con 0x7fbc4803a3c0 2024-05-09T09:49:30.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.006+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(99 notify.0 [watch unwatch cookie 94632091852000] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x7fbc4803a3c0 2024-05-09T09:49:30.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.006+0000 7fbc551a4980 20 remove_watcher() i=0 2024-05-09T09:49:30.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.006+0000 7fbc551a4980 2 removed watcher, disabling cache 2024-05-09T09:49:30.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.006+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94632091849792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403948f0 con 0x5611403743e0 2024-05-09T09:49:30.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.006+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(100 notify.1 [watch unwatch cookie 94632091849792] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:30.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.006+0000 7fbc551a4980 20 remove_watcher() i=1 2024-05-09T09:49:30.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.006+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94632091858352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403948f0 con 0x56114037d6b0 2024-05-09T09:49:30.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.010+0000 7fbc524be640 1 -- 172.21.15.157:0/991457840 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(101 notify.2 [watch unwatch cookie 94632091858352] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc48049040 con 0x56114037d6b0 2024-05-09T09:49:30.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.010+0000 7fbc551a4980 20 remove_watcher() i=2 2024-05-09T09:49:30.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.010+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:102 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94632091863056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403948f0 con 0x7fbc4803a3c0 2024-05-09T09:49:30.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.010+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(102 notify.3 [watch unwatch cookie 94632091863056] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x7fbc4803a3c0 2024-05-09T09:49:30.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.010+0000 7fbc551a4980 20 remove_watcher() i=3 2024-05-09T09:49:30.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.010+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94632091855856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403948f0 con 0x5611403743e0 2024-05-09T09:49:30.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.014+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(103 notify.4 [watch unwatch cookie 94632091855856] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc4c00a4d0 con 0x5611403743e0 2024-05-09T09:49:30.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.014+0000 7fbc551a4980 20 remove_watcher() i=4 2024-05-09T09:49:30.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.014+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94632091866656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403948f0 con 0x561140378dd0 2024-05-09T09:49:30.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.014+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(104 notify.5 [watch unwatch cookie 94632091866656] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140378dd0 2024-05-09T09:49:30.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.014+0000 7fbc551a4980 20 remove_watcher() i=5 2024-05-09T09:49:30.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.014+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:105 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94632091870224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403948f0 con 0x561140378dd0 2024-05-09T09:49:30.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.018+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(105 notify.6 [watch unwatch cookie 94632091870224] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140378dd0 2024-05-09T09:49:30.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.018+0000 7fbc551a4980 20 remove_watcher() i=6 2024-05-09T09:49:30.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.018+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:106 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94632091875536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611403948f0 con 0x561140378dd0 2024-05-09T09:49:30.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc52cbf640 1 -- 172.21.15.157:0/991457840 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(106 notify.7 [watch unwatch cookie 94632091875536] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc440cf3c0 con 0x561140378dd0 2024-05-09T09:49:30.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 20 remove_watcher() i=7 2024-05-09T09:49:30.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561140378dd0 msgr2=0x56114037b1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 --2- 172.21.15.157:0/991457840 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561140378dd0 0x56114037b1c0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5611403743e0 msgr2=0x5611403768a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 --2- 172.21.15.157:0/991457840 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5611403743e0 0x5611403768a0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fbc4803a3c0 msgr2=0x7fbc4803a800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 --2- 172.21.15.157:0/991457840 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fbc4803a3c0 0x7fbc4803a800 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56114037d6b0 msgr2=0x56114037fb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 --2- 172.21.15.157:0/991457840 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56114037d6b0 0x56114037fb20 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb1c034bb0 msgr2=0x7fbb1c037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 --2- 172.21.15.157:0/991457840 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb1c034bb0 0x7fbb1c037070 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbc4800baa0 tx=0x7fbc48010000 comp rx=0 tx=0).stop 2024-05-09T09:49:30.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561140360650 msgr2=0x5611403679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 --2- 172.21.15.157:0/991457840 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561140360650 0x5611403679e0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fbc440a7a40 tx=0x7fbc440a8f50 comp rx=0 tx=0).stop 2024-05-09T09:49:30.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc534c0640 1 -- 172.21.15.157:0/991457840 reap_dead start 2024-05-09T09:49:30.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 shutdown_connections 2024-05-09T09:49:30.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 >> 172.21.15.157:0/991457840 conn(0x56114035c9d0 msgr2=0x56114035a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:30.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 shutdown_connections 2024-05-09T09:49:30.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 -- 172.21.15.157:0/991457840 wait complete. 2024-05-09T09:49:30.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 -- 172.21.15.157:0/863853576 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb2c034c00 msgr2=0x7fbb2c0370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 --2- 172.21.15.157:0/863853576 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb2c034c00 0x7fbb2c0370c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x56114032dbe0 tx=0x7fbc4800f000 comp rx=0 tx=0).stop 2024-05-09T09:49:30.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 -- 172.21.15.157:0/863853576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561140353690 msgr2=0x561140353ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 --2- 172.21.15.157:0/863853576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561140353690 0x561140353ab0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fbc440e3f70 tx=0x7fbc440c9d70 comp rx=0 tx=0).stop 2024-05-09T09:49:30.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 -- 172.21.15.157:0/863853576 shutdown_connections 2024-05-09T09:49:30.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 --2- 172.21.15.157:0/863853576 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb2c034c00 0x7fbb2c0370c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 --2- 172.21.15.157:0/863853576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x561140353690 0x561140353ab0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 -- 172.21.15.157:0/863853576 >> 172.21.15.157:0/863853576 conn(0x561140348460 msgr2=0x561140348f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:30.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 -- 172.21.15.157:0/863853576 shutdown_connections 2024-05-09T09:49:30.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 -- 172.21.15.157:0/863853576 wait complete. 2024-05-09T09:49:30.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 -- 172.21.15.157:0/1870140394 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561140326d60 msgr2=0x561140329150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 --2- 172.21.15.157:0/1870140394 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x561140326d60 0x561140329150 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 -- 172.21.15.157:0/1870140394 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56114022b460 msgr2=0x5611403243f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 --2- 172.21.15.157:0/1870140394 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56114022b460 0x5611403243f0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 -- 172.21.15.157:0/1870140394 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56114032ac60 msgr2=0x56114032d050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 --2- 172.21.15.157:0/1870140394 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x56114032ac60 0x56114032d050 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 -- 172.21.15.157:0/1870140394 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb38034bb0 msgr2=0x7fbb38037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 --2- 172.21.15.157:0/1870140394 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbb38034bb0 0x7fbb38037070 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbc48001e50 tx=0x7fbc480013b0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 -- 172.21.15.157:0/1870140394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56114022ab40 msgr2=0x56114031d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 --2- 172.21.15.157:0/1870140394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56114022ab40 0x56114031d450 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fbc4401b170 tx=0x7fbc440180e0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc534c0640 1 -- 172.21.15.157:0/1870140394 reap_dead start 2024-05-09T09:49:30.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 -- 172.21.15.157:0/1870140394 shutdown_connections 2024-05-09T09:49:30.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 -- 172.21.15.157:0/1870140394 >> 172.21.15.157:0/1870140394 conn(0x56114019e260 msgr2=0x561140310ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:30.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 -- 172.21.15.157:0/1870140394 shutdown_connections 2024-05-09T09:49:30.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.022+0000 7fbc551a4980 1 -- 172.21.15.157:0/1870140394 wait complete. 2024-05-09T09:49:30.037 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-09T09:49:28.233198Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:49:28.233178Z', 'tags': [], 'group_ids': []} 2024-05-09T09:49:30.037 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-09T09:49:28.233198Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:49:28.233178Z', 'tags': [], 'group_ids': []} 2024-05-09T09:49:30.038 ERROR:root:0 2024-05-09T09:49:30.038 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-09T09:49:30.043 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-09T09:49:30.043 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-09T09:49:30.043 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-09T09:49:30.043 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-05-09T09:49:30.119 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:49:30.119 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:49:30.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.118+0000 7f9fe8cf7980 1 Processor -- start 2024-05-09T09:49:30.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.118+0000 7f9fe8cf7980 1 -- start start 2024-05-09T09:49:30.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.118+0000 7f9fe8cf7980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55f4db812f10 0x55f4db8132f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.118+0000 7f9fe8cf7980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f4db6c6440 con 0x55f4db813dd0 2024-05-09T09:49:30.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.118+0000 7f9fe8cf7980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55f4db6b15f0 con 0x55f4db812f10 2024-05-09T09:49:30.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.118+0000 7f9fe6812640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55f4db812f10 0x55f4db8132f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.118+0000 7f9fe6812640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55f4db812f10 0x55f4db8132f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39464/0 (socket says 172.21.15.157:39464) 2024-05-09T09:49:30.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.118+0000 7f9fe6812640 1 -- 172.21.15.157:0/509916377 learned_addr learned my addr 172.21.15.157:0/509916377 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:30.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.118+0000 7f9fe6812640 1 -- 172.21.15.157:0/509916377 >> v1:172.21.15.110:6789/0 conn(0x55f4db813dd0 legacy=0x55f4db8141e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.118+0000 7f9fe6812640 1 -- 172.21.15.157:0/509916377 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4db6bc990 con 0x55f4db812f10 2024-05-09T09:49:30.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.122+0000 7f9fe6812640 1 --2- 172.21.15.157:0/509916377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db812f10 0x55f4db8132f0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f9fe000a5c0 tx=0x7f9fe001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32684c63713db644 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.122+0000 7f9fe5810640 1 -- 172.21.15.157:0/509916377 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fe00b1070 con 0x55f4db812f10 2024-05-09T09:49:30.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.122+0000 7f9fe5810640 1 -- 172.21.15.157:0/509916377 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fe00a8070 con 0x55f4db812f10 2024-05-09T09:49:30.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.122+0000 7f9fe5810640 1 -- 172.21.15.157:0/509916377 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fe00ac5b0 con 0x55f4db812f10 2024-05-09T09:49:30.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.122+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/509916377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db812f10 msgr2=0x55f4db8132f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.122+0000 7f9fe8cf7980 1 --2- 172.21.15.157:0/509916377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db812f10 0x55f4db8132f0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f9fe000a5c0 tx=0x7f9fe001b340 comp rx=0 tx=0).stop 2024-05-09T09:49:30.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.122+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/509916377 shutdown_connections 2024-05-09T09:49:30.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.122+0000 7f9fe8cf7980 1 --2- 172.21.15.157:0/509916377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db812f10 0x55f4db8132f0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.122+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/509916377 >> 172.21.15.157:0/509916377 conn(0x55f4db7862b0 msgr2=0x55f4db7866c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:30.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.122+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/509916377 shutdown_connections 2024-05-09T09:49:30.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.122+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/509916377 wait complete. 2024-05-09T09:49:30.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.138+0000 7f9fe8cf7980 1 Processor -- start 2024-05-09T09:49:30.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.138+0000 7f9fe8cf7980 1 -- start start 2024-05-09T09:49:30.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.138+0000 7f9fe8cf7980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db812f10 0x55f4db8fe340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.138+0000 7f9fe8cf7980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f4db713fe0 con 0x55f4db812f10 2024-05-09T09:49:30.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.138+0000 7f9fe6812640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db812f10 0x55f4db8fe340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.138+0000 7f9fe6812640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db812f10 0x55f4db8fe340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39466/0 (socket says 172.21.15.157:39466) 2024-05-09T09:49:30.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.138+0000 7f9fe6812640 1 -- 172.21.15.157:0/2247066279 learned_addr learned my addr 172.21.15.157:0/2247066279 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:30.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.138+0000 7f9fe6812640 1 -- 172.21.15.157:0/2247066279 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4db698ae0 con 0x55f4db812f10 2024-05-09T09:49:30.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.138+0000 7f9fe6812640 1 --2- 172.21.15.157:0/2247066279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db812f10 0x55f4db8fe340 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00af040 tx=0x7f9fe0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45edc743e3b47256 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.138+0000 7f9ed4e09640 1 -- 172.21.15.157:0/2247066279 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fe00b1040 con 0x55f4db812f10 2024-05-09T09:49:30.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.138+0000 7f9ed4e09640 1 -- 172.21.15.157:0/2247066279 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fe00bc070 con 0x55f4db812f10 2024-05-09T09:49:30.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.138+0000 7f9ed4e09640 1 -- 172.21.15.157:0/2247066279 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fe00ac740 con 0x55f4db812f10 2024-05-09T09:49:30.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.142+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/2247066279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db812f10 msgr2=0x55f4db8fe340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.142+0000 7f9fe8cf7980 1 --2- 172.21.15.157:0/2247066279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db812f10 0x55f4db8fe340 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00af040 tx=0x7f9fe0003030 comp rx=0 tx=0).stop 2024-05-09T09:49:30.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.142+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/2247066279 shutdown_connections 2024-05-09T09:49:30.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.142+0000 7f9fe8cf7980 1 --2- 172.21.15.157:0/2247066279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db812f10 0x55f4db8fe340 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.142+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/2247066279 >> 172.21.15.157:0/2247066279 conn(0x55f4db7862b0 msgr2=0x55f4db8f9ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:30.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.142+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/2247066279 shutdown_connections 2024-05-09T09:49:30.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.142+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/2247066279 wait complete. 2024-05-09T09:49:30.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.142+0000 7f9fe8cf7980 1 Processor -- start 2024-05-09T09:49:30.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.142+0000 7f9fe8cf7980 1 -- start start 2024-05-09T09:49:30.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.142+0000 7f9fe8cf7980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db812f10 0x55f4db9052d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.142+0000 7f9fe8cf7980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f4db81cb40 con 0x55f4db812f10 2024-05-09T09:49:30.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.142+0000 7f9fe6812640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db812f10 0x55f4db9052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.142+0000 7f9fe6812640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db812f10 0x55f4db9052d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39480/0 (socket says 172.21.15.157:39480) 2024-05-09T09:49:30.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.142+0000 7f9fe6812640 1 -- 172.21.15.157:0/3158032468 learned_addr learned my addr 172.21.15.157:0/3158032468 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:30.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.142+0000 7f9fe6812640 1 -- 172.21.15.157:0/3158032468 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4db905810 con 0x55f4db812f10 2024-05-09T09:49:30.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.142+0000 7f9fe6812640 1 --2- 172.21.15.157:0/3158032468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db812f10 0x55f4db9052d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f9fe001b170 tx=0x7f9fe00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.142+0000 7f9ed3606640 1 -- 172.21.15.157:0/3158032468 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fe00c5070 con 0x55f4db812f10 2024-05-09T09:49:30.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.142+0000 7f9ed3606640 1 -- 172.21.15.157:0/3158032468 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fe00b7870 con 0x55f4db812f10 2024-05-09T09:49:30.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.142+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/3158032468 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4db905aa0 con 0x55f4db812f10 2024-05-09T09:49:30.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.142+0000 7f9ed3606640 1 -- 172.21.15.157:0/3158032468 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fe00b1070 con 0x55f4db812f10 2024-05-09T09:49:30.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.142+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/3158032468 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4db908730 con 0x55f4db812f10 2024-05-09T09:49:30.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.142+0000 7f9ed3606640 1 -- 172.21.15.157:0/3158032468 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f9fe00aa070 con 0x55f4db812f10 2024-05-09T09:49:30.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.146+0000 7f9ed3606640 1 --2- 172.21.15.157:0/3158032468 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9ecc034c00 0x7f9ecc0370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.146+0000 7f9ed3606640 1 -- 172.21.15.157:0/3158032468 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f9fe00e53e0 con 0x55f4db812f10 2024-05-09T09:49:30.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.146+0000 7f9fe6011640 1 --2- 172.21.15.157:0/3158032468 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9ecc034c00 0x7f9ecc0370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.146+0000 7f9fe8cf7980 1 --2- 172.21.15.157:0/3158032468 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f4db813dd0 0x55f4db90c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.146+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/3158032468 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4db90c7e0 con 0x55f4db813dd0 2024-05-09T09:49:30.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.146+0000 7f9fe7013640 1 --2- 172.21.15.157:0/3158032468 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f4db813dd0 0x55f4db90c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.146+0000 7f9fe6011640 1 --2- 172.21.15.157:0/3158032468 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9ecc034c00 0x7f9ecc0370c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0001e20 tx=0x7f9fd00013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.148 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.146+0000 7f9fe7013640 1 --2- 172.21.15.157:0/3158032468 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f4db813dd0 0x55f4db90c210 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.146+0000 7f9fe7013640 1 -- 172.21.15.157:0/3158032468 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db813dd0 2024-05-09T09:49:30.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.146+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/3158032468 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4db909950 con 0x55f4db813dd0 2024-05-09T09:49:30.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.146+0000 7f9fe7013640 1 -- 172.21.15.157:0/3158032468 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db813dd0 2024-05-09T09:49:30.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.146+0000 7f9fe8cf7980 1 --2- 172.21.15.157:0/3158032468 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f4db90eb30 0x55f4db910f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.146+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/3158032468 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9115f0 con 0x55f4db90eb30 2024-05-09T09:49:30.149 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.146+0000 7f9fe6812640 1 --2- 172.21.15.157:0/3158032468 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f4db90eb30 0x55f4db910f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.150+0000 7f9fe6812640 1 --2- 172.21.15.157:0/3158032468 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f4db90eb30 0x55f4db910f20 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.150+0000 7f9fe6812640 1 -- 172.21.15.157:0/3158032468 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9fe00b4040 con 0x55f4db90eb30 2024-05-09T09:49:30.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.150+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/3158032468 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4db90d9d0 con 0x55f4db813dd0 2024-05-09T09:49:30.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.150+0000 7f9fe7013640 1 -- 172.21.15.157:0/3158032468 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db813dd0 2024-05-09T09:49:30.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.150+0000 7f9fe8cf7980 1 --2- 172.21.15.157:0/3158032468 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f4db912a30 0x55f4db914e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.150+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/3158032468 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9155b0 con 0x55f4db912a30 2024-05-09T09:49:30.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.150+0000 7f9fe6011640 1 --2- 172.21.15.157:0/3158032468 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f4db912a30 0x55f4db914e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.150+0000 7f9fe6011640 1 --2- 172.21.15.157:0/3158032468 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f4db912a30 0x55f4db914e20 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.154 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.150+0000 7f9fe6011640 1 -- 172.21.15.157:0/3158032468 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9fd000d040 con 0x55f4db912a30 2024-05-09T09:49:30.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.154+0000 7f9fe8cf7980 1 Processor -- start 2024-05-09T09:49:30.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.154+0000 7f9fe8cf7980 1 -- start start 2024-05-09T09:49:30.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.154+0000 7f9fe8cf7980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db93b5f0 0x55f4db93ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.154+0000 7f9fe8cf7980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f4db718020 con 0x55f4db93b5f0 2024-05-09T09:49:30.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.158+0000 7f9fe6812640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db93b5f0 0x55f4db93ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.158+0000 7f9fe6812640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db93b5f0 0x55f4db93ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39490/0 (socket says 172.21.15.157:39490) 2024-05-09T09:49:30.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.158+0000 7f9fe6812640 1 -- 172.21.15.157:0/3045673190 learned_addr learned my addr 172.21.15.157:0/3045673190 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:30.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.158+0000 7f9fe6812640 1 -- 172.21.15.157:0/3045673190 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4db93bf50 con 0x55f4db93b5f0 2024-05-09T09:49:30.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.158+0000 7f9fe6812640 1 --2- 172.21.15.157:0/3045673190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db93b5f0 0x55f4db93ba10 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00ace70 tx=0x7f9fe00b6b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.158+0000 7f9ecb7fe640 1 -- 172.21.15.157:0/3045673190 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fe00e9070 con 0x55f4db93b5f0 2024-05-09T09:49:30.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.158+0000 7f9ecb7fe640 1 -- 172.21.15.157:0/3045673190 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fe00c1580 con 0x55f4db93b5f0 2024-05-09T09:49:30.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.158+0000 7f9ecb7fe640 1 -- 172.21.15.157:0/3045673190 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fe0006de0 con 0x55f4db93b5f0 2024-05-09T09:49:30.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.158+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/3045673190 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4db93c9e0 con 0x55f4db93b5f0 2024-05-09T09:49:30.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.158+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/3045673190 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4db93cec0 con 0x55f4db93b5f0 2024-05-09T09:49:30.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.158+0000 7f9ecb7fe640 1 -- 172.21.15.157:0/3045673190 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f9fe00ec070 con 0x55f4db93b5f0 2024-05-09T09:49:30.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.158+0000 7f9ecb7fe640 1 --2- 172.21.15.157:0/3045673190 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9ec0034bb0 0x7f9ec0037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.158+0000 7f9ecb7fe640 1 -- 172.21.15.157:0/3045673190 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f9fe00efd70 con 0x55f4db93b5f0 2024-05-09T09:49:30.161 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.158+0000 7f9fe6011640 1 --2- 172.21.15.157:0/3045673190 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9ec0034bb0 0x7f9ec0037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.158+0000 7f9fe8cf7980 1 Processor -- start 2024-05-09T09:49:30.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.158+0000 7f9fe8cf7980 1 -- start start 2024-05-09T09:49:30.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.158+0000 7f9fe6011640 1 --2- 172.21.15.157:0/3045673190 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9ec0034bb0 0x7f9ec0037070 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x55f4db9159b0 tx=0x7f9fd0006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.158+0000 7f9fe8cf7980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db948550 0x55f4db948970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.158+0000 7f9fe8cf7980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f4db8fe9d0 con 0x55f4db948550 2024-05-09T09:49:30.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.162+0000 7f9fe6812640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db948550 0x55f4db948970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.162+0000 7f9fe6812640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db948550 0x55f4db948970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39504/0 (socket says 172.21.15.157:39504) 2024-05-09T09:49:30.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.162+0000 7f9fe6812640 1 -- 172.21.15.157:0/2069016286 learned_addr learned my addr 172.21.15.157:0/2069016286 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:30.163 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.162+0000 7f9fe6812640 1 -- 172.21.15.157:0/2069016286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4db948f40 con 0x55f4db948550 2024-05-09T09:49:30.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.162+0000 7f9fe6812640 1 --2- 172.21.15.157:0/2069016286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db948550 0x55f4db948970 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00c1c30 tx=0x7f9fe00ca460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f446161a7b321b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.162+0000 7f9ec97fa640 1 -- 172.21.15.157:0/2069016286 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fe00c06f0 con 0x55f4db948550 2024-05-09T09:49:30.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.162+0000 7f9ec97fa640 1 -- 172.21.15.157:0/2069016286 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fe00d6ca0 con 0x55f4db948550 2024-05-09T09:49:30.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.162+0000 7f9ec97fa640 1 -- 172.21.15.157:0/2069016286 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fe0006390 con 0x55f4db948550 2024-05-09T09:49:30.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.162+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/2069016286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db948550 msgr2=0x55f4db948970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.162+0000 7f9fe8cf7980 1 --2- 172.21.15.157:0/2069016286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db948550 0x55f4db948970 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00c1c30 tx=0x7f9fe00ca460 comp rx=0 tx=0).stop 2024-05-09T09:49:30.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.162+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/2069016286 shutdown_connections 2024-05-09T09:49:30.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.162+0000 7f9fe8cf7980 1 --2- 172.21.15.157:0/2069016286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db948550 0x55f4db948970 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.162+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/2069016286 >> 172.21.15.157:0/2069016286 conn(0x55f4db944960 msgr2=0x55f4db9429c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:30.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.162+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/2069016286 shutdown_connections 2024-05-09T09:49:30.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.162+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/2069016286 wait complete. 2024-05-09T09:49:30.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.162+0000 7f9fe8cf7980 1 Processor -- start 2024-05-09T09:49:30.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.162+0000 7f9fe8cf7980 1 -- start start 2024-05-09T09:49:30.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.162+0000 7f9fe8cf7980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db948550 0x55f4db94f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.162+0000 7f9fe8cf7980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f4db949520 con 0x55f4db948550 2024-05-09T09:49:30.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.162+0000 7f9fe6812640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db948550 0x55f4db94f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.162+0000 7f9fe6812640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db948550 0x55f4db94f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39514/0 (socket says 172.21.15.157:39514) 2024-05-09T09:49:30.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.162+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 learned_addr learned my addr 172.21.15.157:0/1791267158 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:30.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.162+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4db94fe40 con 0x55f4db948550 2024-05-09T09:49:30.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.162+0000 7f9fe6812640 1 --2- 172.21.15.157:0/1791267158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db948550 0x55f4db94f900 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00ca7b0 tx=0x7f9fe00dcf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.166+0000 7f9eb77fe640 1 -- 172.21.15.157:0/1791267158 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fe0110020 con 0x55f4db948550 2024-05-09T09:49:30.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.166+0000 7f9eb77fe640 1 -- 172.21.15.157:0/1791267158 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fe0006390 con 0x55f4db948550 2024-05-09T09:49:30.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.166+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4db94fe40 con 0x55f4db948550 2024-05-09T09:49:30.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.166+0000 7f9eb77fe640 1 -- 172.21.15.157:0/1791267158 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fe00cac80 con 0x55f4db948550 2024-05-09T09:49:30.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.166+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4db94fe40 con 0x55f4db948550 2024-05-09T09:49:30.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.166+0000 7f9eb77fe640 1 -- 172.21.15.157:0/1791267158 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f9fe0113020 con 0x55f4db948550 2024-05-09T09:49:30.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.166+0000 7f9eb77fe640 1 --2- 172.21.15.157:0/1791267158 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9eb0034bb0 0x7f9eb0037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.166+0000 7f9eb77fe640 1 -- 172.21.15.157:0/1791267158 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f9fe0108070 con 0x55f4db948550 2024-05-09T09:49:30.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.166+0000 7f9fe6011640 1 --2- 172.21.15.157:0/1791267158 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9eb0034bb0 0x7f9eb0037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.166+0000 7f9fe8cf7980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.166+0000 7f9fe8cf7980 1 --2- 172.21.15.157:0/1791267158 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f4db95c460 0x55f4db95e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.166+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4db95f070 con 0x55f4db95c460 2024-05-09T09:49:30.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.166+0000 7f9fe6011640 1 --2- 172.21.15.157:0/1791267158 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9eb0034bb0 0x7f9eb0037070 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9fd00207d0 tx=0x7f9fd0011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.169 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.166+0000 7f9fe7013640 1 --2- 172.21.15.157:0/1791267158 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f4db95c460 0x55f4db95e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.166+0000 7f9fe7013640 1 --2- 172.21.15.157:0/1791267158 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f4db95c460 0x55f4db95e920 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.166+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.166+0000 7f9fe8cf7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:30.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.166+0000 7f9fe8cf7980 20 realm 2024-05-09T09:49:30.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.166+0000 7f9fe8cf7980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.166+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4db95f480 con 0x55f4db95c460 2024-05-09T09:49:30.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.166+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.166+0000 7f9fe8cf7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:30.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.166+0000 7f9fe8cf7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:49:30.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.166+0000 7f9fe8cf7980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.166+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4db95fd50 con 0x55f4db95c460 2024-05-09T09:49:30.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.166+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.166+0000 7f9fe8cf7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:30.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.166+0000 7f9fe8cf7980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.166+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x55f4db95c460 2024-05-09T09:49:30.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.170+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.170+0000 7f9fe8cf7980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:30.172 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.170+0000 7f9fe8cf7980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.170+0000 7f9fe8cf7980 1 --2- 172.21.15.157:0/1791267158 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f4db960e50 0x55f4db963240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.170+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4db963810 con 0x55f4db960e50 2024-05-09T09:49:30.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.170+0000 7f9fe6812640 1 --2- 172.21.15.157:0/1791267158 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f4db960e50 0x55f4db963240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.170+0000 7f9fe6812640 1 --2- 172.21.15.157:0/1791267158 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f4db960e50 0x55f4db963240 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.170+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9fe00eb030 con 0x55f4db960e50 2024-05-09T09:49:30.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.170+0000 7f9fe8cf7980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:49:30.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.170+0000 7f9fe8cf7980 20 searching for the correct realm 2024-05-09T09:49:30.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.170+0000 7f9fe8cf7980 1 --2- 172.21.15.157:0/1791267158 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f4db965760 0x55f4db967b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.170+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db968260 con 0x55f4db965760 2024-05-09T09:49:30.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.170+0000 7f9fe6011640 1 --2- 172.21.15.157:0/1791267158 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f4db965760 0x55f4db967b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.170+0000 7f9fe6011640 1 --2- 172.21.15.157:0/1791267158 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f4db965760 0x55f4db967b90 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.170+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fd0036040 con 0x55f4db965760 2024-05-09T09:49:30.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.170+0000 7f9fe6011640 1 --2- 172.21.15.157:0/1791267158 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f9fd000f3d0 0x7f9fd000f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.170+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db968260 con 0x7f9fd000f3d0 2024-05-09T09:49:30.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.170+0000 7f9fe7013640 1 --2- 172.21.15.157:0/1791267158 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f9fd000f3d0 0x7f9fd000f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.174+0000 7f9fe7013640 1 --2- 172.21.15.157:0/1791267158 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f9fd000f3d0 0x7f9fd000f7f0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.174+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fd800a4d0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.174+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x55f4db960e50 2024-05-09T09:49:30.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.174+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fe00eb030 con 0x55f4db960e50 2024-05-09T09:49:30.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.174+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x55f4db95c460 2024-05-09T09:49:30.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.174+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.174+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x55f4db95c460 2024-05-09T09:49:30.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.174+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.174+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x55f4db960e50 2024-05-09T09:49:30.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.174+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fe00eb030 con 0x55f4db960e50 2024-05-09T09:49:30.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.174+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x55f4db960e50 2024-05-09T09:49:30.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.174+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fe00eb030 con 0x55f4db960e50 2024-05-09T09:49:30.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.174+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.174+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fd800a4d0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.174+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x55f4db965760 2024-05-09T09:49:30.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.178+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fd0036040 con 0x55f4db965760 2024-05-09T09:49:30.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.178+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x55f4db95c460 2024-05-09T09:49:30.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.178+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.178+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x55f4db960e50 2024-05-09T09:49:30.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.178+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fe00eb030 con 0x55f4db960e50 2024-05-09T09:49:30.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.178+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x55f4db95c460 2024-05-09T09:49:30.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.178+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.178+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.178+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9fd800a4d0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.178+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x55f4db965760 2024-05-09T09:49:30.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.178+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fd0036040 con 0x55f4db965760 2024-05-09T09:49:30.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.178+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x55f4db965760 2024-05-09T09:49:30.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.178+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9fd0036040 con 0x55f4db965760 2024-05-09T09:49:30.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.178+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x55f4db960e50 2024-05-09T09:49:30.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.178+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fe00eb030 con 0x55f4db960e50 2024-05-09T09:49:30.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.178+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x55f4db965760 2024-05-09T09:49:30.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.178+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fd0036040 con 0x55f4db965760 2024-05-09T09:49:30.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.178+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x55f4db965760 2024-05-09T09:49:30.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.178+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fd0036040 con 0x55f4db965760 2024-05-09T09:49:30.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.178+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x55f4db95c460 2024-05-09T09:49:30.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.182+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.182+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x55f4db95c460 2024-05-09T09:49:30.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.182+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.182+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x55f4db960e50 2024-05-09T09:49:30.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.182+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fe00eb030 con 0x55f4db960e50 2024-05-09T09:49:30.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.182+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x55f4db965760 2024-05-09T09:49:30.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.182+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fd0036040 con 0x55f4db965760 2024-05-09T09:49:30.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.182+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.182+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fd800a4d0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.182+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x55f4db95c460 2024-05-09T09:49:30.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.182+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.182+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x55f4db960e50 2024-05-09T09:49:30.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.182+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9fe00eb030 con 0x55f4db960e50 2024-05-09T09:49:30.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.182+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x55f4db965760 2024-05-09T09:49:30.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.182+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fd0036040 con 0x55f4db965760 2024-05-09T09:49:30.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.182+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x55f4db960e50 2024-05-09T09:49:30.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fe00eb030 con 0x55f4db960e50 2024-05-09T09:49:30.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fd800a4d0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x55f4db965760 2024-05-09T09:49:30.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fd0049040 con 0x55f4db965760 2024-05-09T09:49:30.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x55f4db960e50 2024-05-09T09:49:30.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fe00eb030 con 0x55f4db960e50 2024-05-09T09:49:30.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x55f4db95c460 2024-05-09T09:49:30.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9600f0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fd800a4d0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe8cf7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:49:30.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe8cf7980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:49:30.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe8cf7980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:49:30.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe8cf7980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:49:30.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe8cf7980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:49:30.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe8cf7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:49:30.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe8cf7980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9640d0 con 0x55f4db95c460 2024-05-09T09:49:30.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe8cf7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:30.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe8cf7980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9640d0 con 0x55f4db95c460 2024-05-09T09:49:30.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe8cf7980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:30.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe8cf7980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9640d0 con 0x55f4db965760 2024-05-09T09:49:30.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9fd0049040 con 0x55f4db965760 2024-05-09T09:49:30.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe8cf7980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:49:30.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe8cf7980 20 zone default found 2024-05-09T09:49:30.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe8cf7980 4 Realm: () 2024-05-09T09:49:30.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe8cf7980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:49:30.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe8cf7980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:49:30.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe8cf7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:49:30.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe8cf7980 20 zonegroup default 2024-05-09T09:49:30.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe8cf7980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.186+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4db964b00 con 0x55f4db960e50 2024-05-09T09:49:30.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.190+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9fe00eb030 con 0x55f4db960e50 2024-05-09T09:49:30.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.190+0000 7f9fe8cf7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:30.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.190+0000 7f9fe8cf7980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.190+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4db96a570 con 0x55f4db965760 2024-05-09T09:49:30.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.190+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9fd0049040 con 0x55f4db965760 2024-05-09T09:49:30.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.190+0000 7f9fe8cf7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:30.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.190+0000 7f9fe8cf7980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.190+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4db96a910 con 0x55f4db965760 2024-05-09T09:49:30.194 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.190+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9fd0049040 con 0x55f4db965760 2024-05-09T09:49:30.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.190+0000 7f9fe8cf7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:30.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.190+0000 7f9fe8cf7980 20 started sync module instance, tier type = 2024-05-09T09:49:30.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.190+0000 7f9fe8cf7980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:49:30.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.190+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9699b0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.190+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.190+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94510144462240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9699b0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.190+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db96b1a0 con 0x55f4db95c460 2024-05-09T09:49:30.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.190+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94510144462240] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.194+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.194+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94510144466096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9699b0 con 0x55f4db95c460 2024-05-09T09:49:30.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.194+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db96bbb0 con 0x55f4db965760 2024-05-09T09:49:30.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.194+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fd0049040 con 0x55f4db965760 2024-05-09T09:49:30.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.194+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94510144468736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db96c400 con 0x55f4db965760 2024-05-09T09:49:30.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.194+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db96ce00 con 0x7f9fd000f3d0 2024-05-09T09:49:30.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.194+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94510144466096] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.198+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.198+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94510144460032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db96cdc0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.198+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db96d810 con 0x55f4db95c460 2024-05-09T09:49:30.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.198+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94510144468736] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fd0049040 con 0x55f4db965760 2024-05-09T09:49:30.200 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.198+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94510144460032] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.198+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.198+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94510144473360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db96d360 con 0x55f4db95c460 2024-05-09T09:49:30.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.198+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db96dbb0 con 0x55f4db960e50 2024-05-09T09:49:30.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.202+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fe00eb030 con 0x55f4db960e50 2024-05-09T09:49:30.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.202+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94510144476304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db96e400 con 0x55f4db960e50 2024-05-09T09:49:30.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.202+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db96edc0 con 0x55f4db960e50 2024-05-09T09:49:30.203 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.202+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94510144473360] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.202+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fe00eb030 con 0x55f4db960e50 2024-05-09T09:49:30.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.202+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94510144481552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db96f1e0 con 0x55f4db960e50 2024-05-09T09:49:30.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.202+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db96fba0 con 0x55f4db960e50 2024-05-09T09:49:30.205 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.202+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94510144476304] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fe00eb030 con 0x55f4db960e50 2024-05-09T09:49:30.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.206+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94510144481552] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fe00eb030 con 0x55f4db960e50 2024-05-09T09:49:30.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.206+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fe00eb030 con 0x55f4db960e50 2024-05-09T09:49:30.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.206+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94510144479056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db96f6f0 con 0x55f4db960e50 2024-05-09T09:49:30.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.206+0000 7f9fe8cf7980 20 add_watcher() i=0 2024-05-09T09:49:30.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.206+0000 7f9fe8cf7980 20 add_watcher() i=1 2024-05-09T09:49:30.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.206+0000 7f9fe8cf7980 20 add_watcher() i=2 2024-05-09T09:49:30.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.206+0000 7f9fe8cf7980 20 add_watcher() i=3 2024-05-09T09:49:30.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.206+0000 7f9fe8cf7980 20 add_watcher() i=4 2024-05-09T09:49:30.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.206+0000 7f9fe8cf7980 20 add_watcher() i=5 2024-05-09T09:49:30.208 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.206+0000 7f9fe8cf7980 20 add_watcher() i=6 2024-05-09T09:49:30.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.206+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94510144479056] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fe00eb030 con 0x55f4db960e50 2024-05-09T09:49:30.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.206+0000 7f9fe8cf7980 20 add_watcher() i=7 2024-05-09T09:49:30.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.206+0000 7f9fe8cf7980 2 all 8 watchers are set, enabling cache 2024-05-09T09:49:30.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.206+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4db96f6f0 con 0x55f4db95c460 2024-05-09T09:49:30.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.206+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.206+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94510144482608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db96f6f0 con 0x55f4db95c460 2024-05-09T09:49:30.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.210+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94510144482608] v32'465 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.210+0000 7f9e977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:30.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.210+0000 7f9fe8cf7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:49:30.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.210+0000 7f9fe8cf7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:49:30.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.210+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97b3c0 con 0x55f4db95c460 2024-05-09T09:49:30.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.210+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'106 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.210+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97ba90 con 0x55f4db960e50 2024-05-09T09:49:30.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.214+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'101 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9fe00eb030 con 0x55f4db960e50 2024-05-09T09:49:30.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.214+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97ba90 con 0x55f4db965760 2024-05-09T09:49:30.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.214+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'100 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9fd0049040 con 0x55f4db965760 2024-05-09T09:49:30.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.214+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97c060 con 0x55f4db95c460 2024-05-09T09:49:30.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.218+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'466 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.218+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97c510 con 0x7f9fd000f3d0 2024-05-09T09:49:30.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.218+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'287 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.218+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97ca80 con 0x55f4db965760 2024-05-09T09:49:30.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.218+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'192 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9fd0049040 con 0x55f4db965760 2024-05-09T09:49:30.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.218+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97cf30 con 0x55f4db95c460 2024-05-09T09:49:30.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.222+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'101 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.222+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97cf30 con 0x55f4db960e50 2024-05-09T09:49:30.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.226+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'191 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9fe00eb030 con 0x55f4db960e50 2024-05-09T09:49:30.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.226+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97cfc0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.226+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'99 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.226+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97cfc0 con 0x55f4db965760 2024-05-09T09:49:30.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.226+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'105 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9fd0049040 con 0x55f4db965760 2024-05-09T09:49:30.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.226+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97d6b0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.230+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'288 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.230+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97d6b0 con 0x55f4db960e50 2024-05-09T09:49:30.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.230+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'105 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9fe00eb030 con 0x55f4db960e50 2024-05-09T09:49:30.233 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.230+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97d6b0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.234 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.234+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'99 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.235 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.234+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97d6b0 con 0x55f4db960e50 2024-05-09T09:49:30.236 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.234+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'197 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9fe00eb030 con 0x55f4db960e50 2024-05-09T09:49:30.237 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.234+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97d6b0 con 0x55f4db95c460 2024-05-09T09:49:30.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.234+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'467 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.234+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97d6b0 con 0x55f4db965760 2024-05-09T09:49:30.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.238+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'281 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9fd0049040 con 0x55f4db965760 2024-05-09T09:49:30.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.238+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97dc40 con 0x7f9fd000f3d0 2024-05-09T09:49:30.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.238+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'289 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.238+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97dc40 con 0x55f4db965760 2024-05-09T09:49:30.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.242+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'99 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9fd0049040 con 0x55f4db965760 2024-05-09T09:49:30.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.242+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97dc40 con 0x55f4db95c460 2024-05-09T09:49:30.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.242+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'107 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.245 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.242+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97dc40 con 0x55f4db95c460 2024-05-09T09:49:30.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.246+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'468 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.246+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97dc40 con 0x55f4db965760 2024-05-09T09:49:30.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.246+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'282 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9fd0049040 con 0x55f4db965760 2024-05-09T09:49:30.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.246+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97dc40 con 0x7f9fd000f3d0 2024-05-09T09:49:30.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.246+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'111 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.246+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97dc40 con 0x55f4db965760 2024-05-09T09:49:30.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.250+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'101 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9fd0049040 con 0x55f4db965760 2024-05-09T09:49:30.251 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.250+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97dc40 con 0x55f4db965760 2024-05-09T09:49:30.252 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.250+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'105 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9fd0049040 con 0x55f4db965760 2024-05-09T09:49:30.253 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.250+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97dc40 con 0x55f4db965760 2024-05-09T09:49:30.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.250+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'96 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9fd0049040 con 0x55f4db965760 2024-05-09T09:49:30.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.250+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97dc40 con 0x55f4db965760 2024-05-09T09:49:30.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.254+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'193 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9fd0049040 con 0x55f4db965760 2024-05-09T09:49:30.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.254+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97dc40 con 0x55f4db960e50 2024-05-09T09:49:30.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.254+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'101 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9fe00eb030 con 0x55f4db960e50 2024-05-09T09:49:30.258 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.254+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97dc40 con 0x55f4db965760 2024-05-09T09:49:30.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.258+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'100 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9fd0049040 con 0x55f4db965760 2024-05-09T09:49:30.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.258+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97dc40 con 0x55f4db960e50 2024-05-09T09:49:30.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.258+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'192 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9fe00eb030 con 0x55f4db960e50 2024-05-09T09:49:30.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.258+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97dc40 con 0x55f4db965760 2024-05-09T09:49:30.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.262+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'283 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9fd0049040 con 0x55f4db965760 2024-05-09T09:49:30.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.262+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97dc40 con 0x55f4db960e50 2024-05-09T09:49:30.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.262+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'198 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9fe00eb030 con 0x55f4db960e50 2024-05-09T09:49:30.266 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.262+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db97dc40 con 0x7f9fd000f3d0 2024-05-09T09:49:30.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.266+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'105 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.266+0000 7f9e967fc640 20 reqs_thread_entry: start 2024-05-09T09:49:30.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.266+0000 7f9fe8cf7980 20 init_complete bucket index max shards: 11 2024-05-09T09:49:30.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.266+0000 7f9e07fff640 20 reqs_thread_entry: start 2024-05-09T09:49:30.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.266+0000 7f9fe8cf7980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-09T09:49:30.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.266+0000 7f9fe8cf7980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.266+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:94 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4db979120 con 0x55f4db960e50 2024-05-09T09:49:30.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.266+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(94 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f9fe00eb030 con 0x55f4db960e50 2024-05-09T09:49:30.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.266+0000 7f9fe8cf7980 20 rados_obj.operate() r=0 bl.length=490 2024-05-09T09:49:30.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.266+0000 7f9fe8cf7980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-09T09:49:30.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.266+0000 7f9fe8cf7980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:30.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.266+0000 7f9fe8cf7980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:49:30.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.266+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:95 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db99fad0 con 0x55f4db960e50 2024-05-09T09:49:30.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.270+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(95 ada [delete,create,call,call,writefull 0~503] v32'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f9fe00eb030 con 0x55f4db960e50 2024-05-09T09:49:30.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.270+0000 7f9fe8cf7980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-09T09:49:30.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.270+0000 7f9fe8cf7980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:30.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.270+0000 7f9fe8cf7980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-09T09:49:30.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.270+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 7.d 7:b4812045:::notify.4:head [notify cookie 94510144681408 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f4db99b390 con 0x55f4db95c460 2024-05-09T09:49:30.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.270+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== watch-notify(notify (1) cookie 94510144473360 notify 137438953510 ret 0) ==== 721+0+0 (crc 0 0 0) 0x55f4db97ccf0 con 0x55f4db95c460 2024-05-09T09:49:30.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.270+0000 7f9ec97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953510 cookie 94510144473360 notifier 4894 bl.length()=679 2024-05-09T09:49:30.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.270+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(96 notify.4 [notify cookie 94510144681408 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.270+0000 7f9ec97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-09T09:49:30.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.270+0000 7f9ec97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:30.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.270+0000 7f9ec97fa640 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9ea80056c0 con 0x55f4db95c460 2024-05-09T09:49:30.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.270+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(97 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.270+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== watch-notify(notify_complete (2) cookie 94510144681408 notify 137438953510 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f4db97c8b0 con 0x55f4db95c460 2024-05-09T09:49:30.274 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-09T09:49:28.233198Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:49:28.233178Z","tags":[],"group_ids":[]} 2024-05-09T09:49:30.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.274+0000 7f9e977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:30.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.274+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94510144482608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db9782d0 con 0x55f4db95c460 2024-05-09T09:49:30.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.274+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(98 data_loggenerations_metadata [watch unwatch cookie 94510144482608] v32'469 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.274+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94510144462240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db96ed30 con 0x7f9fd000f3d0 2024-05-09T09:49:30.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.274+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(99 notify.0 [watch unwatch cookie 94510144462240] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.274+0000 7f9fe8cf7980 20 remove_watcher() i=0 2024-05-09T09:49:30.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.274+0000 7f9fe8cf7980 2 removed watcher, disabling cache 2024-05-09T09:49:30.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.274+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94510144466096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db96ed30 con 0x55f4db95c460 2024-05-09T09:49:30.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.278+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(100 notify.1 [watch unwatch cookie 94510144466096] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.278+0000 7f9fe8cf7980 20 remove_watcher() i=1 2024-05-09T09:49:30.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.278+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94510144468736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db96ed30 con 0x55f4db965760 2024-05-09T09:49:30.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.278+0000 7f9fe6011640 1 -- 172.21.15.157:0/1791267158 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(101 notify.2 [watch unwatch cookie 94510144468736] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fd0049040 con 0x55f4db965760 2024-05-09T09:49:30.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.278+0000 7f9fe8cf7980 20 remove_watcher() i=2 2024-05-09T09:49:30.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.278+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:102 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94510144460032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db96b700 con 0x7f9fd000f3d0 2024-05-09T09:49:30.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.282+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(102 notify.3 [watch unwatch cookie 94510144460032] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x7f9fd000f3d0 2024-05-09T09:49:30.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.282+0000 7f9fe8cf7980 20 remove_watcher() i=3 2024-05-09T09:49:30.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.282+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94510144473360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db96ed30 con 0x55f4db95c460 2024-05-09T09:49:30.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.282+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(103 notify.4 [watch unwatch cookie 94510144473360] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fd800a4d0 con 0x55f4db95c460 2024-05-09T09:49:30.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.282+0000 7f9fe8cf7980 20 remove_watcher() i=4 2024-05-09T09:49:30.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.282+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94510144476304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db969500 con 0x55f4db960e50 2024-05-09T09:49:30.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.286+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(104 notify.5 [watch unwatch cookie 94510144476304] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fe00eb030 con 0x55f4db960e50 2024-05-09T09:49:30.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.286+0000 7f9fe8cf7980 20 remove_watcher() i=5 2024-05-09T09:49:30.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.286+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:105 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94510144481552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db96b700 con 0x55f4db960e50 2024-05-09T09:49:30.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.286+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(105 notify.6 [watch unwatch cookie 94510144481552] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fe00eb030 con 0x55f4db960e50 2024-05-09T09:49:30.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.286+0000 7f9fe8cf7980 20 remove_watcher() i=6 2024-05-09T09:49:30.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.286+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:106 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94510144479056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f4db96c910 con 0x55f4db960e50 2024-05-09T09:49:30.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe6812640 1 -- 172.21.15.157:0/1791267158 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(106 notify.7 [watch unwatch cookie 94510144479056] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fe00eb030 con 0x55f4db960e50 2024-05-09T09:49:30.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe8cf7980 20 remove_watcher() i=7 2024-05-09T09:49:30.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f4db960e50 msgr2=0x55f4db963240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe8cf7980 1 --2- 172.21.15.157:0/1791267158 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f4db960e50 0x55f4db963240 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f4db95c460 msgr2=0x55f4db95e920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe8cf7980 1 --2- 172.21.15.157:0/1791267158 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f4db95c460 0x55f4db95e920 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f9fd000f3d0 msgr2=0x7f9fd000f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe8cf7980 1 --2- 172.21.15.157:0/1791267158 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f9fd000f3d0 0x7f9fd000f7f0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f4db965760 msgr2=0x55f4db967b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe8cf7980 1 --2- 172.21.15.157:0/1791267158 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f4db965760 0x55f4db967b90 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9eb0034bb0 msgr2=0x7f9eb0037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe8cf7980 1 --2- 172.21.15.157:0/1791267158 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9eb0034bb0 0x7f9eb0037070 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9fd00207d0 tx=0x7f9fd0011000 comp rx=0 tx=0).stop 2024-05-09T09:49:30.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db948550 msgr2=0x55f4db94f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe7013640 1 -- 172.21.15.157:0/1791267158 reap_dead start 2024-05-09T09:49:30.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe8cf7980 1 --2- 172.21.15.157:0/1791267158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db948550 0x55f4db94f900 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00ca7b0 tx=0x7f9fe00dcf00 comp rx=0 tx=0).stop 2024-05-09T09:49:30.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 shutdown_connections 2024-05-09T09:49:30.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe8cf7980 1 --2- 172.21.15.157:0/1791267158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db948550 0x55f4db94f900 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 >> 172.21.15.157:0/1791267158 conn(0x55f4db944960 msgr2=0x55f4db941fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:30.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 shutdown_connections 2024-05-09T09:49:30.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/1791267158 wait complete. 2024-05-09T09:49:30.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/3045673190 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9ec0034bb0 msgr2=0x7f9ec0037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe8cf7980 1 --2- 172.21.15.157:0/3045673190 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9ec0034bb0 0x7f9ec0037070 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x55f4db9159b0 tx=0x7f9fd0006000 comp rx=0 tx=0).stop 2024-05-09T09:49:30.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/3045673190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db93b5f0 msgr2=0x55f4db93ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe8cf7980 1 --2- 172.21.15.157:0/3045673190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db93b5f0 0x55f4db93ba10 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00ace70 tx=0x7f9fe00b6b20 comp rx=0 tx=0).stop 2024-05-09T09:49:30.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/3045673190 shutdown_connections 2024-05-09T09:49:30.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe8cf7980 1 --2- 172.21.15.157:0/3045673190 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9ec0034bb0 0x7f9ec0037070 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe8cf7980 1 --2- 172.21.15.157:0/3045673190 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db93b5f0 0x55f4db93ba10 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/3045673190 >> 172.21.15.157:0/3045673190 conn(0x55f4db9303c0 msgr2=0x55f4db930ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:30.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/3045673190 shutdown_connections 2024-05-09T09:49:30.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.290+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/3045673190 wait complete. 2024-05-09T09:49:30.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.294+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/3158032468 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f4db90eb30 msgr2=0x55f4db910f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.294+0000 7f9fe8cf7980 1 --2- 172.21.15.157:0/3158032468 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55f4db90eb30 0x55f4db910f20 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.294+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/3158032468 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f4db813dd0 msgr2=0x55f4db90c210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.294+0000 7f9fe8cf7980 1 --2- 172.21.15.157:0/3158032468 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55f4db813dd0 0x55f4db90c210 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.294+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/3158032468 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f4db912a30 msgr2=0x55f4db914e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.294+0000 7f9fe8cf7980 1 --2- 172.21.15.157:0/3158032468 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55f4db912a30 0x55f4db914e20 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.294+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/3158032468 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9ecc034c00 msgr2=0x7f9ecc0370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.294+0000 7f9fe8cf7980 1 --2- 172.21.15.157:0/3158032468 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9ecc034c00 0x7f9ecc0370c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0001e20 tx=0x7f9fd00013a0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.294+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/3158032468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db812f10 msgr2=0x55f4db9052d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.294+0000 7f9fe8cf7980 1 --2- 172.21.15.157:0/3158032468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f4db812f10 0x55f4db9052d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f9fe001b170 tx=0x7f9fe00180e0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.294+0000 7f9fe7013640 1 -- 172.21.15.157:0/3158032468 reap_dead start 2024-05-09T09:49:30.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.294+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/3158032468 shutdown_connections 2024-05-09T09:49:30.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.294+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/3158032468 >> 172.21.15.157:0/3158032468 conn(0x55f4db7862b0 msgr2=0x55f4db8f89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:30.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.294+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/3158032468 shutdown_connections 2024-05-09T09:49:30.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.294+0000 7f9fe8cf7980 1 -- 172.21.15.157:0/3158032468 wait complete. 2024-05-09T09:49:30.307 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-09T09:49:28.233198Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:49:28.233178Z', 'tags': [], 'group_ids': []} 2024-05-09T09:49:30.307 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-09T09:49:28.233198Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:49:28.233178Z', 'tags': [], 'group_ids': []} 2024-05-09T09:49:30.307 ERROR:root:0 2024-05-09T09:49:30.307 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-09T09:49:30.312 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-09T09:49:30.312 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-05-09T09:49:30.312 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-05-09T09:49:30.313 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-05-09T09:49:30.390 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:49:30.390 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:49:30.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.390+0000 7f2d2dd99980 1 Processor -- start 2024-05-09T09:49:30.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.390+0000 7f2d2dd99980 1 -- start start 2024-05-09T09:49:30.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.390+0000 7f2d2dd99980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5641e8812f10 0x5641e88132f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.390+0000 7f2d2dd99980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5641e86c6440 con 0x5641e8813dd0 2024-05-09T09:49:30.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.390+0000 7f2d2dd99980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5641e86b15f0 con 0x5641e8812f10 2024-05-09T09:49:30.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.390+0000 7f2d2b8b4640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5641e8812f10 0x5641e88132f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.390+0000 7f2d2b8b4640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5641e8812f10 0x5641e88132f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39518/0 (socket says 172.21.15.157:39518) 2024-05-09T09:49:30.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.390+0000 7f2d2b0b3640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x5641e8813dd0 0x5641e88141e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:45632/0 (socket says 172.21.15.157:45632) 2024-05-09T09:49:30.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.390+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/1693230699 learned_addr learned my addr 172.21.15.157:0/1693230699 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:30.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.390+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/1693230699 >> v1:172.21.15.110:6789/0 conn(0x5641e8813dd0 legacy=0x5641e88141e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.390+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/1693230699 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641e86bc990 con 0x5641e8812f10 2024-05-09T09:49:30.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.394+0000 7f2d2b8b4640 1 --2- 172.21.15.157:0/1693230699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8812f10 0x5641e88132f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f2d2400a4e0 tx=0x7f2d2401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d3a635333c7784 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.395 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.394+0000 7f2d2a8b2640 1 -- 172.21.15.157:0/1693230699 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d240aa540 con 0x5641e8812f10 2024-05-09T09:49:30.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.394+0000 7f2d2a8b2640 1 -- 172.21.15.157:0/1693230699 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d240aa6e0 con 0x5641e8812f10 2024-05-09T09:49:30.396 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.394+0000 7f2d2a8b2640 1 -- 172.21.15.157:0/1693230699 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d240aaa40 con 0x5641e8812f10 2024-05-09T09:49:30.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.394+0000 7f2d2dd99980 1 -- 172.21.15.157:0/1693230699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8812f10 msgr2=0x5641e88132f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.394+0000 7f2d2dd99980 1 --2- 172.21.15.157:0/1693230699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8812f10 0x5641e88132f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f2d2400a4e0 tx=0x7f2d2401b090 comp rx=0 tx=0).stop 2024-05-09T09:49:30.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.394+0000 7f2d2dd99980 1 -- 172.21.15.157:0/1693230699 shutdown_connections 2024-05-09T09:49:30.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.394+0000 7f2d2dd99980 1 --2- 172.21.15.157:0/1693230699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8812f10 0x5641e88132f0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.394+0000 7f2d2dd99980 1 -- 172.21.15.157:0/1693230699 >> 172.21.15.157:0/1693230699 conn(0x5641e87862b0 msgr2=0x5641e87866c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:30.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.394+0000 7f2d2dd99980 1 -- 172.21.15.157:0/1693230699 shutdown_connections 2024-05-09T09:49:30.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.394+0000 7f2d2dd99980 1 -- 172.21.15.157:0/1693230699 wait complete. 2024-05-09T09:49:30.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.410+0000 7f2d2dd99980 1 Processor -- start 2024-05-09T09:49:30.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.410+0000 7f2d2dd99980 1 -- start start 2024-05-09T09:49:30.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.410+0000 7f2d2dd99980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8812f10 0x5641e88fe370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.410+0000 7f2d2dd99980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5641e8713fe0 con 0x5641e8812f10 2024-05-09T09:49:30.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.410+0000 7f2d2b8b4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8812f10 0x5641e88fe370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.410+0000 7f2d2b8b4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8812f10 0x5641e88fe370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39522/0 (socket says 172.21.15.157:39522) 2024-05-09T09:49:30.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.410+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/194110443 learned_addr learned my addr 172.21.15.157:0/194110443 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:30.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.410+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/194110443 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641e8698ae0 con 0x5641e8812f10 2024-05-09T09:49:30.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.410+0000 7f2d2b8b4640 1 --2- 172.21.15.157:0/194110443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8812f10 0x5641e88fe370 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f2d24018cc0 tx=0x7f2d240033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7940ace0252a9f04 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.410+0000 7f2c19e0b640 1 -- 172.21.15.157:0/194110443 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d240b9070 con 0x5641e8812f10 2024-05-09T09:49:30.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.410+0000 7f2c19e0b640 1 -- 172.21.15.157:0/194110443 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d240aa9c0 con 0x5641e8812f10 2024-05-09T09:49:30.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.410+0000 7f2c19e0b640 1 -- 172.21.15.157:0/194110443 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d240aaca0 con 0x5641e8812f10 2024-05-09T09:49:30.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.414+0000 7f2d2dd99980 1 -- 172.21.15.157:0/194110443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8812f10 msgr2=0x5641e88fe370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.414+0000 7f2d2dd99980 1 --2- 172.21.15.157:0/194110443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8812f10 0x5641e88fe370 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f2d24018cc0 tx=0x7f2d240033b0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.414+0000 7f2d2dd99980 1 -- 172.21.15.157:0/194110443 shutdown_connections 2024-05-09T09:49:30.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.414+0000 7f2d2dd99980 1 --2- 172.21.15.157:0/194110443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8812f10 0x5641e88fe370 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.414+0000 7f2d2dd99980 1 -- 172.21.15.157:0/194110443 >> 172.21.15.157:0/194110443 conn(0x5641e87862b0 msgr2=0x5641e88f9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:30.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.414+0000 7f2d2dd99980 1 -- 172.21.15.157:0/194110443 shutdown_connections 2024-05-09T09:49:30.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.414+0000 7f2d2dd99980 1 -- 172.21.15.157:0/194110443 wait complete. 2024-05-09T09:49:30.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.414+0000 7f2d2dd99980 1 Processor -- start 2024-05-09T09:49:30.416 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.414+0000 7f2d2dd99980 1 -- start start 2024-05-09T09:49:30.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.414+0000 7f2d2dd99980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8812f10 0x5641e8905310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.414+0000 7f2d2dd99980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5641e881cb40 con 0x5641e8812f10 2024-05-09T09:49:30.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.414+0000 7f2d2b8b4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8812f10 0x5641e8905310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.414+0000 7f2d2b8b4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8812f10 0x5641e8905310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39534/0 (socket says 172.21.15.157:39534) 2024-05-09T09:49:30.417 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.414+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/2198996920 learned_addr learned my addr 172.21.15.157:0/2198996920 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:30.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.414+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/2198996920 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641e8905850 con 0x5641e8812f10 2024-05-09T09:49:30.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.414+0000 7f2d2b8b4640 1 --2- 172.21.15.157:0/2198996920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8812f10 0x5641e8905310 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f2d2401b0d0 tx=0x7f2d24017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.414+0000 7f2c13fff640 1 -- 172.21.15.157:0/2198996920 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d240b9070 con 0x5641e8812f10 2024-05-09T09:49:30.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.414+0000 7f2c13fff640 1 -- 172.21.15.157:0/2198996920 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d240b5be0 con 0x5641e8812f10 2024-05-09T09:49:30.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.414+0000 7f2d2dd99980 1 -- 172.21.15.157:0/2198996920 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641e8905ae0 con 0x5641e8812f10 2024-05-09T09:49:30.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.414+0000 7f2c13fff640 1 -- 172.21.15.157:0/2198996920 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d240c7400 con 0x5641e8812f10 2024-05-09T09:49:30.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.414+0000 7f2d2dd99980 1 -- 172.21.15.157:0/2198996920 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641e89086d0 con 0x5641e8812f10 2024-05-09T09:49:30.419 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.418+0000 7f2c13fff640 1 -- 172.21.15.157:0/2198996920 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f2d240b3040 con 0x5641e8812f10 2024-05-09T09:49:30.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.418+0000 7f2c13fff640 1 --2- 172.21.15.157:0/2198996920 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2c14034bb0 0x7f2c14037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.418+0000 7f2c13fff640 1 -- 172.21.15.157:0/2198996920 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f2d240c4070 con 0x5641e8812f10 2024-05-09T09:49:30.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.418+0000 7f2d2b0b3640 1 --2- 172.21.15.157:0/2198996920 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2c14034bb0 0x7f2c14037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.418+0000 7f2d2dd99980 1 --2- 172.21.15.157:0/2198996920 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5641e8813dd0 0x5641e890c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.418+0000 7f2d2dd99980 1 -- 172.21.15.157:0/2198996920 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e890c860 con 0x5641e8813dd0 2024-05-09T09:49:30.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.418+0000 7f2d2c0b5640 1 --2- 172.21.15.157:0/2198996920 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5641e8813dd0 0x5641e890c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.418+0000 7f2d2b0b3640 1 --2- 172.21.15.157:0/2198996920 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2c14034bb0 0x7f2c14037070 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2d20001e50 tx=0x7f2d200013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.420 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.418+0000 7f2d2c0b5640 1 --2- 172.21.15.157:0/2198996920 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5641e8813dd0 0x5641e890c1f0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.418+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/2198996920 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d1c0083f0 con 0x5641e8813dd0 2024-05-09T09:49:30.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.418+0000 7f2d2dd99980 1 -- 172.21.15.157:0/2198996920 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e89098d0 con 0x5641e8813dd0 2024-05-09T09:49:30.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.418+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/2198996920 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2d1c0083f0 con 0x5641e8813dd0 2024-05-09T09:49:30.421 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.418+0000 7f2d2dd99980 1 --2- 172.21.15.157:0/2198996920 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5641e890eb90 0x5641e8910f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.418+0000 7f2d2dd99980 1 -- 172.21.15.157:0/2198996920 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e8911650 con 0x5641e890eb90 2024-05-09T09:49:30.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.418+0000 7f2d2b8b4640 1 --2- 172.21.15.157:0/2198996920 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5641e890eb90 0x5641e8910f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.422 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.418+0000 7f2d2b8b4640 1 --2- 172.21.15.157:0/2198996920 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5641e890eb90 0x5641e8910f80 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.422+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/2198996920 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2d240b2330 con 0x5641e890eb90 2024-05-09T09:49:30.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.422+0000 7f2d2dd99980 1 -- 172.21.15.157:0/2198996920 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e890da30 con 0x5641e8813dd0 2024-05-09T09:49:30.423 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.422+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/2198996920 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2d1c0083f0 con 0x5641e8813dd0 2024-05-09T09:49:30.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.422+0000 7f2d2dd99980 1 --2- 172.21.15.157:0/2198996920 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5641e8912a90 0x5641e8914e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.422+0000 7f2d2dd99980 1 -- 172.21.15.157:0/2198996920 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e8915610 con 0x5641e8912a90 2024-05-09T09:49:30.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.422+0000 7f2d2b0b3640 1 --2- 172.21.15.157:0/2198996920 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5641e8912a90 0x5641e8914e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.422+0000 7f2d2b0b3640 1 --2- 172.21.15.157:0/2198996920 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5641e8912a90 0x5641e8914e80 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.424 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.422+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/2198996920 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2d2000f700 con 0x5641e8912a90 2024-05-09T09:49:30.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.426+0000 7f2d2dd99980 1 Processor -- start 2024-05-09T09:49:30.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.426+0000 7f2d2dd99980 1 -- start start 2024-05-09T09:49:30.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.426+0000 7f2d2dd99980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e893b650 0x5641e893ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.426+0000 7f2d2dd99980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5641e8718020 con 0x5641e893b650 2024-05-09T09:49:30.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.426+0000 7f2d2b8b4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e893b650 0x5641e893ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.428 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.426+0000 7f2d2b8b4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e893b650 0x5641e893ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39548/0 (socket says 172.21.15.157:39548) 2024-05-09T09:49:30.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.426+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3621586187 learned_addr learned my addr 172.21.15.157:0/3621586187 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:30.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.426+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3621586187 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641e893bfb0 con 0x5641e893b650 2024-05-09T09:49:30.429 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.426+0000 7f2d2b8b4640 1 --2- 172.21.15.157:0/3621586187 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e893b650 0x5641e893ba70 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f2d240e2920 tx=0x7f2d240e45d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.426+0000 7f2c0bfff640 1 -- 172.21.15.157:0/3621586187 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d240bc560 con 0x5641e893b650 2024-05-09T09:49:30.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.426+0000 7f2c0bfff640 1 -- 172.21.15.157:0/3621586187 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d240bc700 con 0x5641e893b650 2024-05-09T09:49:30.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.426+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3621586187 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641e893ca40 con 0x5641e893b650 2024-05-09T09:49:30.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.426+0000 7f2c0bfff640 1 -- 172.21.15.157:0/3621586187 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d240bca20 con 0x5641e893b650 2024-05-09T09:49:30.430 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.426+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3621586187 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641e893cf20 con 0x5641e893b650 2024-05-09T09:49:30.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.430+0000 7f2c0bfff640 1 -- 172.21.15.157:0/3621586187 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f2d240dc120 con 0x5641e893b650 2024-05-09T09:49:30.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.430+0000 7f2c0bfff640 1 --2- 172.21.15.157:0/3621586187 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2c04034c00 0x7f2c040370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.430+0000 7f2c0bfff640 1 -- 172.21.15.157:0/3621586187 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f2d240dad10 con 0x5641e893b650 2024-05-09T09:49:30.431 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.430+0000 7f2d2b0b3640 1 --2- 172.21.15.157:0/3621586187 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2c04034c00 0x7f2c040370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.430+0000 7f2d2dd99980 1 Processor -- start 2024-05-09T09:49:30.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.430+0000 7f2d2dd99980 1 -- start start 2024-05-09T09:49:30.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.430+0000 7f2d2b0b3640 1 --2- 172.21.15.157:0/3621586187 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2c04034c00 0x7f2c040370c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x5641e8915a10 tx=0x7f2d2000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.430+0000 7f2d2dd99980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8948640 0x5641e8948a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.430+0000 7f2d2dd99980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5641e88fea00 con 0x5641e8948640 2024-05-09T09:49:30.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.430+0000 7f2d2b8b4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8948640 0x5641e8948a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.430+0000 7f2d2b8b4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8948640 0x5641e8948a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39556/0 (socket says 172.21.15.157:39556) 2024-05-09T09:49:30.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.430+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/2473009803 learned_addr learned my addr 172.21.15.157:0/2473009803 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:30.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.430+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/2473009803 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641e8949030 con 0x5641e8948640 2024-05-09T09:49:30.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.430+0000 7f2d2b8b4640 1 --2- 172.21.15.157:0/2473009803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8948640 0x5641e8948a60 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f2d240b3ed0 tx=0x7f2d240c7c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adeda44d61c7e680 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.430+0000 7f2c09ffb640 1 -- 172.21.15.157:0/2473009803 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d240b3460 con 0x5641e8948640 2024-05-09T09:49:30.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.430+0000 7f2c09ffb640 1 -- 172.21.15.157:0/2473009803 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d240dd910 con 0x5641e8948640 2024-05-09T09:49:30.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.430+0000 7f2c09ffb640 1 -- 172.21.15.157:0/2473009803 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d240ddc10 con 0x5641e8948640 2024-05-09T09:49:30.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.430+0000 7f2d2dd99980 1 -- 172.21.15.157:0/2473009803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8948640 msgr2=0x5641e8948a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.430+0000 7f2d2dd99980 1 --2- 172.21.15.157:0/2473009803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8948640 0x5641e8948a60 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f2d240b3ed0 tx=0x7f2d240c7c00 comp rx=0 tx=0).stop 2024-05-09T09:49:30.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.430+0000 7f2d2dd99980 1 -- 172.21.15.157:0/2473009803 shutdown_connections 2024-05-09T09:49:30.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.430+0000 7f2d2dd99980 1 --2- 172.21.15.157:0/2473009803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8948640 0x5641e8948a60 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.430+0000 7f2d2dd99980 1 -- 172.21.15.157:0/2473009803 >> 172.21.15.157:0/2473009803 conn(0x5641e89449c0 msgr2=0x5641e8942a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:30.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.430+0000 7f2d2dd99980 1 -- 172.21.15.157:0/2473009803 shutdown_connections 2024-05-09T09:49:30.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.430+0000 7f2d2dd99980 1 -- 172.21.15.157:0/2473009803 wait complete. 2024-05-09T09:49:30.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.434+0000 7f2d2dd99980 1 Processor -- start 2024-05-09T09:49:30.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.434+0000 7f2d2dd99980 1 -- start start 2024-05-09T09:49:30.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.434+0000 7f2d2dd99980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8948640 0x5641e894f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.434+0000 7f2d2dd99980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5641e8949700 con 0x5641e8948640 2024-05-09T09:49:30.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.434+0000 7f2d2b8b4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8948640 0x5641e894f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.434+0000 7f2d2b8b4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8948640 0x5641e894f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39568/0 (socket says 172.21.15.157:39568) 2024-05-09T09:49:30.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.434+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 learned_addr learned my addr 172.21.15.157:0/3025409625 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:30.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.434+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641e894fec0 con 0x5641e8948640 2024-05-09T09:49:30.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.434+0000 7f2d2b8b4640 1 --2- 172.21.15.157:0/3025409625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8948640 0x5641e894f980 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f2d240defd0 tx=0x7f2d240b3aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.434+0000 7f2bfbfff640 1 -- 172.21.15.157:0/3025409625 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d240a98c0 con 0x5641e8948640 2024-05-09T09:49:30.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.434+0000 7f2bfbfff640 1 -- 172.21.15.157:0/3025409625 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d240a9a60 con 0x5641e8948640 2024-05-09T09:49:30.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.434+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641e894fec0 con 0x5641e8948640 2024-05-09T09:49:30.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.434+0000 7f2bfbfff640 1 -- 172.21.15.157:0/3025409625 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d240a9d40 con 0x5641e8948640 2024-05-09T09:49:30.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.434+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641e894fec0 con 0x5641e8948640 2024-05-09T09:49:30.440 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.434+0000 7f2bfbfff640 1 -- 172.21.15.157:0/3025409625 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f2d240b6030 con 0x5641e8948640 2024-05-09T09:49:30.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.434+0000 7f2bfbfff640 1 --2- 172.21.15.157:0/3025409625 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2bf4034bb0 0x7f2bf4037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.434+0000 7f2bfbfff640 1 -- 172.21.15.157:0/3025409625 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f2d240ff070 con 0x5641e8948640 2024-05-09T09:49:30.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.434+0000 7f2d2b0b3640 1 --2- 172.21.15.157:0/3025409625 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2bf4034bb0 0x7f2bf4037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.434+0000 7f2d2dd99980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.434+0000 7f2d2dd99980 1 --2- 172.21.15.157:0/3025409625 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5641e895c4e0 0x5641e895e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.434+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e895f0f0 con 0x5641e895c4e0 2024-05-09T09:49:30.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.434+0000 7f2d2c0b5640 1 --2- 172.21.15.157:0/3025409625 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5641e895c4e0 0x5641e895e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.434+0000 7f2d2b0b3640 1 --2- 172.21.15.157:0/3025409625 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2bf4034bb0 0x7f2bf4037070 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000baa0 tx=0x7f2d20010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.438+0000 7f2d2c0b5640 1 --2- 172.21.15.157:0/3025409625 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5641e895c4e0 0x5641e895e9a0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.438+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d1c0083f0 con 0x5641e895c4e0 2024-05-09T09:49:30.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.438+0000 7f2d2dd99980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:30.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.438+0000 7f2d2dd99980 20 realm 2024-05-09T09:49:30.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.438+0000 7f2d2dd99980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.441 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.438+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e895f500 con 0x5641e895c4e0 2024-05-09T09:49:30.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.438+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d1c0083f0 con 0x5641e895c4e0 2024-05-09T09:49:30.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.438+0000 7f2d2dd99980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:30.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.438+0000 7f2d2dd99980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:49:30.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.438+0000 7f2d2dd99980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.438+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e895fdd0 con 0x5641e895c4e0 2024-05-09T09:49:30.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.438+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d1c0083f0 con 0x5641e895c4e0 2024-05-09T09:49:30.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.438+0000 7f2d2dd99980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:30.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.438+0000 7f2d2dd99980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.438+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x5641e895c4e0 2024-05-09T09:49:30.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.438+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2d1c0083f0 con 0x5641e895c4e0 2024-05-09T09:49:30.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.438+0000 7f2d2dd99980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:30.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.438+0000 7f2d2dd99980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.438+0000 7f2d2dd99980 1 --2- 172.21.15.157:0/3025409625 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5641e8960ed0 0x5641e89632c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.438+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e89638d0 con 0x5641e8960ed0 2024-05-09T09:49:30.443 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.438+0000 7f2d2b8b4640 1 --2- 172.21.15.157:0/3025409625 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5641e8960ed0 0x5641e89632c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.438+0000 7f2d2b8b4640 1 --2- 172.21.15.157:0/3025409625 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5641e8960ed0 0x5641e89632c0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.438+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2d24109020 con 0x5641e8960ed0 2024-05-09T09:49:30.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.438+0000 7f2d2dd99980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:49:30.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.438+0000 7f2d2dd99980 20 searching for the correct realm 2024-05-09T09:49:30.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.438+0000 7f2d2dd99980 1 --2- 172.21.15.157:0/3025409625 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5641e8965820 0x5641e8967c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.438+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8968300 con 0x5641e8965820 2024-05-09T09:49:30.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.438+0000 7f2d2b0b3640 1 --2- 172.21.15.157:0/3025409625 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5641e8965820 0x5641e8967c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.438+0000 7f2d2b0b3640 1 --2- 172.21.15.157:0/3025409625 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5641e8965820 0x5641e8967c30 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.445 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.442+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d20037040 con 0x5641e8965820 2024-05-09T09:49:30.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.442+0000 7f2d2b0b3640 1 --2- 172.21.15.157:0/3025409625 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2d2003a3c0 0x7f2d2003a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.442+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8968300 con 0x7f2d2003a3c0 2024-05-09T09:49:30.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.442+0000 7f2d2c0b5640 1 --2- 172.21.15.157:0/3025409625 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2d2003a3c0 0x7f2d2003a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.442+0000 7f2d2c0b5640 1 --2- 172.21.15.157:0/3025409625 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2d2003a3c0 0x7f2d2003a800 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.442+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d1c0083f0 con 0x7f2d2003a3c0 2024-05-09T09:49:30.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.442+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x5641e8960ed0 2024-05-09T09:49:30.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.442+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d24109020 con 0x5641e8960ed0 2024-05-09T09:49:30.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.442+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x5641e895c4e0 2024-05-09T09:49:30.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.442+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d1c0083f0 con 0x5641e895c4e0 2024-05-09T09:49:30.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.442+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x5641e895c4e0 2024-05-09T09:49:30.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.442+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d1c0083f0 con 0x5641e895c4e0 2024-05-09T09:49:30.446 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.442+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x5641e8960ed0 2024-05-09T09:49:30.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.442+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d24109020 con 0x5641e8960ed0 2024-05-09T09:49:30.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.442+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x5641e8960ed0 2024-05-09T09:49:30.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.446+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d24109020 con 0x5641e8960ed0 2024-05-09T09:49:30.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.446+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x7f2d2003a3c0 2024-05-09T09:49:30.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.446+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d1c0083f0 con 0x7f2d2003a3c0 2024-05-09T09:49:30.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.446+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x5641e8965820 2024-05-09T09:49:30.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.446+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d20037040 con 0x5641e8965820 2024-05-09T09:49:30.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.446+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x5641e895c4e0 2024-05-09T09:49:30.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.446+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d1c0083f0 con 0x5641e895c4e0 2024-05-09T09:49:30.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.446+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x5641e8960ed0 2024-05-09T09:49:30.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.446+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d24109020 con 0x5641e8960ed0 2024-05-09T09:49:30.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.446+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x5641e895c4e0 2024-05-09T09:49:30.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.446+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d1c0083f0 con 0x5641e895c4e0 2024-05-09T09:49:30.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.446+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x7f2d2003a3c0 2024-05-09T09:49:30.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.446+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2d1c0083f0 con 0x7f2d2003a3c0 2024-05-09T09:49:30.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.446+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x5641e8965820 2024-05-09T09:49:30.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.446+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d20037040 con 0x5641e8965820 2024-05-09T09:49:30.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.446+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x5641e8965820 2024-05-09T09:49:30.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.446+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2d20037040 con 0x5641e8965820 2024-05-09T09:49:30.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.446+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x5641e8960ed0 2024-05-09T09:49:30.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.446+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d24109020 con 0x5641e8960ed0 2024-05-09T09:49:30.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.446+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x5641e8965820 2024-05-09T09:49:30.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.450+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d20037040 con 0x5641e8965820 2024-05-09T09:49:30.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.450+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x5641e8965820 2024-05-09T09:49:30.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.450+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d20037040 con 0x5641e8965820 2024-05-09T09:49:30.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.450+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x5641e895c4e0 2024-05-09T09:49:30.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.450+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d1c0083f0 con 0x5641e895c4e0 2024-05-09T09:49:30.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.450+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x5641e895c4e0 2024-05-09T09:49:30.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.450+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2d1c0083f0 con 0x5641e895c4e0 2024-05-09T09:49:30.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.450+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x5641e8960ed0 2024-05-09T09:49:30.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.450+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d24109020 con 0x5641e8960ed0 2024-05-09T09:49:30.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.450+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x5641e8965820 2024-05-09T09:49:30.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.450+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d20037040 con 0x5641e8965820 2024-05-09T09:49:30.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.450+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x7f2d2003a3c0 2024-05-09T09:49:30.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.450+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d1c0083f0 con 0x7f2d2003a3c0 2024-05-09T09:49:30.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.450+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x5641e895c4e0 2024-05-09T09:49:30.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.450+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d1c0083f0 con 0x5641e895c4e0 2024-05-09T09:49:30.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.450+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x5641e8960ed0 2024-05-09T09:49:30.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.454+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2d24109020 con 0x5641e8960ed0 2024-05-09T09:49:30.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.454+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x5641e8965820 2024-05-09T09:49:30.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.454+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d20037040 con 0x5641e8965820 2024-05-09T09:49:30.455 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.454+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x5641e8960ed0 2024-05-09T09:49:30.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.454+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d24109020 con 0x5641e8960ed0 2024-05-09T09:49:30.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.454+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x7f2d2003a3c0 2024-05-09T09:49:30.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.454+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d1c0083f0 con 0x7f2d2003a3c0 2024-05-09T09:49:30.456 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.454+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x5641e8965820 2024-05-09T09:49:30.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.454+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d20049040 con 0x5641e8965820 2024-05-09T09:49:30.457 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.454+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x5641e8960ed0 2024-05-09T09:49:30.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.454+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d24109020 con 0x5641e8960ed0 2024-05-09T09:49:30.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.454+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x5641e895c4e0 2024-05-09T09:49:30.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.454+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2d1c0083f0 con 0x5641e895c4e0 2024-05-09T09:49:30.458 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.454+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5641e8960170 con 0x7f2d2003a3c0 2024-05-09T09:49:30.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d1c0083f0 con 0x7f2d2003a3c0 2024-05-09T09:49:30.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:49:30.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:49:30.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:49:30.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:49:30.461 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:49:30.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:49:30.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e8964190 con 0x5641e895c4e0 2024-05-09T09:49:30.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d1c0083f0 con 0x5641e895c4e0 2024-05-09T09:49:30.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:30.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e8964190 con 0x5641e895c4e0 2024-05-09T09:49:30.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2d1c0083f0 con 0x5641e895c4e0 2024-05-09T09:49:30.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:30.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e8964190 con 0x5641e8965820 2024-05-09T09:49:30.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2d20049040 con 0x5641e8965820 2024-05-09T09:49:30.462 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:49:30.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 20 zone default found 2024-05-09T09:49:30.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 4 Realm: () 2024-05-09T09:49:30.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:49:30.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:49:30.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:49:30.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 20 zonegroup default 2024-05-09T09:49:30.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e8964be0 con 0x5641e8960ed0 2024-05-09T09:49:30.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2d24109020 con 0x5641e8960ed0 2024-05-09T09:49:30.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:30.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e896a610 con 0x5641e8965820 2024-05-09T09:49:30.463 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2d20049040 con 0x5641e8965820 2024-05-09T09:49:30.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:30.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e896a9b0 con 0x5641e8965820 2024-05-09T09:49:30.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2d20049040 con 0x5641e8965820 2024-05-09T09:49:30.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:30.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 20 started sync module instance, tier type = 2024-05-09T09:49:30.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:49:30.464 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.458+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e8969a50 con 0x7f2d2003a3c0 2024-05-09T09:49:30.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.462+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d1c0083f0 con 0x7f2d2003a3c0 2024-05-09T09:49:30.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.462+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94841075048048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e8969a50 con 0x7f2d2003a3c0 2024-05-09T09:49:30.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.462+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e896b240 con 0x5641e895c4e0 2024-05-09T09:49:30.465 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.462+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94841075048048] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d1c035040 con 0x7f2d2003a3c0 2024-05-09T09:49:30.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.462+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d1c035040 con 0x5641e895c4e0 2024-05-09T09:49:30.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.462+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94841075051856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e8969a50 con 0x5641e895c4e0 2024-05-09T09:49:30.466 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.462+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e896bc50 con 0x5641e8965820 2024-05-09T09:49:30.467 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.466+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d20049040 con 0x5641e8965820 2024-05-09T09:49:30.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.466+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94841075054496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e896c4f0 con 0x5641e8965820 2024-05-09T09:49:30.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.466+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e896cef0 con 0x7f2d2003a3c0 2024-05-09T09:49:30.468 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.466+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94841075051856] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d1c035040 con 0x5641e895c4e0 2024-05-09T09:49:30.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.466+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d1c035040 con 0x7f2d2003a3c0 2024-05-09T09:49:30.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.466+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94841075045792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e896d2e0 con 0x7f2d2003a3c0 2024-05-09T09:49:30.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.466+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e896dbb0 con 0x5641e895c4e0 2024-05-09T09:49:30.469 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.466+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94841075054496] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d20049040 con 0x5641e8965820 2024-05-09T09:49:30.470 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.466+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94841075045792] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d1c035040 con 0x7f2d2003a3c0 2024-05-09T09:49:30.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.470+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d1c035040 con 0x5641e895c4e0 2024-05-09T09:49:30.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.470+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94841075059200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e896d290 con 0x5641e895c4e0 2024-05-09T09:49:30.471 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.470+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e896e450 con 0x5641e8960ed0 2024-05-09T09:49:30.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.470+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d24109020 con 0x5641e8960ed0 2024-05-09T09:49:30.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.470+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94841075064736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e896d290 con 0x5641e8960ed0 2024-05-09T09:49:30.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.470+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e896f1d0 con 0x5641e8960ed0 2024-05-09T09:49:30.473 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.470+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94841075059200] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d1c035040 con 0x5641e895c4e0 2024-05-09T09:49:30.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.474+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94841075064736] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d24109020 con 0x5641e8960ed0 2024-05-09T09:49:30.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.474+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d24109020 con 0x5641e8960ed0 2024-05-09T09:49:30.475 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.474+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94841075056704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e896ece0 con 0x5641e8960ed0 2024-05-09T09:49:30.476 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.474+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e896f980 con 0x5641e8960ed0 2024-05-09T09:49:30.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.474+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d24109020 con 0x5641e8960ed0 2024-05-09T09:49:30.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.474+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94841075056704] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d24109020 con 0x5641e8960ed0 2024-05-09T09:49:30.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.474+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94841075070032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e896fdf0 con 0x5641e8960ed0 2024-05-09T09:49:30.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.474+0000 7f2d2dd99980 20 add_watcher() i=0 2024-05-09T09:49:30.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.474+0000 7f2d2dd99980 20 add_watcher() i=1 2024-05-09T09:49:30.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.474+0000 7f2d2dd99980 20 add_watcher() i=2 2024-05-09T09:49:30.478 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.474+0000 7f2d2dd99980 20 add_watcher() i=3 2024-05-09T09:49:30.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.474+0000 7f2d2dd99980 20 add_watcher() i=4 2024-05-09T09:49:30.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.474+0000 7f2d2dd99980 20 add_watcher() i=5 2024-05-09T09:49:30.479 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.474+0000 7f2d2dd99980 20 add_watcher() i=6 2024-05-09T09:49:30.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.478+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94841075070032] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d24109020 con 0x5641e8960ed0 2024-05-09T09:49:30.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.478+0000 7f2d2dd99980 20 add_watcher() i=7 2024-05-09T09:49:30.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.478+0000 7f2d2dd99980 2 all 8 watchers are set, enabling cache 2024-05-09T09:49:30.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.478+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e896fdf0 con 0x5641e895c4e0 2024-05-09T09:49:30.480 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.478+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2d1c035040 con 0x5641e895c4e0 2024-05-09T09:49:30.481 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.478+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94841075071296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e896fdd0 con 0x5641e895c4e0 2024-05-09T09:49:30.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.478+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94841075071296] v32'470 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2d1c035040 con 0x5641e895c4e0 2024-05-09T09:49:30.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.478+0000 7f2be0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:30.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.478+0000 7f2d2dd99980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:49:30.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.478+0000 7f2d2dd99980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:49:30.482 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.478+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e897b7b0 con 0x5641e895c4e0 2024-05-09T09:49:30.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.482+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'107 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2d1c035040 con 0x5641e895c4e0 2024-05-09T09:49:30.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.482+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e897be00 con 0x5641e8960ed0 2024-05-09T09:49:30.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.486+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'102 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2d24109020 con 0x5641e8960ed0 2024-05-09T09:49:30.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.486+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e897be00 con 0x5641e8965820 2024-05-09T09:49:30.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.486+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'101 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2d20049040 con 0x5641e8965820 2024-05-09T09:49:30.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.486+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e897c8c0 con 0x5641e895c4e0 2024-05-09T09:49:30.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.486+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'471 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2d1c035040 con 0x5641e895c4e0 2024-05-09T09:49:30.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.486+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e8979670 con 0x7f2d2003a3c0 2024-05-09T09:49:30.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.490+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'290 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2d1c035040 con 0x7f2d2003a3c0 2024-05-09T09:49:30.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.490+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e8979670 con 0x5641e8965820 2024-05-09T09:49:30.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.490+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'194 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2d20049040 con 0x5641e8965820 2024-05-09T09:49:30.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.490+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e897d5f0 con 0x5641e895c4e0 2024-05-09T09:49:30.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.490+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'102 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2d1c035040 con 0x5641e895c4e0 2024-05-09T09:49:30.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.494+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e8979840 con 0x5641e8960ed0 2024-05-09T09:49:30.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.494+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'193 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2d24109020 con 0x5641e8960ed0 2024-05-09T09:49:30.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.494+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e8979840 con 0x7f2d2003a3c0 2024-05-09T09:49:30.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.498+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'100 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2d1c035040 con 0x7f2d2003a3c0 2024-05-09T09:49:30.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.498+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e8979840 con 0x5641e8965820 2024-05-09T09:49:30.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.498+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'106 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2d20049040 con 0x5641e8965820 2024-05-09T09:49:30.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.498+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e897dbc0 con 0x7f2d2003a3c0 2024-05-09T09:49:30.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.502+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'291 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d1c035040 con 0x7f2d2003a3c0 2024-05-09T09:49:30.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.502+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e897dae0 con 0x5641e8960ed0 2024-05-09T09:49:30.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.502+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'106 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d24109020 con 0x5641e8960ed0 2024-05-09T09:49:30.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.502+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e897dab0 con 0x7f2d2003a3c0 2024-05-09T09:49:30.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.506+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'100 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d1c035040 con 0x7f2d2003a3c0 2024-05-09T09:49:30.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.506+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e897dea0 con 0x5641e8960ed0 2024-05-09T09:49:30.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.506+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'199 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d24109020 con 0x5641e8960ed0 2024-05-09T09:49:30.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.506+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e897dea0 con 0x5641e895c4e0 2024-05-09T09:49:30.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.510+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'472 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d1c035040 con 0x5641e895c4e0 2024-05-09T09:49:30.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.510+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e897dea0 con 0x5641e8965820 2024-05-09T09:49:30.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.510+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'284 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d20049040 con 0x5641e8965820 2024-05-09T09:49:30.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.510+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e897dea0 con 0x7f2d2003a3c0 2024-05-09T09:49:30.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.514+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'292 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d1c035040 con 0x7f2d2003a3c0 2024-05-09T09:49:30.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.514+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e897dea0 con 0x5641e8965820 2024-05-09T09:49:30.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.514+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'100 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d20049040 con 0x5641e8965820 2024-05-09T09:49:30.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.514+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e897dea0 con 0x5641e895c4e0 2024-05-09T09:49:30.518 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.518+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'108 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d1c035040 con 0x5641e895c4e0 2024-05-09T09:49:30.519 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.518+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e897dea0 con 0x5641e895c4e0 2024-05-09T09:49:30.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.518+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'473 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d1c035040 con 0x5641e895c4e0 2024-05-09T09:49:30.520 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.518+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e897dea0 con 0x5641e8965820 2024-05-09T09:49:30.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.522+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'285 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d20049040 con 0x5641e8965820 2024-05-09T09:49:30.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.522+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e897dea0 con 0x7f2d2003a3c0 2024-05-09T09:49:30.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.522+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'112 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d1c035040 con 0x7f2d2003a3c0 2024-05-09T09:49:30.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.522+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e897dea0 con 0x5641e8965820 2024-05-09T09:49:30.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.522+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'102 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d20049040 con 0x5641e8965820 2024-05-09T09:49:30.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.522+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e897dea0 con 0x5641e8965820 2024-05-09T09:49:30.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.526+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'106 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d20049040 con 0x5641e8965820 2024-05-09T09:49:30.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.526+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e897dea0 con 0x5641e8965820 2024-05-09T09:49:30.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.526+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'97 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d20049040 con 0x5641e8965820 2024-05-09T09:49:30.528 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.526+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e897dea0 con 0x5641e8965820 2024-05-09T09:49:30.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.526+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'195 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d20049040 con 0x5641e8965820 2024-05-09T09:49:30.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.526+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e897dea0 con 0x5641e8960ed0 2024-05-09T09:49:30.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.530+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'102 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d24109020 con 0x5641e8960ed0 2024-05-09T09:49:30.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.530+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e897dab0 con 0x5641e8965820 2024-05-09T09:49:30.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.534+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'101 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d20049040 con 0x5641e8965820 2024-05-09T09:49:30.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.534+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e897dab0 con 0x5641e8960ed0 2024-05-09T09:49:30.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.534+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'194 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d24109020 con 0x5641e8960ed0 2024-05-09T09:49:30.538 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.534+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e897dab0 con 0x5641e8965820 2024-05-09T09:49:30.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.538+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'286 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d20049040 con 0x5641e8965820 2024-05-09T09:49:30.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.538+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e897dab0 con 0x5641e8960ed0 2024-05-09T09:49:30.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.542+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'200 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d24109020 con 0x5641e8960ed0 2024-05-09T09:49:30.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.542+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e897dab0 con 0x7f2d2003a3c0 2024-05-09T09:49:30.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.542+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'106 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d1c035040 con 0x7f2d2003a3c0 2024-05-09T09:49:30.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.542+0000 7f2b5b7fe640 20 reqs_thread_entry: start 2024-05-09T09:49:30.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.546+0000 7f2d2dd99980 20 init_complete bucket index max shards: 11 2024-05-09T09:49:30.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.546+0000 7f2d2dd99980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-09T09:49:30.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.546+0000 7f2d2dd99980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.546+0000 7f2b597fa640 20 reqs_thread_entry: start 2024-05-09T09:49:30.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.546+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:94 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e8978500 con 0x5641e8960ed0 2024-05-09T09:49:30.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.546+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(94 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7f2d24109020 con 0x5641e8960ed0 2024-05-09T09:49:30.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.546+0000 7f2d2dd99980 20 rados_obj.operate() r=0 bl.length=503 2024-05-09T09:49:30.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.546+0000 7f2d2dd99980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-09T09:49:30.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.546+0000 7f2d2dd99980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:30.548 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.546+0000 7f2d2dd99980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:49:30.549 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.546+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:95 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e899ff80 con 0x5641e8960ed0 2024-05-09T09:49:30.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.550+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(95 ada [delete,create,call,call,writefull 0~460] v32'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f2d24109020 con 0x5641e8960ed0 2024-05-09T09:49:30.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.550+0000 7f2d2dd99980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-09T09:49:30.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.550+0000 7f2d2dd99980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:30.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.550+0000 7f2d2dd99980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-09T09:49:30.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.550+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 7.d 7:b4812045:::notify.4:head [notify cookie 94841075268240 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5641e899b8f0 con 0x5641e895c4e0 2024-05-09T09:49:30.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.550+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== watch-notify(notify (1) cookie 94841075059200 notify 137438953511 ret 0) ==== 678+0+0 (crc 0 0 0) 0x5641e897dea0 con 0x5641e895c4e0 2024-05-09T09:49:30.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.550+0000 7f2c09ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953511 cookie 94841075059200 notifier 4901 bl.length()=636 2024-05-09T09:49:30.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.550+0000 7f2c09ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-09T09:49:30.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.550+0000 7f2c09ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:30.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.550+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(96 notify.4 [notify cookie 94841075268240 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2d1c035040 con 0x5641e895c4e0 2024-05-09T09:49:30.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.550+0000 7f2c09ffb640 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2bf00056c0 con 0x5641e895c4e0 2024-05-09T09:49:30.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.550+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== watch-notify(notify_complete (2) cookie 94841075268240 notify 137438953511 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5641e8978ff0 con 0x5641e895c4e0 2024-05-09T09:49:30.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.550+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(97 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d1c035040 con 0x5641e895c4e0 2024-05-09T09:49:30.553 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-09T09:49:28.233198Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:49:28.233178Z","tags":[],"group_ids":[]} 2024-05-09T09:49:30.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.550+0000 7f2be0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:30.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.550+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94841075071296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e89776a0 con 0x5641e895c4e0 2024-05-09T09:49:30.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.554+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(98 data_loggenerations_metadata [watch unwatch cookie 94841075071296] v32'474 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2d1c035040 con 0x5641e895c4e0 2024-05-09T09:49:30.555 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.554+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94841075048048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e896f940 con 0x7f2d2003a3c0 2024-05-09T09:49:30.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.554+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(99 notify.0 [watch unwatch cookie 94841075048048] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d1c035040 con 0x7f2d2003a3c0 2024-05-09T09:49:30.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.554+0000 7f2d2dd99980 20 remove_watcher() i=0 2024-05-09T09:49:30.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.554+0000 7f2d2dd99980 2 removed watcher, disabling cache 2024-05-09T09:49:30.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.554+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94841075051856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e896f940 con 0x5641e895c4e0 2024-05-09T09:49:30.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.558+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(100 notify.1 [watch unwatch cookie 94841075051856] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d1c035040 con 0x5641e895c4e0 2024-05-09T09:49:30.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.558+0000 7f2d2dd99980 20 remove_watcher() i=1 2024-05-09T09:49:30.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.558+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94841075054496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e896f940 con 0x5641e8965820 2024-05-09T09:49:30.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.558+0000 7f2d2b0b3640 1 -- 172.21.15.157:0/3025409625 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(101 notify.2 [watch unwatch cookie 94841075054496] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d20049040 con 0x5641e8965820 2024-05-09T09:49:30.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.558+0000 7f2d2dd99980 20 remove_watcher() i=2 2024-05-09T09:49:30.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.558+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:102 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94841075045792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e896f940 con 0x7f2d2003a3c0 2024-05-09T09:49:30.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.562+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(102 notify.3 [watch unwatch cookie 94841075045792] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d1c035040 con 0x7f2d2003a3c0 2024-05-09T09:49:30.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.562+0000 7f2d2dd99980 20 remove_watcher() i=3 2024-05-09T09:49:30.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.562+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94841075059200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e89695a0 con 0x5641e895c4e0 2024-05-09T09:49:30.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.562+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(103 notify.4 [watch unwatch cookie 94841075059200] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d1c035040 con 0x5641e895c4e0 2024-05-09T09:49:30.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.562+0000 7f2d2dd99980 20 remove_watcher() i=4 2024-05-09T09:49:30.565 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.562+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94841075064736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e896f940 con 0x5641e8960ed0 2024-05-09T09:49:30.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.566+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(104 notify.5 [watch unwatch cookie 94841075064736] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d24109020 con 0x5641e8960ed0 2024-05-09T09:49:30.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.566+0000 7f2d2dd99980 20 remove_watcher() i=5 2024-05-09T09:49:30.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.566+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:105 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94841075056704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e89695a0 con 0x5641e8960ed0 2024-05-09T09:49:30.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.566+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(105 notify.6 [watch unwatch cookie 94841075056704] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d24109020 con 0x5641e8960ed0 2024-05-09T09:49:30.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.566+0000 7f2d2dd99980 20 remove_watcher() i=6 2024-05-09T09:49:30.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.566+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:106 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94841075070032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5641e896f940 con 0x5641e8960ed0 2024-05-09T09:49:30.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2b8b4640 1 -- 172.21.15.157:0/3025409625 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(106 notify.7 [watch unwatch cookie 94841075070032] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d24109020 con 0x5641e8960ed0 2024-05-09T09:49:30.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 20 remove_watcher() i=7 2024-05-09T09:49:30.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5641e8960ed0 msgr2=0x5641e89632c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 --2- 172.21.15.157:0/3025409625 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5641e8960ed0 0x5641e89632c0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5641e895c4e0 msgr2=0x5641e895e9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 --2- 172.21.15.157:0/3025409625 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5641e895c4e0 0x5641e895e9a0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2d2003a3c0 msgr2=0x7f2d2003a800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 --2- 172.21.15.157:0/3025409625 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f2d2003a3c0 0x7f2d2003a800 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5641e8965820 msgr2=0x5641e8967c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 --2- 172.21.15.157:0/3025409625 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5641e8965820 0x5641e8967c30 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2bf4034bb0 msgr2=0x7f2bf4037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 --2- 172.21.15.157:0/3025409625 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2bf4034bb0 0x7f2bf4037070 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000baa0 tx=0x7f2d20010000 comp rx=0 tx=0).stop 2024-05-09T09:49:30.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8948640 msgr2=0x5641e894f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 --2- 172.21.15.157:0/3025409625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8948640 0x5641e894f980 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f2d240defd0 tx=0x7f2d240b3aa0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/3025409625 reap_dead start 2024-05-09T09:49:30.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 shutdown_connections 2024-05-09T09:49:30.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 --2- 172.21.15.157:0/3025409625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8948640 0x5641e894f980 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 >> 172.21.15.157:0/3025409625 conn(0x5641e89449c0 msgr2=0x5641e8942020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:30.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 shutdown_connections 2024-05-09T09:49:30.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3025409625 wait complete. 2024-05-09T09:49:30.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3621586187 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2c04034c00 msgr2=0x7f2c040370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 --2- 172.21.15.157:0/3621586187 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2c04034c00 0x7f2c040370c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x5641e8915a10 tx=0x7f2d2000f000 comp rx=0 tx=0).stop 2024-05-09T09:49:30.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3621586187 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e893b650 msgr2=0x5641e893ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 --2- 172.21.15.157:0/3621586187 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e893b650 0x5641e893ba70 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f2d240e2920 tx=0x7f2d240e45d0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3621586187 shutdown_connections 2024-05-09T09:49:30.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 --2- 172.21.15.157:0/3621586187 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2c04034c00 0x7f2c040370c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 --2- 172.21.15.157:0/3621586187 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e893b650 0x5641e893ba70 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3621586187 >> 172.21.15.157:0/3621586187 conn(0x5641e8930420 msgr2=0x5641e8930f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:30.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3621586187 shutdown_connections 2024-05-09T09:49:30.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 -- 172.21.15.157:0/3621586187 wait complete. 2024-05-09T09:49:30.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 -- 172.21.15.157:0/2198996920 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5641e890eb90 msgr2=0x5641e8910f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.576 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 --2- 172.21.15.157:0/2198996920 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5641e890eb90 0x5641e8910f80 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 -- 172.21.15.157:0/2198996920 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5641e8813dd0 msgr2=0x5641e890c1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 --2- 172.21.15.157:0/2198996920 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5641e8813dd0 0x5641e890c1f0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 -- 172.21.15.157:0/2198996920 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5641e8912a90 msgr2=0x5641e8914e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 --2- 172.21.15.157:0/2198996920 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5641e8912a90 0x5641e8914e80 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 -- 172.21.15.157:0/2198996920 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2c14034bb0 msgr2=0x7f2c14037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 --2- 172.21.15.157:0/2198996920 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2c14034bb0 0x7f2c14037070 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2d20001e50 tx=0x7f2d200013b0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 -- 172.21.15.157:0/2198996920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8812f10 msgr2=0x5641e8905310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 --2- 172.21.15.157:0/2198996920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5641e8812f10 0x5641e8905310 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f2d2401b0d0 tx=0x7f2d24017e30 comp rx=0 tx=0).stop 2024-05-09T09:49:30.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2c0b5640 1 -- 172.21.15.157:0/2198996920 reap_dead start 2024-05-09T09:49:30.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 -- 172.21.15.157:0/2198996920 shutdown_connections 2024-05-09T09:49:30.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 -- 172.21.15.157:0/2198996920 >> 172.21.15.157:0/2198996920 conn(0x5641e87862b0 msgr2=0x5641e88f8a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:30.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 -- 172.21.15.157:0/2198996920 shutdown_connections 2024-05-09T09:49:30.577 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.570+0000 7f2d2dd99980 1 -- 172.21.15.157:0/2198996920 wait complete. 2024-05-09T09:49:30.588 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-09T09:49:28.233198Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:49:28.233178Z', 'tags': [], 'group_ids': []} 2024-05-09T09:49:30.588 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-09T09:49:28.233198Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:49:28.233178Z', 'tags': [], 'group_ids': []} 2024-05-09T09:49:30.588 ERROR:root:0 2024-05-09T09:49:30.588 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-05-09T09:49:30.588 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-05-09T09:49:30.588 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-05-09T09:49:30.668 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:49:30.668 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:49:30.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.666+0000 7f5989f69980 1 Processor -- start 2024-05-09T09:49:30.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.666+0000 7f5989f69980 1 -- start start 2024-05-09T09:49:30.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.666+0000 7f5989f69980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x557150bf7040 0x557150bf9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.666+0000 7f5989f69980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557150aa6440 con 0x557150bf2b40 2024-05-09T09:49:30.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.666+0000 7f5989f69980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x557150a915f0 con 0x557150bf7040 2024-05-09T09:49:30.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.666+0000 7f5987283640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x557150bf7040 0x557150bf9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.666+0000 7f5987a84640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x557150bf2b40 0x557150bf2f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:45634/0 (socket says 172.21.15.157:45634) 2024-05-09T09:49:30.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.666+0000 7f5987283640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x557150bf7040 0x557150bf9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39578/0 (socket says 172.21.15.157:39578) 2024-05-09T09:49:30.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.666+0000 7f5987a84640 1 -- 172.21.15.157:0/1860606064 learned_addr learned my addr 172.21.15.157:0/1860606064 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:49:30.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.670+0000 7f5987283640 1 -- 172.21.15.157:0/1860606064 >> v1:172.21.15.110:6789/0 conn(0x557150bf2b40 legacy=0x557150bf2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.670+0000 7f5987283640 1 -- 172.21.15.157:0/1860606064 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557150a9c990 con 0x557150bf7040 2024-05-09T09:49:30.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.670+0000 7f5987283640 1 --2- 172.21.15.157:0/1860606064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150bf7040 0x557150bf9430 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f597c00a480 tx=0x7f597c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158d2036f247cca8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.670+0000 7f5986a82640 1 -- 172.21.15.157:0/1860606064 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f597c0b0070 con 0x557150bf7040 2024-05-09T09:49:30.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.670+0000 7f5986a82640 1 -- 172.21.15.157:0/1860606064 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f597c0ab540 con 0x557150bf7040 2024-05-09T09:49:30.673 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.670+0000 7f5986a82640 1 -- 172.21.15.157:0/1860606064 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f597c0ab840 con 0x557150bf7040 2024-05-09T09:49:30.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.670+0000 7f5989f69980 1 -- 172.21.15.157:0/1860606064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150bf7040 msgr2=0x557150bf9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.670+0000 7f5989f69980 1 --2- 172.21.15.157:0/1860606064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150bf7040 0x557150bf9430 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f597c00a480 tx=0x7f597c01b280 comp rx=0 tx=0).stop 2024-05-09T09:49:30.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.670+0000 7f5989f69980 1 -- 172.21.15.157:0/1860606064 shutdown_connections 2024-05-09T09:49:30.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.670+0000 7f5989f69980 1 --2- 172.21.15.157:0/1860606064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150bf7040 0x557150bf9430 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.670+0000 7f5989f69980 1 -- 172.21.15.157:0/1860606064 >> 172.21.15.157:0/1860606064 conn(0x557150b66260 msgr2=0x557150b66670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:30.674 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.670+0000 7f5989f69980 1 -- 172.21.15.157:0/1860606064 shutdown_connections 2024-05-09T09:49:30.675 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.670+0000 7f5989f69980 1 -- 172.21.15.157:0/1860606064 wait complete. 2024-05-09T09:49:30.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.686+0000 7f5989f69980 1 Processor -- start 2024-05-09T09:49:30.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.686+0000 7f5989f69980 1 -- start start 2024-05-09T09:49:30.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.686+0000 7f5989f69980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150bf2b40 0x557150cddde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.686+0000 7f5989f69980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557150af3fe0 con 0x557150bf2b40 2024-05-09T09:49:30.690 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.686+0000 7f5987a84640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150bf2b40 0x557150cddde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.686+0000 7f5987a84640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150bf2b40 0x557150cddde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39592/0 (socket says 172.21.15.157:39592) 2024-05-09T09:49:30.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.686+0000 7f5987a84640 1 -- 172.21.15.157:0/2528694983 learned_addr learned my addr 172.21.15.157:0/2528694983 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:30.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.690+0000 7f5987a84640 1 -- 172.21.15.157:0/2528694983 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557150a78ae0 con 0x557150bf2b40 2024-05-09T09:49:30.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.690+0000 7f5987a84640 1 --2- 172.21.15.157:0/2528694983 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150bf2b40 0x557150cddde0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f5978001e20 tx=0x7f597800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a89d06a317e21c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.690+0000 7f5875e0b640 1 -- 172.21.15.157:0/2528694983 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5978012020 con 0x557150bf2b40 2024-05-09T09:49:30.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.690+0000 7f5875e0b640 1 -- 172.21.15.157:0/2528694983 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f597800e7c0 con 0x557150bf2b40 2024-05-09T09:49:30.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.690+0000 7f5875e0b640 1 -- 172.21.15.157:0/2528694983 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f597800eb00 con 0x557150bf2b40 2024-05-09T09:49:30.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.690+0000 7f5989f69980 1 -- 172.21.15.157:0/2528694983 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150bf2b40 msgr2=0x557150cddde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.690+0000 7f5989f69980 1 --2- 172.21.15.157:0/2528694983 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150bf2b40 0x557150cddde0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f5978001e20 tx=0x7f597800b790 comp rx=0 tx=0).stop 2024-05-09T09:49:30.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.690+0000 7f5989f69980 1 -- 172.21.15.157:0/2528694983 shutdown_connections 2024-05-09T09:49:30.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.690+0000 7f5989f69980 1 --2- 172.21.15.157:0/2528694983 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150bf2b40 0x557150cddde0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.690+0000 7f5989f69980 1 -- 172.21.15.157:0/2528694983 >> 172.21.15.157:0/2528694983 conn(0x557150b66260 msgr2=0x557150cd9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:30.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.690+0000 7f5989f69980 1 -- 172.21.15.157:0/2528694983 shutdown_connections 2024-05-09T09:49:30.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.690+0000 7f5989f69980 1 -- 172.21.15.157:0/2528694983 wait complete. 2024-05-09T09:49:30.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.690+0000 7f5989f69980 1 Processor -- start 2024-05-09T09:49:30.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.690+0000 7f5989f69980 1 -- start start 2024-05-09T09:49:30.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.690+0000 7f5989f69980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150bf2b40 0x557150ce5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.690+0000 7f5989f69980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557150bfc460 con 0x557150bf2b40 2024-05-09T09:49:30.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.690+0000 7f5987a84640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150bf2b40 0x557150ce5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.690+0000 7f5987a84640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150bf2b40 0x557150ce5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39598/0 (socket says 172.21.15.157:39598) 2024-05-09T09:49:30.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.690+0000 7f5987a84640 1 -- 172.21.15.157:0/2830032329 learned_addr learned my addr 172.21.15.157:0/2830032329 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:30.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.690+0000 7f5987a84640 1 -- 172.21.15.157:0/2830032329 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557150ce5560 con 0x557150bf2b40 2024-05-09T09:49:30.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.690+0000 7f5987a84640 1 --2- 172.21.15.157:0/2830032329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150bf2b40 0x557150ce5020 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f5978001e20 tx=0x7f5978000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.694+0000 7f586ffff640 1 -- 172.21.15.157:0/2830032329 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5978012030 con 0x557150bf2b40 2024-05-09T09:49:30.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.694+0000 7f5989f69980 1 -- 172.21.15.157:0/2830032329 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557150ce57f0 con 0x557150bf2b40 2024-05-09T09:49:30.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.694+0000 7f586ffff640 1 -- 172.21.15.157:0/2830032329 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5978001480 con 0x557150bf2b40 2024-05-09T09:49:30.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.694+0000 7f586ffff640 1 -- 172.21.15.157:0/2830032329 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f597801a910 con 0x557150bf2b40 2024-05-09T09:49:30.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.694+0000 7f5989f69980 1 -- 172.21.15.157:0/2830032329 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557150ce8480 con 0x557150bf2b40 2024-05-09T09:49:30.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.694+0000 7f586ffff640 1 -- 172.21.15.157:0/2830032329 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f5978015020 con 0x557150bf2b40 2024-05-09T09:49:30.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.694+0000 7f586ffff640 1 --2- 172.21.15.157:0/2830032329 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5870034bb0 0x7f5870037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.694+0000 7f586ffff640 1 -- 172.21.15.157:0/2830032329 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f5978020030 con 0x557150bf2b40 2024-05-09T09:49:30.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.694+0000 7f5987283640 1 --2- 172.21.15.157:0/2830032329 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5870034bb0 0x7f5870037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.694+0000 7f5989f69980 1 --2- 172.21.15.157:0/2830032329 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557150bf7040 0x557150cebfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.694+0000 7f5989f69980 1 -- 172.21.15.157:0/2830032329 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557150cec610 con 0x557150bf7040 2024-05-09T09:49:30.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.694+0000 7f5988285640 1 --2- 172.21.15.157:0/2830032329 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557150bf7040 0x557150cebfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.694+0000 7f5987283640 1 --2- 172.21.15.157:0/2830032329 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5870034bb0 0x7f5870037070 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f597c0ad000 tx=0x7f597c0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.694+0000 7f5988285640 1 --2- 172.21.15.157:0/2830032329 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557150bf7040 0x557150cebfa0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.694+0000 7f5988285640 1 -- 172.21.15.157:0/2830032329 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x557150bf7040 2024-05-09T09:49:30.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.694+0000 7f5989f69980 1 -- 172.21.15.157:0/2830032329 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557150ce9680 con 0x557150bf7040 2024-05-09T09:49:30.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.694+0000 7f5988285640 1 -- 172.21.15.157:0/2830032329 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f598000a4d0 con 0x557150bf7040 2024-05-09T09:49:30.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.694+0000 7f5989f69980 1 --2- 172.21.15.157:0/2830032329 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557150cee940 0x557150cf0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.694+0000 7f5989f69980 1 -- 172.21.15.157:0/2830032329 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557150cf1400 con 0x557150cee940 2024-05-09T09:49:30.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.694+0000 7f5987a84640 1 --2- 172.21.15.157:0/2830032329 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557150cee940 0x557150cf0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.698+0000 7f5987a84640 1 --2- 172.21.15.157:0/2830032329 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557150cee940 0x557150cf0d30 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.698+0000 7f5987a84640 1 -- 172.21.15.157:0/2830032329 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5978008030 con 0x557150cee940 2024-05-09T09:49:30.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.698+0000 7f5989f69980 1 -- 172.21.15.157:0/2830032329 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557150ced7b0 con 0x557150bf7040 2024-05-09T09:49:30.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.698+0000 7f5988285640 1 -- 172.21.15.157:0/2830032329 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f598000a4d0 con 0x557150bf7040 2024-05-09T09:49:30.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.698+0000 7f5989f69980 1 --2- 172.21.15.157:0/2830032329 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557150cf2860 0x557150cf4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.698+0000 7f5989f69980 1 -- 172.21.15.157:0/2830032329 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557150cf5340 con 0x557150cf2860 2024-05-09T09:49:30.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.698+0000 7f5987283640 1 --2- 172.21.15.157:0/2830032329 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557150cf2860 0x557150cf4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.698+0000 7f5987283640 1 --2- 172.21.15.157:0/2830032329 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557150cf2860 0x557150cf4c50 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.701 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.698+0000 7f5987283640 1 -- 172.21.15.157:0/2830032329 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f597c0b3040 con 0x557150cf2860 2024-05-09T09:49:30.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.702+0000 7f5989f69980 1 Processor -- start 2024-05-09T09:49:30.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.702+0000 7f5989f69980 1 -- start start 2024-05-09T09:49:30.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.702+0000 7f5989f69980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150d1b190 0x557150d1b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.702+0000 7f5989f69980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557150af8020 con 0x557150d1b190 2024-05-09T09:49:30.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.702+0000 7f5987a84640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150d1b190 0x557150d1b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.702+0000 7f5987a84640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150d1b190 0x557150d1b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39604/0 (socket says 172.21.15.157:39604) 2024-05-09T09:49:30.705 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.702+0000 7f5987a84640 1 -- 172.21.15.157:0/425053088 learned_addr learned my addr 172.21.15.157:0/425053088 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:30.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.702+0000 7f5987a84640 1 -- 172.21.15.157:0/425053088 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557150d1baf0 con 0x557150d1b190 2024-05-09T09:49:30.706 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.702+0000 7f5987a84640 1 --2- 172.21.15.157:0/425053088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150d1b190 0x557150d1b5b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f597800efb0 tx=0x7f597800db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.706+0000 7f5867fff640 1 -- 172.21.15.157:0/425053088 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f597800d510 con 0x557150d1b190 2024-05-09T09:49:30.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.706+0000 7f5867fff640 1 -- 172.21.15.157:0/425053088 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f597801ac90 con 0x557150d1b190 2024-05-09T09:49:30.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.706+0000 7f5989f69980 1 -- 172.21.15.157:0/425053088 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557150d1c580 con 0x557150d1b190 2024-05-09T09:49:30.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.706+0000 7f5867fff640 1 -- 172.21.15.157:0/425053088 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5978017c50 con 0x557150d1b190 2024-05-09T09:49:30.707 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.706+0000 7f5989f69980 1 -- 172.21.15.157:0/425053088 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557150d1ca60 con 0x557150d1b190 2024-05-09T09:49:30.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.706+0000 7f5867fff640 1 -- 172.21.15.157:0/425053088 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f5978009070 con 0x557150d1b190 2024-05-09T09:49:30.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.706+0000 7f5867fff640 1 --2- 172.21.15.157:0/425053088 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5860034c00 0x7f58600370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.708 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.706+0000 7f5867fff640 1 -- 172.21.15.157:0/425053088 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f5978039070 con 0x557150d1b190 2024-05-09T09:49:30.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.706+0000 7f5987283640 1 --2- 172.21.15.157:0/425053088 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5860034c00 0x7f58600370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.706+0000 7f5989f69980 1 Processor -- start 2024-05-09T09:49:30.709 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.706+0000 7f5989f69980 1 -- start start 2024-05-09T09:49:30.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.706+0000 7f5989f69980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150d28150 0x557150d28550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.706+0000 7f5989f69980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557150cde530 con 0x557150d28150 2024-05-09T09:49:30.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.706+0000 7f5987283640 1 --2- 172.21.15.157:0/425053088 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5860034c00 0x7f58600370c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x557150cecef0 tx=0x7f597c005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.706+0000 7f5987a84640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150d28150 0x557150d28550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.706+0000 7f5987a84640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150d28150 0x557150d28550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39618/0 (socket says 172.21.15.157:39618) 2024-05-09T09:49:30.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.706+0000 7f5987a84640 1 -- 172.21.15.157:0/4240425251 learned_addr learned my addr 172.21.15.157:0/4240425251 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:30.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.706+0000 7f5987a84640 1 -- 172.21.15.157:0/4240425251 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557150d28b20 con 0x557150d28150 2024-05-09T09:49:30.710 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.706+0000 7f5987a84640 1 --2- 172.21.15.157:0/4240425251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150d28150 0x557150d28550 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f597801a6f0 tx=0x7f597803b470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93091a7e295ddb6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.706+0000 7f5865ffb640 1 -- 172.21.15.157:0/4240425251 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f597804a9f0 con 0x557150d28150 2024-05-09T09:49:30.712 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.710+0000 7f5865ffb640 1 -- 172.21.15.157:0/4240425251 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59780421f0 con 0x557150d28150 2024-05-09T09:49:30.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.710+0000 7f5865ffb640 1 -- 172.21.15.157:0/4240425251 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f597804ac30 con 0x557150d28150 2024-05-09T09:49:30.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.710+0000 7f5989f69980 1 -- 172.21.15.157:0/4240425251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150d28150 msgr2=0x557150d28550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.710+0000 7f5989f69980 1 --2- 172.21.15.157:0/4240425251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150d28150 0x557150d28550 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f597801a6f0 tx=0x7f597803b470 comp rx=0 tx=0).stop 2024-05-09T09:49:30.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.710+0000 7f5989f69980 1 -- 172.21.15.157:0/4240425251 shutdown_connections 2024-05-09T09:49:30.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.710+0000 7f5989f69980 1 --2- 172.21.15.157:0/4240425251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150d28150 0x557150d28550 secure :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f597801a6f0 tx=0x7f597803b470 comp rx=0 tx=0).stop 2024-05-09T09:49:30.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.710+0000 7f5989f69980 1 -- 172.21.15.157:0/4240425251 >> 172.21.15.157:0/4240425251 conn(0x557150d244d0 msgr2=0x557150d22530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:30.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.710+0000 7f5989f69980 1 -- 172.21.15.157:0/4240425251 shutdown_connections 2024-05-09T09:49:30.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.710+0000 7f5989f69980 1 -- 172.21.15.157:0/4240425251 wait complete. 2024-05-09T09:49:30.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.710+0000 7f5989f69980 1 Processor -- start 2024-05-09T09:49:30.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.710+0000 7f5989f69980 1 -- start start 2024-05-09T09:49:30.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.710+0000 7f5989f69980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150d2f680 0x557150d2faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.710+0000 7f5989f69980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557150d29210 con 0x557150d2f680 2024-05-09T09:49:30.713 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.710+0000 7f5987a84640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150d2f680 0x557150d2faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.710+0000 7f5987a84640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150d2f680 0x557150d2faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39624/0 (socket says 172.21.15.157:39624) 2024-05-09T09:49:30.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.710+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 learned_addr learned my addr 172.21.15.157:0/2503829270 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:30.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.710+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557150d2ffe0 con 0x557150d2f680 2024-05-09T09:49:30.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.710+0000 7f5987a84640 1 --2- 172.21.15.157:0/2503829270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150d2f680 0x557150d2faa0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f5978032e70 tx=0x7f5978042f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.710+0000 7f5857fff640 1 -- 172.21.15.157:0/2503829270 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f597806c070 con 0x557150d2f680 2024-05-09T09:49:30.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.710+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557150d2ffe0 con 0x557150d2f680 2024-05-09T09:49:30.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.710+0000 7f5857fff640 1 -- 172.21.15.157:0/2503829270 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59780470e0 con 0x557150d2f680 2024-05-09T09:49:30.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.710+0000 7f5857fff640 1 -- 172.21.15.157:0/2503829270 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5978047300 con 0x557150d2f680 2024-05-09T09:49:30.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.710+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557150d32b10 con 0x557150d2f680 2024-05-09T09:49:30.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.710+0000 7f5857fff640 1 -- 172.21.15.157:0/2503829270 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f597806f070 con 0x557150d2f680 2024-05-09T09:49:30.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5857fff640 1 --2- 172.21.15.157:0/2503829270 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5850034b60 0x7f5850037020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5857fff640 1 -- 172.21.15.157:0/2503829270 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f5978064050 con 0x557150d2f680 2024-05-09T09:49:30.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5987283640 1 --2- 172.21.15.157:0/2503829270 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5850034b60 0x7f5850037020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5987283640 1 --2- 172.21.15.157:0/2503829270 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5850034b60 0x7f5850037020 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f597c01b2c0 tx=0x7f597c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5989f69980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5989f69980 1 --2- 172.21.15.157:0/2503829270 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557150d3c600 0x557150d3eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557150d3f210 con 0x557150d3c600 2024-05-09T09:49:30.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5988285640 1 --2- 172.21.15.157:0/2503829270 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557150d3c600 0x557150d3eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5988285640 1 --2- 172.21.15.157:0/2503829270 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557150d3c600 0x557150d3eac0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5989f69980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:30.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5989f69980 20 realm 2024-05-09T09:49:30.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5989f69980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557150d3f620 con 0x557150d3c600 2024-05-09T09:49:30.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5989f69980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:30.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5989f69980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:49:30.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5989f69980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557150d3fef0 con 0x557150d3c600 2024-05-09T09:49:30.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5989f69980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:30.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5989f69980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557150d40290 con 0x557150d3c600 2024-05-09T09:49:30.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5989f69980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:30.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5989f69980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5989f69980 1 --2- 172.21.15.157:0/2503829270 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557150d40ff0 0x557150d433e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557150d439f0 con 0x557150d40ff0 2024-05-09T09:49:30.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5987a84640 1 --2- 172.21.15.157:0/2503829270 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557150d40ff0 0x557150d433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.714+0000 7f5987a84640 1 --2- 172.21.15.157:0/2503829270 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557150d40ff0 0x557150d433e0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.718+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f597806e030 con 0x557150d40ff0 2024-05-09T09:49:30.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.718+0000 7f5989f69980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:49:30.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.718+0000 7f5989f69980 20 searching for the correct realm 2024-05-09T09:49:30.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.718+0000 7f5989f69980 1 --2- 172.21.15.157:0/2503829270 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557150d45940 0x557150d47d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.718+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557150d48420 con 0x557150d45940 2024-05-09T09:49:30.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.718+0000 7f5987283640 1 --2- 172.21.15.157:0/2503829270 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557150d45940 0x557150d47d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.718+0000 7f5987283640 1 --2- 172.21.15.157:0/2503829270 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557150d45940 0x557150d47d50 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.718+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597c0d9070 con 0x557150d45940 2024-05-09T09:49:30.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.718+0000 7f5987283640 1 --2- 172.21.15.157:0/2503829270 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f597c0ce040 0x7f597c0db410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.718+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557150d48420 con 0x7f597c0ce040 2024-05-09T09:49:30.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.718+0000 7f5988285640 1 --2- 172.21.15.157:0/2503829270 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f597c0ce040 0x7f597c0db410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.718+0000 7f5988285640 1 --2- 172.21.15.157:0/2503829270 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f597c0ce040 0x7f597c0db410 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.718+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f598000a4d0 con 0x7f597c0ce040 2024-05-09T09:49:30.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.718+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557150d40290 con 0x557150d40ff0 2024-05-09T09:49:30.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.718+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597806e030 con 0x557150d40ff0 2024-05-09T09:49:30.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.718+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557150d40290 con 0x557150d3c600 2024-05-09T09:49:30.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.718+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.718+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557150d40290 con 0x557150d3c600 2024-05-09T09:49:30.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.722+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.722+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557150d40290 con 0x557150d40ff0 2024-05-09T09:49:30.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.722+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597806e030 con 0x557150d40ff0 2024-05-09T09:49:30.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.722+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557150d40290 con 0x557150d40ff0 2024-05-09T09:49:30.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.722+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597806e030 con 0x557150d40ff0 2024-05-09T09:49:30.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.722+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f597807e040 con 0x7f597c0ce040 2024-05-09T09:49:30.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.722+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f598000a4d0 con 0x7f597c0ce040 2024-05-09T09:49:30.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.722+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f597807e040 con 0x557150d45940 2024-05-09T09:49:30.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.722+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597c0d9070 con 0x557150d45940 2024-05-09T09:49:30.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.722+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f597807e040 con 0x557150d3c600 2024-05-09T09:49:30.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.722+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.722+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f597807e040 con 0x557150d40ff0 2024-05-09T09:49:30.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.722+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597806e030 con 0x557150d40ff0 2024-05-09T09:49:30.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.722+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f597807e040 con 0x557150d3c600 2024-05-09T09:49:30.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.722+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.726+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f597807e040 con 0x7f597c0ce040 2024-05-09T09:49:30.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.726+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f598000a4d0 con 0x7f597c0ce040 2024-05-09T09:49:30.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.726+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f597807e040 con 0x557150d45940 2024-05-09T09:49:30.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.726+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597c0d9070 con 0x557150d45940 2024-05-09T09:49:30.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.726+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f597c0e8040 con 0x557150d45940 2024-05-09T09:49:30.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.726+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f597c0d9070 con 0x557150d45940 2024-05-09T09:49:30.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.726+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f597c0e8040 con 0x557150d40ff0 2024-05-09T09:49:30.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.726+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597806e030 con 0x557150d40ff0 2024-05-09T09:49:30.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.726+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f597c0e8040 con 0x557150d45940 2024-05-09T09:49:30.729 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.726+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597c0d9070 con 0x557150d45940 2024-05-09T09:49:30.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.726+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f597c0e8040 con 0x557150d45940 2024-05-09T09:49:30.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.726+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597c0d9070 con 0x557150d45940 2024-05-09T09:49:30.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.726+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f597c0e8040 con 0x557150d3c600 2024-05-09T09:49:30.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.726+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.726+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f597c0e8040 con 0x557150d3c600 2024-05-09T09:49:30.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.726+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.730 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.726+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f597c0e8040 con 0x557150d40ff0 2024-05-09T09:49:30.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.726+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597806e030 con 0x557150d40ff0 2024-05-09T09:49:30.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.726+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f597c0e8040 con 0x557150d45940 2024-05-09T09:49:30.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.730+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597c0d9070 con 0x557150d45940 2024-05-09T09:49:30.731 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.730+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f597c0e8040 con 0x7f597c0ce040 2024-05-09T09:49:30.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.730+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f598000a4d0 con 0x7f597c0ce040 2024-05-09T09:49:30.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.730+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f597c0e8040 con 0x557150d3c600 2024-05-09T09:49:30.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.730+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.730+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f597c0e8040 con 0x557150d40ff0 2024-05-09T09:49:30.732 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.730+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f597806e030 con 0x557150d40ff0 2024-05-09T09:49:30.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.730+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f597c0e8040 con 0x557150d45940 2024-05-09T09:49:30.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.730+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597c0d9070 con 0x557150d45940 2024-05-09T09:49:30.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.730+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f597c0e8040 con 0x557150d40ff0 2024-05-09T09:49:30.733 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.730+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597806e030 con 0x557150d40ff0 2024-05-09T09:49:30.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.730+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f597c0e8040 con 0x7f597c0ce040 2024-05-09T09:49:30.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.730+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f598000a4d0 con 0x7f597c0ce040 2024-05-09T09:49:30.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.730+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f597c0e8040 con 0x557150d45940 2024-05-09T09:49:30.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.730+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597c0d9070 con 0x557150d45940 2024-05-09T09:49:30.734 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.730+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f597c0e8040 con 0x557150d40ff0 2024-05-09T09:49:30.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f597806e030 con 0x557150d40ff0 2024-05-09T09:49:30.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f597c0e8040 con 0x557150d3c600 2024-05-09T09:49:30.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f597c0e8040 con 0x7f597c0ce040 2024-05-09T09:49:30.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f598000a4d0 con 0x7f597c0ce040 2024-05-09T09:49:30.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:49:30.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:49:30.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:49:30.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:49:30.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:49:30.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:49:30.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557150d442b0 con 0x557150d3c600 2024-05-09T09:49:30.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:30.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557150d442b0 con 0x557150d3c600 2024-05-09T09:49:30.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:30.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557150d442b0 con 0x557150d45940 2024-05-09T09:49:30.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f597c0d9070 con 0x557150d45940 2024-05-09T09:49:30.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:49:30.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 20 zone default found 2024-05-09T09:49:30.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 4 Realm: () 2024-05-09T09:49:30.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:49:30.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:49:30.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:49:30.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 20 zonegroup default 2024-05-09T09:49:30.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557150d44be0 con 0x557150d40ff0 2024-05-09T09:49:30.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f597806e030 con 0x557150d40ff0 2024-05-09T09:49:30.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:30.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557150d4a2e0 con 0x557150d45940 2024-05-09T09:49:30.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f597c0d9070 con 0x557150d45940 2024-05-09T09:49:30.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:30.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557150d4a740 con 0x557150d45940 2024-05-09T09:49:30.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f597c0d9070 con 0x557150d45940 2024-05-09T09:49:30.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:30.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 20 started sync module instance, tier type = 2024-05-09T09:49:30.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:49:30.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.734+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d49720 con 0x7f597c0ce040 2024-05-09T09:49:30.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.738+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x7f597c0ce040 2024-05-09T09:49:30.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.738+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93945175776320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d49720 con 0x7f597c0ce040 2024-05-09T09:49:30.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.738+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d4b1c0 con 0x557150d3c600 2024-05-09T09:49:30.742 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.738+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93945175776320] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x7f597c0ce040 2024-05-09T09:49:30.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.738+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.738+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93945175780928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d49720 con 0x557150d3c600 2024-05-09T09:49:30.743 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.738+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d4bbd0 con 0x557150d45940 2024-05-09T09:49:30.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.742+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93945175780928] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.742+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f597c0d9070 con 0x557150d45940 2024-05-09T09:49:30.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.742+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93945175773808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d49690 con 0x557150d45940 2024-05-09T09:49:30.744 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.742+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d4c920 con 0x7f597c0ce040 2024-05-09T09:49:30.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.742+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x7f597c0ce040 2024-05-09T09:49:30.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.742+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93945175786608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d4c890 con 0x7f597c0ce040 2024-05-09T09:49:30.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.742+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d4d860 con 0x557150d3c600 2024-05-09T09:49:30.746 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.742+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93945175773808] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f597c0d9070 con 0x557150d45940 2024-05-09T09:49:30.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.746+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93945175786608] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x7f597c0ce040 2024-05-09T09:49:30.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.746+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.746+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93945175790384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d4d820 con 0x557150d3c600 2024-05-09T09:49:30.748 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.746+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d4dc50 con 0x557150d40ff0 2024-05-09T09:49:30.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.746+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93945175790384] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.746+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f597806e030 con 0x557150d40ff0 2024-05-09T09:49:30.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.746+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93945175788736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d4dff0 con 0x557150d40ff0 2024-05-09T09:49:30.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.746+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d4e8e0 con 0x557150d40ff0 2024-05-09T09:49:30.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.750+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93945175788736] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f597806e030 con 0x557150d40ff0 2024-05-09T09:49:30.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.750+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f597806e030 con 0x557150d40ff0 2024-05-09T09:49:30.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.750+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93945175794576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d4c0a0 con 0x557150d40ff0 2024-05-09T09:49:30.752 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.750+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d4f6a0 con 0x557150d40ff0 2024-05-09T09:49:30.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.750+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f597806e030 con 0x557150d40ff0 2024-05-09T09:49:30.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.750+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93945175798160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d4fb10 con 0x557150d40ff0 2024-05-09T09:49:30.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.750+0000 7f5989f69980 20 add_watcher() i=0 2024-05-09T09:49:30.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.750+0000 7f5989f69980 20 add_watcher() i=1 2024-05-09T09:49:30.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.750+0000 7f5989f69980 20 add_watcher() i=2 2024-05-09T09:49:30.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.750+0000 7f5989f69980 20 add_watcher() i=3 2024-05-09T09:49:30.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.750+0000 7f5989f69980 20 add_watcher() i=4 2024-05-09T09:49:30.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.750+0000 7f5989f69980 20 add_watcher() i=5 2024-05-09T09:49:30.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.754+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93945175794576] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f597806e030 con 0x557150d40ff0 2024-05-09T09:49:30.755 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.754+0000 7f5989f69980 20 add_watcher() i=6 2024-05-09T09:49:30.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.754+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93945175798160] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f597806e030 con 0x557150d40ff0 2024-05-09T09:49:30.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.754+0000 7f5989f69980 20 add_watcher() i=7 2024-05-09T09:49:30.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.754+0000 7f5989f69980 2 all 8 watchers are set, enabling cache 2024-05-09T09:49:30.756 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.754+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557150d4fb10 con 0x557150d3c600 2024-05-09T09:49:30.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.754+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.757 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.754+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93945175799392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d4fa80 con 0x557150d3c600 2024-05-09T09:49:30.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.754+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93945175799392] v32'475 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.754+0000 7f583cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:30.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.754+0000 7f5989f69980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:49:30.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.754+0000 7f5989f69980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:49:30.758 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.754+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5b4b0 con 0x557150d3c600 2024-05-09T09:49:30.760 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.758+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'108 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.761 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.758+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5bb00 con 0x557150d40ff0 2024-05-09T09:49:30.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.762+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'103 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f597806e030 con 0x557150d40ff0 2024-05-09T09:49:30.763 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.762+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5bb00 con 0x557150d45940 2024-05-09T09:49:30.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.762+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'102 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f597c0d9070 con 0x557150d45940 2024-05-09T09:49:30.764 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.762+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5c130 con 0x557150d3c600 2024-05-09T09:49:30.765 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.762+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'476 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.766 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.762+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5c5e0 con 0x7f597c0ce040 2024-05-09T09:49:30.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.766+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'293 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x7f597c0ce040 2024-05-09T09:49:30.767 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.766+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d59330 con 0x557150d45940 2024-05-09T09:49:30.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.766+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'196 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f597c0d9070 con 0x557150d45940 2024-05-09T09:49:30.768 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.766+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d59330 con 0x557150d3c600 2024-05-09T09:49:30.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.770+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'103 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.771 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.770+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5d430 con 0x557150d40ff0 2024-05-09T09:49:30.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.770+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'195 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f597806e030 con 0x557150d40ff0 2024-05-09T09:49:30.773 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.770+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5d430 con 0x7f597c0ce040 2024-05-09T09:49:30.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.774+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'101 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x7f597c0ce040 2024-05-09T09:49:30.775 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.774+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5d430 con 0x557150d45940 2024-05-09T09:49:30.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.774+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'107 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f597c0d9070 con 0x557150d45940 2024-05-09T09:49:30.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.774+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5d8e0 con 0x7f597c0ce040 2024-05-09T09:49:30.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.774+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'294 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x7f597c0ce040 2024-05-09T09:49:30.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.774+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5d8e0 con 0x557150d40ff0 2024-05-09T09:49:30.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.778+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'107 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f597806e030 con 0x557150d40ff0 2024-05-09T09:49:30.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.778+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5d8e0 con 0x7f597c0ce040 2024-05-09T09:49:30.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.778+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'101 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x7f597c0ce040 2024-05-09T09:49:30.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.782+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5d8e0 con 0x557150d40ff0 2024-05-09T09:49:30.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.782+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'201 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f597806e030 con 0x557150d40ff0 2024-05-09T09:49:30.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.782+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5d8e0 con 0x557150d3c600 2024-05-09T09:49:30.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.782+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'477 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.786+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5d8e0 con 0x557150d45940 2024-05-09T09:49:30.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.786+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'287 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f597c0d9070 con 0x557150d45940 2024-05-09T09:49:30.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.786+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5d8e0 con 0x7f597c0ce040 2024-05-09T09:49:30.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.786+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'295 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x7f597c0ce040 2024-05-09T09:49:30.790 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.786+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5d8e0 con 0x557150d45940 2024-05-09T09:49:30.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.790+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'101 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f597c0d9070 con 0x557150d45940 2024-05-09T09:49:30.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.790+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5d8e0 con 0x557150d3c600 2024-05-09T09:49:30.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.790+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'109 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.794 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.790+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5d8e0 con 0x557150d3c600 2024-05-09T09:49:30.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.794+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'478 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.794+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5d8e0 con 0x557150d45940 2024-05-09T09:49:30.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.794+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'288 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f597c0d9070 con 0x557150d45940 2024-05-09T09:49:30.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.794+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5d8e0 con 0x7f597c0ce040 2024-05-09T09:49:30.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.798+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'113 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x7f597c0ce040 2024-05-09T09:49:30.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.798+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5d8e0 con 0x557150d45940 2024-05-09T09:49:30.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.798+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'103 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f597c0d9070 con 0x557150d45940 2024-05-09T09:49:30.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.798+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5d8e0 con 0x557150d45940 2024-05-09T09:49:30.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.802+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'107 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f597c0d9070 con 0x557150d45940 2024-05-09T09:49:30.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.802+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5d8e0 con 0x557150d45940 2024-05-09T09:49:30.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.802+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'98 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f597c0d9070 con 0x557150d45940 2024-05-09T09:49:30.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.802+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5d8e0 con 0x557150d45940 2024-05-09T09:49:30.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.806+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'197 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f597c0d9070 con 0x557150d45940 2024-05-09T09:49:30.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.806+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5d8e0 con 0x557150d40ff0 2024-05-09T09:49:30.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.806+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'103 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f597806e030 con 0x557150d40ff0 2024-05-09T09:49:30.809 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.806+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5d8e0 con 0x557150d45940 2024-05-09T09:49:30.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.810+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'102 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f597c0d9070 con 0x557150d45940 2024-05-09T09:49:30.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.810+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5d8e0 con 0x557150d40ff0 2024-05-09T09:49:30.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.810+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'196 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f597806e030 con 0x557150d40ff0 2024-05-09T09:49:30.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.810+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5d8e0 con 0x557150d45940 2024-05-09T09:49:30.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.814+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'289 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f597c0d9070 con 0x557150d45940 2024-05-09T09:49:30.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.814+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5d8e0 con 0x557150d40ff0 2024-05-09T09:49:30.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.818+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'202 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f597806e030 con 0x557150d40ff0 2024-05-09T09:49:30.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.818+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d5d8e0 con 0x7f597c0ce040 2024-05-09T09:49:30.821 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.818+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'107 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x7f597c0ce040 2024-05-09T09:49:30.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.818+0000 7f57b77fe640 20 reqs_thread_entry: start 2024-05-09T09:49:30.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.818+0000 7f5989f69980 20 init_complete bucket index max shards: 11 2024-05-09T09:49:30.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.818+0000 7f5989f69980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-09T09:49:30.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.818+0000 7f57b57fa640 20 reqs_thread_entry: start 2024-05-09T09:49:30.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.818+0000 7f5989f69980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.822 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.818+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:94 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557150d58310 con 0x557150d40ff0 2024-05-09T09:49:30.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.822+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(94 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f597806e030 con 0x557150d40ff0 2024-05-09T09:49:30.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.822+0000 7f5989f69980 20 rados_obj.operate() r=0 bl.length=460 2024-05-09T09:49:30.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.822+0000 7f5989f69980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-09T09:49:30.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.822+0000 7f5989f69980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:30.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.822+0000 7f5989f69980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:49:30.824 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.822+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:95 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d7f5f0 con 0x557150d40ff0 2024-05-09T09:49:30.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.826+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(95 ada [delete,create,call,call,writefull 0~490] v32'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f597806e030 con 0x557150d40ff0 2024-05-09T09:49:30.827 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.826+0000 7f5989f69980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-09T09:49:30.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.826+0000 7f5989f69980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:30.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.826+0000 7f5989f69980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-09T09:49:30.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.826+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 7.d 7:b4812045:::notify.4:head [notify cookie 93945175994624 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557150d7af60 con 0x557150d3c600 2024-05-09T09:49:30.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.826+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== watch-notify(notify (1) cookie 93945175790384 notify 137438953512 ret 0) ==== 708+0+0 (crc 0 0 0) 0x557150d5d140 con 0x557150d3c600 2024-05-09T09:49:30.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.826+0000 7f5865ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953512 cookie 93945175790384 notifier 4908 bl.length()=666 2024-05-09T09:49:30.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.826+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(96 notify.4 [notify cookie 93945175994624 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.826+0000 7f5865ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-09T09:49:30.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.826+0000 7f5865ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:30.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.826+0000 7f5865ffb640 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f584c0056c0 con 0x557150d3c600 2024-05-09T09:49:30.828 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.826+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(97 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.826+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== watch-notify(notify_complete (2) cookie 93945175994624 notify 137438953512 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557150d5b010 con 0x557150d3c600 2024-05-09T09:49:30.829 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-09T09:49:28.233198Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:49:28.233178Z","tags":[],"group_ids":[]} 2024-05-09T09:49:30.829 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.826+0000 7f583cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:30.830 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.826+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93945175799392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d7e480 con 0x557150d3c600 2024-05-09T09:49:30.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.830+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(98 data_loggenerations_metadata [watch unwatch cookie 93945175799392] v32'479 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.830+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93945175776320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d4f660 con 0x7f597c0ce040 2024-05-09T09:49:30.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.830+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(99 notify.0 [watch unwatch cookie 93945175776320] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x7f597c0ce040 2024-05-09T09:49:30.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.830+0000 7f5989f69980 20 remove_watcher() i=0 2024-05-09T09:49:30.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.830+0000 7f5989f69980 2 removed watcher, disabling cache 2024-05-09T09:49:30.832 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.830+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93945175780928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d4f660 con 0x557150d3c600 2024-05-09T09:49:30.834 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.834+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(100 notify.1 [watch unwatch cookie 93945175780928] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.834+0000 7f5989f69980 20 remove_watcher() i=1 2024-05-09T09:49:30.835 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.834+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93945175773808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d4ae40 con 0x557150d45940 2024-05-09T09:49:30.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.834+0000 7f5987283640 1 -- 172.21.15.157:0/2503829270 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(101 notify.2 [watch unwatch cookie 93945175773808] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f597c0d9070 con 0x557150d45940 2024-05-09T09:49:30.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.834+0000 7f5989f69980 20 remove_watcher() i=2 2024-05-09T09:49:30.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.834+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:102 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93945175786608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d4f660 con 0x7f597c0ce040 2024-05-09T09:49:30.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.834+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(102 notify.3 [watch unwatch cookie 93945175786608] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x7f597c0ce040 2024-05-09T09:49:30.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.834+0000 7f5989f69980 20 remove_watcher() i=3 2024-05-09T09:49:30.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.834+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93945175790384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d49270 con 0x557150d3c600 2024-05-09T09:49:30.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.838+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(103 notify.4 [watch unwatch cookie 93945175790384] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f598000a4d0 con 0x557150d3c600 2024-05-09T09:49:30.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.838+0000 7f5989f69980 20 remove_watcher() i=4 2024-05-09T09:49:30.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.838+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93945175788736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d4f660 con 0x557150d40ff0 2024-05-09T09:49:30.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.842+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(104 notify.5 [watch unwatch cookie 93945175788736] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f597806e030 con 0x557150d40ff0 2024-05-09T09:49:30.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.842+0000 7f5989f69980 20 remove_watcher() i=5 2024-05-09T09:49:30.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.842+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:105 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93945175794576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d49270 con 0x557150d40ff0 2024-05-09T09:49:30.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.842+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(105 notify.6 [watch unwatch cookie 93945175794576] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f597806e030 con 0x557150d40ff0 2024-05-09T09:49:30.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.842+0000 7f5989f69980 20 remove_watcher() i=6 2024-05-09T09:49:30.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.842+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:106 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93945175798160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557150d4ccc0 con 0x557150d40ff0 2024-05-09T09:49:30.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5987a84640 1 -- 172.21.15.157:0/2503829270 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(106 notify.7 [watch unwatch cookie 93945175798160] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f597806e030 con 0x557150d40ff0 2024-05-09T09:49:30.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 20 remove_watcher() i=7 2024-05-09T09:49:30.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557150d40ff0 msgr2=0x557150d433e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 --2- 172.21.15.157:0/2503829270 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557150d40ff0 0x557150d433e0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.849 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557150d3c600 msgr2=0x557150d3eac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 --2- 172.21.15.157:0/2503829270 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557150d3c600 0x557150d3eac0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f597c0ce040 msgr2=0x7f597c0db410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 --2- 172.21.15.157:0/2503829270 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f597c0ce040 0x7f597c0db410 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557150d45940 msgr2=0x557150d47d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 --2- 172.21.15.157:0/2503829270 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557150d45940 0x557150d47d50 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5850034b60 msgr2=0x7f5850037020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 --2- 172.21.15.157:0/2503829270 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5850034b60 0x7f5850037020 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f597c01b2c0 tx=0x7f597c0a6000 comp rx=0 tx=0).stop 2024-05-09T09:49:30.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5988285640 1 -- 172.21.15.157:0/2503829270 reap_dead start 2024-05-09T09:49:30.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150d2f680 msgr2=0x557150d2faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 --2- 172.21.15.157:0/2503829270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150d2f680 0x557150d2faa0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f5978032e70 tx=0x7f5978042f30 comp rx=0 tx=0).stop 2024-05-09T09:49:30.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 shutdown_connections 2024-05-09T09:49:30.850 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 --2- 172.21.15.157:0/2503829270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150d2f680 0x557150d2faa0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 >> 172.21.15.157:0/2503829270 conn(0x557150d244d0 msgr2=0x557150d21b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:30.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 shutdown_connections 2024-05-09T09:49:30.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 -- 172.21.15.157:0/2503829270 wait complete. 2024-05-09T09:49:30.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 -- 172.21.15.157:0/425053088 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5860034c00 msgr2=0x7f58600370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 --2- 172.21.15.157:0/425053088 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5860034c00 0x7f58600370c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x557150cecef0 tx=0x7f597c005a10 comp rx=0 tx=0).stop 2024-05-09T09:49:30.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 -- 172.21.15.157:0/425053088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150d1b190 msgr2=0x557150d1b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 --2- 172.21.15.157:0/425053088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150d1b190 0x557150d1b5b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f597800efb0 tx=0x7f597800db30 comp rx=0 tx=0).stop 2024-05-09T09:49:30.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 -- 172.21.15.157:0/425053088 shutdown_connections 2024-05-09T09:49:30.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 --2- 172.21.15.157:0/425053088 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5860034c00 0x7f58600370c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 --2- 172.21.15.157:0/425053088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150d1b190 0x557150d1b5b0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 -- 172.21.15.157:0/425053088 >> 172.21.15.157:0/425053088 conn(0x557150d0ff60 msgr2=0x557150d10a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:30.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 -- 172.21.15.157:0/425053088 shutdown_connections 2024-05-09T09:49:30.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 -- 172.21.15.157:0/425053088 wait complete. 2024-05-09T09:49:30.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 -- 172.21.15.157:0/2830032329 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557150cee940 msgr2=0x557150cf0d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 --2- 172.21.15.157:0/2830032329 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x557150cee940 0x557150cf0d30 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 -- 172.21.15.157:0/2830032329 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557150bf7040 msgr2=0x557150cebfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 --2- 172.21.15.157:0/2830032329 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x557150bf7040 0x557150cebfa0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 -- 172.21.15.157:0/2830032329 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557150cf2860 msgr2=0x557150cf4c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 --2- 172.21.15.157:0/2830032329 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x557150cf2860 0x557150cf4c50 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 -- 172.21.15.157:0/2830032329 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5870034bb0 msgr2=0x7f5870037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 --2- 172.21.15.157:0/2830032329 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5870034bb0 0x7f5870037070 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f597c0ad000 tx=0x7f597c0a5040 comp rx=0 tx=0).stop 2024-05-09T09:49:30.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 -- 172.21.15.157:0/2830032329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150bf2b40 msgr2=0x557150ce5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 --2- 172.21.15.157:0/2830032329 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557150bf2b40 0x557150ce5020 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f5978001e20 tx=0x7f5978000ee0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5988285640 1 -- 172.21.15.157:0/2830032329 reap_dead start 2024-05-09T09:49:30.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 -- 172.21.15.157:0/2830032329 shutdown_connections 2024-05-09T09:49:30.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 -- 172.21.15.157:0/2830032329 >> 172.21.15.157:0/2830032329 conn(0x557150b66260 msgr2=0x557150cd8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:30.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 -- 172.21.15.157:0/2830032329 shutdown_connections 2024-05-09T09:49:30.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.846+0000 7f5989f69980 1 -- 172.21.15.157:0/2830032329 wait complete. 2024-05-09T09:49:30.862 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-09T09:49:28.233198Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:49:28.233178Z', 'tags': [], 'group_ids': []} 2024-05-09T09:49:30.862 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-09T09:49:28.233198Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:49:28.233178Z', 'tags': [], 'group_ids': []} 2024-05-09T09:49:30.862 ERROR:root:0 2024-05-09T09:49:30.862 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-09T09:49:30.867 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx0000094879af2537f457e-00663c9c2a-4238-default', 'HostId': '4238-default-default'} 2024-05-09T09:49:30.867 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-05-09T09:49:30.867 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-05-09T09:49:30.867 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-05-09T09:49:30.937 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:49:30.937 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:49:30.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.938+0000 7f0baa1a6980 1 Processor -- start 2024-05-09T09:49:30.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.938+0000 7f0baa1a6980 1 -- start start 2024-05-09T09:49:30.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.938+0000 7f0baa1a6980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55bdf6ad9b40 0x55bdf6ad9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.938+0000 7f0baa1a6980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bdf698d440 con 0x55bdf6ada460 2024-05-09T09:49:30.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.938+0000 7f0baa1a6980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55bdf69785f0 con 0x55bdf6ad9b40 2024-05-09T09:49:30.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.938+0000 7f0ba7cc1640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55bdf6ad9b40 0x55bdf6ad9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.938+0000 7f0ba7cc1640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55bdf6ad9b40 0x55bdf6ad9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39636/0 (socket says 172.21.15.157:39636) 2024-05-09T09:49:30.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.938+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/1848756861 learned_addr learned my addr 172.21.15.157:0/1848756861 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:30.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.938+0000 7f0ba74c0640 1 --1- 172.21.15.157:0/1848756861 >> v1:172.21.15.110:6789/0 conn(0x55bdf6ada460 0x55bdf6adae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:45646/0 (socket says 172.21.15.157:45646) 2024-05-09T09:49:30.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.938+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/1848756861 >> v1:172.21.15.110:6789/0 conn(0x55bdf6ada460 legacy=0x55bdf6adae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.940 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.938+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/1848756861 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdf6983990 con 0x55bdf6ad9b40 2024-05-09T09:49:30.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.938+0000 7f0ba7cc1640 1 --2- 172.21.15.157:0/1848756861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6ad9b40 0x55bdf6ad9f20 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f0ba000a5c0 tx=0x7f0ba001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9734889017139044 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.942+0000 7f0ba6cbf640 1 -- 172.21.15.157:0/1848756861 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ba00a6070 con 0x55bdf6ad9b40 2024-05-09T09:49:30.942 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.942+0000 7f0ba6cbf640 1 -- 172.21.15.157:0/1848756861 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba00af070 con 0x55bdf6ad9b40 2024-05-09T09:49:30.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.942+0000 7f0ba6cbf640 1 -- 172.21.15.157:0/1848756861 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ba00aa5c0 con 0x55bdf6ad9b40 2024-05-09T09:49:30.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.942+0000 7f0baa1a6980 1 -- 172.21.15.157:0/1848756861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6ad9b40 msgr2=0x55bdf6ad9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.942+0000 7f0baa1a6980 1 --2- 172.21.15.157:0/1848756861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6ad9b40 0x55bdf6ad9f20 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f0ba000a5c0 tx=0x7f0ba001b340 comp rx=0 tx=0).stop 2024-05-09T09:49:30.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.942+0000 7f0baa1a6980 1 -- 172.21.15.157:0/1848756861 shutdown_connections 2024-05-09T09:49:30.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.942+0000 7f0baa1a6980 1 --2- 172.21.15.157:0/1848756861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6ad9b40 0x55bdf6ad9f20 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.942+0000 7f0baa1a6980 1 -- 172.21.15.157:0/1848756861 >> 172.21.15.157:0/1848756861 conn(0x55bdf6a4d260 msgr2=0x55bdf6a4d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:30.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.942+0000 7f0baa1a6980 1 -- 172.21.15.157:0/1848756861 shutdown_connections 2024-05-09T09:49:30.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.942+0000 7f0baa1a6980 1 -- 172.21.15.157:0/1848756861 wait complete. 2024-05-09T09:49:30.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.958+0000 7f0baa1a6980 1 Processor -- start 2024-05-09T09:49:30.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.958+0000 7f0baa1a6980 1 -- start start 2024-05-09T09:49:30.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.958+0000 7f0baa1a6980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6ad9b40 0x55bdf6bc54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.958+0000 7f0baa1a6980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55bdf69dafe0 con 0x55bdf6ad9b40 2024-05-09T09:49:30.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.958+0000 7f0ba7cc1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6ad9b40 0x55bdf6bc54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.958+0000 7f0ba7cc1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6ad9b40 0x55bdf6bc54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39638/0 (socket says 172.21.15.157:39638) 2024-05-09T09:49:30.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.958+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/2324761284 learned_addr learned my addr 172.21.15.157:0/2324761284 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:30.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.958+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/2324761284 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdf695fae0 con 0x55bdf6ad9b40 2024-05-09T09:49:30.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.958+0000 7f0ba7cc1640 1 --2- 172.21.15.157:0/2324761284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6ad9b40 0x55bdf6bc54c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0018f70 tx=0x7f0ba0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be840d612507934c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.958+0000 7f0a95e0b640 1 -- 172.21.15.157:0/2324761284 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ba00aa9e0 con 0x55bdf6ad9b40 2024-05-09T09:49:30.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.958+0000 7f0a95e0b640 1 -- 172.21.15.157:0/2324761284 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba00aab80 con 0x55bdf6ad9b40 2024-05-09T09:49:30.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.958+0000 7f0a95e0b640 1 -- 172.21.15.157:0/2324761284 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ba00aae60 con 0x55bdf6ad9b40 2024-05-09T09:49:30.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.958+0000 7f0baa1a6980 1 -- 172.21.15.157:0/2324761284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6ad9b40 msgr2=0x55bdf6bc54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.958+0000 7f0baa1a6980 1 --2- 172.21.15.157:0/2324761284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6ad9b40 0x55bdf6bc54c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0018f70 tx=0x7f0ba0003030 comp rx=0 tx=0).stop 2024-05-09T09:49:30.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.958+0000 7f0baa1a6980 1 -- 172.21.15.157:0/2324761284 shutdown_connections 2024-05-09T09:49:30.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.958+0000 7f0baa1a6980 1 --2- 172.21.15.157:0/2324761284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6ad9b40 0x55bdf6bc54c0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.958+0000 7f0baa1a6980 1 -- 172.21.15.157:0/2324761284 >> 172.21.15.157:0/2324761284 conn(0x55bdf6a4d260 msgr2=0x55bdf6bc1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:30.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.958+0000 7f0baa1a6980 1 -- 172.21.15.157:0/2324761284 shutdown_connections 2024-05-09T09:49:30.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.958+0000 7f0baa1a6980 1 -- 172.21.15.157:0/2324761284 wait complete. 2024-05-09T09:49:30.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.958+0000 7f0baa1a6980 1 Processor -- start 2024-05-09T09:49:30.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.958+0000 7f0baa1a6980 1 -- start start 2024-05-09T09:49:30.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.962+0000 7f0baa1a6980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6ad9b40 0x55bdf6bcc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.962+0000 7f0baa1a6980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55bdf6ae3b80 con 0x55bdf6ad9b40 2024-05-09T09:49:30.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.962+0000 7f0ba7cc1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6ad9b40 0x55bdf6bcc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.962+0000 7f0ba7cc1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6ad9b40 0x55bdf6bcc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39652/0 (socket says 172.21.15.157:39652) 2024-05-09T09:49:30.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.962+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/3627699706 learned_addr learned my addr 172.21.15.157:0/3627699706 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:30.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.962+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/3627699706 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdf6bcca40 con 0x55bdf6ad9b40 2024-05-09T09:49:30.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.962+0000 7f0ba7cc1640 1 --2- 172.21.15.157:0/3627699706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6ad9b40 0x55bdf6bcc500 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0ba001b170 tx=0x7f0ba00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.962+0000 7f0a8ffff640 1 -- 172.21.15.157:0/3627699706 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ba00bd7c0 con 0x55bdf6ad9b40 2024-05-09T09:49:30.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.962+0000 7f0baa1a6980 1 -- 172.21.15.157:0/3627699706 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bdf6bcccd0 con 0x55bdf6ad9b40 2024-05-09T09:49:30.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.962+0000 7f0baa1a6980 1 -- 172.21.15.157:0/3627699706 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdf6bcf960 con 0x55bdf6ad9b40 2024-05-09T09:49:30.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.962+0000 7f0a8ffff640 1 -- 172.21.15.157:0/3627699706 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba00bd960 con 0x55bdf6ad9b40 2024-05-09T09:49:30.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.962+0000 7f0a8ffff640 1 -- 172.21.15.157:0/3627699706 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ba00bdc40 con 0x55bdf6ad9b40 2024-05-09T09:49:30.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.962+0000 7f0a8ffff640 1 -- 172.21.15.157:0/3627699706 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f0ba00ce030 con 0x55bdf6ad9b40 2024-05-09T09:49:30.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.962+0000 7f0a8ffff640 1 --2- 172.21.15.157:0/3627699706 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0a90034bb0 0x7f0a90037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.962+0000 7f0a8ffff640 1 -- 172.21.15.157:0/3627699706 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f0ba00cc020 con 0x55bdf6ad9b40 2024-05-09T09:49:30.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.962+0000 7f0ba74c0640 1 --2- 172.21.15.157:0/3627699706 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0a90034bb0 0x7f0a90037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.962+0000 7f0baa1a6980 1 --2- 172.21.15.157:0/3627699706 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55bdf6ada460 0x55bdf6bd34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.962+0000 7f0baa1a6980 1 -- 172.21.15.157:0/3627699706 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6bd3ab0 con 0x55bdf6ada460 2024-05-09T09:49:30.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.962+0000 7f0ba84c2640 1 --2- 172.21.15.157:0/3627699706 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55bdf6ada460 0x55bdf6bd34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.962+0000 7f0ba74c0640 1 --2- 172.21.15.157:0/3627699706 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0a90034bb0 0x7f0a90037070 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c0012f0 tx=0x7f0b9c006700 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.966+0000 7f0ba84c2640 1 --2- 172.21.15.157:0/3627699706 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55bdf6ada460 0x55bdf6bd34c0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.966+0000 7f0ba84c2640 1 -- 172.21.15.157:0/3627699706 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b980083f0 con 0x55bdf6ada460 2024-05-09T09:49:30.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.966+0000 7f0baa1a6980 1 -- 172.21.15.157:0/3627699706 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6bd0b80 con 0x55bdf6ada460 2024-05-09T09:49:30.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.966+0000 7f0ba84c2640 1 -- 172.21.15.157:0/3627699706 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0b980083f0 con 0x55bdf6ada460 2024-05-09T09:49:30.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.966+0000 7f0baa1a6980 1 --2- 172.21.15.157:0/3627699706 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55bdf6bd5e00 0x55bdf6bd81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.966+0000 7f0baa1a6980 1 -- 172.21.15.157:0/3627699706 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6bd88c0 con 0x55bdf6bd5e00 2024-05-09T09:49:30.968 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.966+0000 7f0ba7cc1640 1 --2- 172.21.15.157:0/3627699706 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55bdf6bd5e00 0x55bdf6bd81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.966+0000 7f0ba7cc1640 1 --2- 172.21.15.157:0/3627699706 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55bdf6bd5e00 0x55bdf6bd81f0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.966+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/3627699706 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0ba00c6d20 con 0x55bdf6bd5e00 2024-05-09T09:49:30.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.966+0000 7f0baa1a6980 1 -- 172.21.15.157:0/3627699706 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6bd4ca0 con 0x55bdf6ada460 2024-05-09T09:49:30.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.966+0000 7f0ba84c2640 1 -- 172.21.15.157:0/3627699706 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0b980083f0 con 0x55bdf6ada460 2024-05-09T09:49:30.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.966+0000 7f0baa1a6980 1 --2- 172.21.15.157:0/3627699706 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55bdf6bd9d00 0x55bdf6bdc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.966+0000 7f0baa1a6980 1 -- 172.21.15.157:0/3627699706 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6bdc880 con 0x55bdf6bd9d00 2024-05-09T09:49:30.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.966+0000 7f0ba74c0640 1 --2- 172.21.15.157:0/3627699706 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55bdf6bd9d00 0x55bdf6bdc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.966+0000 7f0ba74c0640 1 --2- 172.21.15.157:0/3627699706 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55bdf6bd9d00 0x55bdf6bdc0f0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.966+0000 7f0ba74c0640 1 -- 172.21.15.157:0/3627699706 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0b9c00f070 con 0x55bdf6bd9d00 2024-05-09T09:49:30.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.970+0000 7f0baa1a6980 1 Processor -- start 2024-05-09T09:49:30.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.970+0000 7f0baa1a6980 1 -- start start 2024-05-09T09:49:30.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.970+0000 7f0baa1a6980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6c02730 0x55bdf6c02b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.970+0000 7f0baa1a6980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55bdf69df020 con 0x55bdf6c02730 2024-05-09T09:49:30.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.974+0000 7f0ba7cc1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6c02730 0x55bdf6c02b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.974+0000 7f0ba7cc1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6c02730 0x55bdf6c02b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39654/0 (socket says 172.21.15.157:39654) 2024-05-09T09:49:30.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.974+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/1862509937 learned_addr learned my addr 172.21.15.157:0/1862509937 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:30.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.974+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/1862509937 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdf6c03090 con 0x55bdf6c02730 2024-05-09T09:49:30.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.974+0000 7f0ba7cc1640 1 --2- 172.21.15.157:0/1862509937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6c02730 0x55bdf6c02b50 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00e4020 tx=0x7f0ba00de3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.974+0000 7f0a87fff640 1 -- 172.21.15.157:0/1862509937 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ba00c57b0 con 0x55bdf6c02730 2024-05-09T09:49:30.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.974+0000 7f0a87fff640 1 -- 172.21.15.157:0/1862509937 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba00cf9d0 con 0x55bdf6c02730 2024-05-09T09:49:30.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.974+0000 7f0a87fff640 1 -- 172.21.15.157:0/1862509937 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ba00c5950 con 0x55bdf6c02730 2024-05-09T09:49:30.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.974+0000 7f0baa1a6980 1 -- 172.21.15.157:0/1862509937 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bdf6c03b20 con 0x55bdf6c02730 2024-05-09T09:49:30.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.974+0000 7f0baa1a6980 1 -- 172.21.15.157:0/1862509937 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdf6c04000 con 0x55bdf6c02730 2024-05-09T09:49:30.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.974+0000 7f0a87fff640 1 -- 172.21.15.157:0/1862509937 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f0ba00cfcb0 con 0x55bdf6c02730 2024-05-09T09:49:30.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.974+0000 7f0a87fff640 1 --2- 172.21.15.157:0/1862509937 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0a80034bb0 0x7f0a80037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.974+0000 7f0a87fff640 1 -- 172.21.15.157:0/1862509937 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f0ba00efda0 con 0x55bdf6c02730 2024-05-09T09:49:30.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.974+0000 7f0ba74c0640 1 --2- 172.21.15.157:0/1862509937 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0a80034bb0 0x7f0a80037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.978 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.974+0000 7f0baa1a6980 1 Processor -- start 2024-05-09T09:49:30.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.974+0000 7f0baa1a6980 1 -- start start 2024-05-09T09:49:30.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.974+0000 7f0baa1a6980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6c0f710 0x55bdf6c0faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.974+0000 7f0baa1a6980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55bdf6bc5b50 con 0x55bdf6c0f710 2024-05-09T09:49:30.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.974+0000 7f0ba74c0640 1 --2- 172.21.15.157:0/1862509937 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0a80034bb0 0x7f0a80037070 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c006300 tx=0x7f0b9c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.978+0000 7f0ba7cc1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6c0f710 0x55bdf6c0faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.978+0000 7f0ba7cc1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6c0f710 0x55bdf6c0faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39666/0 (socket says 172.21.15.157:39666) 2024-05-09T09:49:30.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.978+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/3135028763 learned_addr learned my addr 172.21.15.157:0/3135028763 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:30.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.978+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/3135028763 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdf6c100c0 con 0x55bdf6c0f710 2024-05-09T09:49:30.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.978+0000 7f0ba7cc1640 1 --2- 172.21.15.157:0/3135028763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6c0f710 0x55bdf6c0faf0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00cd550 tx=0x7f0ba00cd2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801b3d51f842bd01 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.978+0000 7f0a85ffb640 1 -- 172.21.15.157:0/3135028763 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ba00b38a0 con 0x55bdf6c0f710 2024-05-09T09:49:30.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.978+0000 7f0a85ffb640 1 -- 172.21.15.157:0/3135028763 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba00c6800 con 0x55bdf6c0f710 2024-05-09T09:49:30.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.978+0000 7f0a85ffb640 1 -- 172.21.15.157:0/3135028763 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ba00b3a40 con 0x55bdf6c0f710 2024-05-09T09:49:30.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.978+0000 7f0baa1a6980 1 -- 172.21.15.157:0/3135028763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6c0f710 msgr2=0x55bdf6c0faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:30.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.978+0000 7f0baa1a6980 1 --2- 172.21.15.157:0/3135028763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6c0f710 0x55bdf6c0faf0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00cd550 tx=0x7f0ba00cd2c0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.978+0000 7f0baa1a6980 1 -- 172.21.15.157:0/3135028763 shutdown_connections 2024-05-09T09:49:30.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.978+0000 7f0baa1a6980 1 --2- 172.21.15.157:0/3135028763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6c0f710 0x55bdf6c0faf0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:30.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.978+0000 7f0baa1a6980 1 -- 172.21.15.157:0/3135028763 >> 172.21.15.157:0/3135028763 conn(0x55bdf6c0ba90 msgr2=0x55bdf6c09af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:30.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.978+0000 7f0baa1a6980 1 -- 172.21.15.157:0/3135028763 shutdown_connections 2024-05-09T09:49:30.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.978+0000 7f0baa1a6980 1 -- 172.21.15.157:0/3135028763 wait complete. 2024-05-09T09:49:30.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.978+0000 7f0baa1a6980 1 Processor -- start 2024-05-09T09:49:30.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.978+0000 7f0baa1a6980 1 -- start start 2024-05-09T09:49:30.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.978+0000 7f0baa1a6980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6c0f710 0x55bdf6c16a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.978+0000 7f0baa1a6980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55bdf6c107d0 con 0x55bdf6c0f710 2024-05-09T09:49:30.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.978+0000 7f0ba7cc1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6c0f710 0x55bdf6c16a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.978+0000 7f0ba7cc1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6c0f710 0x55bdf6c16a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39674/0 (socket says 172.21.15.157:39674) 2024-05-09T09:49:30.983 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.978+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 learned_addr learned my addr 172.21.15.157:0/575684983 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:30.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.978+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdf6c16fa0 con 0x55bdf6c0f710 2024-05-09T09:49:30.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.978+0000 7f0ba7cc1640 1 --2- 172.21.15.157:0/575684983 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6c0f710 0x55bdf6c16a60 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00bff50 tx=0x7f0ba0002000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.978+0000 7f0a77fff640 1 -- 172.21.15.157:0/575684983 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ba010e070 con 0x55bdf6c0f710 2024-05-09T09:49:30.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.978+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bdf6c16fa0 con 0x55bdf6c0f710 2024-05-09T09:49:30.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.978+0000 7f0a77fff640 1 -- 172.21.15.157:0/575684983 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba00e5a40 con 0x55bdf6c0f710 2024-05-09T09:49:30.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.978+0000 7f0a77fff640 1 -- 172.21.15.157:0/575684983 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ba00de6a0 con 0x55bdf6c0f710 2024-05-09T09:49:30.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.978+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdf6c17420 con 0x55bdf6c0f710 2024-05-09T09:49:30.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.982+0000 7f0a77fff640 1 -- 172.21.15.157:0/575684983 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f0ba0111070 con 0x55bdf6c0f710 2024-05-09T09:49:30.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.982+0000 7f0a77fff640 1 --2- 172.21.15.157:0/575684983 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0a70034c00 0x7f0a700370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.982+0000 7f0a77fff640 1 -- 172.21.15.157:0/575684983 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f0ba00ff030 con 0x55bdf6c0f710 2024-05-09T09:49:30.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.982+0000 7f0baa1a6980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.982+0000 7f0ba74c0640 1 --2- 172.21.15.157:0/575684983 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0a70034c00 0x7f0a700370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.982+0000 7f0baa1a6980 1 --2- 172.21.15.157:0/575684983 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55bdf6c23440 0x55bdf6c25900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.982+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c26050 con 0x55bdf6c23440 2024-05-09T09:49:30.987 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.982+0000 7f0ba84c2640 1 --2- 172.21.15.157:0/575684983 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55bdf6c23440 0x55bdf6c25900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.982+0000 7f0ba74c0640 1 --2- 172.21.15.157:0/575684983 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0a70034c00 0x7f0a700370c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x55bdf6bdcc80 tx=0x7f0b9c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.982+0000 7f0ba84c2640 1 --2- 172.21.15.157:0/575684983 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55bdf6c23440 0x55bdf6c25900 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.982+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b980083f0 con 0x55bdf6c23440 2024-05-09T09:49:30.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.982+0000 7f0baa1a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:30.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.982+0000 7f0baa1a6980 20 realm 2024-05-09T09:49:30.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.982+0000 7f0baa1a6980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.982+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c26460 con 0x55bdf6c23440 2024-05-09T09:49:30.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.982+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b980083f0 con 0x55bdf6c23440 2024-05-09T09:49:30.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.982+0000 7f0baa1a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:30.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.982+0000 7f0baa1a6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:49:30.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.982+0000 7f0baa1a6980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.982+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c26d30 con 0x55bdf6c23440 2024-05-09T09:49:30.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.982+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b980083f0 con 0x55bdf6c23440 2024-05-09T09:49:30.988 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.982+0000 7f0baa1a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:30.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.982+0000 7f0baa1a6980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.982+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x55bdf6c23440 2024-05-09T09:49:30.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.982+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0b980083f0 con 0x55bdf6c23440 2024-05-09T09:49:30.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.982+0000 7f0baa1a6980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:30.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.982+0000 7f0baa1a6980 20 rados->read ofs=0 len=0 2024-05-09T09:49:30.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.982+0000 7f0baa1a6980 1 --2- 172.21.15.157:0/575684983 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55bdf6c27e30 0x55bdf6c2a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.982+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c2a830 con 0x55bdf6c27e30 2024-05-09T09:49:30.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.986+0000 7f0ba7cc1640 1 --2- 172.21.15.157:0/575684983 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55bdf6c27e30 0x55bdf6c2a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.986+0000 7f0ba7cc1640 1 --2- 172.21.15.157:0/575684983 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55bdf6c27e30 0x55bdf6c2a220 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.986+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0ba011a070 con 0x55bdf6c27e30 2024-05-09T09:49:30.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.986+0000 7f0baa1a6980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:49:30.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.986+0000 7f0baa1a6980 20 searching for the correct realm 2024-05-09T09:49:30.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.986+0000 7f0baa1a6980 1 --2- 172.21.15.157:0/575684983 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55bdf6c2c780 0x55bdf6c2eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.986+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c2f260 con 0x55bdf6c2c780 2024-05-09T09:49:30.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.986+0000 7f0ba74c0640 1 --2- 172.21.15.157:0/575684983 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55bdf6c2c780 0x55bdf6c2eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.986+0000 7f0ba74c0640 1 --2- 172.21.15.157:0/575684983 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55bdf6c2c780 0x55bdf6c2eb90 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.986+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b9c00f070 con 0x55bdf6c2c780 2024-05-09T09:49:30.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.986+0000 7f0ba74c0640 1 --2- 172.21.15.157:0/575684983 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f0b9c024070 0x7f0b9c031460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:30.992 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.986+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c2f260 con 0x7f0b9c024070 2024-05-09T09:49:30.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.986+0000 7f0ba84c2640 1 --2- 172.21.15.157:0/575684983 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f0b9c024070 0x7f0b9c031460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:30.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.986+0000 7f0ba84c2640 1 --2- 172.21.15.157:0/575684983 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f0b9c024070 0x7f0b9c031460 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:30.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.986+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b980083f0 con 0x7f0b9c024070 2024-05-09T09:49:30.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.986+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x55bdf6c27e30 2024-05-09T09:49:30.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.990+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ba011a070 con 0x55bdf6c27e30 2024-05-09T09:49:30.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.990+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x55bdf6c23440 2024-05-09T09:49:30.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.990+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b980083f0 con 0x55bdf6c23440 2024-05-09T09:49:30.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.990+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x55bdf6c23440 2024-05-09T09:49:30.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.990+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b98026040 con 0x55bdf6c23440 2024-05-09T09:49:30.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.990+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x55bdf6c27e30 2024-05-09T09:49:30.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.990+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ba011a070 con 0x55bdf6c27e30 2024-05-09T09:49:30.993 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.990+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x55bdf6c27e30 2024-05-09T09:49:30.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.990+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ba011a070 con 0x55bdf6c27e30 2024-05-09T09:49:30.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.990+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x7f0b9c024070 2024-05-09T09:49:30.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.990+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b98026040 con 0x7f0b9c024070 2024-05-09T09:49:30.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.990+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x55bdf6c2c780 2024-05-09T09:49:30.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.990+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b9c00f070 con 0x55bdf6c2c780 2024-05-09T09:49:30.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.990+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x55bdf6c23440 2024-05-09T09:49:30.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.990+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b98026040 con 0x55bdf6c23440 2024-05-09T09:49:30.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.990+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x55bdf6c27e30 2024-05-09T09:49:30.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.990+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ba011a070 con 0x55bdf6c27e30 2024-05-09T09:49:30.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.990+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x55bdf6c23440 2024-05-09T09:49:30.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.994+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b98026040 con 0x55bdf6c23440 2024-05-09T09:49:30.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.994+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x7f0b9c024070 2024-05-09T09:49:30.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.994+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0b98026040 con 0x7f0b9c024070 2024-05-09T09:49:30.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.994+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x55bdf6c2c780 2024-05-09T09:49:30.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.994+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b9c040040 con 0x55bdf6c2c780 2024-05-09T09:49:30.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.994+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x55bdf6c2c780 2024-05-09T09:49:30.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.994+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0b9c040040 con 0x55bdf6c2c780 2024-05-09T09:49:30.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.994+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x55bdf6c27e30 2024-05-09T09:49:30.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.994+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ba011a070 con 0x55bdf6c27e30 2024-05-09T09:49:30.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.994+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x55bdf6c2c780 2024-05-09T09:49:30.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.994+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b9c040040 con 0x55bdf6c2c780 2024-05-09T09:49:30.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.994+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x55bdf6c2c780 2024-05-09T09:49:31.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.994+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b9c040040 con 0x55bdf6c2c780 2024-05-09T09:49:31.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.994+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x55bdf6c23440 2024-05-09T09:49:31.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.994+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b98026040 con 0x55bdf6c23440 2024-05-09T09:49:31.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.994+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x55bdf6c23440 2024-05-09T09:49:31.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.994+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0b98026040 con 0x55bdf6c23440 2024-05-09T09:49:31.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.994+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x55bdf6c27e30 2024-05-09T09:49:31.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.994+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ba011a070 con 0x55bdf6c27e30 2024-05-09T09:49:31.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.994+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x55bdf6c2c780 2024-05-09T09:49:31.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.998+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b9c040040 con 0x55bdf6c2c780 2024-05-09T09:49:31.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.998+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x7f0b9c024070 2024-05-09T09:49:31.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.998+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b98026040 con 0x7f0b9c024070 2024-05-09T09:49:31.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.998+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x55bdf6c23440 2024-05-09T09:49:31.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.998+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b98026040 con 0x55bdf6c23440 2024-05-09T09:49:31.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.998+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x55bdf6c27e30 2024-05-09T09:49:31.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.998+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0ba011a070 con 0x55bdf6c27e30 2024-05-09T09:49:31.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.998+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x55bdf6c2c780 2024-05-09T09:49:31.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.998+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b9c040040 con 0x55bdf6c2c780 2024-05-09T09:49:31.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.998+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x55bdf6c27e30 2024-05-09T09:49:31.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.998+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ba011a070 con 0x55bdf6c27e30 2024-05-09T09:49:31.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.998+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x7f0b9c024070 2024-05-09T09:49:31.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.998+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b98026040 con 0x7f0b9c024070 2024-05-09T09:49:31.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.998+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x55bdf6c2c780 2024-05-09T09:49:31.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.998+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b9c040040 con 0x55bdf6c2c780 2024-05-09T09:49:31.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:30.998+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x55bdf6c27e30 2024-05-09T09:49:31.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ba011a070 con 0x55bdf6c27e30 2024-05-09T09:49:31.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x55bdf6c23440 2024-05-09T09:49:31.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0b98026040 con 0x55bdf6c23440 2024-05-09T09:49:31.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c270d0 con 0x7f0b9c024070 2024-05-09T09:49:31.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b98026040 con 0x7f0b9c024070 2024-05-09T09:49:31.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:49:31.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:49:31.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:49:31.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:49:31.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:49:31.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:49:31.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c2b0f0 con 0x55bdf6c23440 2024-05-09T09:49:31.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b98026040 con 0x55bdf6c23440 2024-05-09T09:49:31.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:31.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c2b0f0 con 0x55bdf6c23440 2024-05-09T09:49:31.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0b98026040 con 0x55bdf6c23440 2024-05-09T09:49:31.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:31.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c2b0f0 con 0x55bdf6c2c780 2024-05-09T09:49:31.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0b9c040040 con 0x55bdf6c2c780 2024-05-09T09:49:31.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:49:31.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 20 zone default found 2024-05-09T09:49:31.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 4 Realm: () 2024-05-09T09:49:31.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:49:31.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:49:31.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:49:31.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 20 zonegroup default 2024-05-09T09:49:31.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c2bb40 con 0x55bdf6c27e30 2024-05-09T09:49:31.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0ba011a070 con 0x55bdf6c27e30 2024-05-09T09:49:31.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:31.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c31570 con 0x55bdf6c2c780 2024-05-09T09:49:31.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0b9c040040 con 0x55bdf6c2c780 2024-05-09T09:49:31.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:31.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c31910 con 0x55bdf6c2c780 2024-05-09T09:49:31.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0b9c040040 con 0x55bdf6c2c780 2024-05-09T09:49:31.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:31.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 20 started sync module instance, tier type = 2024-05-09T09:49:31.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:49:31.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.002+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c309b0 con 0x7f0b9c024070 2024-05-09T09:49:31.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.006+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b98026040 con 0x7f0b9c024070 2024-05-09T09:49:31.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.006+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94274377158096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c309b0 con 0x7f0b9c024070 2024-05-09T09:49:31.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.006+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c32160 con 0x55bdf6c23440 2024-05-09T09:49:31.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.006+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94274377158096] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b98036040 con 0x7f0b9c024070 2024-05-09T09:49:31.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.006+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b98036040 con 0x55bdf6c23440 2024-05-09T09:49:31.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.006+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94274377162176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c309b0 con 0x55bdf6c23440 2024-05-09T09:49:31.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.006+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c32ba0 con 0x55bdf6c2c780 2024-05-09T09:49:31.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.010+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b9c040040 con 0x55bdf6c2c780 2024-05-09T09:49:31.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.010+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94274377162176] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b98036040 con 0x55bdf6c23440 2024-05-09T09:49:31.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.010+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94274377164528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c333f0 con 0x55bdf6c2c780 2024-05-09T09:49:31.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.010+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c30500 con 0x7f0b9c024070 2024-05-09T09:49:31.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.010+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b98036040 con 0x7f0b9c024070 2024-05-09T09:49:31.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.010+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94274377169152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c341d0 con 0x7f0b9c024070 2024-05-09T09:49:31.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.010+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c34b90 con 0x55bdf6c23440 2024-05-09T09:49:31.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.010+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94274377164528] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b9c040040 con 0x55bdf6c2c780 2024-05-09T09:49:31.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.014+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94274377169152] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b98036040 con 0x7f0b9c024070 2024-05-09T09:49:31.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.014+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b98036040 con 0x55bdf6c23440 2024-05-09T09:49:31.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.014+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94274377170208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c33050 con 0x55bdf6c23440 2024-05-09T09:49:31.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.014+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c35040 con 0x55bdf6c27e30 2024-05-09T09:49:31.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.014+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94274377170208] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b98036040 con 0x55bdf6c23440 2024-05-09T09:49:31.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.014+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ba011a070 con 0x55bdf6c27e30 2024-05-09T09:49:31.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.014+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94274377172704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c353e0 con 0x55bdf6c27e30 2024-05-09T09:49:31.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.014+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c35c30 con 0x55bdf6c27e30 2024-05-09T09:49:31.019 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.018+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ba011a070 con 0x55bdf6c27e30 2024-05-09T09:49:31.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.018+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94274377179088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c368a0 con 0x55bdf6c27e30 2024-05-09T09:49:31.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.018+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c37260 con 0x55bdf6c27e30 2024-05-09T09:49:31.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.018+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94274377172704] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ba011a070 con 0x55bdf6c27e30 2024-05-09T09:49:31.021 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.018+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94274377179088] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ba011a070 con 0x55bdf6c27e30 2024-05-09T09:49:31.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.018+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ba011a070 con 0x55bdf6c27e30 2024-05-09T09:49:31.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.018+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94274377173760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c36500 con 0x55bdf6c27e30 2024-05-09T09:49:31.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.018+0000 7f0baa1a6980 20 add_watcher() i=0 2024-05-09T09:49:31.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.018+0000 7f0baa1a6980 20 add_watcher() i=1 2024-05-09T09:49:31.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.018+0000 7f0baa1a6980 20 add_watcher() i=2 2024-05-09T09:49:31.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.018+0000 7f0baa1a6980 20 add_watcher() i=3 2024-05-09T09:49:31.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.018+0000 7f0baa1a6980 20 add_watcher() i=4 2024-05-09T09:49:31.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.018+0000 7f0baa1a6980 20 add_watcher() i=5 2024-05-09T09:49:31.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.018+0000 7f0baa1a6980 20 add_watcher() i=6 2024-05-09T09:49:31.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.022+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94274377173760] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ba011a070 con 0x55bdf6c27e30 2024-05-09T09:49:31.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.022+0000 7f0baa1a6980 20 add_watcher() i=7 2024-05-09T09:49:31.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.022+0000 7f0baa1a6980 2 all 8 watchers are set, enabling cache 2024-05-09T09:49:31.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.022+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c3a460 con 0x55bdf6c23440 2024-05-09T09:49:31.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.022+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0b98036040 con 0x55bdf6c23440 2024-05-09T09:49:31.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.022+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94274377182640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c37950 con 0x55bdf6c23440 2024-05-09T09:49:31.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.022+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94274377182640] v32'480 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0b98036040 con 0x55bdf6c23440 2024-05-09T09:49:31.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.022+0000 7f0a5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:31.025 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.022+0000 7f0baa1a6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:49:31.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.022+0000 7f0baa1a6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:49:31.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.022+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c42e00 con 0x55bdf6c23440 2024-05-09T09:49:31.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.026+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'109 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b98036040 con 0x55bdf6c23440 2024-05-09T09:49:31.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.026+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c43450 con 0x55bdf6c27e30 2024-05-09T09:49:31.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.026+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'104 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0ba011a070 con 0x55bdf6c27e30 2024-05-09T09:49:31.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.030+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c43450 con 0x55bdf6c2c780 2024-05-09T09:49:31.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.030+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'103 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b9c040040 con 0x55bdf6c2c780 2024-05-09T09:49:31.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.030+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c43f10 con 0x55bdf6c23440 2024-05-09T09:49:31.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.030+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'481 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b98036040 con 0x55bdf6c23440 2024-05-09T09:49:31.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.030+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c40d10 con 0x7f0b9c024070 2024-05-09T09:49:31.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.034+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'296 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b98036040 con 0x7f0b9c024070 2024-05-09T09:49:31.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.034+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c40d10 con 0x55bdf6c2c780 2024-05-09T09:49:31.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.034+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'198 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b9c040040 con 0x55bdf6c2c780 2024-05-09T09:49:31.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.034+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c44c40 con 0x55bdf6c23440 2024-05-09T09:49:31.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.034+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'104 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b98036040 con 0x55bdf6c23440 2024-05-09T09:49:31.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.038+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c44c40 con 0x55bdf6c27e30 2024-05-09T09:49:31.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.038+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'197 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0ba011a070 con 0x55bdf6c27e30 2024-05-09T09:49:31.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.038+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c44c40 con 0x7f0b9c024070 2024-05-09T09:49:31.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.042+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'102 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b98036040 con 0x7f0b9c024070 2024-05-09T09:49:31.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.042+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c44c40 con 0x55bdf6c2c780 2024-05-09T09:49:31.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.042+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'108 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0b9c040040 con 0x55bdf6c2c780 2024-05-09T09:49:31.045 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.042+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c44f20 con 0x7f0b9c024070 2024-05-09T09:49:31.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.046+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'297 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b98036040 con 0x7f0b9c024070 2024-05-09T09:49:31.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.046+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c44f20 con 0x55bdf6c27e30 2024-05-09T09:49:31.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.046+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'108 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ba011a070 con 0x55bdf6c27e30 2024-05-09T09:49:31.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.046+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c44f20 con 0x7f0b9c024070 2024-05-09T09:49:31.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.050+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'102 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b98036040 con 0x7f0b9c024070 2024-05-09T09:49:31.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.050+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c44f20 con 0x55bdf6c27e30 2024-05-09T09:49:31.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.050+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'203 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ba011a070 con 0x55bdf6c27e30 2024-05-09T09:49:31.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.050+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c44f20 con 0x55bdf6c23440 2024-05-09T09:49:31.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.054+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'482 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b98036040 con 0x55bdf6c23440 2024-05-09T09:49:31.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.054+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c44f20 con 0x55bdf6c2c780 2024-05-09T09:49:31.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.058+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'290 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b9c040040 con 0x55bdf6c2c780 2024-05-09T09:49:31.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.058+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c44f20 con 0x7f0b9c024070 2024-05-09T09:49:31.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.058+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'298 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b98036040 con 0x7f0b9c024070 2024-05-09T09:49:31.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.058+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c44f20 con 0x55bdf6c2c780 2024-05-09T09:49:31.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.062+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'102 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b9c040040 con 0x55bdf6c2c780 2024-05-09T09:49:31.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.062+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c44f20 con 0x55bdf6c23440 2024-05-09T09:49:31.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.062+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'110 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b98036040 con 0x55bdf6c23440 2024-05-09T09:49:31.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.062+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c44f20 con 0x55bdf6c23440 2024-05-09T09:49:31.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.066+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'483 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b98036040 con 0x55bdf6c23440 2024-05-09T09:49:31.067 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.066+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c44f20 con 0x55bdf6c2c780 2024-05-09T09:49:31.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.066+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'291 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b9c040040 con 0x55bdf6c2c780 2024-05-09T09:49:31.069 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.066+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c44f20 con 0x7f0b9c024070 2024-05-09T09:49:31.070 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.070+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'114 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b98036040 con 0x7f0b9c024070 2024-05-09T09:49:31.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.070+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c44f20 con 0x55bdf6c2c780 2024-05-09T09:49:31.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.070+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'104 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b9c040040 con 0x55bdf6c2c780 2024-05-09T09:49:31.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.070+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c44f20 con 0x55bdf6c2c780 2024-05-09T09:49:31.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.074+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'108 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b9c040040 con 0x55bdf6c2c780 2024-05-09T09:49:31.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.074+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c44f20 con 0x55bdf6c2c780 2024-05-09T09:49:31.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.074+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'99 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b9c040040 con 0x55bdf6c2c780 2024-05-09T09:49:31.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.074+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c44f20 con 0x55bdf6c2c780 2024-05-09T09:49:31.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.074+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'199 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b9c040040 con 0x55bdf6c2c780 2024-05-09T09:49:31.078 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.074+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c44f20 con 0x55bdf6c27e30 2024-05-09T09:49:31.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.078+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'104 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ba011a070 con 0x55bdf6c27e30 2024-05-09T09:49:31.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.078+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c44f20 con 0x55bdf6c2c780 2024-05-09T09:49:31.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.082+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'103 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b9c040040 con 0x55bdf6c2c780 2024-05-09T09:49:31.083 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.082+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c44f20 con 0x55bdf6c27e30 2024-05-09T09:49:31.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.086+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'198 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ba011a070 con 0x55bdf6c27e30 2024-05-09T09:49:31.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.086+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c44f20 con 0x55bdf6c2c780 2024-05-09T09:49:31.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.086+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'292 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b9c040040 con 0x55bdf6c2c780 2024-05-09T09:49:31.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.086+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c44f20 con 0x55bdf6c27e30 2024-05-09T09:49:31.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.090+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'204 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0ba011a070 con 0x55bdf6c27e30 2024-05-09T09:49:31.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.090+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c44f20 con 0x7f0b9c024070 2024-05-09T09:49:31.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.094+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'108 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0b98036040 con 0x7f0b9c024070 2024-05-09T09:49:31.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.094+0000 7f09d77fe640 20 reqs_thread_entry: start 2024-05-09T09:49:31.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.094+0000 7f0baa1a6980 20 init_complete bucket index max shards: 11 2024-05-09T09:49:31.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.094+0000 7f09d57fa640 20 reqs_thread_entry: start 2024-05-09T09:49:31.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.094+0000 7f0baa1a6980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-09T09:49:31.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.094+0000 7f0baa1a6980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.097 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.094+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:94 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c60ae0 con 0x55bdf6c27e30 2024-05-09T09:49:31.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.094+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(94 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f0ba011a070 con 0x55bdf6c27e30 2024-05-09T09:49:31.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.094+0000 7f0baa1a6980 20 rados_obj.operate() r=0 bl.length=490 2024-05-09T09:49:31.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.094+0000 7f0baa1a6980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-09T09:49:31.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.094+0000 7f0baa1a6980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:31.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.094+0000 7f0baa1a6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:49:31.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.094+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:95 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c67080 con 0x55bdf6c27e30 2024-05-09T09:49:31.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.098+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(95 ada [delete,create,call,call,writefull 0~460] v32'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0ba011a070 con 0x55bdf6c27e30 2024-05-09T09:49:31.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.098+0000 7f0baa1a6980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-09T09:49:31.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.098+0000 7f0baa1a6980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:31.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.098+0000 7f0baa1a6980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-09T09:49:31.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.098+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 7.d 7:b4812045:::notify.4:head [notify cookie 94274377378576 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c62b00 con 0x55bdf6c23440 2024-05-09T09:49:31.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.098+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== watch-notify(notify (1) cookie 94274377170208 notify 137438953513 ret 0) ==== 678+0+0 (crc 0 0 0) 0x55bdf6c40a30 con 0x55bdf6c23440 2024-05-09T09:49:31.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.098+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(96 notify.4 [notify cookie 94274377378576 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0b98036040 con 0x55bdf6c23440 2024-05-09T09:49:31.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.098+0000 7f0a85ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953513 cookie 94274377170208 notifier 4915 bl.length()=636 2024-05-09T09:49:31.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.098+0000 7f0a85ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-09T09:49:31.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.098+0000 7f0a85ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:31.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.098+0000 7f0a85ffb640 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0a6c0056c0 con 0x55bdf6c23440 2024-05-09T09:49:31.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.098+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(97 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b98036040 con 0x55bdf6c23440 2024-05-09T09:49:31.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.098+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== watch-notify(notify_complete (2) cookie 94274377378576 notify 137438953513 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bdf6c40690 con 0x55bdf6c23440 2024-05-09T09:49:31.103 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-09T09:49:28.233198Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:49:28.233178Z","tags":[],"group_ids":[]} 2024-05-09T09:49:31.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.102+0000 7f0a5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:31.103 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.102+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94274377182640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c3e810 con 0x55bdf6c23440 2024-05-09T09:49:31.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.102+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(98 data_loggenerations_metadata [watch unwatch cookie 94274377182640] v32'484 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0b98036040 con 0x55bdf6c23440 2024-05-09T09:49:31.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.102+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94274377158096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c36db0 con 0x7f0b9c024070 2024-05-09T09:49:31.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.102+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(99 notify.0 [watch unwatch cookie 94274377158096] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b98036040 con 0x7f0b9c024070 2024-05-09T09:49:31.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.102+0000 7f0baa1a6980 20 remove_watcher() i=0 2024-05-09T09:49:31.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.102+0000 7f0baa1a6980 2 removed watcher, disabling cache 2024-05-09T09:49:31.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.102+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94274377162176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c36db0 con 0x55bdf6c23440 2024-05-09T09:49:31.108 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.106+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(100 notify.1 [watch unwatch cookie 94274377162176] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b98036040 con 0x55bdf6c23440 2024-05-09T09:49:31.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.106+0000 7f0baa1a6980 20 remove_watcher() i=1 2024-05-09T09:49:31.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.106+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94274377164528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c36db0 con 0x55bdf6c2c780 2024-05-09T09:49:31.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.110+0000 7f0ba74c0640 1 -- 172.21.15.157:0/575684983 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(101 notify.2 [watch unwatch cookie 94274377164528] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b9c040040 con 0x55bdf6c2c780 2024-05-09T09:49:31.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.110+0000 7f0baa1a6980 20 remove_watcher() i=2 2024-05-09T09:49:31.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.110+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:102 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94274377169152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c36db0 con 0x7f0b9c024070 2024-05-09T09:49:31.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.110+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(102 notify.3 [watch unwatch cookie 94274377169152] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b98036040 con 0x7f0b9c024070 2024-05-09T09:49:31.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.110+0000 7f0baa1a6980 20 remove_watcher() i=3 2024-05-09T09:49:31.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.110+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94274377170208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c33900 con 0x55bdf6c23440 2024-05-09T09:49:31.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.114+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(103 notify.4 [watch unwatch cookie 94274377170208] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b98036040 con 0x55bdf6c23440 2024-05-09T09:49:31.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.114+0000 7f0baa1a6980 20 remove_watcher() i=4 2024-05-09T09:49:31.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.114+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94274377172704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c36db0 con 0x55bdf6c27e30 2024-05-09T09:49:31.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.114+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(104 notify.5 [watch unwatch cookie 94274377172704] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ba011a070 con 0x55bdf6c27e30 2024-05-09T09:49:31.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.114+0000 7f0baa1a6980 20 remove_watcher() i=5 2024-05-09T09:49:31.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.114+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:105 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94274377179088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c346e0 con 0x55bdf6c27e30 2024-05-09T09:49:31.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.118+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(105 notify.6 [watch unwatch cookie 94274377179088] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ba011a070 con 0x55bdf6c27e30 2024-05-09T09:49:31.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.118+0000 7f0baa1a6980 20 remove_watcher() i=6 2024-05-09T09:49:31.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.118+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:106 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94274377173760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bdf6c346e0 con 0x55bdf6c27e30 2024-05-09T09:49:31.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.118+0000 7f0ba7cc1640 1 -- 172.21.15.157:0/575684983 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(106 notify.7 [watch unwatch cookie 94274377173760] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ba011a070 con 0x55bdf6c27e30 2024-05-09T09:49:31.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.118+0000 7f0baa1a6980 20 remove_watcher() i=7 2024-05-09T09:49:31.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.118+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55bdf6c27e30 msgr2=0x55bdf6c2a220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.118+0000 7f0baa1a6980 1 --2- 172.21.15.157:0/575684983 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55bdf6c27e30 0x55bdf6c2a220 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.118+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55bdf6c23440 msgr2=0x55bdf6c25900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.118+0000 7f0baa1a6980 1 --2- 172.21.15.157:0/575684983 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55bdf6c23440 0x55bdf6c25900 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.118+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f0b9c024070 msgr2=0x7f0b9c031460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.118+0000 7f0baa1a6980 1 --2- 172.21.15.157:0/575684983 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f0b9c024070 0x7f0b9c031460 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.118+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55bdf6c2c780 msgr2=0x55bdf6c2eb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.118+0000 7f0baa1a6980 1 --2- 172.21.15.157:0/575684983 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55bdf6c2c780 0x55bdf6c2eb90 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.118+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0a70034c00 msgr2=0x7f0a700370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.118+0000 7f0baa1a6980 1 --2- 172.21.15.157:0/575684983 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0a70034c00 0x7f0a700370c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x55bdf6bdcc80 tx=0x7f0b9c010000 comp rx=0 tx=0).stop 2024-05-09T09:49:31.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.118+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6c0f710 msgr2=0x55bdf6c16a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.118+0000 7f0baa1a6980 1 --2- 172.21.15.157:0/575684983 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6c0f710 0x55bdf6c16a60 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00bff50 tx=0x7f0ba0002000 comp rx=0 tx=0).stop 2024-05-09T09:49:31.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.118+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 reap_dead start 2024-05-09T09:49:31.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.118+0000 7f0ba84c2640 1 -- 172.21.15.157:0/575684983 reap_dead start 2024-05-09T09:49:31.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.118+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 shutdown_connections 2024-05-09T09:49:31.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.118+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 >> 172.21.15.157:0/575684983 conn(0x55bdf6c0ba90 msgr2=0x55bdf6c090f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:31.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.118+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 shutdown_connections 2024-05-09T09:49:31.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.118+0000 7f0baa1a6980 1 -- 172.21.15.157:0/575684983 wait complete. 2024-05-09T09:49:31.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.122+0000 7f0baa1a6980 1 -- 172.21.15.157:0/1862509937 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0a80034bb0 msgr2=0x7f0a80037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.122+0000 7f0baa1a6980 1 --2- 172.21.15.157:0/1862509937 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0a80034bb0 0x7f0a80037070 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c006300 tx=0x7f0b9c00f000 comp rx=0 tx=0).stop 2024-05-09T09:49:31.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.122+0000 7f0baa1a6980 1 -- 172.21.15.157:0/1862509937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6c02730 msgr2=0x55bdf6c02b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.122+0000 7f0baa1a6980 1 --2- 172.21.15.157:0/1862509937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6c02730 0x55bdf6c02b50 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00e4020 tx=0x7f0ba00de3a0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.122+0000 7f0baa1a6980 1 -- 172.21.15.157:0/1862509937 shutdown_connections 2024-05-09T09:49:31.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.122+0000 7f0baa1a6980 1 --2- 172.21.15.157:0/1862509937 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0a80034bb0 0x7f0a80037070 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.122+0000 7f0baa1a6980 1 --2- 172.21.15.157:0/1862509937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6c02730 0x55bdf6c02b50 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.122+0000 7f0baa1a6980 1 -- 172.21.15.157:0/1862509937 >> 172.21.15.157:0/1862509937 conn(0x55bdf6bf7500 msgr2=0x55bdf6bf8010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:31.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.122+0000 7f0baa1a6980 1 -- 172.21.15.157:0/1862509937 shutdown_connections 2024-05-09T09:49:31.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.122+0000 7f0baa1a6980 1 -- 172.21.15.157:0/1862509937 wait complete. 2024-05-09T09:49:31.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.122+0000 7f0baa1a6980 1 -- 172.21.15.157:0/3627699706 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55bdf6bd5e00 msgr2=0x55bdf6bd81f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.122+0000 7f0baa1a6980 1 --2- 172.21.15.157:0/3627699706 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55bdf6bd5e00 0x55bdf6bd81f0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.122+0000 7f0baa1a6980 1 -- 172.21.15.157:0/3627699706 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55bdf6ada460 msgr2=0x55bdf6bd34c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.122+0000 7f0baa1a6980 1 --2- 172.21.15.157:0/3627699706 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55bdf6ada460 0x55bdf6bd34c0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.122+0000 7f0baa1a6980 1 -- 172.21.15.157:0/3627699706 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55bdf6bd9d00 msgr2=0x55bdf6bdc0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.122+0000 7f0baa1a6980 1 --2- 172.21.15.157:0/3627699706 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55bdf6bd9d00 0x55bdf6bdc0f0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.122+0000 7f0baa1a6980 1 -- 172.21.15.157:0/3627699706 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0a90034bb0 msgr2=0x7f0a90037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.122+0000 7f0baa1a6980 1 --2- 172.21.15.157:0/3627699706 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0a90034bb0 0x7f0a90037070 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c0012f0 tx=0x7f0b9c006700 comp rx=0 tx=0).stop 2024-05-09T09:49:31.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.122+0000 7f0baa1a6980 1 -- 172.21.15.157:0/3627699706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6ad9b40 msgr2=0x55bdf6bcc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.122+0000 7f0baa1a6980 1 --2- 172.21.15.157:0/3627699706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55bdf6ad9b40 0x55bdf6bcc500 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0ba001b170 tx=0x7f0ba00180e0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.122+0000 7f0ba84c2640 1 -- 172.21.15.157:0/3627699706 reap_dead start 2024-05-09T09:49:31.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.122+0000 7f0baa1a6980 1 -- 172.21.15.157:0/3627699706 shutdown_connections 2024-05-09T09:49:31.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.122+0000 7f0baa1a6980 1 -- 172.21.15.157:0/3627699706 >> 172.21.15.157:0/3627699706 conn(0x55bdf6a4d260 msgr2=0x55bdf6bbfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:31.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.122+0000 7f0baa1a6980 1 -- 172.21.15.157:0/3627699706 shutdown_connections 2024-05-09T09:49:31.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.122+0000 7f0baa1a6980 1 -- 172.21.15.157:0/3627699706 wait complete. 2024-05-09T09:49:31.137 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-09T09:49:28.233198Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:49:28.233178Z', 'tags': [], 'group_ids': []} 2024-05-09T09:49:31.137 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-09T09:49:28.233198Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:49:28.233178Z', 'tags': [], 'group_ids': []} 2024-05-09T09:49:31.137 ERROR:root:0 2024-05-09T09:49:31.137 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-09T09:49:31.137 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-09T09:49:31.137 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-05-09T09:49:31.215 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:49:31.216 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:49:31.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.214+0000 7f044b211980 1 Processor -- start 2024-05-09T09:49:31.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.214+0000 7f044b211980 1 -- start start 2024-05-09T09:49:31.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.214+0000 7f044b211980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x562268502d70 0x562268505160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.214+0000 7f044b211980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5622683b5440 con 0x5622684fe810 2024-05-09T09:49:31.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.214+0000 7f044b211980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5622683a05f0 con 0x562268502d70 2024-05-09T09:49:31.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.214+0000 7f044852b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x562268502d70 0x562268505160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.214+0000 7f044852b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x562268502d70 0x562268505160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39678/0 (socket says 172.21.15.157:39678) 2024-05-09T09:49:31.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.214+0000 7f0448d2c640 1 --1- 172.21.15.157:0/520633168 >> v1:172.21.15.110:6789/0 conn(0x5622684fe810 0x5622684febf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:45656/0 (socket says 172.21.15.157:45656) 2024-05-09T09:49:31.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.214+0000 7f044852b640 1 -- 172.21.15.157:0/520633168 learned_addr learned my addr 172.21.15.157:0/520633168 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:31.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.214+0000 7f044852b640 1 -- 172.21.15.157:0/520633168 >> v1:172.21.15.110:6789/0 conn(0x5622684fe810 legacy=0x5622684febf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.214+0000 7f044852b640 1 -- 172.21.15.157:0/520633168 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622683ab990 con 0x562268502d70 2024-05-09T09:49:31.220 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.218+0000 7f044852b640 1 --2- 172.21.15.157:0/520633168 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562268502d70 0x562268505160 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f043800a5c0 tx=0x7f043801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57cb11e64add3f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.218+0000 7f0447d2a640 1 -- 172.21.15.157:0/520633168 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04380a6070 con 0x562268502d70 2024-05-09T09:49:31.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.218+0000 7f0447d2a640 1 -- 172.21.15.157:0/520633168 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04380af070 con 0x562268502d70 2024-05-09T09:49:31.221 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.218+0000 7f0447d2a640 1 -- 172.21.15.157:0/520633168 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04380aa5c0 con 0x562268502d70 2024-05-09T09:49:31.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.218+0000 7f044b211980 1 -- 172.21.15.157:0/520633168 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562268502d70 msgr2=0x562268505160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.218+0000 7f044b211980 1 --2- 172.21.15.157:0/520633168 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562268502d70 0x562268505160 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f043800a5c0 tx=0x7f043801b340 comp rx=0 tx=0).stop 2024-05-09T09:49:31.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.218+0000 7f044b211980 1 -- 172.21.15.157:0/520633168 shutdown_connections 2024-05-09T09:49:31.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.218+0000 7f044b211980 1 --2- 172.21.15.157:0/520633168 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562268502d70 0x562268505160 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.218+0000 7f044b211980 1 -- 172.21.15.157:0/520633168 >> 172.21.15.157:0/520633168 conn(0x5622684fa0e0 msgr2=0x5622684fc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:31.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.218+0000 7f044b211980 1 -- 172.21.15.157:0/520633168 shutdown_connections 2024-05-09T09:49:31.222 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.218+0000 7f044b211980 1 -- 172.21.15.157:0/520633168 wait complete. 2024-05-09T09:49:31.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.234+0000 7f044b211980 1 Processor -- start 2024-05-09T09:49:31.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.234+0000 7f044b211980 1 -- start start 2024-05-09T09:49:31.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.234+0000 7f044b211980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5622684fe810 0x562268473190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.234+0000 7f044b211980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x562268402fe0 con 0x5622684fe810 2024-05-09T09:49:31.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.234+0000 7f0448d2c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5622684fe810 0x562268473190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.234+0000 7f0448d2c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5622684fe810 0x562268473190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39680/0 (socket says 172.21.15.157:39680) 2024-05-09T09:49:31.238 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.234+0000 7f0448d2c640 1 -- 172.21.15.157:0/254324192 learned_addr learned my addr 172.21.15.157:0/254324192 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:31.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.238+0000 7f0448d2c640 1 -- 172.21.15.157:0/254324192 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562268387ae0 con 0x5622684fe810 2024-05-09T09:49:31.239 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.238+0000 7f0448d2c640 1 --2- 172.21.15.157:0/254324192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5622684fe810 0x562268473190 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f0430001e50 tx=0x7f0430001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2129b523efb790 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.238+0000 7f0335e1b640 1 -- 172.21.15.157:0/254324192 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f043000e5d0 con 0x5622684fe810 2024-05-09T09:49:31.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.238+0000 7f0335e1b640 1 -- 172.21.15.157:0/254324192 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f043000e770 con 0x5622684fe810 2024-05-09T09:49:31.240 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.238+0000 7f0335e1b640 1 -- 172.21.15.157:0/254324192 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f043000eab0 con 0x5622684fe810 2024-05-09T09:49:31.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.238+0000 7f044b211980 1 -- 172.21.15.157:0/254324192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5622684fe810 msgr2=0x562268473190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.238+0000 7f044b211980 1 --2- 172.21.15.157:0/254324192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5622684fe810 0x562268473190 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f0430001e50 tx=0x7f0430001e80 comp rx=0 tx=0).stop 2024-05-09T09:49:31.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.238+0000 7f044b211980 1 -- 172.21.15.157:0/254324192 shutdown_connections 2024-05-09T09:49:31.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.238+0000 7f044b211980 1 --2- 172.21.15.157:0/254324192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5622684fe810 0x562268473190 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.238+0000 7f044b211980 1 -- 172.21.15.157:0/254324192 >> 172.21.15.157:0/254324192 conn(0x5622684fa0e0 msgr2=0x5622685e5660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:31.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.238+0000 7f044b211980 1 -- 172.21.15.157:0/254324192 shutdown_connections 2024-05-09T09:49:31.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.238+0000 7f044b211980 1 -- 172.21.15.157:0/254324192 wait complete. 2024-05-09T09:49:31.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.238+0000 7f044b211980 1 Processor -- start 2024-05-09T09:49:31.241 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.238+0000 7f044b211980 1 -- start start 2024-05-09T09:49:31.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.238+0000 7f044b211980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5622684fe810 0x5622685f1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.238+0000 7f044b211980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x562268508190 con 0x5622684fe810 2024-05-09T09:49:31.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.242+0000 7f0448d2c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5622684fe810 0x5622685f1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.242+0000 7f0448d2c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5622684fe810 0x5622685f1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39694/0 (socket says 172.21.15.157:39694) 2024-05-09T09:49:31.242 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.242+0000 7f0448d2c640 1 -- 172.21.15.157:0/3279080503 learned_addr learned my addr 172.21.15.157:0/3279080503 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:31.243 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.242+0000 7f0448d2c640 1 -- 172.21.15.157:0/3279080503 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622685f22a0 con 0x5622684fe810 2024-05-09T09:49:31.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.242+0000 7f0448d2c640 1 --2- 172.21.15.157:0/3279080503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5622684fe810 0x5622685f1d60 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x5622685eba80 tx=0x7f0430000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.242+0000 7f032ffff640 1 -- 172.21.15.157:0/3279080503 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0430001260 con 0x5622684fe810 2024-05-09T09:49:31.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.242+0000 7f044b211980 1 -- 172.21.15.157:0/3279080503 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5622685f2530 con 0x5622684fe810 2024-05-09T09:49:31.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.242+0000 7f032ffff640 1 -- 172.21.15.157:0/3279080503 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f043000fa40 con 0x5622684fe810 2024-05-09T09:49:31.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.242+0000 7f032ffff640 1 -- 172.21.15.157:0/3279080503 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f043002c060 con 0x5622684fe810 2024-05-09T09:49:31.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.242+0000 7f044b211980 1 -- 172.21.15.157:0/3279080503 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622685f5210 con 0x5622684fe810 2024-05-09T09:49:31.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.242+0000 7f032ffff640 1 -- 172.21.15.157:0/3279080503 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f0430017070 con 0x5622684fe810 2024-05-09T09:49:31.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.242+0000 7f032ffff640 1 --2- 172.21.15.157:0/3279080503 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0330034bb0 0x7f0330037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.242+0000 7f032ffff640 1 -- 172.21.15.157:0/3279080503 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f0430015020 con 0x5622684fe810 2024-05-09T09:49:31.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.242+0000 7f044852b640 1 --2- 172.21.15.157:0/3279080503 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0330034bb0 0x7f0330037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.242+0000 7f044b211980 1 --2- 172.21.15.157:0/3279080503 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x562268502d70 0x5622685f8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.242+0000 7f044b211980 1 -- 172.21.15.157:0/3279080503 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622685f93c0 con 0x562268502d70 2024-05-09T09:49:31.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.242+0000 7f044952d640 1 --2- 172.21.15.157:0/3279080503 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x562268502d70 0x5622685f8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.242+0000 7f044852b640 1 --2- 172.21.15.157:0/3279080503 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0330034bb0 0x7f0330037070 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f04380ae000 tx=0x7f04380a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.246 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.242+0000 7f044952d640 1 --2- 172.21.15.157:0/3279080503 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x562268502d70 0x5622685f8d50 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.242+0000 7f044952d640 1 -- 172.21.15.157:0/3279080503 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x562268502d70 2024-05-09T09:49:31.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.246+0000 7f044b211980 1 -- 172.21.15.157:0/3279080503 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622685f6410 con 0x562268502d70 2024-05-09T09:49:31.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.246+0000 7f044952d640 1 -- 172.21.15.157:0/3279080503 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f044000a4d0 con 0x562268502d70 2024-05-09T09:49:31.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.246+0000 7f044b211980 1 --2- 172.21.15.157:0/3279080503 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5622685fb6f0 0x5622685fdae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.247 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.246+0000 7f044b211980 1 -- 172.21.15.157:0/3279080503 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622685fe1b0 con 0x5622685fb6f0 2024-05-09T09:49:31.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.246+0000 7f0448d2c640 1 --2- 172.21.15.157:0/3279080503 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5622685fb6f0 0x5622685fdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.248 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.246+0000 7f0448d2c640 1 --2- 172.21.15.157:0/3279080503 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5622685fb6f0 0x5622685fdae0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.246+0000 7f0448d2c640 1 -- 172.21.15.157:0/3279080503 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f043002e070 con 0x5622685fb6f0 2024-05-09T09:49:31.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.246+0000 7f044b211980 1 -- 172.21.15.157:0/3279080503 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622685fa560 con 0x562268502d70 2024-05-09T09:49:31.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.246+0000 7f044952d640 1 -- 172.21.15.157:0/3279080503 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f044000a4d0 con 0x562268502d70 2024-05-09T09:49:31.249 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.246+0000 7f044b211980 1 --2- 172.21.15.157:0/3279080503 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5622685ff5f0 0x5622686019e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.246+0000 7f044b211980 1 -- 172.21.15.157:0/3279080503 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562268602150 con 0x5622685ff5f0 2024-05-09T09:49:31.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.246+0000 7f044852b640 1 --2- 172.21.15.157:0/3279080503 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5622685ff5f0 0x5622686019e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.246+0000 7f044852b640 1 --2- 172.21.15.157:0/3279080503 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5622685ff5f0 0x5622686019e0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.250 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.246+0000 7f044852b640 1 -- 172.21.15.157:0/3279080503 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f04380aaa60 con 0x5622685ff5f0 2024-05-09T09:49:31.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.250+0000 7f044b211980 1 Processor -- start 2024-05-09T09:49:31.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.250+0000 7f044b211980 1 -- start start 2024-05-09T09:49:31.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.250+0000 7f044b211980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5622685eb560 0x5622685e99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.254 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.250+0000 7f044b211980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x562268407020 con 0x5622685eb560 2024-05-09T09:49:31.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.254+0000 7f0448d2c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5622685eb560 0x5622685e99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.254+0000 7f0448d2c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5622685eb560 0x5622685e99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39710/0 (socket says 172.21.15.157:39710) 2024-05-09T09:49:31.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.254+0000 7f0448d2c640 1 -- 172.21.15.157:0/1516017483 learned_addr learned my addr 172.21.15.157:0/1516017483 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:31.255 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.254+0000 7f0448d2c640 1 -- 172.21.15.157:0/1516017483 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622685e9f30 con 0x5622685eb560 2024-05-09T09:49:31.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.254+0000 7f0448d2c640 1 --2- 172.21.15.157:0/1516017483 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5622685eb560 0x5622685e99f0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f0430049500 tx=0x7f043000a600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.254+0000 7f0327fff640 1 -- 172.21.15.157:0/1516017483 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f043001a5b0 con 0x5622685eb560 2024-05-09T09:49:31.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.254+0000 7f0327fff640 1 -- 172.21.15.157:0/1516017483 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f043001a750 con 0x5622685eb560 2024-05-09T09:49:31.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.254+0000 7f044b211980 1 -- 172.21.15.157:0/1516017483 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5622685ea1c0 con 0x5622685eb560 2024-05-09T09:49:31.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.254+0000 7f0327fff640 1 -- 172.21.15.157:0/1516017483 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0430042b60 con 0x5622685eb560 2024-05-09T09:49:31.256 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.254+0000 7f044b211980 1 -- 172.21.15.157:0/1516017483 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622685ea1c0 con 0x5622685eb560 2024-05-09T09:49:31.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.254+0000 7f0327fff640 1 -- 172.21.15.157:0/1516017483 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f0430044030 con 0x5622685eb560 2024-05-09T09:49:31.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.254+0000 7f0327fff640 1 --2- 172.21.15.157:0/1516017483 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0320034bb0 0x7f0320037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.254+0000 7f0327fff640 1 -- 172.21.15.157:0/1516017483 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f0430040d50 con 0x5622685eb560 2024-05-09T09:49:31.257 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.254+0000 7f044852b640 1 --2- 172.21.15.157:0/1516017483 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0320034bb0 0x7f0320037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.254+0000 7f044b211980 1 Processor -- start 2024-05-09T09:49:31.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.254+0000 7f044b211980 1 -- start start 2024-05-09T09:49:31.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.254+0000 7f044852b640 1 --2- 172.21.15.157:0/1516017483 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0320034bb0 0x7f0320037070 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f043801b380 tx=0x7f0438005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.254+0000 7f044b211980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562268637010 0x562268637430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.254+0000 7f044b211980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5622684738e0 con 0x562268637010 2024-05-09T09:49:31.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.258+0000 7f0448d2c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562268637010 0x562268637430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.258+0000 7f0448d2c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562268637010 0x562268637430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39724/0 (socket says 172.21.15.157:39724) 2024-05-09T09:49:31.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.258+0000 7f0448d2c640 1 -- 172.21.15.157:0/474434425 learned_addr learned my addr 172.21.15.157:0/474434425 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:31.259 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.258+0000 7f0448d2c640 1 -- 172.21.15.157:0/474434425 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562268637a00 con 0x562268637010 2024-05-09T09:49:31.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.258+0000 7f0448d2c640 1 --2- 172.21.15.157:0/474434425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562268637010 0x562268637430 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f043000f700 tx=0x7f0430032b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70345371b5d4eea5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.258+0000 7f0325ffb640 1 -- 172.21.15.157:0/474434425 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0430032460 con 0x562268637010 2024-05-09T09:49:31.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.258+0000 7f0325ffb640 1 -- 172.21.15.157:0/474434425 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f043000a7b0 con 0x562268637010 2024-05-09T09:49:31.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.258+0000 7f0325ffb640 1 -- 172.21.15.157:0/474434425 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f043002f350 con 0x562268637010 2024-05-09T09:49:31.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.258+0000 7f044b211980 1 -- 172.21.15.157:0/474434425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562268637010 msgr2=0x562268637430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.258+0000 7f044b211980 1 --2- 172.21.15.157:0/474434425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562268637010 0x562268637430 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f043000f700 tx=0x7f0430032b10 comp rx=0 tx=0).stop 2024-05-09T09:49:31.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.258+0000 7f044b211980 1 -- 172.21.15.157:0/474434425 shutdown_connections 2024-05-09T09:49:31.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.258+0000 7f044b211980 1 --2- 172.21.15.157:0/474434425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562268637010 0x562268637430 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.261 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.258+0000 7f044b211980 1 -- 172.21.15.157:0/474434425 >> 172.21.15.157:0/474434425 conn(0x562268633390 msgr2=0x5622686313f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:31.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.258+0000 7f044b211980 1 -- 172.21.15.157:0/474434425 shutdown_connections 2024-05-09T09:49:31.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.258+0000 7f044b211980 1 -- 172.21.15.157:0/474434425 wait complete. 2024-05-09T09:49:31.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.258+0000 7f044b211980 1 Processor -- start 2024-05-09T09:49:31.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.258+0000 7f044b211980 1 -- start start 2024-05-09T09:49:31.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.258+0000 7f044b211980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562268637010 0x56226863e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.262 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.258+0000 7f044b211980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5622686380d0 con 0x562268637010 2024-05-09T09:49:31.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.258+0000 7f0448d2c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562268637010 0x56226863e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.258+0000 7f0448d2c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562268637010 0x56226863e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39730/0 (socket says 172.21.15.157:39730) 2024-05-09T09:49:31.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.258+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 learned_addr learned my addr 172.21.15.157:0/3463480136 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:31.263 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.258+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56226863e8b0 con 0x562268637010 2024-05-09T09:49:31.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f0448d2c640 1 --2- 172.21.15.157:0/3463480136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562268637010 0x56226863e370 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f043000a960 tx=0x7f043004fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f0317fff640 1 -- 172.21.15.157:0/3463480136 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0430070070 con 0x562268637010 2024-05-09T09:49:31.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56226863e8b0 con 0x562268637010 2024-05-09T09:49:31.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f0317fff640 1 -- 172.21.15.157:0/3463480136 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f043004ee30 con 0x562268637010 2024-05-09T09:49:31.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f0317fff640 1 -- 172.21.15.157:0/3463480136 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f043002f350 con 0x562268637010 2024-05-09T09:49:31.264 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56226863e8b0 con 0x562268637010 2024-05-09T09:49:31.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f0317fff640 1 -- 172.21.15.157:0/3463480136 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f0430073070 con 0x562268637010 2024-05-09T09:49:31.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f0317fff640 1 --2- 172.21.15.157:0/3463480136 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0310034bb0 0x7f0310037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f0317fff640 1 -- 172.21.15.157:0/3463480136 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f0430068070 con 0x562268637010 2024-05-09T09:49:31.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f044852b640 1 --2- 172.21.15.157:0/3463480136 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0310034bb0 0x7f0310037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f044b211980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f044b211980 1 --2- 172.21.15.157:0/3463480136 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56226864add0 0x56226864d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56226864d9e0 con 0x56226864add0 2024-05-09T09:49:31.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f044952d640 1 --2- 172.21.15.157:0/3463480136 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56226864add0 0x56226864d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f044852b640 1 --2- 172.21.15.157:0/3463480136 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0310034bb0 0x7f0310037070 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f04380aafd0 tx=0x7f04380c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f044952d640 1 --2- 172.21.15.157:0/3463480136 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56226864add0 0x56226864d290 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f044b211980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:31.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f044b211980 20 realm 2024-05-09T09:49:31.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f044b211980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56226864ddf0 con 0x56226864add0 2024-05-09T09:49:31.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f044b211980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:31.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f044b211980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:49:31.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f044b211980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56226864e6c0 con 0x56226864add0 2024-05-09T09:49:31.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f044b211980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:31.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f044b211980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.262+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x56226864add0 2024-05-09T09:49:31.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.266+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.266+0000 7f044b211980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:31.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.266+0000 7f044b211980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.266+0000 7f044b211980 1 --2- 172.21.15.157:0/3463480136 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56226864f7c0 0x562268651bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.266+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562268652170 con 0x56226864f7c0 2024-05-09T09:49:31.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.266+0000 7f0448d2c640 1 --2- 172.21.15.157:0/3463480136 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56226864f7c0 0x562268651bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.266+0000 7f0448d2c640 1 --2- 172.21.15.157:0/3463480136 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56226864f7c0 0x562268651bb0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.266+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0430072030 con 0x56226864f7c0 2024-05-09T09:49:31.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.266+0000 7f044b211980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:49:31.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.266+0000 7f044b211980 20 searching for the correct realm 2024-05-09T09:49:31.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.266+0000 7f044b211980 1 --2- 172.21.15.157:0/3463480136 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5622686540c0 0x5622686564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.266+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562268656ba0 con 0x5622686540c0 2024-05-09T09:49:31.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.266+0000 7f044852b640 1 --2- 172.21.15.157:0/3463480136 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5622686540c0 0x5622686564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.266+0000 7f044852b640 1 --2- 172.21.15.157:0/3463480136 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5622686540c0 0x5622686564d0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.266+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04380aaa60 con 0x5622686540c0 2024-05-09T09:49:31.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.266+0000 7f044852b640 1 --2- 172.21.15.157:0/3463480136 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f04380e0040 0x7f04380e0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.266+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562268656ba0 con 0x7f04380e0040 2024-05-09T09:49:31.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.266+0000 7f044952d640 1 --2- 172.21.15.157:0/3463480136 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f04380e0040 0x7f04380e0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.266+0000 7f044952d640 1 --2- 172.21.15.157:0/3463480136 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f04380e0040 0x7f04380e0930 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.270+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f044000a4d0 con 0x7f04380e0040 2024-05-09T09:49:31.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.270+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x56226864f7c0 2024-05-09T09:49:31.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.270+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0430072030 con 0x56226864f7c0 2024-05-09T09:49:31.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.270+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x56226864add0 2024-05-09T09:49:31.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.270+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.270+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x56226864add0 2024-05-09T09:49:31.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.270+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.270+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x56226864f7c0 2024-05-09T09:49:31.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.270+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0430072030 con 0x56226864f7c0 2024-05-09T09:49:31.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.270+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x56226864f7c0 2024-05-09T09:49:31.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.270+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0430072030 con 0x56226864f7c0 2024-05-09T09:49:31.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.270+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x7f04380e0040 2024-05-09T09:49:31.275 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.270+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f044000a4d0 con 0x7f04380e0040 2024-05-09T09:49:31.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.270+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x5622686540c0 2024-05-09T09:49:31.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.270+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04380aaa60 con 0x5622686540c0 2024-05-09T09:49:31.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.270+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x56226864add0 2024-05-09T09:49:31.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.270+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.270+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x56226864f7c0 2024-05-09T09:49:31.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.274+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0430072030 con 0x56226864f7c0 2024-05-09T09:49:31.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.274+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x56226864add0 2024-05-09T09:49:31.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.274+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.274+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x7f04380e0040 2024-05-09T09:49:31.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.274+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f044000a4d0 con 0x7f04380e0040 2024-05-09T09:49:31.276 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.274+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x5622686540c0 2024-05-09T09:49:31.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.274+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04380aaa60 con 0x5622686540c0 2024-05-09T09:49:31.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.274+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x5622686540c0 2024-05-09T09:49:31.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.274+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f04380aaa60 con 0x5622686540c0 2024-05-09T09:49:31.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.274+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x56226864f7c0 2024-05-09T09:49:31.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.274+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0430072030 con 0x56226864f7c0 2024-05-09T09:49:31.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.274+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x5622686540c0 2024-05-09T09:49:31.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.274+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04380aaa60 con 0x5622686540c0 2024-05-09T09:49:31.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.274+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x5622686540c0 2024-05-09T09:49:31.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.274+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04380aaa60 con 0x5622686540c0 2024-05-09T09:49:31.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.274+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x56226864add0 2024-05-09T09:49:31.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.274+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.274+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x56226864add0 2024-05-09T09:49:31.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.274+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.274+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x56226864f7c0 2024-05-09T09:49:31.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.278+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0430072030 con 0x56226864f7c0 2024-05-09T09:49:31.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.278+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x5622686540c0 2024-05-09T09:49:31.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.278+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04380aaa60 con 0x5622686540c0 2024-05-09T09:49:31.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.278+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x7f04380e0040 2024-05-09T09:49:31.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.278+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f044000a4d0 con 0x7f04380e0040 2024-05-09T09:49:31.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.278+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x56226864add0 2024-05-09T09:49:31.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.278+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.278+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x56226864f7c0 2024-05-09T09:49:31.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.278+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0430072030 con 0x56226864f7c0 2024-05-09T09:49:31.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.278+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x5622686540c0 2024-05-09T09:49:31.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.278+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04380aaa60 con 0x5622686540c0 2024-05-09T09:49:31.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.278+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x56226864f7c0 2024-05-09T09:49:31.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.278+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0430072030 con 0x56226864f7c0 2024-05-09T09:49:31.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.278+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x7f04380e0040 2024-05-09T09:49:31.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.278+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f044000a4d0 con 0x7f04380e0040 2024-05-09T09:49:31.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.278+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x5622686540c0 2024-05-09T09:49:31.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.278+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04380aaa60 con 0x5622686540c0 2024-05-09T09:49:31.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.278+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x56226864f7c0 2024-05-09T09:49:31.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0430072030 con 0x56226864f7c0 2024-05-09T09:49:31.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x56226864add0 2024-05-09T09:49:31.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56226864ea60 con 0x7f04380e0040 2024-05-09T09:49:31.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f044000a4d0 con 0x7f04380e0040 2024-05-09T09:49:31.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:49:31.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:49:31.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:49:31.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:49:31.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:49:31.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:49:31.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.285 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562268652a30 con 0x56226864add0 2024-05-09T09:49:31.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:31.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562268652a30 con 0x56226864add0 2024-05-09T09:49:31.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:31.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562268652a30 con 0x5622686540c0 2024-05-09T09:49:31.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f04380aaa60 con 0x5622686540c0 2024-05-09T09:49:31.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:49:31.288 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 20 zone default found 2024-05-09T09:49:31.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 4 Realm: () 2024-05-09T09:49:31.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:49:31.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:49:31.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:49:31.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 20 zonegroup default 2024-05-09T09:49:31.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562268653430 con 0x56226864f7c0 2024-05-09T09:49:31.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0430072030 con 0x56226864f7c0 2024-05-09T09:49:31.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:31.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562268653000 con 0x5622686540c0 2024-05-09T09:49:31.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f04380aaa60 con 0x5622686540c0 2024-05-09T09:49:31.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:31.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562268658f80 con 0x5622686540c0 2024-05-09T09:49:31.289 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f04380aaa60 con 0x5622686540c0 2024-05-09T09:49:31.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:31.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 20 started sync module instance, tier type = 2024-05-09T09:49:31.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:49:31.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.282+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562268658340 con 0x7f04380e0040 2024-05-09T09:49:31.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.286+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x7f04380e0040 2024-05-09T09:49:31.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.286+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94705780361312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562268658340 con 0x7f04380e0040 2024-05-09T09:49:31.290 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.286+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562268659a20 con 0x56226864add0 2024-05-09T09:49:31.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.286+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94705780361312] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x7f04380e0040 2024-05-09T09:49:31.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.286+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.286+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94705780364592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562268658340 con 0x56226864add0 2024-05-09T09:49:31.291 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.286+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226865a430 con 0x5622686540c0 2024-05-09T09:49:31.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.290+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94705780364592] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.290+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04380aaa60 con 0x5622686540c0 2024-05-09T09:49:31.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.290+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94705780358800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622686582b0 con 0x5622686540c0 2024-05-09T09:49:31.292 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.290+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226865b1c0 con 0x7f04380e0040 2024-05-09T09:49:31.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.290+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x7f04380e0040 2024-05-09T09:49:31.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.290+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94705780370640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226865ba60 con 0x7f04380e0040 2024-05-09T09:49:31.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.290+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226865c420 con 0x56226864add0 2024-05-09T09:49:31.294 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.294+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94705780358800] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04380aaa60 con 0x5622686540c0 2024-05-09T09:49:31.295 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.294+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94705780370640] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x7f04380e0040 2024-05-09T09:49:31.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.294+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.294+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94705780372736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226865bf70 con 0x56226864add0 2024-05-09T09:49:31.296 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.294+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226865c7c0 con 0x56226864f7c0 2024-05-09T09:49:31.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.294+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94705780372736] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.298+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0430072030 con 0x56226864f7c0 2024-05-09T09:49:31.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.298+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94705780375408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226865c390 con 0x56226864f7c0 2024-05-09T09:49:31.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.298+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226865d510 con 0x56226864f7c0 2024-05-09T09:49:31.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.298+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0430072030 con 0x56226864f7c0 2024-05-09T09:49:31.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.298+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94705780380224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226865dcd0 con 0x56226864f7c0 2024-05-09T09:49:31.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.298+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226865e7f0 con 0x56226864f7c0 2024-05-09T09:49:31.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.298+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94705780375408] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0430072030 con 0x56226864f7c0 2024-05-09T09:49:31.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.302+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94705780380224] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0430072030 con 0x56226864f7c0 2024-05-09T09:49:31.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.302+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0430072030 con 0x56226864f7c0 2024-05-09T09:49:31.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.302+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94705780384448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226865cb60 con 0x56226864f7c0 2024-05-09T09:49:31.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.302+0000 7f044b211980 20 add_watcher() i=0 2024-05-09T09:49:31.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.302+0000 7f044b211980 20 add_watcher() i=1 2024-05-09T09:49:31.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.302+0000 7f044b211980 20 add_watcher() i=2 2024-05-09T09:49:31.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.302+0000 7f044b211980 20 add_watcher() i=3 2024-05-09T09:49:31.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.302+0000 7f044b211980 20 add_watcher() i=4 2024-05-09T09:49:31.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.302+0000 7f044b211980 20 add_watcher() i=5 2024-05-09T09:49:31.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.302+0000 7f044b211980 20 add_watcher() i=6 2024-05-09T09:49:31.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.302+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94705780384448] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0430072030 con 0x56226864f7c0 2024-05-09T09:49:31.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.302+0000 7f044b211980 20 add_watcher() i=7 2024-05-09T09:49:31.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.302+0000 7f044b211980 2 all 8 watchers are set, enabling cache 2024-05-09T09:49:31.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.302+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622686617e0 con 0x56226864add0 2024-05-09T09:49:31.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.302+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.302+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94705780381472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226865ec60 con 0x56226864add0 2024-05-09T09:49:31.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.306+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94705780381472] v32'485 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.306+0000 7f02fcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:31.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.306+0000 7f044b211980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:49:31.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.306+0000 7f044b211980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:49:31.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.306+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226866a050 con 0x56226864add0 2024-05-09T09:49:31.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.306+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'110 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.306+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226866a680 con 0x56226864f7c0 2024-05-09T09:49:31.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.310+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'105 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0430072030 con 0x56226864f7c0 2024-05-09T09:49:31.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.310+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226866a680 con 0x5622686540c0 2024-05-09T09:49:31.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.310+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'104 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f04380aaa60 con 0x5622686540c0 2024-05-09T09:49:31.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.310+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226866acb0 con 0x56226864add0 2024-05-09T09:49:31.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.310+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'486 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.310+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226866b220 con 0x7f04380e0040 2024-05-09T09:49:31.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.314+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'299 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x7f04380e0040 2024-05-09T09:49:31.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.314+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226866b6d0 con 0x5622686540c0 2024-05-09T09:49:31.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.314+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'200 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f04380aaa60 con 0x5622686540c0 2024-05-09T09:49:31.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.314+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562268667e40 con 0x56226864add0 2024-05-09T09:49:31.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.318+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'105 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.318+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562268667e40 con 0x56226864f7c0 2024-05-09T09:49:31.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.318+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'199 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0430072030 con 0x56226864f7c0 2024-05-09T09:49:31.321 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.318+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562268667e40 con 0x7f04380e0040 2024-05-09T09:49:31.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.322+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'103 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x7f04380e0040 2024-05-09T09:49:31.324 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.322+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562268667ef0 con 0x5622686540c0 2024-05-09T09:49:31.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.322+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'109 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f04380aaa60 con 0x5622686540c0 2024-05-09T09:49:31.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.322+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226866c230 con 0x7f04380e0040 2024-05-09T09:49:31.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.326+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'300 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x7f04380e0040 2024-05-09T09:49:31.327 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.326+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226866c230 con 0x56226864f7c0 2024-05-09T09:49:31.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.326+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'109 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0430072030 con 0x56226864f7c0 2024-05-09T09:49:31.330 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.326+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226866c230 con 0x7f04380e0040 2024-05-09T09:49:31.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.330+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'103 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x7f04380e0040 2024-05-09T09:49:31.331 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.330+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226866c230 con 0x56226864f7c0 2024-05-09T09:49:31.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.330+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'205 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0430072030 con 0x56226864f7c0 2024-05-09T09:49:31.334 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.330+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226866c230 con 0x56226864add0 2024-05-09T09:49:31.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.334+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'487 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.334+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226866c230 con 0x5622686540c0 2024-05-09T09:49:31.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.334+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'293 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f04380aaa60 con 0x5622686540c0 2024-05-09T09:49:31.338 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.334+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226866c400 con 0x7f04380e0040 2024-05-09T09:49:31.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.338+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'301 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x7f04380e0040 2024-05-09T09:49:31.339 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.338+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226866c400 con 0x5622686540c0 2024-05-09T09:49:31.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.338+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'103 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f04380aaa60 con 0x5622686540c0 2024-05-09T09:49:31.341 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.338+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226866c400 con 0x56226864add0 2024-05-09T09:49:31.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.342+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'111 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.343 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.342+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226866c400 con 0x56226864add0 2024-05-09T09:49:31.344 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.342+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'488 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.345 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.342+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226866c400 con 0x5622686540c0 2024-05-09T09:49:31.346 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.346+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'294 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f04380aaa60 con 0x5622686540c0 2024-05-09T09:49:31.347 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.346+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226866c800 con 0x7f04380e0040 2024-05-09T09:49:31.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.346+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'115 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x7f04380e0040 2024-05-09T09:49:31.348 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.346+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226866c800 con 0x5622686540c0 2024-05-09T09:49:31.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.346+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'105 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f04380aaa60 con 0x5622686540c0 2024-05-09T09:49:31.349 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.346+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226866c800 con 0x5622686540c0 2024-05-09T09:49:31.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.350+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'109 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f04380aaa60 con 0x5622686540c0 2024-05-09T09:49:31.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.350+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226866c800 con 0x5622686540c0 2024-05-09T09:49:31.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.350+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'100 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f04380aaa60 con 0x5622686540c0 2024-05-09T09:49:31.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.350+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226866c800 con 0x5622686540c0 2024-05-09T09:49:31.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.350+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'201 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f04380aaa60 con 0x5622686540c0 2024-05-09T09:49:31.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.350+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226866c800 con 0x56226864f7c0 2024-05-09T09:49:31.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.354+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'105 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0430072030 con 0x56226864f7c0 2024-05-09T09:49:31.356 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.354+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226866c800 con 0x5622686540c0 2024-05-09T09:49:31.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.354+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'104 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f04380aaa60 con 0x5622686540c0 2024-05-09T09:49:31.357 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.354+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226866c800 con 0x56226864f7c0 2024-05-09T09:49:31.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.358+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'200 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0430072030 con 0x56226864f7c0 2024-05-09T09:49:31.360 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.358+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226866c230 con 0x5622686540c0 2024-05-09T09:49:31.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.362+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'295 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f04380aaa60 con 0x5622686540c0 2024-05-09T09:49:31.363 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.362+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226866c230 con 0x56226864f7c0 2024-05-09T09:49:31.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.362+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'206 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0430072030 con 0x56226864f7c0 2024-05-09T09:49:31.366 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.362+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226866c230 con 0x7f04380e0040 2024-05-09T09:49:31.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.366+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'109 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x7f04380e0040 2024-05-09T09:49:31.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.366+0000 7f02777fe640 20 reqs_thread_entry: start 2024-05-09T09:49:31.369 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.366+0000 7f044b211980 20 init_complete bucket index max shards: 11 2024-05-09T09:49:31.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.366+0000 7f02757fa640 20 reqs_thread_entry: start 2024-05-09T09:49:31.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.366+0000 7f044b211980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-09T09:49:31.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.366+0000 7f044b211980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.370 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.366+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:94 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562268687fd0 con 0x56226864f7c0 2024-05-09T09:49:31.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.370+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(94 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f0430072030 con 0x56226864f7c0 2024-05-09T09:49:31.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.370+0000 7f044b211980 20 rados_obj.operate() r=0 bl.length=460 2024-05-09T09:49:31.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.370+0000 7f044b211980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-09T09:49:31.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.370+0000 7f044b211980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:31.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.370+0000 7f044b211980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:49:31.371 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.370+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:95 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226868e3b0 con 0x56226864f7c0 2024-05-09T09:49:31.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.370+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(95 ada [delete,create,call,call,writefull 0~473] v32'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0430072030 con 0x56226864f7c0 2024-05-09T09:49:31.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.370+0000 7f044b211980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-09T09:49:31.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.370+0000 7f044b211980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:31.374 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.370+0000 7f044b211980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-09T09:49:31.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.370+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 7.d 7:b4812045:::notify.4:head [notify cookie 94705780579872 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562268689a60 con 0x56226864add0 2024-05-09T09:49:31.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.370+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== watch-notify(notify (1) cookie 94705780372736 notify 137438953514 ret 0) ==== 691+0+0 (crc 0 0 0) 0x562268668470 con 0x56226864add0 2024-05-09T09:49:31.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.370+0000 7f0325ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953514 cookie 94705780372736 notifier 4922 bl.length()=649 2024-05-09T09:49:31.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.370+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(96 notify.4 [notify cookie 94705780579872 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.370+0000 7f0325ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-09T09:49:31.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.370+0000 7f0325ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:31.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.370+0000 7f0325ffb640 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f030c0056c0 con 0x56226864add0 2024-05-09T09:49:31.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.370+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(97 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.375 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.374+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== watch-notify(notify_complete (2) cookie 94705780579872 notify 137438953514 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56226866ae80 con 0x56226864add0 2024-05-09T09:49:31.375 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-09T09:49:28.233198Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:49:28.233178Z","tags":[],"group_ids":[]} 2024-05-09T09:49:31.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.374+0000 7f02fcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:31.376 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.374+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94705780381472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562268666050 con 0x56226864add0 2024-05-09T09:49:31.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.374+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(98 data_loggenerations_metadata [watch unwatch cookie 94705780381472] v32'489 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.377 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.374+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94705780361312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226865d720 con 0x7f04380e0040 2024-05-09T09:49:31.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.378+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(99 notify.0 [watch unwatch cookie 94705780361312] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x7f04380e0040 2024-05-09T09:49:31.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.378+0000 7f044b211980 20 remove_watcher() i=0 2024-05-09T09:49:31.378 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.378+0000 7f044b211980 2 removed watcher, disabling cache 2024-05-09T09:49:31.379 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.378+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94705780364592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562268658840 con 0x56226864add0 2024-05-09T09:49:31.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.378+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(100 notify.1 [watch unwatch cookie 94705780364592] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.378+0000 7f044b211980 20 remove_watcher() i=1 2024-05-09T09:49:31.381 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.378+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94705780358800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562268659530 con 0x5622686540c0 2024-05-09T09:49:31.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.382+0000 7f044852b640 1 -- 172.21.15.157:0/3463480136 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(101 notify.2 [watch unwatch cookie 94705780358800] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04380aaa60 con 0x5622686540c0 2024-05-09T09:49:31.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.382+0000 7f044b211980 20 remove_watcher() i=2 2024-05-09T09:49:31.383 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.382+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:102 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94705780370640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562268659530 con 0x7f04380e0040 2024-05-09T09:49:31.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.382+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(102 notify.3 [watch unwatch cookie 94705780370640] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x7f04380e0040 2024-05-09T09:49:31.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.382+0000 7f044b211980 20 remove_watcher() i=3 2024-05-09T09:49:31.385 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.382+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94705780372736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562268659530 con 0x56226864add0 2024-05-09T09:49:31.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.386+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(103 notify.4 [watch unwatch cookie 94705780372736] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f044000a4d0 con 0x56226864add0 2024-05-09T09:49:31.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.386+0000 7f044b211980 20 remove_watcher() i=4 2024-05-09T09:49:31.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.386+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94705780375408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226865b500 con 0x56226864f7c0 2024-05-09T09:49:31.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.386+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(104 notify.5 [watch unwatch cookie 94705780375408] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0430072030 con 0x56226864f7c0 2024-05-09T09:49:31.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.386+0000 7f044b211980 20 remove_watcher() i=5 2024-05-09T09:49:31.389 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.386+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:105 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94705780380224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562268659530 con 0x56226864f7c0 2024-05-09T09:49:31.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.390+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(105 notify.6 [watch unwatch cookie 94705780380224] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0430072030 con 0x56226864f7c0 2024-05-09T09:49:31.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.390+0000 7f044b211980 20 remove_watcher() i=6 2024-05-09T09:49:31.392 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.390+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:106 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94705780384448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56226865bf70 con 0x56226864f7c0 2024-05-09T09:49:31.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.390+0000 7f0448d2c640 1 -- 172.21.15.157:0/3463480136 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(106 notify.7 [watch unwatch cookie 94705780384448] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0430072030 con 0x56226864f7c0 2024-05-09T09:49:31.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.390+0000 7f044b211980 20 remove_watcher() i=7 2024-05-09T09:49:31.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.390+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56226864f7c0 msgr2=0x562268651bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.390+0000 7f044b211980 1 --2- 172.21.15.157:0/3463480136 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x56226864f7c0 0x562268651bb0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.390+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56226864add0 msgr2=0x56226864d290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.390+0000 7f044b211980 1 --2- 172.21.15.157:0/3463480136 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x56226864add0 0x56226864d290 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.390+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f04380e0040 msgr2=0x7f04380e0930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.390+0000 7f044b211980 1 --2- 172.21.15.157:0/3463480136 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f04380e0040 0x7f04380e0930 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.390+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5622686540c0 msgr2=0x5622686564d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.390+0000 7f044b211980 1 --2- 172.21.15.157:0/3463480136 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5622686540c0 0x5622686564d0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.390+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0310034bb0 msgr2=0x7f0310037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.397 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.390+0000 7f044b211980 1 --2- 172.21.15.157:0/3463480136 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0310034bb0 0x7f0310037070 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f04380aafd0 tx=0x7f04380c1040 comp rx=0 tx=0).stop 2024-05-09T09:49:31.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562268637010 msgr2=0x56226863e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044952d640 1 -- 172.21.15.157:0/3463480136 reap_dead start 2024-05-09T09:49:31.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 --2- 172.21.15.157:0/3463480136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562268637010 0x56226863e370 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f043000a960 tx=0x7f043004fed0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 shutdown_connections 2024-05-09T09:49:31.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 --2- 172.21.15.157:0/3463480136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562268637010 0x56226863e370 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 >> 172.21.15.157:0/3463480136 conn(0x562268633390 msgr2=0x5622686309f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:31.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 shutdown_connections 2024-05-09T09:49:31.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 -- 172.21.15.157:0/3463480136 wait complete. 2024-05-09T09:49:31.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 -- 172.21.15.157:0/1516017483 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0320034bb0 msgr2=0x7f0320037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 --2- 172.21.15.157:0/1516017483 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0320034bb0 0x7f0320037070 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f043801b380 tx=0x7f0438005ad0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 -- 172.21.15.157:0/1516017483 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5622685eb560 msgr2=0x5622685e99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 --2- 172.21.15.157:0/1516017483 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5622685eb560 0x5622685e99f0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f0430049500 tx=0x7f043000a600 comp rx=0 tx=0).stop 2024-05-09T09:49:31.398 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 -- 172.21.15.157:0/1516017483 shutdown_connections 2024-05-09T09:49:31.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 --2- 172.21.15.157:0/1516017483 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0320034bb0 0x7f0320037070 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 --2- 172.21.15.157:0/1516017483 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5622685eb560 0x5622685e99f0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 -- 172.21.15.157:0/1516017483 >> 172.21.15.157:0/1516017483 conn(0x56226861cda0 msgr2=0x56226861d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:31.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 -- 172.21.15.157:0/1516017483 shutdown_connections 2024-05-09T09:49:31.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 -- 172.21.15.157:0/1516017483 wait complete. 2024-05-09T09:49:31.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 -- 172.21.15.157:0/3279080503 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5622685fb6f0 msgr2=0x5622685fdae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 --2- 172.21.15.157:0/3279080503 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5622685fb6f0 0x5622685fdae0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 -- 172.21.15.157:0/3279080503 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x562268502d70 msgr2=0x5622685f8d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 --2- 172.21.15.157:0/3279080503 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x562268502d70 0x5622685f8d50 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 -- 172.21.15.157:0/3279080503 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5622685ff5f0 msgr2=0x5622686019e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 --2- 172.21.15.157:0/3279080503 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5622685ff5f0 0x5622686019e0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 -- 172.21.15.157:0/3279080503 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0330034bb0 msgr2=0x7f0330037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.399 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 --2- 172.21.15.157:0/3279080503 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0330034bb0 0x7f0330037070 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f04380ae000 tx=0x7f04380a6000 comp rx=0 tx=0).stop 2024-05-09T09:49:31.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 -- 172.21.15.157:0/3279080503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5622684fe810 msgr2=0x5622685f1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 --2- 172.21.15.157:0/3279080503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5622684fe810 0x5622685f1d60 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x5622685eba80 tx=0x7f0430000bd0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044952d640 1 -- 172.21.15.157:0/3279080503 reap_dead start 2024-05-09T09:49:31.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 -- 172.21.15.157:0/3279080503 shutdown_connections 2024-05-09T09:49:31.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 -- 172.21.15.157:0/3279080503 >> 172.21.15.157:0/3279080503 conn(0x5622684fa0e0 msgr2=0x5622685e4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:31.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 -- 172.21.15.157:0/3279080503 shutdown_connections 2024-05-09T09:49:31.400 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.394+0000 7f044b211980 1 -- 172.21.15.157:0/3279080503 wait complete. 2024-05-09T09:49:31.407 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-09T09:49:28.233198Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:49:28.233178Z', 'tags': [], 'group_ids': []} 2024-05-09T09:49:31.408 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-09T09:49:28.233198Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:49:28.233178Z', 'tags': [], 'group_ids': []} 2024-05-09T09:49:31.408 ERROR:root:0 2024-05-09T09:49:31.408 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-09T09:49:31.408 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-09T09:49:31.408 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-05-09T09:49:31.484 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:49:31.484 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:49:31.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.482+0000 7fc0864ad980 1 Processor -- start 2024-05-09T09:49:31.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.482+0000 7fc0864ad980 1 -- start start 2024-05-09T09:49:31.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.482+0000 7fc0864ad980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5635d4730040 0x5635d4732430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.482+0000 7fc0864ad980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5635d45df440 con 0x5635d472bb40 2024-05-09T09:49:31.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.482+0000 7fc0864ad980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x5635d45ca5f0 con 0x5635d4730040 2024-05-09T09:49:31.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.482+0000 7fc0837c7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x5635d4730040 0x5635d4732430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.482+0000 7fc083fc8640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x5635d472bb40 0x5635d472bf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:45668/0 (socket says 172.21.15.157:45668) 2024-05-09T09:49:31.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.482+0000 7fc083fc8640 1 -- 172.21.15.157:0/2864852884 learned_addr learned my addr 172.21.15.157:0/2864852884 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-05-09T09:49:31.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.486+0000 7fc0837c7640 1 -- 172.21.15.157:0/2864852884 >> v1:172.21.15.110:6789/0 conn(0x5635d472bb40 legacy=0x5635d472bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.487 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.486+0000 7fc0837c7640 1 -- 172.21.15.157:0/2864852884 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635d45d5990 con 0x5635d4730040 2024-05-09T09:49:31.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.486+0000 7fc0837c7640 1 --2- 172.21.15.157:0/2864852884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d4730040 0x5635d4732430 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fc06c00a480 tx=0x7fc06c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67edd3abbe11a4ec server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.486+0000 7fc082fc6640 1 -- 172.21.15.157:0/2864852884 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc06c0b0070 con 0x5635d4730040 2024-05-09T09:49:31.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.486+0000 7fc082fc6640 1 -- 172.21.15.157:0/2864852884 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc06c0ab540 con 0x5635d4730040 2024-05-09T09:49:31.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.486+0000 7fc082fc6640 1 -- 172.21.15.157:0/2864852884 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc06c0ab840 con 0x5635d4730040 2024-05-09T09:49:31.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.486+0000 7fc0864ad980 1 -- 172.21.15.157:0/2864852884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d4730040 msgr2=0x5635d4732430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.486+0000 7fc0864ad980 1 --2- 172.21.15.157:0/2864852884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d4730040 0x5635d4732430 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fc06c00a480 tx=0x7fc06c01b280 comp rx=0 tx=0).stop 2024-05-09T09:49:31.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.486+0000 7fc0864ad980 1 -- 172.21.15.157:0/2864852884 shutdown_connections 2024-05-09T09:49:31.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.486+0000 7fc0864ad980 1 --2- 172.21.15.157:0/2864852884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d4730040 0x5635d4732430 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.486+0000 7fc0864ad980 1 -- 172.21.15.157:0/2864852884 >> 172.21.15.157:0/2864852884 conn(0x5635d469f260 msgr2=0x5635d469f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:31.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.486+0000 7fc0864ad980 1 -- 172.21.15.157:0/2864852884 shutdown_connections 2024-05-09T09:49:31.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.486+0000 7fc0864ad980 1 -- 172.21.15.157:0/2864852884 wait complete. 2024-05-09T09:49:31.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.502+0000 7fc0864ad980 1 Processor -- start 2024-05-09T09:49:31.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.502+0000 7fc0864ad980 1 -- start start 2024-05-09T09:49:31.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.502+0000 7fc0864ad980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d472bb40 0x5635d4816da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.502+0000 7fc0864ad980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5635d462cfe0 con 0x5635d472bb40 2024-05-09T09:49:31.506 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.502+0000 7fc083fc8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d472bb40 0x5635d4816da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.502+0000 7fc083fc8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d472bb40 0x5635d4816da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39734/0 (socket says 172.21.15.157:39734) 2024-05-09T09:49:31.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.502+0000 7fc083fc8640 1 -- 172.21.15.157:0/2734376574 learned_addr learned my addr 172.21.15.157:0/2734376574 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:31.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.506+0000 7fc083fc8640 1 -- 172.21.15.157:0/2734376574 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635d45b1ae0 con 0x5635d472bb40 2024-05-09T09:49:31.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.506+0000 7fc083fc8640 1 --2- 172.21.15.157:0/2734376574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d472bb40 0x5635d4816da0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fc0740015f0 tx=0x7fc074001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3707682732710daa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.506+0000 7fbf71e0b640 1 -- 172.21.15.157:0/2734376574 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc074004530 con 0x5635d472bb40 2024-05-09T09:49:31.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.506+0000 7fbf71e0b640 1 -- 172.21.15.157:0/2734376574 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0740046f0 con 0x5635d472bb40 2024-05-09T09:49:31.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.506+0000 7fbf71e0b640 1 -- 172.21.15.157:0/2734376574 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc074004a90 con 0x5635d472bb40 2024-05-09T09:49:31.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.506+0000 7fc0864ad980 1 -- 172.21.15.157:0/2734376574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d472bb40 msgr2=0x5635d4816da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.506+0000 7fc0864ad980 1 --2- 172.21.15.157:0/2734376574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d472bb40 0x5635d4816da0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fc0740015f0 tx=0x7fc074001ab0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.506+0000 7fc0864ad980 1 -- 172.21.15.157:0/2734376574 shutdown_connections 2024-05-09T09:49:31.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.506+0000 7fc0864ad980 1 --2- 172.21.15.157:0/2734376574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d472bb40 0x5635d4816da0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.506+0000 7fc0864ad980 1 -- 172.21.15.157:0/2734376574 >> 172.21.15.157:0/2734376574 conn(0x5635d469f260 msgr2=0x5635d4812930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:31.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.506+0000 7fc0864ad980 1 -- 172.21.15.157:0/2734376574 shutdown_connections 2024-05-09T09:49:31.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.506+0000 7fc0864ad980 1 -- 172.21.15.157:0/2734376574 wait complete. 2024-05-09T09:49:31.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.506+0000 7fc0864ad980 1 Processor -- start 2024-05-09T09:49:31.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.506+0000 7fc0864ad980 1 -- start start 2024-05-09T09:49:31.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.506+0000 7fc0864ad980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d472bb40 0x5635d481dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.506+0000 7fc0864ad980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5635d4735460 con 0x5635d472bb40 2024-05-09T09:49:31.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.506+0000 7fc083fc8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d472bb40 0x5635d481dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.506+0000 7fc083fc8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d472bb40 0x5635d481dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39740/0 (socket says 172.21.15.157:39740) 2024-05-09T09:49:31.510 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.506+0000 7fc083fc8640 1 -- 172.21.15.157:0/380963240 learned_addr learned my addr 172.21.15.157:0/380963240 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:31.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.506+0000 7fc083fc8640 1 -- 172.21.15.157:0/380963240 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635d481e500 con 0x5635d472bb40 2024-05-09T09:49:31.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.506+0000 7fc083fc8640 1 --2- 172.21.15.157:0/380963240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d472bb40 0x5635d481dfc0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x5635d4817c30 tx=0x7fc074000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.510+0000 7fbf6bfff640 1 -- 172.21.15.157:0/380963240 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc074013760 con 0x5635d472bb40 2024-05-09T09:49:31.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.510+0000 7fc0864ad980 1 -- 172.21.15.157:0/380963240 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635d481e790 con 0x5635d472bb40 2024-05-09T09:49:31.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.510+0000 7fbf6bfff640 1 -- 172.21.15.157:0/380963240 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc074013900 con 0x5635d472bb40 2024-05-09T09:49:31.511 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.510+0000 7fbf6bfff640 1 -- 172.21.15.157:0/380963240 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc074013be0 con 0x5635d472bb40 2024-05-09T09:49:31.512 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.510+0000 7fc0864ad980 1 -- 172.21.15.157:0/380963240 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635d4821420 con 0x5635d472bb40 2024-05-09T09:49:31.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.510+0000 7fbf6bfff640 1 -- 172.21.15.157:0/380963240 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fc074010070 con 0x5635d472bb40 2024-05-09T09:49:31.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.510+0000 7fbf6bfff640 1 --2- 172.21.15.157:0/380963240 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbf6c034c00 0x7fbf6c0370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.510+0000 7fbf6bfff640 1 -- 172.21.15.157:0/380963240 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fc074018070 con 0x5635d472bb40 2024-05-09T09:49:31.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.510+0000 7fc0837c7640 1 --2- 172.21.15.157:0/380963240 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbf6c034c00 0x7fbf6c0370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.510+0000 7fc0864ad980 1 --2- 172.21.15.157:0/380963240 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5635d4730040 0x5635d4825070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.510+0000 7fc0864ad980 1 -- 172.21.15.157:0/380963240 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635d48255f0 con 0x5635d4730040 2024-05-09T09:49:31.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.510+0000 7fc0847c9640 1 --2- 172.21.15.157:0/380963240 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5635d4730040 0x5635d4825070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.510+0000 7fc0837c7640 1 --2- 172.21.15.157:0/380963240 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbf6c034c00 0x7fbf6c0370c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc06c0ad000 tx=0x7fc06c0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.510+0000 7fc0847c9640 1 --2- 172.21.15.157:0/380963240 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5635d4730040 0x5635d4825070 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.510+0000 7fc0847c9640 1 -- 172.21.15.157:0/380963240 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc07c0083f0 con 0x5635d4730040 2024-05-09T09:49:31.514 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.510+0000 7fc0864ad980 1 -- 172.21.15.157:0/380963240 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635d4822640 con 0x5635d4730040 2024-05-09T09:49:31.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.510+0000 7fc0847c9640 1 -- 172.21.15.157:0/380963240 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc07c0083f0 con 0x5635d4730040 2024-05-09T09:49:31.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.510+0000 7fc0864ad980 1 --2- 172.21.15.157:0/380963240 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5635d4827970 0x5635d4829d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.510+0000 7fc0864ad980 1 -- 172.21.15.157:0/380963240 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635d482a450 con 0x5635d4827970 2024-05-09T09:49:31.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.510+0000 7fc083fc8640 1 --2- 172.21.15.157:0/380963240 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5635d4827970 0x5635d4829d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.515 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.514+0000 7fc083fc8640 1 --2- 172.21.15.157:0/380963240 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5635d4827970 0x5635d4829d60 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.514+0000 7fc083fc8640 1 -- 172.21.15.157:0/380963240 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc07401b030 con 0x5635d4827970 2024-05-09T09:49:31.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.514+0000 7fc0864ad980 1 -- 172.21.15.157:0/380963240 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635d4826810 con 0x5635d4730040 2024-05-09T09:49:31.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.514+0000 7fc0847c9640 1 -- 172.21.15.157:0/380963240 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc07c0083f0 con 0x5635d4730040 2024-05-09T09:49:31.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.514+0000 7fc0864ad980 1 --2- 172.21.15.157:0/380963240 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5635d482b8b0 0x5635d482dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.514+0000 7fc0864ad980 1 -- 172.21.15.157:0/380963240 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635d482e3e0 con 0x5635d482b8b0 2024-05-09T09:49:31.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.514+0000 7fc0837c7640 1 --2- 172.21.15.157:0/380963240 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5635d482b8b0 0x5635d482dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.514+0000 7fc0837c7640 1 --2- 172.21.15.157:0/380963240 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5635d482b8b0 0x5635d482dca0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.517 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.514+0000 7fc0837c7640 1 -- 172.21.15.157:0/380963240 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc06c0b3040 con 0x5635d482b8b0 2024-05-09T09:49:31.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.518+0000 7fc0864ad980 1 Processor -- start 2024-05-09T09:49:31.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.518+0000 7fc0864ad980 1 -- start start 2024-05-09T09:49:31.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.518+0000 7fc0864ad980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d4854200 0x5635d4854620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.521 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.518+0000 7fc0864ad980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5635d4631020 con 0x5635d4854200 2024-05-09T09:49:31.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.518+0000 7fc083fc8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d4854200 0x5635d4854620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.518+0000 7fc083fc8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d4854200 0x5635d4854620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39752/0 (socket says 172.21.15.157:39752) 2024-05-09T09:49:31.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.518+0000 7fc083fc8640 1 -- 172.21.15.157:0/4041123107 learned_addr learned my addr 172.21.15.157:0/4041123107 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:31.522 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.518+0000 7fc083fc8640 1 -- 172.21.15.157:0/4041123107 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635d4854b60 con 0x5635d4854200 2024-05-09T09:49:31.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.518+0000 7fc083fc8640 1 --2- 172.21.15.157:0/4041123107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d4854200 0x5635d4854620 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fc074048be0 tx=0x7fc074010e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.522+0000 7fbf63fff640 1 -- 172.21.15.157:0/4041123107 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc074038070 con 0x5635d4854200 2024-05-09T09:49:31.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.522+0000 7fbf63fff640 1 -- 172.21.15.157:0/4041123107 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc074042e60 con 0x5635d4854200 2024-05-09T09:49:31.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.522+0000 7fbf63fff640 1 -- 172.21.15.157:0/4041123107 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc074012720 con 0x5635d4854200 2024-05-09T09:49:31.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.522+0000 7fc0864ad980 1 -- 172.21.15.157:0/4041123107 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635d48555f0 con 0x5635d4854200 2024-05-09T09:49:31.523 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.522+0000 7fc0864ad980 1 -- 172.21.15.157:0/4041123107 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635d4855ad0 con 0x5635d4854200 2024-05-09T09:49:31.524 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.522+0000 7fbf63fff640 1 -- 172.21.15.157:0/4041123107 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fc074042210 con 0x5635d4854200 2024-05-09T09:49:31.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.522+0000 7fbf63fff640 1 --2- 172.21.15.157:0/4041123107 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbf5c034bb0 0x7fbf5c037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.522+0000 7fbf63fff640 1 -- 172.21.15.157:0/4041123107 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fc07403c020 con 0x5635d4854200 2024-05-09T09:49:31.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.522+0000 7fc0837c7640 1 --2- 172.21.15.157:0/4041123107 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbf5c034bb0 0x7fbf5c037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.522+0000 7fc0864ad980 1 Processor -- start 2024-05-09T09:49:31.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.522+0000 7fc0864ad980 1 -- start start 2024-05-09T09:49:31.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.522+0000 7fc0864ad980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d48611e0 0x5635d4861600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.522+0000 7fc0864ad980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5635d48174f0 con 0x5635d48611e0 2024-05-09T09:49:31.525 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.522+0000 7fc0837c7640 1 --2- 172.21.15.157:0/4041123107 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbf5c034bb0 0x7fbf5c037070 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x5635d4825af0 tx=0x7fc06c005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.522+0000 7fc083fc8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d48611e0 0x5635d4861600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.522+0000 7fc083fc8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d48611e0 0x5635d4861600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39754/0 (socket says 172.21.15.157:39754) 2024-05-09T09:49:31.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.522+0000 7fc083fc8640 1 -- 172.21.15.157:0/439898244 learned_addr learned my addr 172.21.15.157:0/439898244 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:31.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.522+0000 7fc083fc8640 1 -- 172.21.15.157:0/439898244 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635d4861bd0 con 0x5635d48611e0 2024-05-09T09:49:31.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.522+0000 7fc083fc8640 1 --2- 172.21.15.157:0/439898244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d48611e0 0x5635d4861600 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fc074012f70 tx=0x7fc074034f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83124e404157b07d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.522+0000 7fbf61ffb640 1 -- 172.21.15.157:0/439898244 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc07404f070 con 0x5635d48611e0 2024-05-09T09:49:31.526 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.522+0000 7fbf61ffb640 1 -- 172.21.15.157:0/439898244 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc074014dd0 con 0x5635d48611e0 2024-05-09T09:49:31.527 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.522+0000 7fbf61ffb640 1 -- 172.21.15.157:0/439898244 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0740119f0 con 0x5635d48611e0 2024-05-09T09:49:31.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.526+0000 7fc0864ad980 1 -- 172.21.15.157:0/439898244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d48611e0 msgr2=0x5635d4861600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.526+0000 7fc0864ad980 1 --2- 172.21.15.157:0/439898244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d48611e0 0x5635d4861600 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fc074012f70 tx=0x7fc074034f20 comp rx=0 tx=0).stop 2024-05-09T09:49:31.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.526+0000 7fc0864ad980 1 -- 172.21.15.157:0/439898244 shutdown_connections 2024-05-09T09:49:31.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.526+0000 7fc0864ad980 1 --2- 172.21.15.157:0/439898244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d48611e0 0x5635d4861600 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.526+0000 7fc0864ad980 1 -- 172.21.15.157:0/439898244 >> 172.21.15.157:0/439898244 conn(0x5635d485d4c0 msgr2=0x5635d485b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:31.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.526+0000 7fc0864ad980 1 -- 172.21.15.157:0/439898244 shutdown_connections 2024-05-09T09:49:31.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.526+0000 7fc0864ad980 1 -- 172.21.15.157:0/439898244 wait complete. 2024-05-09T09:49:31.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.526+0000 7fc0864ad980 1 Processor -- start 2024-05-09T09:49:31.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.526+0000 7fc0864ad980 1 -- start start 2024-05-09T09:49:31.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.526+0000 7fc0864ad980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d48611e0 0x5635d48684f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.526+0000 7fc0864ad980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5635d4862240 con 0x5635d48611e0 2024-05-09T09:49:31.529 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.526+0000 7fc083fc8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d48611e0 0x5635d48684f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.526+0000 7fc083fc8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d48611e0 0x5635d48684f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:39760/0 (socket says 172.21.15.157:39760) 2024-05-09T09:49:31.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.526+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 learned_addr learned my addr 172.21.15.157:0/2151222258 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:49:31.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.526+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635d4868a30 con 0x5635d48611e0 2024-05-09T09:49:31.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.526+0000 7fc083fc8640 1 --2- 172.21.15.157:0/2151222258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d48611e0 0x5635d48684f0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fc074034f60 tx=0x7fc07405b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.526+0000 7fbf53fff640 1 -- 172.21.15.157:0/2151222258 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc07406d030 con 0x5635d48611e0 2024-05-09T09:49:31.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.526+0000 7fbf53fff640 1 -- 172.21.15.157:0/2151222258 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc074028a20 con 0x5635d48611e0 2024-05-09T09:49:31.530 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.526+0000 7fbf53fff640 1 -- 172.21.15.157:0/2151222258 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc074011de0 con 0x5635d48611e0 2024-05-09T09:49:31.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.526+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635d4868a30 con 0x5635d48611e0 2024-05-09T09:49:31.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.526+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635d4868a30 con 0x5635d48611e0 2024-05-09T09:49:31.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fc0864ad980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fbf53fff640 1 -- 172.21.15.157:0/2151222258 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fc074070070 con 0x5635d48611e0 2024-05-09T09:49:31.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fbf53fff640 1 --2- 172.21.15.157:0/2151222258 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbf4c034b60 0x7fbf4c037020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fbf53fff640 1 -- 172.21.15.157:0/2151222258 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fc07406e070 con 0x5635d48611e0 2024-05-09T09:49:31.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fc0837c7640 1 --2- 172.21.15.157:0/2151222258 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbf4c034b60 0x7fbf4c037020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fc0864ad980 1 --2- 172.21.15.157:0/2151222258 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5635d48750a0 0x5635d4877560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635d4877cb0 con 0x5635d48750a0 2024-05-09T09:49:31.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fc0847c9640 1 --2- 172.21.15.157:0/2151222258 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5635d48750a0 0x5635d4877560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fc0837c7640 1 --2- 172.21.15.157:0/2151222258 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbf4c034b60 0x7fbf4c037020 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc06c0abfd0 tx=0x7fc06c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.534 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fc0847c9640 1 --2- 172.21.15.157:0/2151222258 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5635d48750a0 0x5635d4877560 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc07c0083f0 con 0x5635d48750a0 2024-05-09T09:49:31.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fc0864ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:31.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fc0864ad980 20 realm 2024-05-09T09:49:31.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fc0864ad980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635d48780c0 con 0x5635d48750a0 2024-05-09T09:49:31.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc07c0083f0 con 0x5635d48750a0 2024-05-09T09:49:31.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fc0864ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:31.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fc0864ad980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:49:31.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fc0864ad980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635d4878960 con 0x5635d48750a0 2024-05-09T09:49:31.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc07c0083f0 con 0x5635d48750a0 2024-05-09T09:49:31.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fc0864ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:31.535 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fc0864ad980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635d4878d00 con 0x5635d48750a0 2024-05-09T09:49:31.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc07c0083f0 con 0x5635d48750a0 2024-05-09T09:49:31.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fc0864ad980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:31.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fc0864ad980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fc0864ad980 1 --2- 172.21.15.157:0/2151222258 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5635d4879a60 0x5635d487be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635d487c4a0 con 0x5635d4879a60 2024-05-09T09:49:31.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fc083fc8640 1 --2- 172.21.15.157:0/2151222258 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5635d4879a60 0x5635d487be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.530+0000 7fc083fc8640 1 --2- 172.21.15.157:0/2151222258 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5635d4879a60 0x5635d487be50 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.534+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc074051070 con 0x5635d4879a60 2024-05-09T09:49:31.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.534+0000 7fc0864ad980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:49:31.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.534+0000 7fc0864ad980 20 searching for the correct realm 2024-05-09T09:49:31.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.534+0000 7fc0864ad980 1 --2- 172.21.15.157:0/2151222258 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5635d487e380 0x5635d4880820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.534+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635d4880ea0 con 0x5635d487e380 2024-05-09T09:49:31.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.534+0000 7fc0837c7640 1 --2- 172.21.15.157:0/2151222258 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5635d487e380 0x5635d4880820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.534+0000 7fc0837c7640 1 --2- 172.21.15.157:0/2151222258 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5635d487e380 0x5635d4880820 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.534+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc06c0d9070 con 0x5635d487e380 2024-05-09T09:49:31.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.534+0000 7fc0837c7640 1 --2- 172.21.15.157:0/2151222258 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fc06c0ce040 0x7fc06c0db410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:49:31.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.534+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635d4880ea0 con 0x7fc06c0ce040 2024-05-09T09:49:31.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.534+0000 7fc0847c9640 1 --2- 172.21.15.157:0/2151222258 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fc06c0ce040 0x7fc06c0db410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:49:31.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.534+0000 7fc0847c9640 1 --2- 172.21.15.157:0/2151222258 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fc06c0ce040 0x7fc06c0db410 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:49:31.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.534+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc07c0083f0 con 0x7fc06c0ce040 2024-05-09T09:49:31.539 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.534+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635d4878d00 con 0x5635d4879a60 2024-05-09T09:49:31.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.534+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc074051070 con 0x5635d4879a60 2024-05-09T09:49:31.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.534+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635d4878d00 con 0x5635d48750a0 2024-05-09T09:49:31.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.534+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc07c0083f0 con 0x5635d48750a0 2024-05-09T09:49:31.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.534+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635d4878d00 con 0x5635d48750a0 2024-05-09T09:49:31.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.534+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc07c026040 con 0x5635d48750a0 2024-05-09T09:49:31.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.534+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635d4878d00 con 0x5635d4879a60 2024-05-09T09:49:31.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.538+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc074051070 con 0x5635d4879a60 2024-05-09T09:49:31.540 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.538+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635d4878d00 con 0x5635d4879a60 2024-05-09T09:49:31.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.538+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc074051070 con 0x5635d4879a60 2024-05-09T09:49:31.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.538+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635d4878d00 con 0x7fc06c0ce040 2024-05-09T09:49:31.542 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.538+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc07c026040 con 0x7fc06c0ce040 2024-05-09T09:49:31.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.538+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635d4878d00 con 0x5635d487e380 2024-05-09T09:49:31.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.538+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc06c0d9070 con 0x5635d487e380 2024-05-09T09:49:31.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.538+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635d4878d00 con 0x5635d48750a0 2024-05-09T09:49:31.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.538+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc07c026040 con 0x5635d48750a0 2024-05-09T09:49:31.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.538+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635d4878d00 con 0x5635d4879a60 2024-05-09T09:49:31.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.538+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc074051070 con 0x5635d4879a60 2024-05-09T09:49:31.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.538+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635d4878d00 con 0x5635d48750a0 2024-05-09T09:49:31.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.538+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc07c026040 con 0x5635d48750a0 2024-05-09T09:49:31.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.538+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635d4878d00 con 0x7fc06c0ce040 2024-05-09T09:49:31.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.538+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc07c026040 con 0x7fc06c0ce040 2024-05-09T09:49:31.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.538+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5635d4878d00 con 0x5635d487e380 2024-05-09T09:49:31.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.538+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc06c0d9070 con 0x5635d487e380 2024-05-09T09:49:31.543 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.538+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc06c0e8040 con 0x5635d487e380 2024-05-09T09:49:31.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.538+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc06c0d9070 con 0x5635d487e380 2024-05-09T09:49:31.544 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.538+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc06c0e8040 con 0x5635d4879a60 2024-05-09T09:49:31.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.542+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc074051070 con 0x5635d4879a60 2024-05-09T09:49:31.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.542+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc06c0e8040 con 0x5635d487e380 2024-05-09T09:49:31.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.542+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc06c0d9070 con 0x5635d487e380 2024-05-09T09:49:31.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.542+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc06c0e8040 con 0x5635d487e380 2024-05-09T09:49:31.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.542+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc06c0d9070 con 0x5635d487e380 2024-05-09T09:49:31.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.542+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc06c0e8040 con 0x5635d48750a0 2024-05-09T09:49:31.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.542+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc07c026040 con 0x5635d48750a0 2024-05-09T09:49:31.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.542+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc06c0e8040 con 0x5635d48750a0 2024-05-09T09:49:31.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.542+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc07c026040 con 0x5635d48750a0 2024-05-09T09:49:31.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.542+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc06c0e8040 con 0x5635d4879a60 2024-05-09T09:49:31.546 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.542+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc074051070 con 0x5635d4879a60 2024-05-09T09:49:31.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.542+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc06c0e8040 con 0x5635d487e380 2024-05-09T09:49:31.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.542+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc06c0d9070 con 0x5635d487e380 2024-05-09T09:49:31.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.542+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc06c0e8040 con 0x7fc06c0ce040 2024-05-09T09:49:31.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.542+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc07c026040 con 0x7fc06c0ce040 2024-05-09T09:49:31.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.542+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc06c0e8040 con 0x5635d48750a0 2024-05-09T09:49:31.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.542+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc07c026040 con 0x5635d48750a0 2024-05-09T09:49:31.547 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.542+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc06c0e8040 con 0x5635d4879a60 2024-05-09T09:49:31.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc074051070 con 0x5635d4879a60 2024-05-09T09:49:31.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc06c0e8040 con 0x5635d487e380 2024-05-09T09:49:31.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc06c0d9070 con 0x5635d487e380 2024-05-09T09:49:31.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc06c0e8040 con 0x5635d4879a60 2024-05-09T09:49:31.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc074051070 con 0x5635d4879a60 2024-05-09T09:49:31.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc06c0e8040 con 0x7fc06c0ce040 2024-05-09T09:49:31.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc07c026040 con 0x7fc06c0ce040 2024-05-09T09:49:31.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc06c0e8040 con 0x5635d487e380 2024-05-09T09:49:31.551 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc06c0d9070 con 0x5635d487e380 2024-05-09T09:49:31.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc06c0e8040 con 0x5635d4879a60 2024-05-09T09:49:31.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc074051070 con 0x5635d4879a60 2024-05-09T09:49:31.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc06c0e8040 con 0x5635d48750a0 2024-05-09T09:49:31.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc07c026040 con 0x5635d48750a0 2024-05-09T09:49:31.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc06c0e8040 con 0x7fc06c0ce040 2024-05-09T09:49:31.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc07c026040 con 0x7fc06c0ce040 2024-05-09T09:49:31.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc0864ad980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:49:31.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc0864ad980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:49:31.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc0864ad980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:49:31.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc0864ad980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:49:31.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc0864ad980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:49:31.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc0864ad980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:49:31.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc0864ad980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635d487ccf0 con 0x5635d48750a0 2024-05-09T09:49:31.552 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc07c026040 con 0x5635d48750a0 2024-05-09T09:49:31.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc0864ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:31.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc0864ad980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635d487ccf0 con 0x5635d48750a0 2024-05-09T09:49:31.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc07c026040 con 0x5635d48750a0 2024-05-09T09:49:31.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc0864ad980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:49:31.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc0864ad980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.546+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635d487ccf0 con 0x5635d487e380 2024-05-09T09:49:31.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.550+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc06c0d9070 con 0x5635d487e380 2024-05-09T09:49:31.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.550+0000 7fc0864ad980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:49:31.553 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.550+0000 7fc0864ad980 20 zone default found 2024-05-09T09:49:31.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.550+0000 7fc0864ad980 4 Realm: () 2024-05-09T09:49:31.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.550+0000 7fc0864ad980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:49:31.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.550+0000 7fc0864ad980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:49:31.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.550+0000 7fc0864ad980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:49:31.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.550+0000 7fc0864ad980 20 zonegroup default 2024-05-09T09:49:31.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.550+0000 7fc0864ad980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.554 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.550+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635d487d710 con 0x5635d4879a60 2024-05-09T09:49:31.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.550+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc074051070 con 0x5635d4879a60 2024-05-09T09:49:31.556 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.550+0000 7fc0864ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:31.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.550+0000 7fc0864ad980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.550+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635d48831b0 con 0x5635d487e380 2024-05-09T09:49:31.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.550+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc06c0d9070 con 0x5635d487e380 2024-05-09T09:49:31.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.550+0000 7fc0864ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:31.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.550+0000 7fc0864ad980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.550+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635d4883550 con 0x5635d487e380 2024-05-09T09:49:31.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.550+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc06c0d9070 con 0x5635d487e380 2024-05-09T09:49:31.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.550+0000 7fc0864ad980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:49:31.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.550+0000 7fc0864ad980 20 started sync module instance, tier type = 2024-05-09T09:49:31.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.550+0000 7fc0864ad980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:49:31.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.550+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d48825f0 con 0x7fc06c0ce040 2024-05-09T09:49:31.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.550+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc07c026040 con 0x7fc06c0ce040 2024-05-09T09:49:31.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.550+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94789198948832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4882e00 con 0x7fc06c0ce040 2024-05-09T09:49:31.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.550+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4883da0 con 0x5635d48750a0 2024-05-09T09:49:31.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.554+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94789198948832] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc07c036040 con 0x7fc06c0ce040 2024-05-09T09:49:31.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.554+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc07c036040 con 0x5635d48750a0 2024-05-09T09:49:31.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.554+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94789198952688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4883d10 con 0x5635d48750a0 2024-05-09T09:49:31.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.554+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4884b50 con 0x5635d487e380 2024-05-09T09:49:31.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.554+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94789198952688] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc07c036040 con 0x5635d48750a0 2024-05-09T09:49:31.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.554+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc06c0d9070 con 0x5635d487e380 2024-05-09T09:49:31.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.554+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94789198954896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4884f40 con 0x5635d487e380 2024-05-09T09:49:31.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.554+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4885900 con 0x7fc06c0ce040 2024-05-09T09:49:31.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.558+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc07c036040 con 0x7fc06c0ce040 2024-05-09T09:49:31.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.558+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94789198959696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4885d20 con 0x7fc06c0ce040 2024-05-09T09:49:31.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.558+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4886790 con 0x5635d48750a0 2024-05-09T09:49:31.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.558+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94789198954896] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc06c0d9070 con 0x5635d487e380 2024-05-09T09:49:31.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.558+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94789198959696] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc07c036040 con 0x7fc06c0ce040 2024-05-09T09:49:31.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.558+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc07c036040 con 0x5635d48750a0 2024-05-09T09:49:31.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.558+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94789198963296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4885870 con 0x5635d48750a0 2024-05-09T09:49:31.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.558+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4887030 con 0x5635d4879a60 2024-05-09T09:49:31.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.562+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94789198963296] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc07c036040 con 0x5635d48750a0 2024-05-09T09:49:31.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.562+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc074051070 con 0x5635d4879a60 2024-05-09T09:49:31.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.562+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94789198965632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4885870 con 0x5635d4879a60 2024-05-09T09:49:31.564 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.562+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4887880 con 0x5635d4879a60 2024-05-09T09:49:31.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.566+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(56 notify.6 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc074051070 con 0x5635d4879a60 2024-05-09T09:49:31.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.566+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94789198965632] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc074051070 con 0x5635d4879a60 2024-05-09T09:49:31.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.566+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94789198967760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4887ca0 con 0x5635d4879a60 2024-05-09T09:49:31.567 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.566+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d48845f0 con 0x5635d4879a60 2024-05-09T09:49:31.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.566+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(58 notify.7 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc074051070 con 0x5635d4879a60 2024-05-09T09:49:31.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.566+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94789198971536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d48845f0 con 0x5635d4879a60 2024-05-09T09:49:31.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.566+0000 7fc0864ad980 20 add_watcher() i=0 2024-05-09T09:49:31.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.566+0000 7fc0864ad980 20 add_watcher() i=1 2024-05-09T09:49:31.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.566+0000 7fc0864ad980 20 add_watcher() i=2 2024-05-09T09:49:31.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.566+0000 7fc0864ad980 20 add_watcher() i=3 2024-05-09T09:49:31.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.566+0000 7fc0864ad980 20 add_watcher() i=4 2024-05-09T09:49:31.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.566+0000 7fc0864ad980 20 add_watcher() i=5 2024-05-09T09:49:31.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.566+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94789198967760] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc074051070 con 0x5635d4879a60 2024-05-09T09:49:31.569 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.566+0000 7fc0864ad980 20 add_watcher() i=6 2024-05-09T09:49:31.570 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.570+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94789198971536] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc074051070 con 0x5635d4879a60 2024-05-09T09:49:31.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.570+0000 7fc0864ad980 20 add_watcher() i=7 2024-05-09T09:49:31.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.570+0000 7fc0864ad980 2 all 8 watchers are set, enabling cache 2024-05-09T09:49:31.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.570+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635d488b6e0 con 0x5635d48750a0 2024-05-09T09:49:31.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.570+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc07c036040 con 0x5635d48750a0 2024-05-09T09:49:31.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.570+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94789198968816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4888bd0 con 0x5635d48750a0 2024-05-09T09:49:31.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.570+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94789198968816] v32'490 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc07c036040 con 0x5635d48750a0 2024-05-09T09:49:31.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.570+0000 7fbf38fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:31.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.570+0000 7fc0864ad980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:49:31.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.570+0000 7fc0864ad980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:49:31.573 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.570+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4893fb0 con 0x5635d48750a0 2024-05-09T09:49:31.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.574+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'111 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc07c036040 con 0x5635d48750a0 2024-05-09T09:49:31.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.574+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4894600 con 0x5635d4879a60 2024-05-09T09:49:31.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.574+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'106 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc074051070 con 0x5635d4879a60 2024-05-09T09:49:31.578 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.574+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4894600 con 0x5635d487e380 2024-05-09T09:49:31.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.578+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'105 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc06c0d9070 con 0x5635d487e380 2024-05-09T09:49:31.580 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.578+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4894c30 con 0x5635d48750a0 2024-05-09T09:49:31.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.578+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'491 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc07c036040 con 0x5635d48750a0 2024-05-09T09:49:31.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.578+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d48950e0 con 0x7fc06c0ce040 2024-05-09T09:49:31.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.582+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'302 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc07c036040 con 0x7fc06c0ce040 2024-05-09T09:49:31.583 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.582+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4891f00 con 0x5635d487e380 2024-05-09T09:49:31.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.582+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'202 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc06c0d9070 con 0x5635d487e380 2024-05-09T09:49:31.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.582+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4891f00 con 0x5635d48750a0 2024-05-09T09:49:31.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.586+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'106 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc07c036040 con 0x5635d48750a0 2024-05-09T09:49:31.587 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.586+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4895e60 con 0x5635d4879a60 2024-05-09T09:49:31.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.586+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'201 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc074051070 con 0x5635d4879a60 2024-05-09T09:49:31.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.586+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4895e60 con 0x7fc06c0ce040 2024-05-09T09:49:31.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.590+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'104 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc07c036040 con 0x7fc06c0ce040 2024-05-09T09:49:31.592 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.590+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4895e60 con 0x5635d487e380 2024-05-09T09:49:31.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.590+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'110 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc06c0d9070 con 0x5635d487e380 2024-05-09T09:49:31.594 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.590+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4896310 con 0x7fc06c0ce040 2024-05-09T09:49:31.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.594+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'303 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc07c036040 con 0x7fc06c0ce040 2024-05-09T09:49:31.595 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.594+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4896310 con 0x5635d4879a60 2024-05-09T09:49:31.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.594+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'110 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc074051070 con 0x5635d4879a60 2024-05-09T09:49:31.598 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.594+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4896310 con 0x7fc06c0ce040 2024-05-09T09:49:31.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.598+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'104 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc07c036040 con 0x7fc06c0ce040 2024-05-09T09:49:31.599 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.598+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4896310 con 0x5635d4879a60 2024-05-09T09:49:31.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.598+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'207 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc074051070 con 0x5635d4879a60 2024-05-09T09:49:31.602 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.598+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4896310 con 0x5635d48750a0 2024-05-09T09:49:31.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.602+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'492 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc07c036040 con 0x5635d48750a0 2024-05-09T09:49:31.604 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.602+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4896310 con 0x5635d487e380 2024-05-09T09:49:31.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.602+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'296 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc06c0d9070 con 0x5635d487e380 2024-05-09T09:49:31.606 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.602+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4896310 con 0x7fc06c0ce040 2024-05-09T09:49:31.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.606+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'304 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc07c036040 con 0x7fc06c0ce040 2024-05-09T09:49:31.608 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.606+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4896310 con 0x5635d487e380 2024-05-09T09:49:31.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.606+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'104 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc06c0d9070 con 0x5635d487e380 2024-05-09T09:49:31.610 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.606+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4896310 con 0x5635d48750a0 2024-05-09T09:49:31.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.610+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'112 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc07c036040 con 0x5635d48750a0 2024-05-09T09:49:31.612 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.610+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4896310 con 0x5635d48750a0 2024-05-09T09:49:31.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.610+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'493 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc07c036040 con 0x5635d48750a0 2024-05-09T09:49:31.614 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.614+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4896310 con 0x5635d487e380 2024-05-09T09:49:31.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.614+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'297 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc06c0d9070 con 0x5635d487e380 2024-05-09T09:49:31.617 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.614+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4896310 con 0x7fc06c0ce040 2024-05-09T09:49:31.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.618+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'116 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc07c036040 con 0x7fc06c0ce040 2024-05-09T09:49:31.619 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.618+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4896310 con 0x5635d487e380 2024-05-09T09:49:31.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.618+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'106 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc06c0d9070 con 0x5635d487e380 2024-05-09T09:49:31.621 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.618+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4896310 con 0x5635d487e380 2024-05-09T09:49:31.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.622+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'110 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc06c0d9070 con 0x5635d487e380 2024-05-09T09:49:31.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.622+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4896310 con 0x5635d487e380 2024-05-09T09:49:31.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.622+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'101 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc06c0d9070 con 0x5635d487e380 2024-05-09T09:49:31.624 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.622+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4896310 con 0x5635d487e380 2024-05-09T09:49:31.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.622+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'203 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc06c0d9070 con 0x5635d487e380 2024-05-09T09:49:31.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.622+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4896310 con 0x5635d4879a60 2024-05-09T09:49:31.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.626+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'106 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc074051070 con 0x5635d4879a60 2024-05-09T09:49:31.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.626+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4896310 con 0x5635d487e380 2024-05-09T09:49:31.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.630+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'105 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc06c0d9070 con 0x5635d487e380 2024-05-09T09:49:31.631 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.630+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4896310 con 0x5635d4879a60 2024-05-09T09:49:31.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.630+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'202 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc074051070 con 0x5635d4879a60 2024-05-09T09:49:31.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.630+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4896310 con 0x5635d487e380 2024-05-09T09:49:31.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.634+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'298 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc06c0d9070 con 0x5635d487e380 2024-05-09T09:49:31.636 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.634+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4896310 con 0x5635d4879a60 2024-05-09T09:49:31.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.638+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'208 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc074051070 con 0x5635d4879a60 2024-05-09T09:49:31.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.638+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4896310 con 0x7fc06c0ce040 2024-05-09T09:49:31.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.638+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'110 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc07c036040 con 0x7fc06c0ce040 2024-05-09T09:49:31.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.638+0000 7fbeb37fe640 20 reqs_thread_entry: start 2024-05-09T09:49:31.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.638+0000 7fc0864ad980 20 init_complete bucket index max shards: 11 2024-05-09T09:49:31.642 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.642+0000 7fbeb17fa640 20 reqs_thread_entry: start 2024-05-09T09:49:31.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.642+0000 7fc0864ad980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-09T09:49:31.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.642+0000 7fc0864ad980 20 rados->read ofs=0 len=0 2024-05-09T09:49:31.643 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.642+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:94 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635d48b1de0 con 0x5635d4879a60 2024-05-09T09:49:31.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.642+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(94 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7fc074051070 con 0x5635d4879a60 2024-05-09T09:49:31.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.642+0000 7fc0864ad980 20 rados_obj.operate() r=0 bl.length=473 2024-05-09T09:49:31.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.642+0000 7fc0864ad980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-09T09:49:31.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.642+0000 7fc0864ad980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:31.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.642+0000 7fc0864ad980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-09T09:49:31.644 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.642+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:95 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d48b8410 con 0x5635d4879a60 2024-05-09T09:49:31.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.646+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(95 ada [delete,create,call,call,writefull 0~473] v32'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc074051070 con 0x5635d4879a60 2024-05-09T09:49:31.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.646+0000 7fc0864ad980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-09T09:49:31.647 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.646+0000 7fc0864ad980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:31.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.646+0000 7fc0864ad980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-09T09:49:31.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.646+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:96 7.d 7:b4812045:::notify.4:head [notify cookie 94789199167104 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5635d48b3aa0 con 0x5635d48750a0 2024-05-09T09:49:31.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.646+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== watch-notify(notify (1) cookie 94789198963296 notify 137438953515 ret 0) ==== 691+0+0 (crc 0 0 0) 0x5635d4895c40 con 0x5635d48750a0 2024-05-09T09:49:31.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.646+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(96 notify.4 [notify cookie 94789199167104 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc07c036040 con 0x5635d48750a0 2024-05-09T09:49:31.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.646+0000 7fbf61ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953515 cookie 94789198963296 notifier 4929 bl.length()=649 2024-05-09T09:49:31.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.646+0000 7fbf61ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-09T09:49:31.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.646+0000 7fbf61ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-09T09:49:31.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.646+0000 7fbf61ffb640 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:97 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fbf480056c0 con 0x5635d48750a0 2024-05-09T09:49:31.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.646+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(97 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc07c036040 con 0x5635d48750a0 2024-05-09T09:49:31.648 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.646+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== watch-notify(notify_complete (2) cookie 94789199167104 notify 137438953515 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5635d4893910 con 0x5635d48750a0 2024-05-09T09:49:31.648 INFO:teuthology.orchestra.run.smithi157.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-09T09:49:28.233198Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-09T09:49:28.233178Z","tags":[],"group_ids":[]} 2024-05-09T09:49:31.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.646+0000 7fbf38fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:49:31.649 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.646+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:98 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94789198968816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d48b7720 con 0x5635d48750a0 2024-05-09T09:49:31.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.646+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(98 data_loggenerations_metadata [watch unwatch cookie 94789198968816] v32'494 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc07c036040 con 0x5635d48750a0 2024-05-09T09:49:31.650 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.646+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94789198948832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d48b7720 con 0x7fc06c0ce040 2024-05-09T09:49:31.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.650+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(99 notify.0 [watch unwatch cookie 94789198948832] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc07c036040 con 0x7fc06c0ce040 2024-05-09T09:49:31.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.650+0000 7fc0864ad980 20 remove_watcher() i=0 2024-05-09T09:49:31.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.650+0000 7fc0864ad980 2 removed watcher, disabling cache 2024-05-09T09:49:31.652 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.650+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:100 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94789198952688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d48b7720 con 0x5635d48750a0 2024-05-09T09:49:31.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.650+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(100 notify.1 [watch unwatch cookie 94789198952688] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc07c036040 con 0x5635d48750a0 2024-05-09T09:49:31.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.650+0000 7fc0864ad980 20 remove_watcher() i=1 2024-05-09T09:49:31.654 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.650+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94789198954896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d48b7720 con 0x5635d487e380 2024-05-09T09:49:31.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.654+0000 7fc0837c7640 1 -- 172.21.15.157:0/2151222258 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(101 notify.2 [watch unwatch cookie 94789198954896] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc06c0d9070 con 0x5635d487e380 2024-05-09T09:49:31.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.654+0000 7fc0864ad980 20 remove_watcher() i=2 2024-05-09T09:49:31.656 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.654+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:102 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94789198959696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d48b7720 con 0x7fc06c0ce040 2024-05-09T09:49:31.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.654+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(102 notify.3 [watch unwatch cookie 94789198959696] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc07c036040 con 0x7fc06c0ce040 2024-05-09T09:49:31.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.654+0000 7fc0864ad980 20 remove_watcher() i=3 2024-05-09T09:49:31.658 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.654+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:103 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94789198963296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d48b7720 con 0x5635d48750a0 2024-05-09T09:49:31.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.658+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(103 notify.4 [watch unwatch cookie 94789198963296] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc07c036040 con 0x5635d48750a0 2024-05-09T09:49:31.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.658+0000 7fc0864ad980 20 remove_watcher() i=4 2024-05-09T09:49:31.660 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.658+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94789198965632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d48838f0 con 0x5635d4879a60 2024-05-09T09:49:31.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.662+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(104 notify.5 [watch unwatch cookie 94789198965632] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc074051070 con 0x5635d4879a60 2024-05-09T09:49:31.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.662+0000 7fc0864ad980 20 remove_watcher() i=5 2024-05-09T09:49:31.663 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.662+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:105 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94789198967760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4885450 con 0x5635d4879a60 2024-05-09T09:49:31.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.662+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(105 notify.6 [watch unwatch cookie 94789198967760] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc074051070 con 0x5635d4879a60 2024-05-09T09:49:31.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.662+0000 7fc0864ad980 20 remove_watcher() i=6 2024-05-09T09:49:31.665 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.662+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:106 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94789198971536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5635d4886260 con 0x5635d4879a60 2024-05-09T09:49:31.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc083fc8640 1 -- 172.21.15.157:0/2151222258 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(106 notify.7 [watch unwatch cookie 94789198971536] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc074051070 con 0x5635d4879a60 2024-05-09T09:49:31.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 20 remove_watcher() i=7 2024-05-09T09:49:31.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5635d4879a60 msgr2=0x5635d487be50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 --2- 172.21.15.157:0/2151222258 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5635d4879a60 0x5635d487be50 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5635d48750a0 msgr2=0x5635d4877560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.669 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 --2- 172.21.15.157:0/2151222258 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5635d48750a0 0x5635d4877560 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fc06c0ce040 msgr2=0x7fc06c0db410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 --2- 172.21.15.157:0/2151222258 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7fc06c0ce040 0x7fc06c0db410 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5635d487e380 msgr2=0x5635d4880820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 --2- 172.21.15.157:0/2151222258 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5635d487e380 0x5635d4880820 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbf4c034b60 msgr2=0x7fbf4c037020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 --2- 172.21.15.157:0/2151222258 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbf4c034b60 0x7fbf4c037020 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc06c0abfd0 tx=0x7fc06c0a6000 comp rx=0 tx=0).stop 2024-05-09T09:49:31.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d48611e0 msgr2=0x5635d48684f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0847c9640 1 -- 172.21.15.157:0/2151222258 reap_dead start 2024-05-09T09:49:31.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 --2- 172.21.15.157:0/2151222258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d48611e0 0x5635d48684f0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fc074034f60 tx=0x7fc07405b000 comp rx=0 tx=0).stop 2024-05-09T09:49:31.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 shutdown_connections 2024-05-09T09:49:31.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 --2- 172.21.15.157:0/2151222258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d48611e0 0x5635d48684f0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 >> 172.21.15.157:0/2151222258 conn(0x5635d485d4c0 msgr2=0x5635d485ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:31.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 shutdown_connections 2024-05-09T09:49:31.670 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 -- 172.21.15.157:0/2151222258 wait complete. 2024-05-09T09:49:31.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 -- 172.21.15.157:0/4041123107 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbf5c034bb0 msgr2=0x7fbf5c037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 --2- 172.21.15.157:0/4041123107 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbf5c034bb0 0x7fbf5c037070 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x5635d4825af0 tx=0x7fc06c005a10 comp rx=0 tx=0).stop 2024-05-09T09:49:31.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 -- 172.21.15.157:0/4041123107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d4854200 msgr2=0x5635d4854620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 --2- 172.21.15.157:0/4041123107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d4854200 0x5635d4854620 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fc074048be0 tx=0x7fc074010e30 comp rx=0 tx=0).stop 2024-05-09T09:49:31.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 -- 172.21.15.157:0/4041123107 shutdown_connections 2024-05-09T09:49:31.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 --2- 172.21.15.157:0/4041123107 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbf5c034bb0 0x7fbf5c037070 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 --2- 172.21.15.157:0/4041123107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d4854200 0x5635d4854620 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 -- 172.21.15.157:0/4041123107 >> 172.21.15.157:0/4041123107 conn(0x5635d4848fd0 msgr2=0x5635d4849ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:31.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 -- 172.21.15.157:0/4041123107 shutdown_connections 2024-05-09T09:49:31.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 -- 172.21.15.157:0/4041123107 wait complete. 2024-05-09T09:49:31.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 -- 172.21.15.157:0/380963240 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5635d4827970 msgr2=0x5635d4829d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 --2- 172.21.15.157:0/380963240 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x5635d4827970 0x5635d4829d60 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 -- 172.21.15.157:0/380963240 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5635d4730040 msgr2=0x5635d4825070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 --2- 172.21.15.157:0/380963240 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x5635d4730040 0x5635d4825070 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.671 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 -- 172.21.15.157:0/380963240 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5635d482b8b0 msgr2=0x5635d482dca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 --2- 172.21.15.157:0/380963240 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x5635d482b8b0 0x5635d482dca0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:49:31.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 -- 172.21.15.157:0/380963240 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbf6c034c00 msgr2=0x7fbf6c0370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 --2- 172.21.15.157:0/380963240 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fbf6c034c00 0x7fbf6c0370c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc06c0ad000 tx=0x7fc06c0a5040 comp rx=0 tx=0).stop 2024-05-09T09:49:31.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 -- 172.21.15.157:0/380963240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d472bb40 msgr2=0x5635d481dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:49:31.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 --2- 172.21.15.157:0/380963240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5635d472bb40 0x5635d481dfc0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x5635d4817c30 tx=0x7fc074000f50 comp rx=0 tx=0).stop 2024-05-09T09:49:31.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0847c9640 1 -- 172.21.15.157:0/380963240 reap_dead start 2024-05-09T09:49:31.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 -- 172.21.15.157:0/380963240 shutdown_connections 2024-05-09T09:49:31.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 -- 172.21.15.157:0/380963240 >> 172.21.15.157:0/380963240 conn(0x5635d469f260 msgr2=0x5635d4811440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:49:31.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 -- 172.21.15.157:0/380963240 shutdown_connections 2024-05-09T09:49:31.672 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:49:31.666+0000 7fc0864ad980 1 -- 172.21.15.157:0/380963240 wait complete. 2024-05-09T09:49:31.683 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-09T09:49:28.233198Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:49:28.233178Z', 'tags': [], 'group_ids': []} 2024-05-09T09:49:31.683 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-09T09:49:28.233198Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-09T09:49:28.233178Z', 'tags': [], 'group_ids': []} 2024-05-09T09:49:31.683 ERROR:root:0 2024-05-09T09:49:31.683 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-05-09T09:49:31.691 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-09T09:49:31.691 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-09T09:49:31.695 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-09T09:49:31.695 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-05-09T09:49:31.702 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-09T09:49:31.702 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-09T09:49:31.706 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-09T09:49:31.706 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-05-09T09:49:31.719 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-05-09T09:49:31.719 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-09T09:49:31.723 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-09T09:49:31.723 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-05-09T09:49:31.732 INFO:tasks.radosgw_admin_rest: empty result 2024-05-09T09:49:31.732 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-09T09:49:31.736 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-09T09:49:31.736 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-05-09T09:49:31.746 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-05-09T09:49:31.747 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-09T09:49:31.750 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-09T09:49:31.751 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-05-09T09:49:31.761 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-05-09T09:49:31.761 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-09T09:49:31.765 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-09T09:49:31.765 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-05-09T09:49:31.774 INFO:tasks.radosgw_admin_rest: empty result 2024-05-09T09:49:31.774 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-09T09:49:31.778 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-09T09:49:31.778 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-05-09T09:49:31.785 INFO:tasks.radosgw_admin_rest: empty result 2024-05-09T09:49:31.785 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-09T09:49:31.789 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-09T09:49:31.789 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-05-09T09:49:31.800 INFO:tasks.radosgw_admin_rest: empty result 2024-05-09T09:49:31.800 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-09T09:49:31.804 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-09T09:49:31.804 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-05-09T09:49:31.809 INFO:tasks.radosgw_admin_rest: json result: [] 2024-05-09T09:49:31.810 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-05-09T09:49:31.814 INFO:tasks.radosgw_admin_rest: json result: [] 2024-05-09T09:49:31.831 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-05-09T09:49:31.836 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-05-09T09:49:31.836 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-05-09T09:49:31.843 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '69d0cd00-5979-46bf-b012-5813947e658a', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11', 'marker': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-09T09:49:31.824864Z', 'creation_time': '2024-05-09T09:49:31.820636Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-09T09:49:31.843 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-05-09T09:49:31.850 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '69d0cd00-5979-46bf-b012-5813947e658a', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11', 'marker': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-09T09:49:31.824864Z', 'creation_time': '2024-05-09T09:49:31.820636Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-05-09T09:49:31.859 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-05-09T09:49:31.866 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '69d0cd00-5979-46bf-b012-5813947e658a', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11', 'marker': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-09T09:49:31.824864Z', 'creation_time': '2024-05-09T09:49:31.820636Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-09T09:49:31.866 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-05-09T09:49:31.871 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx00000c736ab268f658975-00663c9c2b-4238-default', 'HostId': '4238-default-default'} 2024-05-09T09:49:31.880 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-05-09T09:49:31.892 INFO:tasks.radosgw_admin_rest: empty result 2024-05-09T09:49:31.893 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-05-09T09:49:31.909 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'fud', 'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-09T09:49:31.968 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11'} 2024-05-09T09:49:31.990 INFO:tasks.radosgw_admin_rest: empty result 2024-05-09T09:49:31.995 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11'} 2024-05-09T09:49:32.016 INFO:tasks.radosgw_admin_rest: empty result 2024-05-09T09:49:32.017 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-05-09T09:49:32.038 INFO:tasks.radosgw_admin_rest: empty result 2024-05-09T09:49:32.053 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-05-09T09:49:32.065 INFO:tasks.radosgw_admin_rest: empty result 2024-05-09T09:49:32.065 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-05-09T09:49:32.072 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '69d0cd00-5979-46bf-b012-5813947e658a', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11', 'marker': 'b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-09T09:49:32.004314Z', 'creation_time': '2024-05-09T09:49:31.820636Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-09T09:50:32.192 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-05-09T09:50:32.231 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'bar', 'categories': [], 's3select': {}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'bud', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'fud', 'categories': [], 's3select': {}}, {'bucket': 'myfoo7', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'fud', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-09T09:50:32.232 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-05-09T09:50:32.264 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo7', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-09T09:50:32.264 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-05-09T09:50:32.270 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-09T09:50:32.270 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-05-09T09:50:32.275 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-09T09:50:32.276 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-05-09T09:50:32.281 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-09T09:50:32.281 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-05-09T09:50:32.286 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-09T09:50:32.287 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-05-09T09:50:32.292 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-05-09T09:00:00.000000Z', 'epoch': 1715245200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-09T09:50:32.292 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-05-09T09:50:32.303 INFO:tasks.radosgw_admin_rest: empty result 2024-05-09T09:50:32.303 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-05-09T09:50:32.308 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-05-09T09:50:32.308 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-05-09T09:50:32.323 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-09T09:50:32.328 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-05-09T09:50:32.344 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-09T09:50:32.727 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-05-09T09:50:32.732 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx000000e0c9b2203078de3-00663c9c68-4238-default', 'HostId': '4238-default-default'} 2024-05-09T09:50:32.913 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-05-09T09:50:32.920 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-05-09T09:50:32.930 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-05-09T09:50:32.935 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-05-09T09:50:33.082 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-05-09T09:50:33.177 INFO:tasks.radosgw_admin_rest: empty result 2024-05-09T09:50:33.177 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-05-09T09:50:33.187 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-05-09T09:50:33.188 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-05-09T09:50:33.198 INFO:tasks.radosgw_admin_rest: json result: [] 2024-05-09T09:50:33.222 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-05-09T09:50:33.227 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx000007551f28658ccaef6-00663c9c69-4238-default', 'HostId': '4238-default-default'} 2024-05-09T09:50:33.271 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-05-09T09:50:33.345 INFO:tasks.radosgw_admin_rest: empty result 2024-05-09T09:50:33.345 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-09T09:50:33.350 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000d65c0c7c11027c35-00663c9c69-4238-default', 'HostId': '4238-default-default'} 2024-05-09T09:50:33.351 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-05-09T09:50:33.355 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': 'c05d0fe5-e814-4a03-b82b-3bb6168d5691'}]}} 2024-05-09T09:50:33.355 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-05-09T09:50:33.378 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'ratelimit_user', 'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-09T09:50:33.378 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-05-09T09:50:33.382 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-05-09T09:50:33.383 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-05-09T09:50:33.388 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000ff318cf19f766bda-00663c9c69-4238-default', 'HostId': '4238-default-default'} 2024-05-09T09:50:33.389 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-05-09T09:50:33.393 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000a9154ff0c813e7a4-00663c9c69-4238-default', 'HostId': '4238-default-default'} 2024-05-09T09:50:33.416 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-05-09T09:50:33.420 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-05-09T09:50:33.421 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-05-09T09:50:33.426 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000019be6aa0619b4ff3-00663c9c69-4238-default', 'HostId': '4238-default-default'} 2024-05-09T09:50:33.426 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-05-09T09:50:33.430 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000006b518c89407e70ec-00663c9c69-4238-default', 'HostId': '4238-default-default'} 2024-05-09T09:50:33.430 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-05-09T09:50:33.435 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-05-09T09:50:33.436 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-05-09T09:50:33.440 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000992dbded2f6bd7d1-00663c9c69-4238-default', 'HostId': '4238-default-default'} 2024-05-09T09:50:33.440 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-05-09T09:50:33.444 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000002fb362cf156b310f-00663c9c69-4238-default', 'HostId': '4238-default-default'} 2024-05-09T09:50:33.444 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-05-09T09:50:33.448 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000e419048c3c92b092-00663c9c69-4238-default', 'HostId': '4238-default-default'} 2024-05-09T09:50:33.448 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-05-09T09:50:33.452 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000b201c863de11dcaf-00663c9c69-4238-default', 'HostId': '4238-default-default'} 2024-05-09T09:50:33.452 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-05-09T09:50:33.472 INFO:tasks.radosgw_admin_rest: empty result 2024-05-09T09:50:33.473 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-05-09T09:50:33.477 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-05-09T09:50:33.477 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-05-09T09:50:33.487 INFO:tasks.radosgw_admin_rest: empty result 2024-05-09T09:50:33.488 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-05-09T09:50:33.492 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-05-09T09:50:33.492 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-05-09T09:50:33.501 INFO:tasks.radosgw_admin_rest: empty result 2024-05-09T09:50:33.505 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-05-09T09:50:33.515 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-05-09T09:50:33.516 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T09:50:33.517 INFO:tasks.rgw.client.0.smithi157.stdout:2024-05-09T09:50:33.514+0000 7f315e46c640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 27779) UID: 0 2024-05-09T09:50:33.517 INFO:tasks.rgw.client.0.smithi157.stdout:2024-05-09T09:50:33.514+0000 7f31629559c0 -1 shutting down 2024-05-09T09:50:34.626 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-05-09T09:50:39.617 INFO:tasks.rgw.client.0:Stopped 2024-05-09T09:50:39.617 DEBUG:teuthology.orchestra.run.smithi157:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-05-09T09:50:39.624 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f /etc/ceph/vault-root-token 2024-05-09T09:50:39.679 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-05-09T09:50:39.734 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-05-09T09:50:39.734 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-05-09T09:50:39.734 DEBUG:teuthology.orchestra.run.smithi157:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-05-09T09:50:39.814 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setuser ceph since I am not root 2024-05-09T09:50:39.814 INFO:teuthology.orchestra.run.smithi157.stderr:ignoring --setgroup ceph since I am not root 2024-05-09T09:50:39.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.814+0000 7f828414b980 1 Processor -- start 2024-05-09T09:50:39.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.814+0000 7f828414b980 1 -- start start 2024-05-09T09:50:39.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.814+0000 7f828414b980 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55c4514ef800 0x55c4514efbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:39.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.814+0000 7f828414b980 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c4513a6440 con 0x55c4514f0120 2024-05-09T09:50:39.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.814+0000 7f828414b980 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x55c4513915f0 con 0x55c4514ef800 2024-05-09T09:50:39.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.814+0000 7f8281c66640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55c4514ef800 0x55c4514efbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:39.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.814+0000 7f8281c66640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x55c4514ef800 0x55c4514efbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:42086/0 (socket says 172.21.15.157:42086) 2024-05-09T09:50:39.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.814+0000 7f8281c66640 1 -- 172.21.15.157:0/3946652505 learned_addr learned my addr 172.21.15.157:0/3946652505 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:50:39.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.814+0000 7f8281465640 1 --1- 172.21.15.157:0/3946652505 >> v1:172.21.15.110:6789/0 conn(0x55c4514f0120 0x55c4514f0b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.157:34178/0 (socket says 172.21.15.157:34178) 2024-05-09T09:50:39.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.814+0000 7f8281c66640 1 -- 172.21.15.157:0/3946652505 >> v1:172.21.15.110:6789/0 conn(0x55c4514f0120 legacy=0x55c4514f0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:39.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.814+0000 7f8281c66640 1 -- 172.21.15.157:0/3946652505 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c45139c990 con 0x55c4514ef800 2024-05-09T09:50:39.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.818+0000 7f8281c66640 1 --2- 172.21.15.157:0/3946652505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4514ef800 0x55c4514efbe0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f827400a5c0 tx=0x7f827401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1777069db0cb1d65 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:39.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.818+0000 7f8280c64640 1 -- 172.21.15.157:0/3946652505 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82740af070 con 0x55c4514ef800 2024-05-09T09:50:39.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.818+0000 7f8280c64640 1 -- 172.21.15.157:0/3946652505 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82740aa530 con 0x55c4514ef800 2024-05-09T09:50:39.819 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.818+0000 7f8280c64640 1 -- 172.21.15.157:0/3946652505 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82740aa830 con 0x55c4514ef800 2024-05-09T09:50:39.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.818+0000 7f828414b980 1 -- 172.21.15.157:0/3946652505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4514ef800 msgr2=0x55c4514efbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:39.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.818+0000 7f828414b980 1 --2- 172.21.15.157:0/3946652505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4514ef800 0x55c4514efbe0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f827400a5c0 tx=0x7f827401b340 comp rx=0 tx=0).stop 2024-05-09T09:50:39.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.818+0000 7f828414b980 1 -- 172.21.15.157:0/3946652505 shutdown_connections 2024-05-09T09:50:39.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.818+0000 7f828414b980 1 --2- 172.21.15.157:0/3946652505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4514ef800 0x55c4514efbe0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:39.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.818+0000 7f828414b980 1 -- 172.21.15.157:0/3946652505 >> 172.21.15.157:0/3946652505 conn(0x55c4514eb0d0 msgr2=0x55c4514ed4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:39.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.818+0000 7f828414b980 1 -- 172.21.15.157:0/3946652505 shutdown_connections 2024-05-09T09:50:39.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.818+0000 7f828414b980 1 -- 172.21.15.157:0/3946652505 wait complete. 2024-05-09T09:50:39.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.834+0000 7f828414b980 1 Processor -- start 2024-05-09T09:50:39.836 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.834+0000 7f828414b980 1 -- start start 2024-05-09T09:50:39.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.834+0000 7f828414b980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4514ef800 0x55c4515da1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:39.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.834+0000 7f828414b980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55c4513f3fe0 con 0x55c4514ef800 2024-05-09T09:50:39.837 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.834+0000 7f8281c66640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4514ef800 0x55c4515da1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:39.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.834+0000 7f8281c66640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4514ef800 0x55c4515da1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:42096/0 (socket says 172.21.15.157:42096) 2024-05-09T09:50:39.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.834+0000 7f8281c66640 1 -- 172.21.15.157:0/1309833378 learned_addr learned my addr 172.21.15.157:0/1309833378 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:50:39.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.834+0000 7f8281c66640 1 -- 172.21.15.157:0/1309833378 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c451378ae0 con 0x55c4514ef800 2024-05-09T09:50:39.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.834+0000 7f8281c66640 1 --2- 172.21.15.157:0/1309833378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4514ef800 0x55c4515da1b0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f8274017f50 tx=0x7f8274003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f37a6fef08af73f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:39.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.838+0000 7f816fe07640 1 -- 172.21.15.157:0/1309833378 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82740af040 con 0x55c4514ef800 2024-05-09T09:50:39.838 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.838+0000 7f816fe07640 1 -- 172.21.15.157:0/1309833378 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82740aa9d0 con 0x55c4514ef800 2024-05-09T09:50:39.839 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.838+0000 7f816fe07640 1 -- 172.21.15.157:0/1309833378 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82740aacf0 con 0x55c4514ef800 2024-05-09T09:50:39.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.838+0000 7f828414b980 1 -- 172.21.15.157:0/1309833378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4514ef800 msgr2=0x55c4515da1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:39.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.838+0000 7f828414b980 1 --2- 172.21.15.157:0/1309833378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4514ef800 0x55c4515da1b0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f8274017f50 tx=0x7f8274003030 comp rx=0 tx=0).stop 2024-05-09T09:50:39.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.838+0000 7f828414b980 1 -- 172.21.15.157:0/1309833378 shutdown_connections 2024-05-09T09:50:39.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.838+0000 7f828414b980 1 --2- 172.21.15.157:0/1309833378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4514ef800 0x55c4515da1b0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:39.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.838+0000 7f828414b980 1 -- 172.21.15.157:0/1309833378 >> 172.21.15.157:0/1309833378 conn(0x55c4514eb0d0 msgr2=0x55c4515d5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:39.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.838+0000 7f828414b980 1 -- 172.21.15.157:0/1309833378 shutdown_connections 2024-05-09T09:50:39.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.838+0000 7f828414b980 1 -- 172.21.15.157:0/1309833378 wait complete. 2024-05-09T09:50:39.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.838+0000 7f828414b980 1 Processor -- start 2024-05-09T09:50:39.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.838+0000 7f828414b980 1 -- start start 2024-05-09T09:50:39.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.838+0000 7f828414b980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4514ef800 0x55c4515e12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:39.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.838+0000 7f828414b980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55c451464970 con 0x55c4514ef800 2024-05-09T09:50:39.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.838+0000 7f8281c66640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4514ef800 0x55c4515e12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:39.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.838+0000 7f8281c66640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4514ef800 0x55c4515e12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:42108/0 (socket says 172.21.15.157:42108) 2024-05-09T09:50:39.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.838+0000 7f8281c66640 1 -- 172.21.15.157:0/2874799394 learned_addr learned my addr 172.21.15.157:0/2874799394 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:50:39.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.838+0000 7f8281c66640 1 -- 172.21.15.157:0/2874799394 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4515e1820 con 0x55c4514ef800 2024-05-09T09:50:39.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.838+0000 7f8281c66640 1 --2- 172.21.15.157:0/2874799394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4514ef800 0x55c4515e12e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f827401b380 tx=0x7f82740180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:39.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.838+0000 7f816e604640 1 -- 172.21.15.157:0/2874799394 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82740c3020 con 0x55c4514ef800 2024-05-09T09:50:39.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.838+0000 7f816e604640 1 -- 172.21.15.157:0/2874799394 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82740b5ba0 con 0x55c4514ef800 2024-05-09T09:50:39.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.838+0000 7f828414b980 1 -- 172.21.15.157:0/2874799394 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c4515e1ab0 con 0x55c4514ef800 2024-05-09T09:50:39.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.838+0000 7f816e604640 1 -- 172.21.15.157:0/2874799394 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82740af070 con 0x55c4514ef800 2024-05-09T09:50:39.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.838+0000 7f828414b980 1 -- 172.21.15.157:0/2874799394 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4515e4740 con 0x55c4514ef800 2024-05-09T09:50:39.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.842+0000 7f816e604640 1 -- 172.21.15.157:0/2874799394 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f82740c6020 con 0x55c4514ef800 2024-05-09T09:50:39.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.842+0000 7f816e604640 1 --2- 172.21.15.157:0/2874799394 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8168034bb0 0x7f8168037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:39.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.842+0000 7f816e604640 1 -- 172.21.15.157:0/2874799394 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f82740ba070 con 0x55c4514ef800 2024-05-09T09:50:39.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.842+0000 7f8281465640 1 --2- 172.21.15.157:0/2874799394 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8168034bb0 0x7f8168037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:39.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.842+0000 7f828414b980 1 --2- 172.21.15.157:0/2874799394 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55c4514f0120 0x55c4515e8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:39.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.842+0000 7f828414b980 1 -- 172.21.15.157:0/2874799394 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4515e8840 con 0x55c4514f0120 2024-05-09T09:50:39.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.842+0000 7f8282467640 1 --2- 172.21.15.157:0/2874799394 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55c4514f0120 0x55c4515e8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:39.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.842+0000 7f8281465640 1 --2- 172.21.15.157:0/2874799394 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8168034bb0 0x7f8168037070 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f826c000f70 tx=0x7f826c008590 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:39.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.842+0000 7f8282467640 1 --2- 172.21.15.157:0/2874799394 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55c4514f0120 0x55c4515e8220 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:39.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.842+0000 7f8282467640 1 -- 172.21.15.157:0/2874799394 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c4514f0120 2024-05-09T09:50:39.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.842+0000 7f828414b980 1 -- 172.21.15.157:0/2874799394 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4515e5940 con 0x55c4514f0120 2024-05-09T09:50:39.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.842+0000 7f8282467640 1 -- 172.21.15.157:0/2874799394 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c4514f0120 2024-05-09T09:50:39.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.842+0000 7f828414b980 1 --2- 172.21.15.157:0/2874799394 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55c4515eab70 0x55c4515ecf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:39.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.842+0000 7f828414b980 1 -- 172.21.15.157:0/2874799394 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:3 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4515ed630 con 0x55c4515eab70 2024-05-09T09:50:39.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.842+0000 7f8281c66640 1 --2- 172.21.15.157:0/2874799394 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55c4515eab70 0x55c4515ecf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:39.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.842+0000 7f8281c66640 1 --2- 172.21.15.157:0/2874799394 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55c4515eab70 0x55c4515ecf60 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:39.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.846+0000 7f8281c66640 1 -- 172.21.15.157:0/2874799394 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(3 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f82740b2040 con 0x55c4515eab70 2024-05-09T09:50:39.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.846+0000 7f828414b980 1 -- 172.21.15.157:0/2874799394 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4515e9a10 con 0x55c4514f0120 2024-05-09T09:50:39.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.846+0000 7f8282467640 1 -- 172.21.15.157:0/2874799394 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c4514f0120 2024-05-09T09:50:39.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.846+0000 7f828414b980 1 --2- 172.21.15.157:0/2874799394 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55c4515eea90 0x55c4515f0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:39.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.846+0000 7f828414b980 1 -- 172.21.15.157:0/2874799394 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:5 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4515f1580 con 0x55c4515eea90 2024-05-09T09:50:39.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.846+0000 7f8281465640 1 --2- 172.21.15.157:0/2874799394 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55c4515eea90 0x55c4515f0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:39.847 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.846+0000 7f8281465640 1 --2- 172.21.15.157:0/2874799394 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55c4515eea90 0x55c4515f0e80 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:39.848 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.846+0000 7f8281465640 1 -- 172.21.15.157:0/2874799394 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(5 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f826c00b950 con 0x55c4515eea90 2024-05-09T09:50:39.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.850+0000 7f828414b980 1 Processor -- start 2024-05-09T09:50:39.851 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.850+0000 7f828414b980 1 -- start start 2024-05-09T09:50:39.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.850+0000 7f828414b980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c45161ba10 0x55c45161be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:39.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.850+0000 7f828414b980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55c4513f8020 con 0x55c45161ba10 2024-05-09T09:50:39.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.850+0000 7f8281c66640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c45161ba10 0x55c45161be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:39.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.850+0000 7f8281c66640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c45161ba10 0x55c45161be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:42120/0 (socket says 172.21.15.157:42120) 2024-05-09T09:50:39.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.850+0000 7f8281c66640 1 -- 172.21.15.157:0/2180504308 learned_addr learned my addr 172.21.15.157:0/2180504308 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:50:39.852 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.850+0000 7f8281c66640 1 -- 172.21.15.157:0/2180504308 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c45161c370 con 0x55c45161ba10 2024-05-09T09:50:39.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.850+0000 7f8281c66640 1 --2- 172.21.15.157:0/2180504308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c45161ba10 0x55c45161be30 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f82740e51a0 tx=0x7f82740b3370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:39.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.850+0000 7f81663a1640 1 -- 172.21.15.157:0/2180504308 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82740a9d50 con 0x55c45161ba10 2024-05-09T09:50:39.853 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.850+0000 7f828414b980 1 -- 172.21.15.157:0/2180504308 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c45161ce00 con 0x55c45161ba10 2024-05-09T09:50:39.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.850+0000 7f81663a1640 1 -- 172.21.15.157:0/2180504308 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82740bd7e0 con 0x55c45161ba10 2024-05-09T09:50:39.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.850+0000 7f81663a1640 1 -- 172.21.15.157:0/2180504308 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82740eb060 con 0x55c45161ba10 2024-05-09T09:50:39.854 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.850+0000 7f828414b980 1 -- 172.21.15.157:0/2180504308 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c45161d2e0 con 0x55c45161ba10 2024-05-09T09:50:39.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.854+0000 7f81663a1640 1 -- 172.21.15.157:0/2180504308 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f82740dd070 con 0x55c45161ba10 2024-05-09T09:50:39.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.854+0000 7f81663a1640 1 --2- 172.21.15.157:0/2180504308 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f815c034bb0 0x7f815c037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:39.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.854+0000 7f81663a1640 1 -- 172.21.15.157:0/2180504308 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f82740dfd20 con 0x55c45161ba10 2024-05-09T09:50:39.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.854+0000 7f8281465640 1 --2- 172.21.15.157:0/2180504308 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f815c034bb0 0x7f815c037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:39.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.854+0000 7f828414b980 1 Processor -- start 2024-05-09T09:50:39.855 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.854+0000 7f828414b980 1 -- start start 2024-05-09T09:50:39.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.854+0000 7f8281465640 1 --2- 172.21.15.157:0/2180504308 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f815c034bb0 0x7f815c037070 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55c4515e9120 tx=0x7f826c012000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:39.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.854+0000 7f828414b980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c451628a30 0x55c451628e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:39.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.854+0000 7f828414b980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55c4515da840 con 0x55c451628a30 2024-05-09T09:50:39.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.854+0000 7f8281c66640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c451628a30 0x55c451628e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:39.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.854+0000 7f8281c66640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c451628a30 0x55c451628e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:42136/0 (socket says 172.21.15.157:42136) 2024-05-09T09:50:39.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.854+0000 7f8281c66640 1 -- 172.21.15.157:0/3174097110 learned_addr learned my addr 172.21.15.157:0/3174097110 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:50:39.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.854+0000 7f8281c66640 1 -- 172.21.15.157:0/3174097110 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c451629400 con 0x55c451628a30 2024-05-09T09:50:39.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.854+0000 7f8281c66640 1 --2- 172.21.15.157:0/3174097110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c451628a30 0x55c451628e30 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f82740e2320 tx=0x7f82740d4f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc9ed48bccafe33 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:39.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.854+0000 7f8153fff640 1 -- 172.21.15.157:0/3174097110 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82740bf470 con 0x55c451628a30 2024-05-09T09:50:39.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.854+0000 7f8153fff640 1 -- 172.21.15.157:0/3174097110 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82740d4430 con 0x55c451628a30 2024-05-09T09:50:39.857 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.854+0000 7f8153fff640 1 -- 172.21.15.157:0/3174097110 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82740bf610 con 0x55c451628a30 2024-05-09T09:50:39.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.854+0000 7f828414b980 1 -- 172.21.15.157:0/3174097110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c451628a30 msgr2=0x55c451628e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:39.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.854+0000 7f828414b980 1 --2- 172.21.15.157:0/3174097110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c451628a30 0x55c451628e30 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f82740e2320 tx=0x7f82740d4f70 comp rx=0 tx=0).stop 2024-05-09T09:50:39.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.854+0000 7f828414b980 1 -- 172.21.15.157:0/3174097110 shutdown_connections 2024-05-09T09:50:39.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.854+0000 7f828414b980 1 --2- 172.21.15.157:0/3174097110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c451628a30 0x55c451628e30 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:39.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.854+0000 7f828414b980 1 -- 172.21.15.157:0/3174097110 >> 172.21.15.157:0/3174097110 conn(0x55c451624e00 msgr2=0x55c451622e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:39.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.854+0000 7f828414b980 1 -- 172.21.15.157:0/3174097110 shutdown_connections 2024-05-09T09:50:39.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.854+0000 7f828414b980 1 -- 172.21.15.157:0/3174097110 wait complete. 2024-05-09T09:50:39.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.854+0000 7f828414b980 1 Processor -- start 2024-05-09T09:50:39.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.854+0000 7f828414b980 1 -- start start 2024-05-09T09:50:39.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.854+0000 7f828414b980 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c451628a30 0x55c45162fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:39.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.854+0000 7f828414b980 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55c4516299c0 con 0x55c451628a30 2024-05-09T09:50:39.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.858+0000 7f8281c66640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c451628a30 0x55c45162fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:39.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.858+0000 7f8281c66640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c451628a30 0x55c45162fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.157:42138/0 (socket says 172.21.15.157:42138) 2024-05-09T09:50:39.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.858+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 learned_addr learned my addr 172.21.15.157:0/457538275 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-05-09T09:50:39.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.858+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4516302e0 con 0x55c451628a30 2024-05-09T09:50:39.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.858+0000 7f8281c66640 1 --2- 172.21.15.157:0/457538275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c451628a30 0x55c45162fda0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f82740e5010 tx=0x7f82740d2f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:39.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.858+0000 7f81527fc640 1 -- 172.21.15.157:0/457538275 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82740d9c30 con 0x55c451628a30 2024-05-09T09:50:39.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.858+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c4516302e0 con 0x55c451628a30 2024-05-09T09:50:39.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.858+0000 7f81527fc640 1 -- 172.21.15.157:0/457538275 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82740d9dd0 con 0x55c451628a30 2024-05-09T09:50:39.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.858+0000 7f81527fc640 1 -- 172.21.15.157:0/457538275 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8274109070 con 0x55c451628a30 2024-05-09T09:50:39.861 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.858+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4516302e0 con 0x55c451628a30 2024-05-09T09:50:39.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.858+0000 7f81527fc640 1 -- 172.21.15.157:0/457538275 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f82740c7b60 con 0x55c451628a30 2024-05-09T09:50:39.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.858+0000 7f81527fc640 1 --2- 172.21.15.157:0/457538275 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f814c034bb0 0x7f814c037070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:39.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.858+0000 7f81527fc640 1 -- 172.21.15.157:0/457538275 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f82740f7070 con 0x55c451628a30 2024-05-09T09:50:39.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.858+0000 7f8281465640 1 --2- 172.21.15.157:0/457538275 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f814c034bb0 0x7f814c037070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:39.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.858+0000 7f828414b980 20 rados->read ofs=0 len=0 2024-05-09T09:50:39.864 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.858+0000 7f828414b980 1 --2- 172.21.15.157:0/457538275 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55c45163c920 0x55c45163ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:39.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.858+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45163f530 con 0x55c45163c920 2024-05-09T09:50:39.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.858+0000 7f8282467640 1 --2- 172.21.15.157:0/457538275 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55c45163c920 0x55c45163ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:39.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.858+0000 7f8281465640 1 --2- 172.21.15.157:0/457538275 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f814c034bb0 0x7f814c037070 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f826c0052a0 tx=0x7f826c013000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:39.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.858+0000 7f8282467640 1 --2- 172.21.15.157:0/457538275 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55c45163c920 0x55c45163ede0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:39.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f828414b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:50:39.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f828414b980 20 realm 2024-05-09T09:50:39.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f828414b980 20 rados->read ofs=0 len=0 2024-05-09T09:50:39.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45163f940 con 0x55c45163c920 2024-05-09T09:50:39.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f828414b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:50:39.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f828414b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-09T09:50:39.865 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f828414b980 20 rados->read ofs=0 len=0 2024-05-09T09:50:39.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451640210 con 0x55c45163c920 2024-05-09T09:50:39.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f828414b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:50:39.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f828414b980 20 rados->read ofs=0 len=0 2024-05-09T09:50:39.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x55c45163c920 2024-05-09T09:50:39.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f828414b980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:50:39.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f828414b980 20 rados->read ofs=0 len=0 2024-05-09T09:50:39.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f828414b980 1 --2- 172.21.15.157:0/457538275 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55c451641310 0x55c451643700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:39.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:5 5.3 5:c3597d65:::zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451643d10 con 0x55c451641310 2024-05-09T09:50:39.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f8281c66640 1 --2- 172.21.15.157:0/457538275 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55c451641310 0x55c451643700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:39.866 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f8281c66640 1 --2- 172.21.15.157:0/457538275 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55c451641310 0x55c451643700 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:39.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== osd_op_reply(5 zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:39.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f828414b980 20 rados_obj.operate() r=0 bl.length=993 2024-05-09T09:50:39.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f828414b980 20 searching for the correct realm 2024-05-09T09:50:39.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f828414b980 1 --2- 172.21.15.157:0/457538275 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55c451645c60 0x55c451648070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:39.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c451648740 con 0x55c451645c60 2024-05-09T09:50:39.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f8281465640 1 --2- 172.21.15.157:0/457538275 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55c451645c60 0x55c451648070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:39.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f8281465640 1 --2- 172.21.15.157:0/457538275 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55c451645c60 0x55c451648070 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:39.869 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f8281465640 1 --2- 172.21.15.157:0/457538275 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f826c03a040 0x7f826c03a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:39.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.862+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c451648740 con 0x7f826c03a040 2024-05-09T09:50:39.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.866+0000 7f8282467640 1 --2- 172.21.15.157:0/457538275 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f826c03a040 0x7f826c03a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:39.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.866+0000 7f8282467640 1 --2- 172.21.15.157:0/457538275 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f826c03a040 0x7f826c03a930 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:39.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.866+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:39.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.866+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x55c451641310 2024-05-09T09:50:39.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.866+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:39.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.866+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x55c45163c920 2024-05-09T09:50:39.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.866+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.866+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x55c45163c920 2024-05-09T09:50:39.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.866+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.870 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.866+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x55c451641310 2024-05-09T09:50:39.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.866+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:39.871 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.866+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x55c451641310 2024-05-09T09:50:39.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.866+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:39.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.866+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x7f826c03a040 2024-05-09T09:50:39.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.866+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:39.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.866+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x55c451645c60 2024-05-09T09:50:39.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.870+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.870+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x55c45163c920 2024-05-09T09:50:39.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.870+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.870+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x55c451641310 2024-05-09T09:50:39.873 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.870+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:39.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.870+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x55c45163c920 2024-05-09T09:50:39.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.870+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.870+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x7f826c03a040 2024-05-09T09:50:39.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.870+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:39.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.870+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x55c451645c60 2024-05-09T09:50:39.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.870+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.870+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x55c451645c60 2024-05-09T09:50:39.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.870+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.874 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.870+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x55c451641310 2024-05-09T09:50:39.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.870+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:39.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.870+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x55c451645c60 2024-05-09T09:50:39.876 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.870+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.870+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x55c451645c60 2024-05-09T09:50:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.874+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.874+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x55c45163c920 2024-05-09T09:50:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.874+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.874+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x55c45163c920 2024-05-09T09:50:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.874+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.874+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x55c451641310 2024-05-09T09:50:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.874+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.874+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x55c451645c60 2024-05-09T09:50:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.874+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.874+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x7f826c03a040 2024-05-09T09:50:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.874+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:39.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.874+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x55c45163c920 2024-05-09T09:50:39.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.874+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.878 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.874+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x55c451641310 2024-05-09T09:50:39.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.874+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=140b] v32'5 uv5 ondisk = 1) ==== 144+0+140 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:39.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.874+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x55c451645c60 2024-05-09T09:50:39.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.874+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.874+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x55c451641310 2024-05-09T09:50:39.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:39.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x7f826c03a040 2024-05-09T09:50:39.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:39.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x55c451645c60 2024-05-09T09:50:39.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x55c451641310 2024-05-09T09:50:39.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:39.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x55c45163c920 2024-05-09T09:50:39.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c4516405b0 con 0x7f826c03a040 2024-05-09T09:50:39.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:39.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f828414b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-09T09:50:39.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f828414b980 20 RGWRados::pool_iterate: got zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a 2024-05-09T09:50:39.882 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f828414b980 20 RGWRados::pool_iterate: got default.zone. 2024-05-09T09:50:39.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f828414b980 20 RGWRados::pool_iterate: got zone_info.b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 2024-05-09T09:50:39.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f828414b980 20 RGWRados::pool_iterate: got period_config.default 2024-05-09T09:50:39.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f828414b980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-09T09:50:39.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f828414b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-09T09:50:39.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f828414b980 20 rados->read ofs=0 len=0 2024-05-09T09:50:39.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4516445d0 con 0x55c45163c920 2024-05-09T09:50:39.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f828414b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:50:39.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f828414b980 20 rados->read ofs=0 len=0 2024-05-09T09:50:39.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4516445d0 con 0x55c45163c920 2024-05-09T09:50:39.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f828414b980 20 rados_obj.operate() r=0 bl.length=46 2024-05-09T09:50:39.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f828414b980 20 rados->read ofs=0 len=0 2024-05-09T09:50:39.883 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:40 5.e 5:720a29bb:::zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4516445d0 con 0x55c451645c60 2024-05-09T09:50:39.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 10 ==== osd_op_reply(40 zonegroup_info.69d0cd00-5979-46bf-b012-5813947e658a [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f828414b980 20 rados_obj.operate() r=0 bl.length=436 2024-05-09T09:50:39.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f828414b980 20 zone default found 2024-05-09T09:50:39.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f828414b980 4 Realm: () 2024-05-09T09:50:39.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f828414b980 4 ZoneGroup: default (69d0cd00-5979-46bf-b012-5813947e658a) 2024-05-09T09:50:39.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f828414b980 4 Zone: default (b73385e6-4d12-4d8e-98d6-6f8ed75f5b82) 2024-05-09T09:50:39.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f828414b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-09T09:50:39.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f828414b980 20 zonegroup default 2024-05-09T09:50:39.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f828414b980 20 rados->read ofs=0 len=0 2024-05-09T09:50:39.884 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.878+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451644f40 con 0x55c451641310 2024-05-09T09:50:39.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.882+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 11 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv5 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:39.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.882+0000 7f828414b980 20 rados_obj.operate() r=0 bl.length=187 2024-05-09T09:50:39.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.882+0000 7f828414b980 20 rados->read ofs=0 len=0 2024-05-09T09:50:39.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.882+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45164aa50 con 0x55c451645c60 2024-05-09T09:50:39.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.882+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.882+0000 7f828414b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:50:39.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.882+0000 7f828414b980 20 rados->read ofs=0 len=0 2024-05-09T09:50:39.886 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.882+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45164adf0 con 0x55c451645c60 2024-05-09T09:50:39.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.882+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.882+0000 7f828414b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-09T09:50:39.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.882+0000 7f828414b980 20 started sync module instance, tier type = 2024-05-09T09:50:39.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.882+0000 7f828414b980 20 started zone id=b73385e6-4d12-4d8e-98d6-6f8ed75f5b82 (name=default) with tier type = 2024-05-09T09:50:39.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.882+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c451649e90 con 0x7f826c03a040 2024-05-09T09:50:39.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.882+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 7 ==== osd_op_reply(44 notify.0 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:39.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.882+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94301667500720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c451649e90 con 0x7f826c03a040 2024-05-09T09:50:39.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.882+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45164b6c0 con 0x55c45163c920 2024-05-09T09:50:39.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.886+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94301667500720] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:39.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.886+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 15 ==== osd_op_reply(46 notify.1 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.886+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94301667504528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c451649e90 con 0x55c45163c920 2024-05-09T09:50:39.888 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.886+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45164c0d0 con 0x55c451645c60 2024-05-09T09:50:39.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.886+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94301667504528] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.886+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 13 ==== osd_op_reply(48 notify.2 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.886+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94301667498464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c451649e00 con 0x55c451645c60 2024-05-09T09:50:39.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.886+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45164ce20 con 0x7f826c03a040 2024-05-09T09:50:39.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.890+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 9 ==== osd_op_reply(50 notify.3 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:39.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.890+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94301667510912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45164d530 con 0x7f826c03a040 2024-05-09T09:50:39.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.890+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45164e030 con 0x55c45163c920 2024-05-09T09:50:39.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.890+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94301667498464] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.890+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94301667510912] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:39.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.890+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 17 ==== osd_op_reply(52 notify.4 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.890+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94301667515168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45164dff0 con 0x55c45163c920 2024-05-09T09:50:39.893 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.890+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45164e450 con 0x55c451641310 2024-05-09T09:50:39.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.894+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94301667515168] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.894+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 12 ==== osd_op_reply(54 notify.5 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:39.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.894+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94301667512192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45164e840 con 0x55c451641310 2024-05-09T09:50:39.895 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.894+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45164f090 con 0x55c451641310 2024-05-09T09:50:39.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.894+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94301667512192] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:39.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.894+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 14 ==== osd_op_reply(56 notify.6 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:39.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.894+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94301667519456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45164f000 con 0x55c451641310 2024-05-09T09:50:39.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.894+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45164fe10 con 0x55c451641310 2024-05-09T09:50:39.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.898+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94301667519456] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:39.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.898+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 16 ==== osd_op_reply(58 notify.7 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:39.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.898+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94301667521568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45164fcf0 con 0x55c451641310 2024-05-09T09:50:39.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.898+0000 7f828414b980 20 add_watcher() i=0 2024-05-09T09:50:39.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.898+0000 7f828414b980 20 add_watcher() i=1 2024-05-09T09:50:39.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.898+0000 7f828414b980 20 add_watcher() i=2 2024-05-09T09:50:39.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.898+0000 7f828414b980 20 add_watcher() i=3 2024-05-09T09:50:39.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.898+0000 7f828414b980 20 add_watcher() i=4 2024-05-09T09:50:39.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.898+0000 7f828414b980 20 add_watcher() i=5 2024-05-09T09:50:39.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.898+0000 7f828414b980 20 add_watcher() i=6 2024-05-09T09:50:39.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.898+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94301667521568] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:39.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.902+0000 7f828414b980 20 add_watcher() i=7 2024-05-09T09:50:39.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.902+0000 7f828414b980 2 all 8 watchers are set, enabling cache 2024-05-09T09:50:39.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.902+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4516531d0 con 0x55c45163c920 2024-05-09T09:50:39.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.902+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.902+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94301667523088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c451650690 con 0x55c45163c920 2024-05-09T09:50:39.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.902+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94301667523088] v32'496 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.902+0000 7f8136fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:50:39.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.902+0000 7f828414b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-09T09:50:39.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.902+0000 7f828414b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-09T09:50:39.905 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.902+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165ba20 con 0x55c45163c920 2024-05-09T09:50:39.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.906+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'112 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.906 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.906+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165c070 con 0x55c451641310 2024-05-09T09:50:39.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.906+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'108 uv66 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:39.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.906+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165c070 con 0x55c451645c60 2024-05-09T09:50:39.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.906+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'107 uv106 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.910 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.906+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165cb30 con 0x55c45163c920 2024-05-09T09:50:39.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.910+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'497 uv296 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.910+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4516598f0 con 0x7f826c03a040 2024-05-09T09:50:39.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.910+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'305 uv185 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:39.913 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.910+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c451659890 con 0x55c451645c60 2024-05-09T09:50:39.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.914+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'204 uv125 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.914 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.914+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165d860 con 0x55c45163c920 2024-05-09T09:50:39.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.914+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'107 uv67 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.914+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165d8f0 con 0x55c451641310 2024-05-09T09:50:39.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.917+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'203 uv124 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:39.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.917+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165d9a0 con 0x7f826c03a040 2024-05-09T09:50:39.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.917+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'105 uv65 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:39.921 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.917+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165da50 con 0x55c451645c60 2024-05-09T09:50:39.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.921+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'111 uv71 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.923 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.921+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165de80 con 0x7f826c03a040 2024-05-09T09:50:39.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.921+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'306 uv187 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:39.924 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.921+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165de80 con 0x55c451641310 2024-05-09T09:50:39.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.925+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'115 uv68 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:39.927 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.925+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165de80 con 0x7f826c03a040 2024-05-09T09:50:39.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.925+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'105 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:39.928 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.925+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165de80 con 0x55c451641310 2024-05-09T09:50:39.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.929+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'210 uv130 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:39.930 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.929+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165de80 con 0x55c45163c920 2024-05-09T09:50:39.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.929+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'498 uv298 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.932 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.929+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165de80 con 0x55c451645c60 2024-05-09T09:50:39.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.933+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'299 uv181 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.933+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165df10 con 0x7f826c03a040 2024-05-09T09:50:39.935 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.933+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'307 uv183 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:39.936 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.933+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165df10 con 0x55c451645c60 2024-05-09T09:50:39.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.933+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'105 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.937 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.933+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165dfa0 con 0x55c45163c920 2024-05-09T09:50:39.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.937+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'113 uv73 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.939 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.937+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165dfa0 con 0x55c45163c920 2024-05-09T09:50:39.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.937+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'499 uv294 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.941 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.937+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165dfa0 con 0x55c451645c60 2024-05-09T09:50:39.943 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.941+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'300 uv177 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.944 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.941+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165e030 con 0x7f826c03a040 2024-05-09T09:50:39.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.941+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'117 uv77 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:39.945 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.941+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165e030 con 0x55c451645c60 2024-05-09T09:50:39.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.945+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'107 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.946 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.945+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165e030 con 0x55c451645c60 2024-05-09T09:50:39.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.945+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'111 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.948 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.945+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165e170 con 0x55c451645c60 2024-05-09T09:50:39.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.949+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'102 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.950 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.949+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165e170 con 0x55c451645c60 2024-05-09T09:50:39.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.949+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'205 uv123 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.952 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.949+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165e600 con 0x55c451641310 2024-05-09T09:50:39.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.953+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'107 uv67 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:39.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.953+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165e600 con 0x55c451645c60 2024-05-09T09:50:39.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.953+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'108 uv65 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.956 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.953+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165e600 con 0x55c451641310 2024-05-09T09:50:39.958 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.957+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'204 uv122 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:39.959 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.957+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165e600 con 0x55c451645c60 2024-05-09T09:50:39.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.957+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'301 uv179 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.957+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165e600 con 0x55c451641310 2024-05-09T09:50:39.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.961+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'211 uv128 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:39.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.961+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45165e600 con 0x7f826c03a040 2024-05-09T09:50:39.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.965+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'111 uv71 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:39.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.965+0000 7f8135fe3640 20 reqs_thread_entry: start 2024-05-09T09:50:39.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.965+0000 7f828414b980 20 init_complete bucket index max shards: 11 2024-05-09T09:50:39.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.965+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-05-09T09:50:39.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.965+0000 7f80a77fe640 20 reqs_thread_entry: start 2024-05-09T09:50:39.967 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.965+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:94 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x7f826c03a040 2024-05-09T09:50:39.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.965+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 18 ==== osd_op_reply(94 gc.16 [call] v32'308 uv308 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:39.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.965+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:95 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x7f826c03a040 2024-05-09T09:50:39.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.965+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 19 ==== osd_op_reply(95 gc.16 [call out=15b] v0'0 uv308 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:39.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.965+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:39.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.965+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:96 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679ae0 con 0x7f826c03a040 2024-05-09T09:50:39.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.965+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 20 ==== osd_op_reply(96 gc.16 [call out=24b] v0'0 uv308 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:39.970 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.965+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:97 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x7f826c03a040 2024-05-09T09:50:39.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.969+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 21 ==== osd_op_reply(97 gc.16 [call out=15b] v0'0 uv308 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:39.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.969+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:39.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.969+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:98 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x7f826c03a040 2024-05-09T09:50:39.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.969+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 22 ==== osd_op_reply(98 gc.16 [call out=15b] v0'0 uv308 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:39.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.969+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:39.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.969+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:99 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x7f826c03a040 2024-05-09T09:50:39.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.969+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 23 ==== osd_op_reply(99 gc.16 [call] v32'309 uv309 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:39.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.969+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-05-09T09:50:39.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.969+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:100 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:39.973 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.969+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 27 ==== osd_op_reply(100 gc.17 [call] v32'106 uv106 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.969+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:101 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:39.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.973+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 28 ==== osd_op_reply(101 gc.17 [call out=15b] v0'0 uv106 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.973+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:39.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.973+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:102 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679ae0 con 0x55c451645c60 2024-05-09T09:50:39.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.973+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 29 ==== osd_op_reply(102 gc.17 [call out=24b] v0'0 uv106 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.973+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:103 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:39.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.973+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 30 ==== osd_op_reply(103 gc.17 [call out=15b] v0'0 uv106 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.973+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:39.975 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.973+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:104 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:39.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.973+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 31 ==== osd_op_reply(104 gc.17 [call out=15b] v0'0 uv106 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.973+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:39.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.973+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:105 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:39.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.973+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 32 ==== osd_op_reply(105 gc.17 [call] v32'107 uv107 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.976 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.973+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-05-09T09:50:39.977 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.973+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:106 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c45163c920 2024-05-09T09:50:39.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.977+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 27 ==== osd_op_reply(106 gc.18 [call] v32'114 uv114 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.977+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:107 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c45163c920 2024-05-09T09:50:39.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.977+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 28 ==== osd_op_reply(107 gc.18 [call out=15b] v0'0 uv114 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.977+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:39.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.977+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:108 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679ae0 con 0x55c45163c920 2024-05-09T09:50:39.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.977+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 29 ==== osd_op_reply(108 gc.18 [call out=24b] v0'0 uv114 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.979 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.977+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:109 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c45163c920 2024-05-09T09:50:39.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.977+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 30 ==== osd_op_reply(109 gc.18 [call out=15b] v0'0 uv114 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.977+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:39.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.977+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:110 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c45163c920 2024-05-09T09:50:39.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.977+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 31 ==== osd_op_reply(110 gc.18 [call out=15b] v0'0 uv114 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.977+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:39.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.977+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:111 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c45163c920 2024-05-09T09:50:39.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.977+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 32 ==== osd_op_reply(111 gc.18 [call] v32'115 uv115 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.981+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-05-09T09:50:39.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.981+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:112 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c45163c920 2024-05-09T09:50:39.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.981+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 33 ==== osd_op_reply(112 gc.19 [call] v32'500 uv500 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.981+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:113 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c45163c920 2024-05-09T09:50:39.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.981+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 34 ==== osd_op_reply(113 gc.19 [call out=15b] v0'0 uv500 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.981+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:39.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.981+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:114 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679ae0 con 0x55c45163c920 2024-05-09T09:50:39.984 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.981+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 35 ==== osd_op_reply(114 gc.19 [call out=24b] v0'0 uv500 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.981+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:115 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c45163c920 2024-05-09T09:50:39.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.981+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 36 ==== osd_op_reply(115 gc.19 [call out=15b] v0'0 uv500 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.981+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:39.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.981+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:116 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c45163c920 2024-05-09T09:50:39.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.981+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 37 ==== osd_op_reply(116 gc.19 [call out=15b] v0'0 uv500 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.985 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.981+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:39.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.981+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:117 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c45163c920 2024-05-09T09:50:39.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.985+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 38 ==== osd_op_reply(117 gc.19 [call] v32'501 uv501 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:39.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.985+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-05-09T09:50:39.986 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.985+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:118 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:39.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.985+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 33 ==== osd_op_reply(118 gc.20 [call] v32'302 uv302 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.985+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:119 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:39.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.985+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 34 ==== osd_op_reply(119 gc.20 [call out=15b] v0'0 uv302 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.985+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:39.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.985+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:120 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679ae0 con 0x55c451645c60 2024-05-09T09:50:39.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.985+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 35 ==== osd_op_reply(120 gc.20 [call out=24b] v0'0 uv302 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.989 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.985+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:121 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:39.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.985+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 36 ==== osd_op_reply(121 gc.20 [call out=15b] v0'0 uv302 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.985+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:39.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.985+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:122 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:39.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.985+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 37 ==== osd_op_reply(122 gc.20 [call out=15b] v0'0 uv302 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.985+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:39.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.985+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:123 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:39.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.989+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 38 ==== osd_op_reply(123 gc.20 [call] v32'303 uv303 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.989+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-05-09T09:50:39.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.989+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:124 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x7f826c03a040 2024-05-09T09:50:39.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.989+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 24 ==== osd_op_reply(124 gc.21 [call] v32'118 uv118 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:39.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.989+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:125 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x7f826c03a040 2024-05-09T09:50:39.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.989+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 25 ==== osd_op_reply(125 gc.21 [call out=15b] v0'0 uv118 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:39.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.989+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:39.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.989+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:126 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679ae0 con 0x7f826c03a040 2024-05-09T09:50:39.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.989+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 26 ==== osd_op_reply(126 gc.21 [call out=24b] v0'0 uv118 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:39.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.989+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:127 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x7f826c03a040 2024-05-09T09:50:39.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.989+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 27 ==== osd_op_reply(127 gc.21 [call out=15b] v0'0 uv118 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:39.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.989+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:39.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.989+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:128 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x7f826c03a040 2024-05-09T09:50:39.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.989+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 28 ==== osd_op_reply(128 gc.21 [call out=15b] v0'0 uv118 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:39.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.993+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:39.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.993+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:129 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x7f826c03a040 2024-05-09T09:50:39.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.993+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 29 ==== osd_op_reply(129 gc.21 [call] v32'119 uv119 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:39.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.993+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-05-09T09:50:39.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.993+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:130 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:39.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.993+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 39 ==== osd_op_reply(130 gc.22 [call] v32'108 uv108 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.993+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:131 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:39.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.993+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 40 ==== osd_op_reply(131 gc.22 [call out=15b] v0'0 uv108 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.993+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:39.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.993+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:132 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679ae0 con 0x55c451645c60 2024-05-09T09:50:39.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.993+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 41 ==== osd_op_reply(132 gc.22 [call out=24b] v0'0 uv108 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.993+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:133 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:39.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.993+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 42 ==== osd_op_reply(133 gc.22 [call out=15b] v0'0 uv108 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.993+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:39.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.993+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:134 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:39.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.993+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 43 ==== osd_op_reply(134 gc.22 [call out=15b] v0'0 uv108 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:39.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.993+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:39.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.993+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:135 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:39.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.997+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 44 ==== osd_op_reply(135 gc.22 [call] v32'109 uv109 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.997+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-05-09T09:50:40.000 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.997+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:136 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:40.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.997+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 45 ==== osd_op_reply(136 gc.23 [call] v32'112 uv112 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.997+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:137 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:40.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.997+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 46 ==== osd_op_reply(137 gc.23 [call out=15b] v0'0 uv112 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.997+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.997+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:138 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679ae0 con 0x55c451645c60 2024-05-09T09:50:40.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.997+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 47 ==== osd_op_reply(138 gc.23 [call out=24b] v0'0 uv112 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.997+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:139 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:40.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.997+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 48 ==== osd_op_reply(139 gc.23 [call out=15b] v0'0 uv112 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.002 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.997+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:40.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:39.997+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:140 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:40.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.001+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 49 ==== osd_op_reply(140 gc.23 [call out=15b] v0'0 uv112 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.001+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.001+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:141 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:40.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.001+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 50 ==== osd_op_reply(141 gc.23 [call] v32'113 uv113 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.003 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.001+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-05-09T09:50:40.004 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.001+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:142 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:40.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.001+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 51 ==== osd_op_reply(142 gc.24 [call] v32'103 uv103 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.005 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.001+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:143 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:40.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.001+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 52 ==== osd_op_reply(143 gc.24 [call out=15b] v0'0 uv103 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.001+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.001+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:144 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679ae0 con 0x55c451645c60 2024-05-09T09:50:40.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.001+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 53 ==== osd_op_reply(144 gc.24 [call out=24b] v0'0 uv103 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.006 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.001+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:145 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:40.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.005+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 54 ==== osd_op_reply(145 gc.24 [call out=15b] v0'0 uv103 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.005+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:40.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.005+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:146 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:40.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.005+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 55 ==== osd_op_reply(146 gc.24 [call out=15b] v0'0 uv103 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.005+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.007 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.005+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:147 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:40.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.005+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 56 ==== osd_op_reply(147 gc.24 [call] v32'104 uv104 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.005+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-05-09T09:50:40.008 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.005+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:148 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:40.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.005+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 57 ==== osd_op_reply(148 gc.25 [call] v32'206 uv206 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.005+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:149 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:40.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.009+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 58 ==== osd_op_reply(149 gc.25 [call out=15b] v0'0 uv206 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.009+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.009+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:150 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679ae0 con 0x55c451645c60 2024-05-09T09:50:40.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.009+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 59 ==== osd_op_reply(150 gc.25 [call out=24b] v0'0 uv206 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.009+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:151 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:40.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.009+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 60 ==== osd_op_reply(151 gc.25 [call out=15b] v0'0 uv206 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.009+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:40.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.009+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:152 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:40.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.009+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 61 ==== osd_op_reply(152 gc.25 [call out=15b] v0'0 uv206 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.009+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.009+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:153 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:40.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.009+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 62 ==== osd_op_reply(153 gc.25 [call] v32'207 uv207 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.009+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-05-09T09:50:40.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.009+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:154 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451641310 2024-05-09T09:50:40.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.013+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 25 ==== osd_op_reply(154 gc.26 [call] v32'108 uv108 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.013+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:155 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451641310 2024-05-09T09:50:40.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.013+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 26 ==== osd_op_reply(155 gc.26 [call out=15b] v0'0 uv108 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.013+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.013+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:156 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679ae0 con 0x55c451641310 2024-05-09T09:50:40.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.013+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 27 ==== osd_op_reply(156 gc.26 [call out=24b] v0'0 uv108 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.016 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.013+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:157 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451641310 2024-05-09T09:50:40.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.013+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 28 ==== osd_op_reply(157 gc.26 [call out=15b] v0'0 uv108 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.013+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:40.017 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.013+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:158 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451641310 2024-05-09T09:50:40.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.013+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 29 ==== osd_op_reply(158 gc.26 [call out=15b] v0'0 uv108 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.013+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.018 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.013+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:159 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451641310 2024-05-09T09:50:40.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.017+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 30 ==== osd_op_reply(159 gc.26 [call] v32'109 uv109 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.017+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-05-09T09:50:40.020 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.017+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:160 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:40.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.017+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 63 ==== osd_op_reply(160 gc.27 [call] v32'109 uv109 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.017+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:161 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:40.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.021+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 64 ==== osd_op_reply(161 gc.27 [call out=15b] v0'0 uv109 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.022 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.021+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.021+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:162 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679ae0 con 0x55c451645c60 2024-05-09T09:50:40.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.021+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 65 ==== osd_op_reply(162 gc.27 [call out=24b] v0'0 uv109 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.021+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:163 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:40.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.021+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 66 ==== osd_op_reply(163 gc.27 [call out=15b] v0'0 uv109 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.021+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:40.023 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.021+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:164 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:40.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.021+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 67 ==== osd_op_reply(164 gc.27 [call out=15b] v0'0 uv109 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.021+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.021+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:165 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:40.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.021+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 68 ==== osd_op_reply(165 gc.27 [call] v32'110 uv110 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.021+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-05-09T09:50:40.024 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.021+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:166 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451641310 2024-05-09T09:50:40.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.025+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 31 ==== osd_op_reply(166 gc.28 [call] v32'205 uv205 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.026 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.025+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:167 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451641310 2024-05-09T09:50:40.027 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.025+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 32 ==== osd_op_reply(167 gc.28 [call out=15b] v0'0 uv205 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.025+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.025+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:168 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679ae0 con 0x55c451641310 2024-05-09T09:50:40.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.025+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 33 ==== osd_op_reply(168 gc.28 [call out=24b] v0'0 uv205 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.028 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.025+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:169 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451641310 2024-05-09T09:50:40.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.025+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 34 ==== osd_op_reply(169 gc.28 [call out=15b] v0'0 uv205 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.025+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:40.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.025+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:170 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451641310 2024-05-09T09:50:40.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.025+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 35 ==== osd_op_reply(170 gc.28 [call out=15b] v0'0 uv205 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.025+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.030 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.025+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:171 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451641310 2024-05-09T09:50:40.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.029+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 36 ==== osd_op_reply(171 gc.28 [call] v32'206 uv206 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.029+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-05-09T09:50:40.032 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.029+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:172 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:40.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.029+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 69 ==== osd_op_reply(172 gc.29 [call] v32'304 uv304 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.033+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:173 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:40.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.033+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 70 ==== osd_op_reply(173 gc.29 [call out=15b] v0'0 uv304 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.033+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.033+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:174 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679ae0 con 0x55c451645c60 2024-05-09T09:50:40.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.033+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 71 ==== osd_op_reply(174 gc.29 [call out=24b] v0'0 uv304 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.033+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:175 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:40.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.033+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 72 ==== osd_op_reply(175 gc.29 [call out=15b] v0'0 uv304 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.033+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:40.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.033+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:176 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:40.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.033+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 73 ==== osd_op_reply(176 gc.29 [call out=15b] v0'0 uv304 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.033+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.036 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.033+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:177 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:40.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.037+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 74 ==== osd_op_reply(177 gc.29 [call] v32'305 uv305 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.037+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-05-09T09:50:40.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.037+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:178 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451641310 2024-05-09T09:50:40.040 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.037+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 37 ==== osd_op_reply(178 gc.30 [call] v32'212 uv212 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.037+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:179 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451641310 2024-05-09T09:50:40.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.037+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 38 ==== osd_op_reply(179 gc.30 [call out=15b] v0'0 uv212 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.037+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.041 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.037+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:180 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679ae0 con 0x55c451641310 2024-05-09T09:50:40.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.037+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 39 ==== osd_op_reply(180 gc.30 [call out=24b] v0'0 uv212 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.042 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.037+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:181 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451641310 2024-05-09T09:50:40.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.041+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 40 ==== osd_op_reply(181 gc.30 [call out=15b] v0'0 uv212 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.041+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:40.043 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.041+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:182 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451641310 2024-05-09T09:50:40.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.041+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 41 ==== osd_op_reply(182 gc.30 [call out=15b] v0'0 uv212 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.041+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.044 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.041+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:183 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451641310 2024-05-09T09:50:40.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.045+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 42 ==== osd_op_reply(183 gc.30 [call] v32'213 uv213 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.045+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-05-09T09:50:40.047 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.045+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:184 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x7f826c03a040 2024-05-09T09:50:40.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.045+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 30 ==== osd_op_reply(184 gc.31 [call] v32'112 uv112 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.045+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:185 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x7f826c03a040 2024-05-09T09:50:40.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.045+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 31 ==== osd_op_reply(185 gc.31 [call out=15b] v0'0 uv112 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.049 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.045+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.045+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:186 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679ae0 con 0x7f826c03a040 2024-05-09T09:50:40.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.045+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 32 ==== osd_op_reply(186 gc.31 [call out=24b] v0'0 uv112 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.045+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x7f826c03a040 2024-05-09T09:50:40.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.045+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 33 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv112 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.045+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:40.050 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.045+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x7f826c03a040 2024-05-09T09:50:40.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.049+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 34 ==== osd_op_reply(188 gc.31 [call out=15b] v0'0 uv112 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.049+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.051 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.049+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x7f826c03a040 2024-05-09T09:50:40.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.049+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 35 ==== osd_op_reply(189 gc.31 [call] v32'113 uv113 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.049+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-05-09T09:50:40.052 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.049+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:190 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c45163c920 2024-05-09T09:50:40.054 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.053+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 39 ==== osd_op_reply(190 gc.0 [call] v32'113 uv113 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:40.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.053+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:191 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c45163c920 2024-05-09T09:50:40.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.053+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 40 ==== osd_op_reply(191 gc.0 [call out=15b] v0'0 uv113 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:40.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.053+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.055 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.053+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:192 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679ae0 con 0x55c45163c920 2024-05-09T09:50:40.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.053+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 41 ==== osd_op_reply(192 gc.0 [call out=24b] v0'0 uv113 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:40.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.053+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:193 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c45163c920 2024-05-09T09:50:40.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.053+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 42 ==== osd_op_reply(193 gc.0 [call out=15b] v0'0 uv113 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:40.056 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.053+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:40.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.053+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:194 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c45163c920 2024-05-09T09:50:40.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.053+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 43 ==== osd_op_reply(194 gc.0 [call out=15b] v0'0 uv113 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:40.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.053+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.057 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.053+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:195 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c45163c920 2024-05-09T09:50:40.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.057+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 44 ==== osd_op_reply(195 gc.0 [call] v32'114 uv114 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:40.058 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.057+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-05-09T09:50:40.059 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.057+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:196 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451641310 2024-05-09T09:50:40.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.057+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 43 ==== osd_op_reply(196 gc.1 [call] v32'109 uv109 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.061 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.057+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:197 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451641310 2024-05-09T09:50:40.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.057+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 44 ==== osd_op_reply(197 gc.1 [call out=15b] v0'0 uv109 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.057+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.062 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.057+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:198 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679ae0 con 0x55c451641310 2024-05-09T09:50:40.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.061+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 45 ==== osd_op_reply(198 gc.1 [call out=24b] v0'0 uv109 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.063 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.061+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:199 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451641310 2024-05-09T09:50:40.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.061+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 46 ==== osd_op_reply(199 gc.1 [call out=15b] v0'0 uv109 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.061+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:40.064 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.061+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:200 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451641310 2024-05-09T09:50:40.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.061+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 47 ==== osd_op_reply(200 gc.1 [call out=15b] v0'0 uv109 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.061+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.065 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.061+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:201 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451641310 2024-05-09T09:50:40.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.065+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 48 ==== osd_op_reply(201 gc.1 [call] v32'110 uv110 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.065+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-05-09T09:50:40.068 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.065+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:202 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:40.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.069+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 75 ==== osd_op_reply(202 gc.2 [call] v32'108 uv108 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.069+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:203 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:40.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.069+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 76 ==== osd_op_reply(203 gc.2 [call out=15b] v0'0 uv108 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.069+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.071 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.069+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:204 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679ae0 con 0x55c451645c60 2024-05-09T09:50:40.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.069+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 77 ==== osd_op_reply(204 gc.2 [call out=24b] v0'0 uv108 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.069+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:205 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:40.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.069+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 78 ==== osd_op_reply(205 gc.2 [call out=15b] v0'0 uv108 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.069+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:40.072 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.069+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:206 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167aaf0 con 0x55c451645c60 2024-05-09T09:50:40.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.069+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 79 ==== osd_op_reply(206 gc.2 [call out=1716b] v0'0 uv108 ondisk = 0) ==== 148+0+1716 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.069+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-05-09T09:50:40.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.069+0000 7f828414b980 20 garbage collection: RGWGC::process iterating over entry tag='b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.10477888846360693567', time=2024-05-09T09:50:47.724770+0000, chain.objs.size()=7 2024-05-09T09:50:40.073 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.069+0000 7f828414b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11__shadow_.eTM0i7mIhVCOm6uSBr8fUKA69L-aZ_P_1 2024-05-09T09:50:40.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.069+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:207 3.13s0 3:caad4d69:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11__shadow_.eTM0i7mIhVCOm6uSBr8fUKA69L-aZ_P_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c451658920 con 0x55c451645c60 2024-05-09T09:50:40.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.069+0000 7f828414b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11__shadow_.eTM0i7mIhVCOm6uSBr8fUKA69L-aZ_P_2 2024-05-09T09:50:40.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.069+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:208 3.3cs0 3:3cfb3f9b:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11__shadow_.eTM0i7mIhVCOm6uSBr8fUKA69L-aZ_P_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167df90 con 0x7f826c03a040 2024-05-09T09:50:40.074 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.069+0000 7f828414b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11__shadow_.eTM0i7mIhVCOm6uSBr8fUKA69L-aZ_P_3 2024-05-09T09:50:40.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.069+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:209 3.28s0 3:14031dcf:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11__shadow_.eTM0i7mIhVCOm6uSBr8fUKA69L-aZ_P_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4516809b0 con 0x55c451645c60 2024-05-09T09:50:40.075 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.069+0000 7f828414b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11__shadow_.eTM0i7mIhVCOm6uSBr8fUKA69L-aZ_P_4 2024-05-09T09:50:40.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.069+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:210 3.1as0 3:5940b913:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11__shadow_.eTM0i7mIhVCOm6uSBr8fUKA69L-aZ_P_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4516832c0 con 0x55c45163c920 2024-05-09T09:50:40.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.069+0000 7f828414b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11__shadow_.eTM0i7mIhVCOm6uSBr8fUKA69L-aZ_P_5 2024-05-09T09:50:40.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.069+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:211 3.1cs0 3:3b3df3f7:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11__shadow_.eTM0i7mIhVCOm6uSBr8fUKA69L-aZ_P_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4516809b0 con 0x55c45163c920 2024-05-09T09:50:40.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.069+0000 7f828414b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11__shadow_.eTM0i7mIhVCOm6uSBr8fUKA69L-aZ_P_6 2024-05-09T09:50:40.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.069+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:212 3.2cs0 3:3409e99e:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11__shadow_.eTM0i7mIhVCOm6uSBr8fUKA69L-aZ_P_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4516809b0 con 0x55c451645c60 2024-05-09T09:50:40.076 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.073+0000 7f828414b980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11__shadow_.eTM0i7mIhVCOm6uSBr8fUKA69L-aZ_P_7 2024-05-09T09:50:40.077 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.073+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:213 3.3es0 3:7de4f1f0:::b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11__shadow_.eTM0i7mIhVCOm6uSBr8fUKA69L-aZ_P_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45168a610 con 0x55c451641310 2024-05-09T09:50:40.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.077+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 36 ==== osd_op_reply(208 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11__shadow_.eTM0i7mIhVCOm6uSBr8fUKA69L-aZ_P_2 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.077+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 45 ==== osd_op_reply(211 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11__shadow_.eTM0i7mIhVCOm6uSBr8fUKA69L-aZ_P_5 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:40.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.077+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 46 ==== osd_op_reply(210 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11__shadow_.eTM0i7mIhVCOm6uSBr8fUKA69L-aZ_P_4 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:40.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.077+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 49 ==== osd_op_reply(213 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11__shadow_.eTM0i7mIhVCOm6uSBr8fUKA69L-aZ_P_7 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.077+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 80 ==== osd_op_reply(209 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11__shadow_.eTM0i7mIhVCOm6uSBr8fUKA69L-aZ_P_3 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.081 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.077+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 81 ==== osd_op_reply(207 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11__shadow_.eTM0i7mIhVCOm6uSBr8fUKA69L-aZ_P_1 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.081+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 82 ==== osd_op_reply(212 b73385e6-4d12-4d8e-98d6-6f8ed75f5b82.4238.11__shadow_.eTM0i7mIhVCOm6uSBr8fUKA69L-aZ_P_6 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.081+0000 7f828414b980 5 garbage collection: RGWGC::process removing entries, marker: 2024-05-09T09:50:40.084 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.081+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:214 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c451658310 con 0x55c451645c60 2024-05-09T09:50:40.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.085+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 83 ==== osd_op_reply(214 gc.2 [call] v32'109 uv109 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.087 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.085+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:215 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c451658310 con 0x55c451645c60 2024-05-09T09:50:40.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.085+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 84 ==== osd_op_reply(215 gc.2 [call] v32'110 uv110 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.085+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-05-09T09:50:40.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.085+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:216 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c451658310 con 0x55c45163c920 2024-05-09T09:50:40.091 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.089+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 47 ==== osd_op_reply(216 gc.3 [call] v32'502 uv502 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:40.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.089+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:217 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451658310 con 0x55c45163c920 2024-05-09T09:50:40.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.089+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 48 ==== osd_op_reply(217 gc.3 [call out=15b] v0'0 uv502 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:40.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.089+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.089+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:218 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167f3e0 con 0x55c45163c920 2024-05-09T09:50:40.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.089+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 49 ==== osd_op_reply(218 gc.3 [call out=24b] v0'0 uv502 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:40.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.089+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:219 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451658310 con 0x55c45163c920 2024-05-09T09:50:40.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.089+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 50 ==== osd_op_reply(219 gc.3 [call out=15b] v0'0 uv502 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:40.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.089+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:40.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.089+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:220 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451658310 con 0x55c45163c920 2024-05-09T09:50:40.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.089+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 51 ==== osd_op_reply(220 gc.3 [call out=15b] v0'0 uv502 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:40.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.089+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.089+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:221 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c451658310 con 0x55c45163c920 2024-05-09T09:50:40.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.093+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 52 ==== osd_op_reply(221 gc.3 [call] v32'503 uv503 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:40.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.093+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-05-09T09:50:40.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.093+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:222 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c451658310 con 0x7f826c03a040 2024-05-09T09:50:40.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.097+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 37 ==== osd_op_reply(222 gc.4 [call] v32'310 uv310 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.098 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.097+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:223 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451658310 con 0x7f826c03a040 2024-05-09T09:50:40.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.097+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 38 ==== osd_op_reply(223 gc.4 [call out=15b] v0'0 uv310 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.097+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.097+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:224 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451658310 con 0x7f826c03a040 2024-05-09T09:50:40.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.097+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 39 ==== osd_op_reply(224 gc.4 [call out=24b] v0'0 uv310 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.099 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.097+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:225 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451658310 con 0x7f826c03a040 2024-05-09T09:50:40.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.097+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 40 ==== osd_op_reply(225 gc.4 [call out=15b] v0'0 uv310 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.097+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:40.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.097+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:226 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4516802f0 con 0x7f826c03a040 2024-05-09T09:50:40.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.097+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 41 ==== osd_op_reply(226 gc.4 [call out=15b] v0'0 uv310 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.097+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.100 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.097+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:227 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4516802f0 con 0x7f826c03a040 2024-05-09T09:50:40.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.101+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 42 ==== osd_op_reply(227 gc.4 [call] v32'311 uv311 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.101+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-05-09T09:50:40.102 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.101+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:228 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4516802f0 con 0x55c451645c60 2024-05-09T09:50:40.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.101+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 85 ==== osd_op_reply(228 gc.5 [call] v32'208 uv208 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.101+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:229 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4516802f0 con 0x55c451645c60 2024-05-09T09:50:40.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.101+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 86 ==== osd_op_reply(229 gc.5 [call out=15b] v0'0 uv208 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.101+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.105 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.101+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:230 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167f2e0 con 0x55c451645c60 2024-05-09T09:50:40.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.101+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 87 ==== osd_op_reply(230 gc.5 [call out=24b] v0'0 uv208 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.101+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:231 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c4516802f0 con 0x55c451645c60 2024-05-09T09:50:40.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.101+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 88 ==== osd_op_reply(231 gc.5 [call out=15b] v0'0 uv208 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.105+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:40.106 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.105+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:232 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ba30 con 0x55c451645c60 2024-05-09T09:50:40.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.105+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 89 ==== osd_op_reply(232 gc.5 [call out=15b] v0'0 uv208 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.105+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.107 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.105+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:233 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ba30 con 0x55c451645c60 2024-05-09T09:50:40.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.105+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 90 ==== osd_op_reply(233 gc.5 [call] v32'209 uv209 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.105+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-05-09T09:50:40.109 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.105+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:234 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ba30 con 0x55c45163c920 2024-05-09T09:50:40.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.109+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 53 ==== osd_op_reply(234 gc.6 [call] v32'108 uv108 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:40.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.109+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:235 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ba30 con 0x55c45163c920 2024-05-09T09:50:40.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.109+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 54 ==== osd_op_reply(235 gc.6 [call out=15b] v0'0 uv108 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:40.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.109+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.109+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:236 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ce00 con 0x55c45163c920 2024-05-09T09:50:40.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.109+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 55 ==== osd_op_reply(236 gc.6 [call out=24b] v0'0 uv108 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:40.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.109+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:237 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ba30 con 0x55c45163c920 2024-05-09T09:50:40.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.109+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 56 ==== osd_op_reply(237 gc.6 [call out=15b] v0'0 uv108 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:40.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.109+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:40.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.109+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:238 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ba30 con 0x55c45163c920 2024-05-09T09:50:40.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.113+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 57 ==== osd_op_reply(238 gc.6 [call out=15b] v0'0 uv108 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:40.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.113+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.113+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:239 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ba30 con 0x55c45163c920 2024-05-09T09:50:40.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.113+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 58 ==== osd_op_reply(239 gc.6 [call] v32'109 uv109 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:40.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.113+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-05-09T09:50:40.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.113+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:240 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ba30 con 0x55c451641310 2024-05-09T09:50:40.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.117+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 50 ==== osd_op_reply(240 gc.7 [call] v32'207 uv207 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.117+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:241 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ba30 con 0x55c451641310 2024-05-09T09:50:40.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.117+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 51 ==== osd_op_reply(241 gc.7 [call out=15b] v0'0 uv207 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.117+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.117+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:242 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ce40 con 0x55c451641310 2024-05-09T09:50:40.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.117+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 52 ==== osd_op_reply(242 gc.7 [call out=24b] v0'0 uv207 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.121+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:243 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679a10 con 0x55c451641310 2024-05-09T09:50:40.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.121+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 53 ==== osd_op_reply(243 gc.7 [call out=15b] v0'0 uv207 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.121+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:40.123 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.121+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:244 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679a10 con 0x55c451641310 2024-05-09T09:50:40.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.121+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 54 ==== osd_op_reply(244 gc.7 [call out=15b] v0'0 uv207 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.121+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.121+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:245 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c451679a10 con 0x55c451641310 2024-05-09T09:50:40.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.125+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 55 ==== osd_op_reply(245 gc.7 [call] v32'208 uv208 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.125+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-05-09T09:50:40.127 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.125+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:246 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ba30 con 0x7f826c03a040 2024-05-09T09:50:40.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.125+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 43 ==== osd_op_reply(246 gc.8 [call] v32'106 uv106 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.129 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.125+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:247 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679a10 con 0x7f826c03a040 2024-05-09T09:50:40.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.125+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 44 ==== osd_op_reply(247 gc.8 [call out=15b] v0'0 uv106 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.125+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.125+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:248 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679a10 con 0x7f826c03a040 2024-05-09T09:50:40.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.129+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 45 ==== osd_op_reply(248 gc.8 [call out=24b] v0'0 uv106 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.129+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:249 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679a10 con 0x7f826c03a040 2024-05-09T09:50:40.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.129+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 46 ==== osd_op_reply(249 gc.8 [call out=15b] v0'0 uv106 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.129+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:40.131 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.129+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:250 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679a10 con 0x7f826c03a040 2024-05-09T09:50:40.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.129+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 47 ==== osd_op_reply(250 gc.8 [call out=15b] v0'0 uv106 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.129+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.132 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.129+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:251 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c451679a10 con 0x7f826c03a040 2024-05-09T09:50:40.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.129+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 48 ==== osd_op_reply(251 gc.8 [call] v32'107 uv107 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.129+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-05-09T09:50:40.134 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.129+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:252 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c451679a10 con 0x55c451645c60 2024-05-09T09:50:40.136 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.133+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 91 ==== osd_op_reply(252 gc.9 [call] v32'112 uv112 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.133+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:253 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679a10 con 0x55c451645c60 2024-05-09T09:50:40.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.133+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 92 ==== osd_op_reply(253 gc.9 [call out=15b] v0'0 uv112 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.133+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.137 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.133+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:254 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679a10 con 0x55c451645c60 2024-05-09T09:50:40.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.133+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 93 ==== osd_op_reply(254 gc.9 [call out=24b] v0'0 uv112 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.133+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:255 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679a10 con 0x55c451645c60 2024-05-09T09:50:40.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.133+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 94 ==== osd_op_reply(255 gc.9 [call out=15b] v0'0 uv112 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.133+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:40.138 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.133+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:256 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679a10 con 0x55c451645c60 2024-05-09T09:50:40.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.137+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 95 ==== osd_op_reply(256 gc.9 [call out=15b] v0'0 uv112 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.137+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.137+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:257 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c451679a10 con 0x55c451645c60 2024-05-09T09:50:40.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.137+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 96 ==== osd_op_reply(257 gc.9 [call] v32'113 uv113 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.137+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-05-09T09:50:40.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.137+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:258 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c451679a10 con 0x7f826c03a040 2024-05-09T09:50:40.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.141+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 49 ==== osd_op_reply(258 gc.10 [call] v32'312 uv312 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.141+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:259 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679a10 con 0x7f826c03a040 2024-05-09T09:50:40.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.141+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 50 ==== osd_op_reply(259 gc.10 [call out=15b] v0'0 uv312 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.141+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.141+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:260 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679a10 con 0x7f826c03a040 2024-05-09T09:50:40.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.141+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 51 ==== osd_op_reply(260 gc.10 [call out=24b] v0'0 uv312 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.141+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:261 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679a10 con 0x7f826c03a040 2024-05-09T09:50:40.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.141+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 52 ==== osd_op_reply(261 gc.10 [call out=15b] v0'0 uv312 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.141+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:40.144 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.141+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:262 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ba30 con 0x7f826c03a040 2024-05-09T09:50:40.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.141+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 53 ==== osd_op_reply(262 gc.10 [call out=15b] v0'0 uv312 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.141+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.141+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:263 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ba30 con 0x7f826c03a040 2024-05-09T09:50:40.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.145+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 54 ==== osd_op_reply(263 gc.10 [call] v32'313 uv313 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.145+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-05-09T09:50:40.147 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.145+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:264 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ba30 con 0x55c451641310 2024-05-09T09:50:40.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.145+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 56 ==== osd_op_reply(264 gc.11 [call] v32'116 uv116 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.145+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:265 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ba30 con 0x55c451641310 2024-05-09T09:50:40.150 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.149+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 57 ==== osd_op_reply(265 gc.11 [call out=15b] v0'0 uv116 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.149+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.149+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:266 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ce20 con 0x55c451641310 2024-05-09T09:50:40.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.149+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 58 ==== osd_op_reply(266 gc.11 [call out=24b] v0'0 uv116 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.151 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.149+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:267 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ba30 con 0x55c451641310 2024-05-09T09:50:40.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.149+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 59 ==== osd_op_reply(267 gc.11 [call out=15b] v0'0 uv116 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.149+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:40.152 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.149+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:268 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ba30 con 0x55c451641310 2024-05-09T09:50:40.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.149+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 60 ==== osd_op_reply(268 gc.11 [call out=15b] v0'0 uv116 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.149+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.149+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:269 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ba30 con 0x55c451641310 2024-05-09T09:50:40.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.153+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 61 ==== osd_op_reply(269 gc.11 [call] v32'117 uv117 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.153+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-05-09T09:50:40.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.153+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:270 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ba30 con 0x7f826c03a040 2024-05-09T09:50:40.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.153+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 55 ==== osd_op_reply(270 gc.12 [call] v32'106 uv106 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.153+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:271 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ba30 con 0x7f826c03a040 2024-05-09T09:50:40.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.157+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 56 ==== osd_op_reply(271 gc.12 [call out=15b] v0'0 uv106 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.157+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.158 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.157+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:272 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ce20 con 0x7f826c03a040 2024-05-09T09:50:40.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.157+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 57 ==== osd_op_reply(272 gc.12 [call out=24b] v0'0 uv106 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.157+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:273 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ba30 con 0x7f826c03a040 2024-05-09T09:50:40.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.157+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 58 ==== osd_op_reply(273 gc.12 [call out=15b] v0'0 uv106 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.159 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.157+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:40.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.157+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:274 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679a10 con 0x7f826c03a040 2024-05-09T09:50:40.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.157+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 59 ==== osd_op_reply(274 gc.12 [call out=15b] v0'0 uv106 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.157+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.157+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:275 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c451679a10 con 0x7f826c03a040 2024-05-09T09:50:40.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.157+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 60 ==== osd_op_reply(275 gc.12 [call] v32'107 uv107 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.161+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-05-09T09:50:40.162 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.161+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:276 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c451679a10 con 0x55c451641310 2024-05-09T09:50:40.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.161+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 62 ==== osd_op_reply(276 gc.13 [call] v32'214 uv214 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.165 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.161+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:277 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679a10 con 0x55c451641310 2024-05-09T09:50:40.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.161+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 63 ==== osd_op_reply(277 gc.13 [call out=15b] v0'0 uv214 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.161+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.161+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:278 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679a10 con 0x55c451641310 2024-05-09T09:50:40.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.165+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 64 ==== osd_op_reply(278 gc.13 [call out=24b] v0'0 uv214 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.166 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.165+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:279 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679a10 con 0x55c451641310 2024-05-09T09:50:40.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.165+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 65 ==== osd_op_reply(279 gc.13 [call out=15b] v0'0 uv214 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.165+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:40.167 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.165+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:280 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679a10 con 0x55c451641310 2024-05-09T09:50:40.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.165+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 66 ==== osd_op_reply(280 gc.13 [call out=15b] v0'0 uv214 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.165+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.168 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.165+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:281 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c451679a10 con 0x55c451641310 2024-05-09T09:50:40.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.169+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 67 ==== osd_op_reply(281 gc.13 [call] v32'215 uv215 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.169+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-05-09T09:50:40.171 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.169+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:282 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c451679a10 con 0x55c45163c920 2024-05-09T09:50:40.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.169+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 59 ==== osd_op_reply(282 gc.14 [call] v32'504 uv504 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:40.173 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.169+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:283 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ba30 con 0x55c45163c920 2024-05-09T09:50:40.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.169+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 60 ==== osd_op_reply(283 gc.14 [call out=15b] v0'0 uv504 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:40.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.169+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.169+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:284 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ce20 con 0x55c45163c920 2024-05-09T09:50:40.174 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.173+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 61 ==== osd_op_reply(284 gc.14 [call out=24b] v0'0 uv504 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:40.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.173+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:285 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ba30 con 0x55c45163c920 2024-05-09T09:50:40.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.173+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 62 ==== osd_op_reply(285 gc.14 [call out=15b] v0'0 uv504 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:40.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.173+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:40.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.173+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:286 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ba30 con 0x55c45163c920 2024-05-09T09:50:40.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.173+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 63 ==== osd_op_reply(286 gc.14 [call out=15b] v0'0 uv504 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:40.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.173+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.173+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:287 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ba30 con 0x55c45163c920 2024-05-09T09:50:40.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.177+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 64 ==== osd_op_reply(287 gc.14 [call] v32'505 uv505 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:40.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.177+0000 7f828414b980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-05-09T09:50:40.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.177+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:288 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ba30 con 0x55c451645c60 2024-05-09T09:50:40.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.177+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 97 ==== osd_op_reply(288 gc.15 [call] v32'306 uv306 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.177+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:289 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ba30 con 0x55c451645c60 2024-05-09T09:50:40.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.181+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 98 ==== osd_op_reply(289 gc.15 [call out=15b] v0'0 uv306 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.181+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.181+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:290 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ce40 con 0x55c451645c60 2024-05-09T09:50:40.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.181+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 99 ==== osd_op_reply(290 gc.15 [call out=24b] v0'0 uv306 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.181+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:291 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c451679a10 con 0x55c451645c60 2024-05-09T09:50:40.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.181+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 100 ==== osd_op_reply(291 gc.15 [call out=15b] v0'0 uv306 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.181+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-09T09:50:40.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.181+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:292 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ba30 con 0x55c451645c60 2024-05-09T09:50:40.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.181+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 101 ==== osd_op_reply(292 gc.15 [call out=15b] v0'0 uv306 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.181+0000 7f828414b980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-09T09:50:40.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.181+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:293 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45167ba30 con 0x55c451645c60 2024-05-09T09:50:40.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.185+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 102 ==== osd_op_reply(293 gc.15 [call] v32'307 uv307 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.185+0000 7f8136fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-09T09:50:40.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.185+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94301667523088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c451658310 con 0x55c45163c920 2024-05-09T09:50:40.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.189+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 65 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94301667523088] v32'506 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:40.190 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.189+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94301667500720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45164f9e0 con 0x7f826c03a040 2024-05-09T09:50:40.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.189+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 61 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94301667500720] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.189+0000 7f828414b980 20 remove_watcher() i=0 2024-05-09T09:50:40.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.189+0000 7f828414b980 2 removed watcher, disabling cache 2024-05-09T09:50:40.193 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.189+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94301667504528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45164a2b0 con 0x55c45163c920 2024-05-09T09:50:40.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.193+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 66 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94301667504528] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:40.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.193+0000 7f828414b980 20 remove_watcher() i=1 2024-05-09T09:50:40.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.193+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94301667498464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45164a2b0 con 0x55c451645c60 2024-05-09T09:50:40.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.197+0000 7f8281465640 1 -- 172.21.15.157:0/457538275 <== osd.3 v2:172.21.15.157:6816/2487336710 103 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94301667498464] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f826c00b950 con 0x55c451645c60 2024-05-09T09:50:40.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.197+0000 7f828414b980 20 remove_watcher() i=2 2024-05-09T09:50:40.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.197+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94301667510912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4516499e0 con 0x7f826c03a040 2024-05-09T09:50:40.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.197+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.2 v2:172.21.15.157:6800/354455204 62 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94301667510912] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x7f826c03a040 2024-05-09T09:50:40.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.197+0000 7f828414b980 20 remove_watcher() i=3 2024-05-09T09:50:40.201 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.197+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94301667515168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45164a2b0 con 0x55c45163c920 2024-05-09T09:50:40.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.201+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 <== osd.1 v2:172.21.15.157:6808/3930131338 67 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94301667515168] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827c00a4d0 con 0x55c45163c920 2024-05-09T09:50:40.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.201+0000 7f828414b980 20 remove_watcher() i=4 2024-05-09T09:50:40.204 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.201+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94301667512192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4516499e0 con 0x55c451641310 2024-05-09T09:50:40.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.205+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 68 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94301667512192] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.205+0000 7f828414b980 20 remove_watcher() i=5 2024-05-09T09:50:40.207 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.205+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94301667519456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c45164a2b0 con 0x55c451641310 2024-05-09T09:50:40.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.205+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 69 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94301667519456] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.205+0000 7f828414b980 20 remove_watcher() i=6 2024-05-09T09:50:40.210 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.205+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94301667521568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c4516499e0 con 0x55c451641310 2024-05-09T09:50:40.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.209+0000 7f8281c66640 1 -- 172.21.15.157:0/457538275 <== osd.0 v2:172.21.15.110:6800/231209037 70 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94301667521568] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827410b060 con 0x55c451641310 2024-05-09T09:50:40.212 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.209+0000 7f828414b980 20 remove_watcher() i=7 2024-05-09T09:50:40.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.209+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55c451641310 msgr2=0x55c451643700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:40.213 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.209+0000 7f828414b980 1 --2- 172.21.15.157:0/457538275 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55c451641310 0x55c451643700 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:40.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.209+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55c45163c920 msgr2=0x55c45163ede0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:40.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.209+0000 7f828414b980 1 --2- 172.21.15.157:0/457538275 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55c45163c920 0x55c45163ede0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:40.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.209+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f826c03a040 msgr2=0x7f826c03a930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:40.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.209+0000 7f828414b980 1 --2- 172.21.15.157:0/457538275 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f826c03a040 0x7f826c03a930 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:40.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.209+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55c451645c60 msgr2=0x55c451648070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:40.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.209+0000 7f828414b980 1 --2- 172.21.15.157:0/457538275 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55c451645c60 0x55c451648070 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:40.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.209+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f814c034bb0 msgr2=0x7f814c037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:40.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.209+0000 7f828414b980 1 --2- 172.21.15.157:0/457538275 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f814c034bb0 0x7f814c037070 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f826c0052a0 tx=0x7f826c013000 comp rx=0 tx=0).stop 2024-05-09T09:50:40.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.209+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c451628a30 msgr2=0x55c45162fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:40.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.209+0000 7f828414b980 1 --2- 172.21.15.157:0/457538275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c451628a30 0x55c45162fda0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f82740e5010 tx=0x7f82740d2f20 comp rx=0 tx=0).stop 2024-05-09T09:50:40.214 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.209+0000 7f8282467640 1 -- 172.21.15.157:0/457538275 reap_dead start 2024-05-09T09:50:40.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.213+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 shutdown_connections 2024-05-09T09:50:40.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.213+0000 7f828414b980 1 --2- 172.21.15.157:0/457538275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c451628a30 0x55c45162fda0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:40.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.213+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 >> 172.21.15.157:0/457538275 conn(0x55c451624e00 msgr2=0x55c451622460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:40.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.213+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 shutdown_connections 2024-05-09T09:50:40.215 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.213+0000 7f828414b980 1 -- 172.21.15.157:0/457538275 wait complete. 2024-05-09T09:50:40.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.213+0000 7f828414b980 1 -- 172.21.15.157:0/2180504308 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f815c034bb0 msgr2=0x7f815c037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:40.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.213+0000 7f828414b980 1 --2- 172.21.15.157:0/2180504308 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f815c034bb0 0x7f815c037070 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55c4515e9120 tx=0x7f826c012000 comp rx=0 tx=0).stop 2024-05-09T09:50:40.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.213+0000 7f828414b980 1 -- 172.21.15.157:0/2180504308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c45161ba10 msgr2=0x55c45161be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:40.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.213+0000 7f828414b980 1 --2- 172.21.15.157:0/2180504308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c45161ba10 0x55c45161be30 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f82740e51a0 tx=0x7f82740b3370 comp rx=0 tx=0).stop 2024-05-09T09:50:40.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.213+0000 7f828414b980 1 -- 172.21.15.157:0/2180504308 shutdown_connections 2024-05-09T09:50:40.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.213+0000 7f828414b980 1 --2- 172.21.15.157:0/2180504308 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f815c034bb0 0x7f815c037070 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:40.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.213+0000 7f828414b980 1 --2- 172.21.15.157:0/2180504308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c45161ba10 0x55c45161be30 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:40.216 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.213+0000 7f828414b980 1 -- 172.21.15.157:0/2180504308 >> 172.21.15.157:0/2180504308 conn(0x55c4516107e0 msgr2=0x55c4516112f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:40.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.213+0000 7f828414b980 1 -- 172.21.15.157:0/2180504308 shutdown_connections 2024-05-09T09:50:40.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.213+0000 7f828414b980 1 -- 172.21.15.157:0/2180504308 wait complete. 2024-05-09T09:50:40.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.213+0000 7f828414b980 1 -- 172.21.15.157:0/2874799394 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55c4515eab70 msgr2=0x55c4515ecf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:40.217 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.213+0000 7f828414b980 1 --2- 172.21.15.157:0/2874799394 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x55c4515eab70 0x55c4515ecf60 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:40.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.213+0000 7f828414b980 1 -- 172.21.15.157:0/2874799394 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55c4514f0120 msgr2=0x55c4515e8220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:40.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.213+0000 7f828414b980 1 --2- 172.21.15.157:0/2874799394 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x55c4514f0120 0x55c4515e8220 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:40.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.213+0000 7f828414b980 1 -- 172.21.15.157:0/2874799394 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55c4515eea90 msgr2=0x55c4515f0e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:40.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.213+0000 7f828414b980 1 --2- 172.21.15.157:0/2874799394 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x55c4515eea90 0x55c4515f0e80 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:40.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.213+0000 7f828414b980 1 -- 172.21.15.157:0/2874799394 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8168034bb0 msgr2=0x7f8168037070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:40.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.213+0000 7f828414b980 1 --2- 172.21.15.157:0/2874799394 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f8168034bb0 0x7f8168037070 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f826c000f70 tx=0x7f826c008590 comp rx=0 tx=0).stop 2024-05-09T09:50:40.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.213+0000 7f828414b980 1 -- 172.21.15.157:0/2874799394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4514ef800 msgr2=0x55c4515e12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:40.218 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.213+0000 7f828414b980 1 --2- 172.21.15.157:0/2874799394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c4514ef800 0x55c4515e12e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f827401b380 tx=0x7f82740180e0 comp rx=0 tx=0).stop 2024-05-09T09:50:40.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.213+0000 7f8282467640 1 -- 172.21.15.157:0/2874799394 reap_dead start 2024-05-09T09:50:40.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.213+0000 7f828414b980 1 -- 172.21.15.157:0/2874799394 shutdown_connections 2024-05-09T09:50:40.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.213+0000 7f828414b980 1 -- 172.21.15.157:0/2874799394 >> 172.21.15.157:0/2874799394 conn(0x55c4514eb0d0 msgr2=0x55c4515d4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:40.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.217+0000 7f828414b980 1 -- 172.21.15.157:0/2874799394 shutdown_connections 2024-05-09T09:50:40.219 INFO:teuthology.orchestra.run.smithi157.stderr:2024-05-09T09:50:40.217+0000 7f828414b980 1 -- 172.21.15.157:0/2874799394 wait complete. 2024-05-09T09:50:40.231 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-05-09T09:50:40.239 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-09T09:50:40.250 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T09:50:40.250 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T09:50:40.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.375+0000 7f2ac4683640 1 Processor -- start 2024-05-09T09:50:40.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.375+0000 7f2ac4683640 1 -- start start 2024-05-09T09:50:40.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.379+0000 7f2ac4683640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2abc0963b0 0x7f2abc1342d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:40.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.379+0000 7f2ac4683640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2abc096e60 con 0x7f2abc06ce10 2024-05-09T09:50:40.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.379+0000 7f2ac4683640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f2abc096bc0 con 0x7f2abc0963b0 2024-05-09T09:50:40.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.379+0000 7f2ac1c1e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2abc0963b0 0x7f2abc1342d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:40.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.379+0000 7f2ac241f640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f2abc06ce10 0x7f2abc06d1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:49044/0 (socket says 172.21.15.110:49044) 2024-05-09T09:50:40.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.379+0000 7f2ac241f640 1 -- 172.21.15.110:0/3322326405 learned_addr learned my addr 172.21.15.110:0/3322326405 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:50:40.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.379+0000 7f2ac1c1e640 1 -- 172.21.15.110:0/3322326405 >> v1:172.21.15.110:6789/0 conn(0x7f2abc06ce10 legacy=0x7f2abc06d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:40.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.379+0000 7f2ac1c1e640 1 -- 172.21.15.110:0/3322326405 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2abc09b280 con 0x7f2abc0963b0 2024-05-09T09:50:40.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.379+0000 7f2ac1c1e640 1 --2- 172.21.15.110:0/3322326405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2abc0963b0 0x7f2abc1342d0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8009740 tx=0x7f2ab801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd36bf3635e44f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:40.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.379+0000 7f2ac141d640 1 -- 172.21.15.110:0/3322326405 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ab80b0070 con 0x7f2abc0963b0 2024-05-09T09:50:40.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.379+0000 7f2ac141d640 1 -- 172.21.15.110:0/3322326405 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ab80ab530 con 0x7f2abc0963b0 2024-05-09T09:50:40.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.379+0000 7f2ac141d640 1 -- 172.21.15.110:0/3322326405 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ab80ab830 con 0x7f2abc0963b0 2024-05-09T09:50:40.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.379+0000 7f2ac4683640 1 -- 172.21.15.110:0/3322326405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2abc0963b0 msgr2=0x7f2abc1342d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:40.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.379+0000 7f2ac4683640 1 --2- 172.21.15.110:0/3322326405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2abc0963b0 0x7f2abc1342d0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8009740 tx=0x7f2ab801c370 comp rx=0 tx=0).stop 2024-05-09T09:50:40.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.383+0000 7f2ac4683640 1 -- 172.21.15.110:0/3322326405 shutdown_connections 2024-05-09T09:50:40.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.383+0000 7f2ac4683640 1 --2- 172.21.15.110:0/3322326405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2abc0963b0 0x7f2abc1342d0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:40.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.383+0000 7f2ac4683640 1 -- 172.21.15.110:0/3322326405 >> 172.21.15.110:0/3322326405 conn(0x7f2abc09e4a0 msgr2=0x7f2abc09a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:40.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.383+0000 7f2ac4683640 1 -- 172.21.15.110:0/3322326405 shutdown_connections 2024-05-09T09:50:40.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.383+0000 7f2ac4683640 1 -- 172.21.15.110:0/3322326405 wait complete. 2024-05-09T09:50:40.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.383+0000 7f2ac4683640 1 Processor -- start 2024-05-09T09:50:40.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.383+0000 7f2ac4683640 1 -- start start 2024-05-09T09:50:40.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.383+0000 7f2ac4683640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2abc06ce10 0x7f2abc090250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:40.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.383+0000 7f2ac4683640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2abc1373c0 con 0x7f2abc06ce10 2024-05-09T09:50:40.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.383+0000 7f2ac241f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2abc06ce10 0x7f2abc090250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:40.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.383+0000 7f2ac241f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2abc06ce10 0x7f2abc090250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51208/0 (socket says 172.21.15.110:51208) 2024-05-09T09:50:40.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.383+0000 7f2ac241f640 1 -- 172.21.15.110:0/386862367 learned_addr learned my addr 172.21.15.110:0/386862367 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:50:40.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.383+0000 7f2ac241f640 1 -- 172.21.15.110:0/386862367 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2abc093d40 con 0x7f2abc06ce10 2024-05-09T09:50:40.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.383+0000 7f2ac241f640 1 --2- 172.21.15.110:0/386862367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2abc06ce10 0x7f2abc090250 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f2aac00c3a0 tx=0x7f2aac00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:40.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.383+0000 7f2ab2ffd640 1 -- 172.21.15.110:0/386862367 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2aac017070 con 0x7f2abc06ce10 2024-05-09T09:50:40.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.383+0000 7f2ab2ffd640 1 -- 172.21.15.110:0/386862367 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aac005c20 con 0x7f2abc06ce10 2024-05-09T09:50:40.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.383+0000 7f2ac4683640 1 -- 172.21.15.110:0/386862367 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2abc091d50 con 0x7f2abc06ce10 2024-05-09T09:50:40.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.383+0000 7f2ab2ffd640 1 -- 172.21.15.110:0/386862367 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2aac0070d0 con 0x7f2abc06ce10 2024-05-09T09:50:40.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.383+0000 7f2ac4683640 1 -- 172.21.15.110:0/386862367 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2abc0930a0 con 0x7f2abc06ce10 2024-05-09T09:50:40.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.383+0000 7f2ac4683640 1 -- 172.21.15.110:0/386862367 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2abc063710 con 0x7f2abc06ce10 2024-05-09T09:50:40.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.383+0000 7f2ab2ffd640 1 -- 172.21.15.110:0/386862367 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f2aac01a070 con 0x7f2abc06ce10 2024-05-09T09:50:40.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.383+0000 7f2ab2ffd640 1 --2- 172.21.15.110:0/386862367 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2aa0036310 0x7f2aa00387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:40.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.383+0000 7f2ab2ffd640 1 -- 172.21.15.110:0/386862367 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f2aac048ae0 con 0x7f2abc06ce10 2024-05-09T09:50:40.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.387+0000 7f2ac1c1e640 1 --2- 172.21.15.110:0/386862367 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2aa0036310 0x7f2aa00387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:40.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.387+0000 7f2ac1c1e640 1 --2- 172.21.15.110:0/386862367 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2aa0036310 0x7f2aa00387d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8009740 tx=0x7f2ab80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:40.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.391+0000 7f2ab2ffd640 1 -- 172.21.15.110:0/386862367 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2aac007270 con 0x7f2abc06ce10 2024-05-09T09:50:40.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.551+0000 7f2ac4683640 1 -- 172.21.15.110:0/386862367 --> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2abc067fd0 con 0x7f2aa0036310 2024-05-09T09:50:40.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.611+0000 7f2ab2ffd640 1 -- 172.21.15.110:0/386862367 <== mgr.4100 v2:172.21.15.157:6824/2765519551 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666035 (secure 0 0 0) 0x7f2abc067fd0 con 0x7f2aa0036310 2024-05-09T09:50:40.622 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:50:40.629 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-05-09T09:50:40.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.619+0000 7f2ac4683640 1 -- 172.21.15.110:0/386862367 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2aa0036310 msgr2=0x7f2aa00387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:40.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.619+0000 7f2ac4683640 1 --2- 172.21.15.110:0/386862367 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2aa0036310 0x7f2aa00387d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8009740 tx=0x7f2ab80a6000 comp rx=0 tx=0).stop 2024-05-09T09:50:40.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.619+0000 7f2ac4683640 1 -- 172.21.15.110:0/386862367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2abc06ce10 msgr2=0x7f2abc090250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:40.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.619+0000 7f2ac4683640 1 --2- 172.21.15.110:0/386862367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2abc06ce10 0x7f2abc090250 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f2aac00c3a0 tx=0x7f2aac00c860 comp rx=0 tx=0).stop 2024-05-09T09:50:40.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.619+0000 7f2ac4683640 1 -- 172.21.15.110:0/386862367 shutdown_connections 2024-05-09T09:50:40.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.619+0000 7f2ac4683640 1 --2- 172.21.15.110:0/386862367 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f2aa0036310 0x7f2aa00387d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:40.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.619+0000 7f2ac4683640 1 --2- 172.21.15.110:0/386862367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2abc06ce10 0x7f2abc090250 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:40.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.619+0000 7f2ac4683640 1 -- 172.21.15.110:0/386862367 >> 172.21.15.110:0/386862367 conn(0x7f2abc09e4a0 msgr2=0x7f2abc132d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:40.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.619+0000 7f2ac4683640 1 -- 172.21.15.110:0/386862367 shutdown_connections 2024-05-09T09:50:40.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.619+0000 7f2ac4683640 1 -- 172.21.15.110:0/386862367 wait complete. 2024-05-09T09:50:40.646 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-05-09T09:50:39.172837+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416886,"num_objects":227,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4902,"num_read_kb":4479,"num_write":2106,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6845,"ondisk_log_size":6845,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152848,"kb_used_data":36464,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377334512,"statfs":{"total":386547056640,"available":386390540288,"internally_reserved":0,"allocated":37339136,"data_stored":36186168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":119138070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815784,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007304"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.185131+0000","last_change":"2024-05-09T09:47:12.206481+0000","last_active":"2024-05-09T09:47:52.185131+0000","last_peered":"2024-05-09T09:47:52.185131+0000","last_clean":"2024-05-09T09:47:52.185131+0000","last_became_active":"2024-05-09T09:47:12.205786+0000","last_became_peered":"2024-05-09T09:47:12.205786+0000","last_unstale":"2024-05-09T09:47:52.185131+0000","last_undegraded":"2024-05-09T09:47:52.185131+0000","last_fullsized":"2024-05-09T09:47:52.185131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:17:39.735832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:46.160690+0000","last_change":"2024-05-09T09:47:14.171375+0000","last_active":"2024-05-09T09:48:46.160690+0000","last_peered":"2024-05-09T09:48:46.160690+0000","last_clean":"2024-05-09T09:48:46.160690+0000","last_became_active":"2024-05-09T09:47:14.171044+0000","last_became_peered":"2024-05-09T09:47:14.171044+0000","last_unstale":"2024-05-09T09:48:46.160690+0000","last_undegraded":"2024-05-09T09:48:46.160690+0000","last_fullsized":"2024-05-09T09:48:46.160690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:57.831374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'1","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.162473+0000","last_change":"2024-05-09T09:47:12.190812+0000","last_active":"2024-05-09T09:49:20.162473+0000","last_peered":"2024-05-09T09:49:20.162473+0000","last_clean":"2024-05-09T09:49:20.162473+0000","last_became_active":"2024-05-09T09:47:12.189774+0000","last_became_peered":"2024-05-09T09:47:12.189774+0000","last_unstale":"2024-05-09T09:49:20.162473+0000","last_undegraded":"2024-05-09T09:49:20.162473+0000","last_fullsized":"2024-05-09T09:49:20.162473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:13:12.664064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.180726+0000","last_change":"2024-05-09T09:47:14.193844+0000","last_active":"2024-05-09T09:47:52.180726+0000","last_peered":"2024-05-09T09:47:52.180726+0000","last_clean":"2024-05-09T09:47:52.180726+0000","last_became_active":"2024-05-09T09:47:14.192803+0000","last_became_peered":"2024-05-09T09:47:14.192803+0000","last_unstale":"2024-05-09T09:47:52.180726+0000","last_undegraded":"2024-05-09T09:47:52.180726+0000","last_fullsized":"2024-05-09T09:47:52.180726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:03:50.025641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"32'3","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:45.849127+0000","last_change":"2024-05-09T09:47:12.209625+0000","last_active":"2024-05-09T09:48:45.849127+0000","last_peered":"2024-05-09T09:48:45.849127+0000","last_clean":"2024-05-09T09:48:45.849127+0000","last_became_active":"2024-05-09T09:47:12.207184+0000","last_became_peered":"2024-05-09T09:47:12.207184+0000","last_unstale":"2024-05-09T09:48:45.849127+0000","last_undegraded":"2024-05-09T09:48:45.849127+0000","last_fullsized":"2024-05-09T09:48:45.849127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:58:32.194004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'14","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.151204+0000","last_change":"2024-05-09T09:47:14.193118+0000","last_active":"2024-05-09T09:50:33.151204+0000","last_peered":"2024-05-09T09:50:33.151204+0000","last_clean":"2024-05-09T09:50:33.151204+0000","last_became_active":"2024-05-09T09:47:14.192821+0000","last_became_peered":"2024-05-09T09:47:14.192821+0000","last_unstale":"2024-05-09T09:50:33.151204+0000","last_undegraded":"2024-05-09T09:50:33.151204+0000","last_fullsized":"2024-05-09T09:50:33.151204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:12.396738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"32'1","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:15.168923+0000","last_change":"2024-05-09T09:47:12.195169+0000","last_active":"2024-05-09T09:49:15.168923+0000","last_peered":"2024-05-09T09:49:15.168923+0000","last_clean":"2024-05-09T09:49:15.168923+0000","last_became_active":"2024-05-09T09:47:12.194183+0000","last_became_peered":"2024-05-09T09:47:12.194183+0000","last_unstale":"2024-05-09T09:49:15.168923+0000","last_undegraded":"2024-05-09T09:49:15.168923+0000","last_fullsized":"2024-05-09T09:49:15.168923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:14.033148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'12","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.805704+0000","last_change":"2024-05-09T09:47:52.430986+0000","last_active":"2024-05-09T09:50:32.805704+0000","last_peered":"2024-05-09T09:50:32.805704+0000","last_clean":"2024-05-09T09:50:32.805704+0000","last_became_active":"2024-05-09T09:47:52.429940+0000","last_became_peered":"2024-05-09T09:47:52.429940+0000","last_unstale":"2024-05-09T09:50:32.805704+0000","last_undegraded":"2024-05-09T09:50:32.805704+0000","last_fullsized":"2024-05-09T09:50:32.805704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:46:39.468582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.185616+0000","last_change":"2024-05-09T09:47:12.212361+0000","last_active":"2024-05-09T09:47:52.185616+0000","last_peered":"2024-05-09T09:47:52.185616+0000","last_clean":"2024-05-09T09:47:52.185616+0000","last_became_active":"2024-05-09T09:47:12.204446+0000","last_became_peered":"2024-05-09T09:47:12.204446+0000","last_unstale":"2024-05-09T09:47:52.185616+0000","last_undegraded":"2024-05-09T09:47:52.185616+0000","last_fullsized":"2024-05-09T09:47:52.185616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:14:59.069403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'16","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.303718+0000","last_change":"2024-05-09T09:47:14.185067+0000","last_active":"2024-05-09T09:50:33.303718+0000","last_peered":"2024-05-09T09:50:33.303718+0000","last_clean":"2024-05-09T09:50:33.303718+0000","last_became_active":"2024-05-09T09:47:14.184792+0000","last_became_peered":"2024-05-09T09:47:14.184792+0000","last_unstale":"2024-05-09T09:50:33.303718+0000","last_undegraded":"2024-05-09T09:50:33.303718+0000","last_fullsized":"2024-05-09T09:50:33.303718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:15.097524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.137283+0000","last_change":"2024-05-09T09:47:12.195761+0000","last_active":"2024-05-09T09:50:33.137283+0000","last_peered":"2024-05-09T09:50:33.137283+0000","last_clean":"2024-05-09T09:50:33.137283+0000","last_became_active":"2024-05-09T09:47:12.195117+0000","last_became_peered":"2024-05-09T09:47:12.195117+0000","last_unstale":"2024-05-09T09:50:33.137283+0000","last_undegraded":"2024-05-09T09:50:33.137283+0000","last_fullsized":"2024-05-09T09:50:33.137283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:15:07.437414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'8","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.303421+0000","last_change":"2024-05-09T09:47:14.189185+0000","last_active":"2024-05-09T09:50:33.303421+0000","last_peered":"2024-05-09T09:50:33.303421+0000","last_clean":"2024-05-09T09:50:33.303421+0000","last_became_active":"2024-05-09T09:47:14.188665+0000","last_became_peered":"2024-05-09T09:47:14.188665+0000","last_unstale":"2024-05-09T09:50:33.303421+0000","last_undegraded":"2024-05-09T09:50:33.303421+0000","last_fullsized":"2024-05-09T09:50:33.303421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:39.377012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.175793+0000","last_change":"2024-05-09T09:47:12.201245+0000","last_active":"2024-05-09T09:47:52.175793+0000","last_peered":"2024-05-09T09:47:52.175793+0000","last_clean":"2024-05-09T09:47:52.175793+0000","last_became_active":"2024-05-09T09:47:12.199697+0000","last_became_peered":"2024-05-09T09:47:12.199697+0000","last_unstale":"2024-05-09T09:47:52.175793+0000","last_undegraded":"2024-05-09T09:47:52.175793+0000","last_fullsized":"2024-05-09T09:47:52.175793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:40:31.009399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'12","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.808798+0000","last_change":"2024-05-09T09:47:14.179543+0000","last_active":"2024-05-09T09:50:32.808798+0000","last_peered":"2024-05-09T09:50:32.808798+0000","last_clean":"2024-05-09T09:50:32.808798+0000","last_became_active":"2024-05-09T09:47:14.179041+0000","last_became_peered":"2024-05-09T09:47:14.179041+0000","last_unstale":"2024-05-09T09:50:32.808798+0000","last_undegraded":"2024-05-09T09:50:32.808798+0000","last_fullsized":"2024-05-09T09:50:32.808798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:28:37.119651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.412926+0000","last_change":"2024-05-09T09:47:12.185018+0000","last_active":"2024-05-09T09:47:52.412926+0000","last_peered":"2024-05-09T09:47:52.412926+0000","last_clean":"2024-05-09T09:47:52.412926+0000","last_became_active":"2024-05-09T09:47:12.183745+0000","last_became_peered":"2024-05-09T09:47:12.183745+0000","last_unstale":"2024-05-09T09:47:52.412926+0000","last_undegraded":"2024-05-09T09:47:52.412926+0000","last_fullsized":"2024-05-09T09:47:52.412926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:14.033148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'14","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.303289+0000","last_change":"2024-05-09T09:47:14.173339+0000","last_active":"2024-05-09T09:50:33.303289+0000","last_peered":"2024-05-09T09:50:33.303289+0000","last_clean":"2024-05-09T09:50:33.303289+0000","last_became_active":"2024-05-09T09:47:14.173031+0000","last_became_peered":"2024-05-09T09:47:14.173031+0000","last_unstale":"2024-05-09T09:50:33.303289+0000","last_undegraded":"2024-05-09T09:50:33.303289+0000","last_fullsized":"2024-05-09T09:50:33.303289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:35:20.332271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"30'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.172138+0000","last_change":"2024-05-09T09:47:14.193172+0000","last_active":"2024-05-09T09:47:52.172138+0000","last_peered":"2024-05-09T09:47:52.172138+0000","last_clean":"2024-05-09T09:47:52.172138+0000","last_became_active":"2024-05-09T09:47:14.192744+0000","last_became_peered":"2024-05-09T09:47:14.192744+0000","last_unstale":"2024-05-09T09:47:52.172138+0000","last_undegraded":"2024-05-09T09:47:52.172138+0000","last_fullsized":"2024-05-09T09:47:52.172138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:34:30.799914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.179264+0000","last_change":"2024-05-09T09:47:12.213768+0000","last_active":"2024-05-09T09:47:52.179264+0000","last_peered":"2024-05-09T09:47:52.179264+0000","last_clean":"2024-05-09T09:47:52.179264+0000","last_became_active":"2024-05-09T09:47:12.210781+0000","last_became_peered":"2024-05-09T09:47:12.210781+0000","last_unstale":"2024-05-09T09:47:52.179264+0000","last_undegraded":"2024-05-09T09:47:52.179264+0000","last_fullsized":"2024-05-09T09:47:52.179264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:17:39.735832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'20","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.237884+0000","last_change":"2024-05-09T09:47:14.190782+0000","last_active":"2024-05-09T09:50:33.237884+0000","last_peered":"2024-05-09T09:50:33.237884+0000","last_clean":"2024-05-09T09:50:33.237884+0000","last_became_active":"2024-05-09T09:47:14.190021+0000","last_became_peered":"2024-05-09T09:47:14.190021+0000","last_unstale":"2024-05-09T09:50:33.237884+0000","last_undegraded":"2024-05-09T09:50:33.237884+0000","last_fullsized":"2024-05-09T09:50:33.237884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:34:02.864130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.112255+0000","last_change":"2024-05-09T09:47:12.194645+0000","last_active":"2024-05-09T09:50:33.112255+0000","last_peered":"2024-05-09T09:50:33.112255+0000","last_clean":"2024-05-09T09:50:33.112255+0000","last_became_active":"2024-05-09T09:47:12.193509+0000","last_became_peered":"2024-05-09T09:47:12.193509+0000","last_unstale":"2024-05-09T09:50:33.112255+0000","last_undegraded":"2024-05-09T09:50:33.112255+0000","last_fullsized":"2024-05-09T09:50:33.112255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:00:03.229983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.947737+0000","last_change":"2024-05-09T09:47:14.189775+0000","last_active":"2024-05-09T09:50:32.947737+0000","last_peered":"2024-05-09T09:50:32.947737+0000","last_clean":"2024-05-09T09:50:32.947737+0000","last_became_active":"2024-05-09T09:47:14.189468+0000","last_became_peered":"2024-05-09T09:47:14.189468+0000","last_unstale":"2024-05-09T09:50:32.947737+0000","last_undegraded":"2024-05-09T09:50:32.947737+0000","last_fullsized":"2024-05-09T09:50:32.947737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:28:37.119651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.881830+0000","last_change":"2024-05-09T09:47:12.210720+0000","last_active":"2024-05-09T09:49:31.881830+0000","last_peered":"2024-05-09T09:49:31.881830+0000","last_clean":"2024-05-09T09:49:31.881830+0000","last_became_active":"2024-05-09T09:47:12.206920+0000","last_became_peered":"2024-05-09T09:47:12.206920+0000","last_unstale":"2024-05-09T09:49:31.881830+0000","last_undegraded":"2024-05-09T09:49:31.881830+0000","last_fullsized":"2024-05-09T09:49:31.881830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:14.033148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'18","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.238228+0000","last_change":"2024-05-09T09:47:14.174508+0000","last_active":"2024-05-09T09:50:33.238228+0000","last_peered":"2024-05-09T09:50:33.238228+0000","last_clean":"2024-05-09T09:50:33.238228+0000","last_became_active":"2024-05-09T09:47:14.173701+0000","last_became_peered":"2024-05-09T09:47:14.173701+0000","last_unstale":"2024-05-09T09:50:33.238228+0000","last_undegraded":"2024-05-09T09:50:33.238228+0000","last_fullsized":"2024-05-09T09:50:33.238228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:28:37.119651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.715742+0000","last_change":"2024-05-09T09:47:12.207271+0000","last_active":"2024-05-09T09:50:32.715742+0000","last_peered":"2024-05-09T09:50:32.715742+0000","last_clean":"2024-05-09T09:50:32.715742+0000","last_became_active":"2024-05-09T09:47:12.206564+0000","last_became_peered":"2024-05-09T09:47:12.206564+0000","last_unstale":"2024-05-09T09:50:32.715742+0000","last_undegraded":"2024-05-09T09:50:32.715742+0000","last_fullsized":"2024-05-09T09:50:32.715742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:15:01.079963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'10","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.806551+0000","last_change":"2024-05-09T09:47:14.173448+0000","last_active":"2024-05-09T09:50:32.806551+0000","last_peered":"2024-05-09T09:50:32.806551+0000","last_clean":"2024-05-09T09:50:32.806551+0000","last_became_active":"2024-05-09T09:47:14.173022+0000","last_became_peered":"2024-05-09T09:47:14.173022+0000","last_unstale":"2024-05-09T09:50:32.806551+0000","last_undegraded":"2024-05-09T09:50:32.806551+0000","last_fullsized":"2024-05-09T09:50:32.806551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:58:34.213528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.417285+0000","last_change":"2024-05-09T09:47:12.216902+0000","last_active":"2024-05-09T09:47:52.417285+0000","last_peered":"2024-05-09T09:47:52.417285+0000","last_clean":"2024-05-09T09:47:52.417285+0000","last_became_active":"2024-05-09T09:47:12.214422+0000","last_became_peered":"2024-05-09T09:47:12.214422+0000","last_unstale":"2024-05-09T09:47:52.417285+0000","last_undegraded":"2024-05-09T09:47:52.417285+0000","last_fullsized":"2024-05-09T09:47:52.417285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:17:39.735832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'10","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.237141+0000","last_change":"2024-05-09T09:47:14.172576+0000","last_active":"2024-05-09T09:50:33.237141+0000","last_peered":"2024-05-09T09:50:33.237141+0000","last_clean":"2024-05-09T09:50:33.237141+0000","last_became_active":"2024-05-09T09:47:14.172297+0000","last_became_peered":"2024-05-09T09:47:14.172297+0000","last_unstale":"2024-05-09T09:50:33.237141+0000","last_undegraded":"2024-05-09T09:50:33.237141+0000","last_fullsized":"2024-05-09T09:50:33.237141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:38:12.687762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.066369+0000","last_change":"2024-05-09T09:47:12.213596+0000","last_active":"2024-05-09T09:49:32.066369+0000","last_peered":"2024-05-09T09:49:32.066369+0000","last_clean":"2024-05-09T09:49:32.066369+0000","last_became_active":"2024-05-09T09:47:12.211880+0000","last_became_peered":"2024-05-09T09:47:12.211880+0000","last_unstale":"2024-05-09T09:49:32.066369+0000","last_undegraded":"2024-05-09T09:49:32.066369+0000","last_fullsized":"2024-05-09T09:49:32.066369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:02:04.919917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'39","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.197791+0000","last_change":"2024-05-09T09:47:22.260431+0000","last_active":"2024-05-09T09:50:33.197791+0000","last_peered":"2024-05-09T09:50:33.197791+0000","last_clean":"2024-05-09T09:50:33.197791+0000","last_became_active":"2024-05-09T09:47:22.258991+0000","last_became_peered":"2024-05-09T09:47:22.258991+0000","last_unstale":"2024-05-09T09:50:33.197791+0000","last_undegraded":"2024-05-09T09:50:33.197791+0000","last_fullsized":"2024-05-09T09:50:33.197791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:48:55.320178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":174,"num_read_kb":174,"num_write":107,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:02.667895+0000","last_change":"2024-05-09T09:47:14.185176+0000","last_active":"2024-05-09T09:48:02.667895+0000","last_peered":"2024-05-09T09:48:02.667895+0000","last_clean":"2024-05-09T09:48:02.667895+0000","last_became_active":"2024-05-09T09:47:14.184851+0000","last_became_peered":"2024-05-09T09:47:14.184851+0000","last_unstale":"2024-05-09T09:48:02.667895+0000","last_undegraded":"2024-05-09T09:48:02.667895+0000","last_fullsized":"2024-05-09T09:48:02.667895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:13:24.454355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'1","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.175975+0000","last_change":"2024-05-09T09:47:12.214683+0000","last_active":"2024-05-09T09:49:35.175975+0000","last_peered":"2024-05-09T09:49:35.175975+0000","last_clean":"2024-05-09T09:49:35.175975+0000","last_became_active":"2024-05-09T09:47:12.214108+0000","last_became_peered":"2024-05-09T09:47:12.214108+0000","last_unstale":"2024-05-09T09:49:35.175975+0000","last_undegraded":"2024-05-09T09:49:35.175975+0000","last_fullsized":"2024-05-09T09:49:35.175975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:08:34.152345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.191620+0000","last_change":"2024-05-09T09:47:16.197589+0000","last_active":"2024-05-09T09:47:52.191620+0000","last_peered":"2024-05-09T09:47:52.191620+0000","last_clean":"2024-05-09T09:47:52.191620+0000","last_became_active":"2024-05-09T09:47:16.196516+0000","last_became_peered":"2024-05-09T09:47:16.196516+0000","last_unstale":"2024-05-09T09:47:52.191620+0000","last_undegraded":"2024-05-09T09:47:52.191620+0000","last_fullsized":"2024-05-09T09:47:52.191620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:17:41.107784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'104","reported_seq":146,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.611497+0000","last_change":"2024-05-09T09:47:18.236921+0000","last_active":"2024-05-09T09:49:31.611497+0000","last_peered":"2024-05-09T09:49:31.611497+0000","last_clean":"2024-05-09T09:49:31.611497+0000","last_became_active":"2024-05-09T09:47:18.235911+0000","last_became_peered":"2024-05-09T09:47:18.235911+0000","last_unstale":"2024-05-09T09:49:31.611497+0000","last_undegraded":"2024-05-09T09:49:31.611497+0000","last_fullsized":"2024-05-09T09:49:31.611497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:41:58.214685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.178731+0000","last_change":"2024-05-09T09:47:20.252492+0000","last_active":"2024-05-09T09:47:52.178731+0000","last_peered":"2024-05-09T09:47:52.178731+0000","last_clean":"2024-05-09T09:47:52.178731+0000","last_became_active":"2024-05-09T09:47:20.251712+0000","last_became_peered":"2024-05-09T09:47:20.251712+0000","last_unstale":"2024-05-09T09:47:52.178731+0000","last_undegraded":"2024-05-09T09:47:52.178731+0000","last_fullsized":"2024-05-09T09:47:52.178731+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:51:10.268994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:45.872841+0000","last_change":"2024-05-09T09:47:22.255759+0000","last_active":"2024-05-09T09:48:45.872841+0000","last_peered":"2024-05-09T09:48:45.872841+0000","last_clean":"2024-05-09T09:48:45.872841+0000","last_became_active":"2024-05-09T09:47:22.255180+0000","last_became_peered":"2024-05-09T09:47:22.255180+0000","last_unstale":"2024-05-09T09:48:45.872841+0000","last_undegraded":"2024-05-09T09:48:45.872841+0000","last_fullsized":"2024-05-09T09:48:45.872841+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:01:10.229471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.192939+0000","last_change":"2024-05-09T09:47:14.187449+0000","last_active":"2024-05-09T09:47:52.192939+0000","last_peered":"2024-05-09T09:47:52.192939+0000","last_clean":"2024-05-09T09:47:52.192939+0000","last_became_active":"2024-05-09T09:47:14.187095+0000","last_became_peered":"2024-05-09T09:47:14.187095+0000","last_unstale":"2024-05-09T09:47:52.192939+0000","last_undegraded":"2024-05-09T09:47:52.192939+0000","last_fullsized":"2024-05-09T09:47:52.192939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:30:13.157598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.290281+0000","last_change":"2024-05-09T09:47:12.196226+0000","last_active":"2024-05-09T09:50:33.290281+0000","last_peered":"2024-05-09T09:50:33.290281+0000","last_clean":"2024-05-09T09:50:33.290281+0000","last_became_active":"2024-05-09T09:47:12.194549+0000","last_became_peered":"2024-05-09T09:47:12.194549+0000","last_unstale":"2024-05-09T09:50:33.290281+0000","last_undegraded":"2024-05-09T09:50:33.290281+0000","last_fullsized":"2024-05-09T09:50:33.290281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:15:01.079963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.422996+0000","last_change":"2024-05-09T09:47:16.191533+0000","last_active":"2024-05-09T09:47:52.422996+0000","last_peered":"2024-05-09T09:47:52.422996+0000","last_clean":"2024-05-09T09:47:52.422996+0000","last_became_active":"2024-05-09T09:47:16.190755+0000","last_became_peered":"2024-05-09T09:47:16.190755+0000","last_unstale":"2024-05-09T09:47:52.422996+0000","last_undegraded":"2024-05-09T09:47:52.422996+0000","last_fullsized":"2024-05-09T09:47:52.422996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:42:45.452416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.179964+0000","last_change":"2024-05-09T09:47:18.215068+0000","last_active":"2024-05-09T09:49:45.179964+0000","last_peered":"2024-05-09T09:49:45.179964+0000","last_clean":"2024-05-09T09:49:45.179964+0000","last_became_active":"2024-05-09T09:47:18.214299+0000","last_became_peered":"2024-05-09T09:47:18.214299+0000","last_unstale":"2024-05-09T09:49:45.179964+0000","last_undegraded":"2024-05-09T09:49:45.179964+0000","last_fullsized":"2024-05-09T09:49:45.179964+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:49:59.954141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.174479+0000","last_change":"2024-05-09T09:47:20.241740+0000","last_active":"2024-05-09T09:47:52.174479+0000","last_peered":"2024-05-09T09:47:52.174479+0000","last_clean":"2024-05-09T09:47:52.174479+0000","last_became_active":"2024-05-09T09:47:20.241096+0000","last_became_peered":"2024-05-09T09:47:20.241096+0000","last_unstale":"2024-05-09T09:47:52.174479+0000","last_undegraded":"2024-05-09T09:47:52.174479+0000","last_fullsized":"2024-05-09T09:47:52.174479+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:37:23.903396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.416615+0000","last_change":"2024-05-09T09:47:22.258554+0000","last_active":"2024-05-09T09:47:52.416615+0000","last_peered":"2024-05-09T09:47:52.416615+0000","last_clean":"2024-05-09T09:47:52.416615+0000","last_became_active":"2024-05-09T09:47:22.257798+0000","last_became_peered":"2024-05-09T09:47:22.257798+0000","last_unstale":"2024-05-09T09:47:52.416615+0000","last_undegraded":"2024-05-09T09:47:52.416615+0000","last_fullsized":"2024-05-09T09:47:52.416615+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:29:01.635074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.947134+0000","last_change":"2024-05-09T09:47:52.430567+0000","last_active":"2024-05-09T09:50:32.947134+0000","last_peered":"2024-05-09T09:50:32.947134+0000","last_clean":"2024-05-09T09:50:32.947134+0000","last_became_active":"2024-05-09T09:47:52.429857+0000","last_became_peered":"2024-05-09T09:47:52.429857+0000","last_unstale":"2024-05-09T09:50:32.947134+0000","last_undegraded":"2024-05-09T09:50:32.947134+0000","last_fullsized":"2024-05-09T09:50:32.947134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:59:53.671007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.174693+0000","last_change":"2024-05-09T09:47:12.201826+0000","last_active":"2024-05-09T09:47:52.174693+0000","last_peered":"2024-05-09T09:47:52.174693+0000","last_clean":"2024-05-09T09:47:52.174693+0000","last_became_active":"2024-05-09T09:47:12.201415+0000","last_became_peered":"2024-05-09T09:47:12.201415+0000","last_unstale":"2024-05-09T09:47:52.174693+0000","last_undegraded":"2024-05-09T09:47:52.174693+0000","last_fullsized":"2024-05-09T09:47:52.174693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:56:46.263211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.426796+0000","last_change":"2024-05-09T09:47:16.213280+0000","last_active":"2024-05-09T09:47:52.426796+0000","last_peered":"2024-05-09T09:47:52.426796+0000","last_clean":"2024-05-09T09:47:52.426796+0000","last_became_active":"2024-05-09T09:47:16.212543+0000","last_became_peered":"2024-05-09T09:47:16.212543+0000","last_unstale":"2024-05-09T09:47:52.426796+0000","last_undegraded":"2024-05-09T09:47:52.426796+0000","last_fullsized":"2024-05-09T09:47:52.426796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:51:48.988654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.178986+0000","last_change":"2024-05-09T09:47:18.215341+0000","last_active":"2024-05-09T09:47:52.178986+0000","last_peered":"2024-05-09T09:47:52.178986+0000","last_clean":"2024-05-09T09:47:52.178986+0000","last_became_active":"2024-05-09T09:47:18.212685+0000","last_became_peered":"2024-05-09T09:47:18.212685+0000","last_unstale":"2024-05-09T09:47:52.178986+0000","last_undegraded":"2024-05-09T09:47:52.178986+0000","last_fullsized":"2024-05-09T09:47:52.178986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:42:47.464951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'282","reported_seq":383,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:31.469121+0000","last_change":"2024-05-09T09:47:20.250999+0000","last_active":"2024-05-09T09:50:31.469121+0000","last_peered":"2024-05-09T09:50:31.469121+0000","last_clean":"2024-05-09T09:50:31.469121+0000","last_became_active":"2024-05-09T09:47:20.250200+0000","last_became_peered":"2024-05-09T09:47:20.250200+0000","last_unstale":"2024-05-09T09:50:31.469121+0000","last_undegraded":"2024-05-09T09:50:31.469121+0000","last_fullsized":"2024-05-09T09:50:31.469121+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:17:01.311058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.170307+0000","last_change":"2024-05-09T09:47:22.241318+0000","last_active":"2024-05-09T09:47:52.170307+0000","last_peered":"2024-05-09T09:47:52.170307+0000","last_clean":"2024-05-09T09:47:52.170307+0000","last_became_active":"2024-05-09T09:47:22.238160+0000","last_became_peered":"2024-05-09T09:47:22.238160+0000","last_unstale":"2024-05-09T09:47:52.170307+0000","last_undegraded":"2024-05-09T09:47:52.170307+0000","last_fullsized":"2024-05-09T09:47:52.170307+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:26.173328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'16","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.825007+0000","last_change":"2024-05-09T09:47:14.177761+0000","last_active":"2024-05-09T09:50:32.825007+0000","last_peered":"2024-05-09T09:50:32.825007+0000","last_clean":"2024-05-09T09:50:32.825007+0000","last_became_active":"2024-05-09T09:47:14.176295+0000","last_became_peered":"2024-05-09T09:47:14.176295+0000","last_unstale":"2024-05-09T09:50:32.825007+0000","last_undegraded":"2024-05-09T09:50:32.825007+0000","last_fullsized":"2024-05-09T09:50:32.825007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:29:53.547705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.163979+0000","last_change":"2024-05-09T09:47:12.192627+0000","last_active":"2024-05-09T09:47:52.163979+0000","last_peered":"2024-05-09T09:47:52.163979+0000","last_clean":"2024-05-09T09:47:52.163979+0000","last_became_active":"2024-05-09T09:47:12.191194+0000","last_became_peered":"2024-05-09T09:47:12.191194+0000","last_unstale":"2024-05-09T09:47:52.163979+0000","last_undegraded":"2024-05-09T09:47:52.163979+0000","last_fullsized":"2024-05-09T09:47:52.163979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:21:00.747450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.203101+0000","last_change":"2024-05-09T09:47:52.201792+0000","last_active":"2024-05-09T09:47:52.203101+0000","last_peered":"2024-05-09T09:47:52.203101+0000","last_clean":"2024-05-09T09:47:52.203101+0000","last_became_active":"2024-05-09T09:47:52.201081+0000","last_became_peered":"2024-05-09T09:47:52.201081+0000","last_unstale":"2024-05-09T09:47:52.203101+0000","last_undegraded":"2024-05-09T09:47:52.203101+0000","last_fullsized":"2024-05-09T09:47:52.203101+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:13:19.457015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'104","reported_seq":146,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.600969+0000","last_change":"2024-05-09T09:47:18.219458+0000","last_active":"2024-05-09T09:49:31.600969+0000","last_peered":"2024-05-09T09:49:31.600969+0000","last_clean":"2024-05-09T09:49:31.600969+0000","last_became_active":"2024-05-09T09:47:18.217843+0000","last_became_peered":"2024-05-09T09:47:18.217843+0000","last_unstale":"2024-05-09T09:49:31.600969+0000","last_undegraded":"2024-05-09T09:49:31.600969+0000","last_fullsized":"2024-05-09T09:49:31.600969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:34:34.825637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'282","reported_seq":443,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.311661+0000","last_change":"2024-05-09T09:47:20.243402+0000","last_active":"2024-05-09T09:50:33.311661+0000","last_peered":"2024-05-09T09:50:33.311661+0000","last_clean":"2024-05-09T09:50:33.311661+0000","last_became_active":"2024-05-09T09:47:20.242448+0000","last_became_peered":"2024-05-09T09:47:20.242448+0000","last_unstale":"2024-05-09T09:50:33.311661+0000","last_undegraded":"2024-05-09T09:50:33.311661+0000","last_fullsized":"2024-05-09T09:50:33.311661+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:07.968167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.150356+0000","last_change":"2024-05-09T09:47:52.179916+0000","last_active":"2024-05-09T09:50:33.150356+0000","last_peered":"2024-05-09T09:50:33.150356+0000","last_clean":"2024-05-09T09:50:33.150356+0000","last_became_active":"2024-05-09T09:47:52.179059+0000","last_became_peered":"2024-05-09T09:47:52.179059+0000","last_unstale":"2024-05-09T09:50:33.150356+0000","last_undegraded":"2024-05-09T09:50:33.150356+0000","last_fullsized":"2024-05-09T09:50:33.150356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:20:28.160797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.183609+0000","last_change":"2024-05-09T09:47:12.206447+0000","last_active":"2024-05-09T09:47:52.183609+0000","last_peered":"2024-05-09T09:47:52.183609+0000","last_clean":"2024-05-09T09:47:52.183609+0000","last_became_active":"2024-05-09T09:47:12.205259+0000","last_became_peered":"2024-05-09T09:47:12.205259+0000","last_unstale":"2024-05-09T09:47:52.183609+0000","last_undegraded":"2024-05-09T09:47:52.183609+0000","last_fullsized":"2024-05-09T09:47:52.183609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:15.767283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.165019+0000","last_change":"2024-05-09T09:47:16.207890+0000","last_active":"2024-05-09T09:47:52.165019+0000","last_peered":"2024-05-09T09:47:52.165019+0000","last_clean":"2024-05-09T09:47:52.165019+0000","last_became_active":"2024-05-09T09:47:16.207404+0000","last_became_peered":"2024-05-09T09:47:16.207404+0000","last_unstale":"2024-05-09T09:47:52.165019+0000","last_undegraded":"2024-05-09T09:47:52.165019+0000","last_fullsized":"2024-05-09T09:47:52.165019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:51:48.988654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'116","reported_seq":163,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.349509+0000","last_change":"2024-05-09T09:47:18.221550+0000","last_active":"2024-05-09T09:49:31.349509+0000","last_peered":"2024-05-09T09:49:31.349509+0000","last_clean":"2024-05-09T09:49:31.349509+0000","last_became_active":"2024-05-09T09:47:18.220596+0000","last_became_peered":"2024-05-09T09:47:18.220596+0000","last_unstale":"2024-05-09T09:49:31.349509+0000","last_undegraded":"2024-05-09T09:49:31.349509+0000","last_fullsized":"2024-05-09T09:49:31.349509+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:03:54.051364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":54,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.420451+0000","last_change":"2024-05-09T09:47:20.246363+0000","last_active":"2024-05-09T09:47:52.420451+0000","last_peered":"2024-05-09T09:47:52.420451+0000","last_clean":"2024-05-09T09:47:52.420451+0000","last_became_active":"2024-05-09T09:47:20.244839+0000","last_became_peered":"2024-05-09T09:47:20.244839+0000","last_unstale":"2024-05-09T09:47:52.420451+0000","last_undegraded":"2024-05-09T09:47:52.420451+0000","last_fullsized":"2024-05-09T09:47:52.420451+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:40:50.226397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.950700+0000","last_change":"2024-05-09T09:47:22.237841+0000","last_active":"2024-05-09T09:50:32.950700+0000","last_peered":"2024-05-09T09:50:32.950700+0000","last_clean":"2024-05-09T09:50:32.950700+0000","last_became_active":"2024-05-09T09:47:22.235895+0000","last_became_peered":"2024-05-09T09:47:22.235895+0000","last_unstale":"2024-05-09T09:50:32.950700+0000","last_undegraded":"2024-05-09T09:50:32.950700+0000","last_fullsized":"2024-05-09T09:50:32.950700+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:59:20.801393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.174181+0000","last_change":"2024-05-09T09:47:14.172537+0000","last_active":"2024-05-09T09:49:25.174181+0000","last_peered":"2024-05-09T09:49:25.174181+0000","last_clean":"2024-05-09T09:49:25.174181+0000","last_became_active":"2024-05-09T09:47:14.172275+0000","last_became_peered":"2024-05-09T09:47:14.172275+0000","last_unstale":"2024-05-09T09:49:25.174181+0000","last_undegraded":"2024-05-09T09:49:25.174181+0000","last_fullsized":"2024-05-09T09:49:25.174181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:16:59.077638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:59.963235+0000","last_change":"2024-05-09T09:47:12.210250+0000","last_active":"2024-05-09T09:47:59.963235+0000","last_peered":"2024-05-09T09:47:59.963235+0000","last_clean":"2024-05-09T09:47:59.963235+0000","last_became_active":"2024-05-09T09:47:12.209274+0000","last_became_peered":"2024-05-09T09:47:12.209274+0000","last_unstale":"2024-05-09T09:47:59.963235+0000","last_undegraded":"2024-05-09T09:47:59.963235+0000","last_fullsized":"2024-05-09T09:47:59.963235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:19:17.059104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.420100+0000","last_change":"2024-05-09T09:47:16.215057+0000","last_active":"2024-05-09T09:47:52.420100+0000","last_peered":"2024-05-09T09:47:52.420100+0000","last_clean":"2024-05-09T09:47:52.420100+0000","last_became_active":"2024-05-09T09:47:16.214484+0000","last_became_peered":"2024-05-09T09:47:16.214484+0000","last_unstale":"2024-05-09T09:47:52.420100+0000","last_undegraded":"2024-05-09T09:47:52.420100+0000","last_fullsized":"2024-05-09T09:47:52.420100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:13:09.787784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'106","reported_seq":148,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.175951+0000","last_change":"2024-05-09T09:47:18.231906+0000","last_active":"2024-05-09T09:49:35.175951+0000","last_peered":"2024-05-09T09:49:35.175951+0000","last_clean":"2024-05-09T09:49:35.175951+0000","last_became_active":"2024-05-09T09:47:18.224815+0000","last_became_peered":"2024-05-09T09:47:18.224815+0000","last_unstale":"2024-05-09T09:49:35.175951+0000","last_undegraded":"2024-05-09T09:49:35.175951+0000","last_fullsized":"2024-05-09T09:49:35.175951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:55:53.240395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.412400+0000","last_change":"2024-05-09T09:47:20.251863+0000","last_active":"2024-05-09T09:47:52.412400+0000","last_peered":"2024-05-09T09:47:52.412400+0000","last_clean":"2024-05-09T09:47:52.412400+0000","last_became_active":"2024-05-09T09:47:20.250686+0000","last_became_peered":"2024-05-09T09:47:20.250686+0000","last_unstale":"2024-05-09T09:47:52.412400+0000","last_undegraded":"2024-05-09T09:47:52.412400+0000","last_fullsized":"2024-05-09T09:47:52.412400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:37:23.903396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'17","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.338642+0000","last_change":"2024-05-09T09:47:22.255914+0000","last_active":"2024-05-09T09:50:32.338642+0000","last_peered":"2024-05-09T09:50:32.338642+0000","last_clean":"2024-05-09T09:50:32.338642+0000","last_became_active":"2024-05-09T09:47:22.255076+0000","last_became_peered":"2024-05-09T09:47:22.255076+0000","last_unstale":"2024-05-09T09:50:32.338642+0000","last_undegraded":"2024-05-09T09:50:32.338642+0000","last_fullsized":"2024-05-09T09:50:32.338642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:25:35.144336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":92,"num_read_kb":72,"num_write":55,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.173175+0000","last_change":"2024-05-09T09:47:14.180737+0000","last_active":"2024-05-09T09:47:52.173175+0000","last_peered":"2024-05-09T09:47:52.173175+0000","last_clean":"2024-05-09T09:47:52.173175+0000","last_became_active":"2024-05-09T09:47:14.180185+0000","last_became_peered":"2024-05-09T09:47:14.180185+0000","last_unstale":"2024-05-09T09:47:52.173175+0000","last_undegraded":"2024-05-09T09:47:52.173175+0000","last_fullsized":"2024-05-09T09:47:52.173175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:44.612188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:59.962280+0000","last_change":"2024-05-09T09:47:12.211357+0000","last_active":"2024-05-09T09:47:59.962280+0000","last_peered":"2024-05-09T09:47:59.962280+0000","last_clean":"2024-05-09T09:47:59.962280+0000","last_became_active":"2024-05-09T09:47:12.207751+0000","last_became_peered":"2024-05-09T09:47:12.207751+0000","last_unstale":"2024-05-09T09:47:59.962280+0000","last_undegraded":"2024-05-09T09:47:59.962280+0000","last_fullsized":"2024-05-09T09:47:59.962280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:41:27.203063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.427281+0000","last_change":"2024-05-09T09:47:16.208197+0000","last_active":"2024-05-09T09:47:52.427281+0000","last_peered":"2024-05-09T09:47:52.427281+0000","last_clean":"2024-05-09T09:47:52.427281+0000","last_became_active":"2024-05-09T09:47:16.207734+0000","last_became_peered":"2024-05-09T09:47:16.207734+0000","last_unstale":"2024-05-09T09:47:52.427281+0000","last_undegraded":"2024-05-09T09:47:52.427281+0000","last_fullsized":"2024-05-09T09:47:52.427281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:57:13.986799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'110","reported_seq":155,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.352435+0000","last_change":"2024-05-09T09:47:18.231116+0000","last_active":"2024-05-09T09:49:31.352435+0000","last_peered":"2024-05-09T09:49:31.352435+0000","last_clean":"2024-05-09T09:49:31.352435+0000","last_became_active":"2024-05-09T09:47:18.230440+0000","last_became_peered":"2024-05-09T09:47:18.230440+0000","last_unstale":"2024-05-09T09:49:31.352435+0000","last_undegraded":"2024-05-09T09:49:31.352435+0000","last_fullsized":"2024-05-09T09:49:31.352435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:05:58.884035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'282","reported_seq":350,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.502365+0000","last_change":"2024-05-09T09:47:20.254991+0000","last_active":"2024-05-09T09:50:33.502365+0000","last_peered":"2024-05-09T09:50:33.502365+0000","last_clean":"2024-05-09T09:50:33.502365+0000","last_became_active":"2024-05-09T09:47:20.254305+0000","last_became_peered":"2024-05-09T09:47:20.254305+0000","last_unstale":"2024-05-09T09:50:33.502365+0000","last_undegraded":"2024-05-09T09:50:33.502365+0000","last_fullsized":"2024-05-09T09:50:33.502365+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:35:09.855318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.424385+0000","last_change":"2024-05-09T09:47:22.239987+0000","last_active":"2024-05-09T09:47:52.424385+0000","last_peered":"2024-05-09T09:47:52.424385+0000","last_clean":"2024-05-09T09:47:52.424385+0000","last_became_active":"2024-05-09T09:47:22.239262+0000","last_became_peered":"2024-05-09T09:47:22.239262+0000","last_unstale":"2024-05-09T09:47:52.424385+0000","last_undegraded":"2024-05-09T09:47:52.424385+0000","last_fullsized":"2024-05-09T09:47:52.424385+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:19:34.324968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'8","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:45.864227+0000","last_change":"2024-05-09T09:47:14.184937+0000","last_active":"2024-05-09T09:48:45.864227+0000","last_peered":"2024-05-09T09:48:45.864227+0000","last_clean":"2024-05-09T09:48:45.864227+0000","last_became_active":"2024-05-09T09:47:14.184593+0000","last_became_peered":"2024-05-09T09:47:14.184593+0000","last_unstale":"2024-05-09T09:48:45.864227+0000","last_undegraded":"2024-05-09T09:48:45.864227+0000","last_fullsized":"2024-05-09T09:48:45.864227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:30:37.903160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'8","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.754083+0000","last_change":"2024-05-09T09:47:12.211539+0000","last_active":"2024-05-09T09:50:32.754083+0000","last_peered":"2024-05-09T09:50:32.754083+0000","last_clean":"2024-05-09T09:50:32.754083+0000","last_became_active":"2024-05-09T09:47:12.207403+0000","last_became_peered":"2024-05-09T09:47:12.207403+0000","last_unstale":"2024-05-09T09:50:32.754083+0000","last_undegraded":"2024-05-09T09:50:32.754083+0000","last_fullsized":"2024-05-09T09:50:32.754083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:20:53.292716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":16,"num_write_kb":8838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.419204+0000","last_change":"2024-05-09T09:47:16.215117+0000","last_active":"2024-05-09T09:47:52.419204+0000","last_peered":"2024-05-09T09:47:52.419204+0000","last_clean":"2024-05-09T09:47:52.419204+0000","last_became_active":"2024-05-09T09:47:16.214607+0000","last_became_peered":"2024-05-09T09:47:16.214607+0000","last_unstale":"2024-05-09T09:47:52.419204+0000","last_undegraded":"2024-05-09T09:47:52.419204+0000","last_fullsized":"2024-05-09T09:47:52.419204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:25:29.477094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'203","reported_seq":259,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.586505+0000","last_change":"2024-05-09T09:47:18.225638+0000","last_active":"2024-05-09T09:49:31.586505+0000","last_peered":"2024-05-09T09:49:31.586505+0000","last_clean":"2024-05-09T09:49:31.586505+0000","last_became_active":"2024-05-09T09:47:18.224893+0000","last_became_peered":"2024-05-09T09:47:18.224893+0000","last_unstale":"2024-05-09T09:49:31.586505+0000","last_undegraded":"2024-05-09T09:49:31.586505+0000","last_fullsized":"2024-05-09T09:49:31.586505+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:04:53.766220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.413967+0000","last_change":"2024-05-09T09:47:20.229087+0000","last_active":"2024-05-09T09:47:52.413967+0000","last_peered":"2024-05-09T09:47:52.413967+0000","last_clean":"2024-05-09T09:47:52.413967+0000","last_became_active":"2024-05-09T09:47:20.228339+0000","last_became_peered":"2024-05-09T09:47:20.228339+0000","last_unstale":"2024-05-09T09:47:52.413967+0000","last_undegraded":"2024-05-09T09:47:52.413967+0000","last_fullsized":"2024-05-09T09:47:52.413967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:36.440080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.461775+0000","last_change":"2024-05-09T09:47:22.230031+0000","last_active":"2024-05-09T09:50:33.461775+0000","last_peered":"2024-05-09T09:50:33.461775+0000","last_clean":"2024-05-09T09:50:33.461775+0000","last_became_active":"2024-05-09T09:47:22.229193+0000","last_became_peered":"2024-05-09T09:47:22.229193+0000","last_unstale":"2024-05-09T09:50:33.461775+0000","last_undegraded":"2024-05-09T09:50:33.461775+0000","last_fullsized":"2024-05-09T09:50:33.461775+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:48:21.332216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.239007+0000","last_change":"2024-05-09T09:47:14.177074+0000","last_active":"2024-05-09T09:50:33.239007+0000","last_peered":"2024-05-09T09:50:33.239007+0000","last_clean":"2024-05-09T09:50:33.239007+0000","last_became_active":"2024-05-09T09:47:14.176717+0000","last_became_peered":"2024-05-09T09:47:14.176717+0000","last_unstale":"2024-05-09T09:50:33.239007+0000","last_undegraded":"2024-05-09T09:50:33.239007+0000","last_fullsized":"2024-05-09T09:50:33.239007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:44:03.763451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.420829+0000","last_change":"2024-05-09T09:47:12.205840+0000","last_active":"2024-05-09T09:47:52.420829+0000","last_peered":"2024-05-09T09:47:52.420829+0000","last_clean":"2024-05-09T09:47:52.420829+0000","last_became_active":"2024-05-09T09:47:12.204317+0000","last_became_peered":"2024-05-09T09:47:12.204317+0000","last_unstale":"2024-05-09T09:47:52.420829+0000","last_undegraded":"2024-05-09T09:47:52.420829+0000","last_fullsized":"2024-05-09T09:47:52.420829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:00:05.597093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.182486+0000","last_change":"2024-05-09T09:47:16.201348+0000","last_active":"2024-05-09T09:47:52.182486+0000","last_peered":"2024-05-09T09:47:52.182486+0000","last_clean":"2024-05-09T09:47:52.182486+0000","last_became_active":"2024-05-09T09:47:16.197031+0000","last_became_peered":"2024-05-09T09:47:16.197031+0000","last_unstale":"2024-05-09T09:47:52.182486+0000","last_undegraded":"2024-05-09T09:47:52.182486+0000","last_fullsized":"2024-05-09T09:47:52.182486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:01:00.598993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'106","reported_seq":149,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.588499+0000","last_change":"2024-05-09T09:47:18.216586+0000","last_active":"2024-05-09T09:49:31.588499+0000","last_peered":"2024-05-09T09:49:31.588499+0000","last_clean":"2024-05-09T09:49:31.588499+0000","last_became_active":"2024-05-09T09:47:18.215793+0000","last_became_peered":"2024-05-09T09:47:18.215793+0000","last_unstale":"2024-05-09T09:49:31.588499+0000","last_undegraded":"2024-05-09T09:49:31.588499+0000","last_fullsized":"2024-05-09T09:49:31.588499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:36:23.945979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.196563+0000","last_change":"2024-05-09T09:47:20.251219+0000","last_active":"2024-05-09T09:47:52.196563+0000","last_peered":"2024-05-09T09:47:52.196563+0000","last_clean":"2024-05-09T09:47:52.196563+0000","last_became_active":"2024-05-09T09:47:20.250363+0000","last_became_peered":"2024-05-09T09:47:20.250363+0000","last_unstale":"2024-05-09T09:47:52.196563+0000","last_undegraded":"2024-05-09T09:47:52.196563+0000","last_fullsized":"2024-05-09T09:47:52.196563+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:59:21.981954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:29.007272+0000","last_change":"2024-05-09T09:47:22.243140+0000","last_active":"2024-05-09T09:49:29.007272+0000","last_peered":"2024-05-09T09:49:29.007272+0000","last_clean":"2024-05-09T09:49:29.007272+0000","last_became_active":"2024-05-09T09:47:22.242410+0000","last_became_peered":"2024-05-09T09:47:22.242410+0000","last_unstale":"2024-05-09T09:49:29.007272+0000","last_undegraded":"2024-05-09T09:49:29.007272+0000","last_fullsized":"2024-05-09T09:49:29.007272+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:49:33.614704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:01.438873+0000","last_change":"2024-05-09T09:47:14.190653+0000","last_active":"2024-05-09T09:48:01.438873+0000","last_peered":"2024-05-09T09:48:01.438873+0000","last_clean":"2024-05-09T09:48:01.438873+0000","last_became_active":"2024-05-09T09:47:14.190016+0000","last_became_peered":"2024-05-09T09:47:14.190016+0000","last_unstale":"2024-05-09T09:48:01.438873+0000","last_undegraded":"2024-05-09T09:48:01.438873+0000","last_fullsized":"2024-05-09T09:48:01.438873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:03.774479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.178134+0000","last_change":"2024-05-09T09:47:12.212155+0000","last_active":"2024-05-09T09:47:52.178134+0000","last_peered":"2024-05-09T09:47:52.178134+0000","last_clean":"2024-05-09T09:47:52.178134+0000","last_became_active":"2024-05-09T09:47:12.211221+0000","last_became_peered":"2024-05-09T09:47:12.211221+0000","last_unstale":"2024-05-09T09:47:52.178134+0000","last_undegraded":"2024-05-09T09:47:52.178134+0000","last_fullsized":"2024-05-09T09:47:52.178134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:35:10.235355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.423260+0000","last_change":"2024-05-09T09:47:16.215089+0000","last_active":"2024-05-09T09:47:52.423260+0000","last_peered":"2024-05-09T09:47:52.423260+0000","last_clean":"2024-05-09T09:47:52.423260+0000","last_became_active":"2024-05-09T09:47:16.214462+0000","last_became_peered":"2024-05-09T09:47:16.214462+0000","last_unstale":"2024-05-09T09:47:52.423260+0000","last_undegraded":"2024-05-09T09:47:52.423260+0000","last_fullsized":"2024-05-09T09:47:52.423260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:34:32.813103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'110","reported_seq":155,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.643232+0000","last_change":"2024-05-09T09:47:18.213308+0000","last_active":"2024-05-09T09:49:31.643232+0000","last_peered":"2024-05-09T09:49:31.643232+0000","last_clean":"2024-05-09T09:49:31.643232+0000","last_became_active":"2024-05-09T09:47:18.212543+0000","last_became_peered":"2024-05-09T09:47:18.212543+0000","last_unstale":"2024-05-09T09:49:31.643232+0000","last_undegraded":"2024-05-09T09:49:31.643232+0000","last_fullsized":"2024-05-09T09:49:31.643232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:51:51.001188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'282","reported_seq":433,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.474123+0000","last_change":"2024-05-09T09:47:20.240819+0000","last_active":"2024-05-09T09:50:33.474123+0000","last_peered":"2024-05-09T09:50:33.474123+0000","last_clean":"2024-05-09T09:50:33.474123+0000","last_became_active":"2024-05-09T09:47:20.240236+0000","last_became_peered":"2024-05-09T09:47:20.240236+0000","last_unstale":"2024-05-09T09:50:33.474123+0000","last_undegraded":"2024-05-09T09:50:33.474123+0000","last_fullsized":"2024-05-09T09:50:33.474123+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:36:25.958106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'14","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.031493+0000","last_change":"2024-05-09T09:47:22.258681+0000","last_active":"2024-05-09T09:49:32.031493+0000","last_peered":"2024-05-09T09:49:32.031493+0000","last_clean":"2024-05-09T09:49:32.031493+0000","last_became_active":"2024-05-09T09:47:22.257986+0000","last_became_peered":"2024-05-09T09:47:22.257986+0000","last_unstale":"2024-05-09T09:49:32.031493+0000","last_undegraded":"2024-05-09T09:49:32.031493+0000","last_fullsized":"2024-05-09T09:49:32.031493+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:25:35.144336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.238754+0000","last_change":"2024-05-09T09:47:14.173042+0000","last_active":"2024-05-09T09:50:33.238754+0000","last_peered":"2024-05-09T09:50:33.238754+0000","last_clean":"2024-05-09T09:50:33.238754+0000","last_became_active":"2024-05-09T09:47:14.171963+0000","last_became_peered":"2024-05-09T09:47:14.171963+0000","last_unstale":"2024-05-09T09:50:33.238754+0000","last_undegraded":"2024-05-09T09:50:33.238754+0000","last_fullsized":"2024-05-09T09:50:33.238754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:32:19.275039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.181005+0000","last_change":"2024-05-09T09:47:12.211112+0000","last_active":"2024-05-09T09:47:52.181005+0000","last_peered":"2024-05-09T09:47:52.181005+0000","last_clean":"2024-05-09T09:47:52.181005+0000","last_became_active":"2024-05-09T09:47:12.204519+0000","last_became_peered":"2024-05-09T09:47:12.204519+0000","last_unstale":"2024-05-09T09:47:52.181005+0000","last_undegraded":"2024-05-09T09:47:52.181005+0000","last_fullsized":"2024-05-09T09:47:52.181005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:35:14.637438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":413,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.551841+0000","last_change":"2024-05-09T09:47:16.211670+0000","last_active":"2024-05-09T09:49:31.551841+0000","last_peered":"2024-05-09T09:49:31.551841+0000","last_clean":"2024-05-09T09:49:31.551841+0000","last_became_active":"2024-05-09T09:47:16.210812+0000","last_became_peered":"2024-05-09T09:47:16.210812+0000","last_unstale":"2024-05-09T09:49:31.551841+0000","last_undegraded":"2024-05-09T09:49:31.551841+0000","last_fullsized":"2024-05-09T09:49:31.551841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:41.390200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.190863+0000","last_change":"2024-05-09T09:47:18.225280+0000","last_active":"2024-05-09T09:47:52.190863+0000","last_peered":"2024-05-09T09:47:52.190863+0000","last_clean":"2024-05-09T09:47:52.190863+0000","last_became_active":"2024-05-09T09:47:18.224565+0000","last_became_peered":"2024-05-09T09:47:18.224565+0000","last_unstale":"2024-05-09T09:47:52.190863+0000","last_undegraded":"2024-05-09T09:47:52.190863+0000","last_fullsized":"2024-05-09T09:47:52.190863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:53:57.817020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'282","reported_seq":470,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.415046+0000","last_change":"2024-05-09T09:47:20.215231+0000","last_active":"2024-05-09T09:50:33.415046+0000","last_peered":"2024-05-09T09:50:33.415046+0000","last_clean":"2024-05-09T09:50:33.415046+0000","last_became_active":"2024-05-09T09:47:20.214337+0000","last_became_peered":"2024-05-09T09:47:20.214337+0000","last_unstale":"2024-05-09T09:50:33.415046+0000","last_undegraded":"2024-05-09T09:50:33.415046+0000","last_fullsized":"2024-05-09T09:50:33.415046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:35:09.855318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.761634+0000","last_change":"2024-05-09T09:47:22.235441+0000","last_active":"2024-05-09T09:49:31.761634+0000","last_peered":"2024-05-09T09:49:31.761634+0000","last_clean":"2024-05-09T09:49:31.761634+0000","last_became_active":"2024-05-09T09:47:22.233796+0000","last_became_peered":"2024-05-09T09:47:22.233796+0000","last_unstale":"2024-05-09T09:49:31.761634+0000","last_undegraded":"2024-05-09T09:49:31.761634+0000","last_fullsized":"2024-05-09T09:49:31.761634+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:25:18.746306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.164264+0000","last_change":"2024-05-09T09:47:14.175270+0000","last_active":"2024-05-09T09:49:32.164264+0000","last_peered":"2024-05-09T09:49:32.164264+0000","last_clean":"2024-05-09T09:49:32.164264+0000","last_became_active":"2024-05-09T09:47:14.174707+0000","last_became_peered":"2024-05-09T09:47:14.174707+0000","last_unstale":"2024-05-09T09:49:32.164264+0000","last_undegraded":"2024-05-09T09:49:32.164264+0000","last_fullsized":"2024-05-09T09:49:32.164264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:54:18.468178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:01.759832+0000","last_change":"2024-05-09T09:47:12.208521+0000","last_active":"2024-05-09T09:48:01.759832+0000","last_peered":"2024-05-09T09:48:01.759832+0000","last_clean":"2024-05-09T09:48:01.759832+0000","last_became_active":"2024-05-09T09:47:12.207874+0000","last_became_peered":"2024-05-09T09:47:12.207874+0000","last_unstale":"2024-05-09T09:48:01.759832+0000","last_undegraded":"2024-05-09T09:48:01.759832+0000","last_fullsized":"2024-05-09T09:48:01.759832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:30:35.883636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"23'1","reported_seq":218,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.552287+0000","last_change":"2024-05-09T09:47:16.205195+0000","last_active":"2024-05-09T09:49:31.552287+0000","last_peered":"2024-05-09T09:49:31.552287+0000","last_clean":"2024-05-09T09:49:31.552287+0000","last_became_active":"2024-05-09T09:47:16.204577+0000","last_became_peered":"2024-05-09T09:47:16.204577+0000","last_unstale":"2024-05-09T09:49:31.552287+0000","last_undegraded":"2024-05-09T09:49:31.552287+0000","last_fullsized":"2024-05-09T09:49:31.552287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:40:46.201735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'112","reported_seq":158,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.613890+0000","last_change":"2024-05-09T09:47:18.204810+0000","last_active":"2024-05-09T09:49:31.613890+0000","last_peered":"2024-05-09T09:49:31.613890+0000","last_clean":"2024-05-09T09:49:31.613890+0000","last_became_active":"2024-05-09T09:47:18.204057+0000","last_became_peered":"2024-05-09T09:47:18.204057+0000","last_unstale":"2024-05-09T09:49:31.613890+0000","last_undegraded":"2024-05-09T09:49:31.613890+0000","last_fullsized":"2024-05-09T09:49:31.613890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:27:23.487170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.178557+0000","last_change":"2024-05-09T09:47:20.255850+0000","last_active":"2024-05-09T09:47:52.178557+0000","last_peered":"2024-05-09T09:47:52.178557+0000","last_clean":"2024-05-09T09:47:52.178557+0000","last_became_active":"2024-05-09T09:47:20.255477+0000","last_became_peered":"2024-05-09T09:47:20.255477+0000","last_unstale":"2024-05-09T09:47:52.178557+0000","last_undegraded":"2024-05-09T09:47:52.178557+0000","last_fullsized":"2024-05-09T09:47:52.178557+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:09.812329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'8","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.372509+0000","last_change":"2024-05-09T09:47:22.228107+0000","last_active":"2024-05-09T09:50:33.372509+0000","last_peered":"2024-05-09T09:50:33.372509+0000","last_clean":"2024-05-09T09:50:33.372509+0000","last_became_active":"2024-05-09T09:47:22.227373+0000","last_became_peered":"2024-05-09T09:47:22.227373+0000","last_unstale":"2024-05-09T09:50:33.372509+0000","last_undegraded":"2024-05-09T09:50:33.372509+0000","last_fullsized":"2024-05-09T09:50:33.372509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:22:52.362489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'7","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.172569+0000","last_change":"2024-05-09T09:47:14.189976+0000","last_active":"2024-05-09T09:49:20.172569+0000","last_peered":"2024-05-09T09:49:20.172569+0000","last_clean":"2024-05-09T09:49:20.172569+0000","last_became_active":"2024-05-09T09:47:14.189623+0000","last_became_peered":"2024-05-09T09:47:14.189623+0000","last_unstale":"2024-05-09T09:49:20.172569+0000","last_undegraded":"2024-05-09T09:49:20.172569+0000","last_fullsized":"2024-05-09T09:49:20.172569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:21.387148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":202,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.163439+0000","last_change":"2024-05-09T09:46:57.510904+0000","last_active":"2024-05-09T09:47:52.163439+0000","last_peered":"2024-05-09T09:47:52.163439+0000","last_clean":"2024-05-09T09:47:52.163439+0000","last_became_active":"2024-05-09T09:46:57.508178+0000","last_became_peered":"2024-05-09T09:46:57.508178+0000","last_unstale":"2024-05-09T09:47:52.163439+0000","last_undegraded":"2024-05-09T09:47:52.163439+0000","last_fullsized":"2024-05-09T09:47:52.163439+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:46:56.015260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:46:56.015260+0000","last_clean_scrub_stamp":"2024-05-09T09:46:56.015260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:04:32.521129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.187056+0000","last_change":"2024-05-09T09:47:03.054623+0000","last_active":"2024-05-09T09:47:52.187056+0000","last_peered":"2024-05-09T09:47:52.187056+0000","last_clean":"2024-05-09T09:47:52.187056+0000","last_became_active":"2024-05-09T09:47:03.053783+0000","last_became_peered":"2024-05-09T09:47:03.053783+0000","last_unstale":"2024-05-09T09:47:52.187056+0000","last_undegraded":"2024-05-09T09:47:52.187056+0000","last_fullsized":"2024-05-09T09:47:52.187056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:12:39.792983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.176479+0000","last_change":"2024-05-09T09:47:12.212397+0000","last_active":"2024-05-09T09:47:52.176479+0000","last_peered":"2024-05-09T09:47:52.176479+0000","last_clean":"2024-05-09T09:47:52.176479+0000","last_became_active":"2024-05-09T09:47:12.211344+0000","last_became_peered":"2024-05-09T09:47:12.211344+0000","last_unstale":"2024-05-09T09:47:52.176479+0000","last_undegraded":"2024-05-09T09:47:52.176479+0000","last_fullsized":"2024-05-09T09:47:52.176479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:42.592663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.170165+0000","last_change":"2024-05-09T09:47:16.211676+0000","last_active":"2024-05-09T09:47:52.170165+0000","last_peered":"2024-05-09T09:47:52.170165+0000","last_clean":"2024-05-09T09:47:52.170165+0000","last_became_active":"2024-05-09T09:47:16.210404+0000","last_became_peered":"2024-05-09T09:47:16.210404+0000","last_unstale":"2024-05-09T09:47:52.170165+0000","last_undegraded":"2024-05-09T09:47:52.170165+0000","last_fullsized":"2024-05-09T09:47:52.170165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:29:50.436846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'298","reported_seq":367,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.618245+0000","last_change":"2024-05-09T09:47:18.237058+0000","last_active":"2024-05-09T09:49:31.618245+0000","last_peered":"2024-05-09T09:49:31.618245+0000","last_clean":"2024-05-09T09:49:31.618245+0000","last_became_active":"2024-05-09T09:47:18.236370+0000","last_became_peered":"2024-05-09T09:47:18.236370+0000","last_unstale":"2024-05-09T09:49:31.618245+0000","last_undegraded":"2024-05-09T09:49:31.618245+0000","last_fullsized":"2024-05-09T09:49:31.618245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:35:27.710372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.423093+0000","last_change":"2024-05-09T09:47:20.251241+0000","last_active":"2024-05-09T09:47:52.423093+0000","last_peered":"2024-05-09T09:47:52.423093+0000","last_clean":"2024-05-09T09:47:52.423093+0000","last_became_active":"2024-05-09T09:47:20.250373+0000","last_became_peered":"2024-05-09T09:47:20.250373+0000","last_unstale":"2024-05-09T09:47:52.423093+0000","last_undegraded":"2024-05-09T09:47:52.423093+0000","last_fullsized":"2024-05-09T09:47:52.423093+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:20:34.198648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'86","reported_seq":169,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.328990+0000","last_change":"2024-05-09T09:47:22.237003+0000","last_active":"2024-05-09T09:50:33.328990+0000","last_peered":"2024-05-09T09:50:33.328990+0000","last_clean":"2024-05-09T09:50:33.328990+0000","last_became_active":"2024-05-09T09:47:22.236267+0000","last_became_peered":"2024-05-09T09:47:22.236267+0000","last_unstale":"2024-05-09T09:50:33.328990+0000","last_undegraded":"2024-05-09T09:50:33.328990+0000","last_fullsized":"2024-05-09T09:50:33.328990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:08.206306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":223,"num_write":170,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:01.804496+0000","last_change":"2024-05-09T09:47:14.185397+0000","last_active":"2024-05-09T09:48:01.804496+0000","last_peered":"2024-05-09T09:48:01.804496+0000","last_clean":"2024-05-09T09:48:01.804496+0000","last_became_active":"2024-05-09T09:47:14.185071+0000","last_became_peered":"2024-05-09T09:47:14.185071+0000","last_unstale":"2024-05-09T09:48:01.804496+0000","last_undegraded":"2024-05-09T09:48:01.804496+0000","last_fullsized":"2024-05-09T09:48:01.804496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:49:40.986014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.168817+0000","last_change":"2024-05-09T09:47:03.051628+0000","last_active":"2024-05-09T09:47:52.168817+0000","last_peered":"2024-05-09T09:47:52.168817+0000","last_clean":"2024-05-09T09:47:52.168817+0000","last_became_active":"2024-05-09T09:47:03.050535+0000","last_became_peered":"2024-05-09T09:47:03.050535+0000","last_unstale":"2024-05-09T09:47:52.168817+0000","last_undegraded":"2024-05-09T09:47:52.168817+0000","last_fullsized":"2024-05-09T09:47:52.168817+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:09:16.875087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:46.145259+0000","last_change":"2024-05-09T09:47:12.206331+0000","last_active":"2024-05-09T09:48:46.145259+0000","last_peered":"2024-05-09T09:48:46.145259+0000","last_clean":"2024-05-09T09:48:46.145259+0000","last_became_active":"2024-05-09T09:47:12.203494+0000","last_became_peered":"2024-05-09T09:47:12.203494+0000","last_unstale":"2024-05-09T09:48:46.145259+0000","last_undegraded":"2024-05-09T09:48:46.145259+0000","last_fullsized":"2024-05-09T09:48:46.145259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:55.107119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.196899+0000","last_change":"2024-05-09T09:47:16.201019+0000","last_active":"2024-05-09T09:47:52.196899+0000","last_peered":"2024-05-09T09:47:52.196899+0000","last_clean":"2024-05-09T09:47:52.196899+0000","last_became_active":"2024-05-09T09:47:16.200369+0000","last_became_peered":"2024-05-09T09:47:16.200369+0000","last_unstale":"2024-05-09T09:47:52.196899+0000","last_undegraded":"2024-05-09T09:47:52.196899+0000","last_fullsized":"2024-05-09T09:47:52.196899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:03.943505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'495","reported_seq":700,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:31.469895+0000","last_change":"2024-05-09T09:47:18.220093+0000","last_active":"2024-05-09T09:50:31.469895+0000","last_peered":"2024-05-09T09:50:31.469895+0000","last_clean":"2024-05-09T09:50:31.469895+0000","last_became_active":"2024-05-09T09:47:18.219321+0000","last_became_peered":"2024-05-09T09:47:18.219321+0000","last_unstale":"2024-05-09T09:50:31.469895+0000","last_undegraded":"2024-05-09T09:50:31.469895+0000","last_fullsized":"2024-05-09T09:50:31.469895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:07.800202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.191188+0000","last_change":"2024-05-09T09:47:20.249740+0000","last_active":"2024-05-09T09:47:52.191188+0000","last_peered":"2024-05-09T09:47:52.191188+0000","last_clean":"2024-05-09T09:47:52.191188+0000","last_became_active":"2024-05-09T09:47:20.249089+0000","last_became_peered":"2024-05-09T09:47:20.249089+0000","last_unstale":"2024-05-09T09:47:52.191188+0000","last_undegraded":"2024-05-09T09:47:52.191188+0000","last_fullsized":"2024-05-09T09:47:52.191188+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:15:27.189938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:45.869681+0000","last_change":"2024-05-09T09:47:22.245460+0000","last_active":"2024-05-09T09:48:45.869681+0000","last_peered":"2024-05-09T09:48:45.869681+0000","last_clean":"2024-05-09T09:48:45.869681+0000","last_became_active":"2024-05-09T09:47:22.244543+0000","last_became_peered":"2024-05-09T09:47:22.244543+0000","last_unstale":"2024-05-09T09:48:45.869681+0000","last_undegraded":"2024-05-09T09:48:45.869681+0000","last_fullsized":"2024-05-09T09:48:45.869681+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:59:48.546473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.150108+0000","last_change":"2024-05-09T09:47:14.177030+0000","last_active":"2024-05-09T09:50:33.150108+0000","last_peered":"2024-05-09T09:50:33.150108+0000","last_clean":"2024-05-09T09:50:33.150108+0000","last_became_active":"2024-05-09T09:47:14.173959+0000","last_became_peered":"2024-05-09T09:47:14.173959+0000","last_unstale":"2024-05-09T09:50:33.150108+0000","last_undegraded":"2024-05-09T09:50:33.150108+0000","last_fullsized":"2024-05-09T09:50:33.150108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:57.831374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.167819+0000","last_change":"2024-05-09T09:47:03.052957+0000","last_active":"2024-05-09T09:47:52.167819+0000","last_peered":"2024-05-09T09:47:52.167819+0000","last_clean":"2024-05-09T09:47:52.167819+0000","last_became_active":"2024-05-09T09:47:03.052185+0000","last_became_peered":"2024-05-09T09:47:03.052185+0000","last_unstale":"2024-05-09T09:47:52.167819+0000","last_undegraded":"2024-05-09T09:47:52.167819+0000","last_fullsized":"2024-05-09T09:47:52.167819+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:48:39.354125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.102108+0000","last_change":"2024-05-09T09:47:12.186149+0000","last_active":"2024-05-09T09:50:33.102108+0000","last_peered":"2024-05-09T09:50:33.102108+0000","last_clean":"2024-05-09T09:50:33.102108+0000","last_became_active":"2024-05-09T09:47:12.183846+0000","last_became_peered":"2024-05-09T09:47:12.183846+0000","last_unstale":"2024-05-09T09:50:33.102108+0000","last_undegraded":"2024-05-09T09:50:33.102108+0000","last_fullsized":"2024-05-09T09:50:33.102108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:46.107016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.185095+0000","last_change":"2024-05-09T09:47:16.202023+0000","last_active":"2024-05-09T09:47:52.185095+0000","last_peered":"2024-05-09T09:47:52.185095+0000","last_clean":"2024-05-09T09:47:52.185095+0000","last_became_active":"2024-05-09T09:47:16.197380+0000","last_became_peered":"2024-05-09T09:47:16.197380+0000","last_unstale":"2024-05-09T09:47:52.185095+0000","last_undegraded":"2024-05-09T09:47:52.185095+0000","last_fullsized":"2024-05-09T09:47:52.185095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:23:20.908060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'18","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:31.469305+0000","last_change":"2024-05-09T09:47:18.218553+0000","last_active":"2024-05-09T09:50:31.469305+0000","last_peered":"2024-05-09T09:50:31.469305+0000","last_clean":"2024-05-09T09:50:31.469305+0000","last_became_active":"2024-05-09T09:47:18.217023+0000","last_became_peered":"2024-05-09T09:47:18.217023+0000","last_unstale":"2024-05-09T09:50:31.469305+0000","last_undegraded":"2024-05-09T09:50:31.469305+0000","last_fullsized":"2024-05-09T09:50:31.469305+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:31.382403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.420979+0000","last_change":"2024-05-09T09:47:20.251883+0000","last_active":"2024-05-09T09:47:52.420979+0000","last_peered":"2024-05-09T09:47:52.420979+0000","last_clean":"2024-05-09T09:47:52.420979+0000","last_became_active":"2024-05-09T09:47:20.250979+0000","last_became_peered":"2024-05-09T09:47:20.250979+0000","last_unstale":"2024-05-09T09:47:52.420979+0000","last_undegraded":"2024-05-09T09:47:52.420979+0000","last_fullsized":"2024-05-09T09:47:52.420979+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:41:44.382613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.176855+0000","last_change":"2024-05-09T09:47:22.264183+0000","last_active":"2024-05-09T09:47:52.176855+0000","last_peered":"2024-05-09T09:47:52.176855+0000","last_clean":"2024-05-09T09:47:52.176855+0000","last_became_active":"2024-05-09T09:47:22.263615+0000","last_became_peered":"2024-05-09T09:47:22.263615+0000","last_unstale":"2024-05-09T09:47:52.176855+0000","last_undegraded":"2024-05-09T09:47:52.176855+0000","last_fullsized":"2024-05-09T09:47:52.176855+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:55:41.434447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'4","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:00.834605+0000","last_change":"2024-05-09T09:47:14.190245+0000","last_active":"2024-05-09T09:48:00.834605+0000","last_peered":"2024-05-09T09:48:00.834605+0000","last_clean":"2024-05-09T09:48:00.834605+0000","last_became_active":"2024-05-09T09:47:14.188644+0000","last_became_peered":"2024-05-09T09:47:14.188644+0000","last_unstale":"2024-05-09T09:48:00.834605+0000","last_undegraded":"2024-05-09T09:48:00.834605+0000","last_fullsized":"2024-05-09T09:48:00.834605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:41:29.222588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.173230+0000","last_change":"2024-05-09T09:47:03.051760+0000","last_active":"2024-05-09T09:47:52.173230+0000","last_peered":"2024-05-09T09:47:52.173230+0000","last_clean":"2024-05-09T09:47:52.173230+0000","last_became_active":"2024-05-09T09:47:03.050832+0000","last_became_peered":"2024-05-09T09:47:03.050832+0000","last_unstale":"2024-05-09T09:47:52.173230+0000","last_undegraded":"2024-05-09T09:47:52.173230+0000","last_fullsized":"2024-05-09T09:47:52.173230+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:47.680871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.179110+0000","last_change":"2024-05-09T09:47:12.191109+0000","last_active":"2024-05-09T09:47:52.179110+0000","last_peered":"2024-05-09T09:47:52.179110+0000","last_clean":"2024-05-09T09:47:52.179110+0000","last_became_active":"2024-05-09T09:47:12.190521+0000","last_became_peered":"2024-05-09T09:47:12.190521+0000","last_unstale":"2024-05-09T09:47:52.179110+0000","last_undegraded":"2024-05-09T09:47:52.179110+0000","last_fullsized":"2024-05-09T09:47:52.179110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:14:11.726333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.423038+0000","last_change":"2024-05-09T09:47:16.189464+0000","last_active":"2024-05-09T09:47:52.423038+0000","last_peered":"2024-05-09T09:47:52.423038+0000","last_clean":"2024-05-09T09:47:52.423038+0000","last_became_active":"2024-05-09T09:47:16.187120+0000","last_became_peered":"2024-05-09T09:47:16.187120+0000","last_unstale":"2024-05-09T09:47:52.423038+0000","last_undegraded":"2024-05-09T09:47:52.423038+0000","last_fullsized":"2024-05-09T09:47:52.423038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:29.369869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'14","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.208504+0000","last_change":"2024-05-09T09:47:18.231683+0000","last_active":"2024-05-09T09:50:32.208504+0000","last_peered":"2024-05-09T09:50:32.208504+0000","last_clean":"2024-05-09T09:50:32.208504+0000","last_became_active":"2024-05-09T09:47:18.230757+0000","last_became_peered":"2024-05-09T09:47:18.230757+0000","last_unstale":"2024-05-09T09:50:32.208504+0000","last_undegraded":"2024-05-09T09:50:32.208504+0000","last_fullsized":"2024-05-09T09:50:32.208504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:11:55.151452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.198252+0000","last_change":"2024-05-09T09:47:20.250439+0000","last_active":"2024-05-09T09:47:52.198252+0000","last_peered":"2024-05-09T09:47:52.198252+0000","last_clean":"2024-05-09T09:47:52.198252+0000","last_became_active":"2024-05-09T09:47:20.249919+0000","last_became_peered":"2024-05-09T09:47:20.249919+0000","last_unstale":"2024-05-09T09:47:52.198252+0000","last_undegraded":"2024-05-09T09:47:52.198252+0000","last_fullsized":"2024-05-09T09:47:52.198252+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:01:29.818831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'6","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.774666+0000","last_change":"2024-05-09T09:47:22.260930+0000","last_active":"2024-05-09T09:49:31.774666+0000","last_peered":"2024-05-09T09:49:31.774666+0000","last_clean":"2024-05-09T09:49:31.774666+0000","last_became_active":"2024-05-09T09:47:22.259833+0000","last_became_peered":"2024-05-09T09:47:22.259833+0000","last_unstale":"2024-05-09T09:49:31.774666+0000","last_undegraded":"2024-05-09T09:49:31.774666+0000","last_fullsized":"2024-05-09T09:49:31.774666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:01.734541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.809750+0000","last_change":"2024-05-09T09:47:14.174110+0000","last_active":"2024-05-09T09:50:32.809750+0000","last_peered":"2024-05-09T09:50:32.809750+0000","last_clean":"2024-05-09T09:50:32.809750+0000","last_became_active":"2024-05-09T09:47:14.173535+0000","last_became_peered":"2024-05-09T09:47:14.173535+0000","last_unstale":"2024-05-09T09:50:32.809750+0000","last_undegraded":"2024-05-09T09:50:32.809750+0000","last_fullsized":"2024-05-09T09:50:32.809750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:35:20.332271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:00.785377+0000","last_change":"2024-05-09T09:47:12.195767+0000","last_active":"2024-05-09T09:48:00.785377+0000","last_peered":"2024-05-09T09:48:00.785377+0000","last_clean":"2024-05-09T09:48:00.785377+0000","last_became_active":"2024-05-09T09:47:12.194500+0000","last_became_peered":"2024-05-09T09:47:12.194500+0000","last_unstale":"2024-05-09T09:48:00.785377+0000","last_undegraded":"2024-05-09T09:48:00.785377+0000","last_fullsized":"2024-05-09T09:48:00.785377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:06.949531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.425796+0000","last_change":"2024-05-09T09:47:03.051513+0000","last_active":"2024-05-09T09:47:52.425796+0000","last_peered":"2024-05-09T09:47:52.425796+0000","last_clean":"2024-05-09T09:47:52.425796+0000","last_became_active":"2024-05-09T09:47:03.051159+0000","last_became_peered":"2024-05-09T09:47:03.051159+0000","last_unstale":"2024-05-09T09:47:52.425796+0000","last_undegraded":"2024-05-09T09:47:52.425796+0000","last_fullsized":"2024-05-09T09:47:52.425796+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:12.598885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'5","reported_seq":227,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.535909+0000","last_change":"2024-05-09T09:47:16.199008+0000","last_active":"2024-05-09T09:49:31.535909+0000","last_peered":"2024-05-09T09:49:31.535909+0000","last_clean":"2024-05-09T09:49:31.535909+0000","last_became_active":"2024-05-09T09:47:16.198233+0000","last_became_peered":"2024-05-09T09:47:16.198233+0000","last_unstale":"2024-05-09T09:49:31.535909+0000","last_undegraded":"2024-05-09T09:49:31.535909+0000","last_fullsized":"2024-05-09T09:49:31.535909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:04.613279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1180,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'209","reported_seq":268,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.639919+0000","last_change":"2024-05-09T09:47:18.200360+0000","last_active":"2024-05-09T09:49:31.639919+0000","last_peered":"2024-05-09T09:49:31.639919+0000","last_clean":"2024-05-09T09:49:31.639919+0000","last_became_active":"2024-05-09T09:47:18.199411+0000","last_became_peered":"2024-05-09T09:47:18.199411+0000","last_unstale":"2024-05-09T09:49:31.639919+0000","last_undegraded":"2024-05-09T09:49:31.639919+0000","last_fullsized":"2024-05-09T09:49:31.639919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:30:17.183321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.166977+0000","last_change":"2024-05-09T09:47:20.233735+0000","last_active":"2024-05-09T09:47:52.166977+0000","last_peered":"2024-05-09T09:47:52.166977+0000","last_clean":"2024-05-09T09:47:52.166977+0000","last_became_active":"2024-05-09T09:47:20.233024+0000","last_became_peered":"2024-05-09T09:47:20.233024+0000","last_unstale":"2024-05-09T09:47:52.166977+0000","last_undegraded":"2024-05-09T09:47:52.166977+0000","last_fullsized":"2024-05-09T09:47:52.166977+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:49:47.023864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.037073+0000","last_change":"2024-05-09T09:47:22.229611+0000","last_active":"2024-05-09T09:49:32.037073+0000","last_peered":"2024-05-09T09:49:32.037073+0000","last_clean":"2024-05-09T09:49:32.037073+0000","last_became_active":"2024-05-09T09:47:22.228855+0000","last_became_peered":"2024-05-09T09:47:22.228855+0000","last_unstale":"2024-05-09T09:49:32.037073+0000","last_undegraded":"2024-05-09T09:49:32.037073+0000","last_fullsized":"2024-05-09T09:49:32.037073+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:42:02.241469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'12","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.303331+0000","last_change":"2024-05-09T09:47:52.440285+0000","last_active":"2024-05-09T09:50:33.303331+0000","last_peered":"2024-05-09T09:50:33.303331+0000","last_clean":"2024-05-09T09:50:33.303331+0000","last_became_active":"2024-05-09T09:47:52.430912+0000","last_became_peered":"2024-05-09T09:47:52.430912+0000","last_unstale":"2024-05-09T09:50:33.303331+0000","last_undegraded":"2024-05-09T09:50:33.303331+0000","last_fullsized":"2024-05-09T09:50:33.303331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:11:51.125729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.420062+0000","last_change":"2024-05-09T09:47:12.190681+0000","last_active":"2024-05-09T09:47:52.420062+0000","last_peered":"2024-05-09T09:47:52.420062+0000","last_clean":"2024-05-09T09:47:52.420062+0000","last_became_active":"2024-05-09T09:47:12.189486+0000","last_became_peered":"2024-05-09T09:47:12.189486+0000","last_unstale":"2024-05-09T09:47:52.420062+0000","last_undegraded":"2024-05-09T09:47:52.420062+0000","last_fullsized":"2024-05-09T09:47:52.420062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:36:27.157767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.192263+0000","last_change":"2024-05-09T09:47:03.051225+0000","last_active":"2024-05-09T09:47:52.192263+0000","last_peered":"2024-05-09T09:47:52.192263+0000","last_clean":"2024-05-09T09:47:52.192263+0000","last_became_active":"2024-05-09T09:47:03.050600+0000","last_became_peered":"2024-05-09T09:47:03.050600+0000","last_unstale":"2024-05-09T09:47:52.192263+0000","last_undegraded":"2024-05-09T09:47:52.192263+0000","last_fullsized":"2024-05-09T09:47:52.192263+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:08:36.545563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.173025+0000","last_change":"2024-05-09T09:47:16.188804+0000","last_active":"2024-05-09T09:47:52.173025+0000","last_peered":"2024-05-09T09:47:52.173025+0000","last_clean":"2024-05-09T09:47:52.173025+0000","last_became_active":"2024-05-09T09:47:16.182232+0000","last_became_peered":"2024-05-09T09:47:16.182232+0000","last_unstale":"2024-05-09T09:47:52.173025+0000","last_undegraded":"2024-05-09T09:47:52.173025+0000","last_fullsized":"2024-05-09T09:47:52.173025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:35:05.830656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.165199+0000","last_change":"2024-05-09T09:47:18.213188+0000","last_active":"2024-05-09T09:47:52.165199+0000","last_peered":"2024-05-09T09:47:52.165199+0000","last_clean":"2024-05-09T09:47:52.165199+0000","last_became_active":"2024-05-09T09:47:18.211020+0000","last_became_peered":"2024-05-09T09:47:18.211020+0000","last_unstale":"2024-05-09T09:47:52.165199+0000","last_undegraded":"2024-05-09T09:47:52.165199+0000","last_fullsized":"2024-05-09T09:47:52.165199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:53:16.173752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'282","reported_seq":371,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:31.469244+0000","last_change":"2024-05-09T09:47:20.227322+0000","last_active":"2024-05-09T09:50:31.469244+0000","last_peered":"2024-05-09T09:50:31.469244+0000","last_clean":"2024-05-09T09:50:31.469244+0000","last_became_active":"2024-05-09T09:47:20.226481+0000","last_became_peered":"2024-05-09T09:47:20.226481+0000","last_unstale":"2024-05-09T09:50:31.469244+0000","last_undegraded":"2024-05-09T09:50:31.469244+0000","last_fullsized":"2024-05-09T09:50:31.469244+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:03:55.645189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.195877+0000","last_change":"2024-05-09T09:47:22.256859+0000","last_active":"2024-05-09T09:47:52.195877+0000","last_peered":"2024-05-09T09:47:52.195877+0000","last_clean":"2024-05-09T09:47:52.195877+0000","last_became_active":"2024-05-09T09:47:22.256285+0000","last_became_peered":"2024-05-09T09:47:22.256285+0000","last_unstale":"2024-05-09T09:47:52.195877+0000","last_undegraded":"2024-05-09T09:47:52.195877+0000","last_fullsized":"2024-05-09T09:47:52.195877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:11:22.508789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.239155+0000","last_change":"2024-05-09T09:47:14.183911+0000","last_active":"2024-05-09T09:50:33.239155+0000","last_peered":"2024-05-09T09:50:33.239155+0000","last_clean":"2024-05-09T09:50:33.239155+0000","last_became_active":"2024-05-09T09:47:14.183542+0000","last_became_peered":"2024-05-09T09:47:14.183542+0000","last_unstale":"2024-05-09T09:50:33.239155+0000","last_undegraded":"2024-05-09T09:50:33.239155+0000","last_fullsized":"2024-05-09T09:50:33.239155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:29:48.423658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.199875+0000","last_change":"2024-05-09T09:47:12.200135+0000","last_active":"2024-05-09T09:47:52.199875+0000","last_peered":"2024-05-09T09:47:52.199875+0000","last_clean":"2024-05-09T09:47:52.199875+0000","last_became_active":"2024-05-09T09:47:12.199656+0000","last_became_peered":"2024-05-09T09:47:12.199656+0000","last_unstale":"2024-05-09T09:47:52.199875+0000","last_undegraded":"2024-05-09T09:47:52.199875+0000","last_fullsized":"2024-05-09T09:47:52.199875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:32:17.255514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.427138+0000","last_change":"2024-05-09T09:47:03.053083+0000","last_active":"2024-05-09T09:47:52.427138+0000","last_peered":"2024-05-09T09:47:52.427138+0000","last_clean":"2024-05-09T09:47:52.427138+0000","last_became_active":"2024-05-09T09:47:03.052728+0000","last_became_peered":"2024-05-09T09:47:03.052728+0000","last_unstale":"2024-05-09T09:47:52.427138+0000","last_undegraded":"2024-05-09T09:47:52.427138+0000","last_fullsized":"2024-05-09T09:47:52.427138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:40:57.635793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.184620+0000","last_change":"2024-05-09T09:47:52.183646+0000","last_active":"2024-05-09T09:47:52.184620+0000","last_peered":"2024-05-09T09:47:52.184620+0000","last_clean":"2024-05-09T09:47:52.184620+0000","last_became_active":"2024-05-09T09:47:52.182360+0000","last_became_peered":"2024-05-09T09:47:52.182360+0000","last_unstale":"2024-05-09T09:47:52.184620+0000","last_undegraded":"2024-05-09T09:47:52.184620+0000","last_fullsized":"2024-05-09T09:47:52.184620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:36:55.505219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.177728+0000","last_change":"2024-05-09T09:47:18.235283+0000","last_active":"2024-05-09T09:47:52.177728+0000","last_peered":"2024-05-09T09:47:52.177728+0000","last_clean":"2024-05-09T09:47:52.177728+0000","last_became_active":"2024-05-09T09:47:18.234556+0000","last_became_peered":"2024-05-09T09:47:18.234556+0000","last_unstale":"2024-05-09T09:47:52.177728+0000","last_undegraded":"2024-05-09T09:47:52.177728+0000","last_fullsized":"2024-05-09T09:47:52.177728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:52:44.437137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'282","reported_seq":401,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.488738+0000","last_change":"2024-05-09T09:47:20.229005+0000","last_active":"2024-05-09T09:50:33.488738+0000","last_peered":"2024-05-09T09:50:33.488738+0000","last_clean":"2024-05-09T09:50:33.488738+0000","last_became_active":"2024-05-09T09:47:20.226936+0000","last_became_peered":"2024-05-09T09:47:20.226936+0000","last_unstale":"2024-05-09T09:50:33.488738+0000","last_undegraded":"2024-05-09T09:50:33.488738+0000","last_fullsized":"2024-05-09T09:50:33.488738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:17:45.132446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.168136+0000","last_change":"2024-05-09T09:47:22.260147+0000","last_active":"2024-05-09T09:47:52.168136+0000","last_peered":"2024-05-09T09:47:52.168136+0000","last_clean":"2024-05-09T09:47:52.168136+0000","last_became_active":"2024-05-09T09:47:22.259547+0000","last_became_peered":"2024-05-09T09:47:22.259547+0000","last_unstale":"2024-05-09T09:47:52.168136+0000","last_undegraded":"2024-05-09T09:47:52.168136+0000","last_fullsized":"2024-05-09T09:47:52.168136+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:00:03.909321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'12","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:46.159946+0000","last_change":"2024-05-09T09:47:14.174039+0000","last_active":"2024-05-09T09:48:46.159946+0000","last_peered":"2024-05-09T09:48:46.159946+0000","last_clean":"2024-05-09T09:48:46.159946+0000","last_became_active":"2024-05-09T09:47:14.173673+0000","last_became_peered":"2024-05-09T09:47:14.173673+0000","last_unstale":"2024-05-09T09:48:46.159946+0000","last_undegraded":"2024-05-09T09:48:46.159946+0000","last_fullsized":"2024-05-09T09:48:46.159946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:56:48.282736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.174836+0000","last_change":"2024-05-09T09:47:12.206199+0000","last_active":"2024-05-09T09:47:52.174836+0000","last_peered":"2024-05-09T09:47:52.174836+0000","last_clean":"2024-05-09T09:47:52.174836+0000","last_became_active":"2024-05-09T09:47:12.205502+0000","last_became_peered":"2024-05-09T09:47:12.205502+0000","last_unstale":"2024-05-09T09:47:52.174836+0000","last_undegraded":"2024-05-09T09:47:52.174836+0000","last_fullsized":"2024-05-09T09:47:52.174836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:00:03.229983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.198477+0000","last_change":"2024-05-09T09:47:03.187330+0000","last_active":"2024-05-09T09:47:52.198477+0000","last_peered":"2024-05-09T09:47:52.198477+0000","last_clean":"2024-05-09T09:47:52.198477+0000","last_became_active":"2024-05-09T09:47:03.186434+0000","last_became_peered":"2024-05-09T09:47:03.186434+0000","last_unstale":"2024-05-09T09:47:52.198477+0000","last_undegraded":"2024-05-09T09:47:52.198477+0000","last_fullsized":"2024-05-09T09:47:52.198477+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:51:35.071748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.168475+0000","last_change":"2024-05-09T09:47:16.184166+0000","last_active":"2024-05-09T09:47:52.168475+0000","last_peered":"2024-05-09T09:47:52.168475+0000","last_clean":"2024-05-09T09:47:52.168475+0000","last_became_active":"2024-05-09T09:47:16.182713+0000","last_became_peered":"2024-05-09T09:47:16.182713+0000","last_unstale":"2024-05-09T09:47:52.168475+0000","last_undegraded":"2024-05-09T09:47:52.168475+0000","last_fullsized":"2024-05-09T09:47:52.168475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:03:51.620527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'304","reported_seq":376,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.596879+0000","last_change":"2024-05-09T09:47:18.227175+0000","last_active":"2024-05-09T09:49:31.596879+0000","last_peered":"2024-05-09T09:49:31.596879+0000","last_clean":"2024-05-09T09:49:31.596879+0000","last_became_active":"2024-05-09T09:47:18.226473+0000","last_became_peered":"2024-05-09T09:47:18.226473+0000","last_unstale":"2024-05-09T09:49:31.596879+0000","last_undegraded":"2024-05-09T09:49:31.596879+0000","last_fullsized":"2024-05-09T09:49:31.596879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:06.625814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.414174+0000","last_change":"2024-05-09T09:47:20.228640+0000","last_active":"2024-05-09T09:47:52.414174+0000","last_peered":"2024-05-09T09:47:52.414174+0000","last_clean":"2024-05-09T09:47:52.414174+0000","last_became_active":"2024-05-09T09:47:20.227198+0000","last_became_peered":"2024-05-09T09:47:20.227198+0000","last_unstale":"2024-05-09T09:47:52.414174+0000","last_undegraded":"2024-05-09T09:47:52.414174+0000","last_fullsized":"2024-05-09T09:47:52.414174+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:03:55.645189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.183943+0000","last_change":"2024-05-09T09:47:22.234544+0000","last_active":"2024-05-09T09:47:52.183943+0000","last_peered":"2024-05-09T09:47:52.183943+0000","last_clean":"2024-05-09T09:47:52.183943+0000","last_became_active":"2024-05-09T09:47:22.233279+0000","last_became_peered":"2024-05-09T09:47:22.233279+0000","last_unstale":"2024-05-09T09:47:52.183943+0000","last_undegraded":"2024-05-09T09:47:52.183943+0000","last_fullsized":"2024-05-09T09:47:52.183943+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:49.038963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.183233+0000","last_change":"2024-05-09T09:47:22.237682+0000","last_active":"2024-05-09T09:47:52.183233+0000","last_peered":"2024-05-09T09:47:52.183233+0000","last_clean":"2024-05-09T09:47:52.183233+0000","last_became_active":"2024-05-09T09:47:22.236863+0000","last_became_peered":"2024-05-09T09:47:22.236863+0000","last_unstale":"2024-05-09T09:47:52.183233+0000","last_undegraded":"2024-05-09T09:47:52.183233+0000","last_fullsized":"2024-05-09T09:47:52.183233+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:03:57.659846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.185906+0000","last_change":"2024-05-09T09:47:14.184633+0000","last_active":"2024-05-09T09:49:32.185906+0000","last_peered":"2024-05-09T09:49:32.185906+0000","last_clean":"2024-05-09T09:49:32.185906+0000","last_became_active":"2024-05-09T09:47:14.184250+0000","last_became_peered":"2024-05-09T09:47:14.184250+0000","last_unstale":"2024-05-09T09:49:32.185906+0000","last_undegraded":"2024-05-09T09:49:32.185906+0000","last_fullsized":"2024-05-09T09:49:32.185906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:04:29.322102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.187933+0000","last_change":"2024-05-09T09:47:12.208454+0000","last_active":"2024-05-09T09:47:52.187933+0000","last_peered":"2024-05-09T09:47:52.187933+0000","last_clean":"2024-05-09T09:47:52.187933+0000","last_became_active":"2024-05-09T09:47:12.203479+0000","last_became_peered":"2024-05-09T09:47:12.203479+0000","last_unstale":"2024-05-09T09:47:52.187933+0000","last_undegraded":"2024-05-09T09:47:52.187933+0000","last_fullsized":"2024-05-09T09:47:52.187933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:04:27.302577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.165369+0000","last_change":"2024-05-09T09:47:16.213892+0000","last_active":"2024-05-09T09:47:52.165369+0000","last_peered":"2024-05-09T09:47:52.165369+0000","last_clean":"2024-05-09T09:47:52.165369+0000","last_became_active":"2024-05-09T09:47:16.210992+0000","last_became_peered":"2024-05-09T09:47:16.210992+0000","last_unstale":"2024-05-09T09:47:52.165369+0000","last_undegraded":"2024-05-09T09:47:52.165369+0000","last_fullsized":"2024-05-09T09:47:52.165369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:14.409926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'106","reported_seq":149,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.622322+0000","last_change":"2024-05-09T09:47:18.234751+0000","last_active":"2024-05-09T09:49:31.622322+0000","last_peered":"2024-05-09T09:49:31.622322+0000","last_clean":"2024-05-09T09:49:31.622322+0000","last_became_active":"2024-05-09T09:47:18.234014+0000","last_became_peered":"2024-05-09T09:47:18.234014+0000","last_unstale":"2024-05-09T09:49:31.622322+0000","last_undegraded":"2024-05-09T09:49:31.622322+0000","last_fullsized":"2024-05-09T09:49:31.622322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:19:30.298184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.171859+0000","last_change":"2024-05-09T09:47:20.254957+0000","last_active":"2024-05-09T09:47:52.171859+0000","last_peered":"2024-05-09T09:47:52.171859+0000","last_clean":"2024-05-09T09:47:52.171859+0000","last_became_active":"2024-05-09T09:47:20.254344+0000","last_became_peered":"2024-05-09T09:47:20.254344+0000","last_unstale":"2024-05-09T09:47:52.171859+0000","last_undegraded":"2024-05-09T09:47:52.171859+0000","last_fullsized":"2024-05-09T09:47:52.171859+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:25:58.655419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'5","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.848146+0000","last_change":"2024-05-09T09:47:22.230150+0000","last_active":"2024-05-09T09:50:32.848146+0000","last_peered":"2024-05-09T09:50:32.848146+0000","last_clean":"2024-05-09T09:50:32.848146+0000","last_became_active":"2024-05-09T09:47:22.229088+0000","last_became_peered":"2024-05-09T09:47:22.229088+0000","last_unstale":"2024-05-09T09:50:32.848146+0000","last_undegraded":"2024-05-09T09:50:32.848146+0000","last_fullsized":"2024-05-09T09:50:32.848146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:55:57.267178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'8","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.947282+0000","last_change":"2024-05-09T09:47:14.174619+0000","last_active":"2024-05-09T09:50:32.947282+0000","last_peered":"2024-05-09T09:50:32.947282+0000","last_clean":"2024-05-09T09:50:32.947282+0000","last_became_active":"2024-05-09T09:47:14.173866+0000","last_became_peered":"2024-05-09T09:47:14.173866+0000","last_unstale":"2024-05-09T09:50:32.947282+0000","last_undegraded":"2024-05-09T09:50:32.947282+0000","last_fullsized":"2024-05-09T09:50:32.947282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:58:34.213528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.179002+0000","last_change":"2024-05-09T09:47:12.206131+0000","last_active":"2024-05-09T09:47:52.179002+0000","last_peered":"2024-05-09T09:47:52.179002+0000","last_clean":"2024-05-09T09:47:52.179002+0000","last_became_active":"2024-05-09T09:47:12.205714+0000","last_became_peered":"2024-05-09T09:47:12.205714+0000","last_unstale":"2024-05-09T09:47:52.179002+0000","last_undegraded":"2024-05-09T09:47:52.179002+0000","last_fullsized":"2024-05-09T09:47:52.179002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:46.107016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.190257+0000","last_change":"2024-05-09T09:47:52.188822+0000","last_active":"2024-05-09T09:47:52.190257+0000","last_peered":"2024-05-09T09:47:52.190257+0000","last_clean":"2024-05-09T09:47:52.190257+0000","last_became_active":"2024-05-09T09:47:52.187627+0000","last_became_peered":"2024-05-09T09:47:52.187627+0000","last_unstale":"2024-05-09T09:47:52.190257+0000","last_undegraded":"2024-05-09T09:47:52.190257+0000","last_fullsized":"2024-05-09T09:47:52.190257+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:41:01.595836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'5","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.222011+0000","last_change":"2024-05-09T09:47:18.218595+0000","last_active":"2024-05-09T09:50:32.222011+0000","last_peered":"2024-05-09T09:50:32.222011+0000","last_clean":"2024-05-09T09:50:32.222011+0000","last_became_active":"2024-05-09T09:47:18.217843+0000","last_became_peered":"2024-05-09T09:47:18.217843+0000","last_unstale":"2024-05-09T09:50:32.222011+0000","last_undegraded":"2024-05-09T09:50:32.222011+0000","last_fullsized":"2024-05-09T09:50:32.222011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:49:45.011737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.167605+0000","last_change":"2024-05-09T09:47:20.256418+0000","last_active":"2024-05-09T09:47:52.167605+0000","last_peered":"2024-05-09T09:47:52.167605+0000","last_clean":"2024-05-09T09:47:52.167605+0000","last_became_active":"2024-05-09T09:47:20.255449+0000","last_became_peered":"2024-05-09T09:47:20.255449+0000","last_unstale":"2024-05-09T09:47:52.167605+0000","last_undegraded":"2024-05-09T09:47:52.167605+0000","last_fullsized":"2024-05-09T09:47:52.167605+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:30:19.195448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.408435+0000","last_change":"2024-05-09T09:47:22.239979+0000","last_active":"2024-05-09T09:50:33.408435+0000","last_peered":"2024-05-09T09:50:33.408435+0000","last_clean":"2024-05-09T09:50:33.408435+0000","last_became_active":"2024-05-09T09:47:22.239113+0000","last_became_peered":"2024-05-09T09:47:22.239113+0000","last_unstale":"2024-05-09T09:50:33.408435+0000","last_undegraded":"2024-05-09T09:50:33.408435+0000","last_fullsized":"2024-05-09T09:50:33.408435+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:34:01.631008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.238187+0000","last_change":"2024-05-09T09:47:14.174348+0000","last_active":"2024-05-09T09:50:33.238187+0000","last_peered":"2024-05-09T09:50:33.238187+0000","last_clean":"2024-05-09T09:50:33.238187+0000","last_became_active":"2024-05-09T09:47:14.173338+0000","last_became_peered":"2024-05-09T09:47:14.173338+0000","last_unstale":"2024-05-09T09:50:33.238187+0000","last_undegraded":"2024-05-09T09:50:33.238187+0000","last_fullsized":"2024-05-09T09:50:33.238187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:58:34.213528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:01.777271+0000","last_change":"2024-05-09T09:47:12.209971+0000","last_active":"2024-05-09T09:48:01.777271+0000","last_peered":"2024-05-09T09:48:01.777271+0000","last_clean":"2024-05-09T09:48:01.777271+0000","last_became_active":"2024-05-09T09:47:12.205864+0000","last_became_peered":"2024-05-09T09:47:12.205864+0000","last_unstale":"2024-05-09T09:48:01.777271+0000","last_undegraded":"2024-05-09T09:48:01.777271+0000","last_fullsized":"2024-05-09T09:48:01.777271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:00:05.597093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.169350+0000","last_change":"2024-05-09T09:47:16.215336+0000","last_active":"2024-05-09T09:47:52.169350+0000","last_peered":"2024-05-09T09:47:52.169350+0000","last_clean":"2024-05-09T09:47:52.169350+0000","last_became_active":"2024-05-09T09:47:16.214780+0000","last_became_peered":"2024-05-09T09:47:16.214780+0000","last_unstale":"2024-05-09T09:47:52.169350+0000","last_undegraded":"2024-05-09T09:47:52.169350+0000","last_fullsized":"2024-05-09T09:47:52.169350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:34:04.877319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'114","reported_seq":173,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.309322+0000","last_change":"2024-05-09T09:47:18.202153+0000","last_active":"2024-05-09T09:50:32.309322+0000","last_peered":"2024-05-09T09:50:32.309322+0000","last_clean":"2024-05-09T09:50:32.309322+0000","last_became_active":"2024-05-09T09:47:18.201443+0000","last_became_peered":"2024-05-09T09:47:18.201443+0000","last_unstale":"2024-05-09T09:50:32.309322+0000","last_undegraded":"2024-05-09T09:50:32.309322+0000","last_fullsized":"2024-05-09T09:50:32.309322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:00:18.197658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.164719+0000","last_change":"2024-05-09T09:47:20.226073+0000","last_active":"2024-05-09T09:47:52.164719+0000","last_peered":"2024-05-09T09:47:52.164719+0000","last_clean":"2024-05-09T09:47:52.164719+0000","last_became_active":"2024-05-09T09:47:20.225261+0000","last_became_peered":"2024-05-09T09:47:20.225261+0000","last_unstale":"2024-05-09T09:47:52.164719+0000","last_undegraded":"2024-05-09T09:47:52.164719+0000","last_fullsized":"2024-05-09T09:47:52.164719+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:47.024306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.185689+0000","last_change":"2024-05-09T09:47:22.253748+0000","last_active":"2024-05-09T09:47:52.185689+0000","last_peered":"2024-05-09T09:47:52.185689+0000","last_clean":"2024-05-09T09:47:52.185689+0000","last_became_active":"2024-05-09T09:47:22.252940+0000","last_became_peered":"2024-05-09T09:47:22.252940+0000","last_unstale":"2024-05-09T09:47:52.185689+0000","last_undegraded":"2024-05-09T09:47:52.185689+0000","last_fullsized":"2024-05-09T09:47:52.185689+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:28:23.186925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.304067+0000","last_change":"2024-05-09T09:47:14.183909+0000","last_active":"2024-05-09T09:50:33.304067+0000","last_peered":"2024-05-09T09:50:33.304067+0000","last_clean":"2024-05-09T09:50:33.304067+0000","last_became_active":"2024-05-09T09:47:14.183622+0000","last_became_peered":"2024-05-09T09:47:14.183622+0000","last_unstale":"2024-05-09T09:50:33.304067+0000","last_undegraded":"2024-05-09T09:50:33.304067+0000","last_fullsized":"2024-05-09T09:50:33.304067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:36:53.103953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.178343+0000","last_change":"2024-05-09T09:47:12.196263+0000","last_active":"2024-05-09T09:47:52.178343+0000","last_peered":"2024-05-09T09:47:52.178343+0000","last_clean":"2024-05-09T09:47:52.178343+0000","last_became_active":"2024-05-09T09:47:12.195857+0000","last_became_peered":"2024-05-09T09:47:12.195857+0000","last_unstale":"2024-05-09T09:47:52.178343+0000","last_undegraded":"2024-05-09T09:47:52.178343+0000","last_fullsized":"2024-05-09T09:47:52.178343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:55.107119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.173473+0000","last_change":"2024-05-09T09:47:16.199413+0000","last_active":"2024-05-09T09:47:52.173473+0000","last_peered":"2024-05-09T09:47:52.173473+0000","last_clean":"2024-05-09T09:47:52.173473+0000","last_became_active":"2024-05-09T09:47:16.198551+0000","last_became_peered":"2024-05-09T09:47:16.198551+0000","last_unstale":"2024-05-09T09:47:52.173473+0000","last_undegraded":"2024-05-09T09:47:52.173473+0000","last_fullsized":"2024-05-09T09:47:52.173473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:42.999644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'104","reported_seq":146,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.593523+0000","last_change":"2024-05-09T09:47:18.217890+0000","last_active":"2024-05-09T09:49:31.593523+0000","last_peered":"2024-05-09T09:49:31.593523+0000","last_clean":"2024-05-09T09:49:31.593523+0000","last_became_active":"2024-05-09T09:47:18.217163+0000","last_became_peered":"2024-05-09T09:47:18.217163+0000","last_unstale":"2024-05-09T09:49:31.593523+0000","last_undegraded":"2024-05-09T09:49:31.593523+0000","last_fullsized":"2024-05-09T09:49:31.593523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:13:11.800319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.170698+0000","last_change":"2024-05-09T09:47:20.239189+0000","last_active":"2024-05-09T09:47:52.170698+0000","last_peered":"2024-05-09T09:47:52.170698+0000","last_clean":"2024-05-09T09:47:52.170698+0000","last_became_active":"2024-05-09T09:47:20.238369+0000","last_became_peered":"2024-05-09T09:47:20.238369+0000","last_unstale":"2024-05-09T09:47:52.170698+0000","last_undegraded":"2024-05-09T09:47:52.170698+0000","last_fullsized":"2024-05-09T09:47:52.170698+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:00:20.209785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'9","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.170964+0000","last_change":"2024-05-09T09:47:14.188262+0000","last_active":"2024-05-09T09:50:33.170964+0000","last_peered":"2024-05-09T09:50:33.170964+0000","last_clean":"2024-05-09T09:50:33.170964+0000","last_became_active":"2024-05-09T09:47:14.187868+0000","last_became_peered":"2024-05-09T09:47:14.187868+0000","last_unstale":"2024-05-09T09:50:33.170964+0000","last_undegraded":"2024-05-09T09:50:33.170964+0000","last_fullsized":"2024-05-09T09:50:33.170964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:00:14.171935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.169058+0000","last_change":"2024-05-09T09:47:12.208626+0000","last_active":"2024-05-09T09:47:52.169058+0000","last_peered":"2024-05-09T09:47:52.169058+0000","last_clean":"2024-05-09T09:47:52.169058+0000","last_became_active":"2024-05-09T09:47:12.208209+0000","last_became_peered":"2024-05-09T09:47:12.208209+0000","last_unstale":"2024-05-09T09:47:52.169058+0000","last_undegraded":"2024-05-09T09:47:52.169058+0000","last_fullsized":"2024-05-09T09:47:52.169058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:02:05.524130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.426897+0000","last_change":"2024-05-09T09:47:16.183573+0000","last_active":"2024-05-09T09:47:52.426897+0000","last_peered":"2024-05-09T09:47:52.426897+0000","last_clean":"2024-05-09T09:47:52.426897+0000","last_became_active":"2024-05-09T09:47:16.182766+0000","last_became_peered":"2024-05-09T09:47:16.182766+0000","last_unstale":"2024-05-09T09:47:52.426897+0000","last_undegraded":"2024-05-09T09:47:52.426897+0000","last_fullsized":"2024-05-09T09:47:52.426897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:03:52.038829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'202","reported_seq":258,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.634202+0000","last_change":"2024-05-09T09:47:18.225686+0000","last_active":"2024-05-09T09:49:31.634202+0000","last_peered":"2024-05-09T09:49:31.634202+0000","last_clean":"2024-05-09T09:49:31.634202+0000","last_became_active":"2024-05-09T09:47:18.225074+0000","last_became_peered":"2024-05-09T09:47:18.225074+0000","last_unstale":"2024-05-09T09:49:31.634202+0000","last_undegraded":"2024-05-09T09:49:31.634202+0000","last_fullsized":"2024-05-09T09:49:31.634202+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:25.412871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.178320+0000","last_change":"2024-05-09T09:47:20.242032+0000","last_active":"2024-05-09T09:47:52.178320+0000","last_peered":"2024-05-09T09:47:52.178320+0000","last_clean":"2024-05-09T09:47:52.178320+0000","last_became_active":"2024-05-09T09:47:20.241372+0000","last_became_peered":"2024-05-09T09:47:20.241372+0000","last_unstale":"2024-05-09T09:47:52.178320+0000","last_undegraded":"2024-05-09T09:47:52.178320+0000","last_fullsized":"2024-05-09T09:47:52.178320+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:27.424998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.026339+0000","last_change":"2024-05-09T09:47:22.260464+0000","last_active":"2024-05-09T09:49:32.026339+0000","last_peered":"2024-05-09T09:49:32.026339+0000","last_clean":"2024-05-09T09:49:32.026339+0000","last_became_active":"2024-05-09T09:47:22.259589+0000","last_became_peered":"2024-05-09T09:47:22.259589+0000","last_unstale":"2024-05-09T09:49:32.026339+0000","last_undegraded":"2024-05-09T09:49:32.026339+0000","last_fullsized":"2024-05-09T09:49:32.026339+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:06:02.910819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:26.976242+0000","last_change":"2024-05-09T09:47:14.176405+0000","last_active":"2024-05-09T09:49:26.976242+0000","last_peered":"2024-05-09T09:49:26.976242+0000","last_clean":"2024-05-09T09:49:26.976242+0000","last_became_active":"2024-05-09T09:47:14.174371+0000","last_became_peered":"2024-05-09T09:47:14.174371+0000","last_unstale":"2024-05-09T09:49:26.976242+0000","last_undegraded":"2024-05-09T09:49:26.976242+0000","last_fullsized":"2024-05-09T09:49:26.976242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:34:58.223894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.163547+0000","last_change":"2024-05-09T09:47:12.198158+0000","last_active":"2024-05-09T09:47:52.163547+0000","last_peered":"2024-05-09T09:47:52.163547+0000","last_clean":"2024-05-09T09:47:52.163547+0000","last_became_active":"2024-05-09T09:47:12.196881+0000","last_became_peered":"2024-05-09T09:47:12.196881+0000","last_unstale":"2024-05-09T09:47:52.163547+0000","last_undegraded":"2024-05-09T09:47:52.163547+0000","last_fullsized":"2024-05-09T09:47:52.163547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:22:46.247782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.187470+0000","last_change":"2024-05-09T09:47:16.189376+0000","last_active":"2024-05-09T09:47:52.187470+0000","last_peered":"2024-05-09T09:47:52.187470+0000","last_clean":"2024-05-09T09:47:52.187470+0000","last_became_active":"2024-05-09T09:47:16.188611+0000","last_became_peered":"2024-05-09T09:47:16.188611+0000","last_unstale":"2024-05-09T09:47:52.187470+0000","last_undegraded":"2024-05-09T09:47:52.187470+0000","last_fullsized":"2024-05-09T09:47:52.187470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:10:07.313658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'110","reported_seq":155,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.595370+0000","last_change":"2024-05-09T09:47:18.233602+0000","last_active":"2024-05-09T09:49:31.595370+0000","last_peered":"2024-05-09T09:49:31.595370+0000","last_clean":"2024-05-09T09:49:31.595370+0000","last_became_active":"2024-05-09T09:47:18.232435+0000","last_became_peered":"2024-05-09T09:47:18.232435+0000","last_unstale":"2024-05-09T09:49:31.595370+0000","last_undegraded":"2024-05-09T09:49:31.595370+0000","last_fullsized":"2024-05-09T09:49:31.595370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:33:57.604224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.171851+0000","last_change":"2024-05-09T09:47:20.243779+0000","last_active":"2024-05-09T09:47:52.171851+0000","last_peered":"2024-05-09T09:47:52.171851+0000","last_clean":"2024-05-09T09:47:52.171851+0000","last_became_active":"2024-05-09T09:47:20.241935+0000","last_became_peered":"2024-05-09T09:47:20.241935+0000","last_unstale":"2024-05-09T09:47:52.171851+0000","last_undegraded":"2024-05-09T09:47:52.171851+0000","last_fullsized":"2024-05-09T09:47:52.171851+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:36.440080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.172300+0000","last_change":"2024-05-09T09:47:22.241900+0000","last_active":"2024-05-09T09:47:52.172300+0000","last_peered":"2024-05-09T09:47:52.172300+0000","last_clean":"2024-05-09T09:47:52.172300+0000","last_became_active":"2024-05-09T09:47:22.241067+0000","last_became_peered":"2024-05-09T09:47:22.241067+0000","last_unstale":"2024-05-09T09:47:52.172300+0000","last_undegraded":"2024-05-09T09:47:52.172300+0000","last_fullsized":"2024-05-09T09:47:52.172300+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:40:12.648847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.946574+0000","last_change":"2024-05-09T09:47:14.192314+0000","last_active":"2024-05-09T09:50:32.946574+0000","last_peered":"2024-05-09T09:50:32.946574+0000","last_clean":"2024-05-09T09:50:32.946574+0000","last_became_active":"2024-05-09T09:47:14.191459+0000","last_became_peered":"2024-05-09T09:47:14.191459+0000","last_unstale":"2024-05-09T09:50:32.946574+0000","last_undegraded":"2024-05-09T09:50:32.946574+0000","last_fullsized":"2024-05-09T09:50:32.946574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:36:19.920255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'1","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.179680+0000","last_change":"2024-05-09T09:47:12.193005+0000","last_active":"2024-05-09T09:49:45.179680+0000","last_peered":"2024-05-09T09:49:45.179680+0000","last_clean":"2024-05-09T09:49:45.179680+0000","last_became_active":"2024-05-09T09:47:12.191204+0000","last_became_peered":"2024-05-09T09:47:12.191204+0000","last_unstale":"2024-05-09T09:49:45.179680+0000","last_undegraded":"2024-05-09T09:49:45.179680+0000","last_fullsized":"2024-05-09T09:49:45.179680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:15:07.437414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.181698+0000","last_change":"2024-05-09T09:47:16.195416+0000","last_active":"2024-05-09T09:47:52.181698+0000","last_peered":"2024-05-09T09:47:52.181698+0000","last_clean":"2024-05-09T09:47:52.181698+0000","last_became_active":"2024-05-09T09:47:16.194314+0000","last_became_peered":"2024-05-09T09:47:16.194314+0000","last_unstale":"2024-05-09T09:47:52.181698+0000","last_undegraded":"2024-05-09T09:47:52.181698+0000","last_fullsized":"2024-05-09T09:47:52.181698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:44:05.776640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'106","reported_seq":149,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.357154+0000","last_change":"2024-05-09T09:47:18.209870+0000","last_active":"2024-05-09T09:49:31.357154+0000","last_peered":"2024-05-09T09:49:31.357154+0000","last_clean":"2024-05-09T09:49:31.357154+0000","last_became_active":"2024-05-09T09:47:18.209099+0000","last_became_peered":"2024-05-09T09:47:18.209099+0000","last_unstale":"2024-05-09T09:49:31.357154+0000","last_undegraded":"2024-05-09T09:49:31.357154+0000","last_fullsized":"2024-05-09T09:49:31.357154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:07.800202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.423415+0000","last_change":"2024-05-09T09:47:20.242600+0000","last_active":"2024-05-09T09:47:52.423415+0000","last_peered":"2024-05-09T09:47:52.423415+0000","last_clean":"2024-05-09T09:47:52.423415+0000","last_became_active":"2024-05-09T09:47:20.241900+0000","last_became_peered":"2024-05-09T09:47:20.241900+0000","last_unstale":"2024-05-09T09:47:52.423415+0000","last_undegraded":"2024-05-09T09:47:52.423415+0000","last_fullsized":"2024-05-09T09:47:52.423415+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:32.134753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'5","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.173022+0000","last_change":"2024-05-09T09:47:22.264988+0000","last_active":"2024-05-09T09:49:32.173022+0000","last_peered":"2024-05-09T09:49:32.173022+0000","last_clean":"2024-05-09T09:49:32.173022+0000","last_became_active":"2024-05-09T09:47:22.263730+0000","last_became_peered":"2024-05-09T09:47:22.263730+0000","last_unstale":"2024-05-09T09:49:32.173022+0000","last_undegraded":"2024-05-09T09:49:32.173022+0000","last_fullsized":"2024-05-09T09:49:32.173022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:54.092435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.184984+0000","last_change":"2024-05-09T09:47:14.191093+0000","last_active":"2024-05-09T09:49:32.184984+0000","last_peered":"2024-05-09T09:49:32.184984+0000","last_clean":"2024-05-09T09:49:32.184984+0000","last_became_active":"2024-05-09T09:47:14.189561+0000","last_became_peered":"2024-05-09T09:47:14.189561+0000","last_unstale":"2024-05-09T09:49:32.184984+0000","last_undegraded":"2024-05-09T09:49:32.184984+0000","last_fullsized":"2024-05-09T09:49:32.184984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:20:55.312241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.185025+0000","last_change":"2024-05-09T09:47:12.215264+0000","last_active":"2024-05-09T09:47:52.185025+0000","last_peered":"2024-05-09T09:47:52.185025+0000","last_clean":"2024-05-09T09:47:52.185025+0000","last_became_active":"2024-05-09T09:47:12.214816+0000","last_became_peered":"2024-05-09T09:47:12.214816+0000","last_unstale":"2024-05-09T09:47:52.185025+0000","last_undegraded":"2024-05-09T09:47:52.185025+0000","last_fullsized":"2024-05-09T09:47:52.185025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:57:22.903663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.172570+0000","last_change":"2024-05-09T09:47:16.211405+0000","last_active":"2024-05-09T09:47:52.172570+0000","last_peered":"2024-05-09T09:47:52.172570+0000","last_clean":"2024-05-09T09:47:52.172570+0000","last_became_active":"2024-05-09T09:47:16.210567+0000","last_became_peered":"2024-05-09T09:47:16.210567+0000","last_unstale":"2024-05-09T09:47:52.172570+0000","last_undegraded":"2024-05-09T09:47:52.172570+0000","last_fullsized":"2024-05-09T09:47:52.172570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:51:59.224530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.195660+0000","last_change":"2024-05-09T09:47:18.235102+0000","last_active":"2024-05-09T09:47:52.195660+0000","last_peered":"2024-05-09T09:47:52.195660+0000","last_clean":"2024-05-09T09:47:52.195660+0000","last_became_active":"2024-05-09T09:47:18.234113+0000","last_became_peered":"2024-05-09T09:47:18.234113+0000","last_unstale":"2024-05-09T09:47:52.195660+0000","last_undegraded":"2024-05-09T09:47:52.195660+0000","last_fullsized":"2024-05-09T09:47:52.195660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:15.072698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'282","reported_seq":368,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:31.469155+0000","last_change":"2024-05-09T09:47:20.255098+0000","last_active":"2024-05-09T09:50:31.469155+0000","last_peered":"2024-05-09T09:50:31.469155+0000","last_clean":"2024-05-09T09:50:31.469155+0000","last_became_active":"2024-05-09T09:47:20.254573+0000","last_became_peered":"2024-05-09T09:47:20.254573+0000","last_unstale":"2024-05-09T09:50:31.469155+0000","last_undegraded":"2024-05-09T09:50:31.469155+0000","last_fullsized":"2024-05-09T09:50:31.469155+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:12.864272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.242341+0000","last_change":"2024-05-09T09:47:22.244085+0000","last_active":"2024-05-09T09:50:33.242341+0000","last_peered":"2024-05-09T09:50:33.242341+0000","last_clean":"2024-05-09T09:50:33.242341+0000","last_became_active":"2024-05-09T09:47:22.243234+0000","last_became_peered":"2024-05-09T09:47:22.243234+0000","last_unstale":"2024-05-09T09:50:33.242341+0000","last_undegraded":"2024-05-09T09:50:33.242341+0000","last_fullsized":"2024-05-09T09:50:33.242341+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:49:43.534043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.176046+0000","last_change":"2024-05-09T09:47:14.188552+0000","last_active":"2024-05-09T09:49:45.176046+0000","last_peered":"2024-05-09T09:49:45.176046+0000","last_clean":"2024-05-09T09:49:45.176046+0000","last_became_active":"2024-05-09T09:47:14.188222+0000","last_became_peered":"2024-05-09T09:47:14.188222+0000","last_unstale":"2024-05-09T09:49:45.176046+0000","last_undegraded":"2024-05-09T09:49:45.176046+0000","last_fullsized":"2024-05-09T09:49:45.176046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:08:36.171869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'1","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.179795+0000","last_change":"2024-05-09T09:47:12.196894+0000","last_active":"2024-05-09T09:49:45.179795+0000","last_peered":"2024-05-09T09:49:45.179795+0000","last_clean":"2024-05-09T09:49:45.179795+0000","last_became_active":"2024-05-09T09:47:12.195936+0000","last_became_peered":"2024-05-09T09:47:12.195936+0000","last_unstale":"2024-05-09T09:49:45.179795+0000","last_undegraded":"2024-05-09T09:49:45.179795+0000","last_fullsized":"2024-05-09T09:49:45.179795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:46.107016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.165234+0000","last_change":"2024-05-09T09:47:16.211838+0000","last_active":"2024-05-09T09:47:52.165234+0000","last_peered":"2024-05-09T09:47:52.165234+0000","last_clean":"2024-05-09T09:47:52.165234+0000","last_became_active":"2024-05-09T09:47:16.210901+0000","last_became_peered":"2024-05-09T09:47:16.210901+0000","last_unstale":"2024-05-09T09:47:52.165234+0000","last_undegraded":"2024-05-09T09:47:52.165234+0000","last_fullsized":"2024-05-09T09:47:52.165234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:36:55.117142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'111","reported_seq":156,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.576707+0000","last_change":"2024-05-09T09:47:18.202901+0000","last_active":"2024-05-09T09:49:31.576707+0000","last_peered":"2024-05-09T09:49:31.576707+0000","last_clean":"2024-05-09T09:49:31.576707+0000","last_became_active":"2024-05-09T09:47:18.202069+0000","last_became_peered":"2024-05-09T09:47:18.202069+0000","last_unstale":"2024-05-09T09:49:31.576707+0000","last_undegraded":"2024-05-09T09:49:31.576707+0000","last_fullsized":"2024-05-09T09:49:31.576707+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:10.852145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.414336+0000","last_change":"2024-05-09T09:47:20.251107+0000","last_active":"2024-05-09T09:47:52.414336+0000","last_peered":"2024-05-09T09:47:52.414336+0000","last_clean":"2024-05-09T09:47:52.414336+0000","last_became_active":"2024-05-09T09:47:20.250194+0000","last_became_peered":"2024-05-09T09:47:20.250194+0000","last_unstale":"2024-05-09T09:47:52.414336+0000","last_undegraded":"2024-05-09T09:47:52.414336+0000","last_fullsized":"2024-05-09T09:47:52.414336+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:47.024306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.214257+0000","last_change":"2024-05-09T09:47:22.240288+0000","last_active":"2024-05-09T09:50:33.214257+0000","last_peered":"2024-05-09T09:50:33.214257+0000","last_clean":"2024-05-09T09:50:33.214257+0000","last_became_active":"2024-05-09T09:47:22.239300+0000","last_became_peered":"2024-05-09T09:47:22.239300+0000","last_unstale":"2024-05-09T09:50:33.214257+0000","last_undegraded":"2024-05-09T09:50:33.214257+0000","last_fullsized":"2024-05-09T09:50:33.214257+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:29:01.635074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'10","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.801428+0000","last_change":"2024-05-09T09:47:14.188510+0000","last_active":"2024-05-09T09:50:32.801428+0000","last_peered":"2024-05-09T09:50:32.801428+0000","last_clean":"2024-05-09T09:50:32.801428+0000","last_became_active":"2024-05-09T09:47:14.187951+0000","last_became_peered":"2024-05-09T09:47:14.187951+0000","last_unstale":"2024-05-09T09:50:32.801428+0000","last_undegraded":"2024-05-09T09:50:32.801428+0000","last_fullsized":"2024-05-09T09:50:32.801428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:08:19.732944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.192638+0000","last_change":"2024-05-09T09:47:12.208585+0000","last_active":"2024-05-09T09:47:52.192638+0000","last_peered":"2024-05-09T09:47:52.192638+0000","last_clean":"2024-05-09T09:47:52.192638+0000","last_became_active":"2024-05-09T09:47:12.203827+0000","last_became_peered":"2024-05-09T09:47:12.203827+0000","last_unstale":"2024-05-09T09:47:52.192638+0000","last_undegraded":"2024-05-09T09:47:52.192638+0000","last_fullsized":"2024-05-09T09:47:52.192638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:13.077999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.181294+0000","last_change":"2024-05-09T09:47:16.197042+0000","last_active":"2024-05-09T09:47:52.181294+0000","last_peered":"2024-05-09T09:47:52.181294+0000","last_clean":"2024-05-09T09:47:52.181294+0000","last_became_active":"2024-05-09T09:47:16.196193+0000","last_became_peered":"2024-05-09T09:47:16.196193+0000","last_unstale":"2024-05-09T09:47:52.181294+0000","last_undegraded":"2024-05-09T09:47:52.181294+0000","last_fullsized":"2024-05-09T09:47:52.181294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:29:55.560893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'107","reported_seq":149,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.168277+0000","last_change":"2024-05-09T09:47:18.200484+0000","last_active":"2024-05-09T09:49:45.168277+0000","last_peered":"2024-05-09T09:49:45.168277+0000","last_clean":"2024-05-09T09:49:45.168277+0000","last_became_active":"2024-05-09T09:47:18.199627+0000","last_became_peered":"2024-05-09T09:47:18.199627+0000","last_unstale":"2024-05-09T09:49:45.168277+0000","last_undegraded":"2024-05-09T09:49:45.168277+0000","last_fullsized":"2024-05-09T09:49:45.168277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:13:28.480078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.172680+0000","last_change":"2024-05-09T09:47:20.252618+0000","last_active":"2024-05-09T09:47:52.172680+0000","last_peered":"2024-05-09T09:47:52.172680+0000","last_clean":"2024-05-09T09:47:52.172680+0000","last_became_active":"2024-05-09T09:47:20.251642+0000","last_became_peered":"2024-05-09T09:47:20.251642+0000","last_unstale":"2024-05-09T09:47:52.172680+0000","last_undegraded":"2024-05-09T09:47:52.172680+0000","last_fullsized":"2024-05-09T09:47:52.172680+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:02:59.842523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.196751+0000","last_change":"2024-05-09T09:47:22.261644+0000","last_active":"2024-05-09T09:47:52.196751+0000","last_peered":"2024-05-09T09:47:52.196751+0000","last_clean":"2024-05-09T09:47:52.196751+0000","last_became_active":"2024-05-09T09:47:22.261164+0000","last_became_peered":"2024-05-09T09:47:22.261164+0000","last_unstale":"2024-05-09T09:47:52.196751+0000","last_undegraded":"2024-05-09T09:47:52.196751+0000","last_fullsized":"2024-05-09T09:47:52.196751+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:08:50.446437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'8","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.150516+0000","last_change":"2024-05-09T09:47:14.185649+0000","last_active":"2024-05-09T09:50:33.150516+0000","last_peered":"2024-05-09T09:50:33.150516+0000","last_clean":"2024-05-09T09:50:33.150516+0000","last_became_active":"2024-05-09T09:47:14.185270+0000","last_became_peered":"2024-05-09T09:47:14.185270+0000","last_unstale":"2024-05-09T09:50:33.150516+0000","last_undegraded":"2024-05-09T09:50:33.150516+0000","last_fullsized":"2024-05-09T09:50:33.150516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:51:57.211341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.420634+0000","last_change":"2024-05-09T09:47:12.185589+0000","last_active":"2024-05-09T09:47:52.420634+0000","last_peered":"2024-05-09T09:47:52.420634+0000","last_clean":"2024-05-09T09:47:52.420634+0000","last_became_active":"2024-05-09T09:47:12.183985+0000","last_became_peered":"2024-05-09T09:47:12.183985+0000","last_unstale":"2024-05-09T09:47:52.420634+0000","last_undegraded":"2024-05-09T09:47:52.420634+0000","last_fullsized":"2024-05-09T09:47:52.420634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:02:04.919917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.163105+0000","last_change":"2024-05-09T09:47:16.210385+0000","last_active":"2024-05-09T09:47:52.163105+0000","last_peered":"2024-05-09T09:47:52.163105+0000","last_clean":"2024-05-09T09:47:52.163105+0000","last_became_active":"2024-05-09T09:47:16.207467+0000","last_became_peered":"2024-05-09T09:47:16.207467+0000","last_unstale":"2024-05-09T09:47:52.163105+0000","last_undegraded":"2024-05-09T09:47:52.163105+0000","last_fullsized":"2024-05-09T09:47:52.163105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:29.369869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'101","reported_seq":141,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.625669+0000","last_change":"2024-05-09T09:47:18.236481+0000","last_active":"2024-05-09T09:49:31.625669+0000","last_peered":"2024-05-09T09:49:31.625669+0000","last_clean":"2024-05-09T09:49:31.625669+0000","last_became_active":"2024-05-09T09:47:18.235557+0000","last_became_peered":"2024-05-09T09:47:18.235557+0000","last_unstale":"2024-05-09T09:49:31.625669+0000","last_undegraded":"2024-05-09T09:49:31.625669+0000","last_fullsized":"2024-05-09T09:49:31.625669+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:48:17.305432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.172984+0000","last_change":"2024-05-09T09:47:20.235738+0000","last_active":"2024-05-09T09:47:52.172984+0000","last_peered":"2024-05-09T09:47:52.172984+0000","last_clean":"2024-05-09T09:47:52.172984+0000","last_became_active":"2024-05-09T09:47:20.231750+0000","last_became_peered":"2024-05-09T09:47:20.231750+0000","last_unstale":"2024-05-09T09:47:52.172984+0000","last_undegraded":"2024-05-09T09:47:52.172984+0000","last_fullsized":"2024-05-09T09:47:52.172984+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:45:32.951562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'8","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:29.505808+0000","last_change":"2024-05-09T09:47:22.256916+0000","last_active":"2024-05-09T09:49:29.505808+0000","last_peered":"2024-05-09T09:49:29.505808+0000","last_clean":"2024-05-09T09:49:29.505808+0000","last_became_active":"2024-05-09T09:47:22.256398+0000","last_became_peered":"2024-05-09T09:47:22.256398+0000","last_unstale":"2024-05-09T09:49:29.505808+0000","last_undegraded":"2024-05-09T09:49:29.505808+0000","last_fullsized":"2024-05-09T09:49:29.505808+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:05:30.419464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'22","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.944688+0000","last_change":"2024-05-09T09:47:14.189375+0000","last_active":"2024-05-09T09:50:32.944688+0000","last_peered":"2024-05-09T09:50:32.944688+0000","last_clean":"2024-05-09T09:50:32.944688+0000","last_became_active":"2024-05-09T09:47:14.188980+0000","last_became_peered":"2024-05-09T09:47:14.188980+0000","last_unstale":"2024-05-09T09:50:32.944688+0000","last_undegraded":"2024-05-09T09:50:32.944688+0000","last_fullsized":"2024-05-09T09:50:32.944688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:57:24.923188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:59.961336+0000","last_change":"2024-05-09T09:47:12.213326+0000","last_active":"2024-05-09T09:47:59.961336+0000","last_peered":"2024-05-09T09:47:59.961336+0000","last_clean":"2024-05-09T09:47:59.961336+0000","last_became_active":"2024-05-09T09:47:12.206136+0000","last_became_peered":"2024-05-09T09:47:12.206136+0000","last_unstale":"2024-05-09T09:47:59.961336+0000","last_undegraded":"2024-05-09T09:47:59.961336+0000","last_fullsized":"2024-05-09T09:47:59.961336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:01:14.038658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:27.582188+0000","last_change":"2024-05-09T09:47:16.211554+0000","last_active":"2024-05-09T09:49:27.582188+0000","last_peered":"2024-05-09T09:49:27.582188+0000","last_clean":"2024-05-09T09:49:27.582188+0000","last_became_active":"2024-05-09T09:47:16.210958+0000","last_became_peered":"2024-05-09T09:47:16.210958+0000","last_unstale":"2024-05-09T09:49:27.582188+0000","last_undegraded":"2024-05-09T09:49:27.582188+0000","last_fullsized":"2024-05-09T09:49:27.582188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:03:52.038829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'107","reported_seq":151,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.255367+0000","last_change":"2024-05-09T09:47:18.234795+0000","last_active":"2024-05-09T09:50:32.255367+0000","last_peered":"2024-05-09T09:50:32.255367+0000","last_clean":"2024-05-09T09:50:32.255367+0000","last_became_active":"2024-05-09T09:47:18.233552+0000","last_became_peered":"2024-05-09T09:47:18.233552+0000","last_unstale":"2024-05-09T09:50:32.255367+0000","last_undegraded":"2024-05-09T09:50:32.255367+0000","last_fullsized":"2024-05-09T09:50:32.255367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:22.991357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.426101+0000","last_change":"2024-05-09T09:47:20.254870+0000","last_active":"2024-05-09T09:47:52.426101+0000","last_peered":"2024-05-09T09:47:52.426101+0000","last_clean":"2024-05-09T09:47:52.426101+0000","last_became_active":"2024-05-09T09:47:20.254083+0000","last_became_peered":"2024-05-09T09:47:20.254083+0000","last_unstale":"2024-05-09T09:47:52.426101+0000","last_undegraded":"2024-05-09T09:47:52.426101+0000","last_fullsized":"2024-05-09T09:47:52.426101+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:51:10.268994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:29.509881+0000","last_change":"2024-05-09T09:47:22.255091+0000","last_active":"2024-05-09T09:49:29.509881+0000","last_peered":"2024-05-09T09:49:29.509881+0000","last_clean":"2024-05-09T09:49:29.509881+0000","last_became_active":"2024-05-09T09:47:22.254386+0000","last_became_peered":"2024-05-09T09:47:22.254386+0000","last_unstale":"2024-05-09T09:49:29.509881+0000","last_undegraded":"2024-05-09T09:49:29.509881+0000","last_fullsized":"2024-05-09T09:49:29.509881+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:55:00.879568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'13","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.322669+0000","last_change":"2024-05-09T09:47:14.178682+0000","last_active":"2024-05-09T09:50:33.322669+0000","last_peered":"2024-05-09T09:50:33.322669+0000","last_clean":"2024-05-09T09:50:33.322669+0000","last_became_active":"2024-05-09T09:47:14.174998+0000","last_became_peered":"2024-05-09T09:47:14.174998+0000","last_unstale":"2024-05-09T09:50:33.322669+0000","last_undegraded":"2024-05-09T09:50:33.322669+0000","last_fullsized":"2024-05-09T09:50:33.322669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:39.521528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.167783+0000","last_change":"2024-05-09T09:47:12.192847+0000","last_active":"2024-05-09T09:47:52.167783+0000","last_peered":"2024-05-09T09:47:52.167783+0000","last_clean":"2024-05-09T09:47:52.167783+0000","last_became_active":"2024-05-09T09:47:12.192448+0000","last_became_peered":"2024-05-09T09:47:12.192448+0000","last_unstale":"2024-05-09T09:47:52.167783+0000","last_undegraded":"2024-05-09T09:47:52.167783+0000","last_fullsized":"2024-05-09T09:47:52.167783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:43:04.277278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'12","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:45.864525+0000","last_change":"2024-05-09T09:47:14.189285+0000","last_active":"2024-05-09T09:48:45.864525+0000","last_peered":"2024-05-09T09:48:45.864525+0000","last_clean":"2024-05-09T09:48:45.864525+0000","last_became_active":"2024-05-09T09:47:14.188534+0000","last_became_peered":"2024-05-09T09:47:14.188534+0000","last_unstale":"2024-05-09T09:48:45.864525+0000","last_undegraded":"2024-05-09T09:48:45.864525+0000","last_fullsized":"2024-05-09T09:48:45.864525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:15.097524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":54,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.120523+0000","last_change":"2024-05-09T09:47:12.185694+0000","last_active":"2024-05-09T09:50:33.120523+0000","last_peered":"2024-05-09T09:50:33.120523+0000","last_clean":"2024-05-09T09:50:33.120523+0000","last_became_active":"2024-05-09T09:47:12.184353+0000","last_became_peered":"2024-05-09T09:47:12.184353+0000","last_unstale":"2024-05-09T09:50:33.120523+0000","last_undegraded":"2024-05-09T09:50:33.120523+0000","last_fullsized":"2024-05-09T09:50:33.120523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:01:14.038658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'8","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:45.864325+0000","last_change":"2024-05-09T09:47:14.187249+0000","last_active":"2024-05-09T09:48:45.864325+0000","last_peered":"2024-05-09T09:48:45.864325+0000","last_clean":"2024-05-09T09:48:45.864325+0000","last_became_active":"2024-05-09T09:47:14.186689+0000","last_became_peered":"2024-05-09T09:47:14.186689+0000","last_unstale":"2024-05-09T09:48:45.864325+0000","last_undegraded":"2024-05-09T09:48:45.864325+0000","last_fullsized":"2024-05-09T09:48:45.864325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:19:55.054927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.175877+0000","last_change":"2024-05-09T09:47:12.211787+0000","last_active":"2024-05-09T09:47:52.175877+0000","last_peered":"2024-05-09T09:47:52.175877+0000","last_clean":"2024-05-09T09:47:52.175877+0000","last_became_active":"2024-05-09T09:47:12.209633+0000","last_became_peered":"2024-05-09T09:47:12.209633+0000","last_unstale":"2024-05-09T09:47:52.175877+0000","last_undegraded":"2024-05-09T09:47:52.175877+0000","last_fullsized":"2024-05-09T09:47:52.175877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:51:58.314102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.163498+0000","last_change":"2024-05-09T09:47:14.193990+0000","last_active":"2024-05-09T09:49:25.163498+0000","last_peered":"2024-05-09T09:49:25.163498+0000","last_clean":"2024-05-09T09:49:25.163498+0000","last_became_active":"2024-05-09T09:47:14.193366+0000","last_became_peered":"2024-05-09T09:47:14.193366+0000","last_unstale":"2024-05-09T09:49:25.163498+0000","last_undegraded":"2024-05-09T09:49:25.163498+0000","last_fullsized":"2024-05-09T09:49:25.163498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:32:19.275039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.420041+0000","last_change":"2024-05-09T09:47:12.215615+0000","last_active":"2024-05-09T09:47:52.420041+0000","last_peered":"2024-05-09T09:47:52.420041+0000","last_clean":"2024-05-09T09:47:52.420041+0000","last_became_active":"2024-05-09T09:47:12.214019+0000","last_became_peered":"2024-05-09T09:47:12.214019+0000","last_unstale":"2024-05-09T09:47:52.420041+0000","last_undegraded":"2024-05-09T09:47:52.420041+0000","last_fullsized":"2024-05-09T09:47:52.420041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:15.767283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.944003+0000","last_change":"2024-05-09T09:47:14.182706+0000","last_active":"2024-05-09T09:50:32.944003+0000","last_peered":"2024-05-09T09:50:32.944003+0000","last_clean":"2024-05-09T09:50:32.944003+0000","last_became_active":"2024-05-09T09:47:14.181824+0000","last_became_peered":"2024-05-09T09:47:14.181824+0000","last_unstale":"2024-05-09T09:50:32.944003+0000","last_undegraded":"2024-05-09T09:50:32.944003+0000","last_fullsized":"2024-05-09T09:50:32.944003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:04:29.322102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.419332+0000","last_change":"2024-05-09T09:47:12.205854+0000","last_active":"2024-05-09T09:47:52.419332+0000","last_peered":"2024-05-09T09:47:52.419332+0000","last_clean":"2024-05-09T09:47:52.419332+0000","last_became_active":"2024-05-09T09:47:12.204322+0000","last_became_peered":"2024-05-09T09:47:12.204322+0000","last_unstale":"2024-05-09T09:47:52.419332+0000","last_undegraded":"2024-05-09T09:47:52.419332+0000","last_fullsized":"2024-05-09T09:47:52.419332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:19:17.059104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.150305+0000","last_change":"2024-05-09T09:47:14.178745+0000","last_active":"2024-05-09T09:50:33.150305+0000","last_peered":"2024-05-09T09:50:33.150305+0000","last_clean":"2024-05-09T09:50:33.150305+0000","last_became_active":"2024-05-09T09:47:14.178503+0000","last_became_peered":"2024-05-09T09:47:14.178503+0000","last_unstale":"2024-05-09T09:50:33.150305+0000","last_undegraded":"2024-05-09T09:50:33.150305+0000","last_fullsized":"2024-05-09T09:50:33.150305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:20:55.312241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"30'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.173367+0000","last_change":"2024-05-09T09:47:12.196461+0000","last_active":"2024-05-09T09:47:52.173367+0000","last_peered":"2024-05-09T09:47:52.173367+0000","last_clean":"2024-05-09T09:47:52.173367+0000","last_became_active":"2024-05-09T09:47:12.196120+0000","last_became_peered":"2024-05-09T09:47:12.196120+0000","last_unstale":"2024-05-09T09:47:52.173367+0000","last_undegraded":"2024-05-09T09:47:52.173367+0000","last_fullsized":"2024-05-09T09:47:52.173367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:06.949531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'5","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.162202+0000","last_change":"2024-05-09T09:47:14.177343+0000","last_active":"2024-05-09T09:49:20.162202+0000","last_peered":"2024-05-09T09:49:20.162202+0000","last_clean":"2024-05-09T09:49:20.162202+0000","last_became_active":"2024-05-09T09:47:14.176615+0000","last_became_peered":"2024-05-09T09:47:14.176615+0000","last_unstale":"2024-05-09T09:49:20.162202+0000","last_undegraded":"2024-05-09T09:49:20.162202+0000","last_fullsized":"2024-05-09T09:49:20.162202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:35:20.332271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.186449+0000","last_change":"2024-05-09T09:47:12.210169+0000","last_active":"2024-05-09T09:47:52.186449+0000","last_peered":"2024-05-09T09:47:52.186449+0000","last_clean":"2024-05-09T09:47:52.186449+0000","last_became_active":"2024-05-09T09:47:12.209171+0000","last_became_peered":"2024-05-09T09:47:12.209171+0000","last_unstale":"2024-05-09T09:47:52.186449+0000","last_undegraded":"2024-05-09T09:47:52.186449+0000","last_fullsized":"2024-05-09T09:47:52.186449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:55.107119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.164956+0000","last_change":"2024-05-09T09:47:14.177426+0000","last_active":"2024-05-09T09:47:52.164956+0000","last_peered":"2024-05-09T09:47:52.164956+0000","last_clean":"2024-05-09T09:47:52.164956+0000","last_became_active":"2024-05-09T09:47:14.177119+0000","last_became_peered":"2024-05-09T09:47:14.177119+0000","last_unstale":"2024-05-09T09:47:52.164956+0000","last_undegraded":"2024-05-09T09:47:52.164956+0000","last_fullsized":"2024-05-09T09:47:52.164956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:41:29.222588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.417060+0000","last_change":"2024-05-09T09:47:12.185203+0000","last_active":"2024-05-09T09:47:52.417060+0000","last_peered":"2024-05-09T09:47:52.417060+0000","last_clean":"2024-05-09T09:47:52.417060+0000","last_became_active":"2024-05-09T09:47:12.184105+0000","last_became_peered":"2024-05-09T09:47:12.184105+0000","last_unstale":"2024-05-09T09:47:52.417060+0000","last_undegraded":"2024-05-09T09:47:52.417060+0000","last_fullsized":"2024-05-09T09:47:52.417060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:18:16.165145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.800585+0000","last_change":"2024-05-09T09:47:14.185348+0000","last_active":"2024-05-09T09:50:32.800585+0000","last_peered":"2024-05-09T09:50:32.800585+0000","last_clean":"2024-05-09T09:50:32.800585+0000","last_became_active":"2024-05-09T09:47:14.182961+0000","last_became_peered":"2024-05-09T09:47:14.182961+0000","last_unstale":"2024-05-09T09:50:32.800585+0000","last_undegraded":"2024-05-09T09:50:32.800585+0000","last_fullsized":"2024-05-09T09:50:32.800585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:14:52.487546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'1","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.173578+0000","last_change":"2024-05-09T09:47:12.206940+0000","last_active":"2024-05-09T09:49:25.173578+0000","last_peered":"2024-05-09T09:49:25.173578+0000","last_clean":"2024-05-09T09:49:25.173578+0000","last_became_active":"2024-05-09T09:47:12.201952+0000","last_became_peered":"2024-05-09T09:47:12.201952+0000","last_unstale":"2024-05-09T09:49:25.173578+0000","last_undegraded":"2024-05-09T09:49:25.173578+0000","last_fullsized":"2024-05-09T09:49:25.173578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:06:37.960812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.944562+0000","last_change":"2024-05-09T09:47:14.193794+0000","last_active":"2024-05-09T09:50:32.944562+0000","last_peered":"2024-05-09T09:50:32.944562+0000","last_clean":"2024-05-09T09:50:32.944562+0000","last_became_active":"2024-05-09T09:47:14.193421+0000","last_became_peered":"2024-05-09T09:47:14.193421+0000","last_unstale":"2024-05-09T09:50:32.944562+0000","last_undegraded":"2024-05-09T09:50:32.944562+0000","last_fullsized":"2024-05-09T09:50:32.944562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:49:55.928418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:01.784206+0000","last_change":"2024-05-09T09:47:12.206566+0000","last_active":"2024-05-09T09:48:01.784206+0000","last_peered":"2024-05-09T09:48:01.784206+0000","last_clean":"2024-05-09T09:48:01.784206+0000","last_became_active":"2024-05-09T09:47:12.203523+0000","last_became_peered":"2024-05-09T09:47:12.203523+0000","last_unstale":"2024-05-09T09:48:01.784206+0000","last_undegraded":"2024-05-09T09:48:01.784206+0000","last_fullsized":"2024-05-09T09:48:01.784206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:00:03.229983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.302907+0000","last_change":"2024-05-09T09:47:14.173720+0000","last_active":"2024-05-09T09:50:33.302907+0000","last_peered":"2024-05-09T09:50:33.302907+0000","last_clean":"2024-05-09T09:50:33.302907+0000","last_became_active":"2024-05-09T09:47:14.171565+0000","last_became_peered":"2024-05-09T09:47:14.171565+0000","last_unstale":"2024-05-09T09:50:33.302907+0000","last_undegraded":"2024-05-09T09:50:33.302907+0000","last_fullsized":"2024-05-09T09:50:33.302907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:16:59.077638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.111363+0000","last_change":"2024-05-09T09:47:12.193541+0000","last_active":"2024-05-09T09:49:32.111363+0000","last_peered":"2024-05-09T09:49:32.111363+0000","last_clean":"2024-05-09T09:49:32.111363+0000","last_became_active":"2024-05-09T09:47:12.192462+0000","last_became_peered":"2024-05-09T09:47:12.192462+0000","last_unstale":"2024-05-09T09:49:32.111363+0000","last_undegraded":"2024-05-09T09:49:32.111363+0000","last_fullsized":"2024-05-09T09:49:32.111363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:43:04.277278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.239153+0000","last_change":"2024-05-09T09:47:14.177456+0000","last_active":"2024-05-09T09:50:33.239153+0000","last_peered":"2024-05-09T09:50:33.239153+0000","last_clean":"2024-05-09T09:50:33.239153+0000","last_became_active":"2024-05-09T09:47:14.176986+0000","last_became_peered":"2024-05-09T09:47:14.176986+0000","last_unstale":"2024-05-09T09:50:33.239153+0000","last_undegraded":"2024-05-09T09:50:33.239153+0000","last_fullsized":"2024-05-09T09:50:33.239153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:00:58.585804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.169090+0000","last_change":"2024-05-09T09:47:12.205826+0000","last_active":"2024-05-09T09:47:52.169090+0000","last_peered":"2024-05-09T09:47:52.169090+0000","last_clean":"2024-05-09T09:47:52.169090+0000","last_became_active":"2024-05-09T09:47:12.205416+0000","last_became_peered":"2024-05-09T09:47:12.205416+0000","last_unstale":"2024-05-09T09:47:52.169090+0000","last_undegraded":"2024-05-09T09:47:52.169090+0000","last_fullsized":"2024-05-09T09:47:52.169090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:14:11.726333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:02.666810+0000","last_change":"2024-05-09T09:47:14.182747+0000","last_active":"2024-05-09T09:48:02.666810+0000","last_peered":"2024-05-09T09:48:02.666810+0000","last_clean":"2024-05-09T09:48:02.666810+0000","last_became_active":"2024-05-09T09:47:14.182248+0000","last_became_peered":"2024-05-09T09:47:14.182248+0000","last_unstale":"2024-05-09T09:48:02.666810+0000","last_undegraded":"2024-05-09T09:48:02.666810+0000","last_fullsized":"2024-05-09T09:48:02.666810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:32:19.275039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'1","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:30.174765+0000","last_change":"2024-05-09T09:47:12.208127+0000","last_active":"2024-05-09T09:49:30.174765+0000","last_peered":"2024-05-09T09:49:30.174765+0000","last_clean":"2024-05-09T09:49:30.174765+0000","last_became_active":"2024-05-09T09:47:12.200127+0000","last_became_peered":"2024-05-09T09:47:12.200127+0000","last_unstale":"2024-05-09T09:49:30.174765+0000","last_undegraded":"2024-05-09T09:49:30.174765+0000","last_fullsized":"2024-05-09T09:49:30.174765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:08:17.713419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.304307+0000","last_change":"2024-05-09T09:47:14.190516+0000","last_active":"2024-05-09T09:50:33.304307+0000","last_peered":"2024-05-09T09:50:33.304307+0000","last_clean":"2024-05-09T09:50:33.304307+0000","last_became_active":"2024-05-09T09:47:14.190033+0000","last_became_peered":"2024-05-09T09:47:14.190033+0000","last_unstale":"2024-05-09T09:50:33.304307+0000","last_undegraded":"2024-05-09T09:50:33.304307+0000","last_fullsized":"2024-05-09T09:50:33.304307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:34:58.223894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:01.765781+0000","last_change":"2024-05-09T09:47:12.208249+0000","last_active":"2024-05-09T09:48:01.765781+0000","last_peered":"2024-05-09T09:48:01.765781+0000","last_clean":"2024-05-09T09:48:01.765781+0000","last_became_active":"2024-05-09T09:47:12.203424+0000","last_became_peered":"2024-05-09T09:47:12.203424+0000","last_unstale":"2024-05-09T09:48:01.765781+0000","last_undegraded":"2024-05-09T09:48:01.765781+0000","last_fullsized":"2024-05-09T09:48:01.765781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:28:35.100126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:30.174695+0000","last_change":"2024-05-09T09:47:14.187165+0000","last_active":"2024-05-09T09:49:30.174695+0000","last_peered":"2024-05-09T09:49:30.174695+0000","last_clean":"2024-05-09T09:49:30.174695+0000","last_became_active":"2024-05-09T09:47:14.186711+0000","last_became_peered":"2024-05-09T09:47:14.186711+0000","last_unstale":"2024-05-09T09:49:30.174695+0000","last_undegraded":"2024-05-09T09:49:30.174695+0000","last_fullsized":"2024-05-09T09:49:30.174695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:51:46.975465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.188697+0000","last_change":"2024-05-09T09:47:12.209730+0000","last_active":"2024-05-09T09:47:52.188697+0000","last_peered":"2024-05-09T09:47:52.188697+0000","last_clean":"2024-05-09T09:47:52.188697+0000","last_became_active":"2024-05-09T09:47:12.205320+0000","last_became_peered":"2024-05-09T09:47:12.205320+0000","last_unstale":"2024-05-09T09:47:52.188697+0000","last_undegraded":"2024-05-09T09:47:52.188697+0000","last_fullsized":"2024-05-09T09:47:52.188697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:01:14.038658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.403843+0000","last_change":"2024-05-09T09:47:14.178306+0000","last_active":"2024-05-09T09:50:33.403843+0000","last_peered":"2024-05-09T09:50:33.403843+0000","last_clean":"2024-05-09T09:50:33.403843+0000","last_became_active":"2024-05-09T09:47:14.177955+0000","last_became_peered":"2024-05-09T09:47:14.177955+0000","last_unstale":"2024-05-09T09:50:33.403843+0000","last_undegraded":"2024-05-09T09:50:33.403843+0000","last_fullsized":"2024-05-09T09:50:33.403843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:29:53.547705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:26.957446+0000","last_change":"2024-05-09T09:47:12.202337+0000","last_active":"2024-05-09T09:49:26.957446+0000","last_peered":"2024-05-09T09:49:26.957446+0000","last_clean":"2024-05-09T09:49:26.957446+0000","last_became_active":"2024-05-09T09:47:12.201790+0000","last_became_peered":"2024-05-09T09:47:12.201790+0000","last_unstale":"2024-05-09T09:49:26.957446+0000","last_undegraded":"2024-05-09T09:49:26.957446+0000","last_fullsized":"2024-05-09T09:49:26.957446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:35:18.312747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'6","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.129089+0000","last_change":"2024-05-09T09:47:12.207600+0000","last_active":"2024-05-09T09:50:33.129089+0000","last_peered":"2024-05-09T09:50:33.129089+0000","last_clean":"2024-05-09T09:50:33.129089+0000","last_became_active":"2024-05-09T09:47:12.203435+0000","last_became_peered":"2024-05-09T09:47:12.203435+0000","last_unstale":"2024-05-09T09:50:33.129089+0000","last_undegraded":"2024-05-09T09:50:33.129089+0000","last_fullsized":"2024-05-09T09:50:33.129089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:13:12.664064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'7","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.321483+0000","last_change":"2024-05-09T09:47:14.179261+0000","last_active":"2024-05-09T09:50:33.321483+0000","last_peered":"2024-05-09T09:50:33.321483+0000","last_clean":"2024-05-09T09:50:33.321483+0000","last_became_active":"2024-05-09T09:47:14.178142+0000","last_became_peered":"2024-05-09T09:47:14.178142+0000","last_unstale":"2024-05-09T09:50:33.321483+0000","last_undegraded":"2024-05-09T09:50:33.321483+0000","last_fullsized":"2024-05-09T09:50:33.321483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:34:02.864130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.412986+0000","last_change":"2024-05-09T09:47:12.207072+0000","last_active":"2024-05-09T09:47:52.412986+0000","last_peered":"2024-05-09T09:47:52.412986+0000","last_clean":"2024-05-09T09:47:52.412986+0000","last_became_active":"2024-05-09T09:47:12.205216+0000","last_became_peered":"2024-05-09T09:47:12.205216+0000","last_unstale":"2024-05-09T09:47:52.412986+0000","last_undegraded":"2024-05-09T09:47:52.412986+0000","last_fullsized":"2024-05-09T09:47:52.412986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:06.949531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'12","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.802415+0000","last_change":"2024-05-09T09:47:14.174424+0000","last_active":"2024-05-09T09:50:32.802415+0000","last_peered":"2024-05-09T09:50:32.802415+0000","last_clean":"2024-05-09T09:50:32.802415+0000","last_became_active":"2024-05-09T09:47:14.174123+0000","last_became_peered":"2024-05-09T09:47:14.174123+0000","last_unstale":"2024-05-09T09:50:32.802415+0000","last_undegraded":"2024-05-09T09:50:32.802415+0000","last_fullsized":"2024-05-09T09:50:32.802415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:10:05.300469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3643,"ondisk_log_size":3643,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1628,"num_read_kb":1518,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705710,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40040,"kb_used_data":8864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331800,"statfs":{"total":96636764160,"available":96595763200,"internally_reserved":0,"allocated":9076736,"data_stored":8754022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705712,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36392,"kb_used_data":9376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335448,"statfs":{"total":96636764160,"available":96599498752,"internally_reserved":0,"allocated":9601024,"data_stored":9339828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705710,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36412,"kb_used_data":9396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335428,"statfs":{"total":96636764160,"available":96599478272,"internally_reserved":0,"allocated":9621504,"data_stored":9341034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40004,"kb_used_data":8828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331836,"statfs":{"total":96636764160,"available":96595800064,"internally_reserved":0,"allocated":9039872,"data_stored":8751284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T09:50:40.658 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T09:50:40.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.807+0000 7f7160804640 1 Processor -- start 2024-05-09T09:50:40.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.807+0000 7f7160804640 1 -- start start 2024-05-09T09:50:40.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.811+0000 7f7160804640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f715c1294f0 0x7f715c131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:40.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.811+0000 7f7160804640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f715c096570 con 0x7f715c0955b0 2024-05-09T09:50:40.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.811+0000 7f7160804640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f715c0971f0 con 0x7f715c1294f0 2024-05-09T09:50:40.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.811+0000 7f7159d9b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f715c1294f0 0x7f715c131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:40.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.811+0000 7f715a59c640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f715c0955b0 0x7f715c129990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:49046/0 (socket says 172.21.15.110:49046) 2024-05-09T09:50:40.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.811+0000 7f715a59c640 1 -- 172.21.15.110:0/2043476659 learned_addr learned my addr 172.21.15.110:0/2043476659 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:50:40.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.811+0000 7f7159d9b640 1 -- 172.21.15.110:0/2043476659 >> v1:172.21.15.110:6789/0 conn(0x7f715c0955b0 legacy=0x7f715c129990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:40.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.811+0000 7f7159d9b640 1 -- 172.21.15.110:0/2043476659 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715c12a0a0 con 0x7f715c1294f0 2024-05-09T09:50:40.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.811+0000 7f715959a640 1 -- 172.21.15.110:0/2043476659 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1943067302 0 0) 0x7f715c096570 con 0x7f715c0955b0 2024-05-09T09:50:40.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.811+0000 7f7159d9b640 1 --2- 172.21.15.110:0/2043476659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f715c1294f0 0x7f715c131be0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f7144009740 tx=0x7f714401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392147650b281018 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:40.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.811+0000 7f715959a640 1 -- 172.21.15.110:0/2043476659 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71440b0070 con 0x7f715c1294f0 2024-05-09T09:50:40.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.811+0000 7f715959a640 1 -- 172.21.15.110:0/2043476659 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71440ab530 con 0x7f715c1294f0 2024-05-09T09:50:40.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.811+0000 7f715959a640 1 -- 172.21.15.110:0/2043476659 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71440ab830 con 0x7f715c1294f0 2024-05-09T09:50:40.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.811+0000 7f7160804640 1 -- 172.21.15.110:0/2043476659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f715c1294f0 msgr2=0x7f715c131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:40.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.811+0000 7f7160804640 1 --2- 172.21.15.110:0/2043476659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f715c1294f0 0x7f715c131be0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f7144009740 tx=0x7f714401c370 comp rx=0 tx=0).stop 2024-05-09T09:50:40.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.811+0000 7f7160804640 1 -- 172.21.15.110:0/2043476659 shutdown_connections 2024-05-09T09:50:40.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.811+0000 7f7160804640 1 --2- 172.21.15.110:0/2043476659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f715c1294f0 0x7f715c131be0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:40.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.811+0000 7f7160804640 1 -- 172.21.15.110:0/2043476659 >> 172.21.15.110:0/2043476659 conn(0x7f715c09ad20 msgr2=0x7f715c09b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:40.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.811+0000 7f7160804640 1 -- 172.21.15.110:0/2043476659 shutdown_connections 2024-05-09T09:50:40.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.811+0000 7f7160804640 1 -- 172.21.15.110:0/2043476659 wait complete. 2024-05-09T09:50:40.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.815+0000 7f7160804640 1 Processor -- start 2024-05-09T09:50:40.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.815+0000 7f7160804640 1 -- start start 2024-05-09T09:50:40.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.815+0000 7f7160804640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f715c0955b0 0x7f715c12b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:40.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.815+0000 7f7160804640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f715c134cd0 con 0x7f715c0955b0 2024-05-09T09:50:40.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.815+0000 7f715a59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f715c0955b0 0x7f715c12b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:40.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.815+0000 7f715a59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f715c0955b0 0x7f715c12b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51230/0 (socket says 172.21.15.110:51230) 2024-05-09T09:50:40.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.815+0000 7f715a59c640 1 -- 172.21.15.110:0/2169101309 learned_addr learned my addr 172.21.15.110:0/2169101309 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:50:40.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.815+0000 7f715a59c640 1 -- 172.21.15.110:0/2169101309 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715c12e920 con 0x7f715c0955b0 2024-05-09T09:50:40.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.815+0000 7f715a59c640 1 --2- 172.21.15.110:0/2169101309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f715c0955b0 0x7f715c12b910 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f714c00c840 tx=0x7f714c00cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:40.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.815+0000 7f7152ffd640 1 -- 172.21.15.110:0/2169101309 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f714c018070 con 0x7f715c0955b0 2024-05-09T09:50:40.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.815+0000 7f7152ffd640 1 -- 172.21.15.110:0/2169101309 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f714c00a660 con 0x7f715c0955b0 2024-05-09T09:50:40.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.815+0000 7f7160804640 1 -- 172.21.15.110:0/2169101309 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f715c12ed60 con 0x7f715c0955b0 2024-05-09T09:50:40.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.815+0000 7f7152ffd640 1 -- 172.21.15.110:0/2169101309 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f714c00a850 con 0x7f715c0955b0 2024-05-09T09:50:40.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.815+0000 7f7160804640 1 -- 172.21.15.110:0/2169101309 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f715c12c020 con 0x7f715c0955b0 2024-05-09T09:50:40.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.815+0000 7f7152ffd640 1 -- 172.21.15.110:0/2169101309 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f714c01b070 con 0x7f715c0955b0 2024-05-09T09:50:40.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.815+0000 7f7160804640 1 -- 172.21.15.110:0/2169101309 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f715c063710 con 0x7f715c0955b0 2024-05-09T09:50:40.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.815+0000 7f7152ffd640 1 --2- 172.21.15.110:0/2169101309 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f713c036310 0x7f713c0387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:40.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.815+0000 7f7152ffd640 1 -- 172.21.15.110:0/2169101309 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f714c048f60 con 0x7f715c0955b0 2024-05-09T09:50:40.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.815+0000 7f7159d9b640 1 --2- 172.21.15.110:0/2169101309 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f713c036310 0x7f713c0387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:40.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.819+0000 7f7159d9b640 1 --2- 172.21.15.110:0/2169101309 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f713c036310 0x7f713c0387d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f71440ad000 tx=0x7f7144008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:40.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.823+0000 7f7152ffd640 1 -- 172.21.15.110:0/2169101309 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f714c01c3b0 con 0x7f715c0955b0 2024-05-09T09:50:40.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:40.979+0000 7f7160804640 1 -- 172.21.15.110:0/2169101309 --> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f715c12d080 con 0x7f713c036310 2024-05-09T09:50:41.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.023+0000 7f7152ffd640 1 -- 172.21.15.110:0/2169101309 <== mgr.4100 v2:172.21.15.157:6824/2765519551 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666035 (secure 0 0 0) 0x7f71440b1040 con 0x7f713c036310 2024-05-09T09:50:41.032 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:50:41.039 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-05-09T09:50:41.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.031+0000 7f7160804640 1 -- 172.21.15.110:0/2169101309 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f713c036310 msgr2=0x7f713c0387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:41.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.035+0000 7f7160804640 1 --2- 172.21.15.110:0/2169101309 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f713c036310 0x7f713c0387d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f71440ad000 tx=0x7f7144008040 comp rx=0 tx=0).stop 2024-05-09T09:50:41.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.035+0000 7f7160804640 1 -- 172.21.15.110:0/2169101309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f715c0955b0 msgr2=0x7f715c12b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:41.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.035+0000 7f7160804640 1 --2- 172.21.15.110:0/2169101309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f715c0955b0 0x7f715c12b910 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f714c00c840 tx=0x7f714c00cd00 comp rx=0 tx=0).stop 2024-05-09T09:50:41.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.035+0000 7f7160804640 1 -- 172.21.15.110:0/2169101309 shutdown_connections 2024-05-09T09:50:41.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.035+0000 7f7160804640 1 --2- 172.21.15.110:0/2169101309 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f713c036310 0x7f713c0387d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:41.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.035+0000 7f7160804640 1 --2- 172.21.15.110:0/2169101309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f715c0955b0 0x7f715c12b910 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:41.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.035+0000 7f7160804640 1 -- 172.21.15.110:0/2169101309 >> 172.21.15.110:0/2169101309 conn(0x7f715c09ad20 msgr2=0x7f715c06d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:41.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.035+0000 7f7160804640 1 -- 172.21.15.110:0/2169101309 shutdown_connections 2024-05-09T09:50:41.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.035+0000 7f7160804640 1 -- 172.21.15.110:0/2169101309 wait complete. 2024-05-09T09:50:41.059 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-05-09T09:50:39.172837+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416886,"num_objects":227,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4902,"num_read_kb":4479,"num_write":2106,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6845,"ondisk_log_size":6845,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152848,"kb_used_data":36464,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377334512,"statfs":{"total":386547056640,"available":386390540288,"internally_reserved":0,"allocated":37339136,"data_stored":36186168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":119138070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815784,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007304"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.185131+0000","last_change":"2024-05-09T09:47:12.206481+0000","last_active":"2024-05-09T09:47:52.185131+0000","last_peered":"2024-05-09T09:47:52.185131+0000","last_clean":"2024-05-09T09:47:52.185131+0000","last_became_active":"2024-05-09T09:47:12.205786+0000","last_became_peered":"2024-05-09T09:47:12.205786+0000","last_unstale":"2024-05-09T09:47:52.185131+0000","last_undegraded":"2024-05-09T09:47:52.185131+0000","last_fullsized":"2024-05-09T09:47:52.185131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:17:39.735832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:46.160690+0000","last_change":"2024-05-09T09:47:14.171375+0000","last_active":"2024-05-09T09:48:46.160690+0000","last_peered":"2024-05-09T09:48:46.160690+0000","last_clean":"2024-05-09T09:48:46.160690+0000","last_became_active":"2024-05-09T09:47:14.171044+0000","last_became_peered":"2024-05-09T09:47:14.171044+0000","last_unstale":"2024-05-09T09:48:46.160690+0000","last_undegraded":"2024-05-09T09:48:46.160690+0000","last_fullsized":"2024-05-09T09:48:46.160690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:57.831374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'1","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.162473+0000","last_change":"2024-05-09T09:47:12.190812+0000","last_active":"2024-05-09T09:49:20.162473+0000","last_peered":"2024-05-09T09:49:20.162473+0000","last_clean":"2024-05-09T09:49:20.162473+0000","last_became_active":"2024-05-09T09:47:12.189774+0000","last_became_peered":"2024-05-09T09:47:12.189774+0000","last_unstale":"2024-05-09T09:49:20.162473+0000","last_undegraded":"2024-05-09T09:49:20.162473+0000","last_fullsized":"2024-05-09T09:49:20.162473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:13:12.664064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.180726+0000","last_change":"2024-05-09T09:47:14.193844+0000","last_active":"2024-05-09T09:47:52.180726+0000","last_peered":"2024-05-09T09:47:52.180726+0000","last_clean":"2024-05-09T09:47:52.180726+0000","last_became_active":"2024-05-09T09:47:14.192803+0000","last_became_peered":"2024-05-09T09:47:14.192803+0000","last_unstale":"2024-05-09T09:47:52.180726+0000","last_undegraded":"2024-05-09T09:47:52.180726+0000","last_fullsized":"2024-05-09T09:47:52.180726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:03:50.025641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"32'3","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:45.849127+0000","last_change":"2024-05-09T09:47:12.209625+0000","last_active":"2024-05-09T09:48:45.849127+0000","last_peered":"2024-05-09T09:48:45.849127+0000","last_clean":"2024-05-09T09:48:45.849127+0000","last_became_active":"2024-05-09T09:47:12.207184+0000","last_became_peered":"2024-05-09T09:47:12.207184+0000","last_unstale":"2024-05-09T09:48:45.849127+0000","last_undegraded":"2024-05-09T09:48:45.849127+0000","last_fullsized":"2024-05-09T09:48:45.849127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:58:32.194004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'14","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.151204+0000","last_change":"2024-05-09T09:47:14.193118+0000","last_active":"2024-05-09T09:50:33.151204+0000","last_peered":"2024-05-09T09:50:33.151204+0000","last_clean":"2024-05-09T09:50:33.151204+0000","last_became_active":"2024-05-09T09:47:14.192821+0000","last_became_peered":"2024-05-09T09:47:14.192821+0000","last_unstale":"2024-05-09T09:50:33.151204+0000","last_undegraded":"2024-05-09T09:50:33.151204+0000","last_fullsized":"2024-05-09T09:50:33.151204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:12.396738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"32'1","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:15.168923+0000","last_change":"2024-05-09T09:47:12.195169+0000","last_active":"2024-05-09T09:49:15.168923+0000","last_peered":"2024-05-09T09:49:15.168923+0000","last_clean":"2024-05-09T09:49:15.168923+0000","last_became_active":"2024-05-09T09:47:12.194183+0000","last_became_peered":"2024-05-09T09:47:12.194183+0000","last_unstale":"2024-05-09T09:49:15.168923+0000","last_undegraded":"2024-05-09T09:49:15.168923+0000","last_fullsized":"2024-05-09T09:49:15.168923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:14.033148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'12","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.805704+0000","last_change":"2024-05-09T09:47:52.430986+0000","last_active":"2024-05-09T09:50:32.805704+0000","last_peered":"2024-05-09T09:50:32.805704+0000","last_clean":"2024-05-09T09:50:32.805704+0000","last_became_active":"2024-05-09T09:47:52.429940+0000","last_became_peered":"2024-05-09T09:47:52.429940+0000","last_unstale":"2024-05-09T09:50:32.805704+0000","last_undegraded":"2024-05-09T09:50:32.805704+0000","last_fullsized":"2024-05-09T09:50:32.805704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:46:39.468582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.185616+0000","last_change":"2024-05-09T09:47:12.212361+0000","last_active":"2024-05-09T09:47:52.185616+0000","last_peered":"2024-05-09T09:47:52.185616+0000","last_clean":"2024-05-09T09:47:52.185616+0000","last_became_active":"2024-05-09T09:47:12.204446+0000","last_became_peered":"2024-05-09T09:47:12.204446+0000","last_unstale":"2024-05-09T09:47:52.185616+0000","last_undegraded":"2024-05-09T09:47:52.185616+0000","last_fullsized":"2024-05-09T09:47:52.185616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:14:59.069403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'16","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.303718+0000","last_change":"2024-05-09T09:47:14.185067+0000","last_active":"2024-05-09T09:50:33.303718+0000","last_peered":"2024-05-09T09:50:33.303718+0000","last_clean":"2024-05-09T09:50:33.303718+0000","last_became_active":"2024-05-09T09:47:14.184792+0000","last_became_peered":"2024-05-09T09:47:14.184792+0000","last_unstale":"2024-05-09T09:50:33.303718+0000","last_undegraded":"2024-05-09T09:50:33.303718+0000","last_fullsized":"2024-05-09T09:50:33.303718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:15.097524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.137283+0000","last_change":"2024-05-09T09:47:12.195761+0000","last_active":"2024-05-09T09:50:33.137283+0000","last_peered":"2024-05-09T09:50:33.137283+0000","last_clean":"2024-05-09T09:50:33.137283+0000","last_became_active":"2024-05-09T09:47:12.195117+0000","last_became_peered":"2024-05-09T09:47:12.195117+0000","last_unstale":"2024-05-09T09:50:33.137283+0000","last_undegraded":"2024-05-09T09:50:33.137283+0000","last_fullsized":"2024-05-09T09:50:33.137283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:15:07.437414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'8","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.303421+0000","last_change":"2024-05-09T09:47:14.189185+0000","last_active":"2024-05-09T09:50:33.303421+0000","last_peered":"2024-05-09T09:50:33.303421+0000","last_clean":"2024-05-09T09:50:33.303421+0000","last_became_active":"2024-05-09T09:47:14.188665+0000","last_became_peered":"2024-05-09T09:47:14.188665+0000","last_unstale":"2024-05-09T09:50:33.303421+0000","last_undegraded":"2024-05-09T09:50:33.303421+0000","last_fullsized":"2024-05-09T09:50:33.303421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:39.377012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.175793+0000","last_change":"2024-05-09T09:47:12.201245+0000","last_active":"2024-05-09T09:47:52.175793+0000","last_peered":"2024-05-09T09:47:52.175793+0000","last_clean":"2024-05-09T09:47:52.175793+0000","last_became_active":"2024-05-09T09:47:12.199697+0000","last_became_peered":"2024-05-09T09:47:12.199697+0000","last_unstale":"2024-05-09T09:47:52.175793+0000","last_undegraded":"2024-05-09T09:47:52.175793+0000","last_fullsized":"2024-05-09T09:47:52.175793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:40:31.009399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'12","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.808798+0000","last_change":"2024-05-09T09:47:14.179543+0000","last_active":"2024-05-09T09:50:32.808798+0000","last_peered":"2024-05-09T09:50:32.808798+0000","last_clean":"2024-05-09T09:50:32.808798+0000","last_became_active":"2024-05-09T09:47:14.179041+0000","last_became_peered":"2024-05-09T09:47:14.179041+0000","last_unstale":"2024-05-09T09:50:32.808798+0000","last_undegraded":"2024-05-09T09:50:32.808798+0000","last_fullsized":"2024-05-09T09:50:32.808798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:28:37.119651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.412926+0000","last_change":"2024-05-09T09:47:12.185018+0000","last_active":"2024-05-09T09:47:52.412926+0000","last_peered":"2024-05-09T09:47:52.412926+0000","last_clean":"2024-05-09T09:47:52.412926+0000","last_became_active":"2024-05-09T09:47:12.183745+0000","last_became_peered":"2024-05-09T09:47:12.183745+0000","last_unstale":"2024-05-09T09:47:52.412926+0000","last_undegraded":"2024-05-09T09:47:52.412926+0000","last_fullsized":"2024-05-09T09:47:52.412926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:14.033148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'14","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.303289+0000","last_change":"2024-05-09T09:47:14.173339+0000","last_active":"2024-05-09T09:50:33.303289+0000","last_peered":"2024-05-09T09:50:33.303289+0000","last_clean":"2024-05-09T09:50:33.303289+0000","last_became_active":"2024-05-09T09:47:14.173031+0000","last_became_peered":"2024-05-09T09:47:14.173031+0000","last_unstale":"2024-05-09T09:50:33.303289+0000","last_undegraded":"2024-05-09T09:50:33.303289+0000","last_fullsized":"2024-05-09T09:50:33.303289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:35:20.332271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"30'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.172138+0000","last_change":"2024-05-09T09:47:14.193172+0000","last_active":"2024-05-09T09:47:52.172138+0000","last_peered":"2024-05-09T09:47:52.172138+0000","last_clean":"2024-05-09T09:47:52.172138+0000","last_became_active":"2024-05-09T09:47:14.192744+0000","last_became_peered":"2024-05-09T09:47:14.192744+0000","last_unstale":"2024-05-09T09:47:52.172138+0000","last_undegraded":"2024-05-09T09:47:52.172138+0000","last_fullsized":"2024-05-09T09:47:52.172138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:34:30.799914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.179264+0000","last_change":"2024-05-09T09:47:12.213768+0000","last_active":"2024-05-09T09:47:52.179264+0000","last_peered":"2024-05-09T09:47:52.179264+0000","last_clean":"2024-05-09T09:47:52.179264+0000","last_became_active":"2024-05-09T09:47:12.210781+0000","last_became_peered":"2024-05-09T09:47:12.210781+0000","last_unstale":"2024-05-09T09:47:52.179264+0000","last_undegraded":"2024-05-09T09:47:52.179264+0000","last_fullsized":"2024-05-09T09:47:52.179264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:17:39.735832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'20","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.237884+0000","last_change":"2024-05-09T09:47:14.190782+0000","last_active":"2024-05-09T09:50:33.237884+0000","last_peered":"2024-05-09T09:50:33.237884+0000","last_clean":"2024-05-09T09:50:33.237884+0000","last_became_active":"2024-05-09T09:47:14.190021+0000","last_became_peered":"2024-05-09T09:47:14.190021+0000","last_unstale":"2024-05-09T09:50:33.237884+0000","last_undegraded":"2024-05-09T09:50:33.237884+0000","last_fullsized":"2024-05-09T09:50:33.237884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:34:02.864130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.112255+0000","last_change":"2024-05-09T09:47:12.194645+0000","last_active":"2024-05-09T09:50:33.112255+0000","last_peered":"2024-05-09T09:50:33.112255+0000","last_clean":"2024-05-09T09:50:33.112255+0000","last_became_active":"2024-05-09T09:47:12.193509+0000","last_became_peered":"2024-05-09T09:47:12.193509+0000","last_unstale":"2024-05-09T09:50:33.112255+0000","last_undegraded":"2024-05-09T09:50:33.112255+0000","last_fullsized":"2024-05-09T09:50:33.112255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:00:03.229983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.947737+0000","last_change":"2024-05-09T09:47:14.189775+0000","last_active":"2024-05-09T09:50:32.947737+0000","last_peered":"2024-05-09T09:50:32.947737+0000","last_clean":"2024-05-09T09:50:32.947737+0000","last_became_active":"2024-05-09T09:47:14.189468+0000","last_became_peered":"2024-05-09T09:47:14.189468+0000","last_unstale":"2024-05-09T09:50:32.947737+0000","last_undegraded":"2024-05-09T09:50:32.947737+0000","last_fullsized":"2024-05-09T09:50:32.947737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:28:37.119651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.881830+0000","last_change":"2024-05-09T09:47:12.210720+0000","last_active":"2024-05-09T09:49:31.881830+0000","last_peered":"2024-05-09T09:49:31.881830+0000","last_clean":"2024-05-09T09:49:31.881830+0000","last_became_active":"2024-05-09T09:47:12.206920+0000","last_became_peered":"2024-05-09T09:47:12.206920+0000","last_unstale":"2024-05-09T09:49:31.881830+0000","last_undegraded":"2024-05-09T09:49:31.881830+0000","last_fullsized":"2024-05-09T09:49:31.881830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:14.033148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'18","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.238228+0000","last_change":"2024-05-09T09:47:14.174508+0000","last_active":"2024-05-09T09:50:33.238228+0000","last_peered":"2024-05-09T09:50:33.238228+0000","last_clean":"2024-05-09T09:50:33.238228+0000","last_became_active":"2024-05-09T09:47:14.173701+0000","last_became_peered":"2024-05-09T09:47:14.173701+0000","last_unstale":"2024-05-09T09:50:33.238228+0000","last_undegraded":"2024-05-09T09:50:33.238228+0000","last_fullsized":"2024-05-09T09:50:33.238228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:28:37.119651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.715742+0000","last_change":"2024-05-09T09:47:12.207271+0000","last_active":"2024-05-09T09:50:32.715742+0000","last_peered":"2024-05-09T09:50:32.715742+0000","last_clean":"2024-05-09T09:50:32.715742+0000","last_became_active":"2024-05-09T09:47:12.206564+0000","last_became_peered":"2024-05-09T09:47:12.206564+0000","last_unstale":"2024-05-09T09:50:32.715742+0000","last_undegraded":"2024-05-09T09:50:32.715742+0000","last_fullsized":"2024-05-09T09:50:32.715742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:15:01.079963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'10","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.806551+0000","last_change":"2024-05-09T09:47:14.173448+0000","last_active":"2024-05-09T09:50:32.806551+0000","last_peered":"2024-05-09T09:50:32.806551+0000","last_clean":"2024-05-09T09:50:32.806551+0000","last_became_active":"2024-05-09T09:47:14.173022+0000","last_became_peered":"2024-05-09T09:47:14.173022+0000","last_unstale":"2024-05-09T09:50:32.806551+0000","last_undegraded":"2024-05-09T09:50:32.806551+0000","last_fullsized":"2024-05-09T09:50:32.806551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:58:34.213528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.417285+0000","last_change":"2024-05-09T09:47:12.216902+0000","last_active":"2024-05-09T09:47:52.417285+0000","last_peered":"2024-05-09T09:47:52.417285+0000","last_clean":"2024-05-09T09:47:52.417285+0000","last_became_active":"2024-05-09T09:47:12.214422+0000","last_became_peered":"2024-05-09T09:47:12.214422+0000","last_unstale":"2024-05-09T09:47:52.417285+0000","last_undegraded":"2024-05-09T09:47:52.417285+0000","last_fullsized":"2024-05-09T09:47:52.417285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:17:39.735832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'10","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.237141+0000","last_change":"2024-05-09T09:47:14.172576+0000","last_active":"2024-05-09T09:50:33.237141+0000","last_peered":"2024-05-09T09:50:33.237141+0000","last_clean":"2024-05-09T09:50:33.237141+0000","last_became_active":"2024-05-09T09:47:14.172297+0000","last_became_peered":"2024-05-09T09:47:14.172297+0000","last_unstale":"2024-05-09T09:50:33.237141+0000","last_undegraded":"2024-05-09T09:50:33.237141+0000","last_fullsized":"2024-05-09T09:50:33.237141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:38:12.687762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.066369+0000","last_change":"2024-05-09T09:47:12.213596+0000","last_active":"2024-05-09T09:49:32.066369+0000","last_peered":"2024-05-09T09:49:32.066369+0000","last_clean":"2024-05-09T09:49:32.066369+0000","last_became_active":"2024-05-09T09:47:12.211880+0000","last_became_peered":"2024-05-09T09:47:12.211880+0000","last_unstale":"2024-05-09T09:49:32.066369+0000","last_undegraded":"2024-05-09T09:49:32.066369+0000","last_fullsized":"2024-05-09T09:49:32.066369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:02:04.919917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'39","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.197791+0000","last_change":"2024-05-09T09:47:22.260431+0000","last_active":"2024-05-09T09:50:33.197791+0000","last_peered":"2024-05-09T09:50:33.197791+0000","last_clean":"2024-05-09T09:50:33.197791+0000","last_became_active":"2024-05-09T09:47:22.258991+0000","last_became_peered":"2024-05-09T09:47:22.258991+0000","last_unstale":"2024-05-09T09:50:33.197791+0000","last_undegraded":"2024-05-09T09:50:33.197791+0000","last_fullsized":"2024-05-09T09:50:33.197791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:48:55.320178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":174,"num_read_kb":174,"num_write":107,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:02.667895+0000","last_change":"2024-05-09T09:47:14.185176+0000","last_active":"2024-05-09T09:48:02.667895+0000","last_peered":"2024-05-09T09:48:02.667895+0000","last_clean":"2024-05-09T09:48:02.667895+0000","last_became_active":"2024-05-09T09:47:14.184851+0000","last_became_peered":"2024-05-09T09:47:14.184851+0000","last_unstale":"2024-05-09T09:48:02.667895+0000","last_undegraded":"2024-05-09T09:48:02.667895+0000","last_fullsized":"2024-05-09T09:48:02.667895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:13:24.454355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'1","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.175975+0000","last_change":"2024-05-09T09:47:12.214683+0000","last_active":"2024-05-09T09:49:35.175975+0000","last_peered":"2024-05-09T09:49:35.175975+0000","last_clean":"2024-05-09T09:49:35.175975+0000","last_became_active":"2024-05-09T09:47:12.214108+0000","last_became_peered":"2024-05-09T09:47:12.214108+0000","last_unstale":"2024-05-09T09:49:35.175975+0000","last_undegraded":"2024-05-09T09:49:35.175975+0000","last_fullsized":"2024-05-09T09:49:35.175975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:08:34.152345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.191620+0000","last_change":"2024-05-09T09:47:16.197589+0000","last_active":"2024-05-09T09:47:52.191620+0000","last_peered":"2024-05-09T09:47:52.191620+0000","last_clean":"2024-05-09T09:47:52.191620+0000","last_became_active":"2024-05-09T09:47:16.196516+0000","last_became_peered":"2024-05-09T09:47:16.196516+0000","last_unstale":"2024-05-09T09:47:52.191620+0000","last_undegraded":"2024-05-09T09:47:52.191620+0000","last_fullsized":"2024-05-09T09:47:52.191620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:17:41.107784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'104","reported_seq":146,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.611497+0000","last_change":"2024-05-09T09:47:18.236921+0000","last_active":"2024-05-09T09:49:31.611497+0000","last_peered":"2024-05-09T09:49:31.611497+0000","last_clean":"2024-05-09T09:49:31.611497+0000","last_became_active":"2024-05-09T09:47:18.235911+0000","last_became_peered":"2024-05-09T09:47:18.235911+0000","last_unstale":"2024-05-09T09:49:31.611497+0000","last_undegraded":"2024-05-09T09:49:31.611497+0000","last_fullsized":"2024-05-09T09:49:31.611497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:41:58.214685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.178731+0000","last_change":"2024-05-09T09:47:20.252492+0000","last_active":"2024-05-09T09:47:52.178731+0000","last_peered":"2024-05-09T09:47:52.178731+0000","last_clean":"2024-05-09T09:47:52.178731+0000","last_became_active":"2024-05-09T09:47:20.251712+0000","last_became_peered":"2024-05-09T09:47:20.251712+0000","last_unstale":"2024-05-09T09:47:52.178731+0000","last_undegraded":"2024-05-09T09:47:52.178731+0000","last_fullsized":"2024-05-09T09:47:52.178731+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:51:10.268994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:45.872841+0000","last_change":"2024-05-09T09:47:22.255759+0000","last_active":"2024-05-09T09:48:45.872841+0000","last_peered":"2024-05-09T09:48:45.872841+0000","last_clean":"2024-05-09T09:48:45.872841+0000","last_became_active":"2024-05-09T09:47:22.255180+0000","last_became_peered":"2024-05-09T09:47:22.255180+0000","last_unstale":"2024-05-09T09:48:45.872841+0000","last_undegraded":"2024-05-09T09:48:45.872841+0000","last_fullsized":"2024-05-09T09:48:45.872841+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:01:10.229471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.192939+0000","last_change":"2024-05-09T09:47:14.187449+0000","last_active":"2024-05-09T09:47:52.192939+0000","last_peered":"2024-05-09T09:47:52.192939+0000","last_clean":"2024-05-09T09:47:52.192939+0000","last_became_active":"2024-05-09T09:47:14.187095+0000","last_became_peered":"2024-05-09T09:47:14.187095+0000","last_unstale":"2024-05-09T09:47:52.192939+0000","last_undegraded":"2024-05-09T09:47:52.192939+0000","last_fullsized":"2024-05-09T09:47:52.192939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:30:13.157598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.290281+0000","last_change":"2024-05-09T09:47:12.196226+0000","last_active":"2024-05-09T09:50:33.290281+0000","last_peered":"2024-05-09T09:50:33.290281+0000","last_clean":"2024-05-09T09:50:33.290281+0000","last_became_active":"2024-05-09T09:47:12.194549+0000","last_became_peered":"2024-05-09T09:47:12.194549+0000","last_unstale":"2024-05-09T09:50:33.290281+0000","last_undegraded":"2024-05-09T09:50:33.290281+0000","last_fullsized":"2024-05-09T09:50:33.290281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:15:01.079963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.422996+0000","last_change":"2024-05-09T09:47:16.191533+0000","last_active":"2024-05-09T09:47:52.422996+0000","last_peered":"2024-05-09T09:47:52.422996+0000","last_clean":"2024-05-09T09:47:52.422996+0000","last_became_active":"2024-05-09T09:47:16.190755+0000","last_became_peered":"2024-05-09T09:47:16.190755+0000","last_unstale":"2024-05-09T09:47:52.422996+0000","last_undegraded":"2024-05-09T09:47:52.422996+0000","last_fullsized":"2024-05-09T09:47:52.422996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:42:45.452416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.179964+0000","last_change":"2024-05-09T09:47:18.215068+0000","last_active":"2024-05-09T09:49:45.179964+0000","last_peered":"2024-05-09T09:49:45.179964+0000","last_clean":"2024-05-09T09:49:45.179964+0000","last_became_active":"2024-05-09T09:47:18.214299+0000","last_became_peered":"2024-05-09T09:47:18.214299+0000","last_unstale":"2024-05-09T09:49:45.179964+0000","last_undegraded":"2024-05-09T09:49:45.179964+0000","last_fullsized":"2024-05-09T09:49:45.179964+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:49:59.954141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.174479+0000","last_change":"2024-05-09T09:47:20.241740+0000","last_active":"2024-05-09T09:47:52.174479+0000","last_peered":"2024-05-09T09:47:52.174479+0000","last_clean":"2024-05-09T09:47:52.174479+0000","last_became_active":"2024-05-09T09:47:20.241096+0000","last_became_peered":"2024-05-09T09:47:20.241096+0000","last_unstale":"2024-05-09T09:47:52.174479+0000","last_undegraded":"2024-05-09T09:47:52.174479+0000","last_fullsized":"2024-05-09T09:47:52.174479+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:37:23.903396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.416615+0000","last_change":"2024-05-09T09:47:22.258554+0000","last_active":"2024-05-09T09:47:52.416615+0000","last_peered":"2024-05-09T09:47:52.416615+0000","last_clean":"2024-05-09T09:47:52.416615+0000","last_became_active":"2024-05-09T09:47:22.257798+0000","last_became_peered":"2024-05-09T09:47:22.257798+0000","last_unstale":"2024-05-09T09:47:52.416615+0000","last_undegraded":"2024-05-09T09:47:52.416615+0000","last_fullsized":"2024-05-09T09:47:52.416615+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:29:01.635074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.947134+0000","last_change":"2024-05-09T09:47:52.430567+0000","last_active":"2024-05-09T09:50:32.947134+0000","last_peered":"2024-05-09T09:50:32.947134+0000","last_clean":"2024-05-09T09:50:32.947134+0000","last_became_active":"2024-05-09T09:47:52.429857+0000","last_became_peered":"2024-05-09T09:47:52.429857+0000","last_unstale":"2024-05-09T09:50:32.947134+0000","last_undegraded":"2024-05-09T09:50:32.947134+0000","last_fullsized":"2024-05-09T09:50:32.947134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:59:53.671007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.174693+0000","last_change":"2024-05-09T09:47:12.201826+0000","last_active":"2024-05-09T09:47:52.174693+0000","last_peered":"2024-05-09T09:47:52.174693+0000","last_clean":"2024-05-09T09:47:52.174693+0000","last_became_active":"2024-05-09T09:47:12.201415+0000","last_became_peered":"2024-05-09T09:47:12.201415+0000","last_unstale":"2024-05-09T09:47:52.174693+0000","last_undegraded":"2024-05-09T09:47:52.174693+0000","last_fullsized":"2024-05-09T09:47:52.174693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:56:46.263211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.426796+0000","last_change":"2024-05-09T09:47:16.213280+0000","last_active":"2024-05-09T09:47:52.426796+0000","last_peered":"2024-05-09T09:47:52.426796+0000","last_clean":"2024-05-09T09:47:52.426796+0000","last_became_active":"2024-05-09T09:47:16.212543+0000","last_became_peered":"2024-05-09T09:47:16.212543+0000","last_unstale":"2024-05-09T09:47:52.426796+0000","last_undegraded":"2024-05-09T09:47:52.426796+0000","last_fullsized":"2024-05-09T09:47:52.426796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:51:48.988654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.178986+0000","last_change":"2024-05-09T09:47:18.215341+0000","last_active":"2024-05-09T09:47:52.178986+0000","last_peered":"2024-05-09T09:47:52.178986+0000","last_clean":"2024-05-09T09:47:52.178986+0000","last_became_active":"2024-05-09T09:47:18.212685+0000","last_became_peered":"2024-05-09T09:47:18.212685+0000","last_unstale":"2024-05-09T09:47:52.178986+0000","last_undegraded":"2024-05-09T09:47:52.178986+0000","last_fullsized":"2024-05-09T09:47:52.178986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:42:47.464951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'282","reported_seq":383,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:31.469121+0000","last_change":"2024-05-09T09:47:20.250999+0000","last_active":"2024-05-09T09:50:31.469121+0000","last_peered":"2024-05-09T09:50:31.469121+0000","last_clean":"2024-05-09T09:50:31.469121+0000","last_became_active":"2024-05-09T09:47:20.250200+0000","last_became_peered":"2024-05-09T09:47:20.250200+0000","last_unstale":"2024-05-09T09:50:31.469121+0000","last_undegraded":"2024-05-09T09:50:31.469121+0000","last_fullsized":"2024-05-09T09:50:31.469121+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:17:01.311058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.170307+0000","last_change":"2024-05-09T09:47:22.241318+0000","last_active":"2024-05-09T09:47:52.170307+0000","last_peered":"2024-05-09T09:47:52.170307+0000","last_clean":"2024-05-09T09:47:52.170307+0000","last_became_active":"2024-05-09T09:47:22.238160+0000","last_became_peered":"2024-05-09T09:47:22.238160+0000","last_unstale":"2024-05-09T09:47:52.170307+0000","last_undegraded":"2024-05-09T09:47:52.170307+0000","last_fullsized":"2024-05-09T09:47:52.170307+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:26.173328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'16","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.825007+0000","last_change":"2024-05-09T09:47:14.177761+0000","last_active":"2024-05-09T09:50:32.825007+0000","last_peered":"2024-05-09T09:50:32.825007+0000","last_clean":"2024-05-09T09:50:32.825007+0000","last_became_active":"2024-05-09T09:47:14.176295+0000","last_became_peered":"2024-05-09T09:47:14.176295+0000","last_unstale":"2024-05-09T09:50:32.825007+0000","last_undegraded":"2024-05-09T09:50:32.825007+0000","last_fullsized":"2024-05-09T09:50:32.825007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:29:53.547705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.163979+0000","last_change":"2024-05-09T09:47:12.192627+0000","last_active":"2024-05-09T09:47:52.163979+0000","last_peered":"2024-05-09T09:47:52.163979+0000","last_clean":"2024-05-09T09:47:52.163979+0000","last_became_active":"2024-05-09T09:47:12.191194+0000","last_became_peered":"2024-05-09T09:47:12.191194+0000","last_unstale":"2024-05-09T09:47:52.163979+0000","last_undegraded":"2024-05-09T09:47:52.163979+0000","last_fullsized":"2024-05-09T09:47:52.163979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:21:00.747450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.203101+0000","last_change":"2024-05-09T09:47:52.201792+0000","last_active":"2024-05-09T09:47:52.203101+0000","last_peered":"2024-05-09T09:47:52.203101+0000","last_clean":"2024-05-09T09:47:52.203101+0000","last_became_active":"2024-05-09T09:47:52.201081+0000","last_became_peered":"2024-05-09T09:47:52.201081+0000","last_unstale":"2024-05-09T09:47:52.203101+0000","last_undegraded":"2024-05-09T09:47:52.203101+0000","last_fullsized":"2024-05-09T09:47:52.203101+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:13:19.457015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'104","reported_seq":146,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.600969+0000","last_change":"2024-05-09T09:47:18.219458+0000","last_active":"2024-05-09T09:49:31.600969+0000","last_peered":"2024-05-09T09:49:31.600969+0000","last_clean":"2024-05-09T09:49:31.600969+0000","last_became_active":"2024-05-09T09:47:18.217843+0000","last_became_peered":"2024-05-09T09:47:18.217843+0000","last_unstale":"2024-05-09T09:49:31.600969+0000","last_undegraded":"2024-05-09T09:49:31.600969+0000","last_fullsized":"2024-05-09T09:49:31.600969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:34:34.825637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'282","reported_seq":443,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.311661+0000","last_change":"2024-05-09T09:47:20.243402+0000","last_active":"2024-05-09T09:50:33.311661+0000","last_peered":"2024-05-09T09:50:33.311661+0000","last_clean":"2024-05-09T09:50:33.311661+0000","last_became_active":"2024-05-09T09:47:20.242448+0000","last_became_peered":"2024-05-09T09:47:20.242448+0000","last_unstale":"2024-05-09T09:50:33.311661+0000","last_undegraded":"2024-05-09T09:50:33.311661+0000","last_fullsized":"2024-05-09T09:50:33.311661+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:07.968167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.150356+0000","last_change":"2024-05-09T09:47:52.179916+0000","last_active":"2024-05-09T09:50:33.150356+0000","last_peered":"2024-05-09T09:50:33.150356+0000","last_clean":"2024-05-09T09:50:33.150356+0000","last_became_active":"2024-05-09T09:47:52.179059+0000","last_became_peered":"2024-05-09T09:47:52.179059+0000","last_unstale":"2024-05-09T09:50:33.150356+0000","last_undegraded":"2024-05-09T09:50:33.150356+0000","last_fullsized":"2024-05-09T09:50:33.150356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:20:28.160797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.183609+0000","last_change":"2024-05-09T09:47:12.206447+0000","last_active":"2024-05-09T09:47:52.183609+0000","last_peered":"2024-05-09T09:47:52.183609+0000","last_clean":"2024-05-09T09:47:52.183609+0000","last_became_active":"2024-05-09T09:47:12.205259+0000","last_became_peered":"2024-05-09T09:47:12.205259+0000","last_unstale":"2024-05-09T09:47:52.183609+0000","last_undegraded":"2024-05-09T09:47:52.183609+0000","last_fullsized":"2024-05-09T09:47:52.183609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:15.767283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.165019+0000","last_change":"2024-05-09T09:47:16.207890+0000","last_active":"2024-05-09T09:47:52.165019+0000","last_peered":"2024-05-09T09:47:52.165019+0000","last_clean":"2024-05-09T09:47:52.165019+0000","last_became_active":"2024-05-09T09:47:16.207404+0000","last_became_peered":"2024-05-09T09:47:16.207404+0000","last_unstale":"2024-05-09T09:47:52.165019+0000","last_undegraded":"2024-05-09T09:47:52.165019+0000","last_fullsized":"2024-05-09T09:47:52.165019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:51:48.988654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'116","reported_seq":163,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.349509+0000","last_change":"2024-05-09T09:47:18.221550+0000","last_active":"2024-05-09T09:49:31.349509+0000","last_peered":"2024-05-09T09:49:31.349509+0000","last_clean":"2024-05-09T09:49:31.349509+0000","last_became_active":"2024-05-09T09:47:18.220596+0000","last_became_peered":"2024-05-09T09:47:18.220596+0000","last_unstale":"2024-05-09T09:49:31.349509+0000","last_undegraded":"2024-05-09T09:49:31.349509+0000","last_fullsized":"2024-05-09T09:49:31.349509+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:03:54.051364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":54,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.420451+0000","last_change":"2024-05-09T09:47:20.246363+0000","last_active":"2024-05-09T09:47:52.420451+0000","last_peered":"2024-05-09T09:47:52.420451+0000","last_clean":"2024-05-09T09:47:52.420451+0000","last_became_active":"2024-05-09T09:47:20.244839+0000","last_became_peered":"2024-05-09T09:47:20.244839+0000","last_unstale":"2024-05-09T09:47:52.420451+0000","last_undegraded":"2024-05-09T09:47:52.420451+0000","last_fullsized":"2024-05-09T09:47:52.420451+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:40:50.226397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.950700+0000","last_change":"2024-05-09T09:47:22.237841+0000","last_active":"2024-05-09T09:50:32.950700+0000","last_peered":"2024-05-09T09:50:32.950700+0000","last_clean":"2024-05-09T09:50:32.950700+0000","last_became_active":"2024-05-09T09:47:22.235895+0000","last_became_peered":"2024-05-09T09:47:22.235895+0000","last_unstale":"2024-05-09T09:50:32.950700+0000","last_undegraded":"2024-05-09T09:50:32.950700+0000","last_fullsized":"2024-05-09T09:50:32.950700+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:59:20.801393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.174181+0000","last_change":"2024-05-09T09:47:14.172537+0000","last_active":"2024-05-09T09:49:25.174181+0000","last_peered":"2024-05-09T09:49:25.174181+0000","last_clean":"2024-05-09T09:49:25.174181+0000","last_became_active":"2024-05-09T09:47:14.172275+0000","last_became_peered":"2024-05-09T09:47:14.172275+0000","last_unstale":"2024-05-09T09:49:25.174181+0000","last_undegraded":"2024-05-09T09:49:25.174181+0000","last_fullsized":"2024-05-09T09:49:25.174181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:16:59.077638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:59.963235+0000","last_change":"2024-05-09T09:47:12.210250+0000","last_active":"2024-05-09T09:47:59.963235+0000","last_peered":"2024-05-09T09:47:59.963235+0000","last_clean":"2024-05-09T09:47:59.963235+0000","last_became_active":"2024-05-09T09:47:12.209274+0000","last_became_peered":"2024-05-09T09:47:12.209274+0000","last_unstale":"2024-05-09T09:47:59.963235+0000","last_undegraded":"2024-05-09T09:47:59.963235+0000","last_fullsized":"2024-05-09T09:47:59.963235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:19:17.059104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.420100+0000","last_change":"2024-05-09T09:47:16.215057+0000","last_active":"2024-05-09T09:47:52.420100+0000","last_peered":"2024-05-09T09:47:52.420100+0000","last_clean":"2024-05-09T09:47:52.420100+0000","last_became_active":"2024-05-09T09:47:16.214484+0000","last_became_peered":"2024-05-09T09:47:16.214484+0000","last_unstale":"2024-05-09T09:47:52.420100+0000","last_undegraded":"2024-05-09T09:47:52.420100+0000","last_fullsized":"2024-05-09T09:47:52.420100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:13:09.787784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'106","reported_seq":148,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.175951+0000","last_change":"2024-05-09T09:47:18.231906+0000","last_active":"2024-05-09T09:49:35.175951+0000","last_peered":"2024-05-09T09:49:35.175951+0000","last_clean":"2024-05-09T09:49:35.175951+0000","last_became_active":"2024-05-09T09:47:18.224815+0000","last_became_peered":"2024-05-09T09:47:18.224815+0000","last_unstale":"2024-05-09T09:49:35.175951+0000","last_undegraded":"2024-05-09T09:49:35.175951+0000","last_fullsized":"2024-05-09T09:49:35.175951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:55:53.240395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.412400+0000","last_change":"2024-05-09T09:47:20.251863+0000","last_active":"2024-05-09T09:47:52.412400+0000","last_peered":"2024-05-09T09:47:52.412400+0000","last_clean":"2024-05-09T09:47:52.412400+0000","last_became_active":"2024-05-09T09:47:20.250686+0000","last_became_peered":"2024-05-09T09:47:20.250686+0000","last_unstale":"2024-05-09T09:47:52.412400+0000","last_undegraded":"2024-05-09T09:47:52.412400+0000","last_fullsized":"2024-05-09T09:47:52.412400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:37:23.903396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'17","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.338642+0000","last_change":"2024-05-09T09:47:22.255914+0000","last_active":"2024-05-09T09:50:32.338642+0000","last_peered":"2024-05-09T09:50:32.338642+0000","last_clean":"2024-05-09T09:50:32.338642+0000","last_became_active":"2024-05-09T09:47:22.255076+0000","last_became_peered":"2024-05-09T09:47:22.255076+0000","last_unstale":"2024-05-09T09:50:32.338642+0000","last_undegraded":"2024-05-09T09:50:32.338642+0000","last_fullsized":"2024-05-09T09:50:32.338642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:25:35.144336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":92,"num_read_kb":72,"num_write":55,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.173175+0000","last_change":"2024-05-09T09:47:14.180737+0000","last_active":"2024-05-09T09:47:52.173175+0000","last_peered":"2024-05-09T09:47:52.173175+0000","last_clean":"2024-05-09T09:47:52.173175+0000","last_became_active":"2024-05-09T09:47:14.180185+0000","last_became_peered":"2024-05-09T09:47:14.180185+0000","last_unstale":"2024-05-09T09:47:52.173175+0000","last_undegraded":"2024-05-09T09:47:52.173175+0000","last_fullsized":"2024-05-09T09:47:52.173175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:44.612188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:59.962280+0000","last_change":"2024-05-09T09:47:12.211357+0000","last_active":"2024-05-09T09:47:59.962280+0000","last_peered":"2024-05-09T09:47:59.962280+0000","last_clean":"2024-05-09T09:47:59.962280+0000","last_became_active":"2024-05-09T09:47:12.207751+0000","last_became_peered":"2024-05-09T09:47:12.207751+0000","last_unstale":"2024-05-09T09:47:59.962280+0000","last_undegraded":"2024-05-09T09:47:59.962280+0000","last_fullsized":"2024-05-09T09:47:59.962280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:41:27.203063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.427281+0000","last_change":"2024-05-09T09:47:16.208197+0000","last_active":"2024-05-09T09:47:52.427281+0000","last_peered":"2024-05-09T09:47:52.427281+0000","last_clean":"2024-05-09T09:47:52.427281+0000","last_became_active":"2024-05-09T09:47:16.207734+0000","last_became_peered":"2024-05-09T09:47:16.207734+0000","last_unstale":"2024-05-09T09:47:52.427281+0000","last_undegraded":"2024-05-09T09:47:52.427281+0000","last_fullsized":"2024-05-09T09:47:52.427281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:57:13.986799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'110","reported_seq":155,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.352435+0000","last_change":"2024-05-09T09:47:18.231116+0000","last_active":"2024-05-09T09:49:31.352435+0000","last_peered":"2024-05-09T09:49:31.352435+0000","last_clean":"2024-05-09T09:49:31.352435+0000","last_became_active":"2024-05-09T09:47:18.230440+0000","last_became_peered":"2024-05-09T09:47:18.230440+0000","last_unstale":"2024-05-09T09:49:31.352435+0000","last_undegraded":"2024-05-09T09:49:31.352435+0000","last_fullsized":"2024-05-09T09:49:31.352435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:05:58.884035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'282","reported_seq":350,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.502365+0000","last_change":"2024-05-09T09:47:20.254991+0000","last_active":"2024-05-09T09:50:33.502365+0000","last_peered":"2024-05-09T09:50:33.502365+0000","last_clean":"2024-05-09T09:50:33.502365+0000","last_became_active":"2024-05-09T09:47:20.254305+0000","last_became_peered":"2024-05-09T09:47:20.254305+0000","last_unstale":"2024-05-09T09:50:33.502365+0000","last_undegraded":"2024-05-09T09:50:33.502365+0000","last_fullsized":"2024-05-09T09:50:33.502365+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:35:09.855318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.424385+0000","last_change":"2024-05-09T09:47:22.239987+0000","last_active":"2024-05-09T09:47:52.424385+0000","last_peered":"2024-05-09T09:47:52.424385+0000","last_clean":"2024-05-09T09:47:52.424385+0000","last_became_active":"2024-05-09T09:47:22.239262+0000","last_became_peered":"2024-05-09T09:47:22.239262+0000","last_unstale":"2024-05-09T09:47:52.424385+0000","last_undegraded":"2024-05-09T09:47:52.424385+0000","last_fullsized":"2024-05-09T09:47:52.424385+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:19:34.324968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'8","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:45.864227+0000","last_change":"2024-05-09T09:47:14.184937+0000","last_active":"2024-05-09T09:48:45.864227+0000","last_peered":"2024-05-09T09:48:45.864227+0000","last_clean":"2024-05-09T09:48:45.864227+0000","last_became_active":"2024-05-09T09:47:14.184593+0000","last_became_peered":"2024-05-09T09:47:14.184593+0000","last_unstale":"2024-05-09T09:48:45.864227+0000","last_undegraded":"2024-05-09T09:48:45.864227+0000","last_fullsized":"2024-05-09T09:48:45.864227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:30:37.903160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'8","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.754083+0000","last_change":"2024-05-09T09:47:12.211539+0000","last_active":"2024-05-09T09:50:32.754083+0000","last_peered":"2024-05-09T09:50:32.754083+0000","last_clean":"2024-05-09T09:50:32.754083+0000","last_became_active":"2024-05-09T09:47:12.207403+0000","last_became_peered":"2024-05-09T09:47:12.207403+0000","last_unstale":"2024-05-09T09:50:32.754083+0000","last_undegraded":"2024-05-09T09:50:32.754083+0000","last_fullsized":"2024-05-09T09:50:32.754083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:20:53.292716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":16,"num_write_kb":8838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.419204+0000","last_change":"2024-05-09T09:47:16.215117+0000","last_active":"2024-05-09T09:47:52.419204+0000","last_peered":"2024-05-09T09:47:52.419204+0000","last_clean":"2024-05-09T09:47:52.419204+0000","last_became_active":"2024-05-09T09:47:16.214607+0000","last_became_peered":"2024-05-09T09:47:16.214607+0000","last_unstale":"2024-05-09T09:47:52.419204+0000","last_undegraded":"2024-05-09T09:47:52.419204+0000","last_fullsized":"2024-05-09T09:47:52.419204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:25:29.477094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'203","reported_seq":259,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.586505+0000","last_change":"2024-05-09T09:47:18.225638+0000","last_active":"2024-05-09T09:49:31.586505+0000","last_peered":"2024-05-09T09:49:31.586505+0000","last_clean":"2024-05-09T09:49:31.586505+0000","last_became_active":"2024-05-09T09:47:18.224893+0000","last_became_peered":"2024-05-09T09:47:18.224893+0000","last_unstale":"2024-05-09T09:49:31.586505+0000","last_undegraded":"2024-05-09T09:49:31.586505+0000","last_fullsized":"2024-05-09T09:49:31.586505+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:04:53.766220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.413967+0000","last_change":"2024-05-09T09:47:20.229087+0000","last_active":"2024-05-09T09:47:52.413967+0000","last_peered":"2024-05-09T09:47:52.413967+0000","last_clean":"2024-05-09T09:47:52.413967+0000","last_became_active":"2024-05-09T09:47:20.228339+0000","last_became_peered":"2024-05-09T09:47:20.228339+0000","last_unstale":"2024-05-09T09:47:52.413967+0000","last_undegraded":"2024-05-09T09:47:52.413967+0000","last_fullsized":"2024-05-09T09:47:52.413967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:36.440080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.461775+0000","last_change":"2024-05-09T09:47:22.230031+0000","last_active":"2024-05-09T09:50:33.461775+0000","last_peered":"2024-05-09T09:50:33.461775+0000","last_clean":"2024-05-09T09:50:33.461775+0000","last_became_active":"2024-05-09T09:47:22.229193+0000","last_became_peered":"2024-05-09T09:47:22.229193+0000","last_unstale":"2024-05-09T09:50:33.461775+0000","last_undegraded":"2024-05-09T09:50:33.461775+0000","last_fullsized":"2024-05-09T09:50:33.461775+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:48:21.332216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.239007+0000","last_change":"2024-05-09T09:47:14.177074+0000","last_active":"2024-05-09T09:50:33.239007+0000","last_peered":"2024-05-09T09:50:33.239007+0000","last_clean":"2024-05-09T09:50:33.239007+0000","last_became_active":"2024-05-09T09:47:14.176717+0000","last_became_peered":"2024-05-09T09:47:14.176717+0000","last_unstale":"2024-05-09T09:50:33.239007+0000","last_undegraded":"2024-05-09T09:50:33.239007+0000","last_fullsized":"2024-05-09T09:50:33.239007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:44:03.763451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.420829+0000","last_change":"2024-05-09T09:47:12.205840+0000","last_active":"2024-05-09T09:47:52.420829+0000","last_peered":"2024-05-09T09:47:52.420829+0000","last_clean":"2024-05-09T09:47:52.420829+0000","last_became_active":"2024-05-09T09:47:12.204317+0000","last_became_peered":"2024-05-09T09:47:12.204317+0000","last_unstale":"2024-05-09T09:47:52.420829+0000","last_undegraded":"2024-05-09T09:47:52.420829+0000","last_fullsized":"2024-05-09T09:47:52.420829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:00:05.597093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.182486+0000","last_change":"2024-05-09T09:47:16.201348+0000","last_active":"2024-05-09T09:47:52.182486+0000","last_peered":"2024-05-09T09:47:52.182486+0000","last_clean":"2024-05-09T09:47:52.182486+0000","last_became_active":"2024-05-09T09:47:16.197031+0000","last_became_peered":"2024-05-09T09:47:16.197031+0000","last_unstale":"2024-05-09T09:47:52.182486+0000","last_undegraded":"2024-05-09T09:47:52.182486+0000","last_fullsized":"2024-05-09T09:47:52.182486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:01:00.598993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'106","reported_seq":149,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.588499+0000","last_change":"2024-05-09T09:47:18.216586+0000","last_active":"2024-05-09T09:49:31.588499+0000","last_peered":"2024-05-09T09:49:31.588499+0000","last_clean":"2024-05-09T09:49:31.588499+0000","last_became_active":"2024-05-09T09:47:18.215793+0000","last_became_peered":"2024-05-09T09:47:18.215793+0000","last_unstale":"2024-05-09T09:49:31.588499+0000","last_undegraded":"2024-05-09T09:49:31.588499+0000","last_fullsized":"2024-05-09T09:49:31.588499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:36:23.945979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.196563+0000","last_change":"2024-05-09T09:47:20.251219+0000","last_active":"2024-05-09T09:47:52.196563+0000","last_peered":"2024-05-09T09:47:52.196563+0000","last_clean":"2024-05-09T09:47:52.196563+0000","last_became_active":"2024-05-09T09:47:20.250363+0000","last_became_peered":"2024-05-09T09:47:20.250363+0000","last_unstale":"2024-05-09T09:47:52.196563+0000","last_undegraded":"2024-05-09T09:47:52.196563+0000","last_fullsized":"2024-05-09T09:47:52.196563+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:59:21.981954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:29.007272+0000","last_change":"2024-05-09T09:47:22.243140+0000","last_active":"2024-05-09T09:49:29.007272+0000","last_peered":"2024-05-09T09:49:29.007272+0000","last_clean":"2024-05-09T09:49:29.007272+0000","last_became_active":"2024-05-09T09:47:22.242410+0000","last_became_peered":"2024-05-09T09:47:22.242410+0000","last_unstale":"2024-05-09T09:49:29.007272+0000","last_undegraded":"2024-05-09T09:49:29.007272+0000","last_fullsized":"2024-05-09T09:49:29.007272+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:49:33.614704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:01.438873+0000","last_change":"2024-05-09T09:47:14.190653+0000","last_active":"2024-05-09T09:48:01.438873+0000","last_peered":"2024-05-09T09:48:01.438873+0000","last_clean":"2024-05-09T09:48:01.438873+0000","last_became_active":"2024-05-09T09:47:14.190016+0000","last_became_peered":"2024-05-09T09:47:14.190016+0000","last_unstale":"2024-05-09T09:48:01.438873+0000","last_undegraded":"2024-05-09T09:48:01.438873+0000","last_fullsized":"2024-05-09T09:48:01.438873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:03.774479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.178134+0000","last_change":"2024-05-09T09:47:12.212155+0000","last_active":"2024-05-09T09:47:52.178134+0000","last_peered":"2024-05-09T09:47:52.178134+0000","last_clean":"2024-05-09T09:47:52.178134+0000","last_became_active":"2024-05-09T09:47:12.211221+0000","last_became_peered":"2024-05-09T09:47:12.211221+0000","last_unstale":"2024-05-09T09:47:52.178134+0000","last_undegraded":"2024-05-09T09:47:52.178134+0000","last_fullsized":"2024-05-09T09:47:52.178134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:35:10.235355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.423260+0000","last_change":"2024-05-09T09:47:16.215089+0000","last_active":"2024-05-09T09:47:52.423260+0000","last_peered":"2024-05-09T09:47:52.423260+0000","last_clean":"2024-05-09T09:47:52.423260+0000","last_became_active":"2024-05-09T09:47:16.214462+0000","last_became_peered":"2024-05-09T09:47:16.214462+0000","last_unstale":"2024-05-09T09:47:52.423260+0000","last_undegraded":"2024-05-09T09:47:52.423260+0000","last_fullsized":"2024-05-09T09:47:52.423260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:34:32.813103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'110","reported_seq":155,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.643232+0000","last_change":"2024-05-09T09:47:18.213308+0000","last_active":"2024-05-09T09:49:31.643232+0000","last_peered":"2024-05-09T09:49:31.643232+0000","last_clean":"2024-05-09T09:49:31.643232+0000","last_became_active":"2024-05-09T09:47:18.212543+0000","last_became_peered":"2024-05-09T09:47:18.212543+0000","last_unstale":"2024-05-09T09:49:31.643232+0000","last_undegraded":"2024-05-09T09:49:31.643232+0000","last_fullsized":"2024-05-09T09:49:31.643232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:51:51.001188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'282","reported_seq":433,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.474123+0000","last_change":"2024-05-09T09:47:20.240819+0000","last_active":"2024-05-09T09:50:33.474123+0000","last_peered":"2024-05-09T09:50:33.474123+0000","last_clean":"2024-05-09T09:50:33.474123+0000","last_became_active":"2024-05-09T09:47:20.240236+0000","last_became_peered":"2024-05-09T09:47:20.240236+0000","last_unstale":"2024-05-09T09:50:33.474123+0000","last_undegraded":"2024-05-09T09:50:33.474123+0000","last_fullsized":"2024-05-09T09:50:33.474123+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:36:25.958106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'14","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.031493+0000","last_change":"2024-05-09T09:47:22.258681+0000","last_active":"2024-05-09T09:49:32.031493+0000","last_peered":"2024-05-09T09:49:32.031493+0000","last_clean":"2024-05-09T09:49:32.031493+0000","last_became_active":"2024-05-09T09:47:22.257986+0000","last_became_peered":"2024-05-09T09:47:22.257986+0000","last_unstale":"2024-05-09T09:49:32.031493+0000","last_undegraded":"2024-05-09T09:49:32.031493+0000","last_fullsized":"2024-05-09T09:49:32.031493+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:25:35.144336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.238754+0000","last_change":"2024-05-09T09:47:14.173042+0000","last_active":"2024-05-09T09:50:33.238754+0000","last_peered":"2024-05-09T09:50:33.238754+0000","last_clean":"2024-05-09T09:50:33.238754+0000","last_became_active":"2024-05-09T09:47:14.171963+0000","last_became_peered":"2024-05-09T09:47:14.171963+0000","last_unstale":"2024-05-09T09:50:33.238754+0000","last_undegraded":"2024-05-09T09:50:33.238754+0000","last_fullsized":"2024-05-09T09:50:33.238754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:32:19.275039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.181005+0000","last_change":"2024-05-09T09:47:12.211112+0000","last_active":"2024-05-09T09:47:52.181005+0000","last_peered":"2024-05-09T09:47:52.181005+0000","last_clean":"2024-05-09T09:47:52.181005+0000","last_became_active":"2024-05-09T09:47:12.204519+0000","last_became_peered":"2024-05-09T09:47:12.204519+0000","last_unstale":"2024-05-09T09:47:52.181005+0000","last_undegraded":"2024-05-09T09:47:52.181005+0000","last_fullsized":"2024-05-09T09:47:52.181005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:35:14.637438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":413,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.551841+0000","last_change":"2024-05-09T09:47:16.211670+0000","last_active":"2024-05-09T09:49:31.551841+0000","last_peered":"2024-05-09T09:49:31.551841+0000","last_clean":"2024-05-09T09:49:31.551841+0000","last_became_active":"2024-05-09T09:47:16.210812+0000","last_became_peered":"2024-05-09T09:47:16.210812+0000","last_unstale":"2024-05-09T09:49:31.551841+0000","last_undegraded":"2024-05-09T09:49:31.551841+0000","last_fullsized":"2024-05-09T09:49:31.551841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:41.390200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.190863+0000","last_change":"2024-05-09T09:47:18.225280+0000","last_active":"2024-05-09T09:47:52.190863+0000","last_peered":"2024-05-09T09:47:52.190863+0000","last_clean":"2024-05-09T09:47:52.190863+0000","last_became_active":"2024-05-09T09:47:18.224565+0000","last_became_peered":"2024-05-09T09:47:18.224565+0000","last_unstale":"2024-05-09T09:47:52.190863+0000","last_undegraded":"2024-05-09T09:47:52.190863+0000","last_fullsized":"2024-05-09T09:47:52.190863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:53:57.817020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'282","reported_seq":470,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.415046+0000","last_change":"2024-05-09T09:47:20.215231+0000","last_active":"2024-05-09T09:50:33.415046+0000","last_peered":"2024-05-09T09:50:33.415046+0000","last_clean":"2024-05-09T09:50:33.415046+0000","last_became_active":"2024-05-09T09:47:20.214337+0000","last_became_peered":"2024-05-09T09:47:20.214337+0000","last_unstale":"2024-05-09T09:50:33.415046+0000","last_undegraded":"2024-05-09T09:50:33.415046+0000","last_fullsized":"2024-05-09T09:50:33.415046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:35:09.855318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.761634+0000","last_change":"2024-05-09T09:47:22.235441+0000","last_active":"2024-05-09T09:49:31.761634+0000","last_peered":"2024-05-09T09:49:31.761634+0000","last_clean":"2024-05-09T09:49:31.761634+0000","last_became_active":"2024-05-09T09:47:22.233796+0000","last_became_peered":"2024-05-09T09:47:22.233796+0000","last_unstale":"2024-05-09T09:49:31.761634+0000","last_undegraded":"2024-05-09T09:49:31.761634+0000","last_fullsized":"2024-05-09T09:49:31.761634+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:25:18.746306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.164264+0000","last_change":"2024-05-09T09:47:14.175270+0000","last_active":"2024-05-09T09:49:32.164264+0000","last_peered":"2024-05-09T09:49:32.164264+0000","last_clean":"2024-05-09T09:49:32.164264+0000","last_became_active":"2024-05-09T09:47:14.174707+0000","last_became_peered":"2024-05-09T09:47:14.174707+0000","last_unstale":"2024-05-09T09:49:32.164264+0000","last_undegraded":"2024-05-09T09:49:32.164264+0000","last_fullsized":"2024-05-09T09:49:32.164264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:54:18.468178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:01.759832+0000","last_change":"2024-05-09T09:47:12.208521+0000","last_active":"2024-05-09T09:48:01.759832+0000","last_peered":"2024-05-09T09:48:01.759832+0000","last_clean":"2024-05-09T09:48:01.759832+0000","last_became_active":"2024-05-09T09:47:12.207874+0000","last_became_peered":"2024-05-09T09:47:12.207874+0000","last_unstale":"2024-05-09T09:48:01.759832+0000","last_undegraded":"2024-05-09T09:48:01.759832+0000","last_fullsized":"2024-05-09T09:48:01.759832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:30:35.883636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"23'1","reported_seq":218,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.552287+0000","last_change":"2024-05-09T09:47:16.205195+0000","last_active":"2024-05-09T09:49:31.552287+0000","last_peered":"2024-05-09T09:49:31.552287+0000","last_clean":"2024-05-09T09:49:31.552287+0000","last_became_active":"2024-05-09T09:47:16.204577+0000","last_became_peered":"2024-05-09T09:47:16.204577+0000","last_unstale":"2024-05-09T09:49:31.552287+0000","last_undegraded":"2024-05-09T09:49:31.552287+0000","last_fullsized":"2024-05-09T09:49:31.552287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:40:46.201735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'112","reported_seq":158,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.613890+0000","last_change":"2024-05-09T09:47:18.204810+0000","last_active":"2024-05-09T09:49:31.613890+0000","last_peered":"2024-05-09T09:49:31.613890+0000","last_clean":"2024-05-09T09:49:31.613890+0000","last_became_active":"2024-05-09T09:47:18.204057+0000","last_became_peered":"2024-05-09T09:47:18.204057+0000","last_unstale":"2024-05-09T09:49:31.613890+0000","last_undegraded":"2024-05-09T09:49:31.613890+0000","last_fullsized":"2024-05-09T09:49:31.613890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:27:23.487170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.178557+0000","last_change":"2024-05-09T09:47:20.255850+0000","last_active":"2024-05-09T09:47:52.178557+0000","last_peered":"2024-05-09T09:47:52.178557+0000","last_clean":"2024-05-09T09:47:52.178557+0000","last_became_active":"2024-05-09T09:47:20.255477+0000","last_became_peered":"2024-05-09T09:47:20.255477+0000","last_unstale":"2024-05-09T09:47:52.178557+0000","last_undegraded":"2024-05-09T09:47:52.178557+0000","last_fullsized":"2024-05-09T09:47:52.178557+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:09.812329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'8","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.372509+0000","last_change":"2024-05-09T09:47:22.228107+0000","last_active":"2024-05-09T09:50:33.372509+0000","last_peered":"2024-05-09T09:50:33.372509+0000","last_clean":"2024-05-09T09:50:33.372509+0000","last_became_active":"2024-05-09T09:47:22.227373+0000","last_became_peered":"2024-05-09T09:47:22.227373+0000","last_unstale":"2024-05-09T09:50:33.372509+0000","last_undegraded":"2024-05-09T09:50:33.372509+0000","last_fullsized":"2024-05-09T09:50:33.372509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:22:52.362489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'7","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.172569+0000","last_change":"2024-05-09T09:47:14.189976+0000","last_active":"2024-05-09T09:49:20.172569+0000","last_peered":"2024-05-09T09:49:20.172569+0000","last_clean":"2024-05-09T09:49:20.172569+0000","last_became_active":"2024-05-09T09:47:14.189623+0000","last_became_peered":"2024-05-09T09:47:14.189623+0000","last_unstale":"2024-05-09T09:49:20.172569+0000","last_undegraded":"2024-05-09T09:49:20.172569+0000","last_fullsized":"2024-05-09T09:49:20.172569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:21.387148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":202,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.163439+0000","last_change":"2024-05-09T09:46:57.510904+0000","last_active":"2024-05-09T09:47:52.163439+0000","last_peered":"2024-05-09T09:47:52.163439+0000","last_clean":"2024-05-09T09:47:52.163439+0000","last_became_active":"2024-05-09T09:46:57.508178+0000","last_became_peered":"2024-05-09T09:46:57.508178+0000","last_unstale":"2024-05-09T09:47:52.163439+0000","last_undegraded":"2024-05-09T09:47:52.163439+0000","last_fullsized":"2024-05-09T09:47:52.163439+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:46:56.015260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:46:56.015260+0000","last_clean_scrub_stamp":"2024-05-09T09:46:56.015260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:04:32.521129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.187056+0000","last_change":"2024-05-09T09:47:03.054623+0000","last_active":"2024-05-09T09:47:52.187056+0000","last_peered":"2024-05-09T09:47:52.187056+0000","last_clean":"2024-05-09T09:47:52.187056+0000","last_became_active":"2024-05-09T09:47:03.053783+0000","last_became_peered":"2024-05-09T09:47:03.053783+0000","last_unstale":"2024-05-09T09:47:52.187056+0000","last_undegraded":"2024-05-09T09:47:52.187056+0000","last_fullsized":"2024-05-09T09:47:52.187056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:12:39.792983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.176479+0000","last_change":"2024-05-09T09:47:12.212397+0000","last_active":"2024-05-09T09:47:52.176479+0000","last_peered":"2024-05-09T09:47:52.176479+0000","last_clean":"2024-05-09T09:47:52.176479+0000","last_became_active":"2024-05-09T09:47:12.211344+0000","last_became_peered":"2024-05-09T09:47:12.211344+0000","last_unstale":"2024-05-09T09:47:52.176479+0000","last_undegraded":"2024-05-09T09:47:52.176479+0000","last_fullsized":"2024-05-09T09:47:52.176479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:42.592663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.170165+0000","last_change":"2024-05-09T09:47:16.211676+0000","last_active":"2024-05-09T09:47:52.170165+0000","last_peered":"2024-05-09T09:47:52.170165+0000","last_clean":"2024-05-09T09:47:52.170165+0000","last_became_active":"2024-05-09T09:47:16.210404+0000","last_became_peered":"2024-05-09T09:47:16.210404+0000","last_unstale":"2024-05-09T09:47:52.170165+0000","last_undegraded":"2024-05-09T09:47:52.170165+0000","last_fullsized":"2024-05-09T09:47:52.170165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:29:50.436846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'298","reported_seq":367,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.618245+0000","last_change":"2024-05-09T09:47:18.237058+0000","last_active":"2024-05-09T09:49:31.618245+0000","last_peered":"2024-05-09T09:49:31.618245+0000","last_clean":"2024-05-09T09:49:31.618245+0000","last_became_active":"2024-05-09T09:47:18.236370+0000","last_became_peered":"2024-05-09T09:47:18.236370+0000","last_unstale":"2024-05-09T09:49:31.618245+0000","last_undegraded":"2024-05-09T09:49:31.618245+0000","last_fullsized":"2024-05-09T09:49:31.618245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:35:27.710372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.423093+0000","last_change":"2024-05-09T09:47:20.251241+0000","last_active":"2024-05-09T09:47:52.423093+0000","last_peered":"2024-05-09T09:47:52.423093+0000","last_clean":"2024-05-09T09:47:52.423093+0000","last_became_active":"2024-05-09T09:47:20.250373+0000","last_became_peered":"2024-05-09T09:47:20.250373+0000","last_unstale":"2024-05-09T09:47:52.423093+0000","last_undegraded":"2024-05-09T09:47:52.423093+0000","last_fullsized":"2024-05-09T09:47:52.423093+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:20:34.198648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'86","reported_seq":169,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.328990+0000","last_change":"2024-05-09T09:47:22.237003+0000","last_active":"2024-05-09T09:50:33.328990+0000","last_peered":"2024-05-09T09:50:33.328990+0000","last_clean":"2024-05-09T09:50:33.328990+0000","last_became_active":"2024-05-09T09:47:22.236267+0000","last_became_peered":"2024-05-09T09:47:22.236267+0000","last_unstale":"2024-05-09T09:50:33.328990+0000","last_undegraded":"2024-05-09T09:50:33.328990+0000","last_fullsized":"2024-05-09T09:50:33.328990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:08.206306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":223,"num_write":170,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:01.804496+0000","last_change":"2024-05-09T09:47:14.185397+0000","last_active":"2024-05-09T09:48:01.804496+0000","last_peered":"2024-05-09T09:48:01.804496+0000","last_clean":"2024-05-09T09:48:01.804496+0000","last_became_active":"2024-05-09T09:47:14.185071+0000","last_became_peered":"2024-05-09T09:47:14.185071+0000","last_unstale":"2024-05-09T09:48:01.804496+0000","last_undegraded":"2024-05-09T09:48:01.804496+0000","last_fullsized":"2024-05-09T09:48:01.804496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:49:40.986014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.168817+0000","last_change":"2024-05-09T09:47:03.051628+0000","last_active":"2024-05-09T09:47:52.168817+0000","last_peered":"2024-05-09T09:47:52.168817+0000","last_clean":"2024-05-09T09:47:52.168817+0000","last_became_active":"2024-05-09T09:47:03.050535+0000","last_became_peered":"2024-05-09T09:47:03.050535+0000","last_unstale":"2024-05-09T09:47:52.168817+0000","last_undegraded":"2024-05-09T09:47:52.168817+0000","last_fullsized":"2024-05-09T09:47:52.168817+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:09:16.875087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:46.145259+0000","last_change":"2024-05-09T09:47:12.206331+0000","last_active":"2024-05-09T09:48:46.145259+0000","last_peered":"2024-05-09T09:48:46.145259+0000","last_clean":"2024-05-09T09:48:46.145259+0000","last_became_active":"2024-05-09T09:47:12.203494+0000","last_became_peered":"2024-05-09T09:47:12.203494+0000","last_unstale":"2024-05-09T09:48:46.145259+0000","last_undegraded":"2024-05-09T09:48:46.145259+0000","last_fullsized":"2024-05-09T09:48:46.145259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:55.107119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.196899+0000","last_change":"2024-05-09T09:47:16.201019+0000","last_active":"2024-05-09T09:47:52.196899+0000","last_peered":"2024-05-09T09:47:52.196899+0000","last_clean":"2024-05-09T09:47:52.196899+0000","last_became_active":"2024-05-09T09:47:16.200369+0000","last_became_peered":"2024-05-09T09:47:16.200369+0000","last_unstale":"2024-05-09T09:47:52.196899+0000","last_undegraded":"2024-05-09T09:47:52.196899+0000","last_fullsized":"2024-05-09T09:47:52.196899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:03.943505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'495","reported_seq":700,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:31.469895+0000","last_change":"2024-05-09T09:47:18.220093+0000","last_active":"2024-05-09T09:50:31.469895+0000","last_peered":"2024-05-09T09:50:31.469895+0000","last_clean":"2024-05-09T09:50:31.469895+0000","last_became_active":"2024-05-09T09:47:18.219321+0000","last_became_peered":"2024-05-09T09:47:18.219321+0000","last_unstale":"2024-05-09T09:50:31.469895+0000","last_undegraded":"2024-05-09T09:50:31.469895+0000","last_fullsized":"2024-05-09T09:50:31.469895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:07.800202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.191188+0000","last_change":"2024-05-09T09:47:20.249740+0000","last_active":"2024-05-09T09:47:52.191188+0000","last_peered":"2024-05-09T09:47:52.191188+0000","last_clean":"2024-05-09T09:47:52.191188+0000","last_became_active":"2024-05-09T09:47:20.249089+0000","last_became_peered":"2024-05-09T09:47:20.249089+0000","last_unstale":"2024-05-09T09:47:52.191188+0000","last_undegraded":"2024-05-09T09:47:52.191188+0000","last_fullsized":"2024-05-09T09:47:52.191188+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:15:27.189938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:45.869681+0000","last_change":"2024-05-09T09:47:22.245460+0000","last_active":"2024-05-09T09:48:45.869681+0000","last_peered":"2024-05-09T09:48:45.869681+0000","last_clean":"2024-05-09T09:48:45.869681+0000","last_became_active":"2024-05-09T09:47:22.244543+0000","last_became_peered":"2024-05-09T09:47:22.244543+0000","last_unstale":"2024-05-09T09:48:45.869681+0000","last_undegraded":"2024-05-09T09:48:45.869681+0000","last_fullsized":"2024-05-09T09:48:45.869681+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:59:48.546473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.150108+0000","last_change":"2024-05-09T09:47:14.177030+0000","last_active":"2024-05-09T09:50:33.150108+0000","last_peered":"2024-05-09T09:50:33.150108+0000","last_clean":"2024-05-09T09:50:33.150108+0000","last_became_active":"2024-05-09T09:47:14.173959+0000","last_became_peered":"2024-05-09T09:47:14.173959+0000","last_unstale":"2024-05-09T09:50:33.150108+0000","last_undegraded":"2024-05-09T09:50:33.150108+0000","last_fullsized":"2024-05-09T09:50:33.150108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:57.831374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.167819+0000","last_change":"2024-05-09T09:47:03.052957+0000","last_active":"2024-05-09T09:47:52.167819+0000","last_peered":"2024-05-09T09:47:52.167819+0000","last_clean":"2024-05-09T09:47:52.167819+0000","last_became_active":"2024-05-09T09:47:03.052185+0000","last_became_peered":"2024-05-09T09:47:03.052185+0000","last_unstale":"2024-05-09T09:47:52.167819+0000","last_undegraded":"2024-05-09T09:47:52.167819+0000","last_fullsized":"2024-05-09T09:47:52.167819+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:48:39.354125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.102108+0000","last_change":"2024-05-09T09:47:12.186149+0000","last_active":"2024-05-09T09:50:33.102108+0000","last_peered":"2024-05-09T09:50:33.102108+0000","last_clean":"2024-05-09T09:50:33.102108+0000","last_became_active":"2024-05-09T09:47:12.183846+0000","last_became_peered":"2024-05-09T09:47:12.183846+0000","last_unstale":"2024-05-09T09:50:33.102108+0000","last_undegraded":"2024-05-09T09:50:33.102108+0000","last_fullsized":"2024-05-09T09:50:33.102108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:46.107016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.185095+0000","last_change":"2024-05-09T09:47:16.202023+0000","last_active":"2024-05-09T09:47:52.185095+0000","last_peered":"2024-05-09T09:47:52.185095+0000","last_clean":"2024-05-09T09:47:52.185095+0000","last_became_active":"2024-05-09T09:47:16.197380+0000","last_became_peered":"2024-05-09T09:47:16.197380+0000","last_unstale":"2024-05-09T09:47:52.185095+0000","last_undegraded":"2024-05-09T09:47:52.185095+0000","last_fullsized":"2024-05-09T09:47:52.185095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:23:20.908060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'18","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:31.469305+0000","last_change":"2024-05-09T09:47:18.218553+0000","last_active":"2024-05-09T09:50:31.469305+0000","last_peered":"2024-05-09T09:50:31.469305+0000","last_clean":"2024-05-09T09:50:31.469305+0000","last_became_active":"2024-05-09T09:47:18.217023+0000","last_became_peered":"2024-05-09T09:47:18.217023+0000","last_unstale":"2024-05-09T09:50:31.469305+0000","last_undegraded":"2024-05-09T09:50:31.469305+0000","last_fullsized":"2024-05-09T09:50:31.469305+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:31.382403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.420979+0000","last_change":"2024-05-09T09:47:20.251883+0000","last_active":"2024-05-09T09:47:52.420979+0000","last_peered":"2024-05-09T09:47:52.420979+0000","last_clean":"2024-05-09T09:47:52.420979+0000","last_became_active":"2024-05-09T09:47:20.250979+0000","last_became_peered":"2024-05-09T09:47:20.250979+0000","last_unstale":"2024-05-09T09:47:52.420979+0000","last_undegraded":"2024-05-09T09:47:52.420979+0000","last_fullsized":"2024-05-09T09:47:52.420979+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:41:44.382613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.176855+0000","last_change":"2024-05-09T09:47:22.264183+0000","last_active":"2024-05-09T09:47:52.176855+0000","last_peered":"2024-05-09T09:47:52.176855+0000","last_clean":"2024-05-09T09:47:52.176855+0000","last_became_active":"2024-05-09T09:47:22.263615+0000","last_became_peered":"2024-05-09T09:47:22.263615+0000","last_unstale":"2024-05-09T09:47:52.176855+0000","last_undegraded":"2024-05-09T09:47:52.176855+0000","last_fullsized":"2024-05-09T09:47:52.176855+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:55:41.434447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'4","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:00.834605+0000","last_change":"2024-05-09T09:47:14.190245+0000","last_active":"2024-05-09T09:48:00.834605+0000","last_peered":"2024-05-09T09:48:00.834605+0000","last_clean":"2024-05-09T09:48:00.834605+0000","last_became_active":"2024-05-09T09:47:14.188644+0000","last_became_peered":"2024-05-09T09:47:14.188644+0000","last_unstale":"2024-05-09T09:48:00.834605+0000","last_undegraded":"2024-05-09T09:48:00.834605+0000","last_fullsized":"2024-05-09T09:48:00.834605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:41:29.222588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.173230+0000","last_change":"2024-05-09T09:47:03.051760+0000","last_active":"2024-05-09T09:47:52.173230+0000","last_peered":"2024-05-09T09:47:52.173230+0000","last_clean":"2024-05-09T09:47:52.173230+0000","last_became_active":"2024-05-09T09:47:03.050832+0000","last_became_peered":"2024-05-09T09:47:03.050832+0000","last_unstale":"2024-05-09T09:47:52.173230+0000","last_undegraded":"2024-05-09T09:47:52.173230+0000","last_fullsized":"2024-05-09T09:47:52.173230+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:47.680871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.179110+0000","last_change":"2024-05-09T09:47:12.191109+0000","last_active":"2024-05-09T09:47:52.179110+0000","last_peered":"2024-05-09T09:47:52.179110+0000","last_clean":"2024-05-09T09:47:52.179110+0000","last_became_active":"2024-05-09T09:47:12.190521+0000","last_became_peered":"2024-05-09T09:47:12.190521+0000","last_unstale":"2024-05-09T09:47:52.179110+0000","last_undegraded":"2024-05-09T09:47:52.179110+0000","last_fullsized":"2024-05-09T09:47:52.179110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:14:11.726333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.423038+0000","last_change":"2024-05-09T09:47:16.189464+0000","last_active":"2024-05-09T09:47:52.423038+0000","last_peered":"2024-05-09T09:47:52.423038+0000","last_clean":"2024-05-09T09:47:52.423038+0000","last_became_active":"2024-05-09T09:47:16.187120+0000","last_became_peered":"2024-05-09T09:47:16.187120+0000","last_unstale":"2024-05-09T09:47:52.423038+0000","last_undegraded":"2024-05-09T09:47:52.423038+0000","last_fullsized":"2024-05-09T09:47:52.423038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:29.369869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'14","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.208504+0000","last_change":"2024-05-09T09:47:18.231683+0000","last_active":"2024-05-09T09:50:32.208504+0000","last_peered":"2024-05-09T09:50:32.208504+0000","last_clean":"2024-05-09T09:50:32.208504+0000","last_became_active":"2024-05-09T09:47:18.230757+0000","last_became_peered":"2024-05-09T09:47:18.230757+0000","last_unstale":"2024-05-09T09:50:32.208504+0000","last_undegraded":"2024-05-09T09:50:32.208504+0000","last_fullsized":"2024-05-09T09:50:32.208504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:11:55.151452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.198252+0000","last_change":"2024-05-09T09:47:20.250439+0000","last_active":"2024-05-09T09:47:52.198252+0000","last_peered":"2024-05-09T09:47:52.198252+0000","last_clean":"2024-05-09T09:47:52.198252+0000","last_became_active":"2024-05-09T09:47:20.249919+0000","last_became_peered":"2024-05-09T09:47:20.249919+0000","last_unstale":"2024-05-09T09:47:52.198252+0000","last_undegraded":"2024-05-09T09:47:52.198252+0000","last_fullsized":"2024-05-09T09:47:52.198252+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:01:29.818831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'6","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.774666+0000","last_change":"2024-05-09T09:47:22.260930+0000","last_active":"2024-05-09T09:49:31.774666+0000","last_peered":"2024-05-09T09:49:31.774666+0000","last_clean":"2024-05-09T09:49:31.774666+0000","last_became_active":"2024-05-09T09:47:22.259833+0000","last_became_peered":"2024-05-09T09:47:22.259833+0000","last_unstale":"2024-05-09T09:49:31.774666+0000","last_undegraded":"2024-05-09T09:49:31.774666+0000","last_fullsized":"2024-05-09T09:49:31.774666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:01.734541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.809750+0000","last_change":"2024-05-09T09:47:14.174110+0000","last_active":"2024-05-09T09:50:32.809750+0000","last_peered":"2024-05-09T09:50:32.809750+0000","last_clean":"2024-05-09T09:50:32.809750+0000","last_became_active":"2024-05-09T09:47:14.173535+0000","last_became_peered":"2024-05-09T09:47:14.173535+0000","last_unstale":"2024-05-09T09:50:32.809750+0000","last_undegraded":"2024-05-09T09:50:32.809750+0000","last_fullsized":"2024-05-09T09:50:32.809750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:35:20.332271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:00.785377+0000","last_change":"2024-05-09T09:47:12.195767+0000","last_active":"2024-05-09T09:48:00.785377+0000","last_peered":"2024-05-09T09:48:00.785377+0000","last_clean":"2024-05-09T09:48:00.785377+0000","last_became_active":"2024-05-09T09:47:12.194500+0000","last_became_peered":"2024-05-09T09:47:12.194500+0000","last_unstale":"2024-05-09T09:48:00.785377+0000","last_undegraded":"2024-05-09T09:48:00.785377+0000","last_fullsized":"2024-05-09T09:48:00.785377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:06.949531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.425796+0000","last_change":"2024-05-09T09:47:03.051513+0000","last_active":"2024-05-09T09:47:52.425796+0000","last_peered":"2024-05-09T09:47:52.425796+0000","last_clean":"2024-05-09T09:47:52.425796+0000","last_became_active":"2024-05-09T09:47:03.051159+0000","last_became_peered":"2024-05-09T09:47:03.051159+0000","last_unstale":"2024-05-09T09:47:52.425796+0000","last_undegraded":"2024-05-09T09:47:52.425796+0000","last_fullsized":"2024-05-09T09:47:52.425796+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:12.598885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'5","reported_seq":227,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.535909+0000","last_change":"2024-05-09T09:47:16.199008+0000","last_active":"2024-05-09T09:49:31.535909+0000","last_peered":"2024-05-09T09:49:31.535909+0000","last_clean":"2024-05-09T09:49:31.535909+0000","last_became_active":"2024-05-09T09:47:16.198233+0000","last_became_peered":"2024-05-09T09:47:16.198233+0000","last_unstale":"2024-05-09T09:49:31.535909+0000","last_undegraded":"2024-05-09T09:49:31.535909+0000","last_fullsized":"2024-05-09T09:49:31.535909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:04.613279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1180,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'209","reported_seq":268,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.639919+0000","last_change":"2024-05-09T09:47:18.200360+0000","last_active":"2024-05-09T09:49:31.639919+0000","last_peered":"2024-05-09T09:49:31.639919+0000","last_clean":"2024-05-09T09:49:31.639919+0000","last_became_active":"2024-05-09T09:47:18.199411+0000","last_became_peered":"2024-05-09T09:47:18.199411+0000","last_unstale":"2024-05-09T09:49:31.639919+0000","last_undegraded":"2024-05-09T09:49:31.639919+0000","last_fullsized":"2024-05-09T09:49:31.639919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:30:17.183321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.166977+0000","last_change":"2024-05-09T09:47:20.233735+0000","last_active":"2024-05-09T09:47:52.166977+0000","last_peered":"2024-05-09T09:47:52.166977+0000","last_clean":"2024-05-09T09:47:52.166977+0000","last_became_active":"2024-05-09T09:47:20.233024+0000","last_became_peered":"2024-05-09T09:47:20.233024+0000","last_unstale":"2024-05-09T09:47:52.166977+0000","last_undegraded":"2024-05-09T09:47:52.166977+0000","last_fullsized":"2024-05-09T09:47:52.166977+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:49:47.023864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.037073+0000","last_change":"2024-05-09T09:47:22.229611+0000","last_active":"2024-05-09T09:49:32.037073+0000","last_peered":"2024-05-09T09:49:32.037073+0000","last_clean":"2024-05-09T09:49:32.037073+0000","last_became_active":"2024-05-09T09:47:22.228855+0000","last_became_peered":"2024-05-09T09:47:22.228855+0000","last_unstale":"2024-05-09T09:49:32.037073+0000","last_undegraded":"2024-05-09T09:49:32.037073+0000","last_fullsized":"2024-05-09T09:49:32.037073+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:42:02.241469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'12","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.303331+0000","last_change":"2024-05-09T09:47:52.440285+0000","last_active":"2024-05-09T09:50:33.303331+0000","last_peered":"2024-05-09T09:50:33.303331+0000","last_clean":"2024-05-09T09:50:33.303331+0000","last_became_active":"2024-05-09T09:47:52.430912+0000","last_became_peered":"2024-05-09T09:47:52.430912+0000","last_unstale":"2024-05-09T09:50:33.303331+0000","last_undegraded":"2024-05-09T09:50:33.303331+0000","last_fullsized":"2024-05-09T09:50:33.303331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:11:51.125729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.420062+0000","last_change":"2024-05-09T09:47:12.190681+0000","last_active":"2024-05-09T09:47:52.420062+0000","last_peered":"2024-05-09T09:47:52.420062+0000","last_clean":"2024-05-09T09:47:52.420062+0000","last_became_active":"2024-05-09T09:47:12.189486+0000","last_became_peered":"2024-05-09T09:47:12.189486+0000","last_unstale":"2024-05-09T09:47:52.420062+0000","last_undegraded":"2024-05-09T09:47:52.420062+0000","last_fullsized":"2024-05-09T09:47:52.420062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:36:27.157767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.192263+0000","last_change":"2024-05-09T09:47:03.051225+0000","last_active":"2024-05-09T09:47:52.192263+0000","last_peered":"2024-05-09T09:47:52.192263+0000","last_clean":"2024-05-09T09:47:52.192263+0000","last_became_active":"2024-05-09T09:47:03.050600+0000","last_became_peered":"2024-05-09T09:47:03.050600+0000","last_unstale":"2024-05-09T09:47:52.192263+0000","last_undegraded":"2024-05-09T09:47:52.192263+0000","last_fullsized":"2024-05-09T09:47:52.192263+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:08:36.545563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.173025+0000","last_change":"2024-05-09T09:47:16.188804+0000","last_active":"2024-05-09T09:47:52.173025+0000","last_peered":"2024-05-09T09:47:52.173025+0000","last_clean":"2024-05-09T09:47:52.173025+0000","last_became_active":"2024-05-09T09:47:16.182232+0000","last_became_peered":"2024-05-09T09:47:16.182232+0000","last_unstale":"2024-05-09T09:47:52.173025+0000","last_undegraded":"2024-05-09T09:47:52.173025+0000","last_fullsized":"2024-05-09T09:47:52.173025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:35:05.830656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.165199+0000","last_change":"2024-05-09T09:47:18.213188+0000","last_active":"2024-05-09T09:47:52.165199+0000","last_peered":"2024-05-09T09:47:52.165199+0000","last_clean":"2024-05-09T09:47:52.165199+0000","last_became_active":"2024-05-09T09:47:18.211020+0000","last_became_peered":"2024-05-09T09:47:18.211020+0000","last_unstale":"2024-05-09T09:47:52.165199+0000","last_undegraded":"2024-05-09T09:47:52.165199+0000","last_fullsized":"2024-05-09T09:47:52.165199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:53:16.173752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'282","reported_seq":371,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:31.469244+0000","last_change":"2024-05-09T09:47:20.227322+0000","last_active":"2024-05-09T09:50:31.469244+0000","last_peered":"2024-05-09T09:50:31.469244+0000","last_clean":"2024-05-09T09:50:31.469244+0000","last_became_active":"2024-05-09T09:47:20.226481+0000","last_became_peered":"2024-05-09T09:47:20.226481+0000","last_unstale":"2024-05-09T09:50:31.469244+0000","last_undegraded":"2024-05-09T09:50:31.469244+0000","last_fullsized":"2024-05-09T09:50:31.469244+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:03:55.645189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.195877+0000","last_change":"2024-05-09T09:47:22.256859+0000","last_active":"2024-05-09T09:47:52.195877+0000","last_peered":"2024-05-09T09:47:52.195877+0000","last_clean":"2024-05-09T09:47:52.195877+0000","last_became_active":"2024-05-09T09:47:22.256285+0000","last_became_peered":"2024-05-09T09:47:22.256285+0000","last_unstale":"2024-05-09T09:47:52.195877+0000","last_undegraded":"2024-05-09T09:47:52.195877+0000","last_fullsized":"2024-05-09T09:47:52.195877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:11:22.508789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.239155+0000","last_change":"2024-05-09T09:47:14.183911+0000","last_active":"2024-05-09T09:50:33.239155+0000","last_peered":"2024-05-09T09:50:33.239155+0000","last_clean":"2024-05-09T09:50:33.239155+0000","last_became_active":"2024-05-09T09:47:14.183542+0000","last_became_peered":"2024-05-09T09:47:14.183542+0000","last_unstale":"2024-05-09T09:50:33.239155+0000","last_undegraded":"2024-05-09T09:50:33.239155+0000","last_fullsized":"2024-05-09T09:50:33.239155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:29:48.423658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.199875+0000","last_change":"2024-05-09T09:47:12.200135+0000","last_active":"2024-05-09T09:47:52.199875+0000","last_peered":"2024-05-09T09:47:52.199875+0000","last_clean":"2024-05-09T09:47:52.199875+0000","last_became_active":"2024-05-09T09:47:12.199656+0000","last_became_peered":"2024-05-09T09:47:12.199656+0000","last_unstale":"2024-05-09T09:47:52.199875+0000","last_undegraded":"2024-05-09T09:47:52.199875+0000","last_fullsized":"2024-05-09T09:47:52.199875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:32:17.255514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.427138+0000","last_change":"2024-05-09T09:47:03.053083+0000","last_active":"2024-05-09T09:47:52.427138+0000","last_peered":"2024-05-09T09:47:52.427138+0000","last_clean":"2024-05-09T09:47:52.427138+0000","last_became_active":"2024-05-09T09:47:03.052728+0000","last_became_peered":"2024-05-09T09:47:03.052728+0000","last_unstale":"2024-05-09T09:47:52.427138+0000","last_undegraded":"2024-05-09T09:47:52.427138+0000","last_fullsized":"2024-05-09T09:47:52.427138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:40:57.635793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.184620+0000","last_change":"2024-05-09T09:47:52.183646+0000","last_active":"2024-05-09T09:47:52.184620+0000","last_peered":"2024-05-09T09:47:52.184620+0000","last_clean":"2024-05-09T09:47:52.184620+0000","last_became_active":"2024-05-09T09:47:52.182360+0000","last_became_peered":"2024-05-09T09:47:52.182360+0000","last_unstale":"2024-05-09T09:47:52.184620+0000","last_undegraded":"2024-05-09T09:47:52.184620+0000","last_fullsized":"2024-05-09T09:47:52.184620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:36:55.505219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.177728+0000","last_change":"2024-05-09T09:47:18.235283+0000","last_active":"2024-05-09T09:47:52.177728+0000","last_peered":"2024-05-09T09:47:52.177728+0000","last_clean":"2024-05-09T09:47:52.177728+0000","last_became_active":"2024-05-09T09:47:18.234556+0000","last_became_peered":"2024-05-09T09:47:18.234556+0000","last_unstale":"2024-05-09T09:47:52.177728+0000","last_undegraded":"2024-05-09T09:47:52.177728+0000","last_fullsized":"2024-05-09T09:47:52.177728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:52:44.437137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'282","reported_seq":401,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.488738+0000","last_change":"2024-05-09T09:47:20.229005+0000","last_active":"2024-05-09T09:50:33.488738+0000","last_peered":"2024-05-09T09:50:33.488738+0000","last_clean":"2024-05-09T09:50:33.488738+0000","last_became_active":"2024-05-09T09:47:20.226936+0000","last_became_peered":"2024-05-09T09:47:20.226936+0000","last_unstale":"2024-05-09T09:50:33.488738+0000","last_undegraded":"2024-05-09T09:50:33.488738+0000","last_fullsized":"2024-05-09T09:50:33.488738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:17:45.132446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.168136+0000","last_change":"2024-05-09T09:47:22.260147+0000","last_active":"2024-05-09T09:47:52.168136+0000","last_peered":"2024-05-09T09:47:52.168136+0000","last_clean":"2024-05-09T09:47:52.168136+0000","last_became_active":"2024-05-09T09:47:22.259547+0000","last_became_peered":"2024-05-09T09:47:22.259547+0000","last_unstale":"2024-05-09T09:47:52.168136+0000","last_undegraded":"2024-05-09T09:47:52.168136+0000","last_fullsized":"2024-05-09T09:47:52.168136+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:00:03.909321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'12","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:46.159946+0000","last_change":"2024-05-09T09:47:14.174039+0000","last_active":"2024-05-09T09:48:46.159946+0000","last_peered":"2024-05-09T09:48:46.159946+0000","last_clean":"2024-05-09T09:48:46.159946+0000","last_became_active":"2024-05-09T09:47:14.173673+0000","last_became_peered":"2024-05-09T09:47:14.173673+0000","last_unstale":"2024-05-09T09:48:46.159946+0000","last_undegraded":"2024-05-09T09:48:46.159946+0000","last_fullsized":"2024-05-09T09:48:46.159946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:56:48.282736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.174836+0000","last_change":"2024-05-09T09:47:12.206199+0000","last_active":"2024-05-09T09:47:52.174836+0000","last_peered":"2024-05-09T09:47:52.174836+0000","last_clean":"2024-05-09T09:47:52.174836+0000","last_became_active":"2024-05-09T09:47:12.205502+0000","last_became_peered":"2024-05-09T09:47:12.205502+0000","last_unstale":"2024-05-09T09:47:52.174836+0000","last_undegraded":"2024-05-09T09:47:52.174836+0000","last_fullsized":"2024-05-09T09:47:52.174836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:00:03.229983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.198477+0000","last_change":"2024-05-09T09:47:03.187330+0000","last_active":"2024-05-09T09:47:52.198477+0000","last_peered":"2024-05-09T09:47:52.198477+0000","last_clean":"2024-05-09T09:47:52.198477+0000","last_became_active":"2024-05-09T09:47:03.186434+0000","last_became_peered":"2024-05-09T09:47:03.186434+0000","last_unstale":"2024-05-09T09:47:52.198477+0000","last_undegraded":"2024-05-09T09:47:52.198477+0000","last_fullsized":"2024-05-09T09:47:52.198477+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:51:35.071748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.168475+0000","last_change":"2024-05-09T09:47:16.184166+0000","last_active":"2024-05-09T09:47:52.168475+0000","last_peered":"2024-05-09T09:47:52.168475+0000","last_clean":"2024-05-09T09:47:52.168475+0000","last_became_active":"2024-05-09T09:47:16.182713+0000","last_became_peered":"2024-05-09T09:47:16.182713+0000","last_unstale":"2024-05-09T09:47:52.168475+0000","last_undegraded":"2024-05-09T09:47:52.168475+0000","last_fullsized":"2024-05-09T09:47:52.168475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:03:51.620527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'304","reported_seq":376,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.596879+0000","last_change":"2024-05-09T09:47:18.227175+0000","last_active":"2024-05-09T09:49:31.596879+0000","last_peered":"2024-05-09T09:49:31.596879+0000","last_clean":"2024-05-09T09:49:31.596879+0000","last_became_active":"2024-05-09T09:47:18.226473+0000","last_became_peered":"2024-05-09T09:47:18.226473+0000","last_unstale":"2024-05-09T09:49:31.596879+0000","last_undegraded":"2024-05-09T09:49:31.596879+0000","last_fullsized":"2024-05-09T09:49:31.596879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:06.625814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.414174+0000","last_change":"2024-05-09T09:47:20.228640+0000","last_active":"2024-05-09T09:47:52.414174+0000","last_peered":"2024-05-09T09:47:52.414174+0000","last_clean":"2024-05-09T09:47:52.414174+0000","last_became_active":"2024-05-09T09:47:20.227198+0000","last_became_peered":"2024-05-09T09:47:20.227198+0000","last_unstale":"2024-05-09T09:47:52.414174+0000","last_undegraded":"2024-05-09T09:47:52.414174+0000","last_fullsized":"2024-05-09T09:47:52.414174+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:03:55.645189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.183943+0000","last_change":"2024-05-09T09:47:22.234544+0000","last_active":"2024-05-09T09:47:52.183943+0000","last_peered":"2024-05-09T09:47:52.183943+0000","last_clean":"2024-05-09T09:47:52.183943+0000","last_became_active":"2024-05-09T09:47:22.233279+0000","last_became_peered":"2024-05-09T09:47:22.233279+0000","last_unstale":"2024-05-09T09:47:52.183943+0000","last_undegraded":"2024-05-09T09:47:52.183943+0000","last_fullsized":"2024-05-09T09:47:52.183943+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:49.038963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.183233+0000","last_change":"2024-05-09T09:47:22.237682+0000","last_active":"2024-05-09T09:47:52.183233+0000","last_peered":"2024-05-09T09:47:52.183233+0000","last_clean":"2024-05-09T09:47:52.183233+0000","last_became_active":"2024-05-09T09:47:22.236863+0000","last_became_peered":"2024-05-09T09:47:22.236863+0000","last_unstale":"2024-05-09T09:47:52.183233+0000","last_undegraded":"2024-05-09T09:47:52.183233+0000","last_fullsized":"2024-05-09T09:47:52.183233+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:03:57.659846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.185906+0000","last_change":"2024-05-09T09:47:14.184633+0000","last_active":"2024-05-09T09:49:32.185906+0000","last_peered":"2024-05-09T09:49:32.185906+0000","last_clean":"2024-05-09T09:49:32.185906+0000","last_became_active":"2024-05-09T09:47:14.184250+0000","last_became_peered":"2024-05-09T09:47:14.184250+0000","last_unstale":"2024-05-09T09:49:32.185906+0000","last_undegraded":"2024-05-09T09:49:32.185906+0000","last_fullsized":"2024-05-09T09:49:32.185906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:04:29.322102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.187933+0000","last_change":"2024-05-09T09:47:12.208454+0000","last_active":"2024-05-09T09:47:52.187933+0000","last_peered":"2024-05-09T09:47:52.187933+0000","last_clean":"2024-05-09T09:47:52.187933+0000","last_became_active":"2024-05-09T09:47:12.203479+0000","last_became_peered":"2024-05-09T09:47:12.203479+0000","last_unstale":"2024-05-09T09:47:52.187933+0000","last_undegraded":"2024-05-09T09:47:52.187933+0000","last_fullsized":"2024-05-09T09:47:52.187933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:04:27.302577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.165369+0000","last_change":"2024-05-09T09:47:16.213892+0000","last_active":"2024-05-09T09:47:52.165369+0000","last_peered":"2024-05-09T09:47:52.165369+0000","last_clean":"2024-05-09T09:47:52.165369+0000","last_became_active":"2024-05-09T09:47:16.210992+0000","last_became_peered":"2024-05-09T09:47:16.210992+0000","last_unstale":"2024-05-09T09:47:52.165369+0000","last_undegraded":"2024-05-09T09:47:52.165369+0000","last_fullsized":"2024-05-09T09:47:52.165369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:14.409926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'106","reported_seq":149,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.622322+0000","last_change":"2024-05-09T09:47:18.234751+0000","last_active":"2024-05-09T09:49:31.622322+0000","last_peered":"2024-05-09T09:49:31.622322+0000","last_clean":"2024-05-09T09:49:31.622322+0000","last_became_active":"2024-05-09T09:47:18.234014+0000","last_became_peered":"2024-05-09T09:47:18.234014+0000","last_unstale":"2024-05-09T09:49:31.622322+0000","last_undegraded":"2024-05-09T09:49:31.622322+0000","last_fullsized":"2024-05-09T09:49:31.622322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:19:30.298184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.171859+0000","last_change":"2024-05-09T09:47:20.254957+0000","last_active":"2024-05-09T09:47:52.171859+0000","last_peered":"2024-05-09T09:47:52.171859+0000","last_clean":"2024-05-09T09:47:52.171859+0000","last_became_active":"2024-05-09T09:47:20.254344+0000","last_became_peered":"2024-05-09T09:47:20.254344+0000","last_unstale":"2024-05-09T09:47:52.171859+0000","last_undegraded":"2024-05-09T09:47:52.171859+0000","last_fullsized":"2024-05-09T09:47:52.171859+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:25:58.655419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'5","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.848146+0000","last_change":"2024-05-09T09:47:22.230150+0000","last_active":"2024-05-09T09:50:32.848146+0000","last_peered":"2024-05-09T09:50:32.848146+0000","last_clean":"2024-05-09T09:50:32.848146+0000","last_became_active":"2024-05-09T09:47:22.229088+0000","last_became_peered":"2024-05-09T09:47:22.229088+0000","last_unstale":"2024-05-09T09:50:32.848146+0000","last_undegraded":"2024-05-09T09:50:32.848146+0000","last_fullsized":"2024-05-09T09:50:32.848146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:55:57.267178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'8","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.947282+0000","last_change":"2024-05-09T09:47:14.174619+0000","last_active":"2024-05-09T09:50:32.947282+0000","last_peered":"2024-05-09T09:50:32.947282+0000","last_clean":"2024-05-09T09:50:32.947282+0000","last_became_active":"2024-05-09T09:47:14.173866+0000","last_became_peered":"2024-05-09T09:47:14.173866+0000","last_unstale":"2024-05-09T09:50:32.947282+0000","last_undegraded":"2024-05-09T09:50:32.947282+0000","last_fullsized":"2024-05-09T09:50:32.947282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:58:34.213528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.179002+0000","last_change":"2024-05-09T09:47:12.206131+0000","last_active":"2024-05-09T09:47:52.179002+0000","last_peered":"2024-05-09T09:47:52.179002+0000","last_clean":"2024-05-09T09:47:52.179002+0000","last_became_active":"2024-05-09T09:47:12.205714+0000","last_became_peered":"2024-05-09T09:47:12.205714+0000","last_unstale":"2024-05-09T09:47:52.179002+0000","last_undegraded":"2024-05-09T09:47:52.179002+0000","last_fullsized":"2024-05-09T09:47:52.179002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:46.107016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.190257+0000","last_change":"2024-05-09T09:47:52.188822+0000","last_active":"2024-05-09T09:47:52.190257+0000","last_peered":"2024-05-09T09:47:52.190257+0000","last_clean":"2024-05-09T09:47:52.190257+0000","last_became_active":"2024-05-09T09:47:52.187627+0000","last_became_peered":"2024-05-09T09:47:52.187627+0000","last_unstale":"2024-05-09T09:47:52.190257+0000","last_undegraded":"2024-05-09T09:47:52.190257+0000","last_fullsized":"2024-05-09T09:47:52.190257+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:41:01.595836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'5","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.222011+0000","last_change":"2024-05-09T09:47:18.218595+0000","last_active":"2024-05-09T09:50:32.222011+0000","last_peered":"2024-05-09T09:50:32.222011+0000","last_clean":"2024-05-09T09:50:32.222011+0000","last_became_active":"2024-05-09T09:47:18.217843+0000","last_became_peered":"2024-05-09T09:47:18.217843+0000","last_unstale":"2024-05-09T09:50:32.222011+0000","last_undegraded":"2024-05-09T09:50:32.222011+0000","last_fullsized":"2024-05-09T09:50:32.222011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:49:45.011737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.167605+0000","last_change":"2024-05-09T09:47:20.256418+0000","last_active":"2024-05-09T09:47:52.167605+0000","last_peered":"2024-05-09T09:47:52.167605+0000","last_clean":"2024-05-09T09:47:52.167605+0000","last_became_active":"2024-05-09T09:47:20.255449+0000","last_became_peered":"2024-05-09T09:47:20.255449+0000","last_unstale":"2024-05-09T09:47:52.167605+0000","last_undegraded":"2024-05-09T09:47:52.167605+0000","last_fullsized":"2024-05-09T09:47:52.167605+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:30:19.195448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.408435+0000","last_change":"2024-05-09T09:47:22.239979+0000","last_active":"2024-05-09T09:50:33.408435+0000","last_peered":"2024-05-09T09:50:33.408435+0000","last_clean":"2024-05-09T09:50:33.408435+0000","last_became_active":"2024-05-09T09:47:22.239113+0000","last_became_peered":"2024-05-09T09:47:22.239113+0000","last_unstale":"2024-05-09T09:50:33.408435+0000","last_undegraded":"2024-05-09T09:50:33.408435+0000","last_fullsized":"2024-05-09T09:50:33.408435+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:34:01.631008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.238187+0000","last_change":"2024-05-09T09:47:14.174348+0000","last_active":"2024-05-09T09:50:33.238187+0000","last_peered":"2024-05-09T09:50:33.238187+0000","last_clean":"2024-05-09T09:50:33.238187+0000","last_became_active":"2024-05-09T09:47:14.173338+0000","last_became_peered":"2024-05-09T09:47:14.173338+0000","last_unstale":"2024-05-09T09:50:33.238187+0000","last_undegraded":"2024-05-09T09:50:33.238187+0000","last_fullsized":"2024-05-09T09:50:33.238187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:58:34.213528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:01.777271+0000","last_change":"2024-05-09T09:47:12.209971+0000","last_active":"2024-05-09T09:48:01.777271+0000","last_peered":"2024-05-09T09:48:01.777271+0000","last_clean":"2024-05-09T09:48:01.777271+0000","last_became_active":"2024-05-09T09:47:12.205864+0000","last_became_peered":"2024-05-09T09:47:12.205864+0000","last_unstale":"2024-05-09T09:48:01.777271+0000","last_undegraded":"2024-05-09T09:48:01.777271+0000","last_fullsized":"2024-05-09T09:48:01.777271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:00:05.597093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.169350+0000","last_change":"2024-05-09T09:47:16.215336+0000","last_active":"2024-05-09T09:47:52.169350+0000","last_peered":"2024-05-09T09:47:52.169350+0000","last_clean":"2024-05-09T09:47:52.169350+0000","last_became_active":"2024-05-09T09:47:16.214780+0000","last_became_peered":"2024-05-09T09:47:16.214780+0000","last_unstale":"2024-05-09T09:47:52.169350+0000","last_undegraded":"2024-05-09T09:47:52.169350+0000","last_fullsized":"2024-05-09T09:47:52.169350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:34:04.877319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'114","reported_seq":173,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.309322+0000","last_change":"2024-05-09T09:47:18.202153+0000","last_active":"2024-05-09T09:50:32.309322+0000","last_peered":"2024-05-09T09:50:32.309322+0000","last_clean":"2024-05-09T09:50:32.309322+0000","last_became_active":"2024-05-09T09:47:18.201443+0000","last_became_peered":"2024-05-09T09:47:18.201443+0000","last_unstale":"2024-05-09T09:50:32.309322+0000","last_undegraded":"2024-05-09T09:50:32.309322+0000","last_fullsized":"2024-05-09T09:50:32.309322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:00:18.197658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.164719+0000","last_change":"2024-05-09T09:47:20.226073+0000","last_active":"2024-05-09T09:47:52.164719+0000","last_peered":"2024-05-09T09:47:52.164719+0000","last_clean":"2024-05-09T09:47:52.164719+0000","last_became_active":"2024-05-09T09:47:20.225261+0000","last_became_peered":"2024-05-09T09:47:20.225261+0000","last_unstale":"2024-05-09T09:47:52.164719+0000","last_undegraded":"2024-05-09T09:47:52.164719+0000","last_fullsized":"2024-05-09T09:47:52.164719+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:47.024306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.185689+0000","last_change":"2024-05-09T09:47:22.253748+0000","last_active":"2024-05-09T09:47:52.185689+0000","last_peered":"2024-05-09T09:47:52.185689+0000","last_clean":"2024-05-09T09:47:52.185689+0000","last_became_active":"2024-05-09T09:47:22.252940+0000","last_became_peered":"2024-05-09T09:47:22.252940+0000","last_unstale":"2024-05-09T09:47:52.185689+0000","last_undegraded":"2024-05-09T09:47:52.185689+0000","last_fullsized":"2024-05-09T09:47:52.185689+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:28:23.186925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.304067+0000","last_change":"2024-05-09T09:47:14.183909+0000","last_active":"2024-05-09T09:50:33.304067+0000","last_peered":"2024-05-09T09:50:33.304067+0000","last_clean":"2024-05-09T09:50:33.304067+0000","last_became_active":"2024-05-09T09:47:14.183622+0000","last_became_peered":"2024-05-09T09:47:14.183622+0000","last_unstale":"2024-05-09T09:50:33.304067+0000","last_undegraded":"2024-05-09T09:50:33.304067+0000","last_fullsized":"2024-05-09T09:50:33.304067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:36:53.103953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.178343+0000","last_change":"2024-05-09T09:47:12.196263+0000","last_active":"2024-05-09T09:47:52.178343+0000","last_peered":"2024-05-09T09:47:52.178343+0000","last_clean":"2024-05-09T09:47:52.178343+0000","last_became_active":"2024-05-09T09:47:12.195857+0000","last_became_peered":"2024-05-09T09:47:12.195857+0000","last_unstale":"2024-05-09T09:47:52.178343+0000","last_undegraded":"2024-05-09T09:47:52.178343+0000","last_fullsized":"2024-05-09T09:47:52.178343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:55.107119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.173473+0000","last_change":"2024-05-09T09:47:16.199413+0000","last_active":"2024-05-09T09:47:52.173473+0000","last_peered":"2024-05-09T09:47:52.173473+0000","last_clean":"2024-05-09T09:47:52.173473+0000","last_became_active":"2024-05-09T09:47:16.198551+0000","last_became_peered":"2024-05-09T09:47:16.198551+0000","last_unstale":"2024-05-09T09:47:52.173473+0000","last_undegraded":"2024-05-09T09:47:52.173473+0000","last_fullsized":"2024-05-09T09:47:52.173473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:42.999644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'104","reported_seq":146,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.593523+0000","last_change":"2024-05-09T09:47:18.217890+0000","last_active":"2024-05-09T09:49:31.593523+0000","last_peered":"2024-05-09T09:49:31.593523+0000","last_clean":"2024-05-09T09:49:31.593523+0000","last_became_active":"2024-05-09T09:47:18.217163+0000","last_became_peered":"2024-05-09T09:47:18.217163+0000","last_unstale":"2024-05-09T09:49:31.593523+0000","last_undegraded":"2024-05-09T09:49:31.593523+0000","last_fullsized":"2024-05-09T09:49:31.593523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:13:11.800319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.170698+0000","last_change":"2024-05-09T09:47:20.239189+0000","last_active":"2024-05-09T09:47:52.170698+0000","last_peered":"2024-05-09T09:47:52.170698+0000","last_clean":"2024-05-09T09:47:52.170698+0000","last_became_active":"2024-05-09T09:47:20.238369+0000","last_became_peered":"2024-05-09T09:47:20.238369+0000","last_unstale":"2024-05-09T09:47:52.170698+0000","last_undegraded":"2024-05-09T09:47:52.170698+0000","last_fullsized":"2024-05-09T09:47:52.170698+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:00:20.209785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'9","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.170964+0000","last_change":"2024-05-09T09:47:14.188262+0000","last_active":"2024-05-09T09:50:33.170964+0000","last_peered":"2024-05-09T09:50:33.170964+0000","last_clean":"2024-05-09T09:50:33.170964+0000","last_became_active":"2024-05-09T09:47:14.187868+0000","last_became_peered":"2024-05-09T09:47:14.187868+0000","last_unstale":"2024-05-09T09:50:33.170964+0000","last_undegraded":"2024-05-09T09:50:33.170964+0000","last_fullsized":"2024-05-09T09:50:33.170964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:00:14.171935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.169058+0000","last_change":"2024-05-09T09:47:12.208626+0000","last_active":"2024-05-09T09:47:52.169058+0000","last_peered":"2024-05-09T09:47:52.169058+0000","last_clean":"2024-05-09T09:47:52.169058+0000","last_became_active":"2024-05-09T09:47:12.208209+0000","last_became_peered":"2024-05-09T09:47:12.208209+0000","last_unstale":"2024-05-09T09:47:52.169058+0000","last_undegraded":"2024-05-09T09:47:52.169058+0000","last_fullsized":"2024-05-09T09:47:52.169058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:02:05.524130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.426897+0000","last_change":"2024-05-09T09:47:16.183573+0000","last_active":"2024-05-09T09:47:52.426897+0000","last_peered":"2024-05-09T09:47:52.426897+0000","last_clean":"2024-05-09T09:47:52.426897+0000","last_became_active":"2024-05-09T09:47:16.182766+0000","last_became_peered":"2024-05-09T09:47:16.182766+0000","last_unstale":"2024-05-09T09:47:52.426897+0000","last_undegraded":"2024-05-09T09:47:52.426897+0000","last_fullsized":"2024-05-09T09:47:52.426897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:03:52.038829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'202","reported_seq":258,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.634202+0000","last_change":"2024-05-09T09:47:18.225686+0000","last_active":"2024-05-09T09:49:31.634202+0000","last_peered":"2024-05-09T09:49:31.634202+0000","last_clean":"2024-05-09T09:49:31.634202+0000","last_became_active":"2024-05-09T09:47:18.225074+0000","last_became_peered":"2024-05-09T09:47:18.225074+0000","last_unstale":"2024-05-09T09:49:31.634202+0000","last_undegraded":"2024-05-09T09:49:31.634202+0000","last_fullsized":"2024-05-09T09:49:31.634202+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:25.412871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.178320+0000","last_change":"2024-05-09T09:47:20.242032+0000","last_active":"2024-05-09T09:47:52.178320+0000","last_peered":"2024-05-09T09:47:52.178320+0000","last_clean":"2024-05-09T09:47:52.178320+0000","last_became_active":"2024-05-09T09:47:20.241372+0000","last_became_peered":"2024-05-09T09:47:20.241372+0000","last_unstale":"2024-05-09T09:47:52.178320+0000","last_undegraded":"2024-05-09T09:47:52.178320+0000","last_fullsized":"2024-05-09T09:47:52.178320+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:27.424998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.026339+0000","last_change":"2024-05-09T09:47:22.260464+0000","last_active":"2024-05-09T09:49:32.026339+0000","last_peered":"2024-05-09T09:49:32.026339+0000","last_clean":"2024-05-09T09:49:32.026339+0000","last_became_active":"2024-05-09T09:47:22.259589+0000","last_became_peered":"2024-05-09T09:47:22.259589+0000","last_unstale":"2024-05-09T09:49:32.026339+0000","last_undegraded":"2024-05-09T09:49:32.026339+0000","last_fullsized":"2024-05-09T09:49:32.026339+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:06:02.910819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:26.976242+0000","last_change":"2024-05-09T09:47:14.176405+0000","last_active":"2024-05-09T09:49:26.976242+0000","last_peered":"2024-05-09T09:49:26.976242+0000","last_clean":"2024-05-09T09:49:26.976242+0000","last_became_active":"2024-05-09T09:47:14.174371+0000","last_became_peered":"2024-05-09T09:47:14.174371+0000","last_unstale":"2024-05-09T09:49:26.976242+0000","last_undegraded":"2024-05-09T09:49:26.976242+0000","last_fullsized":"2024-05-09T09:49:26.976242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:34:58.223894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.163547+0000","last_change":"2024-05-09T09:47:12.198158+0000","last_active":"2024-05-09T09:47:52.163547+0000","last_peered":"2024-05-09T09:47:52.163547+0000","last_clean":"2024-05-09T09:47:52.163547+0000","last_became_active":"2024-05-09T09:47:12.196881+0000","last_became_peered":"2024-05-09T09:47:12.196881+0000","last_unstale":"2024-05-09T09:47:52.163547+0000","last_undegraded":"2024-05-09T09:47:52.163547+0000","last_fullsized":"2024-05-09T09:47:52.163547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:22:46.247782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.187470+0000","last_change":"2024-05-09T09:47:16.189376+0000","last_active":"2024-05-09T09:47:52.187470+0000","last_peered":"2024-05-09T09:47:52.187470+0000","last_clean":"2024-05-09T09:47:52.187470+0000","last_became_active":"2024-05-09T09:47:16.188611+0000","last_became_peered":"2024-05-09T09:47:16.188611+0000","last_unstale":"2024-05-09T09:47:52.187470+0000","last_undegraded":"2024-05-09T09:47:52.187470+0000","last_fullsized":"2024-05-09T09:47:52.187470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:10:07.313658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'110","reported_seq":155,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.595370+0000","last_change":"2024-05-09T09:47:18.233602+0000","last_active":"2024-05-09T09:49:31.595370+0000","last_peered":"2024-05-09T09:49:31.595370+0000","last_clean":"2024-05-09T09:49:31.595370+0000","last_became_active":"2024-05-09T09:47:18.232435+0000","last_became_peered":"2024-05-09T09:47:18.232435+0000","last_unstale":"2024-05-09T09:49:31.595370+0000","last_undegraded":"2024-05-09T09:49:31.595370+0000","last_fullsized":"2024-05-09T09:49:31.595370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:33:57.604224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.171851+0000","last_change":"2024-05-09T09:47:20.243779+0000","last_active":"2024-05-09T09:47:52.171851+0000","last_peered":"2024-05-09T09:47:52.171851+0000","last_clean":"2024-05-09T09:47:52.171851+0000","last_became_active":"2024-05-09T09:47:20.241935+0000","last_became_peered":"2024-05-09T09:47:20.241935+0000","last_unstale":"2024-05-09T09:47:52.171851+0000","last_undegraded":"2024-05-09T09:47:52.171851+0000","last_fullsized":"2024-05-09T09:47:52.171851+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:36.440080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.172300+0000","last_change":"2024-05-09T09:47:22.241900+0000","last_active":"2024-05-09T09:47:52.172300+0000","last_peered":"2024-05-09T09:47:52.172300+0000","last_clean":"2024-05-09T09:47:52.172300+0000","last_became_active":"2024-05-09T09:47:22.241067+0000","last_became_peered":"2024-05-09T09:47:22.241067+0000","last_unstale":"2024-05-09T09:47:52.172300+0000","last_undegraded":"2024-05-09T09:47:52.172300+0000","last_fullsized":"2024-05-09T09:47:52.172300+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:40:12.648847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.946574+0000","last_change":"2024-05-09T09:47:14.192314+0000","last_active":"2024-05-09T09:50:32.946574+0000","last_peered":"2024-05-09T09:50:32.946574+0000","last_clean":"2024-05-09T09:50:32.946574+0000","last_became_active":"2024-05-09T09:47:14.191459+0000","last_became_peered":"2024-05-09T09:47:14.191459+0000","last_unstale":"2024-05-09T09:50:32.946574+0000","last_undegraded":"2024-05-09T09:50:32.946574+0000","last_fullsized":"2024-05-09T09:50:32.946574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:36:19.920255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'1","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.179680+0000","last_change":"2024-05-09T09:47:12.193005+0000","last_active":"2024-05-09T09:49:45.179680+0000","last_peered":"2024-05-09T09:49:45.179680+0000","last_clean":"2024-05-09T09:49:45.179680+0000","last_became_active":"2024-05-09T09:47:12.191204+0000","last_became_peered":"2024-05-09T09:47:12.191204+0000","last_unstale":"2024-05-09T09:49:45.179680+0000","last_undegraded":"2024-05-09T09:49:45.179680+0000","last_fullsized":"2024-05-09T09:49:45.179680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:15:07.437414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.181698+0000","last_change":"2024-05-09T09:47:16.195416+0000","last_active":"2024-05-09T09:47:52.181698+0000","last_peered":"2024-05-09T09:47:52.181698+0000","last_clean":"2024-05-09T09:47:52.181698+0000","last_became_active":"2024-05-09T09:47:16.194314+0000","last_became_peered":"2024-05-09T09:47:16.194314+0000","last_unstale":"2024-05-09T09:47:52.181698+0000","last_undegraded":"2024-05-09T09:47:52.181698+0000","last_fullsized":"2024-05-09T09:47:52.181698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:44:05.776640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'106","reported_seq":149,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.357154+0000","last_change":"2024-05-09T09:47:18.209870+0000","last_active":"2024-05-09T09:49:31.357154+0000","last_peered":"2024-05-09T09:49:31.357154+0000","last_clean":"2024-05-09T09:49:31.357154+0000","last_became_active":"2024-05-09T09:47:18.209099+0000","last_became_peered":"2024-05-09T09:47:18.209099+0000","last_unstale":"2024-05-09T09:49:31.357154+0000","last_undegraded":"2024-05-09T09:49:31.357154+0000","last_fullsized":"2024-05-09T09:49:31.357154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:07.800202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.423415+0000","last_change":"2024-05-09T09:47:20.242600+0000","last_active":"2024-05-09T09:47:52.423415+0000","last_peered":"2024-05-09T09:47:52.423415+0000","last_clean":"2024-05-09T09:47:52.423415+0000","last_became_active":"2024-05-09T09:47:20.241900+0000","last_became_peered":"2024-05-09T09:47:20.241900+0000","last_unstale":"2024-05-09T09:47:52.423415+0000","last_undegraded":"2024-05-09T09:47:52.423415+0000","last_fullsized":"2024-05-09T09:47:52.423415+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:32.134753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'5","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.173022+0000","last_change":"2024-05-09T09:47:22.264988+0000","last_active":"2024-05-09T09:49:32.173022+0000","last_peered":"2024-05-09T09:49:32.173022+0000","last_clean":"2024-05-09T09:49:32.173022+0000","last_became_active":"2024-05-09T09:47:22.263730+0000","last_became_peered":"2024-05-09T09:47:22.263730+0000","last_unstale":"2024-05-09T09:49:32.173022+0000","last_undegraded":"2024-05-09T09:49:32.173022+0000","last_fullsized":"2024-05-09T09:49:32.173022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:54.092435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.184984+0000","last_change":"2024-05-09T09:47:14.191093+0000","last_active":"2024-05-09T09:49:32.184984+0000","last_peered":"2024-05-09T09:49:32.184984+0000","last_clean":"2024-05-09T09:49:32.184984+0000","last_became_active":"2024-05-09T09:47:14.189561+0000","last_became_peered":"2024-05-09T09:47:14.189561+0000","last_unstale":"2024-05-09T09:49:32.184984+0000","last_undegraded":"2024-05-09T09:49:32.184984+0000","last_fullsized":"2024-05-09T09:49:32.184984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:20:55.312241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.185025+0000","last_change":"2024-05-09T09:47:12.215264+0000","last_active":"2024-05-09T09:47:52.185025+0000","last_peered":"2024-05-09T09:47:52.185025+0000","last_clean":"2024-05-09T09:47:52.185025+0000","last_became_active":"2024-05-09T09:47:12.214816+0000","last_became_peered":"2024-05-09T09:47:12.214816+0000","last_unstale":"2024-05-09T09:47:52.185025+0000","last_undegraded":"2024-05-09T09:47:52.185025+0000","last_fullsized":"2024-05-09T09:47:52.185025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:57:22.903663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.172570+0000","last_change":"2024-05-09T09:47:16.211405+0000","last_active":"2024-05-09T09:47:52.172570+0000","last_peered":"2024-05-09T09:47:52.172570+0000","last_clean":"2024-05-09T09:47:52.172570+0000","last_became_active":"2024-05-09T09:47:16.210567+0000","last_became_peered":"2024-05-09T09:47:16.210567+0000","last_unstale":"2024-05-09T09:47:52.172570+0000","last_undegraded":"2024-05-09T09:47:52.172570+0000","last_fullsized":"2024-05-09T09:47:52.172570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:51:59.224530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.195660+0000","last_change":"2024-05-09T09:47:18.235102+0000","last_active":"2024-05-09T09:47:52.195660+0000","last_peered":"2024-05-09T09:47:52.195660+0000","last_clean":"2024-05-09T09:47:52.195660+0000","last_became_active":"2024-05-09T09:47:18.234113+0000","last_became_peered":"2024-05-09T09:47:18.234113+0000","last_unstale":"2024-05-09T09:47:52.195660+0000","last_undegraded":"2024-05-09T09:47:52.195660+0000","last_fullsized":"2024-05-09T09:47:52.195660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:15.072698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'282","reported_seq":368,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:31.469155+0000","last_change":"2024-05-09T09:47:20.255098+0000","last_active":"2024-05-09T09:50:31.469155+0000","last_peered":"2024-05-09T09:50:31.469155+0000","last_clean":"2024-05-09T09:50:31.469155+0000","last_became_active":"2024-05-09T09:47:20.254573+0000","last_became_peered":"2024-05-09T09:47:20.254573+0000","last_unstale":"2024-05-09T09:50:31.469155+0000","last_undegraded":"2024-05-09T09:50:31.469155+0000","last_fullsized":"2024-05-09T09:50:31.469155+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:12.864272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.242341+0000","last_change":"2024-05-09T09:47:22.244085+0000","last_active":"2024-05-09T09:50:33.242341+0000","last_peered":"2024-05-09T09:50:33.242341+0000","last_clean":"2024-05-09T09:50:33.242341+0000","last_became_active":"2024-05-09T09:47:22.243234+0000","last_became_peered":"2024-05-09T09:47:22.243234+0000","last_unstale":"2024-05-09T09:50:33.242341+0000","last_undegraded":"2024-05-09T09:50:33.242341+0000","last_fullsized":"2024-05-09T09:50:33.242341+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:49:43.534043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.176046+0000","last_change":"2024-05-09T09:47:14.188552+0000","last_active":"2024-05-09T09:49:45.176046+0000","last_peered":"2024-05-09T09:49:45.176046+0000","last_clean":"2024-05-09T09:49:45.176046+0000","last_became_active":"2024-05-09T09:47:14.188222+0000","last_became_peered":"2024-05-09T09:47:14.188222+0000","last_unstale":"2024-05-09T09:49:45.176046+0000","last_undegraded":"2024-05-09T09:49:45.176046+0000","last_fullsized":"2024-05-09T09:49:45.176046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:08:36.171869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'1","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.179795+0000","last_change":"2024-05-09T09:47:12.196894+0000","last_active":"2024-05-09T09:49:45.179795+0000","last_peered":"2024-05-09T09:49:45.179795+0000","last_clean":"2024-05-09T09:49:45.179795+0000","last_became_active":"2024-05-09T09:47:12.195936+0000","last_became_peered":"2024-05-09T09:47:12.195936+0000","last_unstale":"2024-05-09T09:49:45.179795+0000","last_undegraded":"2024-05-09T09:49:45.179795+0000","last_fullsized":"2024-05-09T09:49:45.179795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:46.107016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.165234+0000","last_change":"2024-05-09T09:47:16.211838+0000","last_active":"2024-05-09T09:47:52.165234+0000","last_peered":"2024-05-09T09:47:52.165234+0000","last_clean":"2024-05-09T09:47:52.165234+0000","last_became_active":"2024-05-09T09:47:16.210901+0000","last_became_peered":"2024-05-09T09:47:16.210901+0000","last_unstale":"2024-05-09T09:47:52.165234+0000","last_undegraded":"2024-05-09T09:47:52.165234+0000","last_fullsized":"2024-05-09T09:47:52.165234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:36:55.117142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'111","reported_seq":156,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.576707+0000","last_change":"2024-05-09T09:47:18.202901+0000","last_active":"2024-05-09T09:49:31.576707+0000","last_peered":"2024-05-09T09:49:31.576707+0000","last_clean":"2024-05-09T09:49:31.576707+0000","last_became_active":"2024-05-09T09:47:18.202069+0000","last_became_peered":"2024-05-09T09:47:18.202069+0000","last_unstale":"2024-05-09T09:49:31.576707+0000","last_undegraded":"2024-05-09T09:49:31.576707+0000","last_fullsized":"2024-05-09T09:49:31.576707+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:10.852145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.414336+0000","last_change":"2024-05-09T09:47:20.251107+0000","last_active":"2024-05-09T09:47:52.414336+0000","last_peered":"2024-05-09T09:47:52.414336+0000","last_clean":"2024-05-09T09:47:52.414336+0000","last_became_active":"2024-05-09T09:47:20.250194+0000","last_became_peered":"2024-05-09T09:47:20.250194+0000","last_unstale":"2024-05-09T09:47:52.414336+0000","last_undegraded":"2024-05-09T09:47:52.414336+0000","last_fullsized":"2024-05-09T09:47:52.414336+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:47.024306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.214257+0000","last_change":"2024-05-09T09:47:22.240288+0000","last_active":"2024-05-09T09:50:33.214257+0000","last_peered":"2024-05-09T09:50:33.214257+0000","last_clean":"2024-05-09T09:50:33.214257+0000","last_became_active":"2024-05-09T09:47:22.239300+0000","last_became_peered":"2024-05-09T09:47:22.239300+0000","last_unstale":"2024-05-09T09:50:33.214257+0000","last_undegraded":"2024-05-09T09:50:33.214257+0000","last_fullsized":"2024-05-09T09:50:33.214257+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:29:01.635074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'10","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.801428+0000","last_change":"2024-05-09T09:47:14.188510+0000","last_active":"2024-05-09T09:50:32.801428+0000","last_peered":"2024-05-09T09:50:32.801428+0000","last_clean":"2024-05-09T09:50:32.801428+0000","last_became_active":"2024-05-09T09:47:14.187951+0000","last_became_peered":"2024-05-09T09:47:14.187951+0000","last_unstale":"2024-05-09T09:50:32.801428+0000","last_undegraded":"2024-05-09T09:50:32.801428+0000","last_fullsized":"2024-05-09T09:50:32.801428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:08:19.732944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.192638+0000","last_change":"2024-05-09T09:47:12.208585+0000","last_active":"2024-05-09T09:47:52.192638+0000","last_peered":"2024-05-09T09:47:52.192638+0000","last_clean":"2024-05-09T09:47:52.192638+0000","last_became_active":"2024-05-09T09:47:12.203827+0000","last_became_peered":"2024-05-09T09:47:12.203827+0000","last_unstale":"2024-05-09T09:47:52.192638+0000","last_undegraded":"2024-05-09T09:47:52.192638+0000","last_fullsized":"2024-05-09T09:47:52.192638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:13.077999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.181294+0000","last_change":"2024-05-09T09:47:16.197042+0000","last_active":"2024-05-09T09:47:52.181294+0000","last_peered":"2024-05-09T09:47:52.181294+0000","last_clean":"2024-05-09T09:47:52.181294+0000","last_became_active":"2024-05-09T09:47:16.196193+0000","last_became_peered":"2024-05-09T09:47:16.196193+0000","last_unstale":"2024-05-09T09:47:52.181294+0000","last_undegraded":"2024-05-09T09:47:52.181294+0000","last_fullsized":"2024-05-09T09:47:52.181294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:29:55.560893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'107","reported_seq":149,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.168277+0000","last_change":"2024-05-09T09:47:18.200484+0000","last_active":"2024-05-09T09:49:45.168277+0000","last_peered":"2024-05-09T09:49:45.168277+0000","last_clean":"2024-05-09T09:49:45.168277+0000","last_became_active":"2024-05-09T09:47:18.199627+0000","last_became_peered":"2024-05-09T09:47:18.199627+0000","last_unstale":"2024-05-09T09:49:45.168277+0000","last_undegraded":"2024-05-09T09:49:45.168277+0000","last_fullsized":"2024-05-09T09:49:45.168277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:13:28.480078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.172680+0000","last_change":"2024-05-09T09:47:20.252618+0000","last_active":"2024-05-09T09:47:52.172680+0000","last_peered":"2024-05-09T09:47:52.172680+0000","last_clean":"2024-05-09T09:47:52.172680+0000","last_became_active":"2024-05-09T09:47:20.251642+0000","last_became_peered":"2024-05-09T09:47:20.251642+0000","last_unstale":"2024-05-09T09:47:52.172680+0000","last_undegraded":"2024-05-09T09:47:52.172680+0000","last_fullsized":"2024-05-09T09:47:52.172680+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:02:59.842523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.196751+0000","last_change":"2024-05-09T09:47:22.261644+0000","last_active":"2024-05-09T09:47:52.196751+0000","last_peered":"2024-05-09T09:47:52.196751+0000","last_clean":"2024-05-09T09:47:52.196751+0000","last_became_active":"2024-05-09T09:47:22.261164+0000","last_became_peered":"2024-05-09T09:47:22.261164+0000","last_unstale":"2024-05-09T09:47:52.196751+0000","last_undegraded":"2024-05-09T09:47:52.196751+0000","last_fullsized":"2024-05-09T09:47:52.196751+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:08:50.446437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'8","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.150516+0000","last_change":"2024-05-09T09:47:14.185649+0000","last_active":"2024-05-09T09:50:33.150516+0000","last_peered":"2024-05-09T09:50:33.150516+0000","last_clean":"2024-05-09T09:50:33.150516+0000","last_became_active":"2024-05-09T09:47:14.185270+0000","last_became_peered":"2024-05-09T09:47:14.185270+0000","last_unstale":"2024-05-09T09:50:33.150516+0000","last_undegraded":"2024-05-09T09:50:33.150516+0000","last_fullsized":"2024-05-09T09:50:33.150516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:51:57.211341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.420634+0000","last_change":"2024-05-09T09:47:12.185589+0000","last_active":"2024-05-09T09:47:52.420634+0000","last_peered":"2024-05-09T09:47:52.420634+0000","last_clean":"2024-05-09T09:47:52.420634+0000","last_became_active":"2024-05-09T09:47:12.183985+0000","last_became_peered":"2024-05-09T09:47:12.183985+0000","last_unstale":"2024-05-09T09:47:52.420634+0000","last_undegraded":"2024-05-09T09:47:52.420634+0000","last_fullsized":"2024-05-09T09:47:52.420634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:02:04.919917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.163105+0000","last_change":"2024-05-09T09:47:16.210385+0000","last_active":"2024-05-09T09:47:52.163105+0000","last_peered":"2024-05-09T09:47:52.163105+0000","last_clean":"2024-05-09T09:47:52.163105+0000","last_became_active":"2024-05-09T09:47:16.207467+0000","last_became_peered":"2024-05-09T09:47:16.207467+0000","last_unstale":"2024-05-09T09:47:52.163105+0000","last_undegraded":"2024-05-09T09:47:52.163105+0000","last_fullsized":"2024-05-09T09:47:52.163105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:29.369869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'101","reported_seq":141,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.625669+0000","last_change":"2024-05-09T09:47:18.236481+0000","last_active":"2024-05-09T09:49:31.625669+0000","last_peered":"2024-05-09T09:49:31.625669+0000","last_clean":"2024-05-09T09:49:31.625669+0000","last_became_active":"2024-05-09T09:47:18.235557+0000","last_became_peered":"2024-05-09T09:47:18.235557+0000","last_unstale":"2024-05-09T09:49:31.625669+0000","last_undegraded":"2024-05-09T09:49:31.625669+0000","last_fullsized":"2024-05-09T09:49:31.625669+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:48:17.305432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.172984+0000","last_change":"2024-05-09T09:47:20.235738+0000","last_active":"2024-05-09T09:47:52.172984+0000","last_peered":"2024-05-09T09:47:52.172984+0000","last_clean":"2024-05-09T09:47:52.172984+0000","last_became_active":"2024-05-09T09:47:20.231750+0000","last_became_peered":"2024-05-09T09:47:20.231750+0000","last_unstale":"2024-05-09T09:47:52.172984+0000","last_undegraded":"2024-05-09T09:47:52.172984+0000","last_fullsized":"2024-05-09T09:47:52.172984+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:45:32.951562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'8","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:29.505808+0000","last_change":"2024-05-09T09:47:22.256916+0000","last_active":"2024-05-09T09:49:29.505808+0000","last_peered":"2024-05-09T09:49:29.505808+0000","last_clean":"2024-05-09T09:49:29.505808+0000","last_became_active":"2024-05-09T09:47:22.256398+0000","last_became_peered":"2024-05-09T09:47:22.256398+0000","last_unstale":"2024-05-09T09:49:29.505808+0000","last_undegraded":"2024-05-09T09:49:29.505808+0000","last_fullsized":"2024-05-09T09:49:29.505808+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:05:30.419464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'22","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.944688+0000","last_change":"2024-05-09T09:47:14.189375+0000","last_active":"2024-05-09T09:50:32.944688+0000","last_peered":"2024-05-09T09:50:32.944688+0000","last_clean":"2024-05-09T09:50:32.944688+0000","last_became_active":"2024-05-09T09:47:14.188980+0000","last_became_peered":"2024-05-09T09:47:14.188980+0000","last_unstale":"2024-05-09T09:50:32.944688+0000","last_undegraded":"2024-05-09T09:50:32.944688+0000","last_fullsized":"2024-05-09T09:50:32.944688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:57:24.923188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:59.961336+0000","last_change":"2024-05-09T09:47:12.213326+0000","last_active":"2024-05-09T09:47:59.961336+0000","last_peered":"2024-05-09T09:47:59.961336+0000","last_clean":"2024-05-09T09:47:59.961336+0000","last_became_active":"2024-05-09T09:47:12.206136+0000","last_became_peered":"2024-05-09T09:47:12.206136+0000","last_unstale":"2024-05-09T09:47:59.961336+0000","last_undegraded":"2024-05-09T09:47:59.961336+0000","last_fullsized":"2024-05-09T09:47:59.961336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:01:14.038658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:27.582188+0000","last_change":"2024-05-09T09:47:16.211554+0000","last_active":"2024-05-09T09:49:27.582188+0000","last_peered":"2024-05-09T09:49:27.582188+0000","last_clean":"2024-05-09T09:49:27.582188+0000","last_became_active":"2024-05-09T09:47:16.210958+0000","last_became_peered":"2024-05-09T09:47:16.210958+0000","last_unstale":"2024-05-09T09:49:27.582188+0000","last_undegraded":"2024-05-09T09:49:27.582188+0000","last_fullsized":"2024-05-09T09:49:27.582188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:03:52.038829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'107","reported_seq":151,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.255367+0000","last_change":"2024-05-09T09:47:18.234795+0000","last_active":"2024-05-09T09:50:32.255367+0000","last_peered":"2024-05-09T09:50:32.255367+0000","last_clean":"2024-05-09T09:50:32.255367+0000","last_became_active":"2024-05-09T09:47:18.233552+0000","last_became_peered":"2024-05-09T09:47:18.233552+0000","last_unstale":"2024-05-09T09:50:32.255367+0000","last_undegraded":"2024-05-09T09:50:32.255367+0000","last_fullsized":"2024-05-09T09:50:32.255367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:22.991357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.426101+0000","last_change":"2024-05-09T09:47:20.254870+0000","last_active":"2024-05-09T09:47:52.426101+0000","last_peered":"2024-05-09T09:47:52.426101+0000","last_clean":"2024-05-09T09:47:52.426101+0000","last_became_active":"2024-05-09T09:47:20.254083+0000","last_became_peered":"2024-05-09T09:47:20.254083+0000","last_unstale":"2024-05-09T09:47:52.426101+0000","last_undegraded":"2024-05-09T09:47:52.426101+0000","last_fullsized":"2024-05-09T09:47:52.426101+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:51:10.268994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:29.509881+0000","last_change":"2024-05-09T09:47:22.255091+0000","last_active":"2024-05-09T09:49:29.509881+0000","last_peered":"2024-05-09T09:49:29.509881+0000","last_clean":"2024-05-09T09:49:29.509881+0000","last_became_active":"2024-05-09T09:47:22.254386+0000","last_became_peered":"2024-05-09T09:47:22.254386+0000","last_unstale":"2024-05-09T09:49:29.509881+0000","last_undegraded":"2024-05-09T09:49:29.509881+0000","last_fullsized":"2024-05-09T09:49:29.509881+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:55:00.879568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'13","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.322669+0000","last_change":"2024-05-09T09:47:14.178682+0000","last_active":"2024-05-09T09:50:33.322669+0000","last_peered":"2024-05-09T09:50:33.322669+0000","last_clean":"2024-05-09T09:50:33.322669+0000","last_became_active":"2024-05-09T09:47:14.174998+0000","last_became_peered":"2024-05-09T09:47:14.174998+0000","last_unstale":"2024-05-09T09:50:33.322669+0000","last_undegraded":"2024-05-09T09:50:33.322669+0000","last_fullsized":"2024-05-09T09:50:33.322669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:39.521528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.167783+0000","last_change":"2024-05-09T09:47:12.192847+0000","last_active":"2024-05-09T09:47:52.167783+0000","last_peered":"2024-05-09T09:47:52.167783+0000","last_clean":"2024-05-09T09:47:52.167783+0000","last_became_active":"2024-05-09T09:47:12.192448+0000","last_became_peered":"2024-05-09T09:47:12.192448+0000","last_unstale":"2024-05-09T09:47:52.167783+0000","last_undegraded":"2024-05-09T09:47:52.167783+0000","last_fullsized":"2024-05-09T09:47:52.167783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:43:04.277278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'12","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:45.864525+0000","last_change":"2024-05-09T09:47:14.189285+0000","last_active":"2024-05-09T09:48:45.864525+0000","last_peered":"2024-05-09T09:48:45.864525+0000","last_clean":"2024-05-09T09:48:45.864525+0000","last_became_active":"2024-05-09T09:47:14.188534+0000","last_became_peered":"2024-05-09T09:47:14.188534+0000","last_unstale":"2024-05-09T09:48:45.864525+0000","last_undegraded":"2024-05-09T09:48:45.864525+0000","last_fullsized":"2024-05-09T09:48:45.864525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:15.097524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":54,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.120523+0000","last_change":"2024-05-09T09:47:12.185694+0000","last_active":"2024-05-09T09:50:33.120523+0000","last_peered":"2024-05-09T09:50:33.120523+0000","last_clean":"2024-05-09T09:50:33.120523+0000","last_became_active":"2024-05-09T09:47:12.184353+0000","last_became_peered":"2024-05-09T09:47:12.184353+0000","last_unstale":"2024-05-09T09:50:33.120523+0000","last_undegraded":"2024-05-09T09:50:33.120523+0000","last_fullsized":"2024-05-09T09:50:33.120523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:01:14.038658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'8","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:45.864325+0000","last_change":"2024-05-09T09:47:14.187249+0000","last_active":"2024-05-09T09:48:45.864325+0000","last_peered":"2024-05-09T09:48:45.864325+0000","last_clean":"2024-05-09T09:48:45.864325+0000","last_became_active":"2024-05-09T09:47:14.186689+0000","last_became_peered":"2024-05-09T09:47:14.186689+0000","last_unstale":"2024-05-09T09:48:45.864325+0000","last_undegraded":"2024-05-09T09:48:45.864325+0000","last_fullsized":"2024-05-09T09:48:45.864325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:19:55.054927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.175877+0000","last_change":"2024-05-09T09:47:12.211787+0000","last_active":"2024-05-09T09:47:52.175877+0000","last_peered":"2024-05-09T09:47:52.175877+0000","last_clean":"2024-05-09T09:47:52.175877+0000","last_became_active":"2024-05-09T09:47:12.209633+0000","last_became_peered":"2024-05-09T09:47:12.209633+0000","last_unstale":"2024-05-09T09:47:52.175877+0000","last_undegraded":"2024-05-09T09:47:52.175877+0000","last_fullsized":"2024-05-09T09:47:52.175877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:51:58.314102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.163498+0000","last_change":"2024-05-09T09:47:14.193990+0000","last_active":"2024-05-09T09:49:25.163498+0000","last_peered":"2024-05-09T09:49:25.163498+0000","last_clean":"2024-05-09T09:49:25.163498+0000","last_became_active":"2024-05-09T09:47:14.193366+0000","last_became_peered":"2024-05-09T09:47:14.193366+0000","last_unstale":"2024-05-09T09:49:25.163498+0000","last_undegraded":"2024-05-09T09:49:25.163498+0000","last_fullsized":"2024-05-09T09:49:25.163498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:32:19.275039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.420041+0000","last_change":"2024-05-09T09:47:12.215615+0000","last_active":"2024-05-09T09:47:52.420041+0000","last_peered":"2024-05-09T09:47:52.420041+0000","last_clean":"2024-05-09T09:47:52.420041+0000","last_became_active":"2024-05-09T09:47:12.214019+0000","last_became_peered":"2024-05-09T09:47:12.214019+0000","last_unstale":"2024-05-09T09:47:52.420041+0000","last_undegraded":"2024-05-09T09:47:52.420041+0000","last_fullsized":"2024-05-09T09:47:52.420041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:15.767283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.944003+0000","last_change":"2024-05-09T09:47:14.182706+0000","last_active":"2024-05-09T09:50:32.944003+0000","last_peered":"2024-05-09T09:50:32.944003+0000","last_clean":"2024-05-09T09:50:32.944003+0000","last_became_active":"2024-05-09T09:47:14.181824+0000","last_became_peered":"2024-05-09T09:47:14.181824+0000","last_unstale":"2024-05-09T09:50:32.944003+0000","last_undegraded":"2024-05-09T09:50:32.944003+0000","last_fullsized":"2024-05-09T09:50:32.944003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:04:29.322102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.419332+0000","last_change":"2024-05-09T09:47:12.205854+0000","last_active":"2024-05-09T09:47:52.419332+0000","last_peered":"2024-05-09T09:47:52.419332+0000","last_clean":"2024-05-09T09:47:52.419332+0000","last_became_active":"2024-05-09T09:47:12.204322+0000","last_became_peered":"2024-05-09T09:47:12.204322+0000","last_unstale":"2024-05-09T09:47:52.419332+0000","last_undegraded":"2024-05-09T09:47:52.419332+0000","last_fullsized":"2024-05-09T09:47:52.419332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:19:17.059104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.150305+0000","last_change":"2024-05-09T09:47:14.178745+0000","last_active":"2024-05-09T09:50:33.150305+0000","last_peered":"2024-05-09T09:50:33.150305+0000","last_clean":"2024-05-09T09:50:33.150305+0000","last_became_active":"2024-05-09T09:47:14.178503+0000","last_became_peered":"2024-05-09T09:47:14.178503+0000","last_unstale":"2024-05-09T09:50:33.150305+0000","last_undegraded":"2024-05-09T09:50:33.150305+0000","last_fullsized":"2024-05-09T09:50:33.150305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:20:55.312241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"30'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.173367+0000","last_change":"2024-05-09T09:47:12.196461+0000","last_active":"2024-05-09T09:47:52.173367+0000","last_peered":"2024-05-09T09:47:52.173367+0000","last_clean":"2024-05-09T09:47:52.173367+0000","last_became_active":"2024-05-09T09:47:12.196120+0000","last_became_peered":"2024-05-09T09:47:12.196120+0000","last_unstale":"2024-05-09T09:47:52.173367+0000","last_undegraded":"2024-05-09T09:47:52.173367+0000","last_fullsized":"2024-05-09T09:47:52.173367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:06.949531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'5","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.162202+0000","last_change":"2024-05-09T09:47:14.177343+0000","last_active":"2024-05-09T09:49:20.162202+0000","last_peered":"2024-05-09T09:49:20.162202+0000","last_clean":"2024-05-09T09:49:20.162202+0000","last_became_active":"2024-05-09T09:47:14.176615+0000","last_became_peered":"2024-05-09T09:47:14.176615+0000","last_unstale":"2024-05-09T09:49:20.162202+0000","last_undegraded":"2024-05-09T09:49:20.162202+0000","last_fullsized":"2024-05-09T09:49:20.162202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:35:20.332271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.186449+0000","last_change":"2024-05-09T09:47:12.210169+0000","last_active":"2024-05-09T09:47:52.186449+0000","last_peered":"2024-05-09T09:47:52.186449+0000","last_clean":"2024-05-09T09:47:52.186449+0000","last_became_active":"2024-05-09T09:47:12.209171+0000","last_became_peered":"2024-05-09T09:47:12.209171+0000","last_unstale":"2024-05-09T09:47:52.186449+0000","last_undegraded":"2024-05-09T09:47:52.186449+0000","last_fullsized":"2024-05-09T09:47:52.186449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:55.107119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.164956+0000","last_change":"2024-05-09T09:47:14.177426+0000","last_active":"2024-05-09T09:47:52.164956+0000","last_peered":"2024-05-09T09:47:52.164956+0000","last_clean":"2024-05-09T09:47:52.164956+0000","last_became_active":"2024-05-09T09:47:14.177119+0000","last_became_peered":"2024-05-09T09:47:14.177119+0000","last_unstale":"2024-05-09T09:47:52.164956+0000","last_undegraded":"2024-05-09T09:47:52.164956+0000","last_fullsized":"2024-05-09T09:47:52.164956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:41:29.222588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.417060+0000","last_change":"2024-05-09T09:47:12.185203+0000","last_active":"2024-05-09T09:47:52.417060+0000","last_peered":"2024-05-09T09:47:52.417060+0000","last_clean":"2024-05-09T09:47:52.417060+0000","last_became_active":"2024-05-09T09:47:12.184105+0000","last_became_peered":"2024-05-09T09:47:12.184105+0000","last_unstale":"2024-05-09T09:47:52.417060+0000","last_undegraded":"2024-05-09T09:47:52.417060+0000","last_fullsized":"2024-05-09T09:47:52.417060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:18:16.165145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.800585+0000","last_change":"2024-05-09T09:47:14.185348+0000","last_active":"2024-05-09T09:50:32.800585+0000","last_peered":"2024-05-09T09:50:32.800585+0000","last_clean":"2024-05-09T09:50:32.800585+0000","last_became_active":"2024-05-09T09:47:14.182961+0000","last_became_peered":"2024-05-09T09:47:14.182961+0000","last_unstale":"2024-05-09T09:50:32.800585+0000","last_undegraded":"2024-05-09T09:50:32.800585+0000","last_fullsized":"2024-05-09T09:50:32.800585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:14:52.487546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'1","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.173578+0000","last_change":"2024-05-09T09:47:12.206940+0000","last_active":"2024-05-09T09:49:25.173578+0000","last_peered":"2024-05-09T09:49:25.173578+0000","last_clean":"2024-05-09T09:49:25.173578+0000","last_became_active":"2024-05-09T09:47:12.201952+0000","last_became_peered":"2024-05-09T09:47:12.201952+0000","last_unstale":"2024-05-09T09:49:25.173578+0000","last_undegraded":"2024-05-09T09:49:25.173578+0000","last_fullsized":"2024-05-09T09:49:25.173578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:06:37.960812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.944562+0000","last_change":"2024-05-09T09:47:14.193794+0000","last_active":"2024-05-09T09:50:32.944562+0000","last_peered":"2024-05-09T09:50:32.944562+0000","last_clean":"2024-05-09T09:50:32.944562+0000","last_became_active":"2024-05-09T09:47:14.193421+0000","last_became_peered":"2024-05-09T09:47:14.193421+0000","last_unstale":"2024-05-09T09:50:32.944562+0000","last_undegraded":"2024-05-09T09:50:32.944562+0000","last_fullsized":"2024-05-09T09:50:32.944562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:49:55.928418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:01.784206+0000","last_change":"2024-05-09T09:47:12.206566+0000","last_active":"2024-05-09T09:48:01.784206+0000","last_peered":"2024-05-09T09:48:01.784206+0000","last_clean":"2024-05-09T09:48:01.784206+0000","last_became_active":"2024-05-09T09:47:12.203523+0000","last_became_peered":"2024-05-09T09:47:12.203523+0000","last_unstale":"2024-05-09T09:48:01.784206+0000","last_undegraded":"2024-05-09T09:48:01.784206+0000","last_fullsized":"2024-05-09T09:48:01.784206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:00:03.229983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.302907+0000","last_change":"2024-05-09T09:47:14.173720+0000","last_active":"2024-05-09T09:50:33.302907+0000","last_peered":"2024-05-09T09:50:33.302907+0000","last_clean":"2024-05-09T09:50:33.302907+0000","last_became_active":"2024-05-09T09:47:14.171565+0000","last_became_peered":"2024-05-09T09:47:14.171565+0000","last_unstale":"2024-05-09T09:50:33.302907+0000","last_undegraded":"2024-05-09T09:50:33.302907+0000","last_fullsized":"2024-05-09T09:50:33.302907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:16:59.077638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.111363+0000","last_change":"2024-05-09T09:47:12.193541+0000","last_active":"2024-05-09T09:49:32.111363+0000","last_peered":"2024-05-09T09:49:32.111363+0000","last_clean":"2024-05-09T09:49:32.111363+0000","last_became_active":"2024-05-09T09:47:12.192462+0000","last_became_peered":"2024-05-09T09:47:12.192462+0000","last_unstale":"2024-05-09T09:49:32.111363+0000","last_undegraded":"2024-05-09T09:49:32.111363+0000","last_fullsized":"2024-05-09T09:49:32.111363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:43:04.277278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.239153+0000","last_change":"2024-05-09T09:47:14.177456+0000","last_active":"2024-05-09T09:50:33.239153+0000","last_peered":"2024-05-09T09:50:33.239153+0000","last_clean":"2024-05-09T09:50:33.239153+0000","last_became_active":"2024-05-09T09:47:14.176986+0000","last_became_peered":"2024-05-09T09:47:14.176986+0000","last_unstale":"2024-05-09T09:50:33.239153+0000","last_undegraded":"2024-05-09T09:50:33.239153+0000","last_fullsized":"2024-05-09T09:50:33.239153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:00:58.585804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.169090+0000","last_change":"2024-05-09T09:47:12.205826+0000","last_active":"2024-05-09T09:47:52.169090+0000","last_peered":"2024-05-09T09:47:52.169090+0000","last_clean":"2024-05-09T09:47:52.169090+0000","last_became_active":"2024-05-09T09:47:12.205416+0000","last_became_peered":"2024-05-09T09:47:12.205416+0000","last_unstale":"2024-05-09T09:47:52.169090+0000","last_undegraded":"2024-05-09T09:47:52.169090+0000","last_fullsized":"2024-05-09T09:47:52.169090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:14:11.726333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:02.666810+0000","last_change":"2024-05-09T09:47:14.182747+0000","last_active":"2024-05-09T09:48:02.666810+0000","last_peered":"2024-05-09T09:48:02.666810+0000","last_clean":"2024-05-09T09:48:02.666810+0000","last_became_active":"2024-05-09T09:47:14.182248+0000","last_became_peered":"2024-05-09T09:47:14.182248+0000","last_unstale":"2024-05-09T09:48:02.666810+0000","last_undegraded":"2024-05-09T09:48:02.666810+0000","last_fullsized":"2024-05-09T09:48:02.666810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:32:19.275039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'1","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:30.174765+0000","last_change":"2024-05-09T09:47:12.208127+0000","last_active":"2024-05-09T09:49:30.174765+0000","last_peered":"2024-05-09T09:49:30.174765+0000","last_clean":"2024-05-09T09:49:30.174765+0000","last_became_active":"2024-05-09T09:47:12.200127+0000","last_became_peered":"2024-05-09T09:47:12.200127+0000","last_unstale":"2024-05-09T09:49:30.174765+0000","last_undegraded":"2024-05-09T09:49:30.174765+0000","last_fullsized":"2024-05-09T09:49:30.174765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:08:17.713419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.304307+0000","last_change":"2024-05-09T09:47:14.190516+0000","last_active":"2024-05-09T09:50:33.304307+0000","last_peered":"2024-05-09T09:50:33.304307+0000","last_clean":"2024-05-09T09:50:33.304307+0000","last_became_active":"2024-05-09T09:47:14.190033+0000","last_became_peered":"2024-05-09T09:47:14.190033+0000","last_unstale":"2024-05-09T09:50:33.304307+0000","last_undegraded":"2024-05-09T09:50:33.304307+0000","last_fullsized":"2024-05-09T09:50:33.304307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:34:58.223894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:01.765781+0000","last_change":"2024-05-09T09:47:12.208249+0000","last_active":"2024-05-09T09:48:01.765781+0000","last_peered":"2024-05-09T09:48:01.765781+0000","last_clean":"2024-05-09T09:48:01.765781+0000","last_became_active":"2024-05-09T09:47:12.203424+0000","last_became_peered":"2024-05-09T09:47:12.203424+0000","last_unstale":"2024-05-09T09:48:01.765781+0000","last_undegraded":"2024-05-09T09:48:01.765781+0000","last_fullsized":"2024-05-09T09:48:01.765781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:28:35.100126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:30.174695+0000","last_change":"2024-05-09T09:47:14.187165+0000","last_active":"2024-05-09T09:49:30.174695+0000","last_peered":"2024-05-09T09:49:30.174695+0000","last_clean":"2024-05-09T09:49:30.174695+0000","last_became_active":"2024-05-09T09:47:14.186711+0000","last_became_peered":"2024-05-09T09:47:14.186711+0000","last_unstale":"2024-05-09T09:49:30.174695+0000","last_undegraded":"2024-05-09T09:49:30.174695+0000","last_fullsized":"2024-05-09T09:49:30.174695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:51:46.975465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.188697+0000","last_change":"2024-05-09T09:47:12.209730+0000","last_active":"2024-05-09T09:47:52.188697+0000","last_peered":"2024-05-09T09:47:52.188697+0000","last_clean":"2024-05-09T09:47:52.188697+0000","last_became_active":"2024-05-09T09:47:12.205320+0000","last_became_peered":"2024-05-09T09:47:12.205320+0000","last_unstale":"2024-05-09T09:47:52.188697+0000","last_undegraded":"2024-05-09T09:47:52.188697+0000","last_fullsized":"2024-05-09T09:47:52.188697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:01:14.038658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.403843+0000","last_change":"2024-05-09T09:47:14.178306+0000","last_active":"2024-05-09T09:50:33.403843+0000","last_peered":"2024-05-09T09:50:33.403843+0000","last_clean":"2024-05-09T09:50:33.403843+0000","last_became_active":"2024-05-09T09:47:14.177955+0000","last_became_peered":"2024-05-09T09:47:14.177955+0000","last_unstale":"2024-05-09T09:50:33.403843+0000","last_undegraded":"2024-05-09T09:50:33.403843+0000","last_fullsized":"2024-05-09T09:50:33.403843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:29:53.547705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:26.957446+0000","last_change":"2024-05-09T09:47:12.202337+0000","last_active":"2024-05-09T09:49:26.957446+0000","last_peered":"2024-05-09T09:49:26.957446+0000","last_clean":"2024-05-09T09:49:26.957446+0000","last_became_active":"2024-05-09T09:47:12.201790+0000","last_became_peered":"2024-05-09T09:47:12.201790+0000","last_unstale":"2024-05-09T09:49:26.957446+0000","last_undegraded":"2024-05-09T09:49:26.957446+0000","last_fullsized":"2024-05-09T09:49:26.957446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:35:18.312747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'6","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.129089+0000","last_change":"2024-05-09T09:47:12.207600+0000","last_active":"2024-05-09T09:50:33.129089+0000","last_peered":"2024-05-09T09:50:33.129089+0000","last_clean":"2024-05-09T09:50:33.129089+0000","last_became_active":"2024-05-09T09:47:12.203435+0000","last_became_peered":"2024-05-09T09:47:12.203435+0000","last_unstale":"2024-05-09T09:50:33.129089+0000","last_undegraded":"2024-05-09T09:50:33.129089+0000","last_fullsized":"2024-05-09T09:50:33.129089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:13:12.664064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'7","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.321483+0000","last_change":"2024-05-09T09:47:14.179261+0000","last_active":"2024-05-09T09:50:33.321483+0000","last_peered":"2024-05-09T09:50:33.321483+0000","last_clean":"2024-05-09T09:50:33.321483+0000","last_became_active":"2024-05-09T09:47:14.178142+0000","last_became_peered":"2024-05-09T09:47:14.178142+0000","last_unstale":"2024-05-09T09:50:33.321483+0000","last_undegraded":"2024-05-09T09:50:33.321483+0000","last_fullsized":"2024-05-09T09:50:33.321483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:34:02.864130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.412986+0000","last_change":"2024-05-09T09:47:12.207072+0000","last_active":"2024-05-09T09:47:52.412986+0000","last_peered":"2024-05-09T09:47:52.412986+0000","last_clean":"2024-05-09T09:47:52.412986+0000","last_became_active":"2024-05-09T09:47:12.205216+0000","last_became_peered":"2024-05-09T09:47:12.205216+0000","last_unstale":"2024-05-09T09:47:52.412986+0000","last_undegraded":"2024-05-09T09:47:52.412986+0000","last_fullsized":"2024-05-09T09:47:52.412986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:06.949531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'12","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.802415+0000","last_change":"2024-05-09T09:47:14.174424+0000","last_active":"2024-05-09T09:50:32.802415+0000","last_peered":"2024-05-09T09:50:32.802415+0000","last_clean":"2024-05-09T09:50:32.802415+0000","last_became_active":"2024-05-09T09:47:14.174123+0000","last_became_peered":"2024-05-09T09:47:14.174123+0000","last_unstale":"2024-05-09T09:50:32.802415+0000","last_undegraded":"2024-05-09T09:50:32.802415+0000","last_fullsized":"2024-05-09T09:50:32.802415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:10:05.300469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3643,"ondisk_log_size":3643,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1628,"num_read_kb":1518,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705710,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40040,"kb_used_data":8864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331800,"statfs":{"total":96636764160,"available":96595763200,"internally_reserved":0,"allocated":9076736,"data_stored":8754022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705712,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36392,"kb_used_data":9376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335448,"statfs":{"total":96636764160,"available":96599498752,"internally_reserved":0,"allocated":9601024,"data_stored":9339828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705710,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36412,"kb_used_data":9396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335428,"statfs":{"total":96636764160,"available":96599478272,"internally_reserved":0,"allocated":9621504,"data_stored":9341034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40004,"kb_used_data":8828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331836,"statfs":{"total":96636764160,"available":96595800064,"internally_reserved":0,"allocated":9039872,"data_stored":8751284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T09:50:41.068 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T09:50:41.068 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T09:50:41.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.219+0000 7f0ed48eb640 1 Processor -- start 2024-05-09T09:50:41.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.219+0000 7f0ed48eb640 1 -- start start 2024-05-09T09:50:41.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.219+0000 7f0ed48eb640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0ed00955b0 0x7f0ed0129990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:41.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.219+0000 7f0ed48eb640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ed0096570 con 0x7f0ed01294f0 2024-05-09T09:50:41.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.219+0000 7f0ed48eb640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f0ed00971f0 con 0x7f0ed00955b0 2024-05-09T09:50:41.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.223+0000 7f0ecdd9b640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f0ed01294f0 0x7f0ed012c860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:49052/0 (socket says 172.21.15.110:49052) 2024-05-09T09:50:41.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.223+0000 7f0ecdd9b640 1 -- 172.21.15.110:0/811406234 learned_addr learned my addr 172.21.15.110:0/811406234 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:50:41.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.223+0000 7f0ece59c640 1 --2- 172.21.15.110:0/811406234 >> v2:172.21.15.110:3300/0 conn(0x7f0ed00955b0 0x7f0ed0129990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:41.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.223+0000 7f0ece59c640 1 -- 172.21.15.110:0/811406234 >> v1:172.21.15.110:6789/0 conn(0x7f0ed01294f0 legacy=0x7f0ed012c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:41.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.223+0000 7f0ecd59a640 1 -- 172.21.15.110:0/811406234 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2192906225 0 0) 0x7f0ed0096570 con 0x7f0ed01294f0 2024-05-09T09:50:41.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.223+0000 7f0ece59c640 1 -- 172.21.15.110:0/811406234 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed0129ed0 con 0x7f0ed00955b0 2024-05-09T09:50:41.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.223+0000 7f0ece59c640 1 --2- 172.21.15.110:0/811406234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ed00955b0 0x7f0ed0129990 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009740 tx=0x7f0eb801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f6f4d9c0ae4ed3b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:41.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.223+0000 7f0ecd59a640 1 -- 172.21.15.110:0/811406234 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eb80b0070 con 0x7f0ed00955b0 2024-05-09T09:50:41.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.223+0000 7f0ecd59a640 1 -- 172.21.15.110:0/811406234 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eb80ab530 con 0x7f0ed00955b0 2024-05-09T09:50:41.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.223+0000 7f0ecd59a640 1 -- 172.21.15.110:0/811406234 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eb80ab830 con 0x7f0ed00955b0 2024-05-09T09:50:41.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.223+0000 7f0ed48eb640 1 -- 172.21.15.110:0/811406234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ed00955b0 msgr2=0x7f0ed0129990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:41.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.223+0000 7f0ed48eb640 1 --2- 172.21.15.110:0/811406234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ed00955b0 0x7f0ed0129990 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009740 tx=0x7f0eb801c370 comp rx=0 tx=0).stop 2024-05-09T09:50:41.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.223+0000 7f0ed48eb640 1 -- 172.21.15.110:0/811406234 shutdown_connections 2024-05-09T09:50:41.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.223+0000 7f0ed48eb640 1 --2- 172.21.15.110:0/811406234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ed00955b0 0x7f0ed0129990 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:41.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.223+0000 7f0ed48eb640 1 -- 172.21.15.110:0/811406234 >> 172.21.15.110:0/811406234 conn(0x7f0ed009ad20 msgr2=0x7f0ed009b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:41.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.223+0000 7f0ed48eb640 1 -- 172.21.15.110:0/811406234 shutdown_connections 2024-05-09T09:50:41.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.223+0000 7f0ed48eb640 1 -- 172.21.15.110:0/811406234 wait complete. 2024-05-09T09:50:41.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.227+0000 7f0ed48eb640 1 Processor -- start 2024-05-09T09:50:41.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.227+0000 7f0ed48eb640 1 -- start start 2024-05-09T09:50:41.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.227+0000 7f0ed48eb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ed00955b0 0x7f0ed012f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:41.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.227+0000 7f0ed48eb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed01357a0 con 0x7f0ed00955b0 2024-05-09T09:50:41.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.227+0000 7f0ece59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ed00955b0 0x7f0ed012f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:41.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.227+0000 7f0ece59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ed00955b0 0x7f0ed012f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51242/0 (socket says 172.21.15.110:51242) 2024-05-09T09:50:41.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.227+0000 7f0ece59c640 1 -- 172.21.15.110:0/251305426 learned_addr learned my addr 172.21.15.110:0/251305426 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:50:41.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.227+0000 7f0ece59c640 1 -- 172.21.15.110:0/251305426 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed0131710 con 0x7f0ed00955b0 2024-05-09T09:50:41.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.227+0000 7f0ece59c640 1 --2- 172.21.15.110:0/251305426 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ed00955b0 0x7f0ed012f930 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8019fa0 tx=0x7f0eb801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:41.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.227+0000 7f0ec6ffd640 1 -- 172.21.15.110:0/251305426 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eb80bb070 con 0x7f0ed00955b0 2024-05-09T09:50:41.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.227+0000 7f0ec6ffd640 1 -- 172.21.15.110:0/251305426 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eb8004150 con 0x7f0ed00955b0 2024-05-09T09:50:41.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.227+0000 7f0ed48eb640 1 -- 172.21.15.110:0/251305426 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ed01323d0 con 0x7f0ed00955b0 2024-05-09T09:50:41.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.227+0000 7f0ec6ffd640 1 -- 172.21.15.110:0/251305426 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eb80b0040 con 0x7f0ed00955b0 2024-05-09T09:50:41.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.227+0000 7f0ed48eb640 1 -- 172.21.15.110:0/251305426 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ed01222c0 con 0x7f0ed00955b0 2024-05-09T09:50:41.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.227+0000 7f0ed48eb640 1 -- 172.21.15.110:0/251305426 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ed0063710 con 0x7f0ed00955b0 2024-05-09T09:50:41.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.227+0000 7f0ec6ffd640 1 -- 172.21.15.110:0/251305426 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f0eb8003620 con 0x7f0ed00955b0 2024-05-09T09:50:41.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.227+0000 7f0ec6ffd640 1 --2- 172.21.15.110:0/251305426 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0eb0036310 0x7f0eb00387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:41.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.227+0000 7f0ec6ffd640 1 -- 172.21.15.110:0/251305426 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f0eb80e4140 con 0x7f0ed00955b0 2024-05-09T09:50:41.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.227+0000 7f0ecdd9b640 1 --2- 172.21.15.110:0/251305426 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0eb0036310 0x7f0eb00387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:41.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.231+0000 7f0ecdd9b640 1 --2- 172.21.15.110:0/251305426 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0eb0036310 0x7f0eb00387d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0007fd0 tx=0x7f0ec0007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:41.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.231+0000 7f0ec6ffd640 1 -- 172.21.15.110:0/251305426 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0eb8015ff0 con 0x7f0ed00955b0 2024-05-09T09:50:41.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.395+0000 7f0ed48eb640 1 -- 172.21.15.110:0/251305426 --> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0ed0131fa0 con 0x7f0eb0036310 2024-05-09T09:50:41.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.443+0000 7f0ec6ffd640 1 -- 172.21.15.110:0/251305426 <== mgr.4100 v2:172.21.15.157:6824/2765519551 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665894 (secure 0 0 0) 0x7f0ed0131fa0 con 0x7f0eb0036310 2024-05-09T09:50:41.450 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:50:41.456 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-05-09T09:50:41.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.447+0000 7f0ed48eb640 1 -- 172.21.15.110:0/251305426 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0eb0036310 msgr2=0x7f0eb00387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:41.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.447+0000 7f0ed48eb640 1 --2- 172.21.15.110:0/251305426 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0eb0036310 0x7f0eb00387d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0007fd0 tx=0x7f0ec0007980 comp rx=0 tx=0).stop 2024-05-09T09:50:41.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.447+0000 7f0ed48eb640 1 -- 172.21.15.110:0/251305426 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ed00955b0 msgr2=0x7f0ed012f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:41.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.447+0000 7f0ed48eb640 1 --2- 172.21.15.110:0/251305426 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ed00955b0 0x7f0ed012f930 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8019fa0 tx=0x7f0eb801abb0 comp rx=0 tx=0).stop 2024-05-09T09:50:41.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.447+0000 7f0ed48eb640 1 -- 172.21.15.110:0/251305426 shutdown_connections 2024-05-09T09:50:41.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.447+0000 7f0ed48eb640 1 --2- 172.21.15.110:0/251305426 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0eb0036310 0x7f0eb00387d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:41.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.447+0000 7f0ed48eb640 1 --2- 172.21.15.110:0/251305426 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ed00955b0 0x7f0ed012f930 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:41.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.447+0000 7f0ed48eb640 1 -- 172.21.15.110:0/251305426 >> 172.21.15.110:0/251305426 conn(0x7f0ed009ad20 msgr2=0x7f0ed0097820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:41.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.447+0000 7f0ed48eb640 1 -- 172.21.15.110:0/251305426 shutdown_connections 2024-05-09T09:50:41.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.447+0000 7f0ed48eb640 1 -- 172.21.15.110:0/251305426 wait complete. 2024-05-09T09:50:41.468 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-05-09T09:50:41.173570+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5118,"num_read_kb":4699,"num_write":2179,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6967,"ondisk_log_size":6967,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152848,"kb_used_data":36464,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377334512,"statfs":{"total":386547056640,"available":386390540288,"internally_reserved":0,"allocated":37339136,"data_stored":36186168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":119138070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4281,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":713,"num_read_kb":672,"num_write":457,"num_write_kb":29372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006348"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.185131+0000","last_change":"2024-05-09T09:47:12.206481+0000","last_active":"2024-05-09T09:47:52.185131+0000","last_peered":"2024-05-09T09:47:52.185131+0000","last_clean":"2024-05-09T09:47:52.185131+0000","last_became_active":"2024-05-09T09:47:12.205786+0000","last_became_peered":"2024-05-09T09:47:12.205786+0000","last_unstale":"2024-05-09T09:47:52.185131+0000","last_undegraded":"2024-05-09T09:47:52.185131+0000","last_fullsized":"2024-05-09T09:47:52.185131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:17:39.735832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:46.160690+0000","last_change":"2024-05-09T09:47:14.171375+0000","last_active":"2024-05-09T09:48:46.160690+0000","last_peered":"2024-05-09T09:48:46.160690+0000","last_clean":"2024-05-09T09:48:46.160690+0000","last_became_active":"2024-05-09T09:47:14.171044+0000","last_became_peered":"2024-05-09T09:47:14.171044+0000","last_unstale":"2024-05-09T09:48:46.160690+0000","last_undegraded":"2024-05-09T09:48:46.160690+0000","last_fullsized":"2024-05-09T09:48:46.160690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:57.831374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.687417+0000","last_change":"2024-05-09T09:47:12.190812+0000","last_active":"2024-05-09T09:50:32.687417+0000","last_peered":"2024-05-09T09:50:32.687417+0000","last_clean":"2024-05-09T09:50:32.687417+0000","last_became_active":"2024-05-09T09:47:12.189774+0000","last_became_peered":"2024-05-09T09:47:12.189774+0000","last_unstale":"2024-05-09T09:50:32.687417+0000","last_undegraded":"2024-05-09T09:50:32.687417+0000","last_fullsized":"2024-05-09T09:50:32.687417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:13:12.664064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.180726+0000","last_change":"2024-05-09T09:47:14.193844+0000","last_active":"2024-05-09T09:47:52.180726+0000","last_peered":"2024-05-09T09:47:52.180726+0000","last_clean":"2024-05-09T09:47:52.180726+0000","last_became_active":"2024-05-09T09:47:14.192803+0000","last_became_peered":"2024-05-09T09:47:14.192803+0000","last_unstale":"2024-05-09T09:47:52.180726+0000","last_undegraded":"2024-05-09T09:47:52.180726+0000","last_fullsized":"2024-05-09T09:47:52.180726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:03:50.025641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"32'3","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:45.849127+0000","last_change":"2024-05-09T09:47:12.209625+0000","last_active":"2024-05-09T09:48:45.849127+0000","last_peered":"2024-05-09T09:48:45.849127+0000","last_clean":"2024-05-09T09:48:45.849127+0000","last_became_active":"2024-05-09T09:47:12.207184+0000","last_became_peered":"2024-05-09T09:47:12.207184+0000","last_unstale":"2024-05-09T09:48:45.849127+0000","last_undegraded":"2024-05-09T09:48:45.849127+0000","last_fullsized":"2024-05-09T09:48:45.849127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:58:32.194004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'14","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.151204+0000","last_change":"2024-05-09T09:47:14.193118+0000","last_active":"2024-05-09T09:50:33.151204+0000","last_peered":"2024-05-09T09:50:33.151204+0000","last_clean":"2024-05-09T09:50:33.151204+0000","last_became_active":"2024-05-09T09:47:14.192821+0000","last_became_peered":"2024-05-09T09:47:14.192821+0000","last_unstale":"2024-05-09T09:50:33.151204+0000","last_undegraded":"2024-05-09T09:50:33.151204+0000","last_fullsized":"2024-05-09T09:50:33.151204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:12.396738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.575240+0000","last_change":"2024-05-09T09:47:12.195169+0000","last_active":"2024-05-09T09:50:32.575240+0000","last_peered":"2024-05-09T09:50:32.575240+0000","last_clean":"2024-05-09T09:50:32.575240+0000","last_became_active":"2024-05-09T09:47:12.194183+0000","last_became_peered":"2024-05-09T09:47:12.194183+0000","last_unstale":"2024-05-09T09:50:32.575240+0000","last_undegraded":"2024-05-09T09:50:32.575240+0000","last_fullsized":"2024-05-09T09:50:32.575240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:14.033148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'12","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.805704+0000","last_change":"2024-05-09T09:47:52.430986+0000","last_active":"2024-05-09T09:50:32.805704+0000","last_peered":"2024-05-09T09:50:32.805704+0000","last_clean":"2024-05-09T09:50:32.805704+0000","last_became_active":"2024-05-09T09:47:52.429940+0000","last_became_peered":"2024-05-09T09:47:52.429940+0000","last_unstale":"2024-05-09T09:50:32.805704+0000","last_undegraded":"2024-05-09T09:50:32.805704+0000","last_fullsized":"2024-05-09T09:50:32.805704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:46:39.468582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.185616+0000","last_change":"2024-05-09T09:47:12.212361+0000","last_active":"2024-05-09T09:47:52.185616+0000","last_peered":"2024-05-09T09:47:52.185616+0000","last_clean":"2024-05-09T09:47:52.185616+0000","last_became_active":"2024-05-09T09:47:12.204446+0000","last_became_peered":"2024-05-09T09:47:12.204446+0000","last_unstale":"2024-05-09T09:47:52.185616+0000","last_undegraded":"2024-05-09T09:47:52.185616+0000","last_fullsized":"2024-05-09T09:47:52.185616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:14:59.069403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'16","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.303718+0000","last_change":"2024-05-09T09:47:14.185067+0000","last_active":"2024-05-09T09:50:33.303718+0000","last_peered":"2024-05-09T09:50:33.303718+0000","last_clean":"2024-05-09T09:50:33.303718+0000","last_became_active":"2024-05-09T09:47:14.184792+0000","last_became_peered":"2024-05-09T09:47:14.184792+0000","last_unstale":"2024-05-09T09:50:33.303718+0000","last_undegraded":"2024-05-09T09:50:33.303718+0000","last_fullsized":"2024-05-09T09:50:33.303718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:15.097524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.137283+0000","last_change":"2024-05-09T09:47:12.195761+0000","last_active":"2024-05-09T09:50:33.137283+0000","last_peered":"2024-05-09T09:50:33.137283+0000","last_clean":"2024-05-09T09:50:33.137283+0000","last_became_active":"2024-05-09T09:47:12.195117+0000","last_became_peered":"2024-05-09T09:47:12.195117+0000","last_unstale":"2024-05-09T09:50:33.137283+0000","last_undegraded":"2024-05-09T09:50:33.137283+0000","last_fullsized":"2024-05-09T09:50:33.137283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:15:07.437414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'8","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.303421+0000","last_change":"2024-05-09T09:47:14.189185+0000","last_active":"2024-05-09T09:50:33.303421+0000","last_peered":"2024-05-09T09:50:33.303421+0000","last_clean":"2024-05-09T09:50:33.303421+0000","last_became_active":"2024-05-09T09:47:14.188665+0000","last_became_peered":"2024-05-09T09:47:14.188665+0000","last_unstale":"2024-05-09T09:50:33.303421+0000","last_undegraded":"2024-05-09T09:50:33.303421+0000","last_fullsized":"2024-05-09T09:50:33.303421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:39.377012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.175793+0000","last_change":"2024-05-09T09:47:12.201245+0000","last_active":"2024-05-09T09:47:52.175793+0000","last_peered":"2024-05-09T09:47:52.175793+0000","last_clean":"2024-05-09T09:47:52.175793+0000","last_became_active":"2024-05-09T09:47:12.199697+0000","last_became_peered":"2024-05-09T09:47:12.199697+0000","last_unstale":"2024-05-09T09:47:52.175793+0000","last_undegraded":"2024-05-09T09:47:52.175793+0000","last_fullsized":"2024-05-09T09:47:52.175793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:40:31.009399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'12","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.808798+0000","last_change":"2024-05-09T09:47:14.179543+0000","last_active":"2024-05-09T09:50:32.808798+0000","last_peered":"2024-05-09T09:50:32.808798+0000","last_clean":"2024-05-09T09:50:32.808798+0000","last_became_active":"2024-05-09T09:47:14.179041+0000","last_became_peered":"2024-05-09T09:47:14.179041+0000","last_unstale":"2024-05-09T09:50:32.808798+0000","last_undegraded":"2024-05-09T09:50:32.808798+0000","last_fullsized":"2024-05-09T09:50:32.808798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:28:37.119651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.412926+0000","last_change":"2024-05-09T09:47:12.185018+0000","last_active":"2024-05-09T09:47:52.412926+0000","last_peered":"2024-05-09T09:47:52.412926+0000","last_clean":"2024-05-09T09:47:52.412926+0000","last_became_active":"2024-05-09T09:47:12.183745+0000","last_became_peered":"2024-05-09T09:47:12.183745+0000","last_unstale":"2024-05-09T09:47:52.412926+0000","last_undegraded":"2024-05-09T09:47:52.412926+0000","last_fullsized":"2024-05-09T09:47:52.412926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:14.033148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'14","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.303289+0000","last_change":"2024-05-09T09:47:14.173339+0000","last_active":"2024-05-09T09:50:33.303289+0000","last_peered":"2024-05-09T09:50:33.303289+0000","last_clean":"2024-05-09T09:50:33.303289+0000","last_became_active":"2024-05-09T09:47:14.173031+0000","last_became_peered":"2024-05-09T09:47:14.173031+0000","last_unstale":"2024-05-09T09:50:33.303289+0000","last_undegraded":"2024-05-09T09:50:33.303289+0000","last_fullsized":"2024-05-09T09:50:33.303289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:35:20.332271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"30'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.172138+0000","last_change":"2024-05-09T09:47:14.193172+0000","last_active":"2024-05-09T09:47:52.172138+0000","last_peered":"2024-05-09T09:47:52.172138+0000","last_clean":"2024-05-09T09:47:52.172138+0000","last_became_active":"2024-05-09T09:47:14.192744+0000","last_became_peered":"2024-05-09T09:47:14.192744+0000","last_unstale":"2024-05-09T09:47:52.172138+0000","last_undegraded":"2024-05-09T09:47:52.172138+0000","last_fullsized":"2024-05-09T09:47:52.172138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:34:30.799914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.179264+0000","last_change":"2024-05-09T09:47:12.213768+0000","last_active":"2024-05-09T09:47:52.179264+0000","last_peered":"2024-05-09T09:47:52.179264+0000","last_clean":"2024-05-09T09:47:52.179264+0000","last_became_active":"2024-05-09T09:47:12.210781+0000","last_became_peered":"2024-05-09T09:47:12.210781+0000","last_unstale":"2024-05-09T09:47:52.179264+0000","last_undegraded":"2024-05-09T09:47:52.179264+0000","last_fullsized":"2024-05-09T09:47:52.179264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:17:39.735832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'20","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.237884+0000","last_change":"2024-05-09T09:47:14.190782+0000","last_active":"2024-05-09T09:50:33.237884+0000","last_peered":"2024-05-09T09:50:33.237884+0000","last_clean":"2024-05-09T09:50:33.237884+0000","last_became_active":"2024-05-09T09:47:14.190021+0000","last_became_peered":"2024-05-09T09:47:14.190021+0000","last_unstale":"2024-05-09T09:50:33.237884+0000","last_undegraded":"2024-05-09T09:50:33.237884+0000","last_fullsized":"2024-05-09T09:50:33.237884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:34:02.864130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.112255+0000","last_change":"2024-05-09T09:47:12.194645+0000","last_active":"2024-05-09T09:50:33.112255+0000","last_peered":"2024-05-09T09:50:33.112255+0000","last_clean":"2024-05-09T09:50:33.112255+0000","last_became_active":"2024-05-09T09:47:12.193509+0000","last_became_peered":"2024-05-09T09:47:12.193509+0000","last_unstale":"2024-05-09T09:50:33.112255+0000","last_undegraded":"2024-05-09T09:50:33.112255+0000","last_fullsized":"2024-05-09T09:50:33.112255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:00:03.229983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.947737+0000","last_change":"2024-05-09T09:47:14.189775+0000","last_active":"2024-05-09T09:50:32.947737+0000","last_peered":"2024-05-09T09:50:32.947737+0000","last_clean":"2024-05-09T09:50:32.947737+0000","last_became_active":"2024-05-09T09:47:14.189468+0000","last_became_peered":"2024-05-09T09:47:14.189468+0000","last_unstale":"2024-05-09T09:50:32.947737+0000","last_undegraded":"2024-05-09T09:50:32.947737+0000","last_fullsized":"2024-05-09T09:50:32.947737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:28:37.119651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.881830+0000","last_change":"2024-05-09T09:47:12.210720+0000","last_active":"2024-05-09T09:49:31.881830+0000","last_peered":"2024-05-09T09:49:31.881830+0000","last_clean":"2024-05-09T09:49:31.881830+0000","last_became_active":"2024-05-09T09:47:12.206920+0000","last_became_peered":"2024-05-09T09:47:12.206920+0000","last_unstale":"2024-05-09T09:49:31.881830+0000","last_undegraded":"2024-05-09T09:49:31.881830+0000","last_fullsized":"2024-05-09T09:49:31.881830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:14.033148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'18","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.238228+0000","last_change":"2024-05-09T09:47:14.174508+0000","last_active":"2024-05-09T09:50:33.238228+0000","last_peered":"2024-05-09T09:50:33.238228+0000","last_clean":"2024-05-09T09:50:33.238228+0000","last_became_active":"2024-05-09T09:47:14.173701+0000","last_became_peered":"2024-05-09T09:47:14.173701+0000","last_unstale":"2024-05-09T09:50:33.238228+0000","last_undegraded":"2024-05-09T09:50:33.238228+0000","last_fullsized":"2024-05-09T09:50:33.238228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:28:37.119651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.715742+0000","last_change":"2024-05-09T09:47:12.207271+0000","last_active":"2024-05-09T09:50:32.715742+0000","last_peered":"2024-05-09T09:50:32.715742+0000","last_clean":"2024-05-09T09:50:32.715742+0000","last_became_active":"2024-05-09T09:47:12.206564+0000","last_became_peered":"2024-05-09T09:47:12.206564+0000","last_unstale":"2024-05-09T09:50:32.715742+0000","last_undegraded":"2024-05-09T09:50:32.715742+0000","last_fullsized":"2024-05-09T09:50:32.715742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:15:01.079963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'10","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.806551+0000","last_change":"2024-05-09T09:47:14.173448+0000","last_active":"2024-05-09T09:50:32.806551+0000","last_peered":"2024-05-09T09:50:32.806551+0000","last_clean":"2024-05-09T09:50:32.806551+0000","last_became_active":"2024-05-09T09:47:14.173022+0000","last_became_peered":"2024-05-09T09:47:14.173022+0000","last_unstale":"2024-05-09T09:50:32.806551+0000","last_undegraded":"2024-05-09T09:50:32.806551+0000","last_fullsized":"2024-05-09T09:50:32.806551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:58:34.213528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.417285+0000","last_change":"2024-05-09T09:47:12.216902+0000","last_active":"2024-05-09T09:47:52.417285+0000","last_peered":"2024-05-09T09:47:52.417285+0000","last_clean":"2024-05-09T09:47:52.417285+0000","last_became_active":"2024-05-09T09:47:12.214422+0000","last_became_peered":"2024-05-09T09:47:12.214422+0000","last_unstale":"2024-05-09T09:47:52.417285+0000","last_undegraded":"2024-05-09T09:47:52.417285+0000","last_fullsized":"2024-05-09T09:47:52.417285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:17:39.735832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'10","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.237141+0000","last_change":"2024-05-09T09:47:14.172576+0000","last_active":"2024-05-09T09:50:33.237141+0000","last_peered":"2024-05-09T09:50:33.237141+0000","last_clean":"2024-05-09T09:50:33.237141+0000","last_became_active":"2024-05-09T09:47:14.172297+0000","last_became_peered":"2024-05-09T09:47:14.172297+0000","last_unstale":"2024-05-09T09:50:33.237141+0000","last_undegraded":"2024-05-09T09:50:33.237141+0000","last_fullsized":"2024-05-09T09:50:33.237141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:38:12.687762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.066369+0000","last_change":"2024-05-09T09:47:12.213596+0000","last_active":"2024-05-09T09:49:32.066369+0000","last_peered":"2024-05-09T09:49:32.066369+0000","last_clean":"2024-05-09T09:49:32.066369+0000","last_became_active":"2024-05-09T09:47:12.211880+0000","last_became_peered":"2024-05-09T09:47:12.211880+0000","last_unstale":"2024-05-09T09:49:32.066369+0000","last_undegraded":"2024-05-09T09:49:32.066369+0000","last_fullsized":"2024-05-09T09:49:32.066369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:02:04.919917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'39","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.197791+0000","last_change":"2024-05-09T09:47:22.260431+0000","last_active":"2024-05-09T09:50:33.197791+0000","last_peered":"2024-05-09T09:50:33.197791+0000","last_clean":"2024-05-09T09:50:33.197791+0000","last_became_active":"2024-05-09T09:47:22.258991+0000","last_became_peered":"2024-05-09T09:47:22.258991+0000","last_unstale":"2024-05-09T09:50:33.197791+0000","last_undegraded":"2024-05-09T09:50:33.197791+0000","last_fullsized":"2024-05-09T09:50:33.197791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:48:55.320178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":174,"num_read_kb":174,"num_write":107,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:02.667895+0000","last_change":"2024-05-09T09:47:14.185176+0000","last_active":"2024-05-09T09:48:02.667895+0000","last_peered":"2024-05-09T09:48:02.667895+0000","last_clean":"2024-05-09T09:48:02.667895+0000","last_became_active":"2024-05-09T09:47:14.184851+0000","last_became_peered":"2024-05-09T09:47:14.184851+0000","last_unstale":"2024-05-09T09:48:02.667895+0000","last_undegraded":"2024-05-09T09:48:02.667895+0000","last_fullsized":"2024-05-09T09:48:02.667895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:13:24.454355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.546223+0000","last_change":"2024-05-09T09:47:12.214683+0000","last_active":"2024-05-09T09:50:32.546223+0000","last_peered":"2024-05-09T09:50:32.546223+0000","last_clean":"2024-05-09T09:50:32.546223+0000","last_became_active":"2024-05-09T09:47:12.214108+0000","last_became_peered":"2024-05-09T09:47:12.214108+0000","last_unstale":"2024-05-09T09:50:32.546223+0000","last_undegraded":"2024-05-09T09:50:32.546223+0000","last_fullsized":"2024-05-09T09:50:32.546223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:08:34.152345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.191620+0000","last_change":"2024-05-09T09:47:16.197589+0000","last_active":"2024-05-09T09:47:52.191620+0000","last_peered":"2024-05-09T09:47:52.191620+0000","last_clean":"2024-05-09T09:47:52.191620+0000","last_became_active":"2024-05-09T09:47:16.196516+0000","last_became_peered":"2024-05-09T09:47:16.196516+0000","last_unstale":"2024-05-09T09:47:52.191620+0000","last_undegraded":"2024-05-09T09:47:52.191620+0000","last_fullsized":"2024-05-09T09:47:52.191620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:17:41.107784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'107","reported_seq":153,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.977123+0000","last_change":"2024-05-09T09:47:18.236921+0000","last_active":"2024-05-09T09:50:39.977123+0000","last_peered":"2024-05-09T09:50:39.977123+0000","last_clean":"2024-05-09T09:50:39.977123+0000","last_became_active":"2024-05-09T09:47:18.235911+0000","last_became_peered":"2024-05-09T09:47:18.235911+0000","last_unstale":"2024-05-09T09:50:39.977123+0000","last_undegraded":"2024-05-09T09:50:39.977123+0000","last_fullsized":"2024-05-09T09:50:39.977123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:41:58.214685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.178731+0000","last_change":"2024-05-09T09:47:20.252492+0000","last_active":"2024-05-09T09:47:52.178731+0000","last_peered":"2024-05-09T09:47:52.178731+0000","last_clean":"2024-05-09T09:47:52.178731+0000","last_became_active":"2024-05-09T09:47:20.251712+0000","last_became_peered":"2024-05-09T09:47:20.251712+0000","last_unstale":"2024-05-09T09:47:52.178731+0000","last_undegraded":"2024-05-09T09:47:52.178731+0000","last_fullsized":"2024-05-09T09:47:52.178731+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:51:10.268994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:45.872841+0000","last_change":"2024-05-09T09:47:22.255759+0000","last_active":"2024-05-09T09:48:45.872841+0000","last_peered":"2024-05-09T09:48:45.872841+0000","last_clean":"2024-05-09T09:48:45.872841+0000","last_became_active":"2024-05-09T09:47:22.255180+0000","last_became_peered":"2024-05-09T09:47:22.255180+0000","last_unstale":"2024-05-09T09:48:45.872841+0000","last_undegraded":"2024-05-09T09:48:45.872841+0000","last_fullsized":"2024-05-09T09:48:45.872841+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:01:10.229471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.192939+0000","last_change":"2024-05-09T09:47:14.187449+0000","last_active":"2024-05-09T09:47:52.192939+0000","last_peered":"2024-05-09T09:47:52.192939+0000","last_clean":"2024-05-09T09:47:52.192939+0000","last_became_active":"2024-05-09T09:47:14.187095+0000","last_became_peered":"2024-05-09T09:47:14.187095+0000","last_unstale":"2024-05-09T09:47:52.192939+0000","last_undegraded":"2024-05-09T09:47:52.192939+0000","last_fullsized":"2024-05-09T09:47:52.192939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:30:13.157598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.290281+0000","last_change":"2024-05-09T09:47:12.196226+0000","last_active":"2024-05-09T09:50:33.290281+0000","last_peered":"2024-05-09T09:50:33.290281+0000","last_clean":"2024-05-09T09:50:33.290281+0000","last_became_active":"2024-05-09T09:47:12.194549+0000","last_became_peered":"2024-05-09T09:47:12.194549+0000","last_unstale":"2024-05-09T09:50:33.290281+0000","last_undegraded":"2024-05-09T09:50:33.290281+0000","last_fullsized":"2024-05-09T09:50:33.290281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:15:01.079963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.422996+0000","last_change":"2024-05-09T09:47:16.191533+0000","last_active":"2024-05-09T09:47:52.422996+0000","last_peered":"2024-05-09T09:47:52.422996+0000","last_clean":"2024-05-09T09:47:52.422996+0000","last_became_active":"2024-05-09T09:47:16.190755+0000","last_became_peered":"2024-05-09T09:47:16.190755+0000","last_unstale":"2024-05-09T09:47:52.422996+0000","last_undegraded":"2024-05-09T09:47:52.422996+0000","last_fullsized":"2024-05-09T09:47:52.422996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:42:45.452416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.179964+0000","last_change":"2024-05-09T09:47:18.215068+0000","last_active":"2024-05-09T09:49:45.179964+0000","last_peered":"2024-05-09T09:49:45.179964+0000","last_clean":"2024-05-09T09:49:45.179964+0000","last_became_active":"2024-05-09T09:47:18.214299+0000","last_became_peered":"2024-05-09T09:47:18.214299+0000","last_unstale":"2024-05-09T09:49:45.179964+0000","last_undegraded":"2024-05-09T09:49:45.179964+0000","last_fullsized":"2024-05-09T09:49:45.179964+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:49:59.954141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.174479+0000","last_change":"2024-05-09T09:47:20.241740+0000","last_active":"2024-05-09T09:47:52.174479+0000","last_peered":"2024-05-09T09:47:52.174479+0000","last_clean":"2024-05-09T09:47:52.174479+0000","last_became_active":"2024-05-09T09:47:20.241096+0000","last_became_peered":"2024-05-09T09:47:20.241096+0000","last_unstale":"2024-05-09T09:47:52.174479+0000","last_undegraded":"2024-05-09T09:47:52.174479+0000","last_fullsized":"2024-05-09T09:47:52.174479+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:37:23.903396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.416615+0000","last_change":"2024-05-09T09:47:22.258554+0000","last_active":"2024-05-09T09:47:52.416615+0000","last_peered":"2024-05-09T09:47:52.416615+0000","last_clean":"2024-05-09T09:47:52.416615+0000","last_became_active":"2024-05-09T09:47:22.257798+0000","last_became_peered":"2024-05-09T09:47:22.257798+0000","last_unstale":"2024-05-09T09:47:52.416615+0000","last_undegraded":"2024-05-09T09:47:52.416615+0000","last_fullsized":"2024-05-09T09:47:52.416615+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:29:01.635074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.947134+0000","last_change":"2024-05-09T09:47:52.430567+0000","last_active":"2024-05-09T09:50:32.947134+0000","last_peered":"2024-05-09T09:50:32.947134+0000","last_clean":"2024-05-09T09:50:32.947134+0000","last_became_active":"2024-05-09T09:47:52.429857+0000","last_became_peered":"2024-05-09T09:47:52.429857+0000","last_unstale":"2024-05-09T09:50:32.947134+0000","last_undegraded":"2024-05-09T09:50:32.947134+0000","last_fullsized":"2024-05-09T09:50:32.947134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:59:53.671007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.174693+0000","last_change":"2024-05-09T09:47:12.201826+0000","last_active":"2024-05-09T09:47:52.174693+0000","last_peered":"2024-05-09T09:47:52.174693+0000","last_clean":"2024-05-09T09:47:52.174693+0000","last_became_active":"2024-05-09T09:47:12.201415+0000","last_became_peered":"2024-05-09T09:47:12.201415+0000","last_unstale":"2024-05-09T09:47:52.174693+0000","last_undegraded":"2024-05-09T09:47:52.174693+0000","last_fullsized":"2024-05-09T09:47:52.174693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:56:46.263211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.426796+0000","last_change":"2024-05-09T09:47:16.213280+0000","last_active":"2024-05-09T09:47:52.426796+0000","last_peered":"2024-05-09T09:47:52.426796+0000","last_clean":"2024-05-09T09:47:52.426796+0000","last_became_active":"2024-05-09T09:47:16.212543+0000","last_became_peered":"2024-05-09T09:47:16.212543+0000","last_unstale":"2024-05-09T09:47:52.426796+0000","last_undegraded":"2024-05-09T09:47:52.426796+0000","last_fullsized":"2024-05-09T09:47:52.426796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:51:48.988654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.178986+0000","last_change":"2024-05-09T09:47:18.215341+0000","last_active":"2024-05-09T09:47:52.178986+0000","last_peered":"2024-05-09T09:47:52.178986+0000","last_clean":"2024-05-09T09:47:52.178986+0000","last_became_active":"2024-05-09T09:47:18.212685+0000","last_became_peered":"2024-05-09T09:47:18.212685+0000","last_unstale":"2024-05-09T09:47:52.178986+0000","last_undegraded":"2024-05-09T09:47:52.178986+0000","last_fullsized":"2024-05-09T09:47:52.178986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:42:47.464951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'284","reported_seq":385,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.891354+0000","last_change":"2024-05-09T09:47:20.250999+0000","last_active":"2024-05-09T09:50:39.891354+0000","last_peered":"2024-05-09T09:50:39.891354+0000","last_clean":"2024-05-09T09:50:39.891354+0000","last_became_active":"2024-05-09T09:47:20.250200+0000","last_became_peered":"2024-05-09T09:47:20.250200+0000","last_unstale":"2024-05-09T09:50:39.891354+0000","last_undegraded":"2024-05-09T09:50:39.891354+0000","last_fullsized":"2024-05-09T09:50:39.891354+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:17:01.311058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.170307+0000","last_change":"2024-05-09T09:47:22.241318+0000","last_active":"2024-05-09T09:47:52.170307+0000","last_peered":"2024-05-09T09:47:52.170307+0000","last_clean":"2024-05-09T09:47:52.170307+0000","last_became_active":"2024-05-09T09:47:22.238160+0000","last_became_peered":"2024-05-09T09:47:22.238160+0000","last_unstale":"2024-05-09T09:47:52.170307+0000","last_undegraded":"2024-05-09T09:47:52.170307+0000","last_fullsized":"2024-05-09T09:47:52.170307+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:26.173328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'16","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.825007+0000","last_change":"2024-05-09T09:47:14.177761+0000","last_active":"2024-05-09T09:50:32.825007+0000","last_peered":"2024-05-09T09:50:32.825007+0000","last_clean":"2024-05-09T09:50:32.825007+0000","last_became_active":"2024-05-09T09:47:14.176295+0000","last_became_peered":"2024-05-09T09:47:14.176295+0000","last_unstale":"2024-05-09T09:50:32.825007+0000","last_undegraded":"2024-05-09T09:50:32.825007+0000","last_fullsized":"2024-05-09T09:50:32.825007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:29:53.547705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.163979+0000","last_change":"2024-05-09T09:47:12.192627+0000","last_active":"2024-05-09T09:47:52.163979+0000","last_peered":"2024-05-09T09:47:52.163979+0000","last_clean":"2024-05-09T09:47:52.163979+0000","last_became_active":"2024-05-09T09:47:12.191194+0000","last_became_peered":"2024-05-09T09:47:12.191194+0000","last_unstale":"2024-05-09T09:47:52.163979+0000","last_undegraded":"2024-05-09T09:47:52.163979+0000","last_fullsized":"2024-05-09T09:47:52.163979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:21:00.747450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.203101+0000","last_change":"2024-05-09T09:47:52.201792+0000","last_active":"2024-05-09T09:47:52.203101+0000","last_peered":"2024-05-09T09:47:52.203101+0000","last_clean":"2024-05-09T09:47:52.203101+0000","last_became_active":"2024-05-09T09:47:52.201081+0000","last_became_peered":"2024-05-09T09:47:52.201081+0000","last_unstale":"2024-05-09T09:47:52.203101+0000","last_undegraded":"2024-05-09T09:47:52.203101+0000","last_fullsized":"2024-05-09T09:47:52.203101+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:13:19.457015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'107","reported_seq":153,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.161639+0000","last_change":"2024-05-09T09:47:18.219458+0000","last_active":"2024-05-09T09:50:40.161639+0000","last_peered":"2024-05-09T09:50:40.161639+0000","last_clean":"2024-05-09T09:50:40.161639+0000","last_became_active":"2024-05-09T09:47:18.217843+0000","last_became_peered":"2024-05-09T09:47:18.217843+0000","last_unstale":"2024-05-09T09:50:40.161639+0000","last_undegraded":"2024-05-09T09:50:40.161639+0000","last_fullsized":"2024-05-09T09:50:40.161639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:34:34.825637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'284","reported_seq":445,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.899072+0000","last_change":"2024-05-09T09:47:20.243402+0000","last_active":"2024-05-09T09:50:39.899072+0000","last_peered":"2024-05-09T09:50:39.899072+0000","last_clean":"2024-05-09T09:50:39.899072+0000","last_became_active":"2024-05-09T09:47:20.242448+0000","last_became_peered":"2024-05-09T09:47:20.242448+0000","last_unstale":"2024-05-09T09:50:39.899072+0000","last_undegraded":"2024-05-09T09:50:39.899072+0000","last_fullsized":"2024-05-09T09:50:39.899072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:07.968167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.150356+0000","last_change":"2024-05-09T09:47:52.179916+0000","last_active":"2024-05-09T09:50:33.150356+0000","last_peered":"2024-05-09T09:50:33.150356+0000","last_clean":"2024-05-09T09:50:33.150356+0000","last_became_active":"2024-05-09T09:47:52.179059+0000","last_became_peered":"2024-05-09T09:47:52.179059+0000","last_unstale":"2024-05-09T09:50:33.150356+0000","last_undegraded":"2024-05-09T09:50:33.150356+0000","last_fullsized":"2024-05-09T09:50:33.150356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:20:28.160797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.183609+0000","last_change":"2024-05-09T09:47:12.206447+0000","last_active":"2024-05-09T09:47:52.183609+0000","last_peered":"2024-05-09T09:47:52.183609+0000","last_clean":"2024-05-09T09:47:52.183609+0000","last_became_active":"2024-05-09T09:47:12.205259+0000","last_became_peered":"2024-05-09T09:47:12.205259+0000","last_unstale":"2024-05-09T09:47:52.183609+0000","last_undegraded":"2024-05-09T09:47:52.183609+0000","last_fullsized":"2024-05-09T09:47:52.183609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:15.767283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.165019+0000","last_change":"2024-05-09T09:47:16.207890+0000","last_active":"2024-05-09T09:47:52.165019+0000","last_peered":"2024-05-09T09:47:52.165019+0000","last_clean":"2024-05-09T09:47:52.165019+0000","last_became_active":"2024-05-09T09:47:16.207404+0000","last_became_peered":"2024-05-09T09:47:16.207404+0000","last_unstale":"2024-05-09T09:47:52.165019+0000","last_undegraded":"2024-05-09T09:47:52.165019+0000","last_fullsized":"2024-05-09T09:47:52.165019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:51:48.988654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'119","reported_seq":170,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.995944+0000","last_change":"2024-05-09T09:47:18.221550+0000","last_active":"2024-05-09T09:50:39.995944+0000","last_peered":"2024-05-09T09:50:39.995944+0000","last_clean":"2024-05-09T09:50:39.995944+0000","last_became_active":"2024-05-09T09:47:18.220596+0000","last_became_peered":"2024-05-09T09:47:18.220596+0000","last_unstale":"2024-05-09T09:50:39.995944+0000","last_undegraded":"2024-05-09T09:50:39.995944+0000","last_fullsized":"2024-05-09T09:50:39.995944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:03:54.051364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":63,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.420451+0000","last_change":"2024-05-09T09:47:20.246363+0000","last_active":"2024-05-09T09:47:52.420451+0000","last_peered":"2024-05-09T09:47:52.420451+0000","last_clean":"2024-05-09T09:47:52.420451+0000","last_became_active":"2024-05-09T09:47:20.244839+0000","last_became_peered":"2024-05-09T09:47:20.244839+0000","last_unstale":"2024-05-09T09:47:52.420451+0000","last_undegraded":"2024-05-09T09:47:52.420451+0000","last_fullsized":"2024-05-09T09:47:52.420451+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:40:50.226397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.950700+0000","last_change":"2024-05-09T09:47:22.237841+0000","last_active":"2024-05-09T09:50:32.950700+0000","last_peered":"2024-05-09T09:50:32.950700+0000","last_clean":"2024-05-09T09:50:32.950700+0000","last_became_active":"2024-05-09T09:47:22.235895+0000","last_became_peered":"2024-05-09T09:47:22.235895+0000","last_unstale":"2024-05-09T09:50:32.950700+0000","last_undegraded":"2024-05-09T09:50:32.950700+0000","last_fullsized":"2024-05-09T09:50:32.950700+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:59:20.801393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.174181+0000","last_change":"2024-05-09T09:47:14.172537+0000","last_active":"2024-05-09T09:49:25.174181+0000","last_peered":"2024-05-09T09:49:25.174181+0000","last_clean":"2024-05-09T09:49:25.174181+0000","last_became_active":"2024-05-09T09:47:14.172275+0000","last_became_peered":"2024-05-09T09:47:14.172275+0000","last_unstale":"2024-05-09T09:49:25.174181+0000","last_undegraded":"2024-05-09T09:49:25.174181+0000","last_fullsized":"2024-05-09T09:49:25.174181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:16:59.077638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:59.963235+0000","last_change":"2024-05-09T09:47:12.210250+0000","last_active":"2024-05-09T09:47:59.963235+0000","last_peered":"2024-05-09T09:47:59.963235+0000","last_clean":"2024-05-09T09:47:59.963235+0000","last_became_active":"2024-05-09T09:47:12.209274+0000","last_became_peered":"2024-05-09T09:47:12.209274+0000","last_unstale":"2024-05-09T09:47:59.963235+0000","last_undegraded":"2024-05-09T09:47:59.963235+0000","last_fullsized":"2024-05-09T09:47:59.963235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:19:17.059104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.420100+0000","last_change":"2024-05-09T09:47:16.215057+0000","last_active":"2024-05-09T09:47:52.420100+0000","last_peered":"2024-05-09T09:47:52.420100+0000","last_clean":"2024-05-09T09:47:52.420100+0000","last_became_active":"2024-05-09T09:47:16.214484+0000","last_became_peered":"2024-05-09T09:47:16.214484+0000","last_unstale":"2024-05-09T09:47:52.420100+0000","last_undegraded":"2024-05-09T09:47:52.420100+0000","last_fullsized":"2024-05-09T09:47:52.420100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:13:09.787784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'110","reported_seq":156,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.089077+0000","last_change":"2024-05-09T09:47:18.231906+0000","last_active":"2024-05-09T09:50:40.089077+0000","last_peered":"2024-05-09T09:50:40.089077+0000","last_clean":"2024-05-09T09:50:40.089077+0000","last_became_active":"2024-05-09T09:47:18.224815+0000","last_became_peered":"2024-05-09T09:47:18.224815+0000","last_unstale":"2024-05-09T09:50:40.089077+0000","last_undegraded":"2024-05-09T09:50:40.089077+0000","last_fullsized":"2024-05-09T09:50:40.089077+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:55:53.240395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.412400+0000","last_change":"2024-05-09T09:47:20.251863+0000","last_active":"2024-05-09T09:47:52.412400+0000","last_peered":"2024-05-09T09:47:52.412400+0000","last_clean":"2024-05-09T09:47:52.412400+0000","last_became_active":"2024-05-09T09:47:20.250686+0000","last_became_peered":"2024-05-09T09:47:20.250686+0000","last_unstale":"2024-05-09T09:47:52.412400+0000","last_undegraded":"2024-05-09T09:47:52.412400+0000","last_fullsized":"2024-05-09T09:47:52.412400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:37:23.903396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'17","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.338642+0000","last_change":"2024-05-09T09:47:22.255914+0000","last_active":"2024-05-09T09:50:32.338642+0000","last_peered":"2024-05-09T09:50:32.338642+0000","last_clean":"2024-05-09T09:50:32.338642+0000","last_became_active":"2024-05-09T09:47:22.255076+0000","last_became_peered":"2024-05-09T09:47:22.255076+0000","last_unstale":"2024-05-09T09:50:32.338642+0000","last_undegraded":"2024-05-09T09:50:32.338642+0000","last_fullsized":"2024-05-09T09:50:32.338642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:25:35.144336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":92,"num_read_kb":72,"num_write":55,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.173175+0000","last_change":"2024-05-09T09:47:14.180737+0000","last_active":"2024-05-09T09:47:52.173175+0000","last_peered":"2024-05-09T09:47:52.173175+0000","last_clean":"2024-05-09T09:47:52.173175+0000","last_became_active":"2024-05-09T09:47:14.180185+0000","last_became_peered":"2024-05-09T09:47:14.180185+0000","last_unstale":"2024-05-09T09:47:52.173175+0000","last_undegraded":"2024-05-09T09:47:52.173175+0000","last_fullsized":"2024-05-09T09:47:52.173175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:44.612188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:59.962280+0000","last_change":"2024-05-09T09:47:12.211357+0000","last_active":"2024-05-09T09:47:59.962280+0000","last_peered":"2024-05-09T09:47:59.962280+0000","last_clean":"2024-05-09T09:47:59.962280+0000","last_became_active":"2024-05-09T09:47:12.207751+0000","last_became_peered":"2024-05-09T09:47:12.207751+0000","last_unstale":"2024-05-09T09:47:59.962280+0000","last_undegraded":"2024-05-09T09:47:59.962280+0000","last_fullsized":"2024-05-09T09:47:59.962280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:41:27.203063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.427281+0000","last_change":"2024-05-09T09:47:16.208197+0000","last_active":"2024-05-09T09:47:52.427281+0000","last_peered":"2024-05-09T09:47:52.427281+0000","last_clean":"2024-05-09T09:47:52.427281+0000","last_became_active":"2024-05-09T09:47:16.207734+0000","last_became_peered":"2024-05-09T09:47:16.207734+0000","last_unstale":"2024-05-09T09:47:52.427281+0000","last_undegraded":"2024-05-09T09:47:52.427281+0000","last_fullsized":"2024-05-09T09:47:52.427281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:57:13.986799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'113","reported_seq":162,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.004174+0000","last_change":"2024-05-09T09:47:18.231116+0000","last_active":"2024-05-09T09:50:40.004174+0000","last_peered":"2024-05-09T09:50:40.004174+0000","last_clean":"2024-05-09T09:50:40.004174+0000","last_became_active":"2024-05-09T09:47:18.230440+0000","last_became_peered":"2024-05-09T09:47:18.230440+0000","last_unstale":"2024-05-09T09:50:40.004174+0000","last_undegraded":"2024-05-09T09:50:40.004174+0000","last_fullsized":"2024-05-09T09:50:40.004174+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:05:58.884035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'284","reported_seq":352,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.901211+0000","last_change":"2024-05-09T09:47:20.254991+0000","last_active":"2024-05-09T09:50:39.901211+0000","last_peered":"2024-05-09T09:50:39.901211+0000","last_clean":"2024-05-09T09:50:39.901211+0000","last_became_active":"2024-05-09T09:47:20.254305+0000","last_became_peered":"2024-05-09T09:47:20.254305+0000","last_unstale":"2024-05-09T09:50:39.901211+0000","last_undegraded":"2024-05-09T09:50:39.901211+0000","last_fullsized":"2024-05-09T09:50:39.901211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:35:09.855318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.424385+0000","last_change":"2024-05-09T09:47:22.239987+0000","last_active":"2024-05-09T09:47:52.424385+0000","last_peered":"2024-05-09T09:47:52.424385+0000","last_clean":"2024-05-09T09:47:52.424385+0000","last_became_active":"2024-05-09T09:47:22.239262+0000","last_became_peered":"2024-05-09T09:47:22.239262+0000","last_unstale":"2024-05-09T09:47:52.424385+0000","last_undegraded":"2024-05-09T09:47:52.424385+0000","last_fullsized":"2024-05-09T09:47:52.424385+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:19:34.324968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'8","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:45.864227+0000","last_change":"2024-05-09T09:47:14.184937+0000","last_active":"2024-05-09T09:48:45.864227+0000","last_peered":"2024-05-09T09:48:45.864227+0000","last_clean":"2024-05-09T09:48:45.864227+0000","last_became_active":"2024-05-09T09:47:14.184593+0000","last_became_peered":"2024-05-09T09:47:14.184593+0000","last_unstale":"2024-05-09T09:48:45.864227+0000","last_undegraded":"2024-05-09T09:48:45.864227+0000","last_fullsized":"2024-05-09T09:48:45.864227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:30:37.903160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'8","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.754083+0000","last_change":"2024-05-09T09:47:12.211539+0000","last_active":"2024-05-09T09:50:32.754083+0000","last_peered":"2024-05-09T09:50:32.754083+0000","last_clean":"2024-05-09T09:50:32.754083+0000","last_became_active":"2024-05-09T09:47:12.207403+0000","last_became_peered":"2024-05-09T09:47:12.207403+0000","last_unstale":"2024-05-09T09:50:32.754083+0000","last_undegraded":"2024-05-09T09:50:32.754083+0000","last_fullsized":"2024-05-09T09:50:32.754083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:20:53.292716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":16,"num_write_kb":8838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.419204+0000","last_change":"2024-05-09T09:47:16.215117+0000","last_active":"2024-05-09T09:47:52.419204+0000","last_peered":"2024-05-09T09:47:52.419204+0000","last_clean":"2024-05-09T09:47:52.419204+0000","last_became_active":"2024-05-09T09:47:16.214607+0000","last_became_peered":"2024-05-09T09:47:16.214607+0000","last_unstale":"2024-05-09T09:47:52.419204+0000","last_undegraded":"2024-05-09T09:47:52.419204+0000","last_fullsized":"2024-05-09T09:47:52.419204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:25:29.477094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'209","reported_seq":273,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.108458+0000","last_change":"2024-05-09T09:47:18.225638+0000","last_active":"2024-05-09T09:50:40.108458+0000","last_peered":"2024-05-09T09:50:40.108458+0000","last_clean":"2024-05-09T09:50:40.108458+0000","last_became_active":"2024-05-09T09:47:18.224893+0000","last_became_peered":"2024-05-09T09:47:18.224893+0000","last_unstale":"2024-05-09T09:50:40.108458+0000","last_undegraded":"2024-05-09T09:50:40.108458+0000","last_fullsized":"2024-05-09T09:50:40.108458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:04:53.766220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.413967+0000","last_change":"2024-05-09T09:47:20.229087+0000","last_active":"2024-05-09T09:47:52.413967+0000","last_peered":"2024-05-09T09:47:52.413967+0000","last_clean":"2024-05-09T09:47:52.413967+0000","last_became_active":"2024-05-09T09:47:20.228339+0000","last_became_peered":"2024-05-09T09:47:20.228339+0000","last_unstale":"2024-05-09T09:47:52.413967+0000","last_undegraded":"2024-05-09T09:47:52.413967+0000","last_fullsized":"2024-05-09T09:47:52.413967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:36.440080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.461775+0000","last_change":"2024-05-09T09:47:22.230031+0000","last_active":"2024-05-09T09:50:33.461775+0000","last_peered":"2024-05-09T09:50:33.461775+0000","last_clean":"2024-05-09T09:50:33.461775+0000","last_became_active":"2024-05-09T09:47:22.229193+0000","last_became_peered":"2024-05-09T09:47:22.229193+0000","last_unstale":"2024-05-09T09:50:33.461775+0000","last_undegraded":"2024-05-09T09:50:33.461775+0000","last_fullsized":"2024-05-09T09:50:33.461775+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:48:21.332216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.239007+0000","last_change":"2024-05-09T09:47:14.177074+0000","last_active":"2024-05-09T09:50:33.239007+0000","last_peered":"2024-05-09T09:50:33.239007+0000","last_clean":"2024-05-09T09:50:33.239007+0000","last_became_active":"2024-05-09T09:47:14.176717+0000","last_became_peered":"2024-05-09T09:47:14.176717+0000","last_unstale":"2024-05-09T09:50:33.239007+0000","last_undegraded":"2024-05-09T09:50:33.239007+0000","last_fullsized":"2024-05-09T09:50:33.239007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:44:03.763451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.420829+0000","last_change":"2024-05-09T09:47:12.205840+0000","last_active":"2024-05-09T09:47:52.420829+0000","last_peered":"2024-05-09T09:47:52.420829+0000","last_clean":"2024-05-09T09:47:52.420829+0000","last_became_active":"2024-05-09T09:47:12.204317+0000","last_became_peered":"2024-05-09T09:47:12.204317+0000","last_unstale":"2024-05-09T09:47:52.420829+0000","last_undegraded":"2024-05-09T09:47:52.420829+0000","last_fullsized":"2024-05-09T09:47:52.420829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:00:05.597093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.182486+0000","last_change":"2024-05-09T09:47:16.201348+0000","last_active":"2024-05-09T09:47:52.182486+0000","last_peered":"2024-05-09T09:47:52.182486+0000","last_clean":"2024-05-09T09:47:52.182486+0000","last_became_active":"2024-05-09T09:47:16.197031+0000","last_became_peered":"2024-05-09T09:47:16.197031+0000","last_unstale":"2024-05-09T09:47:52.182486+0000","last_undegraded":"2024-05-09T09:47:52.182486+0000","last_fullsized":"2024-05-09T09:47:52.182486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:01:00.598993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'109","reported_seq":156,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.115983+0000","last_change":"2024-05-09T09:47:18.216586+0000","last_active":"2024-05-09T09:50:40.115983+0000","last_peered":"2024-05-09T09:50:40.115983+0000","last_clean":"2024-05-09T09:50:40.115983+0000","last_became_active":"2024-05-09T09:47:18.215793+0000","last_became_peered":"2024-05-09T09:47:18.215793+0000","last_unstale":"2024-05-09T09:50:40.115983+0000","last_undegraded":"2024-05-09T09:50:40.115983+0000","last_fullsized":"2024-05-09T09:50:40.115983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:36:23.945979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.196563+0000","last_change":"2024-05-09T09:47:20.251219+0000","last_active":"2024-05-09T09:47:52.196563+0000","last_peered":"2024-05-09T09:47:52.196563+0000","last_clean":"2024-05-09T09:47:52.196563+0000","last_became_active":"2024-05-09T09:47:20.250363+0000","last_became_peered":"2024-05-09T09:47:20.250363+0000","last_unstale":"2024-05-09T09:47:52.196563+0000","last_undegraded":"2024-05-09T09:47:52.196563+0000","last_fullsized":"2024-05-09T09:47:52.196563+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:59:21.981954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:29.007272+0000","last_change":"2024-05-09T09:47:22.243140+0000","last_active":"2024-05-09T09:49:29.007272+0000","last_peered":"2024-05-09T09:49:29.007272+0000","last_clean":"2024-05-09T09:49:29.007272+0000","last_became_active":"2024-05-09T09:47:22.242410+0000","last_became_peered":"2024-05-09T09:47:22.242410+0000","last_unstale":"2024-05-09T09:49:29.007272+0000","last_undegraded":"2024-05-09T09:49:29.007272+0000","last_fullsized":"2024-05-09T09:49:29.007272+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:49:33.614704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:01.438873+0000","last_change":"2024-05-09T09:47:14.190653+0000","last_active":"2024-05-09T09:48:01.438873+0000","last_peered":"2024-05-09T09:48:01.438873+0000","last_clean":"2024-05-09T09:48:01.438873+0000","last_became_active":"2024-05-09T09:47:14.190016+0000","last_became_peered":"2024-05-09T09:47:14.190016+0000","last_unstale":"2024-05-09T09:48:01.438873+0000","last_undegraded":"2024-05-09T09:48:01.438873+0000","last_fullsized":"2024-05-09T09:48:01.438873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:03.774479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.178134+0000","last_change":"2024-05-09T09:47:12.212155+0000","last_active":"2024-05-09T09:47:52.178134+0000","last_peered":"2024-05-09T09:47:52.178134+0000","last_clean":"2024-05-09T09:47:52.178134+0000","last_became_active":"2024-05-09T09:47:12.211221+0000","last_became_peered":"2024-05-09T09:47:12.211221+0000","last_unstale":"2024-05-09T09:47:52.178134+0000","last_undegraded":"2024-05-09T09:47:52.178134+0000","last_fullsized":"2024-05-09T09:47:52.178134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:35:10.235355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.423260+0000","last_change":"2024-05-09T09:47:16.215089+0000","last_active":"2024-05-09T09:47:52.423260+0000","last_peered":"2024-05-09T09:47:52.423260+0000","last_clean":"2024-05-09T09:47:52.423260+0000","last_became_active":"2024-05-09T09:47:16.214462+0000","last_became_peered":"2024-05-09T09:47:16.214462+0000","last_unstale":"2024-05-09T09:47:52.423260+0000","last_undegraded":"2024-05-09T09:47:52.423260+0000","last_fullsized":"2024-05-09T09:47:52.423260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:34:32.813103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'113","reported_seq":162,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.052078+0000","last_change":"2024-05-09T09:47:18.213308+0000","last_active":"2024-05-09T09:50:40.052078+0000","last_peered":"2024-05-09T09:50:40.052078+0000","last_clean":"2024-05-09T09:50:40.052078+0000","last_became_active":"2024-05-09T09:47:18.212543+0000","last_became_peered":"2024-05-09T09:47:18.212543+0000","last_unstale":"2024-05-09T09:50:40.052078+0000","last_undegraded":"2024-05-09T09:50:40.052078+0000","last_fullsized":"2024-05-09T09:50:40.052078+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:51:51.001188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'284","reported_seq":435,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.892724+0000","last_change":"2024-05-09T09:47:20.240819+0000","last_active":"2024-05-09T09:50:39.892724+0000","last_peered":"2024-05-09T09:50:39.892724+0000","last_clean":"2024-05-09T09:50:39.892724+0000","last_became_active":"2024-05-09T09:47:20.240236+0000","last_became_peered":"2024-05-09T09:47:20.240236+0000","last_unstale":"2024-05-09T09:50:39.892724+0000","last_undegraded":"2024-05-09T09:50:39.892724+0000","last_fullsized":"2024-05-09T09:50:39.892724+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:36:25.958106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'14","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.031493+0000","last_change":"2024-05-09T09:47:22.258681+0000","last_active":"2024-05-09T09:49:32.031493+0000","last_peered":"2024-05-09T09:49:32.031493+0000","last_clean":"2024-05-09T09:49:32.031493+0000","last_became_active":"2024-05-09T09:47:22.257986+0000","last_became_peered":"2024-05-09T09:47:22.257986+0000","last_unstale":"2024-05-09T09:49:32.031493+0000","last_undegraded":"2024-05-09T09:49:32.031493+0000","last_fullsized":"2024-05-09T09:49:32.031493+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:25:35.144336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.238754+0000","last_change":"2024-05-09T09:47:14.173042+0000","last_active":"2024-05-09T09:50:33.238754+0000","last_peered":"2024-05-09T09:50:33.238754+0000","last_clean":"2024-05-09T09:50:33.238754+0000","last_became_active":"2024-05-09T09:47:14.171963+0000","last_became_peered":"2024-05-09T09:47:14.171963+0000","last_unstale":"2024-05-09T09:50:33.238754+0000","last_undegraded":"2024-05-09T09:50:33.238754+0000","last_fullsized":"2024-05-09T09:50:33.238754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:32:19.275039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.181005+0000","last_change":"2024-05-09T09:47:12.211112+0000","last_active":"2024-05-09T09:47:52.181005+0000","last_peered":"2024-05-09T09:47:52.181005+0000","last_clean":"2024-05-09T09:47:52.181005+0000","last_became_active":"2024-05-09T09:47:12.204519+0000","last_became_peered":"2024-05-09T09:47:12.204519+0000","last_unstale":"2024-05-09T09:47:52.181005+0000","last_undegraded":"2024-05-09T09:47:52.181005+0000","last_fullsized":"2024-05-09T09:47:52.181005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:35:14.637438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":417,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.865062+0000","last_change":"2024-05-09T09:47:16.211670+0000","last_active":"2024-05-09T09:50:39.865062+0000","last_peered":"2024-05-09T09:50:39.865062+0000","last_clean":"2024-05-09T09:50:39.865062+0000","last_became_active":"2024-05-09T09:47:16.210812+0000","last_became_peered":"2024-05-09T09:47:16.210812+0000","last_unstale":"2024-05-09T09:50:39.865062+0000","last_undegraded":"2024-05-09T09:50:39.865062+0000","last_fullsized":"2024-05-09T09:50:39.865062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:41.390200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.190863+0000","last_change":"2024-05-09T09:47:18.225280+0000","last_active":"2024-05-09T09:47:52.190863+0000","last_peered":"2024-05-09T09:47:52.190863+0000","last_clean":"2024-05-09T09:47:52.190863+0000","last_became_active":"2024-05-09T09:47:18.224565+0000","last_became_peered":"2024-05-09T09:47:18.224565+0000","last_unstale":"2024-05-09T09:47:52.190863+0000","last_undegraded":"2024-05-09T09:47:52.190863+0000","last_fullsized":"2024-05-09T09:47:52.190863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:53:57.817020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'284","reported_seq":472,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.894617+0000","last_change":"2024-05-09T09:47:20.215231+0000","last_active":"2024-05-09T09:50:39.894617+0000","last_peered":"2024-05-09T09:50:39.894617+0000","last_clean":"2024-05-09T09:50:39.894617+0000","last_became_active":"2024-05-09T09:47:20.214337+0000","last_became_peered":"2024-05-09T09:47:20.214337+0000","last_unstale":"2024-05-09T09:50:39.894617+0000","last_undegraded":"2024-05-09T09:50:39.894617+0000","last_fullsized":"2024-05-09T09:50:39.894617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:35:09.855318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.761634+0000","last_change":"2024-05-09T09:47:22.235441+0000","last_active":"2024-05-09T09:49:31.761634+0000","last_peered":"2024-05-09T09:49:31.761634+0000","last_clean":"2024-05-09T09:49:31.761634+0000","last_became_active":"2024-05-09T09:47:22.233796+0000","last_became_peered":"2024-05-09T09:47:22.233796+0000","last_unstale":"2024-05-09T09:49:31.761634+0000","last_undegraded":"2024-05-09T09:49:31.761634+0000","last_fullsized":"2024-05-09T09:49:31.761634+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:25:18.746306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.164264+0000","last_change":"2024-05-09T09:47:14.175270+0000","last_active":"2024-05-09T09:49:32.164264+0000","last_peered":"2024-05-09T09:49:32.164264+0000","last_clean":"2024-05-09T09:49:32.164264+0000","last_became_active":"2024-05-09T09:47:14.174707+0000","last_became_peered":"2024-05-09T09:47:14.174707+0000","last_unstale":"2024-05-09T09:49:32.164264+0000","last_undegraded":"2024-05-09T09:49:32.164264+0000","last_fullsized":"2024-05-09T09:49:32.164264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:54:18.468178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:01.759832+0000","last_change":"2024-05-09T09:47:12.208521+0000","last_active":"2024-05-09T09:48:01.759832+0000","last_peered":"2024-05-09T09:48:01.759832+0000","last_clean":"2024-05-09T09:48:01.759832+0000","last_became_active":"2024-05-09T09:47:12.207874+0000","last_became_peered":"2024-05-09T09:47:12.207874+0000","last_unstale":"2024-05-09T09:48:01.759832+0000","last_undegraded":"2024-05-09T09:48:01.759832+0000","last_fullsized":"2024-05-09T09:48:01.759832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:30:35.883636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"23'1","reported_seq":220,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.849555+0000","last_change":"2024-05-09T09:47:16.205195+0000","last_active":"2024-05-09T09:50:39.849555+0000","last_peered":"2024-05-09T09:50:39.849555+0000","last_clean":"2024-05-09T09:50:39.849555+0000","last_became_active":"2024-05-09T09:47:16.204577+0000","last_became_peered":"2024-05-09T09:47:16.204577+0000","last_unstale":"2024-05-09T09:50:39.849555+0000","last_undegraded":"2024-05-09T09:50:39.849555+0000","last_fullsized":"2024-05-09T09:50:39.849555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:40:46.201735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'115","reported_seq":165,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.981858+0000","last_change":"2024-05-09T09:47:18.204810+0000","last_active":"2024-05-09T09:50:39.981858+0000","last_peered":"2024-05-09T09:50:39.981858+0000","last_clean":"2024-05-09T09:50:39.981858+0000","last_became_active":"2024-05-09T09:47:18.204057+0000","last_became_peered":"2024-05-09T09:47:18.204057+0000","last_unstale":"2024-05-09T09:50:39.981858+0000","last_undegraded":"2024-05-09T09:50:39.981858+0000","last_fullsized":"2024-05-09T09:50:39.981858+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:27:23.487170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.178557+0000","last_change":"2024-05-09T09:47:20.255850+0000","last_active":"2024-05-09T09:47:52.178557+0000","last_peered":"2024-05-09T09:47:52.178557+0000","last_clean":"2024-05-09T09:47:52.178557+0000","last_became_active":"2024-05-09T09:47:20.255477+0000","last_became_peered":"2024-05-09T09:47:20.255477+0000","last_unstale":"2024-05-09T09:47:52.178557+0000","last_undegraded":"2024-05-09T09:47:52.178557+0000","last_fullsized":"2024-05-09T09:47:52.178557+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:09.812329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'8","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.372509+0000","last_change":"2024-05-09T09:47:22.228107+0000","last_active":"2024-05-09T09:50:33.372509+0000","last_peered":"2024-05-09T09:50:33.372509+0000","last_clean":"2024-05-09T09:50:33.372509+0000","last_became_active":"2024-05-09T09:47:22.227373+0000","last_became_peered":"2024-05-09T09:47:22.227373+0000","last_unstale":"2024-05-09T09:50:33.372509+0000","last_undegraded":"2024-05-09T09:50:33.372509+0000","last_fullsized":"2024-05-09T09:50:33.372509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:22:52.362489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'7","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.172569+0000","last_change":"2024-05-09T09:47:14.189976+0000","last_active":"2024-05-09T09:49:20.172569+0000","last_peered":"2024-05-09T09:49:20.172569+0000","last_clean":"2024-05-09T09:49:20.172569+0000","last_became_active":"2024-05-09T09:47:14.189623+0000","last_became_peered":"2024-05-09T09:47:14.189623+0000","last_unstale":"2024-05-09T09:49:20.172569+0000","last_undegraded":"2024-05-09T09:49:20.172569+0000","last_fullsized":"2024-05-09T09:49:20.172569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:21.387148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":202,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.163439+0000","last_change":"2024-05-09T09:46:57.510904+0000","last_active":"2024-05-09T09:47:52.163439+0000","last_peered":"2024-05-09T09:47:52.163439+0000","last_clean":"2024-05-09T09:47:52.163439+0000","last_became_active":"2024-05-09T09:46:57.508178+0000","last_became_peered":"2024-05-09T09:46:57.508178+0000","last_unstale":"2024-05-09T09:47:52.163439+0000","last_undegraded":"2024-05-09T09:47:52.163439+0000","last_fullsized":"2024-05-09T09:47:52.163439+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:46:56.015260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:46:56.015260+0000","last_clean_scrub_stamp":"2024-05-09T09:46:56.015260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:04:32.521129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.187056+0000","last_change":"2024-05-09T09:47:03.054623+0000","last_active":"2024-05-09T09:47:52.187056+0000","last_peered":"2024-05-09T09:47:52.187056+0000","last_clean":"2024-05-09T09:47:52.187056+0000","last_became_active":"2024-05-09T09:47:03.053783+0000","last_became_peered":"2024-05-09T09:47:03.053783+0000","last_unstale":"2024-05-09T09:47:52.187056+0000","last_undegraded":"2024-05-09T09:47:52.187056+0000","last_fullsized":"2024-05-09T09:47:52.187056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:12:39.792983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.176479+0000","last_change":"2024-05-09T09:47:12.212397+0000","last_active":"2024-05-09T09:47:52.176479+0000","last_peered":"2024-05-09T09:47:52.176479+0000","last_clean":"2024-05-09T09:47:52.176479+0000","last_became_active":"2024-05-09T09:47:12.211344+0000","last_became_peered":"2024-05-09T09:47:12.211344+0000","last_unstale":"2024-05-09T09:47:52.176479+0000","last_undegraded":"2024-05-09T09:47:52.176479+0000","last_fullsized":"2024-05-09T09:47:52.176479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:42.592663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.170165+0000","last_change":"2024-05-09T09:47:16.211676+0000","last_active":"2024-05-09T09:47:52.170165+0000","last_peered":"2024-05-09T09:47:52.170165+0000","last_clean":"2024-05-09T09:47:52.170165+0000","last_became_active":"2024-05-09T09:47:16.210404+0000","last_became_peered":"2024-05-09T09:47:16.210404+0000","last_unstale":"2024-05-09T09:47:52.170165+0000","last_undegraded":"2024-05-09T09:47:52.170165+0000","last_fullsized":"2024-05-09T09:47:52.170165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:29:50.436846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'307","reported_seq":388,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.185873+0000","last_change":"2024-05-09T09:47:18.237058+0000","last_active":"2024-05-09T09:50:40.185873+0000","last_peered":"2024-05-09T09:50:40.185873+0000","last_clean":"2024-05-09T09:50:40.185873+0000","last_became_active":"2024-05-09T09:47:18.236370+0000","last_became_peered":"2024-05-09T09:47:18.236370+0000","last_unstale":"2024-05-09T09:50:40.185873+0000","last_undegraded":"2024-05-09T09:50:40.185873+0000","last_fullsized":"2024-05-09T09:50:40.185873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:35:27.710372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.423093+0000","last_change":"2024-05-09T09:47:20.251241+0000","last_active":"2024-05-09T09:47:52.423093+0000","last_peered":"2024-05-09T09:47:52.423093+0000","last_clean":"2024-05-09T09:47:52.423093+0000","last_became_active":"2024-05-09T09:47:20.250373+0000","last_became_peered":"2024-05-09T09:47:20.250373+0000","last_unstale":"2024-05-09T09:47:52.423093+0000","last_undegraded":"2024-05-09T09:47:52.423093+0000","last_fullsized":"2024-05-09T09:47:52.423093+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:20:34.198648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'86","reported_seq":169,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.328990+0000","last_change":"2024-05-09T09:47:22.237003+0000","last_active":"2024-05-09T09:50:33.328990+0000","last_peered":"2024-05-09T09:50:33.328990+0000","last_clean":"2024-05-09T09:50:33.328990+0000","last_became_active":"2024-05-09T09:47:22.236267+0000","last_became_peered":"2024-05-09T09:47:22.236267+0000","last_unstale":"2024-05-09T09:50:33.328990+0000","last_undegraded":"2024-05-09T09:50:33.328990+0000","last_fullsized":"2024-05-09T09:50:33.328990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:08.206306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":223,"num_write":170,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:01.804496+0000","last_change":"2024-05-09T09:47:14.185397+0000","last_active":"2024-05-09T09:48:01.804496+0000","last_peered":"2024-05-09T09:48:01.804496+0000","last_clean":"2024-05-09T09:48:01.804496+0000","last_became_active":"2024-05-09T09:47:14.185071+0000","last_became_peered":"2024-05-09T09:47:14.185071+0000","last_unstale":"2024-05-09T09:48:01.804496+0000","last_undegraded":"2024-05-09T09:48:01.804496+0000","last_fullsized":"2024-05-09T09:48:01.804496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:49:40.986014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.168817+0000","last_change":"2024-05-09T09:47:03.051628+0000","last_active":"2024-05-09T09:47:52.168817+0000","last_peered":"2024-05-09T09:47:52.168817+0000","last_clean":"2024-05-09T09:47:52.168817+0000","last_became_active":"2024-05-09T09:47:03.050535+0000","last_became_peered":"2024-05-09T09:47:03.050535+0000","last_unstale":"2024-05-09T09:47:52.168817+0000","last_undegraded":"2024-05-09T09:47:52.168817+0000","last_fullsized":"2024-05-09T09:47:52.168817+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:09:16.875087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:46.145259+0000","last_change":"2024-05-09T09:47:12.206331+0000","last_active":"2024-05-09T09:48:46.145259+0000","last_peered":"2024-05-09T09:48:46.145259+0000","last_clean":"2024-05-09T09:48:46.145259+0000","last_became_active":"2024-05-09T09:47:12.203494+0000","last_became_peered":"2024-05-09T09:47:12.203494+0000","last_unstale":"2024-05-09T09:48:46.145259+0000","last_undegraded":"2024-05-09T09:48:46.145259+0000","last_fullsized":"2024-05-09T09:48:46.145259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:55.107119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.196899+0000","last_change":"2024-05-09T09:47:16.201019+0000","last_active":"2024-05-09T09:47:52.196899+0000","last_peered":"2024-05-09T09:47:52.196899+0000","last_clean":"2024-05-09T09:47:52.196899+0000","last_became_active":"2024-05-09T09:47:16.200369+0000","last_became_peered":"2024-05-09T09:47:16.200369+0000","last_unstale":"2024-05-09T09:47:52.196899+0000","last_undegraded":"2024-05-09T09:47:52.196899+0000","last_fullsized":"2024-05-09T09:47:52.196899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:03.943505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'506","reported_seq":724,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.180636+0000","last_change":"2024-05-09T09:47:18.220093+0000","last_active":"2024-05-09T09:50:40.180636+0000","last_peered":"2024-05-09T09:50:40.180636+0000","last_clean":"2024-05-09T09:50:40.180636+0000","last_became_active":"2024-05-09T09:47:18.219321+0000","last_became_peered":"2024-05-09T09:47:18.219321+0000","last_unstale":"2024-05-09T09:50:40.180636+0000","last_undegraded":"2024-05-09T09:50:40.180636+0000","last_fullsized":"2024-05-09T09:50:40.180636+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:07.800202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.191188+0000","last_change":"2024-05-09T09:47:20.249740+0000","last_active":"2024-05-09T09:47:52.191188+0000","last_peered":"2024-05-09T09:47:52.191188+0000","last_clean":"2024-05-09T09:47:52.191188+0000","last_became_active":"2024-05-09T09:47:20.249089+0000","last_became_peered":"2024-05-09T09:47:20.249089+0000","last_unstale":"2024-05-09T09:47:52.191188+0000","last_undegraded":"2024-05-09T09:47:52.191188+0000","last_fullsized":"2024-05-09T09:47:52.191188+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:15:27.189938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:45.869681+0000","last_change":"2024-05-09T09:47:22.245460+0000","last_active":"2024-05-09T09:48:45.869681+0000","last_peered":"2024-05-09T09:48:45.869681+0000","last_clean":"2024-05-09T09:48:45.869681+0000","last_became_active":"2024-05-09T09:47:22.244543+0000","last_became_peered":"2024-05-09T09:47:22.244543+0000","last_unstale":"2024-05-09T09:48:45.869681+0000","last_undegraded":"2024-05-09T09:48:45.869681+0000","last_fullsized":"2024-05-09T09:48:45.869681+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:59:48.546473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.150108+0000","last_change":"2024-05-09T09:47:14.177030+0000","last_active":"2024-05-09T09:50:33.150108+0000","last_peered":"2024-05-09T09:50:33.150108+0000","last_clean":"2024-05-09T09:50:33.150108+0000","last_became_active":"2024-05-09T09:47:14.173959+0000","last_became_peered":"2024-05-09T09:47:14.173959+0000","last_unstale":"2024-05-09T09:50:33.150108+0000","last_undegraded":"2024-05-09T09:50:33.150108+0000","last_fullsized":"2024-05-09T09:50:33.150108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:57.831374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.167819+0000","last_change":"2024-05-09T09:47:03.052957+0000","last_active":"2024-05-09T09:47:52.167819+0000","last_peered":"2024-05-09T09:47:52.167819+0000","last_clean":"2024-05-09T09:47:52.167819+0000","last_became_active":"2024-05-09T09:47:03.052185+0000","last_became_peered":"2024-05-09T09:47:03.052185+0000","last_unstale":"2024-05-09T09:47:52.167819+0000","last_undegraded":"2024-05-09T09:47:52.167819+0000","last_fullsized":"2024-05-09T09:47:52.167819+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:48:39.354125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.102108+0000","last_change":"2024-05-09T09:47:12.186149+0000","last_active":"2024-05-09T09:50:33.102108+0000","last_peered":"2024-05-09T09:50:33.102108+0000","last_clean":"2024-05-09T09:50:33.102108+0000","last_became_active":"2024-05-09T09:47:12.183846+0000","last_became_peered":"2024-05-09T09:47:12.183846+0000","last_unstale":"2024-05-09T09:50:33.102108+0000","last_undegraded":"2024-05-09T09:50:33.102108+0000","last_fullsized":"2024-05-09T09:50:33.102108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:46.107016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.185095+0000","last_change":"2024-05-09T09:47:16.202023+0000","last_active":"2024-05-09T09:47:52.185095+0000","last_peered":"2024-05-09T09:47:52.185095+0000","last_clean":"2024-05-09T09:47:52.185095+0000","last_became_active":"2024-05-09T09:47:16.197380+0000","last_became_peered":"2024-05-09T09:47:16.197380+0000","last_unstale":"2024-05-09T09:47:52.185095+0000","last_undegraded":"2024-05-09T09:47:52.185095+0000","last_fullsized":"2024-05-09T09:47:52.185095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:23:20.908060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'18","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:31.469305+0000","last_change":"2024-05-09T09:47:18.218553+0000","last_active":"2024-05-09T09:50:31.469305+0000","last_peered":"2024-05-09T09:50:31.469305+0000","last_clean":"2024-05-09T09:50:31.469305+0000","last_became_active":"2024-05-09T09:47:18.217023+0000","last_became_peered":"2024-05-09T09:47:18.217023+0000","last_unstale":"2024-05-09T09:50:31.469305+0000","last_undegraded":"2024-05-09T09:50:31.469305+0000","last_fullsized":"2024-05-09T09:50:31.469305+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:31.382403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.420979+0000","last_change":"2024-05-09T09:47:20.251883+0000","last_active":"2024-05-09T09:47:52.420979+0000","last_peered":"2024-05-09T09:47:52.420979+0000","last_clean":"2024-05-09T09:47:52.420979+0000","last_became_active":"2024-05-09T09:47:20.250979+0000","last_became_peered":"2024-05-09T09:47:20.250979+0000","last_unstale":"2024-05-09T09:47:52.420979+0000","last_undegraded":"2024-05-09T09:47:52.420979+0000","last_fullsized":"2024-05-09T09:47:52.420979+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:41:44.382613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.176855+0000","last_change":"2024-05-09T09:47:22.264183+0000","last_active":"2024-05-09T09:47:52.176855+0000","last_peered":"2024-05-09T09:47:52.176855+0000","last_clean":"2024-05-09T09:47:52.176855+0000","last_became_active":"2024-05-09T09:47:22.263615+0000","last_became_peered":"2024-05-09T09:47:22.263615+0000","last_unstale":"2024-05-09T09:47:52.176855+0000","last_undegraded":"2024-05-09T09:47:52.176855+0000","last_fullsized":"2024-05-09T09:47:52.176855+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:55:41.434447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'4","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:00.834605+0000","last_change":"2024-05-09T09:47:14.190245+0000","last_active":"2024-05-09T09:48:00.834605+0000","last_peered":"2024-05-09T09:48:00.834605+0000","last_clean":"2024-05-09T09:48:00.834605+0000","last_became_active":"2024-05-09T09:47:14.188644+0000","last_became_peered":"2024-05-09T09:47:14.188644+0000","last_unstale":"2024-05-09T09:48:00.834605+0000","last_undegraded":"2024-05-09T09:48:00.834605+0000","last_fullsized":"2024-05-09T09:48:00.834605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:41:29.222588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.173230+0000","last_change":"2024-05-09T09:47:03.051760+0000","last_active":"2024-05-09T09:47:52.173230+0000","last_peered":"2024-05-09T09:47:52.173230+0000","last_clean":"2024-05-09T09:47:52.173230+0000","last_became_active":"2024-05-09T09:47:03.050832+0000","last_became_peered":"2024-05-09T09:47:03.050832+0000","last_unstale":"2024-05-09T09:47:52.173230+0000","last_undegraded":"2024-05-09T09:47:52.173230+0000","last_fullsized":"2024-05-09T09:47:52.173230+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:47.680871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.179110+0000","last_change":"2024-05-09T09:47:12.191109+0000","last_active":"2024-05-09T09:47:52.179110+0000","last_peered":"2024-05-09T09:47:52.179110+0000","last_clean":"2024-05-09T09:47:52.179110+0000","last_became_active":"2024-05-09T09:47:12.190521+0000","last_became_peered":"2024-05-09T09:47:12.190521+0000","last_unstale":"2024-05-09T09:47:52.179110+0000","last_undegraded":"2024-05-09T09:47:52.179110+0000","last_fullsized":"2024-05-09T09:47:52.179110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:14:11.726333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.423038+0000","last_change":"2024-05-09T09:47:16.189464+0000","last_active":"2024-05-09T09:47:52.423038+0000","last_peered":"2024-05-09T09:47:52.423038+0000","last_clean":"2024-05-09T09:47:52.423038+0000","last_became_active":"2024-05-09T09:47:16.187120+0000","last_became_peered":"2024-05-09T09:47:16.187120+0000","last_unstale":"2024-05-09T09:47:52.423038+0000","last_undegraded":"2024-05-09T09:47:52.423038+0000","last_fullsized":"2024-05-09T09:47:52.423038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:29.369869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'14","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.208504+0000","last_change":"2024-05-09T09:47:18.231683+0000","last_active":"2024-05-09T09:50:32.208504+0000","last_peered":"2024-05-09T09:50:32.208504+0000","last_clean":"2024-05-09T09:50:32.208504+0000","last_became_active":"2024-05-09T09:47:18.230757+0000","last_became_peered":"2024-05-09T09:47:18.230757+0000","last_unstale":"2024-05-09T09:50:32.208504+0000","last_undegraded":"2024-05-09T09:50:32.208504+0000","last_fullsized":"2024-05-09T09:50:32.208504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:11:55.151452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.198252+0000","last_change":"2024-05-09T09:47:20.250439+0000","last_active":"2024-05-09T09:47:52.198252+0000","last_peered":"2024-05-09T09:47:52.198252+0000","last_clean":"2024-05-09T09:47:52.198252+0000","last_became_active":"2024-05-09T09:47:20.249919+0000","last_became_peered":"2024-05-09T09:47:20.249919+0000","last_unstale":"2024-05-09T09:47:52.198252+0000","last_undegraded":"2024-05-09T09:47:52.198252+0000","last_fullsized":"2024-05-09T09:47:52.198252+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:01:29.818831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'6","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.774666+0000","last_change":"2024-05-09T09:47:22.260930+0000","last_active":"2024-05-09T09:49:31.774666+0000","last_peered":"2024-05-09T09:49:31.774666+0000","last_clean":"2024-05-09T09:49:31.774666+0000","last_became_active":"2024-05-09T09:47:22.259833+0000","last_became_peered":"2024-05-09T09:47:22.259833+0000","last_unstale":"2024-05-09T09:49:31.774666+0000","last_undegraded":"2024-05-09T09:49:31.774666+0000","last_fullsized":"2024-05-09T09:49:31.774666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:01.734541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.809750+0000","last_change":"2024-05-09T09:47:14.174110+0000","last_active":"2024-05-09T09:50:32.809750+0000","last_peered":"2024-05-09T09:50:32.809750+0000","last_clean":"2024-05-09T09:50:32.809750+0000","last_became_active":"2024-05-09T09:47:14.173535+0000","last_became_peered":"2024-05-09T09:47:14.173535+0000","last_unstale":"2024-05-09T09:50:32.809750+0000","last_undegraded":"2024-05-09T09:50:32.809750+0000","last_fullsized":"2024-05-09T09:50:32.809750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:35:20.332271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:00.785377+0000","last_change":"2024-05-09T09:47:12.195767+0000","last_active":"2024-05-09T09:48:00.785377+0000","last_peered":"2024-05-09T09:48:00.785377+0000","last_clean":"2024-05-09T09:48:00.785377+0000","last_became_active":"2024-05-09T09:47:12.194500+0000","last_became_peered":"2024-05-09T09:47:12.194500+0000","last_unstale":"2024-05-09T09:48:00.785377+0000","last_undegraded":"2024-05-09T09:48:00.785377+0000","last_fullsized":"2024-05-09T09:48:00.785377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:06.949531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.425796+0000","last_change":"2024-05-09T09:47:03.051513+0000","last_active":"2024-05-09T09:47:52.425796+0000","last_peered":"2024-05-09T09:47:52.425796+0000","last_clean":"2024-05-09T09:47:52.425796+0000","last_became_active":"2024-05-09T09:47:03.051159+0000","last_became_peered":"2024-05-09T09:47:03.051159+0000","last_unstale":"2024-05-09T09:47:52.425796+0000","last_undegraded":"2024-05-09T09:47:52.425796+0000","last_fullsized":"2024-05-09T09:47:52.425796+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:12.598885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'5","reported_seq":230,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.866525+0000","last_change":"2024-05-09T09:47:16.199008+0000","last_active":"2024-05-09T09:50:39.866525+0000","last_peered":"2024-05-09T09:50:39.866525+0000","last_clean":"2024-05-09T09:50:39.866525+0000","last_became_active":"2024-05-09T09:47:16.198233+0000","last_became_peered":"2024-05-09T09:47:16.198233+0000","last_unstale":"2024-05-09T09:50:39.866525+0000","last_undegraded":"2024-05-09T09:50:39.866525+0000","last_fullsized":"2024-05-09T09:50:39.866525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:04.613279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1180,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":302,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'215","reported_seq":282,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.169833+0000","last_change":"2024-05-09T09:47:18.200360+0000","last_active":"2024-05-09T09:50:40.169833+0000","last_peered":"2024-05-09T09:50:40.169833+0000","last_clean":"2024-05-09T09:50:40.169833+0000","last_became_active":"2024-05-09T09:47:18.199411+0000","last_became_peered":"2024-05-09T09:47:18.199411+0000","last_unstale":"2024-05-09T09:50:40.169833+0000","last_undegraded":"2024-05-09T09:50:40.169833+0000","last_fullsized":"2024-05-09T09:50:40.169833+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:30:17.183321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.166977+0000","last_change":"2024-05-09T09:47:20.233735+0000","last_active":"2024-05-09T09:47:52.166977+0000","last_peered":"2024-05-09T09:47:52.166977+0000","last_clean":"2024-05-09T09:47:52.166977+0000","last_became_active":"2024-05-09T09:47:20.233024+0000","last_became_peered":"2024-05-09T09:47:20.233024+0000","last_unstale":"2024-05-09T09:47:52.166977+0000","last_undegraded":"2024-05-09T09:47:52.166977+0000","last_fullsized":"2024-05-09T09:47:52.166977+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:49:47.023864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.037073+0000","last_change":"2024-05-09T09:47:22.229611+0000","last_active":"2024-05-09T09:49:32.037073+0000","last_peered":"2024-05-09T09:49:32.037073+0000","last_clean":"2024-05-09T09:49:32.037073+0000","last_became_active":"2024-05-09T09:47:22.228855+0000","last_became_peered":"2024-05-09T09:47:22.228855+0000","last_unstale":"2024-05-09T09:49:32.037073+0000","last_undegraded":"2024-05-09T09:49:32.037073+0000","last_fullsized":"2024-05-09T09:49:32.037073+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:42:02.241469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'12","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.303331+0000","last_change":"2024-05-09T09:47:52.440285+0000","last_active":"2024-05-09T09:50:33.303331+0000","last_peered":"2024-05-09T09:50:33.303331+0000","last_clean":"2024-05-09T09:50:33.303331+0000","last_became_active":"2024-05-09T09:47:52.430912+0000","last_became_peered":"2024-05-09T09:47:52.430912+0000","last_unstale":"2024-05-09T09:50:33.303331+0000","last_undegraded":"2024-05-09T09:50:33.303331+0000","last_fullsized":"2024-05-09T09:50:33.303331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:11:51.125729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.420062+0000","last_change":"2024-05-09T09:47:12.190681+0000","last_active":"2024-05-09T09:47:52.420062+0000","last_peered":"2024-05-09T09:47:52.420062+0000","last_clean":"2024-05-09T09:47:52.420062+0000","last_became_active":"2024-05-09T09:47:12.189486+0000","last_became_peered":"2024-05-09T09:47:12.189486+0000","last_unstale":"2024-05-09T09:47:52.420062+0000","last_undegraded":"2024-05-09T09:47:52.420062+0000","last_fullsized":"2024-05-09T09:47:52.420062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:36:27.157767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.192263+0000","last_change":"2024-05-09T09:47:03.051225+0000","last_active":"2024-05-09T09:47:52.192263+0000","last_peered":"2024-05-09T09:47:52.192263+0000","last_clean":"2024-05-09T09:47:52.192263+0000","last_became_active":"2024-05-09T09:47:03.050600+0000","last_became_peered":"2024-05-09T09:47:03.050600+0000","last_unstale":"2024-05-09T09:47:52.192263+0000","last_undegraded":"2024-05-09T09:47:52.192263+0000","last_fullsized":"2024-05-09T09:47:52.192263+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:08:36.545563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.173025+0000","last_change":"2024-05-09T09:47:16.188804+0000","last_active":"2024-05-09T09:47:52.173025+0000","last_peered":"2024-05-09T09:47:52.173025+0000","last_clean":"2024-05-09T09:47:52.173025+0000","last_became_active":"2024-05-09T09:47:16.182232+0000","last_became_peered":"2024-05-09T09:47:16.182232+0000","last_unstale":"2024-05-09T09:47:52.173025+0000","last_undegraded":"2024-05-09T09:47:52.173025+0000","last_fullsized":"2024-05-09T09:47:52.173025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:35:05.830656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.165199+0000","last_change":"2024-05-09T09:47:18.213188+0000","last_active":"2024-05-09T09:47:52.165199+0000","last_peered":"2024-05-09T09:47:52.165199+0000","last_clean":"2024-05-09T09:47:52.165199+0000","last_became_active":"2024-05-09T09:47:18.211020+0000","last_became_peered":"2024-05-09T09:47:18.211020+0000","last_unstale":"2024-05-09T09:47:52.165199+0000","last_undegraded":"2024-05-09T09:47:52.165199+0000","last_fullsized":"2024-05-09T09:47:52.165199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:53:16.173752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'284","reported_seq":373,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.889032+0000","last_change":"2024-05-09T09:47:20.227322+0000","last_active":"2024-05-09T09:50:39.889032+0000","last_peered":"2024-05-09T09:50:39.889032+0000","last_clean":"2024-05-09T09:50:39.889032+0000","last_became_active":"2024-05-09T09:47:20.226481+0000","last_became_peered":"2024-05-09T09:47:20.226481+0000","last_unstale":"2024-05-09T09:50:39.889032+0000","last_undegraded":"2024-05-09T09:50:39.889032+0000","last_fullsized":"2024-05-09T09:50:39.889032+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:03:55.645189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.195877+0000","last_change":"2024-05-09T09:47:22.256859+0000","last_active":"2024-05-09T09:47:52.195877+0000","last_peered":"2024-05-09T09:47:52.195877+0000","last_clean":"2024-05-09T09:47:52.195877+0000","last_became_active":"2024-05-09T09:47:22.256285+0000","last_became_peered":"2024-05-09T09:47:22.256285+0000","last_unstale":"2024-05-09T09:47:52.195877+0000","last_undegraded":"2024-05-09T09:47:52.195877+0000","last_fullsized":"2024-05-09T09:47:52.195877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:11:22.508789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.239155+0000","last_change":"2024-05-09T09:47:14.183911+0000","last_active":"2024-05-09T09:50:33.239155+0000","last_peered":"2024-05-09T09:50:33.239155+0000","last_clean":"2024-05-09T09:50:33.239155+0000","last_became_active":"2024-05-09T09:47:14.183542+0000","last_became_peered":"2024-05-09T09:47:14.183542+0000","last_unstale":"2024-05-09T09:50:33.239155+0000","last_undegraded":"2024-05-09T09:50:33.239155+0000","last_fullsized":"2024-05-09T09:50:33.239155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:29:48.423658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.199875+0000","last_change":"2024-05-09T09:47:12.200135+0000","last_active":"2024-05-09T09:47:52.199875+0000","last_peered":"2024-05-09T09:47:52.199875+0000","last_clean":"2024-05-09T09:47:52.199875+0000","last_became_active":"2024-05-09T09:47:12.199656+0000","last_became_peered":"2024-05-09T09:47:12.199656+0000","last_unstale":"2024-05-09T09:47:52.199875+0000","last_undegraded":"2024-05-09T09:47:52.199875+0000","last_fullsized":"2024-05-09T09:47:52.199875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:32:17.255514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.427138+0000","last_change":"2024-05-09T09:47:03.053083+0000","last_active":"2024-05-09T09:47:52.427138+0000","last_peered":"2024-05-09T09:47:52.427138+0000","last_clean":"2024-05-09T09:47:52.427138+0000","last_became_active":"2024-05-09T09:47:03.052728+0000","last_became_peered":"2024-05-09T09:47:03.052728+0000","last_unstale":"2024-05-09T09:47:52.427138+0000","last_undegraded":"2024-05-09T09:47:52.427138+0000","last_fullsized":"2024-05-09T09:47:52.427138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:40:57.635793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.184620+0000","last_change":"2024-05-09T09:47:52.183646+0000","last_active":"2024-05-09T09:47:52.184620+0000","last_peered":"2024-05-09T09:47:52.184620+0000","last_clean":"2024-05-09T09:47:52.184620+0000","last_became_active":"2024-05-09T09:47:52.182360+0000","last_became_peered":"2024-05-09T09:47:52.182360+0000","last_unstale":"2024-05-09T09:47:52.184620+0000","last_undegraded":"2024-05-09T09:47:52.184620+0000","last_fullsized":"2024-05-09T09:47:52.184620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:36:55.505219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.177728+0000","last_change":"2024-05-09T09:47:18.235283+0000","last_active":"2024-05-09T09:47:52.177728+0000","last_peered":"2024-05-09T09:47:52.177728+0000","last_clean":"2024-05-09T09:47:52.177728+0000","last_became_active":"2024-05-09T09:47:18.234556+0000","last_became_peered":"2024-05-09T09:47:18.234556+0000","last_unstale":"2024-05-09T09:47:52.177728+0000","last_undegraded":"2024-05-09T09:47:52.177728+0000","last_fullsized":"2024-05-09T09:47:52.177728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:52:44.437137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'284","reported_seq":403,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.896692+0000","last_change":"2024-05-09T09:47:20.229005+0000","last_active":"2024-05-09T09:50:39.896692+0000","last_peered":"2024-05-09T09:50:39.896692+0000","last_clean":"2024-05-09T09:50:39.896692+0000","last_became_active":"2024-05-09T09:47:20.226936+0000","last_became_peered":"2024-05-09T09:47:20.226936+0000","last_unstale":"2024-05-09T09:50:39.896692+0000","last_undegraded":"2024-05-09T09:50:39.896692+0000","last_fullsized":"2024-05-09T09:50:39.896692+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:17:45.132446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.168136+0000","last_change":"2024-05-09T09:47:22.260147+0000","last_active":"2024-05-09T09:47:52.168136+0000","last_peered":"2024-05-09T09:47:52.168136+0000","last_clean":"2024-05-09T09:47:52.168136+0000","last_became_active":"2024-05-09T09:47:22.259547+0000","last_became_peered":"2024-05-09T09:47:22.259547+0000","last_unstale":"2024-05-09T09:47:52.168136+0000","last_undegraded":"2024-05-09T09:47:52.168136+0000","last_fullsized":"2024-05-09T09:47:52.168136+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:00:03.909321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'12","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:46.159946+0000","last_change":"2024-05-09T09:47:14.174039+0000","last_active":"2024-05-09T09:48:46.159946+0000","last_peered":"2024-05-09T09:48:46.159946+0000","last_clean":"2024-05-09T09:48:46.159946+0000","last_became_active":"2024-05-09T09:47:14.173673+0000","last_became_peered":"2024-05-09T09:47:14.173673+0000","last_unstale":"2024-05-09T09:48:46.159946+0000","last_undegraded":"2024-05-09T09:48:46.159946+0000","last_fullsized":"2024-05-09T09:48:46.159946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:56:48.282736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.174836+0000","last_change":"2024-05-09T09:47:12.206199+0000","last_active":"2024-05-09T09:47:52.174836+0000","last_peered":"2024-05-09T09:47:52.174836+0000","last_clean":"2024-05-09T09:47:52.174836+0000","last_became_active":"2024-05-09T09:47:12.205502+0000","last_became_peered":"2024-05-09T09:47:12.205502+0000","last_unstale":"2024-05-09T09:47:52.174836+0000","last_undegraded":"2024-05-09T09:47:52.174836+0000","last_fullsized":"2024-05-09T09:47:52.174836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:00:03.229983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.198477+0000","last_change":"2024-05-09T09:47:03.187330+0000","last_active":"2024-05-09T09:47:52.198477+0000","last_peered":"2024-05-09T09:47:52.198477+0000","last_clean":"2024-05-09T09:47:52.198477+0000","last_became_active":"2024-05-09T09:47:03.186434+0000","last_became_peered":"2024-05-09T09:47:03.186434+0000","last_unstale":"2024-05-09T09:47:52.198477+0000","last_undegraded":"2024-05-09T09:47:52.198477+0000","last_fullsized":"2024-05-09T09:47:52.198477+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:51:35.071748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.168475+0000","last_change":"2024-05-09T09:47:16.184166+0000","last_active":"2024-05-09T09:47:52.168475+0000","last_peered":"2024-05-09T09:47:52.168475+0000","last_clean":"2024-05-09T09:47:52.168475+0000","last_became_active":"2024-05-09T09:47:16.182713+0000","last_became_peered":"2024-05-09T09:47:16.182713+0000","last_unstale":"2024-05-09T09:47:52.168475+0000","last_undegraded":"2024-05-09T09:47:52.168475+0000","last_fullsized":"2024-05-09T09:47:52.168475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:03:51.620527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'313","reported_seq":397,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.146762+0000","last_change":"2024-05-09T09:47:18.227175+0000","last_active":"2024-05-09T09:50:40.146762+0000","last_peered":"2024-05-09T09:50:40.146762+0000","last_clean":"2024-05-09T09:50:40.146762+0000","last_became_active":"2024-05-09T09:47:18.226473+0000","last_became_peered":"2024-05-09T09:47:18.226473+0000","last_unstale":"2024-05-09T09:50:40.146762+0000","last_undegraded":"2024-05-09T09:50:40.146762+0000","last_fullsized":"2024-05-09T09:50:40.146762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:06.625814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.414174+0000","last_change":"2024-05-09T09:47:20.228640+0000","last_active":"2024-05-09T09:47:52.414174+0000","last_peered":"2024-05-09T09:47:52.414174+0000","last_clean":"2024-05-09T09:47:52.414174+0000","last_became_active":"2024-05-09T09:47:20.227198+0000","last_became_peered":"2024-05-09T09:47:20.227198+0000","last_unstale":"2024-05-09T09:47:52.414174+0000","last_undegraded":"2024-05-09T09:47:52.414174+0000","last_fullsized":"2024-05-09T09:47:52.414174+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:03:55.645189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.183943+0000","last_change":"2024-05-09T09:47:22.234544+0000","last_active":"2024-05-09T09:47:52.183943+0000","last_peered":"2024-05-09T09:47:52.183943+0000","last_clean":"2024-05-09T09:47:52.183943+0000","last_became_active":"2024-05-09T09:47:22.233279+0000","last_became_peered":"2024-05-09T09:47:22.233279+0000","last_unstale":"2024-05-09T09:47:52.183943+0000","last_undegraded":"2024-05-09T09:47:52.183943+0000","last_fullsized":"2024-05-09T09:47:52.183943+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:49.038963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.183233+0000","last_change":"2024-05-09T09:47:22.237682+0000","last_active":"2024-05-09T09:47:52.183233+0000","last_peered":"2024-05-09T09:47:52.183233+0000","last_clean":"2024-05-09T09:47:52.183233+0000","last_became_active":"2024-05-09T09:47:22.236863+0000","last_became_peered":"2024-05-09T09:47:22.236863+0000","last_unstale":"2024-05-09T09:47:52.183233+0000","last_undegraded":"2024-05-09T09:47:52.183233+0000","last_fullsized":"2024-05-09T09:47:52.183233+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:03:57.659846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.185906+0000","last_change":"2024-05-09T09:47:14.184633+0000","last_active":"2024-05-09T09:49:32.185906+0000","last_peered":"2024-05-09T09:49:32.185906+0000","last_clean":"2024-05-09T09:49:32.185906+0000","last_became_active":"2024-05-09T09:47:14.184250+0000","last_became_peered":"2024-05-09T09:47:14.184250+0000","last_unstale":"2024-05-09T09:49:32.185906+0000","last_undegraded":"2024-05-09T09:49:32.185906+0000","last_fullsized":"2024-05-09T09:49:32.185906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:04:29.322102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.187933+0000","last_change":"2024-05-09T09:47:12.208454+0000","last_active":"2024-05-09T09:47:52.187933+0000","last_peered":"2024-05-09T09:47:52.187933+0000","last_clean":"2024-05-09T09:47:52.187933+0000","last_became_active":"2024-05-09T09:47:12.203479+0000","last_became_peered":"2024-05-09T09:47:12.203479+0000","last_unstale":"2024-05-09T09:47:52.187933+0000","last_undegraded":"2024-05-09T09:47:52.187933+0000","last_fullsized":"2024-05-09T09:47:52.187933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:04:27.302577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.165369+0000","last_change":"2024-05-09T09:47:16.213892+0000","last_active":"2024-05-09T09:47:52.165369+0000","last_peered":"2024-05-09T09:47:52.165369+0000","last_clean":"2024-05-09T09:47:52.165369+0000","last_became_active":"2024-05-09T09:47:16.210992+0000","last_became_peered":"2024-05-09T09:47:16.210992+0000","last_unstale":"2024-05-09T09:47:52.165369+0000","last_undegraded":"2024-05-09T09:47:52.165369+0000","last_fullsized":"2024-05-09T09:47:52.165369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:14.409926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'109","reported_seq":156,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.999833+0000","last_change":"2024-05-09T09:47:18.234751+0000","last_active":"2024-05-09T09:50:39.999833+0000","last_peered":"2024-05-09T09:50:39.999833+0000","last_clean":"2024-05-09T09:50:39.999833+0000","last_became_active":"2024-05-09T09:47:18.234014+0000","last_became_peered":"2024-05-09T09:47:18.234014+0000","last_unstale":"2024-05-09T09:50:39.999833+0000","last_undegraded":"2024-05-09T09:50:39.999833+0000","last_fullsized":"2024-05-09T09:50:39.999833+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:19:30.298184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.171859+0000","last_change":"2024-05-09T09:47:20.254957+0000","last_active":"2024-05-09T09:47:52.171859+0000","last_peered":"2024-05-09T09:47:52.171859+0000","last_clean":"2024-05-09T09:47:52.171859+0000","last_became_active":"2024-05-09T09:47:20.254344+0000","last_became_peered":"2024-05-09T09:47:20.254344+0000","last_unstale":"2024-05-09T09:47:52.171859+0000","last_undegraded":"2024-05-09T09:47:52.171859+0000","last_fullsized":"2024-05-09T09:47:52.171859+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:25:58.655419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'5","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.848146+0000","last_change":"2024-05-09T09:47:22.230150+0000","last_active":"2024-05-09T09:50:32.848146+0000","last_peered":"2024-05-09T09:50:32.848146+0000","last_clean":"2024-05-09T09:50:32.848146+0000","last_became_active":"2024-05-09T09:47:22.229088+0000","last_became_peered":"2024-05-09T09:47:22.229088+0000","last_unstale":"2024-05-09T09:50:32.848146+0000","last_undegraded":"2024-05-09T09:50:32.848146+0000","last_fullsized":"2024-05-09T09:50:32.848146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:55:57.267178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'8","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.947282+0000","last_change":"2024-05-09T09:47:14.174619+0000","last_active":"2024-05-09T09:50:32.947282+0000","last_peered":"2024-05-09T09:50:32.947282+0000","last_clean":"2024-05-09T09:50:32.947282+0000","last_became_active":"2024-05-09T09:47:14.173866+0000","last_became_peered":"2024-05-09T09:47:14.173866+0000","last_unstale":"2024-05-09T09:50:32.947282+0000","last_undegraded":"2024-05-09T09:50:32.947282+0000","last_fullsized":"2024-05-09T09:50:32.947282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:58:34.213528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.179002+0000","last_change":"2024-05-09T09:47:12.206131+0000","last_active":"2024-05-09T09:47:52.179002+0000","last_peered":"2024-05-09T09:47:52.179002+0000","last_clean":"2024-05-09T09:47:52.179002+0000","last_became_active":"2024-05-09T09:47:12.205714+0000","last_became_peered":"2024-05-09T09:47:12.205714+0000","last_unstale":"2024-05-09T09:47:52.179002+0000","last_undegraded":"2024-05-09T09:47:52.179002+0000","last_fullsized":"2024-05-09T09:47:52.179002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:46.107016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.190257+0000","last_change":"2024-05-09T09:47:52.188822+0000","last_active":"2024-05-09T09:47:52.190257+0000","last_peered":"2024-05-09T09:47:52.190257+0000","last_clean":"2024-05-09T09:47:52.190257+0000","last_became_active":"2024-05-09T09:47:52.187627+0000","last_became_peered":"2024-05-09T09:47:52.187627+0000","last_unstale":"2024-05-09T09:47:52.190257+0000","last_undegraded":"2024-05-09T09:47:52.190257+0000","last_fullsized":"2024-05-09T09:47:52.190257+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:41:01.595836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'5","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.222011+0000","last_change":"2024-05-09T09:47:18.218595+0000","last_active":"2024-05-09T09:50:32.222011+0000","last_peered":"2024-05-09T09:50:32.222011+0000","last_clean":"2024-05-09T09:50:32.222011+0000","last_became_active":"2024-05-09T09:47:18.217843+0000","last_became_peered":"2024-05-09T09:47:18.217843+0000","last_unstale":"2024-05-09T09:50:32.222011+0000","last_undegraded":"2024-05-09T09:50:32.222011+0000","last_fullsized":"2024-05-09T09:50:32.222011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:49:45.011737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.167605+0000","last_change":"2024-05-09T09:47:20.256418+0000","last_active":"2024-05-09T09:47:52.167605+0000","last_peered":"2024-05-09T09:47:52.167605+0000","last_clean":"2024-05-09T09:47:52.167605+0000","last_became_active":"2024-05-09T09:47:20.255449+0000","last_became_peered":"2024-05-09T09:47:20.255449+0000","last_unstale":"2024-05-09T09:47:52.167605+0000","last_undegraded":"2024-05-09T09:47:52.167605+0000","last_fullsized":"2024-05-09T09:47:52.167605+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:30:19.195448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.408435+0000","last_change":"2024-05-09T09:47:22.239979+0000","last_active":"2024-05-09T09:50:33.408435+0000","last_peered":"2024-05-09T09:50:33.408435+0000","last_clean":"2024-05-09T09:50:33.408435+0000","last_became_active":"2024-05-09T09:47:22.239113+0000","last_became_peered":"2024-05-09T09:47:22.239113+0000","last_unstale":"2024-05-09T09:50:33.408435+0000","last_undegraded":"2024-05-09T09:50:33.408435+0000","last_fullsized":"2024-05-09T09:50:33.408435+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:34:01.631008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.238187+0000","last_change":"2024-05-09T09:47:14.174348+0000","last_active":"2024-05-09T09:50:33.238187+0000","last_peered":"2024-05-09T09:50:33.238187+0000","last_clean":"2024-05-09T09:50:33.238187+0000","last_became_active":"2024-05-09T09:47:14.173338+0000","last_became_peered":"2024-05-09T09:47:14.173338+0000","last_unstale":"2024-05-09T09:50:33.238187+0000","last_undegraded":"2024-05-09T09:50:33.238187+0000","last_fullsized":"2024-05-09T09:50:33.238187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:58:34.213528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:01.777271+0000","last_change":"2024-05-09T09:47:12.209971+0000","last_active":"2024-05-09T09:48:01.777271+0000","last_peered":"2024-05-09T09:48:01.777271+0000","last_clean":"2024-05-09T09:48:01.777271+0000","last_became_active":"2024-05-09T09:47:12.205864+0000","last_became_peered":"2024-05-09T09:47:12.205864+0000","last_unstale":"2024-05-09T09:48:01.777271+0000","last_undegraded":"2024-05-09T09:48:01.777271+0000","last_fullsized":"2024-05-09T09:48:01.777271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:00:05.597093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.169350+0000","last_change":"2024-05-09T09:47:16.215336+0000","last_active":"2024-05-09T09:47:52.169350+0000","last_peered":"2024-05-09T09:47:52.169350+0000","last_clean":"2024-05-09T09:47:52.169350+0000","last_became_active":"2024-05-09T09:47:16.214780+0000","last_became_peered":"2024-05-09T09:47:16.214780+0000","last_unstale":"2024-05-09T09:47:52.169350+0000","last_undegraded":"2024-05-09T09:47:52.169350+0000","last_fullsized":"2024-05-09T09:47:52.169350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:34:04.877319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'117","reported_seq":180,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.154489+0000","last_change":"2024-05-09T09:47:18.202153+0000","last_active":"2024-05-09T09:50:40.154489+0000","last_peered":"2024-05-09T09:50:40.154489+0000","last_clean":"2024-05-09T09:50:40.154489+0000","last_became_active":"2024-05-09T09:47:18.201443+0000","last_became_peered":"2024-05-09T09:47:18.201443+0000","last_unstale":"2024-05-09T09:50:40.154489+0000","last_undegraded":"2024-05-09T09:50:40.154489+0000","last_fullsized":"2024-05-09T09:50:40.154489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:00:18.197658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.164719+0000","last_change":"2024-05-09T09:47:20.226073+0000","last_active":"2024-05-09T09:47:52.164719+0000","last_peered":"2024-05-09T09:47:52.164719+0000","last_clean":"2024-05-09T09:47:52.164719+0000","last_became_active":"2024-05-09T09:47:20.225261+0000","last_became_peered":"2024-05-09T09:47:20.225261+0000","last_unstale":"2024-05-09T09:47:52.164719+0000","last_undegraded":"2024-05-09T09:47:52.164719+0000","last_fullsized":"2024-05-09T09:47:52.164719+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:47.024306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.185689+0000","last_change":"2024-05-09T09:47:22.253748+0000","last_active":"2024-05-09T09:47:52.185689+0000","last_peered":"2024-05-09T09:47:52.185689+0000","last_clean":"2024-05-09T09:47:52.185689+0000","last_became_active":"2024-05-09T09:47:22.252940+0000","last_became_peered":"2024-05-09T09:47:22.252940+0000","last_unstale":"2024-05-09T09:47:52.185689+0000","last_undegraded":"2024-05-09T09:47:52.185689+0000","last_fullsized":"2024-05-09T09:47:52.185689+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:28:23.186925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.304067+0000","last_change":"2024-05-09T09:47:14.183909+0000","last_active":"2024-05-09T09:50:33.304067+0000","last_peered":"2024-05-09T09:50:33.304067+0000","last_clean":"2024-05-09T09:50:33.304067+0000","last_became_active":"2024-05-09T09:47:14.183622+0000","last_became_peered":"2024-05-09T09:47:14.183622+0000","last_unstale":"2024-05-09T09:50:33.304067+0000","last_undegraded":"2024-05-09T09:50:33.304067+0000","last_fullsized":"2024-05-09T09:50:33.304067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:36:53.103953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.178343+0000","last_change":"2024-05-09T09:47:12.196263+0000","last_active":"2024-05-09T09:47:52.178343+0000","last_peered":"2024-05-09T09:47:52.178343+0000","last_clean":"2024-05-09T09:47:52.178343+0000","last_became_active":"2024-05-09T09:47:12.195857+0000","last_became_peered":"2024-05-09T09:47:12.195857+0000","last_unstale":"2024-05-09T09:47:52.178343+0000","last_undegraded":"2024-05-09T09:47:52.178343+0000","last_fullsized":"2024-05-09T09:47:52.178343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:55.107119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.173473+0000","last_change":"2024-05-09T09:47:16.199413+0000","last_active":"2024-05-09T09:47:52.173473+0000","last_peered":"2024-05-09T09:47:52.173473+0000","last_clean":"2024-05-09T09:47:52.173473+0000","last_became_active":"2024-05-09T09:47:16.198551+0000","last_became_peered":"2024-05-09T09:47:16.198551+0000","last_unstale":"2024-05-09T09:47:52.173473+0000","last_undegraded":"2024-05-09T09:47:52.173473+0000","last_fullsized":"2024-05-09T09:47:52.173473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:42.999644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'107","reported_seq":153,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.133194+0000","last_change":"2024-05-09T09:47:18.217890+0000","last_active":"2024-05-09T09:50:40.133194+0000","last_peered":"2024-05-09T09:50:40.133194+0000","last_clean":"2024-05-09T09:50:40.133194+0000","last_became_active":"2024-05-09T09:47:18.217163+0000","last_became_peered":"2024-05-09T09:47:18.217163+0000","last_unstale":"2024-05-09T09:50:40.133194+0000","last_undegraded":"2024-05-09T09:50:40.133194+0000","last_fullsized":"2024-05-09T09:50:40.133194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:13:11.800319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.170698+0000","last_change":"2024-05-09T09:47:20.239189+0000","last_active":"2024-05-09T09:47:52.170698+0000","last_peered":"2024-05-09T09:47:52.170698+0000","last_clean":"2024-05-09T09:47:52.170698+0000","last_became_active":"2024-05-09T09:47:20.238369+0000","last_became_peered":"2024-05-09T09:47:20.238369+0000","last_unstale":"2024-05-09T09:47:52.170698+0000","last_undegraded":"2024-05-09T09:47:52.170698+0000","last_fullsized":"2024-05-09T09:47:52.170698+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:00:20.209785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'9","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.170964+0000","last_change":"2024-05-09T09:47:14.188262+0000","last_active":"2024-05-09T09:50:33.170964+0000","last_peered":"2024-05-09T09:50:33.170964+0000","last_clean":"2024-05-09T09:50:33.170964+0000","last_became_active":"2024-05-09T09:47:14.187868+0000","last_became_peered":"2024-05-09T09:47:14.187868+0000","last_unstale":"2024-05-09T09:50:33.170964+0000","last_undegraded":"2024-05-09T09:50:33.170964+0000","last_fullsized":"2024-05-09T09:50:33.170964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:00:14.171935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.169058+0000","last_change":"2024-05-09T09:47:12.208626+0000","last_active":"2024-05-09T09:47:52.169058+0000","last_peered":"2024-05-09T09:47:52.169058+0000","last_clean":"2024-05-09T09:47:52.169058+0000","last_became_active":"2024-05-09T09:47:12.208209+0000","last_became_peered":"2024-05-09T09:47:12.208209+0000","last_unstale":"2024-05-09T09:47:52.169058+0000","last_undegraded":"2024-05-09T09:47:52.169058+0000","last_fullsized":"2024-05-09T09:47:52.169058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:02:05.524130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.426897+0000","last_change":"2024-05-09T09:47:16.183573+0000","last_active":"2024-05-09T09:47:52.426897+0000","last_peered":"2024-05-09T09:47:52.426897+0000","last_clean":"2024-05-09T09:47:52.426897+0000","last_became_active":"2024-05-09T09:47:16.182766+0000","last_became_peered":"2024-05-09T09:47:16.182766+0000","last_unstale":"2024-05-09T09:47:52.426897+0000","last_undegraded":"2024-05-09T09:47:52.426897+0000","last_fullsized":"2024-05-09T09:47:52.426897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:03:52.038829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'208","reported_seq":272,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.125642+0000","last_change":"2024-05-09T09:47:18.225686+0000","last_active":"2024-05-09T09:50:40.125642+0000","last_peered":"2024-05-09T09:50:40.125642+0000","last_clean":"2024-05-09T09:50:40.125642+0000","last_became_active":"2024-05-09T09:47:18.225074+0000","last_became_peered":"2024-05-09T09:47:18.225074+0000","last_unstale":"2024-05-09T09:50:40.125642+0000","last_undegraded":"2024-05-09T09:50:40.125642+0000","last_fullsized":"2024-05-09T09:50:40.125642+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:25.412871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.178320+0000","last_change":"2024-05-09T09:47:20.242032+0000","last_active":"2024-05-09T09:47:52.178320+0000","last_peered":"2024-05-09T09:47:52.178320+0000","last_clean":"2024-05-09T09:47:52.178320+0000","last_became_active":"2024-05-09T09:47:20.241372+0000","last_became_peered":"2024-05-09T09:47:20.241372+0000","last_unstale":"2024-05-09T09:47:52.178320+0000","last_undegraded":"2024-05-09T09:47:52.178320+0000","last_fullsized":"2024-05-09T09:47:52.178320+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:27.424998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.026339+0000","last_change":"2024-05-09T09:47:22.260464+0000","last_active":"2024-05-09T09:49:32.026339+0000","last_peered":"2024-05-09T09:49:32.026339+0000","last_clean":"2024-05-09T09:49:32.026339+0000","last_became_active":"2024-05-09T09:47:22.259589+0000","last_became_peered":"2024-05-09T09:47:22.259589+0000","last_unstale":"2024-05-09T09:49:32.026339+0000","last_undegraded":"2024-05-09T09:49:32.026339+0000","last_fullsized":"2024-05-09T09:49:32.026339+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:06:02.910819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:26.976242+0000","last_change":"2024-05-09T09:47:14.176405+0000","last_active":"2024-05-09T09:49:26.976242+0000","last_peered":"2024-05-09T09:49:26.976242+0000","last_clean":"2024-05-09T09:49:26.976242+0000","last_became_active":"2024-05-09T09:47:14.174371+0000","last_became_peered":"2024-05-09T09:47:14.174371+0000","last_unstale":"2024-05-09T09:49:26.976242+0000","last_undegraded":"2024-05-09T09:49:26.976242+0000","last_fullsized":"2024-05-09T09:49:26.976242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:34:58.223894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.163547+0000","last_change":"2024-05-09T09:47:12.198158+0000","last_active":"2024-05-09T09:47:52.163547+0000","last_peered":"2024-05-09T09:47:52.163547+0000","last_clean":"2024-05-09T09:47:52.163547+0000","last_became_active":"2024-05-09T09:47:12.196881+0000","last_became_peered":"2024-05-09T09:47:12.196881+0000","last_unstale":"2024-05-09T09:47:52.163547+0000","last_undegraded":"2024-05-09T09:47:52.163547+0000","last_fullsized":"2024-05-09T09:47:52.163547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:22:46.247782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.187470+0000","last_change":"2024-05-09T09:47:16.189376+0000","last_active":"2024-05-09T09:47:52.187470+0000","last_peered":"2024-05-09T09:47:52.187470+0000","last_clean":"2024-05-09T09:47:52.187470+0000","last_became_active":"2024-05-09T09:47:16.188611+0000","last_became_peered":"2024-05-09T09:47:16.188611+0000","last_unstale":"2024-05-09T09:47:52.187470+0000","last_undegraded":"2024-05-09T09:47:52.187470+0000","last_fullsized":"2024-05-09T09:47:52.187470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:10:07.313658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'113","reported_seq":162,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.139962+0000","last_change":"2024-05-09T09:47:18.233602+0000","last_active":"2024-05-09T09:50:40.139962+0000","last_peered":"2024-05-09T09:50:40.139962+0000","last_clean":"2024-05-09T09:50:40.139962+0000","last_became_active":"2024-05-09T09:47:18.232435+0000","last_became_peered":"2024-05-09T09:47:18.232435+0000","last_unstale":"2024-05-09T09:50:40.139962+0000","last_undegraded":"2024-05-09T09:50:40.139962+0000","last_fullsized":"2024-05-09T09:50:40.139962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:33:57.604224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.171851+0000","last_change":"2024-05-09T09:47:20.243779+0000","last_active":"2024-05-09T09:47:52.171851+0000","last_peered":"2024-05-09T09:47:52.171851+0000","last_clean":"2024-05-09T09:47:52.171851+0000","last_became_active":"2024-05-09T09:47:20.241935+0000","last_became_peered":"2024-05-09T09:47:20.241935+0000","last_unstale":"2024-05-09T09:47:52.171851+0000","last_undegraded":"2024-05-09T09:47:52.171851+0000","last_fullsized":"2024-05-09T09:47:52.171851+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:36.440080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.172300+0000","last_change":"2024-05-09T09:47:22.241900+0000","last_active":"2024-05-09T09:47:52.172300+0000","last_peered":"2024-05-09T09:47:52.172300+0000","last_clean":"2024-05-09T09:47:52.172300+0000","last_became_active":"2024-05-09T09:47:22.241067+0000","last_became_peered":"2024-05-09T09:47:22.241067+0000","last_unstale":"2024-05-09T09:47:52.172300+0000","last_undegraded":"2024-05-09T09:47:52.172300+0000","last_fullsized":"2024-05-09T09:47:52.172300+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:40:12.648847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.946574+0000","last_change":"2024-05-09T09:47:14.192314+0000","last_active":"2024-05-09T09:50:32.946574+0000","last_peered":"2024-05-09T09:50:32.946574+0000","last_clean":"2024-05-09T09:50:32.946574+0000","last_became_active":"2024-05-09T09:47:14.191459+0000","last_became_peered":"2024-05-09T09:47:14.191459+0000","last_unstale":"2024-05-09T09:50:32.946574+0000","last_undegraded":"2024-05-09T09:50:32.946574+0000","last_fullsized":"2024-05-09T09:50:32.946574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:36:19.920255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.631809+0000","last_change":"2024-05-09T09:47:12.193005+0000","last_active":"2024-05-09T09:50:32.631809+0000","last_peered":"2024-05-09T09:50:32.631809+0000","last_clean":"2024-05-09T09:50:32.631809+0000","last_became_active":"2024-05-09T09:47:12.191204+0000","last_became_peered":"2024-05-09T09:47:12.191204+0000","last_unstale":"2024-05-09T09:50:32.631809+0000","last_undegraded":"2024-05-09T09:50:32.631809+0000","last_fullsized":"2024-05-09T09:50:32.631809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:15:07.437414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.181698+0000","last_change":"2024-05-09T09:47:16.195416+0000","last_active":"2024-05-09T09:47:52.181698+0000","last_peered":"2024-05-09T09:47:52.181698+0000","last_clean":"2024-05-09T09:47:52.181698+0000","last_became_active":"2024-05-09T09:47:16.194314+0000","last_became_peered":"2024-05-09T09:47:16.194314+0000","last_unstale":"2024-05-09T09:47:52.181698+0000","last_undegraded":"2024-05-09T09:47:52.181698+0000","last_fullsized":"2024-05-09T09:47:52.181698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:44:05.776640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'109","reported_seq":156,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.019421+0000","last_change":"2024-05-09T09:47:18.209870+0000","last_active":"2024-05-09T09:50:40.019421+0000","last_peered":"2024-05-09T09:50:40.019421+0000","last_clean":"2024-05-09T09:50:40.019421+0000","last_became_active":"2024-05-09T09:47:18.209099+0000","last_became_peered":"2024-05-09T09:47:18.209099+0000","last_unstale":"2024-05-09T09:50:40.019421+0000","last_undegraded":"2024-05-09T09:50:40.019421+0000","last_fullsized":"2024-05-09T09:50:40.019421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:07.800202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.423415+0000","last_change":"2024-05-09T09:47:20.242600+0000","last_active":"2024-05-09T09:47:52.423415+0000","last_peered":"2024-05-09T09:47:52.423415+0000","last_clean":"2024-05-09T09:47:52.423415+0000","last_became_active":"2024-05-09T09:47:20.241900+0000","last_became_peered":"2024-05-09T09:47:20.241900+0000","last_unstale":"2024-05-09T09:47:52.423415+0000","last_undegraded":"2024-05-09T09:47:52.423415+0000","last_fullsized":"2024-05-09T09:47:52.423415+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:32.134753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'5","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.173022+0000","last_change":"2024-05-09T09:47:22.264988+0000","last_active":"2024-05-09T09:49:32.173022+0000","last_peered":"2024-05-09T09:49:32.173022+0000","last_clean":"2024-05-09T09:49:32.173022+0000","last_became_active":"2024-05-09T09:47:22.263730+0000","last_became_peered":"2024-05-09T09:47:22.263730+0000","last_unstale":"2024-05-09T09:49:32.173022+0000","last_undegraded":"2024-05-09T09:49:32.173022+0000","last_fullsized":"2024-05-09T09:49:32.173022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:54.092435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.184984+0000","last_change":"2024-05-09T09:47:14.191093+0000","last_active":"2024-05-09T09:49:32.184984+0000","last_peered":"2024-05-09T09:49:32.184984+0000","last_clean":"2024-05-09T09:49:32.184984+0000","last_became_active":"2024-05-09T09:47:14.189561+0000","last_became_peered":"2024-05-09T09:47:14.189561+0000","last_unstale":"2024-05-09T09:49:32.184984+0000","last_undegraded":"2024-05-09T09:49:32.184984+0000","last_fullsized":"2024-05-09T09:49:32.184984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:20:55.312241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.185025+0000","last_change":"2024-05-09T09:47:12.215264+0000","last_active":"2024-05-09T09:47:52.185025+0000","last_peered":"2024-05-09T09:47:52.185025+0000","last_clean":"2024-05-09T09:47:52.185025+0000","last_became_active":"2024-05-09T09:47:12.214816+0000","last_became_peered":"2024-05-09T09:47:12.214816+0000","last_unstale":"2024-05-09T09:47:52.185025+0000","last_undegraded":"2024-05-09T09:47:52.185025+0000","last_fullsized":"2024-05-09T09:47:52.185025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:57:22.903663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.172570+0000","last_change":"2024-05-09T09:47:16.211405+0000","last_active":"2024-05-09T09:47:52.172570+0000","last_peered":"2024-05-09T09:47:52.172570+0000","last_clean":"2024-05-09T09:47:52.172570+0000","last_became_active":"2024-05-09T09:47:16.210567+0000","last_became_peered":"2024-05-09T09:47:16.210567+0000","last_unstale":"2024-05-09T09:47:52.172570+0000","last_undegraded":"2024-05-09T09:47:52.172570+0000","last_fullsized":"2024-05-09T09:47:52.172570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:51:59.224530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.195660+0000","last_change":"2024-05-09T09:47:18.235102+0000","last_active":"2024-05-09T09:47:52.195660+0000","last_peered":"2024-05-09T09:47:52.195660+0000","last_clean":"2024-05-09T09:47:52.195660+0000","last_became_active":"2024-05-09T09:47:18.234113+0000","last_became_peered":"2024-05-09T09:47:18.234113+0000","last_unstale":"2024-05-09T09:47:52.195660+0000","last_undegraded":"2024-05-09T09:47:52.195660+0000","last_fullsized":"2024-05-09T09:47:52.195660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:15.072698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'284","reported_seq":370,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.886838+0000","last_change":"2024-05-09T09:47:20.255098+0000","last_active":"2024-05-09T09:50:39.886838+0000","last_peered":"2024-05-09T09:50:39.886838+0000","last_clean":"2024-05-09T09:50:39.886838+0000","last_became_active":"2024-05-09T09:47:20.254573+0000","last_became_peered":"2024-05-09T09:47:20.254573+0000","last_unstale":"2024-05-09T09:50:39.886838+0000","last_undegraded":"2024-05-09T09:50:39.886838+0000","last_fullsized":"2024-05-09T09:50:39.886838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:12.864272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.242341+0000","last_change":"2024-05-09T09:47:22.244085+0000","last_active":"2024-05-09T09:50:33.242341+0000","last_peered":"2024-05-09T09:50:33.242341+0000","last_clean":"2024-05-09T09:50:33.242341+0000","last_became_active":"2024-05-09T09:47:22.243234+0000","last_became_peered":"2024-05-09T09:47:22.243234+0000","last_unstale":"2024-05-09T09:50:33.242341+0000","last_undegraded":"2024-05-09T09:50:33.242341+0000","last_fullsized":"2024-05-09T09:50:33.242341+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:49:43.534043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.176046+0000","last_change":"2024-05-09T09:47:14.188552+0000","last_active":"2024-05-09T09:49:45.176046+0000","last_peered":"2024-05-09T09:49:45.176046+0000","last_clean":"2024-05-09T09:49:45.176046+0000","last_became_active":"2024-05-09T09:47:14.188222+0000","last_became_peered":"2024-05-09T09:47:14.188222+0000","last_unstale":"2024-05-09T09:49:45.176046+0000","last_undegraded":"2024-05-09T09:49:45.176046+0000","last_fullsized":"2024-05-09T09:49:45.176046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:08:36.171869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.658006+0000","last_change":"2024-05-09T09:47:12.196894+0000","last_active":"2024-05-09T09:50:32.658006+0000","last_peered":"2024-05-09T09:50:32.658006+0000","last_clean":"2024-05-09T09:50:32.658006+0000","last_became_active":"2024-05-09T09:47:12.195936+0000","last_became_peered":"2024-05-09T09:47:12.195936+0000","last_unstale":"2024-05-09T09:50:32.658006+0000","last_undegraded":"2024-05-09T09:50:32.658006+0000","last_fullsized":"2024-05-09T09:50:32.658006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:46.107016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.165234+0000","last_change":"2024-05-09T09:47:16.211838+0000","last_active":"2024-05-09T09:47:52.165234+0000","last_peered":"2024-05-09T09:47:52.165234+0000","last_clean":"2024-05-09T09:47:52.165234+0000","last_became_active":"2024-05-09T09:47:16.210901+0000","last_became_peered":"2024-05-09T09:47:16.210901+0000","last_unstale":"2024-05-09T09:47:52.165234+0000","last_undegraded":"2024-05-09T09:47:52.165234+0000","last_fullsized":"2024-05-09T09:47:52.165234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:36:55.117142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'114","reported_seq":163,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.058295+0000","last_change":"2024-05-09T09:47:18.202901+0000","last_active":"2024-05-09T09:50:40.058295+0000","last_peered":"2024-05-09T09:50:40.058295+0000","last_clean":"2024-05-09T09:50:40.058295+0000","last_became_active":"2024-05-09T09:47:18.202069+0000","last_became_peered":"2024-05-09T09:47:18.202069+0000","last_unstale":"2024-05-09T09:50:40.058295+0000","last_undegraded":"2024-05-09T09:50:40.058295+0000","last_fullsized":"2024-05-09T09:50:40.058295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:10.852145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.414336+0000","last_change":"2024-05-09T09:47:20.251107+0000","last_active":"2024-05-09T09:47:52.414336+0000","last_peered":"2024-05-09T09:47:52.414336+0000","last_clean":"2024-05-09T09:47:52.414336+0000","last_became_active":"2024-05-09T09:47:20.250194+0000","last_became_peered":"2024-05-09T09:47:20.250194+0000","last_unstale":"2024-05-09T09:47:52.414336+0000","last_undegraded":"2024-05-09T09:47:52.414336+0000","last_fullsized":"2024-05-09T09:47:52.414336+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:47.024306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.214257+0000","last_change":"2024-05-09T09:47:22.240288+0000","last_active":"2024-05-09T09:50:33.214257+0000","last_peered":"2024-05-09T09:50:33.214257+0000","last_clean":"2024-05-09T09:50:33.214257+0000","last_became_active":"2024-05-09T09:47:22.239300+0000","last_became_peered":"2024-05-09T09:47:22.239300+0000","last_unstale":"2024-05-09T09:50:33.214257+0000","last_undegraded":"2024-05-09T09:50:33.214257+0000","last_fullsized":"2024-05-09T09:50:33.214257+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:29:01.635074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'10","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.801428+0000","last_change":"2024-05-09T09:47:14.188510+0000","last_active":"2024-05-09T09:50:32.801428+0000","last_peered":"2024-05-09T09:50:32.801428+0000","last_clean":"2024-05-09T09:50:32.801428+0000","last_became_active":"2024-05-09T09:47:14.187951+0000","last_became_peered":"2024-05-09T09:47:14.187951+0000","last_unstale":"2024-05-09T09:50:32.801428+0000","last_undegraded":"2024-05-09T09:50:32.801428+0000","last_fullsized":"2024-05-09T09:50:32.801428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:08:19.732944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.192638+0000","last_change":"2024-05-09T09:47:12.208585+0000","last_active":"2024-05-09T09:47:52.192638+0000","last_peered":"2024-05-09T09:47:52.192638+0000","last_clean":"2024-05-09T09:47:52.192638+0000","last_became_active":"2024-05-09T09:47:12.203827+0000","last_became_peered":"2024-05-09T09:47:12.203827+0000","last_unstale":"2024-05-09T09:47:52.192638+0000","last_undegraded":"2024-05-09T09:47:52.192638+0000","last_fullsized":"2024-05-09T09:47:52.192638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:13.077999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.181294+0000","last_change":"2024-05-09T09:47:16.197042+0000","last_active":"2024-05-09T09:47:52.181294+0000","last_peered":"2024-05-09T09:47:52.181294+0000","last_clean":"2024-05-09T09:47:52.181294+0000","last_became_active":"2024-05-09T09:47:16.196193+0000","last_became_peered":"2024-05-09T09:47:16.196193+0000","last_unstale":"2024-05-09T09:47:52.181294+0000","last_undegraded":"2024-05-09T09:47:52.181294+0000","last_fullsized":"2024-05-09T09:47:52.181294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:29:55.560893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'110","reported_seq":156,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.066309+0000","last_change":"2024-05-09T09:47:18.200484+0000","last_active":"2024-05-09T09:50:40.066309+0000","last_peered":"2024-05-09T09:50:40.066309+0000","last_clean":"2024-05-09T09:50:40.066309+0000","last_became_active":"2024-05-09T09:47:18.199627+0000","last_became_peered":"2024-05-09T09:47:18.199627+0000","last_unstale":"2024-05-09T09:50:40.066309+0000","last_undegraded":"2024-05-09T09:50:40.066309+0000","last_fullsized":"2024-05-09T09:50:40.066309+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:13:28.480078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.172680+0000","last_change":"2024-05-09T09:47:20.252618+0000","last_active":"2024-05-09T09:47:52.172680+0000","last_peered":"2024-05-09T09:47:52.172680+0000","last_clean":"2024-05-09T09:47:52.172680+0000","last_became_active":"2024-05-09T09:47:20.251642+0000","last_became_peered":"2024-05-09T09:47:20.251642+0000","last_unstale":"2024-05-09T09:47:52.172680+0000","last_undegraded":"2024-05-09T09:47:52.172680+0000","last_fullsized":"2024-05-09T09:47:52.172680+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:02:59.842523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.196751+0000","last_change":"2024-05-09T09:47:22.261644+0000","last_active":"2024-05-09T09:47:52.196751+0000","last_peered":"2024-05-09T09:47:52.196751+0000","last_clean":"2024-05-09T09:47:52.196751+0000","last_became_active":"2024-05-09T09:47:22.261164+0000","last_became_peered":"2024-05-09T09:47:22.261164+0000","last_unstale":"2024-05-09T09:47:52.196751+0000","last_undegraded":"2024-05-09T09:47:52.196751+0000","last_fullsized":"2024-05-09T09:47:52.196751+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:08:50.446437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'8","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.150516+0000","last_change":"2024-05-09T09:47:14.185649+0000","last_active":"2024-05-09T09:50:33.150516+0000","last_peered":"2024-05-09T09:50:33.150516+0000","last_clean":"2024-05-09T09:50:33.150516+0000","last_became_active":"2024-05-09T09:47:14.185270+0000","last_became_peered":"2024-05-09T09:47:14.185270+0000","last_unstale":"2024-05-09T09:50:33.150516+0000","last_undegraded":"2024-05-09T09:50:33.150516+0000","last_fullsized":"2024-05-09T09:50:33.150516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:51:57.211341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.420634+0000","last_change":"2024-05-09T09:47:12.185589+0000","last_active":"2024-05-09T09:47:52.420634+0000","last_peered":"2024-05-09T09:47:52.420634+0000","last_clean":"2024-05-09T09:47:52.420634+0000","last_became_active":"2024-05-09T09:47:12.183985+0000","last_became_peered":"2024-05-09T09:47:12.183985+0000","last_unstale":"2024-05-09T09:47:52.420634+0000","last_undegraded":"2024-05-09T09:47:52.420634+0000","last_fullsized":"2024-05-09T09:47:52.420634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:02:04.919917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.163105+0000","last_change":"2024-05-09T09:47:16.210385+0000","last_active":"2024-05-09T09:47:52.163105+0000","last_peered":"2024-05-09T09:47:52.163105+0000","last_clean":"2024-05-09T09:47:52.163105+0000","last_became_active":"2024-05-09T09:47:16.207467+0000","last_became_peered":"2024-05-09T09:47:16.207467+0000","last_unstale":"2024-05-09T09:47:52.163105+0000","last_undegraded":"2024-05-09T09:47:52.163105+0000","last_fullsized":"2024-05-09T09:47:52.163105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:29.369869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'104","reported_seq":148,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.008802+0000","last_change":"2024-05-09T09:47:18.236481+0000","last_active":"2024-05-09T09:50:40.008802+0000","last_peered":"2024-05-09T09:50:40.008802+0000","last_clean":"2024-05-09T09:50:40.008802+0000","last_became_active":"2024-05-09T09:47:18.235557+0000","last_became_peered":"2024-05-09T09:47:18.235557+0000","last_unstale":"2024-05-09T09:50:40.008802+0000","last_undegraded":"2024-05-09T09:50:40.008802+0000","last_fullsized":"2024-05-09T09:50:40.008802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:48:17.305432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.172984+0000","last_change":"2024-05-09T09:47:20.235738+0000","last_active":"2024-05-09T09:47:52.172984+0000","last_peered":"2024-05-09T09:47:52.172984+0000","last_clean":"2024-05-09T09:47:52.172984+0000","last_became_active":"2024-05-09T09:47:20.231750+0000","last_became_peered":"2024-05-09T09:47:20.231750+0000","last_unstale":"2024-05-09T09:47:52.172984+0000","last_undegraded":"2024-05-09T09:47:52.172984+0000","last_fullsized":"2024-05-09T09:47:52.172984+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:45:32.951562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'8","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:29.505808+0000","last_change":"2024-05-09T09:47:22.256916+0000","last_active":"2024-05-09T09:49:29.505808+0000","last_peered":"2024-05-09T09:49:29.505808+0000","last_clean":"2024-05-09T09:49:29.505808+0000","last_became_active":"2024-05-09T09:47:22.256398+0000","last_became_peered":"2024-05-09T09:47:22.256398+0000","last_unstale":"2024-05-09T09:49:29.505808+0000","last_undegraded":"2024-05-09T09:49:29.505808+0000","last_fullsized":"2024-05-09T09:49:29.505808+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:05:30.419464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'22","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.944688+0000","last_change":"2024-05-09T09:47:14.189375+0000","last_active":"2024-05-09T09:50:32.944688+0000","last_peered":"2024-05-09T09:50:32.944688+0000","last_clean":"2024-05-09T09:50:32.944688+0000","last_became_active":"2024-05-09T09:47:14.188980+0000","last_became_peered":"2024-05-09T09:47:14.188980+0000","last_unstale":"2024-05-09T09:50:32.944688+0000","last_undegraded":"2024-05-09T09:50:32.944688+0000","last_fullsized":"2024-05-09T09:50:32.944688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:57:24.923188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:59.961336+0000","last_change":"2024-05-09T09:47:12.213326+0000","last_active":"2024-05-09T09:47:59.961336+0000","last_peered":"2024-05-09T09:47:59.961336+0000","last_clean":"2024-05-09T09:47:59.961336+0000","last_became_active":"2024-05-09T09:47:12.206136+0000","last_became_peered":"2024-05-09T09:47:12.206136+0000","last_unstale":"2024-05-09T09:47:59.961336+0000","last_undegraded":"2024-05-09T09:47:59.961336+0000","last_fullsized":"2024-05-09T09:47:59.961336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:01:14.038658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:27.582188+0000","last_change":"2024-05-09T09:47:16.211554+0000","last_active":"2024-05-09T09:49:27.582188+0000","last_peered":"2024-05-09T09:49:27.582188+0000","last_clean":"2024-05-09T09:49:27.582188+0000","last_became_active":"2024-05-09T09:47:16.210958+0000","last_became_peered":"2024-05-09T09:47:16.210958+0000","last_unstale":"2024-05-09T09:49:27.582188+0000","last_undegraded":"2024-05-09T09:49:27.582188+0000","last_fullsized":"2024-05-09T09:49:27.582188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:03:52.038829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'110","reported_seq":158,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.025072+0000","last_change":"2024-05-09T09:47:18.234795+0000","last_active":"2024-05-09T09:50:40.025072+0000","last_peered":"2024-05-09T09:50:40.025072+0000","last_clean":"2024-05-09T09:50:40.025072+0000","last_became_active":"2024-05-09T09:47:18.233552+0000","last_became_peered":"2024-05-09T09:47:18.233552+0000","last_unstale":"2024-05-09T09:50:40.025072+0000","last_undegraded":"2024-05-09T09:50:40.025072+0000","last_fullsized":"2024-05-09T09:50:40.025072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:22.991357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.426101+0000","last_change":"2024-05-09T09:47:20.254870+0000","last_active":"2024-05-09T09:47:52.426101+0000","last_peered":"2024-05-09T09:47:52.426101+0000","last_clean":"2024-05-09T09:47:52.426101+0000","last_became_active":"2024-05-09T09:47:20.254083+0000","last_became_peered":"2024-05-09T09:47:20.254083+0000","last_unstale":"2024-05-09T09:47:52.426101+0000","last_undegraded":"2024-05-09T09:47:52.426101+0000","last_fullsized":"2024-05-09T09:47:52.426101+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:51:10.268994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:29.509881+0000","last_change":"2024-05-09T09:47:22.255091+0000","last_active":"2024-05-09T09:49:29.509881+0000","last_peered":"2024-05-09T09:49:29.509881+0000","last_clean":"2024-05-09T09:49:29.509881+0000","last_became_active":"2024-05-09T09:47:22.254386+0000","last_became_peered":"2024-05-09T09:47:22.254386+0000","last_unstale":"2024-05-09T09:49:29.509881+0000","last_undegraded":"2024-05-09T09:49:29.509881+0000","last_fullsized":"2024-05-09T09:49:29.509881+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:55:00.879568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'13","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.322669+0000","last_change":"2024-05-09T09:47:14.178682+0000","last_active":"2024-05-09T09:50:33.322669+0000","last_peered":"2024-05-09T09:50:33.322669+0000","last_clean":"2024-05-09T09:50:33.322669+0000","last_became_active":"2024-05-09T09:47:14.174998+0000","last_became_peered":"2024-05-09T09:47:14.174998+0000","last_unstale":"2024-05-09T09:50:33.322669+0000","last_undegraded":"2024-05-09T09:50:33.322669+0000","last_fullsized":"2024-05-09T09:50:33.322669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:39.521528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.167783+0000","last_change":"2024-05-09T09:47:12.192847+0000","last_active":"2024-05-09T09:47:52.167783+0000","last_peered":"2024-05-09T09:47:52.167783+0000","last_clean":"2024-05-09T09:47:52.167783+0000","last_became_active":"2024-05-09T09:47:12.192448+0000","last_became_peered":"2024-05-09T09:47:12.192448+0000","last_unstale":"2024-05-09T09:47:52.167783+0000","last_undegraded":"2024-05-09T09:47:52.167783+0000","last_fullsized":"2024-05-09T09:47:52.167783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:43:04.277278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'12","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:45.864525+0000","last_change":"2024-05-09T09:47:14.189285+0000","last_active":"2024-05-09T09:48:45.864525+0000","last_peered":"2024-05-09T09:48:45.864525+0000","last_clean":"2024-05-09T09:48:45.864525+0000","last_became_active":"2024-05-09T09:47:14.188534+0000","last_became_peered":"2024-05-09T09:47:14.188534+0000","last_unstale":"2024-05-09T09:48:45.864525+0000","last_undegraded":"2024-05-09T09:48:45.864525+0000","last_fullsized":"2024-05-09T09:48:45.864525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:15.097524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":54,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.120523+0000","last_change":"2024-05-09T09:47:12.185694+0000","last_active":"2024-05-09T09:50:33.120523+0000","last_peered":"2024-05-09T09:50:33.120523+0000","last_clean":"2024-05-09T09:50:33.120523+0000","last_became_active":"2024-05-09T09:47:12.184353+0000","last_became_peered":"2024-05-09T09:47:12.184353+0000","last_unstale":"2024-05-09T09:50:33.120523+0000","last_undegraded":"2024-05-09T09:50:33.120523+0000","last_fullsized":"2024-05-09T09:50:33.120523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:01:14.038658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'8","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:45.864325+0000","last_change":"2024-05-09T09:47:14.187249+0000","last_active":"2024-05-09T09:48:45.864325+0000","last_peered":"2024-05-09T09:48:45.864325+0000","last_clean":"2024-05-09T09:48:45.864325+0000","last_became_active":"2024-05-09T09:47:14.186689+0000","last_became_peered":"2024-05-09T09:47:14.186689+0000","last_unstale":"2024-05-09T09:48:45.864325+0000","last_undegraded":"2024-05-09T09:48:45.864325+0000","last_fullsized":"2024-05-09T09:48:45.864325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:19:55.054927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.175877+0000","last_change":"2024-05-09T09:47:12.211787+0000","last_active":"2024-05-09T09:47:52.175877+0000","last_peered":"2024-05-09T09:47:52.175877+0000","last_clean":"2024-05-09T09:47:52.175877+0000","last_became_active":"2024-05-09T09:47:12.209633+0000","last_became_peered":"2024-05-09T09:47:12.209633+0000","last_unstale":"2024-05-09T09:47:52.175877+0000","last_undegraded":"2024-05-09T09:47:52.175877+0000","last_fullsized":"2024-05-09T09:47:52.175877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:51:58.314102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.163498+0000","last_change":"2024-05-09T09:47:14.193990+0000","last_active":"2024-05-09T09:49:25.163498+0000","last_peered":"2024-05-09T09:49:25.163498+0000","last_clean":"2024-05-09T09:49:25.163498+0000","last_became_active":"2024-05-09T09:47:14.193366+0000","last_became_peered":"2024-05-09T09:47:14.193366+0000","last_unstale":"2024-05-09T09:49:25.163498+0000","last_undegraded":"2024-05-09T09:49:25.163498+0000","last_fullsized":"2024-05-09T09:49:25.163498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:32:19.275039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.420041+0000","last_change":"2024-05-09T09:47:12.215615+0000","last_active":"2024-05-09T09:47:52.420041+0000","last_peered":"2024-05-09T09:47:52.420041+0000","last_clean":"2024-05-09T09:47:52.420041+0000","last_became_active":"2024-05-09T09:47:12.214019+0000","last_became_peered":"2024-05-09T09:47:12.214019+0000","last_unstale":"2024-05-09T09:47:52.420041+0000","last_undegraded":"2024-05-09T09:47:52.420041+0000","last_fullsized":"2024-05-09T09:47:52.420041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:15.767283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.944003+0000","last_change":"2024-05-09T09:47:14.182706+0000","last_active":"2024-05-09T09:50:32.944003+0000","last_peered":"2024-05-09T09:50:32.944003+0000","last_clean":"2024-05-09T09:50:32.944003+0000","last_became_active":"2024-05-09T09:47:14.181824+0000","last_became_peered":"2024-05-09T09:47:14.181824+0000","last_unstale":"2024-05-09T09:50:32.944003+0000","last_undegraded":"2024-05-09T09:50:32.944003+0000","last_fullsized":"2024-05-09T09:50:32.944003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:04:29.322102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.419332+0000","last_change":"2024-05-09T09:47:12.205854+0000","last_active":"2024-05-09T09:47:52.419332+0000","last_peered":"2024-05-09T09:47:52.419332+0000","last_clean":"2024-05-09T09:47:52.419332+0000","last_became_active":"2024-05-09T09:47:12.204322+0000","last_became_peered":"2024-05-09T09:47:12.204322+0000","last_unstale":"2024-05-09T09:47:52.419332+0000","last_undegraded":"2024-05-09T09:47:52.419332+0000","last_fullsized":"2024-05-09T09:47:52.419332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:19:17.059104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.150305+0000","last_change":"2024-05-09T09:47:14.178745+0000","last_active":"2024-05-09T09:50:33.150305+0000","last_peered":"2024-05-09T09:50:33.150305+0000","last_clean":"2024-05-09T09:50:33.150305+0000","last_became_active":"2024-05-09T09:47:14.178503+0000","last_became_peered":"2024-05-09T09:47:14.178503+0000","last_unstale":"2024-05-09T09:50:33.150305+0000","last_undegraded":"2024-05-09T09:50:33.150305+0000","last_fullsized":"2024-05-09T09:50:33.150305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:20:55.312241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"30'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.173367+0000","last_change":"2024-05-09T09:47:12.196461+0000","last_active":"2024-05-09T09:47:52.173367+0000","last_peered":"2024-05-09T09:47:52.173367+0000","last_clean":"2024-05-09T09:47:52.173367+0000","last_became_active":"2024-05-09T09:47:12.196120+0000","last_became_peered":"2024-05-09T09:47:12.196120+0000","last_unstale":"2024-05-09T09:47:52.173367+0000","last_undegraded":"2024-05-09T09:47:52.173367+0000","last_fullsized":"2024-05-09T09:47:52.173367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:06.949531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'5","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.162202+0000","last_change":"2024-05-09T09:47:14.177343+0000","last_active":"2024-05-09T09:49:20.162202+0000","last_peered":"2024-05-09T09:49:20.162202+0000","last_clean":"2024-05-09T09:49:20.162202+0000","last_became_active":"2024-05-09T09:47:14.176615+0000","last_became_peered":"2024-05-09T09:47:14.176615+0000","last_unstale":"2024-05-09T09:49:20.162202+0000","last_undegraded":"2024-05-09T09:49:20.162202+0000","last_fullsized":"2024-05-09T09:49:20.162202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:35:20.332271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.186449+0000","last_change":"2024-05-09T09:47:12.210169+0000","last_active":"2024-05-09T09:47:52.186449+0000","last_peered":"2024-05-09T09:47:52.186449+0000","last_clean":"2024-05-09T09:47:52.186449+0000","last_became_active":"2024-05-09T09:47:12.209171+0000","last_became_peered":"2024-05-09T09:47:12.209171+0000","last_unstale":"2024-05-09T09:47:52.186449+0000","last_undegraded":"2024-05-09T09:47:52.186449+0000","last_fullsized":"2024-05-09T09:47:52.186449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:55.107119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.164956+0000","last_change":"2024-05-09T09:47:14.177426+0000","last_active":"2024-05-09T09:47:52.164956+0000","last_peered":"2024-05-09T09:47:52.164956+0000","last_clean":"2024-05-09T09:47:52.164956+0000","last_became_active":"2024-05-09T09:47:14.177119+0000","last_became_peered":"2024-05-09T09:47:14.177119+0000","last_unstale":"2024-05-09T09:47:52.164956+0000","last_undegraded":"2024-05-09T09:47:52.164956+0000","last_fullsized":"2024-05-09T09:47:52.164956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:41:29.222588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.417060+0000","last_change":"2024-05-09T09:47:12.185203+0000","last_active":"2024-05-09T09:47:52.417060+0000","last_peered":"2024-05-09T09:47:52.417060+0000","last_clean":"2024-05-09T09:47:52.417060+0000","last_became_active":"2024-05-09T09:47:12.184105+0000","last_became_peered":"2024-05-09T09:47:12.184105+0000","last_unstale":"2024-05-09T09:47:52.417060+0000","last_undegraded":"2024-05-09T09:47:52.417060+0000","last_fullsized":"2024-05-09T09:47:52.417060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:18:16.165145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.800585+0000","last_change":"2024-05-09T09:47:14.185348+0000","last_active":"2024-05-09T09:50:32.800585+0000","last_peered":"2024-05-09T09:50:32.800585+0000","last_clean":"2024-05-09T09:50:32.800585+0000","last_became_active":"2024-05-09T09:47:14.182961+0000","last_became_peered":"2024-05-09T09:47:14.182961+0000","last_unstale":"2024-05-09T09:50:32.800585+0000","last_undegraded":"2024-05-09T09:50:32.800585+0000","last_fullsized":"2024-05-09T09:50:32.800585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:14:52.487546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.601065+0000","last_change":"2024-05-09T09:47:12.206940+0000","last_active":"2024-05-09T09:50:32.601065+0000","last_peered":"2024-05-09T09:50:32.601065+0000","last_clean":"2024-05-09T09:50:32.601065+0000","last_became_active":"2024-05-09T09:47:12.201952+0000","last_became_peered":"2024-05-09T09:47:12.201952+0000","last_unstale":"2024-05-09T09:50:32.601065+0000","last_undegraded":"2024-05-09T09:50:32.601065+0000","last_fullsized":"2024-05-09T09:50:32.601065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:06:37.960812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.944562+0000","last_change":"2024-05-09T09:47:14.193794+0000","last_active":"2024-05-09T09:50:32.944562+0000","last_peered":"2024-05-09T09:50:32.944562+0000","last_clean":"2024-05-09T09:50:32.944562+0000","last_became_active":"2024-05-09T09:47:14.193421+0000","last_became_peered":"2024-05-09T09:47:14.193421+0000","last_unstale":"2024-05-09T09:50:32.944562+0000","last_undegraded":"2024-05-09T09:50:32.944562+0000","last_fullsized":"2024-05-09T09:50:32.944562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:49:55.928418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:01.784206+0000","last_change":"2024-05-09T09:47:12.206566+0000","last_active":"2024-05-09T09:48:01.784206+0000","last_peered":"2024-05-09T09:48:01.784206+0000","last_clean":"2024-05-09T09:48:01.784206+0000","last_became_active":"2024-05-09T09:47:12.203523+0000","last_became_peered":"2024-05-09T09:47:12.203523+0000","last_unstale":"2024-05-09T09:48:01.784206+0000","last_undegraded":"2024-05-09T09:48:01.784206+0000","last_fullsized":"2024-05-09T09:48:01.784206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:00:03.229983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.302907+0000","last_change":"2024-05-09T09:47:14.173720+0000","last_active":"2024-05-09T09:50:33.302907+0000","last_peered":"2024-05-09T09:50:33.302907+0000","last_clean":"2024-05-09T09:50:33.302907+0000","last_became_active":"2024-05-09T09:47:14.171565+0000","last_became_peered":"2024-05-09T09:47:14.171565+0000","last_unstale":"2024-05-09T09:50:33.302907+0000","last_undegraded":"2024-05-09T09:50:33.302907+0000","last_fullsized":"2024-05-09T09:50:33.302907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:16:59.077638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.111363+0000","last_change":"2024-05-09T09:47:12.193541+0000","last_active":"2024-05-09T09:49:32.111363+0000","last_peered":"2024-05-09T09:49:32.111363+0000","last_clean":"2024-05-09T09:49:32.111363+0000","last_became_active":"2024-05-09T09:47:12.192462+0000","last_became_peered":"2024-05-09T09:47:12.192462+0000","last_unstale":"2024-05-09T09:49:32.111363+0000","last_undegraded":"2024-05-09T09:49:32.111363+0000","last_fullsized":"2024-05-09T09:49:32.111363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:43:04.277278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.239153+0000","last_change":"2024-05-09T09:47:14.177456+0000","last_active":"2024-05-09T09:50:33.239153+0000","last_peered":"2024-05-09T09:50:33.239153+0000","last_clean":"2024-05-09T09:50:33.239153+0000","last_became_active":"2024-05-09T09:47:14.176986+0000","last_became_peered":"2024-05-09T09:47:14.176986+0000","last_unstale":"2024-05-09T09:50:33.239153+0000","last_undegraded":"2024-05-09T09:50:33.239153+0000","last_fullsized":"2024-05-09T09:50:33.239153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:00:58.585804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.169090+0000","last_change":"2024-05-09T09:47:12.205826+0000","last_active":"2024-05-09T09:47:52.169090+0000","last_peered":"2024-05-09T09:47:52.169090+0000","last_clean":"2024-05-09T09:47:52.169090+0000","last_became_active":"2024-05-09T09:47:12.205416+0000","last_became_peered":"2024-05-09T09:47:12.205416+0000","last_unstale":"2024-05-09T09:47:52.169090+0000","last_undegraded":"2024-05-09T09:47:52.169090+0000","last_fullsized":"2024-05-09T09:47:52.169090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:14:11.726333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:02.666810+0000","last_change":"2024-05-09T09:47:14.182747+0000","last_active":"2024-05-09T09:48:02.666810+0000","last_peered":"2024-05-09T09:48:02.666810+0000","last_clean":"2024-05-09T09:48:02.666810+0000","last_became_active":"2024-05-09T09:47:14.182248+0000","last_became_peered":"2024-05-09T09:47:14.182248+0000","last_unstale":"2024-05-09T09:48:02.666810+0000","last_undegraded":"2024-05-09T09:48:02.666810+0000","last_fullsized":"2024-05-09T09:48:02.666810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:32:19.275039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.689371+0000","last_change":"2024-05-09T09:47:12.208127+0000","last_active":"2024-05-09T09:50:32.689371+0000","last_peered":"2024-05-09T09:50:32.689371+0000","last_clean":"2024-05-09T09:50:32.689371+0000","last_became_active":"2024-05-09T09:47:12.200127+0000","last_became_peered":"2024-05-09T09:47:12.200127+0000","last_unstale":"2024-05-09T09:50:32.689371+0000","last_undegraded":"2024-05-09T09:50:32.689371+0000","last_fullsized":"2024-05-09T09:50:32.689371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:08:17.713419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.304307+0000","last_change":"2024-05-09T09:47:14.190516+0000","last_active":"2024-05-09T09:50:33.304307+0000","last_peered":"2024-05-09T09:50:33.304307+0000","last_clean":"2024-05-09T09:50:33.304307+0000","last_became_active":"2024-05-09T09:47:14.190033+0000","last_became_peered":"2024-05-09T09:47:14.190033+0000","last_unstale":"2024-05-09T09:50:33.304307+0000","last_undegraded":"2024-05-09T09:50:33.304307+0000","last_fullsized":"2024-05-09T09:50:33.304307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:34:58.223894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:01.765781+0000","last_change":"2024-05-09T09:47:12.208249+0000","last_active":"2024-05-09T09:48:01.765781+0000","last_peered":"2024-05-09T09:48:01.765781+0000","last_clean":"2024-05-09T09:48:01.765781+0000","last_became_active":"2024-05-09T09:47:12.203424+0000","last_became_peered":"2024-05-09T09:47:12.203424+0000","last_unstale":"2024-05-09T09:48:01.765781+0000","last_undegraded":"2024-05-09T09:48:01.765781+0000","last_fullsized":"2024-05-09T09:48:01.765781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:28:35.100126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:30.174695+0000","last_change":"2024-05-09T09:47:14.187165+0000","last_active":"2024-05-09T09:49:30.174695+0000","last_peered":"2024-05-09T09:49:30.174695+0000","last_clean":"2024-05-09T09:49:30.174695+0000","last_became_active":"2024-05-09T09:47:14.186711+0000","last_became_peered":"2024-05-09T09:47:14.186711+0000","last_unstale":"2024-05-09T09:49:30.174695+0000","last_undegraded":"2024-05-09T09:49:30.174695+0000","last_fullsized":"2024-05-09T09:49:30.174695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:51:46.975465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.188697+0000","last_change":"2024-05-09T09:47:12.209730+0000","last_active":"2024-05-09T09:47:52.188697+0000","last_peered":"2024-05-09T09:47:52.188697+0000","last_clean":"2024-05-09T09:47:52.188697+0000","last_became_active":"2024-05-09T09:47:12.205320+0000","last_became_peered":"2024-05-09T09:47:12.205320+0000","last_unstale":"2024-05-09T09:47:52.188697+0000","last_undegraded":"2024-05-09T09:47:52.188697+0000","last_fullsized":"2024-05-09T09:47:52.188697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:01:14.038658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.403843+0000","last_change":"2024-05-09T09:47:14.178306+0000","last_active":"2024-05-09T09:50:33.403843+0000","last_peered":"2024-05-09T09:50:33.403843+0000","last_clean":"2024-05-09T09:50:33.403843+0000","last_became_active":"2024-05-09T09:47:14.177955+0000","last_became_peered":"2024-05-09T09:47:14.177955+0000","last_unstale":"2024-05-09T09:50:33.403843+0000","last_undegraded":"2024-05-09T09:50:33.403843+0000","last_fullsized":"2024-05-09T09:50:33.403843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:29:53.547705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:26.957446+0000","last_change":"2024-05-09T09:47:12.202337+0000","last_active":"2024-05-09T09:49:26.957446+0000","last_peered":"2024-05-09T09:49:26.957446+0000","last_clean":"2024-05-09T09:49:26.957446+0000","last_became_active":"2024-05-09T09:47:12.201790+0000","last_became_peered":"2024-05-09T09:47:12.201790+0000","last_unstale":"2024-05-09T09:49:26.957446+0000","last_undegraded":"2024-05-09T09:49:26.957446+0000","last_fullsized":"2024-05-09T09:49:26.957446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:35:18.312747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'6","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.129089+0000","last_change":"2024-05-09T09:47:12.207600+0000","last_active":"2024-05-09T09:50:33.129089+0000","last_peered":"2024-05-09T09:50:33.129089+0000","last_clean":"2024-05-09T09:50:33.129089+0000","last_became_active":"2024-05-09T09:47:12.203435+0000","last_became_peered":"2024-05-09T09:47:12.203435+0000","last_unstale":"2024-05-09T09:50:33.129089+0000","last_undegraded":"2024-05-09T09:50:33.129089+0000","last_fullsized":"2024-05-09T09:50:33.129089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:13:12.664064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'7","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.321483+0000","last_change":"2024-05-09T09:47:14.179261+0000","last_active":"2024-05-09T09:50:33.321483+0000","last_peered":"2024-05-09T09:50:33.321483+0000","last_clean":"2024-05-09T09:50:33.321483+0000","last_became_active":"2024-05-09T09:47:14.178142+0000","last_became_peered":"2024-05-09T09:47:14.178142+0000","last_unstale":"2024-05-09T09:50:33.321483+0000","last_undegraded":"2024-05-09T09:50:33.321483+0000","last_fullsized":"2024-05-09T09:50:33.321483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:34:02.864130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.412986+0000","last_change":"2024-05-09T09:47:12.207072+0000","last_active":"2024-05-09T09:47:52.412986+0000","last_peered":"2024-05-09T09:47:52.412986+0000","last_clean":"2024-05-09T09:47:52.412986+0000","last_became_active":"2024-05-09T09:47:12.205216+0000","last_became_peered":"2024-05-09T09:47:12.205216+0000","last_unstale":"2024-05-09T09:47:52.412986+0000","last_undegraded":"2024-05-09T09:47:52.412986+0000","last_fullsized":"2024-05-09T09:47:52.412986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:06.949531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'12","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.802415+0000","last_change":"2024-05-09T09:47:14.174424+0000","last_active":"2024-05-09T09:50:32.802415+0000","last_peered":"2024-05-09T09:50:32.802415+0000","last_clean":"2024-05-09T09:50:32.802415+0000","last_became_active":"2024-05-09T09:47:14.174123+0000","last_became_peered":"2024-05-09T09:47:14.174123+0000","last_unstale":"2024-05-09T09:50:32.802415+0000","last_undegraded":"2024-05-09T09:50:32.802415+0000","last_fullsized":"2024-05-09T09:50:32.802415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:10:05.300469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2272,"ondisk_log_size":2272,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3742,"ondisk_log_size":3742,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1628,"num_read_kb":1518,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705711,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40040,"kb_used_data":8864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331800,"statfs":{"total":96636764160,"available":96595763200,"internally_reserved":0,"allocated":9076736,"data_stored":8754022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705713,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36392,"kb_used_data":9376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335448,"statfs":{"total":96636764160,"available":96599498752,"internally_reserved":0,"allocated":9601024,"data_stored":9339828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705711,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36412,"kb_used_data":9396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335428,"statfs":{"total":96636764160,"available":96599478272,"internally_reserved":0,"allocated":9621504,"data_stored":9341034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705712,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40004,"kb_used_data":8828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331836,"statfs":{"total":96636764160,"available":96595800064,"internally_reserved":0,"allocated":9039872,"data_stored":8751284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T09:50:41.477 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T09:50:41.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.631+0000 7f25a5418640 1 Processor -- start 2024-05-09T09:50:41.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.631+0000 7f25a5418640 1 -- start start 2024-05-09T09:50:41.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.631+0000 7f25a5418640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f25a009e3b0 0x7f25a012bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:41.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.631+0000 7f25a5418640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25a012b820 con 0x7f25a012c1b0 2024-05-09T09:50:41.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.631+0000 7f25a5418640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f25a00a0fc0 con 0x7f25a009e3b0 2024-05-09T09:50:41.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.631+0000 7f259effd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f25a009e3b0 0x7f25a012bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:41.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.631+0000 7f25967fc640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f25a012c1b0 0x7f25a012ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:49068/0 (socket says 172.21.15.110:49068) 2024-05-09T09:50:41.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.631+0000 7f25967fc640 1 -- 172.21.15.110:0/794615040 learned_addr learned my addr 172.21.15.110:0/794615040 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:50:41.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.631+0000 7f259effd640 1 -- 172.21.15.110:0/794615040 >> v1:172.21.15.110:6789/0 conn(0x7f25a012c1b0 legacy=0x7f25a012ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:41.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.631+0000 7f259effd640 1 -- 172.21.15.110:0/794615040 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a009b5f0 con 0x7f25a009e3b0 2024-05-09T09:50:41.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.631+0000 7f259e7fc640 1 -- 172.21.15.110:0/794615040 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2422073458 0 0) 0x7f25a012b820 con 0x7f25a012c1b0 2024-05-09T09:50:41.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.631+0000 7f259effd640 1 --2- 172.21.15.110:0/794615040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25a009e3b0 0x7f25a012bc70 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f2590009740 tx=0x7f259001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4da14f11fd63ba server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:41.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.631+0000 7f259e7fc640 1 -- 172.21.15.110:0/794615040 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25900b0070 con 0x7f25a009e3b0 2024-05-09T09:50:41.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.631+0000 7f259e7fc640 1 -- 172.21.15.110:0/794615040 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25900ab530 con 0x7f25a009e3b0 2024-05-09T09:50:41.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.631+0000 7f259e7fc640 1 -- 172.21.15.110:0/794615040 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25900ab830 con 0x7f25a009e3b0 2024-05-09T09:50:41.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.635+0000 7f25a5418640 1 -- 172.21.15.110:0/794615040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25a009e3b0 msgr2=0x7f25a012bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:41.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.635+0000 7f25a5418640 1 --2- 172.21.15.110:0/794615040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25a009e3b0 0x7f25a012bc70 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f2590009740 tx=0x7f259001c370 comp rx=0 tx=0).stop 2024-05-09T09:50:41.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.635+0000 7f25a5418640 1 -- 172.21.15.110:0/794615040 shutdown_connections 2024-05-09T09:50:41.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.635+0000 7f25a5418640 1 --2- 172.21.15.110:0/794615040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25a009e3b0 0x7f25a012bc70 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:41.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.635+0000 7f25a5418640 1 -- 172.21.15.110:0/794615040 >> 172.21.15.110:0/794615040 conn(0x7f25a00a17a0 msgr2=0x7f25a009dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:41.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.635+0000 7f25a5418640 1 -- 172.21.15.110:0/794615040 shutdown_connections 2024-05-09T09:50:41.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.635+0000 7f25a5418640 1 -- 172.21.15.110:0/794615040 wait complete. 2024-05-09T09:50:41.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.635+0000 7f25a5418640 1 Processor -- start 2024-05-09T09:50:41.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.635+0000 7f25a5418640 1 -- start start 2024-05-09T09:50:41.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.635+0000 7f25a5418640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25a009e3b0 0x7f25a01c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:41.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.635+0000 7f25a5418640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f25a01371e0 con 0x7f25a009e3b0 2024-05-09T09:50:41.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.635+0000 7f259effd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25a009e3b0 0x7f25a01c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:41.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.635+0000 7f259effd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25a009e3b0 0x7f25a01c69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51256/0 (socket says 172.21.15.110:51256) 2024-05-09T09:50:41.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.635+0000 7f259effd640 1 -- 172.21.15.110:0/3788517638 learned_addr learned my addr 172.21.15.110:0/3788517638 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:50:41.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.635+0000 7f259effd640 1 -- 172.21.15.110:0/3788517638 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a006d490 con 0x7f25a009e3b0 2024-05-09T09:50:41.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.635+0000 7f259effd640 1 --2- 172.21.15.110:0/3788517638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25a009e3b0 0x7f25a01c69f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f2590019fa0 tx=0x7f259001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:41.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.635+0000 7f2597fff640 1 -- 172.21.15.110:0/3788517638 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25900bb070 con 0x7f25a009e3b0 2024-05-09T09:50:41.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.635+0000 7f2597fff640 1 -- 172.21.15.110:0/3788517638 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25900abd90 con 0x7f25a009e3b0 2024-05-09T09:50:41.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.635+0000 7f2597fff640 1 -- 172.21.15.110:0/3788517638 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25900b0040 con 0x7f25a009e3b0 2024-05-09T09:50:41.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.635+0000 7f25a5418640 1 -- 172.21.15.110:0/3788517638 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a0134720 con 0x7f25a009e3b0 2024-05-09T09:50:41.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.635+0000 7f25a5418640 1 -- 172.21.15.110:0/3788517638 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a006e8c0 con 0x7f25a009e3b0 2024-05-09T09:50:41.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.635+0000 7f25a5418640 1 -- 172.21.15.110:0/3788517638 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25a0063710 con 0x7f25a009e3b0 2024-05-09T09:50:41.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.635+0000 7f2597fff640 1 -- 172.21.15.110:0/3788517638 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f2590004220 con 0x7f25a009e3b0 2024-05-09T09:50:41.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.639+0000 7f2597fff640 1 --2- 172.21.15.110:0/3788517638 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f25800362c0 0x7f2580038780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:41.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.639+0000 7f2597fff640 1 -- 172.21.15.110:0/3788517638 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f25900e3e30 con 0x7f25a009e3b0 2024-05-09T09:50:41.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.639+0000 7f25967fc640 1 --2- 172.21.15.110:0/3788517638 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f25800362c0 0x7f2580038780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:41.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.639+0000 7f25967fc640 1 --2- 172.21.15.110:0/3788517638 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f25800362c0 0x7f2580038780 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2588007fd0 tx=0x7f2588007920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:41.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.643+0000 7f2597fff640 1 -- 172.21.15.110:0/3788517638 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2590015ff0 con 0x7f25a009e3b0 2024-05-09T09:50:41.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.803+0000 7f25a5418640 1 -- 172.21.15.110:0/3788517638 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25a0067fd0 con 0x7f25a009e3b0 2024-05-09T09:50:41.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.803+0000 7f2597fff640 1 -- 172.21.15.110:0/3788517638 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+20981 (secure 0 0 0) 0x7f25900aa3a0 con 0x7f25a009e3b0 2024-05-09T09:50:41.808 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:50:41.808 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":32,"fsid":"c05d0fe5-e814-4a03-b82b-3bb6168d5691","created":"2024-05-09T09:46:46.135865+0000","modified":"2024-05-09T09:47:52.156503+0000","last_up_change":"2024-05-09T09:46:55.013992+0000","last_in_change":"2024-05-09T09:46:47.304543+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T09:46:55.113740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-09T09:47:01.859791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-05-09T09:47:10.136920+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-05-09T09:47:12.524171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-05-09T09:47:14.415718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-05-09T09:47:16.354332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-05-09T09:47:18.245981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-05-09T09:47:20.378576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7cc58db-ea92-4134-a9e4-01f3d21592f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":231209037},{"type":"v1","addr":"172.21.15.110:6801","nonce":231209037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":231209037},{"type":"v1","addr":"172.21.15.110:6803","nonce":231209037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":231209037},{"type":"v1","addr":"172.21.15.110:6807","nonce":231209037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":231209037},{"type":"v1","addr":"172.21.15.110:6805","nonce":231209037}]},"public_addr":"172.21.15.110:6801/231209037","cluster_addr":"172.21.15.110:6803/231209037","heartbeat_back_addr":"172.21.15.110:6807/231209037","heartbeat_front_addr":"172.21.15.110:6805/231209037","state":["exists","up"]},{"osd":1,"uuid":"fe2d7e0c-75c9-471d-b77b-5f94220e23bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3930131338},{"type":"v1","addr":"172.21.15.157:6809","nonce":3930131338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3930131338},{"type":"v1","addr":"172.21.15.157:6811","nonce":3930131338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3930131338},{"type":"v1","addr":"172.21.15.157:6815","nonce":3930131338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3930131338},{"type":"v1","addr":"172.21.15.157:6813","nonce":3930131338}]},"public_addr":"172.21.15.157:6809/3930131338","cluster_addr":"172.21.15.157:6811/3930131338","heartbeat_back_addr":"172.21.15.157:6815/3930131338","heartbeat_front_addr":"172.21.15.157:6813/3930131338","state":["exists","up"]},{"osd":2,"uuid":"6fa89462-855a-422a-b215-d2076f0dfb2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":354455204},{"type":"v1","addr":"172.21.15.157:6801","nonce":354455204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":354455204},{"type":"v1","addr":"172.21.15.157:6803","nonce":354455204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":354455204},{"type":"v1","addr":"172.21.15.157:6807","nonce":354455204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":354455204},{"type":"v1","addr":"172.21.15.157:6805","nonce":354455204}]},"public_addr":"172.21.15.157:6801/354455204","cluster_addr":"172.21.15.157:6803/354455204","heartbeat_back_addr":"172.21.15.157:6807/354455204","heartbeat_front_addr":"172.21.15.157:6805/354455204","state":["exists","up"]},{"osd":3,"uuid":"fd8da308-444c-4eaa-851d-6262904f60f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":2487336710},{"type":"v1","addr":"172.21.15.157:6817","nonce":2487336710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":2487336710},{"type":"v1","addr":"172.21.15.157:6819","nonce":2487336710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":2487336710},{"type":"v1","addr":"172.21.15.157:6823","nonce":2487336710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":2487336710},{"type":"v1","addr":"172.21.15.157:6821","nonce":2487336710}]},"public_addr":"172.21.15.157:6817/2487336710","cluster_addr":"172.21.15.157:6819/2487336710","heartbeat_back_addr":"172.21.15.157:6823/2487336710","heartbeat_front_addr":"172.21.15.157:6821/2487336710","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:46:52.614027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:46:52.731468+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:46:52.830714+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T09:46:52.693601+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.3","mappings":[{"from":3,"to":0}]},{"pgid":"4.8","mappings":[{"from":3,"to":2}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]},{"pgid":"5.1","mappings":[{"from":0,"to":2}]},{"pgid":"5.13","mappings":[{"from":0,"to":2}]},{"pgid":"5.16","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T09:50:41.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.807+0000 7f25a5418640 1 -- 172.21.15.110:0/3788517638 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f25800362c0 msgr2=0x7f2580038780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:41.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.807+0000 7f25a5418640 1 --2- 172.21.15.110:0/3788517638 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f25800362c0 0x7f2580038780 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2588007fd0 tx=0x7f2588007920 comp rx=0 tx=0).stop 2024-05-09T09:50:41.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.807+0000 7f25a5418640 1 -- 172.21.15.110:0/3788517638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25a009e3b0 msgr2=0x7f25a01c69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:41.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.807+0000 7f25a5418640 1 --2- 172.21.15.110:0/3788517638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25a009e3b0 0x7f25a01c69f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f2590019fa0 tx=0x7f259001abb0 comp rx=0 tx=0).stop 2024-05-09T09:50:41.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.807+0000 7f25a5418640 1 -- 172.21.15.110:0/3788517638 shutdown_connections 2024-05-09T09:50:41.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.807+0000 7f25a5418640 1 --2- 172.21.15.110:0/3788517638 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f25800362c0 0x7f2580038780 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:41.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.807+0000 7f25a5418640 1 --2- 172.21.15.110:0/3788517638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25a009e3b0 0x7f25a01c69f0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:41.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.807+0000 7f25a5418640 1 -- 172.21.15.110:0/3788517638 >> 172.21.15.110:0/3788517638 conn(0x7f25a00a17a0 msgr2=0x7f25a009d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:41.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.807+0000 7f25a5418640 1 -- 172.21.15.110:0/3788517638 shutdown_connections 2024-05-09T09:50:41.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:41.807+0000 7f25a5418640 1 -- 172.21.15.110:0/3788517638 wait complete. 2024-05-09T09:50:42.827 INFO:tasks.ceph:Scrubbing osd.0 2024-05-09T09:50:42.828 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-09T09:50:42.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.959+0000 7ff6f26fe640 1 Processor -- start 2024-05-09T09:50:42.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.959+0000 7ff6f26fe640 1 -- start start 2024-05-09T09:50:42.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.959+0000 7ff6f26fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff6ec094f60 0x7ff6ec131db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:42.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.959+0000 7ff6f26fe640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6ec096d00 con 0x7ff6ec094470 2024-05-09T09:50:42.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.959+0000 7ff6f26fe640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7ff6ec096960 con 0x7ff6ec094f60 2024-05-09T09:50:42.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.959+0000 7ff6eb7fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff6ec094f60 0x7ff6ec131db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:42.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.959+0000 7ff6ebfff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ff6ec094470 0x7ff6ec094850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:33536/0 (socket says 172.21.15.110:33536) 2024-05-09T09:50:42.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.959+0000 7ff6ebfff640 1 -- 172.21.15.110:0/1149847547 learned_addr learned my addr 172.21.15.110:0/1149847547 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:50:42.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.959+0000 7ff6eb7fe640 1 -- 172.21.15.110:0/1149847547 >> v1:172.21.15.110:6789/0 conn(0x7ff6ec094470 legacy=0x7ff6ec094850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:42.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.959+0000 7ff6eaffd640 1 -- 172.21.15.110:0/1149847547 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3924472262 0 0) 0x7ff6d4001120 con 0x7ff6ec094470 2024-05-09T09:50:42.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.959+0000 7ff6eb7fe640 1 -- 172.21.15.110:0/1149847547 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ec096f80 con 0x7ff6ec094f60 2024-05-09T09:50:42.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.963+0000 7ff6eb7fe640 1 --2- 172.21.15.110:0/1149847547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6ec094f60 0x7ff6ec131db0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc009740 tx=0x7ff6dc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6516669e2efe339b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:42.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.963+0000 7ff6eaffd640 1 -- 172.21.15.110:0/1149847547 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6dc0b1070 con 0x7ff6ec094f60 2024-05-09T09:50:42.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.963+0000 7ff6eaffd640 1 -- 172.21.15.110:0/1149847547 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6dc0ac520 con 0x7ff6ec094f60 2024-05-09T09:50:42.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.963+0000 7ff6eaffd640 1 -- 172.21.15.110:0/1149847547 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6dc0ac820 con 0x7ff6ec094f60 2024-05-09T09:50:42.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.963+0000 7ff6f26fe640 1 -- 172.21.15.110:0/1149847547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6ec094f60 msgr2=0x7ff6ec131db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:42.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.963+0000 7ff6f26fe640 1 --2- 172.21.15.110:0/1149847547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6ec094f60 0x7ff6ec131db0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc009740 tx=0x7ff6dc01c370 comp rx=0 tx=0).stop 2024-05-09T09:50:42.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.963+0000 7ff6f26fe640 1 -- 172.21.15.110:0/1149847547 shutdown_connections 2024-05-09T09:50:42.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.963+0000 7ff6f26fe640 1 --2- 172.21.15.110:0/1149847547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6ec094f60 0x7ff6ec131db0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:42.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.963+0000 7ff6f26fe640 1 -- 172.21.15.110:0/1149847547 >> 172.21.15.110:0/1149847547 conn(0x7ff6ec09a070 msgr2=0x7ff6ec097970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:42.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.963+0000 7ff6f26fe640 1 -- 172.21.15.110:0/1149847547 shutdown_connections 2024-05-09T09:50:42.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.963+0000 7ff6f26fe640 1 -- 172.21.15.110:0/1149847547 wait complete. 2024-05-09T09:50:42.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.963+0000 7ff6f26fe640 1 Processor -- start 2024-05-09T09:50:42.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.963+0000 7ff6f26fe640 1 -- start start 2024-05-09T09:50:42.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.963+0000 7ff6f26fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6ec094470 0x7ff6ec1c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:42.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.963+0000 7ff6f26fe640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec134c90 con 0x7ff6ec094470 2024-05-09T09:50:42.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.963+0000 7ff6ebfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6ec094470 0x7ff6ec1c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:42.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.963+0000 7ff6ebfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6ec094470 0x7ff6ec1c6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35962/0 (socket says 172.21.15.110:35962) 2024-05-09T09:50:42.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.963+0000 7ff6ebfff640 1 -- 172.21.15.110:0/1963755839 learned_addr learned my addr 172.21.15.110:0/1963755839 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:50:42.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.963+0000 7ff6ebfff640 1 -- 172.21.15.110:0/1963755839 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ec1266a0 con 0x7ff6ec094470 2024-05-09T09:50:42.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.963+0000 7ff6ebfff640 1 --2- 172.21.15.110:0/1963755839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6ec094470 0x7ff6ec1c6740 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400c700 tx=0x7ff6d400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:42.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.963+0000 7ff6e8ff9640 1 -- 172.21.15.110:0/1963755839 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6d4018070 con 0x7ff6ec094470 2024-05-09T09:50:42.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.963+0000 7ff6e8ff9640 1 -- 172.21.15.110:0/1963755839 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6d40070d0 con 0x7ff6ec094470 2024-05-09T09:50:42.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.963+0000 7ff6f26fe640 1 -- 172.21.15.110:0/1963755839 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6ec1c62f0 con 0x7ff6ec094470 2024-05-09T09:50:42.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.963+0000 7ff6e8ff9640 1 -- 172.21.15.110:0/1963755839 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6d40073f0 con 0x7ff6ec094470 2024-05-09T09:50:42.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.963+0000 7ff6f26fe640 1 -- 172.21.15.110:0/1963755839 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6ec12f320 con 0x7ff6ec094470 2024-05-09T09:50:42.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.967+0000 7ff6f26fe640 1 -- 172.21.15.110:0/1963755839 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff6ec063710 con 0x7ff6ec094470 2024-05-09T09:50:42.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.967+0000 7ff6e8ff9640 1 -- 172.21.15.110:0/1963755839 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7ff6d401b070 con 0x7ff6ec094470 2024-05-09T09:50:42.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.967+0000 7ff6e8ff9640 1 --2- 172.21.15.110:0/1963755839 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff6cc0362c0 0x7ff6cc038780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:42.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.967+0000 7ff6e8ff9640 1 -- 172.21.15.110:0/1963755839 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7ff6d4048be0 con 0x7ff6ec094470 2024-05-09T09:50:42.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.967+0000 7ff6e8ff9640 1 --2- 172.21.15.110:0/1963755839 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x7ff6cc042710 0x7ff6cc044bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:42.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.967+0000 7ff6e8ff9640 1 -- 172.21.15.110:0/1963755839 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff6cc045280 con 0x7ff6cc042710 2024-05-09T09:50:42.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.967+0000 7ff6e8ff9640 1 -- 172.21.15.110:0/1963755839 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff6d404b310 con 0x7ff6ec094470 2024-05-09T09:50:42.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.967+0000 7ff6f0c9b640 1 --2- 172.21.15.110:0/1963755839 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x7ff6cc042710 0x7ff6cc044bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:42.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.967+0000 7ff6eb7fe640 1 --2- 172.21.15.110:0/1963755839 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff6cc0362c0 0x7ff6cc038780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:42.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.967+0000 7ff6f0c9b640 1 --2- 172.21.15.110:0/1963755839 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x7ff6cc042710 0x7ff6cc044bb0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:42.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.967+0000 7ff6eb7fe640 1 --2- 172.21.15.110:0/1963755839 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff6cc0362c0 0x7ff6cc038780 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc0ae000 tx=0x7ff6dc0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:42.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.967+0000 7ff6e8ff9640 1 -- 172.21.15.110:0/1963755839 <== osd.0 v2:172.21.15.110:6800/231209037 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff6cc045280 con 0x7ff6cc042710 2024-05-09T09:50:42.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.979+0000 7ff6f26fe640 1 -- 172.21.15.110:0/1963755839 --> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff6ec067fd0 con 0x7ff6cc042710 2024-05-09T09:50:42.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.983+0000 7ff6e8ff9640 1 -- 172.21.15.110:0/1963755839 <== osd.0 v2:172.21.15.110:6800/231209037 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff6ec067fd0 con 0x7ff6cc042710 2024-05-09T09:50:42.985 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-05-09T09:50:42.985 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T09:50:42.985 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-05-09T09:50:42.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.983+0000 7ff6f26fe640 1 -- 172.21.15.110:0/1963755839 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x7ff6cc042710 msgr2=0x7ff6cc044bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:42.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.983+0000 7ff6f26fe640 1 --2- 172.21.15.110:0/1963755839 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x7ff6cc042710 0x7ff6cc044bb0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:42.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.983+0000 7ff6f26fe640 1 -- 172.21.15.110:0/1963755839 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff6cc0362c0 msgr2=0x7ff6cc038780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:42.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.983+0000 7ff6f26fe640 1 --2- 172.21.15.110:0/1963755839 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff6cc0362c0 0x7ff6cc038780 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc0ae000 tx=0x7ff6dc0a7000 comp rx=0 tx=0).stop 2024-05-09T09:50:42.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.983+0000 7ff6f26fe640 1 -- 172.21.15.110:0/1963755839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6ec094470 msgr2=0x7ff6ec1c6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:42.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.983+0000 7ff6f26fe640 1 --2- 172.21.15.110:0/1963755839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6ec094470 0x7ff6ec1c6740 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400c700 tx=0x7ff6d400cbc0 comp rx=0 tx=0).stop 2024-05-09T09:50:42.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.983+0000 7ff6f26fe640 1 -- 172.21.15.110:0/1963755839 shutdown_connections 2024-05-09T09:50:42.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.983+0000 7ff6f26fe640 1 --2- 172.21.15.110:0/1963755839 >> [v2:172.21.15.110:6800/231209037,v1:172.21.15.110:6801/231209037] conn(0x7ff6cc042710 0x7ff6cc044bb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:42.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.983+0000 7ff6f26fe640 1 --2- 172.21.15.110:0/1963755839 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff6cc0362c0 0x7ff6cc038780 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:42.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.983+0000 7ff6f26fe640 1 --2- 172.21.15.110:0/1963755839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6ec094470 0x7ff6ec1c6740 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:42.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.983+0000 7ff6f26fe640 1 -- 172.21.15.110:0/1963755839 >> 172.21.15.110:0/1963755839 conn(0x7ff6ec09a070 msgr2=0x7ff6ec09ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:42.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.983+0000 7ff6f26fe640 1 -- 172.21.15.110:0/1963755839 shutdown_connections 2024-05-09T09:50:42.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:42.983+0000 7ff6f26fe640 1 -- 172.21.15.110:0/1963755839 wait complete. 2024-05-09T09:50:43.001 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-09T09:50:43.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.115+0000 7f0e286f8640 1 Processor -- start 2024-05-09T09:50:43.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.115+0000 7f0e286f8640 1 -- start start 2024-05-09T09:50:43.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.115+0000 7f0e286f8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0e2012f180 0x7f0e2012f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:43.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.115+0000 7f0e286f8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e200734a0 con 0x7f0e2012faa0 2024-05-09T09:50:43.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.115+0000 7f0e286f8640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f0e20096ee0 con 0x7f0e2012f180 2024-05-09T09:50:43.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.115+0000 7f0e26494640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0e2012f180 0x7f0e2012f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:43.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.115+0000 7f0e25c93640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f0e2012faa0 0x7f0e20094390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:33542/0 (socket says 172.21.15.110:33542) 2024-05-09T09:50:43.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.115+0000 7f0e25c93640 1 -- 172.21.15.110:0/1309719453 learned_addr learned my addr 172.21.15.110:0/1309719453 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:50:43.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.115+0000 7f0e26494640 1 -- 172.21.15.110:0/1309719453 >> v1:172.21.15.110:6789/0 conn(0x7f0e2012faa0 legacy=0x7f0e20094390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:43.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.115+0000 7f0e26494640 1 -- 172.21.15.110:0/1309719453 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e20094aa0 con 0x7f0e2012f180 2024-05-09T09:50:43.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.119+0000 7f0e26494640 1 --2- 172.21.15.110:0/1309719453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e2012f180 0x7f0e2012f560 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f0e10009740 tx=0x7f0e1001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de5faa753be8b3d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:43.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.119+0000 7f0e25492640 1 -- 172.21.15.110:0/1309719453 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e100b0070 con 0x7f0e2012f180 2024-05-09T09:50:43.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.119+0000 7f0e25492640 1 -- 172.21.15.110:0/1309719453 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e100ab530 con 0x7f0e2012f180 2024-05-09T09:50:43.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.119+0000 7f0e25492640 1 -- 172.21.15.110:0/1309719453 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e100ab830 con 0x7f0e2012f180 2024-05-09T09:50:43.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.119+0000 7f0e286f8640 1 -- 172.21.15.110:0/1309719453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e2012f180 msgr2=0x7f0e2012f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:43.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.119+0000 7f0e286f8640 1 --2- 172.21.15.110:0/1309719453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e2012f180 0x7f0e2012f560 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f0e10009740 tx=0x7f0e1001c400 comp rx=0 tx=0).stop 2024-05-09T09:50:43.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.119+0000 7f0e286f8640 1 -- 172.21.15.110:0/1309719453 shutdown_connections 2024-05-09T09:50:43.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.119+0000 7f0e286f8640 1 --2- 172.21.15.110:0/1309719453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e2012f180 0x7f0e2012f560 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:43.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.123+0000 7f0e286f8640 1 -- 172.21.15.110:0/1309719453 >> 172.21.15.110:0/1309719453 conn(0x7f0e2009ad20 msgr2=0x7f0e2009b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:43.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.123+0000 7f0e286f8640 1 -- 172.21.15.110:0/1309719453 shutdown_connections 2024-05-09T09:50:43.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.123+0000 7f0e286f8640 1 -- 172.21.15.110:0/1309719453 wait complete. 2024-05-09T09:50:43.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.123+0000 7f0e286f8640 1 Processor -- start 2024-05-09T09:50:43.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.123+0000 7f0e286f8640 1 -- start start 2024-05-09T09:50:43.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.123+0000 7f0e286f8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e2012f180 0x7f0e2012e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:43.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.123+0000 7f0e286f8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0e20137210 con 0x7f0e2012f180 2024-05-09T09:50:43.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.123+0000 7f0e26494640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e2012f180 0x7f0e2012e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:43.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.123+0000 7f0e26494640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e2012f180 0x7f0e2012e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35970/0 (socket says 172.21.15.110:35970) 2024-05-09T09:50:43.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.123+0000 7f0e26494640 1 -- 172.21.15.110:0/3356912047 learned_addr learned my addr 172.21.15.110:0/3356912047 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:50:43.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.123+0000 7f0e26494640 1 -- 172.21.15.110:0/3356912047 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e20072a20 con 0x7f0e2012f180 2024-05-09T09:50:43.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.123+0000 7f0e26494640 1 --2- 172.21.15.110:0/3356912047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e2012f180 0x7f0e2012e200 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f0e100ae040 tx=0x7f0e100191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:43.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.123+0000 7f0e16ffd640 1 -- 172.21.15.110:0/3356912047 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e100b8020 con 0x7f0e2012f180 2024-05-09T09:50:43.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.123+0000 7f0e16ffd640 1 -- 172.21.15.110:0/3356912047 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e100aa800 con 0x7f0e2012f180 2024-05-09T09:50:43.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.123+0000 7f0e286f8640 1 -- 172.21.15.110:0/3356912047 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e20092a20 con 0x7f0e2012f180 2024-05-09T09:50:43.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.123+0000 7f0e16ffd640 1 -- 172.21.15.110:0/3356912047 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e100b0040 con 0x7f0e2012f180 2024-05-09T09:50:43.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.123+0000 7f0e286f8640 1 -- 172.21.15.110:0/3356912047 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e2012e740 con 0x7f0e2012f180 2024-05-09T09:50:43.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.123+0000 7f0e16ffd640 1 -- 172.21.15.110:0/3356912047 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f0e100bb020 con 0x7f0e2012f180 2024-05-09T09:50:43.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.123+0000 7f0e286f8640 1 -- 172.21.15.110:0/3356912047 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e20072580 con 0x7f0e2012f180 2024-05-09T09:50:43.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.123+0000 7f0e16ffd640 1 --2- 172.21.15.110:0/3356912047 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0e04036310 0x7f0e040387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:43.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.123+0000 7f0e16ffd640 1 -- 172.21.15.110:0/3356912047 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f0e100e3930 con 0x7f0e2012f180 2024-05-09T09:50:43.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.127+0000 7f0e25c93640 1 --2- 172.21.15.110:0/3356912047 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0e04036310 0x7f0e040387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:43.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.127+0000 7f0e25c93640 1 --2- 172.21.15.110:0/3356912047 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0e04036310 0x7f0e040387d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c001610 tx=0x7f0e1c007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:43.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.131+0000 7f0e16ffd640 1 -- 172.21.15.110:0/3356912047 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0e100c2030 con 0x7f0e2012f180 2024-05-09T09:50:43.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.291+0000 7f0e286f8640 1 -- 172.21.15.110:0/3356912047 --> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f0e20063710 con 0x7f0e04036310 2024-05-09T09:50:43.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.291+0000 7f0e16ffd640 1 -- 172.21.15.110:0/3356912047 <== mgr.4100 v2:172.21.15.157:6824/2765519551 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0e20063710 con 0x7f0e04036310 2024-05-09T09:50:43.295 INFO:teuthology.orchestra.run.smithi110.stderr:instructed osd(s) 0 to deep-scrub 2024-05-09T09:50:43.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.295+0000 7f0e286f8640 1 -- 172.21.15.110:0/3356912047 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0e04036310 msgr2=0x7f0e040387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:43.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.295+0000 7f0e286f8640 1 --2- 172.21.15.110:0/3356912047 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0e04036310 0x7f0e040387d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c001610 tx=0x7f0e1c007ad0 comp rx=0 tx=0).stop 2024-05-09T09:50:43.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.295+0000 7f0e286f8640 1 -- 172.21.15.110:0/3356912047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e2012f180 msgr2=0x7f0e2012e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:43.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.295+0000 7f0e286f8640 1 --2- 172.21.15.110:0/3356912047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e2012f180 0x7f0e2012e200 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f0e100ae040 tx=0x7f0e100191a0 comp rx=0 tx=0).stop 2024-05-09T09:50:43.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.295+0000 7f0e286f8640 1 -- 172.21.15.110:0/3356912047 shutdown_connections 2024-05-09T09:50:43.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.295+0000 7f0e286f8640 1 --2- 172.21.15.110:0/3356912047 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f0e04036310 0x7f0e040387d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:43.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.295+0000 7f0e286f8640 1 --2- 172.21.15.110:0/3356912047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e2012f180 0x7f0e2012e200 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:43.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.295+0000 7f0e286f8640 1 -- 172.21.15.110:0/3356912047 >> 172.21.15.110:0/3356912047 conn(0x7f0e2009ad20 msgr2=0x7f0e201301d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:43.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.295+0000 7f0e286f8640 1 -- 172.21.15.110:0/3356912047 shutdown_connections 2024-05-09T09:50:43.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.295+0000 7f0e286f8640 1 -- 172.21.15.110:0/3356912047 wait complete. 2024-05-09T09:50:43.312 INFO:tasks.ceph:Scrubbing osd.1 2024-05-09T09:50:43.312 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-09T09:50:43.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.419+0000 7fb94075a640 1 Processor -- start 2024-05-09T09:50:43.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.419+0000 7fb94075a640 1 -- start start 2024-05-09T09:50:43.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.419+0000 7fb94075a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb938099090 0x7fb938094470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:43.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.419+0000 7fb94075a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb938096f80 con 0x7fb9380949b0 2024-05-09T09:50:43.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.419+0000 7fb94075a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fb93806bca0 con 0x7fb938099090 2024-05-09T09:50:43.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.419+0000 7fb93e4f6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb938099090 0x7fb938094470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:43.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.419+0000 7fb93dcf5640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fb9380949b0 0x7fb93812f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:33546/0 (socket says 172.21.15.110:33546) 2024-05-09T09:50:43.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.419+0000 7fb93dcf5640 1 -- 172.21.15.110:0/1738812900 learned_addr learned my addr 172.21.15.110:0/1738812900 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:50:43.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.419+0000 7fb93e4f6640 1 -- 172.21.15.110:0/1738812900 >> v1:172.21.15.110:6789/0 conn(0x7fb9380949b0 legacy=0x7fb93812f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:43.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.419+0000 7fb93e4f6640 1 -- 172.21.15.110:0/1738812900 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb938096c70 con 0x7fb938099090 2024-05-09T09:50:43.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.423+0000 7fb93e4f6640 1 --2- 172.21.15.110:0/1738812900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb938099090 0x7fb938094470 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fb934009d90 tx=0x7fb93401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7398904dfbf35f5d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:43.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.423+0000 7fb93d4f4640 1 -- 172.21.15.110:0/1738812900 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9340b2070 con 0x7fb938099090 2024-05-09T09:50:43.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.423+0000 7fb93d4f4640 1 -- 172.21.15.110:0/1738812900 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9340a58e0 con 0x7fb938099090 2024-05-09T09:50:43.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.423+0000 7fb93d4f4640 1 -- 172.21.15.110:0/1738812900 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9340a5be0 con 0x7fb938099090 2024-05-09T09:50:43.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.423+0000 7fb94075a640 1 -- 172.21.15.110:0/1738812900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb938099090 msgr2=0x7fb938094470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:43.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.423+0000 7fb94075a640 1 --2- 172.21.15.110:0/1738812900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb938099090 0x7fb938094470 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fb934009d90 tx=0x7fb93401c950 comp rx=0 tx=0).stop 2024-05-09T09:50:43.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.423+0000 7fb94075a640 1 -- 172.21.15.110:0/1738812900 shutdown_connections 2024-05-09T09:50:43.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.423+0000 7fb94075a640 1 --2- 172.21.15.110:0/1738812900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb938099090 0x7fb938094470 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:43.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.423+0000 7fb94075a640 1 -- 172.21.15.110:0/1738812900 >> 172.21.15.110:0/1738812900 conn(0x7fb93809a070 msgr2=0x7fb938097970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:43.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.423+0000 7fb94075a640 1 -- 172.21.15.110:0/1738812900 shutdown_connections 2024-05-09T09:50:43.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.423+0000 7fb94075a640 1 -- 172.21.15.110:0/1738812900 wait complete. 2024-05-09T09:50:43.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.423+0000 7fb94075a640 1 Processor -- start 2024-05-09T09:50:43.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.427+0000 7fb94075a640 1 -- start start 2024-05-09T09:50:43.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.427+0000 7fb94075a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9380949b0 0x7fb938132660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:43.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.427+0000 7fb94075a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb9381376f0 con 0x7fb9380949b0 2024-05-09T09:50:43.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.427+0000 7fb93e4f6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9380949b0 0x7fb938132660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:43.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.427+0000 7fb93e4f6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9380949b0 0x7fb938132660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35986/0 (socket says 172.21.15.110:35986) 2024-05-09T09:50:43.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.427+0000 7fb93e4f6640 1 -- 172.21.15.110:0/94721173 learned_addr learned my addr 172.21.15.110:0/94721173 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:50:43.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.427+0000 7fb93e4f6640 1 -- 172.21.15.110:0/94721173 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb93806d380 con 0x7fb9380949b0 2024-05-09T09:50:43.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.427+0000 7fb93e4f6640 1 --2- 172.21.15.110:0/94721173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9380949b0 0x7fb938132660 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fb934019560 tx=0x7fb9340196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:43.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.427+0000 7fb92effd640 1 -- 172.21.15.110:0/94721173 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9340b2050 con 0x7fb9380949b0 2024-05-09T09:50:43.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.427+0000 7fb92effd640 1 -- 172.21.15.110:0/94721173 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9340b3040 con 0x7fb9380949b0 2024-05-09T09:50:43.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.427+0000 7fb94075a640 1 -- 172.21.15.110:0/94721173 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb93806eb40 con 0x7fb9380949b0 2024-05-09T09:50:43.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.427+0000 7fb92effd640 1 -- 172.21.15.110:0/94721173 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9340ada10 con 0x7fb9380949b0 2024-05-09T09:50:43.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.427+0000 7fb94075a640 1 -- 172.21.15.110:0/94721173 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb938132ba0 con 0x7fb9380949b0 2024-05-09T09:50:43.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.427+0000 7fb94075a640 1 -- 172.21.15.110:0/94721173 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb938063710 con 0x7fb9380949b0 2024-05-09T09:50:43.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.427+0000 7fb92effd640 1 -- 172.21.15.110:0/94721173 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fb9340c0020 con 0x7fb9380949b0 2024-05-09T09:50:43.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.427+0000 7fb92effd640 1 --2- 172.21.15.110:0/94721173 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb91c036310 0x7fb91c0387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:43.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.427+0000 7fb92effd640 1 -- 172.21.15.110:0/94721173 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fb9340be020 con 0x7fb9380949b0 2024-05-09T09:50:43.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.427+0000 7fb92effd640 1 --2- 172.21.15.110:0/94721173 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x7fb91c042780 0x7fb91c044c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:43.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.427+0000 7fb92effd640 1 -- 172.21.15.110:0/94721173 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb9340a58e0 con 0x7fb91c042780 2024-05-09T09:50:43.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.427+0000 7fb92effd640 1 -- 172.21.15.110:0/94721173 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb9340eb050 con 0x7fb9380949b0 2024-05-09T09:50:43.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.427+0000 7fb93dcf5640 1 --2- 172.21.15.110:0/94721173 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb91c036310 0x7fb91c0387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:43.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.427+0000 7fb93ecf7640 1 --2- 172.21.15.110:0/94721173 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x7fb91c042780 0x7fb91c044c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:43.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.427+0000 7fb93dcf5640 1 --2- 172.21.15.110:0/94721173 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb91c036310 0x7fb91c0387d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb928001570 tx=0x7fb928007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:43.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.427+0000 7fb93ecf7640 1 --2- 172.21.15.110:0/94721173 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x7fb91c042780 0x7fb91c044c20 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:43.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.431+0000 7fb92effd640 1 -- 172.21.15.110:0/94721173 <== osd.1 v2:172.21.15.157:6808/3930131338 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb9340a58e0 con 0x7fb91c042780 2024-05-09T09:50:43.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.443+0000 7fb94075a640 1 -- 172.21.15.110:0/94721173 --> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb93806e700 con 0x7fb91c042780 2024-05-09T09:50:43.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.443+0000 7fb92effd640 1 -- 172.21.15.110:0/94721173 <== osd.1 v2:172.21.15.157:6808/3930131338 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb93806e700 con 0x7fb91c042780 2024-05-09T09:50:43.448 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-05-09T09:50:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T09:50:43.448 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-05-09T09:50:43.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.443+0000 7fb94075a640 1 -- 172.21.15.110:0/94721173 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x7fb91c042780 msgr2=0x7fb91c044c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:43.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.443+0000 7fb94075a640 1 --2- 172.21.15.110:0/94721173 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x7fb91c042780 0x7fb91c044c20 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:43.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.443+0000 7fb94075a640 1 -- 172.21.15.110:0/94721173 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb91c036310 msgr2=0x7fb91c0387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:43.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.443+0000 7fb94075a640 1 --2- 172.21.15.110:0/94721173 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb91c036310 0x7fb91c0387d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb928001570 tx=0x7fb928007ad0 comp rx=0 tx=0).stop 2024-05-09T09:50:43.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.443+0000 7fb94075a640 1 -- 172.21.15.110:0/94721173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9380949b0 msgr2=0x7fb938132660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:43.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.443+0000 7fb94075a640 1 --2- 172.21.15.110:0/94721173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9380949b0 0x7fb938132660 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fb934019560 tx=0x7fb9340196f0 comp rx=0 tx=0).stop 2024-05-09T09:50:43.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.443+0000 7fb94075a640 1 -- 172.21.15.110:0/94721173 shutdown_connections 2024-05-09T09:50:43.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.443+0000 7fb94075a640 1 --2- 172.21.15.110:0/94721173 >> [v2:172.21.15.157:6808/3930131338,v1:172.21.15.157:6809/3930131338] conn(0x7fb91c042780 0x7fb91c044c20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:43.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.443+0000 7fb94075a640 1 --2- 172.21.15.110:0/94721173 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fb91c036310 0x7fb91c0387d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:43.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.443+0000 7fb94075a640 1 --2- 172.21.15.110:0/94721173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9380949b0 0x7fb938132660 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:43.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.443+0000 7fb94075a640 1 -- 172.21.15.110:0/94721173 >> 172.21.15.110:0/94721173 conn(0x7fb93809a070 msgr2=0x7fb93812e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:43.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.443+0000 7fb94075a640 1 -- 172.21.15.110:0/94721173 shutdown_connections 2024-05-09T09:50:43.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.443+0000 7fb94075a640 1 -- 172.21.15.110:0/94721173 wait complete. 2024-05-09T09:50:43.463 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-09T09:50:43.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.571+0000 7fe8d4cf2640 1 Processor -- start 2024-05-09T09:50:43.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.571+0000 7fe8d4cf2640 1 -- start start 2024-05-09T09:50:43.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.571+0000 7fe8d4cf2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe8d009e3b0 0x7fe8d012bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:43.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.571+0000 7fe8d4cf2640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8d012b820 con 0x7fe8d012c1b0 2024-05-09T09:50:43.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.571+0000 7fe8d4cf2640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fe8d00a0fc0 con 0x7fe8d009e3b0 2024-05-09T09:50:43.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.571+0000 7fe8cdd9b640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fe8d012c1b0 0x7fe8d012ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:33552/0 (socket says 172.21.15.110:33552) 2024-05-09T09:50:43.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.571+0000 7fe8ce59c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe8d009e3b0 0x7fe8d012bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:43.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.571+0000 7fe8cdd9b640 1 -- 172.21.15.110:0/3562465413 learned_addr learned my addr 172.21.15.110:0/3562465413 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:50:43.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.571+0000 7fe8ce59c640 1 -- 172.21.15.110:0/3562465413 >> v1:172.21.15.110:6789/0 conn(0x7fe8d012c1b0 legacy=0x7fe8d012ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:43.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.571+0000 7fe8ce59c640 1 -- 172.21.15.110:0/3562465413 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8d009b5f0 con 0x7fe8d009e3b0 2024-05-09T09:50:43.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.575+0000 7fe8ce59c640 1 --2- 172.21.15.110:0/3562465413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8d009e3b0 0x7fe8d012bc70 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0009740 tx=0x7fe8c001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b958e97e1334d79 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:43.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.575+0000 7fe8cd59a640 1 -- 172.21.15.110:0/3562465413 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8c00b0070 con 0x7fe8d009e3b0 2024-05-09T09:50:43.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.575+0000 7fe8cd59a640 1 -- 172.21.15.110:0/3562465413 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8c00ab530 con 0x7fe8d009e3b0 2024-05-09T09:50:43.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.575+0000 7fe8cd59a640 1 -- 172.21.15.110:0/3562465413 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8c00ab830 con 0x7fe8d009e3b0 2024-05-09T09:50:43.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.575+0000 7fe8d4cf2640 1 -- 172.21.15.110:0/3562465413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8d009e3b0 msgr2=0x7fe8d012bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:43.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.575+0000 7fe8d4cf2640 1 --2- 172.21.15.110:0/3562465413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8d009e3b0 0x7fe8d012bc70 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0009740 tx=0x7fe8c001c370 comp rx=0 tx=0).stop 2024-05-09T09:50:43.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.575+0000 7fe8d4cf2640 1 -- 172.21.15.110:0/3562465413 shutdown_connections 2024-05-09T09:50:43.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.575+0000 7fe8d4cf2640 1 --2- 172.21.15.110:0/3562465413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8d009e3b0 0x7fe8d012bc70 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:43.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.575+0000 7fe8d4cf2640 1 -- 172.21.15.110:0/3562465413 >> 172.21.15.110:0/3562465413 conn(0x7fe8d00a17a0 msgr2=0x7fe8d009dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:43.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.575+0000 7fe8d4cf2640 1 -- 172.21.15.110:0/3562465413 shutdown_connections 2024-05-09T09:50:43.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.575+0000 7fe8d4cf2640 1 -- 172.21.15.110:0/3562465413 wait complete. 2024-05-09T09:50:43.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.575+0000 7fe8d4cf2640 1 Processor -- start 2024-05-09T09:50:43.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.575+0000 7fe8d4cf2640 1 -- start start 2024-05-09T09:50:43.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.575+0000 7fe8d4cf2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8d009e3b0 0x7fe8d01332d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:43.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.575+0000 7fe8d4cf2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d01371e0 con 0x7fe8d009e3b0 2024-05-09T09:50:43.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.575+0000 7fe8ce59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8d009e3b0 0x7fe8d01332d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:43.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.575+0000 7fe8ce59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8d009e3b0 0x7fe8d01332d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:36008/0 (socket says 172.21.15.110:36008) 2024-05-09T09:50:43.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.575+0000 7fe8ce59c640 1 -- 172.21.15.110:0/376192202 learned_addr learned my addr 172.21.15.110:0/376192202 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:50:43.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.575+0000 7fe8ce59c640 1 -- 172.21.15.110:0/376192202 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8d006ea70 con 0x7fe8d009e3b0 2024-05-09T09:50:43.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.575+0000 7fe8ce59c640 1 --2- 172.21.15.110:0/376192202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8d009e3b0 0x7fe8d01332d0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00ae040 tx=0x7fe8c0019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:43.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.575+0000 7fe8beffd640 1 -- 172.21.15.110:0/376192202 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8c00b8020 con 0x7fe8d009e3b0 2024-05-09T09:50:43.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.575+0000 7fe8beffd640 1 -- 172.21.15.110:0/376192202 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8c00b4410 con 0x7fe8d009e3b0 2024-05-09T09:50:43.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.575+0000 7fe8beffd640 1 -- 172.21.15.110:0/376192202 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8c00b0040 con 0x7fe8d009e3b0 2024-05-09T09:50:43.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.575+0000 7fe8d4cf2640 1 -- 172.21.15.110:0/376192202 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8d0134a50 con 0x7fe8d009e3b0 2024-05-09T09:50:43.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.575+0000 7fe8d4cf2640 1 -- 172.21.15.110:0/376192202 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8d006e5c0 con 0x7fe8d009e3b0 2024-05-09T09:50:43.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.579+0000 7fe8beffd640 1 -- 172.21.15.110:0/376192202 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fe8c00bb020 con 0x7fe8d009e3b0 2024-05-09T09:50:43.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.579+0000 7fe8d4cf2640 1 -- 172.21.15.110:0/376192202 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8d0063710 con 0x7fe8d009e3b0 2024-05-09T09:50:43.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.579+0000 7fe8beffd640 1 --2- 172.21.15.110:0/376192202 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe8b00362c0 0x7fe8b0038780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:43.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.579+0000 7fe8beffd640 1 -- 172.21.15.110:0/376192202 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fe8c00e3400 con 0x7fe8d009e3b0 2024-05-09T09:50:43.583 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.579+0000 7fe8cdd9b640 1 --2- 172.21.15.110:0/376192202 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe8b00362c0 0x7fe8b0038780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:43.583 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.579+0000 7fe8cdd9b640 1 --2- 172.21.15.110:0/376192202 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe8b00362c0 0x7fe8b0038780 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4001610 tx=0x7fe8c4007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:43.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.583+0000 7fe8beffd640 1 -- 172.21.15.110:0/376192202 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe8c00c2030 con 0x7fe8d009e3b0 2024-05-09T09:50:43.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.747+0000 7fe8d4cf2640 1 -- 172.21.15.110:0/376192202 --> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fe8d0134e40 con 0x7fe8b00362c0 2024-05-09T09:50:43.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.747+0000 7fe8beffd640 1 -- 172.21.15.110:0/376192202 <== mgr.4100 v2:172.21.15.157:6824/2765519551 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe8d0134e40 con 0x7fe8b00362c0 2024-05-09T09:50:43.752 INFO:teuthology.orchestra.run.smithi110.stderr:instructed osd(s) 1 to deep-scrub 2024-05-09T09:50:43.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.751+0000 7fe8d4cf2640 1 -- 172.21.15.110:0/376192202 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe8b00362c0 msgr2=0x7fe8b0038780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:43.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.751+0000 7fe8d4cf2640 1 --2- 172.21.15.110:0/376192202 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe8b00362c0 0x7fe8b0038780 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4001610 tx=0x7fe8c4007ad0 comp rx=0 tx=0).stop 2024-05-09T09:50:43.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.751+0000 7fe8d4cf2640 1 -- 172.21.15.110:0/376192202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8d009e3b0 msgr2=0x7fe8d01332d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:43.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.751+0000 7fe8d4cf2640 1 --2- 172.21.15.110:0/376192202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8d009e3b0 0x7fe8d01332d0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00ae040 tx=0x7fe8c0019110 comp rx=0 tx=0).stop 2024-05-09T09:50:43.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.751+0000 7fe8d4cf2640 1 -- 172.21.15.110:0/376192202 shutdown_connections 2024-05-09T09:50:43.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.751+0000 7fe8d4cf2640 1 --2- 172.21.15.110:0/376192202 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fe8b00362c0 0x7fe8b0038780 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:43.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.751+0000 7fe8d4cf2640 1 --2- 172.21.15.110:0/376192202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8d009e3b0 0x7fe8d01332d0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:43.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.751+0000 7fe8d4cf2640 1 -- 172.21.15.110:0/376192202 >> 172.21.15.110:0/376192202 conn(0x7fe8d00a17a0 msgr2=0x7fe8d00986a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:43.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.751+0000 7fe8d4cf2640 1 -- 172.21.15.110:0/376192202 shutdown_connections 2024-05-09T09:50:43.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.751+0000 7fe8d4cf2640 1 -- 172.21.15.110:0/376192202 wait complete. 2024-05-09T09:50:43.770 INFO:tasks.ceph:Scrubbing osd.2 2024-05-09T09:50:43.770 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-09T09:50:43.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.891+0000 7f1705b02640 1 Processor -- start 2024-05-09T09:50:43.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.891+0000 7f1705b02640 1 -- start start 2024-05-09T09:50:43.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.891+0000 7f1705b02640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f170012b830 0x7f170012bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:43.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.891+0000 7f1705b02640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f170009adb0 con 0x7f170012c150 2024-05-09T09:50:43.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.891+0000 7f1705b02640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f170012b6a0 con 0x7f170012b830 2024-05-09T09:50:43.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.891+0000 7f16ff7fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f170012b830 0x7f170012bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:43.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.891+0000 7f16feffd640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f170012c150 0x7f170012eba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:33568/0 (socket says 172.21.15.110:33568) 2024-05-09T09:50:43.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.891+0000 7f16feffd640 1 -- 172.21.15.110:0/1607904079 learned_addr learned my addr 172.21.15.110:0/1607904079 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:50:43.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.891+0000 7f16ff7fe640 1 -- 172.21.15.110:0/1607904079 >> v1:172.21.15.110:6789/0 conn(0x7f170012c150 legacy=0x7f170012eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:43.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.891+0000 7f16ff7fe640 1 -- 172.21.15.110:0/1607904079 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f170012c580 con 0x7f170012b830 2024-05-09T09:50:43.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.891+0000 7f16ff7fe640 1 --2- 172.21.15.110:0/1607904079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f170012b830 0x7f170012bc10 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009d90 tx=0x7f16f001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf2dd23315f91a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:43.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.891+0000 7f16fe7fc640 1 -- 172.21.15.110:0/1607904079 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16f00b2070 con 0x7f170012b830 2024-05-09T09:50:43.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f16fe7fc640 1 -- 172.21.15.110:0/1607904079 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f00a5660 con 0x7f170012b830 2024-05-09T09:50:43.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f16fe7fc640 1 -- 172.21.15.110:0/1607904079 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16f00a5960 con 0x7f170012b830 2024-05-09T09:50:43.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f1705b02640 1 -- 172.21.15.110:0/1607904079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f170012b830 msgr2=0x7f170012bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:43.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f1705b02640 1 --2- 172.21.15.110:0/1607904079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f170012b830 0x7f170012bc10 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009d90 tx=0x7f16f001c8c0 comp rx=0 tx=0).stop 2024-05-09T09:50:43.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f1705b02640 1 -- 172.21.15.110:0/1607904079 shutdown_connections 2024-05-09T09:50:43.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f1705b02640 1 --2- 172.21.15.110:0/1607904079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f170012b830 0x7f170012bc10 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:43.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f1705b02640 1 -- 172.21.15.110:0/1607904079 >> 172.21.15.110:0/1607904079 conn(0x7f17000a16a0 msgr2=0x7f17000a1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:43.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f1705b02640 1 -- 172.21.15.110:0/1607904079 shutdown_connections 2024-05-09T09:50:43.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f1705b02640 1 -- 172.21.15.110:0/1607904079 wait complete. 2024-05-09T09:50:43.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f1705b02640 1 Processor -- start 2024-05-09T09:50:43.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f1705b02640 1 -- start start 2024-05-09T09:50:43.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f1705b02640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f170012c150 0x7f1700132dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:43.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f1705b02640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f170009b780 con 0x7f170012c150 2024-05-09T09:50:43.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f16ff7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f170012c150 0x7f1700132dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:43.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f16ff7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f170012c150 0x7f1700132dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:36032/0 (socket says 172.21.15.110:36032) 2024-05-09T09:50:43.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f16ff7fe640 1 -- 172.21.15.110:0/772760432 learned_addr learned my addr 172.21.15.110:0/772760432 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:50:43.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f16ff7fe640 1 -- 172.21.15.110:0/772760432 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f170006ecb0 con 0x7f170012c150 2024-05-09T09:50:43.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f16ff7fe640 1 --2- 172.21.15.110:0/772760432 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f170012c150 0x7f1700132dd0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009d90 tx=0x7f16f0019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:43.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f16f7fff640 1 -- 172.21.15.110:0/772760432 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16f00b2050 con 0x7f170012c150 2024-05-09T09:50:43.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f16f7fff640 1 -- 172.21.15.110:0/772760432 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f00b3040 con 0x7f170012c150 2024-05-09T09:50:43.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f1705b02640 1 -- 172.21.15.110:0/772760432 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1700073260 con 0x7f170012c150 2024-05-09T09:50:43.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f16f7fff640 1 -- 172.21.15.110:0/772760432 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16f00ad980 con 0x7f170012c150 2024-05-09T09:50:43.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f1705b02640 1 -- 172.21.15.110:0/772760432 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1700133310 con 0x7f170012c150 2024-05-09T09:50:43.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f1705b02640 1 -- 172.21.15.110:0/772760432 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f17001348c0 con 0x7f170012c150 2024-05-09T09:50:43.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f16f7fff640 1 -- 172.21.15.110:0/772760432 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f16f00c0020 con 0x7f170012c150 2024-05-09T09:50:43.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f16f7fff640 1 --2- 172.21.15.110:0/772760432 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f16e0036310 0x7f16e00387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:43.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f16f7fff640 1 -- 172.21.15.110:0/772760432 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f16f00be020 con 0x7f170012c150 2024-05-09T09:50:43.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f16f7fff640 1 --2- 172.21.15.110:0/772760432 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f16e0042780 0x7f16e0044c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:43.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f16f7fff640 1 -- 172.21.15.110:0/772760432 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f16f00a5660 con 0x7f16e0042780 2024-05-09T09:50:43.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.895+0000 7f16f7fff640 1 -- 172.21.15.110:0/772760432 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f16f00eb050 con 0x7f170012c150 2024-05-09T09:50:43.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.899+0000 7f16feffd640 1 --2- 172.21.15.110:0/772760432 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f16e0036310 0x7f16e00387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:43.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.899+0000 7f16fffff640 1 --2- 172.21.15.110:0/772760432 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f16e0042780 0x7f16e0044c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:43.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.899+0000 7f16feffd640 1 --2- 172.21.15.110:0/772760432 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f16e0036310 0x7f16e00387d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f16e8000f70 tx=0x7f16e8007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:43.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.899+0000 7f16fffff640 1 --2- 172.21.15.110:0/772760432 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f16e0042780 0x7f16e0044c20 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:43.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.899+0000 7f16f7fff640 1 -- 172.21.15.110:0/772760432 <== osd.2 v2:172.21.15.157:6800/354455204 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f16f00a5660 con 0x7f16e0042780 2024-05-09T09:50:43.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.915+0000 7f1705b02640 1 -- 172.21.15.110:0/772760432 --> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f170006e060 con 0x7f16e0042780 2024-05-09T09:50:43.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.915+0000 7f16f7fff640 1 -- 172.21.15.110:0/772760432 <== osd.2 v2:172.21.15.157:6800/354455204 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f16f8009870 con 0x7f16e0042780 2024-05-09T09:50:43.917 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-05-09T09:50:43.918 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T09:50:43.918 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-05-09T09:50:43.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.915+0000 7f1705b02640 1 -- 172.21.15.110:0/772760432 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f16e0042780 msgr2=0x7f16e0044c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:43.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.915+0000 7f1705b02640 1 --2- 172.21.15.110:0/772760432 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f16e0042780 0x7f16e0044c20 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:43.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.915+0000 7f1705b02640 1 -- 172.21.15.110:0/772760432 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f16e0036310 msgr2=0x7f16e00387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:43.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.915+0000 7f1705b02640 1 --2- 172.21.15.110:0/772760432 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f16e0036310 0x7f16e00387d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f16e8000f70 tx=0x7f16e8007a90 comp rx=0 tx=0).stop 2024-05-09T09:50:43.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.915+0000 7f1705b02640 1 -- 172.21.15.110:0/772760432 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f170012c150 msgr2=0x7f1700132dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:43.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.915+0000 7f1705b02640 1 --2- 172.21.15.110:0/772760432 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f170012c150 0x7f1700132dd0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009d90 tx=0x7f16f0019660 comp rx=0 tx=0).stop 2024-05-09T09:50:43.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.915+0000 7f1705b02640 1 -- 172.21.15.110:0/772760432 shutdown_connections 2024-05-09T09:50:43.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.915+0000 7f1705b02640 1 --2- 172.21.15.110:0/772760432 >> [v2:172.21.15.157:6800/354455204,v1:172.21.15.157:6801/354455204] conn(0x7f16e0042780 0x7f16e0044c20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:43.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.915+0000 7f1705b02640 1 --2- 172.21.15.110:0/772760432 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f16e0036310 0x7f16e00387d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:43.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.915+0000 7f1705b02640 1 --2- 172.21.15.110:0/772760432 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f170012c150 0x7f1700132dd0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:43.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.915+0000 7f1705b02640 1 -- 172.21.15.110:0/772760432 >> 172.21.15.110:0/772760432 conn(0x7f17000a16a0 msgr2=0x7f170012a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:43.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.915+0000 7f1705b02640 1 -- 172.21.15.110:0/772760432 shutdown_connections 2024-05-09T09:50:43.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:43.915+0000 7f1705b02640 1 -- 172.21.15.110:0/772760432 wait complete. 2024-05-09T09:50:43.933 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-09T09:50:44.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.043+0000 7f9f393b2640 1 Processor -- start 2024-05-09T09:50:44.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.043+0000 7f9f393b2640 1 -- start start 2024-05-09T09:50:44.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.043+0000 7f9f393b2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9f3409e3b0 0x7f9f3412bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:44.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.043+0000 7f9f393b2640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f3412b820 con 0x7f9f3412c1b0 2024-05-09T09:50:44.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.043+0000 7f9f393b2640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f9f340a0fc0 con 0x7f9f3409e3b0 2024-05-09T09:50:44.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.043+0000 7f9f32ffd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9f3409e3b0 0x7f9f3412bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:44.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.043+0000 7f9f327fc640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f9f3412c1b0 0x7f9f3412ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:33572/0 (socket says 172.21.15.110:33572) 2024-05-09T09:50:44.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.043+0000 7f9f32ffd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9f3409e3b0 0x7f9f3412bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:36040/0 (socket says 172.21.15.110:36040) 2024-05-09T09:50:44.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.043+0000 7f9f32ffd640 1 -- 172.21.15.110:0/1962231562 learned_addr learned my addr 172.21.15.110:0/1962231562 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:50:44.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.043+0000 7f9f32ffd640 1 -- 172.21.15.110:0/1962231562 >> v1:172.21.15.110:6789/0 conn(0x7f9f3412c1b0 legacy=0x7f9f3412ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:44.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.043+0000 7f9f31ffb640 1 -- 172.21.15.110:0/1962231562 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1913452451 0 0) 0x7f9f3412b820 con 0x7f9f3412c1b0 2024-05-09T09:50:44.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.043+0000 7f9f32ffd640 1 -- 172.21.15.110:0/1962231562 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f3409b5f0 con 0x7f9f3409e3b0 2024-05-09T09:50:44.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.047+0000 7f9f32ffd640 1 --2- 172.21.15.110:0/1962231562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f3409e3b0 0x7f9f3412bc70 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f9f280097f0 tx=0x7f9f2801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c485c74543a74304 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:44.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.047+0000 7f9f31ffb640 1 -- 172.21.15.110:0/1962231562 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f280b0070 con 0x7f9f3409e3b0 2024-05-09T09:50:44.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.047+0000 7f9f31ffb640 1 -- 172.21.15.110:0/1962231562 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f280ab530 con 0x7f9f3409e3b0 2024-05-09T09:50:44.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.047+0000 7f9f31ffb640 1 -- 172.21.15.110:0/1962231562 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f280ab830 con 0x7f9f3409e3b0 2024-05-09T09:50:44.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.047+0000 7f9f393b2640 1 -- 172.21.15.110:0/1962231562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f3409e3b0 msgr2=0x7f9f3412bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:44.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.047+0000 7f9f393b2640 1 --2- 172.21.15.110:0/1962231562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f3409e3b0 0x7f9f3412bc70 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f9f280097f0 tx=0x7f9f2801c430 comp rx=0 tx=0).stop 2024-05-09T09:50:44.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.047+0000 7f9f393b2640 1 -- 172.21.15.110:0/1962231562 shutdown_connections 2024-05-09T09:50:44.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.047+0000 7f9f393b2640 1 --2- 172.21.15.110:0/1962231562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f3409e3b0 0x7f9f3412bc70 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:44.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.047+0000 7f9f393b2640 1 -- 172.21.15.110:0/1962231562 >> 172.21.15.110:0/1962231562 conn(0x7f9f340a17a0 msgr2=0x7f9f3409dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:44.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.047+0000 7f9f393b2640 1 -- 172.21.15.110:0/1962231562 shutdown_connections 2024-05-09T09:50:44.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.047+0000 7f9f393b2640 1 -- 172.21.15.110:0/1962231562 wait complete. 2024-05-09T09:50:44.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.047+0000 7f9f393b2640 1 Processor -- start 2024-05-09T09:50:44.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.047+0000 7f9f393b2640 1 -- start start 2024-05-09T09:50:44.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.047+0000 7f9f393b2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f3409e3b0 0x7f9f34132c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:44.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.047+0000 7f9f393b2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9f341371e0 con 0x7f9f3409e3b0 2024-05-09T09:50:44.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.047+0000 7f9f32ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f3409e3b0 0x7f9f34132c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:44.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.047+0000 7f9f32ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f3409e3b0 0x7f9f34132c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:36048/0 (socket says 172.21.15.110:36048) 2024-05-09T09:50:44.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.047+0000 7f9f32ffd640 1 -- 172.21.15.110:0/2919412446 learned_addr learned my addr 172.21.15.110:0/2919412446 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:50:44.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.047+0000 7f9f32ffd640 1 -- 172.21.15.110:0/2919412446 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f3406d770 con 0x7f9f3409e3b0 2024-05-09T09:50:44.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.047+0000 7f9f32ffd640 1 --2- 172.21.15.110:0/2919412446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f3409e3b0 0x7f9f34132c50 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f9f2801a060 tx=0x7f9f2801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:44.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.047+0000 7f9f1b7fe640 1 -- 172.21.15.110:0/2919412446 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f280ba020 con 0x7f9f3409e3b0 2024-05-09T09:50:44.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.047+0000 7f9f1b7fe640 1 -- 172.21.15.110:0/2919412446 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f280b6420 con 0x7f9f3409e3b0 2024-05-09T09:50:44.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.047+0000 7f9f393b2640 1 -- 172.21.15.110:0/2919412446 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f3406e520 con 0x7f9f3409e3b0 2024-05-09T09:50:44.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.047+0000 7f9f1b7fe640 1 -- 172.21.15.110:0/2919412446 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f280b0040 con 0x7f9f3409e3b0 2024-05-09T09:50:44.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.047+0000 7f9f393b2640 1 -- 172.21.15.110:0/2919412446 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f3406e850 con 0x7f9f3409e3b0 2024-05-09T09:50:44.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.051+0000 7f9f1b7fe640 1 -- 172.21.15.110:0/2919412446 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f9f280bd020 con 0x7f9f3409e3b0 2024-05-09T09:50:44.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.051+0000 7f9f393b2640 1 -- 172.21.15.110:0/2919412446 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f34063710 con 0x7f9f3409e3b0 2024-05-09T09:50:44.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.051+0000 7f9f1b7fe640 1 --2- 172.21.15.110:0/2919412446 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9f20036310 0x7f9f200387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:44.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.051+0000 7f9f1b7fe640 1 -- 172.21.15.110:0/2919412446 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f9f280e3a10 con 0x7f9f3409e3b0 2024-05-09T09:50:44.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.051+0000 7f9f327fc640 1 --2- 172.21.15.110:0/2919412446 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9f20036310 0x7f9f200387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:44.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.051+0000 7f9f327fc640 1 --2- 172.21.15.110:0/2919412446 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9f20036310 0x7f9f200387d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9f24007fd0 tx=0x7f9f24007940 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:44.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.055+0000 7f9f1b7fe640 1 -- 172.21.15.110:0/2919412446 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9f280c4030 con 0x7f9f3409e3b0 2024-05-09T09:50:44.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.203+0000 7f9f393b2640 1 -- 172.21.15.110:0/2919412446 --> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f9f34067fd0 con 0x7f9f20036310 2024-05-09T09:50:44.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.203+0000 7f9f1b7fe640 1 -- 172.21.15.110:0/2919412446 <== mgr.4100 v2:172.21.15.157:6824/2765519551 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9f34067fd0 con 0x7f9f20036310 2024-05-09T09:50:44.208 INFO:teuthology.orchestra.run.smithi110.stderr:instructed osd(s) 2 to deep-scrub 2024-05-09T09:50:44.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.207+0000 7f9f393b2640 1 -- 172.21.15.110:0/2919412446 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9f20036310 msgr2=0x7f9f200387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:44.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.207+0000 7f9f393b2640 1 --2- 172.21.15.110:0/2919412446 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9f20036310 0x7f9f200387d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9f24007fd0 tx=0x7f9f24007940 comp rx=0 tx=0).stop 2024-05-09T09:50:44.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.207+0000 7f9f393b2640 1 -- 172.21.15.110:0/2919412446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f3409e3b0 msgr2=0x7f9f34132c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:44.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.207+0000 7f9f393b2640 1 --2- 172.21.15.110:0/2919412446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f3409e3b0 0x7f9f34132c50 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f9f2801a060 tx=0x7f9f2801ac70 comp rx=0 tx=0).stop 2024-05-09T09:50:44.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.207+0000 7f9f393b2640 1 -- 172.21.15.110:0/2919412446 shutdown_connections 2024-05-09T09:50:44.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.207+0000 7f9f393b2640 1 --2- 172.21.15.110:0/2919412446 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f9f20036310 0x7f9f200387d0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:44.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.207+0000 7f9f393b2640 1 --2- 172.21.15.110:0/2919412446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f3409e3b0 0x7f9f34132c50 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:44.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.207+0000 7f9f393b2640 1 -- 172.21.15.110:0/2919412446 >> 172.21.15.110:0/2919412446 conn(0x7f9f340a17a0 msgr2=0x7f9f340986a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:44.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.207+0000 7f9f393b2640 1 -- 172.21.15.110:0/2919412446 shutdown_connections 2024-05-09T09:50:44.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.207+0000 7f9f393b2640 1 -- 172.21.15.110:0/2919412446 wait complete. 2024-05-09T09:50:44.225 INFO:tasks.ceph:Scrubbing osd.3 2024-05-09T09:50:44.226 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-09T09:50:44.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.335+0000 7efda15b4640 1 Processor -- start 2024-05-09T09:50:44.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.335+0000 7efda15b4640 1 -- start start 2024-05-09T09:50:44.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.335+0000 7efda15b4640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efd9c1285d0 0x7efd9c1289b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:44.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.335+0000 7efda15b4640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd9c0992f0 con 0x7efd9c095580 2024-05-09T09:50:44.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.335+0000 7efda15b4640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7efd9c128210 con 0x7efd9c1285d0 2024-05-09T09:50:44.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.335+0000 7efd9affd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efd9c1285d0 0x7efd9c1289b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:44.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.335+0000 7efd9a7fc640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7efd9c095580 0x7efd9c0959b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:33584/0 (socket says 172.21.15.110:33584) 2024-05-09T09:50:44.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.335+0000 7efd9a7fc640 1 -- 172.21.15.110:0/659665735 learned_addr learned my addr 172.21.15.110:0/659665735 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:50:44.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.335+0000 7efd9affd640 1 -- 172.21.15.110:0/659665735 >> v1:172.21.15.110:6789/0 conn(0x7efd9c095580 legacy=0x7efd9c0959b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:44.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.335+0000 7efd9affd640 1 -- 172.21.15.110:0/659665735 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9c06d9c0 con 0x7efd9c1285d0 2024-05-09T09:50:44.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.339+0000 7efd9affd640 1 --2- 172.21.15.110:0/659665735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd9c1285d0 0x7efd9c1289b0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7efd8c009740 tx=0x7efd8c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b6556862693ef43 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:44.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.339+0000 7efd99ffb640 1 -- 172.21.15.110:0/659665735 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd8c0b0070 con 0x7efd9c1285d0 2024-05-09T09:50:44.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.339+0000 7efd99ffb640 1 -- 172.21.15.110:0/659665735 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd8c0ab530 con 0x7efd9c1285d0 2024-05-09T09:50:44.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.339+0000 7efd99ffb640 1 -- 172.21.15.110:0/659665735 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd8c0ab830 con 0x7efd9c1285d0 2024-05-09T09:50:44.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.339+0000 7efda15b4640 1 -- 172.21.15.110:0/659665735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd9c1285d0 msgr2=0x7efd9c1289b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:44.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.339+0000 7efda15b4640 1 --2- 172.21.15.110:0/659665735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd9c1285d0 0x7efd9c1289b0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7efd8c009740 tx=0x7efd8c01c370 comp rx=0 tx=0).stop 2024-05-09T09:50:44.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.339+0000 7efda15b4640 1 -- 172.21.15.110:0/659665735 shutdown_connections 2024-05-09T09:50:44.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.339+0000 7efda15b4640 1 --2- 172.21.15.110:0/659665735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd9c1285d0 0x7efd9c1289b0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:44.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.339+0000 7efda15b4640 1 -- 172.21.15.110:0/659665735 >> 172.21.15.110:0/659665735 conn(0x7efd9c09a070 msgr2=0x7efd9c097970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:44.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.339+0000 7efda15b4640 1 -- 172.21.15.110:0/659665735 shutdown_connections 2024-05-09T09:50:44.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.339+0000 7efda15b4640 1 -- 172.21.15.110:0/659665735 wait complete. 2024-05-09T09:50:44.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.339+0000 7efda15b4640 1 Processor -- start 2024-05-09T09:50:44.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.339+0000 7efda15b4640 1 -- start start 2024-05-09T09:50:44.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.339+0000 7efda15b4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd9c095580 0x7efd9c122480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:44.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.339+0000 7efda15b4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c134260 con 0x7efd9c095580 2024-05-09T09:50:44.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.339+0000 7efd9affd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd9c095580 0x7efd9c122480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:44.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.339+0000 7efd9affd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd9c095580 0x7efd9c122480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:36074/0 (socket says 172.21.15.110:36074) 2024-05-09T09:50:44.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.339+0000 7efd9affd640 1 -- 172.21.15.110:0/3558861224 learned_addr learned my addr 172.21.15.110:0/3558861224 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:50:44.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.339+0000 7efd9affd640 1 -- 172.21.15.110:0/3558861224 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9c123d20 con 0x7efd9c095580 2024-05-09T09:50:44.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.339+0000 7efd9affd640 1 --2- 172.21.15.110:0/3558861224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd9c095580 0x7efd9c122480 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7efd8c0ae040 tx=0x7efd8c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:44.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.343+0000 7efd837fe640 1 -- 172.21.15.110:0/3558861224 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd8c0b0050 con 0x7efd9c095580 2024-05-09T09:50:44.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.343+0000 7efd837fe640 1 -- 172.21.15.110:0/3558861224 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd8c0b1040 con 0x7efd9c095580 2024-05-09T09:50:44.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.343+0000 7efda15b4640 1 -- 172.21.15.110:0/3558861224 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd9c122030 con 0x7efd9c095580 2024-05-09T09:50:44.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.343+0000 7efd837fe640 1 -- 172.21.15.110:0/3558861224 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd8c0b5780 con 0x7efd9c095580 2024-05-09T09:50:44.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.343+0000 7efda15b4640 1 -- 172.21.15.110:0/3558861224 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd9c124420 con 0x7efd9c095580 2024-05-09T09:50:44.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.343+0000 7efda15b4640 1 -- 172.21.15.110:0/3558861224 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efd9c063710 con 0x7efd9c095580 2024-05-09T09:50:44.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.343+0000 7efd837fe640 1 -- 172.21.15.110:0/3558861224 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7efd8c0be030 con 0x7efd9c095580 2024-05-09T09:50:44.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.343+0000 7efd837fe640 1 --2- 172.21.15.110:0/3558861224 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efd88036310 0x7efd880387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:44.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.343+0000 7efd837fe640 1 -- 172.21.15.110:0/3558861224 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7efd8c0bc070 con 0x7efd9c095580 2024-05-09T09:50:44.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.343+0000 7efd837fe640 1 --2- 172.21.15.110:0/3558861224 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x7efd88042780 0x7efd88044c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:44.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.343+0000 7efd837fe640 1 -- 172.21.15.110:0/3558861224 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd8c001d40 con 0x7efd88042780 2024-05-09T09:50:44.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.343+0000 7efd837fe640 1 -- 172.21.15.110:0/3558861224 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7efd8c0ea050 con 0x7efd9c095580 2024-05-09T09:50:44.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.343+0000 7efd9a7fc640 1 --2- 172.21.15.110:0/3558861224 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efd88036310 0x7efd880387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:44.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.343+0000 7efd9b7fe640 1 --2- 172.21.15.110:0/3558861224 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x7efd88042780 0x7efd88044c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:44.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.343+0000 7efd9a7fc640 1 --2- 172.21.15.110:0/3558861224 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efd88036310 0x7efd880387d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efd90001610 tx=0x7efd90007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:44.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.343+0000 7efd9b7fe640 1 --2- 172.21.15.110:0/3558861224 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x7efd88042780 0x7efd88044c20 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:44.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.347+0000 7efd837fe640 1 -- 172.21.15.110:0/3558861224 <== osd.3 v2:172.21.15.157:6816/2487336710 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efd8c001d40 con 0x7efd88042780 2024-05-09T09:50:44.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.359+0000 7efda15b4640 1 -- 172.21.15.110:0/3558861224 --> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7efd9c067fd0 con 0x7efd88042780 2024-05-09T09:50:44.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.359+0000 7efd837fe640 1 -- 172.21.15.110:0/3558861224 <== osd.3 v2:172.21.15.157:6816/2487336710 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7efd9c067fd0 con 0x7efd88042780 2024-05-09T09:50:44.362 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-05-09T09:50:44.362 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T09:50:44.362 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-05-09T09:50:44.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.359+0000 7efda15b4640 1 -- 172.21.15.110:0/3558861224 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x7efd88042780 msgr2=0x7efd88044c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:44.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.359+0000 7efda15b4640 1 --2- 172.21.15.110:0/3558861224 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x7efd88042780 0x7efd88044c20 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:44.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.359+0000 7efda15b4640 1 -- 172.21.15.110:0/3558861224 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efd88036310 msgr2=0x7efd880387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:44.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.359+0000 7efda15b4640 1 --2- 172.21.15.110:0/3558861224 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efd88036310 0x7efd880387d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efd90001610 tx=0x7efd90007ad0 comp rx=0 tx=0).stop 2024-05-09T09:50:44.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.359+0000 7efda15b4640 1 -- 172.21.15.110:0/3558861224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd9c095580 msgr2=0x7efd9c122480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:44.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.359+0000 7efda15b4640 1 --2- 172.21.15.110:0/3558861224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd9c095580 0x7efd9c122480 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7efd8c0ae040 tx=0x7efd8c01abb0 comp rx=0 tx=0).stop 2024-05-09T09:50:44.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.359+0000 7efda15b4640 1 -- 172.21.15.110:0/3558861224 shutdown_connections 2024-05-09T09:50:44.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.359+0000 7efda15b4640 1 --2- 172.21.15.110:0/3558861224 >> [v2:172.21.15.157:6816/2487336710,v1:172.21.15.157:6817/2487336710] conn(0x7efd88042780 0x7efd88044c20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:44.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.359+0000 7efda15b4640 1 --2- 172.21.15.110:0/3558861224 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efd88036310 0x7efd880387d0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:44.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.359+0000 7efda15b4640 1 --2- 172.21.15.110:0/3558861224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd9c095580 0x7efd9c122480 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:44.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.359+0000 7efda15b4640 1 -- 172.21.15.110:0/3558861224 >> 172.21.15.110:0/3558861224 conn(0x7efd9c09a070 msgr2=0x7efd9c06fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:44.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.359+0000 7efda15b4640 1 -- 172.21.15.110:0/3558861224 shutdown_connections 2024-05-09T09:50:44.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.359+0000 7efda15b4640 1 -- 172.21.15.110:0/3558861224 wait complete. 2024-05-09T09:50:44.376 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-09T09:50:44.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.475+0000 7f57ff425640 1 Processor -- start 2024-05-09T09:50:44.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.475+0000 7f57ff425640 1 -- start start 2024-05-09T09:50:44.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.475+0000 7f57ff425640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f57f8128a00 0x7f57f8128de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:44.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.475+0000 7f57ff425640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57f80949c0 con 0x7f57f8095d30 2024-05-09T09:50:44.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.475+0000 7f57ff425640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f57f81285b0 con 0x7f57f8128a00 2024-05-09T09:50:44.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.475+0000 7f57fd1c1640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f57f8128a00 0x7f57f8128de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:44.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.475+0000 7f57fc9c0640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f57f8095d30 0x7f57f80961e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:33594/0 (socket says 172.21.15.110:33594) 2024-05-09T09:50:44.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.475+0000 7f57fd1c1640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f57f8128a00 0x7f57f8128de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:36078/0 (socket says 172.21.15.110:36078) 2024-05-09T09:50:44.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.475+0000 7f57fc9c0640 1 -- 172.21.15.110:0/4000359652 learned_addr learned my addr 172.21.15.110:0/4000359652 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:50:44.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.475+0000 7f57fd1c1640 1 -- 172.21.15.110:0/4000359652 >> v1:172.21.15.110:6789/0 conn(0x7f57f8095d30 legacy=0x7f57f80961e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:44.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.475+0000 7f57fd1c1640 1 -- 172.21.15.110:0/4000359652 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f806dd10 con 0x7f57f8128a00 2024-05-09T09:50:44.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.475+0000 7f57ebfff640 1 -- 172.21.15.110:0/4000359652 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 636655820 0 0) 0x7f57ec001120 con 0x7f57f8095d30 2024-05-09T09:50:44.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.479+0000 7f57fd1c1640 1 --2- 172.21.15.110:0/4000359652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f8128a00 0x7f57f8128de0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f57f0009d90 tx=0x7f57f001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=299aaf752e8044cb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:44.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.479+0000 7f57ebfff640 1 -- 172.21.15.110:0/4000359652 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57f00b2070 con 0x7f57f8128a00 2024-05-09T09:50:44.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.479+0000 7f57ebfff640 1 -- 172.21.15.110:0/4000359652 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57f00a56e0 con 0x7f57f8128a00 2024-05-09T09:50:44.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.479+0000 7f57ebfff640 1 -- 172.21.15.110:0/4000359652 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57f00a59e0 con 0x7f57f8128a00 2024-05-09T09:50:44.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.479+0000 7f57ff425640 1 -- 172.21.15.110:0/4000359652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f8128a00 msgr2=0x7f57f8128de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:44.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.479+0000 7f57ff425640 1 --2- 172.21.15.110:0/4000359652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f8128a00 0x7f57f8128de0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f57f0009d90 tx=0x7f57f001c8c0 comp rx=0 tx=0).stop 2024-05-09T09:50:44.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.479+0000 7f57ff425640 1 -- 172.21.15.110:0/4000359652 shutdown_connections 2024-05-09T09:50:44.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.479+0000 7f57ff425640 1 --2- 172.21.15.110:0/4000359652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f8128a00 0x7f57f8128de0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:44.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.479+0000 7f57ff425640 1 -- 172.21.15.110:0/4000359652 >> 172.21.15.110:0/4000359652 conn(0x7f57f809ad20 msgr2=0x7f57f809b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:44.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.479+0000 7f57ff425640 1 -- 172.21.15.110:0/4000359652 shutdown_connections 2024-05-09T09:50:44.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.479+0000 7f57ff425640 1 -- 172.21.15.110:0/4000359652 wait complete. 2024-05-09T09:50:44.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.479+0000 7f57ff425640 1 Processor -- start 2024-05-09T09:50:44.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.479+0000 7f57ff425640 1 -- start start 2024-05-09T09:50:44.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.479+0000 7f57ff425640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f8095d30 0x7f57f8129dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:44.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.479+0000 7f57ff425640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f57f81344b0 con 0x7f57f8095d30 2024-05-09T09:50:44.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.479+0000 7f57fd1c1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f8095d30 0x7f57f8129dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:44.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.479+0000 7f57fd1c1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f8095d30 0x7f57f8129dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:36080/0 (socket says 172.21.15.110:36080) 2024-05-09T09:50:44.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.479+0000 7f57fd1c1640 1 -- 172.21.15.110:0/3127238157 learned_addr learned my addr 172.21.15.110:0/3127238157 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:50:44.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.479+0000 7f57fd1c1640 1 -- 172.21.15.110:0/3127238157 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f812c4d0 con 0x7f57f8095d30 2024-05-09T09:50:44.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.479+0000 7f57fd1c1640 1 --2- 172.21.15.110:0/3127238157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f8095d30 0x7f57f8129dd0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f57f00a56b0 tx=0x7f57f0019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:44.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.479+0000 7f57e9ffb640 1 -- 172.21.15.110:0/3127238157 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57f00bd020 con 0x7f57f8095d30 2024-05-09T09:50:44.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.483+0000 7f57e9ffb640 1 -- 172.21.15.110:0/3127238157 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57f00b85a0 con 0x7f57f8095d30 2024-05-09T09:50:44.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.483+0000 7f57ff425640 1 -- 172.21.15.110:0/3127238157 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57f8099400 con 0x7f57f8095d30 2024-05-09T09:50:44.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.483+0000 7f57e9ffb640 1 -- 172.21.15.110:0/3127238157 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57f00b2040 con 0x7f57f8095d30 2024-05-09T09:50:44.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.483+0000 7f57ff425640 1 -- 172.21.15.110:0/3127238157 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57f812d100 con 0x7f57f8095d30 2024-05-09T09:50:44.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.483+0000 7f57e9ffb640 1 -- 172.21.15.110:0/3127238157 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f57f00c0020 con 0x7f57f8095d30 2024-05-09T09:50:44.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.483+0000 7f57ff425640 1 -- 172.21.15.110:0/3127238157 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57f8063710 con 0x7f57f8095d30 2024-05-09T09:50:44.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.483+0000 7f57e9ffb640 1 --2- 172.21.15.110:0/3127238157 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f57dc036310 0x7f57dc0387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:44.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.483+0000 7f57e9ffb640 1 -- 172.21.15.110:0/3127238157 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f57f00e47f0 con 0x7f57f8095d30 2024-05-09T09:50:44.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.483+0000 7f57fc9c0640 1 --2- 172.21.15.110:0/3127238157 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f57dc036310 0x7f57dc0387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:44.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.483+0000 7f57fc9c0640 1 --2- 172.21.15.110:0/3127238157 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f57dc036310 0x7f57dc0387d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f57ec000c10 tx=0x7f57ec007a50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:44.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.487+0000 7f57e9ffb640 1 -- 172.21.15.110:0/3127238157 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f57f00c7030 con 0x7f57f8095d30 2024-05-09T09:50:44.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.643+0000 7f57ff425640 1 -- 172.21.15.110:0/3127238157 --> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f57f8067fd0 con 0x7f57dc036310 2024-05-09T09:50:44.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.643+0000 7f57e9ffb640 1 -- 172.21.15.110:0/3127238157 <== mgr.4100 v2:172.21.15.157:6824/2765519551 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f57f8067fd0 con 0x7f57dc036310 2024-05-09T09:50:44.647 INFO:teuthology.orchestra.run.smithi110.stderr:instructed osd(s) 3 to deep-scrub 2024-05-09T09:50:44.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.647+0000 7f57ff425640 1 -- 172.21.15.110:0/3127238157 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f57dc036310 msgr2=0x7f57dc0387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:44.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.647+0000 7f57ff425640 1 --2- 172.21.15.110:0/3127238157 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f57dc036310 0x7f57dc0387d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f57ec000c10 tx=0x7f57ec007a50 comp rx=0 tx=0).stop 2024-05-09T09:50:44.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.647+0000 7f57ff425640 1 -- 172.21.15.110:0/3127238157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f8095d30 msgr2=0x7f57f8129dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:44.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.647+0000 7f57ff425640 1 --2- 172.21.15.110:0/3127238157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f8095d30 0x7f57f8129dd0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f57f00a56b0 tx=0x7f57f0019660 comp rx=0 tx=0).stop 2024-05-09T09:50:44.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.647+0000 7f57ff425640 1 -- 172.21.15.110:0/3127238157 shutdown_connections 2024-05-09T09:50:44.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.647+0000 7f57ff425640 1 --2- 172.21.15.110:0/3127238157 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f57dc036310 0x7f57dc0387d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:44.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.647+0000 7f57ff425640 1 --2- 172.21.15.110:0/3127238157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f8095d30 0x7f57f8129dd0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:44.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.647+0000 7f57ff425640 1 -- 172.21.15.110:0/3127238157 >> 172.21.15.110:0/3127238157 conn(0x7f57f809ad20 msgr2=0x7f57f80981d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:44.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.647+0000 7f57ff425640 1 -- 172.21.15.110:0/3127238157 shutdown_connections 2024-05-09T09:50:44.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.647+0000 7f57ff425640 1 -- 172.21.15.110:0/3127238157 wait complete. 2024-05-09T09:50:44.663 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T09:50:44.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.763+0000 7f9951af8640 1 Processor -- start 2024-05-09T09:50:44.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.763+0000 7f9951af8640 1 -- start start 2024-05-09T09:50:44.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.763+0000 7f9951af8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f994c12b500 0x7f994c12b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:44.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.763+0000 7f9951af8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f994c096f10 con 0x7f994c094c20 2024-05-09T09:50:44.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.763+0000 7f9951af8640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f994c0966d0 con 0x7f994c12b500 2024-05-09T09:50:44.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.767+0000 7f994b7fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f994c12b500 0x7f994c12b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:44.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.767+0000 7f9943fff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f994c094c20 0x7f994c095050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:33602/0 (socket says 172.21.15.110:33602) 2024-05-09T09:50:44.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.767+0000 7f9943fff640 1 -- 172.21.15.110:0/3286963033 learned_addr learned my addr 172.21.15.110:0/3286963033 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:50:44.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.767+0000 7f994b7fe640 1 -- 172.21.15.110:0/3286963033 >> v1:172.21.15.110:6789/0 conn(0x7f994c094c20 legacy=0x7f994c095050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:44.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.767+0000 7f994b7fe640 1 -- 172.21.15.110:0/3286963033 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f994c072d20 con 0x7f994c12b500 2024-05-09T09:50:44.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.767+0000 7f994b7fe640 1 --2- 172.21.15.110:0/3286963033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f994c12b500 0x7f994c12b8e0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f9934009740 tx=0x7f993401c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c48d6fcc311b0f12 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:44.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.767+0000 7f994affd640 1 -- 172.21.15.110:0/3286963033 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99340b0070 con 0x7f994c12b500 2024-05-09T09:50:44.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.767+0000 7f994affd640 1 -- 172.21.15.110:0/3286963033 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99340ab530 con 0x7f994c12b500 2024-05-09T09:50:44.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.767+0000 7f994affd640 1 -- 172.21.15.110:0/3286963033 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99340ab830 con 0x7f994c12b500 2024-05-09T09:50:44.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.767+0000 7f9951af8640 1 -- 172.21.15.110:0/3286963033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f994c12b500 msgr2=0x7f994c12b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:44.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.767+0000 7f9951af8640 1 --2- 172.21.15.110:0/3286963033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f994c12b500 0x7f994c12b8e0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f9934009740 tx=0x7f993401c340 comp rx=0 tx=0).stop 2024-05-09T09:50:44.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.767+0000 7f9951af8640 1 -- 172.21.15.110:0/3286963033 shutdown_connections 2024-05-09T09:50:44.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.767+0000 7f9951af8640 1 --2- 172.21.15.110:0/3286963033 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f994c12b500 0x7f994c12b8e0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:44.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.767+0000 7f9951af8640 1 -- 172.21.15.110:0/3286963033 >> 172.21.15.110:0/3286963033 conn(0x7f994c09ad20 msgr2=0x7f994c09b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:44.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.767+0000 7f9951af8640 1 -- 172.21.15.110:0/3286963033 shutdown_connections 2024-05-09T09:50:44.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.767+0000 7f9951af8640 1 -- 172.21.15.110:0/3286963033 wait complete. 2024-05-09T09:50:44.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.771+0000 7f9951af8640 1 Processor -- start 2024-05-09T09:50:44.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.771+0000 7f9951af8640 1 -- start start 2024-05-09T09:50:44.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.771+0000 7f9951af8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f994c094c20 0x7f994c08dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:44.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.771+0000 7f9951af8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f994c095b30 con 0x7f994c094c20 2024-05-09T09:50:44.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.771+0000 7f994b7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f994c094c20 0x7f994c08dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:44.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.771+0000 7f994b7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f994c094c20 0x7f994c08dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:36104/0 (socket says 172.21.15.110:36104) 2024-05-09T09:50:44.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.771+0000 7f994b7fe640 1 -- 172.21.15.110:0/700751119 learned_addr learned my addr 172.21.15.110:0/700751119 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:50:44.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.771+0000 7f994b7fe640 1 -- 172.21.15.110:0/700751119 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f994c08fcd0 con 0x7f994c094c20 2024-05-09T09:50:44.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.771+0000 7f994b7fe640 1 --2- 172.21.15.110:0/700751119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f994c094c20 0x7f994c08dcf0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f9934019f70 tx=0x7f993401ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:44.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.771+0000 7f9948ff9640 1 -- 172.21.15.110:0/700751119 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99340b0050 con 0x7f994c094c20 2024-05-09T09:50:44.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.771+0000 7f9948ff9640 1 -- 172.21.15.110:0/700751119 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99340b1040 con 0x7f994c094c20 2024-05-09T09:50:44.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.771+0000 7f9951af8640 1 -- 172.21.15.110:0/700751119 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f994c0910d0 con 0x7f994c094c20 2024-05-09T09:50:44.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.771+0000 7f9948ff9640 1 -- 172.21.15.110:0/700751119 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99340b5740 con 0x7f994c094c20 2024-05-09T09:50:44.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.771+0000 7f9951af8640 1 -- 172.21.15.110:0/700751119 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f994c08e400 con 0x7f994c094c20 2024-05-09T09:50:44.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.771+0000 7f9951af8640 1 -- 172.21.15.110:0/700751119 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f994c063710 con 0x7f994c094c20 2024-05-09T09:50:44.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.771+0000 7f9948ff9640 1 -- 172.21.15.110:0/700751119 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f99340be030 con 0x7f994c094c20 2024-05-09T09:50:44.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.771+0000 7f9948ff9640 1 --2- 172.21.15.110:0/700751119 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f992c036310 0x7f992c0387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:50:44.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.771+0000 7f9948ff9640 1 -- 172.21.15.110:0/700751119 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f99340bc070 con 0x7f994c094c20 2024-05-09T09:50:44.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.771+0000 7f9943fff640 1 --2- 172.21.15.110:0/700751119 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f992c036310 0x7f992c0387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:50:44.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.771+0000 7f9943fff640 1 --2- 172.21.15.110:0/700751119 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f992c036310 0x7f992c0387d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f993c001610 tx=0x7f993c007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:50:44.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.775+0000 7f9948ff9640 1 -- 172.21.15.110:0/700751119 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f99340c5020 con 0x7f994c094c20 2024-05-09T09:50:44.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.935+0000 7f9951af8640 1 -- 172.21.15.110:0/700751119 --> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f994c067fd0 con 0x7f992c036310 2024-05-09T09:50:44.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.979+0000 7f9948ff9640 1 -- 172.21.15.110:0/700751119 <== mgr.4100 v2:172.21.15.157:6824/2765519551 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665894 (secure 0 0 0) 0x7f994c067fd0 con 0x7f992c036310 2024-05-09T09:50:44.986 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:50:44.994 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-05-09T09:50:44.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.987+0000 7f9951af8640 1 -- 172.21.15.110:0/700751119 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f992c036310 msgr2=0x7f992c0387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:44.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.987+0000 7f9951af8640 1 --2- 172.21.15.110:0/700751119 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f992c036310 0x7f992c0387d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f993c001610 tx=0x7f993c007ad0 comp rx=0 tx=0).stop 2024-05-09T09:50:44.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.987+0000 7f9951af8640 1 -- 172.21.15.110:0/700751119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f994c094c20 msgr2=0x7f994c08dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:50:44.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.987+0000 7f9951af8640 1 --2- 172.21.15.110:0/700751119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f994c094c20 0x7f994c08dcf0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f9934019f70 tx=0x7f993401ab80 comp rx=0 tx=0).stop 2024-05-09T09:50:44.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.987+0000 7f9951af8640 1 -- 172.21.15.110:0/700751119 shutdown_connections 2024-05-09T09:50:44.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.987+0000 7f9951af8640 1 --2- 172.21.15.110:0/700751119 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f992c036310 0x7f992c0387d0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:44.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.987+0000 7f9951af8640 1 --2- 172.21.15.110:0/700751119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f994c094c20 0x7f994c08dcf0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:50:44.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.987+0000 7f9951af8640 1 -- 172.21.15.110:0/700751119 >> 172.21.15.110:0/700751119 conn(0x7f994c09ad20 msgr2=0x7f994c097820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:50:44.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.987+0000 7f9951af8640 1 -- 172.21.15.110:0/700751119 shutdown_connections 2024-05-09T09:50:44.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:50:44.987+0000 7f9951af8640 1 -- 172.21.15.110:0/700751119 wait complete. 2024-05-09T09:50:45.013 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-05-09T09:50:43.175224+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5118,"num_read_kb":4699,"num_write":2179,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6967,"ondisk_log_size":6967,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152848,"kb_used_data":36464,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377334512,"statfs":{"total":386547056640,"available":386390540288,"internally_reserved":0,"allocated":37339136,"data_stored":36186168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":119138070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4281,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":713,"num_read_kb":672,"num_write":457,"num_write_kb":29372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007373"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.185131+0000","last_change":"2024-05-09T09:47:12.206481+0000","last_active":"2024-05-09T09:47:52.185131+0000","last_peered":"2024-05-09T09:47:52.185131+0000","last_clean":"2024-05-09T09:47:52.185131+0000","last_became_active":"2024-05-09T09:47:12.205786+0000","last_became_peered":"2024-05-09T09:47:12.205786+0000","last_unstale":"2024-05-09T09:47:52.185131+0000","last_undegraded":"2024-05-09T09:47:52.185131+0000","last_fullsized":"2024-05-09T09:47:52.185131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:17:39.735832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:46.160690+0000","last_change":"2024-05-09T09:47:14.171375+0000","last_active":"2024-05-09T09:48:46.160690+0000","last_peered":"2024-05-09T09:48:46.160690+0000","last_clean":"2024-05-09T09:48:46.160690+0000","last_became_active":"2024-05-09T09:47:14.171044+0000","last_became_peered":"2024-05-09T09:47:14.171044+0000","last_unstale":"2024-05-09T09:48:46.160690+0000","last_undegraded":"2024-05-09T09:48:46.160690+0000","last_fullsized":"2024-05-09T09:48:46.160690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:57.831374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.687417+0000","last_change":"2024-05-09T09:47:12.190812+0000","last_active":"2024-05-09T09:50:32.687417+0000","last_peered":"2024-05-09T09:50:32.687417+0000","last_clean":"2024-05-09T09:50:32.687417+0000","last_became_active":"2024-05-09T09:47:12.189774+0000","last_became_peered":"2024-05-09T09:47:12.189774+0000","last_unstale":"2024-05-09T09:50:32.687417+0000","last_undegraded":"2024-05-09T09:50:32.687417+0000","last_fullsized":"2024-05-09T09:50:32.687417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:13:12.664064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.180726+0000","last_change":"2024-05-09T09:47:14.193844+0000","last_active":"2024-05-09T09:47:52.180726+0000","last_peered":"2024-05-09T09:47:52.180726+0000","last_clean":"2024-05-09T09:47:52.180726+0000","last_became_active":"2024-05-09T09:47:14.192803+0000","last_became_peered":"2024-05-09T09:47:14.192803+0000","last_unstale":"2024-05-09T09:47:52.180726+0000","last_undegraded":"2024-05-09T09:47:52.180726+0000","last_fullsized":"2024-05-09T09:47:52.180726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:03:50.025641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"32'3","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:45.849127+0000","last_change":"2024-05-09T09:47:12.209625+0000","last_active":"2024-05-09T09:48:45.849127+0000","last_peered":"2024-05-09T09:48:45.849127+0000","last_clean":"2024-05-09T09:48:45.849127+0000","last_became_active":"2024-05-09T09:47:12.207184+0000","last_became_peered":"2024-05-09T09:47:12.207184+0000","last_unstale":"2024-05-09T09:48:45.849127+0000","last_undegraded":"2024-05-09T09:48:45.849127+0000","last_fullsized":"2024-05-09T09:48:45.849127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:58:32.194004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'14","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.151204+0000","last_change":"2024-05-09T09:47:14.193118+0000","last_active":"2024-05-09T09:50:33.151204+0000","last_peered":"2024-05-09T09:50:33.151204+0000","last_clean":"2024-05-09T09:50:33.151204+0000","last_became_active":"2024-05-09T09:47:14.192821+0000","last_became_peered":"2024-05-09T09:47:14.192821+0000","last_unstale":"2024-05-09T09:50:33.151204+0000","last_undegraded":"2024-05-09T09:50:33.151204+0000","last_fullsized":"2024-05-09T09:50:33.151204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:12.396738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.575240+0000","last_change":"2024-05-09T09:47:12.195169+0000","last_active":"2024-05-09T09:50:32.575240+0000","last_peered":"2024-05-09T09:50:32.575240+0000","last_clean":"2024-05-09T09:50:32.575240+0000","last_became_active":"2024-05-09T09:47:12.194183+0000","last_became_peered":"2024-05-09T09:47:12.194183+0000","last_unstale":"2024-05-09T09:50:32.575240+0000","last_undegraded":"2024-05-09T09:50:32.575240+0000","last_fullsized":"2024-05-09T09:50:32.575240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:14.033148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'12","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.805704+0000","last_change":"2024-05-09T09:47:52.430986+0000","last_active":"2024-05-09T09:50:32.805704+0000","last_peered":"2024-05-09T09:50:32.805704+0000","last_clean":"2024-05-09T09:50:32.805704+0000","last_became_active":"2024-05-09T09:47:52.429940+0000","last_became_peered":"2024-05-09T09:47:52.429940+0000","last_unstale":"2024-05-09T09:50:32.805704+0000","last_undegraded":"2024-05-09T09:50:32.805704+0000","last_fullsized":"2024-05-09T09:50:32.805704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:46:39.468582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.185616+0000","last_change":"2024-05-09T09:47:12.212361+0000","last_active":"2024-05-09T09:47:52.185616+0000","last_peered":"2024-05-09T09:47:52.185616+0000","last_clean":"2024-05-09T09:47:52.185616+0000","last_became_active":"2024-05-09T09:47:12.204446+0000","last_became_peered":"2024-05-09T09:47:12.204446+0000","last_unstale":"2024-05-09T09:47:52.185616+0000","last_undegraded":"2024-05-09T09:47:52.185616+0000","last_fullsized":"2024-05-09T09:47:52.185616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:14:59.069403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'16","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.303718+0000","last_change":"2024-05-09T09:47:14.185067+0000","last_active":"2024-05-09T09:50:33.303718+0000","last_peered":"2024-05-09T09:50:33.303718+0000","last_clean":"2024-05-09T09:50:33.303718+0000","last_became_active":"2024-05-09T09:47:14.184792+0000","last_became_peered":"2024-05-09T09:47:14.184792+0000","last_unstale":"2024-05-09T09:50:33.303718+0000","last_undegraded":"2024-05-09T09:50:33.303718+0000","last_fullsized":"2024-05-09T09:50:33.303718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:15.097524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.137283+0000","last_change":"2024-05-09T09:47:12.195761+0000","last_active":"2024-05-09T09:50:33.137283+0000","last_peered":"2024-05-09T09:50:33.137283+0000","last_clean":"2024-05-09T09:50:33.137283+0000","last_became_active":"2024-05-09T09:47:12.195117+0000","last_became_peered":"2024-05-09T09:47:12.195117+0000","last_unstale":"2024-05-09T09:50:33.137283+0000","last_undegraded":"2024-05-09T09:50:33.137283+0000","last_fullsized":"2024-05-09T09:50:33.137283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:15:07.437414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'8","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.303421+0000","last_change":"2024-05-09T09:47:14.189185+0000","last_active":"2024-05-09T09:50:33.303421+0000","last_peered":"2024-05-09T09:50:33.303421+0000","last_clean":"2024-05-09T09:50:33.303421+0000","last_became_active":"2024-05-09T09:47:14.188665+0000","last_became_peered":"2024-05-09T09:47:14.188665+0000","last_unstale":"2024-05-09T09:50:33.303421+0000","last_undegraded":"2024-05-09T09:50:33.303421+0000","last_fullsized":"2024-05-09T09:50:33.303421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:39.377012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.175793+0000","last_change":"2024-05-09T09:47:12.201245+0000","last_active":"2024-05-09T09:47:52.175793+0000","last_peered":"2024-05-09T09:47:52.175793+0000","last_clean":"2024-05-09T09:47:52.175793+0000","last_became_active":"2024-05-09T09:47:12.199697+0000","last_became_peered":"2024-05-09T09:47:12.199697+0000","last_unstale":"2024-05-09T09:47:52.175793+0000","last_undegraded":"2024-05-09T09:47:52.175793+0000","last_fullsized":"2024-05-09T09:47:52.175793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:40:31.009399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'12","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.808798+0000","last_change":"2024-05-09T09:47:14.179543+0000","last_active":"2024-05-09T09:50:32.808798+0000","last_peered":"2024-05-09T09:50:32.808798+0000","last_clean":"2024-05-09T09:50:32.808798+0000","last_became_active":"2024-05-09T09:47:14.179041+0000","last_became_peered":"2024-05-09T09:47:14.179041+0000","last_unstale":"2024-05-09T09:50:32.808798+0000","last_undegraded":"2024-05-09T09:50:32.808798+0000","last_fullsized":"2024-05-09T09:50:32.808798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:28:37.119651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.412926+0000","last_change":"2024-05-09T09:47:12.185018+0000","last_active":"2024-05-09T09:47:52.412926+0000","last_peered":"2024-05-09T09:47:52.412926+0000","last_clean":"2024-05-09T09:47:52.412926+0000","last_became_active":"2024-05-09T09:47:12.183745+0000","last_became_peered":"2024-05-09T09:47:12.183745+0000","last_unstale":"2024-05-09T09:47:52.412926+0000","last_undegraded":"2024-05-09T09:47:52.412926+0000","last_fullsized":"2024-05-09T09:47:52.412926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:14.033148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'14","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.303289+0000","last_change":"2024-05-09T09:47:14.173339+0000","last_active":"2024-05-09T09:50:33.303289+0000","last_peered":"2024-05-09T09:50:33.303289+0000","last_clean":"2024-05-09T09:50:33.303289+0000","last_became_active":"2024-05-09T09:47:14.173031+0000","last_became_peered":"2024-05-09T09:47:14.173031+0000","last_unstale":"2024-05-09T09:50:33.303289+0000","last_undegraded":"2024-05-09T09:50:33.303289+0000","last_fullsized":"2024-05-09T09:50:33.303289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:35:20.332271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"30'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.172138+0000","last_change":"2024-05-09T09:47:14.193172+0000","last_active":"2024-05-09T09:47:52.172138+0000","last_peered":"2024-05-09T09:47:52.172138+0000","last_clean":"2024-05-09T09:47:52.172138+0000","last_became_active":"2024-05-09T09:47:14.192744+0000","last_became_peered":"2024-05-09T09:47:14.192744+0000","last_unstale":"2024-05-09T09:47:52.172138+0000","last_undegraded":"2024-05-09T09:47:52.172138+0000","last_fullsized":"2024-05-09T09:47:52.172138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:34:30.799914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.179264+0000","last_change":"2024-05-09T09:47:12.213768+0000","last_active":"2024-05-09T09:47:52.179264+0000","last_peered":"2024-05-09T09:47:52.179264+0000","last_clean":"2024-05-09T09:47:52.179264+0000","last_became_active":"2024-05-09T09:47:12.210781+0000","last_became_peered":"2024-05-09T09:47:12.210781+0000","last_unstale":"2024-05-09T09:47:52.179264+0000","last_undegraded":"2024-05-09T09:47:52.179264+0000","last_fullsized":"2024-05-09T09:47:52.179264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:17:39.735832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'20","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.237884+0000","last_change":"2024-05-09T09:47:14.190782+0000","last_active":"2024-05-09T09:50:33.237884+0000","last_peered":"2024-05-09T09:50:33.237884+0000","last_clean":"2024-05-09T09:50:33.237884+0000","last_became_active":"2024-05-09T09:47:14.190021+0000","last_became_peered":"2024-05-09T09:47:14.190021+0000","last_unstale":"2024-05-09T09:50:33.237884+0000","last_undegraded":"2024-05-09T09:50:33.237884+0000","last_fullsized":"2024-05-09T09:50:33.237884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:34:02.864130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.112255+0000","last_change":"2024-05-09T09:47:12.194645+0000","last_active":"2024-05-09T09:50:33.112255+0000","last_peered":"2024-05-09T09:50:33.112255+0000","last_clean":"2024-05-09T09:50:33.112255+0000","last_became_active":"2024-05-09T09:47:12.193509+0000","last_became_peered":"2024-05-09T09:47:12.193509+0000","last_unstale":"2024-05-09T09:50:33.112255+0000","last_undegraded":"2024-05-09T09:50:33.112255+0000","last_fullsized":"2024-05-09T09:50:33.112255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:00:03.229983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.947737+0000","last_change":"2024-05-09T09:47:14.189775+0000","last_active":"2024-05-09T09:50:32.947737+0000","last_peered":"2024-05-09T09:50:32.947737+0000","last_clean":"2024-05-09T09:50:32.947737+0000","last_became_active":"2024-05-09T09:47:14.189468+0000","last_became_peered":"2024-05-09T09:47:14.189468+0000","last_unstale":"2024-05-09T09:50:32.947737+0000","last_undegraded":"2024-05-09T09:50:32.947737+0000","last_fullsized":"2024-05-09T09:50:32.947737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:28:37.119651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.881830+0000","last_change":"2024-05-09T09:47:12.210720+0000","last_active":"2024-05-09T09:49:31.881830+0000","last_peered":"2024-05-09T09:49:31.881830+0000","last_clean":"2024-05-09T09:49:31.881830+0000","last_became_active":"2024-05-09T09:47:12.206920+0000","last_became_peered":"2024-05-09T09:47:12.206920+0000","last_unstale":"2024-05-09T09:49:31.881830+0000","last_undegraded":"2024-05-09T09:49:31.881830+0000","last_fullsized":"2024-05-09T09:49:31.881830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:14.033148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'18","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.238228+0000","last_change":"2024-05-09T09:47:14.174508+0000","last_active":"2024-05-09T09:50:33.238228+0000","last_peered":"2024-05-09T09:50:33.238228+0000","last_clean":"2024-05-09T09:50:33.238228+0000","last_became_active":"2024-05-09T09:47:14.173701+0000","last_became_peered":"2024-05-09T09:47:14.173701+0000","last_unstale":"2024-05-09T09:50:33.238228+0000","last_undegraded":"2024-05-09T09:50:33.238228+0000","last_fullsized":"2024-05-09T09:50:33.238228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:28:37.119651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.715742+0000","last_change":"2024-05-09T09:47:12.207271+0000","last_active":"2024-05-09T09:50:32.715742+0000","last_peered":"2024-05-09T09:50:32.715742+0000","last_clean":"2024-05-09T09:50:32.715742+0000","last_became_active":"2024-05-09T09:47:12.206564+0000","last_became_peered":"2024-05-09T09:47:12.206564+0000","last_unstale":"2024-05-09T09:50:32.715742+0000","last_undegraded":"2024-05-09T09:50:32.715742+0000","last_fullsized":"2024-05-09T09:50:32.715742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:15:01.079963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'10","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.806551+0000","last_change":"2024-05-09T09:47:14.173448+0000","last_active":"2024-05-09T09:50:32.806551+0000","last_peered":"2024-05-09T09:50:32.806551+0000","last_clean":"2024-05-09T09:50:32.806551+0000","last_became_active":"2024-05-09T09:47:14.173022+0000","last_became_peered":"2024-05-09T09:47:14.173022+0000","last_unstale":"2024-05-09T09:50:32.806551+0000","last_undegraded":"2024-05-09T09:50:32.806551+0000","last_fullsized":"2024-05-09T09:50:32.806551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:58:34.213528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.417285+0000","last_change":"2024-05-09T09:47:12.216902+0000","last_active":"2024-05-09T09:47:52.417285+0000","last_peered":"2024-05-09T09:47:52.417285+0000","last_clean":"2024-05-09T09:47:52.417285+0000","last_became_active":"2024-05-09T09:47:12.214422+0000","last_became_peered":"2024-05-09T09:47:12.214422+0000","last_unstale":"2024-05-09T09:47:52.417285+0000","last_undegraded":"2024-05-09T09:47:52.417285+0000","last_fullsized":"2024-05-09T09:47:52.417285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:17:39.735832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'10","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.237141+0000","last_change":"2024-05-09T09:47:14.172576+0000","last_active":"2024-05-09T09:50:33.237141+0000","last_peered":"2024-05-09T09:50:33.237141+0000","last_clean":"2024-05-09T09:50:33.237141+0000","last_became_active":"2024-05-09T09:47:14.172297+0000","last_became_peered":"2024-05-09T09:47:14.172297+0000","last_unstale":"2024-05-09T09:50:33.237141+0000","last_undegraded":"2024-05-09T09:50:33.237141+0000","last_fullsized":"2024-05-09T09:50:33.237141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:38:12.687762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.066369+0000","last_change":"2024-05-09T09:47:12.213596+0000","last_active":"2024-05-09T09:49:32.066369+0000","last_peered":"2024-05-09T09:49:32.066369+0000","last_clean":"2024-05-09T09:49:32.066369+0000","last_became_active":"2024-05-09T09:47:12.211880+0000","last_became_peered":"2024-05-09T09:47:12.211880+0000","last_unstale":"2024-05-09T09:49:32.066369+0000","last_undegraded":"2024-05-09T09:49:32.066369+0000","last_fullsized":"2024-05-09T09:49:32.066369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:02:04.919917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'39","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.197791+0000","last_change":"2024-05-09T09:47:22.260431+0000","last_active":"2024-05-09T09:50:33.197791+0000","last_peered":"2024-05-09T09:50:33.197791+0000","last_clean":"2024-05-09T09:50:33.197791+0000","last_became_active":"2024-05-09T09:47:22.258991+0000","last_became_peered":"2024-05-09T09:47:22.258991+0000","last_unstale":"2024-05-09T09:50:33.197791+0000","last_undegraded":"2024-05-09T09:50:33.197791+0000","last_fullsized":"2024-05-09T09:50:33.197791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:48:55.320178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":174,"num_read_kb":174,"num_write":107,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:02.667895+0000","last_change":"2024-05-09T09:47:14.185176+0000","last_active":"2024-05-09T09:48:02.667895+0000","last_peered":"2024-05-09T09:48:02.667895+0000","last_clean":"2024-05-09T09:48:02.667895+0000","last_became_active":"2024-05-09T09:47:14.184851+0000","last_became_peered":"2024-05-09T09:47:14.184851+0000","last_unstale":"2024-05-09T09:48:02.667895+0000","last_undegraded":"2024-05-09T09:48:02.667895+0000","last_fullsized":"2024-05-09T09:48:02.667895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:13:24.454355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.546223+0000","last_change":"2024-05-09T09:47:12.214683+0000","last_active":"2024-05-09T09:50:32.546223+0000","last_peered":"2024-05-09T09:50:32.546223+0000","last_clean":"2024-05-09T09:50:32.546223+0000","last_became_active":"2024-05-09T09:47:12.214108+0000","last_became_peered":"2024-05-09T09:47:12.214108+0000","last_unstale":"2024-05-09T09:50:32.546223+0000","last_undegraded":"2024-05-09T09:50:32.546223+0000","last_fullsized":"2024-05-09T09:50:32.546223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:08:34.152345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.191620+0000","last_change":"2024-05-09T09:47:16.197589+0000","last_active":"2024-05-09T09:47:52.191620+0000","last_peered":"2024-05-09T09:47:52.191620+0000","last_clean":"2024-05-09T09:47:52.191620+0000","last_became_active":"2024-05-09T09:47:16.196516+0000","last_became_peered":"2024-05-09T09:47:16.196516+0000","last_unstale":"2024-05-09T09:47:52.191620+0000","last_undegraded":"2024-05-09T09:47:52.191620+0000","last_fullsized":"2024-05-09T09:47:52.191620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:17:41.107784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'107","reported_seq":153,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.977123+0000","last_change":"2024-05-09T09:47:18.236921+0000","last_active":"2024-05-09T09:50:39.977123+0000","last_peered":"2024-05-09T09:50:39.977123+0000","last_clean":"2024-05-09T09:50:39.977123+0000","last_became_active":"2024-05-09T09:47:18.235911+0000","last_became_peered":"2024-05-09T09:47:18.235911+0000","last_unstale":"2024-05-09T09:50:39.977123+0000","last_undegraded":"2024-05-09T09:50:39.977123+0000","last_fullsized":"2024-05-09T09:50:39.977123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:41:58.214685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.178731+0000","last_change":"2024-05-09T09:47:20.252492+0000","last_active":"2024-05-09T09:47:52.178731+0000","last_peered":"2024-05-09T09:47:52.178731+0000","last_clean":"2024-05-09T09:47:52.178731+0000","last_became_active":"2024-05-09T09:47:20.251712+0000","last_became_peered":"2024-05-09T09:47:20.251712+0000","last_unstale":"2024-05-09T09:47:52.178731+0000","last_undegraded":"2024-05-09T09:47:52.178731+0000","last_fullsized":"2024-05-09T09:47:52.178731+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:51:10.268994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:45.872841+0000","last_change":"2024-05-09T09:47:22.255759+0000","last_active":"2024-05-09T09:48:45.872841+0000","last_peered":"2024-05-09T09:48:45.872841+0000","last_clean":"2024-05-09T09:48:45.872841+0000","last_became_active":"2024-05-09T09:47:22.255180+0000","last_became_peered":"2024-05-09T09:47:22.255180+0000","last_unstale":"2024-05-09T09:48:45.872841+0000","last_undegraded":"2024-05-09T09:48:45.872841+0000","last_fullsized":"2024-05-09T09:48:45.872841+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:01:10.229471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.192939+0000","last_change":"2024-05-09T09:47:14.187449+0000","last_active":"2024-05-09T09:47:52.192939+0000","last_peered":"2024-05-09T09:47:52.192939+0000","last_clean":"2024-05-09T09:47:52.192939+0000","last_became_active":"2024-05-09T09:47:14.187095+0000","last_became_peered":"2024-05-09T09:47:14.187095+0000","last_unstale":"2024-05-09T09:47:52.192939+0000","last_undegraded":"2024-05-09T09:47:52.192939+0000","last_fullsized":"2024-05-09T09:47:52.192939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:30:13.157598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.290281+0000","last_change":"2024-05-09T09:47:12.196226+0000","last_active":"2024-05-09T09:50:33.290281+0000","last_peered":"2024-05-09T09:50:33.290281+0000","last_clean":"2024-05-09T09:50:33.290281+0000","last_became_active":"2024-05-09T09:47:12.194549+0000","last_became_peered":"2024-05-09T09:47:12.194549+0000","last_unstale":"2024-05-09T09:50:33.290281+0000","last_undegraded":"2024-05-09T09:50:33.290281+0000","last_fullsized":"2024-05-09T09:50:33.290281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:15:01.079963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.422996+0000","last_change":"2024-05-09T09:47:16.191533+0000","last_active":"2024-05-09T09:47:52.422996+0000","last_peered":"2024-05-09T09:47:52.422996+0000","last_clean":"2024-05-09T09:47:52.422996+0000","last_became_active":"2024-05-09T09:47:16.190755+0000","last_became_peered":"2024-05-09T09:47:16.190755+0000","last_unstale":"2024-05-09T09:47:52.422996+0000","last_undegraded":"2024-05-09T09:47:52.422996+0000","last_fullsized":"2024-05-09T09:47:52.422996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:42:45.452416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.179964+0000","last_change":"2024-05-09T09:47:18.215068+0000","last_active":"2024-05-09T09:49:45.179964+0000","last_peered":"2024-05-09T09:49:45.179964+0000","last_clean":"2024-05-09T09:49:45.179964+0000","last_became_active":"2024-05-09T09:47:18.214299+0000","last_became_peered":"2024-05-09T09:47:18.214299+0000","last_unstale":"2024-05-09T09:49:45.179964+0000","last_undegraded":"2024-05-09T09:49:45.179964+0000","last_fullsized":"2024-05-09T09:49:45.179964+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:49:59.954141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.174479+0000","last_change":"2024-05-09T09:47:20.241740+0000","last_active":"2024-05-09T09:47:52.174479+0000","last_peered":"2024-05-09T09:47:52.174479+0000","last_clean":"2024-05-09T09:47:52.174479+0000","last_became_active":"2024-05-09T09:47:20.241096+0000","last_became_peered":"2024-05-09T09:47:20.241096+0000","last_unstale":"2024-05-09T09:47:52.174479+0000","last_undegraded":"2024-05-09T09:47:52.174479+0000","last_fullsized":"2024-05-09T09:47:52.174479+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:37:23.903396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.416615+0000","last_change":"2024-05-09T09:47:22.258554+0000","last_active":"2024-05-09T09:47:52.416615+0000","last_peered":"2024-05-09T09:47:52.416615+0000","last_clean":"2024-05-09T09:47:52.416615+0000","last_became_active":"2024-05-09T09:47:22.257798+0000","last_became_peered":"2024-05-09T09:47:22.257798+0000","last_unstale":"2024-05-09T09:47:52.416615+0000","last_undegraded":"2024-05-09T09:47:52.416615+0000","last_fullsized":"2024-05-09T09:47:52.416615+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:29:01.635074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.947134+0000","last_change":"2024-05-09T09:47:52.430567+0000","last_active":"2024-05-09T09:50:32.947134+0000","last_peered":"2024-05-09T09:50:32.947134+0000","last_clean":"2024-05-09T09:50:32.947134+0000","last_became_active":"2024-05-09T09:47:52.429857+0000","last_became_peered":"2024-05-09T09:47:52.429857+0000","last_unstale":"2024-05-09T09:50:32.947134+0000","last_undegraded":"2024-05-09T09:50:32.947134+0000","last_fullsized":"2024-05-09T09:50:32.947134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:59:53.671007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.174693+0000","last_change":"2024-05-09T09:47:12.201826+0000","last_active":"2024-05-09T09:47:52.174693+0000","last_peered":"2024-05-09T09:47:52.174693+0000","last_clean":"2024-05-09T09:47:52.174693+0000","last_became_active":"2024-05-09T09:47:12.201415+0000","last_became_peered":"2024-05-09T09:47:12.201415+0000","last_unstale":"2024-05-09T09:47:52.174693+0000","last_undegraded":"2024-05-09T09:47:52.174693+0000","last_fullsized":"2024-05-09T09:47:52.174693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:56:46.263211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.426796+0000","last_change":"2024-05-09T09:47:16.213280+0000","last_active":"2024-05-09T09:47:52.426796+0000","last_peered":"2024-05-09T09:47:52.426796+0000","last_clean":"2024-05-09T09:47:52.426796+0000","last_became_active":"2024-05-09T09:47:16.212543+0000","last_became_peered":"2024-05-09T09:47:16.212543+0000","last_unstale":"2024-05-09T09:47:52.426796+0000","last_undegraded":"2024-05-09T09:47:52.426796+0000","last_fullsized":"2024-05-09T09:47:52.426796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:51:48.988654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.178986+0000","last_change":"2024-05-09T09:47:18.215341+0000","last_active":"2024-05-09T09:47:52.178986+0000","last_peered":"2024-05-09T09:47:52.178986+0000","last_clean":"2024-05-09T09:47:52.178986+0000","last_became_active":"2024-05-09T09:47:18.212685+0000","last_became_peered":"2024-05-09T09:47:18.212685+0000","last_unstale":"2024-05-09T09:47:52.178986+0000","last_undegraded":"2024-05-09T09:47:52.178986+0000","last_fullsized":"2024-05-09T09:47:52.178986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:42:47.464951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'284","reported_seq":385,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.891354+0000","last_change":"2024-05-09T09:47:20.250999+0000","last_active":"2024-05-09T09:50:39.891354+0000","last_peered":"2024-05-09T09:50:39.891354+0000","last_clean":"2024-05-09T09:50:39.891354+0000","last_became_active":"2024-05-09T09:47:20.250200+0000","last_became_peered":"2024-05-09T09:47:20.250200+0000","last_unstale":"2024-05-09T09:50:39.891354+0000","last_undegraded":"2024-05-09T09:50:39.891354+0000","last_fullsized":"2024-05-09T09:50:39.891354+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:17:01.311058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.170307+0000","last_change":"2024-05-09T09:47:22.241318+0000","last_active":"2024-05-09T09:47:52.170307+0000","last_peered":"2024-05-09T09:47:52.170307+0000","last_clean":"2024-05-09T09:47:52.170307+0000","last_became_active":"2024-05-09T09:47:22.238160+0000","last_became_peered":"2024-05-09T09:47:22.238160+0000","last_unstale":"2024-05-09T09:47:52.170307+0000","last_undegraded":"2024-05-09T09:47:52.170307+0000","last_fullsized":"2024-05-09T09:47:52.170307+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:26.173328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'16","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.825007+0000","last_change":"2024-05-09T09:47:14.177761+0000","last_active":"2024-05-09T09:50:32.825007+0000","last_peered":"2024-05-09T09:50:32.825007+0000","last_clean":"2024-05-09T09:50:32.825007+0000","last_became_active":"2024-05-09T09:47:14.176295+0000","last_became_peered":"2024-05-09T09:47:14.176295+0000","last_unstale":"2024-05-09T09:50:32.825007+0000","last_undegraded":"2024-05-09T09:50:32.825007+0000","last_fullsized":"2024-05-09T09:50:32.825007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:29:53.547705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.163979+0000","last_change":"2024-05-09T09:47:12.192627+0000","last_active":"2024-05-09T09:47:52.163979+0000","last_peered":"2024-05-09T09:47:52.163979+0000","last_clean":"2024-05-09T09:47:52.163979+0000","last_became_active":"2024-05-09T09:47:12.191194+0000","last_became_peered":"2024-05-09T09:47:12.191194+0000","last_unstale":"2024-05-09T09:47:52.163979+0000","last_undegraded":"2024-05-09T09:47:52.163979+0000","last_fullsized":"2024-05-09T09:47:52.163979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:21:00.747450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.203101+0000","last_change":"2024-05-09T09:47:52.201792+0000","last_active":"2024-05-09T09:47:52.203101+0000","last_peered":"2024-05-09T09:47:52.203101+0000","last_clean":"2024-05-09T09:47:52.203101+0000","last_became_active":"2024-05-09T09:47:52.201081+0000","last_became_peered":"2024-05-09T09:47:52.201081+0000","last_unstale":"2024-05-09T09:47:52.203101+0000","last_undegraded":"2024-05-09T09:47:52.203101+0000","last_fullsized":"2024-05-09T09:47:52.203101+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:13:19.457015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'107","reported_seq":153,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.161639+0000","last_change":"2024-05-09T09:47:18.219458+0000","last_active":"2024-05-09T09:50:40.161639+0000","last_peered":"2024-05-09T09:50:40.161639+0000","last_clean":"2024-05-09T09:50:40.161639+0000","last_became_active":"2024-05-09T09:47:18.217843+0000","last_became_peered":"2024-05-09T09:47:18.217843+0000","last_unstale":"2024-05-09T09:50:40.161639+0000","last_undegraded":"2024-05-09T09:50:40.161639+0000","last_fullsized":"2024-05-09T09:50:40.161639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:34:34.825637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'284","reported_seq":445,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.899072+0000","last_change":"2024-05-09T09:47:20.243402+0000","last_active":"2024-05-09T09:50:39.899072+0000","last_peered":"2024-05-09T09:50:39.899072+0000","last_clean":"2024-05-09T09:50:39.899072+0000","last_became_active":"2024-05-09T09:47:20.242448+0000","last_became_peered":"2024-05-09T09:47:20.242448+0000","last_unstale":"2024-05-09T09:50:39.899072+0000","last_undegraded":"2024-05-09T09:50:39.899072+0000","last_fullsized":"2024-05-09T09:50:39.899072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:07.968167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.150356+0000","last_change":"2024-05-09T09:47:52.179916+0000","last_active":"2024-05-09T09:50:33.150356+0000","last_peered":"2024-05-09T09:50:33.150356+0000","last_clean":"2024-05-09T09:50:33.150356+0000","last_became_active":"2024-05-09T09:47:52.179059+0000","last_became_peered":"2024-05-09T09:47:52.179059+0000","last_unstale":"2024-05-09T09:50:33.150356+0000","last_undegraded":"2024-05-09T09:50:33.150356+0000","last_fullsized":"2024-05-09T09:50:33.150356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:20:28.160797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.183609+0000","last_change":"2024-05-09T09:47:12.206447+0000","last_active":"2024-05-09T09:47:52.183609+0000","last_peered":"2024-05-09T09:47:52.183609+0000","last_clean":"2024-05-09T09:47:52.183609+0000","last_became_active":"2024-05-09T09:47:12.205259+0000","last_became_peered":"2024-05-09T09:47:12.205259+0000","last_unstale":"2024-05-09T09:47:52.183609+0000","last_undegraded":"2024-05-09T09:47:52.183609+0000","last_fullsized":"2024-05-09T09:47:52.183609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:15.767283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.165019+0000","last_change":"2024-05-09T09:47:16.207890+0000","last_active":"2024-05-09T09:47:52.165019+0000","last_peered":"2024-05-09T09:47:52.165019+0000","last_clean":"2024-05-09T09:47:52.165019+0000","last_became_active":"2024-05-09T09:47:16.207404+0000","last_became_peered":"2024-05-09T09:47:16.207404+0000","last_unstale":"2024-05-09T09:47:52.165019+0000","last_undegraded":"2024-05-09T09:47:52.165019+0000","last_fullsized":"2024-05-09T09:47:52.165019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:51:48.988654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'119","reported_seq":170,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.995944+0000","last_change":"2024-05-09T09:47:18.221550+0000","last_active":"2024-05-09T09:50:39.995944+0000","last_peered":"2024-05-09T09:50:39.995944+0000","last_clean":"2024-05-09T09:50:39.995944+0000","last_became_active":"2024-05-09T09:47:18.220596+0000","last_became_peered":"2024-05-09T09:47:18.220596+0000","last_unstale":"2024-05-09T09:50:39.995944+0000","last_undegraded":"2024-05-09T09:50:39.995944+0000","last_fullsized":"2024-05-09T09:50:39.995944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:03:54.051364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":63,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.420451+0000","last_change":"2024-05-09T09:47:20.246363+0000","last_active":"2024-05-09T09:47:52.420451+0000","last_peered":"2024-05-09T09:47:52.420451+0000","last_clean":"2024-05-09T09:47:52.420451+0000","last_became_active":"2024-05-09T09:47:20.244839+0000","last_became_peered":"2024-05-09T09:47:20.244839+0000","last_unstale":"2024-05-09T09:47:52.420451+0000","last_undegraded":"2024-05-09T09:47:52.420451+0000","last_fullsized":"2024-05-09T09:47:52.420451+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:40:50.226397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.950700+0000","last_change":"2024-05-09T09:47:22.237841+0000","last_active":"2024-05-09T09:50:32.950700+0000","last_peered":"2024-05-09T09:50:32.950700+0000","last_clean":"2024-05-09T09:50:32.950700+0000","last_became_active":"2024-05-09T09:47:22.235895+0000","last_became_peered":"2024-05-09T09:47:22.235895+0000","last_unstale":"2024-05-09T09:50:32.950700+0000","last_undegraded":"2024-05-09T09:50:32.950700+0000","last_fullsized":"2024-05-09T09:50:32.950700+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:59:20.801393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.174181+0000","last_change":"2024-05-09T09:47:14.172537+0000","last_active":"2024-05-09T09:49:25.174181+0000","last_peered":"2024-05-09T09:49:25.174181+0000","last_clean":"2024-05-09T09:49:25.174181+0000","last_became_active":"2024-05-09T09:47:14.172275+0000","last_became_peered":"2024-05-09T09:47:14.172275+0000","last_unstale":"2024-05-09T09:49:25.174181+0000","last_undegraded":"2024-05-09T09:49:25.174181+0000","last_fullsized":"2024-05-09T09:49:25.174181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:16:59.077638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:59.963235+0000","last_change":"2024-05-09T09:47:12.210250+0000","last_active":"2024-05-09T09:47:59.963235+0000","last_peered":"2024-05-09T09:47:59.963235+0000","last_clean":"2024-05-09T09:47:59.963235+0000","last_became_active":"2024-05-09T09:47:12.209274+0000","last_became_peered":"2024-05-09T09:47:12.209274+0000","last_unstale":"2024-05-09T09:47:59.963235+0000","last_undegraded":"2024-05-09T09:47:59.963235+0000","last_fullsized":"2024-05-09T09:47:59.963235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:19:17.059104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.420100+0000","last_change":"2024-05-09T09:47:16.215057+0000","last_active":"2024-05-09T09:47:52.420100+0000","last_peered":"2024-05-09T09:47:52.420100+0000","last_clean":"2024-05-09T09:47:52.420100+0000","last_became_active":"2024-05-09T09:47:16.214484+0000","last_became_peered":"2024-05-09T09:47:16.214484+0000","last_unstale":"2024-05-09T09:47:52.420100+0000","last_undegraded":"2024-05-09T09:47:52.420100+0000","last_fullsized":"2024-05-09T09:47:52.420100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:13:09.787784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'110","reported_seq":156,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.089077+0000","last_change":"2024-05-09T09:47:18.231906+0000","last_active":"2024-05-09T09:50:40.089077+0000","last_peered":"2024-05-09T09:50:40.089077+0000","last_clean":"2024-05-09T09:50:40.089077+0000","last_became_active":"2024-05-09T09:47:18.224815+0000","last_became_peered":"2024-05-09T09:47:18.224815+0000","last_unstale":"2024-05-09T09:50:40.089077+0000","last_undegraded":"2024-05-09T09:50:40.089077+0000","last_fullsized":"2024-05-09T09:50:40.089077+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:55:53.240395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.412400+0000","last_change":"2024-05-09T09:47:20.251863+0000","last_active":"2024-05-09T09:47:52.412400+0000","last_peered":"2024-05-09T09:47:52.412400+0000","last_clean":"2024-05-09T09:47:52.412400+0000","last_became_active":"2024-05-09T09:47:20.250686+0000","last_became_peered":"2024-05-09T09:47:20.250686+0000","last_unstale":"2024-05-09T09:47:52.412400+0000","last_undegraded":"2024-05-09T09:47:52.412400+0000","last_fullsized":"2024-05-09T09:47:52.412400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:37:23.903396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'17","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.338642+0000","last_change":"2024-05-09T09:47:22.255914+0000","last_active":"2024-05-09T09:50:32.338642+0000","last_peered":"2024-05-09T09:50:32.338642+0000","last_clean":"2024-05-09T09:50:32.338642+0000","last_became_active":"2024-05-09T09:47:22.255076+0000","last_became_peered":"2024-05-09T09:47:22.255076+0000","last_unstale":"2024-05-09T09:50:32.338642+0000","last_undegraded":"2024-05-09T09:50:32.338642+0000","last_fullsized":"2024-05-09T09:50:32.338642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:25:35.144336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":92,"num_read_kb":72,"num_write":55,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.173175+0000","last_change":"2024-05-09T09:47:14.180737+0000","last_active":"2024-05-09T09:47:52.173175+0000","last_peered":"2024-05-09T09:47:52.173175+0000","last_clean":"2024-05-09T09:47:52.173175+0000","last_became_active":"2024-05-09T09:47:14.180185+0000","last_became_peered":"2024-05-09T09:47:14.180185+0000","last_unstale":"2024-05-09T09:47:52.173175+0000","last_undegraded":"2024-05-09T09:47:52.173175+0000","last_fullsized":"2024-05-09T09:47:52.173175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:44.612188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:59.962280+0000","last_change":"2024-05-09T09:47:12.211357+0000","last_active":"2024-05-09T09:47:59.962280+0000","last_peered":"2024-05-09T09:47:59.962280+0000","last_clean":"2024-05-09T09:47:59.962280+0000","last_became_active":"2024-05-09T09:47:12.207751+0000","last_became_peered":"2024-05-09T09:47:12.207751+0000","last_unstale":"2024-05-09T09:47:59.962280+0000","last_undegraded":"2024-05-09T09:47:59.962280+0000","last_fullsized":"2024-05-09T09:47:59.962280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:41:27.203063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.427281+0000","last_change":"2024-05-09T09:47:16.208197+0000","last_active":"2024-05-09T09:47:52.427281+0000","last_peered":"2024-05-09T09:47:52.427281+0000","last_clean":"2024-05-09T09:47:52.427281+0000","last_became_active":"2024-05-09T09:47:16.207734+0000","last_became_peered":"2024-05-09T09:47:16.207734+0000","last_unstale":"2024-05-09T09:47:52.427281+0000","last_undegraded":"2024-05-09T09:47:52.427281+0000","last_fullsized":"2024-05-09T09:47:52.427281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:57:13.986799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'113","reported_seq":162,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.004174+0000","last_change":"2024-05-09T09:47:18.231116+0000","last_active":"2024-05-09T09:50:40.004174+0000","last_peered":"2024-05-09T09:50:40.004174+0000","last_clean":"2024-05-09T09:50:40.004174+0000","last_became_active":"2024-05-09T09:47:18.230440+0000","last_became_peered":"2024-05-09T09:47:18.230440+0000","last_unstale":"2024-05-09T09:50:40.004174+0000","last_undegraded":"2024-05-09T09:50:40.004174+0000","last_fullsized":"2024-05-09T09:50:40.004174+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:05:58.884035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'284","reported_seq":352,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.901211+0000","last_change":"2024-05-09T09:47:20.254991+0000","last_active":"2024-05-09T09:50:39.901211+0000","last_peered":"2024-05-09T09:50:39.901211+0000","last_clean":"2024-05-09T09:50:39.901211+0000","last_became_active":"2024-05-09T09:47:20.254305+0000","last_became_peered":"2024-05-09T09:47:20.254305+0000","last_unstale":"2024-05-09T09:50:39.901211+0000","last_undegraded":"2024-05-09T09:50:39.901211+0000","last_fullsized":"2024-05-09T09:50:39.901211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:35:09.855318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.424385+0000","last_change":"2024-05-09T09:47:22.239987+0000","last_active":"2024-05-09T09:47:52.424385+0000","last_peered":"2024-05-09T09:47:52.424385+0000","last_clean":"2024-05-09T09:47:52.424385+0000","last_became_active":"2024-05-09T09:47:22.239262+0000","last_became_peered":"2024-05-09T09:47:22.239262+0000","last_unstale":"2024-05-09T09:47:52.424385+0000","last_undegraded":"2024-05-09T09:47:52.424385+0000","last_fullsized":"2024-05-09T09:47:52.424385+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:19:34.324968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'8","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:45.864227+0000","last_change":"2024-05-09T09:47:14.184937+0000","last_active":"2024-05-09T09:48:45.864227+0000","last_peered":"2024-05-09T09:48:45.864227+0000","last_clean":"2024-05-09T09:48:45.864227+0000","last_became_active":"2024-05-09T09:47:14.184593+0000","last_became_peered":"2024-05-09T09:47:14.184593+0000","last_unstale":"2024-05-09T09:48:45.864227+0000","last_undegraded":"2024-05-09T09:48:45.864227+0000","last_fullsized":"2024-05-09T09:48:45.864227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:30:37.903160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'8","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.754083+0000","last_change":"2024-05-09T09:47:12.211539+0000","last_active":"2024-05-09T09:50:32.754083+0000","last_peered":"2024-05-09T09:50:32.754083+0000","last_clean":"2024-05-09T09:50:32.754083+0000","last_became_active":"2024-05-09T09:47:12.207403+0000","last_became_peered":"2024-05-09T09:47:12.207403+0000","last_unstale":"2024-05-09T09:50:32.754083+0000","last_undegraded":"2024-05-09T09:50:32.754083+0000","last_fullsized":"2024-05-09T09:50:32.754083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:20:53.292716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":16,"num_write_kb":8838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.419204+0000","last_change":"2024-05-09T09:47:16.215117+0000","last_active":"2024-05-09T09:47:52.419204+0000","last_peered":"2024-05-09T09:47:52.419204+0000","last_clean":"2024-05-09T09:47:52.419204+0000","last_became_active":"2024-05-09T09:47:16.214607+0000","last_became_peered":"2024-05-09T09:47:16.214607+0000","last_unstale":"2024-05-09T09:47:52.419204+0000","last_undegraded":"2024-05-09T09:47:52.419204+0000","last_fullsized":"2024-05-09T09:47:52.419204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:25:29.477094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'209","reported_seq":273,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.108458+0000","last_change":"2024-05-09T09:47:18.225638+0000","last_active":"2024-05-09T09:50:40.108458+0000","last_peered":"2024-05-09T09:50:40.108458+0000","last_clean":"2024-05-09T09:50:40.108458+0000","last_became_active":"2024-05-09T09:47:18.224893+0000","last_became_peered":"2024-05-09T09:47:18.224893+0000","last_unstale":"2024-05-09T09:50:40.108458+0000","last_undegraded":"2024-05-09T09:50:40.108458+0000","last_fullsized":"2024-05-09T09:50:40.108458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:04:53.766220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.413967+0000","last_change":"2024-05-09T09:47:20.229087+0000","last_active":"2024-05-09T09:47:52.413967+0000","last_peered":"2024-05-09T09:47:52.413967+0000","last_clean":"2024-05-09T09:47:52.413967+0000","last_became_active":"2024-05-09T09:47:20.228339+0000","last_became_peered":"2024-05-09T09:47:20.228339+0000","last_unstale":"2024-05-09T09:47:52.413967+0000","last_undegraded":"2024-05-09T09:47:52.413967+0000","last_fullsized":"2024-05-09T09:47:52.413967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:36.440080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.461775+0000","last_change":"2024-05-09T09:47:22.230031+0000","last_active":"2024-05-09T09:50:33.461775+0000","last_peered":"2024-05-09T09:50:33.461775+0000","last_clean":"2024-05-09T09:50:33.461775+0000","last_became_active":"2024-05-09T09:47:22.229193+0000","last_became_peered":"2024-05-09T09:47:22.229193+0000","last_unstale":"2024-05-09T09:50:33.461775+0000","last_undegraded":"2024-05-09T09:50:33.461775+0000","last_fullsized":"2024-05-09T09:50:33.461775+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:48:21.332216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.239007+0000","last_change":"2024-05-09T09:47:14.177074+0000","last_active":"2024-05-09T09:50:33.239007+0000","last_peered":"2024-05-09T09:50:33.239007+0000","last_clean":"2024-05-09T09:50:33.239007+0000","last_became_active":"2024-05-09T09:47:14.176717+0000","last_became_peered":"2024-05-09T09:47:14.176717+0000","last_unstale":"2024-05-09T09:50:33.239007+0000","last_undegraded":"2024-05-09T09:50:33.239007+0000","last_fullsized":"2024-05-09T09:50:33.239007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:44:03.763451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.420829+0000","last_change":"2024-05-09T09:47:12.205840+0000","last_active":"2024-05-09T09:47:52.420829+0000","last_peered":"2024-05-09T09:47:52.420829+0000","last_clean":"2024-05-09T09:47:52.420829+0000","last_became_active":"2024-05-09T09:47:12.204317+0000","last_became_peered":"2024-05-09T09:47:12.204317+0000","last_unstale":"2024-05-09T09:47:52.420829+0000","last_undegraded":"2024-05-09T09:47:52.420829+0000","last_fullsized":"2024-05-09T09:47:52.420829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:00:05.597093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.182486+0000","last_change":"2024-05-09T09:47:16.201348+0000","last_active":"2024-05-09T09:47:52.182486+0000","last_peered":"2024-05-09T09:47:52.182486+0000","last_clean":"2024-05-09T09:47:52.182486+0000","last_became_active":"2024-05-09T09:47:16.197031+0000","last_became_peered":"2024-05-09T09:47:16.197031+0000","last_unstale":"2024-05-09T09:47:52.182486+0000","last_undegraded":"2024-05-09T09:47:52.182486+0000","last_fullsized":"2024-05-09T09:47:52.182486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:01:00.598993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'109","reported_seq":156,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.115983+0000","last_change":"2024-05-09T09:47:18.216586+0000","last_active":"2024-05-09T09:50:40.115983+0000","last_peered":"2024-05-09T09:50:40.115983+0000","last_clean":"2024-05-09T09:50:40.115983+0000","last_became_active":"2024-05-09T09:47:18.215793+0000","last_became_peered":"2024-05-09T09:47:18.215793+0000","last_unstale":"2024-05-09T09:50:40.115983+0000","last_undegraded":"2024-05-09T09:50:40.115983+0000","last_fullsized":"2024-05-09T09:50:40.115983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:36:23.945979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.196563+0000","last_change":"2024-05-09T09:47:20.251219+0000","last_active":"2024-05-09T09:47:52.196563+0000","last_peered":"2024-05-09T09:47:52.196563+0000","last_clean":"2024-05-09T09:47:52.196563+0000","last_became_active":"2024-05-09T09:47:20.250363+0000","last_became_peered":"2024-05-09T09:47:20.250363+0000","last_unstale":"2024-05-09T09:47:52.196563+0000","last_undegraded":"2024-05-09T09:47:52.196563+0000","last_fullsized":"2024-05-09T09:47:52.196563+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:59:21.981954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:29.007272+0000","last_change":"2024-05-09T09:47:22.243140+0000","last_active":"2024-05-09T09:49:29.007272+0000","last_peered":"2024-05-09T09:49:29.007272+0000","last_clean":"2024-05-09T09:49:29.007272+0000","last_became_active":"2024-05-09T09:47:22.242410+0000","last_became_peered":"2024-05-09T09:47:22.242410+0000","last_unstale":"2024-05-09T09:49:29.007272+0000","last_undegraded":"2024-05-09T09:49:29.007272+0000","last_fullsized":"2024-05-09T09:49:29.007272+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:49:33.614704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:01.438873+0000","last_change":"2024-05-09T09:47:14.190653+0000","last_active":"2024-05-09T09:48:01.438873+0000","last_peered":"2024-05-09T09:48:01.438873+0000","last_clean":"2024-05-09T09:48:01.438873+0000","last_became_active":"2024-05-09T09:47:14.190016+0000","last_became_peered":"2024-05-09T09:47:14.190016+0000","last_unstale":"2024-05-09T09:48:01.438873+0000","last_undegraded":"2024-05-09T09:48:01.438873+0000","last_fullsized":"2024-05-09T09:48:01.438873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:03.774479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.178134+0000","last_change":"2024-05-09T09:47:12.212155+0000","last_active":"2024-05-09T09:47:52.178134+0000","last_peered":"2024-05-09T09:47:52.178134+0000","last_clean":"2024-05-09T09:47:52.178134+0000","last_became_active":"2024-05-09T09:47:12.211221+0000","last_became_peered":"2024-05-09T09:47:12.211221+0000","last_unstale":"2024-05-09T09:47:52.178134+0000","last_undegraded":"2024-05-09T09:47:52.178134+0000","last_fullsized":"2024-05-09T09:47:52.178134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:35:10.235355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.423260+0000","last_change":"2024-05-09T09:47:16.215089+0000","last_active":"2024-05-09T09:47:52.423260+0000","last_peered":"2024-05-09T09:47:52.423260+0000","last_clean":"2024-05-09T09:47:52.423260+0000","last_became_active":"2024-05-09T09:47:16.214462+0000","last_became_peered":"2024-05-09T09:47:16.214462+0000","last_unstale":"2024-05-09T09:47:52.423260+0000","last_undegraded":"2024-05-09T09:47:52.423260+0000","last_fullsized":"2024-05-09T09:47:52.423260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:34:32.813103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'113","reported_seq":162,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.052078+0000","last_change":"2024-05-09T09:47:18.213308+0000","last_active":"2024-05-09T09:50:40.052078+0000","last_peered":"2024-05-09T09:50:40.052078+0000","last_clean":"2024-05-09T09:50:40.052078+0000","last_became_active":"2024-05-09T09:47:18.212543+0000","last_became_peered":"2024-05-09T09:47:18.212543+0000","last_unstale":"2024-05-09T09:50:40.052078+0000","last_undegraded":"2024-05-09T09:50:40.052078+0000","last_fullsized":"2024-05-09T09:50:40.052078+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:51:51.001188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'284","reported_seq":435,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.892724+0000","last_change":"2024-05-09T09:47:20.240819+0000","last_active":"2024-05-09T09:50:39.892724+0000","last_peered":"2024-05-09T09:50:39.892724+0000","last_clean":"2024-05-09T09:50:39.892724+0000","last_became_active":"2024-05-09T09:47:20.240236+0000","last_became_peered":"2024-05-09T09:47:20.240236+0000","last_unstale":"2024-05-09T09:50:39.892724+0000","last_undegraded":"2024-05-09T09:50:39.892724+0000","last_fullsized":"2024-05-09T09:50:39.892724+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:36:25.958106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'14","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.031493+0000","last_change":"2024-05-09T09:47:22.258681+0000","last_active":"2024-05-09T09:49:32.031493+0000","last_peered":"2024-05-09T09:49:32.031493+0000","last_clean":"2024-05-09T09:49:32.031493+0000","last_became_active":"2024-05-09T09:47:22.257986+0000","last_became_peered":"2024-05-09T09:47:22.257986+0000","last_unstale":"2024-05-09T09:49:32.031493+0000","last_undegraded":"2024-05-09T09:49:32.031493+0000","last_fullsized":"2024-05-09T09:49:32.031493+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:25:35.144336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.238754+0000","last_change":"2024-05-09T09:47:14.173042+0000","last_active":"2024-05-09T09:50:33.238754+0000","last_peered":"2024-05-09T09:50:33.238754+0000","last_clean":"2024-05-09T09:50:33.238754+0000","last_became_active":"2024-05-09T09:47:14.171963+0000","last_became_peered":"2024-05-09T09:47:14.171963+0000","last_unstale":"2024-05-09T09:50:33.238754+0000","last_undegraded":"2024-05-09T09:50:33.238754+0000","last_fullsized":"2024-05-09T09:50:33.238754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:32:19.275039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.181005+0000","last_change":"2024-05-09T09:47:12.211112+0000","last_active":"2024-05-09T09:47:52.181005+0000","last_peered":"2024-05-09T09:47:52.181005+0000","last_clean":"2024-05-09T09:47:52.181005+0000","last_became_active":"2024-05-09T09:47:12.204519+0000","last_became_peered":"2024-05-09T09:47:12.204519+0000","last_unstale":"2024-05-09T09:47:52.181005+0000","last_undegraded":"2024-05-09T09:47:52.181005+0000","last_fullsized":"2024-05-09T09:47:52.181005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:35:14.637438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":417,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.865062+0000","last_change":"2024-05-09T09:47:16.211670+0000","last_active":"2024-05-09T09:50:39.865062+0000","last_peered":"2024-05-09T09:50:39.865062+0000","last_clean":"2024-05-09T09:50:39.865062+0000","last_became_active":"2024-05-09T09:47:16.210812+0000","last_became_peered":"2024-05-09T09:47:16.210812+0000","last_unstale":"2024-05-09T09:50:39.865062+0000","last_undegraded":"2024-05-09T09:50:39.865062+0000","last_fullsized":"2024-05-09T09:50:39.865062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:41.390200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.190863+0000","last_change":"2024-05-09T09:47:18.225280+0000","last_active":"2024-05-09T09:47:52.190863+0000","last_peered":"2024-05-09T09:47:52.190863+0000","last_clean":"2024-05-09T09:47:52.190863+0000","last_became_active":"2024-05-09T09:47:18.224565+0000","last_became_peered":"2024-05-09T09:47:18.224565+0000","last_unstale":"2024-05-09T09:47:52.190863+0000","last_undegraded":"2024-05-09T09:47:52.190863+0000","last_fullsized":"2024-05-09T09:47:52.190863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:53:57.817020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'284","reported_seq":472,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.894617+0000","last_change":"2024-05-09T09:47:20.215231+0000","last_active":"2024-05-09T09:50:39.894617+0000","last_peered":"2024-05-09T09:50:39.894617+0000","last_clean":"2024-05-09T09:50:39.894617+0000","last_became_active":"2024-05-09T09:47:20.214337+0000","last_became_peered":"2024-05-09T09:47:20.214337+0000","last_unstale":"2024-05-09T09:50:39.894617+0000","last_undegraded":"2024-05-09T09:50:39.894617+0000","last_fullsized":"2024-05-09T09:50:39.894617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:35:09.855318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.761634+0000","last_change":"2024-05-09T09:47:22.235441+0000","last_active":"2024-05-09T09:49:31.761634+0000","last_peered":"2024-05-09T09:49:31.761634+0000","last_clean":"2024-05-09T09:49:31.761634+0000","last_became_active":"2024-05-09T09:47:22.233796+0000","last_became_peered":"2024-05-09T09:47:22.233796+0000","last_unstale":"2024-05-09T09:49:31.761634+0000","last_undegraded":"2024-05-09T09:49:31.761634+0000","last_fullsized":"2024-05-09T09:49:31.761634+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:25:18.746306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.164264+0000","last_change":"2024-05-09T09:47:14.175270+0000","last_active":"2024-05-09T09:49:32.164264+0000","last_peered":"2024-05-09T09:49:32.164264+0000","last_clean":"2024-05-09T09:49:32.164264+0000","last_became_active":"2024-05-09T09:47:14.174707+0000","last_became_peered":"2024-05-09T09:47:14.174707+0000","last_unstale":"2024-05-09T09:49:32.164264+0000","last_undegraded":"2024-05-09T09:49:32.164264+0000","last_fullsized":"2024-05-09T09:49:32.164264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:54:18.468178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:01.759832+0000","last_change":"2024-05-09T09:47:12.208521+0000","last_active":"2024-05-09T09:48:01.759832+0000","last_peered":"2024-05-09T09:48:01.759832+0000","last_clean":"2024-05-09T09:48:01.759832+0000","last_became_active":"2024-05-09T09:47:12.207874+0000","last_became_peered":"2024-05-09T09:47:12.207874+0000","last_unstale":"2024-05-09T09:48:01.759832+0000","last_undegraded":"2024-05-09T09:48:01.759832+0000","last_fullsized":"2024-05-09T09:48:01.759832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:30:35.883636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"23'1","reported_seq":220,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.849555+0000","last_change":"2024-05-09T09:47:16.205195+0000","last_active":"2024-05-09T09:50:39.849555+0000","last_peered":"2024-05-09T09:50:39.849555+0000","last_clean":"2024-05-09T09:50:39.849555+0000","last_became_active":"2024-05-09T09:47:16.204577+0000","last_became_peered":"2024-05-09T09:47:16.204577+0000","last_unstale":"2024-05-09T09:50:39.849555+0000","last_undegraded":"2024-05-09T09:50:39.849555+0000","last_fullsized":"2024-05-09T09:50:39.849555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:40:46.201735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'115","reported_seq":165,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.981858+0000","last_change":"2024-05-09T09:47:18.204810+0000","last_active":"2024-05-09T09:50:39.981858+0000","last_peered":"2024-05-09T09:50:39.981858+0000","last_clean":"2024-05-09T09:50:39.981858+0000","last_became_active":"2024-05-09T09:47:18.204057+0000","last_became_peered":"2024-05-09T09:47:18.204057+0000","last_unstale":"2024-05-09T09:50:39.981858+0000","last_undegraded":"2024-05-09T09:50:39.981858+0000","last_fullsized":"2024-05-09T09:50:39.981858+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:27:23.487170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.178557+0000","last_change":"2024-05-09T09:47:20.255850+0000","last_active":"2024-05-09T09:47:52.178557+0000","last_peered":"2024-05-09T09:47:52.178557+0000","last_clean":"2024-05-09T09:47:52.178557+0000","last_became_active":"2024-05-09T09:47:20.255477+0000","last_became_peered":"2024-05-09T09:47:20.255477+0000","last_unstale":"2024-05-09T09:47:52.178557+0000","last_undegraded":"2024-05-09T09:47:52.178557+0000","last_fullsized":"2024-05-09T09:47:52.178557+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:09.812329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'8","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.372509+0000","last_change":"2024-05-09T09:47:22.228107+0000","last_active":"2024-05-09T09:50:33.372509+0000","last_peered":"2024-05-09T09:50:33.372509+0000","last_clean":"2024-05-09T09:50:33.372509+0000","last_became_active":"2024-05-09T09:47:22.227373+0000","last_became_peered":"2024-05-09T09:47:22.227373+0000","last_unstale":"2024-05-09T09:50:33.372509+0000","last_undegraded":"2024-05-09T09:50:33.372509+0000","last_fullsized":"2024-05-09T09:50:33.372509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:22:52.362489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'7","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.172569+0000","last_change":"2024-05-09T09:47:14.189976+0000","last_active":"2024-05-09T09:49:20.172569+0000","last_peered":"2024-05-09T09:49:20.172569+0000","last_clean":"2024-05-09T09:49:20.172569+0000","last_became_active":"2024-05-09T09:47:14.189623+0000","last_became_peered":"2024-05-09T09:47:14.189623+0000","last_unstale":"2024-05-09T09:49:20.172569+0000","last_undegraded":"2024-05-09T09:49:20.172569+0000","last_fullsized":"2024-05-09T09:49:20.172569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:21.387148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":202,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.163439+0000","last_change":"2024-05-09T09:46:57.510904+0000","last_active":"2024-05-09T09:47:52.163439+0000","last_peered":"2024-05-09T09:47:52.163439+0000","last_clean":"2024-05-09T09:47:52.163439+0000","last_became_active":"2024-05-09T09:46:57.508178+0000","last_became_peered":"2024-05-09T09:46:57.508178+0000","last_unstale":"2024-05-09T09:47:52.163439+0000","last_undegraded":"2024-05-09T09:47:52.163439+0000","last_fullsized":"2024-05-09T09:47:52.163439+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:46:56.015260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:46:56.015260+0000","last_clean_scrub_stamp":"2024-05-09T09:46:56.015260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:04:32.521129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.187056+0000","last_change":"2024-05-09T09:47:03.054623+0000","last_active":"2024-05-09T09:47:52.187056+0000","last_peered":"2024-05-09T09:47:52.187056+0000","last_clean":"2024-05-09T09:47:52.187056+0000","last_became_active":"2024-05-09T09:47:03.053783+0000","last_became_peered":"2024-05-09T09:47:03.053783+0000","last_unstale":"2024-05-09T09:47:52.187056+0000","last_undegraded":"2024-05-09T09:47:52.187056+0000","last_fullsized":"2024-05-09T09:47:52.187056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:12:39.792983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.176479+0000","last_change":"2024-05-09T09:47:12.212397+0000","last_active":"2024-05-09T09:47:52.176479+0000","last_peered":"2024-05-09T09:47:52.176479+0000","last_clean":"2024-05-09T09:47:52.176479+0000","last_became_active":"2024-05-09T09:47:12.211344+0000","last_became_peered":"2024-05-09T09:47:12.211344+0000","last_unstale":"2024-05-09T09:47:52.176479+0000","last_undegraded":"2024-05-09T09:47:52.176479+0000","last_fullsized":"2024-05-09T09:47:52.176479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:42.592663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.170165+0000","last_change":"2024-05-09T09:47:16.211676+0000","last_active":"2024-05-09T09:47:52.170165+0000","last_peered":"2024-05-09T09:47:52.170165+0000","last_clean":"2024-05-09T09:47:52.170165+0000","last_became_active":"2024-05-09T09:47:16.210404+0000","last_became_peered":"2024-05-09T09:47:16.210404+0000","last_unstale":"2024-05-09T09:47:52.170165+0000","last_undegraded":"2024-05-09T09:47:52.170165+0000","last_fullsized":"2024-05-09T09:47:52.170165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:29:50.436846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'307","reported_seq":388,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.185873+0000","last_change":"2024-05-09T09:47:18.237058+0000","last_active":"2024-05-09T09:50:40.185873+0000","last_peered":"2024-05-09T09:50:40.185873+0000","last_clean":"2024-05-09T09:50:40.185873+0000","last_became_active":"2024-05-09T09:47:18.236370+0000","last_became_peered":"2024-05-09T09:47:18.236370+0000","last_unstale":"2024-05-09T09:50:40.185873+0000","last_undegraded":"2024-05-09T09:50:40.185873+0000","last_fullsized":"2024-05-09T09:50:40.185873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:35:27.710372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.423093+0000","last_change":"2024-05-09T09:47:20.251241+0000","last_active":"2024-05-09T09:47:52.423093+0000","last_peered":"2024-05-09T09:47:52.423093+0000","last_clean":"2024-05-09T09:47:52.423093+0000","last_became_active":"2024-05-09T09:47:20.250373+0000","last_became_peered":"2024-05-09T09:47:20.250373+0000","last_unstale":"2024-05-09T09:47:52.423093+0000","last_undegraded":"2024-05-09T09:47:52.423093+0000","last_fullsized":"2024-05-09T09:47:52.423093+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:20:34.198648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'86","reported_seq":169,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.328990+0000","last_change":"2024-05-09T09:47:22.237003+0000","last_active":"2024-05-09T09:50:33.328990+0000","last_peered":"2024-05-09T09:50:33.328990+0000","last_clean":"2024-05-09T09:50:33.328990+0000","last_became_active":"2024-05-09T09:47:22.236267+0000","last_became_peered":"2024-05-09T09:47:22.236267+0000","last_unstale":"2024-05-09T09:50:33.328990+0000","last_undegraded":"2024-05-09T09:50:33.328990+0000","last_fullsized":"2024-05-09T09:50:33.328990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:08.206306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":223,"num_write":170,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:01.804496+0000","last_change":"2024-05-09T09:47:14.185397+0000","last_active":"2024-05-09T09:48:01.804496+0000","last_peered":"2024-05-09T09:48:01.804496+0000","last_clean":"2024-05-09T09:48:01.804496+0000","last_became_active":"2024-05-09T09:47:14.185071+0000","last_became_peered":"2024-05-09T09:47:14.185071+0000","last_unstale":"2024-05-09T09:48:01.804496+0000","last_undegraded":"2024-05-09T09:48:01.804496+0000","last_fullsized":"2024-05-09T09:48:01.804496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:49:40.986014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.168817+0000","last_change":"2024-05-09T09:47:03.051628+0000","last_active":"2024-05-09T09:47:52.168817+0000","last_peered":"2024-05-09T09:47:52.168817+0000","last_clean":"2024-05-09T09:47:52.168817+0000","last_became_active":"2024-05-09T09:47:03.050535+0000","last_became_peered":"2024-05-09T09:47:03.050535+0000","last_unstale":"2024-05-09T09:47:52.168817+0000","last_undegraded":"2024-05-09T09:47:52.168817+0000","last_fullsized":"2024-05-09T09:47:52.168817+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:09:16.875087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:46.145259+0000","last_change":"2024-05-09T09:47:12.206331+0000","last_active":"2024-05-09T09:48:46.145259+0000","last_peered":"2024-05-09T09:48:46.145259+0000","last_clean":"2024-05-09T09:48:46.145259+0000","last_became_active":"2024-05-09T09:47:12.203494+0000","last_became_peered":"2024-05-09T09:47:12.203494+0000","last_unstale":"2024-05-09T09:48:46.145259+0000","last_undegraded":"2024-05-09T09:48:46.145259+0000","last_fullsized":"2024-05-09T09:48:46.145259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:55.107119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.196899+0000","last_change":"2024-05-09T09:47:16.201019+0000","last_active":"2024-05-09T09:47:52.196899+0000","last_peered":"2024-05-09T09:47:52.196899+0000","last_clean":"2024-05-09T09:47:52.196899+0000","last_became_active":"2024-05-09T09:47:16.200369+0000","last_became_peered":"2024-05-09T09:47:16.200369+0000","last_unstale":"2024-05-09T09:47:52.196899+0000","last_undegraded":"2024-05-09T09:47:52.196899+0000","last_fullsized":"2024-05-09T09:47:52.196899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:42:03.943505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'506","reported_seq":724,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.180636+0000","last_change":"2024-05-09T09:47:18.220093+0000","last_active":"2024-05-09T09:50:40.180636+0000","last_peered":"2024-05-09T09:50:40.180636+0000","last_clean":"2024-05-09T09:50:40.180636+0000","last_became_active":"2024-05-09T09:47:18.219321+0000","last_became_peered":"2024-05-09T09:47:18.219321+0000","last_unstale":"2024-05-09T09:50:40.180636+0000","last_undegraded":"2024-05-09T09:50:40.180636+0000","last_fullsized":"2024-05-09T09:50:40.180636+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:07.800202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.191188+0000","last_change":"2024-05-09T09:47:20.249740+0000","last_active":"2024-05-09T09:47:52.191188+0000","last_peered":"2024-05-09T09:47:52.191188+0000","last_clean":"2024-05-09T09:47:52.191188+0000","last_became_active":"2024-05-09T09:47:20.249089+0000","last_became_peered":"2024-05-09T09:47:20.249089+0000","last_unstale":"2024-05-09T09:47:52.191188+0000","last_undegraded":"2024-05-09T09:47:52.191188+0000","last_fullsized":"2024-05-09T09:47:52.191188+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:15:27.189938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:45.869681+0000","last_change":"2024-05-09T09:47:22.245460+0000","last_active":"2024-05-09T09:48:45.869681+0000","last_peered":"2024-05-09T09:48:45.869681+0000","last_clean":"2024-05-09T09:48:45.869681+0000","last_became_active":"2024-05-09T09:47:22.244543+0000","last_became_peered":"2024-05-09T09:47:22.244543+0000","last_unstale":"2024-05-09T09:48:45.869681+0000","last_undegraded":"2024-05-09T09:48:45.869681+0000","last_fullsized":"2024-05-09T09:48:45.869681+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:59:48.546473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.150108+0000","last_change":"2024-05-09T09:47:14.177030+0000","last_active":"2024-05-09T09:50:33.150108+0000","last_peered":"2024-05-09T09:50:33.150108+0000","last_clean":"2024-05-09T09:50:33.150108+0000","last_became_active":"2024-05-09T09:47:14.173959+0000","last_became_peered":"2024-05-09T09:47:14.173959+0000","last_unstale":"2024-05-09T09:50:33.150108+0000","last_undegraded":"2024-05-09T09:50:33.150108+0000","last_fullsized":"2024-05-09T09:50:33.150108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:57.831374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.167819+0000","last_change":"2024-05-09T09:47:03.052957+0000","last_active":"2024-05-09T09:47:52.167819+0000","last_peered":"2024-05-09T09:47:52.167819+0000","last_clean":"2024-05-09T09:47:52.167819+0000","last_became_active":"2024-05-09T09:47:03.052185+0000","last_became_peered":"2024-05-09T09:47:03.052185+0000","last_unstale":"2024-05-09T09:47:52.167819+0000","last_undegraded":"2024-05-09T09:47:52.167819+0000","last_fullsized":"2024-05-09T09:47:52.167819+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:48:39.354125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.102108+0000","last_change":"2024-05-09T09:47:12.186149+0000","last_active":"2024-05-09T09:50:33.102108+0000","last_peered":"2024-05-09T09:50:33.102108+0000","last_clean":"2024-05-09T09:50:33.102108+0000","last_became_active":"2024-05-09T09:47:12.183846+0000","last_became_peered":"2024-05-09T09:47:12.183846+0000","last_unstale":"2024-05-09T09:50:33.102108+0000","last_undegraded":"2024-05-09T09:50:33.102108+0000","last_fullsized":"2024-05-09T09:50:33.102108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:46.107016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.185095+0000","last_change":"2024-05-09T09:47:16.202023+0000","last_active":"2024-05-09T09:47:52.185095+0000","last_peered":"2024-05-09T09:47:52.185095+0000","last_clean":"2024-05-09T09:47:52.185095+0000","last_became_active":"2024-05-09T09:47:16.197380+0000","last_became_peered":"2024-05-09T09:47:16.197380+0000","last_unstale":"2024-05-09T09:47:52.185095+0000","last_undegraded":"2024-05-09T09:47:52.185095+0000","last_fullsized":"2024-05-09T09:47:52.185095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:23:20.908060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'18","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:31.469305+0000","last_change":"2024-05-09T09:47:18.218553+0000","last_active":"2024-05-09T09:50:31.469305+0000","last_peered":"2024-05-09T09:50:31.469305+0000","last_clean":"2024-05-09T09:50:31.469305+0000","last_became_active":"2024-05-09T09:47:18.217023+0000","last_became_peered":"2024-05-09T09:47:18.217023+0000","last_unstale":"2024-05-09T09:50:31.469305+0000","last_undegraded":"2024-05-09T09:50:31.469305+0000","last_fullsized":"2024-05-09T09:50:31.469305+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:31.382403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.420979+0000","last_change":"2024-05-09T09:47:20.251883+0000","last_active":"2024-05-09T09:47:52.420979+0000","last_peered":"2024-05-09T09:47:52.420979+0000","last_clean":"2024-05-09T09:47:52.420979+0000","last_became_active":"2024-05-09T09:47:20.250979+0000","last_became_peered":"2024-05-09T09:47:20.250979+0000","last_unstale":"2024-05-09T09:47:52.420979+0000","last_undegraded":"2024-05-09T09:47:52.420979+0000","last_fullsized":"2024-05-09T09:47:52.420979+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:41:44.382613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.176855+0000","last_change":"2024-05-09T09:47:22.264183+0000","last_active":"2024-05-09T09:47:52.176855+0000","last_peered":"2024-05-09T09:47:52.176855+0000","last_clean":"2024-05-09T09:47:52.176855+0000","last_became_active":"2024-05-09T09:47:22.263615+0000","last_became_peered":"2024-05-09T09:47:22.263615+0000","last_unstale":"2024-05-09T09:47:52.176855+0000","last_undegraded":"2024-05-09T09:47:52.176855+0000","last_fullsized":"2024-05-09T09:47:52.176855+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:55:41.434447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'4","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:00.834605+0000","last_change":"2024-05-09T09:47:14.190245+0000","last_active":"2024-05-09T09:48:00.834605+0000","last_peered":"2024-05-09T09:48:00.834605+0000","last_clean":"2024-05-09T09:48:00.834605+0000","last_became_active":"2024-05-09T09:47:14.188644+0000","last_became_peered":"2024-05-09T09:47:14.188644+0000","last_unstale":"2024-05-09T09:48:00.834605+0000","last_undegraded":"2024-05-09T09:48:00.834605+0000","last_fullsized":"2024-05-09T09:48:00.834605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:41:29.222588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.173230+0000","last_change":"2024-05-09T09:47:03.051760+0000","last_active":"2024-05-09T09:47:52.173230+0000","last_peered":"2024-05-09T09:47:52.173230+0000","last_clean":"2024-05-09T09:47:52.173230+0000","last_became_active":"2024-05-09T09:47:03.050832+0000","last_became_peered":"2024-05-09T09:47:03.050832+0000","last_unstale":"2024-05-09T09:47:52.173230+0000","last_undegraded":"2024-05-09T09:47:52.173230+0000","last_fullsized":"2024-05-09T09:47:52.173230+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:47.680871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.179110+0000","last_change":"2024-05-09T09:47:12.191109+0000","last_active":"2024-05-09T09:47:52.179110+0000","last_peered":"2024-05-09T09:47:52.179110+0000","last_clean":"2024-05-09T09:47:52.179110+0000","last_became_active":"2024-05-09T09:47:12.190521+0000","last_became_peered":"2024-05-09T09:47:12.190521+0000","last_unstale":"2024-05-09T09:47:52.179110+0000","last_undegraded":"2024-05-09T09:47:52.179110+0000","last_fullsized":"2024-05-09T09:47:52.179110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:14:11.726333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.423038+0000","last_change":"2024-05-09T09:47:16.189464+0000","last_active":"2024-05-09T09:47:52.423038+0000","last_peered":"2024-05-09T09:47:52.423038+0000","last_clean":"2024-05-09T09:47:52.423038+0000","last_became_active":"2024-05-09T09:47:16.187120+0000","last_became_peered":"2024-05-09T09:47:16.187120+0000","last_unstale":"2024-05-09T09:47:52.423038+0000","last_undegraded":"2024-05-09T09:47:52.423038+0000","last_fullsized":"2024-05-09T09:47:52.423038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:29.369869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'14","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.208504+0000","last_change":"2024-05-09T09:47:18.231683+0000","last_active":"2024-05-09T09:50:32.208504+0000","last_peered":"2024-05-09T09:50:32.208504+0000","last_clean":"2024-05-09T09:50:32.208504+0000","last_became_active":"2024-05-09T09:47:18.230757+0000","last_became_peered":"2024-05-09T09:47:18.230757+0000","last_unstale":"2024-05-09T09:50:32.208504+0000","last_undegraded":"2024-05-09T09:50:32.208504+0000","last_fullsized":"2024-05-09T09:50:32.208504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:11:55.151452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.198252+0000","last_change":"2024-05-09T09:47:20.250439+0000","last_active":"2024-05-09T09:47:52.198252+0000","last_peered":"2024-05-09T09:47:52.198252+0000","last_clean":"2024-05-09T09:47:52.198252+0000","last_became_active":"2024-05-09T09:47:20.249919+0000","last_became_peered":"2024-05-09T09:47:20.249919+0000","last_unstale":"2024-05-09T09:47:52.198252+0000","last_undegraded":"2024-05-09T09:47:52.198252+0000","last_fullsized":"2024-05-09T09:47:52.198252+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:01:29.818831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'6","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.774666+0000","last_change":"2024-05-09T09:47:22.260930+0000","last_active":"2024-05-09T09:49:31.774666+0000","last_peered":"2024-05-09T09:49:31.774666+0000","last_clean":"2024-05-09T09:49:31.774666+0000","last_became_active":"2024-05-09T09:47:22.259833+0000","last_became_peered":"2024-05-09T09:47:22.259833+0000","last_unstale":"2024-05-09T09:49:31.774666+0000","last_undegraded":"2024-05-09T09:49:31.774666+0000","last_fullsized":"2024-05-09T09:49:31.774666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:01.734541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.809750+0000","last_change":"2024-05-09T09:47:14.174110+0000","last_active":"2024-05-09T09:50:32.809750+0000","last_peered":"2024-05-09T09:50:32.809750+0000","last_clean":"2024-05-09T09:50:32.809750+0000","last_became_active":"2024-05-09T09:47:14.173535+0000","last_became_peered":"2024-05-09T09:47:14.173535+0000","last_unstale":"2024-05-09T09:50:32.809750+0000","last_undegraded":"2024-05-09T09:50:32.809750+0000","last_fullsized":"2024-05-09T09:50:32.809750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:35:20.332271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:00.785377+0000","last_change":"2024-05-09T09:47:12.195767+0000","last_active":"2024-05-09T09:48:00.785377+0000","last_peered":"2024-05-09T09:48:00.785377+0000","last_clean":"2024-05-09T09:48:00.785377+0000","last_became_active":"2024-05-09T09:47:12.194500+0000","last_became_peered":"2024-05-09T09:47:12.194500+0000","last_unstale":"2024-05-09T09:48:00.785377+0000","last_undegraded":"2024-05-09T09:48:00.785377+0000","last_fullsized":"2024-05-09T09:48:00.785377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:06.949531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.425796+0000","last_change":"2024-05-09T09:47:03.051513+0000","last_active":"2024-05-09T09:47:52.425796+0000","last_peered":"2024-05-09T09:47:52.425796+0000","last_clean":"2024-05-09T09:47:52.425796+0000","last_became_active":"2024-05-09T09:47:03.051159+0000","last_became_peered":"2024-05-09T09:47:03.051159+0000","last_unstale":"2024-05-09T09:47:52.425796+0000","last_undegraded":"2024-05-09T09:47:52.425796+0000","last_fullsized":"2024-05-09T09:47:52.425796+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:12.598885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'5","reported_seq":230,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.866525+0000","last_change":"2024-05-09T09:47:16.199008+0000","last_active":"2024-05-09T09:50:39.866525+0000","last_peered":"2024-05-09T09:50:39.866525+0000","last_clean":"2024-05-09T09:50:39.866525+0000","last_became_active":"2024-05-09T09:47:16.198233+0000","last_became_peered":"2024-05-09T09:47:16.198233+0000","last_unstale":"2024-05-09T09:50:39.866525+0000","last_undegraded":"2024-05-09T09:50:39.866525+0000","last_fullsized":"2024-05-09T09:50:39.866525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:04.613279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1180,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":302,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'215","reported_seq":282,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.169833+0000","last_change":"2024-05-09T09:47:18.200360+0000","last_active":"2024-05-09T09:50:40.169833+0000","last_peered":"2024-05-09T09:50:40.169833+0000","last_clean":"2024-05-09T09:50:40.169833+0000","last_became_active":"2024-05-09T09:47:18.199411+0000","last_became_peered":"2024-05-09T09:47:18.199411+0000","last_unstale":"2024-05-09T09:50:40.169833+0000","last_undegraded":"2024-05-09T09:50:40.169833+0000","last_fullsized":"2024-05-09T09:50:40.169833+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:30:17.183321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.166977+0000","last_change":"2024-05-09T09:47:20.233735+0000","last_active":"2024-05-09T09:47:52.166977+0000","last_peered":"2024-05-09T09:47:52.166977+0000","last_clean":"2024-05-09T09:47:52.166977+0000","last_became_active":"2024-05-09T09:47:20.233024+0000","last_became_peered":"2024-05-09T09:47:20.233024+0000","last_unstale":"2024-05-09T09:47:52.166977+0000","last_undegraded":"2024-05-09T09:47:52.166977+0000","last_fullsized":"2024-05-09T09:47:52.166977+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:49:47.023864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'11","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.037073+0000","last_change":"2024-05-09T09:47:22.229611+0000","last_active":"2024-05-09T09:49:32.037073+0000","last_peered":"2024-05-09T09:49:32.037073+0000","last_clean":"2024-05-09T09:49:32.037073+0000","last_became_active":"2024-05-09T09:47:22.228855+0000","last_became_peered":"2024-05-09T09:47:22.228855+0000","last_unstale":"2024-05-09T09:49:32.037073+0000","last_undegraded":"2024-05-09T09:49:32.037073+0000","last_fullsized":"2024-05-09T09:49:32.037073+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:42:02.241469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'12","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.303331+0000","last_change":"2024-05-09T09:47:52.440285+0000","last_active":"2024-05-09T09:50:33.303331+0000","last_peered":"2024-05-09T09:50:33.303331+0000","last_clean":"2024-05-09T09:50:33.303331+0000","last_became_active":"2024-05-09T09:47:52.430912+0000","last_became_peered":"2024-05-09T09:47:52.430912+0000","last_unstale":"2024-05-09T09:50:33.303331+0000","last_undegraded":"2024-05-09T09:50:33.303331+0000","last_fullsized":"2024-05-09T09:50:33.303331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:11:51.125729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.420062+0000","last_change":"2024-05-09T09:47:12.190681+0000","last_active":"2024-05-09T09:47:52.420062+0000","last_peered":"2024-05-09T09:47:52.420062+0000","last_clean":"2024-05-09T09:47:52.420062+0000","last_became_active":"2024-05-09T09:47:12.189486+0000","last_became_peered":"2024-05-09T09:47:12.189486+0000","last_unstale":"2024-05-09T09:47:52.420062+0000","last_undegraded":"2024-05-09T09:47:52.420062+0000","last_fullsized":"2024-05-09T09:47:52.420062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:36:27.157767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.192263+0000","last_change":"2024-05-09T09:47:03.051225+0000","last_active":"2024-05-09T09:47:52.192263+0000","last_peered":"2024-05-09T09:47:52.192263+0000","last_clean":"2024-05-09T09:47:52.192263+0000","last_became_active":"2024-05-09T09:47:03.050600+0000","last_became_peered":"2024-05-09T09:47:03.050600+0000","last_unstale":"2024-05-09T09:47:52.192263+0000","last_undegraded":"2024-05-09T09:47:52.192263+0000","last_fullsized":"2024-05-09T09:47:52.192263+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:08:36.545563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.173025+0000","last_change":"2024-05-09T09:47:16.188804+0000","last_active":"2024-05-09T09:47:52.173025+0000","last_peered":"2024-05-09T09:47:52.173025+0000","last_clean":"2024-05-09T09:47:52.173025+0000","last_became_active":"2024-05-09T09:47:16.182232+0000","last_became_peered":"2024-05-09T09:47:16.182232+0000","last_unstale":"2024-05-09T09:47:52.173025+0000","last_undegraded":"2024-05-09T09:47:52.173025+0000","last_fullsized":"2024-05-09T09:47:52.173025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:35:05.830656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.165199+0000","last_change":"2024-05-09T09:47:18.213188+0000","last_active":"2024-05-09T09:47:52.165199+0000","last_peered":"2024-05-09T09:47:52.165199+0000","last_clean":"2024-05-09T09:47:52.165199+0000","last_became_active":"2024-05-09T09:47:18.211020+0000","last_became_peered":"2024-05-09T09:47:18.211020+0000","last_unstale":"2024-05-09T09:47:52.165199+0000","last_undegraded":"2024-05-09T09:47:52.165199+0000","last_fullsized":"2024-05-09T09:47:52.165199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:53:16.173752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'284","reported_seq":373,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.889032+0000","last_change":"2024-05-09T09:47:20.227322+0000","last_active":"2024-05-09T09:50:39.889032+0000","last_peered":"2024-05-09T09:50:39.889032+0000","last_clean":"2024-05-09T09:50:39.889032+0000","last_became_active":"2024-05-09T09:47:20.226481+0000","last_became_peered":"2024-05-09T09:47:20.226481+0000","last_unstale":"2024-05-09T09:50:39.889032+0000","last_undegraded":"2024-05-09T09:50:39.889032+0000","last_fullsized":"2024-05-09T09:50:39.889032+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:03:55.645189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.195877+0000","last_change":"2024-05-09T09:47:22.256859+0000","last_active":"2024-05-09T09:47:52.195877+0000","last_peered":"2024-05-09T09:47:52.195877+0000","last_clean":"2024-05-09T09:47:52.195877+0000","last_became_active":"2024-05-09T09:47:22.256285+0000","last_became_peered":"2024-05-09T09:47:22.256285+0000","last_unstale":"2024-05-09T09:47:52.195877+0000","last_undegraded":"2024-05-09T09:47:52.195877+0000","last_fullsized":"2024-05-09T09:47:52.195877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:11:22.508789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.239155+0000","last_change":"2024-05-09T09:47:14.183911+0000","last_active":"2024-05-09T09:50:33.239155+0000","last_peered":"2024-05-09T09:50:33.239155+0000","last_clean":"2024-05-09T09:50:33.239155+0000","last_became_active":"2024-05-09T09:47:14.183542+0000","last_became_peered":"2024-05-09T09:47:14.183542+0000","last_unstale":"2024-05-09T09:50:33.239155+0000","last_undegraded":"2024-05-09T09:50:33.239155+0000","last_fullsized":"2024-05-09T09:50:33.239155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:29:48.423658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.199875+0000","last_change":"2024-05-09T09:47:12.200135+0000","last_active":"2024-05-09T09:47:52.199875+0000","last_peered":"2024-05-09T09:47:52.199875+0000","last_clean":"2024-05-09T09:47:52.199875+0000","last_became_active":"2024-05-09T09:47:12.199656+0000","last_became_peered":"2024-05-09T09:47:12.199656+0000","last_unstale":"2024-05-09T09:47:52.199875+0000","last_undegraded":"2024-05-09T09:47:52.199875+0000","last_fullsized":"2024-05-09T09:47:52.199875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:32:17.255514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.427138+0000","last_change":"2024-05-09T09:47:03.053083+0000","last_active":"2024-05-09T09:47:52.427138+0000","last_peered":"2024-05-09T09:47:52.427138+0000","last_clean":"2024-05-09T09:47:52.427138+0000","last_became_active":"2024-05-09T09:47:03.052728+0000","last_became_peered":"2024-05-09T09:47:03.052728+0000","last_unstale":"2024-05-09T09:47:52.427138+0000","last_undegraded":"2024-05-09T09:47:52.427138+0000","last_fullsized":"2024-05-09T09:47:52.427138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:40:57.635793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.184620+0000","last_change":"2024-05-09T09:47:52.183646+0000","last_active":"2024-05-09T09:47:52.184620+0000","last_peered":"2024-05-09T09:47:52.184620+0000","last_clean":"2024-05-09T09:47:52.184620+0000","last_became_active":"2024-05-09T09:47:52.182360+0000","last_became_peered":"2024-05-09T09:47:52.182360+0000","last_unstale":"2024-05-09T09:47:52.184620+0000","last_undegraded":"2024-05-09T09:47:52.184620+0000","last_fullsized":"2024-05-09T09:47:52.184620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:36:55.505219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.177728+0000","last_change":"2024-05-09T09:47:18.235283+0000","last_active":"2024-05-09T09:47:52.177728+0000","last_peered":"2024-05-09T09:47:52.177728+0000","last_clean":"2024-05-09T09:47:52.177728+0000","last_became_active":"2024-05-09T09:47:18.234556+0000","last_became_peered":"2024-05-09T09:47:18.234556+0000","last_unstale":"2024-05-09T09:47:52.177728+0000","last_undegraded":"2024-05-09T09:47:52.177728+0000","last_fullsized":"2024-05-09T09:47:52.177728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:52:44.437137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'284","reported_seq":403,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.896692+0000","last_change":"2024-05-09T09:47:20.229005+0000","last_active":"2024-05-09T09:50:39.896692+0000","last_peered":"2024-05-09T09:50:39.896692+0000","last_clean":"2024-05-09T09:50:39.896692+0000","last_became_active":"2024-05-09T09:47:20.226936+0000","last_became_peered":"2024-05-09T09:47:20.226936+0000","last_unstale":"2024-05-09T09:50:39.896692+0000","last_undegraded":"2024-05-09T09:50:39.896692+0000","last_fullsized":"2024-05-09T09:50:39.896692+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:17:45.132446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.168136+0000","last_change":"2024-05-09T09:47:22.260147+0000","last_active":"2024-05-09T09:47:52.168136+0000","last_peered":"2024-05-09T09:47:52.168136+0000","last_clean":"2024-05-09T09:47:52.168136+0000","last_became_active":"2024-05-09T09:47:22.259547+0000","last_became_peered":"2024-05-09T09:47:22.259547+0000","last_unstale":"2024-05-09T09:47:52.168136+0000","last_undegraded":"2024-05-09T09:47:52.168136+0000","last_fullsized":"2024-05-09T09:47:52.168136+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:00:03.909321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'12","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:46.159946+0000","last_change":"2024-05-09T09:47:14.174039+0000","last_active":"2024-05-09T09:48:46.159946+0000","last_peered":"2024-05-09T09:48:46.159946+0000","last_clean":"2024-05-09T09:48:46.159946+0000","last_became_active":"2024-05-09T09:47:14.173673+0000","last_became_peered":"2024-05-09T09:47:14.173673+0000","last_unstale":"2024-05-09T09:48:46.159946+0000","last_undegraded":"2024-05-09T09:48:46.159946+0000","last_fullsized":"2024-05-09T09:48:46.159946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:56:48.282736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.174836+0000","last_change":"2024-05-09T09:47:12.206199+0000","last_active":"2024-05-09T09:47:52.174836+0000","last_peered":"2024-05-09T09:47:52.174836+0000","last_clean":"2024-05-09T09:47:52.174836+0000","last_became_active":"2024-05-09T09:47:12.205502+0000","last_became_peered":"2024-05-09T09:47:12.205502+0000","last_unstale":"2024-05-09T09:47:52.174836+0000","last_undegraded":"2024-05-09T09:47:52.174836+0000","last_fullsized":"2024-05-09T09:47:52.174836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:00:03.229983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.198477+0000","last_change":"2024-05-09T09:47:03.187330+0000","last_active":"2024-05-09T09:47:52.198477+0000","last_peered":"2024-05-09T09:47:52.198477+0000","last_clean":"2024-05-09T09:47:52.198477+0000","last_became_active":"2024-05-09T09:47:03.186434+0000","last_became_peered":"2024-05-09T09:47:03.186434+0000","last_unstale":"2024-05-09T09:47:52.198477+0000","last_undegraded":"2024-05-09T09:47:52.198477+0000","last_fullsized":"2024-05-09T09:47:52.198477+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:51:35.071748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.168475+0000","last_change":"2024-05-09T09:47:16.184166+0000","last_active":"2024-05-09T09:47:52.168475+0000","last_peered":"2024-05-09T09:47:52.168475+0000","last_clean":"2024-05-09T09:47:52.168475+0000","last_became_active":"2024-05-09T09:47:16.182713+0000","last_became_peered":"2024-05-09T09:47:16.182713+0000","last_unstale":"2024-05-09T09:47:52.168475+0000","last_undegraded":"2024-05-09T09:47:52.168475+0000","last_fullsized":"2024-05-09T09:47:52.168475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:03:51.620527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'313","reported_seq":397,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.146762+0000","last_change":"2024-05-09T09:47:18.227175+0000","last_active":"2024-05-09T09:50:40.146762+0000","last_peered":"2024-05-09T09:50:40.146762+0000","last_clean":"2024-05-09T09:50:40.146762+0000","last_became_active":"2024-05-09T09:47:18.226473+0000","last_became_peered":"2024-05-09T09:47:18.226473+0000","last_unstale":"2024-05-09T09:50:40.146762+0000","last_undegraded":"2024-05-09T09:50:40.146762+0000","last_fullsized":"2024-05-09T09:50:40.146762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:06.625814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.414174+0000","last_change":"2024-05-09T09:47:20.228640+0000","last_active":"2024-05-09T09:47:52.414174+0000","last_peered":"2024-05-09T09:47:52.414174+0000","last_clean":"2024-05-09T09:47:52.414174+0000","last_became_active":"2024-05-09T09:47:20.227198+0000","last_became_peered":"2024-05-09T09:47:20.227198+0000","last_unstale":"2024-05-09T09:47:52.414174+0000","last_undegraded":"2024-05-09T09:47:52.414174+0000","last_fullsized":"2024-05-09T09:47:52.414174+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:03:55.645189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.183943+0000","last_change":"2024-05-09T09:47:22.234544+0000","last_active":"2024-05-09T09:47:52.183943+0000","last_peered":"2024-05-09T09:47:52.183943+0000","last_clean":"2024-05-09T09:47:52.183943+0000","last_became_active":"2024-05-09T09:47:22.233279+0000","last_became_peered":"2024-05-09T09:47:22.233279+0000","last_unstale":"2024-05-09T09:47:52.183943+0000","last_undegraded":"2024-05-09T09:47:52.183943+0000","last_fullsized":"2024-05-09T09:47:52.183943+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:49.038963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.183233+0000","last_change":"2024-05-09T09:47:22.237682+0000","last_active":"2024-05-09T09:47:52.183233+0000","last_peered":"2024-05-09T09:47:52.183233+0000","last_clean":"2024-05-09T09:47:52.183233+0000","last_became_active":"2024-05-09T09:47:22.236863+0000","last_became_peered":"2024-05-09T09:47:22.236863+0000","last_unstale":"2024-05-09T09:47:52.183233+0000","last_undegraded":"2024-05-09T09:47:52.183233+0000","last_fullsized":"2024-05-09T09:47:52.183233+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:03:57.659846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.185906+0000","last_change":"2024-05-09T09:47:14.184633+0000","last_active":"2024-05-09T09:49:32.185906+0000","last_peered":"2024-05-09T09:49:32.185906+0000","last_clean":"2024-05-09T09:49:32.185906+0000","last_became_active":"2024-05-09T09:47:14.184250+0000","last_became_peered":"2024-05-09T09:47:14.184250+0000","last_unstale":"2024-05-09T09:49:32.185906+0000","last_undegraded":"2024-05-09T09:49:32.185906+0000","last_fullsized":"2024-05-09T09:49:32.185906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:04:29.322102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.187933+0000","last_change":"2024-05-09T09:47:12.208454+0000","last_active":"2024-05-09T09:47:52.187933+0000","last_peered":"2024-05-09T09:47:52.187933+0000","last_clean":"2024-05-09T09:47:52.187933+0000","last_became_active":"2024-05-09T09:47:12.203479+0000","last_became_peered":"2024-05-09T09:47:12.203479+0000","last_unstale":"2024-05-09T09:47:52.187933+0000","last_undegraded":"2024-05-09T09:47:52.187933+0000","last_fullsized":"2024-05-09T09:47:52.187933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:04:27.302577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.165369+0000","last_change":"2024-05-09T09:47:16.213892+0000","last_active":"2024-05-09T09:47:52.165369+0000","last_peered":"2024-05-09T09:47:52.165369+0000","last_clean":"2024-05-09T09:47:52.165369+0000","last_became_active":"2024-05-09T09:47:16.210992+0000","last_became_peered":"2024-05-09T09:47:16.210992+0000","last_unstale":"2024-05-09T09:47:52.165369+0000","last_undegraded":"2024-05-09T09:47:52.165369+0000","last_fullsized":"2024-05-09T09:47:52.165369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:14.409926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'109","reported_seq":156,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.999833+0000","last_change":"2024-05-09T09:47:18.234751+0000","last_active":"2024-05-09T09:50:39.999833+0000","last_peered":"2024-05-09T09:50:39.999833+0000","last_clean":"2024-05-09T09:50:39.999833+0000","last_became_active":"2024-05-09T09:47:18.234014+0000","last_became_peered":"2024-05-09T09:47:18.234014+0000","last_unstale":"2024-05-09T09:50:39.999833+0000","last_undegraded":"2024-05-09T09:50:39.999833+0000","last_fullsized":"2024-05-09T09:50:39.999833+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:19:30.298184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.171859+0000","last_change":"2024-05-09T09:47:20.254957+0000","last_active":"2024-05-09T09:47:52.171859+0000","last_peered":"2024-05-09T09:47:52.171859+0000","last_clean":"2024-05-09T09:47:52.171859+0000","last_became_active":"2024-05-09T09:47:20.254344+0000","last_became_peered":"2024-05-09T09:47:20.254344+0000","last_unstale":"2024-05-09T09:47:52.171859+0000","last_undegraded":"2024-05-09T09:47:52.171859+0000","last_fullsized":"2024-05-09T09:47:52.171859+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:25:58.655419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'5","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.848146+0000","last_change":"2024-05-09T09:47:22.230150+0000","last_active":"2024-05-09T09:50:32.848146+0000","last_peered":"2024-05-09T09:50:32.848146+0000","last_clean":"2024-05-09T09:50:32.848146+0000","last_became_active":"2024-05-09T09:47:22.229088+0000","last_became_peered":"2024-05-09T09:47:22.229088+0000","last_unstale":"2024-05-09T09:50:32.848146+0000","last_undegraded":"2024-05-09T09:50:32.848146+0000","last_fullsized":"2024-05-09T09:50:32.848146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:55:57.267178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'8","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.947282+0000","last_change":"2024-05-09T09:47:14.174619+0000","last_active":"2024-05-09T09:50:32.947282+0000","last_peered":"2024-05-09T09:50:32.947282+0000","last_clean":"2024-05-09T09:50:32.947282+0000","last_became_active":"2024-05-09T09:47:14.173866+0000","last_became_peered":"2024-05-09T09:47:14.173866+0000","last_unstale":"2024-05-09T09:50:32.947282+0000","last_undegraded":"2024-05-09T09:50:32.947282+0000","last_fullsized":"2024-05-09T09:50:32.947282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:58:34.213528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.179002+0000","last_change":"2024-05-09T09:47:12.206131+0000","last_active":"2024-05-09T09:47:52.179002+0000","last_peered":"2024-05-09T09:47:52.179002+0000","last_clean":"2024-05-09T09:47:52.179002+0000","last_became_active":"2024-05-09T09:47:12.205714+0000","last_became_peered":"2024-05-09T09:47:12.205714+0000","last_unstale":"2024-05-09T09:47:52.179002+0000","last_undegraded":"2024-05-09T09:47:52.179002+0000","last_fullsized":"2024-05-09T09:47:52.179002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:46.107016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.190257+0000","last_change":"2024-05-09T09:47:52.188822+0000","last_active":"2024-05-09T09:47:52.190257+0000","last_peered":"2024-05-09T09:47:52.190257+0000","last_clean":"2024-05-09T09:47:52.190257+0000","last_became_active":"2024-05-09T09:47:52.187627+0000","last_became_peered":"2024-05-09T09:47:52.187627+0000","last_unstale":"2024-05-09T09:47:52.190257+0000","last_undegraded":"2024-05-09T09:47:52.190257+0000","last_fullsized":"2024-05-09T09:47:52.190257+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:41:01.595836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'5","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.222011+0000","last_change":"2024-05-09T09:47:18.218595+0000","last_active":"2024-05-09T09:50:32.222011+0000","last_peered":"2024-05-09T09:50:32.222011+0000","last_clean":"2024-05-09T09:50:32.222011+0000","last_became_active":"2024-05-09T09:47:18.217843+0000","last_became_peered":"2024-05-09T09:47:18.217843+0000","last_unstale":"2024-05-09T09:50:32.222011+0000","last_undegraded":"2024-05-09T09:50:32.222011+0000","last_fullsized":"2024-05-09T09:50:32.222011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:49:45.011737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.167605+0000","last_change":"2024-05-09T09:47:20.256418+0000","last_active":"2024-05-09T09:47:52.167605+0000","last_peered":"2024-05-09T09:47:52.167605+0000","last_clean":"2024-05-09T09:47:52.167605+0000","last_became_active":"2024-05-09T09:47:20.255449+0000","last_became_peered":"2024-05-09T09:47:20.255449+0000","last_unstale":"2024-05-09T09:47:52.167605+0000","last_undegraded":"2024-05-09T09:47:52.167605+0000","last_fullsized":"2024-05-09T09:47:52.167605+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:30:19.195448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.408435+0000","last_change":"2024-05-09T09:47:22.239979+0000","last_active":"2024-05-09T09:50:33.408435+0000","last_peered":"2024-05-09T09:50:33.408435+0000","last_clean":"2024-05-09T09:50:33.408435+0000","last_became_active":"2024-05-09T09:47:22.239113+0000","last_became_peered":"2024-05-09T09:47:22.239113+0000","last_unstale":"2024-05-09T09:50:33.408435+0000","last_undegraded":"2024-05-09T09:50:33.408435+0000","last_fullsized":"2024-05-09T09:50:33.408435+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:34:01.631008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.238187+0000","last_change":"2024-05-09T09:47:14.174348+0000","last_active":"2024-05-09T09:50:33.238187+0000","last_peered":"2024-05-09T09:50:33.238187+0000","last_clean":"2024-05-09T09:50:33.238187+0000","last_became_active":"2024-05-09T09:47:14.173338+0000","last_became_peered":"2024-05-09T09:47:14.173338+0000","last_unstale":"2024-05-09T09:50:33.238187+0000","last_undegraded":"2024-05-09T09:50:33.238187+0000","last_fullsized":"2024-05-09T09:50:33.238187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:58:34.213528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:01.777271+0000","last_change":"2024-05-09T09:47:12.209971+0000","last_active":"2024-05-09T09:48:01.777271+0000","last_peered":"2024-05-09T09:48:01.777271+0000","last_clean":"2024-05-09T09:48:01.777271+0000","last_became_active":"2024-05-09T09:47:12.205864+0000","last_became_peered":"2024-05-09T09:47:12.205864+0000","last_unstale":"2024-05-09T09:48:01.777271+0000","last_undegraded":"2024-05-09T09:48:01.777271+0000","last_fullsized":"2024-05-09T09:48:01.777271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:00:05.597093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.169350+0000","last_change":"2024-05-09T09:47:16.215336+0000","last_active":"2024-05-09T09:47:52.169350+0000","last_peered":"2024-05-09T09:47:52.169350+0000","last_clean":"2024-05-09T09:47:52.169350+0000","last_became_active":"2024-05-09T09:47:16.214780+0000","last_became_peered":"2024-05-09T09:47:16.214780+0000","last_unstale":"2024-05-09T09:47:52.169350+0000","last_undegraded":"2024-05-09T09:47:52.169350+0000","last_fullsized":"2024-05-09T09:47:52.169350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:34:04.877319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'117","reported_seq":180,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.154489+0000","last_change":"2024-05-09T09:47:18.202153+0000","last_active":"2024-05-09T09:50:40.154489+0000","last_peered":"2024-05-09T09:50:40.154489+0000","last_clean":"2024-05-09T09:50:40.154489+0000","last_became_active":"2024-05-09T09:47:18.201443+0000","last_became_peered":"2024-05-09T09:47:18.201443+0000","last_unstale":"2024-05-09T09:50:40.154489+0000","last_undegraded":"2024-05-09T09:50:40.154489+0000","last_fullsized":"2024-05-09T09:50:40.154489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:00:18.197658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.164719+0000","last_change":"2024-05-09T09:47:20.226073+0000","last_active":"2024-05-09T09:47:52.164719+0000","last_peered":"2024-05-09T09:47:52.164719+0000","last_clean":"2024-05-09T09:47:52.164719+0000","last_became_active":"2024-05-09T09:47:20.225261+0000","last_became_peered":"2024-05-09T09:47:20.225261+0000","last_unstale":"2024-05-09T09:47:52.164719+0000","last_undegraded":"2024-05-09T09:47:52.164719+0000","last_fullsized":"2024-05-09T09:47:52.164719+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:47.024306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.185689+0000","last_change":"2024-05-09T09:47:22.253748+0000","last_active":"2024-05-09T09:47:52.185689+0000","last_peered":"2024-05-09T09:47:52.185689+0000","last_clean":"2024-05-09T09:47:52.185689+0000","last_became_active":"2024-05-09T09:47:22.252940+0000","last_became_peered":"2024-05-09T09:47:22.252940+0000","last_unstale":"2024-05-09T09:47:52.185689+0000","last_undegraded":"2024-05-09T09:47:52.185689+0000","last_fullsized":"2024-05-09T09:47:52.185689+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:28:23.186925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.304067+0000","last_change":"2024-05-09T09:47:14.183909+0000","last_active":"2024-05-09T09:50:33.304067+0000","last_peered":"2024-05-09T09:50:33.304067+0000","last_clean":"2024-05-09T09:50:33.304067+0000","last_became_active":"2024-05-09T09:47:14.183622+0000","last_became_peered":"2024-05-09T09:47:14.183622+0000","last_unstale":"2024-05-09T09:50:33.304067+0000","last_undegraded":"2024-05-09T09:50:33.304067+0000","last_fullsized":"2024-05-09T09:50:33.304067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:36:53.103953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.178343+0000","last_change":"2024-05-09T09:47:12.196263+0000","last_active":"2024-05-09T09:47:52.178343+0000","last_peered":"2024-05-09T09:47:52.178343+0000","last_clean":"2024-05-09T09:47:52.178343+0000","last_became_active":"2024-05-09T09:47:12.195857+0000","last_became_peered":"2024-05-09T09:47:12.195857+0000","last_unstale":"2024-05-09T09:47:52.178343+0000","last_undegraded":"2024-05-09T09:47:52.178343+0000","last_fullsized":"2024-05-09T09:47:52.178343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:55.107119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.173473+0000","last_change":"2024-05-09T09:47:16.199413+0000","last_active":"2024-05-09T09:47:52.173473+0000","last_peered":"2024-05-09T09:47:52.173473+0000","last_clean":"2024-05-09T09:47:52.173473+0000","last_became_active":"2024-05-09T09:47:16.198551+0000","last_became_peered":"2024-05-09T09:47:16.198551+0000","last_unstale":"2024-05-09T09:47:52.173473+0000","last_undegraded":"2024-05-09T09:47:52.173473+0000","last_fullsized":"2024-05-09T09:47:52.173473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:42.999644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'107","reported_seq":153,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.133194+0000","last_change":"2024-05-09T09:47:18.217890+0000","last_active":"2024-05-09T09:50:40.133194+0000","last_peered":"2024-05-09T09:50:40.133194+0000","last_clean":"2024-05-09T09:50:40.133194+0000","last_became_active":"2024-05-09T09:47:18.217163+0000","last_became_peered":"2024-05-09T09:47:18.217163+0000","last_unstale":"2024-05-09T09:50:40.133194+0000","last_undegraded":"2024-05-09T09:50:40.133194+0000","last_fullsized":"2024-05-09T09:50:40.133194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:13:11.800319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.170698+0000","last_change":"2024-05-09T09:47:20.239189+0000","last_active":"2024-05-09T09:47:52.170698+0000","last_peered":"2024-05-09T09:47:52.170698+0000","last_clean":"2024-05-09T09:47:52.170698+0000","last_became_active":"2024-05-09T09:47:20.238369+0000","last_became_peered":"2024-05-09T09:47:20.238369+0000","last_unstale":"2024-05-09T09:47:52.170698+0000","last_undegraded":"2024-05-09T09:47:52.170698+0000","last_fullsized":"2024-05-09T09:47:52.170698+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:00:20.209785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'9","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.170964+0000","last_change":"2024-05-09T09:47:14.188262+0000","last_active":"2024-05-09T09:50:33.170964+0000","last_peered":"2024-05-09T09:50:33.170964+0000","last_clean":"2024-05-09T09:50:33.170964+0000","last_became_active":"2024-05-09T09:47:14.187868+0000","last_became_peered":"2024-05-09T09:47:14.187868+0000","last_unstale":"2024-05-09T09:50:33.170964+0000","last_undegraded":"2024-05-09T09:50:33.170964+0000","last_fullsized":"2024-05-09T09:50:33.170964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:00:14.171935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.169058+0000","last_change":"2024-05-09T09:47:12.208626+0000","last_active":"2024-05-09T09:47:52.169058+0000","last_peered":"2024-05-09T09:47:52.169058+0000","last_clean":"2024-05-09T09:47:52.169058+0000","last_became_active":"2024-05-09T09:47:12.208209+0000","last_became_peered":"2024-05-09T09:47:12.208209+0000","last_unstale":"2024-05-09T09:47:52.169058+0000","last_undegraded":"2024-05-09T09:47:52.169058+0000","last_fullsized":"2024-05-09T09:47:52.169058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:02:05.524130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.426897+0000","last_change":"2024-05-09T09:47:16.183573+0000","last_active":"2024-05-09T09:47:52.426897+0000","last_peered":"2024-05-09T09:47:52.426897+0000","last_clean":"2024-05-09T09:47:52.426897+0000","last_became_active":"2024-05-09T09:47:16.182766+0000","last_became_peered":"2024-05-09T09:47:16.182766+0000","last_unstale":"2024-05-09T09:47:52.426897+0000","last_undegraded":"2024-05-09T09:47:52.426897+0000","last_fullsized":"2024-05-09T09:47:52.426897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:03:52.038829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'208","reported_seq":272,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.125642+0000","last_change":"2024-05-09T09:47:18.225686+0000","last_active":"2024-05-09T09:50:40.125642+0000","last_peered":"2024-05-09T09:50:40.125642+0000","last_clean":"2024-05-09T09:50:40.125642+0000","last_became_active":"2024-05-09T09:47:18.225074+0000","last_became_peered":"2024-05-09T09:47:18.225074+0000","last_unstale":"2024-05-09T09:50:40.125642+0000","last_undegraded":"2024-05-09T09:50:40.125642+0000","last_fullsized":"2024-05-09T09:50:40.125642+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:25.412871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.178320+0000","last_change":"2024-05-09T09:47:20.242032+0000","last_active":"2024-05-09T09:47:52.178320+0000","last_peered":"2024-05-09T09:47:52.178320+0000","last_clean":"2024-05-09T09:47:52.178320+0000","last_became_active":"2024-05-09T09:47:20.241372+0000","last_became_peered":"2024-05-09T09:47:20.241372+0000","last_unstale":"2024-05-09T09:47:52.178320+0000","last_undegraded":"2024-05-09T09:47:52.178320+0000","last_fullsized":"2024-05-09T09:47:52.178320+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:27.424998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.026339+0000","last_change":"2024-05-09T09:47:22.260464+0000","last_active":"2024-05-09T09:49:32.026339+0000","last_peered":"2024-05-09T09:49:32.026339+0000","last_clean":"2024-05-09T09:49:32.026339+0000","last_became_active":"2024-05-09T09:47:22.259589+0000","last_became_peered":"2024-05-09T09:47:22.259589+0000","last_unstale":"2024-05-09T09:49:32.026339+0000","last_undegraded":"2024-05-09T09:49:32.026339+0000","last_fullsized":"2024-05-09T09:49:32.026339+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:06:02.910819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:26.976242+0000","last_change":"2024-05-09T09:47:14.176405+0000","last_active":"2024-05-09T09:49:26.976242+0000","last_peered":"2024-05-09T09:49:26.976242+0000","last_clean":"2024-05-09T09:49:26.976242+0000","last_became_active":"2024-05-09T09:47:14.174371+0000","last_became_peered":"2024-05-09T09:47:14.174371+0000","last_unstale":"2024-05-09T09:49:26.976242+0000","last_undegraded":"2024-05-09T09:49:26.976242+0000","last_fullsized":"2024-05-09T09:49:26.976242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:34:58.223894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.163547+0000","last_change":"2024-05-09T09:47:12.198158+0000","last_active":"2024-05-09T09:47:52.163547+0000","last_peered":"2024-05-09T09:47:52.163547+0000","last_clean":"2024-05-09T09:47:52.163547+0000","last_became_active":"2024-05-09T09:47:12.196881+0000","last_became_peered":"2024-05-09T09:47:12.196881+0000","last_unstale":"2024-05-09T09:47:52.163547+0000","last_undegraded":"2024-05-09T09:47:52.163547+0000","last_fullsized":"2024-05-09T09:47:52.163547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:22:46.247782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.187470+0000","last_change":"2024-05-09T09:47:16.189376+0000","last_active":"2024-05-09T09:47:52.187470+0000","last_peered":"2024-05-09T09:47:52.187470+0000","last_clean":"2024-05-09T09:47:52.187470+0000","last_became_active":"2024-05-09T09:47:16.188611+0000","last_became_peered":"2024-05-09T09:47:16.188611+0000","last_unstale":"2024-05-09T09:47:52.187470+0000","last_undegraded":"2024-05-09T09:47:52.187470+0000","last_fullsized":"2024-05-09T09:47:52.187470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:10:07.313658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'113","reported_seq":162,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.139962+0000","last_change":"2024-05-09T09:47:18.233602+0000","last_active":"2024-05-09T09:50:40.139962+0000","last_peered":"2024-05-09T09:50:40.139962+0000","last_clean":"2024-05-09T09:50:40.139962+0000","last_became_active":"2024-05-09T09:47:18.232435+0000","last_became_peered":"2024-05-09T09:47:18.232435+0000","last_unstale":"2024-05-09T09:50:40.139962+0000","last_undegraded":"2024-05-09T09:50:40.139962+0000","last_fullsized":"2024-05-09T09:50:40.139962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:33:57.604224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.171851+0000","last_change":"2024-05-09T09:47:20.243779+0000","last_active":"2024-05-09T09:47:52.171851+0000","last_peered":"2024-05-09T09:47:52.171851+0000","last_clean":"2024-05-09T09:47:52.171851+0000","last_became_active":"2024-05-09T09:47:20.241935+0000","last_became_peered":"2024-05-09T09:47:20.241935+0000","last_unstale":"2024-05-09T09:47:52.171851+0000","last_undegraded":"2024-05-09T09:47:52.171851+0000","last_fullsized":"2024-05-09T09:47:52.171851+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:36.440080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.172300+0000","last_change":"2024-05-09T09:47:22.241900+0000","last_active":"2024-05-09T09:47:52.172300+0000","last_peered":"2024-05-09T09:47:52.172300+0000","last_clean":"2024-05-09T09:47:52.172300+0000","last_became_active":"2024-05-09T09:47:22.241067+0000","last_became_peered":"2024-05-09T09:47:22.241067+0000","last_unstale":"2024-05-09T09:47:52.172300+0000","last_undegraded":"2024-05-09T09:47:52.172300+0000","last_fullsized":"2024-05-09T09:47:52.172300+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:40:12.648847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.946574+0000","last_change":"2024-05-09T09:47:14.192314+0000","last_active":"2024-05-09T09:50:32.946574+0000","last_peered":"2024-05-09T09:50:32.946574+0000","last_clean":"2024-05-09T09:50:32.946574+0000","last_became_active":"2024-05-09T09:47:14.191459+0000","last_became_peered":"2024-05-09T09:47:14.191459+0000","last_unstale":"2024-05-09T09:50:32.946574+0000","last_undegraded":"2024-05-09T09:50:32.946574+0000","last_fullsized":"2024-05-09T09:50:32.946574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:36:19.920255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.631809+0000","last_change":"2024-05-09T09:47:12.193005+0000","last_active":"2024-05-09T09:50:32.631809+0000","last_peered":"2024-05-09T09:50:32.631809+0000","last_clean":"2024-05-09T09:50:32.631809+0000","last_became_active":"2024-05-09T09:47:12.191204+0000","last_became_peered":"2024-05-09T09:47:12.191204+0000","last_unstale":"2024-05-09T09:50:32.631809+0000","last_undegraded":"2024-05-09T09:50:32.631809+0000","last_fullsized":"2024-05-09T09:50:32.631809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:15:07.437414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.181698+0000","last_change":"2024-05-09T09:47:16.195416+0000","last_active":"2024-05-09T09:47:52.181698+0000","last_peered":"2024-05-09T09:47:52.181698+0000","last_clean":"2024-05-09T09:47:52.181698+0000","last_became_active":"2024-05-09T09:47:16.194314+0000","last_became_peered":"2024-05-09T09:47:16.194314+0000","last_unstale":"2024-05-09T09:47:52.181698+0000","last_undegraded":"2024-05-09T09:47:52.181698+0000","last_fullsized":"2024-05-09T09:47:52.181698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:44:05.776640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'109","reported_seq":156,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.019421+0000","last_change":"2024-05-09T09:47:18.209870+0000","last_active":"2024-05-09T09:50:40.019421+0000","last_peered":"2024-05-09T09:50:40.019421+0000","last_clean":"2024-05-09T09:50:40.019421+0000","last_became_active":"2024-05-09T09:47:18.209099+0000","last_became_peered":"2024-05-09T09:47:18.209099+0000","last_unstale":"2024-05-09T09:50:40.019421+0000","last_undegraded":"2024-05-09T09:50:40.019421+0000","last_fullsized":"2024-05-09T09:50:40.019421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:27:07.800202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.423415+0000","last_change":"2024-05-09T09:47:20.242600+0000","last_active":"2024-05-09T09:47:52.423415+0000","last_peered":"2024-05-09T09:47:52.423415+0000","last_clean":"2024-05-09T09:47:52.423415+0000","last_became_active":"2024-05-09T09:47:20.241900+0000","last_became_peered":"2024-05-09T09:47:20.241900+0000","last_unstale":"2024-05-09T09:47:52.423415+0000","last_undegraded":"2024-05-09T09:47:52.423415+0000","last_fullsized":"2024-05-09T09:47:52.423415+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:13:32.134753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'5","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.173022+0000","last_change":"2024-05-09T09:47:22.264988+0000","last_active":"2024-05-09T09:49:32.173022+0000","last_peered":"2024-05-09T09:49:32.173022+0000","last_clean":"2024-05-09T09:49:32.173022+0000","last_became_active":"2024-05-09T09:47:22.263730+0000","last_became_peered":"2024-05-09T09:47:22.263730+0000","last_unstale":"2024-05-09T09:49:32.173022+0000","last_undegraded":"2024-05-09T09:49:32.173022+0000","last_fullsized":"2024-05-09T09:49:32.173022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:30:54.092435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.184984+0000","last_change":"2024-05-09T09:47:14.191093+0000","last_active":"2024-05-09T09:49:32.184984+0000","last_peered":"2024-05-09T09:49:32.184984+0000","last_clean":"2024-05-09T09:49:32.184984+0000","last_became_active":"2024-05-09T09:47:14.189561+0000","last_became_peered":"2024-05-09T09:47:14.189561+0000","last_unstale":"2024-05-09T09:49:32.184984+0000","last_undegraded":"2024-05-09T09:49:32.184984+0000","last_fullsized":"2024-05-09T09:49:32.184984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:20:55.312241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.185025+0000","last_change":"2024-05-09T09:47:12.215264+0000","last_active":"2024-05-09T09:47:52.185025+0000","last_peered":"2024-05-09T09:47:52.185025+0000","last_clean":"2024-05-09T09:47:52.185025+0000","last_became_active":"2024-05-09T09:47:12.214816+0000","last_became_peered":"2024-05-09T09:47:12.214816+0000","last_unstale":"2024-05-09T09:47:52.185025+0000","last_undegraded":"2024-05-09T09:47:52.185025+0000","last_fullsized":"2024-05-09T09:47:52.185025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:57:22.903663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.172570+0000","last_change":"2024-05-09T09:47:16.211405+0000","last_active":"2024-05-09T09:47:52.172570+0000","last_peered":"2024-05-09T09:47:52.172570+0000","last_clean":"2024-05-09T09:47:52.172570+0000","last_became_active":"2024-05-09T09:47:16.210567+0000","last_became_peered":"2024-05-09T09:47:16.210567+0000","last_unstale":"2024-05-09T09:47:52.172570+0000","last_undegraded":"2024-05-09T09:47:52.172570+0000","last_fullsized":"2024-05-09T09:47:52.172570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:51:59.224530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.195660+0000","last_change":"2024-05-09T09:47:18.235102+0000","last_active":"2024-05-09T09:47:52.195660+0000","last_peered":"2024-05-09T09:47:52.195660+0000","last_clean":"2024-05-09T09:47:52.195660+0000","last_became_active":"2024-05-09T09:47:18.234113+0000","last_became_peered":"2024-05-09T09:47:18.234113+0000","last_unstale":"2024-05-09T09:47:52.195660+0000","last_undegraded":"2024-05-09T09:47:52.195660+0000","last_fullsized":"2024-05-09T09:47:52.195660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:53:15.072698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'284","reported_seq":370,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.886838+0000","last_change":"2024-05-09T09:47:20.255098+0000","last_active":"2024-05-09T09:50:39.886838+0000","last_peered":"2024-05-09T09:50:39.886838+0000","last_clean":"2024-05-09T09:50:39.886838+0000","last_became_active":"2024-05-09T09:47:20.254573+0000","last_became_peered":"2024-05-09T09:47:20.254573+0000","last_unstale":"2024-05-09T09:50:39.886838+0000","last_undegraded":"2024-05-09T09:50:39.886838+0000","last_fullsized":"2024-05-09T09:50:39.886838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:12.864272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.242341+0000","last_change":"2024-05-09T09:47:22.244085+0000","last_active":"2024-05-09T09:50:33.242341+0000","last_peered":"2024-05-09T09:50:33.242341+0000","last_clean":"2024-05-09T09:50:33.242341+0000","last_became_active":"2024-05-09T09:47:22.243234+0000","last_became_peered":"2024-05-09T09:47:22.243234+0000","last_unstale":"2024-05-09T09:50:33.242341+0000","last_undegraded":"2024-05-09T09:50:33.242341+0000","last_fullsized":"2024-05-09T09:50:33.242341+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:49:43.534043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.176046+0000","last_change":"2024-05-09T09:47:14.188552+0000","last_active":"2024-05-09T09:49:45.176046+0000","last_peered":"2024-05-09T09:49:45.176046+0000","last_clean":"2024-05-09T09:49:45.176046+0000","last_became_active":"2024-05-09T09:47:14.188222+0000","last_became_peered":"2024-05-09T09:47:14.188222+0000","last_unstale":"2024-05-09T09:49:45.176046+0000","last_undegraded":"2024-05-09T09:49:45.176046+0000","last_fullsized":"2024-05-09T09:49:45.176046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:08:36.171869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.658006+0000","last_change":"2024-05-09T09:47:12.196894+0000","last_active":"2024-05-09T09:50:32.658006+0000","last_peered":"2024-05-09T09:50:32.658006+0000","last_clean":"2024-05-09T09:50:32.658006+0000","last_became_active":"2024-05-09T09:47:12.195936+0000","last_became_peered":"2024-05-09T09:47:12.195936+0000","last_unstale":"2024-05-09T09:50:32.658006+0000","last_undegraded":"2024-05-09T09:50:32.658006+0000","last_fullsized":"2024-05-09T09:50:32.658006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:32:46.107016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.165234+0000","last_change":"2024-05-09T09:47:16.211838+0000","last_active":"2024-05-09T09:47:52.165234+0000","last_peered":"2024-05-09T09:47:52.165234+0000","last_clean":"2024-05-09T09:47:52.165234+0000","last_became_active":"2024-05-09T09:47:16.210901+0000","last_became_peered":"2024-05-09T09:47:16.210901+0000","last_unstale":"2024-05-09T09:47:52.165234+0000","last_undegraded":"2024-05-09T09:47:52.165234+0000","last_fullsized":"2024-05-09T09:47:52.165234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:36:55.117142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'114","reported_seq":163,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.058295+0000","last_change":"2024-05-09T09:47:18.202901+0000","last_active":"2024-05-09T09:50:40.058295+0000","last_peered":"2024-05-09T09:50:40.058295+0000","last_clean":"2024-05-09T09:50:40.058295+0000","last_became_active":"2024-05-09T09:47:18.202069+0000","last_became_peered":"2024-05-09T09:47:18.202069+0000","last_unstale":"2024-05-09T09:50:40.058295+0000","last_undegraded":"2024-05-09T09:50:40.058295+0000","last_fullsized":"2024-05-09T09:50:40.058295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:10.852145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.414336+0000","last_change":"2024-05-09T09:47:20.251107+0000","last_active":"2024-05-09T09:47:52.414336+0000","last_peered":"2024-05-09T09:47:52.414336+0000","last_clean":"2024-05-09T09:47:52.414336+0000","last_became_active":"2024-05-09T09:47:20.250194+0000","last_became_peered":"2024-05-09T09:47:20.250194+0000","last_unstale":"2024-05-09T09:47:52.414336+0000","last_undegraded":"2024-05-09T09:47:52.414336+0000","last_fullsized":"2024-05-09T09:47:52.414336+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:20:47.024306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.214257+0000","last_change":"2024-05-09T09:47:22.240288+0000","last_active":"2024-05-09T09:50:33.214257+0000","last_peered":"2024-05-09T09:50:33.214257+0000","last_clean":"2024-05-09T09:50:33.214257+0000","last_became_active":"2024-05-09T09:47:22.239300+0000","last_became_peered":"2024-05-09T09:47:22.239300+0000","last_unstale":"2024-05-09T09:50:33.214257+0000","last_undegraded":"2024-05-09T09:50:33.214257+0000","last_fullsized":"2024-05-09T09:50:33.214257+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:29:01.635074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'10","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.801428+0000","last_change":"2024-05-09T09:47:14.188510+0000","last_active":"2024-05-09T09:50:32.801428+0000","last_peered":"2024-05-09T09:50:32.801428+0000","last_clean":"2024-05-09T09:50:32.801428+0000","last_became_active":"2024-05-09T09:47:14.187951+0000","last_became_peered":"2024-05-09T09:47:14.187951+0000","last_unstale":"2024-05-09T09:50:32.801428+0000","last_undegraded":"2024-05-09T09:50:32.801428+0000","last_fullsized":"2024-05-09T09:50:32.801428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:08:19.732944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.192638+0000","last_change":"2024-05-09T09:47:12.208585+0000","last_active":"2024-05-09T09:47:52.192638+0000","last_peered":"2024-05-09T09:47:52.192638+0000","last_clean":"2024-05-09T09:47:52.192638+0000","last_became_active":"2024-05-09T09:47:12.203827+0000","last_became_peered":"2024-05-09T09:47:12.203827+0000","last_unstale":"2024-05-09T09:47:52.192638+0000","last_undegraded":"2024-05-09T09:47:52.192638+0000","last_fullsized":"2024-05-09T09:47:52.192638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:13.077999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.181294+0000","last_change":"2024-05-09T09:47:16.197042+0000","last_active":"2024-05-09T09:47:52.181294+0000","last_peered":"2024-05-09T09:47:52.181294+0000","last_clean":"2024-05-09T09:47:52.181294+0000","last_became_active":"2024-05-09T09:47:16.196193+0000","last_became_peered":"2024-05-09T09:47:16.196193+0000","last_unstale":"2024-05-09T09:47:52.181294+0000","last_undegraded":"2024-05-09T09:47:52.181294+0000","last_fullsized":"2024-05-09T09:47:52.181294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:29:55.560893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'110","reported_seq":156,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.066309+0000","last_change":"2024-05-09T09:47:18.200484+0000","last_active":"2024-05-09T09:50:40.066309+0000","last_peered":"2024-05-09T09:50:40.066309+0000","last_clean":"2024-05-09T09:50:40.066309+0000","last_became_active":"2024-05-09T09:47:18.199627+0000","last_became_peered":"2024-05-09T09:47:18.199627+0000","last_unstale":"2024-05-09T09:50:40.066309+0000","last_undegraded":"2024-05-09T09:50:40.066309+0000","last_fullsized":"2024-05-09T09:50:40.066309+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:13:28.480078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.172680+0000","last_change":"2024-05-09T09:47:20.252618+0000","last_active":"2024-05-09T09:47:52.172680+0000","last_peered":"2024-05-09T09:47:52.172680+0000","last_clean":"2024-05-09T09:47:52.172680+0000","last_became_active":"2024-05-09T09:47:20.251642+0000","last_became_peered":"2024-05-09T09:47:20.251642+0000","last_unstale":"2024-05-09T09:47:52.172680+0000","last_undegraded":"2024-05-09T09:47:52.172680+0000","last_fullsized":"2024-05-09T09:47:52.172680+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:02:59.842523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.196751+0000","last_change":"2024-05-09T09:47:22.261644+0000","last_active":"2024-05-09T09:47:52.196751+0000","last_peered":"2024-05-09T09:47:52.196751+0000","last_clean":"2024-05-09T09:47:52.196751+0000","last_became_active":"2024-05-09T09:47:22.261164+0000","last_became_peered":"2024-05-09T09:47:22.261164+0000","last_unstale":"2024-05-09T09:47:52.196751+0000","last_undegraded":"2024-05-09T09:47:52.196751+0000","last_fullsized":"2024-05-09T09:47:52.196751+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:08:50.446437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'8","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.150516+0000","last_change":"2024-05-09T09:47:14.185649+0000","last_active":"2024-05-09T09:50:33.150516+0000","last_peered":"2024-05-09T09:50:33.150516+0000","last_clean":"2024-05-09T09:50:33.150516+0000","last_became_active":"2024-05-09T09:47:14.185270+0000","last_became_peered":"2024-05-09T09:47:14.185270+0000","last_unstale":"2024-05-09T09:50:33.150516+0000","last_undegraded":"2024-05-09T09:50:33.150516+0000","last_fullsized":"2024-05-09T09:50:33.150516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:51:57.211341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.420634+0000","last_change":"2024-05-09T09:47:12.185589+0000","last_active":"2024-05-09T09:47:52.420634+0000","last_peered":"2024-05-09T09:47:52.420634+0000","last_clean":"2024-05-09T09:47:52.420634+0000","last_became_active":"2024-05-09T09:47:12.183985+0000","last_became_peered":"2024-05-09T09:47:12.183985+0000","last_unstale":"2024-05-09T09:47:52.420634+0000","last_undegraded":"2024-05-09T09:47:52.420634+0000","last_fullsized":"2024-05-09T09:47:52.420634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:02:04.919917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.163105+0000","last_change":"2024-05-09T09:47:16.210385+0000","last_active":"2024-05-09T09:47:52.163105+0000","last_peered":"2024-05-09T09:47:52.163105+0000","last_clean":"2024-05-09T09:47:52.163105+0000","last_became_active":"2024-05-09T09:47:16.207467+0000","last_became_peered":"2024-05-09T09:47:16.207467+0000","last_unstale":"2024-05-09T09:47:52.163105+0000","last_undegraded":"2024-05-09T09:47:52.163105+0000","last_fullsized":"2024-05-09T09:47:52.163105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:29.369869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'104","reported_seq":148,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.008802+0000","last_change":"2024-05-09T09:47:18.236481+0000","last_active":"2024-05-09T09:50:40.008802+0000","last_peered":"2024-05-09T09:50:40.008802+0000","last_clean":"2024-05-09T09:50:40.008802+0000","last_became_active":"2024-05-09T09:47:18.235557+0000","last_became_peered":"2024-05-09T09:47:18.235557+0000","last_unstale":"2024-05-09T09:50:40.008802+0000","last_undegraded":"2024-05-09T09:50:40.008802+0000","last_fullsized":"2024-05-09T09:50:40.008802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:48:17.305432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.172984+0000","last_change":"2024-05-09T09:47:20.235738+0000","last_active":"2024-05-09T09:47:52.172984+0000","last_peered":"2024-05-09T09:47:52.172984+0000","last_clean":"2024-05-09T09:47:52.172984+0000","last_became_active":"2024-05-09T09:47:20.231750+0000","last_became_peered":"2024-05-09T09:47:20.231750+0000","last_unstale":"2024-05-09T09:47:52.172984+0000","last_undegraded":"2024-05-09T09:47:52.172984+0000","last_fullsized":"2024-05-09T09:47:52.172984+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:45:32.951562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'8","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:29.505808+0000","last_change":"2024-05-09T09:47:22.256916+0000","last_active":"2024-05-09T09:49:29.505808+0000","last_peered":"2024-05-09T09:49:29.505808+0000","last_clean":"2024-05-09T09:49:29.505808+0000","last_became_active":"2024-05-09T09:47:22.256398+0000","last_became_peered":"2024-05-09T09:47:22.256398+0000","last_unstale":"2024-05-09T09:49:29.505808+0000","last_undegraded":"2024-05-09T09:49:29.505808+0000","last_fullsized":"2024-05-09T09:49:29.505808+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:05:30.419464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'22","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.944688+0000","last_change":"2024-05-09T09:47:14.189375+0000","last_active":"2024-05-09T09:50:32.944688+0000","last_peered":"2024-05-09T09:50:32.944688+0000","last_clean":"2024-05-09T09:50:32.944688+0000","last_became_active":"2024-05-09T09:47:14.188980+0000","last_became_peered":"2024-05-09T09:47:14.188980+0000","last_unstale":"2024-05-09T09:50:32.944688+0000","last_undegraded":"2024-05-09T09:50:32.944688+0000","last_fullsized":"2024-05-09T09:50:32.944688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:57:24.923188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:59.961336+0000","last_change":"2024-05-09T09:47:12.213326+0000","last_active":"2024-05-09T09:47:59.961336+0000","last_peered":"2024-05-09T09:47:59.961336+0000","last_clean":"2024-05-09T09:47:59.961336+0000","last_became_active":"2024-05-09T09:47:12.206136+0000","last_became_peered":"2024-05-09T09:47:12.206136+0000","last_unstale":"2024-05-09T09:47:59.961336+0000","last_undegraded":"2024-05-09T09:47:59.961336+0000","last_fullsized":"2024-05-09T09:47:59.961336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:01:14.038658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:27.582188+0000","last_change":"2024-05-09T09:47:16.211554+0000","last_active":"2024-05-09T09:49:27.582188+0000","last_peered":"2024-05-09T09:49:27.582188+0000","last_clean":"2024-05-09T09:49:27.582188+0000","last_became_active":"2024-05-09T09:47:16.210958+0000","last_became_peered":"2024-05-09T09:47:16.210958+0000","last_unstale":"2024-05-09T09:49:27.582188+0000","last_undegraded":"2024-05-09T09:49:27.582188+0000","last_fullsized":"2024-05-09T09:49:27.582188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:03:52.038829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'110","reported_seq":158,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.025072+0000","last_change":"2024-05-09T09:47:18.234795+0000","last_active":"2024-05-09T09:50:40.025072+0000","last_peered":"2024-05-09T09:50:40.025072+0000","last_clean":"2024-05-09T09:50:40.025072+0000","last_became_active":"2024-05-09T09:47:18.233552+0000","last_became_peered":"2024-05-09T09:47:18.233552+0000","last_unstale":"2024-05-09T09:50:40.025072+0000","last_undegraded":"2024-05-09T09:50:40.025072+0000","last_fullsized":"2024-05-09T09:50:40.025072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:22.991357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.426101+0000","last_change":"2024-05-09T09:47:20.254870+0000","last_active":"2024-05-09T09:47:52.426101+0000","last_peered":"2024-05-09T09:47:52.426101+0000","last_clean":"2024-05-09T09:47:52.426101+0000","last_became_active":"2024-05-09T09:47:20.254083+0000","last_became_peered":"2024-05-09T09:47:20.254083+0000","last_unstale":"2024-05-09T09:47:52.426101+0000","last_undegraded":"2024-05-09T09:47:52.426101+0000","last_fullsized":"2024-05-09T09:47:52.426101+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:51:10.268994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:29.509881+0000","last_change":"2024-05-09T09:47:22.255091+0000","last_active":"2024-05-09T09:49:29.509881+0000","last_peered":"2024-05-09T09:49:29.509881+0000","last_clean":"2024-05-09T09:49:29.509881+0000","last_became_active":"2024-05-09T09:47:22.254386+0000","last_became_peered":"2024-05-09T09:47:22.254386+0000","last_unstale":"2024-05-09T09:49:29.509881+0000","last_undegraded":"2024-05-09T09:49:29.509881+0000","last_fullsized":"2024-05-09T09:49:29.509881+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:55:00.879568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'13","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.322669+0000","last_change":"2024-05-09T09:47:14.178682+0000","last_active":"2024-05-09T09:50:33.322669+0000","last_peered":"2024-05-09T09:50:33.322669+0000","last_clean":"2024-05-09T09:50:33.322669+0000","last_became_active":"2024-05-09T09:47:14.174998+0000","last_became_peered":"2024-05-09T09:47:14.174998+0000","last_unstale":"2024-05-09T09:50:33.322669+0000","last_undegraded":"2024-05-09T09:50:33.322669+0000","last_fullsized":"2024-05-09T09:50:33.322669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:39.521528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.167783+0000","last_change":"2024-05-09T09:47:12.192847+0000","last_active":"2024-05-09T09:47:52.167783+0000","last_peered":"2024-05-09T09:47:52.167783+0000","last_clean":"2024-05-09T09:47:52.167783+0000","last_became_active":"2024-05-09T09:47:12.192448+0000","last_became_peered":"2024-05-09T09:47:12.192448+0000","last_unstale":"2024-05-09T09:47:52.167783+0000","last_undegraded":"2024-05-09T09:47:52.167783+0000","last_fullsized":"2024-05-09T09:47:52.167783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:43:04.277278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'12","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:45.864525+0000","last_change":"2024-05-09T09:47:14.189285+0000","last_active":"2024-05-09T09:48:45.864525+0000","last_peered":"2024-05-09T09:48:45.864525+0000","last_clean":"2024-05-09T09:48:45.864525+0000","last_became_active":"2024-05-09T09:47:14.188534+0000","last_became_peered":"2024-05-09T09:47:14.188534+0000","last_unstale":"2024-05-09T09:48:45.864525+0000","last_undegraded":"2024-05-09T09:48:45.864525+0000","last_fullsized":"2024-05-09T09:48:45.864525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:15.097524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":54,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.120523+0000","last_change":"2024-05-09T09:47:12.185694+0000","last_active":"2024-05-09T09:50:33.120523+0000","last_peered":"2024-05-09T09:50:33.120523+0000","last_clean":"2024-05-09T09:50:33.120523+0000","last_became_active":"2024-05-09T09:47:12.184353+0000","last_became_peered":"2024-05-09T09:47:12.184353+0000","last_unstale":"2024-05-09T09:50:33.120523+0000","last_undegraded":"2024-05-09T09:50:33.120523+0000","last_fullsized":"2024-05-09T09:50:33.120523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:01:14.038658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'8","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:45.864325+0000","last_change":"2024-05-09T09:47:14.187249+0000","last_active":"2024-05-09T09:48:45.864325+0000","last_peered":"2024-05-09T09:48:45.864325+0000","last_clean":"2024-05-09T09:48:45.864325+0000","last_became_active":"2024-05-09T09:47:14.186689+0000","last_became_peered":"2024-05-09T09:47:14.186689+0000","last_unstale":"2024-05-09T09:48:45.864325+0000","last_undegraded":"2024-05-09T09:48:45.864325+0000","last_fullsized":"2024-05-09T09:48:45.864325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:19:55.054927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.175877+0000","last_change":"2024-05-09T09:47:12.211787+0000","last_active":"2024-05-09T09:47:52.175877+0000","last_peered":"2024-05-09T09:47:52.175877+0000","last_clean":"2024-05-09T09:47:52.175877+0000","last_became_active":"2024-05-09T09:47:12.209633+0000","last_became_peered":"2024-05-09T09:47:12.209633+0000","last_unstale":"2024-05-09T09:47:52.175877+0000","last_undegraded":"2024-05-09T09:47:52.175877+0000","last_fullsized":"2024-05-09T09:47:52.175877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:51:58.314102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.163498+0000","last_change":"2024-05-09T09:47:14.193990+0000","last_active":"2024-05-09T09:49:25.163498+0000","last_peered":"2024-05-09T09:49:25.163498+0000","last_clean":"2024-05-09T09:49:25.163498+0000","last_became_active":"2024-05-09T09:47:14.193366+0000","last_became_peered":"2024-05-09T09:47:14.193366+0000","last_unstale":"2024-05-09T09:49:25.163498+0000","last_undegraded":"2024-05-09T09:49:25.163498+0000","last_fullsized":"2024-05-09T09:49:25.163498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:32:19.275039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.420041+0000","last_change":"2024-05-09T09:47:12.215615+0000","last_active":"2024-05-09T09:47:52.420041+0000","last_peered":"2024-05-09T09:47:52.420041+0000","last_clean":"2024-05-09T09:47:52.420041+0000","last_became_active":"2024-05-09T09:47:12.214019+0000","last_became_peered":"2024-05-09T09:47:12.214019+0000","last_unstale":"2024-05-09T09:47:52.420041+0000","last_undegraded":"2024-05-09T09:47:52.420041+0000","last_fullsized":"2024-05-09T09:47:52.420041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:15.767283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.944003+0000","last_change":"2024-05-09T09:47:14.182706+0000","last_active":"2024-05-09T09:50:32.944003+0000","last_peered":"2024-05-09T09:50:32.944003+0000","last_clean":"2024-05-09T09:50:32.944003+0000","last_became_active":"2024-05-09T09:47:14.181824+0000","last_became_peered":"2024-05-09T09:47:14.181824+0000","last_unstale":"2024-05-09T09:50:32.944003+0000","last_undegraded":"2024-05-09T09:50:32.944003+0000","last_fullsized":"2024-05-09T09:50:32.944003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:04:29.322102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.419332+0000","last_change":"2024-05-09T09:47:12.205854+0000","last_active":"2024-05-09T09:47:52.419332+0000","last_peered":"2024-05-09T09:47:52.419332+0000","last_clean":"2024-05-09T09:47:52.419332+0000","last_became_active":"2024-05-09T09:47:12.204322+0000","last_became_peered":"2024-05-09T09:47:12.204322+0000","last_unstale":"2024-05-09T09:47:52.419332+0000","last_undegraded":"2024-05-09T09:47:52.419332+0000","last_fullsized":"2024-05-09T09:47:52.419332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:19:17.059104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.150305+0000","last_change":"2024-05-09T09:47:14.178745+0000","last_active":"2024-05-09T09:50:33.150305+0000","last_peered":"2024-05-09T09:50:33.150305+0000","last_clean":"2024-05-09T09:50:33.150305+0000","last_became_active":"2024-05-09T09:47:14.178503+0000","last_became_peered":"2024-05-09T09:47:14.178503+0000","last_unstale":"2024-05-09T09:50:33.150305+0000","last_undegraded":"2024-05-09T09:50:33.150305+0000","last_fullsized":"2024-05-09T09:50:33.150305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:20:55.312241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"30'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.173367+0000","last_change":"2024-05-09T09:47:12.196461+0000","last_active":"2024-05-09T09:47:52.173367+0000","last_peered":"2024-05-09T09:47:52.173367+0000","last_clean":"2024-05-09T09:47:52.173367+0000","last_became_active":"2024-05-09T09:47:12.196120+0000","last_became_peered":"2024-05-09T09:47:12.196120+0000","last_unstale":"2024-05-09T09:47:52.173367+0000","last_undegraded":"2024-05-09T09:47:52.173367+0000","last_fullsized":"2024-05-09T09:47:52.173367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:06.949531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'5","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.162202+0000","last_change":"2024-05-09T09:47:14.177343+0000","last_active":"2024-05-09T09:49:20.162202+0000","last_peered":"2024-05-09T09:49:20.162202+0000","last_clean":"2024-05-09T09:49:20.162202+0000","last_became_active":"2024-05-09T09:47:14.176615+0000","last_became_peered":"2024-05-09T09:47:14.176615+0000","last_unstale":"2024-05-09T09:49:20.162202+0000","last_undegraded":"2024-05-09T09:49:20.162202+0000","last_fullsized":"2024-05-09T09:49:20.162202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:35:20.332271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.186449+0000","last_change":"2024-05-09T09:47:12.210169+0000","last_active":"2024-05-09T09:47:52.186449+0000","last_peered":"2024-05-09T09:47:52.186449+0000","last_clean":"2024-05-09T09:47:52.186449+0000","last_became_active":"2024-05-09T09:47:12.209171+0000","last_became_peered":"2024-05-09T09:47:12.209171+0000","last_unstale":"2024-05-09T09:47:52.186449+0000","last_undegraded":"2024-05-09T09:47:52.186449+0000","last_fullsized":"2024-05-09T09:47:52.186449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:55.107119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.164956+0000","last_change":"2024-05-09T09:47:14.177426+0000","last_active":"2024-05-09T09:47:52.164956+0000","last_peered":"2024-05-09T09:47:52.164956+0000","last_clean":"2024-05-09T09:47:52.164956+0000","last_became_active":"2024-05-09T09:47:14.177119+0000","last_became_peered":"2024-05-09T09:47:14.177119+0000","last_unstale":"2024-05-09T09:47:52.164956+0000","last_undegraded":"2024-05-09T09:47:52.164956+0000","last_fullsized":"2024-05-09T09:47:52.164956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:41:29.222588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.417060+0000","last_change":"2024-05-09T09:47:12.185203+0000","last_active":"2024-05-09T09:47:52.417060+0000","last_peered":"2024-05-09T09:47:52.417060+0000","last_clean":"2024-05-09T09:47:52.417060+0000","last_became_active":"2024-05-09T09:47:12.184105+0000","last_became_peered":"2024-05-09T09:47:12.184105+0000","last_unstale":"2024-05-09T09:47:52.417060+0000","last_undegraded":"2024-05-09T09:47:52.417060+0000","last_fullsized":"2024-05-09T09:47:52.417060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:18:16.165145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.800585+0000","last_change":"2024-05-09T09:47:14.185348+0000","last_active":"2024-05-09T09:50:32.800585+0000","last_peered":"2024-05-09T09:50:32.800585+0000","last_clean":"2024-05-09T09:50:32.800585+0000","last_became_active":"2024-05-09T09:47:14.182961+0000","last_became_peered":"2024-05-09T09:47:14.182961+0000","last_unstale":"2024-05-09T09:50:32.800585+0000","last_undegraded":"2024-05-09T09:50:32.800585+0000","last_fullsized":"2024-05-09T09:50:32.800585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:14:52.487546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.601065+0000","last_change":"2024-05-09T09:47:12.206940+0000","last_active":"2024-05-09T09:50:32.601065+0000","last_peered":"2024-05-09T09:50:32.601065+0000","last_clean":"2024-05-09T09:50:32.601065+0000","last_became_active":"2024-05-09T09:47:12.201952+0000","last_became_peered":"2024-05-09T09:47:12.201952+0000","last_unstale":"2024-05-09T09:50:32.601065+0000","last_undegraded":"2024-05-09T09:50:32.601065+0000","last_fullsized":"2024-05-09T09:50:32.601065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:06:37.960812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.944562+0000","last_change":"2024-05-09T09:47:14.193794+0000","last_active":"2024-05-09T09:50:32.944562+0000","last_peered":"2024-05-09T09:50:32.944562+0000","last_clean":"2024-05-09T09:50:32.944562+0000","last_became_active":"2024-05-09T09:47:14.193421+0000","last_became_peered":"2024-05-09T09:47:14.193421+0000","last_unstale":"2024-05-09T09:50:32.944562+0000","last_undegraded":"2024-05-09T09:50:32.944562+0000","last_fullsized":"2024-05-09T09:50:32.944562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:49:55.928418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:01.784206+0000","last_change":"2024-05-09T09:47:12.206566+0000","last_active":"2024-05-09T09:48:01.784206+0000","last_peered":"2024-05-09T09:48:01.784206+0000","last_clean":"2024-05-09T09:48:01.784206+0000","last_became_active":"2024-05-09T09:47:12.203523+0000","last_became_peered":"2024-05-09T09:47:12.203523+0000","last_unstale":"2024-05-09T09:48:01.784206+0000","last_undegraded":"2024-05-09T09:48:01.784206+0000","last_fullsized":"2024-05-09T09:48:01.784206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:00:03.229983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.302907+0000","last_change":"2024-05-09T09:47:14.173720+0000","last_active":"2024-05-09T09:50:33.302907+0000","last_peered":"2024-05-09T09:50:33.302907+0000","last_clean":"2024-05-09T09:50:33.302907+0000","last_became_active":"2024-05-09T09:47:14.171565+0000","last_became_peered":"2024-05-09T09:47:14.171565+0000","last_unstale":"2024-05-09T09:50:33.302907+0000","last_undegraded":"2024-05-09T09:50:33.302907+0000","last_fullsized":"2024-05-09T09:50:33.302907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:16:59.077638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.111363+0000","last_change":"2024-05-09T09:47:12.193541+0000","last_active":"2024-05-09T09:49:32.111363+0000","last_peered":"2024-05-09T09:49:32.111363+0000","last_clean":"2024-05-09T09:49:32.111363+0000","last_became_active":"2024-05-09T09:47:12.192462+0000","last_became_peered":"2024-05-09T09:47:12.192462+0000","last_unstale":"2024-05-09T09:49:32.111363+0000","last_undegraded":"2024-05-09T09:49:32.111363+0000","last_fullsized":"2024-05-09T09:49:32.111363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:43:04.277278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.239153+0000","last_change":"2024-05-09T09:47:14.177456+0000","last_active":"2024-05-09T09:50:33.239153+0000","last_peered":"2024-05-09T09:50:33.239153+0000","last_clean":"2024-05-09T09:50:33.239153+0000","last_became_active":"2024-05-09T09:47:14.176986+0000","last_became_peered":"2024-05-09T09:47:14.176986+0000","last_unstale":"2024-05-09T09:50:33.239153+0000","last_undegraded":"2024-05-09T09:50:33.239153+0000","last_fullsized":"2024-05-09T09:50:33.239153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:00:58.585804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.169090+0000","last_change":"2024-05-09T09:47:12.205826+0000","last_active":"2024-05-09T09:47:52.169090+0000","last_peered":"2024-05-09T09:47:52.169090+0000","last_clean":"2024-05-09T09:47:52.169090+0000","last_became_active":"2024-05-09T09:47:12.205416+0000","last_became_peered":"2024-05-09T09:47:12.205416+0000","last_unstale":"2024-05-09T09:47:52.169090+0000","last_undegraded":"2024-05-09T09:47:52.169090+0000","last_fullsized":"2024-05-09T09:47:52.169090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:14:11.726333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:02.666810+0000","last_change":"2024-05-09T09:47:14.182747+0000","last_active":"2024-05-09T09:48:02.666810+0000","last_peered":"2024-05-09T09:48:02.666810+0000","last_clean":"2024-05-09T09:48:02.666810+0000","last_became_active":"2024-05-09T09:47:14.182248+0000","last_became_peered":"2024-05-09T09:47:14.182248+0000","last_unstale":"2024-05-09T09:48:02.666810+0000","last_undegraded":"2024-05-09T09:48:02.666810+0000","last_fullsized":"2024-05-09T09:48:02.666810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:32:19.275039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.689371+0000","last_change":"2024-05-09T09:47:12.208127+0000","last_active":"2024-05-09T09:50:32.689371+0000","last_peered":"2024-05-09T09:50:32.689371+0000","last_clean":"2024-05-09T09:50:32.689371+0000","last_became_active":"2024-05-09T09:47:12.200127+0000","last_became_peered":"2024-05-09T09:47:12.200127+0000","last_unstale":"2024-05-09T09:50:32.689371+0000","last_undegraded":"2024-05-09T09:50:32.689371+0000","last_fullsized":"2024-05-09T09:50:32.689371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:08:17.713419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.304307+0000","last_change":"2024-05-09T09:47:14.190516+0000","last_active":"2024-05-09T09:50:33.304307+0000","last_peered":"2024-05-09T09:50:33.304307+0000","last_clean":"2024-05-09T09:50:33.304307+0000","last_became_active":"2024-05-09T09:47:14.190033+0000","last_became_peered":"2024-05-09T09:47:14.190033+0000","last_unstale":"2024-05-09T09:50:33.304307+0000","last_undegraded":"2024-05-09T09:50:33.304307+0000","last_fullsized":"2024-05-09T09:50:33.304307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:34:58.223894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:48:01.765781+0000","last_change":"2024-05-09T09:47:12.208249+0000","last_active":"2024-05-09T09:48:01.765781+0000","last_peered":"2024-05-09T09:48:01.765781+0000","last_clean":"2024-05-09T09:48:01.765781+0000","last_became_active":"2024-05-09T09:47:12.203424+0000","last_became_peered":"2024-05-09T09:47:12.203424+0000","last_unstale":"2024-05-09T09:48:01.765781+0000","last_undegraded":"2024-05-09T09:48:01.765781+0000","last_fullsized":"2024-05-09T09:48:01.765781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:28:35.100126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'5","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:30.174695+0000","last_change":"2024-05-09T09:47:14.187165+0000","last_active":"2024-05-09T09:49:30.174695+0000","last_peered":"2024-05-09T09:49:30.174695+0000","last_clean":"2024-05-09T09:49:30.174695+0000","last_became_active":"2024-05-09T09:47:14.186711+0000","last_became_peered":"2024-05-09T09:47:14.186711+0000","last_unstale":"2024-05-09T09:49:30.174695+0000","last_undegraded":"2024-05-09T09:49:30.174695+0000","last_fullsized":"2024-05-09T09:49:30.174695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:51:46.975465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.188697+0000","last_change":"2024-05-09T09:47:12.209730+0000","last_active":"2024-05-09T09:47:52.188697+0000","last_peered":"2024-05-09T09:47:52.188697+0000","last_clean":"2024-05-09T09:47:52.188697+0000","last_became_active":"2024-05-09T09:47:12.205320+0000","last_became_peered":"2024-05-09T09:47:12.205320+0000","last_unstale":"2024-05-09T09:47:52.188697+0000","last_undegraded":"2024-05-09T09:47:52.188697+0000","last_fullsized":"2024-05-09T09:47:52.188697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:01:14.038658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.403843+0000","last_change":"2024-05-09T09:47:14.178306+0000","last_active":"2024-05-09T09:50:33.403843+0000","last_peered":"2024-05-09T09:50:33.403843+0000","last_clean":"2024-05-09T09:50:33.403843+0000","last_became_active":"2024-05-09T09:47:14.177955+0000","last_became_peered":"2024-05-09T09:47:14.177955+0000","last_unstale":"2024-05-09T09:50:33.403843+0000","last_undegraded":"2024-05-09T09:50:33.403843+0000","last_fullsized":"2024-05-09T09:50:33.403843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:29:53.547705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:26.957446+0000","last_change":"2024-05-09T09:47:12.202337+0000","last_active":"2024-05-09T09:49:26.957446+0000","last_peered":"2024-05-09T09:49:26.957446+0000","last_clean":"2024-05-09T09:49:26.957446+0000","last_became_active":"2024-05-09T09:47:12.201790+0000","last_became_peered":"2024-05-09T09:47:12.201790+0000","last_unstale":"2024-05-09T09:49:26.957446+0000","last_undegraded":"2024-05-09T09:49:26.957446+0000","last_fullsized":"2024-05-09T09:49:26.957446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:35:18.312747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'6","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.129089+0000","last_change":"2024-05-09T09:47:12.207600+0000","last_active":"2024-05-09T09:50:33.129089+0000","last_peered":"2024-05-09T09:50:33.129089+0000","last_clean":"2024-05-09T09:50:33.129089+0000","last_became_active":"2024-05-09T09:47:12.203435+0000","last_became_peered":"2024-05-09T09:47:12.203435+0000","last_unstale":"2024-05-09T09:50:33.129089+0000","last_undegraded":"2024-05-09T09:50:33.129089+0000","last_fullsized":"2024-05-09T09:50:33.129089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:13:12.664064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'7","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.321483+0000","last_change":"2024-05-09T09:47:14.179261+0000","last_active":"2024-05-09T09:50:33.321483+0000","last_peered":"2024-05-09T09:50:33.321483+0000","last_clean":"2024-05-09T09:50:33.321483+0000","last_became_active":"2024-05-09T09:47:14.178142+0000","last_became_peered":"2024-05-09T09:47:14.178142+0000","last_unstale":"2024-05-09T09:50:33.321483+0000","last_undegraded":"2024-05-09T09:50:33.321483+0000","last_fullsized":"2024-05-09T09:50:33.321483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:34:02.864130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:47:52.412986+0000","last_change":"2024-05-09T09:47:12.207072+0000","last_active":"2024-05-09T09:47:52.412986+0000","last_peered":"2024-05-09T09:47:52.412986+0000","last_clean":"2024-05-09T09:47:52.412986+0000","last_became_active":"2024-05-09T09:47:12.205216+0000","last_became_peered":"2024-05-09T09:47:12.205216+0000","last_unstale":"2024-05-09T09:47:52.412986+0000","last_undegraded":"2024-05-09T09:47:52.412986+0000","last_fullsized":"2024-05-09T09:47:52.412986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:06.949531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'12","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.802415+0000","last_change":"2024-05-09T09:47:14.174424+0000","last_active":"2024-05-09T09:50:32.802415+0000","last_peered":"2024-05-09T09:50:32.802415+0000","last_clean":"2024-05-09T09:50:32.802415+0000","last_became_active":"2024-05-09T09:47:14.174123+0000","last_became_peered":"2024-05-09T09:47:14.174123+0000","last_unstale":"2024-05-09T09:50:32.802415+0000","last_undegraded":"2024-05-09T09:50:32.802415+0000","last_fullsized":"2024-05-09T09:50:32.802415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:10:05.300469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2272,"ondisk_log_size":2272,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3742,"ondisk_log_size":3742,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1628,"num_read_kb":1518,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705711,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40040,"kb_used_data":8864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331800,"statfs":{"total":96636764160,"available":96595763200,"internally_reserved":0,"allocated":9076736,"data_stored":8754022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705713,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36392,"kb_used_data":9376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335448,"statfs":{"total":96636764160,"available":96599498752,"internally_reserved":0,"allocated":9601024,"data_stored":9339828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705711,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36412,"kb_used_data":9396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335428,"statfs":{"total":96636764160,"available":96599478272,"internally_reserved":0,"allocated":9621504,"data_stored":9341034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705712,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40004,"kb_used_data":8828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331836,"statfs":{"total":96636764160,"available":96595800064,"internally_reserved":0,"allocated":9039872,"data_stored":8751284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T09:50:45.024 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.024 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.024 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.025 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.025 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.025 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.025 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.025 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.025 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.025 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.025 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.025 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.025 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.026 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.026 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.026 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.026 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.026 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.026 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.026 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.026 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.026 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.027 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.027 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.027 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.027 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.027 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.027 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.027 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.027 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.027 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.027 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.028 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.028 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.028 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.028 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.028 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.028 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.028 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.028 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.028 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.028 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.029 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.029 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.029 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.029 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.029 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.029 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.029 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.029 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.029 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.029 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.029 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.030 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.030 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.030 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.030 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.030 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.030 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.030 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.030 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.030 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.031 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.031 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.031 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.031 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.031 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.031 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.031 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.031 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.031 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.031 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.032 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.032 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.032 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.032 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.032 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.032 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.032 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.032 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.032 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.032 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.033 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.033 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.033 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.033 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.033 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.033 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.033 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.033 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.033 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.033 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.034 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.034 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.034 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.034 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.034 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.034 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.034 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.034 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.034 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.034 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-09T09:46:56.015260+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.035 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-09T09:47:02.030833+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=2, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.035 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.035 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.035 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.035 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.035 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.035 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.035 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-09T09:47:02.030833+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=2, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.035 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.035 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.036 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.036 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.036 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.036 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.036 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-09T09:47:02.030833+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=2, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.036 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.036 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.036 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.036 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.036 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.037 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.037 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-09T09:47:02.030833+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=2, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.037 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.037 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.037 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.037 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.037 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.037 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.037 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.037 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-09T09:47:02.030833+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=2, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.038 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.038 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.038 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.038 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.038 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.038 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.038 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-09T09:47:02.030833+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=2, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.038 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.038 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.039 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.039 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.039 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.039 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.039 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-09T09:47:02.030833+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=2, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.039 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.039 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.039 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.039 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.039 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.040 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.040 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-09T09:47:02.030833+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=2, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.040 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.040 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.040 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.040 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.040 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.040 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.040 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.041 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.041 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.041 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.041 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.041 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.041 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.041 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.041 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.041 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.042 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.042 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.042 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.042 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.042 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.042 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.042 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.042 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.042 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.042 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.043 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.043 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.043 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.043 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.043 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.043 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.043 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.043 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.043 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.043 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.044 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.044 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.044 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.044 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.044 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.044 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.044 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.044 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.044 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.044 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.045 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.045 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.045 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.045 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.045 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.045 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.045 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.045 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.045 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.045 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.046 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.046 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.046 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.046 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.046 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.046 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.046 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.046 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.046 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.047 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.047 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.047 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.047 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.047 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.047 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.047 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.047 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.047 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.048 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.048 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.048 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.048 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.048 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.048 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.048 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.048 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.048 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.048 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.049 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.049 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.049 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.049 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.049 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.049 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.049 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.049 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.049 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.049 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.050 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.050 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.050 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.050 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.050 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.050 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.050 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.050 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.050 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.051 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.051 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.051 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.051 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.051 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.051 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.051 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.051 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.051 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:50:45.051 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-09T09:51:05.052 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T09:51:05.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.179+0000 7ff9cd8d1640 1 Processor -- start 2024-05-09T09:51:05.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.179+0000 7ff9cd8d1640 1 -- start start 2024-05-09T09:51:05.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.179+0000 7ff9cd8d1640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff9c809e3b0 0x7ff9c812bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:51:05.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.179+0000 7ff9cd8d1640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9c812b820 con 0x7ff9c812c1b0 2024-05-09T09:51:05.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.179+0000 7ff9cd8d1640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7ff9c80a0fc0 con 0x7ff9c809e3b0 2024-05-09T09:51:05.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.179+0000 7ff9c6ffd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff9c809e3b0 0x7ff9c812bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:51:05.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.179+0000 7ff9c67fc640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ff9c812c1b0 0x7ff9c812ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:57304/0 (socket says 172.21.15.110:57304) 2024-05-09T09:51:05.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.179+0000 7ff9c67fc640 1 -- 172.21.15.110:0/1174407494 learned_addr learned my addr 172.21.15.110:0/1174407494 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:51:05.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.179+0000 7ff9c6ffd640 1 -- 172.21.15.110:0/1174407494 >> v1:172.21.15.110:6789/0 conn(0x7ff9c812c1b0 legacy=0x7ff9c812ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:51:05.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.179+0000 7ff9c6ffd640 1 -- 172.21.15.110:0/1174407494 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c809b5f0 con 0x7ff9c809e3b0 2024-05-09T09:51:05.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.179+0000 7ff9c6ffd640 1 --2- 172.21.15.110:0/1174407494 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c809e3b0 0x7ff9c812bc70 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc009740 tx=0x7ff9bc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4238733d074ad128 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:51:05.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.179+0000 7ff9c5ffb640 1 -- 172.21.15.110:0/1174407494 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9bc0b0070 con 0x7ff9c809e3b0 2024-05-09T09:51:05.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.179+0000 7ff9c5ffb640 1 -- 172.21.15.110:0/1174407494 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9bc0ab530 con 0x7ff9c809e3b0 2024-05-09T09:51:05.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.179+0000 7ff9c5ffb640 1 -- 172.21.15.110:0/1174407494 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9bc0ab830 con 0x7ff9c809e3b0 2024-05-09T09:51:05.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.179+0000 7ff9cd8d1640 1 -- 172.21.15.110:0/1174407494 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c809e3b0 msgr2=0x7ff9c812bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:51:05.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.183+0000 7ff9cd8d1640 1 --2- 172.21.15.110:0/1174407494 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c809e3b0 0x7ff9c812bc70 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc009740 tx=0x7ff9bc01c370 comp rx=0 tx=0).stop 2024-05-09T09:51:05.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.183+0000 7ff9cd8d1640 1 -- 172.21.15.110:0/1174407494 shutdown_connections 2024-05-09T09:51:05.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.183+0000 7ff9cd8d1640 1 --2- 172.21.15.110:0/1174407494 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c809e3b0 0x7ff9c812bc70 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:51:05.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.183+0000 7ff9cd8d1640 1 -- 172.21.15.110:0/1174407494 >> 172.21.15.110:0/1174407494 conn(0x7ff9c80a17a0 msgr2=0x7ff9c809dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:51:05.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.183+0000 7ff9cd8d1640 1 -- 172.21.15.110:0/1174407494 shutdown_connections 2024-05-09T09:51:05.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.183+0000 7ff9cd8d1640 1 -- 172.21.15.110:0/1174407494 wait complete. 2024-05-09T09:51:05.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.183+0000 7ff9cd8d1640 1 Processor -- start 2024-05-09T09:51:05.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.183+0000 7ff9cd8d1640 1 -- start start 2024-05-09T09:51:05.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.183+0000 7ff9cd8d1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c809e3b0 0x7ff9c8133310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:51:05.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.183+0000 7ff9cd8d1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c81371e0 con 0x7ff9c809e3b0 2024-05-09T09:51:05.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.183+0000 7ff9c6ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c809e3b0 0x7ff9c8133310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:51:05.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.183+0000 7ff9c6ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c809e3b0 0x7ff9c8133310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50122/0 (socket says 172.21.15.110:50122) 2024-05-09T09:51:05.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.183+0000 7ff9c6ffd640 1 -- 172.21.15.110:0/2344372802 learned_addr learned my addr 172.21.15.110:0/2344372802 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:51:05.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.183+0000 7ff9c6ffd640 1 -- 172.21.15.110:0/2344372802 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c806da80 con 0x7ff9c809e3b0 2024-05-09T09:51:05.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.183+0000 7ff9c6ffd640 1 --2- 172.21.15.110:0/2344372802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c809e3b0 0x7ff9c8133310 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0ae040 tx=0x7ff9bc019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:51:05.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.183+0000 7ff9affff640 1 -- 172.21.15.110:0/2344372802 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9bc0b8020 con 0x7ff9c809e3b0 2024-05-09T09:51:05.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.183+0000 7ff9affff640 1 -- 172.21.15.110:0/2344372802 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9bc0b4410 con 0x7ff9c809e3b0 2024-05-09T09:51:05.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.183+0000 7ff9cd8d1640 1 -- 172.21.15.110:0/2344372802 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9c8134ab0 con 0x7ff9c809e3b0 2024-05-09T09:51:05.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.183+0000 7ff9affff640 1 -- 172.21.15.110:0/2344372802 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9bc0b0040 con 0x7ff9c809e3b0 2024-05-09T09:51:05.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.183+0000 7ff9cd8d1640 1 -- 172.21.15.110:0/2344372802 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9c806e6b0 con 0x7ff9c809e3b0 2024-05-09T09:51:05.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.183+0000 7ff9cd8d1640 1 -- 172.21.15.110:0/2344372802 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9c8063710 con 0x7ff9c809e3b0 2024-05-09T09:51:05.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.183+0000 7ff9affff640 1 -- 172.21.15.110:0/2344372802 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7ff9bc0bb020 con 0x7ff9c809e3b0 2024-05-09T09:51:05.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.183+0000 7ff9affff640 1 --2- 172.21.15.110:0/2344372802 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff9b4036310 0x7ff9b40387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:51:05.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.183+0000 7ff9affff640 1 -- 172.21.15.110:0/2344372802 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7ff9bc0e33f0 con 0x7ff9c809e3b0 2024-05-09T09:51:05.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.183+0000 7ff9c67fc640 1 --2- 172.21.15.110:0/2344372802 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff9b4036310 0x7ff9b40387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:51:05.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.187+0000 7ff9c67fc640 1 --2- 172.21.15.110:0/2344372802 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff9b4036310 0x7ff9b40387d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8001610 tx=0x7ff9b8007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:51:05.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.191+0000 7ff9affff640 1 -- 172.21.15.110:0/2344372802 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff9bc0c2030 con 0x7ff9c809e3b0 2024-05-09T09:51:05.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.343+0000 7ff9cd8d1640 1 -- 172.21.15.110:0/2344372802 --> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff9c806d610 con 0x7ff9b4036310 2024-05-09T09:51:05.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.387+0000 7ff9affff640 1 -- 172.21.15.110:0/2344372802 <== mgr.4100 v2:172.21.15.157:6824/2765519551 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+658789 (secure 0 0 0) 0x7ff9c806d610 con 0x7ff9b4036310 2024-05-09T09:51:05.398 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:51:05.406 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-05-09T09:51:05.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.399+0000 7ff9cd8d1640 1 -- 172.21.15.110:0/2344372802 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff9b4036310 msgr2=0x7ff9b40387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:51:05.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.399+0000 7ff9cd8d1640 1 --2- 172.21.15.110:0/2344372802 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff9b4036310 0x7ff9b40387d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8001610 tx=0x7ff9b8007ad0 comp rx=0 tx=0).stop 2024-05-09T09:51:05.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.399+0000 7ff9cd8d1640 1 -- 172.21.15.110:0/2344372802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c809e3b0 msgr2=0x7ff9c8133310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:51:05.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.399+0000 7ff9cd8d1640 1 --2- 172.21.15.110:0/2344372802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c809e3b0 0x7ff9c8133310 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0ae040 tx=0x7ff9bc019110 comp rx=0 tx=0).stop 2024-05-09T09:51:05.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.399+0000 7ff9cd8d1640 1 -- 172.21.15.110:0/2344372802 shutdown_connections 2024-05-09T09:51:05.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.399+0000 7ff9cd8d1640 1 --2- 172.21.15.110:0/2344372802 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7ff9b4036310 0x7ff9b40387d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:51:05.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.399+0000 7ff9cd8d1640 1 --2- 172.21.15.110:0/2344372802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9c809e3b0 0x7ff9c8133310 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:51:05.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.399+0000 7ff9cd8d1640 1 -- 172.21.15.110:0/2344372802 >> 172.21.15.110:0/2344372802 conn(0x7ff9c80a17a0 msgr2=0x7ff9c80986a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:51:05.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.399+0000 7ff9cd8d1640 1 -- 172.21.15.110:0/2344372802 shutdown_connections 2024-05-09T09:51:05.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:05.399+0000 7ff9cd8d1640 1 -- 172.21.15.110:0/2344372802 wait complete. 2024-05-09T09:51:05.423 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-05-09T09:51:05.186493+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5118,"num_read_kb":4699,"num_write":2179,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7112,"ondisk_log_size":7112,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":131704,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":128825,"kb_avail":377355656,"statfs":{"total":386547056640,"available":386412191744,"internally_reserved":0,"allocated":2908160,"data_stored":1759962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":131917590},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2606,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005798"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.170306+0000","last_change":"2024-05-09T09:47:12.206481+0000","last_active":"2024-05-09T09:49:20.170306+0000","last_peered":"2024-05-09T09:49:20.170306+0000","last_clean":"2024-05-09T09:49:20.170306+0000","last_became_active":"2024-05-09T09:47:12.205786+0000","last_became_peered":"2024-05-09T09:47:12.205786+0000","last_unstale":"2024-05-09T09:49:20.170306+0000","last_undegraded":"2024-05-09T09:49:20.170306+0000","last_fullsized":"2024-05-09T09:49:20.170306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.179480+0000","last_change":"2024-05-09T09:47:14.171375+0000","last_active":"2024-05-09T09:49:45.179480+0000","last_peered":"2024-05-09T09:49:45.179480+0000","last_clean":"2024-05-09T09:49:45.179480+0000","last_became_active":"2024-05-09T09:47:14.171044+0000","last_became_peered":"2024-05-09T09:47:14.171044+0000","last_unstale":"2024-05-09T09:49:45.179480+0000","last_undegraded":"2024-05-09T09:49:45.179480+0000","last_fullsized":"2024-05-09T09:49:45.179480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.081487+0000","last_change":"2024-05-09T09:47:12.190812+0000","last_active":"2024-05-09T09:50:40.081487+0000","last_peered":"2024-05-09T09:50:40.081487+0000","last_clean":"2024-05-09T09:50:40.081487+0000","last_became_active":"2024-05-09T09:47:12.189774+0000","last_became_peered":"2024-05-09T09:47:12.189774+0000","last_unstale":"2024-05-09T09:50:40.081487+0000","last_undegraded":"2024-05-09T09:50:40.081487+0000","last_fullsized":"2024-05-09T09:50:40.081487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:58.498693+0000","last_change":"2024-05-09T09:50:58.498826+0000","last_active":"2024-05-09T09:50:58.498693+0000","last_peered":"2024-05-09T09:50:58.498693+0000","last_clean":"2024-05-09T09:50:58.498693+0000","last_became_active":"2024-05-09T09:47:14.192803+0000","last_became_peered":"2024-05-09T09:47:14.192803+0000","last_unstale":"2024-05-09T09:50:58.498693+0000","last_undegraded":"2024-05-09T09:50:58.498693+0000","last_fullsized":"2024-05-09T09:50:58.498693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-09T09:50:58.498439+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-09T09:50:58.498439+0000","last_clean_scrub_stamp":"2024-05-09T09:50:58.498439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:24.753930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"32'3","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.172608+0000","last_change":"2024-05-09T09:47:12.209625+0000","last_active":"2024-05-09T09:49:20.172608+0000","last_peered":"2024-05-09T09:49:20.172608+0000","last_clean":"2024-05-09T09:49:20.172608+0000","last_became_active":"2024-05-09T09:47:12.207184+0000","last_became_peered":"2024-05-09T09:47:12.207184+0000","last_unstale":"2024-05-09T09:49:20.172608+0000","last_undegraded":"2024-05-09T09:49:20.172608+0000","last_fullsized":"2024-05-09T09:49:20.172608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'14","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.171010+0000","last_change":"2024-05-09T09:47:14.193118+0000","last_active":"2024-05-09T09:50:33.171010+0000","last_peered":"2024-05-09T09:50:33.171010+0000","last_clean":"2024-05-09T09:50:33.171010+0000","last_became_active":"2024-05-09T09:47:14.192821+0000","last_became_peered":"2024-05-09T09:47:14.192821+0000","last_unstale":"2024-05-09T09:50:33.171010+0000","last_undegraded":"2024-05-09T09:50:33.171010+0000","last_fullsized":"2024-05-09T09:50:33.171010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.080391+0000","last_change":"2024-05-09T09:47:12.195169+0000","last_active":"2024-05-09T09:50:40.080391+0000","last_peered":"2024-05-09T09:50:40.080391+0000","last_clean":"2024-05-09T09:50:40.080391+0000","last_became_active":"2024-05-09T09:47:12.194183+0000","last_became_peered":"2024-05-09T09:47:12.194183+0000","last_unstale":"2024-05-09T09:50:40.080391+0000","last_undegraded":"2024-05-09T09:50:40.080391+0000","last_fullsized":"2024-05-09T09:50:40.080391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'12","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.824199+0000","last_change":"2024-05-09T09:47:52.430986+0000","last_active":"2024-05-09T09:50:32.824199+0000","last_peered":"2024-05-09T09:50:32.824199+0000","last_clean":"2024-05-09T09:50:32.824199+0000","last_became_active":"2024-05-09T09:47:52.429940+0000","last_became_peered":"2024-05-09T09:47:52.429940+0000","last_unstale":"2024-05-09T09:50:32.824199+0000","last_undegraded":"2024-05-09T09:50:32.824199+0000","last_fullsized":"2024-05-09T09:50:32.824199+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.178988+0000","last_change":"2024-05-09T09:47:12.212361+0000","last_active":"2024-05-09T09:49:45.178988+0000","last_peered":"2024-05-09T09:49:45.178988+0000","last_clean":"2024-05-09T09:49:45.178988+0000","last_became_active":"2024-05-09T09:47:12.204446+0000","last_became_peered":"2024-05-09T09:47:12.204446+0000","last_unstale":"2024-05-09T09:49:45.178988+0000","last_undegraded":"2024-05-09T09:49:45.178988+0000","last_fullsized":"2024-05-09T09:49:45.178988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'16","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.320190+0000","last_change":"2024-05-09T09:47:14.185067+0000","last_active":"2024-05-09T09:50:33.320190+0000","last_peered":"2024-05-09T09:50:33.320190+0000","last_clean":"2024-05-09T09:50:33.320190+0000","last_became_active":"2024-05-09T09:47:14.184792+0000","last_became_peered":"2024-05-09T09:47:14.184792+0000","last_unstale":"2024-05-09T09:50:33.320190+0000","last_undegraded":"2024-05-09T09:50:33.320190+0000","last_fullsized":"2024-05-09T09:50:33.320190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.144347+0000","last_change":"2024-05-09T09:47:12.195761+0000","last_active":"2024-05-09T09:50:33.144347+0000","last_peered":"2024-05-09T09:50:33.144347+0000","last_clean":"2024-05-09T09:50:33.144347+0000","last_became_active":"2024-05-09T09:47:12.195117+0000","last_became_peered":"2024-05-09T09:47:12.195117+0000","last_unstale":"2024-05-09T09:50:33.144347+0000","last_undegraded":"2024-05-09T09:50:33.144347+0000","last_fullsized":"2024-05-09T09:50:33.144347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.321575+0000","last_change":"2024-05-09T09:47:14.189185+0000","last_active":"2024-05-09T09:50:33.321575+0000","last_peered":"2024-05-09T09:50:33.321575+0000","last_clean":"2024-05-09T09:50:33.321575+0000","last_became_active":"2024-05-09T09:47:14.188665+0000","last_became_peered":"2024-05-09T09:47:14.188665+0000","last_unstale":"2024-05-09T09:50:33.321575+0000","last_undegraded":"2024-05-09T09:50:33.321575+0000","last_fullsized":"2024-05-09T09:50:33.321575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"30'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.178799+0000","last_change":"2024-05-09T09:47:12.201245+0000","last_active":"2024-05-09T09:49:45.178799+0000","last_peered":"2024-05-09T09:49:45.178799+0000","last_clean":"2024-05-09T09:49:45.178799+0000","last_became_active":"2024-05-09T09:47:12.199697+0000","last_became_peered":"2024-05-09T09:47:12.199697+0000","last_unstale":"2024-05-09T09:49:45.178799+0000","last_undegraded":"2024-05-09T09:49:45.178799+0000","last_fullsized":"2024-05-09T09:49:45.178799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'12","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.826359+0000","last_change":"2024-05-09T09:47:14.179543+0000","last_active":"2024-05-09T09:50:32.826359+0000","last_peered":"2024-05-09T09:50:32.826359+0000","last_clean":"2024-05-09T09:50:32.826359+0000","last_became_active":"2024-05-09T09:47:14.179041+0000","last_became_peered":"2024-05-09T09:47:14.179041+0000","last_unstale":"2024-05-09T09:50:32.826359+0000","last_undegraded":"2024-05-09T09:50:32.826359+0000","last_fullsized":"2024-05-09T09:50:32.826359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.168380+0000","last_change":"2024-05-09T09:47:12.185018+0000","last_active":"2024-05-09T09:49:45.168380+0000","last_peered":"2024-05-09T09:49:45.168380+0000","last_clean":"2024-05-09T09:49:45.168380+0000","last_became_active":"2024-05-09T09:47:12.183745+0000","last_became_peered":"2024-05-09T09:47:12.183745+0000","last_unstale":"2024-05-09T09:49:45.168380+0000","last_undegraded":"2024-05-09T09:49:45.168380+0000","last_fullsized":"2024-05-09T09:49:45.168380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'14","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.322217+0000","last_change":"2024-05-09T09:47:14.173339+0000","last_active":"2024-05-09T09:50:33.322217+0000","last_peered":"2024-05-09T09:50:33.322217+0000","last_clean":"2024-05-09T09:50:33.322217+0000","last_became_active":"2024-05-09T09:47:14.173031+0000","last_became_peered":"2024-05-09T09:47:14.173031+0000","last_unstale":"2024-05-09T09:50:33.322217+0000","last_undegraded":"2024-05-09T09:50:33.322217+0000","last_fullsized":"2024-05-09T09:50:33.322217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"30'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.175797+0000","last_change":"2024-05-09T09:47:14.193172+0000","last_active":"2024-05-09T09:49:35.175797+0000","last_peered":"2024-05-09T09:49:35.175797+0000","last_clean":"2024-05-09T09:49:35.175797+0000","last_became_active":"2024-05-09T09:47:14.192744+0000","last_became_peered":"2024-05-09T09:47:14.192744+0000","last_unstale":"2024-05-09T09:49:35.175797+0000","last_undegraded":"2024-05-09T09:49:35.175797+0000","last_fullsized":"2024-05-09T09:49:35.175797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.178349+0000","last_change":"2024-05-09T09:47:12.213768+0000","last_active":"2024-05-09T09:49:40.178349+0000","last_peered":"2024-05-09T09:49:40.178349+0000","last_clean":"2024-05-09T09:49:40.178349+0000","last_became_active":"2024-05-09T09:47:12.210781+0000","last_became_peered":"2024-05-09T09:47:12.210781+0000","last_unstale":"2024-05-09T09:49:40.178349+0000","last_undegraded":"2024-05-09T09:49:40.178349+0000","last_fullsized":"2024-05-09T09:49:40.178349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'20","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.253416+0000","last_change":"2024-05-09T09:47:14.190782+0000","last_active":"2024-05-09T09:50:33.253416+0000","last_peered":"2024-05-09T09:50:33.253416+0000","last_clean":"2024-05-09T09:50:33.253416+0000","last_became_active":"2024-05-09T09:47:14.190021+0000","last_became_peered":"2024-05-09T09:47:14.190021+0000","last_unstale":"2024-05-09T09:50:33.253416+0000","last_undegraded":"2024-05-09T09:50:33.253416+0000","last_fullsized":"2024-05-09T09:50:33.253416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.119657+0000","last_change":"2024-05-09T09:47:12.194645+0000","last_active":"2024-05-09T09:50:33.119657+0000","last_peered":"2024-05-09T09:50:33.119657+0000","last_clean":"2024-05-09T09:50:33.119657+0000","last_became_active":"2024-05-09T09:47:12.193509+0000","last_became_peered":"2024-05-09T09:47:12.193509+0000","last_unstale":"2024-05-09T09:50:33.119657+0000","last_undegraded":"2024-05-09T09:50:33.119657+0000","last_fullsized":"2024-05-09T09:50:33.119657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'8","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.961675+0000","last_change":"2024-05-09T09:47:14.189775+0000","last_active":"2024-05-09T09:50:32.961675+0000","last_peered":"2024-05-09T09:50:32.961675+0000","last_clean":"2024-05-09T09:50:32.961675+0000","last_became_active":"2024-05-09T09:47:14.189468+0000","last_became_peered":"2024-05-09T09:47:14.189468+0000","last_unstale":"2024-05-09T09:50:32.961675+0000","last_undegraded":"2024-05-09T09:50:32.961675+0000","last_fullsized":"2024-05-09T09:50:32.961675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.178206+0000","last_change":"2024-05-09T09:47:12.210720+0000","last_active":"2024-05-09T09:49:40.178206+0000","last_peered":"2024-05-09T09:49:40.178206+0000","last_clean":"2024-05-09T09:49:40.178206+0000","last_became_active":"2024-05-09T09:47:12.206920+0000","last_became_peered":"2024-05-09T09:47:12.206920+0000","last_unstale":"2024-05-09T09:49:40.178206+0000","last_undegraded":"2024-05-09T09:49:40.178206+0000","last_fullsized":"2024-05-09T09:49:40.178206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'18","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.253192+0000","last_change":"2024-05-09T09:47:14.174508+0000","last_active":"2024-05-09T09:50:33.253192+0000","last_peered":"2024-05-09T09:50:33.253192+0000","last_clean":"2024-05-09T09:50:33.253192+0000","last_became_active":"2024-05-09T09:47:14.173701+0000","last_became_peered":"2024-05-09T09:47:14.173701+0000","last_unstale":"2024-05-09T09:50:33.253192+0000","last_undegraded":"2024-05-09T09:50:33.253192+0000","last_fullsized":"2024-05-09T09:50:33.253192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.722331+0000","last_change":"2024-05-09T09:47:12.207271+0000","last_active":"2024-05-09T09:50:32.722331+0000","last_peered":"2024-05-09T09:50:32.722331+0000","last_clean":"2024-05-09T09:50:32.722331+0000","last_became_active":"2024-05-09T09:47:12.206564+0000","last_became_peered":"2024-05-09T09:47:12.206564+0000","last_unstale":"2024-05-09T09:50:32.722331+0000","last_undegraded":"2024-05-09T09:50:32.722331+0000","last_fullsized":"2024-05-09T09:50:32.722331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'10","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.826960+0000","last_change":"2024-05-09T09:47:14.173448+0000","last_active":"2024-05-09T09:50:32.826960+0000","last_peered":"2024-05-09T09:50:32.826960+0000","last_clean":"2024-05-09T09:50:32.826960+0000","last_became_active":"2024-05-09T09:47:14.173022+0000","last_became_peered":"2024-05-09T09:47:14.173022+0000","last_unstale":"2024-05-09T09:50:32.826960+0000","last_undegraded":"2024-05-09T09:50:32.826960+0000","last_fullsized":"2024-05-09T09:50:32.826960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.167221+0000","last_change":"2024-05-09T09:47:12.216902+0000","last_active":"2024-05-09T09:49:40.167221+0000","last_peered":"2024-05-09T09:49:40.167221+0000","last_clean":"2024-05-09T09:49:40.167221+0000","last_became_active":"2024-05-09T09:47:12.214422+0000","last_became_peered":"2024-05-09T09:47:12.214422+0000","last_unstale":"2024-05-09T09:49:40.167221+0000","last_undegraded":"2024-05-09T09:49:40.167221+0000","last_fullsized":"2024-05-09T09:49:40.167221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'10","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.251890+0000","last_change":"2024-05-09T09:47:14.172576+0000","last_active":"2024-05-09T09:50:33.251890+0000","last_peered":"2024-05-09T09:50:33.251890+0000","last_clean":"2024-05-09T09:50:33.251890+0000","last_became_active":"2024-05-09T09:47:14.172297+0000","last_became_peered":"2024-05-09T09:47:14.172297+0000","last_unstale":"2024-05-09T09:50:33.251890+0000","last_undegraded":"2024-05-09T09:50:33.251890+0000","last_fullsized":"2024-05-09T09:50:33.251890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.175906+0000","last_change":"2024-05-09T09:47:12.213596+0000","last_active":"2024-05-09T09:49:35.175906+0000","last_peered":"2024-05-09T09:49:35.175906+0000","last_clean":"2024-05-09T09:49:35.175906+0000","last_became_active":"2024-05-09T09:47:12.211880+0000","last_became_peered":"2024-05-09T09:47:12.211880+0000","last_unstale":"2024-05-09T09:49:35.175906+0000","last_undegraded":"2024-05-09T09:49:35.175906+0000","last_fullsized":"2024-05-09T09:49:35.175906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'39","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.344633+0000","last_change":"2024-05-09T09:47:22.260431+0000","last_active":"2024-05-09T09:50:33.344633+0000","last_peered":"2024-05-09T09:50:33.344633+0000","last_clean":"2024-05-09T09:50:33.344633+0000","last_became_active":"2024-05-09T09:47:22.258991+0000","last_became_peered":"2024-05-09T09:47:22.258991+0000","last_unstale":"2024-05-09T09:50:33.344633+0000","last_undegraded":"2024-05-09T09:50:33.344633+0000","last_fullsized":"2024-05-09T09:50:33.344633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":174,"num_read_kb":174,"num_write":107,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.176070+0000","last_change":"2024-05-09T09:47:14.185176+0000","last_active":"2024-05-09T09:49:35.176070+0000","last_peered":"2024-05-09T09:49:35.176070+0000","last_clean":"2024-05-09T09:49:35.176070+0000","last_became_active":"2024-05-09T09:47:14.184851+0000","last_became_peered":"2024-05-09T09:47:14.184851+0000","last_unstale":"2024-05-09T09:49:35.176070+0000","last_undegraded":"2024-05-09T09:49:35.176070+0000","last_fullsized":"2024-05-09T09:49:35.176070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.083065+0000","last_change":"2024-05-09T09:47:12.214683+0000","last_active":"2024-05-09T09:50:40.083065+0000","last_peered":"2024-05-09T09:50:40.083065+0000","last_clean":"2024-05-09T09:50:40.083065+0000","last_became_active":"2024-05-09T09:47:12.214108+0000","last_became_peered":"2024-05-09T09:47:12.214108+0000","last_unstale":"2024-05-09T09:50:40.083065+0000","last_undegraded":"2024-05-09T09:50:40.083065+0000","last_fullsized":"2024-05-09T09:50:40.083065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:53.499175+0000","last_change":"2024-05-09T09:50:53.499229+0000","last_active":"2024-05-09T09:50:53.499175+0000","last_peered":"2024-05-09T09:50:53.499175+0000","last_clean":"2024-05-09T09:50:53.499175+0000","last_became_active":"2024-05-09T09:47:16.196516+0000","last_became_peered":"2024-05-09T09:47:16.196516+0000","last_unstale":"2024-05-09T09:50:53.499175+0000","last_undegraded":"2024-05-09T09:50:53.499175+0000","last_fullsized":"2024-05-09T09:50:53.499175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:53.498977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:53.498977+0000","last_clean_scrub_stamp":"2024-05-09T09:50:53.498977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:34:28.515132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'107","reported_seq":154,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:39.978493+0000","last_change":"2024-05-09T09:47:18.236921+0000","last_active":"2024-05-09T09:50:39.978493+0000","last_peered":"2024-05-09T09:50:39.978493+0000","last_clean":"2024-05-09T09:50:39.978493+0000","last_became_active":"2024-05-09T09:47:18.235911+0000","last_became_peered":"2024-05-09T09:47:18.235911+0000","last_unstale":"2024-05-09T09:50:39.978493+0000","last_undegraded":"2024-05-09T09:50:39.978493+0000","last_fullsized":"2024-05-09T09:50:39.978493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.179992+0000","last_change":"2024-05-09T09:47:20.252492+0000","last_active":"2024-05-09T09:49:45.179992+0000","last_peered":"2024-05-09T09:49:45.179992+0000","last_clean":"2024-05-09T09:49:45.179992+0000","last_became_active":"2024-05-09T09:47:20.251712+0000","last_became_peered":"2024-05-09T09:47:20.251712+0000","last_unstale":"2024-05-09T09:49:45.179992+0000","last_undegraded":"2024-05-09T09:49:45.179992+0000","last_fullsized":"2024-05-09T09:49:45.179992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:50.180967+0000","last_change":"2024-05-09T09:47:22.255759+0000","last_active":"2024-05-09T09:49:50.180967+0000","last_peered":"2024-05-09T09:49:50.180967+0000","last_clean":"2024-05-09T09:49:50.180967+0000","last_became_active":"2024-05-09T09:47:22.255180+0000","last_became_peered":"2024-05-09T09:47:22.255180+0000","last_unstale":"2024-05-09T09:49:50.180967+0000","last_undegraded":"2024-05-09T09:49:50.180967+0000","last_fullsized":"2024-05-09T09:49:50.180967+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.177619+0000","last_change":"2024-05-09T09:47:14.187449+0000","last_active":"2024-05-09T09:49:40.177619+0000","last_peered":"2024-05-09T09:49:40.177619+0000","last_clean":"2024-05-09T09:49:40.177619+0000","last_became_active":"2024-05-09T09:47:14.187095+0000","last_became_peered":"2024-05-09T09:47:14.187095+0000","last_unstale":"2024-05-09T09:49:40.177619+0000","last_undegraded":"2024-05-09T09:49:40.177619+0000","last_fullsized":"2024-05-09T09:49:40.177619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.296894+0000","last_change":"2024-05-09T09:47:12.196226+0000","last_active":"2024-05-09T09:50:33.296894+0000","last_peered":"2024-05-09T09:50:33.296894+0000","last_clean":"2024-05-09T09:50:33.296894+0000","last_became_active":"2024-05-09T09:47:12.194549+0000","last_became_peered":"2024-05-09T09:47:12.194549+0000","last_unstale":"2024-05-09T09:50:33.296894+0000","last_undegraded":"2024-05-09T09:50:33.296894+0000","last_fullsized":"2024-05-09T09:50:33.296894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.167280+0000","last_change":"2024-05-09T09:47:16.191533+0000","last_active":"2024-05-09T09:49:40.167280+0000","last_peered":"2024-05-09T09:49:40.167280+0000","last_clean":"2024-05-09T09:49:40.167280+0000","last_became_active":"2024-05-09T09:47:16.190755+0000","last_became_peered":"2024-05-09T09:47:16.190755+0000","last_unstale":"2024-05-09T09:49:40.167280+0000","last_undegraded":"2024-05-09T09:49:40.167280+0000","last_fullsized":"2024-05-09T09:49:40.167280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'10","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:47.334928+0000","last_change":"2024-05-09T09:50:47.334999+0000","last_active":"2024-05-09T09:50:47.334928+0000","last_peered":"2024-05-09T09:50:47.334928+0000","last_clean":"2024-05-09T09:50:47.334928+0000","last_became_active":"2024-05-09T09:47:18.214299+0000","last_became_peered":"2024-05-09T09:47:18.214299+0000","last_unstale":"2024-05-09T09:50:47.334928+0000","last_undegraded":"2024-05-09T09:50:47.334928+0000","last_fullsized":"2024-05-09T09:50:47.334928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-09T09:50:47.334727+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-09T09:50:47.334727+0000","last_clean_scrub_stamp":"2024-05-09T09:50:47.334727+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:31:56.932969+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:56.256173+0000","last_change":"2024-05-09T09:50:56.256269+0000","last_active":"2024-05-09T09:50:56.256173+0000","last_peered":"2024-05-09T09:50:56.256173+0000","last_clean":"2024-05-09T09:50:56.256173+0000","last_became_active":"2024-05-09T09:47:20.241096+0000","last_became_peered":"2024-05-09T09:47:20.241096+0000","last_unstale":"2024-05-09T09:50:56.256173+0000","last_undegraded":"2024-05-09T09:50:56.256173+0000","last_fullsized":"2024-05-09T09:50:56.256173+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:56.255842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:56.255842+0000","last_clean_scrub_stamp":"2024-05-09T09:50:56.255842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:53:33.355429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:55.170754+0000","last_change":"2024-05-09T09:47:22.258554+0000","last_active":"2024-05-09T09:49:55.170754+0000","last_peered":"2024-05-09T09:49:55.170754+0000","last_clean":"2024-05-09T09:49:55.170754+0000","last_became_active":"2024-05-09T09:47:22.257798+0000","last_became_peered":"2024-05-09T09:47:22.257798+0000","last_unstale":"2024-05-09T09:49:55.170754+0000","last_undegraded":"2024-05-09T09:49:55.170754+0000","last_fullsized":"2024-05-09T09:49:55.170754+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.960457+0000","last_change":"2024-05-09T09:47:52.430567+0000","last_active":"2024-05-09T09:50:32.960457+0000","last_peered":"2024-05-09T09:50:32.960457+0000","last_clean":"2024-05-09T09:50:32.960457+0000","last_became_active":"2024-05-09T09:47:52.429857+0000","last_became_peered":"2024-05-09T09:47:52.429857+0000","last_unstale":"2024-05-09T09:50:32.960457+0000","last_undegraded":"2024-05-09T09:50:32.960457+0000","last_fullsized":"2024-05-09T09:50:32.960457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.175839+0000","last_change":"2024-05-09T09:47:12.201826+0000","last_active":"2024-05-09T09:49:35.175839+0000","last_peered":"2024-05-09T09:49:35.175839+0000","last_clean":"2024-05-09T09:49:35.175839+0000","last_became_active":"2024-05-09T09:47:12.201415+0000","last_became_peered":"2024-05-09T09:47:12.201415+0000","last_unstale":"2024-05-09T09:49:35.175839+0000","last_undegraded":"2024-05-09T09:49:35.175839+0000","last_fullsized":"2024-05-09T09:49:35.175839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:03.013348+0000","last_change":"2024-05-09T09:51:03.013403+0000","last_active":"2024-05-09T09:51:03.013348+0000","last_peered":"2024-05-09T09:51:03.013348+0000","last_clean":"2024-05-09T09:51:03.013348+0000","last_became_active":"2024-05-09T09:47:16.212543+0000","last_became_peered":"2024-05-09T09:47:16.212543+0000","last_unstale":"2024-05-09T09:51:03.013348+0000","last_undegraded":"2024-05-09T09:51:03.013348+0000","last_fullsized":"2024-05-09T09:51:03.013348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:03.013120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:03.013120+0000","last_clean_scrub_stamp":"2024-05-09T09:51:03.013120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:48:14.324538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:56.286640+0000","last_change":"2024-05-09T09:50:56.286722+0000","last_active":"2024-05-09T09:50:56.286640+0000","last_peered":"2024-05-09T09:50:56.286640+0000","last_clean":"2024-05-09T09:50:56.286640+0000","last_became_active":"2024-05-09T09:47:18.212685+0000","last_became_peered":"2024-05-09T09:47:18.212685+0000","last_unstale":"2024-05-09T09:50:56.286640+0000","last_undegraded":"2024-05-09T09:50:56.286640+0000","last_fullsized":"2024-05-09T09:50:56.286640+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-09T09:50:56.286427+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-09T09:50:56.286427+0000","last_clean_scrub_stamp":"2024-05-09T09:50:56.286427+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:21.085497+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":387,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.200535+0000","last_change":"2024-05-09T09:47:20.250999+0000","last_active":"2024-05-09T09:50:40.200535+0000","last_peered":"2024-05-09T09:50:40.200535+0000","last_clean":"2024-05-09T09:50:40.200535+0000","last_became_active":"2024-05-09T09:47:20.250200+0000","last_became_peered":"2024-05-09T09:47:20.250200+0000","last_unstale":"2024-05-09T09:50:40.200535+0000","last_undegraded":"2024-05-09T09:50:40.200535+0000","last_fullsized":"2024-05-09T09:50:40.200535+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:55.178124+0000","last_change":"2024-05-09T09:47:22.241318+0000","last_active":"2024-05-09T09:49:55.178124+0000","last_peered":"2024-05-09T09:49:55.178124+0000","last_clean":"2024-05-09T09:49:55.178124+0000","last_became_active":"2024-05-09T09:47:22.238160+0000","last_became_peered":"2024-05-09T09:47:22.238160+0000","last_unstale":"2024-05-09T09:49:55.178124+0000","last_undegraded":"2024-05-09T09:49:55.178124+0000","last_fullsized":"2024-05-09T09:49:55.178124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'16","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.825514+0000","last_change":"2024-05-09T09:47:14.177761+0000","last_active":"2024-05-09T09:50:32.825514+0000","last_peered":"2024-05-09T09:50:32.825514+0000","last_clean":"2024-05-09T09:50:32.825514+0000","last_became_active":"2024-05-09T09:47:14.176295+0000","last_became_peered":"2024-05-09T09:47:14.176295+0000","last_unstale":"2024-05-09T09:50:32.825514+0000","last_undegraded":"2024-05-09T09:50:32.825514+0000","last_fullsized":"2024-05-09T09:50:32.825514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.176293+0000","last_change":"2024-05-09T09:47:12.192627+0000","last_active":"2024-05-09T09:49:35.176293+0000","last_peered":"2024-05-09T09:49:35.176293+0000","last_clean":"2024-05-09T09:49:35.176293+0000","last_became_active":"2024-05-09T09:47:12.191194+0000","last_became_peered":"2024-05-09T09:47:12.191194+0000","last_unstale":"2024-05-09T09:49:35.176293+0000","last_undegraded":"2024-05-09T09:49:35.176293+0000","last_fullsized":"2024-05-09T09:49:35.176293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.179207+0000","last_change":"2024-05-09T09:47:52.201792+0000","last_active":"2024-05-09T09:49:45.179207+0000","last_peered":"2024-05-09T09:49:45.179207+0000","last_clean":"2024-05-09T09:49:45.179207+0000","last_became_active":"2024-05-09T09:47:52.201081+0000","last_became_peered":"2024-05-09T09:47:52.201081+0000","last_unstale":"2024-05-09T09:49:45.179207+0000","last_undegraded":"2024-05-09T09:49:45.179207+0000","last_fullsized":"2024-05-09T09:49:45.179207+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'110","reported_seq":165,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:52.254206+0000","last_change":"2024-05-09T09:50:52.254281+0000","last_active":"2024-05-09T09:50:52.254206+0000","last_peered":"2024-05-09T09:50:52.254206+0000","last_clean":"2024-05-09T09:50:52.254206+0000","last_became_active":"2024-05-09T09:47:18.217843+0000","last_became_peered":"2024-05-09T09:47:18.217843+0000","last_unstale":"2024-05-09T09:50:52.254206+0000","last_undegraded":"2024-05-09T09:50:52.254206+0000","last_fullsized":"2024-05-09T09:50:52.254206+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'110","last_scrub_stamp":"2024-05-09T09:50:52.254022+0000","last_deep_scrub":"32'110","last_deep_scrub_stamp":"2024-05-09T09:50:52.254022+0000","last_clean_scrub_stamp":"2024-05-09T09:50:52.254022+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:44:38.690119+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":455,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:43.906596+0000","last_change":"2024-05-09T09:50:43.906635+0000","last_active":"2024-05-09T09:50:43.906596+0000","last_peered":"2024-05-09T09:50:43.906596+0000","last_clean":"2024-05-09T09:50:43.906596+0000","last_became_active":"2024-05-09T09:47:20.242448+0000","last_became_peered":"2024-05-09T09:47:20.242448+0000","last_unstale":"2024-05-09T09:50:43.906596+0000","last_undegraded":"2024-05-09T09:50:43.906596+0000","last_fullsized":"2024-05-09T09:50:43.906596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:43.906506+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:43.906506+0000","last_clean_scrub_stamp":"2024-05-09T09:50:43.906506+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:08.705575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.170799+0000","last_change":"2024-05-09T09:47:52.179916+0000","last_active":"2024-05-09T09:50:33.170799+0000","last_peered":"2024-05-09T09:50:33.170799+0000","last_clean":"2024-05-09T09:50:33.170799+0000","last_became_active":"2024-05-09T09:47:52.179059+0000","last_became_peered":"2024-05-09T09:47:52.179059+0000","last_unstale":"2024-05-09T09:50:33.170799+0000","last_undegraded":"2024-05-09T09:50:33.170799+0000","last_fullsized":"2024-05-09T09:50:33.170799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:30.172545+0000","last_change":"2024-05-09T09:47:12.206447+0000","last_active":"2024-05-09T09:49:30.172545+0000","last_peered":"2024-05-09T09:49:30.172545+0000","last_clean":"2024-05-09T09:49:30.172545+0000","last_became_active":"2024-05-09T09:47:12.205259+0000","last_became_peered":"2024-05-09T09:47:12.205259+0000","last_unstale":"2024-05-09T09:49:30.172545+0000","last_undegraded":"2024-05-09T09:49:30.172545+0000","last_fullsized":"2024-05-09T09:49:30.172545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:30.175167+0000","last_change":"2024-05-09T09:47:16.207890+0000","last_active":"2024-05-09T09:49:30.175167+0000","last_peered":"2024-05-09T09:49:30.175167+0000","last_clean":"2024-05-09T09:49:30.175167+0000","last_became_active":"2024-05-09T09:47:16.207404+0000","last_became_peered":"2024-05-09T09:47:16.207404+0000","last_unstale":"2024-05-09T09:49:30.175167+0000","last_undegraded":"2024-05-09T09:49:30.175167+0000","last_fullsized":"2024-05-09T09:49:30.175167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'127","reported_seq":187,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:51.216938+0000","last_change":"2024-05-09T09:50:51.217030+0000","last_active":"2024-05-09T09:50:51.216938+0000","last_peered":"2024-05-09T09:50:51.216938+0000","last_clean":"2024-05-09T09:50:51.216938+0000","last_became_active":"2024-05-09T09:47:18.220596+0000","last_became_peered":"2024-05-09T09:47:18.220596+0000","last_unstale":"2024-05-09T09:50:51.216938+0000","last_undegraded":"2024-05-09T09:50:51.216938+0000","last_fullsized":"2024-05-09T09:50:51.216938+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'127","last_scrub_stamp":"2024-05-09T09:50:51.216776+0000","last_deep_scrub":"32'127","last_deep_scrub_stamp":"2024-05-09T09:50:51.216776+0000","last_clean_scrub_stamp":"2024-05-09T09:50:51.216776+0000","objects_scrubbed":9,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:52:10.006215+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":63,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:45.825591+0000","last_change":"2024-05-09T09:50:45.825646+0000","last_active":"2024-05-09T09:50:45.825591+0000","last_peered":"2024-05-09T09:50:45.825591+0000","last_clean":"2024-05-09T09:50:45.825591+0000","last_became_active":"2024-05-09T09:47:20.244839+0000","last_became_peered":"2024-05-09T09:47:20.244839+0000","last_unstale":"2024-05-09T09:50:45.825591+0000","last_undegraded":"2024-05-09T09:50:45.825591+0000","last_fullsized":"2024-05-09T09:50:45.825591+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:45.825370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:45.825370+0000","last_clean_scrub_stamp":"2024-05-09T09:50:45.825370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:33:58.430560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.965352+0000","last_change":"2024-05-09T09:47:22.237841+0000","last_active":"2024-05-09T09:50:32.965352+0000","last_peered":"2024-05-09T09:50:32.965352+0000","last_clean":"2024-05-09T09:50:32.965352+0000","last_became_active":"2024-05-09T09:47:22.235895+0000","last_became_peered":"2024-05-09T09:47:22.235895+0000","last_unstale":"2024-05-09T09:50:32.965352+0000","last_undegraded":"2024-05-09T09:50:32.965352+0000","last_fullsized":"2024-05-09T09:50:32.965352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'3","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.403853+0000","last_change":"2024-05-09T09:47:14.172537+0000","last_active":"2024-05-09T09:50:33.403853+0000","last_peered":"2024-05-09T09:50:33.403853+0000","last_clean":"2024-05-09T09:50:33.403853+0000","last_became_active":"2024-05-09T09:47:14.172275+0000","last_became_peered":"2024-05-09T09:47:14.172275+0000","last_unstale":"2024-05-09T09:50:33.403853+0000","last_undegraded":"2024-05-09T09:50:33.403853+0000","last_fullsized":"2024-05-09T09:50:33.403853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:30.172488+0000","last_change":"2024-05-09T09:47:12.210250+0000","last_active":"2024-05-09T09:49:30.172488+0000","last_peered":"2024-05-09T09:49:30.172488+0000","last_clean":"2024-05-09T09:49:30.172488+0000","last_became_active":"2024-05-09T09:47:12.209274+0000","last_became_peered":"2024-05-09T09:47:12.209274+0000","last_unstale":"2024-05-09T09:49:30.172488+0000","last_undegraded":"2024-05-09T09:49:30.172488+0000","last_fullsized":"2024-05-09T09:49:30.172488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:59.933360+0000","last_change":"2024-05-09T09:50:59.933420+0000","last_active":"2024-05-09T09:50:59.933360+0000","last_peered":"2024-05-09T09:50:59.933360+0000","last_clean":"2024-05-09T09:50:59.933360+0000","last_became_active":"2024-05-09T09:47:16.214484+0000","last_became_peered":"2024-05-09T09:47:16.214484+0000","last_unstale":"2024-05-09T09:50:59.933360+0000","last_undegraded":"2024-05-09T09:50:59.933360+0000","last_fullsized":"2024-05-09T09:50:59.933360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:59.933158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:59.933158+0000","last_clean_scrub_stamp":"2024-05-09T09:50:59.933158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:53.280118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'113","reported_seq":168,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:51.479962+0000","last_change":"2024-05-09T09:50:51.480062+0000","last_active":"2024-05-09T09:50:51.479962+0000","last_peered":"2024-05-09T09:50:51.479962+0000","last_clean":"2024-05-09T09:50:51.479962+0000","last_became_active":"2024-05-09T09:47:18.224815+0000","last_became_peered":"2024-05-09T09:47:18.224815+0000","last_unstale":"2024-05-09T09:50:51.479962+0000","last_undegraded":"2024-05-09T09:50:51.479962+0000","last_fullsized":"2024-05-09T09:50:51.479962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'113","last_scrub_stamp":"2024-05-09T09:50:51.479757+0000","last_deep_scrub":"32'113","last_deep_scrub_stamp":"2024-05-09T09:50:51.479757+0000","last_clean_scrub_stamp":"2024-05-09T09:50:51.479757+0000","objects_scrubbed":4,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:05.084435+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:02.001137+0000","last_change":"2024-05-09T09:51:02.001194+0000","last_active":"2024-05-09T09:51:02.001137+0000","last_peered":"2024-05-09T09:51:02.001137+0000","last_clean":"2024-05-09T09:51:02.001137+0000","last_became_active":"2024-05-09T09:47:20.250686+0000","last_became_peered":"2024-05-09T09:47:20.250686+0000","last_unstale":"2024-05-09T09:51:02.001137+0000","last_undegraded":"2024-05-09T09:51:02.001137+0000","last_fullsized":"2024-05-09T09:51:02.001137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:02.000873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:02.000873+0000","last_clean_scrub_stamp":"2024-05-09T09:51:02.000873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:10:46.269234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'17","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.818302+0000","last_change":"2024-05-09T09:47:22.255914+0000","last_active":"2024-05-09T09:50:32.818302+0000","last_peered":"2024-05-09T09:50:32.818302+0000","last_clean":"2024-05-09T09:50:32.818302+0000","last_became_active":"2024-05-09T09:47:22.255076+0000","last_became_peered":"2024-05-09T09:47:22.255076+0000","last_unstale":"2024-05-09T09:50:32.818302+0000","last_undegraded":"2024-05-09T09:50:32.818302+0000","last_fullsized":"2024-05-09T09:50:32.818302+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":92,"num_read_kb":72,"num_write":55,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.171310+0000","last_change":"2024-05-09T09:47:14.180737+0000","last_active":"2024-05-09T09:49:25.171310+0000","last_peered":"2024-05-09T09:49:25.171310+0000","last_clean":"2024-05-09T09:49:25.171310+0000","last_became_active":"2024-05-09T09:47:14.180185+0000","last_became_peered":"2024-05-09T09:47:14.180185+0000","last_unstale":"2024-05-09T09:49:25.171310+0000","last_undegraded":"2024-05-09T09:49:25.171310+0000","last_fullsized":"2024-05-09T09:49:25.171310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:30.174800+0000","last_change":"2024-05-09T09:47:12.211357+0000","last_active":"2024-05-09T09:49:30.174800+0000","last_peered":"2024-05-09T09:49:30.174800+0000","last_clean":"2024-05-09T09:49:30.174800+0000","last_became_active":"2024-05-09T09:47:12.207751+0000","last_became_peered":"2024-05-09T09:47:12.207751+0000","last_unstale":"2024-05-09T09:49:30.174800+0000","last_undegraded":"2024-05-09T09:49:30.174800+0000","last_fullsized":"2024-05-09T09:49:30.174800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:04.040553+0000","last_change":"2024-05-09T09:51:04.040606+0000","last_active":"2024-05-09T09:51:04.040553+0000","last_peered":"2024-05-09T09:51:04.040553+0000","last_clean":"2024-05-09T09:51:04.040553+0000","last_became_active":"2024-05-09T09:47:16.207734+0000","last_became_peered":"2024-05-09T09:47:16.207734+0000","last_unstale":"2024-05-09T09:51:04.040553+0000","last_undegraded":"2024-05-09T09:51:04.040553+0000","last_fullsized":"2024-05-09T09:51:04.040553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:04.040339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:04.040339+0000","last_clean_scrub_stamp":"2024-05-09T09:51:04.040339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:34:42.732867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'119","reported_seq":177,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:47.428194+0000","last_change":"2024-05-09T09:50:47.428281+0000","last_active":"2024-05-09T09:50:47.428194+0000","last_peered":"2024-05-09T09:50:47.428194+0000","last_clean":"2024-05-09T09:50:47.428194+0000","last_became_active":"2024-05-09T09:47:18.230440+0000","last_became_peered":"2024-05-09T09:47:18.230440+0000","last_unstale":"2024-05-09T09:50:47.428194+0000","last_undegraded":"2024-05-09T09:50:47.428194+0000","last_fullsized":"2024-05-09T09:50:47.428194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-05-09T09:50:47.427971+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-05-09T09:50:47.427971+0000","last_clean_scrub_stamp":"2024-05-09T09:50:47.427971+0000","objects_scrubbed":7,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:24:59.602471+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":354,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.213885+0000","last_change":"2024-05-09T09:47:20.254991+0000","last_active":"2024-05-09T09:50:40.213885+0000","last_peered":"2024-05-09T09:50:40.213885+0000","last_clean":"2024-05-09T09:50:40.213885+0000","last_became_active":"2024-05-09T09:47:20.254305+0000","last_became_peered":"2024-05-09T09:47:20.254305+0000","last_unstale":"2024-05-09T09:50:40.213885+0000","last_undegraded":"2024-05-09T09:50:40.213885+0000","last_fullsized":"2024-05-09T09:50:40.213885+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.166157+0000","last_change":"2024-05-09T09:47:22.239987+0000","last_active":"2024-05-09T09:49:35.166157+0000","last_peered":"2024-05-09T09:49:35.166157+0000","last_clean":"2024-05-09T09:49:35.166157+0000","last_became_active":"2024-05-09T09:47:22.239262+0000","last_became_peered":"2024-05-09T09:47:22.239262+0000","last_unstale":"2024-05-09T09:49:35.166157+0000","last_undegraded":"2024-05-09T09:49:35.166157+0000","last_fullsized":"2024-05-09T09:49:35.166157+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'8","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:30.172409+0000","last_change":"2024-05-09T09:47:14.184937+0000","last_active":"2024-05-09T09:49:30.172409+0000","last_peered":"2024-05-09T09:49:30.172409+0000","last_clean":"2024-05-09T09:49:30.172409+0000","last_became_active":"2024-05-09T09:47:14.184593+0000","last_became_peered":"2024-05-09T09:47:14.184593+0000","last_unstale":"2024-05-09T09:49:30.172409+0000","last_undegraded":"2024-05-09T09:49:30.172409+0000","last_fullsized":"2024-05-09T09:49:30.172409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'8","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.760996+0000","last_change":"2024-05-09T09:47:12.211539+0000","last_active":"2024-05-09T09:50:32.760996+0000","last_peered":"2024-05-09T09:50:32.760996+0000","last_clean":"2024-05-09T09:50:32.760996+0000","last_became_active":"2024-05-09T09:47:12.207403+0000","last_became_peered":"2024-05-09T09:47:12.207403+0000","last_unstale":"2024-05-09T09:50:32.760996+0000","last_undegraded":"2024-05-09T09:50:32.760996+0000","last_fullsized":"2024-05-09T09:50:32.760996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":16,"num_write_kb":8838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:58.967828+0000","last_change":"2024-05-09T09:50:58.967885+0000","last_active":"2024-05-09T09:50:58.967828+0000","last_peered":"2024-05-09T09:50:58.967828+0000","last_clean":"2024-05-09T09:50:58.967828+0000","last_became_active":"2024-05-09T09:47:16.214607+0000","last_became_peered":"2024-05-09T09:47:16.214607+0000","last_unstale":"2024-05-09T09:50:58.967828+0000","last_undegraded":"2024-05-09T09:50:58.967828+0000","last_fullsized":"2024-05-09T09:50:58.967828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:58.967631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:58.967631+0000","last_clean_scrub_stamp":"2024-05-09T09:50:58.967631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:20.934359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'212","reported_seq":285,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:45.413740+0000","last_change":"2024-05-09T09:50:45.413815+0000","last_active":"2024-05-09T09:50:45.413740+0000","last_peered":"2024-05-09T09:50:45.413740+0000","last_clean":"2024-05-09T09:50:45.413740+0000","last_became_active":"2024-05-09T09:47:18.224893+0000","last_became_peered":"2024-05-09T09:47:18.224893+0000","last_unstale":"2024-05-09T09:50:45.413740+0000","last_undegraded":"2024-05-09T09:50:45.413740+0000","last_fullsized":"2024-05-09T09:50:45.413740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'212","last_scrub_stamp":"2024-05-09T09:50:45.413522+0000","last_deep_scrub":"32'212","last_deep_scrub_stamp":"2024-05-09T09:50:45.413522+0000","last_clean_scrub_stamp":"2024-05-09T09:50:45.413522+0000","objects_scrubbed":5,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:59:04.534534+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:46.831526+0000","last_change":"2024-05-09T09:50:46.831580+0000","last_active":"2024-05-09T09:50:46.831526+0000","last_peered":"2024-05-09T09:50:46.831526+0000","last_clean":"2024-05-09T09:50:46.831526+0000","last_became_active":"2024-05-09T09:47:20.228339+0000","last_became_peered":"2024-05-09T09:47:20.228339+0000","last_unstale":"2024-05-09T09:50:46.831526+0000","last_undegraded":"2024-05-09T09:50:46.831526+0000","last_fullsized":"2024-05-09T09:50:46.831526+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:46.831331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:46.831331+0000","last_clean_scrub_stamp":"2024-05-09T09:50:46.831331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:58:25.885349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.472013+0000","last_change":"2024-05-09T09:47:22.230031+0000","last_active":"2024-05-09T09:50:33.472013+0000","last_peered":"2024-05-09T09:50:33.472013+0000","last_clean":"2024-05-09T09:50:33.472013+0000","last_became_active":"2024-05-09T09:47:22.229193+0000","last_became_peered":"2024-05-09T09:47:22.229193+0000","last_unstale":"2024-05-09T09:50:33.472013+0000","last_undegraded":"2024-05-09T09:50:33.472013+0000","last_fullsized":"2024-05-09T09:50:33.472013+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'8","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.254255+0000","last_change":"2024-05-09T09:47:14.177074+0000","last_active":"2024-05-09T09:50:33.254255+0000","last_peered":"2024-05-09T09:50:33.254255+0000","last_clean":"2024-05-09T09:50:33.254255+0000","last_became_active":"2024-05-09T09:47:14.176717+0000","last_became_peered":"2024-05-09T09:47:14.176717+0000","last_unstale":"2024-05-09T09:50:33.254255+0000","last_undegraded":"2024-05-09T09:50:33.254255+0000","last_fullsized":"2024-05-09T09:50:33.254255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:30.164862+0000","last_change":"2024-05-09T09:47:12.205840+0000","last_active":"2024-05-09T09:49:30.164862+0000","last_peered":"2024-05-09T09:49:30.164862+0000","last_clean":"2024-05-09T09:49:30.164862+0000","last_became_active":"2024-05-09T09:47:12.204317+0000","last_became_peered":"2024-05-09T09:47:12.204317+0000","last_unstale":"2024-05-09T09:49:30.164862+0000","last_undegraded":"2024-05-09T09:49:30.164862+0000","last_fullsized":"2024-05-09T09:49:30.164862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.173560+0000","last_change":"2024-05-09T09:47:16.201348+0000","last_active":"2024-05-09T09:49:35.173560+0000","last_peered":"2024-05-09T09:49:35.173560+0000","last_clean":"2024-05-09T09:49:35.173560+0000","last_became_active":"2024-05-09T09:47:16.197031+0000","last_became_peered":"2024-05-09T09:47:16.197031+0000","last_unstale":"2024-05-09T09:49:35.173560+0000","last_undegraded":"2024-05-09T09:49:35.173560+0000","last_fullsized":"2024-05-09T09:49:35.173560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'113","reported_seq":169,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:46.341277+0000","last_change":"2024-05-09T09:50:46.341361+0000","last_active":"2024-05-09T09:50:46.341277+0000","last_peered":"2024-05-09T09:50:46.341277+0000","last_clean":"2024-05-09T09:50:46.341277+0000","last_became_active":"2024-05-09T09:47:18.215793+0000","last_became_peered":"2024-05-09T09:47:18.215793+0000","last_unstale":"2024-05-09T09:50:46.341277+0000","last_undegraded":"2024-05-09T09:50:46.341277+0000","last_fullsized":"2024-05-09T09:50:46.341277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'113","last_scrub_stamp":"2024-05-09T09:50:46.341062+0000","last_deep_scrub":"32'113","last_deep_scrub_stamp":"2024-05-09T09:50:46.341062+0000","last_clean_scrub_stamp":"2024-05-09T09:50:46.341062+0000","objects_scrubbed":5,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:24:06.850096+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.176228+0000","last_change":"2024-05-09T09:47:20.251219+0000","last_active":"2024-05-09T09:49:35.176228+0000","last_peered":"2024-05-09T09:49:35.176228+0000","last_clean":"2024-05-09T09:49:35.176228+0000","last_became_active":"2024-05-09T09:47:20.250363+0000","last_became_peered":"2024-05-09T09:47:20.250363+0000","last_unstale":"2024-05-09T09:49:35.176228+0000","last_undegraded":"2024-05-09T09:49:35.176228+0000","last_fullsized":"2024-05-09T09:49:35.176228+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.413568+0000","last_change":"2024-05-09T09:47:22.243140+0000","last_active":"2024-05-09T09:50:33.413568+0000","last_peered":"2024-05-09T09:50:33.413568+0000","last_clean":"2024-05-09T09:50:33.413568+0000","last_became_active":"2024-05-09T09:47:22.242410+0000","last_became_peered":"2024-05-09T09:47:22.242410+0000","last_unstale":"2024-05-09T09:50:33.413568+0000","last_undegraded":"2024-05-09T09:50:33.413568+0000","last_fullsized":"2024-05-09T09:50:33.413568+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:30.174814+0000","last_change":"2024-05-09T09:47:14.190653+0000","last_active":"2024-05-09T09:49:30.174814+0000","last_peered":"2024-05-09T09:49:30.174814+0000","last_clean":"2024-05-09T09:49:30.174814+0000","last_became_active":"2024-05-09T09:47:14.190016+0000","last_became_peered":"2024-05-09T09:47:14.190016+0000","last_unstale":"2024-05-09T09:49:30.174814+0000","last_undegraded":"2024-05-09T09:49:30.174814+0000","last_fullsized":"2024-05-09T09:49:30.174814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.173788+0000","last_change":"2024-05-09T09:47:12.212155+0000","last_active":"2024-05-09T09:49:25.173788+0000","last_peered":"2024-05-09T09:49:25.173788+0000","last_clean":"2024-05-09T09:49:25.173788+0000","last_became_active":"2024-05-09T09:47:12.211221+0000","last_became_peered":"2024-05-09T09:47:12.211221+0000","last_unstale":"2024-05-09T09:49:25.173788+0000","last_undegraded":"2024-05-09T09:49:25.173788+0000","last_fullsized":"2024-05-09T09:49:25.173788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:00.977401+0000","last_change":"2024-05-09T09:51:00.977458+0000","last_active":"2024-05-09T09:51:00.977401+0000","last_peered":"2024-05-09T09:51:00.977401+0000","last_clean":"2024-05-09T09:51:00.977401+0000","last_became_active":"2024-05-09T09:47:16.214462+0000","last_became_peered":"2024-05-09T09:47:16.214462+0000","last_unstale":"2024-05-09T09:51:00.977401+0000","last_undegraded":"2024-05-09T09:51:00.977401+0000","last_fullsized":"2024-05-09T09:51:00.977401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:00.977167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:00.977167+0000","last_clean_scrub_stamp":"2024-05-09T09:51:00.977167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:59:20.098179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'119","reported_seq":177,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:57.261189+0000","last_change":"2024-05-09T09:50:57.261272+0000","last_active":"2024-05-09T09:50:57.261189+0000","last_peered":"2024-05-09T09:50:57.261189+0000","last_clean":"2024-05-09T09:50:57.261189+0000","last_became_active":"2024-05-09T09:47:18.212543+0000","last_became_peered":"2024-05-09T09:47:18.212543+0000","last_unstale":"2024-05-09T09:50:57.261189+0000","last_undegraded":"2024-05-09T09:50:57.261189+0000","last_fullsized":"2024-05-09T09:50:57.261189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-05-09T09:50:57.261002+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-05-09T09:50:57.261002+0000","last_clean_scrub_stamp":"2024-05-09T09:50:57.261002+0000","objects_scrubbed":7,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:26:30.185703+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":445,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:45.121613+0000","last_change":"2024-05-09T09:50:45.121680+0000","last_active":"2024-05-09T09:50:45.121613+0000","last_peered":"2024-05-09T09:50:45.121613+0000","last_clean":"2024-05-09T09:50:45.121613+0000","last_became_active":"2024-05-09T09:47:20.240236+0000","last_became_peered":"2024-05-09T09:47:20.240236+0000","last_unstale":"2024-05-09T09:50:45.121613+0000","last_undegraded":"2024-05-09T09:50:45.121613+0000","last_fullsized":"2024-05-09T09:50:45.121613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:45.121417+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:45.121417+0000","last_clean_scrub_stamp":"2024-05-09T09:50:45.121417+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:31:47.109285+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'14","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.417897+0000","last_change":"2024-05-09T09:47:22.258681+0000","last_active":"2024-05-09T09:50:33.417897+0000","last_peered":"2024-05-09T09:50:33.417897+0000","last_clean":"2024-05-09T09:50:33.417897+0000","last_became_active":"2024-05-09T09:47:22.257986+0000","last_became_peered":"2024-05-09T09:47:22.257986+0000","last_unstale":"2024-05-09T09:50:33.417897+0000","last_undegraded":"2024-05-09T09:50:33.417897+0000","last_fullsized":"2024-05-09T09:50:33.417897+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.253436+0000","last_change":"2024-05-09T09:47:14.173042+0000","last_active":"2024-05-09T09:50:33.253436+0000","last_peered":"2024-05-09T09:50:33.253436+0000","last_clean":"2024-05-09T09:50:33.253436+0000","last_became_active":"2024-05-09T09:47:14.171963+0000","last_became_peered":"2024-05-09T09:47:14.171963+0000","last_unstale":"2024-05-09T09:50:33.253436+0000","last_undegraded":"2024-05-09T09:50:33.253436+0000","last_fullsized":"2024-05-09T09:50:33.253436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.173696+0000","last_change":"2024-05-09T09:47:12.211112+0000","last_active":"2024-05-09T09:49:25.173696+0000","last_peered":"2024-05-09T09:49:25.173696+0000","last_clean":"2024-05-09T09:49:25.173696+0000","last_became_active":"2024-05-09T09:47:12.204519+0000","last_became_peered":"2024-05-09T09:47:12.204519+0000","last_unstale":"2024-05-09T09:49:25.173696+0000","last_undegraded":"2024-05-09T09:49:25.173696+0000","last_fullsized":"2024-05-09T09:49:25.173696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":428,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:55.290515+0000","last_change":"2024-05-09T09:50:55.290590+0000","last_active":"2024-05-09T09:50:55.290515+0000","last_peered":"2024-05-09T09:50:55.290515+0000","last_clean":"2024-05-09T09:50:55.290515+0000","last_became_active":"2024-05-09T09:47:16.210812+0000","last_became_peered":"2024-05-09T09:47:16.210812+0000","last_unstale":"2024-05-09T09:50:55.290515+0000","last_undegraded":"2024-05-09T09:50:55.290515+0000","last_fullsized":"2024-05-09T09:50:55.290515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-09T09:50:55.290303+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-09T09:50:55.290303+0000","last_clean_scrub_stamp":"2024-05-09T09:50:55.290303+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:23:31.095926+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:46.428538+0000","last_change":"2024-05-09T09:50:46.428614+0000","last_active":"2024-05-09T09:50:46.428538+0000","last_peered":"2024-05-09T09:50:46.428538+0000","last_clean":"2024-05-09T09:50:46.428538+0000","last_became_active":"2024-05-09T09:47:18.224565+0000","last_became_peered":"2024-05-09T09:47:18.224565+0000","last_unstale":"2024-05-09T09:50:46.428538+0000","last_undegraded":"2024-05-09T09:50:46.428538+0000","last_fullsized":"2024-05-09T09:50:46.428538+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-09T09:50:46.428349+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-09T09:50:46.428349+0000","last_clean_scrub_stamp":"2024-05-09T09:50:46.428349+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:10:30.696710+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":482,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.298607+0000","last_change":"2024-05-09T09:50:44.298675+0000","last_active":"2024-05-09T09:50:44.298607+0000","last_peered":"2024-05-09T09:50:44.298607+0000","last_clean":"2024-05-09T09:50:44.298607+0000","last_became_active":"2024-05-09T09:47:20.214337+0000","last_became_peered":"2024-05-09T09:47:20.214337+0000","last_unstale":"2024-05-09T09:50:44.298607+0000","last_undegraded":"2024-05-09T09:50:44.298607+0000","last_fullsized":"2024-05-09T09:50:44.298607+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:44.298414+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:44.298414+0000","last_clean_scrub_stamp":"2024-05-09T09:50:44.298414+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:00:15.815268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:31.800331+0000","last_change":"2024-05-09T09:47:22.235441+0000","last_active":"2024-05-09T09:49:31.800331+0000","last_peered":"2024-05-09T09:49:31.800331+0000","last_clean":"2024-05-09T09:49:31.800331+0000","last_became_active":"2024-05-09T09:47:22.233796+0000","last_became_peered":"2024-05-09T09:47:22.233796+0000","last_unstale":"2024-05-09T09:49:31.800331+0000","last_undegraded":"2024-05-09T09:49:31.800331+0000","last_fullsized":"2024-05-09T09:49:31.800331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.186084+0000","last_change":"2024-05-09T09:47:14.175270+0000","last_active":"2024-05-09T09:49:32.186084+0000","last_peered":"2024-05-09T09:49:32.186084+0000","last_clean":"2024-05-09T09:49:32.186084+0000","last_became_active":"2024-05-09T09:47:14.174707+0000","last_became_peered":"2024-05-09T09:47:14.174707+0000","last_unstale":"2024-05-09T09:49:32.186084+0000","last_undegraded":"2024-05-09T09:49:32.186084+0000","last_fullsized":"2024-05-09T09:49:32.186084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.173604+0000","last_change":"2024-05-09T09:47:12.208521+0000","last_active":"2024-05-09T09:49:25.173604+0000","last_peered":"2024-05-09T09:49:25.173604+0000","last_clean":"2024-05-09T09:49:25.173604+0000","last_became_active":"2024-05-09T09:47:12.207874+0000","last_became_peered":"2024-05-09T09:47:12.207874+0000","last_unstale":"2024-05-09T09:49:25.173604+0000","last_undegraded":"2024-05-09T09:49:25.173604+0000","last_fullsized":"2024-05-09T09:49:25.173604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"32'2","reported_seq":230,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:48.457895+0000","last_change":"2024-05-09T09:50:48.457964+0000","last_active":"2024-05-09T09:50:48.457895+0000","last_peered":"2024-05-09T09:50:48.457895+0000","last_clean":"2024-05-09T09:50:48.457895+0000","last_became_active":"2024-05-09T09:47:16.204577+0000","last_became_peered":"2024-05-09T09:47:16.204577+0000","last_unstale":"2024-05-09T09:50:48.457895+0000","last_undegraded":"2024-05-09T09:50:48.457895+0000","last_fullsized":"2024-05-09T09:50:48.457895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:50:48.457704+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:50:48.457704+0000","last_clean_scrub_stamp":"2024-05-09T09:50:48.457704+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:20:14.267139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'122","reported_seq":181,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:50.360778+0000","last_change":"2024-05-09T09:50:50.360866+0000","last_active":"2024-05-09T09:50:50.360778+0000","last_peered":"2024-05-09T09:50:50.360778+0000","last_clean":"2024-05-09T09:50:50.360778+0000","last_became_active":"2024-05-09T09:47:18.204057+0000","last_became_peered":"2024-05-09T09:47:18.204057+0000","last_unstale":"2024-05-09T09:50:50.360778+0000","last_undegraded":"2024-05-09T09:50:50.360778+0000","last_fullsized":"2024-05-09T09:50:50.360778+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'122","last_scrub_stamp":"2024-05-09T09:50:50.360552+0000","last_deep_scrub":"32'122","last_deep_scrub_stamp":"2024-05-09T09:50:50.360552+0000","last_clean_scrub_stamp":"2024-05-09T09:50:50.360552+0000","objects_scrubbed":8,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:58:29.414570+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:50.194469+0000","last_change":"2024-05-09T09:50:50.194527+0000","last_active":"2024-05-09T09:50:50.194469+0000","last_peered":"2024-05-09T09:50:50.194469+0000","last_clean":"2024-05-09T09:50:50.194469+0000","last_became_active":"2024-05-09T09:47:20.255477+0000","last_became_peered":"2024-05-09T09:47:20.255477+0000","last_unstale":"2024-05-09T09:50:50.194469+0000","last_undegraded":"2024-05-09T09:50:50.194469+0000","last_fullsized":"2024-05-09T09:50:50.194469+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:50.194227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:50.194227+0000","last_clean_scrub_stamp":"2024-05-09T09:50:50.194227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:40:06.186113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'8","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.467369+0000","last_change":"2024-05-09T09:47:22.228107+0000","last_active":"2024-05-09T09:50:33.467369+0000","last_peered":"2024-05-09T09:50:33.467369+0000","last_clean":"2024-05-09T09:50:33.467369+0000","last_became_active":"2024-05-09T09:47:22.227373+0000","last_became_peered":"2024-05-09T09:47:22.227373+0000","last_unstale":"2024-05-09T09:50:33.467369+0000","last_undegraded":"2024-05-09T09:50:33.467369+0000","last_fullsized":"2024-05-09T09:50:33.467369+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'7","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.405209+0000","last_change":"2024-05-09T09:47:14.189976+0000","last_active":"2024-05-09T09:50:33.405209+0000","last_peered":"2024-05-09T09:50:33.405209+0000","last_clean":"2024-05-09T09:50:33.405209+0000","last_became_active":"2024-05-09T09:47:14.189623+0000","last_became_peered":"2024-05-09T09:47:14.189623+0000","last_unstale":"2024-05-09T09:50:33.405209+0000","last_undegraded":"2024-05-09T09:50:33.405209+0000","last_fullsized":"2024-05-09T09:50:33.405209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":204,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:43.753842+0000","last_change":"2024-05-09T09:46:57.510904+0000","last_active":"2024-05-09T09:50:43.753842+0000","last_peered":"2024-05-09T09:50:43.753842+0000","last_clean":"2024-05-09T09:50:43.753842+0000","last_became_active":"2024-05-09T09:46:57.508178+0000","last_became_peered":"2024-05-09T09:46:57.508178+0000","last_unstale":"2024-05-09T09:50:43.753842+0000","last_undegraded":"2024-05-09T09:50:43.753842+0000","last_fullsized":"2024-05-09T09:50:43.753842+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:46:56.015260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:46:56.015260+0000","last_clean_scrub_stamp":"2024-05-09T09:46:56.015260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:10.169818+0000","last_change":"2024-05-09T09:47:03.054623+0000","last_active":"2024-05-09T09:49:10.169818+0000","last_peered":"2024-05-09T09:49:10.169818+0000","last_clean":"2024-05-09T09:49:10.169818+0000","last_became_active":"2024-05-09T09:47:03.053783+0000","last_became_peered":"2024-05-09T09:47:03.053783+0000","last_unstale":"2024-05-09T09:49:10.169818+0000","last_undegraded":"2024-05-09T09:49:10.169818+0000","last_fullsized":"2024-05-09T09:49:10.169818+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.172320+0000","last_change":"2024-05-09T09:47:12.212397+0000","last_active":"2024-05-09T09:49:20.172320+0000","last_peered":"2024-05-09T09:49:20.172320+0000","last_clean":"2024-05-09T09:49:20.172320+0000","last_became_active":"2024-05-09T09:47:12.211344+0000","last_became_peered":"2024-05-09T09:47:12.211344+0000","last_unstale":"2024-05-09T09:49:20.172320+0000","last_undegraded":"2024-05-09T09:49:20.172320+0000","last_fullsized":"2024-05-09T09:49:20.172320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:57.277858+0000","last_change":"2024-05-09T09:50:57.277911+0000","last_active":"2024-05-09T09:50:57.277858+0000","last_peered":"2024-05-09T09:50:57.277858+0000","last_clean":"2024-05-09T09:50:57.277858+0000","last_became_active":"2024-05-09T09:47:16.210404+0000","last_became_peered":"2024-05-09T09:47:16.210404+0000","last_unstale":"2024-05-09T09:50:57.277858+0000","last_undegraded":"2024-05-09T09:50:57.277858+0000","last_fullsized":"2024-05-09T09:50:57.277858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:57.277661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:57.277661+0000","last_clean_scrub_stamp":"2024-05-09T09:50:57.277661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:35:39.302436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'307","reported_seq":389,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.188277+0000","last_change":"2024-05-09T09:47:18.237058+0000","last_active":"2024-05-09T09:50:40.188277+0000","last_peered":"2024-05-09T09:50:40.188277+0000","last_clean":"2024-05-09T09:50:40.188277+0000","last_became_active":"2024-05-09T09:47:18.236370+0000","last_became_peered":"2024-05-09T09:47:18.236370+0000","last_unstale":"2024-05-09T09:50:40.188277+0000","last_undegraded":"2024-05-09T09:50:40.188277+0000","last_fullsized":"2024-05-09T09:50:40.188277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:53.880308+0000","last_change":"2024-05-09T09:50:53.880361+0000","last_active":"2024-05-09T09:50:53.880308+0000","last_peered":"2024-05-09T09:50:53.880308+0000","last_clean":"2024-05-09T09:50:53.880308+0000","last_became_active":"2024-05-09T09:47:20.250373+0000","last_became_peered":"2024-05-09T09:47:20.250373+0000","last_unstale":"2024-05-09T09:50:53.880308+0000","last_undegraded":"2024-05-09T09:50:53.880308+0000","last_fullsized":"2024-05-09T09:50:53.880308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:53.880117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:53.880117+0000","last_clean_scrub_stamp":"2024-05-09T09:50:53.880117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:35:35.904892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'86","reported_seq":170,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.340073+0000","last_change":"2024-05-09T09:47:22.237003+0000","last_active":"2024-05-09T09:50:33.340073+0000","last_peered":"2024-05-09T09:50:33.340073+0000","last_clean":"2024-05-09T09:50:33.340073+0000","last_became_active":"2024-05-09T09:47:22.236267+0000","last_became_peered":"2024-05-09T09:47:22.236267+0000","last_unstale":"2024-05-09T09:50:33.340073+0000","last_undegraded":"2024-05-09T09:50:33.340073+0000","last_fullsized":"2024-05-09T09:50:33.340073+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":223,"num_write":170,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.173979+0000","last_change":"2024-05-09T09:47:14.185397+0000","last_active":"2024-05-09T09:49:25.173979+0000","last_peered":"2024-05-09T09:49:25.173979+0000","last_clean":"2024-05-09T09:49:25.173979+0000","last_became_active":"2024-05-09T09:47:14.185071+0000","last_became_peered":"2024-05-09T09:47:14.185071+0000","last_unstale":"2024-05-09T09:49:25.173979+0000","last_undegraded":"2024-05-09T09:49:25.173979+0000","last_fullsized":"2024-05-09T09:49:25.173979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:05.168350+0000","last_change":"2024-05-09T09:47:03.051628+0000","last_active":"2024-05-09T09:49:05.168350+0000","last_peered":"2024-05-09T09:49:05.168350+0000","last_clean":"2024-05-09T09:49:05.168350+0000","last_became_active":"2024-05-09T09:47:03.050535+0000","last_became_peered":"2024-05-09T09:47:03.050535+0000","last_unstale":"2024-05-09T09:49:05.168350+0000","last_undegraded":"2024-05-09T09:49:05.168350+0000","last_fullsized":"2024-05-09T09:49:05.168350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.162167+0000","last_change":"2024-05-09T09:47:12.206331+0000","last_active":"2024-05-09T09:49:20.162167+0000","last_peered":"2024-05-09T09:49:20.162167+0000","last_clean":"2024-05-09T09:49:20.162167+0000","last_became_active":"2024-05-09T09:47:12.203494+0000","last_became_peered":"2024-05-09T09:47:12.203494+0000","last_unstale":"2024-05-09T09:49:20.162167+0000","last_undegraded":"2024-05-09T09:49:20.162167+0000","last_fullsized":"2024-05-09T09:49:20.162167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:50.508717+0000","last_change":"2024-05-09T09:50:50.508773+0000","last_active":"2024-05-09T09:50:50.508717+0000","last_peered":"2024-05-09T09:50:50.508717+0000","last_clean":"2024-05-09T09:50:50.508717+0000","last_became_active":"2024-05-09T09:47:16.200369+0000","last_became_peered":"2024-05-09T09:47:16.200369+0000","last_unstale":"2024-05-09T09:50:50.508717+0000","last_undegraded":"2024-05-09T09:50:50.508717+0000","last_fullsized":"2024-05-09T09:50:50.508717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:50.508517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:50.508517+0000","last_clean_scrub_stamp":"2024-05-09T09:50:50.508517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:03:35.673628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'512","reported_seq":739,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:45.298073+0000","last_change":"2024-05-09T09:50:45.298265+0000","last_active":"2024-05-09T09:50:45.298073+0000","last_peered":"2024-05-09T09:50:45.298073+0000","last_clean":"2024-05-09T09:50:45.298073+0000","last_became_active":"2024-05-09T09:47:18.219321+0000","last_became_peered":"2024-05-09T09:47:18.219321+0000","last_unstale":"2024-05-09T09:50:45.298073+0000","last_undegraded":"2024-05-09T09:50:45.298073+0000","last_fullsized":"2024-05-09T09:50:45.298073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'512","last_scrub_stamp":"2024-05-09T09:50:45.297859+0000","last_deep_scrub":"32'512","last_deep_scrub_stamp":"2024-05-09T09:50:45.297859+0000","last_clean_scrub_stamp":"2024-05-09T09:50:45.297859+0000","objects_scrubbed":10,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:39:29.985192+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.173867+0000","last_change":"2024-05-09T09:47:20.249740+0000","last_active":"2024-05-09T09:49:25.173867+0000","last_peered":"2024-05-09T09:49:25.173867+0000","last_clean":"2024-05-09T09:49:25.173867+0000","last_became_active":"2024-05-09T09:47:20.249089+0000","last_became_peered":"2024-05-09T09:47:20.249089+0000","last_unstale":"2024-05-09T09:49:25.173867+0000","last_undegraded":"2024-05-09T09:49:25.173867+0000","last_fullsized":"2024-05-09T09:49:25.173867+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.176388+0000","last_change":"2024-05-09T09:47:22.245460+0000","last_active":"2024-05-09T09:49:35.176388+0000","last_peered":"2024-05-09T09:49:35.176388+0000","last_clean":"2024-05-09T09:49:35.176388+0000","last_became_active":"2024-05-09T09:47:22.244543+0000","last_became_peered":"2024-05-09T09:47:22.244543+0000","last_unstale":"2024-05-09T09:49:35.176388+0000","last_undegraded":"2024-05-09T09:49:35.176388+0000","last_fullsized":"2024-05-09T09:49:35.176388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.170754+0000","last_change":"2024-05-09T09:47:14.177030+0000","last_active":"2024-05-09T09:50:33.170754+0000","last_peered":"2024-05-09T09:50:33.170754+0000","last_clean":"2024-05-09T09:50:33.170754+0000","last_became_active":"2024-05-09T09:47:14.173959+0000","last_became_peered":"2024-05-09T09:47:14.173959+0000","last_unstale":"2024-05-09T09:50:33.170754+0000","last_undegraded":"2024-05-09T09:50:33.170754+0000","last_fullsized":"2024-05-09T09:50:33.170754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:05.166689+0000","last_change":"2024-05-09T09:47:03.052957+0000","last_active":"2024-05-09T09:49:05.166689+0000","last_peered":"2024-05-09T09:49:05.166689+0000","last_clean":"2024-05-09T09:49:05.166689+0000","last_became_active":"2024-05-09T09:47:03.052185+0000","last_became_peered":"2024-05-09T09:47:03.052185+0000","last_unstale":"2024-05-09T09:49:05.166689+0000","last_undegraded":"2024-05-09T09:49:05.166689+0000","last_fullsized":"2024-05-09T09:49:05.166689+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.110565+0000","last_change":"2024-05-09T09:47:12.186149+0000","last_active":"2024-05-09T09:50:33.110565+0000","last_peered":"2024-05-09T09:50:33.110565+0000","last_clean":"2024-05-09T09:50:33.110565+0000","last_became_active":"2024-05-09T09:47:12.183846+0000","last_became_peered":"2024-05-09T09:47:12.183846+0000","last_unstale":"2024-05-09T09:50:33.110565+0000","last_undegraded":"2024-05-09T09:50:33.110565+0000","last_fullsized":"2024-05-09T09:50:33.110565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:30.172473+0000","last_change":"2024-05-09T09:47:16.202023+0000","last_active":"2024-05-09T09:49:30.172473+0000","last_peered":"2024-05-09T09:49:30.172473+0000","last_clean":"2024-05-09T09:49:30.172473+0000","last_became_active":"2024-05-09T09:47:16.197380+0000","last_became_peered":"2024-05-09T09:47:16.197380+0000","last_unstale":"2024-05-09T09:49:30.172473+0000","last_undegraded":"2024-05-09T09:49:30.172473+0000","last_fullsized":"2024-05-09T09:49:30.172473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'25","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:53.285883+0000","last_change":"2024-05-09T09:50:53.286054+0000","last_active":"2024-05-09T09:50:53.285883+0000","last_peered":"2024-05-09T09:50:53.285883+0000","last_clean":"2024-05-09T09:50:53.285883+0000","last_became_active":"2024-05-09T09:47:18.217023+0000","last_became_peered":"2024-05-09T09:47:18.217023+0000","last_unstale":"2024-05-09T09:50:53.285883+0000","last_undegraded":"2024-05-09T09:50:53.285883+0000","last_fullsized":"2024-05-09T09:50:53.285883+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2024-05-09T09:50:53.285640+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2024-05-09T09:50:53.285640+0000","last_clean_scrub_stamp":"2024-05-09T09:50:53.285640+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:56:02.284410+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:57.982132+0000","last_change":"2024-05-09T09:50:57.982184+0000","last_active":"2024-05-09T09:50:57.982132+0000","last_peered":"2024-05-09T09:50:57.982132+0000","last_clean":"2024-05-09T09:50:57.982132+0000","last_became_active":"2024-05-09T09:47:20.250979+0000","last_became_peered":"2024-05-09T09:47:20.250979+0000","last_unstale":"2024-05-09T09:50:57.982132+0000","last_undegraded":"2024-05-09T09:50:57.982132+0000","last_fullsized":"2024-05-09T09:50:57.982132+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:57.981939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:57.981939+0000","last_clean_scrub_stamp":"2024-05-09T09:50:57.981939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:20:07.343476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.177467+0000","last_change":"2024-05-09T09:47:22.264183+0000","last_active":"2024-05-09T09:49:40.177467+0000","last_peered":"2024-05-09T09:49:40.177467+0000","last_clean":"2024-05-09T09:49:40.177467+0000","last_became_active":"2024-05-09T09:47:22.263615+0000","last_became_peered":"2024-05-09T09:47:22.263615+0000","last_unstale":"2024-05-09T09:49:40.177467+0000","last_undegraded":"2024-05-09T09:49:40.177467+0000","last_fullsized":"2024-05-09T09:49:40.177467+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.162362+0000","last_change":"2024-05-09T09:47:14.190245+0000","last_active":"2024-05-09T09:49:20.162362+0000","last_peered":"2024-05-09T09:49:20.162362+0000","last_clean":"2024-05-09T09:49:20.162362+0000","last_became_active":"2024-05-09T09:47:14.188644+0000","last_became_peered":"2024-05-09T09:47:14.188644+0000","last_unstale":"2024-05-09T09:49:20.162362+0000","last_undegraded":"2024-05-09T09:49:20.162362+0000","last_fullsized":"2024-05-09T09:49:20.162362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:10.169706+0000","last_change":"2024-05-09T09:47:03.051760+0000","last_active":"2024-05-09T09:49:10.169706+0000","last_peered":"2024-05-09T09:49:10.169706+0000","last_clean":"2024-05-09T09:49:10.169706+0000","last_became_active":"2024-05-09T09:47:03.050832+0000","last_became_peered":"2024-05-09T09:47:03.050832+0000","last_unstale":"2024-05-09T09:49:10.169706+0000","last_undegraded":"2024-05-09T09:49:10.169706+0000","last_fullsized":"2024-05-09T09:49:10.169706+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.170101+0000","last_change":"2024-05-09T09:47:12.191109+0000","last_active":"2024-05-09T09:49:20.170101+0000","last_peered":"2024-05-09T09:49:20.170101+0000","last_clean":"2024-05-09T09:49:20.170101+0000","last_became_active":"2024-05-09T09:47:12.190521+0000","last_became_peered":"2024-05-09T09:47:12.190521+0000","last_unstale":"2024-05-09T09:49:20.170101+0000","last_undegraded":"2024-05-09T09:49:20.170101+0000","last_fullsized":"2024-05-09T09:49:20.170101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.163552+0000","last_change":"2024-05-09T09:47:16.189464+0000","last_active":"2024-05-09T09:49:25.163552+0000","last_peered":"2024-05-09T09:49:25.163552+0000","last_clean":"2024-05-09T09:49:25.163552+0000","last_became_active":"2024-05-09T09:47:16.187120+0000","last_became_peered":"2024-05-09T09:47:16.187120+0000","last_unstale":"2024-05-09T09:49:25.163552+0000","last_undegraded":"2024-05-09T09:49:25.163552+0000","last_fullsized":"2024-05-09T09:49:25.163552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'21","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:49.497507+0000","last_change":"2024-05-09T09:50:49.497580+0000","last_active":"2024-05-09T09:50:49.497507+0000","last_peered":"2024-05-09T09:50:49.497507+0000","last_clean":"2024-05-09T09:50:49.497507+0000","last_became_active":"2024-05-09T09:47:18.230757+0000","last_became_peered":"2024-05-09T09:47:18.230757+0000","last_unstale":"2024-05-09T09:50:49.497507+0000","last_undegraded":"2024-05-09T09:50:49.497507+0000","last_fullsized":"2024-05-09T09:50:49.497507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-05-09T09:50:49.497309+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-05-09T09:50:49.497309+0000","last_clean_scrub_stamp":"2024-05-09T09:50:49.497309+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:00:57.562854+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:30.174859+0000","last_change":"2024-05-09T09:47:20.250439+0000","last_active":"2024-05-09T09:49:30.174859+0000","last_peered":"2024-05-09T09:49:30.174859+0000","last_clean":"2024-05-09T09:49:30.174859+0000","last_became_active":"2024-05-09T09:47:20.249919+0000","last_became_peered":"2024-05-09T09:47:20.249919+0000","last_unstale":"2024-05-09T09:49:30.174859+0000","last_undegraded":"2024-05-09T09:49:30.174859+0000","last_fullsized":"2024-05-09T09:49:30.174859+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.176243+0000","last_change":"2024-05-09T09:47:22.260930+0000","last_active":"2024-05-09T09:49:35.176243+0000","last_peered":"2024-05-09T09:49:35.176243+0000","last_clean":"2024-05-09T09:49:35.176243+0000","last_became_active":"2024-05-09T09:47:22.259833+0000","last_became_peered":"2024-05-09T09:47:22.259833+0000","last_unstale":"2024-05-09T09:49:35.176243+0000","last_undegraded":"2024-05-09T09:49:35.176243+0000","last_fullsized":"2024-05-09T09:49:35.176243+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.826913+0000","last_change":"2024-05-09T09:47:14.174110+0000","last_active":"2024-05-09T09:50:32.826913+0000","last_peered":"2024-05-09T09:50:32.826913+0000","last_clean":"2024-05-09T09:50:32.826913+0000","last_became_active":"2024-05-09T09:47:14.173535+0000","last_became_peered":"2024-05-09T09:47:14.173535+0000","last_unstale":"2024-05-09T09:50:32.826913+0000","last_undegraded":"2024-05-09T09:50:32.826913+0000","last_fullsized":"2024-05-09T09:50:32.826913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.170160+0000","last_change":"2024-05-09T09:47:12.195767+0000","last_active":"2024-05-09T09:49:20.170160+0000","last_peered":"2024-05-09T09:49:20.170160+0000","last_clean":"2024-05-09T09:49:20.170160+0000","last_became_active":"2024-05-09T09:47:12.194500+0000","last_became_peered":"2024-05-09T09:47:12.194500+0000","last_unstale":"2024-05-09T09:49:20.170160+0000","last_undegraded":"2024-05-09T09:49:20.170160+0000","last_fullsized":"2024-05-09T09:49:20.170160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:10.160057+0000","last_change":"2024-05-09T09:47:03.051513+0000","last_active":"2024-05-09T09:49:10.160057+0000","last_peered":"2024-05-09T09:49:10.160057+0000","last_clean":"2024-05-09T09:49:10.160057+0000","last_became_active":"2024-05-09T09:47:03.051159+0000","last_became_peered":"2024-05-09T09:47:03.051159+0000","last_unstale":"2024-05-09T09:49:10.160057+0000","last_undegraded":"2024-05-09T09:49:10.160057+0000","last_fullsized":"2024-05-09T09:49:10.160057+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'7","reported_seq":241,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:05.017289+0000","last_change":"2024-05-09T09:51:05.017370+0000","last_active":"2024-05-09T09:51:05.017289+0000","last_peered":"2024-05-09T09:51:05.017289+0000","last_clean":"2024-05-09T09:51:05.017289+0000","last_became_active":"2024-05-09T09:47:16.198233+0000","last_became_peered":"2024-05-09T09:47:16.198233+0000","last_unstale":"2024-05-09T09:51:05.017289+0000","last_undegraded":"2024-05-09T09:51:05.017289+0000","last_fullsized":"2024-05-09T09:51:05.017289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-05-09T09:51:05.017095+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-05-09T09:51:05.017095+0000","last_clean_scrub_stamp":"2024-05-09T09:51:05.017095+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:53:06.632153+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1180,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":302,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'221","reported_seq":297,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:56.950855+0000","last_change":"2024-05-09T09:50:56.950939+0000","last_active":"2024-05-09T09:50:56.950855+0000","last_peered":"2024-05-09T09:50:56.950855+0000","last_clean":"2024-05-09T09:50:56.950855+0000","last_became_active":"2024-05-09T09:47:18.199411+0000","last_became_peered":"2024-05-09T09:47:18.199411+0000","last_unstale":"2024-05-09T09:50:56.950855+0000","last_undegraded":"2024-05-09T09:50:56.950855+0000","last_fullsized":"2024-05-09T09:50:56.950855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'221","last_scrub_stamp":"2024-05-09T09:50:56.950671+0000","last_deep_scrub":"32'221","last_deep_scrub_stamp":"2024-05-09T09:50:56.950671+0000","last_clean_scrub_stamp":"2024-05-09T09:50:56.950671+0000","objects_scrubbed":9,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:44:33.387528+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:48.114287+0000","last_change":"2024-05-09T09:50:48.114403+0000","last_active":"2024-05-09T09:50:48.114287+0000","last_peered":"2024-05-09T09:50:48.114287+0000","last_clean":"2024-05-09T09:50:48.114287+0000","last_became_active":"2024-05-09T09:47:20.233024+0000","last_became_peered":"2024-05-09T09:47:20.233024+0000","last_unstale":"2024-05-09T09:50:48.114287+0000","last_undegraded":"2024-05-09T09:50:48.114287+0000","last_fullsized":"2024-05-09T09:50:48.114287+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:48.114039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:48.114039+0000","last_clean_scrub_stamp":"2024-05-09T09:50:48.114039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:03.759841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'11","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.167361+0000","last_change":"2024-05-09T09:47:22.229611+0000","last_active":"2024-05-09T09:49:40.167361+0000","last_peered":"2024-05-09T09:49:40.167361+0000","last_clean":"2024-05-09T09:49:40.167361+0000","last_became_active":"2024-05-09T09:47:22.228855+0000","last_became_peered":"2024-05-09T09:47:22.228855+0000","last_unstale":"2024-05-09T09:49:40.167361+0000","last_undegraded":"2024-05-09T09:49:40.167361+0000","last_fullsized":"2024-05-09T09:49:40.167361+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'12","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.320726+0000","last_change":"2024-05-09T09:47:52.440285+0000","last_active":"2024-05-09T09:50:33.320726+0000","last_peered":"2024-05-09T09:50:33.320726+0000","last_clean":"2024-05-09T09:50:33.320726+0000","last_became_active":"2024-05-09T09:47:52.430912+0000","last_became_peered":"2024-05-09T09:47:52.430912+0000","last_unstale":"2024-05-09T09:50:33.320726+0000","last_undegraded":"2024-05-09T09:50:33.320726+0000","last_fullsized":"2024-05-09T09:50:33.320726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.162334+0000","last_change":"2024-05-09T09:47:12.190681+0000","last_active":"2024-05-09T09:49:20.162334+0000","last_peered":"2024-05-09T09:49:20.162334+0000","last_clean":"2024-05-09T09:49:20.162334+0000","last_became_active":"2024-05-09T09:47:12.189486+0000","last_became_peered":"2024-05-09T09:47:12.189486+0000","last_unstale":"2024-05-09T09:49:20.162334+0000","last_undegraded":"2024-05-09T09:49:20.162334+0000","last_fullsized":"2024-05-09T09:49:20.162334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:10.169909+0000","last_change":"2024-05-09T09:47:03.051225+0000","last_active":"2024-05-09T09:49:10.169909+0000","last_peered":"2024-05-09T09:49:10.169909+0000","last_clean":"2024-05-09T09:49:10.169909+0000","last_became_active":"2024-05-09T09:47:03.050600+0000","last_became_peered":"2024-05-09T09:47:03.050600+0000","last_unstale":"2024-05-09T09:49:10.169909+0000","last_undegraded":"2024-05-09T09:49:10.169909+0000","last_fullsized":"2024-05-09T09:49:10.169909+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:54.486437+0000","last_change":"2024-05-09T09:50:54.486490+0000","last_active":"2024-05-09T09:50:54.486437+0000","last_peered":"2024-05-09T09:50:54.486437+0000","last_clean":"2024-05-09T09:50:54.486437+0000","last_became_active":"2024-05-09T09:47:16.182232+0000","last_became_peered":"2024-05-09T09:47:16.182232+0000","last_unstale":"2024-05-09T09:50:54.486437+0000","last_undegraded":"2024-05-09T09:50:54.486437+0000","last_fullsized":"2024-05-09T09:50:54.486437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:54.486244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:54.486244+0000","last_clean_scrub_stamp":"2024-05-09T09:50:54.486244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:04:41.948173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'21","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:49.380796+0000","last_change":"2024-05-09T09:50:49.380947+0000","last_active":"2024-05-09T09:50:49.380796+0000","last_peered":"2024-05-09T09:50:49.380796+0000","last_clean":"2024-05-09T09:50:49.380796+0000","last_became_active":"2024-05-09T09:47:18.211020+0000","last_became_peered":"2024-05-09T09:47:18.211020+0000","last_unstale":"2024-05-09T09:50:49.380796+0000","last_undegraded":"2024-05-09T09:50:49.380796+0000","last_fullsized":"2024-05-09T09:50:49.380796+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-05-09T09:50:49.380517+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-05-09T09:50:49.380517+0000","last_clean_scrub_stamp":"2024-05-09T09:50:49.380517+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:01.985708+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":383,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:52.295369+0000","last_change":"2024-05-09T09:50:52.295501+0000","last_active":"2024-05-09T09:50:52.295369+0000","last_peered":"2024-05-09T09:50:52.295369+0000","last_clean":"2024-05-09T09:50:52.295369+0000","last_became_active":"2024-05-09T09:47:20.226481+0000","last_became_peered":"2024-05-09T09:47:20.226481+0000","last_unstale":"2024-05-09T09:50:52.295369+0000","last_undegraded":"2024-05-09T09:50:52.295369+0000","last_fullsized":"2024-05-09T09:50:52.295369+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:52.295146+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:52.295146+0000","last_clean_scrub_stamp":"2024-05-09T09:50:52.295146+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:27.487386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.177712+0000","last_change":"2024-05-09T09:47:22.256859+0000","last_active":"2024-05-09T09:49:40.177712+0000","last_peered":"2024-05-09T09:49:40.177712+0000","last_clean":"2024-05-09T09:49:40.177712+0000","last_became_active":"2024-05-09T09:47:22.256285+0000","last_became_peered":"2024-05-09T09:47:22.256285+0000","last_unstale":"2024-05-09T09:49:40.177712+0000","last_undegraded":"2024-05-09T09:49:40.177712+0000","last_fullsized":"2024-05-09T09:49:40.177712+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.252565+0000","last_change":"2024-05-09T09:47:14.183911+0000","last_active":"2024-05-09T09:50:33.252565+0000","last_peered":"2024-05-09T09:50:33.252565+0000","last_clean":"2024-05-09T09:50:33.252565+0000","last_became_active":"2024-05-09T09:47:14.183542+0000","last_became_peered":"2024-05-09T09:47:14.183542+0000","last_unstale":"2024-05-09T09:50:33.252565+0000","last_undegraded":"2024-05-09T09:50:33.252565+0000","last_fullsized":"2024-05-09T09:50:33.252565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.174061+0000","last_change":"2024-05-09T09:47:12.200135+0000","last_active":"2024-05-09T09:49:25.174061+0000","last_peered":"2024-05-09T09:49:25.174061+0000","last_clean":"2024-05-09T09:49:25.174061+0000","last_became_active":"2024-05-09T09:47:12.199656+0000","last_became_peered":"2024-05-09T09:47:12.199656+0000","last_unstale":"2024-05-09T09:49:25.174061+0000","last_undegraded":"2024-05-09T09:49:25.174061+0000","last_fullsized":"2024-05-09T09:49:25.174061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:10.160153+0000","last_change":"2024-05-09T09:47:03.053083+0000","last_active":"2024-05-09T09:49:10.160153+0000","last_peered":"2024-05-09T09:49:10.160153+0000","last_clean":"2024-05-09T09:49:10.160153+0000","last_became_active":"2024-05-09T09:47:03.052728+0000","last_became_peered":"2024-05-09T09:47:03.052728+0000","last_unstale":"2024-05-09T09:49:10.160153+0000","last_undegraded":"2024-05-09T09:49:10.160153+0000","last_fullsized":"2024-05-09T09:49:10.160153+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.173653+0000","last_change":"2024-05-09T09:47:52.183646+0000","last_active":"2024-05-09T09:49:25.173653+0000","last_peered":"2024-05-09T09:49:25.173653+0000","last_clean":"2024-05-09T09:49:25.173653+0000","last_became_active":"2024-05-09T09:47:52.182360+0000","last_became_peered":"2024-05-09T09:47:52.182360+0000","last_unstale":"2024-05-09T09:49:25.173653+0000","last_undegraded":"2024-05-09T09:49:25.173653+0000","last_fullsized":"2024-05-09T09:49:25.173653+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.173762+0000","last_change":"2024-05-09T09:47:18.235283+0000","last_active":"2024-05-09T09:49:25.173762+0000","last_peered":"2024-05-09T09:49:25.173762+0000","last_clean":"2024-05-09T09:49:25.173762+0000","last_became_active":"2024-05-09T09:47:18.234556+0000","last_became_peered":"2024-05-09T09:47:18.234556+0000","last_unstale":"2024-05-09T09:49:25.173762+0000","last_undegraded":"2024-05-09T09:49:25.173762+0000","last_fullsized":"2024-05-09T09:49:25.173762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":413,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:47.848052+0000","last_change":"2024-05-09T09:50:47.848115+0000","last_active":"2024-05-09T09:50:47.848052+0000","last_peered":"2024-05-09T09:50:47.848052+0000","last_clean":"2024-05-09T09:50:47.848052+0000","last_became_active":"2024-05-09T09:47:20.226936+0000","last_became_peered":"2024-05-09T09:47:20.226936+0000","last_unstale":"2024-05-09T09:50:47.848052+0000","last_undegraded":"2024-05-09T09:50:47.848052+0000","last_fullsized":"2024-05-09T09:50:47.848052+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:47.847851+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:47.847851+0000","last_clean_scrub_stamp":"2024-05-09T09:50:47.847851+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:23:07.394309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.178071+0000","last_change":"2024-05-09T09:47:22.260147+0000","last_active":"2024-05-09T09:49:40.178071+0000","last_peered":"2024-05-09T09:49:40.178071+0000","last_clean":"2024-05-09T09:49:40.178071+0000","last_became_active":"2024-05-09T09:47:22.259547+0000","last_became_peered":"2024-05-09T09:47:22.259547+0000","last_unstale":"2024-05-09T09:49:40.178071+0000","last_undegraded":"2024-05-09T09:49:40.178071+0000","last_fullsized":"2024-05-09T09:49:40.178071+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'12","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.170016+0000","last_change":"2024-05-09T09:47:14.174039+0000","last_active":"2024-05-09T09:49:20.170016+0000","last_peered":"2024-05-09T09:49:20.170016+0000","last_clean":"2024-05-09T09:49:20.170016+0000","last_became_active":"2024-05-09T09:47:14.173673+0000","last_became_peered":"2024-05-09T09:47:14.173673+0000","last_unstale":"2024-05-09T09:49:20.170016+0000","last_undegraded":"2024-05-09T09:49:20.170016+0000","last_fullsized":"2024-05-09T09:49:20.170016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.174401+0000","last_change":"2024-05-09T09:47:12.206199+0000","last_active":"2024-05-09T09:49:25.174401+0000","last_peered":"2024-05-09T09:49:25.174401+0000","last_clean":"2024-05-09T09:49:25.174401+0000","last_became_active":"2024-05-09T09:47:12.205502+0000","last_became_peered":"2024-05-09T09:47:12.205502+0000","last_unstale":"2024-05-09T09:49:25.174401+0000","last_undegraded":"2024-05-09T09:49:25.174401+0000","last_fullsized":"2024-05-09T09:49:25.174401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:15.171272+0000","last_change":"2024-05-09T09:47:03.187330+0000","last_active":"2024-05-09T09:49:15.171272+0000","last_peered":"2024-05-09T09:49:15.171272+0000","last_clean":"2024-05-09T09:49:15.171272+0000","last_became_active":"2024-05-09T09:47:03.186434+0000","last_became_peered":"2024-05-09T09:47:03.186434+0000","last_unstale":"2024-05-09T09:49:15.171272+0000","last_undegraded":"2024-05-09T09:49:15.171272+0000","last_fullsized":"2024-05-09T09:49:15.171272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:56.472643+0000","last_change":"2024-05-09T09:50:56.472700+0000","last_active":"2024-05-09T09:50:56.472643+0000","last_peered":"2024-05-09T09:50:56.472643+0000","last_clean":"2024-05-09T09:50:56.472643+0000","last_became_active":"2024-05-09T09:47:16.182713+0000","last_became_peered":"2024-05-09T09:47:16.182713+0000","last_unstale":"2024-05-09T09:50:56.472643+0000","last_undegraded":"2024-05-09T09:50:56.472643+0000","last_fullsized":"2024-05-09T09:50:56.472643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:56.472447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:56.472447+0000","last_clean_scrub_stamp":"2024-05-09T09:50:56.472447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:02:37.915439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'318","reported_seq":411,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:49.169507+0000","last_change":"2024-05-09T09:50:49.169601+0000","last_active":"2024-05-09T09:50:49.169507+0000","last_peered":"2024-05-09T09:50:49.169507+0000","last_clean":"2024-05-09T09:50:49.169507+0000","last_became_active":"2024-05-09T09:47:18.226473+0000","last_became_peered":"2024-05-09T09:47:18.226473+0000","last_unstale":"2024-05-09T09:50:49.169507+0000","last_undegraded":"2024-05-09T09:50:49.169507+0000","last_fullsized":"2024-05-09T09:50:49.169507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'318","last_scrub_stamp":"2024-05-09T09:50:49.169325+0000","last_deep_scrub":"32'318","last_deep_scrub_stamp":"2024-05-09T09:50:49.169325+0000","last_clean_scrub_stamp":"2024-05-09T09:50:49.169325+0000","objects_scrubbed":8,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:47:39.409337+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:48.836834+0000","last_change":"2024-05-09T09:50:48.836895+0000","last_active":"2024-05-09T09:50:48.836834+0000","last_peered":"2024-05-09T09:50:48.836834+0000","last_clean":"2024-05-09T09:50:48.836834+0000","last_became_active":"2024-05-09T09:47:20.227198+0000","last_became_peered":"2024-05-09T09:47:20.227198+0000","last_unstale":"2024-05-09T09:50:48.836834+0000","last_undegraded":"2024-05-09T09:50:48.836834+0000","last_fullsized":"2024-05-09T09:50:48.836834+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:48.836642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:48.836642+0000","last_clean_scrub_stamp":"2024-05-09T09:50:48.836642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:31:25.639707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.174905+0000","last_change":"2024-05-09T09:47:22.234544+0000","last_active":"2024-05-09T09:49:40.174905+0000","last_peered":"2024-05-09T09:49:40.174905+0000","last_clean":"2024-05-09T09:49:40.174905+0000","last_became_active":"2024-05-09T09:47:22.233279+0000","last_became_peered":"2024-05-09T09:47:22.233279+0000","last_unstale":"2024-05-09T09:49:40.174905+0000","last_undegraded":"2024-05-09T09:49:40.174905+0000","last_fullsized":"2024-05-09T09:49:40.174905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:30.172533+0000","last_change":"2024-05-09T09:47:22.237682+0000","last_active":"2024-05-09T09:49:30.172533+0000","last_peered":"2024-05-09T09:49:30.172533+0000","last_clean":"2024-05-09T09:49:30.172533+0000","last_became_active":"2024-05-09T09:47:22.236863+0000","last_became_peered":"2024-05-09T09:47:22.236863+0000","last_unstale":"2024-05-09T09:49:30.172533+0000","last_undegraded":"2024-05-09T09:49:30.172533+0000","last_fullsized":"2024-05-09T09:49:30.172533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.173475+0000","last_change":"2024-05-09T09:47:14.184633+0000","last_active":"2024-05-09T09:49:35.173475+0000","last_peered":"2024-05-09T09:49:35.173475+0000","last_clean":"2024-05-09T09:49:35.173475+0000","last_became_active":"2024-05-09T09:47:14.184250+0000","last_became_peered":"2024-05-09T09:47:14.184250+0000","last_unstale":"2024-05-09T09:49:35.173475+0000","last_undegraded":"2024-05-09T09:49:35.173475+0000","last_fullsized":"2024-05-09T09:49:35.173475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.176039+0000","last_change":"2024-05-09T09:47:12.208454+0000","last_active":"2024-05-09T09:49:35.176039+0000","last_peered":"2024-05-09T09:49:35.176039+0000","last_clean":"2024-05-09T09:49:35.176039+0000","last_became_active":"2024-05-09T09:47:12.203479+0000","last_became_peered":"2024-05-09T09:47:12.203479+0000","last_unstale":"2024-05-09T09:49:35.176039+0000","last_undegraded":"2024-05-09T09:49:35.176039+0000","last_fullsized":"2024-05-09T09:49:35.176039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:53.265518+0000","last_change":"2024-05-09T09:50:53.265573+0000","last_active":"2024-05-09T09:50:53.265518+0000","last_peered":"2024-05-09T09:50:53.265518+0000","last_clean":"2024-05-09T09:50:53.265518+0000","last_became_active":"2024-05-09T09:47:16.210992+0000","last_became_peered":"2024-05-09T09:47:16.210992+0000","last_unstale":"2024-05-09T09:50:53.265518+0000","last_undegraded":"2024-05-09T09:50:53.265518+0000","last_fullsized":"2024-05-09T09:50:53.265518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:53.265312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:53.265312+0000","last_clean_scrub_stamp":"2024-05-09T09:50:53.265312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:28:20.308389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'113","reported_seq":169,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:57.465836+0000","last_change":"2024-05-09T09:50:57.465918+0000","last_active":"2024-05-09T09:50:57.465836+0000","last_peered":"2024-05-09T09:50:57.465836+0000","last_clean":"2024-05-09T09:50:57.465836+0000","last_became_active":"2024-05-09T09:47:18.234014+0000","last_became_peered":"2024-05-09T09:47:18.234014+0000","last_unstale":"2024-05-09T09:50:57.465836+0000","last_undegraded":"2024-05-09T09:50:57.465836+0000","last_fullsized":"2024-05-09T09:50:57.465836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'113","last_scrub_stamp":"2024-05-09T09:50:57.465647+0000","last_deep_scrub":"32'113","last_deep_scrub_stamp":"2024-05-09T09:50:57.465647+0000","last_clean_scrub_stamp":"2024-05-09T09:50:57.465647+0000","objects_scrubbed":5,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:46:16.255842+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.177215+0000","last_change":"2024-05-09T09:47:20.254957+0000","last_active":"2024-05-09T09:49:40.177215+0000","last_peered":"2024-05-09T09:49:40.177215+0000","last_clean":"2024-05-09T09:49:40.177215+0000","last_became_active":"2024-05-09T09:47:20.254344+0000","last_became_peered":"2024-05-09T09:47:20.254344+0000","last_unstale":"2024-05-09T09:49:40.177215+0000","last_undegraded":"2024-05-09T09:49:40.177215+0000","last_fullsized":"2024-05-09T09:49:40.177215+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.162976+0000","last_change":"2024-05-09T09:47:22.230150+0000","last_active":"2024-05-09T09:50:33.162976+0000","last_peered":"2024-05-09T09:50:33.162976+0000","last_clean":"2024-05-09T09:50:33.162976+0000","last_became_active":"2024-05-09T09:47:22.229088+0000","last_became_peered":"2024-05-09T09:47:22.229088+0000","last_unstale":"2024-05-09T09:50:33.162976+0000","last_undegraded":"2024-05-09T09:50:33.162976+0000","last_fullsized":"2024-05-09T09:50:33.162976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.962443+0000","last_change":"2024-05-09T09:47:14.174619+0000","last_active":"2024-05-09T09:50:32.962443+0000","last_peered":"2024-05-09T09:50:32.962443+0000","last_clean":"2024-05-09T09:50:32.962443+0000","last_became_active":"2024-05-09T09:47:14.173866+0000","last_became_peered":"2024-05-09T09:47:14.173866+0000","last_unstale":"2024-05-09T09:50:32.962443+0000","last_undegraded":"2024-05-09T09:50:32.962443+0000","last_fullsized":"2024-05-09T09:50:32.962443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.174849+0000","last_change":"2024-05-09T09:47:12.206131+0000","last_active":"2024-05-09T09:49:40.174849+0000","last_peered":"2024-05-09T09:49:40.174849+0000","last_clean":"2024-05-09T09:49:40.174849+0000","last_became_active":"2024-05-09T09:47:12.205714+0000","last_became_peered":"2024-05-09T09:47:12.205714+0000","last_unstale":"2024-05-09T09:49:40.174849+0000","last_undegraded":"2024-05-09T09:49:40.174849+0000","last_fullsized":"2024-05-09T09:49:40.174849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.177509+0000","last_change":"2024-05-09T09:47:52.188822+0000","last_active":"2024-05-09T09:49:40.177509+0000","last_peered":"2024-05-09T09:49:40.177509+0000","last_clean":"2024-05-09T09:49:40.177509+0000","last_became_active":"2024-05-09T09:47:52.187627+0000","last_became_peered":"2024-05-09T09:47:52.187627+0000","last_unstale":"2024-05-09T09:49:40.177509+0000","last_undegraded":"2024-05-09T09:49:40.177509+0000","last_fullsized":"2024-05-09T09:49:40.177509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'8","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:51.843220+0000","last_change":"2024-05-09T09:50:51.843293+0000","last_active":"2024-05-09T09:50:51.843220+0000","last_peered":"2024-05-09T09:50:51.843220+0000","last_clean":"2024-05-09T09:50:51.843220+0000","last_became_active":"2024-05-09T09:47:18.217843+0000","last_became_peered":"2024-05-09T09:47:18.217843+0000","last_unstale":"2024-05-09T09:50:51.843220+0000","last_undegraded":"2024-05-09T09:50:51.843220+0000","last_fullsized":"2024-05-09T09:50:51.843220+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:50:51.843015+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:50:51.843015+0000","last_clean_scrub_stamp":"2024-05-09T09:50:51.843015+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:01:37.150482+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:58.254932+0000","last_change":"2024-05-09T09:50:58.254985+0000","last_active":"2024-05-09T09:50:58.254932+0000","last_peered":"2024-05-09T09:50:58.254932+0000","last_clean":"2024-05-09T09:50:58.254932+0000","last_became_active":"2024-05-09T09:47:20.255449+0000","last_became_peered":"2024-05-09T09:47:20.255449+0000","last_unstale":"2024-05-09T09:50:58.254932+0000","last_undegraded":"2024-05-09T09:50:58.254932+0000","last_fullsized":"2024-05-09T09:50:58.254932+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:58.254742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:58.254742+0000","last_clean_scrub_stamp":"2024-05-09T09:50:58.254742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:40:28.088373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.486998+0000","last_change":"2024-05-09T09:47:22.239979+0000","last_active":"2024-05-09T09:50:33.486998+0000","last_peered":"2024-05-09T09:50:33.486998+0000","last_clean":"2024-05-09T09:50:33.486998+0000","last_became_active":"2024-05-09T09:47:22.239113+0000","last_became_peered":"2024-05-09T09:47:22.239113+0000","last_unstale":"2024-05-09T09:50:33.486998+0000","last_undegraded":"2024-05-09T09:50:33.486998+0000","last_fullsized":"2024-05-09T09:50:33.486998+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.253206+0000","last_change":"2024-05-09T09:47:14.174348+0000","last_active":"2024-05-09T09:50:33.253206+0000","last_peered":"2024-05-09T09:50:33.253206+0000","last_clean":"2024-05-09T09:50:33.253206+0000","last_became_active":"2024-05-09T09:47:14.173338+0000","last_became_peered":"2024-05-09T09:47:14.173338+0000","last_unstale":"2024-05-09T09:50:33.253206+0000","last_undegraded":"2024-05-09T09:50:33.253206+0000","last_fullsized":"2024-05-09T09:50:33.253206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.174962+0000","last_change":"2024-05-09T09:47:12.209971+0000","last_active":"2024-05-09T09:49:40.174962+0000","last_peered":"2024-05-09T09:49:40.174962+0000","last_clean":"2024-05-09T09:49:40.174962+0000","last_became_active":"2024-05-09T09:47:12.205864+0000","last_became_peered":"2024-05-09T09:47:12.205864+0000","last_unstale":"2024-05-09T09:49:40.174962+0000","last_undegraded":"2024-05-09T09:49:40.174962+0000","last_fullsized":"2024-05-09T09:49:40.174962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:59.267024+0000","last_change":"2024-05-09T09:50:59.267079+0000","last_active":"2024-05-09T09:50:59.267024+0000","last_peered":"2024-05-09T09:50:59.267024+0000","last_clean":"2024-05-09T09:50:59.267024+0000","last_became_active":"2024-05-09T09:47:16.214780+0000","last_became_peered":"2024-05-09T09:47:16.214780+0000","last_unstale":"2024-05-09T09:50:59.267024+0000","last_undegraded":"2024-05-09T09:50:59.267024+0000","last_fullsized":"2024-05-09T09:50:59.267024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:59.266840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:59.266840+0000","last_clean_scrub_stamp":"2024-05-09T09:50:59.266840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:59:17.503566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'121","reported_seq":193,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:54.909342+0000","last_change":"2024-05-09T09:50:54.909493+0000","last_active":"2024-05-09T09:50:54.909342+0000","last_peered":"2024-05-09T09:50:54.909342+0000","last_clean":"2024-05-09T09:50:54.909342+0000","last_became_active":"2024-05-09T09:47:18.201443+0000","last_became_peered":"2024-05-09T09:47:18.201443+0000","last_unstale":"2024-05-09T09:50:54.909342+0000","last_undegraded":"2024-05-09T09:50:54.909342+0000","last_fullsized":"2024-05-09T09:50:54.909342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'121","last_scrub_stamp":"2024-05-09T09:50:54.909111+0000","last_deep_scrub":"32'121","last_deep_scrub_stamp":"2024-05-09T09:50:54.909111+0000","last_clean_scrub_stamp":"2024-05-09T09:50:54.909111+0000","objects_scrubbed":6,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:37:16.030668+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:48.357085+0000","last_change":"2024-05-09T09:50:48.357139+0000","last_active":"2024-05-09T09:50:48.357085+0000","last_peered":"2024-05-09T09:50:48.357085+0000","last_clean":"2024-05-09T09:50:48.357085+0000","last_became_active":"2024-05-09T09:47:20.225261+0000","last_became_peered":"2024-05-09T09:47:20.225261+0000","last_unstale":"2024-05-09T09:50:48.357085+0000","last_undegraded":"2024-05-09T09:50:48.357085+0000","last_fullsized":"2024-05-09T09:50:48.357085+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:48.356886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:48.356886+0000","last_clean_scrub_stamp":"2024-05-09T09:50:48.356886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:18:04.605745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:55.181530+0000","last_change":"2024-05-09T09:47:22.253748+0000","last_active":"2024-05-09T09:49:55.181530+0000","last_peered":"2024-05-09T09:49:55.181530+0000","last_clean":"2024-05-09T09:49:55.181530+0000","last_became_active":"2024-05-09T09:47:22.252940+0000","last_became_peered":"2024-05-09T09:47:22.252940+0000","last_unstale":"2024-05-09T09:49:55.181530+0000","last_undegraded":"2024-05-09T09:49:55.181530+0000","last_fullsized":"2024-05-09T09:49:55.181530+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.321567+0000","last_change":"2024-05-09T09:47:14.183909+0000","last_active":"2024-05-09T09:50:33.321567+0000","last_peered":"2024-05-09T09:50:33.321567+0000","last_clean":"2024-05-09T09:50:33.321567+0000","last_became_active":"2024-05-09T09:47:14.183622+0000","last_became_peered":"2024-05-09T09:47:14.183622+0000","last_unstale":"2024-05-09T09:50:33.321567+0000","last_undegraded":"2024-05-09T09:50:33.321567+0000","last_fullsized":"2024-05-09T09:50:33.321567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.178323+0000","last_change":"2024-05-09T09:47:12.196263+0000","last_active":"2024-05-09T09:49:40.178323+0000","last_peered":"2024-05-09T09:49:40.178323+0000","last_clean":"2024-05-09T09:49:40.178323+0000","last_became_active":"2024-05-09T09:47:12.195857+0000","last_became_peered":"2024-05-09T09:47:12.195857+0000","last_unstale":"2024-05-09T09:49:40.178323+0000","last_undegraded":"2024-05-09T09:49:40.178323+0000","last_fullsized":"2024-05-09T09:49:40.178323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:52.490361+0000","last_change":"2024-05-09T09:50:52.490474+0000","last_active":"2024-05-09T09:50:52.490361+0000","last_peered":"2024-05-09T09:50:52.490361+0000","last_clean":"2024-05-09T09:50:52.490361+0000","last_became_active":"2024-05-09T09:47:16.198551+0000","last_became_peered":"2024-05-09T09:47:16.198551+0000","last_unstale":"2024-05-09T09:50:52.490361+0000","last_undegraded":"2024-05-09T09:50:52.490361+0000","last_fullsized":"2024-05-09T09:50:52.490361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:52.490129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:52.490129+0000","last_clean_scrub_stamp":"2024-05-09T09:50:52.490129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:08:27.216364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'110","reported_seq":165,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:55.303460+0000","last_change":"2024-05-09T09:50:55.303534+0000","last_active":"2024-05-09T09:50:55.303460+0000","last_peered":"2024-05-09T09:50:55.303460+0000","last_clean":"2024-05-09T09:50:55.303460+0000","last_became_active":"2024-05-09T09:47:18.217163+0000","last_became_peered":"2024-05-09T09:47:18.217163+0000","last_unstale":"2024-05-09T09:50:55.303460+0000","last_undegraded":"2024-05-09T09:50:55.303460+0000","last_fullsized":"2024-05-09T09:50:55.303460+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'110","last_scrub_stamp":"2024-05-09T09:50:55.303267+0000","last_deep_scrub":"32'110","last_deep_scrub_stamp":"2024-05-09T09:50:55.303267+0000","last_clean_scrub_stamp":"2024-05-09T09:50:55.303267+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:30:34.471649+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:47.153512+0000","last_change":"2024-05-09T09:50:47.153568+0000","last_active":"2024-05-09T09:50:47.153512+0000","last_peered":"2024-05-09T09:50:47.153512+0000","last_clean":"2024-05-09T09:50:47.153512+0000","last_became_active":"2024-05-09T09:47:20.238369+0000","last_became_peered":"2024-05-09T09:47:20.238369+0000","last_unstale":"2024-05-09T09:50:47.153512+0000","last_undegraded":"2024-05-09T09:50:47.153512+0000","last_fullsized":"2024-05-09T09:50:47.153512+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:47.153312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:47.153312+0000","last_clean_scrub_stamp":"2024-05-09T09:50:47.153312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:16.400691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'9","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.403774+0000","last_change":"2024-05-09T09:47:14.188262+0000","last_active":"2024-05-09T09:50:33.403774+0000","last_peered":"2024-05-09T09:50:33.403774+0000","last_clean":"2024-05-09T09:50:33.403774+0000","last_became_active":"2024-05-09T09:47:14.187868+0000","last_became_peered":"2024-05-09T09:47:14.187868+0000","last_unstale":"2024-05-09T09:50:33.403774+0000","last_undegraded":"2024-05-09T09:50:33.403774+0000","last_fullsized":"2024-05-09T09:50:33.403774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.177134+0000","last_change":"2024-05-09T09:47:12.208626+0000","last_active":"2024-05-09T09:49:40.177134+0000","last_peered":"2024-05-09T09:49:40.177134+0000","last_clean":"2024-05-09T09:49:40.177134+0000","last_became_active":"2024-05-09T09:47:12.208209+0000","last_became_peered":"2024-05-09T09:47:12.208209+0000","last_unstale":"2024-05-09T09:49:40.177134+0000","last_undegraded":"2024-05-09T09:49:40.177134+0000","last_fullsized":"2024-05-09T09:49:40.177134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.162450+0000","last_change":"2024-05-09T09:47:16.183573+0000","last_active":"2024-05-09T09:49:20.162450+0000","last_peered":"2024-05-09T09:49:20.162450+0000","last_clean":"2024-05-09T09:49:20.162450+0000","last_became_active":"2024-05-09T09:47:16.182766+0000","last_became_peered":"2024-05-09T09:47:16.182766+0000","last_unstale":"2024-05-09T09:49:20.162450+0000","last_undegraded":"2024-05-09T09:49:20.162450+0000","last_fullsized":"2024-05-09T09:49:20.162450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'211","reported_seq":284,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:50.874670+0000","last_change":"2024-05-09T09:50:50.874747+0000","last_active":"2024-05-09T09:50:50.874670+0000","last_peered":"2024-05-09T09:50:50.874670+0000","last_clean":"2024-05-09T09:50:50.874670+0000","last_became_active":"2024-05-09T09:47:18.225074+0000","last_became_peered":"2024-05-09T09:47:18.225074+0000","last_unstale":"2024-05-09T09:50:50.874670+0000","last_undegraded":"2024-05-09T09:50:50.874670+0000","last_fullsized":"2024-05-09T09:50:50.874670+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'211","last_scrub_stamp":"2024-05-09T09:50:50.874475+0000","last_deep_scrub":"32'211","last_deep_scrub_stamp":"2024-05-09T09:50:50.874475+0000","last_clean_scrub_stamp":"2024-05-09T09:50:50.874475+0000","objects_scrubbed":5,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:47.628582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:46.119717+0000","last_change":"2024-05-09T09:50:46.119770+0000","last_active":"2024-05-09T09:50:46.119717+0000","last_peered":"2024-05-09T09:50:46.119717+0000","last_clean":"2024-05-09T09:50:46.119717+0000","last_became_active":"2024-05-09T09:47:20.241372+0000","last_became_peered":"2024-05-09T09:47:20.241372+0000","last_unstale":"2024-05-09T09:50:46.119717+0000","last_undegraded":"2024-05-09T09:50:46.119717+0000","last_fullsized":"2024-05-09T09:50:46.119717+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:46.119515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:46.119515+0000","last_clean_scrub_stamp":"2024-05-09T09:50:46.119515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:34:19.012893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.168445+0000","last_change":"2024-05-09T09:47:22.260464+0000","last_active":"2024-05-09T09:49:45.168445+0000","last_peered":"2024-05-09T09:49:45.168445+0000","last_clean":"2024-05-09T09:49:45.168445+0000","last_became_active":"2024-05-09T09:47:22.259589+0000","last_became_peered":"2024-05-09T09:47:22.259589+0000","last_unstale":"2024-05-09T09:49:45.168445+0000","last_undegraded":"2024-05-09T09:49:45.168445+0000","last_fullsized":"2024-05-09T09:49:45.168445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'8","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:26.977481+0000","last_change":"2024-05-09T09:47:14.176405+0000","last_active":"2024-05-09T09:49:26.977481+0000","last_peered":"2024-05-09T09:49:26.977481+0000","last_clean":"2024-05-09T09:49:26.977481+0000","last_became_active":"2024-05-09T09:47:14.174371+0000","last_became_peered":"2024-05-09T09:47:14.174371+0000","last_unstale":"2024-05-09T09:49:26.977481+0000","last_undegraded":"2024-05-09T09:49:26.977481+0000","last_fullsized":"2024-05-09T09:49:26.977481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.177863+0000","last_change":"2024-05-09T09:47:12.198158+0000","last_active":"2024-05-09T09:49:40.177863+0000","last_peered":"2024-05-09T09:49:40.177863+0000","last_clean":"2024-05-09T09:49:40.177863+0000","last_became_active":"2024-05-09T09:47:12.196881+0000","last_became_peered":"2024-05-09T09:47:12.196881+0000","last_unstale":"2024-05-09T09:49:40.177863+0000","last_undegraded":"2024-05-09T09:49:40.177863+0000","last_fullsized":"2024-05-09T09:49:40.177863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.171604+0000","last_change":"2024-05-09T09:47:16.189376+0000","last_active":"2024-05-09T09:49:25.171604+0000","last_peered":"2024-05-09T09:49:25.171604+0000","last_clean":"2024-05-09T09:49:25.171604+0000","last_became_active":"2024-05-09T09:47:16.188611+0000","last_became_peered":"2024-05-09T09:47:16.188611+0000","last_unstale":"2024-05-09T09:49:25.171604+0000","last_undegraded":"2024-05-09T09:49:25.171604+0000","last_fullsized":"2024-05-09T09:49:25.171604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'119","reported_seq":177,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:55.469218+0000","last_change":"2024-05-09T09:50:55.469398+0000","last_active":"2024-05-09T09:50:55.469218+0000","last_peered":"2024-05-09T09:50:55.469218+0000","last_clean":"2024-05-09T09:50:55.469218+0000","last_became_active":"2024-05-09T09:47:18.232435+0000","last_became_peered":"2024-05-09T09:47:18.232435+0000","last_unstale":"2024-05-09T09:50:55.469218+0000","last_undegraded":"2024-05-09T09:50:55.469218+0000","last_fullsized":"2024-05-09T09:50:55.469218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-05-09T09:50:55.468997+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-05-09T09:50:55.468997+0000","last_clean_scrub_stamp":"2024-05-09T09:50:55.468997+0000","objects_scrubbed":7,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:10:29.577014+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:50.181168+0000","last_change":"2024-05-09T09:47:20.243779+0000","last_active":"2024-05-09T09:49:50.181168+0000","last_peered":"2024-05-09T09:49:50.181168+0000","last_clean":"2024-05-09T09:49:50.181168+0000","last_became_active":"2024-05-09T09:47:20.241935+0000","last_became_peered":"2024-05-09T09:47:20.241935+0000","last_unstale":"2024-05-09T09:49:50.181168+0000","last_undegraded":"2024-05-09T09:49:50.181168+0000","last_fullsized":"2024-05-09T09:49:50.181168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.178875+0000","last_change":"2024-05-09T09:47:22.241900+0000","last_active":"2024-05-09T09:49:45.178875+0000","last_peered":"2024-05-09T09:49:45.178875+0000","last_clean":"2024-05-09T09:49:45.178875+0000","last_became_active":"2024-05-09T09:47:22.241067+0000","last_became_peered":"2024-05-09T09:47:22.241067+0000","last_unstale":"2024-05-09T09:49:45.178875+0000","last_undegraded":"2024-05-09T09:49:45.178875+0000","last_fullsized":"2024-05-09T09:49:45.178875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.962563+0000","last_change":"2024-05-09T09:47:14.192314+0000","last_active":"2024-05-09T09:50:32.962563+0000","last_peered":"2024-05-09T09:50:32.962563+0000","last_clean":"2024-05-09T09:50:32.962563+0000","last_became_active":"2024-05-09T09:47:14.191459+0000","last_became_peered":"2024-05-09T09:47:14.191459+0000","last_unstale":"2024-05-09T09:50:32.962563+0000","last_undegraded":"2024-05-09T09:50:32.962563+0000","last_fullsized":"2024-05-09T09:50:32.962563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.081160+0000","last_change":"2024-05-09T09:47:12.193005+0000","last_active":"2024-05-09T09:50:40.081160+0000","last_peered":"2024-05-09T09:50:40.081160+0000","last_clean":"2024-05-09T09:50:40.081160+0000","last_became_active":"2024-05-09T09:47:12.191204+0000","last_became_peered":"2024-05-09T09:47:12.191204+0000","last_unstale":"2024-05-09T09:50:40.081160+0000","last_undegraded":"2024-05-09T09:50:40.081160+0000","last_fullsized":"2024-05-09T09:50:40.081160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:50.177153+0000","last_change":"2024-05-09T09:47:16.195416+0000","last_active":"2024-05-09T09:49:50.177153+0000","last_peered":"2024-05-09T09:49:50.177153+0000","last_clean":"2024-05-09T09:49:50.177153+0000","last_became_active":"2024-05-09T09:47:16.194314+0000","last_became_peered":"2024-05-09T09:47:16.194314+0000","last_unstale":"2024-05-09T09:49:50.177153+0000","last_undegraded":"2024-05-09T09:49:50.177153+0000","last_fullsized":"2024-05-09T09:49:50.177153+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'113","reported_seq":169,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:52.875659+0000","last_change":"2024-05-09T09:50:52.875802+0000","last_active":"2024-05-09T09:50:52.875659+0000","last_peered":"2024-05-09T09:50:52.875659+0000","last_clean":"2024-05-09T09:50:52.875659+0000","last_became_active":"2024-05-09T09:47:18.209099+0000","last_became_peered":"2024-05-09T09:47:18.209099+0000","last_unstale":"2024-05-09T09:50:52.875659+0000","last_undegraded":"2024-05-09T09:50:52.875659+0000","last_fullsized":"2024-05-09T09:50:52.875659+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'113","last_scrub_stamp":"2024-05-09T09:50:52.875426+0000","last_deep_scrub":"32'113","last_deep_scrub_stamp":"2024-05-09T09:50:52.875426+0000","last_clean_scrub_stamp":"2024-05-09T09:50:52.875426+0000","objects_scrubbed":5,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:17:15.117146+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.866680+0000","last_change":"2024-05-09T09:50:44.866730+0000","last_active":"2024-05-09T09:50:44.866680+0000","last_peered":"2024-05-09T09:50:44.866680+0000","last_clean":"2024-05-09T09:50:44.866680+0000","last_became_active":"2024-05-09T09:47:20.241900+0000","last_became_peered":"2024-05-09T09:47:20.241900+0000","last_unstale":"2024-05-09T09:50:44.866680+0000","last_undegraded":"2024-05-09T09:50:44.866680+0000","last_fullsized":"2024-05-09T09:50:44.866680+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:44.866482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:44.866482+0000","last_clean_scrub_stamp":"2024-05-09T09:50:44.866482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:26:17.791183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.178830+0000","last_change":"2024-05-09T09:47:22.264988+0000","last_active":"2024-05-09T09:49:45.178830+0000","last_peered":"2024-05-09T09:49:45.178830+0000","last_clean":"2024-05-09T09:49:45.178830+0000","last_became_active":"2024-05-09T09:47:22.263730+0000","last_became_peered":"2024-05-09T09:47:22.263730+0000","last_unstale":"2024-05-09T09:49:45.178830+0000","last_undegraded":"2024-05-09T09:49:45.178830+0000","last_fullsized":"2024-05-09T09:49:45.178830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.168577+0000","last_change":"2024-05-09T09:47:14.191093+0000","last_active":"2024-05-09T09:49:45.168577+0000","last_peered":"2024-05-09T09:49:45.168577+0000","last_clean":"2024-05-09T09:49:45.168577+0000","last_became_active":"2024-05-09T09:47:14.189561+0000","last_became_peered":"2024-05-09T09:47:14.189561+0000","last_unstale":"2024-05-09T09:49:45.168577+0000","last_undegraded":"2024-05-09T09:49:45.168577+0000","last_fullsized":"2024-05-09T09:49:45.168577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.178967+0000","last_change":"2024-05-09T09:47:12.215264+0000","last_active":"2024-05-09T09:49:45.178967+0000","last_peered":"2024-05-09T09:49:45.178967+0000","last_clean":"2024-05-09T09:49:45.178967+0000","last_became_active":"2024-05-09T09:47:12.214816+0000","last_became_peered":"2024-05-09T09:47:12.214816+0000","last_unstale":"2024-05-09T09:49:45.178967+0000","last_undegraded":"2024-05-09T09:49:45.178967+0000","last_fullsized":"2024-05-09T09:49:45.178967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:59.288158+0000","last_change":"2024-05-09T09:50:59.288294+0000","last_active":"2024-05-09T09:50:59.288158+0000","last_peered":"2024-05-09T09:50:59.288158+0000","last_clean":"2024-05-09T09:50:59.288158+0000","last_became_active":"2024-05-09T09:47:16.210567+0000","last_became_peered":"2024-05-09T09:47:16.210567+0000","last_unstale":"2024-05-09T09:50:59.288158+0000","last_undegraded":"2024-05-09T09:50:59.288158+0000","last_fullsized":"2024-05-09T09:50:59.288158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:59.287849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:59.287849+0000","last_clean_scrub_stamp":"2024-05-09T09:50:59.287849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:11:15.215672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.172665+0000","last_change":"2024-05-09T09:47:18.235102+0000","last_active":"2024-05-09T09:49:20.172665+0000","last_peered":"2024-05-09T09:49:20.172665+0000","last_clean":"2024-05-09T09:49:20.172665+0000","last_became_active":"2024-05-09T09:47:18.234113+0000","last_became_peered":"2024-05-09T09:47:18.234113+0000","last_unstale":"2024-05-09T09:49:20.172665+0000","last_undegraded":"2024-05-09T09:49:20.172665+0000","last_fullsized":"2024-05-09T09:49:20.172665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":380,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:54.255226+0000","last_change":"2024-05-09T09:50:54.255293+0000","last_active":"2024-05-09T09:50:54.255226+0000","last_peered":"2024-05-09T09:50:54.255226+0000","last_clean":"2024-05-09T09:50:54.255226+0000","last_became_active":"2024-05-09T09:47:20.254573+0000","last_became_peered":"2024-05-09T09:47:20.254573+0000","last_unstale":"2024-05-09T09:50:54.255226+0000","last_undegraded":"2024-05-09T09:50:54.255226+0000","last_fullsized":"2024-05-09T09:50:54.255226+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:54.255008+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:54.255008+0000","last_clean_scrub_stamp":"2024-05-09T09:50:54.255008+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:33:59.828045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.256753+0000","last_change":"2024-05-09T09:47:22.244085+0000","last_active":"2024-05-09T09:50:33.256753+0000","last_peered":"2024-05-09T09:50:33.256753+0000","last_clean":"2024-05-09T09:50:33.256753+0000","last_became_active":"2024-05-09T09:47:22.243234+0000","last_became_peered":"2024-05-09T09:47:22.243234+0000","last_unstale":"2024-05-09T09:50:33.256753+0000","last_undegraded":"2024-05-09T09:50:33.256753+0000","last_fullsized":"2024-05-09T09:50:33.256753+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'3","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.402874+0000","last_change":"2024-05-09T09:47:14.188552+0000","last_active":"2024-05-09T09:50:33.402874+0000","last_peered":"2024-05-09T09:50:33.402874+0000","last_clean":"2024-05-09T09:50:33.402874+0000","last_became_active":"2024-05-09T09:47:14.188222+0000","last_became_peered":"2024-05-09T09:47:14.188222+0000","last_unstale":"2024-05-09T09:50:33.402874+0000","last_undegraded":"2024-05-09T09:50:33.402874+0000","last_fullsized":"2024-05-09T09:50:33.402874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.081051+0000","last_change":"2024-05-09T09:47:12.196894+0000","last_active":"2024-05-09T09:50:40.081051+0000","last_peered":"2024-05-09T09:50:40.081051+0000","last_clean":"2024-05-09T09:50:40.081051+0000","last_became_active":"2024-05-09T09:47:12.195936+0000","last_became_peered":"2024-05-09T09:47:12.195936+0000","last_unstale":"2024-05-09T09:50:40.081051+0000","last_undegraded":"2024-05-09T09:50:40.081051+0000","last_fullsized":"2024-05-09T09:50:40.081051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:54.288182+0000","last_change":"2024-05-09T09:50:54.288244+0000","last_active":"2024-05-09T09:50:54.288182+0000","last_peered":"2024-05-09T09:50:54.288182+0000","last_clean":"2024-05-09T09:50:54.288182+0000","last_became_active":"2024-05-09T09:47:16.210901+0000","last_became_peered":"2024-05-09T09:47:16.210901+0000","last_unstale":"2024-05-09T09:50:54.288182+0000","last_undegraded":"2024-05-09T09:50:54.288182+0000","last_fullsized":"2024-05-09T09:50:54.288182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:54.287951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:54.287951+0000","last_clean_scrub_stamp":"2024-05-09T09:50:54.287951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:00:20.805979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'120","reported_seq":178,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:51.351217+0000","last_change":"2024-05-09T09:50:51.351295+0000","last_active":"2024-05-09T09:50:51.351217+0000","last_peered":"2024-05-09T09:50:51.351217+0000","last_clean":"2024-05-09T09:50:51.351217+0000","last_became_active":"2024-05-09T09:47:18.202069+0000","last_became_peered":"2024-05-09T09:47:18.202069+0000","last_unstale":"2024-05-09T09:50:51.351217+0000","last_undegraded":"2024-05-09T09:50:51.351217+0000","last_fullsized":"2024-05-09T09:50:51.351217+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'120","last_scrub_stamp":"2024-05-09T09:50:51.351014+0000","last_deep_scrub":"32'120","last_deep_scrub_stamp":"2024-05-09T09:50:51.351014+0000","last_clean_scrub_stamp":"2024-05-09T09:50:51.351014+0000","objects_scrubbed":7,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:19:59.652432+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:49.840926+0000","last_change":"2024-05-09T09:50:49.840978+0000","last_active":"2024-05-09T09:50:49.840926+0000","last_peered":"2024-05-09T09:50:49.840926+0000","last_clean":"2024-05-09T09:50:49.840926+0000","last_became_active":"2024-05-09T09:47:20.250194+0000","last_became_peered":"2024-05-09T09:47:20.250194+0000","last_unstale":"2024-05-09T09:50:49.840926+0000","last_undegraded":"2024-05-09T09:50:49.840926+0000","last_fullsized":"2024-05-09T09:50:49.840926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:49.840731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:49.840731+0000","last_clean_scrub_stamp":"2024-05-09T09:50:49.840731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:28:16.883808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.314679+0000","last_change":"2024-05-09T09:47:22.240288+0000","last_active":"2024-05-09T09:50:33.314679+0000","last_peered":"2024-05-09T09:50:33.314679+0000","last_clean":"2024-05-09T09:50:33.314679+0000","last_became_active":"2024-05-09T09:47:22.239300+0000","last_became_peered":"2024-05-09T09:47:22.239300+0000","last_unstale":"2024-05-09T09:50:33.314679+0000","last_undegraded":"2024-05-09T09:50:33.314679+0000","last_fullsized":"2024-05-09T09:50:33.314679+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'10","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.824135+0000","last_change":"2024-05-09T09:47:14.188510+0000","last_active":"2024-05-09T09:50:32.824135+0000","last_peered":"2024-05-09T09:50:32.824135+0000","last_clean":"2024-05-09T09:50:32.824135+0000","last_became_active":"2024-05-09T09:47:14.187951+0000","last_became_peered":"2024-05-09T09:47:14.187951+0000","last_unstale":"2024-05-09T09:50:32.824135+0000","last_undegraded":"2024-05-09T09:50:32.824135+0000","last_fullsized":"2024-05-09T09:50:32.824135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.179097+0000","last_change":"2024-05-09T09:47:12.208585+0000","last_active":"2024-05-09T09:49:45.179097+0000","last_peered":"2024-05-09T09:49:45.179097+0000","last_clean":"2024-05-09T09:49:45.179097+0000","last_became_active":"2024-05-09T09:47:12.203827+0000","last_became_peered":"2024-05-09T09:47:12.203827+0000","last_unstale":"2024-05-09T09:49:45.179097+0000","last_undegraded":"2024-05-09T09:49:45.179097+0000","last_fullsized":"2024-05-09T09:49:45.179097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:50.177079+0000","last_change":"2024-05-09T09:47:16.197042+0000","last_active":"2024-05-09T09:49:50.177079+0000","last_peered":"2024-05-09T09:49:50.177079+0000","last_clean":"2024-05-09T09:49:50.177079+0000","last_became_active":"2024-05-09T09:47:16.196193+0000","last_became_peered":"2024-05-09T09:47:16.196193+0000","last_unstale":"2024-05-09T09:49:50.177079+0000","last_undegraded":"2024-05-09T09:49:50.177079+0000","last_fullsized":"2024-05-09T09:49:50.177079+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'113","reported_seq":168,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:55.923859+0000","last_change":"2024-05-09T09:50:55.923928+0000","last_active":"2024-05-09T09:50:55.923859+0000","last_peered":"2024-05-09T09:50:55.923859+0000","last_clean":"2024-05-09T09:50:55.923859+0000","last_became_active":"2024-05-09T09:47:18.199627+0000","last_became_peered":"2024-05-09T09:47:18.199627+0000","last_unstale":"2024-05-09T09:50:55.923859+0000","last_undegraded":"2024-05-09T09:50:55.923859+0000","last_fullsized":"2024-05-09T09:50:55.923859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'113","last_scrub_stamp":"2024-05-09T09:50:55.923673+0000","last_deep_scrub":"32'113","last_deep_scrub_stamp":"2024-05-09T09:50:55.923673+0000","last_clean_scrub_stamp":"2024-05-09T09:50:55.923673+0000","objects_scrubbed":4,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:11:11.851496+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.178751+0000","last_change":"2024-05-09T09:47:20.252618+0000","last_active":"2024-05-09T09:49:45.178751+0000","last_peered":"2024-05-09T09:49:45.178751+0000","last_clean":"2024-05-09T09:49:45.178751+0000","last_became_active":"2024-05-09T09:47:20.251642+0000","last_became_peered":"2024-05-09T09:47:20.251642+0000","last_unstale":"2024-05-09T09:49:45.178751+0000","last_undegraded":"2024-05-09T09:49:45.178751+0000","last_fullsized":"2024-05-09T09:49:45.178751+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:50.180499+0000","last_change":"2024-05-09T09:47:22.261644+0000","last_active":"2024-05-09T09:49:50.180499+0000","last_peered":"2024-05-09T09:49:50.180499+0000","last_clean":"2024-05-09T09:49:50.180499+0000","last_became_active":"2024-05-09T09:47:22.261164+0000","last_became_peered":"2024-05-09T09:47:22.261164+0000","last_unstale":"2024-05-09T09:49:50.180499+0000","last_undegraded":"2024-05-09T09:49:50.180499+0000","last_fullsized":"2024-05-09T09:49:50.180499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.170923+0000","last_change":"2024-05-09T09:47:14.185649+0000","last_active":"2024-05-09T09:50:33.170923+0000","last_peered":"2024-05-09T09:50:33.170923+0000","last_clean":"2024-05-09T09:50:33.170923+0000","last_became_active":"2024-05-09T09:47:14.185270+0000","last_became_peered":"2024-05-09T09:47:14.185270+0000","last_unstale":"2024-05-09T09:50:33.170923+0000","last_undegraded":"2024-05-09T09:50:33.170923+0000","last_fullsized":"2024-05-09T09:50:33.170923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:15.161212+0000","last_change":"2024-05-09T09:47:12.185589+0000","last_active":"2024-05-09T09:49:15.161212+0000","last_peered":"2024-05-09T09:49:15.161212+0000","last_clean":"2024-05-09T09:49:15.161212+0000","last_became_active":"2024-05-09T09:47:12.183985+0000","last_became_peered":"2024-05-09T09:47:12.183985+0000","last_unstale":"2024-05-09T09:49:15.161212+0000","last_undegraded":"2024-05-09T09:49:15.161212+0000","last_fullsized":"2024-05-09T09:49:15.161212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.179403+0000","last_change":"2024-05-09T09:47:16.210385+0000","last_active":"2024-05-09T09:49:45.179403+0000","last_peered":"2024-05-09T09:49:45.179403+0000","last_clean":"2024-05-09T09:49:45.179403+0000","last_became_active":"2024-05-09T09:47:16.207467+0000","last_became_peered":"2024-05-09T09:47:16.207467+0000","last_unstale":"2024-05-09T09:49:45.179403+0000","last_undegraded":"2024-05-09T09:49:45.179403+0000","last_fullsized":"2024-05-09T09:49:45.179403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'104","reported_seq":149,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.010431+0000","last_change":"2024-05-09T09:47:18.236481+0000","last_active":"2024-05-09T09:50:40.010431+0000","last_peered":"2024-05-09T09:50:40.010431+0000","last_clean":"2024-05-09T09:50:40.010431+0000","last_became_active":"2024-05-09T09:47:18.235557+0000","last_became_peered":"2024-05-09T09:47:18.235557+0000","last_unstale":"2024-05-09T09:50:40.010431+0000","last_undegraded":"2024-05-09T09:50:40.010431+0000","last_fullsized":"2024-05-09T09:50:40.010431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:17.172274+0000","last_clean_scrub_stamp":"2024-05-09T09:47:17.172274+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:50.180222+0000","last_change":"2024-05-09T09:47:20.235738+0000","last_active":"2024-05-09T09:49:50.180222+0000","last_peered":"2024-05-09T09:49:50.180222+0000","last_clean":"2024-05-09T09:49:50.180222+0000","last_became_active":"2024-05-09T09:47:20.231750+0000","last_became_peered":"2024-05-09T09:47:20.231750+0000","last_unstale":"2024-05-09T09:49:50.180222+0000","last_undegraded":"2024-05-09T09:49:50.180222+0000","last_fullsized":"2024-05-09T09:49:50.180222+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'8","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:50.180411+0000","last_change":"2024-05-09T09:47:22.256916+0000","last_active":"2024-05-09T09:49:50.180411+0000","last_peered":"2024-05-09T09:49:50.180411+0000","last_clean":"2024-05-09T09:49:50.180411+0000","last_became_active":"2024-05-09T09:47:22.256398+0000","last_became_peered":"2024-05-09T09:47:22.256398+0000","last_unstale":"2024-05-09T09:49:50.180411+0000","last_undegraded":"2024-05-09T09:49:50.180411+0000","last_fullsized":"2024-05-09T09:49:50.180411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'22","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.960460+0000","last_change":"2024-05-09T09:47:14.189375+0000","last_active":"2024-05-09T09:50:32.960460+0000","last_peered":"2024-05-09T09:50:32.960460+0000","last_clean":"2024-05-09T09:50:32.960460+0000","last_became_active":"2024-05-09T09:47:14.188980+0000","last_became_peered":"2024-05-09T09:47:14.188980+0000","last_unstale":"2024-05-09T09:50:32.960460+0000","last_undegraded":"2024-05-09T09:50:32.960460+0000","last_fullsized":"2024-05-09T09:50:32.960460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.173110+0000","last_change":"2024-05-09T09:47:12.213326+0000","last_active":"2024-05-09T09:49:20.173110+0000","last_peered":"2024-05-09T09:49:20.173110+0000","last_clean":"2024-05-09T09:49:20.173110+0000","last_became_active":"2024-05-09T09:47:12.206136+0000","last_became_peered":"2024-05-09T09:47:12.206136+0000","last_unstale":"2024-05-09T09:49:20.173110+0000","last_undegraded":"2024-05-09T09:49:20.173110+0000","last_fullsized":"2024-05-09T09:49:20.173110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:58.281505+0000","last_change":"2024-05-09T09:50:58.281584+0000","last_active":"2024-05-09T09:50:58.281505+0000","last_peered":"2024-05-09T09:50:58.281505+0000","last_clean":"2024-05-09T09:50:58.281505+0000","last_became_active":"2024-05-09T09:47:16.210958+0000","last_became_peered":"2024-05-09T09:47:16.210958+0000","last_unstale":"2024-05-09T09:50:58.281505+0000","last_undegraded":"2024-05-09T09:50:58.281505+0000","last_fullsized":"2024-05-09T09:50:58.281505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-09T09:50:58.281299+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-09T09:50:58.281299+0000","last_clean_scrub_stamp":"2024-05-09T09:50:58.281299+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:37:19.402856+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'114","reported_seq":171,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:59.461776+0000","last_change":"2024-05-09T09:50:59.461850+0000","last_active":"2024-05-09T09:50:59.461776+0000","last_peered":"2024-05-09T09:50:59.461776+0000","last_clean":"2024-05-09T09:50:59.461776+0000","last_became_active":"2024-05-09T09:47:18.233552+0000","last_became_peered":"2024-05-09T09:47:18.233552+0000","last_unstale":"2024-05-09T09:50:59.461776+0000","last_undegraded":"2024-05-09T09:50:59.461776+0000","last_fullsized":"2024-05-09T09:50:59.461776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'114","last_scrub_stamp":"2024-05-09T09:50:59.461590+0000","last_deep_scrub":"32'114","last_deep_scrub_stamp":"2024-05-09T09:50:59.461590+0000","last_clean_scrub_stamp":"2024-05-09T09:50:59.461590+0000","objects_scrubbed":5,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:45:09.985421+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:50.169656+0000","last_change":"2024-05-09T09:47:20.254870+0000","last_active":"2024-05-09T09:49:50.169656+0000","last_peered":"2024-05-09T09:49:50.169656+0000","last_clean":"2024-05-09T09:49:50.169656+0000","last_became_active":"2024-05-09T09:47:20.254083+0000","last_became_peered":"2024-05-09T09:47:20.254083+0000","last_unstale":"2024-05-09T09:49:50.169656+0000","last_undegraded":"2024-05-09T09:49:50.169656+0000","last_fullsized":"2024-05-09T09:49:50.169656+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:19.184401+0000","last_clean_scrub_stamp":"2024-05-09T09:47:19.184401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.179014+0000","last_change":"2024-05-09T09:47:22.255091+0000","last_active":"2024-05-09T09:49:45.179014+0000","last_peered":"2024-05-09T09:49:45.179014+0000","last_clean":"2024-05-09T09:49:45.179014+0000","last_became_active":"2024-05-09T09:47:22.254386+0000","last_became_peered":"2024-05-09T09:47:22.254386+0000","last_unstale":"2024-05-09T09:49:45.179014+0000","last_undegraded":"2024-05-09T09:49:45.179014+0000","last_fullsized":"2024-05-09T09:49:45.179014+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'13","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.404965+0000","last_change":"2024-05-09T09:47:14.178682+0000","last_active":"2024-05-09T09:50:33.404965+0000","last_peered":"2024-05-09T09:50:33.404965+0000","last_clean":"2024-05-09T09:50:33.404965+0000","last_became_active":"2024-05-09T09:47:14.174998+0000","last_became_peered":"2024-05-09T09:47:14.174998+0000","last_unstale":"2024-05-09T09:50:33.404965+0000","last_undegraded":"2024-05-09T09:50:33.404965+0000","last_fullsized":"2024-05-09T09:50:33.404965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.169920+0000","last_change":"2024-05-09T09:47:12.192847+0000","last_active":"2024-05-09T09:49:20.169920+0000","last_peered":"2024-05-09T09:49:20.169920+0000","last_clean":"2024-05-09T09:49:20.169920+0000","last_became_active":"2024-05-09T09:47:12.192448+0000","last_became_peered":"2024-05-09T09:47:12.192448+0000","last_unstale":"2024-05-09T09:49:20.169920+0000","last_undegraded":"2024-05-09T09:49:20.169920+0000","last_fullsized":"2024-05-09T09:49:20.169920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'12","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.163614+0000","last_change":"2024-05-09T09:47:14.189285+0000","last_active":"2024-05-09T09:49:25.163614+0000","last_peered":"2024-05-09T09:49:25.163614+0000","last_clean":"2024-05-09T09:49:25.163614+0000","last_became_active":"2024-05-09T09:47:14.188534+0000","last_became_peered":"2024-05-09T09:47:14.188534+0000","last_unstale":"2024-05-09T09:49:25.163614+0000","last_undegraded":"2024-05-09T09:49:25.163614+0000","last_fullsized":"2024-05-09T09:49:25.163614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":54,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.127608+0000","last_change":"2024-05-09T09:47:12.185694+0000","last_active":"2024-05-09T09:50:33.127608+0000","last_peered":"2024-05-09T09:50:33.127608+0000","last_clean":"2024-05-09T09:50:33.127608+0000","last_became_active":"2024-05-09T09:47:12.184353+0000","last_became_peered":"2024-05-09T09:47:12.184353+0000","last_unstale":"2024-05-09T09:50:33.127608+0000","last_undegraded":"2024-05-09T09:50:33.127608+0000","last_fullsized":"2024-05-09T09:50:33.127608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.173898+0000","last_change":"2024-05-09T09:47:14.187249+0000","last_active":"2024-05-09T09:49:25.173898+0000","last_peered":"2024-05-09T09:49:25.173898+0000","last_clean":"2024-05-09T09:49:25.173898+0000","last_became_active":"2024-05-09T09:47:14.186689+0000","last_became_peered":"2024-05-09T09:47:14.186689+0000","last_unstale":"2024-05-09T09:49:25.173898+0000","last_undegraded":"2024-05-09T09:49:25.173898+0000","last_fullsized":"2024-05-09T09:49:25.173898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.172278+0000","last_change":"2024-05-09T09:47:12.211787+0000","last_active":"2024-05-09T09:49:20.172278+0000","last_peered":"2024-05-09T09:49:20.172278+0000","last_clean":"2024-05-09T09:49:20.172278+0000","last_became_active":"2024-05-09T09:47:12.209633+0000","last_became_peered":"2024-05-09T09:47:12.209633+0000","last_unstale":"2024-05-09T09:49:20.172278+0000","last_undegraded":"2024-05-09T09:49:20.172278+0000","last_fullsized":"2024-05-09T09:49:20.172278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'3","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.403123+0000","last_change":"2024-05-09T09:47:14.193990+0000","last_active":"2024-05-09T09:50:33.403123+0000","last_peered":"2024-05-09T09:50:33.403123+0000","last_clean":"2024-05-09T09:50:33.403123+0000","last_became_active":"2024-05-09T09:47:14.193366+0000","last_became_peered":"2024-05-09T09:47:14.193366+0000","last_unstale":"2024-05-09T09:50:33.403123+0000","last_undegraded":"2024-05-09T09:50:33.403123+0000","last_fullsized":"2024-05-09T09:50:33.403123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.162287+0000","last_change":"2024-05-09T09:47:12.215615+0000","last_active":"2024-05-09T09:49:20.162287+0000","last_peered":"2024-05-09T09:49:20.162287+0000","last_clean":"2024-05-09T09:49:20.162287+0000","last_became_active":"2024-05-09T09:47:12.214019+0000","last_became_peered":"2024-05-09T09:47:12.214019+0000","last_unstale":"2024-05-09T09:49:20.162287+0000","last_undegraded":"2024-05-09T09:49:20.162287+0000","last_fullsized":"2024-05-09T09:49:20.162287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.960137+0000","last_change":"2024-05-09T09:47:14.182706+0000","last_active":"2024-05-09T09:50:32.960137+0000","last_peered":"2024-05-09T09:50:32.960137+0000","last_clean":"2024-05-09T09:50:32.960137+0000","last_became_active":"2024-05-09T09:47:14.181824+0000","last_became_peered":"2024-05-09T09:47:14.181824+0000","last_unstale":"2024-05-09T09:50:32.960137+0000","last_undegraded":"2024-05-09T09:50:32.960137+0000","last_fullsized":"2024-05-09T09:50:32.960137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.163520+0000","last_change":"2024-05-09T09:47:12.205854+0000","last_active":"2024-05-09T09:49:25.163520+0000","last_peered":"2024-05-09T09:49:25.163520+0000","last_clean":"2024-05-09T09:49:25.163520+0000","last_became_active":"2024-05-09T09:47:12.204322+0000","last_became_peered":"2024-05-09T09:47:12.204322+0000","last_unstale":"2024-05-09T09:49:25.163520+0000","last_undegraded":"2024-05-09T09:49:25.163520+0000","last_fullsized":"2024-05-09T09:49:25.163520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.171338+0000","last_change":"2024-05-09T09:47:14.178745+0000","last_active":"2024-05-09T09:50:33.171338+0000","last_peered":"2024-05-09T09:50:33.171338+0000","last_clean":"2024-05-09T09:50:33.171338+0000","last_became_active":"2024-05-09T09:47:14.178503+0000","last_became_peered":"2024-05-09T09:47:14.178503+0000","last_unstale":"2024-05-09T09:50:33.171338+0000","last_undegraded":"2024-05-09T09:50:33.171338+0000","last_fullsized":"2024-05-09T09:50:33.171338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"30'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.174358+0000","last_change":"2024-05-09T09:47:12.196461+0000","last_active":"2024-05-09T09:49:25.174358+0000","last_peered":"2024-05-09T09:49:25.174358+0000","last_clean":"2024-05-09T09:49:25.174358+0000","last_became_active":"2024-05-09T09:47:12.196120+0000","last_became_peered":"2024-05-09T09:47:12.196120+0000","last_unstale":"2024-05-09T09:49:25.174358+0000","last_undegraded":"2024-05-09T09:49:25.174358+0000","last_fullsized":"2024-05-09T09:49:25.174358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'5","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.402934+0000","last_change":"2024-05-09T09:47:14.177343+0000","last_active":"2024-05-09T09:50:33.402934+0000","last_peered":"2024-05-09T09:50:33.402934+0000","last_clean":"2024-05-09T09:50:33.402934+0000","last_became_active":"2024-05-09T09:47:14.176615+0000","last_became_peered":"2024-05-09T09:47:14.176615+0000","last_unstale":"2024-05-09T09:50:33.402934+0000","last_undegraded":"2024-05-09T09:50:33.402934+0000","last_fullsized":"2024-05-09T09:50:33.402934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.171553+0000","last_change":"2024-05-09T09:47:12.210169+0000","last_active":"2024-05-09T09:49:25.171553+0000","last_peered":"2024-05-09T09:49:25.171553+0000","last_clean":"2024-05-09T09:49:25.171553+0000","last_became_active":"2024-05-09T09:47:12.209171+0000","last_became_peered":"2024-05-09T09:47:12.209171+0000","last_unstale":"2024-05-09T09:49:25.171553+0000","last_undegraded":"2024-05-09T09:49:25.171553+0000","last_fullsized":"2024-05-09T09:49:25.171553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.172784+0000","last_change":"2024-05-09T09:47:14.177426+0000","last_active":"2024-05-09T09:49:20.172784+0000","last_peered":"2024-05-09T09:49:20.172784+0000","last_clean":"2024-05-09T09:49:20.172784+0000","last_became_active":"2024-05-09T09:47:14.177119+0000","last_became_peered":"2024-05-09T09:47:14.177119+0000","last_unstale":"2024-05-09T09:49:20.172784+0000","last_undegraded":"2024-05-09T09:49:20.172784+0000","last_fullsized":"2024-05-09T09:49:20.172784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.163658+0000","last_change":"2024-05-09T09:47:12.185203+0000","last_active":"2024-05-09T09:49:25.163658+0000","last_peered":"2024-05-09T09:49:25.163658+0000","last_clean":"2024-05-09T09:49:25.163658+0000","last_became_active":"2024-05-09T09:47:12.184105+0000","last_became_peered":"2024-05-09T09:47:12.184105+0000","last_unstale":"2024-05-09T09:49:25.163658+0000","last_undegraded":"2024-05-09T09:49:25.163658+0000","last_fullsized":"2024-05-09T09:49:25.163658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.825990+0000","last_change":"2024-05-09T09:47:14.185348+0000","last_active":"2024-05-09T09:50:32.825990+0000","last_peered":"2024-05-09T09:50:32.825990+0000","last_clean":"2024-05-09T09:50:32.825990+0000","last_became_active":"2024-05-09T09:47:14.182961+0000","last_became_peered":"2024-05-09T09:47:14.182961+0000","last_unstale":"2024-05-09T09:50:32.825990+0000","last_undegraded":"2024-05-09T09:50:32.825990+0000","last_fullsized":"2024-05-09T09:50:32.825990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.082986+0000","last_change":"2024-05-09T09:47:12.206940+0000","last_active":"2024-05-09T09:50:40.082986+0000","last_peered":"2024-05-09T09:50:40.082986+0000","last_clean":"2024-05-09T09:50:40.082986+0000","last_became_active":"2024-05-09T09:47:12.201952+0000","last_became_peered":"2024-05-09T09:47:12.201952+0000","last_unstale":"2024-05-09T09:50:40.082986+0000","last_undegraded":"2024-05-09T09:50:40.082986+0000","last_fullsized":"2024-05-09T09:50:40.082986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.961153+0000","last_change":"2024-05-09T09:47:14.193794+0000","last_active":"2024-05-09T09:50:32.961153+0000","last_peered":"2024-05-09T09:50:32.961153+0000","last_clean":"2024-05-09T09:50:32.961153+0000","last_became_active":"2024-05-09T09:47:14.193421+0000","last_became_peered":"2024-05-09T09:47:14.193421+0000","last_unstale":"2024-05-09T09:50:32.961153+0000","last_undegraded":"2024-05-09T09:50:32.961153+0000","last_fullsized":"2024-05-09T09:50:32.961153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:30.164726+0000","last_change":"2024-05-09T09:47:12.206566+0000","last_active":"2024-05-09T09:49:30.164726+0000","last_peered":"2024-05-09T09:49:30.164726+0000","last_clean":"2024-05-09T09:49:30.164726+0000","last_became_active":"2024-05-09T09:47:12.203523+0000","last_became_peered":"2024-05-09T09:47:12.203523+0000","last_unstale":"2024-05-09T09:49:30.164726+0000","last_undegraded":"2024-05-09T09:49:30.164726+0000","last_fullsized":"2024-05-09T09:49:30.164726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'4","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.322274+0000","last_change":"2024-05-09T09:47:14.173720+0000","last_active":"2024-05-09T09:50:33.322274+0000","last_peered":"2024-05-09T09:50:33.322274+0000","last_clean":"2024-05-09T09:50:33.322274+0000","last_became_active":"2024-05-09T09:47:14.171565+0000","last_became_peered":"2024-05-09T09:47:14.171565+0000","last_unstale":"2024-05-09T09:50:33.322274+0000","last_undegraded":"2024-05-09T09:50:33.322274+0000","last_fullsized":"2024-05-09T09:50:33.322274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.118450+0000","last_change":"2024-05-09T09:47:12.193541+0000","last_active":"2024-05-09T09:49:32.118450+0000","last_peered":"2024-05-09T09:49:32.118450+0000","last_clean":"2024-05-09T09:49:32.118450+0000","last_became_active":"2024-05-09T09:47:12.192462+0000","last_became_peered":"2024-05-09T09:47:12.192462+0000","last_unstale":"2024-05-09T09:49:32.118450+0000","last_undegraded":"2024-05-09T09:49:32.118450+0000","last_fullsized":"2024-05-09T09:49:32.118450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.253499+0000","last_change":"2024-05-09T09:47:14.177456+0000","last_active":"2024-05-09T09:50:33.253499+0000","last_peered":"2024-05-09T09:50:33.253499+0000","last_clean":"2024-05-09T09:50:33.253499+0000","last_became_active":"2024-05-09T09:47:14.176986+0000","last_became_peered":"2024-05-09T09:47:14.176986+0000","last_unstale":"2024-05-09T09:50:33.253499+0000","last_undegraded":"2024-05-09T09:50:33.253499+0000","last_fullsized":"2024-05-09T09:50:33.253499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:30.175257+0000","last_change":"2024-05-09T09:47:12.205826+0000","last_active":"2024-05-09T09:49:30.175257+0000","last_peered":"2024-05-09T09:49:30.175257+0000","last_clean":"2024-05-09T09:49:30.175257+0000","last_became_active":"2024-05-09T09:47:12.205416+0000","last_became_peered":"2024-05-09T09:47:12.205416+0000","last_unstale":"2024-05-09T09:49:30.175257+0000","last_undegraded":"2024-05-09T09:49:30.175257+0000","last_fullsized":"2024-05-09T09:49:30.175257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:30.175268+0000","last_change":"2024-05-09T09:47:14.182747+0000","last_active":"2024-05-09T09:49:30.175268+0000","last_peered":"2024-05-09T09:49:30.175268+0000","last_clean":"2024-05-09T09:49:30.175268+0000","last_became_active":"2024-05-09T09:47:14.182248+0000","last_became_peered":"2024-05-09T09:47:14.182248+0000","last_unstale":"2024-05-09T09:49:30.175268+0000","last_undegraded":"2024-05-09T09:49:30.175268+0000","last_fullsized":"2024-05-09T09:49:30.175268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.083948+0000","last_change":"2024-05-09T09:47:12.208127+0000","last_active":"2024-05-09T09:50:40.083948+0000","last_peered":"2024-05-09T09:50:40.083948+0000","last_clean":"2024-05-09T09:50:40.083948+0000","last_became_active":"2024-05-09T09:47:12.200127+0000","last_became_peered":"2024-05-09T09:47:12.200127+0000","last_unstale":"2024-05-09T09:50:40.083948+0000","last_undegraded":"2024-05-09T09:50:40.083948+0000","last_fullsized":"2024-05-09T09:50:40.083948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.322647+0000","last_change":"2024-05-09T09:47:14.190516+0000","last_active":"2024-05-09T09:50:33.322647+0000","last_peered":"2024-05-09T09:50:33.322647+0000","last_clean":"2024-05-09T09:50:33.322647+0000","last_became_active":"2024-05-09T09:47:14.190033+0000","last_became_peered":"2024-05-09T09:47:14.190033+0000","last_unstale":"2024-05-09T09:50:33.322647+0000","last_undegraded":"2024-05-09T09:50:33.322647+0000","last_fullsized":"2024-05-09T09:50:33.322647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:30.174791+0000","last_change":"2024-05-09T09:47:12.208249+0000","last_active":"2024-05-09T09:49:30.174791+0000","last_peered":"2024-05-09T09:49:30.174791+0000","last_clean":"2024-05-09T09:49:30.174791+0000","last_became_active":"2024-05-09T09:47:12.203424+0000","last_became_peered":"2024-05-09T09:47:12.203424+0000","last_unstale":"2024-05-09T09:49:30.174791+0000","last_undegraded":"2024-05-09T09:49:30.174791+0000","last_fullsized":"2024-05-09T09:49:30.174791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'5","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.404515+0000","last_change":"2024-05-09T09:47:14.187165+0000","last_active":"2024-05-09T09:50:33.404515+0000","last_peered":"2024-05-09T09:50:33.404515+0000","last_clean":"2024-05-09T09:50:33.404515+0000","last_became_active":"2024-05-09T09:47:14.186711+0000","last_became_peered":"2024-05-09T09:47:14.186711+0000","last_unstale":"2024-05-09T09:50:33.404515+0000","last_undegraded":"2024-05-09T09:50:33.404515+0000","last_fullsized":"2024-05-09T09:50:33.404515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.173661+0000","last_change":"2024-05-09T09:47:12.209730+0000","last_active":"2024-05-09T09:49:35.173661+0000","last_peered":"2024-05-09T09:49:35.173661+0000","last_clean":"2024-05-09T09:49:35.173661+0000","last_became_active":"2024-05-09T09:47:12.205320+0000","last_became_peered":"2024-05-09T09:47:12.205320+0000","last_unstale":"2024-05-09T09:49:35.173661+0000","last_undegraded":"2024-05-09T09:49:35.173661+0000","last_fullsized":"2024-05-09T09:49:35.173661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.404831+0000","last_change":"2024-05-09T09:47:14.178306+0000","last_active":"2024-05-09T09:50:33.404831+0000","last_peered":"2024-05-09T09:50:33.404831+0000","last_clean":"2024-05-09T09:50:33.404831+0000","last_became_active":"2024-05-09T09:47:14.177955+0000","last_became_peered":"2024-05-09T09:47:14.177955+0000","last_unstale":"2024-05-09T09:50:33.404831+0000","last_undegraded":"2024-05-09T09:50:33.404831+0000","last_fullsized":"2024-05-09T09:50:33.404831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.176255+0000","last_change":"2024-05-09T09:47:12.202337+0000","last_active":"2024-05-09T09:49:35.176255+0000","last_peered":"2024-05-09T09:49:35.176255+0000","last_clean":"2024-05-09T09:49:35.176255+0000","last_became_active":"2024-05-09T09:47:12.201790+0000","last_became_peered":"2024-05-09T09:47:12.201790+0000","last_unstale":"2024-05-09T09:49:35.176255+0000","last_undegraded":"2024-05-09T09:49:35.176255+0000","last_fullsized":"2024-05-09T09:49:35.176255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.136122+0000","last_change":"2024-05-09T09:47:12.207600+0000","last_active":"2024-05-09T09:50:33.136122+0000","last_peered":"2024-05-09T09:50:33.136122+0000","last_clean":"2024-05-09T09:50:33.136122+0000","last_became_active":"2024-05-09T09:47:12.203435+0000","last_became_peered":"2024-05-09T09:47:12.203435+0000","last_unstale":"2024-05-09T09:50:33.136122+0000","last_undegraded":"2024-05-09T09:50:33.136122+0000","last_fullsized":"2024-05-09T09:50:33.136122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'7","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.404902+0000","last_change":"2024-05-09T09:47:14.179261+0000","last_active":"2024-05-09T09:50:33.404902+0000","last_peered":"2024-05-09T09:50:33.404902+0000","last_clean":"2024-05-09T09:50:33.404902+0000","last_became_active":"2024-05-09T09:47:14.178142+0000","last_became_peered":"2024-05-09T09:47:14.178142+0000","last_unstale":"2024-05-09T09:50:33.404902+0000","last_undegraded":"2024-05-09T09:50:33.404902+0000","last_fullsized":"2024-05-09T09:50:33.404902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.165924+0000","last_change":"2024-05-09T09:47:12.207072+0000","last_active":"2024-05-09T09:49:35.165924+0000","last_peered":"2024-05-09T09:49:35.165924+0000","last_clean":"2024-05-09T09:49:35.165924+0000","last_became_active":"2024-05-09T09:47:12.205216+0000","last_became_peered":"2024-05-09T09:47:12.205216+0000","last_unstale":"2024-05-09T09:49:35.165924+0000","last_undegraded":"2024-05-09T09:49:35.165924+0000","last_fullsized":"2024-05-09T09:49:35.165924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'12","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.825940+0000","last_change":"2024-05-09T09:47:14.174424+0000","last_active":"2024-05-09T09:50:32.825940+0000","last_peered":"2024-05-09T09:50:32.825940+0000","last_clean":"2024-05-09T09:50:32.825940+0000","last_became_active":"2024-05-09T09:47:14.174123+0000","last_became_peered":"2024-05-09T09:47:14.174123+0000","last_unstale":"2024-05-09T09:50:32.825940+0000","last_undegraded":"2024-05-09T09:50:32.825940+0000","last_fullsized":"2024-05-09T09:50:32.825940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3873,"ondisk_log_size":3873,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1628,"num_read_kb":1518,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705715,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35792,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336048,"statfs":{"total":96636764160,"available":96600113152,"internally_reserved":0,"allocated":466944,"data_stored":146615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705717,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":995328,"data_stored":734132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705715,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1011712,"data_stored":733627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705717,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35760,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336080,"statfs":{"total":96636764160,"available":96600145920,"internally_reserved":0,"allocated":434176,"data_stored":145588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T09:51:05.478 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.478 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.478 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.479 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.479 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.479 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.479 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.479 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.479 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.479 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.479 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.479 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.480 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.480 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.480 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.480 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.480 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.480 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.480 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.480 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.480 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.480 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.481 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.481 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.481 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.481 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.481 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.481 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.481 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.481 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.481 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.481 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.482 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.482 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.482 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.482 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.482 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.482 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.482 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.482 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.482 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.483 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.483 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.483 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.483 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.483 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.483 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.483 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.483 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.483 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.484 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.484 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.484 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.484 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.484 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.484 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.484 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.484 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.485 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.485 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.485 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.485 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.485 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.485 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.485 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.485 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.485 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.486 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.486 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.486 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.486 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.486 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.486 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.486 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-09T09:46:56.015260+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.486 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-09T09:47:02.030833+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=2, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.486 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.487 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.487 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.487 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.487 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-09T09:47:02.030833+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=2, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.487 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.487 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.487 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.487 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.487 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-09T09:47:02.030833+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=2, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.488 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.488 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.488 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.488 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.488 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-09T09:47:02.030833+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=2, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.488 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.488 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.488 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.488 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.488 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.489 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.489 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-09T09:47:02.030833+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=2, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.489 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.489 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.489 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.489 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-09T09:47:02.030833+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=2, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.489 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.489 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.490 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.490 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-09T09:47:02.030833+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=2, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.490 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.490 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.490 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.490 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.490 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.490 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-09T09:47:02.030833+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=2, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.490 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.491 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.491 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.491 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.491 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.491 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.491 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.491 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.491 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.491 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.492 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.492 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.492 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.492 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.492 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.492 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.492 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.492 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.493 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.493 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.493 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.493 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.493 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.493 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.493 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.493 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.493 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.493 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.494 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.494 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.494 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.494 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.494 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.494 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.494 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.494 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.494 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.495 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.495 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.495 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.495 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.495 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.495 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.495 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-05-09T09:47:17.172274+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=17, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.495 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.495 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.496 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.496 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.496 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-05-09T09:47:19.184401+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=19, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.496 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.496 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.496 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.496 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.496 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.496 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.497 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.497 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.497 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.497 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.497 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.497 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.498 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.498 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.498 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.498 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.498 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.498 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.498 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.498 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.498 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.499 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.499 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.499 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.499 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.499 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.499 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.499 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.500 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.500 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.500 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.500 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.500 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.500 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.500 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.500 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.501 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:05.501 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-09T09:51:25.502 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T09:51:25.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.627+0000 7fc55b674640 1 Processor -- start 2024-05-09T09:51:25.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.627+0000 7fc55b674640 1 -- start start 2024-05-09T09:51:25.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.627+0000 7fc55b674640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc55412f4a0 0x7fc554133d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:51:25.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.627+0000 7fc55b674640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc55412f880 con 0x7fc55412e9b0 2024-05-09T09:51:25.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.627+0000 7fc55b674640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fc554115db0 con 0x7fc55412f4a0 2024-05-09T09:51:25.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.631+0000 7fc558c0f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc55412f4a0 0x7fc554133d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:51:25.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.631+0000 7fc559410640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc55412e9b0 0x7fc55412ed90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:56796/0 (socket says 172.21.15.110:56796) 2024-05-09T09:51:25.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.631+0000 7fc559410640 1 -- 172.21.15.110:0/3009780604 learned_addr learned my addr 172.21.15.110:0/3009780604 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:51:25.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.631+0000 7fc558c0f640 1 -- 172.21.15.110:0/3009780604 >> v1:172.21.15.110:6789/0 conn(0x7fc55412e9b0 legacy=0x7fc55412ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:51:25.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.631+0000 7fc553fff640 1 -- 172.21.15.110:0/3009780604 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3260496702 0 0) 0x7fc55412f880 con 0x7fc55412e9b0 2024-05-09T09:51:25.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.631+0000 7fc558c0f640 1 -- 172.21.15.110:0/3009780604 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5541161a0 con 0x7fc55412f4a0 2024-05-09T09:51:25.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.631+0000 7fc558c0f640 1 --2- 172.21.15.110:0/3009780604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc55412f4a0 0x7fc554133d30 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fc548009740 tx=0x7fc54801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac19dc62fb431b57 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:51:25.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.631+0000 7fc553fff640 1 -- 172.21.15.110:0/3009780604 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5480b0070 con 0x7fc55412f4a0 2024-05-09T09:51:25.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.631+0000 7fc553fff640 1 -- 172.21.15.110:0/3009780604 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5480ab530 con 0x7fc55412f4a0 2024-05-09T09:51:25.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.631+0000 7fc553fff640 1 -- 172.21.15.110:0/3009780604 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5480ab830 con 0x7fc55412f4a0 2024-05-09T09:51:25.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.631+0000 7fc55b674640 1 -- 172.21.15.110:0/3009780604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc55412f4a0 msgr2=0x7fc554133d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:51:25.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.631+0000 7fc55b674640 1 --2- 172.21.15.110:0/3009780604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc55412f4a0 0x7fc554133d30 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fc548009740 tx=0x7fc54801c370 comp rx=0 tx=0).stop 2024-05-09T09:51:25.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.635+0000 7fc55b674640 1 -- 172.21.15.110:0/3009780604 shutdown_connections 2024-05-09T09:51:25.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.635+0000 7fc55b674640 1 --2- 172.21.15.110:0/3009780604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc55412f4a0 0x7fc554133d30 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:51:25.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.635+0000 7fc55b674640 1 -- 172.21.15.110:0/3009780604 >> 172.21.15.110:0/3009780604 conn(0x7fc55409fbc0 msgr2=0x7fc554072140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:51:25.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.635+0000 7fc55b674640 1 -- 172.21.15.110:0/3009780604 shutdown_connections 2024-05-09T09:51:25.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.635+0000 7fc55b674640 1 -- 172.21.15.110:0/3009780604 wait complete. 2024-05-09T09:51:25.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.635+0000 7fc55b674640 1 Processor -- start 2024-05-09T09:51:25.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.635+0000 7fc55b674640 1 -- start start 2024-05-09T09:51:25.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.635+0000 7fc55b674640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc55412e9b0 0x7fc554131b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:51:25.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.635+0000 7fc55b674640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc554136e20 con 0x7fc55412e9b0 2024-05-09T09:51:25.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.635+0000 7fc559410640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc55412e9b0 0x7fc554131b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:51:25.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.635+0000 7fc559410640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc55412e9b0 0x7fc554131b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46558/0 (socket says 172.21.15.110:46558) 2024-05-09T09:51:25.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.635+0000 7fc559410640 1 -- 172.21.15.110:0/4293593817 learned_addr learned my addr 172.21.15.110:0/4293593817 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:51:25.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.635+0000 7fc559410640 1 -- 172.21.15.110:0/4293593817 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc554116c80 con 0x7fc55412e9b0 2024-05-09T09:51:25.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.635+0000 7fc559410640 1 --2- 172.21.15.110:0/4293593817 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc55412e9b0 0x7fc554131b50 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fc54c00c700 tx=0x7fc54c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:51:25.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.635+0000 7fc551ffb640 1 -- 172.21.15.110:0/4293593817 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc54c018070 con 0x7fc55412e9b0 2024-05-09T09:51:25.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.635+0000 7fc551ffb640 1 -- 172.21.15.110:0/4293593817 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc54c004d80 con 0x7fc55412e9b0 2024-05-09T09:51:25.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.635+0000 7fc55b674640 1 -- 172.21.15.110:0/4293593817 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5541332c0 con 0x7fc55412e9b0 2024-05-09T09:51:25.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.635+0000 7fc551ffb640 1 -- 172.21.15.110:0/4293593817 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc54c00a7d0 con 0x7fc55412e9b0 2024-05-09T09:51:25.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.635+0000 7fc55b674640 1 -- 172.21.15.110:0/4293593817 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc554117920 con 0x7fc55412e9b0 2024-05-09T09:51:25.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.635+0000 7fc551ffb640 1 -- 172.21.15.110:0/4293593817 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fc54c01b070 con 0x7fc55412e9b0 2024-05-09T09:51:25.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.635+0000 7fc55b674640 1 -- 172.21.15.110:0/4293593817 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc554063710 con 0x7fc55412e9b0 2024-05-09T09:51:25.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.635+0000 7fc551ffb640 1 --2- 172.21.15.110:0/4293593817 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc540036310 0x7fc5400387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:51:25.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.635+0000 7fc551ffb640 1 -- 172.21.15.110:0/4293593817 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fc54c048ef0 con 0x7fc55412e9b0 2024-05-09T09:51:25.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.635+0000 7fc558c0f640 1 --2- 172.21.15.110:0/4293593817 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc540036310 0x7fc5400387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:51:25.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.639+0000 7fc558c0f640 1 --2- 172.21.15.110:0/4293593817 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc540036310 0x7fc5400387d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc548009740 tx=0x7fc548008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:51:25.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.643+0000 7fc551ffb640 1 -- 172.21.15.110:0/4293593817 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc554116c80 con 0x7fc55412e9b0 2024-05-09T09:51:25.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.799+0000 7fc55b674640 1 -- 172.21.15.110:0/4293593817 --> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc554117bb0 con 0x7fc540036310 2024-05-09T09:51:25.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.843+0000 7fc551ffb640 1 -- 172.21.15.110:0/4293593817 <== mgr.4100 v2:172.21.15.157:6824/2765519551 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+661865 (secure 0 0 0) 0x7fc554117bb0 con 0x7fc540036310 2024-05-09T09:51:25.851 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:51:25.860 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-05-09T09:51:25.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.855+0000 7fc55b674640 1 -- 172.21.15.110:0/4293593817 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc540036310 msgr2=0x7fc5400387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:51:25.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.855+0000 7fc55b674640 1 --2- 172.21.15.110:0/4293593817 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc540036310 0x7fc5400387d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc548009740 tx=0x7fc548008040 comp rx=0 tx=0).stop 2024-05-09T09:51:25.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.855+0000 7fc55b674640 1 -- 172.21.15.110:0/4293593817 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc55412e9b0 msgr2=0x7fc554131b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:51:25.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.855+0000 7fc55b674640 1 --2- 172.21.15.110:0/4293593817 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc55412e9b0 0x7fc554131b50 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fc54c00c700 tx=0x7fc54c00cbc0 comp rx=0 tx=0).stop 2024-05-09T09:51:25.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.855+0000 7fc55b674640 1 -- 172.21.15.110:0/4293593817 shutdown_connections 2024-05-09T09:51:25.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.855+0000 7fc55b674640 1 --2- 172.21.15.110:0/4293593817 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fc540036310 0x7fc5400387d0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:51:25.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.855+0000 7fc55b674640 1 --2- 172.21.15.110:0/4293593817 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc55412e9b0 0x7fc554131b50 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:51:25.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.855+0000 7fc55b674640 1 -- 172.21.15.110:0/4293593817 >> 172.21.15.110:0/4293593817 conn(0x7fc55409fbc0 msgr2=0x7fc55412c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:51:25.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.855+0000 7fc55b674640 1 -- 172.21.15.110:0/4293593817 shutdown_connections 2024-05-09T09:51:25.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:25.855+0000 7fc55b674640 1 -- 172.21.15.110:0/4293593817 wait complete. 2024-05-09T09:51:25.878 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2024-05-09T09:51:25.197210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5118,"num_read_kb":4699,"num_write":2179,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7140,"ondisk_log_size":7140,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":135864,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377351496,"statfs":{"total":386547056640,"available":386407931904,"internally_reserved":0,"allocated":2908160,"data_stored":1759962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005867"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:19.312646+0000","last_change":"2024-05-09T09:51:19.312716+0000","last_active":"2024-05-09T09:51:19.312646+0000","last_peered":"2024-05-09T09:51:19.312646+0000","last_clean":"2024-05-09T09:51:19.312646+0000","last_became_active":"2024-05-09T09:47:12.205786+0000","last_became_peered":"2024-05-09T09:47:12.205786+0000","last_unstale":"2024-05-09T09:51:19.312646+0000","last_undegraded":"2024-05-09T09:51:19.312646+0000","last_fullsized":"2024-05-09T09:51:19.312646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:19.312429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:19.312429+0000","last_clean_scrub_stamp":"2024-05-09T09:51:19.312429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:04:04.477540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:17.286142+0000","last_change":"2024-05-09T09:51:17.286281+0000","last_active":"2024-05-09T09:51:17.286142+0000","last_peered":"2024-05-09T09:51:17.286142+0000","last_clean":"2024-05-09T09:51:17.286142+0000","last_became_active":"2024-05-09T09:47:14.171044+0000","last_became_peered":"2024-05-09T09:47:14.171044+0000","last_unstale":"2024-05-09T09:51:17.286142+0000","last_undegraded":"2024-05-09T09:51:17.286142+0000","last_fullsized":"2024-05-09T09:51:17.286142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:17.285919+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:17.285919+0000","last_clean_scrub_stamp":"2024-05-09T09:51:17.285919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:38:58.303485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:43.297009+0000","last_change":"2024-05-09T09:47:12.190812+0000","last_active":"2024-05-09T09:50:43.297009+0000","last_peered":"2024-05-09T09:50:43.297009+0000","last_clean":"2024-05-09T09:50:43.297009+0000","last_became_active":"2024-05-09T09:47:12.189774+0000","last_became_peered":"2024-05-09T09:47:12.189774+0000","last_unstale":"2024-05-09T09:50:43.297009+0000","last_undegraded":"2024-05-09T09:50:43.297009+0000","last_fullsized":"2024-05-09T09:50:43.297009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:58.498693+0000","last_change":"2024-05-09T09:50:58.498826+0000","last_active":"2024-05-09T09:50:58.498693+0000","last_peered":"2024-05-09T09:50:58.498693+0000","last_clean":"2024-05-09T09:50:58.498693+0000","last_became_active":"2024-05-09T09:47:14.192803+0000","last_became_peered":"2024-05-09T09:47:14.192803+0000","last_unstale":"2024-05-09T09:50:58.498693+0000","last_undegraded":"2024-05-09T09:50:58.498693+0000","last_fullsized":"2024-05-09T09:50:58.498693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-09T09:50:58.498439+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-09T09:50:58.498439+0000","last_clean_scrub_stamp":"2024-05-09T09:50:58.498439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:24.753930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"32'3","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.172608+0000","last_change":"2024-05-09T09:47:12.209625+0000","last_active":"2024-05-09T09:49:20.172608+0000","last_peered":"2024-05-09T09:49:20.172608+0000","last_clean":"2024-05-09T09:49:20.172608+0000","last_became_active":"2024-05-09T09:47:12.207184+0000","last_became_peered":"2024-05-09T09:47:12.207184+0000","last_unstale":"2024-05-09T09:49:20.172608+0000","last_undegraded":"2024-05-09T09:49:20.172608+0000","last_fullsized":"2024-05-09T09:49:20.172608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'14","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:02.473931+0000","last_change":"2024-05-09T09:51:02.473990+0000","last_active":"2024-05-09T09:51:02.473931+0000","last_peered":"2024-05-09T09:51:02.473931+0000","last_clean":"2024-05-09T09:51:02.473931+0000","last_became_active":"2024-05-09T09:47:14.192821+0000","last_became_peered":"2024-05-09T09:47:14.192821+0000","last_unstale":"2024-05-09T09:51:02.473931+0000","last_undegraded":"2024-05-09T09:51:02.473931+0000","last_fullsized":"2024-05-09T09:51:02.473931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-05-09T09:51:02.473728+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-05-09T09:51:02.473728+0000","last_clean_scrub_stamp":"2024-05-09T09:51:02.473728+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:32.374501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.210761+0000","last_change":"2024-05-09T09:47:12.195169+0000","last_active":"2024-05-09T09:50:44.210761+0000","last_peered":"2024-05-09T09:50:44.210761+0000","last_clean":"2024-05-09T09:50:44.210761+0000","last_became_active":"2024-05-09T09:47:12.194183+0000","last_became_peered":"2024-05-09T09:47:12.194183+0000","last_unstale":"2024-05-09T09:50:44.210761+0000","last_undegraded":"2024-05-09T09:50:44.210761+0000","last_fullsized":"2024-05-09T09:50:44.210761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'12","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.824199+0000","last_change":"2024-05-09T09:47:52.430986+0000","last_active":"2024-05-09T09:50:32.824199+0000","last_peered":"2024-05-09T09:50:32.824199+0000","last_clean":"2024-05-09T09:50:32.824199+0000","last_became_active":"2024-05-09T09:47:52.429940+0000","last_became_peered":"2024-05-09T09:47:52.429940+0000","last_unstale":"2024-05-09T09:50:32.824199+0000","last_undegraded":"2024-05-09T09:50:32.824199+0000","last_fullsized":"2024-05-09T09:50:32.824199+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.178988+0000","last_change":"2024-05-09T09:47:12.212361+0000","last_active":"2024-05-09T09:49:45.178988+0000","last_peered":"2024-05-09T09:49:45.178988+0000","last_clean":"2024-05-09T09:49:45.178988+0000","last_became_active":"2024-05-09T09:47:12.204446+0000","last_became_peered":"2024-05-09T09:47:12.204446+0000","last_unstale":"2024-05-09T09:49:45.178988+0000","last_undegraded":"2024-05-09T09:49:45.178988+0000","last_fullsized":"2024-05-09T09:49:45.178988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'16","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:09.303305+0000","last_change":"2024-05-09T09:51:09.303305+0000","last_active":"2024-05-09T09:51:09.303305+0000","last_peered":"2024-05-09T09:51:09.303305+0000","last_clean":"2024-05-09T09:51:09.303305+0000","last_became_active":"2024-05-09T09:47:14.184792+0000","last_became_peered":"2024-05-09T09:47:14.184792+0000","last_unstale":"2024-05-09T09:51:09.303305+0000","last_undegraded":"2024-05-09T09:51:09.303305+0000","last_fullsized":"2024-05-09T09:51:09.303305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-05-09T09:51:09.303051+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-05-09T09:51:09.303051+0000","last_clean_scrub_stamp":"2024-05-09T09:51:09.303051+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:45:33.303026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.144347+0000","last_change":"2024-05-09T09:47:12.195761+0000","last_active":"2024-05-09T09:50:33.144347+0000","last_peered":"2024-05-09T09:50:33.144347+0000","last_clean":"2024-05-09T09:50:33.144347+0000","last_became_active":"2024-05-09T09:47:12.195117+0000","last_became_peered":"2024-05-09T09:47:12.195117+0000","last_unstale":"2024-05-09T09:50:33.144347+0000","last_undegraded":"2024-05-09T09:50:33.144347+0000","last_fullsized":"2024-05-09T09:50:33.144347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.321575+0000","last_change":"2024-05-09T09:47:14.189185+0000","last_active":"2024-05-09T09:50:33.321575+0000","last_peered":"2024-05-09T09:50:33.321575+0000","last_clean":"2024-05-09T09:50:33.321575+0000","last_became_active":"2024-05-09T09:47:14.188665+0000","last_became_peered":"2024-05-09T09:47:14.188665+0000","last_unstale":"2024-05-09T09:50:33.321575+0000","last_undegraded":"2024-05-09T09:50:33.321575+0000","last_fullsized":"2024-05-09T09:50:33.321575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"30'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.178799+0000","last_change":"2024-05-09T09:47:12.201245+0000","last_active":"2024-05-09T09:49:45.178799+0000","last_peered":"2024-05-09T09:49:45.178799+0000","last_clean":"2024-05-09T09:49:45.178799+0000","last_became_active":"2024-05-09T09:47:12.199697+0000","last_became_peered":"2024-05-09T09:47:12.199697+0000","last_unstale":"2024-05-09T09:49:45.178799+0000","last_undegraded":"2024-05-09T09:49:45.178799+0000","last_fullsized":"2024-05-09T09:49:45.178799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:14.446763+0000","last_change":"2024-05-09T09:51:14.446828+0000","last_active":"2024-05-09T09:51:14.446763+0000","last_peered":"2024-05-09T09:51:14.446763+0000","last_clean":"2024-05-09T09:51:14.446763+0000","last_became_active":"2024-05-09T09:47:14.179041+0000","last_became_peered":"2024-05-09T09:47:14.179041+0000","last_unstale":"2024-05-09T09:51:14.446763+0000","last_undegraded":"2024-05-09T09:51:14.446763+0000","last_fullsized":"2024-05-09T09:51:14.446763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-09T09:51:14.446529+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-09T09:51:14.446529+0000","last_clean_scrub_stamp":"2024-05-09T09:51:14.446529+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:59:33.567541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.168380+0000","last_change":"2024-05-09T09:47:12.185018+0000","last_active":"2024-05-09T09:49:45.168380+0000","last_peered":"2024-05-09T09:49:45.168380+0000","last_clean":"2024-05-09T09:49:45.168380+0000","last_became_active":"2024-05-09T09:47:12.183745+0000","last_became_peered":"2024-05-09T09:47:12.183745+0000","last_unstale":"2024-05-09T09:49:45.168380+0000","last_undegraded":"2024-05-09T09:49:45.168380+0000","last_fullsized":"2024-05-09T09:49:45.168380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'14","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:08.402177+0000","last_change":"2024-05-09T09:51:08.402293+0000","last_active":"2024-05-09T09:51:08.402177+0000","last_peered":"2024-05-09T09:51:08.402177+0000","last_clean":"2024-05-09T09:51:08.402177+0000","last_became_active":"2024-05-09T09:47:14.173031+0000","last_became_peered":"2024-05-09T09:47:14.173031+0000","last_unstale":"2024-05-09T09:51:08.402177+0000","last_undegraded":"2024-05-09T09:51:08.402177+0000","last_fullsized":"2024-05-09T09:51:08.402177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-05-09T09:51:08.401898+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-05-09T09:51:08.401898+0000","last_clean_scrub_stamp":"2024-05-09T09:51:08.401898+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:55.999690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:01.424330+0000","last_change":"2024-05-09T09:51:01.424391+0000","last_active":"2024-05-09T09:51:01.424330+0000","last_peered":"2024-05-09T09:51:01.424330+0000","last_clean":"2024-05-09T09:51:01.424330+0000","last_became_active":"2024-05-09T09:47:14.192744+0000","last_became_peered":"2024-05-09T09:47:14.192744+0000","last_unstale":"2024-05-09T09:51:01.424330+0000","last_undegraded":"2024-05-09T09:51:01.424330+0000","last_fullsized":"2024-05-09T09:51:01.424330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-05-09T09:51:01.424130+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-05-09T09:51:01.424130+0000","last_clean_scrub_stamp":"2024-05-09T09:51:01.424130+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:37:21.685395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:19.333407+0000","last_change":"2024-05-09T09:51:19.333526+0000","last_active":"2024-05-09T09:51:19.333407+0000","last_peered":"2024-05-09T09:51:19.333407+0000","last_clean":"2024-05-09T09:51:19.333407+0000","last_became_active":"2024-05-09T09:47:12.210781+0000","last_became_peered":"2024-05-09T09:47:12.210781+0000","last_unstale":"2024-05-09T09:51:19.333407+0000","last_undegraded":"2024-05-09T09:51:19.333407+0000","last_fullsized":"2024-05-09T09:51:19.333407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:19.333113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:19.333113+0000","last_clean_scrub_stamp":"2024-05-09T09:51:19.333113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:47:02.729348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'20","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:03.281379+0000","last_change":"2024-05-09T09:51:03.281444+0000","last_active":"2024-05-09T09:51:03.281379+0000","last_peered":"2024-05-09T09:51:03.281379+0000","last_clean":"2024-05-09T09:51:03.281379+0000","last_became_active":"2024-05-09T09:47:14.190021+0000","last_became_peered":"2024-05-09T09:47:14.190021+0000","last_unstale":"2024-05-09T09:51:03.281379+0000","last_undegraded":"2024-05-09T09:51:03.281379+0000","last_fullsized":"2024-05-09T09:51:03.281379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-05-09T09:51:03.281166+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-05-09T09:51:03.281166+0000","last_clean_scrub_stamp":"2024-05-09T09:51:03.281166+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:25.247894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.119657+0000","last_change":"2024-05-09T09:47:12.194645+0000","last_active":"2024-05-09T09:50:33.119657+0000","last_peered":"2024-05-09T09:50:33.119657+0000","last_clean":"2024-05-09T09:50:33.119657+0000","last_became_active":"2024-05-09T09:47:12.193509+0000","last_became_peered":"2024-05-09T09:47:12.193509+0000","last_unstale":"2024-05-09T09:50:33.119657+0000","last_undegraded":"2024-05-09T09:50:33.119657+0000","last_fullsized":"2024-05-09T09:50:33.119657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:06.263774+0000","last_change":"2024-05-09T09:51:06.263845+0000","last_active":"2024-05-09T09:51:06.263774+0000","last_peered":"2024-05-09T09:51:06.263774+0000","last_clean":"2024-05-09T09:51:06.263774+0000","last_became_active":"2024-05-09T09:47:14.189468+0000","last_became_peered":"2024-05-09T09:47:14.189468+0000","last_unstale":"2024-05-09T09:51:06.263774+0000","last_undegraded":"2024-05-09T09:51:06.263774+0000","last_fullsized":"2024-05-09T09:51:06.263774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:06.263525+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:06.263525+0000","last_clean_scrub_stamp":"2024-05-09T09:51:06.263525+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:12:00.576796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.178206+0000","last_change":"2024-05-09T09:47:12.210720+0000","last_active":"2024-05-09T09:49:40.178206+0000","last_peered":"2024-05-09T09:49:40.178206+0000","last_clean":"2024-05-09T09:49:40.178206+0000","last_became_active":"2024-05-09T09:47:12.206920+0000","last_became_peered":"2024-05-09T09:47:12.206920+0000","last_unstale":"2024-05-09T09:49:40.178206+0000","last_undegraded":"2024-05-09T09:49:40.178206+0000","last_fullsized":"2024-05-09T09:49:40.178206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'18","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:20.230718+0000","last_change":"2024-05-09T09:51:20.230883+0000","last_active":"2024-05-09T09:51:20.230718+0000","last_peered":"2024-05-09T09:51:20.230718+0000","last_clean":"2024-05-09T09:51:20.230718+0000","last_became_active":"2024-05-09T09:47:14.173701+0000","last_became_peered":"2024-05-09T09:47:14.173701+0000","last_unstale":"2024-05-09T09:51:20.230718+0000","last_undegraded":"2024-05-09T09:51:20.230718+0000","last_fullsized":"2024-05-09T09:51:20.230718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-05-09T09:51:20.230502+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-05-09T09:51:20.230502+0000","last_clean_scrub_stamp":"2024-05-09T09:51:20.230502+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:08:01.060833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.722331+0000","last_change":"2024-05-09T09:47:12.207271+0000","last_active":"2024-05-09T09:50:32.722331+0000","last_peered":"2024-05-09T09:50:32.722331+0000","last_clean":"2024-05-09T09:50:32.722331+0000","last_became_active":"2024-05-09T09:47:12.206564+0000","last_became_peered":"2024-05-09T09:47:12.206564+0000","last_unstale":"2024-05-09T09:50:32.722331+0000","last_undegraded":"2024-05-09T09:50:32.722331+0000","last_fullsized":"2024-05-09T09:50:32.722331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'10","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:10.414405+0000","last_change":"2024-05-09T09:51:10.414463+0000","last_active":"2024-05-09T09:51:10.414405+0000","last_peered":"2024-05-09T09:51:10.414405+0000","last_clean":"2024-05-09T09:51:10.414405+0000","last_became_active":"2024-05-09T09:47:14.173022+0000","last_became_peered":"2024-05-09T09:47:14.173022+0000","last_unstale":"2024-05-09T09:51:10.414405+0000","last_undegraded":"2024-05-09T09:51:10.414405+0000","last_fullsized":"2024-05-09T09:51:10.414405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-09T09:51:10.414205+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-09T09:51:10.414205+0000","last_clean_scrub_stamp":"2024-05-09T09:51:10.414205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:51:35.503195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:17.187884+0000","last_change":"2024-05-09T09:51:17.187941+0000","last_active":"2024-05-09T09:51:17.187884+0000","last_peered":"2024-05-09T09:51:17.187884+0000","last_clean":"2024-05-09T09:51:17.187884+0000","last_became_active":"2024-05-09T09:47:12.214422+0000","last_became_peered":"2024-05-09T09:47:12.214422+0000","last_unstale":"2024-05-09T09:51:17.187884+0000","last_undegraded":"2024-05-09T09:51:17.187884+0000","last_fullsized":"2024-05-09T09:51:17.187884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:17.187681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:17.187681+0000","last_clean_scrub_stamp":"2024-05-09T09:51:17.187681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:47.088454+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:14.316742+0000","last_change":"2024-05-09T09:51:14.316808+0000","last_active":"2024-05-09T09:51:14.316742+0000","last_peered":"2024-05-09T09:51:14.316742+0000","last_clean":"2024-05-09T09:51:14.316742+0000","last_became_active":"2024-05-09T09:47:14.172297+0000","last_became_peered":"2024-05-09T09:47:14.172297+0000","last_unstale":"2024-05-09T09:51:14.316742+0000","last_undegraded":"2024-05-09T09:51:14.316742+0000","last_fullsized":"2024-05-09T09:51:14.316742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-09T09:51:14.316551+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-09T09:51:14.316551+0000","last_clean_scrub_stamp":"2024-05-09T09:51:14.316551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:05:01.778480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.175906+0000","last_change":"2024-05-09T09:47:12.213596+0000","last_active":"2024-05-09T09:49:35.175906+0000","last_peered":"2024-05-09T09:49:35.175906+0000","last_clean":"2024-05-09T09:49:35.175906+0000","last_became_active":"2024-05-09T09:47:12.211880+0000","last_became_peered":"2024-05-09T09:47:12.211880+0000","last_unstale":"2024-05-09T09:49:35.175906+0000","last_undegraded":"2024-05-09T09:49:35.175906+0000","last_fullsized":"2024-05-09T09:49:35.175906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'39","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.344633+0000","last_change":"2024-05-09T09:47:22.260431+0000","last_active":"2024-05-09T09:50:33.344633+0000","last_peered":"2024-05-09T09:50:33.344633+0000","last_clean":"2024-05-09T09:50:33.344633+0000","last_became_active":"2024-05-09T09:47:22.258991+0000","last_became_peered":"2024-05-09T09:47:22.258991+0000","last_unstale":"2024-05-09T09:50:33.344633+0000","last_undegraded":"2024-05-09T09:50:33.344633+0000","last_fullsized":"2024-05-09T09:50:33.344633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":174,"num_read_kb":174,"num_write":107,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.176070+0000","last_change":"2024-05-09T09:47:14.185176+0000","last_active":"2024-05-09T09:49:35.176070+0000","last_peered":"2024-05-09T09:49:35.176070+0000","last_clean":"2024-05-09T09:49:35.176070+0000","last_became_active":"2024-05-09T09:47:14.184851+0000","last_became_peered":"2024-05-09T09:47:14.184851+0000","last_unstale":"2024-05-09T09:49:35.176070+0000","last_undegraded":"2024-05-09T09:49:35.176070+0000","last_fullsized":"2024-05-09T09:49:35.176070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.083065+0000","last_change":"2024-05-09T09:47:12.214683+0000","last_active":"2024-05-09T09:50:40.083065+0000","last_peered":"2024-05-09T09:50:40.083065+0000","last_clean":"2024-05-09T09:50:40.083065+0000","last_became_active":"2024-05-09T09:47:12.214108+0000","last_became_peered":"2024-05-09T09:47:12.214108+0000","last_unstale":"2024-05-09T09:50:40.083065+0000","last_undegraded":"2024-05-09T09:50:40.083065+0000","last_fullsized":"2024-05-09T09:50:40.083065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:53.499175+0000","last_change":"2024-05-09T09:50:53.499229+0000","last_active":"2024-05-09T09:50:53.499175+0000","last_peered":"2024-05-09T09:50:53.499175+0000","last_clean":"2024-05-09T09:50:53.499175+0000","last_became_active":"2024-05-09T09:47:16.196516+0000","last_became_peered":"2024-05-09T09:47:16.196516+0000","last_unstale":"2024-05-09T09:50:53.499175+0000","last_undegraded":"2024-05-09T09:50:53.499175+0000","last_fullsized":"2024-05-09T09:50:53.499175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:53.498977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:53.498977+0000","last_clean_scrub_stamp":"2024-05-09T09:50:53.498977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:34:28.515132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'111","reported_seq":166,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:13.471271+0000","last_change":"2024-05-09T09:51:13.471414+0000","last_active":"2024-05-09T09:51:13.471271+0000","last_peered":"2024-05-09T09:51:13.471271+0000","last_clean":"2024-05-09T09:51:13.471271+0000","last_became_active":"2024-05-09T09:47:18.235911+0000","last_became_peered":"2024-05-09T09:47:18.235911+0000","last_unstale":"2024-05-09T09:51:13.471271+0000","last_undegraded":"2024-05-09T09:51:13.471271+0000","last_fullsized":"2024-05-09T09:51:13.471271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'111","last_scrub_stamp":"2024-05-09T09:51:13.471021+0000","last_deep_scrub":"32'111","last_deep_scrub_stamp":"2024-05-09T09:51:13.471021+0000","last_clean_scrub_stamp":"2024-05-09T09:51:13.471021+0000","objects_scrubbed":4,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:48:45.181255+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:04.247298+0000","last_change":"2024-05-09T09:51:04.247398+0000","last_active":"2024-05-09T09:51:04.247298+0000","last_peered":"2024-05-09T09:51:04.247298+0000","last_clean":"2024-05-09T09:51:04.247298+0000","last_became_active":"2024-05-09T09:47:20.251712+0000","last_became_peered":"2024-05-09T09:47:20.251712+0000","last_unstale":"2024-05-09T09:51:04.247298+0000","last_undegraded":"2024-05-09T09:51:04.247298+0000","last_fullsized":"2024-05-09T09:51:04.247298+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:04.247033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:04.247033+0000","last_clean_scrub_stamp":"2024-05-09T09:51:04.247033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:57.593992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:50.180967+0000","last_change":"2024-05-09T09:47:22.255759+0000","last_active":"2024-05-09T09:49:50.180967+0000","last_peered":"2024-05-09T09:49:50.180967+0000","last_clean":"2024-05-09T09:49:50.180967+0000","last_became_active":"2024-05-09T09:47:22.255180+0000","last_became_peered":"2024-05-09T09:47:22.255180+0000","last_unstale":"2024-05-09T09:49:50.180967+0000","last_undegraded":"2024-05-09T09:49:50.180967+0000","last_fullsized":"2024-05-09T09:49:50.180967+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.177619+0000","last_change":"2024-05-09T09:47:14.187449+0000","last_active":"2024-05-09T09:49:40.177619+0000","last_peered":"2024-05-09T09:49:40.177619+0000","last_clean":"2024-05-09T09:49:40.177619+0000","last_became_active":"2024-05-09T09:47:14.187095+0000","last_became_peered":"2024-05-09T09:47:14.187095+0000","last_unstale":"2024-05-09T09:49:40.177619+0000","last_undegraded":"2024-05-09T09:49:40.177619+0000","last_fullsized":"2024-05-09T09:49:40.177619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.296894+0000","last_change":"2024-05-09T09:47:12.196226+0000","last_active":"2024-05-09T09:50:33.296894+0000","last_peered":"2024-05-09T09:50:33.296894+0000","last_clean":"2024-05-09T09:50:33.296894+0000","last_became_active":"2024-05-09T09:47:12.194549+0000","last_became_peered":"2024-05-09T09:47:12.194549+0000","last_unstale":"2024-05-09T09:50:33.296894+0000","last_undegraded":"2024-05-09T09:50:33.296894+0000","last_fullsized":"2024-05-09T09:50:33.296894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:07.069278+0000","last_change":"2024-05-09T09:51:07.069334+0000","last_active":"2024-05-09T09:51:07.069278+0000","last_peered":"2024-05-09T09:51:07.069278+0000","last_clean":"2024-05-09T09:51:07.069278+0000","last_became_active":"2024-05-09T09:47:16.190755+0000","last_became_peered":"2024-05-09T09:47:16.190755+0000","last_unstale":"2024-05-09T09:51:07.069278+0000","last_undegraded":"2024-05-09T09:51:07.069278+0000","last_fullsized":"2024-05-09T09:51:07.069278+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:07.069053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:07.069053+0000","last_clean_scrub_stamp":"2024-05-09T09:51:07.069053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:51:02.166302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'10","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:47.334928+0000","last_change":"2024-05-09T09:50:47.334999+0000","last_active":"2024-05-09T09:50:47.334928+0000","last_peered":"2024-05-09T09:50:47.334928+0000","last_clean":"2024-05-09T09:50:47.334928+0000","last_became_active":"2024-05-09T09:47:18.214299+0000","last_became_peered":"2024-05-09T09:47:18.214299+0000","last_unstale":"2024-05-09T09:50:47.334928+0000","last_undegraded":"2024-05-09T09:50:47.334928+0000","last_fullsized":"2024-05-09T09:50:47.334928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-09T09:50:47.334727+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-09T09:50:47.334727+0000","last_clean_scrub_stamp":"2024-05-09T09:50:47.334727+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:31:56.932969+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:56.256173+0000","last_change":"2024-05-09T09:50:56.256269+0000","last_active":"2024-05-09T09:50:56.256173+0000","last_peered":"2024-05-09T09:50:56.256173+0000","last_clean":"2024-05-09T09:50:56.256173+0000","last_became_active":"2024-05-09T09:47:20.241096+0000","last_became_peered":"2024-05-09T09:47:20.241096+0000","last_unstale":"2024-05-09T09:50:56.256173+0000","last_undegraded":"2024-05-09T09:50:56.256173+0000","last_fullsized":"2024-05-09T09:50:56.256173+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:56.255842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:56.255842+0000","last_clean_scrub_stamp":"2024-05-09T09:50:56.255842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:53:33.355429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:55.170754+0000","last_change":"2024-05-09T09:47:22.258554+0000","last_active":"2024-05-09T09:49:55.170754+0000","last_peered":"2024-05-09T09:49:55.170754+0000","last_clean":"2024-05-09T09:49:55.170754+0000","last_became_active":"2024-05-09T09:47:22.257798+0000","last_became_peered":"2024-05-09T09:47:22.257798+0000","last_unstale":"2024-05-09T09:49:55.170754+0000","last_undegraded":"2024-05-09T09:49:55.170754+0000","last_fullsized":"2024-05-09T09:49:55.170754+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.960457+0000","last_change":"2024-05-09T09:47:52.430567+0000","last_active":"2024-05-09T09:50:32.960457+0000","last_peered":"2024-05-09T09:50:32.960457+0000","last_clean":"2024-05-09T09:50:32.960457+0000","last_became_active":"2024-05-09T09:47:52.429857+0000","last_became_peered":"2024-05-09T09:47:52.429857+0000","last_unstale":"2024-05-09T09:50:32.960457+0000","last_undegraded":"2024-05-09T09:50:32.960457+0000","last_fullsized":"2024-05-09T09:50:32.960457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.175839+0000","last_change":"2024-05-09T09:47:12.201826+0000","last_active":"2024-05-09T09:49:35.175839+0000","last_peered":"2024-05-09T09:49:35.175839+0000","last_clean":"2024-05-09T09:49:35.175839+0000","last_became_active":"2024-05-09T09:47:12.201415+0000","last_became_peered":"2024-05-09T09:47:12.201415+0000","last_unstale":"2024-05-09T09:49:35.175839+0000","last_undegraded":"2024-05-09T09:49:35.175839+0000","last_fullsized":"2024-05-09T09:49:35.175839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:03.013348+0000","last_change":"2024-05-09T09:51:03.013403+0000","last_active":"2024-05-09T09:51:03.013348+0000","last_peered":"2024-05-09T09:51:03.013348+0000","last_clean":"2024-05-09T09:51:03.013348+0000","last_became_active":"2024-05-09T09:47:16.212543+0000","last_became_peered":"2024-05-09T09:47:16.212543+0000","last_unstale":"2024-05-09T09:51:03.013348+0000","last_undegraded":"2024-05-09T09:51:03.013348+0000","last_fullsized":"2024-05-09T09:51:03.013348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:03.013120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:03.013120+0000","last_clean_scrub_stamp":"2024-05-09T09:51:03.013120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:48:14.324538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:56.286640+0000","last_change":"2024-05-09T09:50:56.286722+0000","last_active":"2024-05-09T09:50:56.286640+0000","last_peered":"2024-05-09T09:50:56.286640+0000","last_clean":"2024-05-09T09:50:56.286640+0000","last_became_active":"2024-05-09T09:47:18.212685+0000","last_became_peered":"2024-05-09T09:47:18.212685+0000","last_unstale":"2024-05-09T09:50:56.286640+0000","last_undegraded":"2024-05-09T09:50:56.286640+0000","last_fullsized":"2024-05-09T09:50:56.286640+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-09T09:50:56.286427+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-09T09:50:56.286427+0000","last_clean_scrub_stamp":"2024-05-09T09:50:56.286427+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:21.085497+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":395,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:06.438260+0000","last_change":"2024-05-09T09:51:06.438322+0000","last_active":"2024-05-09T09:51:06.438260+0000","last_peered":"2024-05-09T09:51:06.438260+0000","last_clean":"2024-05-09T09:51:06.438260+0000","last_became_active":"2024-05-09T09:47:20.250200+0000","last_became_peered":"2024-05-09T09:47:20.250200+0000","last_unstale":"2024-05-09T09:51:06.438260+0000","last_undegraded":"2024-05-09T09:51:06.438260+0000","last_fullsized":"2024-05-09T09:51:06.438260+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:51:06.438054+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:51:06.438054+0000","last_clean_scrub_stamp":"2024-05-09T09:51:06.438054+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:28:03.481485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:55.178124+0000","last_change":"2024-05-09T09:47:22.241318+0000","last_active":"2024-05-09T09:49:55.178124+0000","last_peered":"2024-05-09T09:49:55.178124+0000","last_clean":"2024-05-09T09:49:55.178124+0000","last_became_active":"2024-05-09T09:47:22.238160+0000","last_became_peered":"2024-05-09T09:47:22.238160+0000","last_unstale":"2024-05-09T09:49:55.178124+0000","last_undegraded":"2024-05-09T09:49:55.178124+0000","last_fullsized":"2024-05-09T09:49:55.178124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'16","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.825514+0000","last_change":"2024-05-09T09:47:14.177761+0000","last_active":"2024-05-09T09:50:32.825514+0000","last_peered":"2024-05-09T09:50:32.825514+0000","last_clean":"2024-05-09T09:50:32.825514+0000","last_became_active":"2024-05-09T09:47:14.176295+0000","last_became_peered":"2024-05-09T09:47:14.176295+0000","last_unstale":"2024-05-09T09:50:32.825514+0000","last_undegraded":"2024-05-09T09:50:32.825514+0000","last_fullsized":"2024-05-09T09:50:32.825514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.176293+0000","last_change":"2024-05-09T09:47:12.192627+0000","last_active":"2024-05-09T09:49:35.176293+0000","last_peered":"2024-05-09T09:49:35.176293+0000","last_clean":"2024-05-09T09:49:35.176293+0000","last_became_active":"2024-05-09T09:47:12.191194+0000","last_became_peered":"2024-05-09T09:47:12.191194+0000","last_unstale":"2024-05-09T09:49:35.176293+0000","last_undegraded":"2024-05-09T09:49:35.176293+0000","last_fullsized":"2024-05-09T09:49:35.176293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.179207+0000","last_change":"2024-05-09T09:47:52.201792+0000","last_active":"2024-05-09T09:49:45.179207+0000","last_peered":"2024-05-09T09:49:45.179207+0000","last_clean":"2024-05-09T09:49:45.179207+0000","last_became_active":"2024-05-09T09:47:52.201081+0000","last_became_peered":"2024-05-09T09:47:52.201081+0000","last_unstale":"2024-05-09T09:49:45.179207+0000","last_undegraded":"2024-05-09T09:49:45.179207+0000","last_fullsized":"2024-05-09T09:49:45.179207+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'110","reported_seq":165,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:52.254206+0000","last_change":"2024-05-09T09:50:52.254281+0000","last_active":"2024-05-09T09:50:52.254206+0000","last_peered":"2024-05-09T09:50:52.254206+0000","last_clean":"2024-05-09T09:50:52.254206+0000","last_became_active":"2024-05-09T09:47:18.217843+0000","last_became_peered":"2024-05-09T09:47:18.217843+0000","last_unstale":"2024-05-09T09:50:52.254206+0000","last_undegraded":"2024-05-09T09:50:52.254206+0000","last_fullsized":"2024-05-09T09:50:52.254206+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'110","last_scrub_stamp":"2024-05-09T09:50:52.254022+0000","last_deep_scrub":"32'110","last_deep_scrub_stamp":"2024-05-09T09:50:52.254022+0000","last_clean_scrub_stamp":"2024-05-09T09:50:52.254022+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:44:38.690119+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":455,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:43.906596+0000","last_change":"2024-05-09T09:50:43.906635+0000","last_active":"2024-05-09T09:50:43.906596+0000","last_peered":"2024-05-09T09:50:43.906596+0000","last_clean":"2024-05-09T09:50:43.906596+0000","last_became_active":"2024-05-09T09:47:20.242448+0000","last_became_peered":"2024-05-09T09:47:20.242448+0000","last_unstale":"2024-05-09T09:50:43.906596+0000","last_undegraded":"2024-05-09T09:50:43.906596+0000","last_fullsized":"2024-05-09T09:50:43.906596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:43.906506+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:43.906506+0000","last_clean_scrub_stamp":"2024-05-09T09:50:43.906506+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:08.705575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.170799+0000","last_change":"2024-05-09T09:47:52.179916+0000","last_active":"2024-05-09T09:50:33.170799+0000","last_peered":"2024-05-09T09:50:33.170799+0000","last_clean":"2024-05-09T09:50:33.170799+0000","last_became_active":"2024-05-09T09:47:52.179059+0000","last_became_peered":"2024-05-09T09:47:52.179059+0000","last_unstale":"2024-05-09T09:50:33.170799+0000","last_undegraded":"2024-05-09T09:50:33.170799+0000","last_fullsized":"2024-05-09T09:50:33.170799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:30.172545+0000","last_change":"2024-05-09T09:47:12.206447+0000","last_active":"2024-05-09T09:49:30.172545+0000","last_peered":"2024-05-09T09:49:30.172545+0000","last_clean":"2024-05-09T09:49:30.172545+0000","last_became_active":"2024-05-09T09:47:12.205259+0000","last_became_peered":"2024-05-09T09:47:12.205259+0000","last_unstale":"2024-05-09T09:49:30.172545+0000","last_undegraded":"2024-05-09T09:49:30.172545+0000","last_fullsized":"2024-05-09T09:49:30.172545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:02.242426+0000","last_change":"2024-05-09T09:51:02.242526+0000","last_active":"2024-05-09T09:51:02.242426+0000","last_peered":"2024-05-09T09:51:02.242426+0000","last_clean":"2024-05-09T09:51:02.242426+0000","last_became_active":"2024-05-09T09:47:16.207404+0000","last_became_peered":"2024-05-09T09:47:16.207404+0000","last_unstale":"2024-05-09T09:51:02.242426+0000","last_undegraded":"2024-05-09T09:51:02.242426+0000","last_fullsized":"2024-05-09T09:51:02.242426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:02.242155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:02.242155+0000","last_clean_scrub_stamp":"2024-05-09T09:51:02.242155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:18:43.580003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'127","reported_seq":187,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:51.216938+0000","last_change":"2024-05-09T09:50:51.217030+0000","last_active":"2024-05-09T09:50:51.216938+0000","last_peered":"2024-05-09T09:50:51.216938+0000","last_clean":"2024-05-09T09:50:51.216938+0000","last_became_active":"2024-05-09T09:47:18.220596+0000","last_became_peered":"2024-05-09T09:47:18.220596+0000","last_unstale":"2024-05-09T09:50:51.216938+0000","last_undegraded":"2024-05-09T09:50:51.216938+0000","last_fullsized":"2024-05-09T09:50:51.216938+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'127","last_scrub_stamp":"2024-05-09T09:50:51.216776+0000","last_deep_scrub":"32'127","last_deep_scrub_stamp":"2024-05-09T09:50:51.216776+0000","last_clean_scrub_stamp":"2024-05-09T09:50:51.216776+0000","objects_scrubbed":9,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:52:10.006215+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":63,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:45.825591+0000","last_change":"2024-05-09T09:50:45.825646+0000","last_active":"2024-05-09T09:50:45.825591+0000","last_peered":"2024-05-09T09:50:45.825591+0000","last_clean":"2024-05-09T09:50:45.825591+0000","last_became_active":"2024-05-09T09:47:20.244839+0000","last_became_peered":"2024-05-09T09:47:20.244839+0000","last_unstale":"2024-05-09T09:50:45.825591+0000","last_undegraded":"2024-05-09T09:50:45.825591+0000","last_fullsized":"2024-05-09T09:50:45.825591+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:45.825370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:45.825370+0000","last_clean_scrub_stamp":"2024-05-09T09:50:45.825370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:33:58.430560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.965352+0000","last_change":"2024-05-09T09:47:22.237841+0000","last_active":"2024-05-09T09:50:32.965352+0000","last_peered":"2024-05-09T09:50:32.965352+0000","last_clean":"2024-05-09T09:50:32.965352+0000","last_became_active":"2024-05-09T09:47:22.235895+0000","last_became_peered":"2024-05-09T09:47:22.235895+0000","last_unstale":"2024-05-09T09:50:32.965352+0000","last_undegraded":"2024-05-09T09:50:32.965352+0000","last_fullsized":"2024-05-09T09:50:32.965352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:15.273227+0000","last_change":"2024-05-09T09:51:15.273289+0000","last_active":"2024-05-09T09:51:15.273227+0000","last_peered":"2024-05-09T09:51:15.273227+0000","last_clean":"2024-05-09T09:51:15.273227+0000","last_became_active":"2024-05-09T09:47:14.172275+0000","last_became_peered":"2024-05-09T09:47:14.172275+0000","last_unstale":"2024-05-09T09:51:15.273227+0000","last_undegraded":"2024-05-09T09:51:15.273227+0000","last_fullsized":"2024-05-09T09:51:15.273227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:15.273035+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:15.273035+0000","last_clean_scrub_stamp":"2024-05-09T09:51:15.273035+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:10:49.381052+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:11.412711+0000","last_change":"2024-05-09T09:51:11.412780+0000","last_active":"2024-05-09T09:51:11.412711+0000","last_peered":"2024-05-09T09:51:11.412711+0000","last_clean":"2024-05-09T09:51:11.412711+0000","last_became_active":"2024-05-09T09:47:12.209274+0000","last_became_peered":"2024-05-09T09:47:12.209274+0000","last_unstale":"2024-05-09T09:51:11.412711+0000","last_undegraded":"2024-05-09T09:51:11.412711+0000","last_fullsized":"2024-05-09T09:51:11.412711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:11.412502+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:11.412502+0000","last_clean_scrub_stamp":"2024-05-09T09:51:11.412502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:20:20.774039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:59.933360+0000","last_change":"2024-05-09T09:50:59.933420+0000","last_active":"2024-05-09T09:50:59.933360+0000","last_peered":"2024-05-09T09:50:59.933360+0000","last_clean":"2024-05-09T09:50:59.933360+0000","last_became_active":"2024-05-09T09:47:16.214484+0000","last_became_peered":"2024-05-09T09:47:16.214484+0000","last_unstale":"2024-05-09T09:50:59.933360+0000","last_undegraded":"2024-05-09T09:50:59.933360+0000","last_fullsized":"2024-05-09T09:50:59.933360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:59.933158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:59.933158+0000","last_clean_scrub_stamp":"2024-05-09T09:50:59.933158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:53.280118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'113","reported_seq":168,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:51.479962+0000","last_change":"2024-05-09T09:50:51.480062+0000","last_active":"2024-05-09T09:50:51.479962+0000","last_peered":"2024-05-09T09:50:51.479962+0000","last_clean":"2024-05-09T09:50:51.479962+0000","last_became_active":"2024-05-09T09:47:18.224815+0000","last_became_peered":"2024-05-09T09:47:18.224815+0000","last_unstale":"2024-05-09T09:50:51.479962+0000","last_undegraded":"2024-05-09T09:50:51.479962+0000","last_fullsized":"2024-05-09T09:50:51.479962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'113","last_scrub_stamp":"2024-05-09T09:50:51.479757+0000","last_deep_scrub":"32'113","last_deep_scrub_stamp":"2024-05-09T09:50:51.479757+0000","last_clean_scrub_stamp":"2024-05-09T09:50:51.479757+0000","objects_scrubbed":4,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:05.084435+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:02.001137+0000","last_change":"2024-05-09T09:51:02.001194+0000","last_active":"2024-05-09T09:51:02.001137+0000","last_peered":"2024-05-09T09:51:02.001137+0000","last_clean":"2024-05-09T09:51:02.001137+0000","last_became_active":"2024-05-09T09:47:20.250686+0000","last_became_peered":"2024-05-09T09:47:20.250686+0000","last_unstale":"2024-05-09T09:51:02.001137+0000","last_undegraded":"2024-05-09T09:51:02.001137+0000","last_fullsized":"2024-05-09T09:51:02.001137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:02.000873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:02.000873+0000","last_clean_scrub_stamp":"2024-05-09T09:51:02.000873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:10:46.269234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'17","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.818302+0000","last_change":"2024-05-09T09:47:22.255914+0000","last_active":"2024-05-09T09:50:32.818302+0000","last_peered":"2024-05-09T09:50:32.818302+0000","last_clean":"2024-05-09T09:50:32.818302+0000","last_became_active":"2024-05-09T09:47:22.255076+0000","last_became_peered":"2024-05-09T09:47:22.255076+0000","last_unstale":"2024-05-09T09:50:32.818302+0000","last_undegraded":"2024-05-09T09:50:32.818302+0000","last_fullsized":"2024-05-09T09:50:32.818302+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":92,"num_read_kb":72,"num_write":55,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:16.427561+0000","last_change":"2024-05-09T09:51:16.427622+0000","last_active":"2024-05-09T09:51:16.427561+0000","last_peered":"2024-05-09T09:51:16.427561+0000","last_clean":"2024-05-09T09:51:16.427561+0000","last_became_active":"2024-05-09T09:47:14.180185+0000","last_became_peered":"2024-05-09T09:47:14.180185+0000","last_unstale":"2024-05-09T09:51:16.427561+0000","last_undegraded":"2024-05-09T09:51:16.427561+0000","last_fullsized":"2024-05-09T09:51:16.427561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-09T09:51:16.427325+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-09T09:51:16.427325+0000","last_clean_scrub_stamp":"2024-05-09T09:51:16.427325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:25:28.601825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:30.174800+0000","last_change":"2024-05-09T09:47:12.211357+0000","last_active":"2024-05-09T09:49:30.174800+0000","last_peered":"2024-05-09T09:49:30.174800+0000","last_clean":"2024-05-09T09:49:30.174800+0000","last_became_active":"2024-05-09T09:47:12.207751+0000","last_became_peered":"2024-05-09T09:47:12.207751+0000","last_unstale":"2024-05-09T09:49:30.174800+0000","last_undegraded":"2024-05-09T09:49:30.174800+0000","last_fullsized":"2024-05-09T09:49:30.174800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:04.040553+0000","last_change":"2024-05-09T09:51:04.040606+0000","last_active":"2024-05-09T09:51:04.040553+0000","last_peered":"2024-05-09T09:51:04.040553+0000","last_clean":"2024-05-09T09:51:04.040553+0000","last_became_active":"2024-05-09T09:47:16.207734+0000","last_became_peered":"2024-05-09T09:47:16.207734+0000","last_unstale":"2024-05-09T09:51:04.040553+0000","last_undegraded":"2024-05-09T09:51:04.040553+0000","last_fullsized":"2024-05-09T09:51:04.040553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:04.040339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:04.040339+0000","last_clean_scrub_stamp":"2024-05-09T09:51:04.040339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:34:42.732867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'119","reported_seq":177,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:47.428194+0000","last_change":"2024-05-09T09:50:47.428281+0000","last_active":"2024-05-09T09:50:47.428194+0000","last_peered":"2024-05-09T09:50:47.428194+0000","last_clean":"2024-05-09T09:50:47.428194+0000","last_became_active":"2024-05-09T09:47:18.230440+0000","last_became_peered":"2024-05-09T09:47:18.230440+0000","last_unstale":"2024-05-09T09:50:47.428194+0000","last_undegraded":"2024-05-09T09:50:47.428194+0000","last_fullsized":"2024-05-09T09:50:47.428194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-05-09T09:50:47.427971+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-05-09T09:50:47.427971+0000","last_clean_scrub_stamp":"2024-05-09T09:50:47.427971+0000","objects_scrubbed":7,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:24:59.602471+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":362,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:10.066149+0000","last_change":"2024-05-09T09:51:10.066212+0000","last_active":"2024-05-09T09:51:10.066149+0000","last_peered":"2024-05-09T09:51:10.066149+0000","last_clean":"2024-05-09T09:51:10.066149+0000","last_became_active":"2024-05-09T09:47:20.254305+0000","last_became_peered":"2024-05-09T09:47:20.254305+0000","last_unstale":"2024-05-09T09:51:10.066149+0000","last_undegraded":"2024-05-09T09:51:10.066149+0000","last_fullsized":"2024-05-09T09:51:10.066149+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:51:10.065958+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:51:10.065958+0000","last_clean_scrub_stamp":"2024-05-09T09:51:10.065958+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:04:57.527887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.166157+0000","last_change":"2024-05-09T09:47:22.239987+0000","last_active":"2024-05-09T09:49:35.166157+0000","last_peered":"2024-05-09T09:49:35.166157+0000","last_clean":"2024-05-09T09:49:35.166157+0000","last_became_active":"2024-05-09T09:47:22.239262+0000","last_became_peered":"2024-05-09T09:47:22.239262+0000","last_unstale":"2024-05-09T09:49:35.166157+0000","last_undegraded":"2024-05-09T09:49:35.166157+0000","last_fullsized":"2024-05-09T09:49:35.166157+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'8","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:30.172409+0000","last_change":"2024-05-09T09:47:14.184937+0000","last_active":"2024-05-09T09:49:30.172409+0000","last_peered":"2024-05-09T09:49:30.172409+0000","last_clean":"2024-05-09T09:49:30.172409+0000","last_became_active":"2024-05-09T09:47:14.184593+0000","last_became_peered":"2024-05-09T09:47:14.184593+0000","last_unstale":"2024-05-09T09:49:30.172409+0000","last_undegraded":"2024-05-09T09:49:30.172409+0000","last_fullsized":"2024-05-09T09:49:30.172409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'8","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.760996+0000","last_change":"2024-05-09T09:47:12.211539+0000","last_active":"2024-05-09T09:50:32.760996+0000","last_peered":"2024-05-09T09:50:32.760996+0000","last_clean":"2024-05-09T09:50:32.760996+0000","last_became_active":"2024-05-09T09:47:12.207403+0000","last_became_peered":"2024-05-09T09:47:12.207403+0000","last_unstale":"2024-05-09T09:50:32.760996+0000","last_undegraded":"2024-05-09T09:50:32.760996+0000","last_fullsized":"2024-05-09T09:50:32.760996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":16,"num_write_kb":8838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:58.967828+0000","last_change":"2024-05-09T09:50:58.967885+0000","last_active":"2024-05-09T09:50:58.967828+0000","last_peered":"2024-05-09T09:50:58.967828+0000","last_clean":"2024-05-09T09:50:58.967828+0000","last_became_active":"2024-05-09T09:47:16.214607+0000","last_became_peered":"2024-05-09T09:47:16.214607+0000","last_unstale":"2024-05-09T09:50:58.967828+0000","last_undegraded":"2024-05-09T09:50:58.967828+0000","last_fullsized":"2024-05-09T09:50:58.967828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:58.967631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:58.967631+0000","last_clean_scrub_stamp":"2024-05-09T09:50:58.967631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:20.934359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'212","reported_seq":285,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:45.413740+0000","last_change":"2024-05-09T09:50:45.413815+0000","last_active":"2024-05-09T09:50:45.413740+0000","last_peered":"2024-05-09T09:50:45.413740+0000","last_clean":"2024-05-09T09:50:45.413740+0000","last_became_active":"2024-05-09T09:47:18.224893+0000","last_became_peered":"2024-05-09T09:47:18.224893+0000","last_unstale":"2024-05-09T09:50:45.413740+0000","last_undegraded":"2024-05-09T09:50:45.413740+0000","last_fullsized":"2024-05-09T09:50:45.413740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'212","last_scrub_stamp":"2024-05-09T09:50:45.413522+0000","last_deep_scrub":"32'212","last_deep_scrub_stamp":"2024-05-09T09:50:45.413522+0000","last_clean_scrub_stamp":"2024-05-09T09:50:45.413522+0000","objects_scrubbed":5,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:59:04.534534+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:46.831526+0000","last_change":"2024-05-09T09:50:46.831580+0000","last_active":"2024-05-09T09:50:46.831526+0000","last_peered":"2024-05-09T09:50:46.831526+0000","last_clean":"2024-05-09T09:50:46.831526+0000","last_became_active":"2024-05-09T09:47:20.228339+0000","last_became_peered":"2024-05-09T09:47:20.228339+0000","last_unstale":"2024-05-09T09:50:46.831526+0000","last_undegraded":"2024-05-09T09:50:46.831526+0000","last_fullsized":"2024-05-09T09:50:46.831526+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:46.831331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:46.831331+0000","last_clean_scrub_stamp":"2024-05-09T09:50:46.831331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:58:25.885349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'18","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.472013+0000","last_change":"2024-05-09T09:47:22.230031+0000","last_active":"2024-05-09T09:50:33.472013+0000","last_peered":"2024-05-09T09:50:33.472013+0000","last_clean":"2024-05-09T09:50:33.472013+0000","last_became_active":"2024-05-09T09:47:22.229193+0000","last_became_peered":"2024-05-09T09:47:22.229193+0000","last_unstale":"2024-05-09T09:50:33.472013+0000","last_undegraded":"2024-05-09T09:50:33.472013+0000","last_fullsized":"2024-05-09T09:50:33.472013+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'8","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.254255+0000","last_change":"2024-05-09T09:47:14.177074+0000","last_active":"2024-05-09T09:50:33.254255+0000","last_peered":"2024-05-09T09:50:33.254255+0000","last_clean":"2024-05-09T09:50:33.254255+0000","last_became_active":"2024-05-09T09:47:14.176717+0000","last_became_peered":"2024-05-09T09:47:14.176717+0000","last_unstale":"2024-05-09T09:50:33.254255+0000","last_undegraded":"2024-05-09T09:50:33.254255+0000","last_fullsized":"2024-05-09T09:50:33.254255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:30.164862+0000","last_change":"2024-05-09T09:47:12.205840+0000","last_active":"2024-05-09T09:49:30.164862+0000","last_peered":"2024-05-09T09:49:30.164862+0000","last_clean":"2024-05-09T09:49:30.164862+0000","last_became_active":"2024-05-09T09:47:12.204317+0000","last_became_peered":"2024-05-09T09:47:12.204317+0000","last_unstale":"2024-05-09T09:49:30.164862+0000","last_undegraded":"2024-05-09T09:49:30.164862+0000","last_fullsized":"2024-05-09T09:49:30.164862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:01.269594+0000","last_change":"2024-05-09T09:51:01.269646+0000","last_active":"2024-05-09T09:51:01.269594+0000","last_peered":"2024-05-09T09:51:01.269594+0000","last_clean":"2024-05-09T09:51:01.269594+0000","last_became_active":"2024-05-09T09:47:16.197031+0000","last_became_peered":"2024-05-09T09:47:16.197031+0000","last_unstale":"2024-05-09T09:51:01.269594+0000","last_undegraded":"2024-05-09T09:51:01.269594+0000","last_fullsized":"2024-05-09T09:51:01.269594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:01.269403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:01.269403+0000","last_clean_scrub_stamp":"2024-05-09T09:51:01.269403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:20:09.570821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'113","reported_seq":169,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:46.341277+0000","last_change":"2024-05-09T09:50:46.341361+0000","last_active":"2024-05-09T09:50:46.341277+0000","last_peered":"2024-05-09T09:50:46.341277+0000","last_clean":"2024-05-09T09:50:46.341277+0000","last_became_active":"2024-05-09T09:47:18.215793+0000","last_became_peered":"2024-05-09T09:47:18.215793+0000","last_unstale":"2024-05-09T09:50:46.341277+0000","last_undegraded":"2024-05-09T09:50:46.341277+0000","last_fullsized":"2024-05-09T09:50:46.341277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'113","last_scrub_stamp":"2024-05-09T09:50:46.341062+0000","last_deep_scrub":"32'113","last_deep_scrub_stamp":"2024-05-09T09:50:46.341062+0000","last_clean_scrub_stamp":"2024-05-09T09:50:46.341062+0000","objects_scrubbed":5,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:24:06.850096+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:05.480724+0000","last_change":"2024-05-09T09:51:05.480782+0000","last_active":"2024-05-09T09:51:05.480724+0000","last_peered":"2024-05-09T09:51:05.480724+0000","last_clean":"2024-05-09T09:51:05.480724+0000","last_became_active":"2024-05-09T09:47:20.250363+0000","last_became_peered":"2024-05-09T09:47:20.250363+0000","last_unstale":"2024-05-09T09:51:05.480724+0000","last_undegraded":"2024-05-09T09:51:05.480724+0000","last_fullsized":"2024-05-09T09:51:05.480724+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:05.480520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:05.480520+0000","last_clean_scrub_stamp":"2024-05-09T09:51:05.480520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:07:46.310851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:19.416295+0000","last_change":"2024-05-09T09:51:19.416370+0000","last_active":"2024-05-09T09:51:19.416295+0000","last_peered":"2024-05-09T09:51:19.416295+0000","last_clean":"2024-05-09T09:51:19.416295+0000","last_became_active":"2024-05-09T09:47:22.242410+0000","last_became_peered":"2024-05-09T09:47:22.242410+0000","last_unstale":"2024-05-09T09:51:19.416295+0000","last_undegraded":"2024-05-09T09:51:19.416295+0000","last_fullsized":"2024-05-09T09:51:19.416295+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:19.416094+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:19.416094+0000","last_clean_scrub_stamp":"2024-05-09T09:51:19.416094+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:58.738776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:17.471788+0000","last_change":"2024-05-09T09:51:17.471951+0000","last_active":"2024-05-09T09:51:17.471788+0000","last_peered":"2024-05-09T09:51:17.471788+0000","last_clean":"2024-05-09T09:51:17.471788+0000","last_became_active":"2024-05-09T09:47:14.190016+0000","last_became_peered":"2024-05-09T09:47:14.190016+0000","last_unstale":"2024-05-09T09:51:17.471788+0000","last_undegraded":"2024-05-09T09:51:17.471788+0000","last_fullsized":"2024-05-09T09:51:17.471788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:17.471525+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:17.471525+0000","last_clean_scrub_stamp":"2024-05-09T09:51:17.471525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:24:31.781883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.173788+0000","last_change":"2024-05-09T09:47:12.212155+0000","last_active":"2024-05-09T09:49:25.173788+0000","last_peered":"2024-05-09T09:49:25.173788+0000","last_clean":"2024-05-09T09:49:25.173788+0000","last_became_active":"2024-05-09T09:47:12.211221+0000","last_became_peered":"2024-05-09T09:47:12.211221+0000","last_unstale":"2024-05-09T09:49:25.173788+0000","last_undegraded":"2024-05-09T09:49:25.173788+0000","last_fullsized":"2024-05-09T09:49:25.173788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:00.977401+0000","last_change":"2024-05-09T09:51:00.977458+0000","last_active":"2024-05-09T09:51:00.977401+0000","last_peered":"2024-05-09T09:51:00.977401+0000","last_clean":"2024-05-09T09:51:00.977401+0000","last_became_active":"2024-05-09T09:47:16.214462+0000","last_became_peered":"2024-05-09T09:47:16.214462+0000","last_unstale":"2024-05-09T09:51:00.977401+0000","last_undegraded":"2024-05-09T09:51:00.977401+0000","last_fullsized":"2024-05-09T09:51:00.977401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:00.977167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:00.977167+0000","last_clean_scrub_stamp":"2024-05-09T09:51:00.977167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:59:20.098179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'119","reported_seq":177,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:57.261189+0000","last_change":"2024-05-09T09:50:57.261272+0000","last_active":"2024-05-09T09:50:57.261189+0000","last_peered":"2024-05-09T09:50:57.261189+0000","last_clean":"2024-05-09T09:50:57.261189+0000","last_became_active":"2024-05-09T09:47:18.212543+0000","last_became_peered":"2024-05-09T09:47:18.212543+0000","last_unstale":"2024-05-09T09:50:57.261189+0000","last_undegraded":"2024-05-09T09:50:57.261189+0000","last_fullsized":"2024-05-09T09:50:57.261189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-05-09T09:50:57.261002+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-05-09T09:50:57.261002+0000","last_clean_scrub_stamp":"2024-05-09T09:50:57.261002+0000","objects_scrubbed":7,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:26:30.185703+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":445,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:45.121613+0000","last_change":"2024-05-09T09:50:45.121680+0000","last_active":"2024-05-09T09:50:45.121613+0000","last_peered":"2024-05-09T09:50:45.121613+0000","last_clean":"2024-05-09T09:50:45.121613+0000","last_became_active":"2024-05-09T09:47:20.240236+0000","last_became_peered":"2024-05-09T09:47:20.240236+0000","last_unstale":"2024-05-09T09:50:45.121613+0000","last_undegraded":"2024-05-09T09:50:45.121613+0000","last_fullsized":"2024-05-09T09:50:45.121613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:45.121417+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:45.121417+0000","last_clean_scrub_stamp":"2024-05-09T09:50:45.121417+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:31:47.109285+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'14","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.417897+0000","last_change":"2024-05-09T09:47:22.258681+0000","last_active":"2024-05-09T09:50:33.417897+0000","last_peered":"2024-05-09T09:50:33.417897+0000","last_clean":"2024-05-09T09:50:33.417897+0000","last_became_active":"2024-05-09T09:47:22.257986+0000","last_became_peered":"2024-05-09T09:47:22.257986+0000","last_unstale":"2024-05-09T09:50:33.417897+0000","last_undegraded":"2024-05-09T09:50:33.417897+0000","last_fullsized":"2024-05-09T09:50:33.417897+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:09.379244+0000","last_change":"2024-05-09T09:51:09.379305+0000","last_active":"2024-05-09T09:51:09.379244+0000","last_peered":"2024-05-09T09:51:09.379244+0000","last_clean":"2024-05-09T09:51:09.379244+0000","last_became_active":"2024-05-09T09:47:14.171963+0000","last_became_peered":"2024-05-09T09:47:14.171963+0000","last_unstale":"2024-05-09T09:51:09.379244+0000","last_undegraded":"2024-05-09T09:51:09.379244+0000","last_fullsized":"2024-05-09T09:51:09.379244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:09.379053+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:09.379053+0000","last_clean_scrub_stamp":"2024-05-09T09:51:09.379053+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:57:44.240122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.173696+0000","last_change":"2024-05-09T09:47:12.211112+0000","last_active":"2024-05-09T09:49:25.173696+0000","last_peered":"2024-05-09T09:49:25.173696+0000","last_clean":"2024-05-09T09:49:25.173696+0000","last_became_active":"2024-05-09T09:47:12.204519+0000","last_became_peered":"2024-05-09T09:47:12.204519+0000","last_unstale":"2024-05-09T09:49:25.173696+0000","last_undegraded":"2024-05-09T09:49:25.173696+0000","last_fullsized":"2024-05-09T09:49:25.173696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":428,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:55.290515+0000","last_change":"2024-05-09T09:50:55.290590+0000","last_active":"2024-05-09T09:50:55.290515+0000","last_peered":"2024-05-09T09:50:55.290515+0000","last_clean":"2024-05-09T09:50:55.290515+0000","last_became_active":"2024-05-09T09:47:16.210812+0000","last_became_peered":"2024-05-09T09:47:16.210812+0000","last_unstale":"2024-05-09T09:50:55.290515+0000","last_undegraded":"2024-05-09T09:50:55.290515+0000","last_fullsized":"2024-05-09T09:50:55.290515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-09T09:50:55.290303+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-09T09:50:55.290303+0000","last_clean_scrub_stamp":"2024-05-09T09:50:55.290303+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:23:31.095926+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:46.428538+0000","last_change":"2024-05-09T09:50:46.428614+0000","last_active":"2024-05-09T09:50:46.428538+0000","last_peered":"2024-05-09T09:50:46.428538+0000","last_clean":"2024-05-09T09:50:46.428538+0000","last_became_active":"2024-05-09T09:47:18.224565+0000","last_became_peered":"2024-05-09T09:47:18.224565+0000","last_unstale":"2024-05-09T09:50:46.428538+0000","last_undegraded":"2024-05-09T09:50:46.428538+0000","last_fullsized":"2024-05-09T09:50:46.428538+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-09T09:50:46.428349+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-09T09:50:46.428349+0000","last_clean_scrub_stamp":"2024-05-09T09:50:46.428349+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:10:30.696710+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":482,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.298607+0000","last_change":"2024-05-09T09:50:44.298675+0000","last_active":"2024-05-09T09:50:44.298607+0000","last_peered":"2024-05-09T09:50:44.298607+0000","last_clean":"2024-05-09T09:50:44.298607+0000","last_became_active":"2024-05-09T09:47:20.214337+0000","last_became_peered":"2024-05-09T09:47:20.214337+0000","last_unstale":"2024-05-09T09:50:44.298607+0000","last_undegraded":"2024-05-09T09:50:44.298607+0000","last_fullsized":"2024-05-09T09:50:44.298607+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:44.298414+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:44.298414+0000","last_clean_scrub_stamp":"2024-05-09T09:50:44.298414+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:00:15.815268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:06.322726+0000","last_change":"2024-05-09T09:51:06.322785+0000","last_active":"2024-05-09T09:51:06.322726+0000","last_peered":"2024-05-09T09:51:06.322726+0000","last_clean":"2024-05-09T09:51:06.322726+0000","last_became_active":"2024-05-09T09:47:22.233796+0000","last_became_peered":"2024-05-09T09:47:22.233796+0000","last_unstale":"2024-05-09T09:51:06.322726+0000","last_undegraded":"2024-05-09T09:51:06.322726+0000","last_fullsized":"2024-05-09T09:51:06.322726+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:06.322504+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:06.322504+0000","last_clean_scrub_stamp":"2024-05-09T09:51:06.322504+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:27:55.927227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.186084+0000","last_change":"2024-05-09T09:47:14.175270+0000","last_active":"2024-05-09T09:49:32.186084+0000","last_peered":"2024-05-09T09:49:32.186084+0000","last_clean":"2024-05-09T09:49:32.186084+0000","last_became_active":"2024-05-09T09:47:14.174707+0000","last_became_peered":"2024-05-09T09:47:14.174707+0000","last_unstale":"2024-05-09T09:49:32.186084+0000","last_undegraded":"2024-05-09T09:49:32.186084+0000","last_fullsized":"2024-05-09T09:49:32.186084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.173604+0000","last_change":"2024-05-09T09:47:12.208521+0000","last_active":"2024-05-09T09:49:25.173604+0000","last_peered":"2024-05-09T09:49:25.173604+0000","last_clean":"2024-05-09T09:49:25.173604+0000","last_became_active":"2024-05-09T09:47:12.207874+0000","last_became_peered":"2024-05-09T09:47:12.207874+0000","last_unstale":"2024-05-09T09:49:25.173604+0000","last_undegraded":"2024-05-09T09:49:25.173604+0000","last_fullsized":"2024-05-09T09:49:25.173604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"32'2","reported_seq":230,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:48.457895+0000","last_change":"2024-05-09T09:50:48.457964+0000","last_active":"2024-05-09T09:50:48.457895+0000","last_peered":"2024-05-09T09:50:48.457895+0000","last_clean":"2024-05-09T09:50:48.457895+0000","last_became_active":"2024-05-09T09:47:16.204577+0000","last_became_peered":"2024-05-09T09:47:16.204577+0000","last_unstale":"2024-05-09T09:50:48.457895+0000","last_undegraded":"2024-05-09T09:50:48.457895+0000","last_fullsized":"2024-05-09T09:50:48.457895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:50:48.457704+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:50:48.457704+0000","last_clean_scrub_stamp":"2024-05-09T09:50:48.457704+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:20:14.267139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'122","reported_seq":181,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:50.360778+0000","last_change":"2024-05-09T09:50:50.360866+0000","last_active":"2024-05-09T09:50:50.360778+0000","last_peered":"2024-05-09T09:50:50.360778+0000","last_clean":"2024-05-09T09:50:50.360778+0000","last_became_active":"2024-05-09T09:47:18.204057+0000","last_became_peered":"2024-05-09T09:47:18.204057+0000","last_unstale":"2024-05-09T09:50:50.360778+0000","last_undegraded":"2024-05-09T09:50:50.360778+0000","last_fullsized":"2024-05-09T09:50:50.360778+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'122","last_scrub_stamp":"2024-05-09T09:50:50.360552+0000","last_deep_scrub":"32'122","last_deep_scrub_stamp":"2024-05-09T09:50:50.360552+0000","last_clean_scrub_stamp":"2024-05-09T09:50:50.360552+0000","objects_scrubbed":8,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:58:29.414570+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:50.194469+0000","last_change":"2024-05-09T09:50:50.194527+0000","last_active":"2024-05-09T09:50:50.194469+0000","last_peered":"2024-05-09T09:50:50.194469+0000","last_clean":"2024-05-09T09:50:50.194469+0000","last_became_active":"2024-05-09T09:47:20.255477+0000","last_became_peered":"2024-05-09T09:47:20.255477+0000","last_unstale":"2024-05-09T09:50:50.194469+0000","last_undegraded":"2024-05-09T09:50:50.194469+0000","last_fullsized":"2024-05-09T09:50:50.194469+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:50.194227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:50.194227+0000","last_clean_scrub_stamp":"2024-05-09T09:50:50.194227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:40:06.186113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:08.256085+0000","last_change":"2024-05-09T09:51:08.256156+0000","last_active":"2024-05-09T09:51:08.256085+0000","last_peered":"2024-05-09T09:51:08.256085+0000","last_clean":"2024-05-09T09:51:08.256085+0000","last_became_active":"2024-05-09T09:47:22.227373+0000","last_became_peered":"2024-05-09T09:47:22.227373+0000","last_unstale":"2024-05-09T09:51:08.256085+0000","last_undegraded":"2024-05-09T09:51:08.256085+0000","last_fullsized":"2024-05-09T09:51:08.256085+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-09T09:51:08.255859+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-09T09:51:08.255859+0000","last_clean_scrub_stamp":"2024-05-09T09:51:08.255859+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:01:16.321404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:18.453711+0000","last_change":"2024-05-09T09:51:18.453848+0000","last_active":"2024-05-09T09:51:18.453711+0000","last_peered":"2024-05-09T09:51:18.453711+0000","last_clean":"2024-05-09T09:51:18.453711+0000","last_became_active":"2024-05-09T09:47:14.189623+0000","last_became_peered":"2024-05-09T09:47:14.189623+0000","last_unstale":"2024-05-09T09:51:18.453711+0000","last_undegraded":"2024-05-09T09:51:18.453711+0000","last_fullsized":"2024-05-09T09:51:18.453711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:18.453472+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:18.453472+0000","last_clean_scrub_stamp":"2024-05-09T09:51:18.453472+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:21:19.357961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":204,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:43.753842+0000","last_change":"2024-05-09T09:46:57.510904+0000","last_active":"2024-05-09T09:50:43.753842+0000","last_peered":"2024-05-09T09:50:43.753842+0000","last_clean":"2024-05-09T09:50:43.753842+0000","last_became_active":"2024-05-09T09:46:57.508178+0000","last_became_peered":"2024-05-09T09:46:57.508178+0000","last_unstale":"2024-05-09T09:50:43.753842+0000","last_undegraded":"2024-05-09T09:50:43.753842+0000","last_fullsized":"2024-05-09T09:50:43.753842+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:46:56.015260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:46:56.015260+0000","last_clean_scrub_stamp":"2024-05-09T09:46:56.015260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.649357+0000","last_change":"2024-05-09T09:47:03.054623+0000","last_active":"2024-05-09T09:50:44.649357+0000","last_peered":"2024-05-09T09:50:44.649357+0000","last_clean":"2024-05-09T09:50:44.649357+0000","last_became_active":"2024-05-09T09:47:03.053783+0000","last_became_peered":"2024-05-09T09:47:03.053783+0000","last_unstale":"2024-05-09T09:50:44.649357+0000","last_undegraded":"2024-05-09T09:50:44.649357+0000","last_fullsized":"2024-05-09T09:50:44.649357+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.172320+0000","last_change":"2024-05-09T09:47:12.212397+0000","last_active":"2024-05-09T09:49:20.172320+0000","last_peered":"2024-05-09T09:49:20.172320+0000","last_clean":"2024-05-09T09:49:20.172320+0000","last_became_active":"2024-05-09T09:47:12.211344+0000","last_became_peered":"2024-05-09T09:47:12.211344+0000","last_unstale":"2024-05-09T09:49:20.172320+0000","last_undegraded":"2024-05-09T09:49:20.172320+0000","last_fullsized":"2024-05-09T09:49:20.172320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:57.277858+0000","last_change":"2024-05-09T09:50:57.277911+0000","last_active":"2024-05-09T09:50:57.277858+0000","last_peered":"2024-05-09T09:50:57.277858+0000","last_clean":"2024-05-09T09:50:57.277858+0000","last_became_active":"2024-05-09T09:47:16.210404+0000","last_became_peered":"2024-05-09T09:47:16.210404+0000","last_unstale":"2024-05-09T09:50:57.277858+0000","last_undegraded":"2024-05-09T09:50:57.277858+0000","last_fullsized":"2024-05-09T09:50:57.277858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:57.277661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:57.277661+0000","last_clean_scrub_stamp":"2024-05-09T09:50:57.277661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:35:39.302436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'312","reported_seq":402,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:12.453361+0000","last_change":"2024-05-09T09:51:12.453446+0000","last_active":"2024-05-09T09:51:12.453361+0000","last_peered":"2024-05-09T09:51:12.453361+0000","last_clean":"2024-05-09T09:51:12.453361+0000","last_became_active":"2024-05-09T09:47:18.236370+0000","last_became_peered":"2024-05-09T09:47:18.236370+0000","last_unstale":"2024-05-09T09:51:12.453361+0000","last_undegraded":"2024-05-09T09:51:12.453361+0000","last_fullsized":"2024-05-09T09:51:12.453361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'312","last_scrub_stamp":"2024-05-09T09:51:12.453173+0000","last_deep_scrub":"32'312","last_deep_scrub_stamp":"2024-05-09T09:51:12.453173+0000","last_clean_scrub_stamp":"2024-05-09T09:51:12.453173+0000","objects_scrubbed":5,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:10:56.767720+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:53.880308+0000","last_change":"2024-05-09T09:50:53.880361+0000","last_active":"2024-05-09T09:50:53.880308+0000","last_peered":"2024-05-09T09:50:53.880308+0000","last_clean":"2024-05-09T09:50:53.880308+0000","last_became_active":"2024-05-09T09:47:20.250373+0000","last_became_peered":"2024-05-09T09:47:20.250373+0000","last_unstale":"2024-05-09T09:50:53.880308+0000","last_undegraded":"2024-05-09T09:50:53.880308+0000","last_fullsized":"2024-05-09T09:50:53.880308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:53.880117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:53.880117+0000","last_clean_scrub_stamp":"2024-05-09T09:50:53.880117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:35:35.904892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'86","reported_seq":170,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.340073+0000","last_change":"2024-05-09T09:47:22.237003+0000","last_active":"2024-05-09T09:50:33.340073+0000","last_peered":"2024-05-09T09:50:33.340073+0000","last_clean":"2024-05-09T09:50:33.340073+0000","last_became_active":"2024-05-09T09:47:22.236267+0000","last_became_peered":"2024-05-09T09:47:22.236267+0000","last_unstale":"2024-05-09T09:50:33.340073+0000","last_undegraded":"2024-05-09T09:50:33.340073+0000","last_fullsized":"2024-05-09T09:50:33.340073+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":223,"num_write":170,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.173979+0000","last_change":"2024-05-09T09:47:14.185397+0000","last_active":"2024-05-09T09:49:25.173979+0000","last_peered":"2024-05-09T09:49:25.173979+0000","last_clean":"2024-05-09T09:49:25.173979+0000","last_became_active":"2024-05-09T09:47:14.185071+0000","last_became_peered":"2024-05-09T09:47:14.185071+0000","last_unstale":"2024-05-09T09:49:25.173979+0000","last_undegraded":"2024-05-09T09:49:25.173979+0000","last_fullsized":"2024-05-09T09:49:25.173979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.649033+0000","last_change":"2024-05-09T09:47:03.051628+0000","last_active":"2024-05-09T09:50:44.649033+0000","last_peered":"2024-05-09T09:50:44.649033+0000","last_clean":"2024-05-09T09:50:44.649033+0000","last_became_active":"2024-05-09T09:47:03.050535+0000","last_became_peered":"2024-05-09T09:47:03.050535+0000","last_unstale":"2024-05-09T09:50:44.649033+0000","last_undegraded":"2024-05-09T09:50:44.649033+0000","last_fullsized":"2024-05-09T09:50:44.649033+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:43.296788+0000","last_change":"2024-05-09T09:47:12.206331+0000","last_active":"2024-05-09T09:50:43.296788+0000","last_peered":"2024-05-09T09:50:43.296788+0000","last_clean":"2024-05-09T09:50:43.296788+0000","last_became_active":"2024-05-09T09:47:12.203494+0000","last_became_peered":"2024-05-09T09:47:12.203494+0000","last_unstale":"2024-05-09T09:50:43.296788+0000","last_undegraded":"2024-05-09T09:50:43.296788+0000","last_fullsized":"2024-05-09T09:50:43.296788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:50.508717+0000","last_change":"2024-05-09T09:50:50.508773+0000","last_active":"2024-05-09T09:50:50.508717+0000","last_peered":"2024-05-09T09:50:50.508717+0000","last_clean":"2024-05-09T09:50:50.508717+0000","last_became_active":"2024-05-09T09:47:16.200369+0000","last_became_peered":"2024-05-09T09:47:16.200369+0000","last_unstale":"2024-05-09T09:50:50.508717+0000","last_undegraded":"2024-05-09T09:50:50.508717+0000","last_fullsized":"2024-05-09T09:50:50.508717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:50.508517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:50.508517+0000","last_clean_scrub_stamp":"2024-05-09T09:50:50.508517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:03:35.673628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'512","reported_seq":739,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:45.298073+0000","last_change":"2024-05-09T09:50:45.298265+0000","last_active":"2024-05-09T09:50:45.298073+0000","last_peered":"2024-05-09T09:50:45.298073+0000","last_clean":"2024-05-09T09:50:45.298073+0000","last_became_active":"2024-05-09T09:47:18.219321+0000","last_became_peered":"2024-05-09T09:47:18.219321+0000","last_unstale":"2024-05-09T09:50:45.298073+0000","last_undegraded":"2024-05-09T09:50:45.298073+0000","last_fullsized":"2024-05-09T09:50:45.298073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'512","last_scrub_stamp":"2024-05-09T09:50:45.297859+0000","last_deep_scrub":"32'512","last_deep_scrub_stamp":"2024-05-09T09:50:45.297859+0000","last_clean_scrub_stamp":"2024-05-09T09:50:45.297859+0000","objects_scrubbed":10,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:39:29.985192+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:09.466170+0000","last_change":"2024-05-09T09:51:09.466226+0000","last_active":"2024-05-09T09:51:09.466170+0000","last_peered":"2024-05-09T09:51:09.466170+0000","last_clean":"2024-05-09T09:51:09.466170+0000","last_became_active":"2024-05-09T09:47:20.249089+0000","last_became_peered":"2024-05-09T09:47:20.249089+0000","last_unstale":"2024-05-09T09:51:09.466170+0000","last_undegraded":"2024-05-09T09:51:09.466170+0000","last_fullsized":"2024-05-09T09:51:09.466170+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:09.465983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:09.465983+0000","last_clean_scrub_stamp":"2024-05-09T09:51:09.465983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:24:45.606721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.176388+0000","last_change":"2024-05-09T09:47:22.245460+0000","last_active":"2024-05-09T09:49:35.176388+0000","last_peered":"2024-05-09T09:49:35.176388+0000","last_clean":"2024-05-09T09:49:35.176388+0000","last_became_active":"2024-05-09T09:47:22.244543+0000","last_became_peered":"2024-05-09T09:47:22.244543+0000","last_unstale":"2024-05-09T09:49:35.176388+0000","last_undegraded":"2024-05-09T09:49:35.176388+0000","last_fullsized":"2024-05-09T09:49:35.176388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:24.272983+0000","last_change":"2024-05-09T09:51:24.273042+0000","last_active":"2024-05-09T09:51:24.272983+0000","last_peered":"2024-05-09T09:51:24.272983+0000","last_clean":"2024-05-09T09:51:24.272983+0000","last_became_active":"2024-05-09T09:47:14.173959+0000","last_became_peered":"2024-05-09T09:47:14.173959+0000","last_unstale":"2024-05-09T09:51:24.272983+0000","last_undegraded":"2024-05-09T09:51:24.272983+0000","last_fullsized":"2024-05-09T09:51:24.272983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:24.272797+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:24.272797+0000","last_clean_scrub_stamp":"2024-05-09T09:51:24.272797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:25:00.413535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.210152+0000","last_change":"2024-05-09T09:47:03.052957+0000","last_active":"2024-05-09T09:50:44.210152+0000","last_peered":"2024-05-09T09:50:44.210152+0000","last_clean":"2024-05-09T09:50:44.210152+0000","last_became_active":"2024-05-09T09:47:03.052185+0000","last_became_peered":"2024-05-09T09:47:03.052185+0000","last_unstale":"2024-05-09T09:50:44.210152+0000","last_undegraded":"2024-05-09T09:50:44.210152+0000","last_fullsized":"2024-05-09T09:50:44.210152+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:43.296612+0000","last_change":"2024-05-09T09:47:12.186149+0000","last_active":"2024-05-09T09:50:43.296612+0000","last_peered":"2024-05-09T09:50:43.296612+0000","last_clean":"2024-05-09T09:50:43.296612+0000","last_became_active":"2024-05-09T09:47:12.183846+0000","last_became_peered":"2024-05-09T09:47:12.183846+0000","last_unstale":"2024-05-09T09:50:43.296612+0000","last_undegraded":"2024-05-09T09:50:43.296612+0000","last_fullsized":"2024-05-09T09:50:43.296612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:00.281930+0000","last_change":"2024-05-09T09:51:00.281973+0000","last_active":"2024-05-09T09:51:00.281930+0000","last_peered":"2024-05-09T09:51:00.281930+0000","last_clean":"2024-05-09T09:51:00.281930+0000","last_became_active":"2024-05-09T09:47:16.197380+0000","last_became_peered":"2024-05-09T09:47:16.197380+0000","last_unstale":"2024-05-09T09:51:00.281930+0000","last_undegraded":"2024-05-09T09:51:00.281930+0000","last_fullsized":"2024-05-09T09:51:00.281930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:00.281822+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:00.281822+0000","last_clean_scrub_stamp":"2024-05-09T09:51:00.281822+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:17:45.780390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'25","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:53.285883+0000","last_change":"2024-05-09T09:50:53.286054+0000","last_active":"2024-05-09T09:50:53.285883+0000","last_peered":"2024-05-09T09:50:53.285883+0000","last_clean":"2024-05-09T09:50:53.285883+0000","last_became_active":"2024-05-09T09:47:18.217023+0000","last_became_peered":"2024-05-09T09:47:18.217023+0000","last_unstale":"2024-05-09T09:50:53.285883+0000","last_undegraded":"2024-05-09T09:50:53.285883+0000","last_fullsized":"2024-05-09T09:50:53.285883+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2024-05-09T09:50:53.285640+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2024-05-09T09:50:53.285640+0000","last_clean_scrub_stamp":"2024-05-09T09:50:53.285640+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:56:02.284410+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:57.982132+0000","last_change":"2024-05-09T09:50:57.982184+0000","last_active":"2024-05-09T09:50:57.982132+0000","last_peered":"2024-05-09T09:50:57.982132+0000","last_clean":"2024-05-09T09:50:57.982132+0000","last_became_active":"2024-05-09T09:47:20.250979+0000","last_became_peered":"2024-05-09T09:47:20.250979+0000","last_unstale":"2024-05-09T09:50:57.982132+0000","last_undegraded":"2024-05-09T09:50:57.982132+0000","last_fullsized":"2024-05-09T09:50:57.982132+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:57.981939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:57.981939+0000","last_clean_scrub_stamp":"2024-05-09T09:50:57.981939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:20:07.343476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.177467+0000","last_change":"2024-05-09T09:47:22.264183+0000","last_active":"2024-05-09T09:49:40.177467+0000","last_peered":"2024-05-09T09:49:40.177467+0000","last_clean":"2024-05-09T09:49:40.177467+0000","last_became_active":"2024-05-09T09:47:22.263615+0000","last_became_peered":"2024-05-09T09:47:22.263615+0000","last_unstale":"2024-05-09T09:49:40.177467+0000","last_undegraded":"2024-05-09T09:49:40.177467+0000","last_fullsized":"2024-05-09T09:49:40.177467+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'4","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:13.101070+0000","last_change":"2024-05-09T09:51:13.101070+0000","last_active":"2024-05-09T09:51:13.101070+0000","last_peered":"2024-05-09T09:51:13.101070+0000","last_clean":"2024-05-09T09:51:13.101070+0000","last_became_active":"2024-05-09T09:47:14.188644+0000","last_became_peered":"2024-05-09T09:47:14.188644+0000","last_unstale":"2024-05-09T09:51:13.101070+0000","last_undegraded":"2024-05-09T09:51:13.101070+0000","last_fullsized":"2024-05-09T09:51:13.101070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:13.100709+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:13.100709+0000","last_clean_scrub_stamp":"2024-05-09T09:51:13.100709+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:32:54.848587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.649028+0000","last_change":"2024-05-09T09:47:03.051760+0000","last_active":"2024-05-09T09:50:44.649028+0000","last_peered":"2024-05-09T09:50:44.649028+0000","last_clean":"2024-05-09T09:50:44.649028+0000","last_became_active":"2024-05-09T09:47:03.050832+0000","last_became_peered":"2024-05-09T09:47:03.050832+0000","last_unstale":"2024-05-09T09:50:44.649028+0000","last_undegraded":"2024-05-09T09:50:44.649028+0000","last_fullsized":"2024-05-09T09:50:44.649028+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.170101+0000","last_change":"2024-05-09T09:47:12.191109+0000","last_active":"2024-05-09T09:49:20.170101+0000","last_peered":"2024-05-09T09:49:20.170101+0000","last_clean":"2024-05-09T09:49:20.170101+0000","last_became_active":"2024-05-09T09:47:12.190521+0000","last_became_peered":"2024-05-09T09:47:12.190521+0000","last_unstale":"2024-05-09T09:49:20.170101+0000","last_undegraded":"2024-05-09T09:49:20.170101+0000","last_fullsized":"2024-05-09T09:49:20.170101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:08.084753+0000","last_change":"2024-05-09T09:51:08.084806+0000","last_active":"2024-05-09T09:51:08.084753+0000","last_peered":"2024-05-09T09:51:08.084753+0000","last_clean":"2024-05-09T09:51:08.084753+0000","last_became_active":"2024-05-09T09:47:16.187120+0000","last_became_peered":"2024-05-09T09:47:16.187120+0000","last_unstale":"2024-05-09T09:51:08.084753+0000","last_undegraded":"2024-05-09T09:51:08.084753+0000","last_fullsized":"2024-05-09T09:51:08.084753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:08.084559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:08.084559+0000","last_clean_scrub_stamp":"2024-05-09T09:51:08.084559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:22.872238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'21","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:49.497507+0000","last_change":"2024-05-09T09:50:49.497580+0000","last_active":"2024-05-09T09:50:49.497507+0000","last_peered":"2024-05-09T09:50:49.497507+0000","last_clean":"2024-05-09T09:50:49.497507+0000","last_became_active":"2024-05-09T09:47:18.230757+0000","last_became_peered":"2024-05-09T09:47:18.230757+0000","last_unstale":"2024-05-09T09:50:49.497507+0000","last_undegraded":"2024-05-09T09:50:49.497507+0000","last_fullsized":"2024-05-09T09:50:49.497507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-05-09T09:50:49.497309+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-05-09T09:50:49.497309+0000","last_clean_scrub_stamp":"2024-05-09T09:50:49.497309+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:00:57.562854+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:08.424896+0000","last_change":"2024-05-09T09:51:08.424955+0000","last_active":"2024-05-09T09:51:08.424896+0000","last_peered":"2024-05-09T09:51:08.424896+0000","last_clean":"2024-05-09T09:51:08.424896+0000","last_became_active":"2024-05-09T09:47:20.249919+0000","last_became_peered":"2024-05-09T09:47:20.249919+0000","last_unstale":"2024-05-09T09:51:08.424896+0000","last_undegraded":"2024-05-09T09:51:08.424896+0000","last_fullsized":"2024-05-09T09:51:08.424896+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:08.424700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:08.424700+0000","last_clean_scrub_stamp":"2024-05-09T09:51:08.424700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:41:47.741972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.176243+0000","last_change":"2024-05-09T09:47:22.260930+0000","last_active":"2024-05-09T09:49:35.176243+0000","last_peered":"2024-05-09T09:49:35.176243+0000","last_clean":"2024-05-09T09:49:35.176243+0000","last_became_active":"2024-05-09T09:47:22.259833+0000","last_became_peered":"2024-05-09T09:47:22.259833+0000","last_unstale":"2024-05-09T09:49:35.176243+0000","last_undegraded":"2024-05-09T09:49:35.176243+0000","last_fullsized":"2024-05-09T09:49:35.176243+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:16.280389+0000","last_change":"2024-05-09T09:51:16.280449+0000","last_active":"2024-05-09T09:51:16.280389+0000","last_peered":"2024-05-09T09:51:16.280389+0000","last_clean":"2024-05-09T09:51:16.280389+0000","last_became_active":"2024-05-09T09:47:14.173535+0000","last_became_peered":"2024-05-09T09:47:14.173535+0000","last_unstale":"2024-05-09T09:51:16.280389+0000","last_undegraded":"2024-05-09T09:51:16.280389+0000","last_fullsized":"2024-05-09T09:51:16.280389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:16.280201+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:16.280201+0000","last_clean_scrub_stamp":"2024-05-09T09:51:16.280201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:02:57.723193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.170160+0000","last_change":"2024-05-09T09:47:12.195767+0000","last_active":"2024-05-09T09:49:20.170160+0000","last_peered":"2024-05-09T09:49:20.170160+0000","last_clean":"2024-05-09T09:49:20.170160+0000","last_became_active":"2024-05-09T09:47:12.194500+0000","last_became_peered":"2024-05-09T09:47:12.194500+0000","last_unstale":"2024-05-09T09:49:20.170160+0000","last_undegraded":"2024-05-09T09:49:20.170160+0000","last_fullsized":"2024-05-09T09:49:20.170160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:43.296670+0000","last_change":"2024-05-09T09:47:03.051513+0000","last_active":"2024-05-09T09:50:43.296670+0000","last_peered":"2024-05-09T09:50:43.296670+0000","last_clean":"2024-05-09T09:50:43.296670+0000","last_became_active":"2024-05-09T09:47:03.051159+0000","last_became_peered":"2024-05-09T09:47:03.051159+0000","last_unstale":"2024-05-09T09:50:43.296670+0000","last_undegraded":"2024-05-09T09:50:43.296670+0000","last_fullsized":"2024-05-09T09:50:43.296670+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'7","reported_seq":241,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:05.017289+0000","last_change":"2024-05-09T09:51:05.017370+0000","last_active":"2024-05-09T09:51:05.017289+0000","last_peered":"2024-05-09T09:51:05.017289+0000","last_clean":"2024-05-09T09:51:05.017289+0000","last_became_active":"2024-05-09T09:47:16.198233+0000","last_became_peered":"2024-05-09T09:47:16.198233+0000","last_unstale":"2024-05-09T09:51:05.017289+0000","last_undegraded":"2024-05-09T09:51:05.017289+0000","last_fullsized":"2024-05-09T09:51:05.017289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-05-09T09:51:05.017095+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-05-09T09:51:05.017095+0000","last_clean_scrub_stamp":"2024-05-09T09:51:05.017095+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:53:06.632153+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1180,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":302,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'221","reported_seq":298,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:56.950939+0000","last_change":"2024-05-09T09:50:56.950939+0000","last_active":"2024-05-09T09:50:56.950939+0000","last_peered":"2024-05-09T09:50:56.950939+0000","last_clean":"2024-05-09T09:50:56.950939+0000","last_became_active":"2024-05-09T09:47:18.199411+0000","last_became_peered":"2024-05-09T09:47:18.199411+0000","last_unstale":"2024-05-09T09:50:56.950939+0000","last_undegraded":"2024-05-09T09:50:56.950939+0000","last_fullsized":"2024-05-09T09:50:56.950939+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'221","last_scrub_stamp":"2024-05-09T09:50:56.950671+0000","last_deep_scrub":"32'221","last_deep_scrub_stamp":"2024-05-09T09:50:56.950671+0000","last_clean_scrub_stamp":"2024-05-09T09:50:56.950671+0000","objects_scrubbed":9,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:44:33.387528+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:48.114287+0000","last_change":"2024-05-09T09:50:48.114403+0000","last_active":"2024-05-09T09:50:48.114287+0000","last_peered":"2024-05-09T09:50:48.114287+0000","last_clean":"2024-05-09T09:50:48.114287+0000","last_became_active":"2024-05-09T09:47:20.233024+0000","last_became_peered":"2024-05-09T09:47:20.233024+0000","last_unstale":"2024-05-09T09:50:48.114287+0000","last_undegraded":"2024-05-09T09:50:48.114287+0000","last_fullsized":"2024-05-09T09:50:48.114287+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:48.114039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:48.114039+0000","last_clean_scrub_stamp":"2024-05-09T09:50:48.114039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:03.759841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'11","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:14.131405+0000","last_change":"2024-05-09T09:51:14.131467+0000","last_active":"2024-05-09T09:51:14.131405+0000","last_peered":"2024-05-09T09:51:14.131405+0000","last_clean":"2024-05-09T09:51:14.131405+0000","last_became_active":"2024-05-09T09:47:22.228855+0000","last_became_peered":"2024-05-09T09:47:22.228855+0000","last_unstale":"2024-05-09T09:51:14.131405+0000","last_undegraded":"2024-05-09T09:51:14.131405+0000","last_fullsized":"2024-05-09T09:51:14.131405+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-05-09T09:51:14.131207+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-05-09T09:51:14.131207+0000","last_clean_scrub_stamp":"2024-05-09T09:51:14.131207+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:46:57.527442+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'12","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.320726+0000","last_change":"2024-05-09T09:47:52.440285+0000","last_active":"2024-05-09T09:50:33.320726+0000","last_peered":"2024-05-09T09:50:33.320726+0000","last_clean":"2024-05-09T09:50:33.320726+0000","last_became_active":"2024-05-09T09:47:52.430912+0000","last_became_peered":"2024-05-09T09:47:52.430912+0000","last_unstale":"2024-05-09T09:50:33.320726+0000","last_undegraded":"2024-05-09T09:50:33.320726+0000","last_fullsized":"2024-05-09T09:50:33.320726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:43.296857+0000","last_change":"2024-05-09T09:47:12.190681+0000","last_active":"2024-05-09T09:50:43.296857+0000","last_peered":"2024-05-09T09:50:43.296857+0000","last_clean":"2024-05-09T09:50:43.296857+0000","last_became_active":"2024-05-09T09:47:12.189486+0000","last_became_peered":"2024-05-09T09:47:12.189486+0000","last_unstale":"2024-05-09T09:50:43.296857+0000","last_undegraded":"2024-05-09T09:50:43.296857+0000","last_fullsized":"2024-05-09T09:50:43.296857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.649061+0000","last_change":"2024-05-09T09:47:03.051225+0000","last_active":"2024-05-09T09:50:44.649061+0000","last_peered":"2024-05-09T09:50:44.649061+0000","last_clean":"2024-05-09T09:50:44.649061+0000","last_became_active":"2024-05-09T09:47:03.050600+0000","last_became_peered":"2024-05-09T09:47:03.050600+0000","last_unstale":"2024-05-09T09:50:44.649061+0000","last_undegraded":"2024-05-09T09:50:44.649061+0000","last_fullsized":"2024-05-09T09:50:44.649061+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:54.486437+0000","last_change":"2024-05-09T09:50:54.486490+0000","last_active":"2024-05-09T09:50:54.486437+0000","last_peered":"2024-05-09T09:50:54.486437+0000","last_clean":"2024-05-09T09:50:54.486437+0000","last_became_active":"2024-05-09T09:47:16.182232+0000","last_became_peered":"2024-05-09T09:47:16.182232+0000","last_unstale":"2024-05-09T09:50:54.486437+0000","last_undegraded":"2024-05-09T09:50:54.486437+0000","last_fullsized":"2024-05-09T09:50:54.486437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:54.486244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:54.486244+0000","last_clean_scrub_stamp":"2024-05-09T09:50:54.486244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:04:41.948173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'21","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:49.380796+0000","last_change":"2024-05-09T09:50:49.380947+0000","last_active":"2024-05-09T09:50:49.380796+0000","last_peered":"2024-05-09T09:50:49.380796+0000","last_clean":"2024-05-09T09:50:49.380796+0000","last_became_active":"2024-05-09T09:47:18.211020+0000","last_became_peered":"2024-05-09T09:47:18.211020+0000","last_unstale":"2024-05-09T09:50:49.380796+0000","last_undegraded":"2024-05-09T09:50:49.380796+0000","last_fullsized":"2024-05-09T09:50:49.380796+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-05-09T09:50:49.380517+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-05-09T09:50:49.380517+0000","last_clean_scrub_stamp":"2024-05-09T09:50:49.380517+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:01.985708+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":384,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:52.295501+0000","last_change":"2024-05-09T09:50:52.295501+0000","last_active":"2024-05-09T09:50:52.295501+0000","last_peered":"2024-05-09T09:50:52.295501+0000","last_clean":"2024-05-09T09:50:52.295501+0000","last_became_active":"2024-05-09T09:47:20.226481+0000","last_became_peered":"2024-05-09T09:47:20.226481+0000","last_unstale":"2024-05-09T09:50:52.295501+0000","last_undegraded":"2024-05-09T09:50:52.295501+0000","last_fullsized":"2024-05-09T09:50:52.295501+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:52.295146+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:52.295146+0000","last_clean_scrub_stamp":"2024-05-09T09:50:52.295146+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:27.487386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.177712+0000","last_change":"2024-05-09T09:47:22.256859+0000","last_active":"2024-05-09T09:49:40.177712+0000","last_peered":"2024-05-09T09:49:40.177712+0000","last_clean":"2024-05-09T09:49:40.177712+0000","last_became_active":"2024-05-09T09:47:22.256285+0000","last_became_peered":"2024-05-09T09:47:22.256285+0000","last_unstale":"2024-05-09T09:49:40.177712+0000","last_undegraded":"2024-05-09T09:49:40.177712+0000","last_fullsized":"2024-05-09T09:49:40.177712+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.649904+0000","last_change":"2024-05-09T09:47:14.183911+0000","last_active":"2024-05-09T09:50:44.649904+0000","last_peered":"2024-05-09T09:50:44.649904+0000","last_clean":"2024-05-09T09:50:44.649904+0000","last_became_active":"2024-05-09T09:47:14.183542+0000","last_became_peered":"2024-05-09T09:47:14.183542+0000","last_unstale":"2024-05-09T09:50:44.649904+0000","last_undegraded":"2024-05-09T09:50:44.649904+0000","last_fullsized":"2024-05-09T09:50:44.649904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.174061+0000","last_change":"2024-05-09T09:47:12.200135+0000","last_active":"2024-05-09T09:49:25.174061+0000","last_peered":"2024-05-09T09:49:25.174061+0000","last_clean":"2024-05-09T09:49:25.174061+0000","last_became_active":"2024-05-09T09:47:12.199656+0000","last_became_peered":"2024-05-09T09:47:12.199656+0000","last_unstale":"2024-05-09T09:49:25.174061+0000","last_undegraded":"2024-05-09T09:49:25.174061+0000","last_fullsized":"2024-05-09T09:49:25.174061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:43.296694+0000","last_change":"2024-05-09T09:47:03.053083+0000","last_active":"2024-05-09T09:50:43.296694+0000","last_peered":"2024-05-09T09:50:43.296694+0000","last_clean":"2024-05-09T09:50:43.296694+0000","last_became_active":"2024-05-09T09:47:03.052728+0000","last_became_peered":"2024-05-09T09:47:03.052728+0000","last_unstale":"2024-05-09T09:50:43.296694+0000","last_undegraded":"2024-05-09T09:50:43.296694+0000","last_fullsized":"2024-05-09T09:50:43.296694+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.173653+0000","last_change":"2024-05-09T09:47:52.183646+0000","last_active":"2024-05-09T09:49:25.173653+0000","last_peered":"2024-05-09T09:49:25.173653+0000","last_clean":"2024-05-09T09:49:25.173653+0000","last_became_active":"2024-05-09T09:47:52.182360+0000","last_became_peered":"2024-05-09T09:47:52.182360+0000","last_unstale":"2024-05-09T09:49:25.173653+0000","last_undegraded":"2024-05-09T09:49:25.173653+0000","last_fullsized":"2024-05-09T09:49:25.173653+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:16.463616+0000","last_change":"2024-05-09T09:51:16.463719+0000","last_active":"2024-05-09T09:51:16.463616+0000","last_peered":"2024-05-09T09:51:16.463616+0000","last_clean":"2024-05-09T09:51:16.463616+0000","last_became_active":"2024-05-09T09:47:18.234556+0000","last_became_peered":"2024-05-09T09:47:18.234556+0000","last_unstale":"2024-05-09T09:51:16.463616+0000","last_undegraded":"2024-05-09T09:51:16.463616+0000","last_fullsized":"2024-05-09T09:51:16.463616+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-09T09:51:16.463413+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-09T09:51:16.463413+0000","last_clean_scrub_stamp":"2024-05-09T09:51:16.463413+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:45:18.905836+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":413,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:47.848052+0000","last_change":"2024-05-09T09:50:47.848115+0000","last_active":"2024-05-09T09:50:47.848052+0000","last_peered":"2024-05-09T09:50:47.848052+0000","last_clean":"2024-05-09T09:50:47.848052+0000","last_became_active":"2024-05-09T09:47:20.226936+0000","last_became_peered":"2024-05-09T09:47:20.226936+0000","last_unstale":"2024-05-09T09:50:47.848052+0000","last_undegraded":"2024-05-09T09:50:47.848052+0000","last_fullsized":"2024-05-09T09:50:47.848052+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:47.847851+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:47.847851+0000","last_clean_scrub_stamp":"2024-05-09T09:50:47.847851+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:23:07.394309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.178071+0000","last_change":"2024-05-09T09:47:22.260147+0000","last_active":"2024-05-09T09:49:40.178071+0000","last_peered":"2024-05-09T09:49:40.178071+0000","last_clean":"2024-05-09T09:49:40.178071+0000","last_became_active":"2024-05-09T09:47:22.259547+0000","last_became_peered":"2024-05-09T09:47:22.259547+0000","last_unstale":"2024-05-09T09:49:40.178071+0000","last_undegraded":"2024-05-09T09:49:40.178071+0000","last_fullsized":"2024-05-09T09:49:40.178071+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'12","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:12.442484+0000","last_change":"2024-05-09T09:51:12.442602+0000","last_active":"2024-05-09T09:51:12.442484+0000","last_peered":"2024-05-09T09:51:12.442484+0000","last_clean":"2024-05-09T09:51:12.442484+0000","last_became_active":"2024-05-09T09:47:14.173673+0000","last_became_peered":"2024-05-09T09:47:14.173673+0000","last_unstale":"2024-05-09T09:51:12.442484+0000","last_undegraded":"2024-05-09T09:51:12.442484+0000","last_fullsized":"2024-05-09T09:51:12.442484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-09T09:51:12.442192+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-09T09:51:12.442192+0000","last_clean_scrub_stamp":"2024-05-09T09:51:12.442192+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:34.408920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.174401+0000","last_change":"2024-05-09T09:47:12.206199+0000","last_active":"2024-05-09T09:49:25.174401+0000","last_peered":"2024-05-09T09:49:25.174401+0000","last_clean":"2024-05-09T09:49:25.174401+0000","last_became_active":"2024-05-09T09:47:12.205502+0000","last_became_peered":"2024-05-09T09:47:12.205502+0000","last_unstale":"2024-05-09T09:49:25.174401+0000","last_undegraded":"2024-05-09T09:49:25.174401+0000","last_fullsized":"2024-05-09T09:49:25.174401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:15.171272+0000","last_change":"2024-05-09T09:47:03.187330+0000","last_active":"2024-05-09T09:49:15.171272+0000","last_peered":"2024-05-09T09:49:15.171272+0000","last_clean":"2024-05-09T09:49:15.171272+0000","last_became_active":"2024-05-09T09:47:03.186434+0000","last_became_peered":"2024-05-09T09:47:03.186434+0000","last_unstale":"2024-05-09T09:49:15.171272+0000","last_undegraded":"2024-05-09T09:49:15.171272+0000","last_fullsized":"2024-05-09T09:49:15.171272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:56.472700+0000","last_change":"2024-05-09T09:50:56.472700+0000","last_active":"2024-05-09T09:50:56.472700+0000","last_peered":"2024-05-09T09:50:56.472700+0000","last_clean":"2024-05-09T09:50:56.472700+0000","last_became_active":"2024-05-09T09:47:16.182713+0000","last_became_peered":"2024-05-09T09:47:16.182713+0000","last_unstale":"2024-05-09T09:50:56.472700+0000","last_undegraded":"2024-05-09T09:50:56.472700+0000","last_fullsized":"2024-05-09T09:50:56.472700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:56.472447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:56.472447+0000","last_clean_scrub_stamp":"2024-05-09T09:50:56.472447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:02:37.915439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'318","reported_seq":411,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:49.169507+0000","last_change":"2024-05-09T09:50:49.169601+0000","last_active":"2024-05-09T09:50:49.169507+0000","last_peered":"2024-05-09T09:50:49.169507+0000","last_clean":"2024-05-09T09:50:49.169507+0000","last_became_active":"2024-05-09T09:47:18.226473+0000","last_became_peered":"2024-05-09T09:47:18.226473+0000","last_unstale":"2024-05-09T09:50:49.169507+0000","last_undegraded":"2024-05-09T09:50:49.169507+0000","last_fullsized":"2024-05-09T09:50:49.169507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'318","last_scrub_stamp":"2024-05-09T09:50:49.169325+0000","last_deep_scrub":"32'318","last_deep_scrub_stamp":"2024-05-09T09:50:49.169325+0000","last_clean_scrub_stamp":"2024-05-09T09:50:49.169325+0000","objects_scrubbed":8,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:47:39.409337+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:48.836834+0000","last_change":"2024-05-09T09:50:48.836895+0000","last_active":"2024-05-09T09:50:48.836834+0000","last_peered":"2024-05-09T09:50:48.836834+0000","last_clean":"2024-05-09T09:50:48.836834+0000","last_became_active":"2024-05-09T09:47:20.227198+0000","last_became_peered":"2024-05-09T09:47:20.227198+0000","last_unstale":"2024-05-09T09:50:48.836834+0000","last_undegraded":"2024-05-09T09:50:48.836834+0000","last_fullsized":"2024-05-09T09:50:48.836834+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:48.836642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:48.836642+0000","last_clean_scrub_stamp":"2024-05-09T09:50:48.836642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:31:25.639707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:02.266177+0000","last_change":"2024-05-09T09:51:02.266234+0000","last_active":"2024-05-09T09:51:02.266177+0000","last_peered":"2024-05-09T09:51:02.266177+0000","last_clean":"2024-05-09T09:51:02.266177+0000","last_became_active":"2024-05-09T09:47:22.233279+0000","last_became_peered":"2024-05-09T09:47:22.233279+0000","last_unstale":"2024-05-09T09:51:02.266177+0000","last_undegraded":"2024-05-09T09:51:02.266177+0000","last_fullsized":"2024-05-09T09:51:02.266177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:02.265986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:02.265986+0000","last_clean_scrub_stamp":"2024-05-09T09:51:02.265986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:11:12.792128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:30.172533+0000","last_change":"2024-05-09T09:47:22.237682+0000","last_active":"2024-05-09T09:49:30.172533+0000","last_peered":"2024-05-09T09:49:30.172533+0000","last_clean":"2024-05-09T09:49:30.172533+0000","last_became_active":"2024-05-09T09:47:22.236863+0000","last_became_peered":"2024-05-09T09:47:22.236863+0000","last_unstale":"2024-05-09T09:49:30.172533+0000","last_undegraded":"2024-05-09T09:49:30.172533+0000","last_fullsized":"2024-05-09T09:49:30.172533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:18.352558+0000","last_change":"2024-05-09T09:51:18.352621+0000","last_active":"2024-05-09T09:51:18.352558+0000","last_peered":"2024-05-09T09:51:18.352558+0000","last_clean":"2024-05-09T09:51:18.352558+0000","last_became_active":"2024-05-09T09:47:14.184250+0000","last_became_peered":"2024-05-09T09:47:14.184250+0000","last_unstale":"2024-05-09T09:51:18.352558+0000","last_undegraded":"2024-05-09T09:51:18.352558+0000","last_fullsized":"2024-05-09T09:51:18.352558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:18.352348+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:18.352348+0000","last_clean_scrub_stamp":"2024-05-09T09:51:18.352348+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:53:19.967406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.176039+0000","last_change":"2024-05-09T09:47:12.208454+0000","last_active":"2024-05-09T09:49:35.176039+0000","last_peered":"2024-05-09T09:49:35.176039+0000","last_clean":"2024-05-09T09:49:35.176039+0000","last_became_active":"2024-05-09T09:47:12.203479+0000","last_became_peered":"2024-05-09T09:47:12.203479+0000","last_unstale":"2024-05-09T09:49:35.176039+0000","last_undegraded":"2024-05-09T09:49:35.176039+0000","last_fullsized":"2024-05-09T09:49:35.176039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:53.265518+0000","last_change":"2024-05-09T09:50:53.265573+0000","last_active":"2024-05-09T09:50:53.265518+0000","last_peered":"2024-05-09T09:50:53.265518+0000","last_clean":"2024-05-09T09:50:53.265518+0000","last_became_active":"2024-05-09T09:47:16.210992+0000","last_became_peered":"2024-05-09T09:47:16.210992+0000","last_unstale":"2024-05-09T09:50:53.265518+0000","last_undegraded":"2024-05-09T09:50:53.265518+0000","last_fullsized":"2024-05-09T09:50:53.265518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:53.265312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:53.265312+0000","last_clean_scrub_stamp":"2024-05-09T09:50:53.265312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:28:20.308389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'113","reported_seq":169,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:57.465836+0000","last_change":"2024-05-09T09:50:57.465918+0000","last_active":"2024-05-09T09:50:57.465836+0000","last_peered":"2024-05-09T09:50:57.465836+0000","last_clean":"2024-05-09T09:50:57.465836+0000","last_became_active":"2024-05-09T09:47:18.234014+0000","last_became_peered":"2024-05-09T09:47:18.234014+0000","last_unstale":"2024-05-09T09:50:57.465836+0000","last_undegraded":"2024-05-09T09:50:57.465836+0000","last_fullsized":"2024-05-09T09:50:57.465836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'113","last_scrub_stamp":"2024-05-09T09:50:57.465647+0000","last_deep_scrub":"32'113","last_deep_scrub_stamp":"2024-05-09T09:50:57.465647+0000","last_clean_scrub_stamp":"2024-05-09T09:50:57.465647+0000","objects_scrubbed":5,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:46:16.255842+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:11.435855+0000","last_change":"2024-05-09T09:51:11.435908+0000","last_active":"2024-05-09T09:51:11.435855+0000","last_peered":"2024-05-09T09:51:11.435855+0000","last_clean":"2024-05-09T09:51:11.435855+0000","last_became_active":"2024-05-09T09:47:20.254344+0000","last_became_peered":"2024-05-09T09:47:20.254344+0000","last_unstale":"2024-05-09T09:51:11.435855+0000","last_undegraded":"2024-05-09T09:51:11.435855+0000","last_fullsized":"2024-05-09T09:51:11.435855+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:11.435657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:11.435657+0000","last_clean_scrub_stamp":"2024-05-09T09:51:11.435657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:58:02.384629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'5","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:43.298281+0000","last_change":"2024-05-09T09:47:22.230150+0000","last_active":"2024-05-09T09:50:43.298281+0000","last_peered":"2024-05-09T09:50:43.298281+0000","last_clean":"2024-05-09T09:50:43.298281+0000","last_became_active":"2024-05-09T09:47:22.229088+0000","last_became_peered":"2024-05-09T09:47:22.229088+0000","last_unstale":"2024-05-09T09:50:43.298281+0000","last_undegraded":"2024-05-09T09:50:43.298281+0000","last_fullsized":"2024-05-09T09:50:43.298281+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'8","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:18.320982+0000","last_change":"2024-05-09T09:51:18.321045+0000","last_active":"2024-05-09T09:51:18.320982+0000","last_peered":"2024-05-09T09:51:18.320982+0000","last_clean":"2024-05-09T09:51:18.320982+0000","last_became_active":"2024-05-09T09:47:14.173866+0000","last_became_peered":"2024-05-09T09:47:14.173866+0000","last_unstale":"2024-05-09T09:51:18.320982+0000","last_undegraded":"2024-05-09T09:51:18.320982+0000","last_fullsized":"2024-05-09T09:51:18.320982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:18.320750+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:18.320750+0000","last_clean_scrub_stamp":"2024-05-09T09:51:18.320750+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:44.576241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.174849+0000","last_change":"2024-05-09T09:47:12.206131+0000","last_active":"2024-05-09T09:49:40.174849+0000","last_peered":"2024-05-09T09:49:40.174849+0000","last_clean":"2024-05-09T09:49:40.174849+0000","last_became_active":"2024-05-09T09:47:12.205714+0000","last_became_peered":"2024-05-09T09:47:12.205714+0000","last_unstale":"2024-05-09T09:49:40.174849+0000","last_undegraded":"2024-05-09T09:49:40.174849+0000","last_fullsized":"2024-05-09T09:49:40.174849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.177509+0000","last_change":"2024-05-09T09:47:52.188822+0000","last_active":"2024-05-09T09:49:40.177509+0000","last_peered":"2024-05-09T09:49:40.177509+0000","last_clean":"2024-05-09T09:49:40.177509+0000","last_became_active":"2024-05-09T09:47:52.187627+0000","last_became_peered":"2024-05-09T09:47:52.187627+0000","last_unstale":"2024-05-09T09:49:40.177509+0000","last_undegraded":"2024-05-09T09:49:40.177509+0000","last_fullsized":"2024-05-09T09:49:40.177509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'8","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:51.843220+0000","last_change":"2024-05-09T09:50:51.843293+0000","last_active":"2024-05-09T09:50:51.843220+0000","last_peered":"2024-05-09T09:50:51.843220+0000","last_clean":"2024-05-09T09:50:51.843220+0000","last_became_active":"2024-05-09T09:47:18.217843+0000","last_became_peered":"2024-05-09T09:47:18.217843+0000","last_unstale":"2024-05-09T09:50:51.843220+0000","last_undegraded":"2024-05-09T09:50:51.843220+0000","last_fullsized":"2024-05-09T09:50:51.843220+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:50:51.843015+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:50:51.843015+0000","last_clean_scrub_stamp":"2024-05-09T09:50:51.843015+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:01:37.150482+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:58.254932+0000","last_change":"2024-05-09T09:50:58.254985+0000","last_active":"2024-05-09T09:50:58.254932+0000","last_peered":"2024-05-09T09:50:58.254932+0000","last_clean":"2024-05-09T09:50:58.254932+0000","last_became_active":"2024-05-09T09:47:20.255449+0000","last_became_peered":"2024-05-09T09:47:20.255449+0000","last_unstale":"2024-05-09T09:50:58.254932+0000","last_undegraded":"2024-05-09T09:50:58.254932+0000","last_fullsized":"2024-05-09T09:50:58.254932+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:58.254742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:58.254742+0000","last_clean_scrub_stamp":"2024-05-09T09:50:58.254742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:40:28.088373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.486998+0000","last_change":"2024-05-09T09:47:22.239979+0000","last_active":"2024-05-09T09:50:33.486998+0000","last_peered":"2024-05-09T09:50:33.486998+0000","last_clean":"2024-05-09T09:50:33.486998+0000","last_became_active":"2024-05-09T09:47:22.239113+0000","last_became_peered":"2024-05-09T09:47:22.239113+0000","last_unstale":"2024-05-09T09:50:33.486998+0000","last_undegraded":"2024-05-09T09:50:33.486998+0000","last_fullsized":"2024-05-09T09:50:33.486998+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:18.173232+0000","last_change":"2024-05-09T09:51:18.173416+0000","last_active":"2024-05-09T09:51:18.173232+0000","last_peered":"2024-05-09T09:51:18.173232+0000","last_clean":"2024-05-09T09:51:18.173232+0000","last_became_active":"2024-05-09T09:47:14.173338+0000","last_became_peered":"2024-05-09T09:47:14.173338+0000","last_unstale":"2024-05-09T09:51:18.173232+0000","last_undegraded":"2024-05-09T09:51:18.173232+0000","last_fullsized":"2024-05-09T09:51:18.173232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:18.173009+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:18.173009+0000","last_clean_scrub_stamp":"2024-05-09T09:51:18.173009+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:59:16.436247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:15.403301+0000","last_change":"2024-05-09T09:51:15.403431+0000","last_active":"2024-05-09T09:51:15.403301+0000","last_peered":"2024-05-09T09:51:15.403301+0000","last_clean":"2024-05-09T09:51:15.403301+0000","last_became_active":"2024-05-09T09:47:12.205864+0000","last_became_peered":"2024-05-09T09:47:12.205864+0000","last_unstale":"2024-05-09T09:51:15.403301+0000","last_undegraded":"2024-05-09T09:51:15.403301+0000","last_fullsized":"2024-05-09T09:51:15.403301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:15.403005+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:15.403005+0000","last_clean_scrub_stamp":"2024-05-09T09:51:15.403005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:10:59.671365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:59.267024+0000","last_change":"2024-05-09T09:50:59.267079+0000","last_active":"2024-05-09T09:50:59.267024+0000","last_peered":"2024-05-09T09:50:59.267024+0000","last_clean":"2024-05-09T09:50:59.267024+0000","last_became_active":"2024-05-09T09:47:16.214780+0000","last_became_peered":"2024-05-09T09:47:16.214780+0000","last_unstale":"2024-05-09T09:50:59.267024+0000","last_undegraded":"2024-05-09T09:50:59.267024+0000","last_fullsized":"2024-05-09T09:50:59.267024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:59.266840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:59.266840+0000","last_clean_scrub_stamp":"2024-05-09T09:50:59.266840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:59:17.503566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'121","reported_seq":193,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:54.909342+0000","last_change":"2024-05-09T09:50:54.909493+0000","last_active":"2024-05-09T09:50:54.909342+0000","last_peered":"2024-05-09T09:50:54.909342+0000","last_clean":"2024-05-09T09:50:54.909342+0000","last_became_active":"2024-05-09T09:47:18.201443+0000","last_became_peered":"2024-05-09T09:47:18.201443+0000","last_unstale":"2024-05-09T09:50:54.909342+0000","last_undegraded":"2024-05-09T09:50:54.909342+0000","last_fullsized":"2024-05-09T09:50:54.909342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'121","last_scrub_stamp":"2024-05-09T09:50:54.909111+0000","last_deep_scrub":"32'121","last_deep_scrub_stamp":"2024-05-09T09:50:54.909111+0000","last_clean_scrub_stamp":"2024-05-09T09:50:54.909111+0000","objects_scrubbed":6,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:37:16.030668+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:48.357085+0000","last_change":"2024-05-09T09:50:48.357139+0000","last_active":"2024-05-09T09:50:48.357085+0000","last_peered":"2024-05-09T09:50:48.357085+0000","last_clean":"2024-05-09T09:50:48.357085+0000","last_became_active":"2024-05-09T09:47:20.225261+0000","last_became_peered":"2024-05-09T09:47:20.225261+0000","last_unstale":"2024-05-09T09:50:48.357085+0000","last_undegraded":"2024-05-09T09:50:48.357085+0000","last_fullsized":"2024-05-09T09:50:48.357085+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:48.356886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:48.356886+0000","last_clean_scrub_stamp":"2024-05-09T09:50:48.356886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:18:04.605745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:55.181530+0000","last_change":"2024-05-09T09:47:22.253748+0000","last_active":"2024-05-09T09:49:55.181530+0000","last_peered":"2024-05-09T09:49:55.181530+0000","last_clean":"2024-05-09T09:49:55.181530+0000","last_became_active":"2024-05-09T09:47:22.252940+0000","last_became_peered":"2024-05-09T09:47:22.252940+0000","last_unstale":"2024-05-09T09:49:55.181530+0000","last_undegraded":"2024-05-09T09:49:55.181530+0000","last_fullsized":"2024-05-09T09:49:55.181530+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.321567+0000","last_change":"2024-05-09T09:47:14.183909+0000","last_active":"2024-05-09T09:50:33.321567+0000","last_peered":"2024-05-09T09:50:33.321567+0000","last_clean":"2024-05-09T09:50:33.321567+0000","last_became_active":"2024-05-09T09:47:14.183622+0000","last_became_peered":"2024-05-09T09:47:14.183622+0000","last_unstale":"2024-05-09T09:50:33.321567+0000","last_undegraded":"2024-05-09T09:50:33.321567+0000","last_fullsized":"2024-05-09T09:50:33.321567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.178323+0000","last_change":"2024-05-09T09:47:12.196263+0000","last_active":"2024-05-09T09:49:40.178323+0000","last_peered":"2024-05-09T09:49:40.178323+0000","last_clean":"2024-05-09T09:49:40.178323+0000","last_became_active":"2024-05-09T09:47:12.195857+0000","last_became_peered":"2024-05-09T09:47:12.195857+0000","last_unstale":"2024-05-09T09:49:40.178323+0000","last_undegraded":"2024-05-09T09:49:40.178323+0000","last_fullsized":"2024-05-09T09:49:40.178323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:52.490361+0000","last_change":"2024-05-09T09:50:52.490474+0000","last_active":"2024-05-09T09:50:52.490361+0000","last_peered":"2024-05-09T09:50:52.490361+0000","last_clean":"2024-05-09T09:50:52.490361+0000","last_became_active":"2024-05-09T09:47:16.198551+0000","last_became_peered":"2024-05-09T09:47:16.198551+0000","last_unstale":"2024-05-09T09:50:52.490361+0000","last_undegraded":"2024-05-09T09:50:52.490361+0000","last_fullsized":"2024-05-09T09:50:52.490361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:52.490129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:52.490129+0000","last_clean_scrub_stamp":"2024-05-09T09:50:52.490129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:08:27.216364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'110","reported_seq":165,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:55.303460+0000","last_change":"2024-05-09T09:50:55.303534+0000","last_active":"2024-05-09T09:50:55.303460+0000","last_peered":"2024-05-09T09:50:55.303460+0000","last_clean":"2024-05-09T09:50:55.303460+0000","last_became_active":"2024-05-09T09:47:18.217163+0000","last_became_peered":"2024-05-09T09:47:18.217163+0000","last_unstale":"2024-05-09T09:50:55.303460+0000","last_undegraded":"2024-05-09T09:50:55.303460+0000","last_fullsized":"2024-05-09T09:50:55.303460+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'110","last_scrub_stamp":"2024-05-09T09:50:55.303267+0000","last_deep_scrub":"32'110","last_deep_scrub_stamp":"2024-05-09T09:50:55.303267+0000","last_clean_scrub_stamp":"2024-05-09T09:50:55.303267+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:30:34.471649+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:47.153512+0000","last_change":"2024-05-09T09:50:47.153568+0000","last_active":"2024-05-09T09:50:47.153512+0000","last_peered":"2024-05-09T09:50:47.153512+0000","last_clean":"2024-05-09T09:50:47.153512+0000","last_became_active":"2024-05-09T09:47:20.238369+0000","last_became_peered":"2024-05-09T09:47:20.238369+0000","last_unstale":"2024-05-09T09:50:47.153512+0000","last_undegraded":"2024-05-09T09:50:47.153512+0000","last_fullsized":"2024-05-09T09:50:47.153512+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:47.153312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:47.153312+0000","last_clean_scrub_stamp":"2024-05-09T09:50:47.153312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:16.400691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'9","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.403774+0000","last_change":"2024-05-09T09:47:14.188262+0000","last_active":"2024-05-09T09:50:33.403774+0000","last_peered":"2024-05-09T09:50:33.403774+0000","last_clean":"2024-05-09T09:50:33.403774+0000","last_became_active":"2024-05-09T09:47:14.187868+0000","last_became_peered":"2024-05-09T09:47:14.187868+0000","last_unstale":"2024-05-09T09:50:33.403774+0000","last_undegraded":"2024-05-09T09:50:33.403774+0000","last_fullsized":"2024-05-09T09:50:33.403774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.177134+0000","last_change":"2024-05-09T09:47:12.208626+0000","last_active":"2024-05-09T09:49:40.177134+0000","last_peered":"2024-05-09T09:49:40.177134+0000","last_clean":"2024-05-09T09:49:40.177134+0000","last_became_active":"2024-05-09T09:47:12.208209+0000","last_became_peered":"2024-05-09T09:47:12.208209+0000","last_unstale":"2024-05-09T09:49:40.177134+0000","last_undegraded":"2024-05-09T09:49:40.177134+0000","last_fullsized":"2024-05-09T09:49:40.177134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:09.038896+0000","last_change":"2024-05-09T09:51:09.038896+0000","last_active":"2024-05-09T09:51:09.038896+0000","last_peered":"2024-05-09T09:51:09.038896+0000","last_clean":"2024-05-09T09:51:09.038896+0000","last_became_active":"2024-05-09T09:47:16.182766+0000","last_became_peered":"2024-05-09T09:47:16.182766+0000","last_unstale":"2024-05-09T09:51:09.038896+0000","last_undegraded":"2024-05-09T09:51:09.038896+0000","last_fullsized":"2024-05-09T09:51:09.038896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:09.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:09.038645+0000","last_clean_scrub_stamp":"2024-05-09T09:51:09.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:34:44.054800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'211","reported_seq":284,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:50.874670+0000","last_change":"2024-05-09T09:50:50.874747+0000","last_active":"2024-05-09T09:50:50.874670+0000","last_peered":"2024-05-09T09:50:50.874670+0000","last_clean":"2024-05-09T09:50:50.874670+0000","last_became_active":"2024-05-09T09:47:18.225074+0000","last_became_peered":"2024-05-09T09:47:18.225074+0000","last_unstale":"2024-05-09T09:50:50.874670+0000","last_undegraded":"2024-05-09T09:50:50.874670+0000","last_fullsized":"2024-05-09T09:50:50.874670+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'211","last_scrub_stamp":"2024-05-09T09:50:50.874475+0000","last_deep_scrub":"32'211","last_deep_scrub_stamp":"2024-05-09T09:50:50.874475+0000","last_clean_scrub_stamp":"2024-05-09T09:50:50.874475+0000","objects_scrubbed":5,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:47.628582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:46.119717+0000","last_change":"2024-05-09T09:50:46.119770+0000","last_active":"2024-05-09T09:50:46.119717+0000","last_peered":"2024-05-09T09:50:46.119717+0000","last_clean":"2024-05-09T09:50:46.119717+0000","last_became_active":"2024-05-09T09:47:20.241372+0000","last_became_peered":"2024-05-09T09:47:20.241372+0000","last_unstale":"2024-05-09T09:50:46.119717+0000","last_undegraded":"2024-05-09T09:50:46.119717+0000","last_fullsized":"2024-05-09T09:50:46.119717+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:46.119515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:46.119515+0000","last_clean_scrub_stamp":"2024-05-09T09:50:46.119515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:34:19.012893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.168445+0000","last_change":"2024-05-09T09:47:22.260464+0000","last_active":"2024-05-09T09:49:45.168445+0000","last_peered":"2024-05-09T09:49:45.168445+0000","last_clean":"2024-05-09T09:49:45.168445+0000","last_became_active":"2024-05-09T09:47:22.259589+0000","last_became_peered":"2024-05-09T09:47:22.259589+0000","last_unstale":"2024-05-09T09:49:45.168445+0000","last_undegraded":"2024-05-09T09:49:45.168445+0000","last_fullsized":"2024-05-09T09:49:45.168445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'8","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:22.285662+0000","last_change":"2024-05-09T09:51:22.285724+0000","last_active":"2024-05-09T09:51:22.285662+0000","last_peered":"2024-05-09T09:51:22.285662+0000","last_clean":"2024-05-09T09:51:22.285662+0000","last_became_active":"2024-05-09T09:47:14.174371+0000","last_became_peered":"2024-05-09T09:47:14.174371+0000","last_unstale":"2024-05-09T09:51:22.285662+0000","last_undegraded":"2024-05-09T09:51:22.285662+0000","last_fullsized":"2024-05-09T09:51:22.285662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:22.285472+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:22.285472+0000","last_clean_scrub_stamp":"2024-05-09T09:51:22.285472+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:31:43.895778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.177863+0000","last_change":"2024-05-09T09:47:12.198158+0000","last_active":"2024-05-09T09:49:40.177863+0000","last_peered":"2024-05-09T09:49:40.177863+0000","last_clean":"2024-05-09T09:49:40.177863+0000","last_became_active":"2024-05-09T09:47:12.196881+0000","last_became_peered":"2024-05-09T09:47:12.196881+0000","last_unstale":"2024-05-09T09:49:40.177863+0000","last_undegraded":"2024-05-09T09:49:40.177863+0000","last_fullsized":"2024-05-09T09:49:40.177863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:05.284187+0000","last_change":"2024-05-09T09:51:05.284242+0000","last_active":"2024-05-09T09:51:05.284187+0000","last_peered":"2024-05-09T09:51:05.284187+0000","last_clean":"2024-05-09T09:51:05.284187+0000","last_became_active":"2024-05-09T09:47:16.188611+0000","last_became_peered":"2024-05-09T09:47:16.188611+0000","last_unstale":"2024-05-09T09:51:05.284187+0000","last_undegraded":"2024-05-09T09:51:05.284187+0000","last_fullsized":"2024-05-09T09:51:05.284187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:05.283953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:05.283953+0000","last_clean_scrub_stamp":"2024-05-09T09:51:05.283953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:53:42.383540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'119","reported_seq":177,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:55.469218+0000","last_change":"2024-05-09T09:50:55.469398+0000","last_active":"2024-05-09T09:50:55.469218+0000","last_peered":"2024-05-09T09:50:55.469218+0000","last_clean":"2024-05-09T09:50:55.469218+0000","last_became_active":"2024-05-09T09:47:18.232435+0000","last_became_peered":"2024-05-09T09:47:18.232435+0000","last_unstale":"2024-05-09T09:50:55.469218+0000","last_undegraded":"2024-05-09T09:50:55.469218+0000","last_fullsized":"2024-05-09T09:50:55.469218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-05-09T09:50:55.468997+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-05-09T09:50:55.468997+0000","last_clean_scrub_stamp":"2024-05-09T09:50:55.468997+0000","objects_scrubbed":7,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:10:29.577014+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:00.251704+0000","last_change":"2024-05-09T09:51:00.251832+0000","last_active":"2024-05-09T09:51:00.251704+0000","last_peered":"2024-05-09T09:51:00.251704+0000","last_clean":"2024-05-09T09:51:00.251704+0000","last_became_active":"2024-05-09T09:47:20.241935+0000","last_became_peered":"2024-05-09T09:47:20.241935+0000","last_unstale":"2024-05-09T09:51:00.251704+0000","last_undegraded":"2024-05-09T09:51:00.251704+0000","last_fullsized":"2024-05-09T09:51:00.251704+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:00.251488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:00.251488+0000","last_clean_scrub_stamp":"2024-05-09T09:51:00.251488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:57:35.112556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:15.485330+0000","last_change":"2024-05-09T09:51:15.485482+0000","last_active":"2024-05-09T09:51:15.485330+0000","last_peered":"2024-05-09T09:51:15.485330+0000","last_clean":"2024-05-09T09:51:15.485330+0000","last_became_active":"2024-05-09T09:47:22.241067+0000","last_became_peered":"2024-05-09T09:47:22.241067+0000","last_unstale":"2024-05-09T09:51:15.485330+0000","last_undegraded":"2024-05-09T09:51:15.485330+0000","last_fullsized":"2024-05-09T09:51:15.485330+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:15.485109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:15.485109+0000","last_clean_scrub_stamp":"2024-05-09T09:51:15.485109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:38.931364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:04.473912+0000","last_change":"2024-05-09T09:51:04.473973+0000","last_active":"2024-05-09T09:51:04.473912+0000","last_peered":"2024-05-09T09:51:04.473912+0000","last_clean":"2024-05-09T09:51:04.473912+0000","last_became_active":"2024-05-09T09:47:14.191459+0000","last_became_peered":"2024-05-09T09:47:14.191459+0000","last_unstale":"2024-05-09T09:51:04.473912+0000","last_undegraded":"2024-05-09T09:51:04.473912+0000","last_fullsized":"2024-05-09T09:51:04.473912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:04.473723+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:04.473723+0000","last_clean_scrub_stamp":"2024-05-09T09:51:04.473723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:30:16.341639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.081160+0000","last_change":"2024-05-09T09:47:12.193005+0000","last_active":"2024-05-09T09:50:40.081160+0000","last_peered":"2024-05-09T09:50:40.081160+0000","last_clean":"2024-05-09T09:50:40.081160+0000","last_became_active":"2024-05-09T09:47:12.191204+0000","last_became_peered":"2024-05-09T09:47:12.191204+0000","last_unstale":"2024-05-09T09:50:40.081160+0000","last_undegraded":"2024-05-09T09:50:40.081160+0000","last_fullsized":"2024-05-09T09:50:40.081160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:04.313775+0000","last_change":"2024-05-09T09:51:04.313828+0000","last_active":"2024-05-09T09:51:04.313775+0000","last_peered":"2024-05-09T09:51:04.313775+0000","last_clean":"2024-05-09T09:51:04.313775+0000","last_became_active":"2024-05-09T09:47:16.194314+0000","last_became_peered":"2024-05-09T09:47:16.194314+0000","last_unstale":"2024-05-09T09:51:04.313775+0000","last_undegraded":"2024-05-09T09:51:04.313775+0000","last_fullsized":"2024-05-09T09:51:04.313775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:04.313561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:04.313561+0000","last_clean_scrub_stamp":"2024-05-09T09:51:04.313561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:23:40.119184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'113","reported_seq":169,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:52.875659+0000","last_change":"2024-05-09T09:50:52.875802+0000","last_active":"2024-05-09T09:50:52.875659+0000","last_peered":"2024-05-09T09:50:52.875659+0000","last_clean":"2024-05-09T09:50:52.875659+0000","last_became_active":"2024-05-09T09:47:18.209099+0000","last_became_peered":"2024-05-09T09:47:18.209099+0000","last_unstale":"2024-05-09T09:50:52.875659+0000","last_undegraded":"2024-05-09T09:50:52.875659+0000","last_fullsized":"2024-05-09T09:50:52.875659+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'113","last_scrub_stamp":"2024-05-09T09:50:52.875426+0000","last_deep_scrub":"32'113","last_deep_scrub_stamp":"2024-05-09T09:50:52.875426+0000","last_clean_scrub_stamp":"2024-05-09T09:50:52.875426+0000","objects_scrubbed":5,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:17:15.117146+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.866730+0000","last_change":"2024-05-09T09:50:44.866730+0000","last_active":"2024-05-09T09:50:44.866730+0000","last_peered":"2024-05-09T09:50:44.866730+0000","last_clean":"2024-05-09T09:50:44.866730+0000","last_became_active":"2024-05-09T09:47:20.241900+0000","last_became_peered":"2024-05-09T09:47:20.241900+0000","last_unstale":"2024-05-09T09:50:44.866730+0000","last_undegraded":"2024-05-09T09:50:44.866730+0000","last_fullsized":"2024-05-09T09:50:44.866730+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:44.866482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:44.866482+0000","last_clean_scrub_stamp":"2024-05-09T09:50:44.866482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:26:17.791183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.178830+0000","last_change":"2024-05-09T09:47:22.264988+0000","last_active":"2024-05-09T09:49:45.178830+0000","last_peered":"2024-05-09T09:49:45.178830+0000","last_clean":"2024-05-09T09:49:45.178830+0000","last_became_active":"2024-05-09T09:47:22.263730+0000","last_became_peered":"2024-05-09T09:47:22.263730+0000","last_unstale":"2024-05-09T09:49:45.178830+0000","last_undegraded":"2024-05-09T09:49:45.178830+0000","last_fullsized":"2024-05-09T09:49:45.178830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'6","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:12.090643+0000","last_change":"2024-05-09T09:51:12.090710+0000","last_active":"2024-05-09T09:51:12.090643+0000","last_peered":"2024-05-09T09:51:12.090643+0000","last_clean":"2024-05-09T09:51:12.090643+0000","last_became_active":"2024-05-09T09:47:14.189561+0000","last_became_peered":"2024-05-09T09:47:14.189561+0000","last_unstale":"2024-05-09T09:51:12.090643+0000","last_undegraded":"2024-05-09T09:51:12.090643+0000","last_fullsized":"2024-05-09T09:51:12.090643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:12.090429+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:12.090429+0000","last_clean_scrub_stamp":"2024-05-09T09:51:12.090429+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:00.491368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.178967+0000","last_change":"2024-05-09T09:47:12.215264+0000","last_active":"2024-05-09T09:49:45.178967+0000","last_peered":"2024-05-09T09:49:45.178967+0000","last_clean":"2024-05-09T09:49:45.178967+0000","last_became_active":"2024-05-09T09:47:12.214816+0000","last_became_peered":"2024-05-09T09:47:12.214816+0000","last_unstale":"2024-05-09T09:49:45.178967+0000","last_undegraded":"2024-05-09T09:49:45.178967+0000","last_fullsized":"2024-05-09T09:49:45.178967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:59.288158+0000","last_change":"2024-05-09T09:50:59.288294+0000","last_active":"2024-05-09T09:50:59.288158+0000","last_peered":"2024-05-09T09:50:59.288158+0000","last_clean":"2024-05-09T09:50:59.288158+0000","last_became_active":"2024-05-09T09:47:16.210567+0000","last_became_peered":"2024-05-09T09:47:16.210567+0000","last_unstale":"2024-05-09T09:50:59.288158+0000","last_undegraded":"2024-05-09T09:50:59.288158+0000","last_fullsized":"2024-05-09T09:50:59.288158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:59.287849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:59.287849+0000","last_clean_scrub_stamp":"2024-05-09T09:50:59.287849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:11:15.215672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:03.498249+0000","last_change":"2024-05-09T09:51:03.498249+0000","last_active":"2024-05-09T09:51:03.498249+0000","last_peered":"2024-05-09T09:51:03.498249+0000","last_clean":"2024-05-09T09:51:03.498249+0000","last_became_active":"2024-05-09T09:47:18.234113+0000","last_became_peered":"2024-05-09T09:47:18.234113+0000","last_unstale":"2024-05-09T09:51:03.498249+0000","last_undegraded":"2024-05-09T09:51:03.498249+0000","last_fullsized":"2024-05-09T09:51:03.498249+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-09T09:51:03.497977+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-09T09:51:03.497977+0000","last_clean_scrub_stamp":"2024-05-09T09:51:03.497977+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:59:01.761215+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":380,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:54.255226+0000","last_change":"2024-05-09T09:50:54.255293+0000","last_active":"2024-05-09T09:50:54.255226+0000","last_peered":"2024-05-09T09:50:54.255226+0000","last_clean":"2024-05-09T09:50:54.255226+0000","last_became_active":"2024-05-09T09:47:20.254573+0000","last_became_peered":"2024-05-09T09:47:20.254573+0000","last_unstale":"2024-05-09T09:50:54.255226+0000","last_undegraded":"2024-05-09T09:50:54.255226+0000","last_fullsized":"2024-05-09T09:50:54.255226+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:54.255008+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:54.255008+0000","last_clean_scrub_stamp":"2024-05-09T09:50:54.255008+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:33:59.828045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.256753+0000","last_change":"2024-05-09T09:47:22.244085+0000","last_active":"2024-05-09T09:50:33.256753+0000","last_peered":"2024-05-09T09:50:33.256753+0000","last_clean":"2024-05-09T09:50:33.256753+0000","last_became_active":"2024-05-09T09:47:22.243234+0000","last_became_peered":"2024-05-09T09:47:22.243234+0000","last_unstale":"2024-05-09T09:50:33.256753+0000","last_undegraded":"2024-05-09T09:50:33.256753+0000","last_fullsized":"2024-05-09T09:50:33.256753+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'3","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.402874+0000","last_change":"2024-05-09T09:47:14.188552+0000","last_active":"2024-05-09T09:50:33.402874+0000","last_peered":"2024-05-09T09:50:33.402874+0000","last_clean":"2024-05-09T09:50:33.402874+0000","last_became_active":"2024-05-09T09:47:14.188222+0000","last_became_peered":"2024-05-09T09:47:14.188222+0000","last_unstale":"2024-05-09T09:50:33.402874+0000","last_undegraded":"2024-05-09T09:50:33.402874+0000","last_fullsized":"2024-05-09T09:50:33.402874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.081051+0000","last_change":"2024-05-09T09:47:12.196894+0000","last_active":"2024-05-09T09:50:40.081051+0000","last_peered":"2024-05-09T09:50:40.081051+0000","last_clean":"2024-05-09T09:50:40.081051+0000","last_became_active":"2024-05-09T09:47:12.195936+0000","last_became_peered":"2024-05-09T09:47:12.195936+0000","last_unstale":"2024-05-09T09:50:40.081051+0000","last_undegraded":"2024-05-09T09:50:40.081051+0000","last_fullsized":"2024-05-09T09:50:40.081051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:54.288182+0000","last_change":"2024-05-09T09:50:54.288244+0000","last_active":"2024-05-09T09:50:54.288182+0000","last_peered":"2024-05-09T09:50:54.288182+0000","last_clean":"2024-05-09T09:50:54.288182+0000","last_became_active":"2024-05-09T09:47:16.210901+0000","last_became_peered":"2024-05-09T09:47:16.210901+0000","last_unstale":"2024-05-09T09:50:54.288182+0000","last_undegraded":"2024-05-09T09:50:54.288182+0000","last_fullsized":"2024-05-09T09:50:54.288182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:54.287951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:54.287951+0000","last_clean_scrub_stamp":"2024-05-09T09:50:54.287951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:00:20.805979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'120","reported_seq":178,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:51.351217+0000","last_change":"2024-05-09T09:50:51.351295+0000","last_active":"2024-05-09T09:50:51.351217+0000","last_peered":"2024-05-09T09:50:51.351217+0000","last_clean":"2024-05-09T09:50:51.351217+0000","last_became_active":"2024-05-09T09:47:18.202069+0000","last_became_peered":"2024-05-09T09:47:18.202069+0000","last_unstale":"2024-05-09T09:50:51.351217+0000","last_undegraded":"2024-05-09T09:50:51.351217+0000","last_fullsized":"2024-05-09T09:50:51.351217+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'120","last_scrub_stamp":"2024-05-09T09:50:51.351014+0000","last_deep_scrub":"32'120","last_deep_scrub_stamp":"2024-05-09T09:50:51.351014+0000","last_clean_scrub_stamp":"2024-05-09T09:50:51.351014+0000","objects_scrubbed":7,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:19:59.652432+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:49.840926+0000","last_change":"2024-05-09T09:50:49.840978+0000","last_active":"2024-05-09T09:50:49.840926+0000","last_peered":"2024-05-09T09:50:49.840926+0000","last_clean":"2024-05-09T09:50:49.840926+0000","last_became_active":"2024-05-09T09:47:20.250194+0000","last_became_peered":"2024-05-09T09:47:20.250194+0000","last_unstale":"2024-05-09T09:50:49.840926+0000","last_undegraded":"2024-05-09T09:50:49.840926+0000","last_fullsized":"2024-05-09T09:50:49.840926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:49.840731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:49.840731+0000","last_clean_scrub_stamp":"2024-05-09T09:50:49.840731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:28:16.883808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:12.276060+0000","last_change":"2024-05-09T09:51:12.276130+0000","last_active":"2024-05-09T09:51:12.276060+0000","last_peered":"2024-05-09T09:51:12.276060+0000","last_clean":"2024-05-09T09:51:12.276060+0000","last_became_active":"2024-05-09T09:47:22.239300+0000","last_became_peered":"2024-05-09T09:47:22.239300+0000","last_unstale":"2024-05-09T09:51:12.276060+0000","last_undegraded":"2024-05-09T09:51:12.276060+0000","last_fullsized":"2024-05-09T09:51:12.276060+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:12.275835+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:12.275835+0000","last_clean_scrub_stamp":"2024-05-09T09:51:12.275835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:27.063514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'10","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.824135+0000","last_change":"2024-05-09T09:47:14.188510+0000","last_active":"2024-05-09T09:50:32.824135+0000","last_peered":"2024-05-09T09:50:32.824135+0000","last_clean":"2024-05-09T09:50:32.824135+0000","last_became_active":"2024-05-09T09:47:14.187951+0000","last_became_peered":"2024-05-09T09:47:14.187951+0000","last_unstale":"2024-05-09T09:50:32.824135+0000","last_undegraded":"2024-05-09T09:50:32.824135+0000","last_fullsized":"2024-05-09T09:50:32.824135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.179097+0000","last_change":"2024-05-09T09:47:12.208585+0000","last_active":"2024-05-09T09:49:45.179097+0000","last_peered":"2024-05-09T09:49:45.179097+0000","last_clean":"2024-05-09T09:49:45.179097+0000","last_became_active":"2024-05-09T09:47:12.203827+0000","last_became_peered":"2024-05-09T09:47:12.203827+0000","last_unstale":"2024-05-09T09:49:45.179097+0000","last_undegraded":"2024-05-09T09:49:45.179097+0000","last_fullsized":"2024-05-09T09:49:45.179097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:03.316460+0000","last_change":"2024-05-09T09:51:03.316512+0000","last_active":"2024-05-09T09:51:03.316460+0000","last_peered":"2024-05-09T09:51:03.316460+0000","last_clean":"2024-05-09T09:51:03.316460+0000","last_became_active":"2024-05-09T09:47:16.196193+0000","last_became_peered":"2024-05-09T09:47:16.196193+0000","last_unstale":"2024-05-09T09:51:03.316460+0000","last_undegraded":"2024-05-09T09:51:03.316460+0000","last_fullsized":"2024-05-09T09:51:03.316460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:03.316273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:03.316273+0000","last_clean_scrub_stamp":"2024-05-09T09:51:03.316273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:59:34.812456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'113","reported_seq":168,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:55.923859+0000","last_change":"2024-05-09T09:50:55.923928+0000","last_active":"2024-05-09T09:50:55.923859+0000","last_peered":"2024-05-09T09:50:55.923859+0000","last_clean":"2024-05-09T09:50:55.923859+0000","last_became_active":"2024-05-09T09:47:18.199627+0000","last_became_peered":"2024-05-09T09:47:18.199627+0000","last_unstale":"2024-05-09T09:50:55.923859+0000","last_undegraded":"2024-05-09T09:50:55.923859+0000","last_fullsized":"2024-05-09T09:50:55.923859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'113","last_scrub_stamp":"2024-05-09T09:50:55.923673+0000","last_deep_scrub":"32'113","last_deep_scrub_stamp":"2024-05-09T09:50:55.923673+0000","last_clean_scrub_stamp":"2024-05-09T09:50:55.923673+0000","objects_scrubbed":4,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:11:11.851496+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:07.405248+0000","last_change":"2024-05-09T09:51:07.405300+0000","last_active":"2024-05-09T09:51:07.405248+0000","last_peered":"2024-05-09T09:51:07.405248+0000","last_clean":"2024-05-09T09:51:07.405248+0000","last_became_active":"2024-05-09T09:47:20.251642+0000","last_became_peered":"2024-05-09T09:47:20.251642+0000","last_unstale":"2024-05-09T09:51:07.405248+0000","last_undegraded":"2024-05-09T09:51:07.405248+0000","last_fullsized":"2024-05-09T09:51:07.405248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:07.405060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:07.405060+0000","last_clean_scrub_stamp":"2024-05-09T09:51:07.405060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:31:29.015365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:50.180499+0000","last_change":"2024-05-09T09:47:22.261644+0000","last_active":"2024-05-09T09:49:50.180499+0000","last_peered":"2024-05-09T09:49:50.180499+0000","last_clean":"2024-05-09T09:49:50.180499+0000","last_became_active":"2024-05-09T09:47:22.261164+0000","last_became_peered":"2024-05-09T09:47:22.261164+0000","last_unstale":"2024-05-09T09:49:50.180499+0000","last_undegraded":"2024-05-09T09:49:50.180499+0000","last_fullsized":"2024-05-09T09:49:50.180499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.170923+0000","last_change":"2024-05-09T09:47:14.185649+0000","last_active":"2024-05-09T09:50:33.170923+0000","last_peered":"2024-05-09T09:50:33.170923+0000","last_clean":"2024-05-09T09:50:33.170923+0000","last_became_active":"2024-05-09T09:47:14.185270+0000","last_became_peered":"2024-05-09T09:47:14.185270+0000","last_unstale":"2024-05-09T09:50:33.170923+0000","last_undegraded":"2024-05-09T09:50:33.170923+0000","last_fullsized":"2024-05-09T09:50:33.170923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:43.296797+0000","last_change":"2024-05-09T09:47:12.185589+0000","last_active":"2024-05-09T09:50:43.296797+0000","last_peered":"2024-05-09T09:50:43.296797+0000","last_clean":"2024-05-09T09:50:43.296797+0000","last_became_active":"2024-05-09T09:47:12.183985+0000","last_became_peered":"2024-05-09T09:47:12.183985+0000","last_unstale":"2024-05-09T09:50:43.296797+0000","last_undegraded":"2024-05-09T09:50:43.296797+0000","last_fullsized":"2024-05-09T09:50:43.296797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:01.251663+0000","last_change":"2024-05-09T09:51:01.251716+0000","last_active":"2024-05-09T09:51:01.251663+0000","last_peered":"2024-05-09T09:51:01.251663+0000","last_clean":"2024-05-09T09:51:01.251663+0000","last_became_active":"2024-05-09T09:47:16.207467+0000","last_became_peered":"2024-05-09T09:47:16.207467+0000","last_unstale":"2024-05-09T09:51:01.251663+0000","last_undegraded":"2024-05-09T09:51:01.251663+0000","last_fullsized":"2024-05-09T09:51:01.251663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:01.251471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:01.251471+0000","last_clean_scrub_stamp":"2024-05-09T09:51:01.251471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:38:45.710781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'106","reported_seq":159,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:14.506892+0000","last_change":"2024-05-09T09:51:14.506957+0000","last_active":"2024-05-09T09:51:14.506892+0000","last_peered":"2024-05-09T09:51:14.506892+0000","last_clean":"2024-05-09T09:51:14.506892+0000","last_became_active":"2024-05-09T09:47:18.235557+0000","last_became_peered":"2024-05-09T09:47:18.235557+0000","last_unstale":"2024-05-09T09:51:14.506892+0000","last_undegraded":"2024-05-09T09:51:14.506892+0000","last_fullsized":"2024-05-09T09:51:14.506892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'106","last_scrub_stamp":"2024-05-09T09:51:14.506702+0000","last_deep_scrub":"32'106","last_deep_scrub_stamp":"2024-05-09T09:51:14.506702+0000","last_clean_scrub_stamp":"2024-05-09T09:51:14.506702+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:14:13.534344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:10.463408+0000","last_change":"2024-05-09T09:51:10.463461+0000","last_active":"2024-05-09T09:51:10.463408+0000","last_peered":"2024-05-09T09:51:10.463408+0000","last_clean":"2024-05-09T09:51:10.463408+0000","last_became_active":"2024-05-09T09:47:20.231750+0000","last_became_peered":"2024-05-09T09:47:20.231750+0000","last_unstale":"2024-05-09T09:51:10.463408+0000","last_undegraded":"2024-05-09T09:51:10.463408+0000","last_fullsized":"2024-05-09T09:51:10.463408+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:10.463214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:10.463214+0000","last_clean_scrub_stamp":"2024-05-09T09:51:10.463214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:19.664307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'8","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:50.180411+0000","last_change":"2024-05-09T09:47:22.256916+0000","last_active":"2024-05-09T09:49:50.180411+0000","last_peered":"2024-05-09T09:49:50.180411+0000","last_clean":"2024-05-09T09:49:50.180411+0000","last_became_active":"2024-05-09T09:47:22.256398+0000","last_became_peered":"2024-05-09T09:47:22.256398+0000","last_unstale":"2024-05-09T09:49:50.180411+0000","last_undegraded":"2024-05-09T09:49:50.180411+0000","last_fullsized":"2024-05-09T09:49:50.180411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'22","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:07.373060+0000","last_change":"2024-05-09T09:51:07.373119+0000","last_active":"2024-05-09T09:51:07.373060+0000","last_peered":"2024-05-09T09:51:07.373060+0000","last_clean":"2024-05-09T09:51:07.373060+0000","last_became_active":"2024-05-09T09:47:14.188980+0000","last_became_peered":"2024-05-09T09:47:14.188980+0000","last_unstale":"2024-05-09T09:51:07.373060+0000","last_undegraded":"2024-05-09T09:51:07.373060+0000","last_fullsized":"2024-05-09T09:51:07.373060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-05-09T09:51:07.372874+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-05-09T09:51:07.372874+0000","last_clean_scrub_stamp":"2024-05-09T09:51:07.372874+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:38.613364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.173110+0000","last_change":"2024-05-09T09:47:12.213326+0000","last_active":"2024-05-09T09:49:20.173110+0000","last_peered":"2024-05-09T09:49:20.173110+0000","last_clean":"2024-05-09T09:49:20.173110+0000","last_became_active":"2024-05-09T09:47:12.206136+0000","last_became_peered":"2024-05-09T09:47:12.206136+0000","last_unstale":"2024-05-09T09:49:20.173110+0000","last_undegraded":"2024-05-09T09:49:20.173110+0000","last_fullsized":"2024-05-09T09:49:20.173110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:58.281505+0000","last_change":"2024-05-09T09:50:58.281584+0000","last_active":"2024-05-09T09:50:58.281505+0000","last_peered":"2024-05-09T09:50:58.281505+0000","last_clean":"2024-05-09T09:50:58.281505+0000","last_became_active":"2024-05-09T09:47:16.210958+0000","last_became_peered":"2024-05-09T09:47:16.210958+0000","last_unstale":"2024-05-09T09:50:58.281505+0000","last_undegraded":"2024-05-09T09:50:58.281505+0000","last_fullsized":"2024-05-09T09:50:58.281505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-09T09:50:58.281299+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-09T09:50:58.281299+0000","last_clean_scrub_stamp":"2024-05-09T09:50:58.281299+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:37:19.402856+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'114","reported_seq":171,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:59.461776+0000","last_change":"2024-05-09T09:50:59.461850+0000","last_active":"2024-05-09T09:50:59.461776+0000","last_peered":"2024-05-09T09:50:59.461776+0000","last_clean":"2024-05-09T09:50:59.461776+0000","last_became_active":"2024-05-09T09:47:18.233552+0000","last_became_peered":"2024-05-09T09:47:18.233552+0000","last_unstale":"2024-05-09T09:50:59.461776+0000","last_undegraded":"2024-05-09T09:50:59.461776+0000","last_fullsized":"2024-05-09T09:50:59.461776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'114","last_scrub_stamp":"2024-05-09T09:50:59.461590+0000","last_deep_scrub":"32'114","last_deep_scrub_stamp":"2024-05-09T09:50:59.461590+0000","last_clean_scrub_stamp":"2024-05-09T09:50:59.461590+0000","objects_scrubbed":5,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:45:09.985421+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:06.027400+0000","last_change":"2024-05-09T09:51:06.027552+0000","last_active":"2024-05-09T09:51:06.027400+0000","last_peered":"2024-05-09T09:51:06.027400+0000","last_clean":"2024-05-09T09:51:06.027400+0000","last_became_active":"2024-05-09T09:47:20.254083+0000","last_became_peered":"2024-05-09T09:47:20.254083+0000","last_unstale":"2024-05-09T09:51:06.027400+0000","last_undegraded":"2024-05-09T09:51:06.027400+0000","last_fullsized":"2024-05-09T09:51:06.027400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:06.027177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:06.027177+0000","last_clean_scrub_stamp":"2024-05-09T09:51:06.027177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:03:51.192288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.179014+0000","last_change":"2024-05-09T09:47:22.255091+0000","last_active":"2024-05-09T09:49:45.179014+0000","last_peered":"2024-05-09T09:49:45.179014+0000","last_clean":"2024-05-09T09:49:45.179014+0000","last_became_active":"2024-05-09T09:47:22.254386+0000","last_became_peered":"2024-05-09T09:47:22.254386+0000","last_unstale":"2024-05-09T09:49:45.179014+0000","last_undegraded":"2024-05-09T09:49:45.179014+0000","last_fullsized":"2024-05-09T09:49:45.179014+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'14","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:13.284422+0000","last_change":"2024-05-09T09:51:13.284595+0000","last_active":"2024-05-09T09:51:13.284422+0000","last_peered":"2024-05-09T09:51:13.284422+0000","last_clean":"2024-05-09T09:51:13.284422+0000","last_became_active":"2024-05-09T09:47:14.174998+0000","last_became_peered":"2024-05-09T09:47:14.174998+0000","last_unstale":"2024-05-09T09:51:13.284422+0000","last_undegraded":"2024-05-09T09:51:13.284422+0000","last_fullsized":"2024-05-09T09:51:13.284422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-05-09T09:51:13.284186+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-05-09T09:51:13.284186+0000","last_clean_scrub_stamp":"2024-05-09T09:51:13.284186+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:34:48.300341+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.169920+0000","last_change":"2024-05-09T09:47:12.192847+0000","last_active":"2024-05-09T09:49:20.169920+0000","last_peered":"2024-05-09T09:49:20.169920+0000","last_clean":"2024-05-09T09:49:20.169920+0000","last_became_active":"2024-05-09T09:47:12.192448+0000","last_became_peered":"2024-05-09T09:47:12.192448+0000","last_unstale":"2024-05-09T09:49:20.169920+0000","last_undegraded":"2024-05-09T09:49:20.169920+0000","last_fullsized":"2024-05-09T09:49:20.169920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'12","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:15.130823+0000","last_change":"2024-05-09T09:51:15.130886+0000","last_active":"2024-05-09T09:51:15.130823+0000","last_peered":"2024-05-09T09:51:15.130823+0000","last_clean":"2024-05-09T09:51:15.130823+0000","last_became_active":"2024-05-09T09:47:14.188534+0000","last_became_peered":"2024-05-09T09:47:14.188534+0000","last_unstale":"2024-05-09T09:51:15.130823+0000","last_undegraded":"2024-05-09T09:51:15.130823+0000","last_fullsized":"2024-05-09T09:51:15.130823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-09T09:51:15.130629+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-09T09:51:15.130629+0000","last_clean_scrub_stamp":"2024-05-09T09:51:15.130629+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:21:10.701384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":54,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:43.297021+0000","last_change":"2024-05-09T09:47:12.185694+0000","last_active":"2024-05-09T09:50:43.297021+0000","last_peered":"2024-05-09T09:50:43.297021+0000","last_clean":"2024-05-09T09:50:43.297021+0000","last_became_active":"2024-05-09T09:47:12.184353+0000","last_became_peered":"2024-05-09T09:47:12.184353+0000","last_unstale":"2024-05-09T09:50:43.297021+0000","last_undegraded":"2024-05-09T09:50:43.297021+0000","last_fullsized":"2024-05-09T09:50:43.297021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'8","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.173898+0000","last_change":"2024-05-09T09:47:14.187249+0000","last_active":"2024-05-09T09:49:25.173898+0000","last_peered":"2024-05-09T09:49:25.173898+0000","last_clean":"2024-05-09T09:49:25.173898+0000","last_became_active":"2024-05-09T09:47:14.186689+0000","last_became_peered":"2024-05-09T09:47:14.186689+0000","last_unstale":"2024-05-09T09:49:25.173898+0000","last_undegraded":"2024-05-09T09:49:25.173898+0000","last_fullsized":"2024-05-09T09:49:25.173898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.172278+0000","last_change":"2024-05-09T09:47:12.211787+0000","last_active":"2024-05-09T09:49:20.172278+0000","last_peered":"2024-05-09T09:49:20.172278+0000","last_clean":"2024-05-09T09:49:20.172278+0000","last_became_active":"2024-05-09T09:47:12.209633+0000","last_became_peered":"2024-05-09T09:47:12.209633+0000","last_unstale":"2024-05-09T09:49:20.172278+0000","last_undegraded":"2024-05-09T09:49:20.172278+0000","last_fullsized":"2024-05-09T09:49:20.172278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:11.046816+0000","last_change":"2024-05-09T09:51:11.046882+0000","last_active":"2024-05-09T09:51:11.046816+0000","last_peered":"2024-05-09T09:51:11.046816+0000","last_clean":"2024-05-09T09:51:11.046816+0000","last_became_active":"2024-05-09T09:47:14.193366+0000","last_became_peered":"2024-05-09T09:47:14.193366+0000","last_unstale":"2024-05-09T09:51:11.046816+0000","last_undegraded":"2024-05-09T09:51:11.046816+0000","last_fullsized":"2024-05-09T09:51:11.046816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:11.046623+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:11.046623+0000","last_clean_scrub_stamp":"2024-05-09T09:51:11.046623+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:34:07.870070+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:19.202106+0000","last_change":"2024-05-09T09:51:19.202106+0000","last_active":"2024-05-09T09:51:19.202106+0000","last_peered":"2024-05-09T09:51:19.202106+0000","last_clean":"2024-05-09T09:51:19.202106+0000","last_became_active":"2024-05-09T09:47:12.214019+0000","last_became_peered":"2024-05-09T09:47:12.214019+0000","last_unstale":"2024-05-09T09:51:19.202106+0000","last_undegraded":"2024-05-09T09:51:19.202106+0000","last_fullsized":"2024-05-09T09:51:19.202106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:19.201848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:19.201848+0000","last_clean_scrub_stamp":"2024-05-09T09:51:19.201848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:30:31.069764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'4","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:43.297159+0000","last_change":"2024-05-09T09:47:14.182706+0000","last_active":"2024-05-09T09:50:43.297159+0000","last_peered":"2024-05-09T09:50:43.297159+0000","last_clean":"2024-05-09T09:50:43.297159+0000","last_became_active":"2024-05-09T09:47:14.181824+0000","last_became_peered":"2024-05-09T09:47:14.181824+0000","last_unstale":"2024-05-09T09:50:43.297159+0000","last_undegraded":"2024-05-09T09:50:43.297159+0000","last_fullsized":"2024-05-09T09:50:43.297159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.163520+0000","last_change":"2024-05-09T09:47:12.205854+0000","last_active":"2024-05-09T09:49:25.163520+0000","last_peered":"2024-05-09T09:49:25.163520+0000","last_clean":"2024-05-09T09:49:25.163520+0000","last_became_active":"2024-05-09T09:47:12.204322+0000","last_became_peered":"2024-05-09T09:47:12.204322+0000","last_unstale":"2024-05-09T09:49:25.163520+0000","last_undegraded":"2024-05-09T09:49:25.163520+0000","last_fullsized":"2024-05-09T09:49:25.163520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:11.318530+0000","last_change":"2024-05-09T09:51:11.318592+0000","last_active":"2024-05-09T09:51:11.318530+0000","last_peered":"2024-05-09T09:51:11.318530+0000","last_clean":"2024-05-09T09:51:11.318530+0000","last_became_active":"2024-05-09T09:47:14.178503+0000","last_became_peered":"2024-05-09T09:47:14.178503+0000","last_unstale":"2024-05-09T09:51:11.318530+0000","last_undegraded":"2024-05-09T09:51:11.318530+0000","last_fullsized":"2024-05-09T09:51:11.318530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:11.318334+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:11.318334+0000","last_clean_scrub_stamp":"2024-05-09T09:51:11.318334+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:48:38.508221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"30'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.174358+0000","last_change":"2024-05-09T09:47:12.196461+0000","last_active":"2024-05-09T09:49:25.174358+0000","last_peered":"2024-05-09T09:49:25.174358+0000","last_clean":"2024-05-09T09:49:25.174358+0000","last_became_active":"2024-05-09T09:47:12.196120+0000","last_became_peered":"2024-05-09T09:47:12.196120+0000","last_unstale":"2024-05-09T09:49:25.174358+0000","last_undegraded":"2024-05-09T09:49:25.174358+0000","last_fullsized":"2024-05-09T09:49:25.174358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'5","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:43.297328+0000","last_change":"2024-05-09T09:47:14.177343+0000","last_active":"2024-05-09T09:50:43.297328+0000","last_peered":"2024-05-09T09:50:43.297328+0000","last_clean":"2024-05-09T09:50:43.297328+0000","last_became_active":"2024-05-09T09:47:14.176615+0000","last_became_peered":"2024-05-09T09:47:14.176615+0000","last_unstale":"2024-05-09T09:50:43.297328+0000","last_undegraded":"2024-05-09T09:50:43.297328+0000","last_fullsized":"2024-05-09T09:50:43.297328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:13.464160+0000","last_change":"2024-05-09T09:51:13.464266+0000","last_active":"2024-05-09T09:51:13.464160+0000","last_peered":"2024-05-09T09:51:13.464160+0000","last_clean":"2024-05-09T09:51:13.464160+0000","last_became_active":"2024-05-09T09:47:12.209171+0000","last_became_peered":"2024-05-09T09:47:12.209171+0000","last_unstale":"2024-05-09T09:51:13.464160+0000","last_undegraded":"2024-05-09T09:51:13.464160+0000","last_fullsized":"2024-05-09T09:51:13.464160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:13.463897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:13.463897+0000","last_clean_scrub_stamp":"2024-05-09T09:51:13.463897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:36:06.810856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:20.172784+0000","last_change":"2024-05-09T09:47:14.177426+0000","last_active":"2024-05-09T09:49:20.172784+0000","last_peered":"2024-05-09T09:49:20.172784+0000","last_clean":"2024-05-09T09:49:20.172784+0000","last_became_active":"2024-05-09T09:47:14.177119+0000","last_became_peered":"2024-05-09T09:47:14.177119+0000","last_unstale":"2024-05-09T09:49:20.172784+0000","last_undegraded":"2024-05-09T09:49:20.172784+0000","last_fullsized":"2024-05-09T09:49:20.172784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:25.163658+0000","last_change":"2024-05-09T09:47:12.185203+0000","last_active":"2024-05-09T09:49:25.163658+0000","last_peered":"2024-05-09T09:49:25.163658+0000","last_clean":"2024-05-09T09:49:25.163658+0000","last_became_active":"2024-05-09T09:47:12.184105+0000","last_became_peered":"2024-05-09T09:47:12.184105+0000","last_unstale":"2024-05-09T09:49:25.163658+0000","last_undegraded":"2024-05-09T09:49:25.163658+0000","last_fullsized":"2024-05-09T09:49:25.163658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'2","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:07.275958+0000","last_change":"2024-05-09T09:51:07.276039+0000","last_active":"2024-05-09T09:51:07.275958+0000","last_peered":"2024-05-09T09:51:07.275958+0000","last_clean":"2024-05-09T09:51:07.275958+0000","last_became_active":"2024-05-09T09:47:14.182961+0000","last_became_peered":"2024-05-09T09:47:14.182961+0000","last_unstale":"2024-05-09T09:51:07.275958+0000","last_undegraded":"2024-05-09T09:51:07.275958+0000","last_fullsized":"2024-05-09T09:51:07.275958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:07.275721+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:07.275721+0000","last_clean_scrub_stamp":"2024-05-09T09:51:07.275721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:48:18.587139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.082986+0000","last_change":"2024-05-09T09:47:12.206940+0000","last_active":"2024-05-09T09:50:40.082986+0000","last_peered":"2024-05-09T09:50:40.082986+0000","last_clean":"2024-05-09T09:50:40.082986+0000","last_became_active":"2024-05-09T09:47:12.201952+0000","last_became_peered":"2024-05-09T09:47:12.201952+0000","last_unstale":"2024-05-09T09:50:40.082986+0000","last_undegraded":"2024-05-09T09:50:40.082986+0000","last_fullsized":"2024-05-09T09:50:40.082986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:00.474004+0000","last_change":"2024-05-09T09:51:00.474068+0000","last_active":"2024-05-09T09:51:00.474004+0000","last_peered":"2024-05-09T09:51:00.474004+0000","last_clean":"2024-05-09T09:51:00.474004+0000","last_became_active":"2024-05-09T09:47:14.193421+0000","last_became_peered":"2024-05-09T09:47:14.193421+0000","last_unstale":"2024-05-09T09:51:00.474004+0000","last_undegraded":"2024-05-09T09:51:00.474004+0000","last_fullsized":"2024-05-09T09:51:00.474004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:00.473817+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:00.473817+0000","last_clean_scrub_stamp":"2024-05-09T09:51:00.473817+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:20:56.044572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:23.303896+0000","last_change":"2024-05-09T09:51:23.303971+0000","last_active":"2024-05-09T09:51:23.303896+0000","last_peered":"2024-05-09T09:51:23.303896+0000","last_clean":"2024-05-09T09:51:23.303896+0000","last_became_active":"2024-05-09T09:47:12.203523+0000","last_became_peered":"2024-05-09T09:47:12.203523+0000","last_unstale":"2024-05-09T09:51:23.303896+0000","last_undegraded":"2024-05-09T09:51:23.303896+0000","last_fullsized":"2024-05-09T09:51:23.303896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:23.303622+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:23.303622+0000","last_clean_scrub_stamp":"2024-05-09T09:51:23.303622+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:42:02.620894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:16.166791+0000","last_change":"2024-05-09T09:51:16.166971+0000","last_active":"2024-05-09T09:51:16.166791+0000","last_peered":"2024-05-09T09:51:16.166791+0000","last_clean":"2024-05-09T09:51:16.166791+0000","last_became_active":"2024-05-09T09:47:14.171565+0000","last_became_peered":"2024-05-09T09:47:14.171565+0000","last_unstale":"2024-05-09T09:51:16.166791+0000","last_undegraded":"2024-05-09T09:51:16.166791+0000","last_fullsized":"2024-05-09T09:51:16.166791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:16.166561+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:16.166561+0000","last_clean_scrub_stamp":"2024-05-09T09:51:16.166561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:37:36.427827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:32.118450+0000","last_change":"2024-05-09T09:47:12.193541+0000","last_active":"2024-05-09T09:49:32.118450+0000","last_peered":"2024-05-09T09:49:32.118450+0000","last_clean":"2024-05-09T09:49:32.118450+0000","last_became_active":"2024-05-09T09:47:12.192462+0000","last_became_peered":"2024-05-09T09:47:12.192462+0000","last_unstale":"2024-05-09T09:49:32.118450+0000","last_undegraded":"2024-05-09T09:49:32.118450+0000","last_fullsized":"2024-05-09T09:49:32.118450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.253499+0000","last_change":"2024-05-09T09:47:14.177456+0000","last_active":"2024-05-09T09:50:33.253499+0000","last_peered":"2024-05-09T09:50:33.253499+0000","last_clean":"2024-05-09T09:50:33.253499+0000","last_became_active":"2024-05-09T09:47:14.176986+0000","last_became_peered":"2024-05-09T09:47:14.176986+0000","last_unstale":"2024-05-09T09:50:33.253499+0000","last_undegraded":"2024-05-09T09:50:33.253499+0000","last_fullsized":"2024-05-09T09:50:33.253499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:30.175257+0000","last_change":"2024-05-09T09:47:12.205826+0000","last_active":"2024-05-09T09:49:30.175257+0000","last_peered":"2024-05-09T09:49:30.175257+0000","last_clean":"2024-05-09T09:49:30.175257+0000","last_became_active":"2024-05-09T09:47:12.205416+0000","last_became_peered":"2024-05-09T09:47:12.205416+0000","last_unstale":"2024-05-09T09:49:30.175257+0000","last_undegraded":"2024-05-09T09:49:30.175257+0000","last_fullsized":"2024-05-09T09:49:30.175257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:10.327555+0000","last_change":"2024-05-09T09:51:10.327719+0000","last_active":"2024-05-09T09:51:10.327555+0000","last_peered":"2024-05-09T09:51:10.327555+0000","last_clean":"2024-05-09T09:51:10.327555+0000","last_became_active":"2024-05-09T09:47:14.182248+0000","last_became_peered":"2024-05-09T09:47:14.182248+0000","last_unstale":"2024-05-09T09:51:10.327555+0000","last_undegraded":"2024-05-09T09:51:10.327555+0000","last_fullsized":"2024-05-09T09:51:10.327555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:10.327288+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:10.327288+0000","last_clean_scrub_stamp":"2024-05-09T09:51:10.327288+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:19:34.184047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.083948+0000","last_change":"2024-05-09T09:47:12.208127+0000","last_active":"2024-05-09T09:50:40.083948+0000","last_peered":"2024-05-09T09:50:40.083948+0000","last_clean":"2024-05-09T09:50:40.083948+0000","last_became_active":"2024-05-09T09:47:12.200127+0000","last_became_peered":"2024-05-09T09:47:12.200127+0000","last_unstale":"2024-05-09T09:50:40.083948+0000","last_undegraded":"2024-05-09T09:50:40.083948+0000","last_fullsized":"2024-05-09T09:50:40.083948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:05.273620+0000","last_change":"2024-05-09T09:51:05.273679+0000","last_active":"2024-05-09T09:51:05.273620+0000","last_peered":"2024-05-09T09:51:05.273620+0000","last_clean":"2024-05-09T09:51:05.273620+0000","last_became_active":"2024-05-09T09:47:14.190033+0000","last_became_peered":"2024-05-09T09:47:14.190033+0000","last_unstale":"2024-05-09T09:51:05.273620+0000","last_undegraded":"2024-05-09T09:51:05.273620+0000","last_fullsized":"2024-05-09T09:51:05.273620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:05.273418+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:05.273418+0000","last_clean_scrub_stamp":"2024-05-09T09:51:05.273418+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:59:24.394431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:30.174791+0000","last_change":"2024-05-09T09:47:12.208249+0000","last_active":"2024-05-09T09:49:30.174791+0000","last_peered":"2024-05-09T09:49:30.174791+0000","last_clean":"2024-05-09T09:49:30.174791+0000","last_became_active":"2024-05-09T09:47:12.203424+0000","last_became_peered":"2024-05-09T09:47:12.203424+0000","last_unstale":"2024-05-09T09:49:30.174791+0000","last_undegraded":"2024-05-09T09:49:30.174791+0000","last_fullsized":"2024-05-09T09:49:30.174791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'5","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.404515+0000","last_change":"2024-05-09T09:47:14.187165+0000","last_active":"2024-05-09T09:50:33.404515+0000","last_peered":"2024-05-09T09:50:33.404515+0000","last_clean":"2024-05-09T09:50:33.404515+0000","last_became_active":"2024-05-09T09:47:14.186711+0000","last_became_peered":"2024-05-09T09:47:14.186711+0000","last_unstale":"2024-05-09T09:50:33.404515+0000","last_undegraded":"2024-05-09T09:50:33.404515+0000","last_fullsized":"2024-05-09T09:50:33.404515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:17.400143+0000","last_change":"2024-05-09T09:51:17.400209+0000","last_active":"2024-05-09T09:51:17.400143+0000","last_peered":"2024-05-09T09:51:17.400143+0000","last_clean":"2024-05-09T09:51:17.400143+0000","last_became_active":"2024-05-09T09:47:12.205320+0000","last_became_peered":"2024-05-09T09:47:12.205320+0000","last_unstale":"2024-05-09T09:51:17.400143+0000","last_undegraded":"2024-05-09T09:51:17.400143+0000","last_fullsized":"2024-05-09T09:51:17.400143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:17.399927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:17.399927+0000","last_clean_scrub_stamp":"2024-05-09T09:51:17.399927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:34:56.092455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.404831+0000","last_change":"2024-05-09T09:47:14.178306+0000","last_active":"2024-05-09T09:50:33.404831+0000","last_peered":"2024-05-09T09:50:33.404831+0000","last_clean":"2024-05-09T09:50:33.404831+0000","last_became_active":"2024-05-09T09:47:14.177955+0000","last_became_peered":"2024-05-09T09:47:14.177955+0000","last_unstale":"2024-05-09T09:50:33.404831+0000","last_undegraded":"2024-05-09T09:50:33.404831+0000","last_fullsized":"2024-05-09T09:50:33.404831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.176255+0000","last_change":"2024-05-09T09:47:12.202337+0000","last_active":"2024-05-09T09:49:35.176255+0000","last_peered":"2024-05-09T09:49:35.176255+0000","last_clean":"2024-05-09T09:49:35.176255+0000","last_became_active":"2024-05-09T09:47:12.201790+0000","last_became_peered":"2024-05-09T09:47:12.201790+0000","last_unstale":"2024-05-09T09:49:35.176255+0000","last_undegraded":"2024-05-09T09:49:35.176255+0000","last_fullsized":"2024-05-09T09:49:35.176255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.136122+0000","last_change":"2024-05-09T09:47:12.207600+0000","last_active":"2024-05-09T09:50:33.136122+0000","last_peered":"2024-05-09T09:50:33.136122+0000","last_clean":"2024-05-09T09:50:33.136122+0000","last_became_active":"2024-05-09T09:47:12.203435+0000","last_became_peered":"2024-05-09T09:47:12.203435+0000","last_unstale":"2024-05-09T09:50:33.136122+0000","last_undegraded":"2024-05-09T09:50:33.136122+0000","last_fullsized":"2024-05-09T09:50:33.136122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'7","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.404902+0000","last_change":"2024-05-09T09:47:14.179261+0000","last_active":"2024-05-09T09:50:33.404902+0000","last_peered":"2024-05-09T09:50:33.404902+0000","last_clean":"2024-05-09T09:50:33.404902+0000","last_became_active":"2024-05-09T09:47:14.178142+0000","last_became_peered":"2024-05-09T09:47:14.178142+0000","last_unstale":"2024-05-09T09:50:33.404902+0000","last_undegraded":"2024-05-09T09:50:33.404902+0000","last_fullsized":"2024-05-09T09:50:33.404902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:21.278268+0000","last_change":"2024-05-09T09:51:21.278372+0000","last_active":"2024-05-09T09:51:21.278268+0000","last_peered":"2024-05-09T09:51:21.278268+0000","last_clean":"2024-05-09T09:51:21.278268+0000","last_became_active":"2024-05-09T09:47:12.205216+0000","last_became_peered":"2024-05-09T09:47:12.205216+0000","last_unstale":"2024-05-09T09:51:21.278268+0000","last_undegraded":"2024-05-09T09:51:21.278268+0000","last_fullsized":"2024-05-09T09:51:21.278268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:21.278009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:21.278009+0000","last_clean_scrub_stamp":"2024-05-09T09:51:21.278009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:28:18.321440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'12","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.825940+0000","last_change":"2024-05-09T09:47:14.174424+0000","last_active":"2024-05-09T09:50:32.825940+0000","last_peered":"2024-05-09T09:50:32.825940+0000","last_clean":"2024-05-09T09:50:32.825940+0000","last_became_active":"2024-05-09T09:47:14.174123+0000","last_became_peered":"2024-05-09T09:47:14.174123+0000","last_unstale":"2024-05-09T09:50:32.825940+0000","last_undegraded":"2024-05-09T09:50:32.825940+0000","last_fullsized":"2024-05-09T09:50:32.825940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3894,"ondisk_log_size":3894,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1628,"num_read_kb":1518,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":477,"ondisk_log_size":477,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705719,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35792,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336048,"statfs":{"total":96636764160,"available":96600113152,"internally_reserved":0,"allocated":466944,"data_stored":146615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705721,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":995328,"data_stored":734132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705719,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1011712,"data_stored":733627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705721,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35760,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336080,"statfs":{"total":96636764160,"available":96600145920,"internally_reserved":0,"allocated":434176,"data_stored":145588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T09:51:25.889 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.889 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.889 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.889 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.890 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.890 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.890 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.890 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.890 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.890 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.890 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.890 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.891 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.891 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.891 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.891 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.891 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.891 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.891 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.892 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.892 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.892 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.892 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.892 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.892 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.892 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.892 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.892 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.893 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.893 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.893 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.893 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.893 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.893 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.893 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.893 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.894 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.894 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.894 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.894 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.894 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.894 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.895 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-09T09:46:56.015260+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=46, tm_sec=56, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.895 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-09T09:47:02.030833+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=2, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.895 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.895 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.895 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.895 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-09T09:47:02.030833+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=2, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.895 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.895 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.896 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-09T09:47:02.030833+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=2, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.896 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.896 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.896 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-09T09:47:02.030833+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=2, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.896 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.896 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.896 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.896 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-09T09:47:02.030833+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=2, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.897 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.897 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.897 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-09T09:47:02.030833+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=2, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.897 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.897 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.897 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.897 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-09T09:47:02.030833+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=2, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.897 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.897 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.898 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.898 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-09T09:47:02.030833+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=2, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.898 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.898 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.898 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.898 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.898 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.899 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.899 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.899 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.899 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.899 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.899 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.899 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.899 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.900 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.900 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.900 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.900 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.900 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.900 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.900 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.901 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.901 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.901 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.901 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.901 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.901 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.901 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.901 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.902 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.902 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.902 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.902 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.902 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.902 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.902 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.902 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.902 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.903 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.903 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.903 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.903 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.903 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.903 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.903 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.903 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.904 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.904 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.904 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.904 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:25.904 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-09T09:51:45.905 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T09:51:46.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.030+0000 7f5a7f219640 1 Processor -- start 2024-05-09T09:51:46.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.030+0000 7f5a7f219640 1 -- start start 2024-05-09T09:51:46.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.034+0000 7f5a7f219640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5a780955b0 0x7f5a78129990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:51:46.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.034+0000 7f5a7f219640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a78096570 con 0x7f5a781294f0 2024-05-09T09:51:46.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.034+0000 7f5a7f219640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f5a780971f0 con 0x7f5a780955b0 2024-05-09T09:51:46.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.034+0000 7f5a77fff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f5a781294f0 0x7f5a7812c860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:36632/0 (socket says 172.21.15.110:36632) 2024-05-09T09:51:46.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.034+0000 7f5a77fff640 1 -- 172.21.15.110:0/71090348 learned_addr learned my addr 172.21.15.110:0/71090348 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:51:46.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.034+0000 7f5a7cfb5640 1 --2- 172.21.15.110:0/71090348 >> v2:172.21.15.110:3300/0 conn(0x7f5a780955b0 0x7f5a78129990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:51:46.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.034+0000 7f5a7cfb5640 1 -- 172.21.15.110:0/71090348 >> v1:172.21.15.110:6789/0 conn(0x7f5a781294f0 legacy=0x7f5a7812c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:51:46.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.034+0000 7f5a7cfb5640 1 -- 172.21.15.110:0/71090348 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a78129ed0 con 0x7f5a780955b0 2024-05-09T09:51:46.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.034+0000 7f5a7cfb5640 1 --2- 172.21.15.110:0/71090348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a780955b0 0x7f5a78129990 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f5a68009740 tx=0x7f5a6801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ebc63eda9bf39d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:51:46.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.034+0000 7f5a777fe640 1 -- 172.21.15.110:0/71090348 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a680b0070 con 0x7f5a780955b0 2024-05-09T09:51:46.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.034+0000 7f5a777fe640 1 -- 172.21.15.110:0/71090348 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a680ab530 con 0x7f5a780955b0 2024-05-09T09:51:46.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.034+0000 7f5a777fe640 1 -- 172.21.15.110:0/71090348 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a680ab830 con 0x7f5a780955b0 2024-05-09T09:51:46.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.034+0000 7f5a7f219640 1 -- 172.21.15.110:0/71090348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a780955b0 msgr2=0x7f5a78129990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:51:46.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.034+0000 7f5a7f219640 1 --2- 172.21.15.110:0/71090348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a780955b0 0x7f5a78129990 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f5a68009740 tx=0x7f5a6801c370 comp rx=0 tx=0).stop 2024-05-09T09:51:46.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.034+0000 7f5a7f219640 1 -- 172.21.15.110:0/71090348 shutdown_connections 2024-05-09T09:51:46.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.034+0000 7f5a7f219640 1 --2- 172.21.15.110:0/71090348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a780955b0 0x7f5a78129990 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:51:46.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.034+0000 7f5a7f219640 1 -- 172.21.15.110:0/71090348 >> 172.21.15.110:0/71090348 conn(0x7f5a7809ad20 msgr2=0x7f5a7809b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:51:46.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.034+0000 7f5a7f219640 1 -- 172.21.15.110:0/71090348 shutdown_connections 2024-05-09T09:51:46.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.034+0000 7f5a7f219640 1 -- 172.21.15.110:0/71090348 wait complete. 2024-05-09T09:51:46.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.038+0000 7f5a7f219640 1 Processor -- start 2024-05-09T09:51:46.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.038+0000 7f5a7f219640 1 -- start start 2024-05-09T09:51:46.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.038+0000 7f5a7f219640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a780955b0 0x7f5a7812f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:51:46.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.038+0000 7f5a7f219640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5a781357a0 con 0x7f5a780955b0 2024-05-09T09:51:46.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.038+0000 7f5a7cfb5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a780955b0 0x7f5a7812f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:51:46.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.038+0000 7f5a7cfb5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a780955b0 0x7f5a7812f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49370/0 (socket says 172.21.15.110:49370) 2024-05-09T09:51:46.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.038+0000 7f5a7cfb5640 1 -- 172.21.15.110:0/3328367125 learned_addr learned my addr 172.21.15.110:0/3328367125 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:51:46.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.038+0000 7f5a7cfb5640 1 -- 172.21.15.110:0/3328367125 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a78131b80 con 0x7f5a780955b0 2024-05-09T09:51:46.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.038+0000 7f5a7cfb5640 1 --2- 172.21.15.110:0/3328367125 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a780955b0 0x7f5a7812f8b0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f5a68019fa0 tx=0x7f5a6801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:51:46.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.038+0000 7f5a757fa640 1 -- 172.21.15.110:0/3328367125 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a680b0050 con 0x7f5a780955b0 2024-05-09T09:51:46.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.038+0000 7f5a757fa640 1 -- 172.21.15.110:0/3328367125 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a680b1040 con 0x7f5a780955b0 2024-05-09T09:51:46.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.038+0000 7f5a7f219640 1 -- 172.21.15.110:0/3328367125 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a78131fd0 con 0x7f5a780955b0 2024-05-09T09:51:46.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.038+0000 7f5a757fa640 1 -- 172.21.15.110:0/3328367125 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a680b5930 con 0x7f5a780955b0 2024-05-09T09:51:46.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.038+0000 7f5a7f219640 1 -- 172.21.15.110:0/3328367125 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a7812fdf0 con 0x7f5a780955b0 2024-05-09T09:51:46.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.038+0000 7f5a7f219640 1 -- 172.21.15.110:0/3328367125 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a78063710 con 0x7f5a780955b0 2024-05-09T09:51:46.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.038+0000 7f5a757fa640 1 -- 172.21.15.110:0/3328367125 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f5a680be030 con 0x7f5a780955b0 2024-05-09T09:51:46.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.038+0000 7f5a757fa640 1 --2- 172.21.15.110:0/3328367125 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5a58036310 0x7f5a580387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:51:46.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.038+0000 7f5a757fa640 1 -- 172.21.15.110:0/3328367125 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f5a680bc070 con 0x7f5a780955b0 2024-05-09T09:51:46.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.038+0000 7f5a77fff640 1 --2- 172.21.15.110:0/3328367125 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5a58036310 0x7f5a580387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:51:46.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.042+0000 7f5a77fff640 1 --2- 172.21.15.110:0/3328367125 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5a58036310 0x7f5a580387d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5a60005890 tx=0x7f5a60007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:51:46.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.042+0000 7f5a757fa640 1 -- 172.21.15.110:0/3328367125 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5a680c5020 con 0x7f5a780955b0 2024-05-09T09:51:46.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.202+0000 7f5a7f219640 1 -- 172.21.15.110:0/3328367125 --> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5a78131d60 con 0x7f5a58036310 2024-05-09T09:51:46.254 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.250+0000 7f5a757fa640 1 -- 172.21.15.110:0/3328367125 <== mgr.4100 v2:172.21.15.157:6824/2765519551 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+664952 (secure 0 0 0) 0x7f5a60001c00 con 0x7f5a58036310 2024-05-09T09:51:46.260 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:51:46.266 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-05-09T09:51:46.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.258+0000 7f5a7f219640 1 -- 172.21.15.110:0/3328367125 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5a58036310 msgr2=0x7f5a580387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:51:46.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.258+0000 7f5a7f219640 1 --2- 172.21.15.110:0/3328367125 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5a58036310 0x7f5a580387d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5a60005890 tx=0x7f5a60007a90 comp rx=0 tx=0).stop 2024-05-09T09:51:46.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.258+0000 7f5a7f219640 1 -- 172.21.15.110:0/3328367125 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a780955b0 msgr2=0x7f5a7812f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:51:46.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.258+0000 7f5a7f219640 1 --2- 172.21.15.110:0/3328367125 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a780955b0 0x7f5a7812f8b0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f5a68019fa0 tx=0x7f5a6801abb0 comp rx=0 tx=0).stop 2024-05-09T09:51:46.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.258+0000 7f5a7f219640 1 -- 172.21.15.110:0/3328367125 shutdown_connections 2024-05-09T09:51:46.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.258+0000 7f5a7f219640 1 --2- 172.21.15.110:0/3328367125 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f5a58036310 0x7f5a580387d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:51:46.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.258+0000 7f5a7f219640 1 --2- 172.21.15.110:0/3328367125 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a780955b0 0x7f5a7812f8b0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:51:46.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.258+0000 7f5a7f219640 1 -- 172.21.15.110:0/3328367125 >> 172.21.15.110:0/3328367125 conn(0x7f5a7809ad20 msgr2=0x7f5a78097820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:51:46.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.258+0000 7f5a7f219640 1 -- 172.21.15.110:0/3328367125 shutdown_connections 2024-05-09T09:51:46.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:51:46.258+0000 7f5a7f219640 1 -- 172.21.15.110:0/3328367125 wait complete. 2024-05-09T09:51:46.280 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2024-05-09T09:51:45.208268+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5118,"num_read_kb":4699,"num_write":2179,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7153,"ondisk_log_size":7153,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":135864,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377351496,"statfs":{"total":386547056640,"available":386407931904,"internally_reserved":0,"allocated":2908160,"data_stored":1759962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006185"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:19.312716+0000","last_change":"2024-05-09T09:51:19.312716+0000","last_active":"2024-05-09T09:51:19.312716+0000","last_peered":"2024-05-09T09:51:19.312716+0000","last_clean":"2024-05-09T09:51:19.312716+0000","last_became_active":"2024-05-09T09:47:12.205786+0000","last_became_peered":"2024-05-09T09:47:12.205786+0000","last_unstale":"2024-05-09T09:51:19.312716+0000","last_undegraded":"2024-05-09T09:51:19.312716+0000","last_fullsized":"2024-05-09T09:51:19.312716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:19.312429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:19.312429+0000","last_clean_scrub_stamp":"2024-05-09T09:51:19.312429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:04:04.477540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:17.286142+0000","last_change":"2024-05-09T09:51:17.286281+0000","last_active":"2024-05-09T09:51:17.286142+0000","last_peered":"2024-05-09T09:51:17.286142+0000","last_clean":"2024-05-09T09:51:17.286142+0000","last_became_active":"2024-05-09T09:47:14.171044+0000","last_became_peered":"2024-05-09T09:47:14.171044+0000","last_unstale":"2024-05-09T09:51:17.286142+0000","last_undegraded":"2024-05-09T09:51:17.286142+0000","last_fullsized":"2024-05-09T09:51:17.286142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:17.285919+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:17.285919+0000","last_clean_scrub_stamp":"2024-05-09T09:51:17.285919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:38:58.303485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:31.265736+0000","last_change":"2024-05-09T09:51:31.265802+0000","last_active":"2024-05-09T09:51:31.265736+0000","last_peered":"2024-05-09T09:51:31.265736+0000","last_clean":"2024-05-09T09:51:31.265736+0000","last_became_active":"2024-05-09T09:47:12.189774+0000","last_became_peered":"2024-05-09T09:47:12.189774+0000","last_unstale":"2024-05-09T09:51:31.265736+0000","last_undegraded":"2024-05-09T09:51:31.265736+0000","last_fullsized":"2024-05-09T09:51:31.265736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:31.265537+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:31.265537+0000","last_clean_scrub_stamp":"2024-05-09T09:51:31.265537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:45:33.707959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:58.498693+0000","last_change":"2024-05-09T09:50:58.498826+0000","last_active":"2024-05-09T09:50:58.498693+0000","last_peered":"2024-05-09T09:50:58.498693+0000","last_clean":"2024-05-09T09:50:58.498693+0000","last_became_active":"2024-05-09T09:47:14.192803+0000","last_became_peered":"2024-05-09T09:47:14.192803+0000","last_unstale":"2024-05-09T09:50:58.498693+0000","last_undegraded":"2024-05-09T09:50:58.498693+0000","last_fullsized":"2024-05-09T09:50:58.498693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-09T09:50:58.498439+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-09T09:50:58.498439+0000","last_clean_scrub_stamp":"2024-05-09T09:50:58.498439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:24.753930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"32'3","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:39.539536+0000","last_change":"2024-05-09T09:51:39.539606+0000","last_active":"2024-05-09T09:51:39.539536+0000","last_peered":"2024-05-09T09:51:39.539536+0000","last_clean":"2024-05-09T09:51:39.539536+0000","last_became_active":"2024-05-09T09:47:12.207184+0000","last_became_peered":"2024-05-09T09:47:12.207184+0000","last_unstale":"2024-05-09T09:51:39.539536+0000","last_undegraded":"2024-05-09T09:51:39.539536+0000","last_fullsized":"2024-05-09T09:51:39.539536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-09T09:51:39.539316+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-09T09:51:39.539316+0000","last_clean_scrub_stamp":"2024-05-09T09:51:39.539316+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:18:24.181972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'14","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:02.473931+0000","last_change":"2024-05-09T09:51:02.473990+0000","last_active":"2024-05-09T09:51:02.473931+0000","last_peered":"2024-05-09T09:51:02.473931+0000","last_clean":"2024-05-09T09:51:02.473931+0000","last_became_active":"2024-05-09T09:47:14.192821+0000","last_became_peered":"2024-05-09T09:47:14.192821+0000","last_unstale":"2024-05-09T09:51:02.473931+0000","last_undegraded":"2024-05-09T09:51:02.473931+0000","last_fullsized":"2024-05-09T09:51:02.473931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-05-09T09:51:02.473728+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-05-09T09:51:02.473728+0000","last_clean_scrub_stamp":"2024-05-09T09:51:02.473728+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:32.374501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:28.190192+0000","last_change":"2024-05-09T09:51:28.190303+0000","last_active":"2024-05-09T09:51:28.190192+0000","last_peered":"2024-05-09T09:51:28.190192+0000","last_clean":"2024-05-09T09:51:28.190192+0000","last_became_active":"2024-05-09T09:47:12.194183+0000","last_became_peered":"2024-05-09T09:47:12.194183+0000","last_unstale":"2024-05-09T09:51:28.190192+0000","last_undegraded":"2024-05-09T09:51:28.190192+0000","last_fullsized":"2024-05-09T09:51:28.190192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:28.189983+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:28.189983+0000","last_clean_scrub_stamp":"2024-05-09T09:51:28.189983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:47:28.328562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'12","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:39.260166+0000","last_change":"2024-05-09T09:51:39.260319+0000","last_active":"2024-05-09T09:51:39.260166+0000","last_peered":"2024-05-09T09:51:39.260166+0000","last_clean":"2024-05-09T09:51:39.260166+0000","last_became_active":"2024-05-09T09:47:52.429940+0000","last_became_peered":"2024-05-09T09:47:52.429940+0000","last_unstale":"2024-05-09T09:51:39.260166+0000","last_undegraded":"2024-05-09T09:51:39.260166+0000","last_fullsized":"2024-05-09T09:51:39.260166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-09T09:51:39.259883+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-09T09:51:39.259883+0000","last_clean_scrub_stamp":"2024-05-09T09:51:39.259883+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:48.460976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.178988+0000","last_change":"2024-05-09T09:47:12.212361+0000","last_active":"2024-05-09T09:49:45.178988+0000","last_peered":"2024-05-09T09:49:45.178988+0000","last_clean":"2024-05-09T09:49:45.178988+0000","last_became_active":"2024-05-09T09:47:12.204446+0000","last_became_peered":"2024-05-09T09:47:12.204446+0000","last_unstale":"2024-05-09T09:49:45.178988+0000","last_undegraded":"2024-05-09T09:49:45.178988+0000","last_fullsized":"2024-05-09T09:49:45.178988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'16","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:09.303305+0000","last_change":"2024-05-09T09:51:09.303305+0000","last_active":"2024-05-09T09:51:09.303305+0000","last_peered":"2024-05-09T09:51:09.303305+0000","last_clean":"2024-05-09T09:51:09.303305+0000","last_became_active":"2024-05-09T09:47:14.184792+0000","last_became_peered":"2024-05-09T09:47:14.184792+0000","last_unstale":"2024-05-09T09:51:09.303305+0000","last_undegraded":"2024-05-09T09:51:09.303305+0000","last_fullsized":"2024-05-09T09:51:09.303305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-05-09T09:51:09.303051+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-05-09T09:51:09.303051+0000","last_clean_scrub_stamp":"2024-05-09T09:51:09.303051+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:45:33.303026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'4","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:30.227495+0000","last_change":"2024-05-09T09:51:30.227586+0000","last_active":"2024-05-09T09:51:30.227495+0000","last_peered":"2024-05-09T09:51:30.227495+0000","last_clean":"2024-05-09T09:51:30.227495+0000","last_became_active":"2024-05-09T09:47:12.195117+0000","last_became_peered":"2024-05-09T09:47:12.195117+0000","last_unstale":"2024-05-09T09:51:30.227495+0000","last_undegraded":"2024-05-09T09:51:30.227495+0000","last_fullsized":"2024-05-09T09:51:30.227495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:30.227300+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:30.227300+0000","last_clean_scrub_stamp":"2024-05-09T09:51:30.227300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:21:25.798055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'8","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:20.459408+0000","last_change":"2024-05-09T09:51:20.459408+0000","last_active":"2024-05-09T09:51:20.459408+0000","last_peered":"2024-05-09T09:51:20.459408+0000","last_clean":"2024-05-09T09:51:20.459408+0000","last_became_active":"2024-05-09T09:47:14.188665+0000","last_became_peered":"2024-05-09T09:47:14.188665+0000","last_unstale":"2024-05-09T09:51:20.459408+0000","last_undegraded":"2024-05-09T09:51:20.459408+0000","last_fullsized":"2024-05-09T09:51:20.459408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:20.459134+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:20.459134+0000","last_clean_scrub_stamp":"2024-05-09T09:51:20.459134+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:03:39.099108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"30'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.178799+0000","last_change":"2024-05-09T09:47:12.201245+0000","last_active":"2024-05-09T09:49:45.178799+0000","last_peered":"2024-05-09T09:49:45.178799+0000","last_clean":"2024-05-09T09:49:45.178799+0000","last_became_active":"2024-05-09T09:47:12.199697+0000","last_became_peered":"2024-05-09T09:47:12.199697+0000","last_unstale":"2024-05-09T09:49:45.178799+0000","last_undegraded":"2024-05-09T09:49:45.178799+0000","last_fullsized":"2024-05-09T09:49:45.178799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'12","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:14.446828+0000","last_change":"2024-05-09T09:51:14.446828+0000","last_active":"2024-05-09T09:51:14.446828+0000","last_peered":"2024-05-09T09:51:14.446828+0000","last_clean":"2024-05-09T09:51:14.446828+0000","last_became_active":"2024-05-09T09:47:14.179041+0000","last_became_peered":"2024-05-09T09:47:14.179041+0000","last_unstale":"2024-05-09T09:51:14.446828+0000","last_undegraded":"2024-05-09T09:51:14.446828+0000","last_fullsized":"2024-05-09T09:51:14.446828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-09T09:51:14.446529+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-09T09:51:14.446529+0000","last_clean_scrub_stamp":"2024-05-09T09:51:14.446529+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:59:33.567541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:34.229589+0000","last_change":"2024-05-09T09:51:34.229655+0000","last_active":"2024-05-09T09:51:34.229589+0000","last_peered":"2024-05-09T09:51:34.229589+0000","last_clean":"2024-05-09T09:51:34.229589+0000","last_became_active":"2024-05-09T09:47:12.183745+0000","last_became_peered":"2024-05-09T09:47:12.183745+0000","last_unstale":"2024-05-09T09:51:34.229589+0000","last_undegraded":"2024-05-09T09:51:34.229589+0000","last_fullsized":"2024-05-09T09:51:34.229589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:34.229365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:34.229365+0000","last_clean_scrub_stamp":"2024-05-09T09:51:34.229365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:13.552047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'14","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:08.402293+0000","last_change":"2024-05-09T09:51:08.402293+0000","last_active":"2024-05-09T09:51:08.402293+0000","last_peered":"2024-05-09T09:51:08.402293+0000","last_clean":"2024-05-09T09:51:08.402293+0000","last_became_active":"2024-05-09T09:47:14.173031+0000","last_became_peered":"2024-05-09T09:47:14.173031+0000","last_unstale":"2024-05-09T09:51:08.402293+0000","last_undegraded":"2024-05-09T09:51:08.402293+0000","last_fullsized":"2024-05-09T09:51:08.402293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-05-09T09:51:08.401898+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-05-09T09:51:08.401898+0000","last_clean_scrub_stamp":"2024-05-09T09:51:08.401898+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:55.999690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:01.424330+0000","last_change":"2024-05-09T09:51:01.424391+0000","last_active":"2024-05-09T09:51:01.424330+0000","last_peered":"2024-05-09T09:51:01.424330+0000","last_clean":"2024-05-09T09:51:01.424330+0000","last_became_active":"2024-05-09T09:47:14.192744+0000","last_became_peered":"2024-05-09T09:47:14.192744+0000","last_unstale":"2024-05-09T09:51:01.424330+0000","last_undegraded":"2024-05-09T09:51:01.424330+0000","last_fullsized":"2024-05-09T09:51:01.424330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-05-09T09:51:01.424130+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-05-09T09:51:01.424130+0000","last_clean_scrub_stamp":"2024-05-09T09:51:01.424130+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:37:21.685395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:19.333407+0000","last_change":"2024-05-09T09:51:19.333526+0000","last_active":"2024-05-09T09:51:19.333407+0000","last_peered":"2024-05-09T09:51:19.333407+0000","last_clean":"2024-05-09T09:51:19.333407+0000","last_became_active":"2024-05-09T09:47:12.210781+0000","last_became_peered":"2024-05-09T09:47:12.210781+0000","last_unstale":"2024-05-09T09:51:19.333407+0000","last_undegraded":"2024-05-09T09:51:19.333407+0000","last_fullsized":"2024-05-09T09:51:19.333407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:19.333113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:19.333113+0000","last_clean_scrub_stamp":"2024-05-09T09:51:19.333113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:47:02.729348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'20","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:03.281379+0000","last_change":"2024-05-09T09:51:03.281444+0000","last_active":"2024-05-09T09:51:03.281379+0000","last_peered":"2024-05-09T09:51:03.281379+0000","last_clean":"2024-05-09T09:51:03.281379+0000","last_became_active":"2024-05-09T09:47:14.190021+0000","last_became_peered":"2024-05-09T09:47:14.190021+0000","last_unstale":"2024-05-09T09:51:03.281379+0000","last_undegraded":"2024-05-09T09:51:03.281379+0000","last_fullsized":"2024-05-09T09:51:03.281379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-05-09T09:51:03.281166+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-05-09T09:51:03.281166+0000","last_clean_scrub_stamp":"2024-05-09T09:51:03.281166+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:25.247894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:27.221868+0000","last_change":"2024-05-09T09:51:27.221934+0000","last_active":"2024-05-09T09:51:27.221868+0000","last_peered":"2024-05-09T09:51:27.221868+0000","last_clean":"2024-05-09T09:51:27.221868+0000","last_became_active":"2024-05-09T09:47:12.193509+0000","last_became_peered":"2024-05-09T09:47:12.193509+0000","last_unstale":"2024-05-09T09:51:27.221868+0000","last_undegraded":"2024-05-09T09:51:27.221868+0000","last_fullsized":"2024-05-09T09:51:27.221868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:27.221674+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:27.221674+0000","last_clean_scrub_stamp":"2024-05-09T09:51:27.221674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:39:08.239240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:06.263774+0000","last_change":"2024-05-09T09:51:06.263845+0000","last_active":"2024-05-09T09:51:06.263774+0000","last_peered":"2024-05-09T09:51:06.263774+0000","last_clean":"2024-05-09T09:51:06.263774+0000","last_became_active":"2024-05-09T09:47:14.189468+0000","last_became_peered":"2024-05-09T09:47:14.189468+0000","last_unstale":"2024-05-09T09:51:06.263774+0000","last_undegraded":"2024-05-09T09:51:06.263774+0000","last_fullsized":"2024-05-09T09:51:06.263774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:06.263525+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:06.263525+0000","last_clean_scrub_stamp":"2024-05-09T09:51:06.263525+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:12:00.576796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:23.303504+0000","last_change":"2024-05-09T09:51:23.303574+0000","last_active":"2024-05-09T09:51:23.303504+0000","last_peered":"2024-05-09T09:51:23.303504+0000","last_clean":"2024-05-09T09:51:23.303504+0000","last_became_active":"2024-05-09T09:47:12.206920+0000","last_became_peered":"2024-05-09T09:47:12.206920+0000","last_unstale":"2024-05-09T09:51:23.303504+0000","last_undegraded":"2024-05-09T09:51:23.303504+0000","last_fullsized":"2024-05-09T09:51:23.303504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:23.303278+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:23.303278+0000","last_clean_scrub_stamp":"2024-05-09T09:51:23.303278+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:08:09.036340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'18","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:20.230718+0000","last_change":"2024-05-09T09:51:20.230883+0000","last_active":"2024-05-09T09:51:20.230718+0000","last_peered":"2024-05-09T09:51:20.230718+0000","last_clean":"2024-05-09T09:51:20.230718+0000","last_became_active":"2024-05-09T09:47:14.173701+0000","last_became_peered":"2024-05-09T09:47:14.173701+0000","last_unstale":"2024-05-09T09:51:20.230718+0000","last_undegraded":"2024-05-09T09:51:20.230718+0000","last_fullsized":"2024-05-09T09:51:20.230718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-05-09T09:51:20.230502+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-05-09T09:51:20.230502+0000","last_clean_scrub_stamp":"2024-05-09T09:51:20.230502+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:08:01.060833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:25.307446+0000","last_change":"2024-05-09T09:51:25.307513+0000","last_active":"2024-05-09T09:51:25.307446+0000","last_peered":"2024-05-09T09:51:25.307446+0000","last_clean":"2024-05-09T09:51:25.307446+0000","last_became_active":"2024-05-09T09:47:12.206564+0000","last_became_peered":"2024-05-09T09:47:12.206564+0000","last_unstale":"2024-05-09T09:51:25.307446+0000","last_undegraded":"2024-05-09T09:51:25.307446+0000","last_fullsized":"2024-05-09T09:51:25.307446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:25.307249+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:25.307249+0000","last_clean_scrub_stamp":"2024-05-09T09:51:25.307249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:48:11.901400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'10","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:10.414405+0000","last_change":"2024-05-09T09:51:10.414463+0000","last_active":"2024-05-09T09:51:10.414405+0000","last_peered":"2024-05-09T09:51:10.414405+0000","last_clean":"2024-05-09T09:51:10.414405+0000","last_became_active":"2024-05-09T09:47:14.173022+0000","last_became_peered":"2024-05-09T09:47:14.173022+0000","last_unstale":"2024-05-09T09:51:10.414405+0000","last_undegraded":"2024-05-09T09:51:10.414405+0000","last_fullsized":"2024-05-09T09:51:10.414405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-09T09:51:10.414205+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-09T09:51:10.414205+0000","last_clean_scrub_stamp":"2024-05-09T09:51:10.414205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:51:35.503195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:17.187884+0000","last_change":"2024-05-09T09:51:17.187941+0000","last_active":"2024-05-09T09:51:17.187884+0000","last_peered":"2024-05-09T09:51:17.187884+0000","last_clean":"2024-05-09T09:51:17.187884+0000","last_became_active":"2024-05-09T09:47:12.214422+0000","last_became_peered":"2024-05-09T09:47:12.214422+0000","last_unstale":"2024-05-09T09:51:17.187884+0000","last_undegraded":"2024-05-09T09:51:17.187884+0000","last_fullsized":"2024-05-09T09:51:17.187884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:17.187681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:17.187681+0000","last_clean_scrub_stamp":"2024-05-09T09:51:17.187681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:47.088454+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:14.316742+0000","last_change":"2024-05-09T09:51:14.316808+0000","last_active":"2024-05-09T09:51:14.316742+0000","last_peered":"2024-05-09T09:51:14.316742+0000","last_clean":"2024-05-09T09:51:14.316742+0000","last_became_active":"2024-05-09T09:47:14.172297+0000","last_became_peered":"2024-05-09T09:47:14.172297+0000","last_unstale":"2024-05-09T09:51:14.316742+0000","last_undegraded":"2024-05-09T09:51:14.316742+0000","last_fullsized":"2024-05-09T09:51:14.316742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-09T09:51:14.316551+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-09T09:51:14.316551+0000","last_clean_scrub_stamp":"2024-05-09T09:51:14.316551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:05:01.778480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:33.483740+0000","last_change":"2024-05-09T09:51:33.483810+0000","last_active":"2024-05-09T09:51:33.483740+0000","last_peered":"2024-05-09T09:51:33.483740+0000","last_clean":"2024-05-09T09:51:33.483740+0000","last_became_active":"2024-05-09T09:47:12.211880+0000","last_became_peered":"2024-05-09T09:47:12.211880+0000","last_unstale":"2024-05-09T09:51:33.483740+0000","last_undegraded":"2024-05-09T09:51:33.483740+0000","last_fullsized":"2024-05-09T09:51:33.483740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:33.483529+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:33.483529+0000","last_clean_scrub_stamp":"2024-05-09T09:51:33.483529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:02:54.678304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'39","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.344633+0000","last_change":"2024-05-09T09:47:22.260431+0000","last_active":"2024-05-09T09:50:33.344633+0000","last_peered":"2024-05-09T09:50:33.344633+0000","last_clean":"2024-05-09T09:50:33.344633+0000","last_became_active":"2024-05-09T09:47:22.258991+0000","last_became_peered":"2024-05-09T09:47:22.258991+0000","last_unstale":"2024-05-09T09:50:33.344633+0000","last_undegraded":"2024-05-09T09:50:33.344633+0000","last_fullsized":"2024-05-09T09:50:33.344633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":174,"num_read_kb":174,"num_write":107,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:29.521776+0000","last_change":"2024-05-09T09:51:29.521842+0000","last_active":"2024-05-09T09:51:29.521776+0000","last_peered":"2024-05-09T09:51:29.521776+0000","last_clean":"2024-05-09T09:51:29.521776+0000","last_became_active":"2024-05-09T09:47:14.184851+0000","last_became_peered":"2024-05-09T09:47:14.184851+0000","last_unstale":"2024-05-09T09:51:29.521776+0000","last_undegraded":"2024-05-09T09:51:29.521776+0000","last_fullsized":"2024-05-09T09:51:29.521776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:29.521558+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:29.521558+0000","last_clean_scrub_stamp":"2024-05-09T09:51:29.521558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:56:44.098725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.083065+0000","last_change":"2024-05-09T09:47:12.214683+0000","last_active":"2024-05-09T09:50:40.083065+0000","last_peered":"2024-05-09T09:50:40.083065+0000","last_clean":"2024-05-09T09:50:40.083065+0000","last_became_active":"2024-05-09T09:47:12.214108+0000","last_became_peered":"2024-05-09T09:47:12.214108+0000","last_unstale":"2024-05-09T09:50:40.083065+0000","last_undegraded":"2024-05-09T09:50:40.083065+0000","last_fullsized":"2024-05-09T09:50:40.083065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:53.499175+0000","last_change":"2024-05-09T09:50:53.499229+0000","last_active":"2024-05-09T09:50:53.499175+0000","last_peered":"2024-05-09T09:50:53.499175+0000","last_clean":"2024-05-09T09:50:53.499175+0000","last_became_active":"2024-05-09T09:47:16.196516+0000","last_became_peered":"2024-05-09T09:47:16.196516+0000","last_unstale":"2024-05-09T09:50:53.499175+0000","last_undegraded":"2024-05-09T09:50:53.499175+0000","last_fullsized":"2024-05-09T09:50:53.499175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:53.498977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:53.498977+0000","last_clean_scrub_stamp":"2024-05-09T09:50:53.498977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:34:28.515132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'111","reported_seq":166,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:13.471271+0000","last_change":"2024-05-09T09:51:13.471414+0000","last_active":"2024-05-09T09:51:13.471271+0000","last_peered":"2024-05-09T09:51:13.471271+0000","last_clean":"2024-05-09T09:51:13.471271+0000","last_became_active":"2024-05-09T09:47:18.235911+0000","last_became_peered":"2024-05-09T09:47:18.235911+0000","last_unstale":"2024-05-09T09:51:13.471271+0000","last_undegraded":"2024-05-09T09:51:13.471271+0000","last_fullsized":"2024-05-09T09:51:13.471271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'111","last_scrub_stamp":"2024-05-09T09:51:13.471021+0000","last_deep_scrub":"32'111","last_deep_scrub_stamp":"2024-05-09T09:51:13.471021+0000","last_clean_scrub_stamp":"2024-05-09T09:51:13.471021+0000","objects_scrubbed":4,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:48:45.181255+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:04.247298+0000","last_change":"2024-05-09T09:51:04.247398+0000","last_active":"2024-05-09T09:51:04.247298+0000","last_peered":"2024-05-09T09:51:04.247298+0000","last_clean":"2024-05-09T09:51:04.247298+0000","last_became_active":"2024-05-09T09:47:20.251712+0000","last_became_peered":"2024-05-09T09:47:20.251712+0000","last_unstale":"2024-05-09T09:51:04.247298+0000","last_undegraded":"2024-05-09T09:51:04.247298+0000","last_fullsized":"2024-05-09T09:51:04.247298+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:04.247033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:04.247033+0000","last_clean_scrub_stamp":"2024-05-09T09:51:04.247033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:57.593992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:50.180967+0000","last_change":"2024-05-09T09:47:22.255759+0000","last_active":"2024-05-09T09:49:50.180967+0000","last_peered":"2024-05-09T09:49:50.180967+0000","last_clean":"2024-05-09T09:49:50.180967+0000","last_became_active":"2024-05-09T09:47:22.255180+0000","last_became_peered":"2024-05-09T09:47:22.255180+0000","last_unstale":"2024-05-09T09:49:50.180967+0000","last_undegraded":"2024-05-09T09:49:50.180967+0000","last_fullsized":"2024-05-09T09:49:50.180967+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:22.501931+0000","last_change":"2024-05-09T09:51:22.502050+0000","last_active":"2024-05-09T09:51:22.501931+0000","last_peered":"2024-05-09T09:51:22.501931+0000","last_clean":"2024-05-09T09:51:22.501931+0000","last_became_active":"2024-05-09T09:47:14.187095+0000","last_became_peered":"2024-05-09T09:47:14.187095+0000","last_unstale":"2024-05-09T09:51:22.501931+0000","last_undegraded":"2024-05-09T09:51:22.501931+0000","last_fullsized":"2024-05-09T09:51:22.501931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:22.501695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:22.501695+0000","last_clean_scrub_stamp":"2024-05-09T09:51:22.501695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:02:09.890340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:31.182361+0000","last_change":"2024-05-09T09:51:31.182425+0000","last_active":"2024-05-09T09:51:31.182361+0000","last_peered":"2024-05-09T09:51:31.182361+0000","last_clean":"2024-05-09T09:51:31.182361+0000","last_became_active":"2024-05-09T09:47:12.194549+0000","last_became_peered":"2024-05-09T09:47:12.194549+0000","last_unstale":"2024-05-09T09:51:31.182361+0000","last_undegraded":"2024-05-09T09:51:31.182361+0000","last_fullsized":"2024-05-09T09:51:31.182361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:31.182162+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:31.182162+0000","last_clean_scrub_stamp":"2024-05-09T09:51:31.182162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:37:51.443427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:07.069278+0000","last_change":"2024-05-09T09:51:07.069334+0000","last_active":"2024-05-09T09:51:07.069278+0000","last_peered":"2024-05-09T09:51:07.069278+0000","last_clean":"2024-05-09T09:51:07.069278+0000","last_became_active":"2024-05-09T09:47:16.190755+0000","last_became_peered":"2024-05-09T09:47:16.190755+0000","last_unstale":"2024-05-09T09:51:07.069278+0000","last_undegraded":"2024-05-09T09:51:07.069278+0000","last_fullsized":"2024-05-09T09:51:07.069278+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:07.069053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:07.069053+0000","last_clean_scrub_stamp":"2024-05-09T09:51:07.069053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:51:02.166302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'10","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:47.334928+0000","last_change":"2024-05-09T09:50:47.334999+0000","last_active":"2024-05-09T09:50:47.334928+0000","last_peered":"2024-05-09T09:50:47.334928+0000","last_clean":"2024-05-09T09:50:47.334928+0000","last_became_active":"2024-05-09T09:47:18.214299+0000","last_became_peered":"2024-05-09T09:47:18.214299+0000","last_unstale":"2024-05-09T09:50:47.334928+0000","last_undegraded":"2024-05-09T09:50:47.334928+0000","last_fullsized":"2024-05-09T09:50:47.334928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-09T09:50:47.334727+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-09T09:50:47.334727+0000","last_clean_scrub_stamp":"2024-05-09T09:50:47.334727+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:31:56.932969+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:56.256173+0000","last_change":"2024-05-09T09:50:56.256269+0000","last_active":"2024-05-09T09:50:56.256173+0000","last_peered":"2024-05-09T09:50:56.256173+0000","last_clean":"2024-05-09T09:50:56.256173+0000","last_became_active":"2024-05-09T09:47:20.241096+0000","last_became_peered":"2024-05-09T09:47:20.241096+0000","last_unstale":"2024-05-09T09:50:56.256173+0000","last_undegraded":"2024-05-09T09:50:56.256173+0000","last_fullsized":"2024-05-09T09:50:56.256173+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:56.255842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:56.255842+0000","last_clean_scrub_stamp":"2024-05-09T09:50:56.255842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:53:33.355429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:55.170754+0000","last_change":"2024-05-09T09:47:22.258554+0000","last_active":"2024-05-09T09:49:55.170754+0000","last_peered":"2024-05-09T09:49:55.170754+0000","last_clean":"2024-05-09T09:49:55.170754+0000","last_became_active":"2024-05-09T09:47:22.257798+0000","last_became_peered":"2024-05-09T09:47:22.257798+0000","last_unstale":"2024-05-09T09:49:55.170754+0000","last_undegraded":"2024-05-09T09:49:55.170754+0000","last_fullsized":"2024-05-09T09:49:55.170754+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:38.265821+0000","last_change":"2024-05-09T09:51:38.265982+0000","last_active":"2024-05-09T09:51:38.265821+0000","last_peered":"2024-05-09T09:51:38.265821+0000","last_clean":"2024-05-09T09:51:38.265821+0000","last_became_active":"2024-05-09T09:47:52.429857+0000","last_became_peered":"2024-05-09T09:47:52.429857+0000","last_unstale":"2024-05-09T09:51:38.265821+0000","last_undegraded":"2024-05-09T09:51:38.265821+0000","last_fullsized":"2024-05-09T09:51:38.265821+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:38.265591+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:38.265591+0000","last_clean_scrub_stamp":"2024-05-09T09:51:38.265591+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:59.065746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.175839+0000","last_change":"2024-05-09T09:47:12.201826+0000","last_active":"2024-05-09T09:49:35.175839+0000","last_peered":"2024-05-09T09:49:35.175839+0000","last_clean":"2024-05-09T09:49:35.175839+0000","last_became_active":"2024-05-09T09:47:12.201415+0000","last_became_peered":"2024-05-09T09:47:12.201415+0000","last_unstale":"2024-05-09T09:49:35.175839+0000","last_undegraded":"2024-05-09T09:49:35.175839+0000","last_fullsized":"2024-05-09T09:49:35.175839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:03.013348+0000","last_change":"2024-05-09T09:51:03.013403+0000","last_active":"2024-05-09T09:51:03.013348+0000","last_peered":"2024-05-09T09:51:03.013348+0000","last_clean":"2024-05-09T09:51:03.013348+0000","last_became_active":"2024-05-09T09:47:16.212543+0000","last_became_peered":"2024-05-09T09:47:16.212543+0000","last_unstale":"2024-05-09T09:51:03.013348+0000","last_undegraded":"2024-05-09T09:51:03.013348+0000","last_fullsized":"2024-05-09T09:51:03.013348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:03.013120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:03.013120+0000","last_clean_scrub_stamp":"2024-05-09T09:51:03.013120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:48:14.324538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:56.286640+0000","last_change":"2024-05-09T09:50:56.286722+0000","last_active":"2024-05-09T09:50:56.286640+0000","last_peered":"2024-05-09T09:50:56.286640+0000","last_clean":"2024-05-09T09:50:56.286640+0000","last_became_active":"2024-05-09T09:47:18.212685+0000","last_became_peered":"2024-05-09T09:47:18.212685+0000","last_unstale":"2024-05-09T09:50:56.286640+0000","last_undegraded":"2024-05-09T09:50:56.286640+0000","last_fullsized":"2024-05-09T09:50:56.286640+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-09T09:50:56.286427+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-09T09:50:56.286427+0000","last_clean_scrub_stamp":"2024-05-09T09:50:56.286427+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:21.085497+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":395,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:06.438260+0000","last_change":"2024-05-09T09:51:06.438322+0000","last_active":"2024-05-09T09:51:06.438260+0000","last_peered":"2024-05-09T09:51:06.438260+0000","last_clean":"2024-05-09T09:51:06.438260+0000","last_became_active":"2024-05-09T09:47:20.250200+0000","last_became_peered":"2024-05-09T09:47:20.250200+0000","last_unstale":"2024-05-09T09:51:06.438260+0000","last_undegraded":"2024-05-09T09:51:06.438260+0000","last_fullsized":"2024-05-09T09:51:06.438260+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:51:06.438054+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:51:06.438054+0000","last_clean_scrub_stamp":"2024-05-09T09:51:06.438054+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:28:03.481485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:36.206944+0000","last_change":"2024-05-09T09:51:36.207039+0000","last_active":"2024-05-09T09:51:36.206944+0000","last_peered":"2024-05-09T09:51:36.206944+0000","last_clean":"2024-05-09T09:51:36.206944+0000","last_became_active":"2024-05-09T09:47:22.238160+0000","last_became_peered":"2024-05-09T09:47:22.238160+0000","last_unstale":"2024-05-09T09:51:36.206944+0000","last_undegraded":"2024-05-09T09:51:36.206944+0000","last_fullsized":"2024-05-09T09:51:36.206944+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:36.206692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:36.206692+0000","last_clean_scrub_stamp":"2024-05-09T09:51:36.206692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:28:28.062055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'16","reported_seq":113,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:28.332710+0000","last_change":"2024-05-09T09:51:28.332773+0000","last_active":"2024-05-09T09:51:28.332710+0000","last_peered":"2024-05-09T09:51:28.332710+0000","last_clean":"2024-05-09T09:51:28.332710+0000","last_became_active":"2024-05-09T09:47:14.176295+0000","last_became_peered":"2024-05-09T09:47:14.176295+0000","last_unstale":"2024-05-09T09:51:28.332710+0000","last_undegraded":"2024-05-09T09:51:28.332710+0000","last_fullsized":"2024-05-09T09:51:28.332710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-05-09T09:51:28.332516+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-05-09T09:51:28.332516+0000","last_clean_scrub_stamp":"2024-05-09T09:51:28.332516+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:28:07.098893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:31.289927+0000","last_change":"2024-05-09T09:51:31.289987+0000","last_active":"2024-05-09T09:51:31.289927+0000","last_peered":"2024-05-09T09:51:31.289927+0000","last_clean":"2024-05-09T09:51:31.289927+0000","last_became_active":"2024-05-09T09:47:12.191194+0000","last_became_peered":"2024-05-09T09:47:12.191194+0000","last_unstale":"2024-05-09T09:51:31.289927+0000","last_undegraded":"2024-05-09T09:51:31.289927+0000","last_fullsized":"2024-05-09T09:51:31.289927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:31.289717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:31.289717+0000","last_clean_scrub_stamp":"2024-05-09T09:51:31.289717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:58:22.238688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.179207+0000","last_change":"2024-05-09T09:47:52.201792+0000","last_active":"2024-05-09T09:49:45.179207+0000","last_peered":"2024-05-09T09:49:45.179207+0000","last_clean":"2024-05-09T09:49:45.179207+0000","last_became_active":"2024-05-09T09:47:52.201081+0000","last_became_peered":"2024-05-09T09:47:52.201081+0000","last_unstale":"2024-05-09T09:49:45.179207+0000","last_undegraded":"2024-05-09T09:49:45.179207+0000","last_fullsized":"2024-05-09T09:49:45.179207+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'110","reported_seq":165,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:52.254206+0000","last_change":"2024-05-09T09:50:52.254281+0000","last_active":"2024-05-09T09:50:52.254206+0000","last_peered":"2024-05-09T09:50:52.254206+0000","last_clean":"2024-05-09T09:50:52.254206+0000","last_became_active":"2024-05-09T09:47:18.217843+0000","last_became_peered":"2024-05-09T09:47:18.217843+0000","last_unstale":"2024-05-09T09:50:52.254206+0000","last_undegraded":"2024-05-09T09:50:52.254206+0000","last_fullsized":"2024-05-09T09:50:52.254206+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'110","last_scrub_stamp":"2024-05-09T09:50:52.254022+0000","last_deep_scrub":"32'110","last_deep_scrub_stamp":"2024-05-09T09:50:52.254022+0000","last_clean_scrub_stamp":"2024-05-09T09:50:52.254022+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:44:38.690119+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":455,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:43.906596+0000","last_change":"2024-05-09T09:50:43.906635+0000","last_active":"2024-05-09T09:50:43.906596+0000","last_peered":"2024-05-09T09:50:43.906596+0000","last_clean":"2024-05-09T09:50:43.906596+0000","last_became_active":"2024-05-09T09:47:20.242448+0000","last_became_peered":"2024-05-09T09:47:20.242448+0000","last_unstale":"2024-05-09T09:50:43.906596+0000","last_undegraded":"2024-05-09T09:50:43.906596+0000","last_fullsized":"2024-05-09T09:50:43.906596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:43.906506+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:43.906506+0000","last_clean_scrub_stamp":"2024-05-09T09:50:43.906506+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:08.705575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:37.221280+0000","last_change":"2024-05-09T09:51:37.221338+0000","last_active":"2024-05-09T09:51:37.221280+0000","last_peered":"2024-05-09T09:51:37.221280+0000","last_clean":"2024-05-09T09:51:37.221280+0000","last_became_active":"2024-05-09T09:47:52.179059+0000","last_became_peered":"2024-05-09T09:47:52.179059+0000","last_unstale":"2024-05-09T09:51:37.221280+0000","last_undegraded":"2024-05-09T09:51:37.221280+0000","last_fullsized":"2024-05-09T09:51:37.221280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:37.221094+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:37.221094+0000","last_clean_scrub_stamp":"2024-05-09T09:51:37.221094+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:00:23.913251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:21.280559+0000","last_change":"2024-05-09T09:51:21.280559+0000","last_active":"2024-05-09T09:51:21.280559+0000","last_peered":"2024-05-09T09:51:21.280559+0000","last_clean":"2024-05-09T09:51:21.280559+0000","last_became_active":"2024-05-09T09:47:12.205259+0000","last_became_peered":"2024-05-09T09:47:12.205259+0000","last_unstale":"2024-05-09T09:51:21.280559+0000","last_undegraded":"2024-05-09T09:51:21.280559+0000","last_fullsized":"2024-05-09T09:51:21.280559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:21.280309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:21.280309+0000","last_clean_scrub_stamp":"2024-05-09T09:51:21.280309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:51:16.377558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:02.242526+0000","last_change":"2024-05-09T09:51:02.242526+0000","last_active":"2024-05-09T09:51:02.242526+0000","last_peered":"2024-05-09T09:51:02.242526+0000","last_clean":"2024-05-09T09:51:02.242526+0000","last_became_active":"2024-05-09T09:47:16.207404+0000","last_became_peered":"2024-05-09T09:47:16.207404+0000","last_unstale":"2024-05-09T09:51:02.242526+0000","last_undegraded":"2024-05-09T09:51:02.242526+0000","last_fullsized":"2024-05-09T09:51:02.242526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:02.242155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:02.242155+0000","last_clean_scrub_stamp":"2024-05-09T09:51:02.242155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:18:43.580003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'127","reported_seq":188,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:51.217030+0000","last_change":"2024-05-09T09:50:51.217030+0000","last_active":"2024-05-09T09:50:51.217030+0000","last_peered":"2024-05-09T09:50:51.217030+0000","last_clean":"2024-05-09T09:50:51.217030+0000","last_became_active":"2024-05-09T09:47:18.220596+0000","last_became_peered":"2024-05-09T09:47:18.220596+0000","last_unstale":"2024-05-09T09:50:51.217030+0000","last_undegraded":"2024-05-09T09:50:51.217030+0000","last_fullsized":"2024-05-09T09:50:51.217030+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'127","last_scrub_stamp":"2024-05-09T09:50:51.216776+0000","last_deep_scrub":"32'127","last_deep_scrub_stamp":"2024-05-09T09:50:51.216776+0000","last_clean_scrub_stamp":"2024-05-09T09:50:51.216776+0000","objects_scrubbed":9,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:52:10.006215+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":63,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:45.825591+0000","last_change":"2024-05-09T09:50:45.825646+0000","last_active":"2024-05-09T09:50:45.825591+0000","last_peered":"2024-05-09T09:50:45.825591+0000","last_clean":"2024-05-09T09:50:45.825591+0000","last_became_active":"2024-05-09T09:47:20.244839+0000","last_became_peered":"2024-05-09T09:47:20.244839+0000","last_unstale":"2024-05-09T09:50:45.825591+0000","last_undegraded":"2024-05-09T09:50:45.825591+0000","last_fullsized":"2024-05-09T09:50:45.825591+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:45.825370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:45.825370+0000","last_clean_scrub_stamp":"2024-05-09T09:50:45.825370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:33:58.430560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:35.203710+0000","last_change":"2024-05-09T09:51:35.203825+0000","last_active":"2024-05-09T09:51:35.203710+0000","last_peered":"2024-05-09T09:51:35.203710+0000","last_clean":"2024-05-09T09:51:35.203710+0000","last_became_active":"2024-05-09T09:47:22.235895+0000","last_became_peered":"2024-05-09T09:47:22.235895+0000","last_unstale":"2024-05-09T09:51:35.203710+0000","last_undegraded":"2024-05-09T09:51:35.203710+0000","last_fullsized":"2024-05-09T09:51:35.203710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-09T09:51:35.203402+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-09T09:51:35.203402+0000","last_clean_scrub_stamp":"2024-05-09T09:51:35.203402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:48:21.797553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:15.273289+0000","last_change":"2024-05-09T09:51:15.273289+0000","last_active":"2024-05-09T09:51:15.273289+0000","last_peered":"2024-05-09T09:51:15.273289+0000","last_clean":"2024-05-09T09:51:15.273289+0000","last_became_active":"2024-05-09T09:47:14.172275+0000","last_became_peered":"2024-05-09T09:47:14.172275+0000","last_unstale":"2024-05-09T09:51:15.273289+0000","last_undegraded":"2024-05-09T09:51:15.273289+0000","last_fullsized":"2024-05-09T09:51:15.273289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:15.273035+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:15.273035+0000","last_clean_scrub_stamp":"2024-05-09T09:51:15.273035+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:10:49.381052+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:11.412780+0000","last_change":"2024-05-09T09:51:11.412780+0000","last_active":"2024-05-09T09:51:11.412780+0000","last_peered":"2024-05-09T09:51:11.412780+0000","last_clean":"2024-05-09T09:51:11.412780+0000","last_became_active":"2024-05-09T09:47:12.209274+0000","last_became_peered":"2024-05-09T09:47:12.209274+0000","last_unstale":"2024-05-09T09:51:11.412780+0000","last_undegraded":"2024-05-09T09:51:11.412780+0000","last_fullsized":"2024-05-09T09:51:11.412780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:11.412502+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:11.412502+0000","last_clean_scrub_stamp":"2024-05-09T09:51:11.412502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:20:20.774039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:59.933420+0000","last_change":"2024-05-09T09:50:59.933420+0000","last_active":"2024-05-09T09:50:59.933420+0000","last_peered":"2024-05-09T09:50:59.933420+0000","last_clean":"2024-05-09T09:50:59.933420+0000","last_became_active":"2024-05-09T09:47:16.214484+0000","last_became_peered":"2024-05-09T09:47:16.214484+0000","last_unstale":"2024-05-09T09:50:59.933420+0000","last_undegraded":"2024-05-09T09:50:59.933420+0000","last_fullsized":"2024-05-09T09:50:59.933420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:59.933158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:59.933158+0000","last_clean_scrub_stamp":"2024-05-09T09:50:59.933158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:53.280118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'113","reported_seq":168,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:51.479962+0000","last_change":"2024-05-09T09:50:51.480062+0000","last_active":"2024-05-09T09:50:51.479962+0000","last_peered":"2024-05-09T09:50:51.479962+0000","last_clean":"2024-05-09T09:50:51.479962+0000","last_became_active":"2024-05-09T09:47:18.224815+0000","last_became_peered":"2024-05-09T09:47:18.224815+0000","last_unstale":"2024-05-09T09:50:51.479962+0000","last_undegraded":"2024-05-09T09:50:51.479962+0000","last_fullsized":"2024-05-09T09:50:51.479962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'113","last_scrub_stamp":"2024-05-09T09:50:51.479757+0000","last_deep_scrub":"32'113","last_deep_scrub_stamp":"2024-05-09T09:50:51.479757+0000","last_clean_scrub_stamp":"2024-05-09T09:50:51.479757+0000","objects_scrubbed":4,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:05.084435+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:02.001194+0000","last_change":"2024-05-09T09:51:02.001194+0000","last_active":"2024-05-09T09:51:02.001194+0000","last_peered":"2024-05-09T09:51:02.001194+0000","last_clean":"2024-05-09T09:51:02.001194+0000","last_became_active":"2024-05-09T09:47:20.250686+0000","last_became_peered":"2024-05-09T09:47:20.250686+0000","last_unstale":"2024-05-09T09:51:02.001194+0000","last_undegraded":"2024-05-09T09:51:02.001194+0000","last_fullsized":"2024-05-09T09:51:02.001194+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:02.000873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:02.000873+0000","last_clean_scrub_stamp":"2024-05-09T09:51:02.000873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:10:46.269234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'17","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:43.755988+0000","last_change":"2024-05-09T09:47:22.255914+0000","last_active":"2024-05-09T09:50:43.755988+0000","last_peered":"2024-05-09T09:50:43.755988+0000","last_clean":"2024-05-09T09:50:43.755988+0000","last_became_active":"2024-05-09T09:47:22.255076+0000","last_became_peered":"2024-05-09T09:47:22.255076+0000","last_unstale":"2024-05-09T09:50:43.755988+0000","last_undegraded":"2024-05-09T09:50:43.755988+0000","last_fullsized":"2024-05-09T09:50:43.755988+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":92,"num_read_kb":72,"num_write":55,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:16.427622+0000","last_change":"2024-05-09T09:51:16.427622+0000","last_active":"2024-05-09T09:51:16.427622+0000","last_peered":"2024-05-09T09:51:16.427622+0000","last_clean":"2024-05-09T09:51:16.427622+0000","last_became_active":"2024-05-09T09:47:14.180185+0000","last_became_peered":"2024-05-09T09:47:14.180185+0000","last_unstale":"2024-05-09T09:51:16.427622+0000","last_undegraded":"2024-05-09T09:51:16.427622+0000","last_fullsized":"2024-05-09T09:51:16.427622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-09T09:51:16.427325+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-09T09:51:16.427325+0000","last_clean_scrub_stamp":"2024-05-09T09:51:16.427325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:25:28.601825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:30.174800+0000","last_change":"2024-05-09T09:47:12.211357+0000","last_active":"2024-05-09T09:49:30.174800+0000","last_peered":"2024-05-09T09:49:30.174800+0000","last_clean":"2024-05-09T09:49:30.174800+0000","last_became_active":"2024-05-09T09:47:12.207751+0000","last_became_peered":"2024-05-09T09:47:12.207751+0000","last_unstale":"2024-05-09T09:49:30.174800+0000","last_undegraded":"2024-05-09T09:49:30.174800+0000","last_fullsized":"2024-05-09T09:49:30.174800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:04.040553+0000","last_change":"2024-05-09T09:51:04.040606+0000","last_active":"2024-05-09T09:51:04.040553+0000","last_peered":"2024-05-09T09:51:04.040553+0000","last_clean":"2024-05-09T09:51:04.040553+0000","last_became_active":"2024-05-09T09:47:16.207734+0000","last_became_peered":"2024-05-09T09:47:16.207734+0000","last_unstale":"2024-05-09T09:51:04.040553+0000","last_undegraded":"2024-05-09T09:51:04.040553+0000","last_fullsized":"2024-05-09T09:51:04.040553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:04.040339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:04.040339+0000","last_clean_scrub_stamp":"2024-05-09T09:51:04.040339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:34:42.732867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'119","reported_seq":178,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:47.428281+0000","last_change":"2024-05-09T09:50:47.428281+0000","last_active":"2024-05-09T09:50:47.428281+0000","last_peered":"2024-05-09T09:50:47.428281+0000","last_clean":"2024-05-09T09:50:47.428281+0000","last_became_active":"2024-05-09T09:47:18.230440+0000","last_became_peered":"2024-05-09T09:47:18.230440+0000","last_unstale":"2024-05-09T09:50:47.428281+0000","last_undegraded":"2024-05-09T09:50:47.428281+0000","last_fullsized":"2024-05-09T09:50:47.428281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-05-09T09:50:47.427971+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-05-09T09:50:47.427971+0000","last_clean_scrub_stamp":"2024-05-09T09:50:47.427971+0000","objects_scrubbed":7,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:24:59.602471+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":363,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:10.066212+0000","last_change":"2024-05-09T09:51:10.066212+0000","last_active":"2024-05-09T09:51:10.066212+0000","last_peered":"2024-05-09T09:51:10.066212+0000","last_clean":"2024-05-09T09:51:10.066212+0000","last_became_active":"2024-05-09T09:47:20.254305+0000","last_became_peered":"2024-05-09T09:47:20.254305+0000","last_unstale":"2024-05-09T09:51:10.066212+0000","last_undegraded":"2024-05-09T09:51:10.066212+0000","last_fullsized":"2024-05-09T09:51:10.066212+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:51:10.065958+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:51:10.065958+0000","last_clean_scrub_stamp":"2024-05-09T09:51:10.065958+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:04:57.527887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:43.274116+0000","last_change":"2024-05-09T09:51:43.274116+0000","last_active":"2024-05-09T09:51:43.274116+0000","last_peered":"2024-05-09T09:51:43.274116+0000","last_clean":"2024-05-09T09:51:43.274116+0000","last_became_active":"2024-05-09T09:47:22.239262+0000","last_became_peered":"2024-05-09T09:47:22.239262+0000","last_unstale":"2024-05-09T09:51:43.274116+0000","last_undegraded":"2024-05-09T09:51:43.274116+0000","last_fullsized":"2024-05-09T09:51:43.274116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:43.273853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:43.273853+0000","last_clean_scrub_stamp":"2024-05-09T09:51:43.273853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:15:17.167906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'8","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:20.323048+0000","last_change":"2024-05-09T09:51:20.323048+0000","last_active":"2024-05-09T09:51:20.323048+0000","last_peered":"2024-05-09T09:51:20.323048+0000","last_clean":"2024-05-09T09:51:20.323048+0000","last_became_active":"2024-05-09T09:47:14.184593+0000","last_became_peered":"2024-05-09T09:47:14.184593+0000","last_unstale":"2024-05-09T09:51:20.323048+0000","last_undegraded":"2024-05-09T09:51:20.323048+0000","last_fullsized":"2024-05-09T09:51:20.323048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:20.322811+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:20.322811+0000","last_clean_scrub_stamp":"2024-05-09T09:51:20.322811+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:33.927489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'8","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:32.760996+0000","last_change":"2024-05-09T09:47:12.211539+0000","last_active":"2024-05-09T09:50:32.760996+0000","last_peered":"2024-05-09T09:50:32.760996+0000","last_clean":"2024-05-09T09:50:32.760996+0000","last_became_active":"2024-05-09T09:47:12.207403+0000","last_became_peered":"2024-05-09T09:47:12.207403+0000","last_unstale":"2024-05-09T09:50:32.760996+0000","last_undegraded":"2024-05-09T09:50:32.760996+0000","last_fullsized":"2024-05-09T09:50:32.760996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":16,"num_write_kb":8838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:58.967885+0000","last_change":"2024-05-09T09:50:58.967885+0000","last_active":"2024-05-09T09:50:58.967885+0000","last_peered":"2024-05-09T09:50:58.967885+0000","last_clean":"2024-05-09T09:50:58.967885+0000","last_became_active":"2024-05-09T09:47:16.214607+0000","last_became_peered":"2024-05-09T09:47:16.214607+0000","last_unstale":"2024-05-09T09:50:58.967885+0000","last_undegraded":"2024-05-09T09:50:58.967885+0000","last_fullsized":"2024-05-09T09:50:58.967885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:58.967631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:58.967631+0000","last_clean_scrub_stamp":"2024-05-09T09:50:58.967631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:20.934359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'212","reported_seq":286,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:45.413815+0000","last_change":"2024-05-09T09:50:45.413815+0000","last_active":"2024-05-09T09:50:45.413815+0000","last_peered":"2024-05-09T09:50:45.413815+0000","last_clean":"2024-05-09T09:50:45.413815+0000","last_became_active":"2024-05-09T09:47:18.224893+0000","last_became_peered":"2024-05-09T09:47:18.224893+0000","last_unstale":"2024-05-09T09:50:45.413815+0000","last_undegraded":"2024-05-09T09:50:45.413815+0000","last_fullsized":"2024-05-09T09:50:45.413815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'212","last_scrub_stamp":"2024-05-09T09:50:45.413522+0000","last_deep_scrub":"32'212","last_deep_scrub_stamp":"2024-05-09T09:50:45.413522+0000","last_clean_scrub_stamp":"2024-05-09T09:50:45.413522+0000","objects_scrubbed":5,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:59:04.534534+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:46.831580+0000","last_change":"2024-05-09T09:50:46.831580+0000","last_active":"2024-05-09T09:50:46.831580+0000","last_peered":"2024-05-09T09:50:46.831580+0000","last_clean":"2024-05-09T09:50:46.831580+0000","last_became_active":"2024-05-09T09:47:20.228339+0000","last_became_peered":"2024-05-09T09:47:20.228339+0000","last_unstale":"2024-05-09T09:50:46.831580+0000","last_undegraded":"2024-05-09T09:50:46.831580+0000","last_fullsized":"2024-05-09T09:50:46.831580+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:46.831331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:46.831331+0000","last_clean_scrub_stamp":"2024-05-09T09:50:46.831331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:58:25.885349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'21","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:41.346917+0000","last_change":"2024-05-09T09:51:41.346917+0000","last_active":"2024-05-09T09:51:41.346917+0000","last_peered":"2024-05-09T09:51:41.346917+0000","last_clean":"2024-05-09T09:51:41.346917+0000","last_became_active":"2024-05-09T09:47:22.229193+0000","last_became_peered":"2024-05-09T09:47:22.229193+0000","last_unstale":"2024-05-09T09:51:41.346917+0000","last_undegraded":"2024-05-09T09:51:41.346917+0000","last_fullsized":"2024-05-09T09:51:41.346917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-05-09T09:51:41.346645+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-05-09T09:51:41.346645+0000","last_clean_scrub_stamp":"2024-05-09T09:51:41.346645+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:35.992222+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:24.268806+0000","last_change":"2024-05-09T09:51:24.268882+0000","last_active":"2024-05-09T09:51:24.268806+0000","last_peered":"2024-05-09T09:51:24.268806+0000","last_clean":"2024-05-09T09:51:24.268806+0000","last_became_active":"2024-05-09T09:47:14.176717+0000","last_became_peered":"2024-05-09T09:47:14.176717+0000","last_unstale":"2024-05-09T09:51:24.268806+0000","last_undegraded":"2024-05-09T09:51:24.268806+0000","last_fullsized":"2024-05-09T09:51:24.268806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:24.268609+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:24.268609+0000","last_clean_scrub_stamp":"2024-05-09T09:51:24.268609+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:03:06.524381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:29.294901+0000","last_change":"2024-05-09T09:51:29.294901+0000","last_active":"2024-05-09T09:51:29.294901+0000","last_peered":"2024-05-09T09:51:29.294901+0000","last_clean":"2024-05-09T09:51:29.294901+0000","last_became_active":"2024-05-09T09:47:12.204317+0000","last_became_peered":"2024-05-09T09:47:12.204317+0000","last_unstale":"2024-05-09T09:51:29.294901+0000","last_undegraded":"2024-05-09T09:51:29.294901+0000","last_fullsized":"2024-05-09T09:51:29.294901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:29.294653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:29.294653+0000","last_clean_scrub_stamp":"2024-05-09T09:51:29.294653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:40:22.840115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:01.269594+0000","last_change":"2024-05-09T09:51:01.269646+0000","last_active":"2024-05-09T09:51:01.269594+0000","last_peered":"2024-05-09T09:51:01.269594+0000","last_clean":"2024-05-09T09:51:01.269594+0000","last_became_active":"2024-05-09T09:47:16.197031+0000","last_became_peered":"2024-05-09T09:47:16.197031+0000","last_unstale":"2024-05-09T09:51:01.269594+0000","last_undegraded":"2024-05-09T09:51:01.269594+0000","last_fullsized":"2024-05-09T09:51:01.269594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:01.269403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:01.269403+0000","last_clean_scrub_stamp":"2024-05-09T09:51:01.269403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:20:09.570821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'113","reported_seq":169,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:46.341277+0000","last_change":"2024-05-09T09:50:46.341361+0000","last_active":"2024-05-09T09:50:46.341277+0000","last_peered":"2024-05-09T09:50:46.341277+0000","last_clean":"2024-05-09T09:50:46.341277+0000","last_became_active":"2024-05-09T09:47:18.215793+0000","last_became_peered":"2024-05-09T09:47:18.215793+0000","last_unstale":"2024-05-09T09:50:46.341277+0000","last_undegraded":"2024-05-09T09:50:46.341277+0000","last_fullsized":"2024-05-09T09:50:46.341277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'113","last_scrub_stamp":"2024-05-09T09:50:46.341062+0000","last_deep_scrub":"32'113","last_deep_scrub_stamp":"2024-05-09T09:50:46.341062+0000","last_clean_scrub_stamp":"2024-05-09T09:50:46.341062+0000","objects_scrubbed":5,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:24:06.850096+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:05.480724+0000","last_change":"2024-05-09T09:51:05.480782+0000","last_active":"2024-05-09T09:51:05.480724+0000","last_peered":"2024-05-09T09:51:05.480724+0000","last_clean":"2024-05-09T09:51:05.480724+0000","last_became_active":"2024-05-09T09:47:20.250363+0000","last_became_peered":"2024-05-09T09:47:20.250363+0000","last_unstale":"2024-05-09T09:51:05.480724+0000","last_undegraded":"2024-05-09T09:51:05.480724+0000","last_fullsized":"2024-05-09T09:51:05.480724+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:05.480520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:05.480520+0000","last_clean_scrub_stamp":"2024-05-09T09:51:05.480520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:07:46.310851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:19.416370+0000","last_change":"2024-05-09T09:51:19.416370+0000","last_active":"2024-05-09T09:51:19.416370+0000","last_peered":"2024-05-09T09:51:19.416370+0000","last_clean":"2024-05-09T09:51:19.416370+0000","last_became_active":"2024-05-09T09:47:22.242410+0000","last_became_peered":"2024-05-09T09:47:22.242410+0000","last_unstale":"2024-05-09T09:51:19.416370+0000","last_undegraded":"2024-05-09T09:51:19.416370+0000","last_fullsized":"2024-05-09T09:51:19.416370+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:19.416094+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:19.416094+0000","last_clean_scrub_stamp":"2024-05-09T09:51:19.416094+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:58.738776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:17.471788+0000","last_change":"2024-05-09T09:51:17.471951+0000","last_active":"2024-05-09T09:51:17.471788+0000","last_peered":"2024-05-09T09:51:17.471788+0000","last_clean":"2024-05-09T09:51:17.471788+0000","last_became_active":"2024-05-09T09:47:14.190016+0000","last_became_peered":"2024-05-09T09:47:14.190016+0000","last_unstale":"2024-05-09T09:51:17.471788+0000","last_undegraded":"2024-05-09T09:51:17.471788+0000","last_fullsized":"2024-05-09T09:51:17.471788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:17.471525+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:17.471525+0000","last_clean_scrub_stamp":"2024-05-09T09:51:17.471525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:24:31.781883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.649471+0000","last_change":"2024-05-09T09:47:12.212155+0000","last_active":"2024-05-09T09:50:44.649471+0000","last_peered":"2024-05-09T09:50:44.649471+0000","last_clean":"2024-05-09T09:50:44.649471+0000","last_became_active":"2024-05-09T09:47:12.211221+0000","last_became_peered":"2024-05-09T09:47:12.211221+0000","last_unstale":"2024-05-09T09:50:44.649471+0000","last_undegraded":"2024-05-09T09:50:44.649471+0000","last_fullsized":"2024-05-09T09:50:44.649471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:00.977401+0000","last_change":"2024-05-09T09:51:00.977458+0000","last_active":"2024-05-09T09:51:00.977401+0000","last_peered":"2024-05-09T09:51:00.977401+0000","last_clean":"2024-05-09T09:51:00.977401+0000","last_became_active":"2024-05-09T09:47:16.214462+0000","last_became_peered":"2024-05-09T09:47:16.214462+0000","last_unstale":"2024-05-09T09:51:00.977401+0000","last_undegraded":"2024-05-09T09:51:00.977401+0000","last_fullsized":"2024-05-09T09:51:00.977401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:00.977167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:00.977167+0000","last_clean_scrub_stamp":"2024-05-09T09:51:00.977167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:59:20.098179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'119","reported_seq":177,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:57.261189+0000","last_change":"2024-05-09T09:50:57.261272+0000","last_active":"2024-05-09T09:50:57.261189+0000","last_peered":"2024-05-09T09:50:57.261189+0000","last_clean":"2024-05-09T09:50:57.261189+0000","last_became_active":"2024-05-09T09:47:18.212543+0000","last_became_peered":"2024-05-09T09:47:18.212543+0000","last_unstale":"2024-05-09T09:50:57.261189+0000","last_undegraded":"2024-05-09T09:50:57.261189+0000","last_fullsized":"2024-05-09T09:50:57.261189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-05-09T09:50:57.261002+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-05-09T09:50:57.261002+0000","last_clean_scrub_stamp":"2024-05-09T09:50:57.261002+0000","objects_scrubbed":7,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:26:30.185703+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":445,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:45.121613+0000","last_change":"2024-05-09T09:50:45.121680+0000","last_active":"2024-05-09T09:50:45.121613+0000","last_peered":"2024-05-09T09:50:45.121613+0000","last_clean":"2024-05-09T09:50:45.121613+0000","last_became_active":"2024-05-09T09:47:20.240236+0000","last_became_peered":"2024-05-09T09:47:20.240236+0000","last_unstale":"2024-05-09T09:50:45.121613+0000","last_undegraded":"2024-05-09T09:50:45.121613+0000","last_fullsized":"2024-05-09T09:50:45.121613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:45.121417+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:45.121417+0000","last_clean_scrub_stamp":"2024-05-09T09:50:45.121417+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:31:47.109285+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'14","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:43.297824+0000","last_change":"2024-05-09T09:47:22.258681+0000","last_active":"2024-05-09T09:50:43.297824+0000","last_peered":"2024-05-09T09:50:43.297824+0000","last_clean":"2024-05-09T09:50:43.297824+0000","last_became_active":"2024-05-09T09:47:22.257986+0000","last_became_peered":"2024-05-09T09:47:22.257986+0000","last_unstale":"2024-05-09T09:50:43.297824+0000","last_undegraded":"2024-05-09T09:50:43.297824+0000","last_fullsized":"2024-05-09T09:50:43.297824+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'6","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:09.379305+0000","last_change":"2024-05-09T09:51:09.379305+0000","last_active":"2024-05-09T09:51:09.379305+0000","last_peered":"2024-05-09T09:51:09.379305+0000","last_clean":"2024-05-09T09:51:09.379305+0000","last_became_active":"2024-05-09T09:47:14.171963+0000","last_became_peered":"2024-05-09T09:47:14.171963+0000","last_unstale":"2024-05-09T09:51:09.379305+0000","last_undegraded":"2024-05-09T09:51:09.379305+0000","last_fullsized":"2024-05-09T09:51:09.379305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:09.379053+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:09.379053+0000","last_clean_scrub_stamp":"2024-05-09T09:51:09.379053+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:57:44.240122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.649133+0000","last_change":"2024-05-09T09:47:12.211112+0000","last_active":"2024-05-09T09:50:44.649133+0000","last_peered":"2024-05-09T09:50:44.649133+0000","last_clean":"2024-05-09T09:50:44.649133+0000","last_became_active":"2024-05-09T09:47:12.204519+0000","last_became_peered":"2024-05-09T09:47:12.204519+0000","last_unstale":"2024-05-09T09:50:44.649133+0000","last_undegraded":"2024-05-09T09:50:44.649133+0000","last_fullsized":"2024-05-09T09:50:44.649133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":428,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:55.290515+0000","last_change":"2024-05-09T09:50:55.290590+0000","last_active":"2024-05-09T09:50:55.290515+0000","last_peered":"2024-05-09T09:50:55.290515+0000","last_clean":"2024-05-09T09:50:55.290515+0000","last_became_active":"2024-05-09T09:47:16.210812+0000","last_became_peered":"2024-05-09T09:47:16.210812+0000","last_unstale":"2024-05-09T09:50:55.290515+0000","last_undegraded":"2024-05-09T09:50:55.290515+0000","last_fullsized":"2024-05-09T09:50:55.290515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-09T09:50:55.290303+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-09T09:50:55.290303+0000","last_clean_scrub_stamp":"2024-05-09T09:50:55.290303+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:23:31.095926+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:46.428538+0000","last_change":"2024-05-09T09:50:46.428614+0000","last_active":"2024-05-09T09:50:46.428538+0000","last_peered":"2024-05-09T09:50:46.428538+0000","last_clean":"2024-05-09T09:50:46.428538+0000","last_became_active":"2024-05-09T09:47:18.224565+0000","last_became_peered":"2024-05-09T09:47:18.224565+0000","last_unstale":"2024-05-09T09:50:46.428538+0000","last_undegraded":"2024-05-09T09:50:46.428538+0000","last_fullsized":"2024-05-09T09:50:46.428538+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-09T09:50:46.428349+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-09T09:50:46.428349+0000","last_clean_scrub_stamp":"2024-05-09T09:50:46.428349+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:10:30.696710+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":482,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.298607+0000","last_change":"2024-05-09T09:50:44.298675+0000","last_active":"2024-05-09T09:50:44.298607+0000","last_peered":"2024-05-09T09:50:44.298607+0000","last_clean":"2024-05-09T09:50:44.298607+0000","last_became_active":"2024-05-09T09:47:20.214337+0000","last_became_peered":"2024-05-09T09:47:20.214337+0000","last_unstale":"2024-05-09T09:50:44.298607+0000","last_undegraded":"2024-05-09T09:50:44.298607+0000","last_fullsized":"2024-05-09T09:50:44.298607+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:44.298414+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:44.298414+0000","last_clean_scrub_stamp":"2024-05-09T09:50:44.298414+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:00:15.815268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:06.322785+0000","last_change":"2024-05-09T09:51:06.322785+0000","last_active":"2024-05-09T09:51:06.322785+0000","last_peered":"2024-05-09T09:51:06.322785+0000","last_clean":"2024-05-09T09:51:06.322785+0000","last_became_active":"2024-05-09T09:47:22.233796+0000","last_became_peered":"2024-05-09T09:47:22.233796+0000","last_unstale":"2024-05-09T09:51:06.322785+0000","last_undegraded":"2024-05-09T09:51:06.322785+0000","last_fullsized":"2024-05-09T09:51:06.322785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:06.322504+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:06.322504+0000","last_clean_scrub_stamp":"2024-05-09T09:51:06.322504+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:27:55.927227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:22.289973+0000","last_change":"2024-05-09T09:51:22.290052+0000","last_active":"2024-05-09T09:51:22.289973+0000","last_peered":"2024-05-09T09:51:22.289973+0000","last_clean":"2024-05-09T09:51:22.289973+0000","last_became_active":"2024-05-09T09:47:14.174707+0000","last_became_peered":"2024-05-09T09:47:14.174707+0000","last_unstale":"2024-05-09T09:51:22.289973+0000","last_undegraded":"2024-05-09T09:51:22.289973+0000","last_fullsized":"2024-05-09T09:51:22.289973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:22.289757+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:22.289757+0000","last_clean_scrub_stamp":"2024-05-09T09:51:22.289757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:39:44.166060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.649394+0000","last_change":"2024-05-09T09:47:12.208521+0000","last_active":"2024-05-09T09:50:44.649394+0000","last_peered":"2024-05-09T09:50:44.649394+0000","last_clean":"2024-05-09T09:50:44.649394+0000","last_became_active":"2024-05-09T09:47:12.207874+0000","last_became_peered":"2024-05-09T09:47:12.207874+0000","last_unstale":"2024-05-09T09:50:44.649394+0000","last_undegraded":"2024-05-09T09:50:44.649394+0000","last_fullsized":"2024-05-09T09:50:44.649394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"32'2","reported_seq":230,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:48.457895+0000","last_change":"2024-05-09T09:50:48.457964+0000","last_active":"2024-05-09T09:50:48.457895+0000","last_peered":"2024-05-09T09:50:48.457895+0000","last_clean":"2024-05-09T09:50:48.457895+0000","last_became_active":"2024-05-09T09:47:16.204577+0000","last_became_peered":"2024-05-09T09:47:16.204577+0000","last_unstale":"2024-05-09T09:50:48.457895+0000","last_undegraded":"2024-05-09T09:50:48.457895+0000","last_fullsized":"2024-05-09T09:50:48.457895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:50:48.457704+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:50:48.457704+0000","last_clean_scrub_stamp":"2024-05-09T09:50:48.457704+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:20:14.267139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'122","reported_seq":181,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:50.360778+0000","last_change":"2024-05-09T09:50:50.360866+0000","last_active":"2024-05-09T09:50:50.360778+0000","last_peered":"2024-05-09T09:50:50.360778+0000","last_clean":"2024-05-09T09:50:50.360778+0000","last_became_active":"2024-05-09T09:47:18.204057+0000","last_became_peered":"2024-05-09T09:47:18.204057+0000","last_unstale":"2024-05-09T09:50:50.360778+0000","last_undegraded":"2024-05-09T09:50:50.360778+0000","last_fullsized":"2024-05-09T09:50:50.360778+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'122","last_scrub_stamp":"2024-05-09T09:50:50.360552+0000","last_deep_scrub":"32'122","last_deep_scrub_stamp":"2024-05-09T09:50:50.360552+0000","last_clean_scrub_stamp":"2024-05-09T09:50:50.360552+0000","objects_scrubbed":8,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:58:29.414570+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:50.194469+0000","last_change":"2024-05-09T09:50:50.194527+0000","last_active":"2024-05-09T09:50:50.194469+0000","last_peered":"2024-05-09T09:50:50.194469+0000","last_clean":"2024-05-09T09:50:50.194469+0000","last_became_active":"2024-05-09T09:47:20.255477+0000","last_became_peered":"2024-05-09T09:47:20.255477+0000","last_unstale":"2024-05-09T09:50:50.194469+0000","last_undegraded":"2024-05-09T09:50:50.194469+0000","last_fullsized":"2024-05-09T09:50:50.194469+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:50.194227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:50.194227+0000","last_clean_scrub_stamp":"2024-05-09T09:50:50.194227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:40:06.186113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'9","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:08.256156+0000","last_change":"2024-05-09T09:51:08.256156+0000","last_active":"2024-05-09T09:51:08.256156+0000","last_peered":"2024-05-09T09:51:08.256156+0000","last_clean":"2024-05-09T09:51:08.256156+0000","last_became_active":"2024-05-09T09:47:22.227373+0000","last_became_peered":"2024-05-09T09:47:22.227373+0000","last_unstale":"2024-05-09T09:51:08.256156+0000","last_undegraded":"2024-05-09T09:51:08.256156+0000","last_fullsized":"2024-05-09T09:51:08.256156+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-09T09:51:08.255859+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-09T09:51:08.255859+0000","last_clean_scrub_stamp":"2024-05-09T09:51:08.255859+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:01:16.321404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:18.453848+0000","last_change":"2024-05-09T09:51:18.453848+0000","last_active":"2024-05-09T09:51:18.453848+0000","last_peered":"2024-05-09T09:51:18.453848+0000","last_clean":"2024-05-09T09:51:18.453848+0000","last_became_active":"2024-05-09T09:47:14.189623+0000","last_became_peered":"2024-05-09T09:47:14.189623+0000","last_unstale":"2024-05-09T09:51:18.453848+0000","last_undegraded":"2024-05-09T09:51:18.453848+0000","last_fullsized":"2024-05-09T09:51:18.453848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:18.453472+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:18.453472+0000","last_clean_scrub_stamp":"2024-05-09T09:51:18.453472+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:21:19.357961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":214,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:30.280676+0000","last_change":"2024-05-09T09:51:30.280748+0000","last_active":"2024-05-09T09:51:30.280676+0000","last_peered":"2024-05-09T09:51:30.280676+0000","last_clean":"2024-05-09T09:51:30.280676+0000","last_became_active":"2024-05-09T09:46:57.508178+0000","last_became_peered":"2024-05-09T09:46:57.508178+0000","last_unstale":"2024-05-09T09:51:30.280676+0000","last_undegraded":"2024-05-09T09:51:30.280676+0000","last_fullsized":"2024-05-09T09:51:30.280676+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-05-09T09:51:30.280470+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-05-09T09:51:30.280470+0000","last_clean_scrub_stamp":"2024-05-09T09:51:30.280470+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:25.211383+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.649357+0000","last_change":"2024-05-09T09:47:03.054623+0000","last_active":"2024-05-09T09:50:44.649357+0000","last_peered":"2024-05-09T09:50:44.649357+0000","last_clean":"2024-05-09T09:50:44.649357+0000","last_became_active":"2024-05-09T09:47:03.053783+0000","last_became_peered":"2024-05-09T09:47:03.053783+0000","last_unstale":"2024-05-09T09:50:44.649357+0000","last_undegraded":"2024-05-09T09:50:44.649357+0000","last_fullsized":"2024-05-09T09:50:44.649357+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:36.494378+0000","last_change":"2024-05-09T09:51:36.494436+0000","last_active":"2024-05-09T09:51:36.494378+0000","last_peered":"2024-05-09T09:51:36.494378+0000","last_clean":"2024-05-09T09:51:36.494378+0000","last_became_active":"2024-05-09T09:47:12.211344+0000","last_became_peered":"2024-05-09T09:47:12.211344+0000","last_unstale":"2024-05-09T09:51:36.494378+0000","last_undegraded":"2024-05-09T09:51:36.494378+0000","last_fullsized":"2024-05-09T09:51:36.494378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:36.494172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:36.494172+0000","last_clean_scrub_stamp":"2024-05-09T09:51:36.494172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:44:27.630619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:57.277911+0000","last_change":"2024-05-09T09:50:57.277911+0000","last_active":"2024-05-09T09:50:57.277911+0000","last_peered":"2024-05-09T09:50:57.277911+0000","last_clean":"2024-05-09T09:50:57.277911+0000","last_became_active":"2024-05-09T09:47:16.210404+0000","last_became_peered":"2024-05-09T09:47:16.210404+0000","last_unstale":"2024-05-09T09:50:57.277911+0000","last_undegraded":"2024-05-09T09:50:57.277911+0000","last_fullsized":"2024-05-09T09:50:57.277911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:57.277661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:57.277661+0000","last_clean_scrub_stamp":"2024-05-09T09:50:57.277661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:35:39.302436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'312","reported_seq":403,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:12.453446+0000","last_change":"2024-05-09T09:51:12.453446+0000","last_active":"2024-05-09T09:51:12.453446+0000","last_peered":"2024-05-09T09:51:12.453446+0000","last_clean":"2024-05-09T09:51:12.453446+0000","last_became_active":"2024-05-09T09:47:18.236370+0000","last_became_peered":"2024-05-09T09:47:18.236370+0000","last_unstale":"2024-05-09T09:51:12.453446+0000","last_undegraded":"2024-05-09T09:51:12.453446+0000","last_fullsized":"2024-05-09T09:51:12.453446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'312","last_scrub_stamp":"2024-05-09T09:51:12.453173+0000","last_deep_scrub":"32'312","last_deep_scrub_stamp":"2024-05-09T09:51:12.453173+0000","last_clean_scrub_stamp":"2024-05-09T09:51:12.453173+0000","objects_scrubbed":5,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:10:56.767720+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:53.880361+0000","last_change":"2024-05-09T09:50:53.880361+0000","last_active":"2024-05-09T09:50:53.880361+0000","last_peered":"2024-05-09T09:50:53.880361+0000","last_clean":"2024-05-09T09:50:53.880361+0000","last_became_active":"2024-05-09T09:47:20.250373+0000","last_became_peered":"2024-05-09T09:47:20.250373+0000","last_unstale":"2024-05-09T09:50:53.880361+0000","last_undegraded":"2024-05-09T09:50:53.880361+0000","last_fullsized":"2024-05-09T09:50:53.880361+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:53.880117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:53.880117+0000","last_clean_scrub_stamp":"2024-05-09T09:50:53.880117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:35:35.904892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'86","reported_seq":179,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:33.196489+0000","last_change":"2024-05-09T09:51:33.196489+0000","last_active":"2024-05-09T09:51:33.196489+0000","last_peered":"2024-05-09T09:51:33.196489+0000","last_clean":"2024-05-09T09:51:33.196489+0000","last_became_active":"2024-05-09T09:47:22.236267+0000","last_became_peered":"2024-05-09T09:47:22.236267+0000","last_unstale":"2024-05-09T09:51:33.196489+0000","last_undegraded":"2024-05-09T09:51:33.196489+0000","last_fullsized":"2024-05-09T09:51:33.196489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'86","last_scrub_stamp":"2024-05-09T09:51:33.196224+0000","last_deep_scrub":"32'86","last_deep_scrub_stamp":"2024-05-09T09:51:33.196224+0000","last_clean_scrub_stamp":"2024-05-09T09:51:33.196224+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:08:18.929286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":223,"num_write":170,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:28.500354+0000","last_change":"2024-05-09T09:51:28.500354+0000","last_active":"2024-05-09T09:51:28.500354+0000","last_peered":"2024-05-09T09:51:28.500354+0000","last_clean":"2024-05-09T09:51:28.500354+0000","last_became_active":"2024-05-09T09:47:14.185071+0000","last_became_peered":"2024-05-09T09:47:14.185071+0000","last_unstale":"2024-05-09T09:51:28.500354+0000","last_undegraded":"2024-05-09T09:51:28.500354+0000","last_fullsized":"2024-05-09T09:51:28.500354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:28.500075+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:28.500075+0000","last_clean_scrub_stamp":"2024-05-09T09:51:28.500075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:15:02.394128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.649033+0000","last_change":"2024-05-09T09:47:03.051628+0000","last_active":"2024-05-09T09:50:44.649033+0000","last_peered":"2024-05-09T09:50:44.649033+0000","last_clean":"2024-05-09T09:50:44.649033+0000","last_became_active":"2024-05-09T09:47:03.050535+0000","last_became_peered":"2024-05-09T09:47:03.050535+0000","last_unstale":"2024-05-09T09:50:44.649033+0000","last_undegraded":"2024-05-09T09:50:44.649033+0000","last_fullsized":"2024-05-09T09:50:44.649033+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"32'2","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:25.300854+0000","last_change":"2024-05-09T09:51:25.300917+0000","last_active":"2024-05-09T09:51:25.300854+0000","last_peered":"2024-05-09T09:51:25.300854+0000","last_clean":"2024-05-09T09:51:25.300854+0000","last_became_active":"2024-05-09T09:47:12.203494+0000","last_became_peered":"2024-05-09T09:47:12.203494+0000","last_unstale":"2024-05-09T09:51:25.300854+0000","last_undegraded":"2024-05-09T09:51:25.300854+0000","last_fullsized":"2024-05-09T09:51:25.300854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:25.300654+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:25.300654+0000","last_clean_scrub_stamp":"2024-05-09T09:51:25.300654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:34.501747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:50.508773+0000","last_change":"2024-05-09T09:50:50.508773+0000","last_active":"2024-05-09T09:50:50.508773+0000","last_peered":"2024-05-09T09:50:50.508773+0000","last_clean":"2024-05-09T09:50:50.508773+0000","last_became_active":"2024-05-09T09:47:16.200369+0000","last_became_peered":"2024-05-09T09:47:16.200369+0000","last_unstale":"2024-05-09T09:50:50.508773+0000","last_undegraded":"2024-05-09T09:50:50.508773+0000","last_fullsized":"2024-05-09T09:50:50.508773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:50.508517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:50.508517+0000","last_clean_scrub_stamp":"2024-05-09T09:50:50.508517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:03:35.673628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'512","reported_seq":740,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:45.298265+0000","last_change":"2024-05-09T09:50:45.298265+0000","last_active":"2024-05-09T09:50:45.298265+0000","last_peered":"2024-05-09T09:50:45.298265+0000","last_clean":"2024-05-09T09:50:45.298265+0000","last_became_active":"2024-05-09T09:47:18.219321+0000","last_became_peered":"2024-05-09T09:47:18.219321+0000","last_unstale":"2024-05-09T09:50:45.298265+0000","last_undegraded":"2024-05-09T09:50:45.298265+0000","last_fullsized":"2024-05-09T09:50:45.298265+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'512","last_scrub_stamp":"2024-05-09T09:50:45.297859+0000","last_deep_scrub":"32'512","last_deep_scrub_stamp":"2024-05-09T09:50:45.297859+0000","last_clean_scrub_stamp":"2024-05-09T09:50:45.297859+0000","objects_scrubbed":10,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:39:29.985192+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:09.466226+0000","last_change":"2024-05-09T09:51:09.466226+0000","last_active":"2024-05-09T09:51:09.466226+0000","last_peered":"2024-05-09T09:51:09.466226+0000","last_clean":"2024-05-09T09:51:09.466226+0000","last_became_active":"2024-05-09T09:47:20.249089+0000","last_became_peered":"2024-05-09T09:47:20.249089+0000","last_unstale":"2024-05-09T09:51:09.466226+0000","last_undegraded":"2024-05-09T09:51:09.466226+0000","last_fullsized":"2024-05-09T09:51:09.466226+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:09.465983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:09.465983+0000","last_clean_scrub_stamp":"2024-05-09T09:51:09.465983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:24:45.606721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:39.199261+0000","last_change":"2024-05-09T09:51:39.199321+0000","last_active":"2024-05-09T09:51:39.199261+0000","last_peered":"2024-05-09T09:51:39.199261+0000","last_clean":"2024-05-09T09:51:39.199261+0000","last_became_active":"2024-05-09T09:47:22.244543+0000","last_became_peered":"2024-05-09T09:47:22.244543+0000","last_unstale":"2024-05-09T09:51:39.199261+0000","last_undegraded":"2024-05-09T09:51:39.199261+0000","last_fullsized":"2024-05-09T09:51:39.199261+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-09T09:51:39.199047+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-09T09:51:39.199047+0000","last_clean_scrub_stamp":"2024-05-09T09:51:39.199047+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:02:01.713821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:24.273042+0000","last_change":"2024-05-09T09:51:24.273042+0000","last_active":"2024-05-09T09:51:24.273042+0000","last_peered":"2024-05-09T09:51:24.273042+0000","last_clean":"2024-05-09T09:51:24.273042+0000","last_became_active":"2024-05-09T09:47:14.173959+0000","last_became_peered":"2024-05-09T09:47:14.173959+0000","last_unstale":"2024-05-09T09:51:24.273042+0000","last_undegraded":"2024-05-09T09:51:24.273042+0000","last_fullsized":"2024-05-09T09:51:24.273042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:24.272797+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:24.272797+0000","last_clean_scrub_stamp":"2024-05-09T09:51:24.272797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:25:00.413535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:24.266143+0000","last_change":"2024-05-09T09:51:24.266195+0000","last_active":"2024-05-09T09:51:24.266143+0000","last_peered":"2024-05-09T09:51:24.266143+0000","last_clean":"2024-05-09T09:51:24.266143+0000","last_became_active":"2024-05-09T09:47:03.052185+0000","last_became_peered":"2024-05-09T09:47:03.052185+0000","last_unstale":"2024-05-09T09:51:24.266143+0000","last_undegraded":"2024-05-09T09:51:24.266143+0000","last_fullsized":"2024-05-09T09:51:24.266143+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:24.265972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:24.265972+0000","last_clean_scrub_stamp":"2024-05-09T09:51:24.265972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:24.371116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:38.333595+0000","last_change":"2024-05-09T09:51:38.333664+0000","last_active":"2024-05-09T09:51:38.333595+0000","last_peered":"2024-05-09T09:51:38.333595+0000","last_clean":"2024-05-09T09:51:38.333595+0000","last_became_active":"2024-05-09T09:47:12.183846+0000","last_became_peered":"2024-05-09T09:47:12.183846+0000","last_unstale":"2024-05-09T09:51:38.333595+0000","last_undegraded":"2024-05-09T09:51:38.333595+0000","last_fullsized":"2024-05-09T09:51:38.333595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:38.333371+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:38.333371+0000","last_clean_scrub_stamp":"2024-05-09T09:51:38.333371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:06:28.044996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:00.281973+0000","last_change":"2024-05-09T09:51:00.281973+0000","last_active":"2024-05-09T09:51:00.281973+0000","last_peered":"2024-05-09T09:51:00.281973+0000","last_clean":"2024-05-09T09:51:00.281973+0000","last_became_active":"2024-05-09T09:47:16.197380+0000","last_became_peered":"2024-05-09T09:47:16.197380+0000","last_unstale":"2024-05-09T09:51:00.281973+0000","last_undegraded":"2024-05-09T09:51:00.281973+0000","last_fullsized":"2024-05-09T09:51:00.281973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:00.281822+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:00.281822+0000","last_clean_scrub_stamp":"2024-05-09T09:51:00.281822+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:17:45.780390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'25","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:53.286054+0000","last_change":"2024-05-09T09:50:53.286054+0000","last_active":"2024-05-09T09:50:53.286054+0000","last_peered":"2024-05-09T09:50:53.286054+0000","last_clean":"2024-05-09T09:50:53.286054+0000","last_became_active":"2024-05-09T09:47:18.217023+0000","last_became_peered":"2024-05-09T09:47:18.217023+0000","last_unstale":"2024-05-09T09:50:53.286054+0000","last_undegraded":"2024-05-09T09:50:53.286054+0000","last_fullsized":"2024-05-09T09:50:53.286054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2024-05-09T09:50:53.285640+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2024-05-09T09:50:53.285640+0000","last_clean_scrub_stamp":"2024-05-09T09:50:53.285640+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:56:02.284410+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:57.982184+0000","last_change":"2024-05-09T09:50:57.982184+0000","last_active":"2024-05-09T09:50:57.982184+0000","last_peered":"2024-05-09T09:50:57.982184+0000","last_clean":"2024-05-09T09:50:57.982184+0000","last_became_active":"2024-05-09T09:47:20.250979+0000","last_became_peered":"2024-05-09T09:47:20.250979+0000","last_unstale":"2024-05-09T09:50:57.982184+0000","last_undegraded":"2024-05-09T09:50:57.982184+0000","last_fullsized":"2024-05-09T09:50:57.982184+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:57.981939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:57.981939+0000","last_clean_scrub_stamp":"2024-05-09T09:50:57.981939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:20:07.343476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.177467+0000","last_change":"2024-05-09T09:47:22.264183+0000","last_active":"2024-05-09T09:49:40.177467+0000","last_peered":"2024-05-09T09:49:40.177467+0000","last_clean":"2024-05-09T09:49:40.177467+0000","last_became_active":"2024-05-09T09:47:22.263615+0000","last_became_peered":"2024-05-09T09:47:22.263615+0000","last_unstale":"2024-05-09T09:49:40.177467+0000","last_undegraded":"2024-05-09T09:49:40.177467+0000","last_fullsized":"2024-05-09T09:49:40.177467+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'4","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:13.101070+0000","last_change":"2024-05-09T09:51:13.101070+0000","last_active":"2024-05-09T09:51:13.101070+0000","last_peered":"2024-05-09T09:51:13.101070+0000","last_clean":"2024-05-09T09:51:13.101070+0000","last_became_active":"2024-05-09T09:47:14.188644+0000","last_became_peered":"2024-05-09T09:47:14.188644+0000","last_unstale":"2024-05-09T09:51:13.101070+0000","last_undegraded":"2024-05-09T09:51:13.101070+0000","last_fullsized":"2024-05-09T09:51:13.101070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:13.100709+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:13.100709+0000","last_clean_scrub_stamp":"2024-05-09T09:51:13.100709+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:32:54.848587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.649028+0000","last_change":"2024-05-09T09:47:03.051760+0000","last_active":"2024-05-09T09:50:44.649028+0000","last_peered":"2024-05-09T09:50:44.649028+0000","last_clean":"2024-05-09T09:50:44.649028+0000","last_became_active":"2024-05-09T09:47:03.050832+0000","last_became_peered":"2024-05-09T09:47:03.050832+0000","last_unstale":"2024-05-09T09:50:44.649028+0000","last_undegraded":"2024-05-09T09:50:44.649028+0000","last_fullsized":"2024-05-09T09:50:44.649028+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:25.242601+0000","last_change":"2024-05-09T09:51:25.242656+0000","last_active":"2024-05-09T09:51:25.242601+0000","last_peered":"2024-05-09T09:51:25.242601+0000","last_clean":"2024-05-09T09:51:25.242601+0000","last_became_active":"2024-05-09T09:47:12.190521+0000","last_became_peered":"2024-05-09T09:47:12.190521+0000","last_unstale":"2024-05-09T09:51:25.242601+0000","last_undegraded":"2024-05-09T09:51:25.242601+0000","last_fullsized":"2024-05-09T09:51:25.242601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:25.242400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:25.242400+0000","last_clean_scrub_stamp":"2024-05-09T09:51:25.242400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:34:22.065847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:08.084806+0000","last_change":"2024-05-09T09:51:08.084806+0000","last_active":"2024-05-09T09:51:08.084806+0000","last_peered":"2024-05-09T09:51:08.084806+0000","last_clean":"2024-05-09T09:51:08.084806+0000","last_became_active":"2024-05-09T09:47:16.187120+0000","last_became_peered":"2024-05-09T09:47:16.187120+0000","last_unstale":"2024-05-09T09:51:08.084806+0000","last_undegraded":"2024-05-09T09:51:08.084806+0000","last_fullsized":"2024-05-09T09:51:08.084806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:08.084559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:08.084559+0000","last_clean_scrub_stamp":"2024-05-09T09:51:08.084559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:22.872238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'21","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:49.497580+0000","last_change":"2024-05-09T09:50:49.497580+0000","last_active":"2024-05-09T09:50:49.497580+0000","last_peered":"2024-05-09T09:50:49.497580+0000","last_clean":"2024-05-09T09:50:49.497580+0000","last_became_active":"2024-05-09T09:47:18.230757+0000","last_became_peered":"2024-05-09T09:47:18.230757+0000","last_unstale":"2024-05-09T09:50:49.497580+0000","last_undegraded":"2024-05-09T09:50:49.497580+0000","last_fullsized":"2024-05-09T09:50:49.497580+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-05-09T09:50:49.497309+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-05-09T09:50:49.497309+0000","last_clean_scrub_stamp":"2024-05-09T09:50:49.497309+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:00:57.562854+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:08.424955+0000","last_change":"2024-05-09T09:51:08.424955+0000","last_active":"2024-05-09T09:51:08.424955+0000","last_peered":"2024-05-09T09:51:08.424955+0000","last_clean":"2024-05-09T09:51:08.424955+0000","last_became_active":"2024-05-09T09:47:20.249919+0000","last_became_peered":"2024-05-09T09:47:20.249919+0000","last_unstale":"2024-05-09T09:51:08.424955+0000","last_undegraded":"2024-05-09T09:51:08.424955+0000","last_fullsized":"2024-05-09T09:51:08.424955+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:08.424700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:08.424700+0000","last_clean_scrub_stamp":"2024-05-09T09:51:08.424700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:41:47.741972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.176243+0000","last_change":"2024-05-09T09:47:22.260930+0000","last_active":"2024-05-09T09:49:35.176243+0000","last_peered":"2024-05-09T09:49:35.176243+0000","last_clean":"2024-05-09T09:49:35.176243+0000","last_became_active":"2024-05-09T09:47:22.259833+0000","last_became_peered":"2024-05-09T09:47:22.259833+0000","last_unstale":"2024-05-09T09:49:35.176243+0000","last_undegraded":"2024-05-09T09:49:35.176243+0000","last_fullsized":"2024-05-09T09:49:35.176243+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:16.280449+0000","last_change":"2024-05-09T09:51:16.280449+0000","last_active":"2024-05-09T09:51:16.280449+0000","last_peered":"2024-05-09T09:51:16.280449+0000","last_clean":"2024-05-09T09:51:16.280449+0000","last_became_active":"2024-05-09T09:47:14.173535+0000","last_became_peered":"2024-05-09T09:47:14.173535+0000","last_unstale":"2024-05-09T09:51:16.280449+0000","last_undegraded":"2024-05-09T09:51:16.280449+0000","last_fullsized":"2024-05-09T09:51:16.280449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:16.280201+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:16.280201+0000","last_clean_scrub_stamp":"2024-05-09T09:51:16.280201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:02:57.723193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:29.238181+0000","last_change":"2024-05-09T09:51:29.238251+0000","last_active":"2024-05-09T09:51:29.238181+0000","last_peered":"2024-05-09T09:51:29.238181+0000","last_clean":"2024-05-09T09:51:29.238181+0000","last_became_active":"2024-05-09T09:47:12.194500+0000","last_became_peered":"2024-05-09T09:47:12.194500+0000","last_unstale":"2024-05-09T09:51:29.238181+0000","last_undegraded":"2024-05-09T09:51:29.238181+0000","last_fullsized":"2024-05-09T09:51:29.238181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:29.237957+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:29.237957+0000","last_clean_scrub_stamp":"2024-05-09T09:51:29.237957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:45:39.761788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:32.222894+0000","last_change":"2024-05-09T09:51:32.222951+0000","last_active":"2024-05-09T09:51:32.222894+0000","last_peered":"2024-05-09T09:51:32.222894+0000","last_clean":"2024-05-09T09:51:32.222894+0000","last_became_active":"2024-05-09T09:47:03.051159+0000","last_became_peered":"2024-05-09T09:47:03.051159+0000","last_unstale":"2024-05-09T09:51:32.222894+0000","last_undegraded":"2024-05-09T09:51:32.222894+0000","last_fullsized":"2024-05-09T09:51:32.222894+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:32.222688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:32.222688+0000","last_clean_scrub_stamp":"2024-05-09T09:51:32.222688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:24:46.533046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'7","reported_seq":242,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:05.017370+0000","last_change":"2024-05-09T09:51:05.017370+0000","last_active":"2024-05-09T09:51:05.017370+0000","last_peered":"2024-05-09T09:51:05.017370+0000","last_clean":"2024-05-09T09:51:05.017370+0000","last_became_active":"2024-05-09T09:47:16.198233+0000","last_became_peered":"2024-05-09T09:47:16.198233+0000","last_unstale":"2024-05-09T09:51:05.017370+0000","last_undegraded":"2024-05-09T09:51:05.017370+0000","last_fullsized":"2024-05-09T09:51:05.017370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-05-09T09:51:05.017095+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-05-09T09:51:05.017095+0000","last_clean_scrub_stamp":"2024-05-09T09:51:05.017095+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:53:06.632153+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1180,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":302,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'221","reported_seq":298,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:56.950939+0000","last_change":"2024-05-09T09:50:56.950939+0000","last_active":"2024-05-09T09:50:56.950939+0000","last_peered":"2024-05-09T09:50:56.950939+0000","last_clean":"2024-05-09T09:50:56.950939+0000","last_became_active":"2024-05-09T09:47:18.199411+0000","last_became_peered":"2024-05-09T09:47:18.199411+0000","last_unstale":"2024-05-09T09:50:56.950939+0000","last_undegraded":"2024-05-09T09:50:56.950939+0000","last_fullsized":"2024-05-09T09:50:56.950939+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'221","last_scrub_stamp":"2024-05-09T09:50:56.950671+0000","last_deep_scrub":"32'221","last_deep_scrub_stamp":"2024-05-09T09:50:56.950671+0000","last_clean_scrub_stamp":"2024-05-09T09:50:56.950671+0000","objects_scrubbed":9,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:44:33.387528+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:48.114403+0000","last_change":"2024-05-09T09:50:48.114403+0000","last_active":"2024-05-09T09:50:48.114403+0000","last_peered":"2024-05-09T09:50:48.114403+0000","last_clean":"2024-05-09T09:50:48.114403+0000","last_became_active":"2024-05-09T09:47:20.233024+0000","last_became_peered":"2024-05-09T09:47:20.233024+0000","last_unstale":"2024-05-09T09:50:48.114403+0000","last_undegraded":"2024-05-09T09:50:48.114403+0000","last_fullsized":"2024-05-09T09:50:48.114403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:48.114039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:48.114039+0000","last_clean_scrub_stamp":"2024-05-09T09:50:48.114039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:03.759841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'11","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:14.131405+0000","last_change":"2024-05-09T09:51:14.131467+0000","last_active":"2024-05-09T09:51:14.131405+0000","last_peered":"2024-05-09T09:51:14.131405+0000","last_clean":"2024-05-09T09:51:14.131405+0000","last_became_active":"2024-05-09T09:47:22.228855+0000","last_became_peered":"2024-05-09T09:47:22.228855+0000","last_unstale":"2024-05-09T09:51:14.131405+0000","last_undegraded":"2024-05-09T09:51:14.131405+0000","last_fullsized":"2024-05-09T09:51:14.131405+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-05-09T09:51:14.131207+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-05-09T09:51:14.131207+0000","last_clean_scrub_stamp":"2024-05-09T09:51:14.131207+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:46:57.527442+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'12","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:43.754378+0000","last_change":"2024-05-09T09:47:52.440285+0000","last_active":"2024-05-09T09:50:43.754378+0000","last_peered":"2024-05-09T09:50:43.754378+0000","last_clean":"2024-05-09T09:50:43.754378+0000","last_became_active":"2024-05-09T09:47:52.430912+0000","last_became_peered":"2024-05-09T09:47:52.430912+0000","last_unstale":"2024-05-09T09:50:43.754378+0000","last_undegraded":"2024-05-09T09:50:43.754378+0000","last_fullsized":"2024-05-09T09:50:43.754378+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:13.146551+0000","last_clean_scrub_stamp":"2024-05-09T09:47:13.146551+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:39.340829+0000","last_change":"2024-05-09T09:51:39.340891+0000","last_active":"2024-05-09T09:51:39.340829+0000","last_peered":"2024-05-09T09:51:39.340829+0000","last_clean":"2024-05-09T09:51:39.340829+0000","last_became_active":"2024-05-09T09:47:12.189486+0000","last_became_peered":"2024-05-09T09:47:12.189486+0000","last_unstale":"2024-05-09T09:51:39.340829+0000","last_undegraded":"2024-05-09T09:51:39.340829+0000","last_fullsized":"2024-05-09T09:51:39.340829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:39.340616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:39.340616+0000","last_clean_scrub_stamp":"2024-05-09T09:51:39.340616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:54:04.794316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.649061+0000","last_change":"2024-05-09T09:47:03.051225+0000","last_active":"2024-05-09T09:50:44.649061+0000","last_peered":"2024-05-09T09:50:44.649061+0000","last_clean":"2024-05-09T09:50:44.649061+0000","last_became_active":"2024-05-09T09:47:03.050600+0000","last_became_peered":"2024-05-09T09:47:03.050600+0000","last_unstale":"2024-05-09T09:50:44.649061+0000","last_undegraded":"2024-05-09T09:50:44.649061+0000","last_fullsized":"2024-05-09T09:50:44.649061+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:54.486490+0000","last_change":"2024-05-09T09:50:54.486490+0000","last_active":"2024-05-09T09:50:54.486490+0000","last_peered":"2024-05-09T09:50:54.486490+0000","last_clean":"2024-05-09T09:50:54.486490+0000","last_became_active":"2024-05-09T09:47:16.182232+0000","last_became_peered":"2024-05-09T09:47:16.182232+0000","last_unstale":"2024-05-09T09:50:54.486490+0000","last_undegraded":"2024-05-09T09:50:54.486490+0000","last_fullsized":"2024-05-09T09:50:54.486490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:54.486244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:54.486244+0000","last_clean_scrub_stamp":"2024-05-09T09:50:54.486244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:04:41.948173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'21","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:49.380947+0000","last_change":"2024-05-09T09:50:49.380947+0000","last_active":"2024-05-09T09:50:49.380947+0000","last_peered":"2024-05-09T09:50:49.380947+0000","last_clean":"2024-05-09T09:50:49.380947+0000","last_became_active":"2024-05-09T09:47:18.211020+0000","last_became_peered":"2024-05-09T09:47:18.211020+0000","last_unstale":"2024-05-09T09:50:49.380947+0000","last_undegraded":"2024-05-09T09:50:49.380947+0000","last_fullsized":"2024-05-09T09:50:49.380947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-05-09T09:50:49.380517+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-05-09T09:50:49.380517+0000","last_clean_scrub_stamp":"2024-05-09T09:50:49.380517+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:01.985708+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":384,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:52.295501+0000","last_change":"2024-05-09T09:50:52.295501+0000","last_active":"2024-05-09T09:50:52.295501+0000","last_peered":"2024-05-09T09:50:52.295501+0000","last_clean":"2024-05-09T09:50:52.295501+0000","last_became_active":"2024-05-09T09:47:20.226481+0000","last_became_peered":"2024-05-09T09:47:20.226481+0000","last_unstale":"2024-05-09T09:50:52.295501+0000","last_undegraded":"2024-05-09T09:50:52.295501+0000","last_fullsized":"2024-05-09T09:50:52.295501+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:52.295146+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:52.295146+0000","last_clean_scrub_stamp":"2024-05-09T09:50:52.295146+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:27.487386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:35.467852+0000","last_change":"2024-05-09T09:51:35.467911+0000","last_active":"2024-05-09T09:51:35.467852+0000","last_peered":"2024-05-09T09:51:35.467852+0000","last_clean":"2024-05-09T09:51:35.467852+0000","last_became_active":"2024-05-09T09:47:22.256285+0000","last_became_peered":"2024-05-09T09:47:22.256285+0000","last_unstale":"2024-05-09T09:51:35.467852+0000","last_undegraded":"2024-05-09T09:51:35.467852+0000","last_fullsized":"2024-05-09T09:51:35.467852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:35.467661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:35.467661+0000","last_clean_scrub_stamp":"2024-05-09T09:51:35.467661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:08:21.152606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:30.564820+0000","last_change":"2024-05-09T09:51:30.564884+0000","last_active":"2024-05-09T09:51:30.564820+0000","last_peered":"2024-05-09T09:51:30.564820+0000","last_clean":"2024-05-09T09:51:30.564820+0000","last_became_active":"2024-05-09T09:47:14.183542+0000","last_became_peered":"2024-05-09T09:47:14.183542+0000","last_unstale":"2024-05-09T09:51:30.564820+0000","last_undegraded":"2024-05-09T09:51:30.564820+0000","last_fullsized":"2024-05-09T09:51:30.564820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:30.564595+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:30.564595+0000","last_clean_scrub_stamp":"2024-05-09T09:51:30.564595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:51.778769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.649289+0000","last_change":"2024-05-09T09:47:12.200135+0000","last_active":"2024-05-09T09:50:44.649289+0000","last_peered":"2024-05-09T09:50:44.649289+0000","last_clean":"2024-05-09T09:50:44.649289+0000","last_became_active":"2024-05-09T09:47:12.199656+0000","last_became_peered":"2024-05-09T09:47:12.199656+0000","last_unstale":"2024-05-09T09:50:44.649289+0000","last_undegraded":"2024-05-09T09:50:44.649289+0000","last_fullsized":"2024-05-09T09:50:44.649289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:33.179270+0000","last_change":"2024-05-09T09:51:33.179325+0000","last_active":"2024-05-09T09:51:33.179270+0000","last_peered":"2024-05-09T09:51:33.179270+0000","last_clean":"2024-05-09T09:51:33.179270+0000","last_became_active":"2024-05-09T09:47:03.052728+0000","last_became_peered":"2024-05-09T09:47:03.052728+0000","last_unstale":"2024-05-09T09:51:33.179270+0000","last_undegraded":"2024-05-09T09:51:33.179270+0000","last_fullsized":"2024-05-09T09:51:33.179270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:33.179071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:33.179071+0000","last_clean_scrub_stamp":"2024-05-09T09:51:33.179071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:21:34.083560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.650656+0000","last_change":"2024-05-09T09:47:52.183646+0000","last_active":"2024-05-09T09:50:44.650656+0000","last_peered":"2024-05-09T09:50:44.650656+0000","last_clean":"2024-05-09T09:50:44.650656+0000","last_became_active":"2024-05-09T09:47:52.182360+0000","last_became_peered":"2024-05-09T09:47:52.182360+0000","last_unstale":"2024-05-09T09:50:44.650656+0000","last_undegraded":"2024-05-09T09:50:44.650656+0000","last_fullsized":"2024-05-09T09:50:44.650656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:16.463719+0000","last_change":"2024-05-09T09:51:16.463719+0000","last_active":"2024-05-09T09:51:16.463719+0000","last_peered":"2024-05-09T09:51:16.463719+0000","last_clean":"2024-05-09T09:51:16.463719+0000","last_became_active":"2024-05-09T09:47:18.234556+0000","last_became_peered":"2024-05-09T09:47:18.234556+0000","last_unstale":"2024-05-09T09:51:16.463719+0000","last_undegraded":"2024-05-09T09:51:16.463719+0000","last_fullsized":"2024-05-09T09:51:16.463719+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-09T09:51:16.463413+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-09T09:51:16.463413+0000","last_clean_scrub_stamp":"2024-05-09T09:51:16.463413+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:45:18.905836+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":414,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:47.848115+0000","last_change":"2024-05-09T09:50:47.848115+0000","last_active":"2024-05-09T09:50:47.848115+0000","last_peered":"2024-05-09T09:50:47.848115+0000","last_clean":"2024-05-09T09:50:47.848115+0000","last_became_active":"2024-05-09T09:47:20.226936+0000","last_became_peered":"2024-05-09T09:47:20.226936+0000","last_unstale":"2024-05-09T09:50:47.848115+0000","last_undegraded":"2024-05-09T09:50:47.848115+0000","last_fullsized":"2024-05-09T09:50:47.848115+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:47.847851+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:47.847851+0000","last_clean_scrub_stamp":"2024-05-09T09:50:47.847851+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:23:07.394309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.178071+0000","last_change":"2024-05-09T09:47:22.260147+0000","last_active":"2024-05-09T09:49:40.178071+0000","last_peered":"2024-05-09T09:49:40.178071+0000","last_clean":"2024-05-09T09:49:40.178071+0000","last_became_active":"2024-05-09T09:47:22.259547+0000","last_became_peered":"2024-05-09T09:47:22.259547+0000","last_unstale":"2024-05-09T09:49:40.178071+0000","last_undegraded":"2024-05-09T09:49:40.178071+0000","last_fullsized":"2024-05-09T09:49:40.178071+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'12","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:12.442602+0000","last_change":"2024-05-09T09:51:12.442602+0000","last_active":"2024-05-09T09:51:12.442602+0000","last_peered":"2024-05-09T09:51:12.442602+0000","last_clean":"2024-05-09T09:51:12.442602+0000","last_became_active":"2024-05-09T09:47:14.173673+0000","last_became_peered":"2024-05-09T09:47:14.173673+0000","last_unstale":"2024-05-09T09:51:12.442602+0000","last_undegraded":"2024-05-09T09:51:12.442602+0000","last_fullsized":"2024-05-09T09:51:12.442602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-09T09:51:12.442192+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-09T09:51:12.442192+0000","last_clean_scrub_stamp":"2024-05-09T09:51:12.442192+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:34.408920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:27.262111+0000","last_change":"2024-05-09T09:51:27.262111+0000","last_active":"2024-05-09T09:51:27.262111+0000","last_peered":"2024-05-09T09:51:27.262111+0000","last_clean":"2024-05-09T09:51:27.262111+0000","last_became_active":"2024-05-09T09:47:12.205502+0000","last_became_peered":"2024-05-09T09:47:12.205502+0000","last_unstale":"2024-05-09T09:51:27.262111+0000","last_undegraded":"2024-05-09T09:51:27.262111+0000","last_fullsized":"2024-05-09T09:51:27.262111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:27.261827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:27.261827+0000","last_clean_scrub_stamp":"2024-05-09T09:51:27.261827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:00:13.953985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.649085+0000","last_change":"2024-05-09T09:47:03.187330+0000","last_active":"2024-05-09T09:50:44.649085+0000","last_peered":"2024-05-09T09:50:44.649085+0000","last_clean":"2024-05-09T09:50:44.649085+0000","last_became_active":"2024-05-09T09:47:03.186434+0000","last_became_peered":"2024-05-09T09:47:03.186434+0000","last_unstale":"2024-05-09T09:50:44.649085+0000","last_undegraded":"2024-05-09T09:50:44.649085+0000","last_fullsized":"2024-05-09T09:50:44.649085+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:02.030833+0000","last_clean_scrub_stamp":"2024-05-09T09:47:02.030833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:56.472700+0000","last_change":"2024-05-09T09:50:56.472700+0000","last_active":"2024-05-09T09:50:56.472700+0000","last_peered":"2024-05-09T09:50:56.472700+0000","last_clean":"2024-05-09T09:50:56.472700+0000","last_became_active":"2024-05-09T09:47:16.182713+0000","last_became_peered":"2024-05-09T09:47:16.182713+0000","last_unstale":"2024-05-09T09:50:56.472700+0000","last_undegraded":"2024-05-09T09:50:56.472700+0000","last_fullsized":"2024-05-09T09:50:56.472700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:56.472447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:56.472447+0000","last_clean_scrub_stamp":"2024-05-09T09:50:56.472447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:02:37.915439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'318","reported_seq":412,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:49.169601+0000","last_change":"2024-05-09T09:50:49.169601+0000","last_active":"2024-05-09T09:50:49.169601+0000","last_peered":"2024-05-09T09:50:49.169601+0000","last_clean":"2024-05-09T09:50:49.169601+0000","last_became_active":"2024-05-09T09:47:18.226473+0000","last_became_peered":"2024-05-09T09:47:18.226473+0000","last_unstale":"2024-05-09T09:50:49.169601+0000","last_undegraded":"2024-05-09T09:50:49.169601+0000","last_fullsized":"2024-05-09T09:50:49.169601+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'318","last_scrub_stamp":"2024-05-09T09:50:49.169325+0000","last_deep_scrub":"32'318","last_deep_scrub_stamp":"2024-05-09T09:50:49.169325+0000","last_clean_scrub_stamp":"2024-05-09T09:50:49.169325+0000","objects_scrubbed":8,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:47:39.409337+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:48.836895+0000","last_change":"2024-05-09T09:50:48.836895+0000","last_active":"2024-05-09T09:50:48.836895+0000","last_peered":"2024-05-09T09:50:48.836895+0000","last_clean":"2024-05-09T09:50:48.836895+0000","last_became_active":"2024-05-09T09:47:20.227198+0000","last_became_peered":"2024-05-09T09:47:20.227198+0000","last_unstale":"2024-05-09T09:50:48.836895+0000","last_undegraded":"2024-05-09T09:50:48.836895+0000","last_fullsized":"2024-05-09T09:50:48.836895+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:48.836642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:48.836642+0000","last_clean_scrub_stamp":"2024-05-09T09:50:48.836642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:31:25.639707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:02.266177+0000","last_change":"2024-05-09T09:51:02.266234+0000","last_active":"2024-05-09T09:51:02.266177+0000","last_peered":"2024-05-09T09:51:02.266177+0000","last_clean":"2024-05-09T09:51:02.266177+0000","last_became_active":"2024-05-09T09:47:22.233279+0000","last_became_peered":"2024-05-09T09:47:22.233279+0000","last_unstale":"2024-05-09T09:51:02.266177+0000","last_undegraded":"2024-05-09T09:51:02.266177+0000","last_fullsized":"2024-05-09T09:51:02.266177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:02.265986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:02.265986+0000","last_clean_scrub_stamp":"2024-05-09T09:51:02.265986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:11:12.792128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:34.206325+0000","last_change":"2024-05-09T09:51:34.206325+0000","last_active":"2024-05-09T09:51:34.206325+0000","last_peered":"2024-05-09T09:51:34.206325+0000","last_clean":"2024-05-09T09:51:34.206325+0000","last_became_active":"2024-05-09T09:47:22.236863+0000","last_became_peered":"2024-05-09T09:47:22.236863+0000","last_unstale":"2024-05-09T09:51:34.206325+0000","last_undegraded":"2024-05-09T09:51:34.206325+0000","last_fullsized":"2024-05-09T09:51:34.206325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:34.206073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:34.206073+0000","last_clean_scrub_stamp":"2024-05-09T09:51:34.206073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:03:16.461845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:18.352558+0000","last_change":"2024-05-09T09:51:18.352621+0000","last_active":"2024-05-09T09:51:18.352558+0000","last_peered":"2024-05-09T09:51:18.352558+0000","last_clean":"2024-05-09T09:51:18.352558+0000","last_became_active":"2024-05-09T09:47:14.184250+0000","last_became_peered":"2024-05-09T09:47:14.184250+0000","last_unstale":"2024-05-09T09:51:18.352558+0000","last_undegraded":"2024-05-09T09:51:18.352558+0000","last_fullsized":"2024-05-09T09:51:18.352558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:18.352348+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:18.352348+0000","last_clean_scrub_stamp":"2024-05-09T09:51:18.352348+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:53:19.967406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.176039+0000","last_change":"2024-05-09T09:47:12.208454+0000","last_active":"2024-05-09T09:49:35.176039+0000","last_peered":"2024-05-09T09:49:35.176039+0000","last_clean":"2024-05-09T09:49:35.176039+0000","last_became_active":"2024-05-09T09:47:12.203479+0000","last_became_peered":"2024-05-09T09:47:12.203479+0000","last_unstale":"2024-05-09T09:49:35.176039+0000","last_undegraded":"2024-05-09T09:49:35.176039+0000","last_fullsized":"2024-05-09T09:49:35.176039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:53.265518+0000","last_change":"2024-05-09T09:50:53.265573+0000","last_active":"2024-05-09T09:50:53.265518+0000","last_peered":"2024-05-09T09:50:53.265518+0000","last_clean":"2024-05-09T09:50:53.265518+0000","last_became_active":"2024-05-09T09:47:16.210992+0000","last_became_peered":"2024-05-09T09:47:16.210992+0000","last_unstale":"2024-05-09T09:50:53.265518+0000","last_undegraded":"2024-05-09T09:50:53.265518+0000","last_fullsized":"2024-05-09T09:50:53.265518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:53.265312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:53.265312+0000","last_clean_scrub_stamp":"2024-05-09T09:50:53.265312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:28:20.308389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'113","reported_seq":169,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:57.465836+0000","last_change":"2024-05-09T09:50:57.465918+0000","last_active":"2024-05-09T09:50:57.465836+0000","last_peered":"2024-05-09T09:50:57.465836+0000","last_clean":"2024-05-09T09:50:57.465836+0000","last_became_active":"2024-05-09T09:47:18.234014+0000","last_became_peered":"2024-05-09T09:47:18.234014+0000","last_unstale":"2024-05-09T09:50:57.465836+0000","last_undegraded":"2024-05-09T09:50:57.465836+0000","last_fullsized":"2024-05-09T09:50:57.465836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'113","last_scrub_stamp":"2024-05-09T09:50:57.465647+0000","last_deep_scrub":"32'113","last_deep_scrub_stamp":"2024-05-09T09:50:57.465647+0000","last_clean_scrub_stamp":"2024-05-09T09:50:57.465647+0000","objects_scrubbed":5,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:46:16.255842+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:11.435855+0000","last_change":"2024-05-09T09:51:11.435908+0000","last_active":"2024-05-09T09:51:11.435855+0000","last_peered":"2024-05-09T09:51:11.435855+0000","last_clean":"2024-05-09T09:51:11.435855+0000","last_became_active":"2024-05-09T09:47:20.254344+0000","last_became_peered":"2024-05-09T09:47:20.254344+0000","last_unstale":"2024-05-09T09:51:11.435855+0000","last_undegraded":"2024-05-09T09:51:11.435855+0000","last_fullsized":"2024-05-09T09:51:11.435855+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:11.435657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:11.435657+0000","last_clean_scrub_stamp":"2024-05-09T09:51:11.435657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:58:02.384629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'5","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:42.322512+0000","last_change":"2024-05-09T09:51:42.322576+0000","last_active":"2024-05-09T09:51:42.322512+0000","last_peered":"2024-05-09T09:51:42.322512+0000","last_clean":"2024-05-09T09:51:42.322512+0000","last_became_active":"2024-05-09T09:47:22.229088+0000","last_became_peered":"2024-05-09T09:47:22.229088+0000","last_unstale":"2024-05-09T09:51:42.322512+0000","last_undegraded":"2024-05-09T09:51:42.322512+0000","last_fullsized":"2024-05-09T09:51:42.322512+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-09T09:51:42.322274+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-09T09:51:42.322274+0000","last_clean_scrub_stamp":"2024-05-09T09:51:42.322274+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:56:18.475958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'8","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:18.320982+0000","last_change":"2024-05-09T09:51:18.321045+0000","last_active":"2024-05-09T09:51:18.320982+0000","last_peered":"2024-05-09T09:51:18.320982+0000","last_clean":"2024-05-09T09:51:18.320982+0000","last_became_active":"2024-05-09T09:47:14.173866+0000","last_became_peered":"2024-05-09T09:47:14.173866+0000","last_unstale":"2024-05-09T09:51:18.320982+0000","last_undegraded":"2024-05-09T09:51:18.320982+0000","last_fullsized":"2024-05-09T09:51:18.320982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:18.320750+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:18.320750+0000","last_clean_scrub_stamp":"2024-05-09T09:51:18.320750+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:44.576241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:23.271597+0000","last_change":"2024-05-09T09:51:23.271656+0000","last_active":"2024-05-09T09:51:23.271597+0000","last_peered":"2024-05-09T09:51:23.271597+0000","last_clean":"2024-05-09T09:51:23.271597+0000","last_became_active":"2024-05-09T09:47:12.205714+0000","last_became_peered":"2024-05-09T09:47:12.205714+0000","last_unstale":"2024-05-09T09:51:23.271597+0000","last_undegraded":"2024-05-09T09:51:23.271597+0000","last_fullsized":"2024-05-09T09:51:23.271597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:23.271378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:23.271378+0000","last_clean_scrub_stamp":"2024-05-09T09:51:23.271378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:23:12.920105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:40.177509+0000","last_change":"2024-05-09T09:47:52.188822+0000","last_active":"2024-05-09T09:49:40.177509+0000","last_peered":"2024-05-09T09:49:40.177509+0000","last_clean":"2024-05-09T09:49:40.177509+0000","last_became_active":"2024-05-09T09:47:52.187627+0000","last_became_peered":"2024-05-09T09:47:52.187627+0000","last_unstale":"2024-05-09T09:49:40.177509+0000","last_undegraded":"2024-05-09T09:49:40.177509+0000","last_fullsized":"2024-05-09T09:49:40.177509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'8","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:51.843220+0000","last_change":"2024-05-09T09:50:51.843293+0000","last_active":"2024-05-09T09:50:51.843220+0000","last_peered":"2024-05-09T09:50:51.843220+0000","last_clean":"2024-05-09T09:50:51.843220+0000","last_became_active":"2024-05-09T09:47:18.217843+0000","last_became_peered":"2024-05-09T09:47:18.217843+0000","last_unstale":"2024-05-09T09:50:51.843220+0000","last_undegraded":"2024-05-09T09:50:51.843220+0000","last_fullsized":"2024-05-09T09:50:51.843220+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:50:51.843015+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:50:51.843015+0000","last_clean_scrub_stamp":"2024-05-09T09:50:51.843015+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:01:37.150482+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:58.254932+0000","last_change":"2024-05-09T09:50:58.254985+0000","last_active":"2024-05-09T09:50:58.254932+0000","last_peered":"2024-05-09T09:50:58.254932+0000","last_clean":"2024-05-09T09:50:58.254932+0000","last_became_active":"2024-05-09T09:47:20.255449+0000","last_became_peered":"2024-05-09T09:47:20.255449+0000","last_unstale":"2024-05-09T09:50:58.254932+0000","last_undegraded":"2024-05-09T09:50:58.254932+0000","last_fullsized":"2024-05-09T09:50:58.254932+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:58.254742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:58.254742+0000","last_clean_scrub_stamp":"2024-05-09T09:50:58.254742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:40:28.088373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'3","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:44.264275+0000","last_change":"2024-05-09T09:51:44.264339+0000","last_active":"2024-05-09T09:51:44.264275+0000","last_peered":"2024-05-09T09:51:44.264275+0000","last_clean":"2024-05-09T09:51:44.264275+0000","last_became_active":"2024-05-09T09:47:22.239113+0000","last_became_peered":"2024-05-09T09:47:22.239113+0000","last_unstale":"2024-05-09T09:51:44.264275+0000","last_undegraded":"2024-05-09T09:51:44.264275+0000","last_fullsized":"2024-05-09T09:51:44.264275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-09T09:51:44.264078+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-09T09:51:44.264078+0000","last_clean_scrub_stamp":"2024-05-09T09:51:44.264078+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:56:58.841244+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:18.173232+0000","last_change":"2024-05-09T09:51:18.173416+0000","last_active":"2024-05-09T09:51:18.173232+0000","last_peered":"2024-05-09T09:51:18.173232+0000","last_clean":"2024-05-09T09:51:18.173232+0000","last_became_active":"2024-05-09T09:47:14.173338+0000","last_became_peered":"2024-05-09T09:47:14.173338+0000","last_unstale":"2024-05-09T09:51:18.173232+0000","last_undegraded":"2024-05-09T09:51:18.173232+0000","last_fullsized":"2024-05-09T09:51:18.173232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:18.173009+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:18.173009+0000","last_clean_scrub_stamp":"2024-05-09T09:51:18.173009+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:59:16.436247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:15.403301+0000","last_change":"2024-05-09T09:51:15.403431+0000","last_active":"2024-05-09T09:51:15.403301+0000","last_peered":"2024-05-09T09:51:15.403301+0000","last_clean":"2024-05-09T09:51:15.403301+0000","last_became_active":"2024-05-09T09:47:12.205864+0000","last_became_peered":"2024-05-09T09:47:12.205864+0000","last_unstale":"2024-05-09T09:51:15.403301+0000","last_undegraded":"2024-05-09T09:51:15.403301+0000","last_fullsized":"2024-05-09T09:51:15.403301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:15.403005+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:15.403005+0000","last_clean_scrub_stamp":"2024-05-09T09:51:15.403005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:10:59.671365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:59.267024+0000","last_change":"2024-05-09T09:50:59.267079+0000","last_active":"2024-05-09T09:50:59.267024+0000","last_peered":"2024-05-09T09:50:59.267024+0000","last_clean":"2024-05-09T09:50:59.267024+0000","last_became_active":"2024-05-09T09:47:16.214780+0000","last_became_peered":"2024-05-09T09:47:16.214780+0000","last_unstale":"2024-05-09T09:50:59.267024+0000","last_undegraded":"2024-05-09T09:50:59.267024+0000","last_fullsized":"2024-05-09T09:50:59.267024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:59.266840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:59.266840+0000","last_clean_scrub_stamp":"2024-05-09T09:50:59.266840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:59:17.503566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'121","reported_seq":193,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:54.909342+0000","last_change":"2024-05-09T09:50:54.909493+0000","last_active":"2024-05-09T09:50:54.909342+0000","last_peered":"2024-05-09T09:50:54.909342+0000","last_clean":"2024-05-09T09:50:54.909342+0000","last_became_active":"2024-05-09T09:47:18.201443+0000","last_became_peered":"2024-05-09T09:47:18.201443+0000","last_unstale":"2024-05-09T09:50:54.909342+0000","last_undegraded":"2024-05-09T09:50:54.909342+0000","last_fullsized":"2024-05-09T09:50:54.909342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'121","last_scrub_stamp":"2024-05-09T09:50:54.909111+0000","last_deep_scrub":"32'121","last_deep_scrub_stamp":"2024-05-09T09:50:54.909111+0000","last_clean_scrub_stamp":"2024-05-09T09:50:54.909111+0000","objects_scrubbed":6,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:37:16.030668+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:48.357085+0000","last_change":"2024-05-09T09:50:48.357139+0000","last_active":"2024-05-09T09:50:48.357085+0000","last_peered":"2024-05-09T09:50:48.357085+0000","last_clean":"2024-05-09T09:50:48.357085+0000","last_became_active":"2024-05-09T09:47:20.225261+0000","last_became_peered":"2024-05-09T09:47:20.225261+0000","last_unstale":"2024-05-09T09:50:48.357085+0000","last_undegraded":"2024-05-09T09:50:48.357085+0000","last_fullsized":"2024-05-09T09:50:48.357085+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:48.356886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:48.356886+0000","last_clean_scrub_stamp":"2024-05-09T09:50:48.356886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:18:04.605745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:27.489127+0000","last_change":"2024-05-09T09:51:27.489186+0000","last_active":"2024-05-09T09:51:27.489127+0000","last_peered":"2024-05-09T09:51:27.489127+0000","last_clean":"2024-05-09T09:51:27.489127+0000","last_became_active":"2024-05-09T09:47:22.252940+0000","last_became_peered":"2024-05-09T09:47:22.252940+0000","last_unstale":"2024-05-09T09:51:27.489127+0000","last_undegraded":"2024-05-09T09:51:27.489127+0000","last_fullsized":"2024-05-09T09:51:27.489127+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-09T09:51:27.488901+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-09T09:51:27.488901+0000","last_clean_scrub_stamp":"2024-05-09T09:51:27.488901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:56:03.642585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:32.523243+0000","last_change":"2024-05-09T09:51:32.523308+0000","last_active":"2024-05-09T09:51:32.523243+0000","last_peered":"2024-05-09T09:51:32.523243+0000","last_clean":"2024-05-09T09:51:32.523243+0000","last_became_active":"2024-05-09T09:47:14.183622+0000","last_became_peered":"2024-05-09T09:47:14.183622+0000","last_unstale":"2024-05-09T09:51:32.523243+0000","last_undegraded":"2024-05-09T09:51:32.523243+0000","last_fullsized":"2024-05-09T09:51:32.523243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:32.523049+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:32.523049+0000","last_clean_scrub_stamp":"2024-05-09T09:51:32.523049+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:00:49.214343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:34.234184+0000","last_change":"2024-05-09T09:51:34.234278+0000","last_active":"2024-05-09T09:51:34.234184+0000","last_peered":"2024-05-09T09:51:34.234184+0000","last_clean":"2024-05-09T09:51:34.234184+0000","last_became_active":"2024-05-09T09:47:12.195857+0000","last_became_peered":"2024-05-09T09:47:12.195857+0000","last_unstale":"2024-05-09T09:51:34.234184+0000","last_undegraded":"2024-05-09T09:51:34.234184+0000","last_fullsized":"2024-05-09T09:51:34.234184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:34.233870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:34.233870+0000","last_clean_scrub_stamp":"2024-05-09T09:51:34.233870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:40:27.779332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:52.490361+0000","last_change":"2024-05-09T09:50:52.490474+0000","last_active":"2024-05-09T09:50:52.490361+0000","last_peered":"2024-05-09T09:50:52.490361+0000","last_clean":"2024-05-09T09:50:52.490361+0000","last_became_active":"2024-05-09T09:47:16.198551+0000","last_became_peered":"2024-05-09T09:47:16.198551+0000","last_unstale":"2024-05-09T09:50:52.490361+0000","last_undegraded":"2024-05-09T09:50:52.490361+0000","last_fullsized":"2024-05-09T09:50:52.490361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:52.490129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:52.490129+0000","last_clean_scrub_stamp":"2024-05-09T09:50:52.490129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:08:27.216364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'110","reported_seq":165,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:55.303460+0000","last_change":"2024-05-09T09:50:55.303534+0000","last_active":"2024-05-09T09:50:55.303460+0000","last_peered":"2024-05-09T09:50:55.303460+0000","last_clean":"2024-05-09T09:50:55.303460+0000","last_became_active":"2024-05-09T09:47:18.217163+0000","last_became_peered":"2024-05-09T09:47:18.217163+0000","last_unstale":"2024-05-09T09:50:55.303460+0000","last_undegraded":"2024-05-09T09:50:55.303460+0000","last_fullsized":"2024-05-09T09:50:55.303460+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'110","last_scrub_stamp":"2024-05-09T09:50:55.303267+0000","last_deep_scrub":"32'110","last_deep_scrub_stamp":"2024-05-09T09:50:55.303267+0000","last_clean_scrub_stamp":"2024-05-09T09:50:55.303267+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:30:34.471649+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:47.153512+0000","last_change":"2024-05-09T09:50:47.153568+0000","last_active":"2024-05-09T09:50:47.153512+0000","last_peered":"2024-05-09T09:50:47.153512+0000","last_clean":"2024-05-09T09:50:47.153512+0000","last_became_active":"2024-05-09T09:47:20.238369+0000","last_became_peered":"2024-05-09T09:47:20.238369+0000","last_unstale":"2024-05-09T09:50:47.153512+0000","last_undegraded":"2024-05-09T09:50:47.153512+0000","last_fullsized":"2024-05-09T09:50:47.153512+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:47.153312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:47.153312+0000","last_clean_scrub_stamp":"2024-05-09T09:50:47.153312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:16.400691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:21.490513+0000","last_change":"2024-05-09T09:51:21.490513+0000","last_active":"2024-05-09T09:51:21.490513+0000","last_peered":"2024-05-09T09:51:21.490513+0000","last_clean":"2024-05-09T09:51:21.490513+0000","last_became_active":"2024-05-09T09:47:14.187868+0000","last_became_peered":"2024-05-09T09:47:14.187868+0000","last_unstale":"2024-05-09T09:51:21.490513+0000","last_undegraded":"2024-05-09T09:51:21.490513+0000","last_fullsized":"2024-05-09T09:51:21.490513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-09T09:51:21.490253+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-09T09:51:21.490253+0000","last_clean_scrub_stamp":"2024-05-09T09:51:21.490253+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:21:46.793888+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:38.495965+0000","last_change":"2024-05-09T09:51:38.496075+0000","last_active":"2024-05-09T09:51:38.495965+0000","last_peered":"2024-05-09T09:51:38.495965+0000","last_clean":"2024-05-09T09:51:38.495965+0000","last_became_active":"2024-05-09T09:47:12.208209+0000","last_became_peered":"2024-05-09T09:47:12.208209+0000","last_unstale":"2024-05-09T09:51:38.495965+0000","last_undegraded":"2024-05-09T09:51:38.495965+0000","last_fullsized":"2024-05-09T09:51:38.495965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:38.495753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:38.495753+0000","last_clean_scrub_stamp":"2024-05-09T09:51:38.495753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:37:11.624510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:09.038896+0000","last_change":"2024-05-09T09:51:09.038896+0000","last_active":"2024-05-09T09:51:09.038896+0000","last_peered":"2024-05-09T09:51:09.038896+0000","last_clean":"2024-05-09T09:51:09.038896+0000","last_became_active":"2024-05-09T09:47:16.182766+0000","last_became_peered":"2024-05-09T09:47:16.182766+0000","last_unstale":"2024-05-09T09:51:09.038896+0000","last_undegraded":"2024-05-09T09:51:09.038896+0000","last_fullsized":"2024-05-09T09:51:09.038896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:09.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:09.038645+0000","last_clean_scrub_stamp":"2024-05-09T09:51:09.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:34:44.054800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'211","reported_seq":284,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:50.874670+0000","last_change":"2024-05-09T09:50:50.874747+0000","last_active":"2024-05-09T09:50:50.874670+0000","last_peered":"2024-05-09T09:50:50.874670+0000","last_clean":"2024-05-09T09:50:50.874670+0000","last_became_active":"2024-05-09T09:47:18.225074+0000","last_became_peered":"2024-05-09T09:47:18.225074+0000","last_unstale":"2024-05-09T09:50:50.874670+0000","last_undegraded":"2024-05-09T09:50:50.874670+0000","last_fullsized":"2024-05-09T09:50:50.874670+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'211","last_scrub_stamp":"2024-05-09T09:50:50.874475+0000","last_deep_scrub":"32'211","last_deep_scrub_stamp":"2024-05-09T09:50:50.874475+0000","last_clean_scrub_stamp":"2024-05-09T09:50:50.874475+0000","objects_scrubbed":5,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:47.628582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:46.119717+0000","last_change":"2024-05-09T09:50:46.119770+0000","last_active":"2024-05-09T09:50:46.119717+0000","last_peered":"2024-05-09T09:50:46.119717+0000","last_clean":"2024-05-09T09:50:46.119717+0000","last_became_active":"2024-05-09T09:47:20.241372+0000","last_became_peered":"2024-05-09T09:47:20.241372+0000","last_unstale":"2024-05-09T09:50:46.119717+0000","last_undegraded":"2024-05-09T09:50:46.119717+0000","last_fullsized":"2024-05-09T09:50:46.119717+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:46.119515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:46.119515+0000","last_clean_scrub_stamp":"2024-05-09T09:50:46.119515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:34:19.012893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.168445+0000","last_change":"2024-05-09T09:47:22.260464+0000","last_active":"2024-05-09T09:49:45.168445+0000","last_peered":"2024-05-09T09:49:45.168445+0000","last_clean":"2024-05-09T09:49:45.168445+0000","last_became_active":"2024-05-09T09:47:22.259589+0000","last_became_peered":"2024-05-09T09:47:22.259589+0000","last_unstale":"2024-05-09T09:49:45.168445+0000","last_undegraded":"2024-05-09T09:49:45.168445+0000","last_fullsized":"2024-05-09T09:49:45.168445+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'8","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:22.285662+0000","last_change":"2024-05-09T09:51:22.285724+0000","last_active":"2024-05-09T09:51:22.285662+0000","last_peered":"2024-05-09T09:51:22.285662+0000","last_clean":"2024-05-09T09:51:22.285662+0000","last_became_active":"2024-05-09T09:47:14.174371+0000","last_became_peered":"2024-05-09T09:47:14.174371+0000","last_unstale":"2024-05-09T09:51:22.285662+0000","last_undegraded":"2024-05-09T09:51:22.285662+0000","last_fullsized":"2024-05-09T09:51:22.285662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:22.285472+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:22.285472+0000","last_clean_scrub_stamp":"2024-05-09T09:51:22.285472+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:31:43.895778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:37.242635+0000","last_change":"2024-05-09T09:51:37.242716+0000","last_active":"2024-05-09T09:51:37.242635+0000","last_peered":"2024-05-09T09:51:37.242635+0000","last_clean":"2024-05-09T09:51:37.242635+0000","last_became_active":"2024-05-09T09:47:12.196881+0000","last_became_peered":"2024-05-09T09:47:12.196881+0000","last_unstale":"2024-05-09T09:51:37.242635+0000","last_undegraded":"2024-05-09T09:51:37.242635+0000","last_fullsized":"2024-05-09T09:51:37.242635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:37.242412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:37.242412+0000","last_clean_scrub_stamp":"2024-05-09T09:51:37.242412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:24:51.552770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:05.284242+0000","last_change":"2024-05-09T09:51:05.284242+0000","last_active":"2024-05-09T09:51:05.284242+0000","last_peered":"2024-05-09T09:51:05.284242+0000","last_clean":"2024-05-09T09:51:05.284242+0000","last_became_active":"2024-05-09T09:47:16.188611+0000","last_became_peered":"2024-05-09T09:47:16.188611+0000","last_unstale":"2024-05-09T09:51:05.284242+0000","last_undegraded":"2024-05-09T09:51:05.284242+0000","last_fullsized":"2024-05-09T09:51:05.284242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:05.283953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:05.283953+0000","last_clean_scrub_stamp":"2024-05-09T09:51:05.283953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:53:42.383540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'119","reported_seq":177,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:55.469218+0000","last_change":"2024-05-09T09:50:55.469398+0000","last_active":"2024-05-09T09:50:55.469218+0000","last_peered":"2024-05-09T09:50:55.469218+0000","last_clean":"2024-05-09T09:50:55.469218+0000","last_became_active":"2024-05-09T09:47:18.232435+0000","last_became_peered":"2024-05-09T09:47:18.232435+0000","last_unstale":"2024-05-09T09:50:55.469218+0000","last_undegraded":"2024-05-09T09:50:55.469218+0000","last_fullsized":"2024-05-09T09:50:55.469218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-05-09T09:50:55.468997+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-05-09T09:50:55.468997+0000","last_clean_scrub_stamp":"2024-05-09T09:50:55.468997+0000","objects_scrubbed":7,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:10:29.577014+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:00.251704+0000","last_change":"2024-05-09T09:51:00.251832+0000","last_active":"2024-05-09T09:51:00.251704+0000","last_peered":"2024-05-09T09:51:00.251704+0000","last_clean":"2024-05-09T09:51:00.251704+0000","last_became_active":"2024-05-09T09:47:20.241935+0000","last_became_peered":"2024-05-09T09:47:20.241935+0000","last_unstale":"2024-05-09T09:51:00.251704+0000","last_undegraded":"2024-05-09T09:51:00.251704+0000","last_fullsized":"2024-05-09T09:51:00.251704+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:00.251488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:00.251488+0000","last_clean_scrub_stamp":"2024-05-09T09:51:00.251488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:57:35.112556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:15.485330+0000","last_change":"2024-05-09T09:51:15.485482+0000","last_active":"2024-05-09T09:51:15.485330+0000","last_peered":"2024-05-09T09:51:15.485330+0000","last_clean":"2024-05-09T09:51:15.485330+0000","last_became_active":"2024-05-09T09:47:22.241067+0000","last_became_peered":"2024-05-09T09:47:22.241067+0000","last_unstale":"2024-05-09T09:51:15.485330+0000","last_undegraded":"2024-05-09T09:51:15.485330+0000","last_fullsized":"2024-05-09T09:51:15.485330+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:15.485109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:15.485109+0000","last_clean_scrub_stamp":"2024-05-09T09:51:15.485109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:38.931364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:04.473912+0000","last_change":"2024-05-09T09:51:04.473973+0000","last_active":"2024-05-09T09:51:04.473912+0000","last_peered":"2024-05-09T09:51:04.473912+0000","last_clean":"2024-05-09T09:51:04.473912+0000","last_became_active":"2024-05-09T09:47:14.191459+0000","last_became_peered":"2024-05-09T09:47:14.191459+0000","last_unstale":"2024-05-09T09:51:04.473912+0000","last_undegraded":"2024-05-09T09:51:04.473912+0000","last_fullsized":"2024-05-09T09:51:04.473912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:04.473723+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:04.473723+0000","last_clean_scrub_stamp":"2024-05-09T09:51:04.473723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:30:16.341639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:32.249206+0000","last_change":"2024-05-09T09:51:32.249279+0000","last_active":"2024-05-09T09:51:32.249206+0000","last_peered":"2024-05-09T09:51:32.249206+0000","last_clean":"2024-05-09T09:51:32.249206+0000","last_became_active":"2024-05-09T09:47:12.191204+0000","last_became_peered":"2024-05-09T09:47:12.191204+0000","last_unstale":"2024-05-09T09:51:32.249206+0000","last_undegraded":"2024-05-09T09:51:32.249206+0000","last_fullsized":"2024-05-09T09:51:32.249206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:32.248976+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:32.248976+0000","last_clean_scrub_stamp":"2024-05-09T09:51:32.248976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:11:16.563523+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:04.313775+0000","last_change":"2024-05-09T09:51:04.313828+0000","last_active":"2024-05-09T09:51:04.313775+0000","last_peered":"2024-05-09T09:51:04.313775+0000","last_clean":"2024-05-09T09:51:04.313775+0000","last_became_active":"2024-05-09T09:47:16.194314+0000","last_became_peered":"2024-05-09T09:47:16.194314+0000","last_unstale":"2024-05-09T09:51:04.313775+0000","last_undegraded":"2024-05-09T09:51:04.313775+0000","last_fullsized":"2024-05-09T09:51:04.313775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:04.313561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:04.313561+0000","last_clean_scrub_stamp":"2024-05-09T09:51:04.313561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:23:40.119184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'113","reported_seq":170,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:52.875802+0000","last_change":"2024-05-09T09:50:52.875802+0000","last_active":"2024-05-09T09:50:52.875802+0000","last_peered":"2024-05-09T09:50:52.875802+0000","last_clean":"2024-05-09T09:50:52.875802+0000","last_became_active":"2024-05-09T09:47:18.209099+0000","last_became_peered":"2024-05-09T09:47:18.209099+0000","last_unstale":"2024-05-09T09:50:52.875802+0000","last_undegraded":"2024-05-09T09:50:52.875802+0000","last_fullsized":"2024-05-09T09:50:52.875802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'113","last_scrub_stamp":"2024-05-09T09:50:52.875426+0000","last_deep_scrub":"32'113","last_deep_scrub_stamp":"2024-05-09T09:50:52.875426+0000","last_clean_scrub_stamp":"2024-05-09T09:50:52.875426+0000","objects_scrubbed":5,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:17:15.117146+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.866730+0000","last_change":"2024-05-09T09:50:44.866730+0000","last_active":"2024-05-09T09:50:44.866730+0000","last_peered":"2024-05-09T09:50:44.866730+0000","last_clean":"2024-05-09T09:50:44.866730+0000","last_became_active":"2024-05-09T09:47:20.241900+0000","last_became_peered":"2024-05-09T09:47:20.241900+0000","last_unstale":"2024-05-09T09:50:44.866730+0000","last_undegraded":"2024-05-09T09:50:44.866730+0000","last_fullsized":"2024-05-09T09:50:44.866730+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:44.866482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:44.866482+0000","last_clean_scrub_stamp":"2024-05-09T09:50:44.866482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:26:17.791183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.178830+0000","last_change":"2024-05-09T09:47:22.264988+0000","last_active":"2024-05-09T09:49:45.178830+0000","last_peered":"2024-05-09T09:49:45.178830+0000","last_clean":"2024-05-09T09:49:45.178830+0000","last_became_active":"2024-05-09T09:47:22.263730+0000","last_became_peered":"2024-05-09T09:47:22.263730+0000","last_unstale":"2024-05-09T09:49:45.178830+0000","last_undegraded":"2024-05-09T09:49:45.178830+0000","last_fullsized":"2024-05-09T09:49:45.178830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'6","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:12.090643+0000","last_change":"2024-05-09T09:51:12.090710+0000","last_active":"2024-05-09T09:51:12.090643+0000","last_peered":"2024-05-09T09:51:12.090643+0000","last_clean":"2024-05-09T09:51:12.090643+0000","last_became_active":"2024-05-09T09:47:14.189561+0000","last_became_peered":"2024-05-09T09:47:14.189561+0000","last_unstale":"2024-05-09T09:51:12.090643+0000","last_undegraded":"2024-05-09T09:51:12.090643+0000","last_fullsized":"2024-05-09T09:51:12.090643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:12.090429+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:12.090429+0000","last_clean_scrub_stamp":"2024-05-09T09:51:12.090429+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:00.491368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:34.462231+0000","last_change":"2024-05-09T09:51:34.462352+0000","last_active":"2024-05-09T09:51:34.462231+0000","last_peered":"2024-05-09T09:51:34.462231+0000","last_clean":"2024-05-09T09:51:34.462231+0000","last_became_active":"2024-05-09T09:47:12.214816+0000","last_became_peered":"2024-05-09T09:47:12.214816+0000","last_unstale":"2024-05-09T09:51:34.462231+0000","last_undegraded":"2024-05-09T09:51:34.462231+0000","last_fullsized":"2024-05-09T09:51:34.462231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:34.461979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:34.461979+0000","last_clean_scrub_stamp":"2024-05-09T09:51:34.461979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:57:32.758279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:59.288158+0000","last_change":"2024-05-09T09:50:59.288294+0000","last_active":"2024-05-09T09:50:59.288158+0000","last_peered":"2024-05-09T09:50:59.288158+0000","last_clean":"2024-05-09T09:50:59.288158+0000","last_became_active":"2024-05-09T09:47:16.210567+0000","last_became_peered":"2024-05-09T09:47:16.210567+0000","last_unstale":"2024-05-09T09:50:59.288158+0000","last_undegraded":"2024-05-09T09:50:59.288158+0000","last_fullsized":"2024-05-09T09:50:59.288158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:59.287849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:59.287849+0000","last_clean_scrub_stamp":"2024-05-09T09:50:59.287849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:11:15.215672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:03.498249+0000","last_change":"2024-05-09T09:51:03.498249+0000","last_active":"2024-05-09T09:51:03.498249+0000","last_peered":"2024-05-09T09:51:03.498249+0000","last_clean":"2024-05-09T09:51:03.498249+0000","last_became_active":"2024-05-09T09:47:18.234113+0000","last_became_peered":"2024-05-09T09:47:18.234113+0000","last_unstale":"2024-05-09T09:51:03.498249+0000","last_undegraded":"2024-05-09T09:51:03.498249+0000","last_fullsized":"2024-05-09T09:51:03.498249+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-09T09:51:03.497977+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-09T09:51:03.497977+0000","last_clean_scrub_stamp":"2024-05-09T09:51:03.497977+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:59:01.761215+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":381,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:54.255293+0000","last_change":"2024-05-09T09:50:54.255293+0000","last_active":"2024-05-09T09:50:54.255293+0000","last_peered":"2024-05-09T09:50:54.255293+0000","last_clean":"2024-05-09T09:50:54.255293+0000","last_became_active":"2024-05-09T09:47:20.254573+0000","last_became_peered":"2024-05-09T09:47:20.254573+0000","last_unstale":"2024-05-09T09:50:54.255293+0000","last_undegraded":"2024-05-09T09:50:54.255293+0000","last_fullsized":"2024-05-09T09:50:54.255293+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:54.255008+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:54.255008+0000","last_clean_scrub_stamp":"2024-05-09T09:50:54.255008+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:33:59.828045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:23.485638+0000","last_change":"2024-05-09T09:51:23.485708+0000","last_active":"2024-05-09T09:51:23.485638+0000","last_peered":"2024-05-09T09:51:23.485638+0000","last_clean":"2024-05-09T09:51:23.485638+0000","last_became_active":"2024-05-09T09:47:22.243234+0000","last_became_peered":"2024-05-09T09:47:22.243234+0000","last_unstale":"2024-05-09T09:51:23.485638+0000","last_undegraded":"2024-05-09T09:51:23.485638+0000","last_fullsized":"2024-05-09T09:51:23.485638+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:23.485408+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:23.485408+0000","last_clean_scrub_stamp":"2024-05-09T09:51:23.485408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:06:13.197033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:32.186977+0000","last_change":"2024-05-09T09:51:32.187038+0000","last_active":"2024-05-09T09:51:32.186977+0000","last_peered":"2024-05-09T09:51:32.186977+0000","last_clean":"2024-05-09T09:51:32.186977+0000","last_became_active":"2024-05-09T09:47:14.188222+0000","last_became_peered":"2024-05-09T09:47:14.188222+0000","last_unstale":"2024-05-09T09:51:32.186977+0000","last_undegraded":"2024-05-09T09:51:32.186977+0000","last_fullsized":"2024-05-09T09:51:32.186977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:32.186791+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:32.186791+0000","last_clean_scrub_stamp":"2024-05-09T09:51:32.186791+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:39:54.063094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:36.228396+0000","last_change":"2024-05-09T09:51:36.228464+0000","last_active":"2024-05-09T09:51:36.228396+0000","last_peered":"2024-05-09T09:51:36.228396+0000","last_clean":"2024-05-09T09:51:36.228396+0000","last_became_active":"2024-05-09T09:47:12.195936+0000","last_became_peered":"2024-05-09T09:47:12.195936+0000","last_unstale":"2024-05-09T09:51:36.228396+0000","last_undegraded":"2024-05-09T09:51:36.228396+0000","last_fullsized":"2024-05-09T09:51:36.228396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:36.228198+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:36.228198+0000","last_clean_scrub_stamp":"2024-05-09T09:51:36.228198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:56:14.740338+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:54.288182+0000","last_change":"2024-05-09T09:50:54.288244+0000","last_active":"2024-05-09T09:50:54.288182+0000","last_peered":"2024-05-09T09:50:54.288182+0000","last_clean":"2024-05-09T09:50:54.288182+0000","last_became_active":"2024-05-09T09:47:16.210901+0000","last_became_peered":"2024-05-09T09:47:16.210901+0000","last_unstale":"2024-05-09T09:50:54.288182+0000","last_undegraded":"2024-05-09T09:50:54.288182+0000","last_fullsized":"2024-05-09T09:50:54.288182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:54.287951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:54.287951+0000","last_clean_scrub_stamp":"2024-05-09T09:50:54.287951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:00:20.805979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'120","reported_seq":178,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:51.351217+0000","last_change":"2024-05-09T09:50:51.351295+0000","last_active":"2024-05-09T09:50:51.351217+0000","last_peered":"2024-05-09T09:50:51.351217+0000","last_clean":"2024-05-09T09:50:51.351217+0000","last_became_active":"2024-05-09T09:47:18.202069+0000","last_became_peered":"2024-05-09T09:47:18.202069+0000","last_unstale":"2024-05-09T09:50:51.351217+0000","last_undegraded":"2024-05-09T09:50:51.351217+0000","last_fullsized":"2024-05-09T09:50:51.351217+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'120","last_scrub_stamp":"2024-05-09T09:50:51.351014+0000","last_deep_scrub":"32'120","last_deep_scrub_stamp":"2024-05-09T09:50:51.351014+0000","last_clean_scrub_stamp":"2024-05-09T09:50:51.351014+0000","objects_scrubbed":7,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:19:59.652432+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:49.840926+0000","last_change":"2024-05-09T09:50:49.840978+0000","last_active":"2024-05-09T09:50:49.840926+0000","last_peered":"2024-05-09T09:50:49.840926+0000","last_clean":"2024-05-09T09:50:49.840926+0000","last_became_active":"2024-05-09T09:47:20.250194+0000","last_became_peered":"2024-05-09T09:47:20.250194+0000","last_unstale":"2024-05-09T09:50:49.840926+0000","last_undegraded":"2024-05-09T09:50:49.840926+0000","last_fullsized":"2024-05-09T09:50:49.840926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:49.840731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:49.840731+0000","last_clean_scrub_stamp":"2024-05-09T09:50:49.840731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:28:16.883808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:12.276060+0000","last_change":"2024-05-09T09:51:12.276130+0000","last_active":"2024-05-09T09:51:12.276060+0000","last_peered":"2024-05-09T09:51:12.276060+0000","last_clean":"2024-05-09T09:51:12.276060+0000","last_became_active":"2024-05-09T09:47:22.239300+0000","last_became_peered":"2024-05-09T09:47:22.239300+0000","last_unstale":"2024-05-09T09:51:12.276060+0000","last_undegraded":"2024-05-09T09:51:12.276060+0000","last_fullsized":"2024-05-09T09:51:12.276060+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:12.275835+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:12.275835+0000","last_clean_scrub_stamp":"2024-05-09T09:51:12.275835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:27.063514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'10","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:22.276039+0000","last_change":"2024-05-09T09:51:22.276099+0000","last_active":"2024-05-09T09:51:22.276039+0000","last_peered":"2024-05-09T09:51:22.276039+0000","last_clean":"2024-05-09T09:51:22.276039+0000","last_became_active":"2024-05-09T09:47:14.187951+0000","last_became_peered":"2024-05-09T09:47:14.187951+0000","last_unstale":"2024-05-09T09:51:22.276039+0000","last_undegraded":"2024-05-09T09:51:22.276039+0000","last_fullsized":"2024-05-09T09:51:22.276039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-09T09:51:22.275813+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-09T09:51:22.275813+0000","last_clean_scrub_stamp":"2024-05-09T09:51:22.275813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:33.300865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:37.465185+0000","last_change":"2024-05-09T09:51:37.465245+0000","last_active":"2024-05-09T09:51:37.465185+0000","last_peered":"2024-05-09T09:51:37.465185+0000","last_clean":"2024-05-09T09:51:37.465185+0000","last_became_active":"2024-05-09T09:47:12.203827+0000","last_became_peered":"2024-05-09T09:47:12.203827+0000","last_unstale":"2024-05-09T09:51:37.465185+0000","last_undegraded":"2024-05-09T09:51:37.465185+0000","last_fullsized":"2024-05-09T09:51:37.465185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:37.464973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:37.464973+0000","last_clean_scrub_stamp":"2024-05-09T09:51:37.464973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:31:23.921813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:03.316460+0000","last_change":"2024-05-09T09:51:03.316512+0000","last_active":"2024-05-09T09:51:03.316460+0000","last_peered":"2024-05-09T09:51:03.316460+0000","last_clean":"2024-05-09T09:51:03.316460+0000","last_became_active":"2024-05-09T09:47:16.196193+0000","last_became_peered":"2024-05-09T09:47:16.196193+0000","last_unstale":"2024-05-09T09:51:03.316460+0000","last_undegraded":"2024-05-09T09:51:03.316460+0000","last_fullsized":"2024-05-09T09:51:03.316460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:03.316273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:03.316273+0000","last_clean_scrub_stamp":"2024-05-09T09:51:03.316273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:59:34.812456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'113","reported_seq":168,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:55.923859+0000","last_change":"2024-05-09T09:50:55.923928+0000","last_active":"2024-05-09T09:50:55.923859+0000","last_peered":"2024-05-09T09:50:55.923859+0000","last_clean":"2024-05-09T09:50:55.923859+0000","last_became_active":"2024-05-09T09:47:18.199627+0000","last_became_peered":"2024-05-09T09:47:18.199627+0000","last_unstale":"2024-05-09T09:50:55.923859+0000","last_undegraded":"2024-05-09T09:50:55.923859+0000","last_fullsized":"2024-05-09T09:50:55.923859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'113","last_scrub_stamp":"2024-05-09T09:50:55.923673+0000","last_deep_scrub":"32'113","last_deep_scrub_stamp":"2024-05-09T09:50:55.923673+0000","last_clean_scrub_stamp":"2024-05-09T09:50:55.923673+0000","objects_scrubbed":4,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:11:11.851496+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:07.405248+0000","last_change":"2024-05-09T09:51:07.405300+0000","last_active":"2024-05-09T09:51:07.405248+0000","last_peered":"2024-05-09T09:51:07.405248+0000","last_clean":"2024-05-09T09:51:07.405248+0000","last_became_active":"2024-05-09T09:47:20.251642+0000","last_became_peered":"2024-05-09T09:47:20.251642+0000","last_unstale":"2024-05-09T09:51:07.405248+0000","last_undegraded":"2024-05-09T09:51:07.405248+0000","last_fullsized":"2024-05-09T09:51:07.405248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:07.405060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:07.405060+0000","last_clean_scrub_stamp":"2024-05-09T09:51:07.405060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:31:29.015365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:50.180499+0000","last_change":"2024-05-09T09:47:22.261644+0000","last_active":"2024-05-09T09:49:50.180499+0000","last_peered":"2024-05-09T09:49:50.180499+0000","last_clean":"2024-05-09T09:49:50.180499+0000","last_became_active":"2024-05-09T09:47:22.261164+0000","last_became_peered":"2024-05-09T09:47:22.261164+0000","last_unstale":"2024-05-09T09:49:50.180499+0000","last_undegraded":"2024-05-09T09:49:50.180499+0000","last_fullsized":"2024-05-09T09:49:50.180499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'8","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:26.443590+0000","last_change":"2024-05-09T09:51:26.443657+0000","last_active":"2024-05-09T09:51:26.443590+0000","last_peered":"2024-05-09T09:51:26.443590+0000","last_clean":"2024-05-09T09:51:26.443590+0000","last_became_active":"2024-05-09T09:47:14.185270+0000","last_became_peered":"2024-05-09T09:47:14.185270+0000","last_unstale":"2024-05-09T09:51:26.443590+0000","last_undegraded":"2024-05-09T09:51:26.443590+0000","last_fullsized":"2024-05-09T09:51:26.443590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:26.443394+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:26.443394+0000","last_clean_scrub_stamp":"2024-05-09T09:51:26.443394+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:21.088972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:36.249899+0000","last_change":"2024-05-09T09:51:36.249959+0000","last_active":"2024-05-09T09:51:36.249899+0000","last_peered":"2024-05-09T09:51:36.249899+0000","last_clean":"2024-05-09T09:51:36.249899+0000","last_became_active":"2024-05-09T09:47:12.183985+0000","last_became_peered":"2024-05-09T09:47:12.183985+0000","last_unstale":"2024-05-09T09:51:36.249899+0000","last_undegraded":"2024-05-09T09:51:36.249899+0000","last_fullsized":"2024-05-09T09:51:36.249899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:36.249688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:36.249688+0000","last_clean_scrub_stamp":"2024-05-09T09:51:36.249688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:01.553324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:01.251663+0000","last_change":"2024-05-09T09:51:01.251716+0000","last_active":"2024-05-09T09:51:01.251663+0000","last_peered":"2024-05-09T09:51:01.251663+0000","last_clean":"2024-05-09T09:51:01.251663+0000","last_became_active":"2024-05-09T09:47:16.207467+0000","last_became_peered":"2024-05-09T09:47:16.207467+0000","last_unstale":"2024-05-09T09:51:01.251663+0000","last_undegraded":"2024-05-09T09:51:01.251663+0000","last_fullsized":"2024-05-09T09:51:01.251663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:01.251471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:01.251471+0000","last_clean_scrub_stamp":"2024-05-09T09:51:01.251471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:38:45.710781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'106","reported_seq":159,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:14.506892+0000","last_change":"2024-05-09T09:51:14.506957+0000","last_active":"2024-05-09T09:51:14.506892+0000","last_peered":"2024-05-09T09:51:14.506892+0000","last_clean":"2024-05-09T09:51:14.506892+0000","last_became_active":"2024-05-09T09:47:18.235557+0000","last_became_peered":"2024-05-09T09:47:18.235557+0000","last_unstale":"2024-05-09T09:51:14.506892+0000","last_undegraded":"2024-05-09T09:51:14.506892+0000","last_fullsized":"2024-05-09T09:51:14.506892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'106","last_scrub_stamp":"2024-05-09T09:51:14.506702+0000","last_deep_scrub":"32'106","last_deep_scrub_stamp":"2024-05-09T09:51:14.506702+0000","last_clean_scrub_stamp":"2024-05-09T09:51:14.506702+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:14:13.534344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:10.463408+0000","last_change":"2024-05-09T09:51:10.463461+0000","last_active":"2024-05-09T09:51:10.463408+0000","last_peered":"2024-05-09T09:51:10.463408+0000","last_clean":"2024-05-09T09:51:10.463408+0000","last_became_active":"2024-05-09T09:47:20.231750+0000","last_became_peered":"2024-05-09T09:47:20.231750+0000","last_unstale":"2024-05-09T09:51:10.463408+0000","last_undegraded":"2024-05-09T09:51:10.463408+0000","last_fullsized":"2024-05-09T09:51:10.463408+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:10.463214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:10.463214+0000","last_clean_scrub_stamp":"2024-05-09T09:51:10.463214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:19.664307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'8","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:50.180411+0000","last_change":"2024-05-09T09:47:22.256916+0000","last_active":"2024-05-09T09:49:50.180411+0000","last_peered":"2024-05-09T09:49:50.180411+0000","last_clean":"2024-05-09T09:49:50.180411+0000","last_became_active":"2024-05-09T09:47:22.256398+0000","last_became_peered":"2024-05-09T09:47:22.256398+0000","last_unstale":"2024-05-09T09:49:50.180411+0000","last_undegraded":"2024-05-09T09:49:50.180411+0000","last_fullsized":"2024-05-09T09:49:50.180411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'22","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:07.373060+0000","last_change":"2024-05-09T09:51:07.373119+0000","last_active":"2024-05-09T09:51:07.373060+0000","last_peered":"2024-05-09T09:51:07.373060+0000","last_clean":"2024-05-09T09:51:07.373060+0000","last_became_active":"2024-05-09T09:47:14.188980+0000","last_became_peered":"2024-05-09T09:47:14.188980+0000","last_unstale":"2024-05-09T09:51:07.373060+0000","last_undegraded":"2024-05-09T09:51:07.373060+0000","last_fullsized":"2024-05-09T09:51:07.373060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-05-09T09:51:07.372874+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-05-09T09:51:07.372874+0000","last_clean_scrub_stamp":"2024-05-09T09:51:07.372874+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:38.613364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:21.338164+0000","last_change":"2024-05-09T09:51:21.338164+0000","last_active":"2024-05-09T09:51:21.338164+0000","last_peered":"2024-05-09T09:51:21.338164+0000","last_clean":"2024-05-09T09:51:21.338164+0000","last_became_active":"2024-05-09T09:47:12.206136+0000","last_became_peered":"2024-05-09T09:47:12.206136+0000","last_unstale":"2024-05-09T09:51:21.338164+0000","last_undegraded":"2024-05-09T09:51:21.338164+0000","last_fullsized":"2024-05-09T09:51:21.338164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:21.337902+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:21.337902+0000","last_clean_scrub_stamp":"2024-05-09T09:51:21.337902+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:37:41.599167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:58.281505+0000","last_change":"2024-05-09T09:50:58.281584+0000","last_active":"2024-05-09T09:50:58.281505+0000","last_peered":"2024-05-09T09:50:58.281505+0000","last_clean":"2024-05-09T09:50:58.281505+0000","last_became_active":"2024-05-09T09:47:16.210958+0000","last_became_peered":"2024-05-09T09:47:16.210958+0000","last_unstale":"2024-05-09T09:50:58.281505+0000","last_undegraded":"2024-05-09T09:50:58.281505+0000","last_fullsized":"2024-05-09T09:50:58.281505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-09T09:50:58.281299+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-09T09:50:58.281299+0000","last_clean_scrub_stamp":"2024-05-09T09:50:58.281299+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:37:19.402856+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'114","reported_seq":171,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:59.461776+0000","last_change":"2024-05-09T09:50:59.461850+0000","last_active":"2024-05-09T09:50:59.461776+0000","last_peered":"2024-05-09T09:50:59.461776+0000","last_clean":"2024-05-09T09:50:59.461776+0000","last_became_active":"2024-05-09T09:47:18.233552+0000","last_became_peered":"2024-05-09T09:47:18.233552+0000","last_unstale":"2024-05-09T09:50:59.461776+0000","last_undegraded":"2024-05-09T09:50:59.461776+0000","last_fullsized":"2024-05-09T09:50:59.461776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'114","last_scrub_stamp":"2024-05-09T09:50:59.461590+0000","last_deep_scrub":"32'114","last_deep_scrub_stamp":"2024-05-09T09:50:59.461590+0000","last_clean_scrub_stamp":"2024-05-09T09:50:59.461590+0000","objects_scrubbed":5,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:45:09.985421+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:06.027400+0000","last_change":"2024-05-09T09:51:06.027552+0000","last_active":"2024-05-09T09:51:06.027400+0000","last_peered":"2024-05-09T09:51:06.027400+0000","last_clean":"2024-05-09T09:51:06.027400+0000","last_became_active":"2024-05-09T09:47:20.254083+0000","last_became_peered":"2024-05-09T09:47:20.254083+0000","last_unstale":"2024-05-09T09:51:06.027400+0000","last_undegraded":"2024-05-09T09:51:06.027400+0000","last_fullsized":"2024-05-09T09:51:06.027400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:06.027177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:06.027177+0000","last_clean_scrub_stamp":"2024-05-09T09:51:06.027177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:03:51.192288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:31.567933+0000","last_change":"2024-05-09T09:51:31.567995+0000","last_active":"2024-05-09T09:51:31.567933+0000","last_peered":"2024-05-09T09:51:31.567933+0000","last_clean":"2024-05-09T09:51:31.567933+0000","last_became_active":"2024-05-09T09:47:22.254386+0000","last_became_peered":"2024-05-09T09:47:22.254386+0000","last_unstale":"2024-05-09T09:51:31.567933+0000","last_undegraded":"2024-05-09T09:51:31.567933+0000","last_fullsized":"2024-05-09T09:51:31.567933+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:31.567738+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:31.567738+0000","last_clean_scrub_stamp":"2024-05-09T09:51:31.567738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:09:40.249232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'14","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:13.284595+0000","last_change":"2024-05-09T09:51:13.284595+0000","last_active":"2024-05-09T09:51:13.284595+0000","last_peered":"2024-05-09T09:51:13.284595+0000","last_clean":"2024-05-09T09:51:13.284595+0000","last_became_active":"2024-05-09T09:47:14.174998+0000","last_became_peered":"2024-05-09T09:47:14.174998+0000","last_unstale":"2024-05-09T09:51:13.284595+0000","last_undegraded":"2024-05-09T09:51:13.284595+0000","last_fullsized":"2024-05-09T09:51:13.284595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-05-09T09:51:13.284186+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-05-09T09:51:13.284186+0000","last_clean_scrub_stamp":"2024-05-09T09:51:13.284186+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:34:48.300341+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:26.238694+0000","last_change":"2024-05-09T09:51:26.238755+0000","last_active":"2024-05-09T09:51:26.238694+0000","last_peered":"2024-05-09T09:51:26.238694+0000","last_clean":"2024-05-09T09:51:26.238694+0000","last_became_active":"2024-05-09T09:47:12.192448+0000","last_became_peered":"2024-05-09T09:47:12.192448+0000","last_unstale":"2024-05-09T09:51:26.238694+0000","last_undegraded":"2024-05-09T09:51:26.238694+0000","last_fullsized":"2024-05-09T09:51:26.238694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:26.238496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:26.238496+0000","last_clean_scrub_stamp":"2024-05-09T09:51:26.238496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:14.639434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'12","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:15.130886+0000","last_change":"2024-05-09T09:51:15.130886+0000","last_active":"2024-05-09T09:51:15.130886+0000","last_peered":"2024-05-09T09:51:15.130886+0000","last_clean":"2024-05-09T09:51:15.130886+0000","last_became_active":"2024-05-09T09:47:14.188534+0000","last_became_peered":"2024-05-09T09:47:14.188534+0000","last_unstale":"2024-05-09T09:51:15.130886+0000","last_undegraded":"2024-05-09T09:51:15.130886+0000","last_fullsized":"2024-05-09T09:51:15.130886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-09T09:51:15.130629+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-09T09:51:15.130629+0000","last_clean_scrub_stamp":"2024-05-09T09:51:15.130629+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:21:10.701384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":54,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:37.298645+0000","last_change":"2024-05-09T09:51:37.298710+0000","last_active":"2024-05-09T09:51:37.298645+0000","last_peered":"2024-05-09T09:51:37.298645+0000","last_clean":"2024-05-09T09:51:37.298645+0000","last_became_active":"2024-05-09T09:47:12.184353+0000","last_became_peered":"2024-05-09T09:47:12.184353+0000","last_unstale":"2024-05-09T09:51:37.298645+0000","last_undegraded":"2024-05-09T09:51:37.298645+0000","last_fullsized":"2024-05-09T09:51:37.298645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:37.298447+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:37.298447+0000","last_clean_scrub_stamp":"2024-05-09T09:51:37.298447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:02:24.687092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:24.458824+0000","last_change":"2024-05-09T09:51:24.458824+0000","last_active":"2024-05-09T09:51:24.458824+0000","last_peered":"2024-05-09T09:51:24.458824+0000","last_clean":"2024-05-09T09:51:24.458824+0000","last_became_active":"2024-05-09T09:47:14.186689+0000","last_became_peered":"2024-05-09T09:47:14.186689+0000","last_unstale":"2024-05-09T09:51:24.458824+0000","last_undegraded":"2024-05-09T09:51:24.458824+0000","last_fullsized":"2024-05-09T09:51:24.458824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:24.458569+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:24.458569+0000","last_clean_scrub_stamp":"2024-05-09T09:51:24.458569+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:53:49.912270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.649621+0000","last_change":"2024-05-09T09:47:12.211787+0000","last_active":"2024-05-09T09:50:44.649621+0000","last_peered":"2024-05-09T09:50:44.649621+0000","last_clean":"2024-05-09T09:50:44.649621+0000","last_became_active":"2024-05-09T09:47:12.209633+0000","last_became_peered":"2024-05-09T09:47:12.209633+0000","last_unstale":"2024-05-09T09:50:44.649621+0000","last_undegraded":"2024-05-09T09:50:44.649621+0000","last_fullsized":"2024-05-09T09:50:44.649621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:11.046882+0000","last_change":"2024-05-09T09:51:11.046882+0000","last_active":"2024-05-09T09:51:11.046882+0000","last_peered":"2024-05-09T09:51:11.046882+0000","last_clean":"2024-05-09T09:51:11.046882+0000","last_became_active":"2024-05-09T09:47:14.193366+0000","last_became_peered":"2024-05-09T09:47:14.193366+0000","last_unstale":"2024-05-09T09:51:11.046882+0000","last_undegraded":"2024-05-09T09:51:11.046882+0000","last_fullsized":"2024-05-09T09:51:11.046882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:11.046623+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:11.046623+0000","last_clean_scrub_stamp":"2024-05-09T09:51:11.046623+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:34:07.870070+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:19.202106+0000","last_change":"2024-05-09T09:51:19.202106+0000","last_active":"2024-05-09T09:51:19.202106+0000","last_peered":"2024-05-09T09:51:19.202106+0000","last_clean":"2024-05-09T09:51:19.202106+0000","last_became_active":"2024-05-09T09:47:12.214019+0000","last_became_peered":"2024-05-09T09:47:12.214019+0000","last_unstale":"2024-05-09T09:51:19.202106+0000","last_undegraded":"2024-05-09T09:51:19.202106+0000","last_fullsized":"2024-05-09T09:51:19.202106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:19.201848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:19.201848+0000","last_clean_scrub_stamp":"2024-05-09T09:51:19.201848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:30:31.069764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:40.294522+0000","last_change":"2024-05-09T09:51:40.294585+0000","last_active":"2024-05-09T09:51:40.294522+0000","last_peered":"2024-05-09T09:51:40.294522+0000","last_clean":"2024-05-09T09:51:40.294522+0000","last_became_active":"2024-05-09T09:47:14.181824+0000","last_became_peered":"2024-05-09T09:47:14.181824+0000","last_unstale":"2024-05-09T09:51:40.294522+0000","last_undegraded":"2024-05-09T09:51:40.294522+0000","last_fullsized":"2024-05-09T09:51:40.294522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:40.294309+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:40.294309+0000","last_clean_scrub_stamp":"2024-05-09T09:51:40.294309+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:56.173489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:27.323249+0000","last_change":"2024-05-09T09:51:27.323249+0000","last_active":"2024-05-09T09:51:27.323249+0000","last_peered":"2024-05-09T09:51:27.323249+0000","last_clean":"2024-05-09T09:51:27.323249+0000","last_became_active":"2024-05-09T09:47:12.204322+0000","last_became_peered":"2024-05-09T09:47:12.204322+0000","last_unstale":"2024-05-09T09:51:27.323249+0000","last_undegraded":"2024-05-09T09:51:27.323249+0000","last_fullsized":"2024-05-09T09:51:27.323249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:27.322986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:27.322986+0000","last_clean_scrub_stamp":"2024-05-09T09:51:27.322986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:11:11.637533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:11.318592+0000","last_change":"2024-05-09T09:51:11.318592+0000","last_active":"2024-05-09T09:51:11.318592+0000","last_peered":"2024-05-09T09:51:11.318592+0000","last_clean":"2024-05-09T09:51:11.318592+0000","last_became_active":"2024-05-09T09:47:14.178503+0000","last_became_peered":"2024-05-09T09:47:14.178503+0000","last_unstale":"2024-05-09T09:51:11.318592+0000","last_undegraded":"2024-05-09T09:51:11.318592+0000","last_fullsized":"2024-05-09T09:51:11.318592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:11.318334+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:11.318334+0000","last_clean_scrub_stamp":"2024-05-09T09:51:11.318334+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:48:38.508221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"30'2","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:35.220050+0000","last_change":"2024-05-09T09:51:35.220206+0000","last_active":"2024-05-09T09:51:35.220050+0000","last_peered":"2024-05-09T09:51:35.220050+0000","last_clean":"2024-05-09T09:51:35.220050+0000","last_became_active":"2024-05-09T09:47:12.196120+0000","last_became_peered":"2024-05-09T09:47:12.196120+0000","last_unstale":"2024-05-09T09:51:35.220050+0000","last_undegraded":"2024-05-09T09:51:35.220050+0000","last_fullsized":"2024-05-09T09:51:35.220050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-09T09:51:35.219793+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-09T09:51:35.219793+0000","last_clean_scrub_stamp":"2024-05-09T09:51:35.219793+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:58.666048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:26.352885+0000","last_change":"2024-05-09T09:51:26.352954+0000","last_active":"2024-05-09T09:51:26.352885+0000","last_peered":"2024-05-09T09:51:26.352885+0000","last_clean":"2024-05-09T09:51:26.352885+0000","last_became_active":"2024-05-09T09:47:14.176615+0000","last_became_peered":"2024-05-09T09:47:14.176615+0000","last_unstale":"2024-05-09T09:51:26.352885+0000","last_undegraded":"2024-05-09T09:51:26.352885+0000","last_fullsized":"2024-05-09T09:51:26.352885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:26.352681+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:26.352681+0000","last_clean_scrub_stamp":"2024-05-09T09:51:26.352681+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:58:17.301653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:13.464266+0000","last_change":"2024-05-09T09:51:13.464266+0000","last_active":"2024-05-09T09:51:13.464266+0000","last_peered":"2024-05-09T09:51:13.464266+0000","last_clean":"2024-05-09T09:51:13.464266+0000","last_became_active":"2024-05-09T09:47:12.209171+0000","last_became_peered":"2024-05-09T09:47:12.209171+0000","last_unstale":"2024-05-09T09:51:13.464266+0000","last_undegraded":"2024-05-09T09:51:13.464266+0000","last_fullsized":"2024-05-09T09:51:13.464266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:13.463897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:13.463897+0000","last_clean_scrub_stamp":"2024-05-09T09:51:13.463897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:36:06.810856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:26.295234+0000","last_change":"2024-05-09T09:51:26.295289+0000","last_active":"2024-05-09T09:51:26.295234+0000","last_peered":"2024-05-09T09:51:26.295234+0000","last_clean":"2024-05-09T09:51:26.295234+0000","last_became_active":"2024-05-09T09:47:14.177119+0000","last_became_peered":"2024-05-09T09:47:14.177119+0000","last_unstale":"2024-05-09T09:51:26.295234+0000","last_undegraded":"2024-05-09T09:51:26.295234+0000","last_fullsized":"2024-05-09T09:51:26.295234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:26.295031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:26.295031+0000","last_clean_scrub_stamp":"2024-05-09T09:51:26.295031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:28:18.150394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:35.259996+0000","last_change":"2024-05-09T09:51:35.260058+0000","last_active":"2024-05-09T09:51:35.259996+0000","last_peered":"2024-05-09T09:51:35.259996+0000","last_clean":"2024-05-09T09:51:35.259996+0000","last_became_active":"2024-05-09T09:47:12.184105+0000","last_became_peered":"2024-05-09T09:47:12.184105+0000","last_unstale":"2024-05-09T09:51:35.259996+0000","last_undegraded":"2024-05-09T09:51:35.259996+0000","last_fullsized":"2024-05-09T09:51:35.259996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:35.259799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:35.259799+0000","last_clean_scrub_stamp":"2024-05-09T09:51:35.259799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:03:53.899773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'2","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:07.275958+0000","last_change":"2024-05-09T09:51:07.276039+0000","last_active":"2024-05-09T09:51:07.275958+0000","last_peered":"2024-05-09T09:51:07.275958+0000","last_clean":"2024-05-09T09:51:07.275958+0000","last_became_active":"2024-05-09T09:47:14.182961+0000","last_became_peered":"2024-05-09T09:47:14.182961+0000","last_unstale":"2024-05-09T09:51:07.275958+0000","last_undegraded":"2024-05-09T09:51:07.275958+0000","last_fullsized":"2024-05-09T09:51:07.275958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:07.275721+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:07.275721+0000","last_clean_scrub_stamp":"2024-05-09T09:51:07.275721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:48:18.587139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.649712+0000","last_change":"2024-05-09T09:47:12.206940+0000","last_active":"2024-05-09T09:50:44.649712+0000","last_peered":"2024-05-09T09:50:44.649712+0000","last_clean":"2024-05-09T09:50:44.649712+0000","last_became_active":"2024-05-09T09:47:12.201952+0000","last_became_peered":"2024-05-09T09:47:12.201952+0000","last_unstale":"2024-05-09T09:50:44.649712+0000","last_undegraded":"2024-05-09T09:50:44.649712+0000","last_fullsized":"2024-05-09T09:50:44.649712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:00.474004+0000","last_change":"2024-05-09T09:51:00.474068+0000","last_active":"2024-05-09T09:51:00.474004+0000","last_peered":"2024-05-09T09:51:00.474004+0000","last_clean":"2024-05-09T09:51:00.474004+0000","last_became_active":"2024-05-09T09:47:14.193421+0000","last_became_peered":"2024-05-09T09:47:14.193421+0000","last_unstale":"2024-05-09T09:51:00.474004+0000","last_undegraded":"2024-05-09T09:51:00.474004+0000","last_fullsized":"2024-05-09T09:51:00.474004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:00.473817+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:00.473817+0000","last_clean_scrub_stamp":"2024-05-09T09:51:00.473817+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:20:56.044572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'4","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:23.303971+0000","last_change":"2024-05-09T09:51:23.303971+0000","last_active":"2024-05-09T09:51:23.303971+0000","last_peered":"2024-05-09T09:51:23.303971+0000","last_clean":"2024-05-09T09:51:23.303971+0000","last_became_active":"2024-05-09T09:47:12.203523+0000","last_became_peered":"2024-05-09T09:47:12.203523+0000","last_unstale":"2024-05-09T09:51:23.303971+0000","last_undegraded":"2024-05-09T09:51:23.303971+0000","last_fullsized":"2024-05-09T09:51:23.303971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:23.303622+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:23.303622+0000","last_clean_scrub_stamp":"2024-05-09T09:51:23.303622+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:42:02.620894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:16.166971+0000","last_change":"2024-05-09T09:51:16.166971+0000","last_active":"2024-05-09T09:51:16.166971+0000","last_peered":"2024-05-09T09:51:16.166971+0000","last_clean":"2024-05-09T09:51:16.166971+0000","last_became_active":"2024-05-09T09:47:14.171565+0000","last_became_peered":"2024-05-09T09:47:14.171565+0000","last_unstale":"2024-05-09T09:51:16.166971+0000","last_undegraded":"2024-05-09T09:51:16.166971+0000","last_fullsized":"2024-05-09T09:51:16.166971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:16.166561+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:16.166561+0000","last_clean_scrub_stamp":"2024-05-09T09:51:16.166561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:37:36.427827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:33.207649+0000","last_change":"2024-05-09T09:51:33.207783+0000","last_active":"2024-05-09T09:51:33.207649+0000","last_peered":"2024-05-09T09:51:33.207649+0000","last_clean":"2024-05-09T09:51:33.207649+0000","last_became_active":"2024-05-09T09:47:12.192462+0000","last_became_peered":"2024-05-09T09:47:12.192462+0000","last_unstale":"2024-05-09T09:51:33.207649+0000","last_undegraded":"2024-05-09T09:51:33.207649+0000","last_fullsized":"2024-05-09T09:51:33.207649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:33.207312+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:33.207312+0000","last_clean_scrub_stamp":"2024-05-09T09:51:33.207312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:28:11.973689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:28.290371+0000","last_change":"2024-05-09T09:51:28.290430+0000","last_active":"2024-05-09T09:51:28.290371+0000","last_peered":"2024-05-09T09:51:28.290371+0000","last_clean":"2024-05-09T09:51:28.290371+0000","last_became_active":"2024-05-09T09:47:14.176986+0000","last_became_peered":"2024-05-09T09:47:14.176986+0000","last_unstale":"2024-05-09T09:51:28.290371+0000","last_undegraded":"2024-05-09T09:51:28.290371+0000","last_fullsized":"2024-05-09T09:51:28.290371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:28.290172+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:28.290172+0000","last_clean_scrub_stamp":"2024-05-09T09:51:28.290172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:15:50.005621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:29.243133+0000","last_change":"2024-05-09T09:51:29.243256+0000","last_active":"2024-05-09T09:51:29.243133+0000","last_peered":"2024-05-09T09:51:29.243133+0000","last_clean":"2024-05-09T09:51:29.243133+0000","last_became_active":"2024-05-09T09:47:12.205416+0000","last_became_peered":"2024-05-09T09:47:12.205416+0000","last_unstale":"2024-05-09T09:51:29.243133+0000","last_undegraded":"2024-05-09T09:51:29.243133+0000","last_fullsized":"2024-05-09T09:51:29.243133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:29.242902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:29.242902+0000","last_clean_scrub_stamp":"2024-05-09T09:51:29.242902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:27:32.401344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:10.327555+0000","last_change":"2024-05-09T09:51:10.327719+0000","last_active":"2024-05-09T09:51:10.327555+0000","last_peered":"2024-05-09T09:51:10.327555+0000","last_clean":"2024-05-09T09:51:10.327555+0000","last_became_active":"2024-05-09T09:47:14.182248+0000","last_became_peered":"2024-05-09T09:47:14.182248+0000","last_unstale":"2024-05-09T09:51:10.327555+0000","last_undegraded":"2024-05-09T09:51:10.327555+0000","last_fullsized":"2024-05-09T09:51:10.327555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:10.327288+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:10.327288+0000","last_clean_scrub_stamp":"2024-05-09T09:51:10.327288+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:19:34.184047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:40.083948+0000","last_change":"2024-05-09T09:47:12.208127+0000","last_active":"2024-05-09T09:50:40.083948+0000","last_peered":"2024-05-09T09:50:40.083948+0000","last_clean":"2024-05-09T09:50:40.083948+0000","last_became_active":"2024-05-09T09:47:12.200127+0000","last_became_peered":"2024-05-09T09:47:12.200127+0000","last_unstale":"2024-05-09T09:50:40.083948+0000","last_undegraded":"2024-05-09T09:50:40.083948+0000","last_fullsized":"2024-05-09T09:50:40.083948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:05.273620+0000","last_change":"2024-05-09T09:51:05.273679+0000","last_active":"2024-05-09T09:51:05.273620+0000","last_peered":"2024-05-09T09:51:05.273620+0000","last_clean":"2024-05-09T09:51:05.273620+0000","last_became_active":"2024-05-09T09:47:14.190033+0000","last_became_peered":"2024-05-09T09:47:14.190033+0000","last_unstale":"2024-05-09T09:51:05.273620+0000","last_undegraded":"2024-05-09T09:51:05.273620+0000","last_fullsized":"2024-05-09T09:51:05.273620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:05.273418+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:05.273418+0000","last_clean_scrub_stamp":"2024-05-09T09:51:05.273418+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:59:24.394431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:30.174791+0000","last_change":"2024-05-09T09:47:12.208249+0000","last_active":"2024-05-09T09:49:30.174791+0000","last_peered":"2024-05-09T09:49:30.174791+0000","last_clean":"2024-05-09T09:49:30.174791+0000","last_became_active":"2024-05-09T09:47:12.203424+0000","last_became_peered":"2024-05-09T09:47:12.203424+0000","last_unstale":"2024-05-09T09:49:30.174791+0000","last_undegraded":"2024-05-09T09:49:30.174791+0000","last_fullsized":"2024-05-09T09:49:30.174791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:25.488624+0000","last_change":"2024-05-09T09:51:25.488693+0000","last_active":"2024-05-09T09:51:25.488624+0000","last_peered":"2024-05-09T09:51:25.488624+0000","last_clean":"2024-05-09T09:51:25.488624+0000","last_became_active":"2024-05-09T09:47:14.186711+0000","last_became_peered":"2024-05-09T09:47:14.186711+0000","last_unstale":"2024-05-09T09:51:25.488624+0000","last_undegraded":"2024-05-09T09:51:25.488624+0000","last_fullsized":"2024-05-09T09:51:25.488624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:25.488447+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:25.488447+0000","last_clean_scrub_stamp":"2024-05-09T09:51:25.488447+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:56:25.287354+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:17.400143+0000","last_change":"2024-05-09T09:51:17.400209+0000","last_active":"2024-05-09T09:51:17.400143+0000","last_peered":"2024-05-09T09:51:17.400143+0000","last_clean":"2024-05-09T09:51:17.400143+0000","last_became_active":"2024-05-09T09:47:12.205320+0000","last_became_peered":"2024-05-09T09:47:12.205320+0000","last_unstale":"2024-05-09T09:51:17.400143+0000","last_undegraded":"2024-05-09T09:51:17.400143+0000","last_fullsized":"2024-05-09T09:51:17.400143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:17.399927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:17.399927+0000","last_clean_scrub_stamp":"2024-05-09T09:51:17.399927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:34:56.092455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:38.212465+0000","last_change":"2024-05-09T09:51:38.212529+0000","last_active":"2024-05-09T09:51:38.212465+0000","last_peered":"2024-05-09T09:51:38.212465+0000","last_clean":"2024-05-09T09:51:38.212465+0000","last_became_active":"2024-05-09T09:47:14.177955+0000","last_became_peered":"2024-05-09T09:47:14.177955+0000","last_unstale":"2024-05-09T09:51:38.212465+0000","last_undegraded":"2024-05-09T09:51:38.212465+0000","last_fullsized":"2024-05-09T09:51:38.212465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-09T09:51:38.212277+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-09T09:51:38.212277+0000","last_clean_scrub_stamp":"2024-05-09T09:51:38.212277+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:36:25.679596+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:35.176255+0000","last_change":"2024-05-09T09:47:12.202337+0000","last_active":"2024-05-09T09:49:35.176255+0000","last_peered":"2024-05-09T09:49:35.176255+0000","last_clean":"2024-05-09T09:49:35.176255+0000","last_became_active":"2024-05-09T09:47:12.201790+0000","last_became_peered":"2024-05-09T09:47:12.201790+0000","last_unstale":"2024-05-09T09:49:35.176255+0000","last_undegraded":"2024-05-09T09:49:35.176255+0000","last_fullsized":"2024-05-09T09:49:35.176255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:33.136122+0000","last_change":"2024-05-09T09:47:12.207600+0000","last_active":"2024-05-09T09:50:33.136122+0000","last_peered":"2024-05-09T09:50:33.136122+0000","last_clean":"2024-05-09T09:50:33.136122+0000","last_became_active":"2024-05-09T09:47:12.203435+0000","last_became_peered":"2024-05-09T09:47:12.203435+0000","last_unstale":"2024-05-09T09:50:33.136122+0000","last_undegraded":"2024-05-09T09:50:33.136122+0000","last_fullsized":"2024-05-09T09:50:33.136122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:11.127026+0000","last_clean_scrub_stamp":"2024-05-09T09:47:11.127026+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:30.272434+0000","last_change":"2024-05-09T09:51:30.272514+0000","last_active":"2024-05-09T09:51:30.272434+0000","last_peered":"2024-05-09T09:51:30.272434+0000","last_clean":"2024-05-09T09:51:30.272434+0000","last_became_active":"2024-05-09T09:47:14.178142+0000","last_became_peered":"2024-05-09T09:47:14.178142+0000","last_unstale":"2024-05-09T09:51:30.272434+0000","last_undegraded":"2024-05-09T09:51:30.272434+0000","last_fullsized":"2024-05-09T09:51:30.272434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:30.272229+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:30.272229+0000","last_clean_scrub_stamp":"2024-05-09T09:51:30.272229+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:37:34.451434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:21.278268+0000","last_change":"2024-05-09T09:51:21.278372+0000","last_active":"2024-05-09T09:51:21.278268+0000","last_peered":"2024-05-09T09:51:21.278268+0000","last_clean":"2024-05-09T09:51:21.278268+0000","last_became_active":"2024-05-09T09:47:12.205216+0000","last_became_peered":"2024-05-09T09:47:12.205216+0000","last_unstale":"2024-05-09T09:51:21.278268+0000","last_undegraded":"2024-05-09T09:51:21.278268+0000","last_fullsized":"2024-05-09T09:51:21.278268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:21.278009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:21.278009+0000","last_clean_scrub_stamp":"2024-05-09T09:51:21.278009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:28:18.321440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'12","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:20.318142+0000","last_change":"2024-05-09T09:51:20.318209+0000","last_active":"2024-05-09T09:51:20.318142+0000","last_peered":"2024-05-09T09:51:20.318142+0000","last_clean":"2024-05-09T09:51:20.318142+0000","last_became_active":"2024-05-09T09:47:14.174123+0000","last_became_peered":"2024-05-09T09:47:14.174123+0000","last_unstale":"2024-05-09T09:51:20.318142+0000","last_undegraded":"2024-05-09T09:51:20.318142+0000","last_fullsized":"2024-05-09T09:51:20.318142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-09T09:51:20.317917+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-09T09:51:20.317917+0000","last_clean_scrub_stamp":"2024-05-09T09:51:20.317917+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:08:14.769747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":274,"ondisk_log_size":274,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3894,"ondisk_log_size":3894,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1628,"num_read_kb":1518,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705723,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35792,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336048,"statfs":{"total":96636764160,"available":96600113152,"internally_reserved":0,"allocated":466944,"data_stored":146615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705726,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":995328,"data_stored":734132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705723,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1011712,"data_stored":733627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705725,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35760,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336080,"statfs":{"total":96636764160,"available":96600145920,"internally_reserved":0,"allocated":434176,"data_stored":145588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T09:51:46.291 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.291 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.291 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.291 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.291 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.292 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.292 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.292 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.292 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.292 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.292 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.293 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.293 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.293 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.293 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.293 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-09T09:47:02.030833+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=2, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.294 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-09T09:47:02.030833+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=2, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.294 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.294 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-09T09:47:02.030833+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=2, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.294 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.294 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-09T09:47:13.146551+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=13, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.294 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-09T09:47:02.030833+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=2, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.295 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.295 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.295 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.295 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-09T09:47:02.030833+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=2, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.295 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.295 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.296 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.296 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.296 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.296 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.297 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.297 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.297 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.297 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.297 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.297 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-09T09:47:11.127026+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=11, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:51:46.298 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-09T09:52:06.298 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T09:52:06.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.422+0000 7fa6e4a9b640 1 Processor -- start 2024-05-09T09:52:06.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.422+0000 7fa6e4a9b640 1 -- start start 2024-05-09T09:52:06.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.422+0000 7fa6e4a9b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa6e012f180 0x7fa6e012f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:52:06.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.422+0000 7fa6e4a9b640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6e00734a0 con 0x7fa6e012faa0 2024-05-09T09:52:06.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.422+0000 7fa6e4a9b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fa6e0096ee0 con 0x7fa6e012f180 2024-05-09T09:52:06.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.426+0000 7fa6de59c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa6e012f180 0x7fa6e012f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:52:06.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.426+0000 7fa6d5d9b640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa6e012faa0 0x7fa6e0094390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:49740/0 (socket says 172.21.15.110:49740) 2024-05-09T09:52:06.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.426+0000 7fa6d5d9b640 1 -- 172.21.15.110:0/136378888 learned_addr learned my addr 172.21.15.110:0/136378888 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:52:06.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.426+0000 7fa6de59c640 1 -- 172.21.15.110:0/136378888 >> v1:172.21.15.110:6789/0 conn(0x7fa6e012faa0 legacy=0x7fa6e0094390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:52:06.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.426+0000 7fa6de59c640 1 -- 172.21.15.110:0/136378888 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6e0094aa0 con 0x7fa6e012f180 2024-05-09T09:52:06.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.426+0000 7fa6de59c640 1 --2- 172.21.15.110:0/136378888 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6e012f180 0x7fa6e012f560 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0009740 tx=0x7fa6d001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1af7f8822fd8fa8a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:52:06.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.426+0000 7fa6ddd9b640 1 -- 172.21.15.110:0/136378888 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6d00b0070 con 0x7fa6e012f180 2024-05-09T09:52:06.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.426+0000 7fa6ddd9b640 1 -- 172.21.15.110:0/136378888 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6d00ab530 con 0x7fa6e012f180 2024-05-09T09:52:06.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.426+0000 7fa6ddd9b640 1 -- 172.21.15.110:0/136378888 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6d00ab830 con 0x7fa6e012f180 2024-05-09T09:52:06.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.426+0000 7fa6e4a9b640 1 -- 172.21.15.110:0/136378888 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6e012f180 msgr2=0x7fa6e012f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:52:06.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.426+0000 7fa6e4a9b640 1 --2- 172.21.15.110:0/136378888 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6e012f180 0x7fa6e012f560 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0009740 tx=0x7fa6d001c400 comp rx=0 tx=0).stop 2024-05-09T09:52:06.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.426+0000 7fa6e4a9b640 1 -- 172.21.15.110:0/136378888 shutdown_connections 2024-05-09T09:52:06.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.426+0000 7fa6e4a9b640 1 --2- 172.21.15.110:0/136378888 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6e012f180 0x7fa6e012f560 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:52:06.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.426+0000 7fa6e4a9b640 1 -- 172.21.15.110:0/136378888 >> 172.21.15.110:0/136378888 conn(0x7fa6e009ad20 msgr2=0x7fa6e009b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:52:06.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.426+0000 7fa6e4a9b640 1 -- 172.21.15.110:0/136378888 shutdown_connections 2024-05-09T09:52:06.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.426+0000 7fa6e4a9b640 1 -- 172.21.15.110:0/136378888 wait complete. 2024-05-09T09:52:06.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.430+0000 7fa6e4a9b640 1 Processor -- start 2024-05-09T09:52:06.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.430+0000 7fa6e4a9b640 1 -- start start 2024-05-09T09:52:06.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.430+0000 7fa6e4a9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6e012f180 0x7fa6e006f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:52:06.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.430+0000 7fa6e4a9b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e0137210 con 0x7fa6e012f180 2024-05-09T09:52:06.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.430+0000 7fa6de59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6e012f180 0x7fa6e006f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:52:06.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.430+0000 7fa6de59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6e012f180 0x7fa6e006f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39984/0 (socket says 172.21.15.110:39984) 2024-05-09T09:52:06.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.430+0000 7fa6de59c640 1 -- 172.21.15.110:0/111212022 learned_addr learned my addr 172.21.15.110:0/111212022 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:52:06.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.430+0000 7fa6de59c640 1 -- 172.21.15.110:0/111212022 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6e0092960 con 0x7fa6e012f180 2024-05-09T09:52:06.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.430+0000 7fa6de59c640 1 --2- 172.21.15.110:0/111212022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6e012f180 0x7fa6e006f1e0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00ae040 tx=0x7fa6d00191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:52:06.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.430+0000 7fa6d77fe640 1 -- 172.21.15.110:0/111212022 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6d00b8020 con 0x7fa6e012f180 2024-05-09T09:52:06.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.430+0000 7fa6d77fe640 1 -- 172.21.15.110:0/111212022 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6d00aa6d0 con 0x7fa6e012f180 2024-05-09T09:52:06.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.430+0000 7fa6e4a9b640 1 -- 172.21.15.110:0/111212022 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6e0072bd0 con 0x7fa6e012f180 2024-05-09T09:52:06.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.430+0000 7fa6d77fe640 1 -- 172.21.15.110:0/111212022 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6d00b0040 con 0x7fa6e012f180 2024-05-09T09:52:06.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.430+0000 7fa6e4a9b640 1 -- 172.21.15.110:0/111212022 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6e0071850 con 0x7fa6e012f180 2024-05-09T09:52:06.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.430+0000 7fa6e4a9b640 1 -- 172.21.15.110:0/111212022 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6e0063710 con 0x7fa6e012f180 2024-05-09T09:52:06.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.430+0000 7fa6d77fe640 1 -- 172.21.15.110:0/111212022 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7fa6d00bb020 con 0x7fa6e012f180 2024-05-09T09:52:06.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.430+0000 7fa6d77fe640 1 --2- 172.21.15.110:0/111212022 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa6c0036310 0x7fa6c00387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:52:06.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.430+0000 7fa6d77fe640 1 -- 172.21.15.110:0/111212022 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7fa6d00e3ac0 con 0x7fa6e012f180 2024-05-09T09:52:06.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.430+0000 7fa6d5d9b640 1 --2- 172.21.15.110:0/111212022 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa6c0036310 0x7fa6c00387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:52:06.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.434+0000 7fa6d5d9b640 1 --2- 172.21.15.110:0/111212022 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa6c0036310 0x7fa6c00387d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8000f70 tx=0x7fa6c8007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:52:06.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.434+0000 7fa6d77fe640 1 -- 172.21.15.110:0/111212022 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa6d00c2030 con 0x7fa6e012f180 2024-05-09T09:52:06.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.590+0000 7fa6e4a9b640 1 -- 172.21.15.110:0/111212022 --> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa6e0070be0 con 0x7fa6c0036310 2024-05-09T09:52:06.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.638+0000 7fa6d77fe640 1 -- 172.21.15.110:0/111212022 <== mgr.4100 v2:172.21.15.157:6824/2765519551 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666266 (secure 0 0 0) 0x7fa6e0070be0 con 0x7fa6c0036310 2024-05-09T09:52:06.643 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:52:06.653 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-05-09T09:52:06.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.646+0000 7fa6e4a9b640 1 -- 172.21.15.110:0/111212022 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa6c0036310 msgr2=0x7fa6c00387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:52:06.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.646+0000 7fa6e4a9b640 1 --2- 172.21.15.110:0/111212022 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa6c0036310 0x7fa6c00387d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8000f70 tx=0x7fa6c8007a90 comp rx=0 tx=0).stop 2024-05-09T09:52:06.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.646+0000 7fa6e4a9b640 1 -- 172.21.15.110:0/111212022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6e012f180 msgr2=0x7fa6e006f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:52:06.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.646+0000 7fa6e4a9b640 1 --2- 172.21.15.110:0/111212022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6e012f180 0x7fa6e006f1e0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00ae040 tx=0x7fa6d00191a0 comp rx=0 tx=0).stop 2024-05-09T09:52:06.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.646+0000 7fa6e4a9b640 1 -- 172.21.15.110:0/111212022 shutdown_connections 2024-05-09T09:52:06.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.646+0000 7fa6e4a9b640 1 --2- 172.21.15.110:0/111212022 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7fa6c0036310 0x7fa6c00387d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:52:06.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.646+0000 7fa6e4a9b640 1 --2- 172.21.15.110:0/111212022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6e012f180 0x7fa6e006f1e0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:52:06.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.646+0000 7fa6e4a9b640 1 -- 172.21.15.110:0/111212022 >> 172.21.15.110:0/111212022 conn(0x7fa6e009ad20 msgr2=0x7fa6e01301d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:52:06.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.646+0000 7fa6e4a9b640 1 -- 172.21.15.110:0/111212022 shutdown_connections 2024-05-09T09:52:06.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:06.646+0000 7fa6e4a9b640 1 -- 172.21.15.110:0/111212022 wait complete. 2024-05-09T09:52:06.669 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-05-09T09:52:05.219145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5118,"num_read_kb":4699,"num_write":2179,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7156,"ondisk_log_size":7156,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":135864,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377351496,"statfs":{"total":386547056640,"available":386407931904,"internally_reserved":0,"allocated":2908160,"data_stored":1759962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005584"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:19.312716+0000","last_change":"2024-05-09T09:51:19.312716+0000","last_active":"2024-05-09T09:51:19.312716+0000","last_peered":"2024-05-09T09:51:19.312716+0000","last_clean":"2024-05-09T09:51:19.312716+0000","last_became_active":"2024-05-09T09:47:12.205786+0000","last_became_peered":"2024-05-09T09:47:12.205786+0000","last_unstale":"2024-05-09T09:51:19.312716+0000","last_undegraded":"2024-05-09T09:51:19.312716+0000","last_fullsized":"2024-05-09T09:51:19.312716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:19.312429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:19.312429+0000","last_clean_scrub_stamp":"2024-05-09T09:51:19.312429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:04:04.477540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:17.286142+0000","last_change":"2024-05-09T09:51:17.286281+0000","last_active":"2024-05-09T09:51:17.286142+0000","last_peered":"2024-05-09T09:51:17.286142+0000","last_clean":"2024-05-09T09:51:17.286142+0000","last_became_active":"2024-05-09T09:47:14.171044+0000","last_became_peered":"2024-05-09T09:47:14.171044+0000","last_unstale":"2024-05-09T09:51:17.286142+0000","last_undegraded":"2024-05-09T09:51:17.286142+0000","last_fullsized":"2024-05-09T09:51:17.286142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:17.285919+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:17.285919+0000","last_clean_scrub_stamp":"2024-05-09T09:51:17.285919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:38:58.303485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:31.265736+0000","last_change":"2024-05-09T09:51:31.265802+0000","last_active":"2024-05-09T09:51:31.265736+0000","last_peered":"2024-05-09T09:51:31.265736+0000","last_clean":"2024-05-09T09:51:31.265736+0000","last_became_active":"2024-05-09T09:47:12.189774+0000","last_became_peered":"2024-05-09T09:47:12.189774+0000","last_unstale":"2024-05-09T09:51:31.265736+0000","last_undegraded":"2024-05-09T09:51:31.265736+0000","last_fullsized":"2024-05-09T09:51:31.265736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:31.265537+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:31.265537+0000","last_clean_scrub_stamp":"2024-05-09T09:51:31.265537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:45:33.707959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:58.498693+0000","last_change":"2024-05-09T09:50:58.498826+0000","last_active":"2024-05-09T09:50:58.498693+0000","last_peered":"2024-05-09T09:50:58.498693+0000","last_clean":"2024-05-09T09:50:58.498693+0000","last_became_active":"2024-05-09T09:47:14.192803+0000","last_became_peered":"2024-05-09T09:47:14.192803+0000","last_unstale":"2024-05-09T09:50:58.498693+0000","last_undegraded":"2024-05-09T09:50:58.498693+0000","last_fullsized":"2024-05-09T09:50:58.498693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-09T09:50:58.498439+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-09T09:50:58.498439+0000","last_clean_scrub_stamp":"2024-05-09T09:50:58.498439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:24.753930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"32'3","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:39.539536+0000","last_change":"2024-05-09T09:51:39.539606+0000","last_active":"2024-05-09T09:51:39.539536+0000","last_peered":"2024-05-09T09:51:39.539536+0000","last_clean":"2024-05-09T09:51:39.539536+0000","last_became_active":"2024-05-09T09:47:12.207184+0000","last_became_peered":"2024-05-09T09:47:12.207184+0000","last_unstale":"2024-05-09T09:51:39.539536+0000","last_undegraded":"2024-05-09T09:51:39.539536+0000","last_fullsized":"2024-05-09T09:51:39.539536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-09T09:51:39.539316+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-09T09:51:39.539316+0000","last_clean_scrub_stamp":"2024-05-09T09:51:39.539316+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:18:24.181972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'14","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:02.473931+0000","last_change":"2024-05-09T09:51:02.473990+0000","last_active":"2024-05-09T09:51:02.473931+0000","last_peered":"2024-05-09T09:51:02.473931+0000","last_clean":"2024-05-09T09:51:02.473931+0000","last_became_active":"2024-05-09T09:47:14.192821+0000","last_became_peered":"2024-05-09T09:47:14.192821+0000","last_unstale":"2024-05-09T09:51:02.473931+0000","last_undegraded":"2024-05-09T09:51:02.473931+0000","last_fullsized":"2024-05-09T09:51:02.473931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-05-09T09:51:02.473728+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-05-09T09:51:02.473728+0000","last_clean_scrub_stamp":"2024-05-09T09:51:02.473728+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:32.374501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:28.190192+0000","last_change":"2024-05-09T09:51:28.190303+0000","last_active":"2024-05-09T09:51:28.190192+0000","last_peered":"2024-05-09T09:51:28.190192+0000","last_clean":"2024-05-09T09:51:28.190192+0000","last_became_active":"2024-05-09T09:47:12.194183+0000","last_became_peered":"2024-05-09T09:47:12.194183+0000","last_unstale":"2024-05-09T09:51:28.190192+0000","last_undegraded":"2024-05-09T09:51:28.190192+0000","last_fullsized":"2024-05-09T09:51:28.190192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:28.189983+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:28.189983+0000","last_clean_scrub_stamp":"2024-05-09T09:51:28.189983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:47:28.328562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'12","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:39.260166+0000","last_change":"2024-05-09T09:51:39.260319+0000","last_active":"2024-05-09T09:51:39.260166+0000","last_peered":"2024-05-09T09:51:39.260166+0000","last_clean":"2024-05-09T09:51:39.260166+0000","last_became_active":"2024-05-09T09:47:52.429940+0000","last_became_peered":"2024-05-09T09:47:52.429940+0000","last_unstale":"2024-05-09T09:51:39.260166+0000","last_undegraded":"2024-05-09T09:51:39.260166+0000","last_fullsized":"2024-05-09T09:51:39.260166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-09T09:51:39.259883+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-09T09:51:39.259883+0000","last_clean_scrub_stamp":"2024-05-09T09:51:39.259883+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:48.460976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:51.518497+0000","last_change":"2024-05-09T09:51:51.518559+0000","last_active":"2024-05-09T09:51:51.518497+0000","last_peered":"2024-05-09T09:51:51.518497+0000","last_clean":"2024-05-09T09:51:51.518497+0000","last_became_active":"2024-05-09T09:47:12.204446+0000","last_became_peered":"2024-05-09T09:47:12.204446+0000","last_unstale":"2024-05-09T09:51:51.518497+0000","last_undegraded":"2024-05-09T09:51:51.518497+0000","last_fullsized":"2024-05-09T09:51:51.518497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:51.518284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:51.518284+0000","last_clean_scrub_stamp":"2024-05-09T09:51:51.518284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:38:07.006781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'16","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:09.303305+0000","last_change":"2024-05-09T09:51:09.303305+0000","last_active":"2024-05-09T09:51:09.303305+0000","last_peered":"2024-05-09T09:51:09.303305+0000","last_clean":"2024-05-09T09:51:09.303305+0000","last_became_active":"2024-05-09T09:47:14.184792+0000","last_became_peered":"2024-05-09T09:47:14.184792+0000","last_unstale":"2024-05-09T09:51:09.303305+0000","last_undegraded":"2024-05-09T09:51:09.303305+0000","last_fullsized":"2024-05-09T09:51:09.303305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-05-09T09:51:09.303051+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-05-09T09:51:09.303051+0000","last_clean_scrub_stamp":"2024-05-09T09:51:09.303051+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:45:33.303026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'4","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:30.227495+0000","last_change":"2024-05-09T09:51:30.227586+0000","last_active":"2024-05-09T09:51:30.227495+0000","last_peered":"2024-05-09T09:51:30.227495+0000","last_clean":"2024-05-09T09:51:30.227495+0000","last_became_active":"2024-05-09T09:47:12.195117+0000","last_became_peered":"2024-05-09T09:47:12.195117+0000","last_unstale":"2024-05-09T09:51:30.227495+0000","last_undegraded":"2024-05-09T09:51:30.227495+0000","last_fullsized":"2024-05-09T09:51:30.227495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:30.227300+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:30.227300+0000","last_clean_scrub_stamp":"2024-05-09T09:51:30.227300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:21:25.798055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'8","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:20.459408+0000","last_change":"2024-05-09T09:51:20.459408+0000","last_active":"2024-05-09T09:51:20.459408+0000","last_peered":"2024-05-09T09:51:20.459408+0000","last_clean":"2024-05-09T09:51:20.459408+0000","last_became_active":"2024-05-09T09:47:14.188665+0000","last_became_peered":"2024-05-09T09:47:14.188665+0000","last_unstale":"2024-05-09T09:51:20.459408+0000","last_undegraded":"2024-05-09T09:51:20.459408+0000","last_fullsized":"2024-05-09T09:51:20.459408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:20.459134+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:20.459134+0000","last_clean_scrub_stamp":"2024-05-09T09:51:20.459134+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:03:39.099108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:59.390637+0000","last_change":"2024-05-09T09:51:59.390710+0000","last_active":"2024-05-09T09:51:59.390637+0000","last_peered":"2024-05-09T09:51:59.390637+0000","last_clean":"2024-05-09T09:51:59.390637+0000","last_became_active":"2024-05-09T09:47:12.199697+0000","last_became_peered":"2024-05-09T09:47:12.199697+0000","last_unstale":"2024-05-09T09:51:59.390637+0000","last_undegraded":"2024-05-09T09:51:59.390637+0000","last_fullsized":"2024-05-09T09:51:59.390637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-09T09:51:59.390420+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-09T09:51:59.390420+0000","last_clean_scrub_stamp":"2024-05-09T09:51:59.390420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:34.627602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'12","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:14.446828+0000","last_change":"2024-05-09T09:51:14.446828+0000","last_active":"2024-05-09T09:51:14.446828+0000","last_peered":"2024-05-09T09:51:14.446828+0000","last_clean":"2024-05-09T09:51:14.446828+0000","last_became_active":"2024-05-09T09:47:14.179041+0000","last_became_peered":"2024-05-09T09:47:14.179041+0000","last_unstale":"2024-05-09T09:51:14.446828+0000","last_undegraded":"2024-05-09T09:51:14.446828+0000","last_fullsized":"2024-05-09T09:51:14.446828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-09T09:51:14.446529+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-09T09:51:14.446529+0000","last_clean_scrub_stamp":"2024-05-09T09:51:14.446529+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:59:33.567541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:34.229589+0000","last_change":"2024-05-09T09:51:34.229655+0000","last_active":"2024-05-09T09:51:34.229589+0000","last_peered":"2024-05-09T09:51:34.229589+0000","last_clean":"2024-05-09T09:51:34.229589+0000","last_became_active":"2024-05-09T09:47:12.183745+0000","last_became_peered":"2024-05-09T09:47:12.183745+0000","last_unstale":"2024-05-09T09:51:34.229589+0000","last_undegraded":"2024-05-09T09:51:34.229589+0000","last_fullsized":"2024-05-09T09:51:34.229589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:34.229365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:34.229365+0000","last_clean_scrub_stamp":"2024-05-09T09:51:34.229365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:13.552047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'14","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:08.402293+0000","last_change":"2024-05-09T09:51:08.402293+0000","last_active":"2024-05-09T09:51:08.402293+0000","last_peered":"2024-05-09T09:51:08.402293+0000","last_clean":"2024-05-09T09:51:08.402293+0000","last_became_active":"2024-05-09T09:47:14.173031+0000","last_became_peered":"2024-05-09T09:47:14.173031+0000","last_unstale":"2024-05-09T09:51:08.402293+0000","last_undegraded":"2024-05-09T09:51:08.402293+0000","last_fullsized":"2024-05-09T09:51:08.402293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-05-09T09:51:08.401898+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-05-09T09:51:08.401898+0000","last_clean_scrub_stamp":"2024-05-09T09:51:08.401898+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:55.999690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"30'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:01.424391+0000","last_change":"2024-05-09T09:51:01.424391+0000","last_active":"2024-05-09T09:51:01.424391+0000","last_peered":"2024-05-09T09:51:01.424391+0000","last_clean":"2024-05-09T09:51:01.424391+0000","last_became_active":"2024-05-09T09:47:14.192744+0000","last_became_peered":"2024-05-09T09:47:14.192744+0000","last_unstale":"2024-05-09T09:51:01.424391+0000","last_undegraded":"2024-05-09T09:51:01.424391+0000","last_fullsized":"2024-05-09T09:51:01.424391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-05-09T09:51:01.424130+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-05-09T09:51:01.424130+0000","last_clean_scrub_stamp":"2024-05-09T09:51:01.424130+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:37:21.685395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:19.333526+0000","last_change":"2024-05-09T09:51:19.333526+0000","last_active":"2024-05-09T09:51:19.333526+0000","last_peered":"2024-05-09T09:51:19.333526+0000","last_clean":"2024-05-09T09:51:19.333526+0000","last_became_active":"2024-05-09T09:47:12.210781+0000","last_became_peered":"2024-05-09T09:47:12.210781+0000","last_unstale":"2024-05-09T09:51:19.333526+0000","last_undegraded":"2024-05-09T09:51:19.333526+0000","last_fullsized":"2024-05-09T09:51:19.333526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:19.333113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:19.333113+0000","last_clean_scrub_stamp":"2024-05-09T09:51:19.333113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:47:02.729348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'20","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:03.281444+0000","last_change":"2024-05-09T09:51:03.281444+0000","last_active":"2024-05-09T09:51:03.281444+0000","last_peered":"2024-05-09T09:51:03.281444+0000","last_clean":"2024-05-09T09:51:03.281444+0000","last_became_active":"2024-05-09T09:47:14.190021+0000","last_became_peered":"2024-05-09T09:47:14.190021+0000","last_unstale":"2024-05-09T09:51:03.281444+0000","last_undegraded":"2024-05-09T09:51:03.281444+0000","last_fullsized":"2024-05-09T09:51:03.281444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-05-09T09:51:03.281166+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-05-09T09:51:03.281166+0000","last_clean_scrub_stamp":"2024-05-09T09:51:03.281166+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:25.247894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:27.221934+0000","last_change":"2024-05-09T09:51:27.221934+0000","last_active":"2024-05-09T09:51:27.221934+0000","last_peered":"2024-05-09T09:51:27.221934+0000","last_clean":"2024-05-09T09:51:27.221934+0000","last_became_active":"2024-05-09T09:47:12.193509+0000","last_became_peered":"2024-05-09T09:47:12.193509+0000","last_unstale":"2024-05-09T09:51:27.221934+0000","last_undegraded":"2024-05-09T09:51:27.221934+0000","last_fullsized":"2024-05-09T09:51:27.221934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:27.221674+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:27.221674+0000","last_clean_scrub_stamp":"2024-05-09T09:51:27.221674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:39:08.239240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'8","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:06.263845+0000","last_change":"2024-05-09T09:51:06.263845+0000","last_active":"2024-05-09T09:51:06.263845+0000","last_peered":"2024-05-09T09:51:06.263845+0000","last_clean":"2024-05-09T09:51:06.263845+0000","last_became_active":"2024-05-09T09:47:14.189468+0000","last_became_peered":"2024-05-09T09:47:14.189468+0000","last_unstale":"2024-05-09T09:51:06.263845+0000","last_undegraded":"2024-05-09T09:51:06.263845+0000","last_fullsized":"2024-05-09T09:51:06.263845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:06.263525+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:06.263525+0000","last_clean_scrub_stamp":"2024-05-09T09:51:06.263525+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:12:00.576796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:23.303574+0000","last_change":"2024-05-09T09:51:23.303574+0000","last_active":"2024-05-09T09:51:23.303574+0000","last_peered":"2024-05-09T09:51:23.303574+0000","last_clean":"2024-05-09T09:51:23.303574+0000","last_became_active":"2024-05-09T09:47:12.206920+0000","last_became_peered":"2024-05-09T09:47:12.206920+0000","last_unstale":"2024-05-09T09:51:23.303574+0000","last_undegraded":"2024-05-09T09:51:23.303574+0000","last_fullsized":"2024-05-09T09:51:23.303574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:23.303278+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:23.303278+0000","last_clean_scrub_stamp":"2024-05-09T09:51:23.303278+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:08:09.036340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'18","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:20.230883+0000","last_change":"2024-05-09T09:51:20.230883+0000","last_active":"2024-05-09T09:51:20.230883+0000","last_peered":"2024-05-09T09:51:20.230883+0000","last_clean":"2024-05-09T09:51:20.230883+0000","last_became_active":"2024-05-09T09:47:14.173701+0000","last_became_peered":"2024-05-09T09:47:14.173701+0000","last_unstale":"2024-05-09T09:51:20.230883+0000","last_undegraded":"2024-05-09T09:51:20.230883+0000","last_fullsized":"2024-05-09T09:51:20.230883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-05-09T09:51:20.230502+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-05-09T09:51:20.230502+0000","last_clean_scrub_stamp":"2024-05-09T09:51:20.230502+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:08:01.060833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:25.307513+0000","last_change":"2024-05-09T09:51:25.307513+0000","last_active":"2024-05-09T09:51:25.307513+0000","last_peered":"2024-05-09T09:51:25.307513+0000","last_clean":"2024-05-09T09:51:25.307513+0000","last_became_active":"2024-05-09T09:47:12.206564+0000","last_became_peered":"2024-05-09T09:47:12.206564+0000","last_unstale":"2024-05-09T09:51:25.307513+0000","last_undegraded":"2024-05-09T09:51:25.307513+0000","last_fullsized":"2024-05-09T09:51:25.307513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:25.307249+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:25.307249+0000","last_clean_scrub_stamp":"2024-05-09T09:51:25.307249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:48:11.901400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'10","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:10.414463+0000","last_change":"2024-05-09T09:51:10.414463+0000","last_active":"2024-05-09T09:51:10.414463+0000","last_peered":"2024-05-09T09:51:10.414463+0000","last_clean":"2024-05-09T09:51:10.414463+0000","last_became_active":"2024-05-09T09:47:14.173022+0000","last_became_peered":"2024-05-09T09:47:14.173022+0000","last_unstale":"2024-05-09T09:51:10.414463+0000","last_undegraded":"2024-05-09T09:51:10.414463+0000","last_fullsized":"2024-05-09T09:51:10.414463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-09T09:51:10.414205+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-09T09:51:10.414205+0000","last_clean_scrub_stamp":"2024-05-09T09:51:10.414205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:51:35.503195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:17.187941+0000","last_change":"2024-05-09T09:51:17.187941+0000","last_active":"2024-05-09T09:51:17.187941+0000","last_peered":"2024-05-09T09:51:17.187941+0000","last_clean":"2024-05-09T09:51:17.187941+0000","last_became_active":"2024-05-09T09:47:12.214422+0000","last_became_peered":"2024-05-09T09:47:12.214422+0000","last_unstale":"2024-05-09T09:51:17.187941+0000","last_undegraded":"2024-05-09T09:51:17.187941+0000","last_fullsized":"2024-05-09T09:51:17.187941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:17.187681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:17.187681+0000","last_clean_scrub_stamp":"2024-05-09T09:51:17.187681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:47.088454+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'10","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:14.316808+0000","last_change":"2024-05-09T09:51:14.316808+0000","last_active":"2024-05-09T09:51:14.316808+0000","last_peered":"2024-05-09T09:51:14.316808+0000","last_clean":"2024-05-09T09:51:14.316808+0000","last_became_active":"2024-05-09T09:47:14.172297+0000","last_became_peered":"2024-05-09T09:47:14.172297+0000","last_unstale":"2024-05-09T09:51:14.316808+0000","last_undegraded":"2024-05-09T09:51:14.316808+0000","last_fullsized":"2024-05-09T09:51:14.316808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-09T09:51:14.316551+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-09T09:51:14.316551+0000","last_clean_scrub_stamp":"2024-05-09T09:51:14.316551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:05:01.778480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:33.483810+0000","last_change":"2024-05-09T09:51:33.483810+0000","last_active":"2024-05-09T09:51:33.483810+0000","last_peered":"2024-05-09T09:51:33.483810+0000","last_clean":"2024-05-09T09:51:33.483810+0000","last_became_active":"2024-05-09T09:47:12.211880+0000","last_became_peered":"2024-05-09T09:47:12.211880+0000","last_unstale":"2024-05-09T09:51:33.483810+0000","last_undegraded":"2024-05-09T09:51:33.483810+0000","last_fullsized":"2024-05-09T09:51:33.483810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:33.483529+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:33.483529+0000","last_clean_scrub_stamp":"2024-05-09T09:51:33.483529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:02:54.678304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'40","reported_seq":113,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:43.227579+0000","last_change":"2024-05-09T09:51:43.227650+0000","last_active":"2024-05-09T09:51:43.227579+0000","last_peered":"2024-05-09T09:51:43.227579+0000","last_clean":"2024-05-09T09:51:43.227579+0000","last_became_active":"2024-05-09T09:47:22.258991+0000","last_became_peered":"2024-05-09T09:47:22.258991+0000","last_unstale":"2024-05-09T09:51:43.227579+0000","last_undegraded":"2024-05-09T09:51:43.227579+0000","last_fullsized":"2024-05-09T09:51:43.227579+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-05-09T09:51:43.227380+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-05-09T09:51:43.227380+0000","last_clean_scrub_stamp":"2024-05-09T09:51:43.227380+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:54:08.681081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":174,"num_read_kb":174,"num_write":107,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:29.521842+0000","last_change":"2024-05-09T09:51:29.521842+0000","last_active":"2024-05-09T09:51:29.521842+0000","last_peered":"2024-05-09T09:51:29.521842+0000","last_clean":"2024-05-09T09:51:29.521842+0000","last_became_active":"2024-05-09T09:47:14.184851+0000","last_became_peered":"2024-05-09T09:47:14.184851+0000","last_unstale":"2024-05-09T09:51:29.521842+0000","last_undegraded":"2024-05-09T09:51:29.521842+0000","last_fullsized":"2024-05-09T09:51:29.521842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:29.521558+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:29.521558+0000","last_clean_scrub_stamp":"2024-05-09T09:51:29.521558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:56:44.098725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:52:01.344764+0000","last_change":"2024-05-09T09:52:01.344839+0000","last_active":"2024-05-09T09:52:01.344764+0000","last_peered":"2024-05-09T09:52:01.344764+0000","last_clean":"2024-05-09T09:52:01.344764+0000","last_became_active":"2024-05-09T09:47:12.214108+0000","last_became_peered":"2024-05-09T09:47:12.214108+0000","last_unstale":"2024-05-09T09:52:01.344764+0000","last_undegraded":"2024-05-09T09:52:01.344764+0000","last_fullsized":"2024-05-09T09:52:01.344764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:52:01.344557+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:52:01.344557+0000","last_clean_scrub_stamp":"2024-05-09T09:52:01.344557+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:23:29.367503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:53.499175+0000","last_change":"2024-05-09T09:50:53.499229+0000","last_active":"2024-05-09T09:50:53.499175+0000","last_peered":"2024-05-09T09:50:53.499175+0000","last_clean":"2024-05-09T09:50:53.499175+0000","last_became_active":"2024-05-09T09:47:16.196516+0000","last_became_peered":"2024-05-09T09:47:16.196516+0000","last_unstale":"2024-05-09T09:50:53.499175+0000","last_undegraded":"2024-05-09T09:50:53.499175+0000","last_fullsized":"2024-05-09T09:50:53.499175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:53.498977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:53.498977+0000","last_clean_scrub_stamp":"2024-05-09T09:50:53.498977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:34:28.515132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'111","reported_seq":166,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:13.471271+0000","last_change":"2024-05-09T09:51:13.471414+0000","last_active":"2024-05-09T09:51:13.471271+0000","last_peered":"2024-05-09T09:51:13.471271+0000","last_clean":"2024-05-09T09:51:13.471271+0000","last_became_active":"2024-05-09T09:47:18.235911+0000","last_became_peered":"2024-05-09T09:47:18.235911+0000","last_unstale":"2024-05-09T09:51:13.471271+0000","last_undegraded":"2024-05-09T09:51:13.471271+0000","last_fullsized":"2024-05-09T09:51:13.471271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'111","last_scrub_stamp":"2024-05-09T09:51:13.471021+0000","last_deep_scrub":"32'111","last_deep_scrub_stamp":"2024-05-09T09:51:13.471021+0000","last_clean_scrub_stamp":"2024-05-09T09:51:13.471021+0000","objects_scrubbed":4,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:48:45.181255+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:04.247298+0000","last_change":"2024-05-09T09:51:04.247398+0000","last_active":"2024-05-09T09:51:04.247298+0000","last_peered":"2024-05-09T09:51:04.247298+0000","last_clean":"2024-05-09T09:51:04.247298+0000","last_became_active":"2024-05-09T09:47:20.251712+0000","last_became_peered":"2024-05-09T09:47:20.251712+0000","last_unstale":"2024-05-09T09:51:04.247298+0000","last_undegraded":"2024-05-09T09:51:04.247298+0000","last_fullsized":"2024-05-09T09:51:04.247298+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:04.247033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:04.247033+0000","last_clean_scrub_stamp":"2024-05-09T09:51:04.247033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:57.593992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:40.230855+0000","last_change":"2024-05-09T09:51:40.230983+0000","last_active":"2024-05-09T09:51:40.230855+0000","last_peered":"2024-05-09T09:51:40.230855+0000","last_clean":"2024-05-09T09:51:40.230855+0000","last_became_active":"2024-05-09T09:47:22.255180+0000","last_became_peered":"2024-05-09T09:47:22.255180+0000","last_unstale":"2024-05-09T09:51:40.230855+0000","last_undegraded":"2024-05-09T09:51:40.230855+0000","last_fullsized":"2024-05-09T09:51:40.230855+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-05-09T09:51:40.230582+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-05-09T09:51:40.230582+0000","last_clean_scrub_stamp":"2024-05-09T09:51:40.230582+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:03:58.870556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:22.502050+0000","last_change":"2024-05-09T09:51:22.502050+0000","last_active":"2024-05-09T09:51:22.502050+0000","last_peered":"2024-05-09T09:51:22.502050+0000","last_clean":"2024-05-09T09:51:22.502050+0000","last_became_active":"2024-05-09T09:47:14.187095+0000","last_became_peered":"2024-05-09T09:47:14.187095+0000","last_unstale":"2024-05-09T09:51:22.502050+0000","last_undegraded":"2024-05-09T09:51:22.502050+0000","last_fullsized":"2024-05-09T09:51:22.502050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:22.501695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:22.501695+0000","last_clean_scrub_stamp":"2024-05-09T09:51:22.501695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:02:09.890340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:31.182425+0000","last_change":"2024-05-09T09:51:31.182425+0000","last_active":"2024-05-09T09:51:31.182425+0000","last_peered":"2024-05-09T09:51:31.182425+0000","last_clean":"2024-05-09T09:51:31.182425+0000","last_became_active":"2024-05-09T09:47:12.194549+0000","last_became_peered":"2024-05-09T09:47:12.194549+0000","last_unstale":"2024-05-09T09:51:31.182425+0000","last_undegraded":"2024-05-09T09:51:31.182425+0000","last_fullsized":"2024-05-09T09:51:31.182425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:31.182162+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:31.182162+0000","last_clean_scrub_stamp":"2024-05-09T09:51:31.182162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:37:51.443427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:07.069334+0000","last_change":"2024-05-09T09:51:07.069334+0000","last_active":"2024-05-09T09:51:07.069334+0000","last_peered":"2024-05-09T09:51:07.069334+0000","last_clean":"2024-05-09T09:51:07.069334+0000","last_became_active":"2024-05-09T09:47:16.190755+0000","last_became_peered":"2024-05-09T09:47:16.190755+0000","last_unstale":"2024-05-09T09:51:07.069334+0000","last_undegraded":"2024-05-09T09:51:07.069334+0000","last_fullsized":"2024-05-09T09:51:07.069334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:07.069053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:07.069053+0000","last_clean_scrub_stamp":"2024-05-09T09:51:07.069053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:51:02.166302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'10","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:47.334928+0000","last_change":"2024-05-09T09:50:47.334999+0000","last_active":"2024-05-09T09:50:47.334928+0000","last_peered":"2024-05-09T09:50:47.334928+0000","last_clean":"2024-05-09T09:50:47.334928+0000","last_became_active":"2024-05-09T09:47:18.214299+0000","last_became_peered":"2024-05-09T09:47:18.214299+0000","last_unstale":"2024-05-09T09:50:47.334928+0000","last_undegraded":"2024-05-09T09:50:47.334928+0000","last_fullsized":"2024-05-09T09:50:47.334928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-09T09:50:47.334727+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-09T09:50:47.334727+0000","last_clean_scrub_stamp":"2024-05-09T09:50:47.334727+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:31:56.932969+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:56.256173+0000","last_change":"2024-05-09T09:50:56.256269+0000","last_active":"2024-05-09T09:50:56.256173+0000","last_peered":"2024-05-09T09:50:56.256173+0000","last_clean":"2024-05-09T09:50:56.256173+0000","last_became_active":"2024-05-09T09:47:20.241096+0000","last_became_peered":"2024-05-09T09:47:20.241096+0000","last_unstale":"2024-05-09T09:50:56.256173+0000","last_undegraded":"2024-05-09T09:50:56.256173+0000","last_fullsized":"2024-05-09T09:50:56.256173+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:56.255842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:56.255842+0000","last_clean_scrub_stamp":"2024-05-09T09:50:56.255842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:53:33.355429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:45.239000+0000","last_change":"2024-05-09T09:51:45.239069+0000","last_active":"2024-05-09T09:51:45.239000+0000","last_peered":"2024-05-09T09:51:45.239000+0000","last_clean":"2024-05-09T09:51:45.239000+0000","last_became_active":"2024-05-09T09:47:22.257798+0000","last_became_peered":"2024-05-09T09:47:22.257798+0000","last_unstale":"2024-05-09T09:51:45.239000+0000","last_undegraded":"2024-05-09T09:51:45.239000+0000","last_fullsized":"2024-05-09T09:51:45.239000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-09T09:51:45.238788+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-09T09:51:45.238788+0000","last_clean_scrub_stamp":"2024-05-09T09:51:45.238788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:51:23.350868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:38.265821+0000","last_change":"2024-05-09T09:51:38.265982+0000","last_active":"2024-05-09T09:51:38.265821+0000","last_peered":"2024-05-09T09:51:38.265821+0000","last_clean":"2024-05-09T09:51:38.265821+0000","last_became_active":"2024-05-09T09:47:52.429857+0000","last_became_peered":"2024-05-09T09:47:52.429857+0000","last_unstale":"2024-05-09T09:51:38.265821+0000","last_undegraded":"2024-05-09T09:51:38.265821+0000","last_fullsized":"2024-05-09T09:51:38.265821+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:38.265591+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:38.265591+0000","last_clean_scrub_stamp":"2024-05-09T09:51:38.265591+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:59.065746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:52:00.356383+0000","last_change":"2024-05-09T09:52:00.356405+0000","last_active":"2024-05-09T09:52:00.356383+0000","last_peered":"2024-05-09T09:52:00.356383+0000","last_clean":"2024-05-09T09:52:00.356383+0000","last_became_active":"2024-05-09T09:47:12.201415+0000","last_became_peered":"2024-05-09T09:47:12.201415+0000","last_unstale":"2024-05-09T09:52:00.356383+0000","last_undegraded":"2024-05-09T09:52:00.356383+0000","last_fullsized":"2024-05-09T09:52:00.356383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:52:00.356312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:52:00.356312+0000","last_clean_scrub_stamp":"2024-05-09T09:52:00.356312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:42:20.079946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:03.013348+0000","last_change":"2024-05-09T09:51:03.013403+0000","last_active":"2024-05-09T09:51:03.013348+0000","last_peered":"2024-05-09T09:51:03.013348+0000","last_clean":"2024-05-09T09:51:03.013348+0000","last_became_active":"2024-05-09T09:47:16.212543+0000","last_became_peered":"2024-05-09T09:47:16.212543+0000","last_unstale":"2024-05-09T09:51:03.013348+0000","last_undegraded":"2024-05-09T09:51:03.013348+0000","last_fullsized":"2024-05-09T09:51:03.013348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:03.013120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:03.013120+0000","last_clean_scrub_stamp":"2024-05-09T09:51:03.013120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:48:14.324538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:56.286722+0000","last_change":"2024-05-09T09:50:56.286722+0000","last_active":"2024-05-09T09:50:56.286722+0000","last_peered":"2024-05-09T09:50:56.286722+0000","last_clean":"2024-05-09T09:50:56.286722+0000","last_became_active":"2024-05-09T09:47:18.212685+0000","last_became_peered":"2024-05-09T09:47:18.212685+0000","last_unstale":"2024-05-09T09:50:56.286722+0000","last_undegraded":"2024-05-09T09:50:56.286722+0000","last_fullsized":"2024-05-09T09:50:56.286722+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-09T09:50:56.286427+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-09T09:50:56.286427+0000","last_clean_scrub_stamp":"2024-05-09T09:50:56.286427+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:21.085497+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":395,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:06.438260+0000","last_change":"2024-05-09T09:51:06.438322+0000","last_active":"2024-05-09T09:51:06.438260+0000","last_peered":"2024-05-09T09:51:06.438260+0000","last_clean":"2024-05-09T09:51:06.438260+0000","last_became_active":"2024-05-09T09:47:20.250200+0000","last_became_peered":"2024-05-09T09:47:20.250200+0000","last_unstale":"2024-05-09T09:51:06.438260+0000","last_undegraded":"2024-05-09T09:51:06.438260+0000","last_fullsized":"2024-05-09T09:51:06.438260+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:51:06.438054+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:51:06.438054+0000","last_clean_scrub_stamp":"2024-05-09T09:51:06.438054+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:28:03.481485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:36.206944+0000","last_change":"2024-05-09T09:51:36.207039+0000","last_active":"2024-05-09T09:51:36.206944+0000","last_peered":"2024-05-09T09:51:36.206944+0000","last_clean":"2024-05-09T09:51:36.206944+0000","last_became_active":"2024-05-09T09:47:22.238160+0000","last_became_peered":"2024-05-09T09:47:22.238160+0000","last_unstale":"2024-05-09T09:51:36.206944+0000","last_undegraded":"2024-05-09T09:51:36.206944+0000","last_fullsized":"2024-05-09T09:51:36.206944+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:36.206692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:36.206692+0000","last_clean_scrub_stamp":"2024-05-09T09:51:36.206692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:28:28.062055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'16","reported_seq":114,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:28.332773+0000","last_change":"2024-05-09T09:51:28.332773+0000","last_active":"2024-05-09T09:51:28.332773+0000","last_peered":"2024-05-09T09:51:28.332773+0000","last_clean":"2024-05-09T09:51:28.332773+0000","last_became_active":"2024-05-09T09:47:14.176295+0000","last_became_peered":"2024-05-09T09:47:14.176295+0000","last_unstale":"2024-05-09T09:51:28.332773+0000","last_undegraded":"2024-05-09T09:51:28.332773+0000","last_fullsized":"2024-05-09T09:51:28.332773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-05-09T09:51:28.332516+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-05-09T09:51:28.332516+0000","last_clean_scrub_stamp":"2024-05-09T09:51:28.332516+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:28:07.098893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:31.289987+0000","last_change":"2024-05-09T09:51:31.289987+0000","last_active":"2024-05-09T09:51:31.289987+0000","last_peered":"2024-05-09T09:51:31.289987+0000","last_clean":"2024-05-09T09:51:31.289987+0000","last_became_active":"2024-05-09T09:47:12.191194+0000","last_became_peered":"2024-05-09T09:47:12.191194+0000","last_unstale":"2024-05-09T09:51:31.289987+0000","last_undegraded":"2024-05-09T09:51:31.289987+0000","last_fullsized":"2024-05-09T09:51:31.289987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:31.289717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:31.289717+0000","last_clean_scrub_stamp":"2024-05-09T09:51:31.289717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:58:22.238688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:49:45.179207+0000","last_change":"2024-05-09T09:47:52.201792+0000","last_active":"2024-05-09T09:49:45.179207+0000","last_peered":"2024-05-09T09:49:45.179207+0000","last_clean":"2024-05-09T09:49:45.179207+0000","last_became_active":"2024-05-09T09:47:52.201081+0000","last_became_peered":"2024-05-09T09:47:52.201081+0000","last_unstale":"2024-05-09T09:49:45.179207+0000","last_undegraded":"2024-05-09T09:49:45.179207+0000","last_fullsized":"2024-05-09T09:49:45.179207+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'110","reported_seq":165,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:52.254206+0000","last_change":"2024-05-09T09:50:52.254281+0000","last_active":"2024-05-09T09:50:52.254206+0000","last_peered":"2024-05-09T09:50:52.254206+0000","last_clean":"2024-05-09T09:50:52.254206+0000","last_became_active":"2024-05-09T09:47:18.217843+0000","last_became_peered":"2024-05-09T09:47:18.217843+0000","last_unstale":"2024-05-09T09:50:52.254206+0000","last_undegraded":"2024-05-09T09:50:52.254206+0000","last_fullsized":"2024-05-09T09:50:52.254206+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'110","last_scrub_stamp":"2024-05-09T09:50:52.254022+0000","last_deep_scrub":"32'110","last_deep_scrub_stamp":"2024-05-09T09:50:52.254022+0000","last_clean_scrub_stamp":"2024-05-09T09:50:52.254022+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:44:38.690119+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":456,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:43.906635+0000","last_change":"2024-05-09T09:50:43.906635+0000","last_active":"2024-05-09T09:50:43.906635+0000","last_peered":"2024-05-09T09:50:43.906635+0000","last_clean":"2024-05-09T09:50:43.906635+0000","last_became_active":"2024-05-09T09:47:20.242448+0000","last_became_peered":"2024-05-09T09:47:20.242448+0000","last_unstale":"2024-05-09T09:50:43.906635+0000","last_undegraded":"2024-05-09T09:50:43.906635+0000","last_fullsized":"2024-05-09T09:50:43.906635+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:43.906506+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:43.906506+0000","last_clean_scrub_stamp":"2024-05-09T09:50:43.906506+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:08.705575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:37.221280+0000","last_change":"2024-05-09T09:51:37.221338+0000","last_active":"2024-05-09T09:51:37.221280+0000","last_peered":"2024-05-09T09:51:37.221280+0000","last_clean":"2024-05-09T09:51:37.221280+0000","last_became_active":"2024-05-09T09:47:52.179059+0000","last_became_peered":"2024-05-09T09:47:52.179059+0000","last_unstale":"2024-05-09T09:51:37.221280+0000","last_undegraded":"2024-05-09T09:51:37.221280+0000","last_fullsized":"2024-05-09T09:51:37.221280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:37.221094+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:37.221094+0000","last_clean_scrub_stamp":"2024-05-09T09:51:37.221094+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:00:23.913251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:21.280559+0000","last_change":"2024-05-09T09:51:21.280559+0000","last_active":"2024-05-09T09:51:21.280559+0000","last_peered":"2024-05-09T09:51:21.280559+0000","last_clean":"2024-05-09T09:51:21.280559+0000","last_became_active":"2024-05-09T09:47:12.205259+0000","last_became_peered":"2024-05-09T09:47:12.205259+0000","last_unstale":"2024-05-09T09:51:21.280559+0000","last_undegraded":"2024-05-09T09:51:21.280559+0000","last_fullsized":"2024-05-09T09:51:21.280559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:21.280309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:21.280309+0000","last_clean_scrub_stamp":"2024-05-09T09:51:21.280309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:51:16.377558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:02.242526+0000","last_change":"2024-05-09T09:51:02.242526+0000","last_active":"2024-05-09T09:51:02.242526+0000","last_peered":"2024-05-09T09:51:02.242526+0000","last_clean":"2024-05-09T09:51:02.242526+0000","last_became_active":"2024-05-09T09:47:16.207404+0000","last_became_peered":"2024-05-09T09:47:16.207404+0000","last_unstale":"2024-05-09T09:51:02.242526+0000","last_undegraded":"2024-05-09T09:51:02.242526+0000","last_fullsized":"2024-05-09T09:51:02.242526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:02.242155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:02.242155+0000","last_clean_scrub_stamp":"2024-05-09T09:51:02.242155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:18:43.580003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'127","reported_seq":188,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:51.217030+0000","last_change":"2024-05-09T09:50:51.217030+0000","last_active":"2024-05-09T09:50:51.217030+0000","last_peered":"2024-05-09T09:50:51.217030+0000","last_clean":"2024-05-09T09:50:51.217030+0000","last_became_active":"2024-05-09T09:47:18.220596+0000","last_became_peered":"2024-05-09T09:47:18.220596+0000","last_unstale":"2024-05-09T09:50:51.217030+0000","last_undegraded":"2024-05-09T09:50:51.217030+0000","last_fullsized":"2024-05-09T09:50:51.217030+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'127","last_scrub_stamp":"2024-05-09T09:50:51.216776+0000","last_deep_scrub":"32'127","last_deep_scrub_stamp":"2024-05-09T09:50:51.216776+0000","last_clean_scrub_stamp":"2024-05-09T09:50:51.216776+0000","objects_scrubbed":9,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:52:10.006215+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":63,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:45.825646+0000","last_change":"2024-05-09T09:50:45.825646+0000","last_active":"2024-05-09T09:50:45.825646+0000","last_peered":"2024-05-09T09:50:45.825646+0000","last_clean":"2024-05-09T09:50:45.825646+0000","last_became_active":"2024-05-09T09:47:20.244839+0000","last_became_peered":"2024-05-09T09:47:20.244839+0000","last_unstale":"2024-05-09T09:50:45.825646+0000","last_undegraded":"2024-05-09T09:50:45.825646+0000","last_fullsized":"2024-05-09T09:50:45.825646+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:45.825370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:45.825370+0000","last_clean_scrub_stamp":"2024-05-09T09:50:45.825370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:33:58.430560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:35.203710+0000","last_change":"2024-05-09T09:51:35.203825+0000","last_active":"2024-05-09T09:51:35.203710+0000","last_peered":"2024-05-09T09:51:35.203710+0000","last_clean":"2024-05-09T09:51:35.203710+0000","last_became_active":"2024-05-09T09:47:22.235895+0000","last_became_peered":"2024-05-09T09:47:22.235895+0000","last_unstale":"2024-05-09T09:51:35.203710+0000","last_undegraded":"2024-05-09T09:51:35.203710+0000","last_fullsized":"2024-05-09T09:51:35.203710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-09T09:51:35.203402+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-09T09:51:35.203402+0000","last_clean_scrub_stamp":"2024-05-09T09:51:35.203402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:48:21.797553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:15.273289+0000","last_change":"2024-05-09T09:51:15.273289+0000","last_active":"2024-05-09T09:51:15.273289+0000","last_peered":"2024-05-09T09:51:15.273289+0000","last_clean":"2024-05-09T09:51:15.273289+0000","last_became_active":"2024-05-09T09:47:14.172275+0000","last_became_peered":"2024-05-09T09:47:14.172275+0000","last_unstale":"2024-05-09T09:51:15.273289+0000","last_undegraded":"2024-05-09T09:51:15.273289+0000","last_fullsized":"2024-05-09T09:51:15.273289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:15.273035+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:15.273035+0000","last_clean_scrub_stamp":"2024-05-09T09:51:15.273035+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:10:49.381052+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:11.412780+0000","last_change":"2024-05-09T09:51:11.412780+0000","last_active":"2024-05-09T09:51:11.412780+0000","last_peered":"2024-05-09T09:51:11.412780+0000","last_clean":"2024-05-09T09:51:11.412780+0000","last_became_active":"2024-05-09T09:47:12.209274+0000","last_became_peered":"2024-05-09T09:47:12.209274+0000","last_unstale":"2024-05-09T09:51:11.412780+0000","last_undegraded":"2024-05-09T09:51:11.412780+0000","last_fullsized":"2024-05-09T09:51:11.412780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:11.412502+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:11.412502+0000","last_clean_scrub_stamp":"2024-05-09T09:51:11.412502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:20:20.774039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:59.933420+0000","last_change":"2024-05-09T09:50:59.933420+0000","last_active":"2024-05-09T09:50:59.933420+0000","last_peered":"2024-05-09T09:50:59.933420+0000","last_clean":"2024-05-09T09:50:59.933420+0000","last_became_active":"2024-05-09T09:47:16.214484+0000","last_became_peered":"2024-05-09T09:47:16.214484+0000","last_unstale":"2024-05-09T09:50:59.933420+0000","last_undegraded":"2024-05-09T09:50:59.933420+0000","last_fullsized":"2024-05-09T09:50:59.933420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:59.933158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:59.933158+0000","last_clean_scrub_stamp":"2024-05-09T09:50:59.933158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:53.280118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'113","reported_seq":169,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:51.480062+0000","last_change":"2024-05-09T09:50:51.480062+0000","last_active":"2024-05-09T09:50:51.480062+0000","last_peered":"2024-05-09T09:50:51.480062+0000","last_clean":"2024-05-09T09:50:51.480062+0000","last_became_active":"2024-05-09T09:47:18.224815+0000","last_became_peered":"2024-05-09T09:47:18.224815+0000","last_unstale":"2024-05-09T09:50:51.480062+0000","last_undegraded":"2024-05-09T09:50:51.480062+0000","last_fullsized":"2024-05-09T09:50:51.480062+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'113","last_scrub_stamp":"2024-05-09T09:50:51.479757+0000","last_deep_scrub":"32'113","last_deep_scrub_stamp":"2024-05-09T09:50:51.479757+0000","last_clean_scrub_stamp":"2024-05-09T09:50:51.479757+0000","objects_scrubbed":4,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:05.084435+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:02.001194+0000","last_change":"2024-05-09T09:51:02.001194+0000","last_active":"2024-05-09T09:51:02.001194+0000","last_peered":"2024-05-09T09:51:02.001194+0000","last_clean":"2024-05-09T09:51:02.001194+0000","last_became_active":"2024-05-09T09:47:20.250686+0000","last_became_peered":"2024-05-09T09:47:20.250686+0000","last_unstale":"2024-05-09T09:51:02.001194+0000","last_undegraded":"2024-05-09T09:51:02.001194+0000","last_fullsized":"2024-05-09T09:51:02.001194+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:02.000873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:02.000873+0000","last_clean_scrub_stamp":"2024-05-09T09:51:02.000873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:10:46.269234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'18","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:41.194026+0000","last_change":"2024-05-09T09:51:41.194107+0000","last_active":"2024-05-09T09:51:41.194026+0000","last_peered":"2024-05-09T09:51:41.194026+0000","last_clean":"2024-05-09T09:51:41.194026+0000","last_became_active":"2024-05-09T09:47:22.255076+0000","last_became_peered":"2024-05-09T09:47:22.255076+0000","last_unstale":"2024-05-09T09:51:41.194026+0000","last_undegraded":"2024-05-09T09:51:41.194026+0000","last_fullsized":"2024-05-09T09:51:41.194026+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-05-09T09:51:41.193833+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-05-09T09:51:41.193833+0000","last_clean_scrub_stamp":"2024-05-09T09:51:41.193833+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:37:35.974545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":92,"num_read_kb":72,"num_write":55,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:16.427622+0000","last_change":"2024-05-09T09:51:16.427622+0000","last_active":"2024-05-09T09:51:16.427622+0000","last_peered":"2024-05-09T09:51:16.427622+0000","last_clean":"2024-05-09T09:51:16.427622+0000","last_became_active":"2024-05-09T09:47:14.180185+0000","last_became_peered":"2024-05-09T09:47:14.180185+0000","last_unstale":"2024-05-09T09:51:16.427622+0000","last_undegraded":"2024-05-09T09:51:16.427622+0000","last_fullsized":"2024-05-09T09:51:16.427622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-09T09:51:16.427325+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-09T09:51:16.427325+0000","last_clean_scrub_stamp":"2024-05-09T09:51:16.427325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:25:28.601825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:43.556517+0000","last_change":"2024-05-09T09:51:43.556517+0000","last_active":"2024-05-09T09:51:43.556517+0000","last_peered":"2024-05-09T09:51:43.556517+0000","last_clean":"2024-05-09T09:51:43.556517+0000","last_became_active":"2024-05-09T09:47:12.207751+0000","last_became_peered":"2024-05-09T09:47:12.207751+0000","last_unstale":"2024-05-09T09:51:43.556517+0000","last_undegraded":"2024-05-09T09:51:43.556517+0000","last_fullsized":"2024-05-09T09:51:43.556517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:43.556242+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:43.556242+0000","last_clean_scrub_stamp":"2024-05-09T09:51:43.556242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:00.404161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:04.040606+0000","last_change":"2024-05-09T09:51:04.040606+0000","last_active":"2024-05-09T09:51:04.040606+0000","last_peered":"2024-05-09T09:51:04.040606+0000","last_clean":"2024-05-09T09:51:04.040606+0000","last_became_active":"2024-05-09T09:47:16.207734+0000","last_became_peered":"2024-05-09T09:47:16.207734+0000","last_unstale":"2024-05-09T09:51:04.040606+0000","last_undegraded":"2024-05-09T09:51:04.040606+0000","last_fullsized":"2024-05-09T09:51:04.040606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:04.040339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:04.040339+0000","last_clean_scrub_stamp":"2024-05-09T09:51:04.040339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:34:42.732867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'119","reported_seq":178,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:47.428281+0000","last_change":"2024-05-09T09:50:47.428281+0000","last_active":"2024-05-09T09:50:47.428281+0000","last_peered":"2024-05-09T09:50:47.428281+0000","last_clean":"2024-05-09T09:50:47.428281+0000","last_became_active":"2024-05-09T09:47:18.230440+0000","last_became_peered":"2024-05-09T09:47:18.230440+0000","last_unstale":"2024-05-09T09:50:47.428281+0000","last_undegraded":"2024-05-09T09:50:47.428281+0000","last_fullsized":"2024-05-09T09:50:47.428281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-05-09T09:50:47.427971+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-05-09T09:50:47.427971+0000","last_clean_scrub_stamp":"2024-05-09T09:50:47.427971+0000","objects_scrubbed":7,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:24:59.602471+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":363,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:10.066212+0000","last_change":"2024-05-09T09:51:10.066212+0000","last_active":"2024-05-09T09:51:10.066212+0000","last_peered":"2024-05-09T09:51:10.066212+0000","last_clean":"2024-05-09T09:51:10.066212+0000","last_became_active":"2024-05-09T09:47:20.254305+0000","last_became_peered":"2024-05-09T09:47:20.254305+0000","last_unstale":"2024-05-09T09:51:10.066212+0000","last_undegraded":"2024-05-09T09:51:10.066212+0000","last_fullsized":"2024-05-09T09:51:10.066212+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:51:10.065958+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:51:10.065958+0000","last_clean_scrub_stamp":"2024-05-09T09:51:10.065958+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:04:57.527887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:43.274116+0000","last_change":"2024-05-09T09:51:43.274116+0000","last_active":"2024-05-09T09:51:43.274116+0000","last_peered":"2024-05-09T09:51:43.274116+0000","last_clean":"2024-05-09T09:51:43.274116+0000","last_became_active":"2024-05-09T09:47:22.239262+0000","last_became_peered":"2024-05-09T09:47:22.239262+0000","last_unstale":"2024-05-09T09:51:43.274116+0000","last_undegraded":"2024-05-09T09:51:43.274116+0000","last_fullsized":"2024-05-09T09:51:43.274116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:43.273853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:43.273853+0000","last_clean_scrub_stamp":"2024-05-09T09:51:43.273853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:15:17.167906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'8","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:20.323048+0000","last_change":"2024-05-09T09:51:20.323048+0000","last_active":"2024-05-09T09:51:20.323048+0000","last_peered":"2024-05-09T09:51:20.323048+0000","last_clean":"2024-05-09T09:51:20.323048+0000","last_became_active":"2024-05-09T09:47:14.184593+0000","last_became_peered":"2024-05-09T09:47:14.184593+0000","last_unstale":"2024-05-09T09:51:20.323048+0000","last_undegraded":"2024-05-09T09:51:20.323048+0000","last_fullsized":"2024-05-09T09:51:20.323048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:20.322811+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:20.322811+0000","last_clean_scrub_stamp":"2024-05-09T09:51:20.322811+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:33.927489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:45.521499+0000","last_change":"2024-05-09T09:51:45.521653+0000","last_active":"2024-05-09T09:51:45.521499+0000","last_peered":"2024-05-09T09:51:45.521499+0000","last_clean":"2024-05-09T09:51:45.521499+0000","last_became_active":"2024-05-09T09:47:12.207403+0000","last_became_peered":"2024-05-09T09:47:12.207403+0000","last_unstale":"2024-05-09T09:51:45.521499+0000","last_undegraded":"2024-05-09T09:51:45.521499+0000","last_fullsized":"2024-05-09T09:51:45.521499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:45.521234+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:45.521234+0000","last_clean_scrub_stamp":"2024-05-09T09:51:45.521234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:42:59.600820+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":16,"num_write_kb":8838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:58.967885+0000","last_change":"2024-05-09T09:50:58.967885+0000","last_active":"2024-05-09T09:50:58.967885+0000","last_peered":"2024-05-09T09:50:58.967885+0000","last_clean":"2024-05-09T09:50:58.967885+0000","last_became_active":"2024-05-09T09:47:16.214607+0000","last_became_peered":"2024-05-09T09:47:16.214607+0000","last_unstale":"2024-05-09T09:50:58.967885+0000","last_undegraded":"2024-05-09T09:50:58.967885+0000","last_fullsized":"2024-05-09T09:50:58.967885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:58.967631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:58.967631+0000","last_clean_scrub_stamp":"2024-05-09T09:50:58.967631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:20.934359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'212","reported_seq":286,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:45.413815+0000","last_change":"2024-05-09T09:50:45.413815+0000","last_active":"2024-05-09T09:50:45.413815+0000","last_peered":"2024-05-09T09:50:45.413815+0000","last_clean":"2024-05-09T09:50:45.413815+0000","last_became_active":"2024-05-09T09:47:18.224893+0000","last_became_peered":"2024-05-09T09:47:18.224893+0000","last_unstale":"2024-05-09T09:50:45.413815+0000","last_undegraded":"2024-05-09T09:50:45.413815+0000","last_fullsized":"2024-05-09T09:50:45.413815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'212","last_scrub_stamp":"2024-05-09T09:50:45.413522+0000","last_deep_scrub":"32'212","last_deep_scrub_stamp":"2024-05-09T09:50:45.413522+0000","last_clean_scrub_stamp":"2024-05-09T09:50:45.413522+0000","objects_scrubbed":5,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:59:04.534534+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:46.831580+0000","last_change":"2024-05-09T09:50:46.831580+0000","last_active":"2024-05-09T09:50:46.831580+0000","last_peered":"2024-05-09T09:50:46.831580+0000","last_clean":"2024-05-09T09:50:46.831580+0000","last_became_active":"2024-05-09T09:47:20.228339+0000","last_became_peered":"2024-05-09T09:47:20.228339+0000","last_unstale":"2024-05-09T09:50:46.831580+0000","last_undegraded":"2024-05-09T09:50:46.831580+0000","last_fullsized":"2024-05-09T09:50:46.831580+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:46.831331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:46.831331+0000","last_clean_scrub_stamp":"2024-05-09T09:50:46.831331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:58:25.885349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'21","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:41.346917+0000","last_change":"2024-05-09T09:51:41.346917+0000","last_active":"2024-05-09T09:51:41.346917+0000","last_peered":"2024-05-09T09:51:41.346917+0000","last_clean":"2024-05-09T09:51:41.346917+0000","last_became_active":"2024-05-09T09:47:22.229193+0000","last_became_peered":"2024-05-09T09:47:22.229193+0000","last_unstale":"2024-05-09T09:51:41.346917+0000","last_undegraded":"2024-05-09T09:51:41.346917+0000","last_fullsized":"2024-05-09T09:51:41.346917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-05-09T09:51:41.346645+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-05-09T09:51:41.346645+0000","last_clean_scrub_stamp":"2024-05-09T09:51:41.346645+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:35.992222+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'8","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:24.268882+0000","last_change":"2024-05-09T09:51:24.268882+0000","last_active":"2024-05-09T09:51:24.268882+0000","last_peered":"2024-05-09T09:51:24.268882+0000","last_clean":"2024-05-09T09:51:24.268882+0000","last_became_active":"2024-05-09T09:47:14.176717+0000","last_became_peered":"2024-05-09T09:47:14.176717+0000","last_unstale":"2024-05-09T09:51:24.268882+0000","last_undegraded":"2024-05-09T09:51:24.268882+0000","last_fullsized":"2024-05-09T09:51:24.268882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:24.268609+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:24.268609+0000","last_clean_scrub_stamp":"2024-05-09T09:51:24.268609+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:03:06.524381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:29.294901+0000","last_change":"2024-05-09T09:51:29.294901+0000","last_active":"2024-05-09T09:51:29.294901+0000","last_peered":"2024-05-09T09:51:29.294901+0000","last_clean":"2024-05-09T09:51:29.294901+0000","last_became_active":"2024-05-09T09:47:12.204317+0000","last_became_peered":"2024-05-09T09:47:12.204317+0000","last_unstale":"2024-05-09T09:51:29.294901+0000","last_undegraded":"2024-05-09T09:51:29.294901+0000","last_fullsized":"2024-05-09T09:51:29.294901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:29.294653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:29.294653+0000","last_clean_scrub_stamp":"2024-05-09T09:51:29.294653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:40:22.840115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:01.269646+0000","last_change":"2024-05-09T09:51:01.269646+0000","last_active":"2024-05-09T09:51:01.269646+0000","last_peered":"2024-05-09T09:51:01.269646+0000","last_clean":"2024-05-09T09:51:01.269646+0000","last_became_active":"2024-05-09T09:47:16.197031+0000","last_became_peered":"2024-05-09T09:47:16.197031+0000","last_unstale":"2024-05-09T09:51:01.269646+0000","last_undegraded":"2024-05-09T09:51:01.269646+0000","last_fullsized":"2024-05-09T09:51:01.269646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:01.269403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:01.269403+0000","last_clean_scrub_stamp":"2024-05-09T09:51:01.269403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:20:09.570821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'113","reported_seq":170,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:46.341361+0000","last_change":"2024-05-09T09:50:46.341361+0000","last_active":"2024-05-09T09:50:46.341361+0000","last_peered":"2024-05-09T09:50:46.341361+0000","last_clean":"2024-05-09T09:50:46.341361+0000","last_became_active":"2024-05-09T09:47:18.215793+0000","last_became_peered":"2024-05-09T09:47:18.215793+0000","last_unstale":"2024-05-09T09:50:46.341361+0000","last_undegraded":"2024-05-09T09:50:46.341361+0000","last_fullsized":"2024-05-09T09:50:46.341361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'113","last_scrub_stamp":"2024-05-09T09:50:46.341062+0000","last_deep_scrub":"32'113","last_deep_scrub_stamp":"2024-05-09T09:50:46.341062+0000","last_clean_scrub_stamp":"2024-05-09T09:50:46.341062+0000","objects_scrubbed":5,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:24:06.850096+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:05.480782+0000","last_change":"2024-05-09T09:51:05.480782+0000","last_active":"2024-05-09T09:51:05.480782+0000","last_peered":"2024-05-09T09:51:05.480782+0000","last_clean":"2024-05-09T09:51:05.480782+0000","last_became_active":"2024-05-09T09:47:20.250363+0000","last_became_peered":"2024-05-09T09:47:20.250363+0000","last_unstale":"2024-05-09T09:51:05.480782+0000","last_undegraded":"2024-05-09T09:51:05.480782+0000","last_fullsized":"2024-05-09T09:51:05.480782+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:05.480520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:05.480520+0000","last_clean_scrub_stamp":"2024-05-09T09:51:05.480520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:07:46.310851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:19.416370+0000","last_change":"2024-05-09T09:51:19.416370+0000","last_active":"2024-05-09T09:51:19.416370+0000","last_peered":"2024-05-09T09:51:19.416370+0000","last_clean":"2024-05-09T09:51:19.416370+0000","last_became_active":"2024-05-09T09:47:22.242410+0000","last_became_peered":"2024-05-09T09:47:22.242410+0000","last_unstale":"2024-05-09T09:51:19.416370+0000","last_undegraded":"2024-05-09T09:51:19.416370+0000","last_fullsized":"2024-05-09T09:51:19.416370+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:19.416094+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:19.416094+0000","last_clean_scrub_stamp":"2024-05-09T09:51:19.416094+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:58.738776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:17.471951+0000","last_change":"2024-05-09T09:51:17.471951+0000","last_active":"2024-05-09T09:51:17.471951+0000","last_peered":"2024-05-09T09:51:17.471951+0000","last_clean":"2024-05-09T09:51:17.471951+0000","last_became_active":"2024-05-09T09:47:14.190016+0000","last_became_peered":"2024-05-09T09:47:14.190016+0000","last_unstale":"2024-05-09T09:51:17.471951+0000","last_undegraded":"2024-05-09T09:51:17.471951+0000","last_fullsized":"2024-05-09T09:51:17.471951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:17.471525+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:17.471525+0000","last_clean_scrub_stamp":"2024-05-09T09:51:17.471525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:24:31.781883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:49.477452+0000","last_change":"2024-05-09T09:51:49.477516+0000","last_active":"2024-05-09T09:51:49.477452+0000","last_peered":"2024-05-09T09:51:49.477452+0000","last_clean":"2024-05-09T09:51:49.477452+0000","last_became_active":"2024-05-09T09:47:12.211221+0000","last_became_peered":"2024-05-09T09:47:12.211221+0000","last_unstale":"2024-05-09T09:51:49.477452+0000","last_undegraded":"2024-05-09T09:51:49.477452+0000","last_fullsized":"2024-05-09T09:51:49.477452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:49.477255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:49.477255+0000","last_clean_scrub_stamp":"2024-05-09T09:51:49.477255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:13:32.253186+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:00.977458+0000","last_change":"2024-05-09T09:51:00.977458+0000","last_active":"2024-05-09T09:51:00.977458+0000","last_peered":"2024-05-09T09:51:00.977458+0000","last_clean":"2024-05-09T09:51:00.977458+0000","last_became_active":"2024-05-09T09:47:16.214462+0000","last_became_peered":"2024-05-09T09:47:16.214462+0000","last_unstale":"2024-05-09T09:51:00.977458+0000","last_undegraded":"2024-05-09T09:51:00.977458+0000","last_fullsized":"2024-05-09T09:51:00.977458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:00.977167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:00.977167+0000","last_clean_scrub_stamp":"2024-05-09T09:51:00.977167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:59:20.098179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'119","reported_seq":178,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:57.261272+0000","last_change":"2024-05-09T09:50:57.261272+0000","last_active":"2024-05-09T09:50:57.261272+0000","last_peered":"2024-05-09T09:50:57.261272+0000","last_clean":"2024-05-09T09:50:57.261272+0000","last_became_active":"2024-05-09T09:47:18.212543+0000","last_became_peered":"2024-05-09T09:47:18.212543+0000","last_unstale":"2024-05-09T09:50:57.261272+0000","last_undegraded":"2024-05-09T09:50:57.261272+0000","last_fullsized":"2024-05-09T09:50:57.261272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-05-09T09:50:57.261002+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-05-09T09:50:57.261002+0000","last_clean_scrub_stamp":"2024-05-09T09:50:57.261002+0000","objects_scrubbed":7,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:26:30.185703+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":446,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:45.121680+0000","last_change":"2024-05-09T09:50:45.121680+0000","last_active":"2024-05-09T09:50:45.121680+0000","last_peered":"2024-05-09T09:50:45.121680+0000","last_clean":"2024-05-09T09:50:45.121680+0000","last_became_active":"2024-05-09T09:47:20.240236+0000","last_became_peered":"2024-05-09T09:47:20.240236+0000","last_unstale":"2024-05-09T09:50:45.121680+0000","last_undegraded":"2024-05-09T09:50:45.121680+0000","last_fullsized":"2024-05-09T09:50:45.121680+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:45.121417+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:45.121417+0000","last_clean_scrub_stamp":"2024-05-09T09:50:45.121417+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:31:47.109285+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'15","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:46.269523+0000","last_change":"2024-05-09T09:51:46.269599+0000","last_active":"2024-05-09T09:51:46.269523+0000","last_peered":"2024-05-09T09:51:46.269523+0000","last_clean":"2024-05-09T09:51:46.269523+0000","last_became_active":"2024-05-09T09:47:22.257986+0000","last_became_peered":"2024-05-09T09:47:22.257986+0000","last_unstale":"2024-05-09T09:51:46.269523+0000","last_undegraded":"2024-05-09T09:51:46.269523+0000","last_fullsized":"2024-05-09T09:51:46.269523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-09T09:51:46.269334+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-09T09:51:46.269334+0000","last_clean_scrub_stamp":"2024-05-09T09:51:46.269334+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:07:45.149305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'6","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:09.379305+0000","last_change":"2024-05-09T09:51:09.379305+0000","last_active":"2024-05-09T09:51:09.379305+0000","last_peered":"2024-05-09T09:51:09.379305+0000","last_clean":"2024-05-09T09:51:09.379305+0000","last_became_active":"2024-05-09T09:47:14.171963+0000","last_became_peered":"2024-05-09T09:47:14.171963+0000","last_unstale":"2024-05-09T09:51:09.379305+0000","last_undegraded":"2024-05-09T09:51:09.379305+0000","last_fullsized":"2024-05-09T09:51:09.379305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:09.379053+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:09.379053+0000","last_clean_scrub_stamp":"2024-05-09T09:51:09.379053+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:57:44.240122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:41.549977+0000","last_change":"2024-05-09T09:51:41.550037+0000","last_active":"2024-05-09T09:51:41.549977+0000","last_peered":"2024-05-09T09:51:41.549977+0000","last_clean":"2024-05-09T09:51:41.549977+0000","last_became_active":"2024-05-09T09:47:12.204519+0000","last_became_peered":"2024-05-09T09:47:12.204519+0000","last_unstale":"2024-05-09T09:51:41.549977+0000","last_undegraded":"2024-05-09T09:51:41.549977+0000","last_fullsized":"2024-05-09T09:51:41.549977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:41.549759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:41.549759+0000","last_clean_scrub_stamp":"2024-05-09T09:51:41.549759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:37:31.414388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":429,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:55.290590+0000","last_change":"2024-05-09T09:50:55.290590+0000","last_active":"2024-05-09T09:50:55.290590+0000","last_peered":"2024-05-09T09:50:55.290590+0000","last_clean":"2024-05-09T09:50:55.290590+0000","last_became_active":"2024-05-09T09:47:16.210812+0000","last_became_peered":"2024-05-09T09:47:16.210812+0000","last_unstale":"2024-05-09T09:50:55.290590+0000","last_undegraded":"2024-05-09T09:50:55.290590+0000","last_fullsized":"2024-05-09T09:50:55.290590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-09T09:50:55.290303+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-09T09:50:55.290303+0000","last_clean_scrub_stamp":"2024-05-09T09:50:55.290303+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:23:31.095926+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:46.428614+0000","last_change":"2024-05-09T09:50:46.428614+0000","last_active":"2024-05-09T09:50:46.428614+0000","last_peered":"2024-05-09T09:50:46.428614+0000","last_clean":"2024-05-09T09:50:46.428614+0000","last_became_active":"2024-05-09T09:47:18.224565+0000","last_became_peered":"2024-05-09T09:47:18.224565+0000","last_unstale":"2024-05-09T09:50:46.428614+0000","last_undegraded":"2024-05-09T09:50:46.428614+0000","last_fullsized":"2024-05-09T09:50:46.428614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-09T09:50:46.428349+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-09T09:50:46.428349+0000","last_clean_scrub_stamp":"2024-05-09T09:50:46.428349+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:10:30.696710+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":483,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.298675+0000","last_change":"2024-05-09T09:50:44.298675+0000","last_active":"2024-05-09T09:50:44.298675+0000","last_peered":"2024-05-09T09:50:44.298675+0000","last_clean":"2024-05-09T09:50:44.298675+0000","last_became_active":"2024-05-09T09:47:20.214337+0000","last_became_peered":"2024-05-09T09:47:20.214337+0000","last_unstale":"2024-05-09T09:50:44.298675+0000","last_undegraded":"2024-05-09T09:50:44.298675+0000","last_fullsized":"2024-05-09T09:50:44.298675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:44.298414+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:44.298414+0000","last_clean_scrub_stamp":"2024-05-09T09:50:44.298414+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:00:15.815268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:06.322785+0000","last_change":"2024-05-09T09:51:06.322785+0000","last_active":"2024-05-09T09:51:06.322785+0000","last_peered":"2024-05-09T09:51:06.322785+0000","last_clean":"2024-05-09T09:51:06.322785+0000","last_became_active":"2024-05-09T09:47:22.233796+0000","last_became_peered":"2024-05-09T09:47:22.233796+0000","last_unstale":"2024-05-09T09:51:06.322785+0000","last_undegraded":"2024-05-09T09:51:06.322785+0000","last_fullsized":"2024-05-09T09:51:06.322785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:06.322504+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:06.322504+0000","last_clean_scrub_stamp":"2024-05-09T09:51:06.322504+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:27:55.927227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:22.290052+0000","last_change":"2024-05-09T09:51:22.290052+0000","last_active":"2024-05-09T09:51:22.290052+0000","last_peered":"2024-05-09T09:51:22.290052+0000","last_clean":"2024-05-09T09:51:22.290052+0000","last_became_active":"2024-05-09T09:47:14.174707+0000","last_became_peered":"2024-05-09T09:47:14.174707+0000","last_unstale":"2024-05-09T09:51:22.290052+0000","last_undegraded":"2024-05-09T09:51:22.290052+0000","last_fullsized":"2024-05-09T09:51:22.290052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:22.289757+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:22.289757+0000","last_clean_scrub_stamp":"2024-05-09T09:51:22.289757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:39:44.166060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:40.589993+0000","last_change":"2024-05-09T09:51:40.590058+0000","last_active":"2024-05-09T09:51:40.589993+0000","last_peered":"2024-05-09T09:51:40.589993+0000","last_clean":"2024-05-09T09:51:40.589993+0000","last_became_active":"2024-05-09T09:47:12.207874+0000","last_became_peered":"2024-05-09T09:47:12.207874+0000","last_unstale":"2024-05-09T09:51:40.589993+0000","last_undegraded":"2024-05-09T09:51:40.589993+0000","last_fullsized":"2024-05-09T09:51:40.589993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:40.589802+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:40.589802+0000","last_clean_scrub_stamp":"2024-05-09T09:51:40.589802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:23:01.386163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"32'2","reported_seq":231,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:48.457964+0000","last_change":"2024-05-09T09:50:48.457964+0000","last_active":"2024-05-09T09:50:48.457964+0000","last_peered":"2024-05-09T09:50:48.457964+0000","last_clean":"2024-05-09T09:50:48.457964+0000","last_became_active":"2024-05-09T09:47:16.204577+0000","last_became_peered":"2024-05-09T09:47:16.204577+0000","last_unstale":"2024-05-09T09:50:48.457964+0000","last_undegraded":"2024-05-09T09:50:48.457964+0000","last_fullsized":"2024-05-09T09:50:48.457964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:50:48.457704+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:50:48.457704+0000","last_clean_scrub_stamp":"2024-05-09T09:50:48.457704+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:20:14.267139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'122","reported_seq":182,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:50.360866+0000","last_change":"2024-05-09T09:50:50.360866+0000","last_active":"2024-05-09T09:50:50.360866+0000","last_peered":"2024-05-09T09:50:50.360866+0000","last_clean":"2024-05-09T09:50:50.360866+0000","last_became_active":"2024-05-09T09:47:18.204057+0000","last_became_peered":"2024-05-09T09:47:18.204057+0000","last_unstale":"2024-05-09T09:50:50.360866+0000","last_undegraded":"2024-05-09T09:50:50.360866+0000","last_fullsized":"2024-05-09T09:50:50.360866+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'122","last_scrub_stamp":"2024-05-09T09:50:50.360552+0000","last_deep_scrub":"32'122","last_deep_scrub_stamp":"2024-05-09T09:50:50.360552+0000","last_clean_scrub_stamp":"2024-05-09T09:50:50.360552+0000","objects_scrubbed":8,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:58:29.414570+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:50.194527+0000","last_change":"2024-05-09T09:50:50.194527+0000","last_active":"2024-05-09T09:50:50.194527+0000","last_peered":"2024-05-09T09:50:50.194527+0000","last_clean":"2024-05-09T09:50:50.194527+0000","last_became_active":"2024-05-09T09:47:20.255477+0000","last_became_peered":"2024-05-09T09:47:20.255477+0000","last_unstale":"2024-05-09T09:50:50.194527+0000","last_undegraded":"2024-05-09T09:50:50.194527+0000","last_fullsized":"2024-05-09T09:50:50.194527+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:50.194227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:50.194227+0000","last_clean_scrub_stamp":"2024-05-09T09:50:50.194227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:40:06.186113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'9","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:08.256156+0000","last_change":"2024-05-09T09:51:08.256156+0000","last_active":"2024-05-09T09:51:08.256156+0000","last_peered":"2024-05-09T09:51:08.256156+0000","last_clean":"2024-05-09T09:51:08.256156+0000","last_became_active":"2024-05-09T09:47:22.227373+0000","last_became_peered":"2024-05-09T09:47:22.227373+0000","last_unstale":"2024-05-09T09:51:08.256156+0000","last_undegraded":"2024-05-09T09:51:08.256156+0000","last_fullsized":"2024-05-09T09:51:08.256156+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-09T09:51:08.255859+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-09T09:51:08.255859+0000","last_clean_scrub_stamp":"2024-05-09T09:51:08.255859+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:01:16.321404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:18.453848+0000","last_change":"2024-05-09T09:51:18.453848+0000","last_active":"2024-05-09T09:51:18.453848+0000","last_peered":"2024-05-09T09:51:18.453848+0000","last_clean":"2024-05-09T09:51:18.453848+0000","last_became_active":"2024-05-09T09:47:14.189623+0000","last_became_peered":"2024-05-09T09:47:14.189623+0000","last_unstale":"2024-05-09T09:51:18.453848+0000","last_undegraded":"2024-05-09T09:51:18.453848+0000","last_fullsized":"2024-05-09T09:51:18.453848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:18.453472+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:18.453472+0000","last_clean_scrub_stamp":"2024-05-09T09:51:18.453472+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:21:19.357961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":214,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:30.280676+0000","last_change":"2024-05-09T09:51:30.280748+0000","last_active":"2024-05-09T09:51:30.280676+0000","last_peered":"2024-05-09T09:51:30.280676+0000","last_clean":"2024-05-09T09:51:30.280676+0000","last_became_active":"2024-05-09T09:46:57.508178+0000","last_became_peered":"2024-05-09T09:46:57.508178+0000","last_unstale":"2024-05-09T09:51:30.280676+0000","last_undegraded":"2024-05-09T09:51:30.280676+0000","last_fullsized":"2024-05-09T09:51:30.280676+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-05-09T09:51:30.280470+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-05-09T09:51:30.280470+0000","last_clean_scrub_stamp":"2024-05-09T09:51:30.280470+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:25.211383+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:56.442302+0000","last_change":"2024-05-09T09:51:56.442362+0000","last_active":"2024-05-09T09:51:56.442302+0000","last_peered":"2024-05-09T09:51:56.442302+0000","last_clean":"2024-05-09T09:51:56.442302+0000","last_became_active":"2024-05-09T09:47:03.053783+0000","last_became_peered":"2024-05-09T09:47:03.053783+0000","last_unstale":"2024-05-09T09:51:56.442302+0000","last_undegraded":"2024-05-09T09:51:56.442302+0000","last_fullsized":"2024-05-09T09:51:56.442302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:56.442092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:56.442092+0000","last_clean_scrub_stamp":"2024-05-09T09:51:56.442092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:09:15.752316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:36.494378+0000","last_change":"2024-05-09T09:51:36.494436+0000","last_active":"2024-05-09T09:51:36.494378+0000","last_peered":"2024-05-09T09:51:36.494378+0000","last_clean":"2024-05-09T09:51:36.494378+0000","last_became_active":"2024-05-09T09:47:12.211344+0000","last_became_peered":"2024-05-09T09:47:12.211344+0000","last_unstale":"2024-05-09T09:51:36.494378+0000","last_undegraded":"2024-05-09T09:51:36.494378+0000","last_fullsized":"2024-05-09T09:51:36.494378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:36.494172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:36.494172+0000","last_clean_scrub_stamp":"2024-05-09T09:51:36.494172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:44:27.630619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:57.277911+0000","last_change":"2024-05-09T09:50:57.277911+0000","last_active":"2024-05-09T09:50:57.277911+0000","last_peered":"2024-05-09T09:50:57.277911+0000","last_clean":"2024-05-09T09:50:57.277911+0000","last_became_active":"2024-05-09T09:47:16.210404+0000","last_became_peered":"2024-05-09T09:47:16.210404+0000","last_unstale":"2024-05-09T09:50:57.277911+0000","last_undegraded":"2024-05-09T09:50:57.277911+0000","last_fullsized":"2024-05-09T09:50:57.277911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:57.277661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:57.277661+0000","last_clean_scrub_stamp":"2024-05-09T09:50:57.277661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:35:39.302436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'312","reported_seq":403,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:12.453446+0000","last_change":"2024-05-09T09:51:12.453446+0000","last_active":"2024-05-09T09:51:12.453446+0000","last_peered":"2024-05-09T09:51:12.453446+0000","last_clean":"2024-05-09T09:51:12.453446+0000","last_became_active":"2024-05-09T09:47:18.236370+0000","last_became_peered":"2024-05-09T09:47:18.236370+0000","last_unstale":"2024-05-09T09:51:12.453446+0000","last_undegraded":"2024-05-09T09:51:12.453446+0000","last_fullsized":"2024-05-09T09:51:12.453446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'312","last_scrub_stamp":"2024-05-09T09:51:12.453173+0000","last_deep_scrub":"32'312","last_deep_scrub_stamp":"2024-05-09T09:51:12.453173+0000","last_clean_scrub_stamp":"2024-05-09T09:51:12.453173+0000","objects_scrubbed":5,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:10:56.767720+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:53.880361+0000","last_change":"2024-05-09T09:50:53.880361+0000","last_active":"2024-05-09T09:50:53.880361+0000","last_peered":"2024-05-09T09:50:53.880361+0000","last_clean":"2024-05-09T09:50:53.880361+0000","last_became_active":"2024-05-09T09:47:20.250373+0000","last_became_peered":"2024-05-09T09:47:20.250373+0000","last_unstale":"2024-05-09T09:50:53.880361+0000","last_undegraded":"2024-05-09T09:50:53.880361+0000","last_fullsized":"2024-05-09T09:50:53.880361+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:53.880117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:53.880117+0000","last_clean_scrub_stamp":"2024-05-09T09:50:53.880117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:35:35.904892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'86","reported_seq":179,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:33.196489+0000","last_change":"2024-05-09T09:51:33.196489+0000","last_active":"2024-05-09T09:51:33.196489+0000","last_peered":"2024-05-09T09:51:33.196489+0000","last_clean":"2024-05-09T09:51:33.196489+0000","last_became_active":"2024-05-09T09:47:22.236267+0000","last_became_peered":"2024-05-09T09:47:22.236267+0000","last_unstale":"2024-05-09T09:51:33.196489+0000","last_undegraded":"2024-05-09T09:51:33.196489+0000","last_fullsized":"2024-05-09T09:51:33.196489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'86","last_scrub_stamp":"2024-05-09T09:51:33.196224+0000","last_deep_scrub":"32'86","last_deep_scrub_stamp":"2024-05-09T09:51:33.196224+0000","last_clean_scrub_stamp":"2024-05-09T09:51:33.196224+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:08:18.929286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":223,"num_write":170,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:28.500354+0000","last_change":"2024-05-09T09:51:28.500354+0000","last_active":"2024-05-09T09:51:28.500354+0000","last_peered":"2024-05-09T09:51:28.500354+0000","last_clean":"2024-05-09T09:51:28.500354+0000","last_became_active":"2024-05-09T09:47:14.185071+0000","last_became_peered":"2024-05-09T09:47:14.185071+0000","last_unstale":"2024-05-09T09:51:28.500354+0000","last_undegraded":"2024-05-09T09:51:28.500354+0000","last_fullsized":"2024-05-09T09:51:28.500354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:28.500075+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:28.500075+0000","last_clean_scrub_stamp":"2024-05-09T09:51:28.500075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:15:02.394128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:54.446226+0000","last_change":"2024-05-09T09:51:54.446283+0000","last_active":"2024-05-09T09:51:54.446226+0000","last_peered":"2024-05-09T09:51:54.446226+0000","last_clean":"2024-05-09T09:51:54.446226+0000","last_became_active":"2024-05-09T09:47:03.050535+0000","last_became_peered":"2024-05-09T09:47:03.050535+0000","last_unstale":"2024-05-09T09:51:54.446226+0000","last_undegraded":"2024-05-09T09:51:54.446226+0000","last_fullsized":"2024-05-09T09:51:54.446226+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:54.446002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:54.446002+0000","last_clean_scrub_stamp":"2024-05-09T09:51:54.446002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:37:15.445620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"32'2","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:25.300854+0000","last_change":"2024-05-09T09:51:25.300917+0000","last_active":"2024-05-09T09:51:25.300854+0000","last_peered":"2024-05-09T09:51:25.300854+0000","last_clean":"2024-05-09T09:51:25.300854+0000","last_became_active":"2024-05-09T09:47:12.203494+0000","last_became_peered":"2024-05-09T09:47:12.203494+0000","last_unstale":"2024-05-09T09:51:25.300854+0000","last_undegraded":"2024-05-09T09:51:25.300854+0000","last_fullsized":"2024-05-09T09:51:25.300854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:25.300654+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:25.300654+0000","last_clean_scrub_stamp":"2024-05-09T09:51:25.300654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:34.501747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:50.508773+0000","last_change":"2024-05-09T09:50:50.508773+0000","last_active":"2024-05-09T09:50:50.508773+0000","last_peered":"2024-05-09T09:50:50.508773+0000","last_clean":"2024-05-09T09:50:50.508773+0000","last_became_active":"2024-05-09T09:47:16.200369+0000","last_became_peered":"2024-05-09T09:47:16.200369+0000","last_unstale":"2024-05-09T09:50:50.508773+0000","last_undegraded":"2024-05-09T09:50:50.508773+0000","last_fullsized":"2024-05-09T09:50:50.508773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:50.508517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:50.508517+0000","last_clean_scrub_stamp":"2024-05-09T09:50:50.508517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:03:35.673628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'512","reported_seq":740,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:45.298265+0000","last_change":"2024-05-09T09:50:45.298265+0000","last_active":"2024-05-09T09:50:45.298265+0000","last_peered":"2024-05-09T09:50:45.298265+0000","last_clean":"2024-05-09T09:50:45.298265+0000","last_became_active":"2024-05-09T09:47:18.219321+0000","last_became_peered":"2024-05-09T09:47:18.219321+0000","last_unstale":"2024-05-09T09:50:45.298265+0000","last_undegraded":"2024-05-09T09:50:45.298265+0000","last_fullsized":"2024-05-09T09:50:45.298265+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'512","last_scrub_stamp":"2024-05-09T09:50:45.297859+0000","last_deep_scrub":"32'512","last_deep_scrub_stamp":"2024-05-09T09:50:45.297859+0000","last_clean_scrub_stamp":"2024-05-09T09:50:45.297859+0000","objects_scrubbed":10,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:39:29.985192+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:09.466226+0000","last_change":"2024-05-09T09:51:09.466226+0000","last_active":"2024-05-09T09:51:09.466226+0000","last_peered":"2024-05-09T09:51:09.466226+0000","last_clean":"2024-05-09T09:51:09.466226+0000","last_became_active":"2024-05-09T09:47:20.249089+0000","last_became_peered":"2024-05-09T09:47:20.249089+0000","last_unstale":"2024-05-09T09:51:09.466226+0000","last_undegraded":"2024-05-09T09:51:09.466226+0000","last_fullsized":"2024-05-09T09:51:09.466226+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:09.465983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:09.465983+0000","last_clean_scrub_stamp":"2024-05-09T09:51:09.465983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:24:45.606721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:39.199321+0000","last_change":"2024-05-09T09:51:39.199321+0000","last_active":"2024-05-09T09:51:39.199321+0000","last_peered":"2024-05-09T09:51:39.199321+0000","last_clean":"2024-05-09T09:51:39.199321+0000","last_became_active":"2024-05-09T09:47:22.244543+0000","last_became_peered":"2024-05-09T09:47:22.244543+0000","last_unstale":"2024-05-09T09:51:39.199321+0000","last_undegraded":"2024-05-09T09:51:39.199321+0000","last_fullsized":"2024-05-09T09:51:39.199321+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-09T09:51:39.199047+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-09T09:51:39.199047+0000","last_clean_scrub_stamp":"2024-05-09T09:51:39.199047+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:02:01.713821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:24.273042+0000","last_change":"2024-05-09T09:51:24.273042+0000","last_active":"2024-05-09T09:51:24.273042+0000","last_peered":"2024-05-09T09:51:24.273042+0000","last_clean":"2024-05-09T09:51:24.273042+0000","last_became_active":"2024-05-09T09:47:14.173959+0000","last_became_peered":"2024-05-09T09:47:14.173959+0000","last_unstale":"2024-05-09T09:51:24.273042+0000","last_undegraded":"2024-05-09T09:51:24.273042+0000","last_fullsized":"2024-05-09T09:51:24.273042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:24.272797+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:24.272797+0000","last_clean_scrub_stamp":"2024-05-09T09:51:24.272797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:25:00.413535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:24.266143+0000","last_change":"2024-05-09T09:51:24.266195+0000","last_active":"2024-05-09T09:51:24.266143+0000","last_peered":"2024-05-09T09:51:24.266143+0000","last_clean":"2024-05-09T09:51:24.266143+0000","last_became_active":"2024-05-09T09:47:03.052185+0000","last_became_peered":"2024-05-09T09:47:03.052185+0000","last_unstale":"2024-05-09T09:51:24.266143+0000","last_undegraded":"2024-05-09T09:51:24.266143+0000","last_fullsized":"2024-05-09T09:51:24.266143+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:24.265972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:24.265972+0000","last_clean_scrub_stamp":"2024-05-09T09:51:24.265972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:24.371116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:38.333595+0000","last_change":"2024-05-09T09:51:38.333664+0000","last_active":"2024-05-09T09:51:38.333595+0000","last_peered":"2024-05-09T09:51:38.333595+0000","last_clean":"2024-05-09T09:51:38.333595+0000","last_became_active":"2024-05-09T09:47:12.183846+0000","last_became_peered":"2024-05-09T09:47:12.183846+0000","last_unstale":"2024-05-09T09:51:38.333595+0000","last_undegraded":"2024-05-09T09:51:38.333595+0000","last_fullsized":"2024-05-09T09:51:38.333595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:38.333371+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:38.333371+0000","last_clean_scrub_stamp":"2024-05-09T09:51:38.333371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:06:28.044996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:00.281973+0000","last_change":"2024-05-09T09:51:00.281973+0000","last_active":"2024-05-09T09:51:00.281973+0000","last_peered":"2024-05-09T09:51:00.281973+0000","last_clean":"2024-05-09T09:51:00.281973+0000","last_became_active":"2024-05-09T09:47:16.197380+0000","last_became_peered":"2024-05-09T09:47:16.197380+0000","last_unstale":"2024-05-09T09:51:00.281973+0000","last_undegraded":"2024-05-09T09:51:00.281973+0000","last_fullsized":"2024-05-09T09:51:00.281973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:00.281822+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:00.281822+0000","last_clean_scrub_stamp":"2024-05-09T09:51:00.281822+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:17:45.780390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'25","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:53.286054+0000","last_change":"2024-05-09T09:50:53.286054+0000","last_active":"2024-05-09T09:50:53.286054+0000","last_peered":"2024-05-09T09:50:53.286054+0000","last_clean":"2024-05-09T09:50:53.286054+0000","last_became_active":"2024-05-09T09:47:18.217023+0000","last_became_peered":"2024-05-09T09:47:18.217023+0000","last_unstale":"2024-05-09T09:50:53.286054+0000","last_undegraded":"2024-05-09T09:50:53.286054+0000","last_fullsized":"2024-05-09T09:50:53.286054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2024-05-09T09:50:53.285640+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2024-05-09T09:50:53.285640+0000","last_clean_scrub_stamp":"2024-05-09T09:50:53.285640+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:56:02.284410+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:57.982184+0000","last_change":"2024-05-09T09:50:57.982184+0000","last_active":"2024-05-09T09:50:57.982184+0000","last_peered":"2024-05-09T09:50:57.982184+0000","last_clean":"2024-05-09T09:50:57.982184+0000","last_became_active":"2024-05-09T09:47:20.250979+0000","last_became_peered":"2024-05-09T09:47:20.250979+0000","last_unstale":"2024-05-09T09:50:57.982184+0000","last_undegraded":"2024-05-09T09:50:57.982184+0000","last_fullsized":"2024-05-09T09:50:57.982184+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:57.981939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:57.981939+0000","last_clean_scrub_stamp":"2024-05-09T09:50:57.981939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:20:07.343476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:52:04.336536+0000","last_change":"2024-05-09T09:52:04.336641+0000","last_active":"2024-05-09T09:52:04.336536+0000","last_peered":"2024-05-09T09:52:04.336536+0000","last_clean":"2024-05-09T09:52:04.336536+0000","last_became_active":"2024-05-09T09:47:22.263615+0000","last_became_peered":"2024-05-09T09:47:22.263615+0000","last_unstale":"2024-05-09T09:52:04.336536+0000","last_undegraded":"2024-05-09T09:52:04.336536+0000","last_fullsized":"2024-05-09T09:52:04.336536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:52:04.336307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:52:04.336307+0000","last_clean_scrub_stamp":"2024-05-09T09:52:04.336307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:27.302464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'4","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:13.101070+0000","last_change":"2024-05-09T09:51:13.101070+0000","last_active":"2024-05-09T09:51:13.101070+0000","last_peered":"2024-05-09T09:51:13.101070+0000","last_clean":"2024-05-09T09:51:13.101070+0000","last_became_active":"2024-05-09T09:47:14.188644+0000","last_became_peered":"2024-05-09T09:47:14.188644+0000","last_unstale":"2024-05-09T09:51:13.101070+0000","last_undegraded":"2024-05-09T09:51:13.101070+0000","last_fullsized":"2024-05-09T09:51:13.101070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:13.100709+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:13.100709+0000","last_clean_scrub_stamp":"2024-05-09T09:51:13.100709+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:32:54.848587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:55.422607+0000","last_change":"2024-05-09T09:51:55.422667+0000","last_active":"2024-05-09T09:51:55.422607+0000","last_peered":"2024-05-09T09:51:55.422607+0000","last_clean":"2024-05-09T09:51:55.422607+0000","last_became_active":"2024-05-09T09:47:03.050832+0000","last_became_peered":"2024-05-09T09:47:03.050832+0000","last_unstale":"2024-05-09T09:51:55.422607+0000","last_undegraded":"2024-05-09T09:51:55.422607+0000","last_fullsized":"2024-05-09T09:51:55.422607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:55.422415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:55.422415+0000","last_clean_scrub_stamp":"2024-05-09T09:51:55.422415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:49:42.947181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:25.242601+0000","last_change":"2024-05-09T09:51:25.242656+0000","last_active":"2024-05-09T09:51:25.242601+0000","last_peered":"2024-05-09T09:51:25.242601+0000","last_clean":"2024-05-09T09:51:25.242601+0000","last_became_active":"2024-05-09T09:47:12.190521+0000","last_became_peered":"2024-05-09T09:47:12.190521+0000","last_unstale":"2024-05-09T09:51:25.242601+0000","last_undegraded":"2024-05-09T09:51:25.242601+0000","last_fullsized":"2024-05-09T09:51:25.242601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:25.242400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:25.242400+0000","last_clean_scrub_stamp":"2024-05-09T09:51:25.242400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:34:22.065847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:08.084806+0000","last_change":"2024-05-09T09:51:08.084806+0000","last_active":"2024-05-09T09:51:08.084806+0000","last_peered":"2024-05-09T09:51:08.084806+0000","last_clean":"2024-05-09T09:51:08.084806+0000","last_became_active":"2024-05-09T09:47:16.187120+0000","last_became_peered":"2024-05-09T09:47:16.187120+0000","last_unstale":"2024-05-09T09:51:08.084806+0000","last_undegraded":"2024-05-09T09:51:08.084806+0000","last_fullsized":"2024-05-09T09:51:08.084806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:08.084559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:08.084559+0000","last_clean_scrub_stamp":"2024-05-09T09:51:08.084559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:22.872238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'21","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:49.497580+0000","last_change":"2024-05-09T09:50:49.497580+0000","last_active":"2024-05-09T09:50:49.497580+0000","last_peered":"2024-05-09T09:50:49.497580+0000","last_clean":"2024-05-09T09:50:49.497580+0000","last_became_active":"2024-05-09T09:47:18.230757+0000","last_became_peered":"2024-05-09T09:47:18.230757+0000","last_unstale":"2024-05-09T09:50:49.497580+0000","last_undegraded":"2024-05-09T09:50:49.497580+0000","last_fullsized":"2024-05-09T09:50:49.497580+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-05-09T09:50:49.497309+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-05-09T09:50:49.497309+0000","last_clean_scrub_stamp":"2024-05-09T09:50:49.497309+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:00:57.562854+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:08.424955+0000","last_change":"2024-05-09T09:51:08.424955+0000","last_active":"2024-05-09T09:51:08.424955+0000","last_peered":"2024-05-09T09:51:08.424955+0000","last_clean":"2024-05-09T09:51:08.424955+0000","last_became_active":"2024-05-09T09:47:20.249919+0000","last_became_peered":"2024-05-09T09:47:20.249919+0000","last_unstale":"2024-05-09T09:51:08.424955+0000","last_undegraded":"2024-05-09T09:51:08.424955+0000","last_fullsized":"2024-05-09T09:51:08.424955+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:08.424700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:08.424700+0000","last_clean_scrub_stamp":"2024-05-09T09:51:08.424700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:41:47.741972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'6","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:44.236951+0000","last_change":"2024-05-09T09:51:44.236951+0000","last_active":"2024-05-09T09:51:44.236951+0000","last_peered":"2024-05-09T09:51:44.236951+0000","last_clean":"2024-05-09T09:51:44.236951+0000","last_became_active":"2024-05-09T09:47:22.259833+0000","last_became_peered":"2024-05-09T09:47:22.259833+0000","last_unstale":"2024-05-09T09:51:44.236951+0000","last_undegraded":"2024-05-09T09:51:44.236951+0000","last_fullsized":"2024-05-09T09:51:44.236951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:44.236663+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:44.236663+0000","last_clean_scrub_stamp":"2024-05-09T09:51:44.236663+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:00.115843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:16.280449+0000","last_change":"2024-05-09T09:51:16.280449+0000","last_active":"2024-05-09T09:51:16.280449+0000","last_peered":"2024-05-09T09:51:16.280449+0000","last_clean":"2024-05-09T09:51:16.280449+0000","last_became_active":"2024-05-09T09:47:14.173535+0000","last_became_peered":"2024-05-09T09:47:14.173535+0000","last_unstale":"2024-05-09T09:51:16.280449+0000","last_undegraded":"2024-05-09T09:51:16.280449+0000","last_fullsized":"2024-05-09T09:51:16.280449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:16.280201+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:16.280201+0000","last_clean_scrub_stamp":"2024-05-09T09:51:16.280201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:02:57.723193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:29.238181+0000","last_change":"2024-05-09T09:51:29.238251+0000","last_active":"2024-05-09T09:51:29.238181+0000","last_peered":"2024-05-09T09:51:29.238181+0000","last_clean":"2024-05-09T09:51:29.238181+0000","last_became_active":"2024-05-09T09:47:12.194500+0000","last_became_peered":"2024-05-09T09:47:12.194500+0000","last_unstale":"2024-05-09T09:51:29.238181+0000","last_undegraded":"2024-05-09T09:51:29.238181+0000","last_fullsized":"2024-05-09T09:51:29.238181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:29.237957+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:29.237957+0000","last_clean_scrub_stamp":"2024-05-09T09:51:29.237957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:45:39.761788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:32.222894+0000","last_change":"2024-05-09T09:51:32.222951+0000","last_active":"2024-05-09T09:51:32.222894+0000","last_peered":"2024-05-09T09:51:32.222894+0000","last_clean":"2024-05-09T09:51:32.222894+0000","last_became_active":"2024-05-09T09:47:03.051159+0000","last_became_peered":"2024-05-09T09:47:03.051159+0000","last_unstale":"2024-05-09T09:51:32.222894+0000","last_undegraded":"2024-05-09T09:51:32.222894+0000","last_fullsized":"2024-05-09T09:51:32.222894+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:32.222688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:32.222688+0000","last_clean_scrub_stamp":"2024-05-09T09:51:32.222688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:24:46.533046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'7","reported_seq":242,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:05.017370+0000","last_change":"2024-05-09T09:51:05.017370+0000","last_active":"2024-05-09T09:51:05.017370+0000","last_peered":"2024-05-09T09:51:05.017370+0000","last_clean":"2024-05-09T09:51:05.017370+0000","last_became_active":"2024-05-09T09:47:16.198233+0000","last_became_peered":"2024-05-09T09:47:16.198233+0000","last_unstale":"2024-05-09T09:51:05.017370+0000","last_undegraded":"2024-05-09T09:51:05.017370+0000","last_fullsized":"2024-05-09T09:51:05.017370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-05-09T09:51:05.017095+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-05-09T09:51:05.017095+0000","last_clean_scrub_stamp":"2024-05-09T09:51:05.017095+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:53:06.632153+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1180,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":302,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'221","reported_seq":298,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:56.950939+0000","last_change":"2024-05-09T09:50:56.950939+0000","last_active":"2024-05-09T09:50:56.950939+0000","last_peered":"2024-05-09T09:50:56.950939+0000","last_clean":"2024-05-09T09:50:56.950939+0000","last_became_active":"2024-05-09T09:47:18.199411+0000","last_became_peered":"2024-05-09T09:47:18.199411+0000","last_unstale":"2024-05-09T09:50:56.950939+0000","last_undegraded":"2024-05-09T09:50:56.950939+0000","last_fullsized":"2024-05-09T09:50:56.950939+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'221","last_scrub_stamp":"2024-05-09T09:50:56.950671+0000","last_deep_scrub":"32'221","last_deep_scrub_stamp":"2024-05-09T09:50:56.950671+0000","last_clean_scrub_stamp":"2024-05-09T09:50:56.950671+0000","objects_scrubbed":9,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:44:33.387528+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:48.114403+0000","last_change":"2024-05-09T09:50:48.114403+0000","last_active":"2024-05-09T09:50:48.114403+0000","last_peered":"2024-05-09T09:50:48.114403+0000","last_clean":"2024-05-09T09:50:48.114403+0000","last_became_active":"2024-05-09T09:47:20.233024+0000","last_became_peered":"2024-05-09T09:47:20.233024+0000","last_unstale":"2024-05-09T09:50:48.114403+0000","last_undegraded":"2024-05-09T09:50:48.114403+0000","last_fullsized":"2024-05-09T09:50:48.114403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:48.114039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:48.114039+0000","last_clean_scrub_stamp":"2024-05-09T09:50:48.114039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:03.759841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'11","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:14.131467+0000","last_change":"2024-05-09T09:51:14.131467+0000","last_active":"2024-05-09T09:51:14.131467+0000","last_peered":"2024-05-09T09:51:14.131467+0000","last_clean":"2024-05-09T09:51:14.131467+0000","last_became_active":"2024-05-09T09:47:22.228855+0000","last_became_peered":"2024-05-09T09:47:22.228855+0000","last_unstale":"2024-05-09T09:51:14.131467+0000","last_undegraded":"2024-05-09T09:51:14.131467+0000","last_fullsized":"2024-05-09T09:51:14.131467+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-05-09T09:51:14.131207+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-05-09T09:51:14.131207+0000","last_clean_scrub_stamp":"2024-05-09T09:51:14.131207+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:46:57.527442+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'12","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:45.269754+0000","last_change":"2024-05-09T09:51:45.269833+0000","last_active":"2024-05-09T09:51:45.269754+0000","last_peered":"2024-05-09T09:51:45.269754+0000","last_clean":"2024-05-09T09:51:45.269754+0000","last_became_active":"2024-05-09T09:47:52.430912+0000","last_became_peered":"2024-05-09T09:47:52.430912+0000","last_unstale":"2024-05-09T09:51:45.269754+0000","last_undegraded":"2024-05-09T09:51:45.269754+0000","last_fullsized":"2024-05-09T09:51:45.269754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-09T09:51:45.269561+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-09T09:51:45.269561+0000","last_clean_scrub_stamp":"2024-05-09T09:51:45.269561+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:27.877783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:39.340829+0000","last_change":"2024-05-09T09:51:39.340891+0000","last_active":"2024-05-09T09:51:39.340829+0000","last_peered":"2024-05-09T09:51:39.340829+0000","last_clean":"2024-05-09T09:51:39.340829+0000","last_became_active":"2024-05-09T09:47:12.189486+0000","last_became_peered":"2024-05-09T09:47:12.189486+0000","last_unstale":"2024-05-09T09:51:39.340829+0000","last_undegraded":"2024-05-09T09:51:39.340829+0000","last_fullsized":"2024-05-09T09:51:39.340829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:39.340616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:39.340616+0000","last_clean_scrub_stamp":"2024-05-09T09:51:39.340616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:54:04.794316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:53.468929+0000","last_change":"2024-05-09T09:51:53.469073+0000","last_active":"2024-05-09T09:51:53.468929+0000","last_peered":"2024-05-09T09:51:53.468929+0000","last_clean":"2024-05-09T09:51:53.468929+0000","last_became_active":"2024-05-09T09:47:03.050600+0000","last_became_peered":"2024-05-09T09:47:03.050600+0000","last_unstale":"2024-05-09T09:51:53.468929+0000","last_undegraded":"2024-05-09T09:51:53.468929+0000","last_fullsized":"2024-05-09T09:51:53.468929+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:53.468698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:53.468698+0000","last_clean_scrub_stamp":"2024-05-09T09:51:53.468698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:04:39.515405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:54.486490+0000","last_change":"2024-05-09T09:50:54.486490+0000","last_active":"2024-05-09T09:50:54.486490+0000","last_peered":"2024-05-09T09:50:54.486490+0000","last_clean":"2024-05-09T09:50:54.486490+0000","last_became_active":"2024-05-09T09:47:16.182232+0000","last_became_peered":"2024-05-09T09:47:16.182232+0000","last_unstale":"2024-05-09T09:50:54.486490+0000","last_undegraded":"2024-05-09T09:50:54.486490+0000","last_fullsized":"2024-05-09T09:50:54.486490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:54.486244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:54.486244+0000","last_clean_scrub_stamp":"2024-05-09T09:50:54.486244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:04:41.948173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'21","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:49.380947+0000","last_change":"2024-05-09T09:50:49.380947+0000","last_active":"2024-05-09T09:50:49.380947+0000","last_peered":"2024-05-09T09:50:49.380947+0000","last_clean":"2024-05-09T09:50:49.380947+0000","last_became_active":"2024-05-09T09:47:18.211020+0000","last_became_peered":"2024-05-09T09:47:18.211020+0000","last_unstale":"2024-05-09T09:50:49.380947+0000","last_undegraded":"2024-05-09T09:50:49.380947+0000","last_fullsized":"2024-05-09T09:50:49.380947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-05-09T09:50:49.380517+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-05-09T09:50:49.380517+0000","last_clean_scrub_stamp":"2024-05-09T09:50:49.380517+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:01.985708+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":384,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:52.295501+0000","last_change":"2024-05-09T09:50:52.295501+0000","last_active":"2024-05-09T09:50:52.295501+0000","last_peered":"2024-05-09T09:50:52.295501+0000","last_clean":"2024-05-09T09:50:52.295501+0000","last_became_active":"2024-05-09T09:47:20.226481+0000","last_became_peered":"2024-05-09T09:47:20.226481+0000","last_unstale":"2024-05-09T09:50:52.295501+0000","last_undegraded":"2024-05-09T09:50:52.295501+0000","last_fullsized":"2024-05-09T09:50:52.295501+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:52.295146+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:52.295146+0000","last_clean_scrub_stamp":"2024-05-09T09:50:52.295146+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:27.487386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:35.467911+0000","last_change":"2024-05-09T09:51:35.467911+0000","last_active":"2024-05-09T09:51:35.467911+0000","last_peered":"2024-05-09T09:51:35.467911+0000","last_clean":"2024-05-09T09:51:35.467911+0000","last_became_active":"2024-05-09T09:47:22.256285+0000","last_became_peered":"2024-05-09T09:47:22.256285+0000","last_unstale":"2024-05-09T09:51:35.467911+0000","last_undegraded":"2024-05-09T09:51:35.467911+0000","last_fullsized":"2024-05-09T09:51:35.467911+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:35.467661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:35.467661+0000","last_clean_scrub_stamp":"2024-05-09T09:51:35.467661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:08:21.152606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:30.564820+0000","last_change":"2024-05-09T09:51:30.564884+0000","last_active":"2024-05-09T09:51:30.564820+0000","last_peered":"2024-05-09T09:51:30.564820+0000","last_clean":"2024-05-09T09:51:30.564820+0000","last_became_active":"2024-05-09T09:47:14.183542+0000","last_became_peered":"2024-05-09T09:47:14.183542+0000","last_unstale":"2024-05-09T09:51:30.564820+0000","last_undegraded":"2024-05-09T09:51:30.564820+0000","last_fullsized":"2024-05-09T09:51:30.564820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:30.564595+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:30.564595+0000","last_clean_scrub_stamp":"2024-05-09T09:51:30.564595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:51.778769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:58.435136+0000","last_change":"2024-05-09T09:51:58.435260+0000","last_active":"2024-05-09T09:51:58.435136+0000","last_peered":"2024-05-09T09:51:58.435136+0000","last_clean":"2024-05-09T09:51:58.435136+0000","last_became_active":"2024-05-09T09:47:12.199656+0000","last_became_peered":"2024-05-09T09:47:12.199656+0000","last_unstale":"2024-05-09T09:51:58.435136+0000","last_undegraded":"2024-05-09T09:51:58.435136+0000","last_fullsized":"2024-05-09T09:51:58.435136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:58.434887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:58.434887+0000","last_clean_scrub_stamp":"2024-05-09T09:51:58.434887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:36:29.410701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:33.179270+0000","last_change":"2024-05-09T09:51:33.179325+0000","last_active":"2024-05-09T09:51:33.179270+0000","last_peered":"2024-05-09T09:51:33.179270+0000","last_clean":"2024-05-09T09:51:33.179270+0000","last_became_active":"2024-05-09T09:47:03.052728+0000","last_became_peered":"2024-05-09T09:47:03.052728+0000","last_unstale":"2024-05-09T09:51:33.179270+0000","last_undegraded":"2024-05-09T09:51:33.179270+0000","last_fullsized":"2024-05-09T09:51:33.179270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:33.179071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:33.179071+0000","last_clean_scrub_stamp":"2024-05-09T09:51:33.179071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:21:34.083560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.650656+0000","last_change":"2024-05-09T09:47:52.183646+0000","last_active":"2024-05-09T09:50:44.650656+0000","last_peered":"2024-05-09T09:50:44.650656+0000","last_clean":"2024-05-09T09:50:44.650656+0000","last_became_active":"2024-05-09T09:47:52.182360+0000","last_became_peered":"2024-05-09T09:47:52.182360+0000","last_unstale":"2024-05-09T09:50:44.650656+0000","last_undegraded":"2024-05-09T09:50:44.650656+0000","last_fullsized":"2024-05-09T09:50:44.650656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:16.463719+0000","last_change":"2024-05-09T09:51:16.463719+0000","last_active":"2024-05-09T09:51:16.463719+0000","last_peered":"2024-05-09T09:51:16.463719+0000","last_clean":"2024-05-09T09:51:16.463719+0000","last_became_active":"2024-05-09T09:47:18.234556+0000","last_became_peered":"2024-05-09T09:47:18.234556+0000","last_unstale":"2024-05-09T09:51:16.463719+0000","last_undegraded":"2024-05-09T09:51:16.463719+0000","last_fullsized":"2024-05-09T09:51:16.463719+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-09T09:51:16.463413+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-09T09:51:16.463413+0000","last_clean_scrub_stamp":"2024-05-09T09:51:16.463413+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:45:18.905836+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":414,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:47.848115+0000","last_change":"2024-05-09T09:50:47.848115+0000","last_active":"2024-05-09T09:50:47.848115+0000","last_peered":"2024-05-09T09:50:47.848115+0000","last_clean":"2024-05-09T09:50:47.848115+0000","last_became_active":"2024-05-09T09:47:20.226936+0000","last_became_peered":"2024-05-09T09:47:20.226936+0000","last_unstale":"2024-05-09T09:50:47.848115+0000","last_undegraded":"2024-05-09T09:50:47.848115+0000","last_fullsized":"2024-05-09T09:50:47.848115+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:47.847851+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:47.847851+0000","last_clean_scrub_stamp":"2024-05-09T09:50:47.847851+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:23:07.394309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:42.210770+0000","last_change":"2024-05-09T09:51:42.210770+0000","last_active":"2024-05-09T09:51:42.210770+0000","last_peered":"2024-05-09T09:51:42.210770+0000","last_clean":"2024-05-09T09:51:42.210770+0000","last_became_active":"2024-05-09T09:47:22.259547+0000","last_became_peered":"2024-05-09T09:47:22.259547+0000","last_unstale":"2024-05-09T09:51:42.210770+0000","last_undegraded":"2024-05-09T09:51:42.210770+0000","last_fullsized":"2024-05-09T09:51:42.210770+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-05-09T09:51:42.210490+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-05-09T09:51:42.210490+0000","last_clean_scrub_stamp":"2024-05-09T09:51:42.210490+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:06:31.922115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'12","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:12.442602+0000","last_change":"2024-05-09T09:51:12.442602+0000","last_active":"2024-05-09T09:51:12.442602+0000","last_peered":"2024-05-09T09:51:12.442602+0000","last_clean":"2024-05-09T09:51:12.442602+0000","last_became_active":"2024-05-09T09:47:14.173673+0000","last_became_peered":"2024-05-09T09:47:14.173673+0000","last_unstale":"2024-05-09T09:51:12.442602+0000","last_undegraded":"2024-05-09T09:51:12.442602+0000","last_fullsized":"2024-05-09T09:51:12.442602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-09T09:51:12.442192+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-09T09:51:12.442192+0000","last_clean_scrub_stamp":"2024-05-09T09:51:12.442192+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:34.408920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:27.262111+0000","last_change":"2024-05-09T09:51:27.262111+0000","last_active":"2024-05-09T09:51:27.262111+0000","last_peered":"2024-05-09T09:51:27.262111+0000","last_clean":"2024-05-09T09:51:27.262111+0000","last_became_active":"2024-05-09T09:47:12.205502+0000","last_became_peered":"2024-05-09T09:47:12.205502+0000","last_unstale":"2024-05-09T09:51:27.262111+0000","last_undegraded":"2024-05-09T09:51:27.262111+0000","last_fullsized":"2024-05-09T09:51:27.262111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:27.261827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:27.261827+0000","last_clean_scrub_stamp":"2024-05-09T09:51:27.261827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:00:13.953985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:57.424168+0000","last_change":"2024-05-09T09:51:57.424228+0000","last_active":"2024-05-09T09:51:57.424168+0000","last_peered":"2024-05-09T09:51:57.424168+0000","last_clean":"2024-05-09T09:51:57.424168+0000","last_became_active":"2024-05-09T09:47:03.186434+0000","last_became_peered":"2024-05-09T09:47:03.186434+0000","last_unstale":"2024-05-09T09:51:57.424168+0000","last_undegraded":"2024-05-09T09:51:57.424168+0000","last_fullsized":"2024-05-09T09:51:57.424168+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:57.423911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:57.423911+0000","last_clean_scrub_stamp":"2024-05-09T09:51:57.423911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:14.320140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:56.472700+0000","last_change":"2024-05-09T09:50:56.472700+0000","last_active":"2024-05-09T09:50:56.472700+0000","last_peered":"2024-05-09T09:50:56.472700+0000","last_clean":"2024-05-09T09:50:56.472700+0000","last_became_active":"2024-05-09T09:47:16.182713+0000","last_became_peered":"2024-05-09T09:47:16.182713+0000","last_unstale":"2024-05-09T09:50:56.472700+0000","last_undegraded":"2024-05-09T09:50:56.472700+0000","last_fullsized":"2024-05-09T09:50:56.472700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:56.472447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:56.472447+0000","last_clean_scrub_stamp":"2024-05-09T09:50:56.472447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:02:37.915439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'318","reported_seq":412,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:49.169601+0000","last_change":"2024-05-09T09:50:49.169601+0000","last_active":"2024-05-09T09:50:49.169601+0000","last_peered":"2024-05-09T09:50:49.169601+0000","last_clean":"2024-05-09T09:50:49.169601+0000","last_became_active":"2024-05-09T09:47:18.226473+0000","last_became_peered":"2024-05-09T09:47:18.226473+0000","last_unstale":"2024-05-09T09:50:49.169601+0000","last_undegraded":"2024-05-09T09:50:49.169601+0000","last_fullsized":"2024-05-09T09:50:49.169601+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'318","last_scrub_stamp":"2024-05-09T09:50:49.169325+0000","last_deep_scrub":"32'318","last_deep_scrub_stamp":"2024-05-09T09:50:49.169325+0000","last_clean_scrub_stamp":"2024-05-09T09:50:49.169325+0000","objects_scrubbed":8,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:47:39.409337+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:48.836895+0000","last_change":"2024-05-09T09:50:48.836895+0000","last_active":"2024-05-09T09:50:48.836895+0000","last_peered":"2024-05-09T09:50:48.836895+0000","last_clean":"2024-05-09T09:50:48.836895+0000","last_became_active":"2024-05-09T09:47:20.227198+0000","last_became_peered":"2024-05-09T09:47:20.227198+0000","last_unstale":"2024-05-09T09:50:48.836895+0000","last_undegraded":"2024-05-09T09:50:48.836895+0000","last_fullsized":"2024-05-09T09:50:48.836895+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:48.836642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:48.836642+0000","last_clean_scrub_stamp":"2024-05-09T09:50:48.836642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:31:25.639707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:02.266234+0000","last_change":"2024-05-09T09:51:02.266234+0000","last_active":"2024-05-09T09:51:02.266234+0000","last_peered":"2024-05-09T09:51:02.266234+0000","last_clean":"2024-05-09T09:51:02.266234+0000","last_became_active":"2024-05-09T09:47:22.233279+0000","last_became_peered":"2024-05-09T09:47:22.233279+0000","last_unstale":"2024-05-09T09:51:02.266234+0000","last_undegraded":"2024-05-09T09:51:02.266234+0000","last_fullsized":"2024-05-09T09:51:02.266234+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:02.265986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:02.265986+0000","last_clean_scrub_stamp":"2024-05-09T09:51:02.265986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:11:12.792128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:34.206325+0000","last_change":"2024-05-09T09:51:34.206325+0000","last_active":"2024-05-09T09:51:34.206325+0000","last_peered":"2024-05-09T09:51:34.206325+0000","last_clean":"2024-05-09T09:51:34.206325+0000","last_became_active":"2024-05-09T09:47:22.236863+0000","last_became_peered":"2024-05-09T09:47:22.236863+0000","last_unstale":"2024-05-09T09:51:34.206325+0000","last_undegraded":"2024-05-09T09:51:34.206325+0000","last_fullsized":"2024-05-09T09:51:34.206325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:34.206073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:34.206073+0000","last_clean_scrub_stamp":"2024-05-09T09:51:34.206073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:03:16.461845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:18.352621+0000","last_change":"2024-05-09T09:51:18.352621+0000","last_active":"2024-05-09T09:51:18.352621+0000","last_peered":"2024-05-09T09:51:18.352621+0000","last_clean":"2024-05-09T09:51:18.352621+0000","last_became_active":"2024-05-09T09:47:14.184250+0000","last_became_peered":"2024-05-09T09:47:14.184250+0000","last_unstale":"2024-05-09T09:51:18.352621+0000","last_undegraded":"2024-05-09T09:51:18.352621+0000","last_fullsized":"2024-05-09T09:51:18.352621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:18.352348+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:18.352348+0000","last_clean_scrub_stamp":"2024-05-09T09:51:18.352348+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:53:19.967406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:42.577858+0000","last_change":"2024-05-09T09:51:42.577858+0000","last_active":"2024-05-09T09:51:42.577858+0000","last_peered":"2024-05-09T09:51:42.577858+0000","last_clean":"2024-05-09T09:51:42.577858+0000","last_became_active":"2024-05-09T09:47:12.203479+0000","last_became_peered":"2024-05-09T09:47:12.203479+0000","last_unstale":"2024-05-09T09:51:42.577858+0000","last_undegraded":"2024-05-09T09:51:42.577858+0000","last_fullsized":"2024-05-09T09:51:42.577858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:42.577565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:42.577565+0000","last_clean_scrub_stamp":"2024-05-09T09:51:42.577565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:55:08.778669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:53.265573+0000","last_change":"2024-05-09T09:50:53.265573+0000","last_active":"2024-05-09T09:50:53.265573+0000","last_peered":"2024-05-09T09:50:53.265573+0000","last_clean":"2024-05-09T09:50:53.265573+0000","last_became_active":"2024-05-09T09:47:16.210992+0000","last_became_peered":"2024-05-09T09:47:16.210992+0000","last_unstale":"2024-05-09T09:50:53.265573+0000","last_undegraded":"2024-05-09T09:50:53.265573+0000","last_fullsized":"2024-05-09T09:50:53.265573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:53.265312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:53.265312+0000","last_clean_scrub_stamp":"2024-05-09T09:50:53.265312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:28:20.308389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'113","reported_seq":170,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:57.465918+0000","last_change":"2024-05-09T09:50:57.465918+0000","last_active":"2024-05-09T09:50:57.465918+0000","last_peered":"2024-05-09T09:50:57.465918+0000","last_clean":"2024-05-09T09:50:57.465918+0000","last_became_active":"2024-05-09T09:47:18.234014+0000","last_became_peered":"2024-05-09T09:47:18.234014+0000","last_unstale":"2024-05-09T09:50:57.465918+0000","last_undegraded":"2024-05-09T09:50:57.465918+0000","last_fullsized":"2024-05-09T09:50:57.465918+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'113","last_scrub_stamp":"2024-05-09T09:50:57.465647+0000","last_deep_scrub":"32'113","last_deep_scrub_stamp":"2024-05-09T09:50:57.465647+0000","last_clean_scrub_stamp":"2024-05-09T09:50:57.465647+0000","objects_scrubbed":5,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:46:16.255842+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:11.435908+0000","last_change":"2024-05-09T09:51:11.435908+0000","last_active":"2024-05-09T09:51:11.435908+0000","last_peered":"2024-05-09T09:51:11.435908+0000","last_clean":"2024-05-09T09:51:11.435908+0000","last_became_active":"2024-05-09T09:47:20.254344+0000","last_became_peered":"2024-05-09T09:47:20.254344+0000","last_unstale":"2024-05-09T09:51:11.435908+0000","last_undegraded":"2024-05-09T09:51:11.435908+0000","last_fullsized":"2024-05-09T09:51:11.435908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:11.435657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:11.435657+0000","last_clean_scrub_stamp":"2024-05-09T09:51:11.435657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:58:02.384629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'5","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:42.322512+0000","last_change":"2024-05-09T09:51:42.322576+0000","last_active":"2024-05-09T09:51:42.322512+0000","last_peered":"2024-05-09T09:51:42.322512+0000","last_clean":"2024-05-09T09:51:42.322512+0000","last_became_active":"2024-05-09T09:47:22.229088+0000","last_became_peered":"2024-05-09T09:47:22.229088+0000","last_unstale":"2024-05-09T09:51:42.322512+0000","last_undegraded":"2024-05-09T09:51:42.322512+0000","last_fullsized":"2024-05-09T09:51:42.322512+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-09T09:51:42.322274+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-09T09:51:42.322274+0000","last_clean_scrub_stamp":"2024-05-09T09:51:42.322274+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:56:18.475958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:18.321045+0000","last_change":"2024-05-09T09:51:18.321045+0000","last_active":"2024-05-09T09:51:18.321045+0000","last_peered":"2024-05-09T09:51:18.321045+0000","last_clean":"2024-05-09T09:51:18.321045+0000","last_became_active":"2024-05-09T09:47:14.173866+0000","last_became_peered":"2024-05-09T09:47:14.173866+0000","last_unstale":"2024-05-09T09:51:18.321045+0000","last_undegraded":"2024-05-09T09:51:18.321045+0000","last_fullsized":"2024-05-09T09:51:18.321045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:18.320750+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:18.320750+0000","last_clean_scrub_stamp":"2024-05-09T09:51:18.320750+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:44.576241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:23.271656+0000","last_change":"2024-05-09T09:51:23.271656+0000","last_active":"2024-05-09T09:51:23.271656+0000","last_peered":"2024-05-09T09:51:23.271656+0000","last_clean":"2024-05-09T09:51:23.271656+0000","last_became_active":"2024-05-09T09:47:12.205714+0000","last_became_peered":"2024-05-09T09:47:12.205714+0000","last_unstale":"2024-05-09T09:51:23.271656+0000","last_undegraded":"2024-05-09T09:51:23.271656+0000","last_fullsized":"2024-05-09T09:51:23.271656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:23.271378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:23.271378+0000","last_clean_scrub_stamp":"2024-05-09T09:51:23.271378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:23:12.920105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.650816+0000","last_change":"2024-05-09T09:47:52.188822+0000","last_active":"2024-05-09T09:50:44.650816+0000","last_peered":"2024-05-09T09:50:44.650816+0000","last_clean":"2024-05-09T09:50:44.650816+0000","last_became_active":"2024-05-09T09:47:52.187627+0000","last_became_peered":"2024-05-09T09:47:52.187627+0000","last_unstale":"2024-05-09T09:50:44.650816+0000","last_undegraded":"2024-05-09T09:50:44.650816+0000","last_fullsized":"2024-05-09T09:50:44.650816+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:15.159739+0000","last_clean_scrub_stamp":"2024-05-09T09:47:15.159739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'8","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:51.843293+0000","last_change":"2024-05-09T09:50:51.843293+0000","last_active":"2024-05-09T09:50:51.843293+0000","last_peered":"2024-05-09T09:50:51.843293+0000","last_clean":"2024-05-09T09:50:51.843293+0000","last_became_active":"2024-05-09T09:47:18.217843+0000","last_became_peered":"2024-05-09T09:47:18.217843+0000","last_unstale":"2024-05-09T09:50:51.843293+0000","last_undegraded":"2024-05-09T09:50:51.843293+0000","last_fullsized":"2024-05-09T09:50:51.843293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:50:51.843015+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:50:51.843015+0000","last_clean_scrub_stamp":"2024-05-09T09:50:51.843015+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:01:37.150482+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:58.254985+0000","last_change":"2024-05-09T09:50:58.254985+0000","last_active":"2024-05-09T09:50:58.254985+0000","last_peered":"2024-05-09T09:50:58.254985+0000","last_clean":"2024-05-09T09:50:58.254985+0000","last_became_active":"2024-05-09T09:47:20.255449+0000","last_became_peered":"2024-05-09T09:47:20.255449+0000","last_unstale":"2024-05-09T09:50:58.254985+0000","last_undegraded":"2024-05-09T09:50:58.254985+0000","last_fullsized":"2024-05-09T09:50:58.254985+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:58.254742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:58.254742+0000","last_clean_scrub_stamp":"2024-05-09T09:50:58.254742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:40:28.088373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'3","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:44.264275+0000","last_change":"2024-05-09T09:51:44.264339+0000","last_active":"2024-05-09T09:51:44.264275+0000","last_peered":"2024-05-09T09:51:44.264275+0000","last_clean":"2024-05-09T09:51:44.264275+0000","last_became_active":"2024-05-09T09:47:22.239113+0000","last_became_peered":"2024-05-09T09:47:22.239113+0000","last_unstale":"2024-05-09T09:51:44.264275+0000","last_undegraded":"2024-05-09T09:51:44.264275+0000","last_fullsized":"2024-05-09T09:51:44.264275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-09T09:51:44.264078+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-09T09:51:44.264078+0000","last_clean_scrub_stamp":"2024-05-09T09:51:44.264078+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:56:58.841244+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:18.173416+0000","last_change":"2024-05-09T09:51:18.173416+0000","last_active":"2024-05-09T09:51:18.173416+0000","last_peered":"2024-05-09T09:51:18.173416+0000","last_clean":"2024-05-09T09:51:18.173416+0000","last_became_active":"2024-05-09T09:47:14.173338+0000","last_became_peered":"2024-05-09T09:47:14.173338+0000","last_unstale":"2024-05-09T09:51:18.173416+0000","last_undegraded":"2024-05-09T09:51:18.173416+0000","last_fullsized":"2024-05-09T09:51:18.173416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:18.173009+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:18.173009+0000","last_clean_scrub_stamp":"2024-05-09T09:51:18.173009+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:59:16.436247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:15.403431+0000","last_change":"2024-05-09T09:51:15.403431+0000","last_active":"2024-05-09T09:51:15.403431+0000","last_peered":"2024-05-09T09:51:15.403431+0000","last_clean":"2024-05-09T09:51:15.403431+0000","last_became_active":"2024-05-09T09:47:12.205864+0000","last_became_peered":"2024-05-09T09:47:12.205864+0000","last_unstale":"2024-05-09T09:51:15.403431+0000","last_undegraded":"2024-05-09T09:51:15.403431+0000","last_fullsized":"2024-05-09T09:51:15.403431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:15.403005+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:15.403005+0000","last_clean_scrub_stamp":"2024-05-09T09:51:15.403005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:10:59.671365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:59.267079+0000","last_change":"2024-05-09T09:50:59.267079+0000","last_active":"2024-05-09T09:50:59.267079+0000","last_peered":"2024-05-09T09:50:59.267079+0000","last_clean":"2024-05-09T09:50:59.267079+0000","last_became_active":"2024-05-09T09:47:16.214780+0000","last_became_peered":"2024-05-09T09:47:16.214780+0000","last_unstale":"2024-05-09T09:50:59.267079+0000","last_undegraded":"2024-05-09T09:50:59.267079+0000","last_fullsized":"2024-05-09T09:50:59.267079+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:59.266840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:59.266840+0000","last_clean_scrub_stamp":"2024-05-09T09:50:59.266840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:59:17.503566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'121","reported_seq":194,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:54.909493+0000","last_change":"2024-05-09T09:50:54.909493+0000","last_active":"2024-05-09T09:50:54.909493+0000","last_peered":"2024-05-09T09:50:54.909493+0000","last_clean":"2024-05-09T09:50:54.909493+0000","last_became_active":"2024-05-09T09:47:18.201443+0000","last_became_peered":"2024-05-09T09:47:18.201443+0000","last_unstale":"2024-05-09T09:50:54.909493+0000","last_undegraded":"2024-05-09T09:50:54.909493+0000","last_fullsized":"2024-05-09T09:50:54.909493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'121","last_scrub_stamp":"2024-05-09T09:50:54.909111+0000","last_deep_scrub":"32'121","last_deep_scrub_stamp":"2024-05-09T09:50:54.909111+0000","last_clean_scrub_stamp":"2024-05-09T09:50:54.909111+0000","objects_scrubbed":6,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:37:16.030668+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:48.357139+0000","last_change":"2024-05-09T09:50:48.357139+0000","last_active":"2024-05-09T09:50:48.357139+0000","last_peered":"2024-05-09T09:50:48.357139+0000","last_clean":"2024-05-09T09:50:48.357139+0000","last_became_active":"2024-05-09T09:47:20.225261+0000","last_became_peered":"2024-05-09T09:47:20.225261+0000","last_unstale":"2024-05-09T09:50:48.357139+0000","last_undegraded":"2024-05-09T09:50:48.357139+0000","last_fullsized":"2024-05-09T09:50:48.357139+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:48.356886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:48.356886+0000","last_clean_scrub_stamp":"2024-05-09T09:50:48.356886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:18:04.605745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:27.489127+0000","last_change":"2024-05-09T09:51:27.489186+0000","last_active":"2024-05-09T09:51:27.489127+0000","last_peered":"2024-05-09T09:51:27.489127+0000","last_clean":"2024-05-09T09:51:27.489127+0000","last_became_active":"2024-05-09T09:47:22.252940+0000","last_became_peered":"2024-05-09T09:47:22.252940+0000","last_unstale":"2024-05-09T09:51:27.489127+0000","last_undegraded":"2024-05-09T09:51:27.489127+0000","last_fullsized":"2024-05-09T09:51:27.489127+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-09T09:51:27.488901+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-09T09:51:27.488901+0000","last_clean_scrub_stamp":"2024-05-09T09:51:27.488901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:56:03.642585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:32.523308+0000","last_change":"2024-05-09T09:51:32.523308+0000","last_active":"2024-05-09T09:51:32.523308+0000","last_peered":"2024-05-09T09:51:32.523308+0000","last_clean":"2024-05-09T09:51:32.523308+0000","last_became_active":"2024-05-09T09:47:14.183622+0000","last_became_peered":"2024-05-09T09:47:14.183622+0000","last_unstale":"2024-05-09T09:51:32.523308+0000","last_undegraded":"2024-05-09T09:51:32.523308+0000","last_fullsized":"2024-05-09T09:51:32.523308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:32.523049+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:32.523049+0000","last_clean_scrub_stamp":"2024-05-09T09:51:32.523049+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:00:49.214343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:34.234278+0000","last_change":"2024-05-09T09:51:34.234278+0000","last_active":"2024-05-09T09:51:34.234278+0000","last_peered":"2024-05-09T09:51:34.234278+0000","last_clean":"2024-05-09T09:51:34.234278+0000","last_became_active":"2024-05-09T09:47:12.195857+0000","last_became_peered":"2024-05-09T09:47:12.195857+0000","last_unstale":"2024-05-09T09:51:34.234278+0000","last_undegraded":"2024-05-09T09:51:34.234278+0000","last_fullsized":"2024-05-09T09:51:34.234278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:34.233870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:34.233870+0000","last_clean_scrub_stamp":"2024-05-09T09:51:34.233870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:40:27.779332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:52.490474+0000","last_change":"2024-05-09T09:50:52.490474+0000","last_active":"2024-05-09T09:50:52.490474+0000","last_peered":"2024-05-09T09:50:52.490474+0000","last_clean":"2024-05-09T09:50:52.490474+0000","last_became_active":"2024-05-09T09:47:16.198551+0000","last_became_peered":"2024-05-09T09:47:16.198551+0000","last_unstale":"2024-05-09T09:50:52.490474+0000","last_undegraded":"2024-05-09T09:50:52.490474+0000","last_fullsized":"2024-05-09T09:50:52.490474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:52.490129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:52.490129+0000","last_clean_scrub_stamp":"2024-05-09T09:50:52.490129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:08:27.216364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'110","reported_seq":166,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:55.303534+0000","last_change":"2024-05-09T09:50:55.303534+0000","last_active":"2024-05-09T09:50:55.303534+0000","last_peered":"2024-05-09T09:50:55.303534+0000","last_clean":"2024-05-09T09:50:55.303534+0000","last_became_active":"2024-05-09T09:47:18.217163+0000","last_became_peered":"2024-05-09T09:47:18.217163+0000","last_unstale":"2024-05-09T09:50:55.303534+0000","last_undegraded":"2024-05-09T09:50:55.303534+0000","last_fullsized":"2024-05-09T09:50:55.303534+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'110","last_scrub_stamp":"2024-05-09T09:50:55.303267+0000","last_deep_scrub":"32'110","last_deep_scrub_stamp":"2024-05-09T09:50:55.303267+0000","last_clean_scrub_stamp":"2024-05-09T09:50:55.303267+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:30:34.471649+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:47.153568+0000","last_change":"2024-05-09T09:50:47.153568+0000","last_active":"2024-05-09T09:50:47.153568+0000","last_peered":"2024-05-09T09:50:47.153568+0000","last_clean":"2024-05-09T09:50:47.153568+0000","last_became_active":"2024-05-09T09:47:20.238369+0000","last_became_peered":"2024-05-09T09:47:20.238369+0000","last_unstale":"2024-05-09T09:50:47.153568+0000","last_undegraded":"2024-05-09T09:50:47.153568+0000","last_fullsized":"2024-05-09T09:50:47.153568+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:47.153312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:47.153312+0000","last_clean_scrub_stamp":"2024-05-09T09:50:47.153312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:16.400691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:21.490513+0000","last_change":"2024-05-09T09:51:21.490513+0000","last_active":"2024-05-09T09:51:21.490513+0000","last_peered":"2024-05-09T09:51:21.490513+0000","last_clean":"2024-05-09T09:51:21.490513+0000","last_became_active":"2024-05-09T09:47:14.187868+0000","last_became_peered":"2024-05-09T09:47:14.187868+0000","last_unstale":"2024-05-09T09:51:21.490513+0000","last_undegraded":"2024-05-09T09:51:21.490513+0000","last_fullsized":"2024-05-09T09:51:21.490513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-09T09:51:21.490253+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-09T09:51:21.490253+0000","last_clean_scrub_stamp":"2024-05-09T09:51:21.490253+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:21:46.793888+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:38.496075+0000","last_change":"2024-05-09T09:51:38.496075+0000","last_active":"2024-05-09T09:51:38.496075+0000","last_peered":"2024-05-09T09:51:38.496075+0000","last_clean":"2024-05-09T09:51:38.496075+0000","last_became_active":"2024-05-09T09:47:12.208209+0000","last_became_peered":"2024-05-09T09:47:12.208209+0000","last_unstale":"2024-05-09T09:51:38.496075+0000","last_undegraded":"2024-05-09T09:51:38.496075+0000","last_fullsized":"2024-05-09T09:51:38.496075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:38.495753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:38.495753+0000","last_clean_scrub_stamp":"2024-05-09T09:51:38.495753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:37:11.624510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:09.038896+0000","last_change":"2024-05-09T09:51:09.038896+0000","last_active":"2024-05-09T09:51:09.038896+0000","last_peered":"2024-05-09T09:51:09.038896+0000","last_clean":"2024-05-09T09:51:09.038896+0000","last_became_active":"2024-05-09T09:47:16.182766+0000","last_became_peered":"2024-05-09T09:47:16.182766+0000","last_unstale":"2024-05-09T09:51:09.038896+0000","last_undegraded":"2024-05-09T09:51:09.038896+0000","last_fullsized":"2024-05-09T09:51:09.038896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:09.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:09.038645+0000","last_clean_scrub_stamp":"2024-05-09T09:51:09.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:34:44.054800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'211","reported_seq":284,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:50.874670+0000","last_change":"2024-05-09T09:50:50.874747+0000","last_active":"2024-05-09T09:50:50.874670+0000","last_peered":"2024-05-09T09:50:50.874670+0000","last_clean":"2024-05-09T09:50:50.874670+0000","last_became_active":"2024-05-09T09:47:18.225074+0000","last_became_peered":"2024-05-09T09:47:18.225074+0000","last_unstale":"2024-05-09T09:50:50.874670+0000","last_undegraded":"2024-05-09T09:50:50.874670+0000","last_fullsized":"2024-05-09T09:50:50.874670+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'211","last_scrub_stamp":"2024-05-09T09:50:50.874475+0000","last_deep_scrub":"32'211","last_deep_scrub_stamp":"2024-05-09T09:50:50.874475+0000","last_clean_scrub_stamp":"2024-05-09T09:50:50.874475+0000","objects_scrubbed":5,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:47.628582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:46.119717+0000","last_change":"2024-05-09T09:50:46.119770+0000","last_active":"2024-05-09T09:50:46.119717+0000","last_peered":"2024-05-09T09:50:46.119717+0000","last_clean":"2024-05-09T09:50:46.119717+0000","last_became_active":"2024-05-09T09:47:20.241372+0000","last_became_peered":"2024-05-09T09:47:20.241372+0000","last_unstale":"2024-05-09T09:50:46.119717+0000","last_undegraded":"2024-05-09T09:50:46.119717+0000","last_fullsized":"2024-05-09T09:50:46.119717+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:46.119515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:46.119515+0000","last_clean_scrub_stamp":"2024-05-09T09:50:46.119515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:34:19.012893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:47.249378+0000","last_change":"2024-05-09T09:51:47.249378+0000","last_active":"2024-05-09T09:51:47.249378+0000","last_peered":"2024-05-09T09:51:47.249378+0000","last_clean":"2024-05-09T09:51:47.249378+0000","last_became_active":"2024-05-09T09:47:22.259589+0000","last_became_peered":"2024-05-09T09:47:22.259589+0000","last_unstale":"2024-05-09T09:51:47.249378+0000","last_undegraded":"2024-05-09T09:51:47.249378+0000","last_fullsized":"2024-05-09T09:51:47.249378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-05-09T09:51:47.249113+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-05-09T09:51:47.249113+0000","last_clean_scrub_stamp":"2024-05-09T09:51:47.249113+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:12:38.800416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'8","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:22.285662+0000","last_change":"2024-05-09T09:51:22.285724+0000","last_active":"2024-05-09T09:51:22.285662+0000","last_peered":"2024-05-09T09:51:22.285662+0000","last_clean":"2024-05-09T09:51:22.285662+0000","last_became_active":"2024-05-09T09:47:14.174371+0000","last_became_peered":"2024-05-09T09:47:14.174371+0000","last_unstale":"2024-05-09T09:51:22.285662+0000","last_undegraded":"2024-05-09T09:51:22.285662+0000","last_fullsized":"2024-05-09T09:51:22.285662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:22.285472+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:22.285472+0000","last_clean_scrub_stamp":"2024-05-09T09:51:22.285472+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:31:43.895778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:37.242716+0000","last_change":"2024-05-09T09:51:37.242716+0000","last_active":"2024-05-09T09:51:37.242716+0000","last_peered":"2024-05-09T09:51:37.242716+0000","last_clean":"2024-05-09T09:51:37.242716+0000","last_became_active":"2024-05-09T09:47:12.196881+0000","last_became_peered":"2024-05-09T09:47:12.196881+0000","last_unstale":"2024-05-09T09:51:37.242716+0000","last_undegraded":"2024-05-09T09:51:37.242716+0000","last_fullsized":"2024-05-09T09:51:37.242716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:37.242412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:37.242412+0000","last_clean_scrub_stamp":"2024-05-09T09:51:37.242412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:24:51.552770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:05.284242+0000","last_change":"2024-05-09T09:51:05.284242+0000","last_active":"2024-05-09T09:51:05.284242+0000","last_peered":"2024-05-09T09:51:05.284242+0000","last_clean":"2024-05-09T09:51:05.284242+0000","last_became_active":"2024-05-09T09:47:16.188611+0000","last_became_peered":"2024-05-09T09:47:16.188611+0000","last_unstale":"2024-05-09T09:51:05.284242+0000","last_undegraded":"2024-05-09T09:51:05.284242+0000","last_fullsized":"2024-05-09T09:51:05.284242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:05.283953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:05.283953+0000","last_clean_scrub_stamp":"2024-05-09T09:51:05.283953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:53:42.383540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'119","reported_seq":177,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:55.469218+0000","last_change":"2024-05-09T09:50:55.469398+0000","last_active":"2024-05-09T09:50:55.469218+0000","last_peered":"2024-05-09T09:50:55.469218+0000","last_clean":"2024-05-09T09:50:55.469218+0000","last_became_active":"2024-05-09T09:47:18.232435+0000","last_became_peered":"2024-05-09T09:47:18.232435+0000","last_unstale":"2024-05-09T09:50:55.469218+0000","last_undegraded":"2024-05-09T09:50:55.469218+0000","last_fullsized":"2024-05-09T09:50:55.469218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-05-09T09:50:55.468997+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-05-09T09:50:55.468997+0000","last_clean_scrub_stamp":"2024-05-09T09:50:55.468997+0000","objects_scrubbed":7,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:10:29.577014+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:00.251704+0000","last_change":"2024-05-09T09:51:00.251832+0000","last_active":"2024-05-09T09:51:00.251704+0000","last_peered":"2024-05-09T09:51:00.251704+0000","last_clean":"2024-05-09T09:51:00.251704+0000","last_became_active":"2024-05-09T09:47:20.241935+0000","last_became_peered":"2024-05-09T09:47:20.241935+0000","last_unstale":"2024-05-09T09:51:00.251704+0000","last_undegraded":"2024-05-09T09:51:00.251704+0000","last_fullsized":"2024-05-09T09:51:00.251704+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:00.251488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:00.251488+0000","last_clean_scrub_stamp":"2024-05-09T09:51:00.251488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:57:35.112556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:15.485482+0000","last_change":"2024-05-09T09:51:15.485482+0000","last_active":"2024-05-09T09:51:15.485482+0000","last_peered":"2024-05-09T09:51:15.485482+0000","last_clean":"2024-05-09T09:51:15.485482+0000","last_became_active":"2024-05-09T09:47:22.241067+0000","last_became_peered":"2024-05-09T09:47:22.241067+0000","last_unstale":"2024-05-09T09:51:15.485482+0000","last_undegraded":"2024-05-09T09:51:15.485482+0000","last_fullsized":"2024-05-09T09:51:15.485482+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:15.485109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:15.485109+0000","last_clean_scrub_stamp":"2024-05-09T09:51:15.485109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:38.931364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:04.473912+0000","last_change":"2024-05-09T09:51:04.473973+0000","last_active":"2024-05-09T09:51:04.473912+0000","last_peered":"2024-05-09T09:51:04.473912+0000","last_clean":"2024-05-09T09:51:04.473912+0000","last_became_active":"2024-05-09T09:47:14.191459+0000","last_became_peered":"2024-05-09T09:47:14.191459+0000","last_unstale":"2024-05-09T09:51:04.473912+0000","last_undegraded":"2024-05-09T09:51:04.473912+0000","last_fullsized":"2024-05-09T09:51:04.473912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:04.473723+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:04.473723+0000","last_clean_scrub_stamp":"2024-05-09T09:51:04.473723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:30:16.341639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:32.249206+0000","last_change":"2024-05-09T09:51:32.249279+0000","last_active":"2024-05-09T09:51:32.249206+0000","last_peered":"2024-05-09T09:51:32.249206+0000","last_clean":"2024-05-09T09:51:32.249206+0000","last_became_active":"2024-05-09T09:47:12.191204+0000","last_became_peered":"2024-05-09T09:47:12.191204+0000","last_unstale":"2024-05-09T09:51:32.249206+0000","last_undegraded":"2024-05-09T09:51:32.249206+0000","last_fullsized":"2024-05-09T09:51:32.249206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:32.248976+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:32.248976+0000","last_clean_scrub_stamp":"2024-05-09T09:51:32.248976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:11:16.563523+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:04.313775+0000","last_change":"2024-05-09T09:51:04.313828+0000","last_active":"2024-05-09T09:51:04.313775+0000","last_peered":"2024-05-09T09:51:04.313775+0000","last_clean":"2024-05-09T09:51:04.313775+0000","last_became_active":"2024-05-09T09:47:16.194314+0000","last_became_peered":"2024-05-09T09:47:16.194314+0000","last_unstale":"2024-05-09T09:51:04.313775+0000","last_undegraded":"2024-05-09T09:51:04.313775+0000","last_fullsized":"2024-05-09T09:51:04.313775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:04.313561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:04.313561+0000","last_clean_scrub_stamp":"2024-05-09T09:51:04.313561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:23:40.119184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'113","reported_seq":170,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:52.875802+0000","last_change":"2024-05-09T09:50:52.875802+0000","last_active":"2024-05-09T09:50:52.875802+0000","last_peered":"2024-05-09T09:50:52.875802+0000","last_clean":"2024-05-09T09:50:52.875802+0000","last_became_active":"2024-05-09T09:47:18.209099+0000","last_became_peered":"2024-05-09T09:47:18.209099+0000","last_unstale":"2024-05-09T09:50:52.875802+0000","last_undegraded":"2024-05-09T09:50:52.875802+0000","last_fullsized":"2024-05-09T09:50:52.875802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'113","last_scrub_stamp":"2024-05-09T09:50:52.875426+0000","last_deep_scrub":"32'113","last_deep_scrub_stamp":"2024-05-09T09:50:52.875426+0000","last_clean_scrub_stamp":"2024-05-09T09:50:52.875426+0000","objects_scrubbed":5,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:17:15.117146+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.866730+0000","last_change":"2024-05-09T09:50:44.866730+0000","last_active":"2024-05-09T09:50:44.866730+0000","last_peered":"2024-05-09T09:50:44.866730+0000","last_clean":"2024-05-09T09:50:44.866730+0000","last_became_active":"2024-05-09T09:47:20.241900+0000","last_became_peered":"2024-05-09T09:47:20.241900+0000","last_unstale":"2024-05-09T09:50:44.866730+0000","last_undegraded":"2024-05-09T09:50:44.866730+0000","last_fullsized":"2024-05-09T09:50:44.866730+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:44.866482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:44.866482+0000","last_clean_scrub_stamp":"2024-05-09T09:50:44.866482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:26:17.791183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'5","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.651782+0000","last_change":"2024-05-09T09:47:22.264988+0000","last_active":"2024-05-09T09:50:44.651782+0000","last_peered":"2024-05-09T09:50:44.651782+0000","last_clean":"2024-05-09T09:50:44.651782+0000","last_became_active":"2024-05-09T09:47:22.263730+0000","last_became_peered":"2024-05-09T09:47:22.263730+0000","last_unstale":"2024-05-09T09:50:44.651782+0000","last_undegraded":"2024-05-09T09:50:44.651782+0000","last_fullsized":"2024-05-09T09:50:44.651782+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:47:21.199058+0000","last_clean_scrub_stamp":"2024-05-09T09:47:21.199058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'6","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:12.090643+0000","last_change":"2024-05-09T09:51:12.090710+0000","last_active":"2024-05-09T09:51:12.090643+0000","last_peered":"2024-05-09T09:51:12.090643+0000","last_clean":"2024-05-09T09:51:12.090643+0000","last_became_active":"2024-05-09T09:47:14.189561+0000","last_became_peered":"2024-05-09T09:47:14.189561+0000","last_unstale":"2024-05-09T09:51:12.090643+0000","last_undegraded":"2024-05-09T09:51:12.090643+0000","last_fullsized":"2024-05-09T09:51:12.090643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:12.090429+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:12.090429+0000","last_clean_scrub_stamp":"2024-05-09T09:51:12.090429+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:00.491368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:34.462231+0000","last_change":"2024-05-09T09:51:34.462352+0000","last_active":"2024-05-09T09:51:34.462231+0000","last_peered":"2024-05-09T09:51:34.462231+0000","last_clean":"2024-05-09T09:51:34.462231+0000","last_became_active":"2024-05-09T09:47:12.214816+0000","last_became_peered":"2024-05-09T09:47:12.214816+0000","last_unstale":"2024-05-09T09:51:34.462231+0000","last_undegraded":"2024-05-09T09:51:34.462231+0000","last_fullsized":"2024-05-09T09:51:34.462231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:34.461979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:34.461979+0000","last_clean_scrub_stamp":"2024-05-09T09:51:34.461979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:57:32.758279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:59.288158+0000","last_change":"2024-05-09T09:50:59.288294+0000","last_active":"2024-05-09T09:50:59.288158+0000","last_peered":"2024-05-09T09:50:59.288158+0000","last_clean":"2024-05-09T09:50:59.288158+0000","last_became_active":"2024-05-09T09:47:16.210567+0000","last_became_peered":"2024-05-09T09:47:16.210567+0000","last_unstale":"2024-05-09T09:50:59.288158+0000","last_undegraded":"2024-05-09T09:50:59.288158+0000","last_fullsized":"2024-05-09T09:50:59.288158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:59.287849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:59.287849+0000","last_clean_scrub_stamp":"2024-05-09T09:50:59.287849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:11:15.215672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:03.498249+0000","last_change":"2024-05-09T09:51:03.498249+0000","last_active":"2024-05-09T09:51:03.498249+0000","last_peered":"2024-05-09T09:51:03.498249+0000","last_clean":"2024-05-09T09:51:03.498249+0000","last_became_active":"2024-05-09T09:47:18.234113+0000","last_became_peered":"2024-05-09T09:47:18.234113+0000","last_unstale":"2024-05-09T09:51:03.498249+0000","last_undegraded":"2024-05-09T09:51:03.498249+0000","last_fullsized":"2024-05-09T09:51:03.498249+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-09T09:51:03.497977+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-09T09:51:03.497977+0000","last_clean_scrub_stamp":"2024-05-09T09:51:03.497977+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:59:01.761215+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":381,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:54.255293+0000","last_change":"2024-05-09T09:50:54.255293+0000","last_active":"2024-05-09T09:50:54.255293+0000","last_peered":"2024-05-09T09:50:54.255293+0000","last_clean":"2024-05-09T09:50:54.255293+0000","last_became_active":"2024-05-09T09:47:20.254573+0000","last_became_peered":"2024-05-09T09:47:20.254573+0000","last_unstale":"2024-05-09T09:50:54.255293+0000","last_undegraded":"2024-05-09T09:50:54.255293+0000","last_fullsized":"2024-05-09T09:50:54.255293+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:54.255008+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:54.255008+0000","last_clean_scrub_stamp":"2024-05-09T09:50:54.255008+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:33:59.828045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:23.485708+0000","last_change":"2024-05-09T09:51:23.485708+0000","last_active":"2024-05-09T09:51:23.485708+0000","last_peered":"2024-05-09T09:51:23.485708+0000","last_clean":"2024-05-09T09:51:23.485708+0000","last_became_active":"2024-05-09T09:47:22.243234+0000","last_became_peered":"2024-05-09T09:47:22.243234+0000","last_unstale":"2024-05-09T09:51:23.485708+0000","last_undegraded":"2024-05-09T09:51:23.485708+0000","last_fullsized":"2024-05-09T09:51:23.485708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:23.485408+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:23.485408+0000","last_clean_scrub_stamp":"2024-05-09T09:51:23.485408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:06:13.197033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:32.186977+0000","last_change":"2024-05-09T09:51:32.187038+0000","last_active":"2024-05-09T09:51:32.186977+0000","last_peered":"2024-05-09T09:51:32.186977+0000","last_clean":"2024-05-09T09:51:32.186977+0000","last_became_active":"2024-05-09T09:47:14.188222+0000","last_became_peered":"2024-05-09T09:47:14.188222+0000","last_unstale":"2024-05-09T09:51:32.186977+0000","last_undegraded":"2024-05-09T09:51:32.186977+0000","last_fullsized":"2024-05-09T09:51:32.186977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:32.186791+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:32.186791+0000","last_clean_scrub_stamp":"2024-05-09T09:51:32.186791+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:39:54.063094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:36.228396+0000","last_change":"2024-05-09T09:51:36.228464+0000","last_active":"2024-05-09T09:51:36.228396+0000","last_peered":"2024-05-09T09:51:36.228396+0000","last_clean":"2024-05-09T09:51:36.228396+0000","last_became_active":"2024-05-09T09:47:12.195936+0000","last_became_peered":"2024-05-09T09:47:12.195936+0000","last_unstale":"2024-05-09T09:51:36.228396+0000","last_undegraded":"2024-05-09T09:51:36.228396+0000","last_fullsized":"2024-05-09T09:51:36.228396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:36.228198+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:36.228198+0000","last_clean_scrub_stamp":"2024-05-09T09:51:36.228198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:56:14.740338+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:54.288182+0000","last_change":"2024-05-09T09:50:54.288244+0000","last_active":"2024-05-09T09:50:54.288182+0000","last_peered":"2024-05-09T09:50:54.288182+0000","last_clean":"2024-05-09T09:50:54.288182+0000","last_became_active":"2024-05-09T09:47:16.210901+0000","last_became_peered":"2024-05-09T09:47:16.210901+0000","last_unstale":"2024-05-09T09:50:54.288182+0000","last_undegraded":"2024-05-09T09:50:54.288182+0000","last_fullsized":"2024-05-09T09:50:54.288182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:54.287951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:54.287951+0000","last_clean_scrub_stamp":"2024-05-09T09:50:54.287951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:00:20.805979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'120","reported_seq":178,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:51.351217+0000","last_change":"2024-05-09T09:50:51.351295+0000","last_active":"2024-05-09T09:50:51.351217+0000","last_peered":"2024-05-09T09:50:51.351217+0000","last_clean":"2024-05-09T09:50:51.351217+0000","last_became_active":"2024-05-09T09:47:18.202069+0000","last_became_peered":"2024-05-09T09:47:18.202069+0000","last_unstale":"2024-05-09T09:50:51.351217+0000","last_undegraded":"2024-05-09T09:50:51.351217+0000","last_fullsized":"2024-05-09T09:50:51.351217+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'120","last_scrub_stamp":"2024-05-09T09:50:51.351014+0000","last_deep_scrub":"32'120","last_deep_scrub_stamp":"2024-05-09T09:50:51.351014+0000","last_clean_scrub_stamp":"2024-05-09T09:50:51.351014+0000","objects_scrubbed":7,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:19:59.652432+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:49.840926+0000","last_change":"2024-05-09T09:50:49.840978+0000","last_active":"2024-05-09T09:50:49.840926+0000","last_peered":"2024-05-09T09:50:49.840926+0000","last_clean":"2024-05-09T09:50:49.840926+0000","last_became_active":"2024-05-09T09:47:20.250194+0000","last_became_peered":"2024-05-09T09:47:20.250194+0000","last_unstale":"2024-05-09T09:50:49.840926+0000","last_undegraded":"2024-05-09T09:50:49.840926+0000","last_fullsized":"2024-05-09T09:50:49.840926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:49.840731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:49.840731+0000","last_clean_scrub_stamp":"2024-05-09T09:50:49.840731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:28:16.883808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:12.276060+0000","last_change":"2024-05-09T09:51:12.276130+0000","last_active":"2024-05-09T09:51:12.276060+0000","last_peered":"2024-05-09T09:51:12.276060+0000","last_clean":"2024-05-09T09:51:12.276060+0000","last_became_active":"2024-05-09T09:47:22.239300+0000","last_became_peered":"2024-05-09T09:47:22.239300+0000","last_unstale":"2024-05-09T09:51:12.276060+0000","last_undegraded":"2024-05-09T09:51:12.276060+0000","last_fullsized":"2024-05-09T09:51:12.276060+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:12.275835+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:12.275835+0000","last_clean_scrub_stamp":"2024-05-09T09:51:12.275835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:27.063514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'10","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:22.276039+0000","last_change":"2024-05-09T09:51:22.276099+0000","last_active":"2024-05-09T09:51:22.276039+0000","last_peered":"2024-05-09T09:51:22.276039+0000","last_clean":"2024-05-09T09:51:22.276039+0000","last_became_active":"2024-05-09T09:47:14.187951+0000","last_became_peered":"2024-05-09T09:47:14.187951+0000","last_unstale":"2024-05-09T09:51:22.276039+0000","last_undegraded":"2024-05-09T09:51:22.276039+0000","last_fullsized":"2024-05-09T09:51:22.276039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-09T09:51:22.275813+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-09T09:51:22.275813+0000","last_clean_scrub_stamp":"2024-05-09T09:51:22.275813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:33.300865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:37.465185+0000","last_change":"2024-05-09T09:51:37.465245+0000","last_active":"2024-05-09T09:51:37.465185+0000","last_peered":"2024-05-09T09:51:37.465185+0000","last_clean":"2024-05-09T09:51:37.465185+0000","last_became_active":"2024-05-09T09:47:12.203827+0000","last_became_peered":"2024-05-09T09:47:12.203827+0000","last_unstale":"2024-05-09T09:51:37.465185+0000","last_undegraded":"2024-05-09T09:51:37.465185+0000","last_fullsized":"2024-05-09T09:51:37.465185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:37.464973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:37.464973+0000","last_clean_scrub_stamp":"2024-05-09T09:51:37.464973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:31:23.921813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:03.316460+0000","last_change":"2024-05-09T09:51:03.316512+0000","last_active":"2024-05-09T09:51:03.316460+0000","last_peered":"2024-05-09T09:51:03.316460+0000","last_clean":"2024-05-09T09:51:03.316460+0000","last_became_active":"2024-05-09T09:47:16.196193+0000","last_became_peered":"2024-05-09T09:47:16.196193+0000","last_unstale":"2024-05-09T09:51:03.316460+0000","last_undegraded":"2024-05-09T09:51:03.316460+0000","last_fullsized":"2024-05-09T09:51:03.316460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:03.316273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:03.316273+0000","last_clean_scrub_stamp":"2024-05-09T09:51:03.316273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:59:34.812456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'113","reported_seq":168,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:55.923859+0000","last_change":"2024-05-09T09:50:55.923928+0000","last_active":"2024-05-09T09:50:55.923859+0000","last_peered":"2024-05-09T09:50:55.923859+0000","last_clean":"2024-05-09T09:50:55.923859+0000","last_became_active":"2024-05-09T09:47:18.199627+0000","last_became_peered":"2024-05-09T09:47:18.199627+0000","last_unstale":"2024-05-09T09:50:55.923859+0000","last_undegraded":"2024-05-09T09:50:55.923859+0000","last_fullsized":"2024-05-09T09:50:55.923859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'113","last_scrub_stamp":"2024-05-09T09:50:55.923673+0000","last_deep_scrub":"32'113","last_deep_scrub_stamp":"2024-05-09T09:50:55.923673+0000","last_clean_scrub_stamp":"2024-05-09T09:50:55.923673+0000","objects_scrubbed":4,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:11:11.851496+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:07.405248+0000","last_change":"2024-05-09T09:51:07.405300+0000","last_active":"2024-05-09T09:51:07.405248+0000","last_peered":"2024-05-09T09:51:07.405248+0000","last_clean":"2024-05-09T09:51:07.405248+0000","last_became_active":"2024-05-09T09:47:20.251642+0000","last_became_peered":"2024-05-09T09:47:20.251642+0000","last_unstale":"2024-05-09T09:51:07.405248+0000","last_undegraded":"2024-05-09T09:51:07.405248+0000","last_fullsized":"2024-05-09T09:51:07.405248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:07.405060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:07.405060+0000","last_clean_scrub_stamp":"2024-05-09T09:51:07.405060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:31:29.015365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:52:03.316390+0000","last_change":"2024-05-09T09:52:03.316442+0000","last_active":"2024-05-09T09:52:03.316390+0000","last_peered":"2024-05-09T09:52:03.316390+0000","last_clean":"2024-05-09T09:52:03.316390+0000","last_became_active":"2024-05-09T09:47:22.261164+0000","last_became_peered":"2024-05-09T09:47:22.261164+0000","last_unstale":"2024-05-09T09:52:03.316390+0000","last_undegraded":"2024-05-09T09:52:03.316390+0000","last_fullsized":"2024-05-09T09:52:03.316390+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:52:03.316195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:52:03.316195+0000","last_clean_scrub_stamp":"2024-05-09T09:52:03.316195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:47:29.457535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'8","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:26.443657+0000","last_change":"2024-05-09T09:51:26.443657+0000","last_active":"2024-05-09T09:51:26.443657+0000","last_peered":"2024-05-09T09:51:26.443657+0000","last_clean":"2024-05-09T09:51:26.443657+0000","last_became_active":"2024-05-09T09:47:14.185270+0000","last_became_peered":"2024-05-09T09:47:14.185270+0000","last_unstale":"2024-05-09T09:51:26.443657+0000","last_undegraded":"2024-05-09T09:51:26.443657+0000","last_fullsized":"2024-05-09T09:51:26.443657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:26.443394+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:26.443394+0000","last_clean_scrub_stamp":"2024-05-09T09:51:26.443394+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:21.088972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:36.249899+0000","last_change":"2024-05-09T09:51:36.249959+0000","last_active":"2024-05-09T09:51:36.249899+0000","last_peered":"2024-05-09T09:51:36.249899+0000","last_clean":"2024-05-09T09:51:36.249899+0000","last_became_active":"2024-05-09T09:47:12.183985+0000","last_became_peered":"2024-05-09T09:47:12.183985+0000","last_unstale":"2024-05-09T09:51:36.249899+0000","last_undegraded":"2024-05-09T09:51:36.249899+0000","last_fullsized":"2024-05-09T09:51:36.249899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:36.249688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:36.249688+0000","last_clean_scrub_stamp":"2024-05-09T09:51:36.249688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:01.553324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:01.251663+0000","last_change":"2024-05-09T09:51:01.251716+0000","last_active":"2024-05-09T09:51:01.251663+0000","last_peered":"2024-05-09T09:51:01.251663+0000","last_clean":"2024-05-09T09:51:01.251663+0000","last_became_active":"2024-05-09T09:47:16.207467+0000","last_became_peered":"2024-05-09T09:47:16.207467+0000","last_unstale":"2024-05-09T09:51:01.251663+0000","last_undegraded":"2024-05-09T09:51:01.251663+0000","last_fullsized":"2024-05-09T09:51:01.251663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:01.251471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:01.251471+0000","last_clean_scrub_stamp":"2024-05-09T09:51:01.251471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:38:45.710781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'106","reported_seq":159,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:14.506892+0000","last_change":"2024-05-09T09:51:14.506957+0000","last_active":"2024-05-09T09:51:14.506892+0000","last_peered":"2024-05-09T09:51:14.506892+0000","last_clean":"2024-05-09T09:51:14.506892+0000","last_became_active":"2024-05-09T09:47:18.235557+0000","last_became_peered":"2024-05-09T09:47:18.235557+0000","last_unstale":"2024-05-09T09:51:14.506892+0000","last_undegraded":"2024-05-09T09:51:14.506892+0000","last_fullsized":"2024-05-09T09:51:14.506892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'106","last_scrub_stamp":"2024-05-09T09:51:14.506702+0000","last_deep_scrub":"32'106","last_deep_scrub_stamp":"2024-05-09T09:51:14.506702+0000","last_clean_scrub_stamp":"2024-05-09T09:51:14.506702+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:14:13.534344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:10.463408+0000","last_change":"2024-05-09T09:51:10.463461+0000","last_active":"2024-05-09T09:51:10.463408+0000","last_peered":"2024-05-09T09:51:10.463408+0000","last_clean":"2024-05-09T09:51:10.463408+0000","last_became_active":"2024-05-09T09:47:20.231750+0000","last_became_peered":"2024-05-09T09:47:20.231750+0000","last_unstale":"2024-05-09T09:51:10.463408+0000","last_undegraded":"2024-05-09T09:51:10.463408+0000","last_fullsized":"2024-05-09T09:51:10.463408+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:10.463214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:10.463214+0000","last_clean_scrub_stamp":"2024-05-09T09:51:10.463214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:19.664307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'8","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:52:02.326616+0000","last_change":"2024-05-09T09:52:02.326677+0000","last_active":"2024-05-09T09:52:02.326616+0000","last_peered":"2024-05-09T09:52:02.326616+0000","last_clean":"2024-05-09T09:52:02.326616+0000","last_became_active":"2024-05-09T09:47:22.256398+0000","last_became_peered":"2024-05-09T09:47:22.256398+0000","last_unstale":"2024-05-09T09:52:02.326616+0000","last_undegraded":"2024-05-09T09:52:02.326616+0000","last_fullsized":"2024-05-09T09:52:02.326616+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:52:02.326427+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:52:02.326427+0000","last_clean_scrub_stamp":"2024-05-09T09:52:02.326427+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:47:04.771667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'22","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:07.373119+0000","last_change":"2024-05-09T09:51:07.373119+0000","last_active":"2024-05-09T09:51:07.373119+0000","last_peered":"2024-05-09T09:51:07.373119+0000","last_clean":"2024-05-09T09:51:07.373119+0000","last_became_active":"2024-05-09T09:47:14.188980+0000","last_became_peered":"2024-05-09T09:47:14.188980+0000","last_unstale":"2024-05-09T09:51:07.373119+0000","last_undegraded":"2024-05-09T09:51:07.373119+0000","last_fullsized":"2024-05-09T09:51:07.373119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-05-09T09:51:07.372874+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-05-09T09:51:07.372874+0000","last_clean_scrub_stamp":"2024-05-09T09:51:07.372874+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:38.613364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:21.338164+0000","last_change":"2024-05-09T09:51:21.338164+0000","last_active":"2024-05-09T09:51:21.338164+0000","last_peered":"2024-05-09T09:51:21.338164+0000","last_clean":"2024-05-09T09:51:21.338164+0000","last_became_active":"2024-05-09T09:47:12.206136+0000","last_became_peered":"2024-05-09T09:47:12.206136+0000","last_unstale":"2024-05-09T09:51:21.338164+0000","last_undegraded":"2024-05-09T09:51:21.338164+0000","last_fullsized":"2024-05-09T09:51:21.338164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:21.337902+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:21.337902+0000","last_clean_scrub_stamp":"2024-05-09T09:51:21.337902+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:37:41.599167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:58.281505+0000","last_change":"2024-05-09T09:50:58.281584+0000","last_active":"2024-05-09T09:50:58.281505+0000","last_peered":"2024-05-09T09:50:58.281505+0000","last_clean":"2024-05-09T09:50:58.281505+0000","last_became_active":"2024-05-09T09:47:16.210958+0000","last_became_peered":"2024-05-09T09:47:16.210958+0000","last_unstale":"2024-05-09T09:50:58.281505+0000","last_undegraded":"2024-05-09T09:50:58.281505+0000","last_fullsized":"2024-05-09T09:50:58.281505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-09T09:50:58.281299+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-09T09:50:58.281299+0000","last_clean_scrub_stamp":"2024-05-09T09:50:58.281299+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:37:19.402856+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'114","reported_seq":171,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:59.461776+0000","last_change":"2024-05-09T09:50:59.461850+0000","last_active":"2024-05-09T09:50:59.461776+0000","last_peered":"2024-05-09T09:50:59.461776+0000","last_clean":"2024-05-09T09:50:59.461776+0000","last_became_active":"2024-05-09T09:47:18.233552+0000","last_became_peered":"2024-05-09T09:47:18.233552+0000","last_unstale":"2024-05-09T09:50:59.461776+0000","last_undegraded":"2024-05-09T09:50:59.461776+0000","last_fullsized":"2024-05-09T09:50:59.461776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'114","last_scrub_stamp":"2024-05-09T09:50:59.461590+0000","last_deep_scrub":"32'114","last_deep_scrub_stamp":"2024-05-09T09:50:59.461590+0000","last_clean_scrub_stamp":"2024-05-09T09:50:59.461590+0000","objects_scrubbed":5,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:45:09.985421+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:06.027400+0000","last_change":"2024-05-09T09:51:06.027552+0000","last_active":"2024-05-09T09:51:06.027400+0000","last_peered":"2024-05-09T09:51:06.027400+0000","last_clean":"2024-05-09T09:51:06.027400+0000","last_became_active":"2024-05-09T09:47:20.254083+0000","last_became_peered":"2024-05-09T09:47:20.254083+0000","last_unstale":"2024-05-09T09:51:06.027400+0000","last_undegraded":"2024-05-09T09:51:06.027400+0000","last_fullsized":"2024-05-09T09:51:06.027400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:06.027177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:06.027177+0000","last_clean_scrub_stamp":"2024-05-09T09:51:06.027177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:03:51.192288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:31.567995+0000","last_change":"2024-05-09T09:51:31.567995+0000","last_active":"2024-05-09T09:51:31.567995+0000","last_peered":"2024-05-09T09:51:31.567995+0000","last_clean":"2024-05-09T09:51:31.567995+0000","last_became_active":"2024-05-09T09:47:22.254386+0000","last_became_peered":"2024-05-09T09:47:22.254386+0000","last_unstale":"2024-05-09T09:51:31.567995+0000","last_undegraded":"2024-05-09T09:51:31.567995+0000","last_fullsized":"2024-05-09T09:51:31.567995+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:31.567738+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:31.567738+0000","last_clean_scrub_stamp":"2024-05-09T09:51:31.567738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:09:40.249232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'14","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:13.284595+0000","last_change":"2024-05-09T09:51:13.284595+0000","last_active":"2024-05-09T09:51:13.284595+0000","last_peered":"2024-05-09T09:51:13.284595+0000","last_clean":"2024-05-09T09:51:13.284595+0000","last_became_active":"2024-05-09T09:47:14.174998+0000","last_became_peered":"2024-05-09T09:47:14.174998+0000","last_unstale":"2024-05-09T09:51:13.284595+0000","last_undegraded":"2024-05-09T09:51:13.284595+0000","last_fullsized":"2024-05-09T09:51:13.284595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-05-09T09:51:13.284186+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-05-09T09:51:13.284186+0000","last_clean_scrub_stamp":"2024-05-09T09:51:13.284186+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:34:48.300341+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:26.238694+0000","last_change":"2024-05-09T09:51:26.238755+0000","last_active":"2024-05-09T09:51:26.238694+0000","last_peered":"2024-05-09T09:51:26.238694+0000","last_clean":"2024-05-09T09:51:26.238694+0000","last_became_active":"2024-05-09T09:47:12.192448+0000","last_became_peered":"2024-05-09T09:47:12.192448+0000","last_unstale":"2024-05-09T09:51:26.238694+0000","last_undegraded":"2024-05-09T09:51:26.238694+0000","last_fullsized":"2024-05-09T09:51:26.238694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:26.238496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:26.238496+0000","last_clean_scrub_stamp":"2024-05-09T09:51:26.238496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:14.639434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'12","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:15.130886+0000","last_change":"2024-05-09T09:51:15.130886+0000","last_active":"2024-05-09T09:51:15.130886+0000","last_peered":"2024-05-09T09:51:15.130886+0000","last_clean":"2024-05-09T09:51:15.130886+0000","last_became_active":"2024-05-09T09:47:14.188534+0000","last_became_peered":"2024-05-09T09:47:14.188534+0000","last_unstale":"2024-05-09T09:51:15.130886+0000","last_undegraded":"2024-05-09T09:51:15.130886+0000","last_fullsized":"2024-05-09T09:51:15.130886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-09T09:51:15.130629+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-09T09:51:15.130629+0000","last_clean_scrub_stamp":"2024-05-09T09:51:15.130629+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:21:10.701384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":54,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:37.298645+0000","last_change":"2024-05-09T09:51:37.298710+0000","last_active":"2024-05-09T09:51:37.298645+0000","last_peered":"2024-05-09T09:51:37.298645+0000","last_clean":"2024-05-09T09:51:37.298645+0000","last_became_active":"2024-05-09T09:47:12.184353+0000","last_became_peered":"2024-05-09T09:47:12.184353+0000","last_unstale":"2024-05-09T09:51:37.298645+0000","last_undegraded":"2024-05-09T09:51:37.298645+0000","last_fullsized":"2024-05-09T09:51:37.298645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:37.298447+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:37.298447+0000","last_clean_scrub_stamp":"2024-05-09T09:51:37.298447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:02:24.687092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:24.458824+0000","last_change":"2024-05-09T09:51:24.458824+0000","last_active":"2024-05-09T09:51:24.458824+0000","last_peered":"2024-05-09T09:51:24.458824+0000","last_clean":"2024-05-09T09:51:24.458824+0000","last_became_active":"2024-05-09T09:47:14.186689+0000","last_became_peered":"2024-05-09T09:47:14.186689+0000","last_unstale":"2024-05-09T09:51:24.458824+0000","last_undegraded":"2024-05-09T09:51:24.458824+0000","last_fullsized":"2024-05-09T09:51:24.458824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:24.458569+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:24.458569+0000","last_clean_scrub_stamp":"2024-05-09T09:51:24.458569+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:53:49.912270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:47.477436+0000","last_change":"2024-05-09T09:51:47.477492+0000","last_active":"2024-05-09T09:51:47.477436+0000","last_peered":"2024-05-09T09:51:47.477436+0000","last_clean":"2024-05-09T09:51:47.477436+0000","last_became_active":"2024-05-09T09:47:12.209633+0000","last_became_peered":"2024-05-09T09:47:12.209633+0000","last_unstale":"2024-05-09T09:51:47.477436+0000","last_undegraded":"2024-05-09T09:51:47.477436+0000","last_fullsized":"2024-05-09T09:51:47.477436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:47.477235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:47.477235+0000","last_clean_scrub_stamp":"2024-05-09T09:51:47.477235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:44:08.238812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:11.046882+0000","last_change":"2024-05-09T09:51:11.046882+0000","last_active":"2024-05-09T09:51:11.046882+0000","last_peered":"2024-05-09T09:51:11.046882+0000","last_clean":"2024-05-09T09:51:11.046882+0000","last_became_active":"2024-05-09T09:47:14.193366+0000","last_became_peered":"2024-05-09T09:47:14.193366+0000","last_unstale":"2024-05-09T09:51:11.046882+0000","last_undegraded":"2024-05-09T09:51:11.046882+0000","last_fullsized":"2024-05-09T09:51:11.046882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:11.046623+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:11.046623+0000","last_clean_scrub_stamp":"2024-05-09T09:51:11.046623+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:34:07.870070+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:19.202106+0000","last_change":"2024-05-09T09:51:19.202106+0000","last_active":"2024-05-09T09:51:19.202106+0000","last_peered":"2024-05-09T09:51:19.202106+0000","last_clean":"2024-05-09T09:51:19.202106+0000","last_became_active":"2024-05-09T09:47:12.214019+0000","last_became_peered":"2024-05-09T09:47:12.214019+0000","last_unstale":"2024-05-09T09:51:19.202106+0000","last_undegraded":"2024-05-09T09:51:19.202106+0000","last_fullsized":"2024-05-09T09:51:19.202106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:19.201848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:19.201848+0000","last_clean_scrub_stamp":"2024-05-09T09:51:19.201848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:30:31.069764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:40.294522+0000","last_change":"2024-05-09T09:51:40.294585+0000","last_active":"2024-05-09T09:51:40.294522+0000","last_peered":"2024-05-09T09:51:40.294522+0000","last_clean":"2024-05-09T09:51:40.294522+0000","last_became_active":"2024-05-09T09:47:14.181824+0000","last_became_peered":"2024-05-09T09:47:14.181824+0000","last_unstale":"2024-05-09T09:51:40.294522+0000","last_undegraded":"2024-05-09T09:51:40.294522+0000","last_fullsized":"2024-05-09T09:51:40.294522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:40.294309+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:40.294309+0000","last_clean_scrub_stamp":"2024-05-09T09:51:40.294309+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:56.173489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:27.323249+0000","last_change":"2024-05-09T09:51:27.323249+0000","last_active":"2024-05-09T09:51:27.323249+0000","last_peered":"2024-05-09T09:51:27.323249+0000","last_clean":"2024-05-09T09:51:27.323249+0000","last_became_active":"2024-05-09T09:47:12.204322+0000","last_became_peered":"2024-05-09T09:47:12.204322+0000","last_unstale":"2024-05-09T09:51:27.323249+0000","last_undegraded":"2024-05-09T09:51:27.323249+0000","last_fullsized":"2024-05-09T09:51:27.323249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:27.322986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:27.322986+0000","last_clean_scrub_stamp":"2024-05-09T09:51:27.322986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:11:11.637533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:11.318592+0000","last_change":"2024-05-09T09:51:11.318592+0000","last_active":"2024-05-09T09:51:11.318592+0000","last_peered":"2024-05-09T09:51:11.318592+0000","last_clean":"2024-05-09T09:51:11.318592+0000","last_became_active":"2024-05-09T09:47:14.178503+0000","last_became_peered":"2024-05-09T09:47:14.178503+0000","last_unstale":"2024-05-09T09:51:11.318592+0000","last_undegraded":"2024-05-09T09:51:11.318592+0000","last_fullsized":"2024-05-09T09:51:11.318592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:11.318334+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:11.318334+0000","last_clean_scrub_stamp":"2024-05-09T09:51:11.318334+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:48:38.508221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"30'2","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:35.220050+0000","last_change":"2024-05-09T09:51:35.220206+0000","last_active":"2024-05-09T09:51:35.220050+0000","last_peered":"2024-05-09T09:51:35.220050+0000","last_clean":"2024-05-09T09:51:35.220050+0000","last_became_active":"2024-05-09T09:47:12.196120+0000","last_became_peered":"2024-05-09T09:47:12.196120+0000","last_unstale":"2024-05-09T09:51:35.220050+0000","last_undegraded":"2024-05-09T09:51:35.220050+0000","last_fullsized":"2024-05-09T09:51:35.220050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-09T09:51:35.219793+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-09T09:51:35.219793+0000","last_clean_scrub_stamp":"2024-05-09T09:51:35.219793+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:58.666048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:26.352885+0000","last_change":"2024-05-09T09:51:26.352954+0000","last_active":"2024-05-09T09:51:26.352885+0000","last_peered":"2024-05-09T09:51:26.352885+0000","last_clean":"2024-05-09T09:51:26.352885+0000","last_became_active":"2024-05-09T09:47:14.176615+0000","last_became_peered":"2024-05-09T09:47:14.176615+0000","last_unstale":"2024-05-09T09:51:26.352885+0000","last_undegraded":"2024-05-09T09:51:26.352885+0000","last_fullsized":"2024-05-09T09:51:26.352885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:26.352681+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:26.352681+0000","last_clean_scrub_stamp":"2024-05-09T09:51:26.352681+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:58:17.301653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:13.464266+0000","last_change":"2024-05-09T09:51:13.464266+0000","last_active":"2024-05-09T09:51:13.464266+0000","last_peered":"2024-05-09T09:51:13.464266+0000","last_clean":"2024-05-09T09:51:13.464266+0000","last_became_active":"2024-05-09T09:47:12.209171+0000","last_became_peered":"2024-05-09T09:47:12.209171+0000","last_unstale":"2024-05-09T09:51:13.464266+0000","last_undegraded":"2024-05-09T09:51:13.464266+0000","last_fullsized":"2024-05-09T09:51:13.464266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:13.463897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:13.463897+0000","last_clean_scrub_stamp":"2024-05-09T09:51:13.463897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:36:06.810856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:26.295234+0000","last_change":"2024-05-09T09:51:26.295289+0000","last_active":"2024-05-09T09:51:26.295234+0000","last_peered":"2024-05-09T09:51:26.295234+0000","last_clean":"2024-05-09T09:51:26.295234+0000","last_became_active":"2024-05-09T09:47:14.177119+0000","last_became_peered":"2024-05-09T09:47:14.177119+0000","last_unstale":"2024-05-09T09:51:26.295234+0000","last_undegraded":"2024-05-09T09:51:26.295234+0000","last_fullsized":"2024-05-09T09:51:26.295234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:26.295031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:26.295031+0000","last_clean_scrub_stamp":"2024-05-09T09:51:26.295031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:28:18.150394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:35.259996+0000","last_change":"2024-05-09T09:51:35.260058+0000","last_active":"2024-05-09T09:51:35.259996+0000","last_peered":"2024-05-09T09:51:35.259996+0000","last_clean":"2024-05-09T09:51:35.259996+0000","last_became_active":"2024-05-09T09:47:12.184105+0000","last_became_peered":"2024-05-09T09:47:12.184105+0000","last_unstale":"2024-05-09T09:51:35.259996+0000","last_undegraded":"2024-05-09T09:51:35.259996+0000","last_fullsized":"2024-05-09T09:51:35.259996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:35.259799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:35.259799+0000","last_clean_scrub_stamp":"2024-05-09T09:51:35.259799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:03:53.899773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'2","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:07.276039+0000","last_change":"2024-05-09T09:51:07.276039+0000","last_active":"2024-05-09T09:51:07.276039+0000","last_peered":"2024-05-09T09:51:07.276039+0000","last_clean":"2024-05-09T09:51:07.276039+0000","last_became_active":"2024-05-09T09:47:14.182961+0000","last_became_peered":"2024-05-09T09:47:14.182961+0000","last_unstale":"2024-05-09T09:51:07.276039+0000","last_undegraded":"2024-05-09T09:51:07.276039+0000","last_fullsized":"2024-05-09T09:51:07.276039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:07.275721+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:07.275721+0000","last_clean_scrub_stamp":"2024-05-09T09:51:07.275721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:48:18.587139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:50.481958+0000","last_change":"2024-05-09T09:51:50.482024+0000","last_active":"2024-05-09T09:51:50.481958+0000","last_peered":"2024-05-09T09:51:50.481958+0000","last_clean":"2024-05-09T09:51:50.481958+0000","last_became_active":"2024-05-09T09:47:12.201952+0000","last_became_peered":"2024-05-09T09:47:12.201952+0000","last_unstale":"2024-05-09T09:51:50.481958+0000","last_undegraded":"2024-05-09T09:51:50.481958+0000","last_fullsized":"2024-05-09T09:51:50.481958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:50.481764+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:50.481764+0000","last_clean_scrub_stamp":"2024-05-09T09:51:50.481764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:53:19.714515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:00.474068+0000","last_change":"2024-05-09T09:51:00.474068+0000","last_active":"2024-05-09T09:51:00.474068+0000","last_peered":"2024-05-09T09:51:00.474068+0000","last_clean":"2024-05-09T09:51:00.474068+0000","last_became_active":"2024-05-09T09:47:14.193421+0000","last_became_peered":"2024-05-09T09:47:14.193421+0000","last_unstale":"2024-05-09T09:51:00.474068+0000","last_undegraded":"2024-05-09T09:51:00.474068+0000","last_fullsized":"2024-05-09T09:51:00.474068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:00.473817+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:00.473817+0000","last_clean_scrub_stamp":"2024-05-09T09:51:00.473817+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:20:56.044572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'4","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:23.303971+0000","last_change":"2024-05-09T09:51:23.303971+0000","last_active":"2024-05-09T09:51:23.303971+0000","last_peered":"2024-05-09T09:51:23.303971+0000","last_clean":"2024-05-09T09:51:23.303971+0000","last_became_active":"2024-05-09T09:47:12.203523+0000","last_became_peered":"2024-05-09T09:47:12.203523+0000","last_unstale":"2024-05-09T09:51:23.303971+0000","last_undegraded":"2024-05-09T09:51:23.303971+0000","last_fullsized":"2024-05-09T09:51:23.303971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:23.303622+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:23.303622+0000","last_clean_scrub_stamp":"2024-05-09T09:51:23.303622+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:42:02.620894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:16.166971+0000","last_change":"2024-05-09T09:51:16.166971+0000","last_active":"2024-05-09T09:51:16.166971+0000","last_peered":"2024-05-09T09:51:16.166971+0000","last_clean":"2024-05-09T09:51:16.166971+0000","last_became_active":"2024-05-09T09:47:14.171565+0000","last_became_peered":"2024-05-09T09:47:14.171565+0000","last_unstale":"2024-05-09T09:51:16.166971+0000","last_undegraded":"2024-05-09T09:51:16.166971+0000","last_fullsized":"2024-05-09T09:51:16.166971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:16.166561+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:16.166561+0000","last_clean_scrub_stamp":"2024-05-09T09:51:16.166561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:37:36.427827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:33.207783+0000","last_change":"2024-05-09T09:51:33.207783+0000","last_active":"2024-05-09T09:51:33.207783+0000","last_peered":"2024-05-09T09:51:33.207783+0000","last_clean":"2024-05-09T09:51:33.207783+0000","last_became_active":"2024-05-09T09:47:12.192462+0000","last_became_peered":"2024-05-09T09:47:12.192462+0000","last_unstale":"2024-05-09T09:51:33.207783+0000","last_undegraded":"2024-05-09T09:51:33.207783+0000","last_fullsized":"2024-05-09T09:51:33.207783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:33.207312+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:33.207312+0000","last_clean_scrub_stamp":"2024-05-09T09:51:33.207312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:28:11.973689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:28.290430+0000","last_change":"2024-05-09T09:51:28.290430+0000","last_active":"2024-05-09T09:51:28.290430+0000","last_peered":"2024-05-09T09:51:28.290430+0000","last_clean":"2024-05-09T09:51:28.290430+0000","last_became_active":"2024-05-09T09:47:14.176986+0000","last_became_peered":"2024-05-09T09:47:14.176986+0000","last_unstale":"2024-05-09T09:51:28.290430+0000","last_undegraded":"2024-05-09T09:51:28.290430+0000","last_fullsized":"2024-05-09T09:51:28.290430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:28.290172+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:28.290172+0000","last_clean_scrub_stamp":"2024-05-09T09:51:28.290172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:15:50.005621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:29.243256+0000","last_change":"2024-05-09T09:51:29.243256+0000","last_active":"2024-05-09T09:51:29.243256+0000","last_peered":"2024-05-09T09:51:29.243256+0000","last_clean":"2024-05-09T09:51:29.243256+0000","last_became_active":"2024-05-09T09:47:12.205416+0000","last_became_peered":"2024-05-09T09:47:12.205416+0000","last_unstale":"2024-05-09T09:51:29.243256+0000","last_undegraded":"2024-05-09T09:51:29.243256+0000","last_fullsized":"2024-05-09T09:51:29.243256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:29.242902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:29.242902+0000","last_clean_scrub_stamp":"2024-05-09T09:51:29.242902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:27:32.401344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:10.327719+0000","last_change":"2024-05-09T09:51:10.327719+0000","last_active":"2024-05-09T09:51:10.327719+0000","last_peered":"2024-05-09T09:51:10.327719+0000","last_clean":"2024-05-09T09:51:10.327719+0000","last_became_active":"2024-05-09T09:47:14.182248+0000","last_became_peered":"2024-05-09T09:47:14.182248+0000","last_unstale":"2024-05-09T09:51:10.327719+0000","last_undegraded":"2024-05-09T09:51:10.327719+0000","last_fullsized":"2024-05-09T09:51:10.327719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:10.327288+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:10.327288+0000","last_clean_scrub_stamp":"2024-05-09T09:51:10.327288+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:19:34.184047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:46.494521+0000","last_change":"2024-05-09T09:51:46.494590+0000","last_active":"2024-05-09T09:51:46.494521+0000","last_peered":"2024-05-09T09:51:46.494521+0000","last_clean":"2024-05-09T09:51:46.494521+0000","last_became_active":"2024-05-09T09:47:12.200127+0000","last_became_peered":"2024-05-09T09:47:12.200127+0000","last_unstale":"2024-05-09T09:51:46.494521+0000","last_undegraded":"2024-05-09T09:51:46.494521+0000","last_fullsized":"2024-05-09T09:51:46.494521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:46.494326+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:46.494326+0000","last_clean_scrub_stamp":"2024-05-09T09:51:46.494326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:54:21.768687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:05.273679+0000","last_change":"2024-05-09T09:51:05.273679+0000","last_active":"2024-05-09T09:51:05.273679+0000","last_peered":"2024-05-09T09:51:05.273679+0000","last_clean":"2024-05-09T09:51:05.273679+0000","last_became_active":"2024-05-09T09:47:14.190033+0000","last_became_peered":"2024-05-09T09:47:14.190033+0000","last_unstale":"2024-05-09T09:51:05.273679+0000","last_undegraded":"2024-05-09T09:51:05.273679+0000","last_fullsized":"2024-05-09T09:51:05.273679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:05.273418+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:05.273418+0000","last_clean_scrub_stamp":"2024-05-09T09:51:05.273418+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:59:24.394431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:44.536280+0000","last_change":"2024-05-09T09:51:44.536280+0000","last_active":"2024-05-09T09:51:44.536280+0000","last_peered":"2024-05-09T09:51:44.536280+0000","last_clean":"2024-05-09T09:51:44.536280+0000","last_became_active":"2024-05-09T09:47:12.203424+0000","last_became_peered":"2024-05-09T09:47:12.203424+0000","last_unstale":"2024-05-09T09:51:44.536280+0000","last_undegraded":"2024-05-09T09:51:44.536280+0000","last_fullsized":"2024-05-09T09:51:44.536280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:44.535998+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:44.535998+0000","last_clean_scrub_stamp":"2024-05-09T09:51:44.535998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:50.456307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:25.488693+0000","last_change":"2024-05-09T09:51:25.488693+0000","last_active":"2024-05-09T09:51:25.488693+0000","last_peered":"2024-05-09T09:51:25.488693+0000","last_clean":"2024-05-09T09:51:25.488693+0000","last_became_active":"2024-05-09T09:47:14.186711+0000","last_became_peered":"2024-05-09T09:47:14.186711+0000","last_unstale":"2024-05-09T09:51:25.488693+0000","last_undegraded":"2024-05-09T09:51:25.488693+0000","last_fullsized":"2024-05-09T09:51:25.488693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:25.488447+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:25.488447+0000","last_clean_scrub_stamp":"2024-05-09T09:51:25.488447+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:56:25.287354+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:17.400209+0000","last_change":"2024-05-09T09:51:17.400209+0000","last_active":"2024-05-09T09:51:17.400209+0000","last_peered":"2024-05-09T09:51:17.400209+0000","last_clean":"2024-05-09T09:51:17.400209+0000","last_became_active":"2024-05-09T09:47:12.205320+0000","last_became_peered":"2024-05-09T09:47:12.205320+0000","last_unstale":"2024-05-09T09:51:17.400209+0000","last_undegraded":"2024-05-09T09:51:17.400209+0000","last_fullsized":"2024-05-09T09:51:17.400209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:17.399927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:17.399927+0000","last_clean_scrub_stamp":"2024-05-09T09:51:17.399927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:34:56.092455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:38.212465+0000","last_change":"2024-05-09T09:51:38.212529+0000","last_active":"2024-05-09T09:51:38.212465+0000","last_peered":"2024-05-09T09:51:38.212465+0000","last_clean":"2024-05-09T09:51:38.212465+0000","last_became_active":"2024-05-09T09:47:14.177955+0000","last_became_peered":"2024-05-09T09:47:14.177955+0000","last_unstale":"2024-05-09T09:51:38.212465+0000","last_undegraded":"2024-05-09T09:51:38.212465+0000","last_fullsized":"2024-05-09T09:51:38.212465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-09T09:51:38.212277+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-09T09:51:38.212277+0000","last_clean_scrub_stamp":"2024-05-09T09:51:38.212277+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:36:25.679596+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:52.501866+0000","last_change":"2024-05-09T09:51:52.501866+0000","last_active":"2024-05-09T09:51:52.501866+0000","last_peered":"2024-05-09T09:51:52.501866+0000","last_clean":"2024-05-09T09:51:52.501866+0000","last_became_active":"2024-05-09T09:47:12.201790+0000","last_became_peered":"2024-05-09T09:47:12.201790+0000","last_unstale":"2024-05-09T09:51:52.501866+0000","last_undegraded":"2024-05-09T09:51:52.501866+0000","last_fullsized":"2024-05-09T09:51:52.501866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:52.501565+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:52.501565+0000","last_clean_scrub_stamp":"2024-05-09T09:51:52.501565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:54:17.100717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:48.437592+0000","last_change":"2024-05-09T09:51:48.437592+0000","last_active":"2024-05-09T09:51:48.437592+0000","last_peered":"2024-05-09T09:51:48.437592+0000","last_clean":"2024-05-09T09:51:48.437592+0000","last_became_active":"2024-05-09T09:47:12.203435+0000","last_became_peered":"2024-05-09T09:47:12.203435+0000","last_unstale":"2024-05-09T09:51:48.437592+0000","last_undegraded":"2024-05-09T09:51:48.437592+0000","last_fullsized":"2024-05-09T09:51:48.437592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:48.437314+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:48.437314+0000","last_clean_scrub_stamp":"2024-05-09T09:51:48.437314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:08:50.430772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:30.272514+0000","last_change":"2024-05-09T09:51:30.272514+0000","last_active":"2024-05-09T09:51:30.272514+0000","last_peered":"2024-05-09T09:51:30.272514+0000","last_clean":"2024-05-09T09:51:30.272514+0000","last_became_active":"2024-05-09T09:47:14.178142+0000","last_became_peered":"2024-05-09T09:47:14.178142+0000","last_unstale":"2024-05-09T09:51:30.272514+0000","last_undegraded":"2024-05-09T09:51:30.272514+0000","last_fullsized":"2024-05-09T09:51:30.272514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:30.272229+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:30.272229+0000","last_clean_scrub_stamp":"2024-05-09T09:51:30.272229+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:37:34.451434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:21.278372+0000","last_change":"2024-05-09T09:51:21.278372+0000","last_active":"2024-05-09T09:51:21.278372+0000","last_peered":"2024-05-09T09:51:21.278372+0000","last_clean":"2024-05-09T09:51:21.278372+0000","last_became_active":"2024-05-09T09:47:12.205216+0000","last_became_peered":"2024-05-09T09:47:12.205216+0000","last_unstale":"2024-05-09T09:51:21.278372+0000","last_undegraded":"2024-05-09T09:51:21.278372+0000","last_fullsized":"2024-05-09T09:51:21.278372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:21.278009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:21.278009+0000","last_clean_scrub_stamp":"2024-05-09T09:51:21.278009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:28:18.321440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'12","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:20.318209+0000","last_change":"2024-05-09T09:51:20.318209+0000","last_active":"2024-05-09T09:51:20.318209+0000","last_peered":"2024-05-09T09:51:20.318209+0000","last_clean":"2024-05-09T09:51:20.318209+0000","last_became_active":"2024-05-09T09:47:14.174123+0000","last_became_peered":"2024-05-09T09:47:14.174123+0000","last_unstale":"2024-05-09T09:51:20.318209+0000","last_undegraded":"2024-05-09T09:51:20.318209+0000","last_fullsized":"2024-05-09T09:51:20.318209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-09T09:51:20.317917+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-09T09:51:20.317917+0000","last_clean_scrub_stamp":"2024-05-09T09:51:20.317917+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:08:14.769747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3894,"ondisk_log_size":3894,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1628,"num_read_kb":1518,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705728,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35792,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336048,"statfs":{"total":96636764160,"available":96600113152,"internally_reserved":0,"allocated":466944,"data_stored":146615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705730,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":995328,"data_stored":734132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705728,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1011712,"data_stored":733627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705729,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35760,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336080,"statfs":{"total":96636764160,"available":96600145920,"internally_reserved":0,"allocated":434176,"data_stored":145588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T09:52:06.681 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:52:06.682 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:52:06.682 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-05-09T09:47:15.159739+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=15, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:52:06.683 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-09T09:47:21.199058+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=47, tm_sec=21, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=9, tm_min=50, tm_sec=41, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T09:52:06.684 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-09T09:52:26.685 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T09:52:26.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.810+0000 7f94384fb640 1 Processor -- start 2024-05-09T09:52:26.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.810+0000 7f94384fb640 1 -- start start 2024-05-09T09:52:26.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.814+0000 7f94384fb640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f943009e3b0 0x7f943012bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:52:26.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.814+0000 7f94384fb640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f943012b820 con 0x7f943012c1b0 2024-05-09T09:52:26.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.814+0000 7f94384fb640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f94300a0fc0 con 0x7f943009e3b0 2024-05-09T09:52:26.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.814+0000 7f9436297640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f943009e3b0 0x7f943012bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:52:26.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.814+0000 7f9436297640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f943009e3b0 0x7f943012bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50748/0 (socket says 172.21.15.110:50748) 2024-05-09T09:52:26.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.814+0000 7f9435a96640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f943012c1b0 0x7f943012ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:55780/0 (socket says 172.21.15.110:55780) 2024-05-09T09:52:26.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.814+0000 7f9436297640 1 -- 172.21.15.110:0/4063011099 learned_addr learned my addr 172.21.15.110:0/4063011099 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:52:26.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.814+0000 7f9436297640 1 -- 172.21.15.110:0/4063011099 >> v1:172.21.15.110:6789/0 conn(0x7f943012c1b0 legacy=0x7f943012ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:52:26.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.814+0000 7f9436297640 1 -- 172.21.15.110:0/4063011099 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f943009b5f0 con 0x7f943009e3b0 2024-05-09T09:52:26.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.814+0000 7f9436297640 1 --2- 172.21.15.110:0/4063011099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f943009e3b0 0x7f943012bc70 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f94280097f0 tx=0x7f942801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ba830ec2fb4ac6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:52:26.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.814+0000 7f9435295640 1 -- 172.21.15.110:0/4063011099 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94280b0070 con 0x7f943009e3b0 2024-05-09T09:52:26.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.814+0000 7f9435295640 1 -- 172.21.15.110:0/4063011099 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94280ab530 con 0x7f943009e3b0 2024-05-09T09:52:26.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.814+0000 7f9435295640 1 -- 172.21.15.110:0/4063011099 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94280ab830 con 0x7f943009e3b0 2024-05-09T09:52:26.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.814+0000 7f94384fb640 1 -- 172.21.15.110:0/4063011099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f943009e3b0 msgr2=0x7f943012bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:52:26.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.814+0000 7f94384fb640 1 --2- 172.21.15.110:0/4063011099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f943009e3b0 0x7f943012bc70 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f94280097f0 tx=0x7f942801c430 comp rx=0 tx=0).stop 2024-05-09T09:52:26.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.814+0000 7f94384fb640 1 -- 172.21.15.110:0/4063011099 shutdown_connections 2024-05-09T09:52:26.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.814+0000 7f94384fb640 1 --2- 172.21.15.110:0/4063011099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f943009e3b0 0x7f943012bc70 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:52:26.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.814+0000 7f94384fb640 1 -- 172.21.15.110:0/4063011099 >> 172.21.15.110:0/4063011099 conn(0x7f94300a17a0 msgr2=0x7f943009dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:52:26.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.814+0000 7f94384fb640 1 -- 172.21.15.110:0/4063011099 shutdown_connections 2024-05-09T09:52:26.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.814+0000 7f94384fb640 1 -- 172.21.15.110:0/4063011099 wait complete. 2024-05-09T09:52:26.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.818+0000 7f94384fb640 1 Processor -- start 2024-05-09T09:52:26.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.818+0000 7f94384fb640 1 -- start start 2024-05-09T09:52:26.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.818+0000 7f94384fb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f943009e3b0 0x7f9430133310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:52:26.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.818+0000 7f94384fb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f94301371e0 con 0x7f943009e3b0 2024-05-09T09:52:26.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.818+0000 7f9436297640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f943009e3b0 0x7f9430133310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:52:26.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.818+0000 7f9436297640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f943009e3b0 0x7f9430133310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50754/0 (socket says 172.21.15.110:50754) 2024-05-09T09:52:26.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.818+0000 7f9436297640 1 -- 172.21.15.110:0/1067403469 learned_addr learned my addr 172.21.15.110:0/1067403469 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:52:26.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.818+0000 7f9436297640 1 -- 172.21.15.110:0/1067403469 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f943006da80 con 0x7f943009e3b0 2024-05-09T09:52:26.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.818+0000 7f9436297640 1 --2- 172.21.15.110:0/1067403469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f943009e3b0 0x7f9430133310 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f942801a060 tx=0x7f94280191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:52:26.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.818+0000 7f942effd640 1 -- 172.21.15.110:0/1067403469 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94280b0040 con 0x7f943009e3b0 2024-05-09T09:52:26.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.818+0000 7f942effd640 1 -- 172.21.15.110:0/1067403469 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94280b4440 con 0x7f943009e3b0 2024-05-09T09:52:26.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.818+0000 7f94384fb640 1 -- 172.21.15.110:0/1067403469 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9430134ab0 con 0x7f943009e3b0 2024-05-09T09:52:26.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.818+0000 7f942effd640 1 -- 172.21.15.110:0/1067403469 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94280abe60 con 0x7f943009e3b0 2024-05-09T09:52:26.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.818+0000 7f94384fb640 1 -- 172.21.15.110:0/1067403469 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f943006e6b0 con 0x7f943009e3b0 2024-05-09T09:52:26.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.818+0000 7f94384fb640 1 -- 172.21.15.110:0/1067403469 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9430063710 con 0x7f943009e3b0 2024-05-09T09:52:26.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.818+0000 7f942effd640 1 -- 172.21.15.110:0/1067403469 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7f94280bb020 con 0x7f943009e3b0 2024-05-09T09:52:26.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.818+0000 7f942effd640 1 --2- 172.21.15.110:0/1067403469 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f941c036310 0x7f941c0387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:52:26.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.818+0000 7f942effd640 1 -- 172.21.15.110:0/1067403469 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7f94280b9020 con 0x7f943009e3b0 2024-05-09T09:52:26.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.818+0000 7f9435a96640 1 --2- 172.21.15.110:0/1067403469 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f941c036310 0x7f941c0387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:52:26.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.822+0000 7f9435a96640 1 --2- 172.21.15.110:0/1067403469 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f941c036310 0x7f941c0387d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9424001d00 tx=0x7f9424007dd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:52:26.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.826+0000 7f942effd640 1 -- 172.21.15.110:0/1067403469 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f94280c2020 con 0x7f943009e3b0 2024-05-09T09:52:26.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:26.974+0000 7f94384fb640 1 -- 172.21.15.110:0/1067403469 --> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f943006d610 con 0x7f941c036310 2024-05-09T09:52:27.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.018+0000 7f942effd640 1 -- 172.21.15.110:0/1067403469 <== mgr.4100 v2:172.21.15.157:6824/2765519551 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666416 (secure 0 0 0) 0x7f943006d610 con 0x7f941c036310 2024-05-09T09:52:27.031 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T09:52:27.040 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-05-09T09:52:27.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.026+0000 7f94384fb640 1 -- 172.21.15.110:0/1067403469 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f941c036310 msgr2=0x7f941c0387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:52:27.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.026+0000 7f94384fb640 1 --2- 172.21.15.110:0/1067403469 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f941c036310 0x7f941c0387d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9424001d00 tx=0x7f9424007dd0 comp rx=0 tx=0).stop 2024-05-09T09:52:27.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.026+0000 7f94384fb640 1 -- 172.21.15.110:0/1067403469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f943009e3b0 msgr2=0x7f9430133310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:52:27.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.026+0000 7f94384fb640 1 --2- 172.21.15.110:0/1067403469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f943009e3b0 0x7f9430133310 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f942801a060 tx=0x7f94280191d0 comp rx=0 tx=0).stop 2024-05-09T09:52:27.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.026+0000 7f94384fb640 1 -- 172.21.15.110:0/1067403469 shutdown_connections 2024-05-09T09:52:27.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.026+0000 7f94384fb640 1 --2- 172.21.15.110:0/1067403469 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7f941c036310 0x7f941c0387d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:52:27.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.026+0000 7f94384fb640 1 --2- 172.21.15.110:0/1067403469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f943009e3b0 0x7f9430133310 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:52:27.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.026+0000 7f94384fb640 1 -- 172.21.15.110:0/1067403469 >> 172.21.15.110:0/1067403469 conn(0x7f94300a17a0 msgr2=0x7f94300986a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:52:27.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.026+0000 7f94384fb640 1 -- 172.21.15.110:0/1067403469 shutdown_connections 2024-05-09T09:52:27.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.026+0000 7f94384fb640 1 -- 172.21.15.110:0/1067403469 wait complete. 2024-05-09T09:52:27.046 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-05-09T09:52:25.229220+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5118,"num_read_kb":4699,"num_write":2179,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7156,"ondisk_log_size":7156,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":135864,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377351496,"statfs":{"total":386547056640,"available":386407931904,"internally_reserved":0,"allocated":2908160,"data_stored":1759962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005584"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:19.312716+0000","last_change":"2024-05-09T09:51:19.312716+0000","last_active":"2024-05-09T09:51:19.312716+0000","last_peered":"2024-05-09T09:51:19.312716+0000","last_clean":"2024-05-09T09:51:19.312716+0000","last_became_active":"2024-05-09T09:47:12.205786+0000","last_became_peered":"2024-05-09T09:47:12.205786+0000","last_unstale":"2024-05-09T09:51:19.312716+0000","last_undegraded":"2024-05-09T09:51:19.312716+0000","last_fullsized":"2024-05-09T09:51:19.312716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:19.312429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:19.312429+0000","last_clean_scrub_stamp":"2024-05-09T09:51:19.312429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:04:04.477540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'4","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:17.286281+0000","last_change":"2024-05-09T09:51:17.286281+0000","last_active":"2024-05-09T09:51:17.286281+0000","last_peered":"2024-05-09T09:51:17.286281+0000","last_clean":"2024-05-09T09:51:17.286281+0000","last_became_active":"2024-05-09T09:47:14.171044+0000","last_became_peered":"2024-05-09T09:47:14.171044+0000","last_unstale":"2024-05-09T09:51:17.286281+0000","last_undegraded":"2024-05-09T09:51:17.286281+0000","last_fullsized":"2024-05-09T09:51:17.286281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:17.285919+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:17.285919+0000","last_clean_scrub_stamp":"2024-05-09T09:51:17.285919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:38:58.303485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:31.265736+0000","last_change":"2024-05-09T09:51:31.265802+0000","last_active":"2024-05-09T09:51:31.265736+0000","last_peered":"2024-05-09T09:51:31.265736+0000","last_clean":"2024-05-09T09:51:31.265736+0000","last_became_active":"2024-05-09T09:47:12.189774+0000","last_became_peered":"2024-05-09T09:47:12.189774+0000","last_unstale":"2024-05-09T09:51:31.265736+0000","last_undegraded":"2024-05-09T09:51:31.265736+0000","last_fullsized":"2024-05-09T09:51:31.265736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:31.265537+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:31.265537+0000","last_clean_scrub_stamp":"2024-05-09T09:51:31.265537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:45:33.707959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:58.498826+0000","last_change":"2024-05-09T09:50:58.498826+0000","last_active":"2024-05-09T09:50:58.498826+0000","last_peered":"2024-05-09T09:50:58.498826+0000","last_clean":"2024-05-09T09:50:58.498826+0000","last_became_active":"2024-05-09T09:47:14.192803+0000","last_became_peered":"2024-05-09T09:47:14.192803+0000","last_unstale":"2024-05-09T09:50:58.498826+0000","last_undegraded":"2024-05-09T09:50:58.498826+0000","last_fullsized":"2024-05-09T09:50:58.498826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-09T09:50:58.498439+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-09T09:50:58.498439+0000","last_clean_scrub_stamp":"2024-05-09T09:50:58.498439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:24.753930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"32'3","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:39.539536+0000","last_change":"2024-05-09T09:51:39.539606+0000","last_active":"2024-05-09T09:51:39.539536+0000","last_peered":"2024-05-09T09:51:39.539536+0000","last_clean":"2024-05-09T09:51:39.539536+0000","last_became_active":"2024-05-09T09:47:12.207184+0000","last_became_peered":"2024-05-09T09:47:12.207184+0000","last_unstale":"2024-05-09T09:51:39.539536+0000","last_undegraded":"2024-05-09T09:51:39.539536+0000","last_fullsized":"2024-05-09T09:51:39.539536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-09T09:51:39.539316+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-09T09:51:39.539316+0000","last_clean_scrub_stamp":"2024-05-09T09:51:39.539316+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:18:24.181972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'14","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:02.473990+0000","last_change":"2024-05-09T09:51:02.473990+0000","last_active":"2024-05-09T09:51:02.473990+0000","last_peered":"2024-05-09T09:51:02.473990+0000","last_clean":"2024-05-09T09:51:02.473990+0000","last_became_active":"2024-05-09T09:47:14.192821+0000","last_became_peered":"2024-05-09T09:47:14.192821+0000","last_unstale":"2024-05-09T09:51:02.473990+0000","last_undegraded":"2024-05-09T09:51:02.473990+0000","last_fullsized":"2024-05-09T09:51:02.473990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-05-09T09:51:02.473728+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-05-09T09:51:02.473728+0000","last_clean_scrub_stamp":"2024-05-09T09:51:02.473728+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:32.374501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:28.190192+0000","last_change":"2024-05-09T09:51:28.190303+0000","last_active":"2024-05-09T09:51:28.190192+0000","last_peered":"2024-05-09T09:51:28.190192+0000","last_clean":"2024-05-09T09:51:28.190192+0000","last_became_active":"2024-05-09T09:47:12.194183+0000","last_became_peered":"2024-05-09T09:47:12.194183+0000","last_unstale":"2024-05-09T09:51:28.190192+0000","last_undegraded":"2024-05-09T09:51:28.190192+0000","last_fullsized":"2024-05-09T09:51:28.190192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:28.189983+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:28.189983+0000","last_clean_scrub_stamp":"2024-05-09T09:51:28.189983+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:47:28.328562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'12","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:39.260166+0000","last_change":"2024-05-09T09:51:39.260319+0000","last_active":"2024-05-09T09:51:39.260166+0000","last_peered":"2024-05-09T09:51:39.260166+0000","last_clean":"2024-05-09T09:51:39.260166+0000","last_became_active":"2024-05-09T09:47:52.429940+0000","last_became_peered":"2024-05-09T09:47:52.429940+0000","last_unstale":"2024-05-09T09:51:39.260166+0000","last_undegraded":"2024-05-09T09:51:39.260166+0000","last_fullsized":"2024-05-09T09:51:39.260166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-09T09:51:39.259883+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-09T09:51:39.259883+0000","last_clean_scrub_stamp":"2024-05-09T09:51:39.259883+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:48.460976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:51.518559+0000","last_change":"2024-05-09T09:51:51.518559+0000","last_active":"2024-05-09T09:51:51.518559+0000","last_peered":"2024-05-09T09:51:51.518559+0000","last_clean":"2024-05-09T09:51:51.518559+0000","last_became_active":"2024-05-09T09:47:12.204446+0000","last_became_peered":"2024-05-09T09:47:12.204446+0000","last_unstale":"2024-05-09T09:51:51.518559+0000","last_undegraded":"2024-05-09T09:51:51.518559+0000","last_fullsized":"2024-05-09T09:51:51.518559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:51.518284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:51.518284+0000","last_clean_scrub_stamp":"2024-05-09T09:51:51.518284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:38:07.006781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'16","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:09.303305+0000","last_change":"2024-05-09T09:51:09.303305+0000","last_active":"2024-05-09T09:51:09.303305+0000","last_peered":"2024-05-09T09:51:09.303305+0000","last_clean":"2024-05-09T09:51:09.303305+0000","last_became_active":"2024-05-09T09:47:14.184792+0000","last_became_peered":"2024-05-09T09:47:14.184792+0000","last_unstale":"2024-05-09T09:51:09.303305+0000","last_undegraded":"2024-05-09T09:51:09.303305+0000","last_fullsized":"2024-05-09T09:51:09.303305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-05-09T09:51:09.303051+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-05-09T09:51:09.303051+0000","last_clean_scrub_stamp":"2024-05-09T09:51:09.303051+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:45:33.303026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":40,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:30.227586+0000","last_change":"2024-05-09T09:51:30.227586+0000","last_active":"2024-05-09T09:51:30.227586+0000","last_peered":"2024-05-09T09:51:30.227586+0000","last_clean":"2024-05-09T09:51:30.227586+0000","last_became_active":"2024-05-09T09:47:12.195117+0000","last_became_peered":"2024-05-09T09:47:12.195117+0000","last_unstale":"2024-05-09T09:51:30.227586+0000","last_undegraded":"2024-05-09T09:51:30.227586+0000","last_fullsized":"2024-05-09T09:51:30.227586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:30.227300+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:30.227300+0000","last_clean_scrub_stamp":"2024-05-09T09:51:30.227300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:21:25.798055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'8","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:20.459408+0000","last_change":"2024-05-09T09:51:20.459408+0000","last_active":"2024-05-09T09:51:20.459408+0000","last_peered":"2024-05-09T09:51:20.459408+0000","last_clean":"2024-05-09T09:51:20.459408+0000","last_became_active":"2024-05-09T09:47:14.188665+0000","last_became_peered":"2024-05-09T09:47:14.188665+0000","last_unstale":"2024-05-09T09:51:20.459408+0000","last_undegraded":"2024-05-09T09:51:20.459408+0000","last_fullsized":"2024-05-09T09:51:20.459408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:20.459134+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:20.459134+0000","last_clean_scrub_stamp":"2024-05-09T09:51:20.459134+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:03:39.099108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"30'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:59.390710+0000","last_change":"2024-05-09T09:51:59.390710+0000","last_active":"2024-05-09T09:51:59.390710+0000","last_peered":"2024-05-09T09:51:59.390710+0000","last_clean":"2024-05-09T09:51:59.390710+0000","last_became_active":"2024-05-09T09:47:12.199697+0000","last_became_peered":"2024-05-09T09:47:12.199697+0000","last_unstale":"2024-05-09T09:51:59.390710+0000","last_undegraded":"2024-05-09T09:51:59.390710+0000","last_fullsized":"2024-05-09T09:51:59.390710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-09T09:51:59.390420+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-09T09:51:59.390420+0000","last_clean_scrub_stamp":"2024-05-09T09:51:59.390420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:45:34.627602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'12","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:14.446828+0000","last_change":"2024-05-09T09:51:14.446828+0000","last_active":"2024-05-09T09:51:14.446828+0000","last_peered":"2024-05-09T09:51:14.446828+0000","last_clean":"2024-05-09T09:51:14.446828+0000","last_became_active":"2024-05-09T09:47:14.179041+0000","last_became_peered":"2024-05-09T09:47:14.179041+0000","last_unstale":"2024-05-09T09:51:14.446828+0000","last_undegraded":"2024-05-09T09:51:14.446828+0000","last_fullsized":"2024-05-09T09:51:14.446828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-09T09:51:14.446529+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-09T09:51:14.446529+0000","last_clean_scrub_stamp":"2024-05-09T09:51:14.446529+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:59:33.567541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:34.229655+0000","last_change":"2024-05-09T09:51:34.229655+0000","last_active":"2024-05-09T09:51:34.229655+0000","last_peered":"2024-05-09T09:51:34.229655+0000","last_clean":"2024-05-09T09:51:34.229655+0000","last_became_active":"2024-05-09T09:47:12.183745+0000","last_became_peered":"2024-05-09T09:47:12.183745+0000","last_unstale":"2024-05-09T09:51:34.229655+0000","last_undegraded":"2024-05-09T09:51:34.229655+0000","last_fullsized":"2024-05-09T09:51:34.229655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:34.229365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:34.229365+0000","last_clean_scrub_stamp":"2024-05-09T09:51:34.229365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:13:13.552047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'14","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:08.402293+0000","last_change":"2024-05-09T09:51:08.402293+0000","last_active":"2024-05-09T09:51:08.402293+0000","last_peered":"2024-05-09T09:51:08.402293+0000","last_clean":"2024-05-09T09:51:08.402293+0000","last_became_active":"2024-05-09T09:47:14.173031+0000","last_became_peered":"2024-05-09T09:47:14.173031+0000","last_unstale":"2024-05-09T09:51:08.402293+0000","last_undegraded":"2024-05-09T09:51:08.402293+0000","last_fullsized":"2024-05-09T09:51:08.402293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-05-09T09:51:08.401898+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-05-09T09:51:08.401898+0000","last_clean_scrub_stamp":"2024-05-09T09:51:08.401898+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:55.999690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"30'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:01.424391+0000","last_change":"2024-05-09T09:51:01.424391+0000","last_active":"2024-05-09T09:51:01.424391+0000","last_peered":"2024-05-09T09:51:01.424391+0000","last_clean":"2024-05-09T09:51:01.424391+0000","last_became_active":"2024-05-09T09:47:14.192744+0000","last_became_peered":"2024-05-09T09:47:14.192744+0000","last_unstale":"2024-05-09T09:51:01.424391+0000","last_undegraded":"2024-05-09T09:51:01.424391+0000","last_fullsized":"2024-05-09T09:51:01.424391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-05-09T09:51:01.424130+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-05-09T09:51:01.424130+0000","last_clean_scrub_stamp":"2024-05-09T09:51:01.424130+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:37:21.685395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:19.333526+0000","last_change":"2024-05-09T09:51:19.333526+0000","last_active":"2024-05-09T09:51:19.333526+0000","last_peered":"2024-05-09T09:51:19.333526+0000","last_clean":"2024-05-09T09:51:19.333526+0000","last_became_active":"2024-05-09T09:47:12.210781+0000","last_became_peered":"2024-05-09T09:47:12.210781+0000","last_unstale":"2024-05-09T09:51:19.333526+0000","last_undegraded":"2024-05-09T09:51:19.333526+0000","last_fullsized":"2024-05-09T09:51:19.333526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:19.333113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:19.333113+0000","last_clean_scrub_stamp":"2024-05-09T09:51:19.333113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:47:02.729348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'20","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:03.281444+0000","last_change":"2024-05-09T09:51:03.281444+0000","last_active":"2024-05-09T09:51:03.281444+0000","last_peered":"2024-05-09T09:51:03.281444+0000","last_clean":"2024-05-09T09:51:03.281444+0000","last_became_active":"2024-05-09T09:47:14.190021+0000","last_became_peered":"2024-05-09T09:47:14.190021+0000","last_unstale":"2024-05-09T09:51:03.281444+0000","last_undegraded":"2024-05-09T09:51:03.281444+0000","last_fullsized":"2024-05-09T09:51:03.281444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-05-09T09:51:03.281166+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-05-09T09:51:03.281166+0000","last_clean_scrub_stamp":"2024-05-09T09:51:03.281166+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:25.247894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:27.221934+0000","last_change":"2024-05-09T09:51:27.221934+0000","last_active":"2024-05-09T09:51:27.221934+0000","last_peered":"2024-05-09T09:51:27.221934+0000","last_clean":"2024-05-09T09:51:27.221934+0000","last_became_active":"2024-05-09T09:47:12.193509+0000","last_became_peered":"2024-05-09T09:47:12.193509+0000","last_unstale":"2024-05-09T09:51:27.221934+0000","last_undegraded":"2024-05-09T09:51:27.221934+0000","last_fullsized":"2024-05-09T09:51:27.221934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:27.221674+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:27.221674+0000","last_clean_scrub_stamp":"2024-05-09T09:51:27.221674+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:39:08.239240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'8","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:06.263845+0000","last_change":"2024-05-09T09:51:06.263845+0000","last_active":"2024-05-09T09:51:06.263845+0000","last_peered":"2024-05-09T09:51:06.263845+0000","last_clean":"2024-05-09T09:51:06.263845+0000","last_became_active":"2024-05-09T09:47:14.189468+0000","last_became_peered":"2024-05-09T09:47:14.189468+0000","last_unstale":"2024-05-09T09:51:06.263845+0000","last_undegraded":"2024-05-09T09:51:06.263845+0000","last_fullsized":"2024-05-09T09:51:06.263845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:06.263525+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:06.263525+0000","last_clean_scrub_stamp":"2024-05-09T09:51:06.263525+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:12:00.576796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:23.303574+0000","last_change":"2024-05-09T09:51:23.303574+0000","last_active":"2024-05-09T09:51:23.303574+0000","last_peered":"2024-05-09T09:51:23.303574+0000","last_clean":"2024-05-09T09:51:23.303574+0000","last_became_active":"2024-05-09T09:47:12.206920+0000","last_became_peered":"2024-05-09T09:47:12.206920+0000","last_unstale":"2024-05-09T09:51:23.303574+0000","last_undegraded":"2024-05-09T09:51:23.303574+0000","last_fullsized":"2024-05-09T09:51:23.303574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:23.303278+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:23.303278+0000","last_clean_scrub_stamp":"2024-05-09T09:51:23.303278+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:08:09.036340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'18","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:20.230883+0000","last_change":"2024-05-09T09:51:20.230883+0000","last_active":"2024-05-09T09:51:20.230883+0000","last_peered":"2024-05-09T09:51:20.230883+0000","last_clean":"2024-05-09T09:51:20.230883+0000","last_became_active":"2024-05-09T09:47:14.173701+0000","last_became_peered":"2024-05-09T09:47:14.173701+0000","last_unstale":"2024-05-09T09:51:20.230883+0000","last_undegraded":"2024-05-09T09:51:20.230883+0000","last_fullsized":"2024-05-09T09:51:20.230883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-05-09T09:51:20.230502+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-05-09T09:51:20.230502+0000","last_clean_scrub_stamp":"2024-05-09T09:51:20.230502+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:08:01.060833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:25.307513+0000","last_change":"2024-05-09T09:51:25.307513+0000","last_active":"2024-05-09T09:51:25.307513+0000","last_peered":"2024-05-09T09:51:25.307513+0000","last_clean":"2024-05-09T09:51:25.307513+0000","last_became_active":"2024-05-09T09:47:12.206564+0000","last_became_peered":"2024-05-09T09:47:12.206564+0000","last_unstale":"2024-05-09T09:51:25.307513+0000","last_undegraded":"2024-05-09T09:51:25.307513+0000","last_fullsized":"2024-05-09T09:51:25.307513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:25.307249+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:25.307249+0000","last_clean_scrub_stamp":"2024-05-09T09:51:25.307249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:48:11.901400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'10","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:10.414463+0000","last_change":"2024-05-09T09:51:10.414463+0000","last_active":"2024-05-09T09:51:10.414463+0000","last_peered":"2024-05-09T09:51:10.414463+0000","last_clean":"2024-05-09T09:51:10.414463+0000","last_became_active":"2024-05-09T09:47:14.173022+0000","last_became_peered":"2024-05-09T09:47:14.173022+0000","last_unstale":"2024-05-09T09:51:10.414463+0000","last_undegraded":"2024-05-09T09:51:10.414463+0000","last_fullsized":"2024-05-09T09:51:10.414463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-09T09:51:10.414205+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-09T09:51:10.414205+0000","last_clean_scrub_stamp":"2024-05-09T09:51:10.414205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:51:35.503195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:17.187941+0000","last_change":"2024-05-09T09:51:17.187941+0000","last_active":"2024-05-09T09:51:17.187941+0000","last_peered":"2024-05-09T09:51:17.187941+0000","last_clean":"2024-05-09T09:51:17.187941+0000","last_became_active":"2024-05-09T09:47:12.214422+0000","last_became_peered":"2024-05-09T09:47:12.214422+0000","last_unstale":"2024-05-09T09:51:17.187941+0000","last_undegraded":"2024-05-09T09:51:17.187941+0000","last_fullsized":"2024-05-09T09:51:17.187941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:17.187681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:17.187681+0000","last_clean_scrub_stamp":"2024-05-09T09:51:17.187681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:47.088454+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'10","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:14.316808+0000","last_change":"2024-05-09T09:51:14.316808+0000","last_active":"2024-05-09T09:51:14.316808+0000","last_peered":"2024-05-09T09:51:14.316808+0000","last_clean":"2024-05-09T09:51:14.316808+0000","last_became_active":"2024-05-09T09:47:14.172297+0000","last_became_peered":"2024-05-09T09:47:14.172297+0000","last_unstale":"2024-05-09T09:51:14.316808+0000","last_undegraded":"2024-05-09T09:51:14.316808+0000","last_fullsized":"2024-05-09T09:51:14.316808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-09T09:51:14.316551+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-09T09:51:14.316551+0000","last_clean_scrub_stamp":"2024-05-09T09:51:14.316551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:05:01.778480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:33.483810+0000","last_change":"2024-05-09T09:51:33.483810+0000","last_active":"2024-05-09T09:51:33.483810+0000","last_peered":"2024-05-09T09:51:33.483810+0000","last_clean":"2024-05-09T09:51:33.483810+0000","last_became_active":"2024-05-09T09:47:12.211880+0000","last_became_peered":"2024-05-09T09:47:12.211880+0000","last_unstale":"2024-05-09T09:51:33.483810+0000","last_undegraded":"2024-05-09T09:51:33.483810+0000","last_fullsized":"2024-05-09T09:51:33.483810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:33.483529+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:33.483529+0000","last_clean_scrub_stamp":"2024-05-09T09:51:33.483529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:02:54.678304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'40","reported_seq":114,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:43.227650+0000","last_change":"2024-05-09T09:51:43.227650+0000","last_active":"2024-05-09T09:51:43.227650+0000","last_peered":"2024-05-09T09:51:43.227650+0000","last_clean":"2024-05-09T09:51:43.227650+0000","last_became_active":"2024-05-09T09:47:22.258991+0000","last_became_peered":"2024-05-09T09:47:22.258991+0000","last_unstale":"2024-05-09T09:51:43.227650+0000","last_undegraded":"2024-05-09T09:51:43.227650+0000","last_fullsized":"2024-05-09T09:51:43.227650+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-05-09T09:51:43.227380+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-05-09T09:51:43.227380+0000","last_clean_scrub_stamp":"2024-05-09T09:51:43.227380+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:54:08.681081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":174,"num_read_kb":174,"num_write":107,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:29.521842+0000","last_change":"2024-05-09T09:51:29.521842+0000","last_active":"2024-05-09T09:51:29.521842+0000","last_peered":"2024-05-09T09:51:29.521842+0000","last_clean":"2024-05-09T09:51:29.521842+0000","last_became_active":"2024-05-09T09:47:14.184851+0000","last_became_peered":"2024-05-09T09:47:14.184851+0000","last_unstale":"2024-05-09T09:51:29.521842+0000","last_undegraded":"2024-05-09T09:51:29.521842+0000","last_fullsized":"2024-05-09T09:51:29.521842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:29.521558+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:29.521558+0000","last_clean_scrub_stamp":"2024-05-09T09:51:29.521558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:56:44.098725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:52:01.344764+0000","last_change":"2024-05-09T09:52:01.344839+0000","last_active":"2024-05-09T09:52:01.344764+0000","last_peered":"2024-05-09T09:52:01.344764+0000","last_clean":"2024-05-09T09:52:01.344764+0000","last_became_active":"2024-05-09T09:47:12.214108+0000","last_became_peered":"2024-05-09T09:47:12.214108+0000","last_unstale":"2024-05-09T09:52:01.344764+0000","last_undegraded":"2024-05-09T09:52:01.344764+0000","last_fullsized":"2024-05-09T09:52:01.344764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:52:01.344557+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:52:01.344557+0000","last_clean_scrub_stamp":"2024-05-09T09:52:01.344557+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:23:29.367503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:53.499229+0000","last_change":"2024-05-09T09:50:53.499229+0000","last_active":"2024-05-09T09:50:53.499229+0000","last_peered":"2024-05-09T09:50:53.499229+0000","last_clean":"2024-05-09T09:50:53.499229+0000","last_became_active":"2024-05-09T09:47:16.196516+0000","last_became_peered":"2024-05-09T09:47:16.196516+0000","last_unstale":"2024-05-09T09:50:53.499229+0000","last_undegraded":"2024-05-09T09:50:53.499229+0000","last_fullsized":"2024-05-09T09:50:53.499229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:53.498977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:53.498977+0000","last_clean_scrub_stamp":"2024-05-09T09:50:53.498977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:34:28.515132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'111","reported_seq":167,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:13.471414+0000","last_change":"2024-05-09T09:51:13.471414+0000","last_active":"2024-05-09T09:51:13.471414+0000","last_peered":"2024-05-09T09:51:13.471414+0000","last_clean":"2024-05-09T09:51:13.471414+0000","last_became_active":"2024-05-09T09:47:18.235911+0000","last_became_peered":"2024-05-09T09:47:18.235911+0000","last_unstale":"2024-05-09T09:51:13.471414+0000","last_undegraded":"2024-05-09T09:51:13.471414+0000","last_fullsized":"2024-05-09T09:51:13.471414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'111","last_scrub_stamp":"2024-05-09T09:51:13.471021+0000","last_deep_scrub":"32'111","last_deep_scrub_stamp":"2024-05-09T09:51:13.471021+0000","last_clean_scrub_stamp":"2024-05-09T09:51:13.471021+0000","objects_scrubbed":4,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:48:45.181255+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:04.247398+0000","last_change":"2024-05-09T09:51:04.247398+0000","last_active":"2024-05-09T09:51:04.247398+0000","last_peered":"2024-05-09T09:51:04.247398+0000","last_clean":"2024-05-09T09:51:04.247398+0000","last_became_active":"2024-05-09T09:47:20.251712+0000","last_became_peered":"2024-05-09T09:47:20.251712+0000","last_unstale":"2024-05-09T09:51:04.247398+0000","last_undegraded":"2024-05-09T09:51:04.247398+0000","last_fullsized":"2024-05-09T09:51:04.247398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:04.247033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:04.247033+0000","last_clean_scrub_stamp":"2024-05-09T09:51:04.247033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:57.593992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:40.230983+0000","last_change":"2024-05-09T09:51:40.230983+0000","last_active":"2024-05-09T09:51:40.230983+0000","last_peered":"2024-05-09T09:51:40.230983+0000","last_clean":"2024-05-09T09:51:40.230983+0000","last_became_active":"2024-05-09T09:47:22.255180+0000","last_became_peered":"2024-05-09T09:47:22.255180+0000","last_unstale":"2024-05-09T09:51:40.230983+0000","last_undegraded":"2024-05-09T09:51:40.230983+0000","last_fullsized":"2024-05-09T09:51:40.230983+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-05-09T09:51:40.230582+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-05-09T09:51:40.230582+0000","last_clean_scrub_stamp":"2024-05-09T09:51:40.230582+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:03:58.870556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:22.502050+0000","last_change":"2024-05-09T09:51:22.502050+0000","last_active":"2024-05-09T09:51:22.502050+0000","last_peered":"2024-05-09T09:51:22.502050+0000","last_clean":"2024-05-09T09:51:22.502050+0000","last_became_active":"2024-05-09T09:47:14.187095+0000","last_became_peered":"2024-05-09T09:47:14.187095+0000","last_unstale":"2024-05-09T09:51:22.502050+0000","last_undegraded":"2024-05-09T09:51:22.502050+0000","last_fullsized":"2024-05-09T09:51:22.502050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:22.501695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:22.501695+0000","last_clean_scrub_stamp":"2024-05-09T09:51:22.501695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:02:09.890340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:31.182425+0000","last_change":"2024-05-09T09:51:31.182425+0000","last_active":"2024-05-09T09:51:31.182425+0000","last_peered":"2024-05-09T09:51:31.182425+0000","last_clean":"2024-05-09T09:51:31.182425+0000","last_became_active":"2024-05-09T09:47:12.194549+0000","last_became_peered":"2024-05-09T09:47:12.194549+0000","last_unstale":"2024-05-09T09:51:31.182425+0000","last_undegraded":"2024-05-09T09:51:31.182425+0000","last_fullsized":"2024-05-09T09:51:31.182425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:31.182162+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:31.182162+0000","last_clean_scrub_stamp":"2024-05-09T09:51:31.182162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:37:51.443427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:07.069334+0000","last_change":"2024-05-09T09:51:07.069334+0000","last_active":"2024-05-09T09:51:07.069334+0000","last_peered":"2024-05-09T09:51:07.069334+0000","last_clean":"2024-05-09T09:51:07.069334+0000","last_became_active":"2024-05-09T09:47:16.190755+0000","last_became_peered":"2024-05-09T09:47:16.190755+0000","last_unstale":"2024-05-09T09:51:07.069334+0000","last_undegraded":"2024-05-09T09:51:07.069334+0000","last_fullsized":"2024-05-09T09:51:07.069334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:07.069053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:07.069053+0000","last_clean_scrub_stamp":"2024-05-09T09:51:07.069053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:51:02.166302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'10","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:47.334999+0000","last_change":"2024-05-09T09:50:47.334999+0000","last_active":"2024-05-09T09:50:47.334999+0000","last_peered":"2024-05-09T09:50:47.334999+0000","last_clean":"2024-05-09T09:50:47.334999+0000","last_became_active":"2024-05-09T09:47:18.214299+0000","last_became_peered":"2024-05-09T09:47:18.214299+0000","last_unstale":"2024-05-09T09:50:47.334999+0000","last_undegraded":"2024-05-09T09:50:47.334999+0000","last_fullsized":"2024-05-09T09:50:47.334999+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-09T09:50:47.334727+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-09T09:50:47.334727+0000","last_clean_scrub_stamp":"2024-05-09T09:50:47.334727+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:31:56.932969+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:56.256269+0000","last_change":"2024-05-09T09:50:56.256269+0000","last_active":"2024-05-09T09:50:56.256269+0000","last_peered":"2024-05-09T09:50:56.256269+0000","last_clean":"2024-05-09T09:50:56.256269+0000","last_became_active":"2024-05-09T09:47:20.241096+0000","last_became_peered":"2024-05-09T09:47:20.241096+0000","last_unstale":"2024-05-09T09:50:56.256269+0000","last_undegraded":"2024-05-09T09:50:56.256269+0000","last_fullsized":"2024-05-09T09:50:56.256269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:56.255842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:56.255842+0000","last_clean_scrub_stamp":"2024-05-09T09:50:56.255842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:53:33.355429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"30'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:45.239069+0000","last_change":"2024-05-09T09:51:45.239069+0000","last_active":"2024-05-09T09:51:45.239069+0000","last_peered":"2024-05-09T09:51:45.239069+0000","last_clean":"2024-05-09T09:51:45.239069+0000","last_became_active":"2024-05-09T09:47:22.257798+0000","last_became_peered":"2024-05-09T09:47:22.257798+0000","last_unstale":"2024-05-09T09:51:45.239069+0000","last_undegraded":"2024-05-09T09:51:45.239069+0000","last_fullsized":"2024-05-09T09:51:45.239069+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-09T09:51:45.238788+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-09T09:51:45.238788+0000","last_clean_scrub_stamp":"2024-05-09T09:51:45.238788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:51:23.350868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:38.265821+0000","last_change":"2024-05-09T09:51:38.265982+0000","last_active":"2024-05-09T09:51:38.265821+0000","last_peered":"2024-05-09T09:51:38.265821+0000","last_clean":"2024-05-09T09:51:38.265821+0000","last_became_active":"2024-05-09T09:47:52.429857+0000","last_became_peered":"2024-05-09T09:47:52.429857+0000","last_unstale":"2024-05-09T09:51:38.265821+0000","last_undegraded":"2024-05-09T09:51:38.265821+0000","last_fullsized":"2024-05-09T09:51:38.265821+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:38.265591+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:38.265591+0000","last_clean_scrub_stamp":"2024-05-09T09:51:38.265591+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:59.065746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:52:00.356383+0000","last_change":"2024-05-09T09:52:00.356405+0000","last_active":"2024-05-09T09:52:00.356383+0000","last_peered":"2024-05-09T09:52:00.356383+0000","last_clean":"2024-05-09T09:52:00.356383+0000","last_became_active":"2024-05-09T09:47:12.201415+0000","last_became_peered":"2024-05-09T09:47:12.201415+0000","last_unstale":"2024-05-09T09:52:00.356383+0000","last_undegraded":"2024-05-09T09:52:00.356383+0000","last_fullsized":"2024-05-09T09:52:00.356383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:52:00.356312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:52:00.356312+0000","last_clean_scrub_stamp":"2024-05-09T09:52:00.356312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:42:20.079946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:03.013403+0000","last_change":"2024-05-09T09:51:03.013403+0000","last_active":"2024-05-09T09:51:03.013403+0000","last_peered":"2024-05-09T09:51:03.013403+0000","last_clean":"2024-05-09T09:51:03.013403+0000","last_became_active":"2024-05-09T09:47:16.212543+0000","last_became_peered":"2024-05-09T09:47:16.212543+0000","last_unstale":"2024-05-09T09:51:03.013403+0000","last_undegraded":"2024-05-09T09:51:03.013403+0000","last_fullsized":"2024-05-09T09:51:03.013403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:03.013120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:03.013120+0000","last_clean_scrub_stamp":"2024-05-09T09:51:03.013120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:48:14.324538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:56.286722+0000","last_change":"2024-05-09T09:50:56.286722+0000","last_active":"2024-05-09T09:50:56.286722+0000","last_peered":"2024-05-09T09:50:56.286722+0000","last_clean":"2024-05-09T09:50:56.286722+0000","last_became_active":"2024-05-09T09:47:18.212685+0000","last_became_peered":"2024-05-09T09:47:18.212685+0000","last_unstale":"2024-05-09T09:50:56.286722+0000","last_undegraded":"2024-05-09T09:50:56.286722+0000","last_fullsized":"2024-05-09T09:50:56.286722+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-09T09:50:56.286427+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-09T09:50:56.286427+0000","last_clean_scrub_stamp":"2024-05-09T09:50:56.286427+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:21.085497+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":396,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:06.438322+0000","last_change":"2024-05-09T09:51:06.438322+0000","last_active":"2024-05-09T09:51:06.438322+0000","last_peered":"2024-05-09T09:51:06.438322+0000","last_clean":"2024-05-09T09:51:06.438322+0000","last_became_active":"2024-05-09T09:47:20.250200+0000","last_became_peered":"2024-05-09T09:47:20.250200+0000","last_unstale":"2024-05-09T09:51:06.438322+0000","last_undegraded":"2024-05-09T09:51:06.438322+0000","last_fullsized":"2024-05-09T09:51:06.438322+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:51:06.438054+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:51:06.438054+0000","last_clean_scrub_stamp":"2024-05-09T09:51:06.438054+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:28:03.481485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:36.207039+0000","last_change":"2024-05-09T09:51:36.207039+0000","last_active":"2024-05-09T09:51:36.207039+0000","last_peered":"2024-05-09T09:51:36.207039+0000","last_clean":"2024-05-09T09:51:36.207039+0000","last_became_active":"2024-05-09T09:47:22.238160+0000","last_became_peered":"2024-05-09T09:47:22.238160+0000","last_unstale":"2024-05-09T09:51:36.207039+0000","last_undegraded":"2024-05-09T09:51:36.207039+0000","last_fullsized":"2024-05-09T09:51:36.207039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:36.206692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:36.206692+0000","last_clean_scrub_stamp":"2024-05-09T09:51:36.206692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:28:28.062055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'16","reported_seq":114,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:28.332773+0000","last_change":"2024-05-09T09:51:28.332773+0000","last_active":"2024-05-09T09:51:28.332773+0000","last_peered":"2024-05-09T09:51:28.332773+0000","last_clean":"2024-05-09T09:51:28.332773+0000","last_became_active":"2024-05-09T09:47:14.176295+0000","last_became_peered":"2024-05-09T09:47:14.176295+0000","last_unstale":"2024-05-09T09:51:28.332773+0000","last_undegraded":"2024-05-09T09:51:28.332773+0000","last_fullsized":"2024-05-09T09:51:28.332773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-05-09T09:51:28.332516+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-05-09T09:51:28.332516+0000","last_clean_scrub_stamp":"2024-05-09T09:51:28.332516+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:28:07.098893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:31.289987+0000","last_change":"2024-05-09T09:51:31.289987+0000","last_active":"2024-05-09T09:51:31.289987+0000","last_peered":"2024-05-09T09:51:31.289987+0000","last_clean":"2024-05-09T09:51:31.289987+0000","last_became_active":"2024-05-09T09:47:12.191194+0000","last_became_peered":"2024-05-09T09:47:12.191194+0000","last_unstale":"2024-05-09T09:51:31.289987+0000","last_undegraded":"2024-05-09T09:51:31.289987+0000","last_fullsized":"2024-05-09T09:51:31.289987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:31.289717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:31.289717+0000","last_clean_scrub_stamp":"2024-05-09T09:51:31.289717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:58:22.238688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:52:08.352292+0000","last_change":"2024-05-09T09:52:08.352292+0000","last_active":"2024-05-09T09:52:08.352292+0000","last_peered":"2024-05-09T09:52:08.352292+0000","last_clean":"2024-05-09T09:52:08.352292+0000","last_became_active":"2024-05-09T09:47:52.201081+0000","last_became_peered":"2024-05-09T09:47:52.201081+0000","last_unstale":"2024-05-09T09:52:08.352292+0000","last_undegraded":"2024-05-09T09:52:08.352292+0000","last_fullsized":"2024-05-09T09:52:08.352292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:52:08.352045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:52:08.352045+0000","last_clean_scrub_stamp":"2024-05-09T09:52:08.352045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:19.773234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'110","reported_seq":166,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:52.254281+0000","last_change":"2024-05-09T09:50:52.254281+0000","last_active":"2024-05-09T09:50:52.254281+0000","last_peered":"2024-05-09T09:50:52.254281+0000","last_clean":"2024-05-09T09:50:52.254281+0000","last_became_active":"2024-05-09T09:47:18.217843+0000","last_became_peered":"2024-05-09T09:47:18.217843+0000","last_unstale":"2024-05-09T09:50:52.254281+0000","last_undegraded":"2024-05-09T09:50:52.254281+0000","last_fullsized":"2024-05-09T09:50:52.254281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'110","last_scrub_stamp":"2024-05-09T09:50:52.254022+0000","last_deep_scrub":"32'110","last_deep_scrub_stamp":"2024-05-09T09:50:52.254022+0000","last_clean_scrub_stamp":"2024-05-09T09:50:52.254022+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:44:38.690119+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":456,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:43.906635+0000","last_change":"2024-05-09T09:50:43.906635+0000","last_active":"2024-05-09T09:50:43.906635+0000","last_peered":"2024-05-09T09:50:43.906635+0000","last_clean":"2024-05-09T09:50:43.906635+0000","last_became_active":"2024-05-09T09:47:20.242448+0000","last_became_peered":"2024-05-09T09:47:20.242448+0000","last_unstale":"2024-05-09T09:50:43.906635+0000","last_undegraded":"2024-05-09T09:50:43.906635+0000","last_fullsized":"2024-05-09T09:50:43.906635+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:43.906506+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:43.906506+0000","last_clean_scrub_stamp":"2024-05-09T09:50:43.906506+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:08.705575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:37.221338+0000","last_change":"2024-05-09T09:51:37.221338+0000","last_active":"2024-05-09T09:51:37.221338+0000","last_peered":"2024-05-09T09:51:37.221338+0000","last_clean":"2024-05-09T09:51:37.221338+0000","last_became_active":"2024-05-09T09:47:52.179059+0000","last_became_peered":"2024-05-09T09:47:52.179059+0000","last_unstale":"2024-05-09T09:51:37.221338+0000","last_undegraded":"2024-05-09T09:51:37.221338+0000","last_fullsized":"2024-05-09T09:51:37.221338+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:37.221094+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:37.221094+0000","last_clean_scrub_stamp":"2024-05-09T09:51:37.221094+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:00:23.913251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:21.280559+0000","last_change":"2024-05-09T09:51:21.280559+0000","last_active":"2024-05-09T09:51:21.280559+0000","last_peered":"2024-05-09T09:51:21.280559+0000","last_clean":"2024-05-09T09:51:21.280559+0000","last_became_active":"2024-05-09T09:47:12.205259+0000","last_became_peered":"2024-05-09T09:47:12.205259+0000","last_unstale":"2024-05-09T09:51:21.280559+0000","last_undegraded":"2024-05-09T09:51:21.280559+0000","last_fullsized":"2024-05-09T09:51:21.280559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:21.280309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:21.280309+0000","last_clean_scrub_stamp":"2024-05-09T09:51:21.280309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:51:16.377558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:02.242526+0000","last_change":"2024-05-09T09:51:02.242526+0000","last_active":"2024-05-09T09:51:02.242526+0000","last_peered":"2024-05-09T09:51:02.242526+0000","last_clean":"2024-05-09T09:51:02.242526+0000","last_became_active":"2024-05-09T09:47:16.207404+0000","last_became_peered":"2024-05-09T09:47:16.207404+0000","last_unstale":"2024-05-09T09:51:02.242526+0000","last_undegraded":"2024-05-09T09:51:02.242526+0000","last_fullsized":"2024-05-09T09:51:02.242526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:02.242155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:02.242155+0000","last_clean_scrub_stamp":"2024-05-09T09:51:02.242155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:18:43.580003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'127","reported_seq":188,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:51.217030+0000","last_change":"2024-05-09T09:50:51.217030+0000","last_active":"2024-05-09T09:50:51.217030+0000","last_peered":"2024-05-09T09:50:51.217030+0000","last_clean":"2024-05-09T09:50:51.217030+0000","last_became_active":"2024-05-09T09:47:18.220596+0000","last_became_peered":"2024-05-09T09:47:18.220596+0000","last_unstale":"2024-05-09T09:50:51.217030+0000","last_undegraded":"2024-05-09T09:50:51.217030+0000","last_fullsized":"2024-05-09T09:50:51.217030+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'127","last_scrub_stamp":"2024-05-09T09:50:51.216776+0000","last_deep_scrub":"32'127","last_deep_scrub_stamp":"2024-05-09T09:50:51.216776+0000","last_clean_scrub_stamp":"2024-05-09T09:50:51.216776+0000","objects_scrubbed":9,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:52:10.006215+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":63,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:45.825646+0000","last_change":"2024-05-09T09:50:45.825646+0000","last_active":"2024-05-09T09:50:45.825646+0000","last_peered":"2024-05-09T09:50:45.825646+0000","last_clean":"2024-05-09T09:50:45.825646+0000","last_became_active":"2024-05-09T09:47:20.244839+0000","last_became_peered":"2024-05-09T09:47:20.244839+0000","last_unstale":"2024-05-09T09:50:45.825646+0000","last_undegraded":"2024-05-09T09:50:45.825646+0000","last_fullsized":"2024-05-09T09:50:45.825646+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:45.825370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:45.825370+0000","last_clean_scrub_stamp":"2024-05-09T09:50:45.825370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:33:58.430560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:35.203710+0000","last_change":"2024-05-09T09:51:35.203825+0000","last_active":"2024-05-09T09:51:35.203710+0000","last_peered":"2024-05-09T09:51:35.203710+0000","last_clean":"2024-05-09T09:51:35.203710+0000","last_became_active":"2024-05-09T09:47:22.235895+0000","last_became_peered":"2024-05-09T09:47:22.235895+0000","last_unstale":"2024-05-09T09:51:35.203710+0000","last_undegraded":"2024-05-09T09:51:35.203710+0000","last_fullsized":"2024-05-09T09:51:35.203710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-09T09:51:35.203402+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-09T09:51:35.203402+0000","last_clean_scrub_stamp":"2024-05-09T09:51:35.203402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:48:21.797553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:15.273289+0000","last_change":"2024-05-09T09:51:15.273289+0000","last_active":"2024-05-09T09:51:15.273289+0000","last_peered":"2024-05-09T09:51:15.273289+0000","last_clean":"2024-05-09T09:51:15.273289+0000","last_became_active":"2024-05-09T09:47:14.172275+0000","last_became_peered":"2024-05-09T09:47:14.172275+0000","last_unstale":"2024-05-09T09:51:15.273289+0000","last_undegraded":"2024-05-09T09:51:15.273289+0000","last_fullsized":"2024-05-09T09:51:15.273289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:15.273035+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:15.273035+0000","last_clean_scrub_stamp":"2024-05-09T09:51:15.273035+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:10:49.381052+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:11.412780+0000","last_change":"2024-05-09T09:51:11.412780+0000","last_active":"2024-05-09T09:51:11.412780+0000","last_peered":"2024-05-09T09:51:11.412780+0000","last_clean":"2024-05-09T09:51:11.412780+0000","last_became_active":"2024-05-09T09:47:12.209274+0000","last_became_peered":"2024-05-09T09:47:12.209274+0000","last_unstale":"2024-05-09T09:51:11.412780+0000","last_undegraded":"2024-05-09T09:51:11.412780+0000","last_fullsized":"2024-05-09T09:51:11.412780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:11.412502+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:11.412502+0000","last_clean_scrub_stamp":"2024-05-09T09:51:11.412502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:20:20.774039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:59.933420+0000","last_change":"2024-05-09T09:50:59.933420+0000","last_active":"2024-05-09T09:50:59.933420+0000","last_peered":"2024-05-09T09:50:59.933420+0000","last_clean":"2024-05-09T09:50:59.933420+0000","last_became_active":"2024-05-09T09:47:16.214484+0000","last_became_peered":"2024-05-09T09:47:16.214484+0000","last_unstale":"2024-05-09T09:50:59.933420+0000","last_undegraded":"2024-05-09T09:50:59.933420+0000","last_fullsized":"2024-05-09T09:50:59.933420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:59.933158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:59.933158+0000","last_clean_scrub_stamp":"2024-05-09T09:50:59.933158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:53.280118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'113","reported_seq":169,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:51.480062+0000","last_change":"2024-05-09T09:50:51.480062+0000","last_active":"2024-05-09T09:50:51.480062+0000","last_peered":"2024-05-09T09:50:51.480062+0000","last_clean":"2024-05-09T09:50:51.480062+0000","last_became_active":"2024-05-09T09:47:18.224815+0000","last_became_peered":"2024-05-09T09:47:18.224815+0000","last_unstale":"2024-05-09T09:50:51.480062+0000","last_undegraded":"2024-05-09T09:50:51.480062+0000","last_fullsized":"2024-05-09T09:50:51.480062+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'113","last_scrub_stamp":"2024-05-09T09:50:51.479757+0000","last_deep_scrub":"32'113","last_deep_scrub_stamp":"2024-05-09T09:50:51.479757+0000","last_clean_scrub_stamp":"2024-05-09T09:50:51.479757+0000","objects_scrubbed":4,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:05.084435+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":42,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:02.001194+0000","last_change":"2024-05-09T09:51:02.001194+0000","last_active":"2024-05-09T09:51:02.001194+0000","last_peered":"2024-05-09T09:51:02.001194+0000","last_clean":"2024-05-09T09:51:02.001194+0000","last_became_active":"2024-05-09T09:47:20.250686+0000","last_became_peered":"2024-05-09T09:47:20.250686+0000","last_unstale":"2024-05-09T09:51:02.001194+0000","last_undegraded":"2024-05-09T09:51:02.001194+0000","last_fullsized":"2024-05-09T09:51:02.001194+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:02.000873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:02.000873+0000","last_clean_scrub_stamp":"2024-05-09T09:51:02.000873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:10:46.269234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'18","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:41.194026+0000","last_change":"2024-05-09T09:51:41.194107+0000","last_active":"2024-05-09T09:51:41.194026+0000","last_peered":"2024-05-09T09:51:41.194026+0000","last_clean":"2024-05-09T09:51:41.194026+0000","last_became_active":"2024-05-09T09:47:22.255076+0000","last_became_peered":"2024-05-09T09:47:22.255076+0000","last_unstale":"2024-05-09T09:51:41.194026+0000","last_undegraded":"2024-05-09T09:51:41.194026+0000","last_fullsized":"2024-05-09T09:51:41.194026+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-05-09T09:51:41.193833+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-05-09T09:51:41.193833+0000","last_clean_scrub_stamp":"2024-05-09T09:51:41.193833+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:37:35.974545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":92,"num_read_kb":72,"num_write":55,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:16.427622+0000","last_change":"2024-05-09T09:51:16.427622+0000","last_active":"2024-05-09T09:51:16.427622+0000","last_peered":"2024-05-09T09:51:16.427622+0000","last_clean":"2024-05-09T09:51:16.427622+0000","last_became_active":"2024-05-09T09:47:14.180185+0000","last_became_peered":"2024-05-09T09:47:14.180185+0000","last_unstale":"2024-05-09T09:51:16.427622+0000","last_undegraded":"2024-05-09T09:51:16.427622+0000","last_fullsized":"2024-05-09T09:51:16.427622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-09T09:51:16.427325+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-09T09:51:16.427325+0000","last_clean_scrub_stamp":"2024-05-09T09:51:16.427325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:25:28.601825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:43.556517+0000","last_change":"2024-05-09T09:51:43.556517+0000","last_active":"2024-05-09T09:51:43.556517+0000","last_peered":"2024-05-09T09:51:43.556517+0000","last_clean":"2024-05-09T09:51:43.556517+0000","last_became_active":"2024-05-09T09:47:12.207751+0000","last_became_peered":"2024-05-09T09:47:12.207751+0000","last_unstale":"2024-05-09T09:51:43.556517+0000","last_undegraded":"2024-05-09T09:51:43.556517+0000","last_fullsized":"2024-05-09T09:51:43.556517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:43.556242+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:43.556242+0000","last_clean_scrub_stamp":"2024-05-09T09:51:43.556242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:46:00.404161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:04.040606+0000","last_change":"2024-05-09T09:51:04.040606+0000","last_active":"2024-05-09T09:51:04.040606+0000","last_peered":"2024-05-09T09:51:04.040606+0000","last_clean":"2024-05-09T09:51:04.040606+0000","last_became_active":"2024-05-09T09:47:16.207734+0000","last_became_peered":"2024-05-09T09:47:16.207734+0000","last_unstale":"2024-05-09T09:51:04.040606+0000","last_undegraded":"2024-05-09T09:51:04.040606+0000","last_fullsized":"2024-05-09T09:51:04.040606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:04.040339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:04.040339+0000","last_clean_scrub_stamp":"2024-05-09T09:51:04.040339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:34:42.732867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'119","reported_seq":178,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:47.428281+0000","last_change":"2024-05-09T09:50:47.428281+0000","last_active":"2024-05-09T09:50:47.428281+0000","last_peered":"2024-05-09T09:50:47.428281+0000","last_clean":"2024-05-09T09:50:47.428281+0000","last_became_active":"2024-05-09T09:47:18.230440+0000","last_became_peered":"2024-05-09T09:47:18.230440+0000","last_unstale":"2024-05-09T09:50:47.428281+0000","last_undegraded":"2024-05-09T09:50:47.428281+0000","last_fullsized":"2024-05-09T09:50:47.428281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-05-09T09:50:47.427971+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-05-09T09:50:47.427971+0000","last_clean_scrub_stamp":"2024-05-09T09:50:47.427971+0000","objects_scrubbed":7,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:24:59.602471+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":363,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:10.066212+0000","last_change":"2024-05-09T09:51:10.066212+0000","last_active":"2024-05-09T09:51:10.066212+0000","last_peered":"2024-05-09T09:51:10.066212+0000","last_clean":"2024-05-09T09:51:10.066212+0000","last_became_active":"2024-05-09T09:47:20.254305+0000","last_became_peered":"2024-05-09T09:47:20.254305+0000","last_unstale":"2024-05-09T09:51:10.066212+0000","last_undegraded":"2024-05-09T09:51:10.066212+0000","last_fullsized":"2024-05-09T09:51:10.066212+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:51:10.065958+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:51:10.065958+0000","last_clean_scrub_stamp":"2024-05-09T09:51:10.065958+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:04:57.527887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:43.274116+0000","last_change":"2024-05-09T09:51:43.274116+0000","last_active":"2024-05-09T09:51:43.274116+0000","last_peered":"2024-05-09T09:51:43.274116+0000","last_clean":"2024-05-09T09:51:43.274116+0000","last_became_active":"2024-05-09T09:47:22.239262+0000","last_became_peered":"2024-05-09T09:47:22.239262+0000","last_unstale":"2024-05-09T09:51:43.274116+0000","last_undegraded":"2024-05-09T09:51:43.274116+0000","last_fullsized":"2024-05-09T09:51:43.274116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:43.273853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:43.273853+0000","last_clean_scrub_stamp":"2024-05-09T09:51:43.273853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:15:17.167906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'8","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:20.323048+0000","last_change":"2024-05-09T09:51:20.323048+0000","last_active":"2024-05-09T09:51:20.323048+0000","last_peered":"2024-05-09T09:51:20.323048+0000","last_clean":"2024-05-09T09:51:20.323048+0000","last_became_active":"2024-05-09T09:47:14.184593+0000","last_became_peered":"2024-05-09T09:47:14.184593+0000","last_unstale":"2024-05-09T09:51:20.323048+0000","last_undegraded":"2024-05-09T09:51:20.323048+0000","last_fullsized":"2024-05-09T09:51:20.323048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:20.322811+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:20.322811+0000","last_clean_scrub_stamp":"2024-05-09T09:51:20.322811+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:33.927489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:45.521499+0000","last_change":"2024-05-09T09:51:45.521653+0000","last_active":"2024-05-09T09:51:45.521499+0000","last_peered":"2024-05-09T09:51:45.521499+0000","last_clean":"2024-05-09T09:51:45.521499+0000","last_became_active":"2024-05-09T09:47:12.207403+0000","last_became_peered":"2024-05-09T09:47:12.207403+0000","last_unstale":"2024-05-09T09:51:45.521499+0000","last_undegraded":"2024-05-09T09:51:45.521499+0000","last_fullsized":"2024-05-09T09:51:45.521499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:45.521234+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:45.521234+0000","last_clean_scrub_stamp":"2024-05-09T09:51:45.521234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:42:59.600820+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":16,"num_write_kb":8838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:58.967885+0000","last_change":"2024-05-09T09:50:58.967885+0000","last_active":"2024-05-09T09:50:58.967885+0000","last_peered":"2024-05-09T09:50:58.967885+0000","last_clean":"2024-05-09T09:50:58.967885+0000","last_became_active":"2024-05-09T09:47:16.214607+0000","last_became_peered":"2024-05-09T09:47:16.214607+0000","last_unstale":"2024-05-09T09:50:58.967885+0000","last_undegraded":"2024-05-09T09:50:58.967885+0000","last_fullsized":"2024-05-09T09:50:58.967885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:58.967631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:58.967631+0000","last_clean_scrub_stamp":"2024-05-09T09:50:58.967631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:20.934359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'212","reported_seq":286,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:45.413815+0000","last_change":"2024-05-09T09:50:45.413815+0000","last_active":"2024-05-09T09:50:45.413815+0000","last_peered":"2024-05-09T09:50:45.413815+0000","last_clean":"2024-05-09T09:50:45.413815+0000","last_became_active":"2024-05-09T09:47:18.224893+0000","last_became_peered":"2024-05-09T09:47:18.224893+0000","last_unstale":"2024-05-09T09:50:45.413815+0000","last_undegraded":"2024-05-09T09:50:45.413815+0000","last_fullsized":"2024-05-09T09:50:45.413815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'212","last_scrub_stamp":"2024-05-09T09:50:45.413522+0000","last_deep_scrub":"32'212","last_deep_scrub_stamp":"2024-05-09T09:50:45.413522+0000","last_clean_scrub_stamp":"2024-05-09T09:50:45.413522+0000","objects_scrubbed":5,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:59:04.534534+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:46.831580+0000","last_change":"2024-05-09T09:50:46.831580+0000","last_active":"2024-05-09T09:50:46.831580+0000","last_peered":"2024-05-09T09:50:46.831580+0000","last_clean":"2024-05-09T09:50:46.831580+0000","last_became_active":"2024-05-09T09:47:20.228339+0000","last_became_peered":"2024-05-09T09:47:20.228339+0000","last_unstale":"2024-05-09T09:50:46.831580+0000","last_undegraded":"2024-05-09T09:50:46.831580+0000","last_fullsized":"2024-05-09T09:50:46.831580+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:46.831331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:46.831331+0000","last_clean_scrub_stamp":"2024-05-09T09:50:46.831331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:58:25.885349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'21","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:41.346917+0000","last_change":"2024-05-09T09:51:41.346917+0000","last_active":"2024-05-09T09:51:41.346917+0000","last_peered":"2024-05-09T09:51:41.346917+0000","last_clean":"2024-05-09T09:51:41.346917+0000","last_became_active":"2024-05-09T09:47:22.229193+0000","last_became_peered":"2024-05-09T09:47:22.229193+0000","last_unstale":"2024-05-09T09:51:41.346917+0000","last_undegraded":"2024-05-09T09:51:41.346917+0000","last_fullsized":"2024-05-09T09:51:41.346917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-05-09T09:51:41.346645+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-05-09T09:51:41.346645+0000","last_clean_scrub_stamp":"2024-05-09T09:51:41.346645+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:35.992222+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'8","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:24.268882+0000","last_change":"2024-05-09T09:51:24.268882+0000","last_active":"2024-05-09T09:51:24.268882+0000","last_peered":"2024-05-09T09:51:24.268882+0000","last_clean":"2024-05-09T09:51:24.268882+0000","last_became_active":"2024-05-09T09:47:14.176717+0000","last_became_peered":"2024-05-09T09:47:14.176717+0000","last_unstale":"2024-05-09T09:51:24.268882+0000","last_undegraded":"2024-05-09T09:51:24.268882+0000","last_fullsized":"2024-05-09T09:51:24.268882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:24.268609+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:24.268609+0000","last_clean_scrub_stamp":"2024-05-09T09:51:24.268609+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:03:06.524381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:29.294901+0000","last_change":"2024-05-09T09:51:29.294901+0000","last_active":"2024-05-09T09:51:29.294901+0000","last_peered":"2024-05-09T09:51:29.294901+0000","last_clean":"2024-05-09T09:51:29.294901+0000","last_became_active":"2024-05-09T09:47:12.204317+0000","last_became_peered":"2024-05-09T09:47:12.204317+0000","last_unstale":"2024-05-09T09:51:29.294901+0000","last_undegraded":"2024-05-09T09:51:29.294901+0000","last_fullsized":"2024-05-09T09:51:29.294901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:29.294653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:29.294653+0000","last_clean_scrub_stamp":"2024-05-09T09:51:29.294653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:40:22.840115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:01.269646+0000","last_change":"2024-05-09T09:51:01.269646+0000","last_active":"2024-05-09T09:51:01.269646+0000","last_peered":"2024-05-09T09:51:01.269646+0000","last_clean":"2024-05-09T09:51:01.269646+0000","last_became_active":"2024-05-09T09:47:16.197031+0000","last_became_peered":"2024-05-09T09:47:16.197031+0000","last_unstale":"2024-05-09T09:51:01.269646+0000","last_undegraded":"2024-05-09T09:51:01.269646+0000","last_fullsized":"2024-05-09T09:51:01.269646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:01.269403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:01.269403+0000","last_clean_scrub_stamp":"2024-05-09T09:51:01.269403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:20:09.570821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'113","reported_seq":170,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:46.341361+0000","last_change":"2024-05-09T09:50:46.341361+0000","last_active":"2024-05-09T09:50:46.341361+0000","last_peered":"2024-05-09T09:50:46.341361+0000","last_clean":"2024-05-09T09:50:46.341361+0000","last_became_active":"2024-05-09T09:47:18.215793+0000","last_became_peered":"2024-05-09T09:47:18.215793+0000","last_unstale":"2024-05-09T09:50:46.341361+0000","last_undegraded":"2024-05-09T09:50:46.341361+0000","last_fullsized":"2024-05-09T09:50:46.341361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'113","last_scrub_stamp":"2024-05-09T09:50:46.341062+0000","last_deep_scrub":"32'113","last_deep_scrub_stamp":"2024-05-09T09:50:46.341062+0000","last_clean_scrub_stamp":"2024-05-09T09:50:46.341062+0000","objects_scrubbed":5,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:24:06.850096+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:05.480782+0000","last_change":"2024-05-09T09:51:05.480782+0000","last_active":"2024-05-09T09:51:05.480782+0000","last_peered":"2024-05-09T09:51:05.480782+0000","last_clean":"2024-05-09T09:51:05.480782+0000","last_became_active":"2024-05-09T09:47:20.250363+0000","last_became_peered":"2024-05-09T09:47:20.250363+0000","last_unstale":"2024-05-09T09:51:05.480782+0000","last_undegraded":"2024-05-09T09:51:05.480782+0000","last_fullsized":"2024-05-09T09:51:05.480782+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:05.480520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:05.480520+0000","last_clean_scrub_stamp":"2024-05-09T09:51:05.480520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:07:46.310851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:19.416370+0000","last_change":"2024-05-09T09:51:19.416370+0000","last_active":"2024-05-09T09:51:19.416370+0000","last_peered":"2024-05-09T09:51:19.416370+0000","last_clean":"2024-05-09T09:51:19.416370+0000","last_became_active":"2024-05-09T09:47:22.242410+0000","last_became_peered":"2024-05-09T09:47:22.242410+0000","last_unstale":"2024-05-09T09:51:19.416370+0000","last_undegraded":"2024-05-09T09:51:19.416370+0000","last_fullsized":"2024-05-09T09:51:19.416370+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:19.416094+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:19.416094+0000","last_clean_scrub_stamp":"2024-05-09T09:51:19.416094+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:58.738776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:17.471951+0000","last_change":"2024-05-09T09:51:17.471951+0000","last_active":"2024-05-09T09:51:17.471951+0000","last_peered":"2024-05-09T09:51:17.471951+0000","last_clean":"2024-05-09T09:51:17.471951+0000","last_became_active":"2024-05-09T09:47:14.190016+0000","last_became_peered":"2024-05-09T09:47:14.190016+0000","last_unstale":"2024-05-09T09:51:17.471951+0000","last_undegraded":"2024-05-09T09:51:17.471951+0000","last_fullsized":"2024-05-09T09:51:17.471951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:17.471525+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:17.471525+0000","last_clean_scrub_stamp":"2024-05-09T09:51:17.471525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:24:31.781883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:49.477452+0000","last_change":"2024-05-09T09:51:49.477516+0000","last_active":"2024-05-09T09:51:49.477452+0000","last_peered":"2024-05-09T09:51:49.477452+0000","last_clean":"2024-05-09T09:51:49.477452+0000","last_became_active":"2024-05-09T09:47:12.211221+0000","last_became_peered":"2024-05-09T09:47:12.211221+0000","last_unstale":"2024-05-09T09:51:49.477452+0000","last_undegraded":"2024-05-09T09:51:49.477452+0000","last_fullsized":"2024-05-09T09:51:49.477452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:49.477255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:49.477255+0000","last_clean_scrub_stamp":"2024-05-09T09:51:49.477255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:13:32.253186+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:00.977458+0000","last_change":"2024-05-09T09:51:00.977458+0000","last_active":"2024-05-09T09:51:00.977458+0000","last_peered":"2024-05-09T09:51:00.977458+0000","last_clean":"2024-05-09T09:51:00.977458+0000","last_became_active":"2024-05-09T09:47:16.214462+0000","last_became_peered":"2024-05-09T09:47:16.214462+0000","last_unstale":"2024-05-09T09:51:00.977458+0000","last_undegraded":"2024-05-09T09:51:00.977458+0000","last_fullsized":"2024-05-09T09:51:00.977458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:00.977167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:00.977167+0000","last_clean_scrub_stamp":"2024-05-09T09:51:00.977167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:59:20.098179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'119","reported_seq":178,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:57.261272+0000","last_change":"2024-05-09T09:50:57.261272+0000","last_active":"2024-05-09T09:50:57.261272+0000","last_peered":"2024-05-09T09:50:57.261272+0000","last_clean":"2024-05-09T09:50:57.261272+0000","last_became_active":"2024-05-09T09:47:18.212543+0000","last_became_peered":"2024-05-09T09:47:18.212543+0000","last_unstale":"2024-05-09T09:50:57.261272+0000","last_undegraded":"2024-05-09T09:50:57.261272+0000","last_fullsized":"2024-05-09T09:50:57.261272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-05-09T09:50:57.261002+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-05-09T09:50:57.261002+0000","last_clean_scrub_stamp":"2024-05-09T09:50:57.261002+0000","objects_scrubbed":7,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:26:30.185703+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":446,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:45.121680+0000","last_change":"2024-05-09T09:50:45.121680+0000","last_active":"2024-05-09T09:50:45.121680+0000","last_peered":"2024-05-09T09:50:45.121680+0000","last_clean":"2024-05-09T09:50:45.121680+0000","last_became_active":"2024-05-09T09:47:20.240236+0000","last_became_peered":"2024-05-09T09:47:20.240236+0000","last_unstale":"2024-05-09T09:50:45.121680+0000","last_undegraded":"2024-05-09T09:50:45.121680+0000","last_fullsized":"2024-05-09T09:50:45.121680+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:45.121417+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:45.121417+0000","last_clean_scrub_stamp":"2024-05-09T09:50:45.121417+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:31:47.109285+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'15","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:46.269523+0000","last_change":"2024-05-09T09:51:46.269599+0000","last_active":"2024-05-09T09:51:46.269523+0000","last_peered":"2024-05-09T09:51:46.269523+0000","last_clean":"2024-05-09T09:51:46.269523+0000","last_became_active":"2024-05-09T09:47:22.257986+0000","last_became_peered":"2024-05-09T09:47:22.257986+0000","last_unstale":"2024-05-09T09:51:46.269523+0000","last_undegraded":"2024-05-09T09:51:46.269523+0000","last_fullsized":"2024-05-09T09:51:46.269523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-09T09:51:46.269334+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-09T09:51:46.269334+0000","last_clean_scrub_stamp":"2024-05-09T09:51:46.269334+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:07:45.149305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'6","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:09.379305+0000","last_change":"2024-05-09T09:51:09.379305+0000","last_active":"2024-05-09T09:51:09.379305+0000","last_peered":"2024-05-09T09:51:09.379305+0000","last_clean":"2024-05-09T09:51:09.379305+0000","last_became_active":"2024-05-09T09:47:14.171963+0000","last_became_peered":"2024-05-09T09:47:14.171963+0000","last_unstale":"2024-05-09T09:51:09.379305+0000","last_undegraded":"2024-05-09T09:51:09.379305+0000","last_fullsized":"2024-05-09T09:51:09.379305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:09.379053+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:09.379053+0000","last_clean_scrub_stamp":"2024-05-09T09:51:09.379053+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:57:44.240122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:41.549977+0000","last_change":"2024-05-09T09:51:41.550037+0000","last_active":"2024-05-09T09:51:41.549977+0000","last_peered":"2024-05-09T09:51:41.549977+0000","last_clean":"2024-05-09T09:51:41.549977+0000","last_became_active":"2024-05-09T09:47:12.204519+0000","last_became_peered":"2024-05-09T09:47:12.204519+0000","last_unstale":"2024-05-09T09:51:41.549977+0000","last_undegraded":"2024-05-09T09:51:41.549977+0000","last_fullsized":"2024-05-09T09:51:41.549977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:41.549759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:41.549759+0000","last_clean_scrub_stamp":"2024-05-09T09:51:41.549759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:37:31.414388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":429,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:55.290590+0000","last_change":"2024-05-09T09:50:55.290590+0000","last_active":"2024-05-09T09:50:55.290590+0000","last_peered":"2024-05-09T09:50:55.290590+0000","last_clean":"2024-05-09T09:50:55.290590+0000","last_became_active":"2024-05-09T09:47:16.210812+0000","last_became_peered":"2024-05-09T09:47:16.210812+0000","last_unstale":"2024-05-09T09:50:55.290590+0000","last_undegraded":"2024-05-09T09:50:55.290590+0000","last_fullsized":"2024-05-09T09:50:55.290590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-09T09:50:55.290303+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-09T09:50:55.290303+0000","last_clean_scrub_stamp":"2024-05-09T09:50:55.290303+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:23:31.095926+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:46.428614+0000","last_change":"2024-05-09T09:50:46.428614+0000","last_active":"2024-05-09T09:50:46.428614+0000","last_peered":"2024-05-09T09:50:46.428614+0000","last_clean":"2024-05-09T09:50:46.428614+0000","last_became_active":"2024-05-09T09:47:18.224565+0000","last_became_peered":"2024-05-09T09:47:18.224565+0000","last_unstale":"2024-05-09T09:50:46.428614+0000","last_undegraded":"2024-05-09T09:50:46.428614+0000","last_fullsized":"2024-05-09T09:50:46.428614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-09T09:50:46.428349+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-09T09:50:46.428349+0000","last_clean_scrub_stamp":"2024-05-09T09:50:46.428349+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:10:30.696710+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":483,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.298675+0000","last_change":"2024-05-09T09:50:44.298675+0000","last_active":"2024-05-09T09:50:44.298675+0000","last_peered":"2024-05-09T09:50:44.298675+0000","last_clean":"2024-05-09T09:50:44.298675+0000","last_became_active":"2024-05-09T09:47:20.214337+0000","last_became_peered":"2024-05-09T09:47:20.214337+0000","last_unstale":"2024-05-09T09:50:44.298675+0000","last_undegraded":"2024-05-09T09:50:44.298675+0000","last_fullsized":"2024-05-09T09:50:44.298675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:44.298414+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:44.298414+0000","last_clean_scrub_stamp":"2024-05-09T09:50:44.298414+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:00:15.815268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:06.322785+0000","last_change":"2024-05-09T09:51:06.322785+0000","last_active":"2024-05-09T09:51:06.322785+0000","last_peered":"2024-05-09T09:51:06.322785+0000","last_clean":"2024-05-09T09:51:06.322785+0000","last_became_active":"2024-05-09T09:47:22.233796+0000","last_became_peered":"2024-05-09T09:47:22.233796+0000","last_unstale":"2024-05-09T09:51:06.322785+0000","last_undegraded":"2024-05-09T09:51:06.322785+0000","last_fullsized":"2024-05-09T09:51:06.322785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:06.322504+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:06.322504+0000","last_clean_scrub_stamp":"2024-05-09T09:51:06.322504+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:27:55.927227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:22.290052+0000","last_change":"2024-05-09T09:51:22.290052+0000","last_active":"2024-05-09T09:51:22.290052+0000","last_peered":"2024-05-09T09:51:22.290052+0000","last_clean":"2024-05-09T09:51:22.290052+0000","last_became_active":"2024-05-09T09:47:14.174707+0000","last_became_peered":"2024-05-09T09:47:14.174707+0000","last_unstale":"2024-05-09T09:51:22.290052+0000","last_undegraded":"2024-05-09T09:51:22.290052+0000","last_fullsized":"2024-05-09T09:51:22.290052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:22.289757+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:22.289757+0000","last_clean_scrub_stamp":"2024-05-09T09:51:22.289757+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:39:44.166060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:40.589993+0000","last_change":"2024-05-09T09:51:40.590058+0000","last_active":"2024-05-09T09:51:40.589993+0000","last_peered":"2024-05-09T09:51:40.589993+0000","last_clean":"2024-05-09T09:51:40.589993+0000","last_became_active":"2024-05-09T09:47:12.207874+0000","last_became_peered":"2024-05-09T09:47:12.207874+0000","last_unstale":"2024-05-09T09:51:40.589993+0000","last_undegraded":"2024-05-09T09:51:40.589993+0000","last_fullsized":"2024-05-09T09:51:40.589993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:40.589802+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:40.589802+0000","last_clean_scrub_stamp":"2024-05-09T09:51:40.589802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:23:01.386163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"32'2","reported_seq":231,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:48.457964+0000","last_change":"2024-05-09T09:50:48.457964+0000","last_active":"2024-05-09T09:50:48.457964+0000","last_peered":"2024-05-09T09:50:48.457964+0000","last_clean":"2024-05-09T09:50:48.457964+0000","last_became_active":"2024-05-09T09:47:16.204577+0000","last_became_peered":"2024-05-09T09:47:16.204577+0000","last_unstale":"2024-05-09T09:50:48.457964+0000","last_undegraded":"2024-05-09T09:50:48.457964+0000","last_fullsized":"2024-05-09T09:50:48.457964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:50:48.457704+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:50:48.457704+0000","last_clean_scrub_stamp":"2024-05-09T09:50:48.457704+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:20:14.267139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'122","reported_seq":182,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:50.360866+0000","last_change":"2024-05-09T09:50:50.360866+0000","last_active":"2024-05-09T09:50:50.360866+0000","last_peered":"2024-05-09T09:50:50.360866+0000","last_clean":"2024-05-09T09:50:50.360866+0000","last_became_active":"2024-05-09T09:47:18.204057+0000","last_became_peered":"2024-05-09T09:47:18.204057+0000","last_unstale":"2024-05-09T09:50:50.360866+0000","last_undegraded":"2024-05-09T09:50:50.360866+0000","last_fullsized":"2024-05-09T09:50:50.360866+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'122","last_scrub_stamp":"2024-05-09T09:50:50.360552+0000","last_deep_scrub":"32'122","last_deep_scrub_stamp":"2024-05-09T09:50:50.360552+0000","last_clean_scrub_stamp":"2024-05-09T09:50:50.360552+0000","objects_scrubbed":8,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:58:29.414570+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:50.194527+0000","last_change":"2024-05-09T09:50:50.194527+0000","last_active":"2024-05-09T09:50:50.194527+0000","last_peered":"2024-05-09T09:50:50.194527+0000","last_clean":"2024-05-09T09:50:50.194527+0000","last_became_active":"2024-05-09T09:47:20.255477+0000","last_became_peered":"2024-05-09T09:47:20.255477+0000","last_unstale":"2024-05-09T09:50:50.194527+0000","last_undegraded":"2024-05-09T09:50:50.194527+0000","last_fullsized":"2024-05-09T09:50:50.194527+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:50.194227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:50.194227+0000","last_clean_scrub_stamp":"2024-05-09T09:50:50.194227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:40:06.186113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'9","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:08.256156+0000","last_change":"2024-05-09T09:51:08.256156+0000","last_active":"2024-05-09T09:51:08.256156+0000","last_peered":"2024-05-09T09:51:08.256156+0000","last_clean":"2024-05-09T09:51:08.256156+0000","last_became_active":"2024-05-09T09:47:22.227373+0000","last_became_peered":"2024-05-09T09:47:22.227373+0000","last_unstale":"2024-05-09T09:51:08.256156+0000","last_undegraded":"2024-05-09T09:51:08.256156+0000","last_fullsized":"2024-05-09T09:51:08.256156+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-09T09:51:08.255859+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-09T09:51:08.255859+0000","last_clean_scrub_stamp":"2024-05-09T09:51:08.255859+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:01:16.321404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:18.453848+0000","last_change":"2024-05-09T09:51:18.453848+0000","last_active":"2024-05-09T09:51:18.453848+0000","last_peered":"2024-05-09T09:51:18.453848+0000","last_clean":"2024-05-09T09:51:18.453848+0000","last_became_active":"2024-05-09T09:47:14.189623+0000","last_became_peered":"2024-05-09T09:47:14.189623+0000","last_unstale":"2024-05-09T09:51:18.453848+0000","last_undegraded":"2024-05-09T09:51:18.453848+0000","last_fullsized":"2024-05-09T09:51:18.453848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:18.453472+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:18.453472+0000","last_clean_scrub_stamp":"2024-05-09T09:51:18.453472+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:21:19.357961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":214,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:30.280676+0000","last_change":"2024-05-09T09:51:30.280748+0000","last_active":"2024-05-09T09:51:30.280676+0000","last_peered":"2024-05-09T09:51:30.280676+0000","last_clean":"2024-05-09T09:51:30.280676+0000","last_became_active":"2024-05-09T09:46:57.508178+0000","last_became_peered":"2024-05-09T09:46:57.508178+0000","last_unstale":"2024-05-09T09:51:30.280676+0000","last_undegraded":"2024-05-09T09:51:30.280676+0000","last_fullsized":"2024-05-09T09:51:30.280676+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-05-09T09:51:30.280470+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-05-09T09:51:30.280470+0000","last_clean_scrub_stamp":"2024-05-09T09:51:30.280470+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:25.211383+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:56.442302+0000","last_change":"2024-05-09T09:51:56.442362+0000","last_active":"2024-05-09T09:51:56.442302+0000","last_peered":"2024-05-09T09:51:56.442302+0000","last_clean":"2024-05-09T09:51:56.442302+0000","last_became_active":"2024-05-09T09:47:03.053783+0000","last_became_peered":"2024-05-09T09:47:03.053783+0000","last_unstale":"2024-05-09T09:51:56.442302+0000","last_undegraded":"2024-05-09T09:51:56.442302+0000","last_fullsized":"2024-05-09T09:51:56.442302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:56.442092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:56.442092+0000","last_clean_scrub_stamp":"2024-05-09T09:51:56.442092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:09:15.752316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:36.494378+0000","last_change":"2024-05-09T09:51:36.494436+0000","last_active":"2024-05-09T09:51:36.494378+0000","last_peered":"2024-05-09T09:51:36.494378+0000","last_clean":"2024-05-09T09:51:36.494378+0000","last_became_active":"2024-05-09T09:47:12.211344+0000","last_became_peered":"2024-05-09T09:47:12.211344+0000","last_unstale":"2024-05-09T09:51:36.494378+0000","last_undegraded":"2024-05-09T09:51:36.494378+0000","last_fullsized":"2024-05-09T09:51:36.494378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:36.494172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:36.494172+0000","last_clean_scrub_stamp":"2024-05-09T09:51:36.494172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:44:27.630619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:57.277911+0000","last_change":"2024-05-09T09:50:57.277911+0000","last_active":"2024-05-09T09:50:57.277911+0000","last_peered":"2024-05-09T09:50:57.277911+0000","last_clean":"2024-05-09T09:50:57.277911+0000","last_became_active":"2024-05-09T09:47:16.210404+0000","last_became_peered":"2024-05-09T09:47:16.210404+0000","last_unstale":"2024-05-09T09:50:57.277911+0000","last_undegraded":"2024-05-09T09:50:57.277911+0000","last_fullsized":"2024-05-09T09:50:57.277911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:57.277661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:57.277661+0000","last_clean_scrub_stamp":"2024-05-09T09:50:57.277661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:35:39.302436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'312","reported_seq":403,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:12.453446+0000","last_change":"2024-05-09T09:51:12.453446+0000","last_active":"2024-05-09T09:51:12.453446+0000","last_peered":"2024-05-09T09:51:12.453446+0000","last_clean":"2024-05-09T09:51:12.453446+0000","last_became_active":"2024-05-09T09:47:18.236370+0000","last_became_peered":"2024-05-09T09:47:18.236370+0000","last_unstale":"2024-05-09T09:51:12.453446+0000","last_undegraded":"2024-05-09T09:51:12.453446+0000","last_fullsized":"2024-05-09T09:51:12.453446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'312","last_scrub_stamp":"2024-05-09T09:51:12.453173+0000","last_deep_scrub":"32'312","last_deep_scrub_stamp":"2024-05-09T09:51:12.453173+0000","last_clean_scrub_stamp":"2024-05-09T09:51:12.453173+0000","objects_scrubbed":5,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:10:56.767720+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:53.880361+0000","last_change":"2024-05-09T09:50:53.880361+0000","last_active":"2024-05-09T09:50:53.880361+0000","last_peered":"2024-05-09T09:50:53.880361+0000","last_clean":"2024-05-09T09:50:53.880361+0000","last_became_active":"2024-05-09T09:47:20.250373+0000","last_became_peered":"2024-05-09T09:47:20.250373+0000","last_unstale":"2024-05-09T09:50:53.880361+0000","last_undegraded":"2024-05-09T09:50:53.880361+0000","last_fullsized":"2024-05-09T09:50:53.880361+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:53.880117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:53.880117+0000","last_clean_scrub_stamp":"2024-05-09T09:50:53.880117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:35:35.904892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'86","reported_seq":179,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:33.196489+0000","last_change":"2024-05-09T09:51:33.196489+0000","last_active":"2024-05-09T09:51:33.196489+0000","last_peered":"2024-05-09T09:51:33.196489+0000","last_clean":"2024-05-09T09:51:33.196489+0000","last_became_active":"2024-05-09T09:47:22.236267+0000","last_became_peered":"2024-05-09T09:47:22.236267+0000","last_unstale":"2024-05-09T09:51:33.196489+0000","last_undegraded":"2024-05-09T09:51:33.196489+0000","last_fullsized":"2024-05-09T09:51:33.196489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'86","last_scrub_stamp":"2024-05-09T09:51:33.196224+0000","last_deep_scrub":"32'86","last_deep_scrub_stamp":"2024-05-09T09:51:33.196224+0000","last_clean_scrub_stamp":"2024-05-09T09:51:33.196224+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:08:18.929286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":223,"num_write":170,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:28.500354+0000","last_change":"2024-05-09T09:51:28.500354+0000","last_active":"2024-05-09T09:51:28.500354+0000","last_peered":"2024-05-09T09:51:28.500354+0000","last_clean":"2024-05-09T09:51:28.500354+0000","last_became_active":"2024-05-09T09:47:14.185071+0000","last_became_peered":"2024-05-09T09:47:14.185071+0000","last_unstale":"2024-05-09T09:51:28.500354+0000","last_undegraded":"2024-05-09T09:51:28.500354+0000","last_fullsized":"2024-05-09T09:51:28.500354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:28.500075+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:28.500075+0000","last_clean_scrub_stamp":"2024-05-09T09:51:28.500075+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:15:02.394128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:54.446226+0000","last_change":"2024-05-09T09:51:54.446283+0000","last_active":"2024-05-09T09:51:54.446226+0000","last_peered":"2024-05-09T09:51:54.446226+0000","last_clean":"2024-05-09T09:51:54.446226+0000","last_became_active":"2024-05-09T09:47:03.050535+0000","last_became_peered":"2024-05-09T09:47:03.050535+0000","last_unstale":"2024-05-09T09:51:54.446226+0000","last_undegraded":"2024-05-09T09:51:54.446226+0000","last_fullsized":"2024-05-09T09:51:54.446226+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:54.446002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:54.446002+0000","last_clean_scrub_stamp":"2024-05-09T09:51:54.446002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:37:15.445620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"32'2","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:25.300854+0000","last_change":"2024-05-09T09:51:25.300917+0000","last_active":"2024-05-09T09:51:25.300854+0000","last_peered":"2024-05-09T09:51:25.300854+0000","last_clean":"2024-05-09T09:51:25.300854+0000","last_became_active":"2024-05-09T09:47:12.203494+0000","last_became_peered":"2024-05-09T09:47:12.203494+0000","last_unstale":"2024-05-09T09:51:25.300854+0000","last_undegraded":"2024-05-09T09:51:25.300854+0000","last_fullsized":"2024-05-09T09:51:25.300854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:25.300654+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:25.300654+0000","last_clean_scrub_stamp":"2024-05-09T09:51:25.300654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:34.501747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:50.508773+0000","last_change":"2024-05-09T09:50:50.508773+0000","last_active":"2024-05-09T09:50:50.508773+0000","last_peered":"2024-05-09T09:50:50.508773+0000","last_clean":"2024-05-09T09:50:50.508773+0000","last_became_active":"2024-05-09T09:47:16.200369+0000","last_became_peered":"2024-05-09T09:47:16.200369+0000","last_unstale":"2024-05-09T09:50:50.508773+0000","last_undegraded":"2024-05-09T09:50:50.508773+0000","last_fullsized":"2024-05-09T09:50:50.508773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:50.508517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:50.508517+0000","last_clean_scrub_stamp":"2024-05-09T09:50:50.508517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:03:35.673628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'512","reported_seq":740,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:45.298265+0000","last_change":"2024-05-09T09:50:45.298265+0000","last_active":"2024-05-09T09:50:45.298265+0000","last_peered":"2024-05-09T09:50:45.298265+0000","last_clean":"2024-05-09T09:50:45.298265+0000","last_became_active":"2024-05-09T09:47:18.219321+0000","last_became_peered":"2024-05-09T09:47:18.219321+0000","last_unstale":"2024-05-09T09:50:45.298265+0000","last_undegraded":"2024-05-09T09:50:45.298265+0000","last_fullsized":"2024-05-09T09:50:45.298265+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'512","last_scrub_stamp":"2024-05-09T09:50:45.297859+0000","last_deep_scrub":"32'512","last_deep_scrub_stamp":"2024-05-09T09:50:45.297859+0000","last_clean_scrub_stamp":"2024-05-09T09:50:45.297859+0000","objects_scrubbed":10,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:39:29.985192+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:09.466226+0000","last_change":"2024-05-09T09:51:09.466226+0000","last_active":"2024-05-09T09:51:09.466226+0000","last_peered":"2024-05-09T09:51:09.466226+0000","last_clean":"2024-05-09T09:51:09.466226+0000","last_became_active":"2024-05-09T09:47:20.249089+0000","last_became_peered":"2024-05-09T09:47:20.249089+0000","last_unstale":"2024-05-09T09:51:09.466226+0000","last_undegraded":"2024-05-09T09:51:09.466226+0000","last_fullsized":"2024-05-09T09:51:09.466226+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:09.465983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:09.465983+0000","last_clean_scrub_stamp":"2024-05-09T09:51:09.465983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:24:45.606721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:39.199321+0000","last_change":"2024-05-09T09:51:39.199321+0000","last_active":"2024-05-09T09:51:39.199321+0000","last_peered":"2024-05-09T09:51:39.199321+0000","last_clean":"2024-05-09T09:51:39.199321+0000","last_became_active":"2024-05-09T09:47:22.244543+0000","last_became_peered":"2024-05-09T09:47:22.244543+0000","last_unstale":"2024-05-09T09:51:39.199321+0000","last_undegraded":"2024-05-09T09:51:39.199321+0000","last_fullsized":"2024-05-09T09:51:39.199321+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-09T09:51:39.199047+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-09T09:51:39.199047+0000","last_clean_scrub_stamp":"2024-05-09T09:51:39.199047+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:02:01.713821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:24.273042+0000","last_change":"2024-05-09T09:51:24.273042+0000","last_active":"2024-05-09T09:51:24.273042+0000","last_peered":"2024-05-09T09:51:24.273042+0000","last_clean":"2024-05-09T09:51:24.273042+0000","last_became_active":"2024-05-09T09:47:14.173959+0000","last_became_peered":"2024-05-09T09:47:14.173959+0000","last_unstale":"2024-05-09T09:51:24.273042+0000","last_undegraded":"2024-05-09T09:51:24.273042+0000","last_fullsized":"2024-05-09T09:51:24.273042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:24.272797+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:24.272797+0000","last_clean_scrub_stamp":"2024-05-09T09:51:24.272797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:25:00.413535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:24.266143+0000","last_change":"2024-05-09T09:51:24.266195+0000","last_active":"2024-05-09T09:51:24.266143+0000","last_peered":"2024-05-09T09:51:24.266143+0000","last_clean":"2024-05-09T09:51:24.266143+0000","last_became_active":"2024-05-09T09:47:03.052185+0000","last_became_peered":"2024-05-09T09:47:03.052185+0000","last_unstale":"2024-05-09T09:51:24.266143+0000","last_undegraded":"2024-05-09T09:51:24.266143+0000","last_fullsized":"2024-05-09T09:51:24.266143+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:24.265972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:24.265972+0000","last_clean_scrub_stamp":"2024-05-09T09:51:24.265972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:24.371116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:38.333595+0000","last_change":"2024-05-09T09:51:38.333664+0000","last_active":"2024-05-09T09:51:38.333595+0000","last_peered":"2024-05-09T09:51:38.333595+0000","last_clean":"2024-05-09T09:51:38.333595+0000","last_became_active":"2024-05-09T09:47:12.183846+0000","last_became_peered":"2024-05-09T09:47:12.183846+0000","last_unstale":"2024-05-09T09:51:38.333595+0000","last_undegraded":"2024-05-09T09:51:38.333595+0000","last_fullsized":"2024-05-09T09:51:38.333595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:38.333371+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:38.333371+0000","last_clean_scrub_stamp":"2024-05-09T09:51:38.333371+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:06:28.044996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:00.281973+0000","last_change":"2024-05-09T09:51:00.281973+0000","last_active":"2024-05-09T09:51:00.281973+0000","last_peered":"2024-05-09T09:51:00.281973+0000","last_clean":"2024-05-09T09:51:00.281973+0000","last_became_active":"2024-05-09T09:47:16.197380+0000","last_became_peered":"2024-05-09T09:47:16.197380+0000","last_unstale":"2024-05-09T09:51:00.281973+0000","last_undegraded":"2024-05-09T09:51:00.281973+0000","last_fullsized":"2024-05-09T09:51:00.281973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:00.281822+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:00.281822+0000","last_clean_scrub_stamp":"2024-05-09T09:51:00.281822+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:17:45.780390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'25","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:53.286054+0000","last_change":"2024-05-09T09:50:53.286054+0000","last_active":"2024-05-09T09:50:53.286054+0000","last_peered":"2024-05-09T09:50:53.286054+0000","last_clean":"2024-05-09T09:50:53.286054+0000","last_became_active":"2024-05-09T09:47:18.217023+0000","last_became_peered":"2024-05-09T09:47:18.217023+0000","last_unstale":"2024-05-09T09:50:53.286054+0000","last_undegraded":"2024-05-09T09:50:53.286054+0000","last_fullsized":"2024-05-09T09:50:53.286054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2024-05-09T09:50:53.285640+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2024-05-09T09:50:53.285640+0000","last_clean_scrub_stamp":"2024-05-09T09:50:53.285640+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:56:02.284410+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:57.982184+0000","last_change":"2024-05-09T09:50:57.982184+0000","last_active":"2024-05-09T09:50:57.982184+0000","last_peered":"2024-05-09T09:50:57.982184+0000","last_clean":"2024-05-09T09:50:57.982184+0000","last_became_active":"2024-05-09T09:47:20.250979+0000","last_became_peered":"2024-05-09T09:47:20.250979+0000","last_unstale":"2024-05-09T09:50:57.982184+0000","last_undegraded":"2024-05-09T09:50:57.982184+0000","last_fullsized":"2024-05-09T09:50:57.982184+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:57.981939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:57.981939+0000","last_clean_scrub_stamp":"2024-05-09T09:50:57.981939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:20:07.343476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:52:04.336536+0000","last_change":"2024-05-09T09:52:04.336641+0000","last_active":"2024-05-09T09:52:04.336536+0000","last_peered":"2024-05-09T09:52:04.336536+0000","last_clean":"2024-05-09T09:52:04.336536+0000","last_became_active":"2024-05-09T09:47:22.263615+0000","last_became_peered":"2024-05-09T09:47:22.263615+0000","last_unstale":"2024-05-09T09:52:04.336536+0000","last_undegraded":"2024-05-09T09:52:04.336536+0000","last_fullsized":"2024-05-09T09:52:04.336536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:52:04.336307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:52:04.336307+0000","last_clean_scrub_stamp":"2024-05-09T09:52:04.336307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:27.302464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'4","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:13.101070+0000","last_change":"2024-05-09T09:51:13.101070+0000","last_active":"2024-05-09T09:51:13.101070+0000","last_peered":"2024-05-09T09:51:13.101070+0000","last_clean":"2024-05-09T09:51:13.101070+0000","last_became_active":"2024-05-09T09:47:14.188644+0000","last_became_peered":"2024-05-09T09:47:14.188644+0000","last_unstale":"2024-05-09T09:51:13.101070+0000","last_undegraded":"2024-05-09T09:51:13.101070+0000","last_fullsized":"2024-05-09T09:51:13.101070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:13.100709+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:13.100709+0000","last_clean_scrub_stamp":"2024-05-09T09:51:13.100709+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:32:54.848587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:55.422607+0000","last_change":"2024-05-09T09:51:55.422667+0000","last_active":"2024-05-09T09:51:55.422607+0000","last_peered":"2024-05-09T09:51:55.422607+0000","last_clean":"2024-05-09T09:51:55.422607+0000","last_became_active":"2024-05-09T09:47:03.050832+0000","last_became_peered":"2024-05-09T09:47:03.050832+0000","last_unstale":"2024-05-09T09:51:55.422607+0000","last_undegraded":"2024-05-09T09:51:55.422607+0000","last_fullsized":"2024-05-09T09:51:55.422607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:55.422415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:55.422415+0000","last_clean_scrub_stamp":"2024-05-09T09:51:55.422415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:49:42.947181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:25.242601+0000","last_change":"2024-05-09T09:51:25.242656+0000","last_active":"2024-05-09T09:51:25.242601+0000","last_peered":"2024-05-09T09:51:25.242601+0000","last_clean":"2024-05-09T09:51:25.242601+0000","last_became_active":"2024-05-09T09:47:12.190521+0000","last_became_peered":"2024-05-09T09:47:12.190521+0000","last_unstale":"2024-05-09T09:51:25.242601+0000","last_undegraded":"2024-05-09T09:51:25.242601+0000","last_fullsized":"2024-05-09T09:51:25.242601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:25.242400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:25.242400+0000","last_clean_scrub_stamp":"2024-05-09T09:51:25.242400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:34:22.065847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:08.084806+0000","last_change":"2024-05-09T09:51:08.084806+0000","last_active":"2024-05-09T09:51:08.084806+0000","last_peered":"2024-05-09T09:51:08.084806+0000","last_clean":"2024-05-09T09:51:08.084806+0000","last_became_active":"2024-05-09T09:47:16.187120+0000","last_became_peered":"2024-05-09T09:47:16.187120+0000","last_unstale":"2024-05-09T09:51:08.084806+0000","last_undegraded":"2024-05-09T09:51:08.084806+0000","last_fullsized":"2024-05-09T09:51:08.084806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:08.084559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:08.084559+0000","last_clean_scrub_stamp":"2024-05-09T09:51:08.084559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:22.872238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'21","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:49.497580+0000","last_change":"2024-05-09T09:50:49.497580+0000","last_active":"2024-05-09T09:50:49.497580+0000","last_peered":"2024-05-09T09:50:49.497580+0000","last_clean":"2024-05-09T09:50:49.497580+0000","last_became_active":"2024-05-09T09:47:18.230757+0000","last_became_peered":"2024-05-09T09:47:18.230757+0000","last_unstale":"2024-05-09T09:50:49.497580+0000","last_undegraded":"2024-05-09T09:50:49.497580+0000","last_fullsized":"2024-05-09T09:50:49.497580+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-05-09T09:50:49.497309+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-05-09T09:50:49.497309+0000","last_clean_scrub_stamp":"2024-05-09T09:50:49.497309+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:00:57.562854+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:08.424955+0000","last_change":"2024-05-09T09:51:08.424955+0000","last_active":"2024-05-09T09:51:08.424955+0000","last_peered":"2024-05-09T09:51:08.424955+0000","last_clean":"2024-05-09T09:51:08.424955+0000","last_became_active":"2024-05-09T09:47:20.249919+0000","last_became_peered":"2024-05-09T09:47:20.249919+0000","last_unstale":"2024-05-09T09:51:08.424955+0000","last_undegraded":"2024-05-09T09:51:08.424955+0000","last_fullsized":"2024-05-09T09:51:08.424955+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:08.424700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:08.424700+0000","last_clean_scrub_stamp":"2024-05-09T09:51:08.424700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:41:47.741972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'6","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:44.236951+0000","last_change":"2024-05-09T09:51:44.236951+0000","last_active":"2024-05-09T09:51:44.236951+0000","last_peered":"2024-05-09T09:51:44.236951+0000","last_clean":"2024-05-09T09:51:44.236951+0000","last_became_active":"2024-05-09T09:47:22.259833+0000","last_became_peered":"2024-05-09T09:47:22.259833+0000","last_unstale":"2024-05-09T09:51:44.236951+0000","last_undegraded":"2024-05-09T09:51:44.236951+0000","last_fullsized":"2024-05-09T09:51:44.236951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:44.236663+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:44.236663+0000","last_clean_scrub_stamp":"2024-05-09T09:51:44.236663+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:00.115843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'4","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:16.280449+0000","last_change":"2024-05-09T09:51:16.280449+0000","last_active":"2024-05-09T09:51:16.280449+0000","last_peered":"2024-05-09T09:51:16.280449+0000","last_clean":"2024-05-09T09:51:16.280449+0000","last_became_active":"2024-05-09T09:47:14.173535+0000","last_became_peered":"2024-05-09T09:47:14.173535+0000","last_unstale":"2024-05-09T09:51:16.280449+0000","last_undegraded":"2024-05-09T09:51:16.280449+0000","last_fullsized":"2024-05-09T09:51:16.280449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:16.280201+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:16.280201+0000","last_clean_scrub_stamp":"2024-05-09T09:51:16.280201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:02:57.723193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:29.238181+0000","last_change":"2024-05-09T09:51:29.238251+0000","last_active":"2024-05-09T09:51:29.238181+0000","last_peered":"2024-05-09T09:51:29.238181+0000","last_clean":"2024-05-09T09:51:29.238181+0000","last_became_active":"2024-05-09T09:47:12.194500+0000","last_became_peered":"2024-05-09T09:47:12.194500+0000","last_unstale":"2024-05-09T09:51:29.238181+0000","last_undegraded":"2024-05-09T09:51:29.238181+0000","last_fullsized":"2024-05-09T09:51:29.238181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:29.237957+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:29.237957+0000","last_clean_scrub_stamp":"2024-05-09T09:51:29.237957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:45:39.761788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:32.222894+0000","last_change":"2024-05-09T09:51:32.222951+0000","last_active":"2024-05-09T09:51:32.222894+0000","last_peered":"2024-05-09T09:51:32.222894+0000","last_clean":"2024-05-09T09:51:32.222894+0000","last_became_active":"2024-05-09T09:47:03.051159+0000","last_became_peered":"2024-05-09T09:47:03.051159+0000","last_unstale":"2024-05-09T09:51:32.222894+0000","last_undegraded":"2024-05-09T09:51:32.222894+0000","last_fullsized":"2024-05-09T09:51:32.222894+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:32.222688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:32.222688+0000","last_clean_scrub_stamp":"2024-05-09T09:51:32.222688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:24:46.533046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'7","reported_seq":242,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:05.017370+0000","last_change":"2024-05-09T09:51:05.017370+0000","last_active":"2024-05-09T09:51:05.017370+0000","last_peered":"2024-05-09T09:51:05.017370+0000","last_clean":"2024-05-09T09:51:05.017370+0000","last_became_active":"2024-05-09T09:47:16.198233+0000","last_became_peered":"2024-05-09T09:47:16.198233+0000","last_unstale":"2024-05-09T09:51:05.017370+0000","last_undegraded":"2024-05-09T09:51:05.017370+0000","last_fullsized":"2024-05-09T09:51:05.017370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-05-09T09:51:05.017095+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-05-09T09:51:05.017095+0000","last_clean_scrub_stamp":"2024-05-09T09:51:05.017095+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:53:06.632153+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1180,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":302,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'221","reported_seq":298,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:56.950939+0000","last_change":"2024-05-09T09:50:56.950939+0000","last_active":"2024-05-09T09:50:56.950939+0000","last_peered":"2024-05-09T09:50:56.950939+0000","last_clean":"2024-05-09T09:50:56.950939+0000","last_became_active":"2024-05-09T09:47:18.199411+0000","last_became_peered":"2024-05-09T09:47:18.199411+0000","last_unstale":"2024-05-09T09:50:56.950939+0000","last_undegraded":"2024-05-09T09:50:56.950939+0000","last_fullsized":"2024-05-09T09:50:56.950939+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'221","last_scrub_stamp":"2024-05-09T09:50:56.950671+0000","last_deep_scrub":"32'221","last_deep_scrub_stamp":"2024-05-09T09:50:56.950671+0000","last_clean_scrub_stamp":"2024-05-09T09:50:56.950671+0000","objects_scrubbed":9,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:44:33.387528+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:48.114403+0000","last_change":"2024-05-09T09:50:48.114403+0000","last_active":"2024-05-09T09:50:48.114403+0000","last_peered":"2024-05-09T09:50:48.114403+0000","last_clean":"2024-05-09T09:50:48.114403+0000","last_became_active":"2024-05-09T09:47:20.233024+0000","last_became_peered":"2024-05-09T09:47:20.233024+0000","last_unstale":"2024-05-09T09:50:48.114403+0000","last_undegraded":"2024-05-09T09:50:48.114403+0000","last_fullsized":"2024-05-09T09:50:48.114403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:48.114039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:48.114039+0000","last_clean_scrub_stamp":"2024-05-09T09:50:48.114039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:31:03.759841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'11","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:14.131467+0000","last_change":"2024-05-09T09:51:14.131467+0000","last_active":"2024-05-09T09:51:14.131467+0000","last_peered":"2024-05-09T09:51:14.131467+0000","last_clean":"2024-05-09T09:51:14.131467+0000","last_became_active":"2024-05-09T09:47:22.228855+0000","last_became_peered":"2024-05-09T09:47:22.228855+0000","last_unstale":"2024-05-09T09:51:14.131467+0000","last_undegraded":"2024-05-09T09:51:14.131467+0000","last_fullsized":"2024-05-09T09:51:14.131467+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-05-09T09:51:14.131207+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-05-09T09:51:14.131207+0000","last_clean_scrub_stamp":"2024-05-09T09:51:14.131207+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:46:57.527442+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'12","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:45.269754+0000","last_change":"2024-05-09T09:51:45.269833+0000","last_active":"2024-05-09T09:51:45.269754+0000","last_peered":"2024-05-09T09:51:45.269754+0000","last_clean":"2024-05-09T09:51:45.269754+0000","last_became_active":"2024-05-09T09:47:52.430912+0000","last_became_peered":"2024-05-09T09:47:52.430912+0000","last_unstale":"2024-05-09T09:51:45.269754+0000","last_undegraded":"2024-05-09T09:51:45.269754+0000","last_fullsized":"2024-05-09T09:51:45.269754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-09T09:51:45.269561+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-09T09:51:45.269561+0000","last_clean_scrub_stamp":"2024-05-09T09:51:45.269561+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:27.877783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:39.340829+0000","last_change":"2024-05-09T09:51:39.340891+0000","last_active":"2024-05-09T09:51:39.340829+0000","last_peered":"2024-05-09T09:51:39.340829+0000","last_clean":"2024-05-09T09:51:39.340829+0000","last_became_active":"2024-05-09T09:47:12.189486+0000","last_became_peered":"2024-05-09T09:47:12.189486+0000","last_unstale":"2024-05-09T09:51:39.340829+0000","last_undegraded":"2024-05-09T09:51:39.340829+0000","last_fullsized":"2024-05-09T09:51:39.340829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:39.340616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:39.340616+0000","last_clean_scrub_stamp":"2024-05-09T09:51:39.340616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:54:04.794316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:53.468929+0000","last_change":"2024-05-09T09:51:53.469073+0000","last_active":"2024-05-09T09:51:53.468929+0000","last_peered":"2024-05-09T09:51:53.468929+0000","last_clean":"2024-05-09T09:51:53.468929+0000","last_became_active":"2024-05-09T09:47:03.050600+0000","last_became_peered":"2024-05-09T09:47:03.050600+0000","last_unstale":"2024-05-09T09:51:53.468929+0000","last_undegraded":"2024-05-09T09:51:53.468929+0000","last_fullsized":"2024-05-09T09:51:53.468929+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:53.468698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:53.468698+0000","last_clean_scrub_stamp":"2024-05-09T09:51:53.468698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:04:39.515405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:54.486490+0000","last_change":"2024-05-09T09:50:54.486490+0000","last_active":"2024-05-09T09:50:54.486490+0000","last_peered":"2024-05-09T09:50:54.486490+0000","last_clean":"2024-05-09T09:50:54.486490+0000","last_became_active":"2024-05-09T09:47:16.182232+0000","last_became_peered":"2024-05-09T09:47:16.182232+0000","last_unstale":"2024-05-09T09:50:54.486490+0000","last_undegraded":"2024-05-09T09:50:54.486490+0000","last_fullsized":"2024-05-09T09:50:54.486490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:54.486244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:54.486244+0000","last_clean_scrub_stamp":"2024-05-09T09:50:54.486244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:04:41.948173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'21","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:49.380947+0000","last_change":"2024-05-09T09:50:49.380947+0000","last_active":"2024-05-09T09:50:49.380947+0000","last_peered":"2024-05-09T09:50:49.380947+0000","last_clean":"2024-05-09T09:50:49.380947+0000","last_became_active":"2024-05-09T09:47:18.211020+0000","last_became_peered":"2024-05-09T09:47:18.211020+0000","last_unstale":"2024-05-09T09:50:49.380947+0000","last_undegraded":"2024-05-09T09:50:49.380947+0000","last_fullsized":"2024-05-09T09:50:49.380947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-05-09T09:50:49.380517+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-05-09T09:50:49.380517+0000","last_clean_scrub_stamp":"2024-05-09T09:50:49.380517+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:34:01.985708+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":384,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:52.295501+0000","last_change":"2024-05-09T09:50:52.295501+0000","last_active":"2024-05-09T09:50:52.295501+0000","last_peered":"2024-05-09T09:50:52.295501+0000","last_clean":"2024-05-09T09:50:52.295501+0000","last_became_active":"2024-05-09T09:47:20.226481+0000","last_became_peered":"2024-05-09T09:47:20.226481+0000","last_unstale":"2024-05-09T09:50:52.295501+0000","last_undegraded":"2024-05-09T09:50:52.295501+0000","last_fullsized":"2024-05-09T09:50:52.295501+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:52.295146+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:52.295146+0000","last_clean_scrub_stamp":"2024-05-09T09:50:52.295146+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:27.487386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:35.467911+0000","last_change":"2024-05-09T09:51:35.467911+0000","last_active":"2024-05-09T09:51:35.467911+0000","last_peered":"2024-05-09T09:51:35.467911+0000","last_clean":"2024-05-09T09:51:35.467911+0000","last_became_active":"2024-05-09T09:47:22.256285+0000","last_became_peered":"2024-05-09T09:47:22.256285+0000","last_unstale":"2024-05-09T09:51:35.467911+0000","last_undegraded":"2024-05-09T09:51:35.467911+0000","last_fullsized":"2024-05-09T09:51:35.467911+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:35.467661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:35.467661+0000","last_clean_scrub_stamp":"2024-05-09T09:51:35.467661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:08:21.152606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:30.564820+0000","last_change":"2024-05-09T09:51:30.564884+0000","last_active":"2024-05-09T09:51:30.564820+0000","last_peered":"2024-05-09T09:51:30.564820+0000","last_clean":"2024-05-09T09:51:30.564820+0000","last_became_active":"2024-05-09T09:47:14.183542+0000","last_became_peered":"2024-05-09T09:47:14.183542+0000","last_unstale":"2024-05-09T09:51:30.564820+0000","last_undegraded":"2024-05-09T09:51:30.564820+0000","last_fullsized":"2024-05-09T09:51:30.564820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:30.564595+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:30.564595+0000","last_clean_scrub_stamp":"2024-05-09T09:51:30.564595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:24:51.778769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:58.435136+0000","last_change":"2024-05-09T09:51:58.435260+0000","last_active":"2024-05-09T09:51:58.435136+0000","last_peered":"2024-05-09T09:51:58.435136+0000","last_clean":"2024-05-09T09:51:58.435136+0000","last_became_active":"2024-05-09T09:47:12.199656+0000","last_became_peered":"2024-05-09T09:47:12.199656+0000","last_unstale":"2024-05-09T09:51:58.435136+0000","last_undegraded":"2024-05-09T09:51:58.435136+0000","last_fullsized":"2024-05-09T09:51:58.435136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:58.434887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:58.434887+0000","last_clean_scrub_stamp":"2024-05-09T09:51:58.434887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:36:29.410701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:33.179270+0000","last_change":"2024-05-09T09:51:33.179325+0000","last_active":"2024-05-09T09:51:33.179270+0000","last_peered":"2024-05-09T09:51:33.179270+0000","last_clean":"2024-05-09T09:51:33.179270+0000","last_became_active":"2024-05-09T09:47:03.052728+0000","last_became_peered":"2024-05-09T09:47:03.052728+0000","last_unstale":"2024-05-09T09:51:33.179270+0000","last_undegraded":"2024-05-09T09:51:33.179270+0000","last_fullsized":"2024-05-09T09:51:33.179270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:33.179071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:33.179071+0000","last_clean_scrub_stamp":"2024-05-09T09:51:33.179071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:21:34.083560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:52:06.402199+0000","last_change":"2024-05-09T09:52:06.402256+0000","last_active":"2024-05-09T09:52:06.402199+0000","last_peered":"2024-05-09T09:52:06.402199+0000","last_clean":"2024-05-09T09:52:06.402199+0000","last_became_active":"2024-05-09T09:47:52.182360+0000","last_became_peered":"2024-05-09T09:47:52.182360+0000","last_unstale":"2024-05-09T09:52:06.402199+0000","last_undegraded":"2024-05-09T09:52:06.402199+0000","last_fullsized":"2024-05-09T09:52:06.402199+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:52:06.402003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:52:06.402003+0000","last_clean_scrub_stamp":"2024-05-09T09:52:06.402003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:41:33.381160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:16.463719+0000","last_change":"2024-05-09T09:51:16.463719+0000","last_active":"2024-05-09T09:51:16.463719+0000","last_peered":"2024-05-09T09:51:16.463719+0000","last_clean":"2024-05-09T09:51:16.463719+0000","last_became_active":"2024-05-09T09:47:18.234556+0000","last_became_peered":"2024-05-09T09:47:18.234556+0000","last_unstale":"2024-05-09T09:51:16.463719+0000","last_undegraded":"2024-05-09T09:51:16.463719+0000","last_fullsized":"2024-05-09T09:51:16.463719+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-09T09:51:16.463413+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-09T09:51:16.463413+0000","last_clean_scrub_stamp":"2024-05-09T09:51:16.463413+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:45:18.905836+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":414,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:47.848115+0000","last_change":"2024-05-09T09:50:47.848115+0000","last_active":"2024-05-09T09:50:47.848115+0000","last_peered":"2024-05-09T09:50:47.848115+0000","last_clean":"2024-05-09T09:50:47.848115+0000","last_became_active":"2024-05-09T09:47:20.226936+0000","last_became_peered":"2024-05-09T09:47:20.226936+0000","last_unstale":"2024-05-09T09:50:47.848115+0000","last_undegraded":"2024-05-09T09:50:47.848115+0000","last_fullsized":"2024-05-09T09:50:47.848115+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:47.847851+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:47.847851+0000","last_clean_scrub_stamp":"2024-05-09T09:50:47.847851+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:23:07.394309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:42.210770+0000","last_change":"2024-05-09T09:51:42.210770+0000","last_active":"2024-05-09T09:51:42.210770+0000","last_peered":"2024-05-09T09:51:42.210770+0000","last_clean":"2024-05-09T09:51:42.210770+0000","last_became_active":"2024-05-09T09:47:22.259547+0000","last_became_peered":"2024-05-09T09:47:22.259547+0000","last_unstale":"2024-05-09T09:51:42.210770+0000","last_undegraded":"2024-05-09T09:51:42.210770+0000","last_fullsized":"2024-05-09T09:51:42.210770+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-05-09T09:51:42.210490+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-05-09T09:51:42.210490+0000","last_clean_scrub_stamp":"2024-05-09T09:51:42.210490+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:06:31.922115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'12","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:12.442602+0000","last_change":"2024-05-09T09:51:12.442602+0000","last_active":"2024-05-09T09:51:12.442602+0000","last_peered":"2024-05-09T09:51:12.442602+0000","last_clean":"2024-05-09T09:51:12.442602+0000","last_became_active":"2024-05-09T09:47:14.173673+0000","last_became_peered":"2024-05-09T09:47:14.173673+0000","last_unstale":"2024-05-09T09:51:12.442602+0000","last_undegraded":"2024-05-09T09:51:12.442602+0000","last_fullsized":"2024-05-09T09:51:12.442602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-09T09:51:12.442192+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-09T09:51:12.442192+0000","last_clean_scrub_stamp":"2024-05-09T09:51:12.442192+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:34.408920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:27.262111+0000","last_change":"2024-05-09T09:51:27.262111+0000","last_active":"2024-05-09T09:51:27.262111+0000","last_peered":"2024-05-09T09:51:27.262111+0000","last_clean":"2024-05-09T09:51:27.262111+0000","last_became_active":"2024-05-09T09:47:12.205502+0000","last_became_peered":"2024-05-09T09:47:12.205502+0000","last_unstale":"2024-05-09T09:51:27.262111+0000","last_undegraded":"2024-05-09T09:51:27.262111+0000","last_fullsized":"2024-05-09T09:51:27.262111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:27.261827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:27.261827+0000","last_clean_scrub_stamp":"2024-05-09T09:51:27.261827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:00:13.953985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:57.424168+0000","last_change":"2024-05-09T09:51:57.424228+0000","last_active":"2024-05-09T09:51:57.424168+0000","last_peered":"2024-05-09T09:51:57.424168+0000","last_clean":"2024-05-09T09:51:57.424168+0000","last_became_active":"2024-05-09T09:47:03.186434+0000","last_became_peered":"2024-05-09T09:47:03.186434+0000","last_unstale":"2024-05-09T09:51:57.424168+0000","last_undegraded":"2024-05-09T09:51:57.424168+0000","last_fullsized":"2024-05-09T09:51:57.424168+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:57.423911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:57.423911+0000","last_clean_scrub_stamp":"2024-05-09T09:51:57.423911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:45:14.320140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:56.472700+0000","last_change":"2024-05-09T09:50:56.472700+0000","last_active":"2024-05-09T09:50:56.472700+0000","last_peered":"2024-05-09T09:50:56.472700+0000","last_clean":"2024-05-09T09:50:56.472700+0000","last_became_active":"2024-05-09T09:47:16.182713+0000","last_became_peered":"2024-05-09T09:47:16.182713+0000","last_unstale":"2024-05-09T09:50:56.472700+0000","last_undegraded":"2024-05-09T09:50:56.472700+0000","last_fullsized":"2024-05-09T09:50:56.472700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:56.472447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:56.472447+0000","last_clean_scrub_stamp":"2024-05-09T09:50:56.472447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:02:37.915439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'318","reported_seq":412,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:49.169601+0000","last_change":"2024-05-09T09:50:49.169601+0000","last_active":"2024-05-09T09:50:49.169601+0000","last_peered":"2024-05-09T09:50:49.169601+0000","last_clean":"2024-05-09T09:50:49.169601+0000","last_became_active":"2024-05-09T09:47:18.226473+0000","last_became_peered":"2024-05-09T09:47:18.226473+0000","last_unstale":"2024-05-09T09:50:49.169601+0000","last_undegraded":"2024-05-09T09:50:49.169601+0000","last_fullsized":"2024-05-09T09:50:49.169601+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'318","last_scrub_stamp":"2024-05-09T09:50:49.169325+0000","last_deep_scrub":"32'318","last_deep_scrub_stamp":"2024-05-09T09:50:49.169325+0000","last_clean_scrub_stamp":"2024-05-09T09:50:49.169325+0000","objects_scrubbed":8,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:47:39.409337+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:48.836895+0000","last_change":"2024-05-09T09:50:48.836895+0000","last_active":"2024-05-09T09:50:48.836895+0000","last_peered":"2024-05-09T09:50:48.836895+0000","last_clean":"2024-05-09T09:50:48.836895+0000","last_became_active":"2024-05-09T09:47:20.227198+0000","last_became_peered":"2024-05-09T09:47:20.227198+0000","last_unstale":"2024-05-09T09:50:48.836895+0000","last_undegraded":"2024-05-09T09:50:48.836895+0000","last_fullsized":"2024-05-09T09:50:48.836895+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:48.836642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:48.836642+0000","last_clean_scrub_stamp":"2024-05-09T09:50:48.836642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:31:25.639707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:02.266234+0000","last_change":"2024-05-09T09:51:02.266234+0000","last_active":"2024-05-09T09:51:02.266234+0000","last_peered":"2024-05-09T09:51:02.266234+0000","last_clean":"2024-05-09T09:51:02.266234+0000","last_became_active":"2024-05-09T09:47:22.233279+0000","last_became_peered":"2024-05-09T09:47:22.233279+0000","last_unstale":"2024-05-09T09:51:02.266234+0000","last_undegraded":"2024-05-09T09:51:02.266234+0000","last_fullsized":"2024-05-09T09:51:02.266234+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:02.265986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:02.265986+0000","last_clean_scrub_stamp":"2024-05-09T09:51:02.265986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:11:12.792128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:34.206325+0000","last_change":"2024-05-09T09:51:34.206325+0000","last_active":"2024-05-09T09:51:34.206325+0000","last_peered":"2024-05-09T09:51:34.206325+0000","last_clean":"2024-05-09T09:51:34.206325+0000","last_became_active":"2024-05-09T09:47:22.236863+0000","last_became_peered":"2024-05-09T09:47:22.236863+0000","last_unstale":"2024-05-09T09:51:34.206325+0000","last_undegraded":"2024-05-09T09:51:34.206325+0000","last_fullsized":"2024-05-09T09:51:34.206325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:34.206073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:34.206073+0000","last_clean_scrub_stamp":"2024-05-09T09:51:34.206073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:03:16.461845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:18.352621+0000","last_change":"2024-05-09T09:51:18.352621+0000","last_active":"2024-05-09T09:51:18.352621+0000","last_peered":"2024-05-09T09:51:18.352621+0000","last_clean":"2024-05-09T09:51:18.352621+0000","last_became_active":"2024-05-09T09:47:14.184250+0000","last_became_peered":"2024-05-09T09:47:14.184250+0000","last_unstale":"2024-05-09T09:51:18.352621+0000","last_undegraded":"2024-05-09T09:51:18.352621+0000","last_fullsized":"2024-05-09T09:51:18.352621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:18.352348+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:18.352348+0000","last_clean_scrub_stamp":"2024-05-09T09:51:18.352348+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:53:19.967406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:42.577858+0000","last_change":"2024-05-09T09:51:42.577858+0000","last_active":"2024-05-09T09:51:42.577858+0000","last_peered":"2024-05-09T09:51:42.577858+0000","last_clean":"2024-05-09T09:51:42.577858+0000","last_became_active":"2024-05-09T09:47:12.203479+0000","last_became_peered":"2024-05-09T09:47:12.203479+0000","last_unstale":"2024-05-09T09:51:42.577858+0000","last_undegraded":"2024-05-09T09:51:42.577858+0000","last_fullsized":"2024-05-09T09:51:42.577858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:42.577565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:42.577565+0000","last_clean_scrub_stamp":"2024-05-09T09:51:42.577565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:55:08.778669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:53.265573+0000","last_change":"2024-05-09T09:50:53.265573+0000","last_active":"2024-05-09T09:50:53.265573+0000","last_peered":"2024-05-09T09:50:53.265573+0000","last_clean":"2024-05-09T09:50:53.265573+0000","last_became_active":"2024-05-09T09:47:16.210992+0000","last_became_peered":"2024-05-09T09:47:16.210992+0000","last_unstale":"2024-05-09T09:50:53.265573+0000","last_undegraded":"2024-05-09T09:50:53.265573+0000","last_fullsized":"2024-05-09T09:50:53.265573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:53.265312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:53.265312+0000","last_clean_scrub_stamp":"2024-05-09T09:50:53.265312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:28:20.308389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'113","reported_seq":170,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:57.465918+0000","last_change":"2024-05-09T09:50:57.465918+0000","last_active":"2024-05-09T09:50:57.465918+0000","last_peered":"2024-05-09T09:50:57.465918+0000","last_clean":"2024-05-09T09:50:57.465918+0000","last_became_active":"2024-05-09T09:47:18.234014+0000","last_became_peered":"2024-05-09T09:47:18.234014+0000","last_unstale":"2024-05-09T09:50:57.465918+0000","last_undegraded":"2024-05-09T09:50:57.465918+0000","last_fullsized":"2024-05-09T09:50:57.465918+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'113","last_scrub_stamp":"2024-05-09T09:50:57.465647+0000","last_deep_scrub":"32'113","last_deep_scrub_stamp":"2024-05-09T09:50:57.465647+0000","last_clean_scrub_stamp":"2024-05-09T09:50:57.465647+0000","objects_scrubbed":5,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:46:16.255842+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:11.435908+0000","last_change":"2024-05-09T09:51:11.435908+0000","last_active":"2024-05-09T09:51:11.435908+0000","last_peered":"2024-05-09T09:51:11.435908+0000","last_clean":"2024-05-09T09:51:11.435908+0000","last_became_active":"2024-05-09T09:47:20.254344+0000","last_became_peered":"2024-05-09T09:47:20.254344+0000","last_unstale":"2024-05-09T09:51:11.435908+0000","last_undegraded":"2024-05-09T09:51:11.435908+0000","last_fullsized":"2024-05-09T09:51:11.435908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:11.435657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:11.435657+0000","last_clean_scrub_stamp":"2024-05-09T09:51:11.435657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:58:02.384629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'5","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:42.322512+0000","last_change":"2024-05-09T09:51:42.322576+0000","last_active":"2024-05-09T09:51:42.322512+0000","last_peered":"2024-05-09T09:51:42.322512+0000","last_clean":"2024-05-09T09:51:42.322512+0000","last_became_active":"2024-05-09T09:47:22.229088+0000","last_became_peered":"2024-05-09T09:47:22.229088+0000","last_unstale":"2024-05-09T09:51:42.322512+0000","last_undegraded":"2024-05-09T09:51:42.322512+0000","last_fullsized":"2024-05-09T09:51:42.322512+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-09T09:51:42.322274+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-09T09:51:42.322274+0000","last_clean_scrub_stamp":"2024-05-09T09:51:42.322274+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:56:18.475958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:18.321045+0000","last_change":"2024-05-09T09:51:18.321045+0000","last_active":"2024-05-09T09:51:18.321045+0000","last_peered":"2024-05-09T09:51:18.321045+0000","last_clean":"2024-05-09T09:51:18.321045+0000","last_became_active":"2024-05-09T09:47:14.173866+0000","last_became_peered":"2024-05-09T09:47:14.173866+0000","last_unstale":"2024-05-09T09:51:18.321045+0000","last_undegraded":"2024-05-09T09:51:18.321045+0000","last_fullsized":"2024-05-09T09:51:18.321045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:18.320750+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:18.320750+0000","last_clean_scrub_stamp":"2024-05-09T09:51:18.320750+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:25:44.576241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:23.271656+0000","last_change":"2024-05-09T09:51:23.271656+0000","last_active":"2024-05-09T09:51:23.271656+0000","last_peered":"2024-05-09T09:51:23.271656+0000","last_clean":"2024-05-09T09:51:23.271656+0000","last_became_active":"2024-05-09T09:47:12.205714+0000","last_became_peered":"2024-05-09T09:47:12.205714+0000","last_unstale":"2024-05-09T09:51:23.271656+0000","last_undegraded":"2024-05-09T09:51:23.271656+0000","last_fullsized":"2024-05-09T09:51:23.271656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:23.271378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:23.271378+0000","last_clean_scrub_stamp":"2024-05-09T09:51:23.271378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:23:12.920105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:52:07.356491+0000","last_change":"2024-05-09T09:52:07.356545+0000","last_active":"2024-05-09T09:52:07.356491+0000","last_peered":"2024-05-09T09:52:07.356491+0000","last_clean":"2024-05-09T09:52:07.356491+0000","last_became_active":"2024-05-09T09:47:52.187627+0000","last_became_peered":"2024-05-09T09:47:52.187627+0000","last_unstale":"2024-05-09T09:52:07.356491+0000","last_undegraded":"2024-05-09T09:52:07.356491+0000","last_fullsized":"2024-05-09T09:52:07.356491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:52:07.356275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:52:07.356275+0000","last_clean_scrub_stamp":"2024-05-09T09:52:07.356275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:48:40.968291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'8","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:51.843293+0000","last_change":"2024-05-09T09:50:51.843293+0000","last_active":"2024-05-09T09:50:51.843293+0000","last_peered":"2024-05-09T09:50:51.843293+0000","last_clean":"2024-05-09T09:50:51.843293+0000","last_became_active":"2024-05-09T09:47:18.217843+0000","last_became_peered":"2024-05-09T09:47:18.217843+0000","last_unstale":"2024-05-09T09:50:51.843293+0000","last_undegraded":"2024-05-09T09:50:51.843293+0000","last_fullsized":"2024-05-09T09:50:51.843293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:50:51.843015+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:50:51.843015+0000","last_clean_scrub_stamp":"2024-05-09T09:50:51.843015+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:01:37.150482+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:58.254985+0000","last_change":"2024-05-09T09:50:58.254985+0000","last_active":"2024-05-09T09:50:58.254985+0000","last_peered":"2024-05-09T09:50:58.254985+0000","last_clean":"2024-05-09T09:50:58.254985+0000","last_became_active":"2024-05-09T09:47:20.255449+0000","last_became_peered":"2024-05-09T09:47:20.255449+0000","last_unstale":"2024-05-09T09:50:58.254985+0000","last_undegraded":"2024-05-09T09:50:58.254985+0000","last_fullsized":"2024-05-09T09:50:58.254985+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:58.254742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:58.254742+0000","last_clean_scrub_stamp":"2024-05-09T09:50:58.254742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:40:28.088373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"32'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:44.264339+0000","last_change":"2024-05-09T09:51:44.264339+0000","last_active":"2024-05-09T09:51:44.264339+0000","last_peered":"2024-05-09T09:51:44.264339+0000","last_clean":"2024-05-09T09:51:44.264339+0000","last_became_active":"2024-05-09T09:47:22.239113+0000","last_became_peered":"2024-05-09T09:47:22.239113+0000","last_unstale":"2024-05-09T09:51:44.264339+0000","last_undegraded":"2024-05-09T09:51:44.264339+0000","last_fullsized":"2024-05-09T09:51:44.264339+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-09T09:51:44.264078+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-09T09:51:44.264078+0000","last_clean_scrub_stamp":"2024-05-09T09:51:44.264078+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:56:58.841244+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:18.173416+0000","last_change":"2024-05-09T09:51:18.173416+0000","last_active":"2024-05-09T09:51:18.173416+0000","last_peered":"2024-05-09T09:51:18.173416+0000","last_clean":"2024-05-09T09:51:18.173416+0000","last_became_active":"2024-05-09T09:47:14.173338+0000","last_became_peered":"2024-05-09T09:47:14.173338+0000","last_unstale":"2024-05-09T09:51:18.173416+0000","last_undegraded":"2024-05-09T09:51:18.173416+0000","last_fullsized":"2024-05-09T09:51:18.173416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:18.173009+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:18.173009+0000","last_clean_scrub_stamp":"2024-05-09T09:51:18.173009+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:59:16.436247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:15.403431+0000","last_change":"2024-05-09T09:51:15.403431+0000","last_active":"2024-05-09T09:51:15.403431+0000","last_peered":"2024-05-09T09:51:15.403431+0000","last_clean":"2024-05-09T09:51:15.403431+0000","last_became_active":"2024-05-09T09:47:12.205864+0000","last_became_peered":"2024-05-09T09:47:12.205864+0000","last_unstale":"2024-05-09T09:51:15.403431+0000","last_undegraded":"2024-05-09T09:51:15.403431+0000","last_fullsized":"2024-05-09T09:51:15.403431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:15.403005+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:15.403005+0000","last_clean_scrub_stamp":"2024-05-09T09:51:15.403005+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:10:59.671365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:59.267079+0000","last_change":"2024-05-09T09:50:59.267079+0000","last_active":"2024-05-09T09:50:59.267079+0000","last_peered":"2024-05-09T09:50:59.267079+0000","last_clean":"2024-05-09T09:50:59.267079+0000","last_became_active":"2024-05-09T09:47:16.214780+0000","last_became_peered":"2024-05-09T09:47:16.214780+0000","last_unstale":"2024-05-09T09:50:59.267079+0000","last_undegraded":"2024-05-09T09:50:59.267079+0000","last_fullsized":"2024-05-09T09:50:59.267079+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:59.266840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:59.266840+0000","last_clean_scrub_stamp":"2024-05-09T09:50:59.266840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:59:17.503566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'121","reported_seq":194,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:54.909493+0000","last_change":"2024-05-09T09:50:54.909493+0000","last_active":"2024-05-09T09:50:54.909493+0000","last_peered":"2024-05-09T09:50:54.909493+0000","last_clean":"2024-05-09T09:50:54.909493+0000","last_became_active":"2024-05-09T09:47:18.201443+0000","last_became_peered":"2024-05-09T09:47:18.201443+0000","last_unstale":"2024-05-09T09:50:54.909493+0000","last_undegraded":"2024-05-09T09:50:54.909493+0000","last_fullsized":"2024-05-09T09:50:54.909493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'121","last_scrub_stamp":"2024-05-09T09:50:54.909111+0000","last_deep_scrub":"32'121","last_deep_scrub_stamp":"2024-05-09T09:50:54.909111+0000","last_clean_scrub_stamp":"2024-05-09T09:50:54.909111+0000","objects_scrubbed":6,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:37:16.030668+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:48.357139+0000","last_change":"2024-05-09T09:50:48.357139+0000","last_active":"2024-05-09T09:50:48.357139+0000","last_peered":"2024-05-09T09:50:48.357139+0000","last_clean":"2024-05-09T09:50:48.357139+0000","last_became_active":"2024-05-09T09:47:20.225261+0000","last_became_peered":"2024-05-09T09:47:20.225261+0000","last_unstale":"2024-05-09T09:50:48.357139+0000","last_undegraded":"2024-05-09T09:50:48.357139+0000","last_fullsized":"2024-05-09T09:50:48.357139+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:48.356886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:48.356886+0000","last_clean_scrub_stamp":"2024-05-09T09:50:48.356886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:18:04.605745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"30'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:27.489186+0000","last_change":"2024-05-09T09:51:27.489186+0000","last_active":"2024-05-09T09:51:27.489186+0000","last_peered":"2024-05-09T09:51:27.489186+0000","last_clean":"2024-05-09T09:51:27.489186+0000","last_became_active":"2024-05-09T09:47:22.252940+0000","last_became_peered":"2024-05-09T09:47:22.252940+0000","last_unstale":"2024-05-09T09:51:27.489186+0000","last_undegraded":"2024-05-09T09:51:27.489186+0000","last_fullsized":"2024-05-09T09:51:27.489186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-09T09:51:27.488901+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-09T09:51:27.488901+0000","last_clean_scrub_stamp":"2024-05-09T09:51:27.488901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:56:03.642585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:32.523308+0000","last_change":"2024-05-09T09:51:32.523308+0000","last_active":"2024-05-09T09:51:32.523308+0000","last_peered":"2024-05-09T09:51:32.523308+0000","last_clean":"2024-05-09T09:51:32.523308+0000","last_became_active":"2024-05-09T09:47:14.183622+0000","last_became_peered":"2024-05-09T09:47:14.183622+0000","last_unstale":"2024-05-09T09:51:32.523308+0000","last_undegraded":"2024-05-09T09:51:32.523308+0000","last_fullsized":"2024-05-09T09:51:32.523308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:32.523049+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:32.523049+0000","last_clean_scrub_stamp":"2024-05-09T09:51:32.523049+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:00:49.214343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:34.234278+0000","last_change":"2024-05-09T09:51:34.234278+0000","last_active":"2024-05-09T09:51:34.234278+0000","last_peered":"2024-05-09T09:51:34.234278+0000","last_clean":"2024-05-09T09:51:34.234278+0000","last_became_active":"2024-05-09T09:47:12.195857+0000","last_became_peered":"2024-05-09T09:47:12.195857+0000","last_unstale":"2024-05-09T09:51:34.234278+0000","last_undegraded":"2024-05-09T09:51:34.234278+0000","last_fullsized":"2024-05-09T09:51:34.234278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:34.233870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:34.233870+0000","last_clean_scrub_stamp":"2024-05-09T09:51:34.233870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:40:27.779332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:52.490474+0000","last_change":"2024-05-09T09:50:52.490474+0000","last_active":"2024-05-09T09:50:52.490474+0000","last_peered":"2024-05-09T09:50:52.490474+0000","last_clean":"2024-05-09T09:50:52.490474+0000","last_became_active":"2024-05-09T09:47:16.198551+0000","last_became_peered":"2024-05-09T09:47:16.198551+0000","last_unstale":"2024-05-09T09:50:52.490474+0000","last_undegraded":"2024-05-09T09:50:52.490474+0000","last_fullsized":"2024-05-09T09:50:52.490474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:52.490129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:52.490129+0000","last_clean_scrub_stamp":"2024-05-09T09:50:52.490129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:08:27.216364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'110","reported_seq":166,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:55.303534+0000","last_change":"2024-05-09T09:50:55.303534+0000","last_active":"2024-05-09T09:50:55.303534+0000","last_peered":"2024-05-09T09:50:55.303534+0000","last_clean":"2024-05-09T09:50:55.303534+0000","last_became_active":"2024-05-09T09:47:18.217163+0000","last_became_peered":"2024-05-09T09:47:18.217163+0000","last_unstale":"2024-05-09T09:50:55.303534+0000","last_undegraded":"2024-05-09T09:50:55.303534+0000","last_fullsized":"2024-05-09T09:50:55.303534+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'110","last_scrub_stamp":"2024-05-09T09:50:55.303267+0000","last_deep_scrub":"32'110","last_deep_scrub_stamp":"2024-05-09T09:50:55.303267+0000","last_clean_scrub_stamp":"2024-05-09T09:50:55.303267+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:30:34.471649+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:47.153568+0000","last_change":"2024-05-09T09:50:47.153568+0000","last_active":"2024-05-09T09:50:47.153568+0000","last_peered":"2024-05-09T09:50:47.153568+0000","last_clean":"2024-05-09T09:50:47.153568+0000","last_became_active":"2024-05-09T09:47:20.238369+0000","last_became_peered":"2024-05-09T09:47:20.238369+0000","last_unstale":"2024-05-09T09:50:47.153568+0000","last_undegraded":"2024-05-09T09:50:47.153568+0000","last_fullsized":"2024-05-09T09:50:47.153568+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:47.153312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:47.153312+0000","last_clean_scrub_stamp":"2024-05-09T09:50:47.153312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:16.400691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:21.490513+0000","last_change":"2024-05-09T09:51:21.490513+0000","last_active":"2024-05-09T09:51:21.490513+0000","last_peered":"2024-05-09T09:51:21.490513+0000","last_clean":"2024-05-09T09:51:21.490513+0000","last_became_active":"2024-05-09T09:47:14.187868+0000","last_became_peered":"2024-05-09T09:47:14.187868+0000","last_unstale":"2024-05-09T09:51:21.490513+0000","last_undegraded":"2024-05-09T09:51:21.490513+0000","last_fullsized":"2024-05-09T09:51:21.490513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-09T09:51:21.490253+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-09T09:51:21.490253+0000","last_clean_scrub_stamp":"2024-05-09T09:51:21.490253+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:21:46.793888+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:38.496075+0000","last_change":"2024-05-09T09:51:38.496075+0000","last_active":"2024-05-09T09:51:38.496075+0000","last_peered":"2024-05-09T09:51:38.496075+0000","last_clean":"2024-05-09T09:51:38.496075+0000","last_became_active":"2024-05-09T09:47:12.208209+0000","last_became_peered":"2024-05-09T09:47:12.208209+0000","last_unstale":"2024-05-09T09:51:38.496075+0000","last_undegraded":"2024-05-09T09:51:38.496075+0000","last_fullsized":"2024-05-09T09:51:38.496075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:38.495753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:38.495753+0000","last_clean_scrub_stamp":"2024-05-09T09:51:38.495753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:37:11.624510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:09.038896+0000","last_change":"2024-05-09T09:51:09.038896+0000","last_active":"2024-05-09T09:51:09.038896+0000","last_peered":"2024-05-09T09:51:09.038896+0000","last_clean":"2024-05-09T09:51:09.038896+0000","last_became_active":"2024-05-09T09:47:16.182766+0000","last_became_peered":"2024-05-09T09:47:16.182766+0000","last_unstale":"2024-05-09T09:51:09.038896+0000","last_undegraded":"2024-05-09T09:51:09.038896+0000","last_fullsized":"2024-05-09T09:51:09.038896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:09.038645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:09.038645+0000","last_clean_scrub_stamp":"2024-05-09T09:51:09.038645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:34:44.054800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'211","reported_seq":285,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:50.874747+0000","last_change":"2024-05-09T09:50:50.874747+0000","last_active":"2024-05-09T09:50:50.874747+0000","last_peered":"2024-05-09T09:50:50.874747+0000","last_clean":"2024-05-09T09:50:50.874747+0000","last_became_active":"2024-05-09T09:47:18.225074+0000","last_became_peered":"2024-05-09T09:47:18.225074+0000","last_unstale":"2024-05-09T09:50:50.874747+0000","last_undegraded":"2024-05-09T09:50:50.874747+0000","last_fullsized":"2024-05-09T09:50:50.874747+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'211","last_scrub_stamp":"2024-05-09T09:50:50.874475+0000","last_deep_scrub":"32'211","last_deep_scrub_stamp":"2024-05-09T09:50:50.874475+0000","last_clean_scrub_stamp":"2024-05-09T09:50:50.874475+0000","objects_scrubbed":5,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:47.628582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:46.119770+0000","last_change":"2024-05-09T09:50:46.119770+0000","last_active":"2024-05-09T09:50:46.119770+0000","last_peered":"2024-05-09T09:50:46.119770+0000","last_clean":"2024-05-09T09:50:46.119770+0000","last_became_active":"2024-05-09T09:47:20.241372+0000","last_became_peered":"2024-05-09T09:47:20.241372+0000","last_unstale":"2024-05-09T09:50:46.119770+0000","last_undegraded":"2024-05-09T09:50:46.119770+0000","last_fullsized":"2024-05-09T09:50:46.119770+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:46.119515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:46.119515+0000","last_clean_scrub_stamp":"2024-05-09T09:50:46.119515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:34:19.012893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:47.249378+0000","last_change":"2024-05-09T09:51:47.249378+0000","last_active":"2024-05-09T09:51:47.249378+0000","last_peered":"2024-05-09T09:51:47.249378+0000","last_clean":"2024-05-09T09:51:47.249378+0000","last_became_active":"2024-05-09T09:47:22.259589+0000","last_became_peered":"2024-05-09T09:47:22.259589+0000","last_unstale":"2024-05-09T09:51:47.249378+0000","last_undegraded":"2024-05-09T09:51:47.249378+0000","last_fullsized":"2024-05-09T09:51:47.249378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-05-09T09:51:47.249113+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-05-09T09:51:47.249113+0000","last_clean_scrub_stamp":"2024-05-09T09:51:47.249113+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:12:38.800416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'8","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:22.285662+0000","last_change":"2024-05-09T09:51:22.285724+0000","last_active":"2024-05-09T09:51:22.285662+0000","last_peered":"2024-05-09T09:51:22.285662+0000","last_clean":"2024-05-09T09:51:22.285662+0000","last_became_active":"2024-05-09T09:47:14.174371+0000","last_became_peered":"2024-05-09T09:47:14.174371+0000","last_unstale":"2024-05-09T09:51:22.285662+0000","last_undegraded":"2024-05-09T09:51:22.285662+0000","last_fullsized":"2024-05-09T09:51:22.285662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:22.285472+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:22.285472+0000","last_clean_scrub_stamp":"2024-05-09T09:51:22.285472+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:31:43.895778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:37.242716+0000","last_change":"2024-05-09T09:51:37.242716+0000","last_active":"2024-05-09T09:51:37.242716+0000","last_peered":"2024-05-09T09:51:37.242716+0000","last_clean":"2024-05-09T09:51:37.242716+0000","last_became_active":"2024-05-09T09:47:12.196881+0000","last_became_peered":"2024-05-09T09:47:12.196881+0000","last_unstale":"2024-05-09T09:51:37.242716+0000","last_undegraded":"2024-05-09T09:51:37.242716+0000","last_fullsized":"2024-05-09T09:51:37.242716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:37.242412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:37.242412+0000","last_clean_scrub_stamp":"2024-05-09T09:51:37.242412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:24:51.552770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:05.284242+0000","last_change":"2024-05-09T09:51:05.284242+0000","last_active":"2024-05-09T09:51:05.284242+0000","last_peered":"2024-05-09T09:51:05.284242+0000","last_clean":"2024-05-09T09:51:05.284242+0000","last_became_active":"2024-05-09T09:47:16.188611+0000","last_became_peered":"2024-05-09T09:47:16.188611+0000","last_unstale":"2024-05-09T09:51:05.284242+0000","last_undegraded":"2024-05-09T09:51:05.284242+0000","last_fullsized":"2024-05-09T09:51:05.284242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:05.283953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:05.283953+0000","last_clean_scrub_stamp":"2024-05-09T09:51:05.283953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:53:42.383540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'119","reported_seq":178,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:55.469398+0000","last_change":"2024-05-09T09:50:55.469398+0000","last_active":"2024-05-09T09:50:55.469398+0000","last_peered":"2024-05-09T09:50:55.469398+0000","last_clean":"2024-05-09T09:50:55.469398+0000","last_became_active":"2024-05-09T09:47:18.232435+0000","last_became_peered":"2024-05-09T09:47:18.232435+0000","last_unstale":"2024-05-09T09:50:55.469398+0000","last_undegraded":"2024-05-09T09:50:55.469398+0000","last_fullsized":"2024-05-09T09:50:55.469398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-05-09T09:50:55.468997+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-05-09T09:50:55.468997+0000","last_clean_scrub_stamp":"2024-05-09T09:50:55.468997+0000","objects_scrubbed":7,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:10:29.577014+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:00.251832+0000","last_change":"2024-05-09T09:51:00.251832+0000","last_active":"2024-05-09T09:51:00.251832+0000","last_peered":"2024-05-09T09:51:00.251832+0000","last_clean":"2024-05-09T09:51:00.251832+0000","last_became_active":"2024-05-09T09:47:20.241935+0000","last_became_peered":"2024-05-09T09:47:20.241935+0000","last_unstale":"2024-05-09T09:51:00.251832+0000","last_undegraded":"2024-05-09T09:51:00.251832+0000","last_fullsized":"2024-05-09T09:51:00.251832+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:00.251488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:00.251488+0000","last_clean_scrub_stamp":"2024-05-09T09:51:00.251488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:57:35.112556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:15.485482+0000","last_change":"2024-05-09T09:51:15.485482+0000","last_active":"2024-05-09T09:51:15.485482+0000","last_peered":"2024-05-09T09:51:15.485482+0000","last_clean":"2024-05-09T09:51:15.485482+0000","last_became_active":"2024-05-09T09:47:22.241067+0000","last_became_peered":"2024-05-09T09:47:22.241067+0000","last_unstale":"2024-05-09T09:51:15.485482+0000","last_undegraded":"2024-05-09T09:51:15.485482+0000","last_fullsized":"2024-05-09T09:51:15.485482+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:15.485109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:15.485109+0000","last_clean_scrub_stamp":"2024-05-09T09:51:15.485109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:38.931364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:04.473973+0000","last_change":"2024-05-09T09:51:04.473973+0000","last_active":"2024-05-09T09:51:04.473973+0000","last_peered":"2024-05-09T09:51:04.473973+0000","last_clean":"2024-05-09T09:51:04.473973+0000","last_became_active":"2024-05-09T09:47:14.191459+0000","last_became_peered":"2024-05-09T09:47:14.191459+0000","last_unstale":"2024-05-09T09:51:04.473973+0000","last_undegraded":"2024-05-09T09:51:04.473973+0000","last_fullsized":"2024-05-09T09:51:04.473973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:04.473723+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:04.473723+0000","last_clean_scrub_stamp":"2024-05-09T09:51:04.473723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:30:16.341639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:32.249279+0000","last_change":"2024-05-09T09:51:32.249279+0000","last_active":"2024-05-09T09:51:32.249279+0000","last_peered":"2024-05-09T09:51:32.249279+0000","last_clean":"2024-05-09T09:51:32.249279+0000","last_became_active":"2024-05-09T09:47:12.191204+0000","last_became_peered":"2024-05-09T09:47:12.191204+0000","last_unstale":"2024-05-09T09:51:32.249279+0000","last_undegraded":"2024-05-09T09:51:32.249279+0000","last_fullsized":"2024-05-09T09:51:32.249279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:32.248976+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:32.248976+0000","last_clean_scrub_stamp":"2024-05-09T09:51:32.248976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:11:16.563523+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:04.313828+0000","last_change":"2024-05-09T09:51:04.313828+0000","last_active":"2024-05-09T09:51:04.313828+0000","last_peered":"2024-05-09T09:51:04.313828+0000","last_clean":"2024-05-09T09:51:04.313828+0000","last_became_active":"2024-05-09T09:47:16.194314+0000","last_became_peered":"2024-05-09T09:47:16.194314+0000","last_unstale":"2024-05-09T09:51:04.313828+0000","last_undegraded":"2024-05-09T09:51:04.313828+0000","last_fullsized":"2024-05-09T09:51:04.313828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:04.313561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:04.313561+0000","last_clean_scrub_stamp":"2024-05-09T09:51:04.313561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:23:40.119184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'113","reported_seq":170,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:52.875802+0000","last_change":"2024-05-09T09:50:52.875802+0000","last_active":"2024-05-09T09:50:52.875802+0000","last_peered":"2024-05-09T09:50:52.875802+0000","last_clean":"2024-05-09T09:50:52.875802+0000","last_became_active":"2024-05-09T09:47:18.209099+0000","last_became_peered":"2024-05-09T09:47:18.209099+0000","last_unstale":"2024-05-09T09:50:52.875802+0000","last_undegraded":"2024-05-09T09:50:52.875802+0000","last_fullsized":"2024-05-09T09:50:52.875802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'113","last_scrub_stamp":"2024-05-09T09:50:52.875426+0000","last_deep_scrub":"32'113","last_deep_scrub_stamp":"2024-05-09T09:50:52.875426+0000","last_clean_scrub_stamp":"2024-05-09T09:50:52.875426+0000","objects_scrubbed":5,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:17:15.117146+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:44.866730+0000","last_change":"2024-05-09T09:50:44.866730+0000","last_active":"2024-05-09T09:50:44.866730+0000","last_peered":"2024-05-09T09:50:44.866730+0000","last_clean":"2024-05-09T09:50:44.866730+0000","last_became_active":"2024-05-09T09:47:20.241900+0000","last_became_peered":"2024-05-09T09:47:20.241900+0000","last_unstale":"2024-05-09T09:50:44.866730+0000","last_undegraded":"2024-05-09T09:50:44.866730+0000","last_fullsized":"2024-05-09T09:50:44.866730+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:44.866482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:44.866482+0000","last_clean_scrub_stamp":"2024-05-09T09:50:44.866482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:26:17.791183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'5","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:52:05.354813+0000","last_change":"2024-05-09T09:52:05.354940+0000","last_active":"2024-05-09T09:52:05.354813+0000","last_peered":"2024-05-09T09:52:05.354813+0000","last_clean":"2024-05-09T09:52:05.354813+0000","last_became_active":"2024-05-09T09:47:22.263730+0000","last_became_peered":"2024-05-09T09:47:22.263730+0000","last_unstale":"2024-05-09T09:52:05.354813+0000","last_undegraded":"2024-05-09T09:52:05.354813+0000","last_fullsized":"2024-05-09T09:52:05.354813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-09T09:52:05.354570+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-09T09:52:05.354570+0000","last_clean_scrub_stamp":"2024-05-09T09:52:05.354570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:17:55.172844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'6","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:12.090710+0000","last_change":"2024-05-09T09:51:12.090710+0000","last_active":"2024-05-09T09:51:12.090710+0000","last_peered":"2024-05-09T09:51:12.090710+0000","last_clean":"2024-05-09T09:51:12.090710+0000","last_became_active":"2024-05-09T09:47:14.189561+0000","last_became_peered":"2024-05-09T09:47:14.189561+0000","last_unstale":"2024-05-09T09:51:12.090710+0000","last_undegraded":"2024-05-09T09:51:12.090710+0000","last_fullsized":"2024-05-09T09:51:12.090710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:12.090429+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:12.090429+0000","last_clean_scrub_stamp":"2024-05-09T09:51:12.090429+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:00.491368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:34.462352+0000","last_change":"2024-05-09T09:51:34.462352+0000","last_active":"2024-05-09T09:51:34.462352+0000","last_peered":"2024-05-09T09:51:34.462352+0000","last_clean":"2024-05-09T09:51:34.462352+0000","last_became_active":"2024-05-09T09:47:12.214816+0000","last_became_peered":"2024-05-09T09:47:12.214816+0000","last_unstale":"2024-05-09T09:51:34.462352+0000","last_undegraded":"2024-05-09T09:51:34.462352+0000","last_fullsized":"2024-05-09T09:51:34.462352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:34.461979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:34.461979+0000","last_clean_scrub_stamp":"2024-05-09T09:51:34.461979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:57:32.758279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:59.288294+0000","last_change":"2024-05-09T09:50:59.288294+0000","last_active":"2024-05-09T09:50:59.288294+0000","last_peered":"2024-05-09T09:50:59.288294+0000","last_clean":"2024-05-09T09:50:59.288294+0000","last_became_active":"2024-05-09T09:47:16.210567+0000","last_became_peered":"2024-05-09T09:47:16.210567+0000","last_unstale":"2024-05-09T09:50:59.288294+0000","last_undegraded":"2024-05-09T09:50:59.288294+0000","last_fullsized":"2024-05-09T09:50:59.288294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:59.287849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:59.287849+0000","last_clean_scrub_stamp":"2024-05-09T09:50:59.287849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:11:15.215672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:03.498249+0000","last_change":"2024-05-09T09:51:03.498249+0000","last_active":"2024-05-09T09:51:03.498249+0000","last_peered":"2024-05-09T09:51:03.498249+0000","last_clean":"2024-05-09T09:51:03.498249+0000","last_became_active":"2024-05-09T09:47:18.234113+0000","last_became_peered":"2024-05-09T09:47:18.234113+0000","last_unstale":"2024-05-09T09:51:03.498249+0000","last_undegraded":"2024-05-09T09:51:03.498249+0000","last_fullsized":"2024-05-09T09:51:03.498249+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-09T09:51:03.497977+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-09T09:51:03.497977+0000","last_clean_scrub_stamp":"2024-05-09T09:51:03.497977+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:59:01.761215+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":381,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:54.255293+0000","last_change":"2024-05-09T09:50:54.255293+0000","last_active":"2024-05-09T09:50:54.255293+0000","last_peered":"2024-05-09T09:50:54.255293+0000","last_clean":"2024-05-09T09:50:54.255293+0000","last_became_active":"2024-05-09T09:47:20.254573+0000","last_became_peered":"2024-05-09T09:47:20.254573+0000","last_unstale":"2024-05-09T09:50:54.255293+0000","last_undegraded":"2024-05-09T09:50:54.255293+0000","last_fullsized":"2024-05-09T09:50:54.255293+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-09T09:50:54.255008+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-09T09:50:54.255008+0000","last_clean_scrub_stamp":"2024-05-09T09:50:54.255008+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:33:59.828045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:23.485708+0000","last_change":"2024-05-09T09:51:23.485708+0000","last_active":"2024-05-09T09:51:23.485708+0000","last_peered":"2024-05-09T09:51:23.485708+0000","last_clean":"2024-05-09T09:51:23.485708+0000","last_became_active":"2024-05-09T09:47:22.243234+0000","last_became_peered":"2024-05-09T09:47:22.243234+0000","last_unstale":"2024-05-09T09:51:23.485708+0000","last_undegraded":"2024-05-09T09:51:23.485708+0000","last_fullsized":"2024-05-09T09:51:23.485708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:23.485408+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:23.485408+0000","last_clean_scrub_stamp":"2024-05-09T09:51:23.485408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:06:13.197033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:32.187038+0000","last_change":"2024-05-09T09:51:32.187038+0000","last_active":"2024-05-09T09:51:32.187038+0000","last_peered":"2024-05-09T09:51:32.187038+0000","last_clean":"2024-05-09T09:51:32.187038+0000","last_became_active":"2024-05-09T09:47:14.188222+0000","last_became_peered":"2024-05-09T09:47:14.188222+0000","last_unstale":"2024-05-09T09:51:32.187038+0000","last_undegraded":"2024-05-09T09:51:32.187038+0000","last_fullsized":"2024-05-09T09:51:32.187038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:32.186791+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:32.186791+0000","last_clean_scrub_stamp":"2024-05-09T09:51:32.186791+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:39:54.063094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:36.228464+0000","last_change":"2024-05-09T09:51:36.228464+0000","last_active":"2024-05-09T09:51:36.228464+0000","last_peered":"2024-05-09T09:51:36.228464+0000","last_clean":"2024-05-09T09:51:36.228464+0000","last_became_active":"2024-05-09T09:47:12.195936+0000","last_became_peered":"2024-05-09T09:47:12.195936+0000","last_unstale":"2024-05-09T09:51:36.228464+0000","last_undegraded":"2024-05-09T09:51:36.228464+0000","last_fullsized":"2024-05-09T09:51:36.228464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:36.228198+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:36.228198+0000","last_clean_scrub_stamp":"2024-05-09T09:51:36.228198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:56:14.740338+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:54.288244+0000","last_change":"2024-05-09T09:50:54.288244+0000","last_active":"2024-05-09T09:50:54.288244+0000","last_peered":"2024-05-09T09:50:54.288244+0000","last_clean":"2024-05-09T09:50:54.288244+0000","last_became_active":"2024-05-09T09:47:16.210901+0000","last_became_peered":"2024-05-09T09:47:16.210901+0000","last_unstale":"2024-05-09T09:50:54.288244+0000","last_undegraded":"2024-05-09T09:50:54.288244+0000","last_fullsized":"2024-05-09T09:50:54.288244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:54.287951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:54.287951+0000","last_clean_scrub_stamp":"2024-05-09T09:50:54.287951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:00:20.805979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'120","reported_seq":179,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:51.351295+0000","last_change":"2024-05-09T09:50:51.351295+0000","last_active":"2024-05-09T09:50:51.351295+0000","last_peered":"2024-05-09T09:50:51.351295+0000","last_clean":"2024-05-09T09:50:51.351295+0000","last_became_active":"2024-05-09T09:47:18.202069+0000","last_became_peered":"2024-05-09T09:47:18.202069+0000","last_unstale":"2024-05-09T09:50:51.351295+0000","last_undegraded":"2024-05-09T09:50:51.351295+0000","last_fullsized":"2024-05-09T09:50:51.351295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'120","last_scrub_stamp":"2024-05-09T09:50:51.351014+0000","last_deep_scrub":"32'120","last_deep_scrub_stamp":"2024-05-09T09:50:51.351014+0000","last_clean_scrub_stamp":"2024-05-09T09:50:51.351014+0000","objects_scrubbed":7,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:19:59.652432+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:49.840978+0000","last_change":"2024-05-09T09:50:49.840978+0000","last_active":"2024-05-09T09:50:49.840978+0000","last_peered":"2024-05-09T09:50:49.840978+0000","last_clean":"2024-05-09T09:50:49.840978+0000","last_became_active":"2024-05-09T09:47:20.250194+0000","last_became_peered":"2024-05-09T09:47:20.250194+0000","last_unstale":"2024-05-09T09:50:49.840978+0000","last_undegraded":"2024-05-09T09:50:49.840978+0000","last_fullsized":"2024-05-09T09:50:49.840978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:50:49.840731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:50:49.840731+0000","last_clean_scrub_stamp":"2024-05-09T09:50:49.840731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:28:16.883808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:12.276130+0000","last_change":"2024-05-09T09:51:12.276130+0000","last_active":"2024-05-09T09:51:12.276130+0000","last_peered":"2024-05-09T09:51:12.276130+0000","last_clean":"2024-05-09T09:51:12.276130+0000","last_became_active":"2024-05-09T09:47:22.239300+0000","last_became_peered":"2024-05-09T09:47:22.239300+0000","last_unstale":"2024-05-09T09:51:12.276130+0000","last_undegraded":"2024-05-09T09:51:12.276130+0000","last_fullsized":"2024-05-09T09:51:12.276130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:12.275835+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:12.275835+0000","last_clean_scrub_stamp":"2024-05-09T09:51:12.275835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:16:27.063514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'10","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:22.276099+0000","last_change":"2024-05-09T09:51:22.276099+0000","last_active":"2024-05-09T09:51:22.276099+0000","last_peered":"2024-05-09T09:51:22.276099+0000","last_clean":"2024-05-09T09:51:22.276099+0000","last_became_active":"2024-05-09T09:47:14.187951+0000","last_became_peered":"2024-05-09T09:47:14.187951+0000","last_unstale":"2024-05-09T09:51:22.276099+0000","last_undegraded":"2024-05-09T09:51:22.276099+0000","last_fullsized":"2024-05-09T09:51:22.276099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-09T09:51:22.275813+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-09T09:51:22.275813+0000","last_clean_scrub_stamp":"2024-05-09T09:51:22.275813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:33.300865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:37.465245+0000","last_change":"2024-05-09T09:51:37.465245+0000","last_active":"2024-05-09T09:51:37.465245+0000","last_peered":"2024-05-09T09:51:37.465245+0000","last_clean":"2024-05-09T09:51:37.465245+0000","last_became_active":"2024-05-09T09:47:12.203827+0000","last_became_peered":"2024-05-09T09:47:12.203827+0000","last_unstale":"2024-05-09T09:51:37.465245+0000","last_undegraded":"2024-05-09T09:51:37.465245+0000","last_fullsized":"2024-05-09T09:51:37.465245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:37.464973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:37.464973+0000","last_clean_scrub_stamp":"2024-05-09T09:51:37.464973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:31:23.921813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:03.316512+0000","last_change":"2024-05-09T09:51:03.316512+0000","last_active":"2024-05-09T09:51:03.316512+0000","last_peered":"2024-05-09T09:51:03.316512+0000","last_clean":"2024-05-09T09:51:03.316512+0000","last_became_active":"2024-05-09T09:47:16.196193+0000","last_became_peered":"2024-05-09T09:47:16.196193+0000","last_unstale":"2024-05-09T09:51:03.316512+0000","last_undegraded":"2024-05-09T09:51:03.316512+0000","last_fullsized":"2024-05-09T09:51:03.316512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:03.316273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:03.316273+0000","last_clean_scrub_stamp":"2024-05-09T09:51:03.316273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:59:34.812456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'113","reported_seq":169,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:55.923928+0000","last_change":"2024-05-09T09:50:55.923928+0000","last_active":"2024-05-09T09:50:55.923928+0000","last_peered":"2024-05-09T09:50:55.923928+0000","last_clean":"2024-05-09T09:50:55.923928+0000","last_became_active":"2024-05-09T09:47:18.199627+0000","last_became_peered":"2024-05-09T09:47:18.199627+0000","last_unstale":"2024-05-09T09:50:55.923928+0000","last_undegraded":"2024-05-09T09:50:55.923928+0000","last_fullsized":"2024-05-09T09:50:55.923928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'113","last_scrub_stamp":"2024-05-09T09:50:55.923673+0000","last_deep_scrub":"32'113","last_deep_scrub_stamp":"2024-05-09T09:50:55.923673+0000","last_clean_scrub_stamp":"2024-05-09T09:50:55.923673+0000","objects_scrubbed":4,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:11:11.851496+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:07.405300+0000","last_change":"2024-05-09T09:51:07.405300+0000","last_active":"2024-05-09T09:51:07.405300+0000","last_peered":"2024-05-09T09:51:07.405300+0000","last_clean":"2024-05-09T09:51:07.405300+0000","last_became_active":"2024-05-09T09:47:20.251642+0000","last_became_peered":"2024-05-09T09:47:20.251642+0000","last_unstale":"2024-05-09T09:51:07.405300+0000","last_undegraded":"2024-05-09T09:51:07.405300+0000","last_fullsized":"2024-05-09T09:51:07.405300+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:07.405060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:07.405060+0000","last_clean_scrub_stamp":"2024-05-09T09:51:07.405060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:31:29.015365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:52:03.316442+0000","last_change":"2024-05-09T09:52:03.316442+0000","last_active":"2024-05-09T09:52:03.316442+0000","last_peered":"2024-05-09T09:52:03.316442+0000","last_clean":"2024-05-09T09:52:03.316442+0000","last_became_active":"2024-05-09T09:47:22.261164+0000","last_became_peered":"2024-05-09T09:47:22.261164+0000","last_unstale":"2024-05-09T09:52:03.316442+0000","last_undegraded":"2024-05-09T09:52:03.316442+0000","last_fullsized":"2024-05-09T09:52:03.316442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:52:03.316195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:52:03.316195+0000","last_clean_scrub_stamp":"2024-05-09T09:52:03.316195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:47:29.457535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'8","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:26.443657+0000","last_change":"2024-05-09T09:51:26.443657+0000","last_active":"2024-05-09T09:51:26.443657+0000","last_peered":"2024-05-09T09:51:26.443657+0000","last_clean":"2024-05-09T09:51:26.443657+0000","last_became_active":"2024-05-09T09:47:14.185270+0000","last_became_peered":"2024-05-09T09:47:14.185270+0000","last_unstale":"2024-05-09T09:51:26.443657+0000","last_undegraded":"2024-05-09T09:51:26.443657+0000","last_fullsized":"2024-05-09T09:51:26.443657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:26.443394+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:26.443394+0000","last_clean_scrub_stamp":"2024-05-09T09:51:26.443394+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:21.088972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:36.249899+0000","last_change":"2024-05-09T09:51:36.249959+0000","last_active":"2024-05-09T09:51:36.249899+0000","last_peered":"2024-05-09T09:51:36.249899+0000","last_clean":"2024-05-09T09:51:36.249899+0000","last_became_active":"2024-05-09T09:47:12.183985+0000","last_became_peered":"2024-05-09T09:47:12.183985+0000","last_unstale":"2024-05-09T09:51:36.249899+0000","last_undegraded":"2024-05-09T09:51:36.249899+0000","last_fullsized":"2024-05-09T09:51:36.249899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:36.249688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:36.249688+0000","last_clean_scrub_stamp":"2024-05-09T09:51:36.249688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:22:01.553324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:01.251716+0000","last_change":"2024-05-09T09:51:01.251716+0000","last_active":"2024-05-09T09:51:01.251716+0000","last_peered":"2024-05-09T09:51:01.251716+0000","last_clean":"2024-05-09T09:51:01.251716+0000","last_became_active":"2024-05-09T09:47:16.207467+0000","last_became_peered":"2024-05-09T09:47:16.207467+0000","last_unstale":"2024-05-09T09:51:01.251716+0000","last_undegraded":"2024-05-09T09:51:01.251716+0000","last_fullsized":"2024-05-09T09:51:01.251716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:01.251471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:01.251471+0000","last_clean_scrub_stamp":"2024-05-09T09:51:01.251471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:38:45.710781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'106","reported_seq":160,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:14.506957+0000","last_change":"2024-05-09T09:51:14.506957+0000","last_active":"2024-05-09T09:51:14.506957+0000","last_peered":"2024-05-09T09:51:14.506957+0000","last_clean":"2024-05-09T09:51:14.506957+0000","last_became_active":"2024-05-09T09:47:18.235557+0000","last_became_peered":"2024-05-09T09:47:18.235557+0000","last_unstale":"2024-05-09T09:51:14.506957+0000","last_undegraded":"2024-05-09T09:51:14.506957+0000","last_fullsized":"2024-05-09T09:51:14.506957+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'106","last_scrub_stamp":"2024-05-09T09:51:14.506702+0000","last_deep_scrub":"32'106","last_deep_scrub_stamp":"2024-05-09T09:51:14.506702+0000","last_clean_scrub_stamp":"2024-05-09T09:51:14.506702+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:14:13.534344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:10.463461+0000","last_change":"2024-05-09T09:51:10.463461+0000","last_active":"2024-05-09T09:51:10.463461+0000","last_peered":"2024-05-09T09:51:10.463461+0000","last_clean":"2024-05-09T09:51:10.463461+0000","last_became_active":"2024-05-09T09:47:20.231750+0000","last_became_peered":"2024-05-09T09:47:20.231750+0000","last_unstale":"2024-05-09T09:51:10.463461+0000","last_undegraded":"2024-05-09T09:51:10.463461+0000","last_fullsized":"2024-05-09T09:51:10.463461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:10.463214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:10.463214+0000","last_clean_scrub_stamp":"2024-05-09T09:51:10.463214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:19.664307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'8","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:52:02.326677+0000","last_change":"2024-05-09T09:52:02.326677+0000","last_active":"2024-05-09T09:52:02.326677+0000","last_peered":"2024-05-09T09:52:02.326677+0000","last_clean":"2024-05-09T09:52:02.326677+0000","last_became_active":"2024-05-09T09:47:22.256398+0000","last_became_peered":"2024-05-09T09:47:22.256398+0000","last_unstale":"2024-05-09T09:52:02.326677+0000","last_undegraded":"2024-05-09T09:52:02.326677+0000","last_fullsized":"2024-05-09T09:52:02.326677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:52:02.326427+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:52:02.326427+0000","last_clean_scrub_stamp":"2024-05-09T09:52:02.326427+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:47:04.771667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'22","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:07.373119+0000","last_change":"2024-05-09T09:51:07.373119+0000","last_active":"2024-05-09T09:51:07.373119+0000","last_peered":"2024-05-09T09:51:07.373119+0000","last_clean":"2024-05-09T09:51:07.373119+0000","last_became_active":"2024-05-09T09:47:14.188980+0000","last_became_peered":"2024-05-09T09:47:14.188980+0000","last_unstale":"2024-05-09T09:51:07.373119+0000","last_undegraded":"2024-05-09T09:51:07.373119+0000","last_fullsized":"2024-05-09T09:51:07.373119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-05-09T09:51:07.372874+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-05-09T09:51:07.372874+0000","last_clean_scrub_stamp":"2024-05-09T09:51:07.372874+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:38.613364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:21.338164+0000","last_change":"2024-05-09T09:51:21.338164+0000","last_active":"2024-05-09T09:51:21.338164+0000","last_peered":"2024-05-09T09:51:21.338164+0000","last_clean":"2024-05-09T09:51:21.338164+0000","last_became_active":"2024-05-09T09:47:12.206136+0000","last_became_peered":"2024-05-09T09:47:12.206136+0000","last_unstale":"2024-05-09T09:51:21.338164+0000","last_undegraded":"2024-05-09T09:51:21.338164+0000","last_fullsized":"2024-05-09T09:51:21.338164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:21.337902+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:21.337902+0000","last_clean_scrub_stamp":"2024-05-09T09:51:21.337902+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:37:41.599167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:58.281584+0000","last_change":"2024-05-09T09:50:58.281584+0000","last_active":"2024-05-09T09:50:58.281584+0000","last_peered":"2024-05-09T09:50:58.281584+0000","last_clean":"2024-05-09T09:50:58.281584+0000","last_became_active":"2024-05-09T09:47:16.210958+0000","last_became_peered":"2024-05-09T09:47:16.210958+0000","last_unstale":"2024-05-09T09:50:58.281584+0000","last_undegraded":"2024-05-09T09:50:58.281584+0000","last_fullsized":"2024-05-09T09:50:58.281584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-09T09:50:58.281299+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-09T09:50:58.281299+0000","last_clean_scrub_stamp":"2024-05-09T09:50:58.281299+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:37:19.402856+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'114","reported_seq":172,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:50:59.461850+0000","last_change":"2024-05-09T09:50:59.461850+0000","last_active":"2024-05-09T09:50:59.461850+0000","last_peered":"2024-05-09T09:50:59.461850+0000","last_clean":"2024-05-09T09:50:59.461850+0000","last_became_active":"2024-05-09T09:47:18.233552+0000","last_became_peered":"2024-05-09T09:47:18.233552+0000","last_unstale":"2024-05-09T09:50:59.461850+0000","last_undegraded":"2024-05-09T09:50:59.461850+0000","last_fullsized":"2024-05-09T09:50:59.461850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'114","last_scrub_stamp":"2024-05-09T09:50:59.461590+0000","last_deep_scrub":"32'114","last_deep_scrub_stamp":"2024-05-09T09:50:59.461590+0000","last_clean_scrub_stamp":"2024-05-09T09:50:59.461590+0000","objects_scrubbed":5,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:45:09.985421+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:06.027552+0000","last_change":"2024-05-09T09:51:06.027552+0000","last_active":"2024-05-09T09:51:06.027552+0000","last_peered":"2024-05-09T09:51:06.027552+0000","last_clean":"2024-05-09T09:51:06.027552+0000","last_became_active":"2024-05-09T09:47:20.254083+0000","last_became_peered":"2024-05-09T09:47:20.254083+0000","last_unstale":"2024-05-09T09:51:06.027552+0000","last_undegraded":"2024-05-09T09:51:06.027552+0000","last_fullsized":"2024-05-09T09:51:06.027552+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:06.027177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:06.027177+0000","last_clean_scrub_stamp":"2024-05-09T09:51:06.027177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:03:51.192288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:31.567995+0000","last_change":"2024-05-09T09:51:31.567995+0000","last_active":"2024-05-09T09:51:31.567995+0000","last_peered":"2024-05-09T09:51:31.567995+0000","last_clean":"2024-05-09T09:51:31.567995+0000","last_became_active":"2024-05-09T09:47:22.254386+0000","last_became_peered":"2024-05-09T09:47:22.254386+0000","last_unstale":"2024-05-09T09:51:31.567995+0000","last_undegraded":"2024-05-09T09:51:31.567995+0000","last_fullsized":"2024-05-09T09:51:31.567995+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:31.567738+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:31.567738+0000","last_clean_scrub_stamp":"2024-05-09T09:51:31.567738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:09:40.249232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'14","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:13.284595+0000","last_change":"2024-05-09T09:51:13.284595+0000","last_active":"2024-05-09T09:51:13.284595+0000","last_peered":"2024-05-09T09:51:13.284595+0000","last_clean":"2024-05-09T09:51:13.284595+0000","last_became_active":"2024-05-09T09:47:14.174998+0000","last_became_peered":"2024-05-09T09:47:14.174998+0000","last_unstale":"2024-05-09T09:51:13.284595+0000","last_undegraded":"2024-05-09T09:51:13.284595+0000","last_fullsized":"2024-05-09T09:51:13.284595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-05-09T09:51:13.284186+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-05-09T09:51:13.284186+0000","last_clean_scrub_stamp":"2024-05-09T09:51:13.284186+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:34:48.300341+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:26.238694+0000","last_change":"2024-05-09T09:51:26.238755+0000","last_active":"2024-05-09T09:51:26.238694+0000","last_peered":"2024-05-09T09:51:26.238694+0000","last_clean":"2024-05-09T09:51:26.238694+0000","last_became_active":"2024-05-09T09:47:12.192448+0000","last_became_peered":"2024-05-09T09:47:12.192448+0000","last_unstale":"2024-05-09T09:51:26.238694+0000","last_undegraded":"2024-05-09T09:51:26.238694+0000","last_fullsized":"2024-05-09T09:51:26.238694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:26.238496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:26.238496+0000","last_clean_scrub_stamp":"2024-05-09T09:51:26.238496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:48:14.639434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'12","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:15.130886+0000","last_change":"2024-05-09T09:51:15.130886+0000","last_active":"2024-05-09T09:51:15.130886+0000","last_peered":"2024-05-09T09:51:15.130886+0000","last_clean":"2024-05-09T09:51:15.130886+0000","last_became_active":"2024-05-09T09:47:14.188534+0000","last_became_peered":"2024-05-09T09:47:14.188534+0000","last_unstale":"2024-05-09T09:51:15.130886+0000","last_undegraded":"2024-05-09T09:51:15.130886+0000","last_fullsized":"2024-05-09T09:51:15.130886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-09T09:51:15.130629+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-09T09:51:15.130629+0000","last_clean_scrub_stamp":"2024-05-09T09:51:15.130629+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:21:10.701384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":54,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:37.298645+0000","last_change":"2024-05-09T09:51:37.298710+0000","last_active":"2024-05-09T09:51:37.298645+0000","last_peered":"2024-05-09T09:51:37.298645+0000","last_clean":"2024-05-09T09:51:37.298645+0000","last_became_active":"2024-05-09T09:47:12.184353+0000","last_became_peered":"2024-05-09T09:47:12.184353+0000","last_unstale":"2024-05-09T09:51:37.298645+0000","last_undegraded":"2024-05-09T09:51:37.298645+0000","last_fullsized":"2024-05-09T09:51:37.298645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:37.298447+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:37.298447+0000","last_clean_scrub_stamp":"2024-05-09T09:51:37.298447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:02:24.687092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:24.458824+0000","last_change":"2024-05-09T09:51:24.458824+0000","last_active":"2024-05-09T09:51:24.458824+0000","last_peered":"2024-05-09T09:51:24.458824+0000","last_clean":"2024-05-09T09:51:24.458824+0000","last_became_active":"2024-05-09T09:47:14.186689+0000","last_became_peered":"2024-05-09T09:47:14.186689+0000","last_unstale":"2024-05-09T09:51:24.458824+0000","last_undegraded":"2024-05-09T09:51:24.458824+0000","last_fullsized":"2024-05-09T09:51:24.458824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:24.458569+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:24.458569+0000","last_clean_scrub_stamp":"2024-05-09T09:51:24.458569+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:53:49.912270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:47.477436+0000","last_change":"2024-05-09T09:51:47.477492+0000","last_active":"2024-05-09T09:51:47.477436+0000","last_peered":"2024-05-09T09:51:47.477436+0000","last_clean":"2024-05-09T09:51:47.477436+0000","last_became_active":"2024-05-09T09:47:12.209633+0000","last_became_peered":"2024-05-09T09:47:12.209633+0000","last_unstale":"2024-05-09T09:51:47.477436+0000","last_undegraded":"2024-05-09T09:51:47.477436+0000","last_fullsized":"2024-05-09T09:51:47.477436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:47.477235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:47.477235+0000","last_clean_scrub_stamp":"2024-05-09T09:51:47.477235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:44:08.238812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:11.046882+0000","last_change":"2024-05-09T09:51:11.046882+0000","last_active":"2024-05-09T09:51:11.046882+0000","last_peered":"2024-05-09T09:51:11.046882+0000","last_clean":"2024-05-09T09:51:11.046882+0000","last_became_active":"2024-05-09T09:47:14.193366+0000","last_became_peered":"2024-05-09T09:47:14.193366+0000","last_unstale":"2024-05-09T09:51:11.046882+0000","last_undegraded":"2024-05-09T09:51:11.046882+0000","last_fullsized":"2024-05-09T09:51:11.046882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:11.046623+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:11.046623+0000","last_clean_scrub_stamp":"2024-05-09T09:51:11.046623+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:34:07.870070+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:19.202106+0000","last_change":"2024-05-09T09:51:19.202106+0000","last_active":"2024-05-09T09:51:19.202106+0000","last_peered":"2024-05-09T09:51:19.202106+0000","last_clean":"2024-05-09T09:51:19.202106+0000","last_became_active":"2024-05-09T09:47:12.214019+0000","last_became_peered":"2024-05-09T09:47:12.214019+0000","last_unstale":"2024-05-09T09:51:19.202106+0000","last_undegraded":"2024-05-09T09:51:19.202106+0000","last_fullsized":"2024-05-09T09:51:19.202106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:19.201848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:19.201848+0000","last_clean_scrub_stamp":"2024-05-09T09:51:19.201848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T20:30:31.069764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:40.294522+0000","last_change":"2024-05-09T09:51:40.294585+0000","last_active":"2024-05-09T09:51:40.294522+0000","last_peered":"2024-05-09T09:51:40.294522+0000","last_clean":"2024-05-09T09:51:40.294522+0000","last_became_active":"2024-05-09T09:47:14.181824+0000","last_became_peered":"2024-05-09T09:47:14.181824+0000","last_unstale":"2024-05-09T09:51:40.294522+0000","last_undegraded":"2024-05-09T09:51:40.294522+0000","last_fullsized":"2024-05-09T09:51:40.294522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:40.294309+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:40.294309+0000","last_clean_scrub_stamp":"2024-05-09T09:51:40.294309+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:45:56.173489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:27.323249+0000","last_change":"2024-05-09T09:51:27.323249+0000","last_active":"2024-05-09T09:51:27.323249+0000","last_peered":"2024-05-09T09:51:27.323249+0000","last_clean":"2024-05-09T09:51:27.323249+0000","last_became_active":"2024-05-09T09:47:12.204322+0000","last_became_peered":"2024-05-09T09:47:12.204322+0000","last_unstale":"2024-05-09T09:51:27.323249+0000","last_undegraded":"2024-05-09T09:51:27.323249+0000","last_fullsized":"2024-05-09T09:51:27.323249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:27.322986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:27.322986+0000","last_clean_scrub_stamp":"2024-05-09T09:51:27.322986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:11:11.637533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:11.318592+0000","last_change":"2024-05-09T09:51:11.318592+0000","last_active":"2024-05-09T09:51:11.318592+0000","last_peered":"2024-05-09T09:51:11.318592+0000","last_clean":"2024-05-09T09:51:11.318592+0000","last_became_active":"2024-05-09T09:47:14.178503+0000","last_became_peered":"2024-05-09T09:47:14.178503+0000","last_unstale":"2024-05-09T09:51:11.318592+0000","last_undegraded":"2024-05-09T09:51:11.318592+0000","last_fullsized":"2024-05-09T09:51:11.318592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:11.318334+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:11.318334+0000","last_clean_scrub_stamp":"2024-05-09T09:51:11.318334+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:48:38.508221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"30'2","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:35.220050+0000","last_change":"2024-05-09T09:51:35.220206+0000","last_active":"2024-05-09T09:51:35.220050+0000","last_peered":"2024-05-09T09:51:35.220050+0000","last_clean":"2024-05-09T09:51:35.220050+0000","last_became_active":"2024-05-09T09:47:12.196120+0000","last_became_peered":"2024-05-09T09:47:12.196120+0000","last_unstale":"2024-05-09T09:51:35.220050+0000","last_undegraded":"2024-05-09T09:51:35.220050+0000","last_fullsized":"2024-05-09T09:51:35.220050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-09T09:51:35.219793+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-09T09:51:35.219793+0000","last_clean_scrub_stamp":"2024-05-09T09:51:35.219793+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:58.666048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:26.352885+0000","last_change":"2024-05-09T09:51:26.352954+0000","last_active":"2024-05-09T09:51:26.352885+0000","last_peered":"2024-05-09T09:51:26.352885+0000","last_clean":"2024-05-09T09:51:26.352885+0000","last_became_active":"2024-05-09T09:47:14.176615+0000","last_became_peered":"2024-05-09T09:47:14.176615+0000","last_unstale":"2024-05-09T09:51:26.352885+0000","last_undegraded":"2024-05-09T09:51:26.352885+0000","last_fullsized":"2024-05-09T09:51:26.352885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:26.352681+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:26.352681+0000","last_clean_scrub_stamp":"2024-05-09T09:51:26.352681+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:58:17.301653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:13.464266+0000","last_change":"2024-05-09T09:51:13.464266+0000","last_active":"2024-05-09T09:51:13.464266+0000","last_peered":"2024-05-09T09:51:13.464266+0000","last_clean":"2024-05-09T09:51:13.464266+0000","last_became_active":"2024-05-09T09:47:12.209171+0000","last_became_peered":"2024-05-09T09:47:12.209171+0000","last_unstale":"2024-05-09T09:51:13.464266+0000","last_undegraded":"2024-05-09T09:51:13.464266+0000","last_fullsized":"2024-05-09T09:51:13.464266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:13.463897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:13.463897+0000","last_clean_scrub_stamp":"2024-05-09T09:51:13.463897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:36:06.810856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:26.295234+0000","last_change":"2024-05-09T09:51:26.295289+0000","last_active":"2024-05-09T09:51:26.295234+0000","last_peered":"2024-05-09T09:51:26.295234+0000","last_clean":"2024-05-09T09:51:26.295234+0000","last_became_active":"2024-05-09T09:47:14.177119+0000","last_became_peered":"2024-05-09T09:47:14.177119+0000","last_unstale":"2024-05-09T09:51:26.295234+0000","last_undegraded":"2024-05-09T09:51:26.295234+0000","last_fullsized":"2024-05-09T09:51:26.295234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:26.295031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:26.295031+0000","last_clean_scrub_stamp":"2024-05-09T09:51:26.295031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:28:18.150394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:35.259996+0000","last_change":"2024-05-09T09:51:35.260058+0000","last_active":"2024-05-09T09:51:35.259996+0000","last_peered":"2024-05-09T09:51:35.259996+0000","last_clean":"2024-05-09T09:51:35.259996+0000","last_became_active":"2024-05-09T09:47:12.184105+0000","last_became_peered":"2024-05-09T09:47:12.184105+0000","last_unstale":"2024-05-09T09:51:35.259996+0000","last_undegraded":"2024-05-09T09:51:35.259996+0000","last_fullsized":"2024-05-09T09:51:35.259996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:35.259799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:35.259799+0000","last_clean_scrub_stamp":"2024-05-09T09:51:35.259799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:03:53.899773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'2","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:07.276039+0000","last_change":"2024-05-09T09:51:07.276039+0000","last_active":"2024-05-09T09:51:07.276039+0000","last_peered":"2024-05-09T09:51:07.276039+0000","last_clean":"2024-05-09T09:51:07.276039+0000","last_became_active":"2024-05-09T09:47:14.182961+0000","last_became_peered":"2024-05-09T09:47:14.182961+0000","last_unstale":"2024-05-09T09:51:07.276039+0000","last_undegraded":"2024-05-09T09:51:07.276039+0000","last_fullsized":"2024-05-09T09:51:07.276039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:07.275721+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:07.275721+0000","last_clean_scrub_stamp":"2024-05-09T09:51:07.275721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:48:18.587139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:50.481958+0000","last_change":"2024-05-09T09:51:50.482024+0000","last_active":"2024-05-09T09:51:50.481958+0000","last_peered":"2024-05-09T09:51:50.481958+0000","last_clean":"2024-05-09T09:51:50.481958+0000","last_became_active":"2024-05-09T09:47:12.201952+0000","last_became_peered":"2024-05-09T09:47:12.201952+0000","last_unstale":"2024-05-09T09:51:50.481958+0000","last_undegraded":"2024-05-09T09:51:50.481958+0000","last_fullsized":"2024-05-09T09:51:50.481958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:50.481764+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:50.481764+0000","last_clean_scrub_stamp":"2024-05-09T09:51:50.481764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:53:19.714515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:00.474068+0000","last_change":"2024-05-09T09:51:00.474068+0000","last_active":"2024-05-09T09:51:00.474068+0000","last_peered":"2024-05-09T09:51:00.474068+0000","last_clean":"2024-05-09T09:51:00.474068+0000","last_became_active":"2024-05-09T09:47:14.193421+0000","last_became_peered":"2024-05-09T09:47:14.193421+0000","last_unstale":"2024-05-09T09:51:00.474068+0000","last_undegraded":"2024-05-09T09:51:00.474068+0000","last_fullsized":"2024-05-09T09:51:00.474068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:00.473817+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:00.473817+0000","last_clean_scrub_stamp":"2024-05-09T09:51:00.473817+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:20:56.044572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"32'4","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:23.303971+0000","last_change":"2024-05-09T09:51:23.303971+0000","last_active":"2024-05-09T09:51:23.303971+0000","last_peered":"2024-05-09T09:51:23.303971+0000","last_clean":"2024-05-09T09:51:23.303971+0000","last_became_active":"2024-05-09T09:47:12.203523+0000","last_became_peered":"2024-05-09T09:47:12.203523+0000","last_unstale":"2024-05-09T09:51:23.303971+0000","last_undegraded":"2024-05-09T09:51:23.303971+0000","last_fullsized":"2024-05-09T09:51:23.303971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:23.303622+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:23.303622+0000","last_clean_scrub_stamp":"2024-05-09T09:51:23.303622+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:42:02.620894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:16.166971+0000","last_change":"2024-05-09T09:51:16.166971+0000","last_active":"2024-05-09T09:51:16.166971+0000","last_peered":"2024-05-09T09:51:16.166971+0000","last_clean":"2024-05-09T09:51:16.166971+0000","last_became_active":"2024-05-09T09:47:14.171565+0000","last_became_peered":"2024-05-09T09:47:14.171565+0000","last_unstale":"2024-05-09T09:51:16.166971+0000","last_undegraded":"2024-05-09T09:51:16.166971+0000","last_fullsized":"2024-05-09T09:51:16.166971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:16.166561+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:16.166561+0000","last_clean_scrub_stamp":"2024-05-09T09:51:16.166561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:37:36.427827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:33.207783+0000","last_change":"2024-05-09T09:51:33.207783+0000","last_active":"2024-05-09T09:51:33.207783+0000","last_peered":"2024-05-09T09:51:33.207783+0000","last_clean":"2024-05-09T09:51:33.207783+0000","last_became_active":"2024-05-09T09:47:12.192462+0000","last_became_peered":"2024-05-09T09:47:12.192462+0000","last_unstale":"2024-05-09T09:51:33.207783+0000","last_undegraded":"2024-05-09T09:51:33.207783+0000","last_fullsized":"2024-05-09T09:51:33.207783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:33.207312+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:33.207312+0000","last_clean_scrub_stamp":"2024-05-09T09:51:33.207312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:28:11.973689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:28.290430+0000","last_change":"2024-05-09T09:51:28.290430+0000","last_active":"2024-05-09T09:51:28.290430+0000","last_peered":"2024-05-09T09:51:28.290430+0000","last_clean":"2024-05-09T09:51:28.290430+0000","last_became_active":"2024-05-09T09:47:14.176986+0000","last_became_peered":"2024-05-09T09:47:14.176986+0000","last_unstale":"2024-05-09T09:51:28.290430+0000","last_undegraded":"2024-05-09T09:51:28.290430+0000","last_fullsized":"2024-05-09T09:51:28.290430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:28.290172+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:28.290172+0000","last_clean_scrub_stamp":"2024-05-09T09:51:28.290172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:15:50.005621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:29.243256+0000","last_change":"2024-05-09T09:51:29.243256+0000","last_active":"2024-05-09T09:51:29.243256+0000","last_peered":"2024-05-09T09:51:29.243256+0000","last_clean":"2024-05-09T09:51:29.243256+0000","last_became_active":"2024-05-09T09:47:12.205416+0000","last_became_peered":"2024-05-09T09:47:12.205416+0000","last_unstale":"2024-05-09T09:51:29.243256+0000","last_undegraded":"2024-05-09T09:51:29.243256+0000","last_fullsized":"2024-05-09T09:51:29.243256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:29.242902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:29.242902+0000","last_clean_scrub_stamp":"2024-05-09T09:51:29.242902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:27:32.401344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:10.327719+0000","last_change":"2024-05-09T09:51:10.327719+0000","last_active":"2024-05-09T09:51:10.327719+0000","last_peered":"2024-05-09T09:51:10.327719+0000","last_clean":"2024-05-09T09:51:10.327719+0000","last_became_active":"2024-05-09T09:47:14.182248+0000","last_became_peered":"2024-05-09T09:47:14.182248+0000","last_unstale":"2024-05-09T09:51:10.327719+0000","last_undegraded":"2024-05-09T09:51:10.327719+0000","last_fullsized":"2024-05-09T09:51:10.327719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:10.327288+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:10.327288+0000","last_clean_scrub_stamp":"2024-05-09T09:51:10.327288+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:19:34.184047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:46.494521+0000","last_change":"2024-05-09T09:51:46.494590+0000","last_active":"2024-05-09T09:51:46.494521+0000","last_peered":"2024-05-09T09:51:46.494521+0000","last_clean":"2024-05-09T09:51:46.494521+0000","last_became_active":"2024-05-09T09:47:12.200127+0000","last_became_peered":"2024-05-09T09:47:12.200127+0000","last_unstale":"2024-05-09T09:51:46.494521+0000","last_undegraded":"2024-05-09T09:51:46.494521+0000","last_fullsized":"2024-05-09T09:51:46.494521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:46.494326+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:46.494326+0000","last_clean_scrub_stamp":"2024-05-09T09:51:46.494326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:54:21.768687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:05.273679+0000","last_change":"2024-05-09T09:51:05.273679+0000","last_active":"2024-05-09T09:51:05.273679+0000","last_peered":"2024-05-09T09:51:05.273679+0000","last_clean":"2024-05-09T09:51:05.273679+0000","last_became_active":"2024-05-09T09:47:14.190033+0000","last_became_peered":"2024-05-09T09:47:14.190033+0000","last_unstale":"2024-05-09T09:51:05.273679+0000","last_undegraded":"2024-05-09T09:51:05.273679+0000","last_fullsized":"2024-05-09T09:51:05.273679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:05.273418+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:05.273418+0000","last_clean_scrub_stamp":"2024-05-09T09:51:05.273418+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:59:24.394431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:44.536280+0000","last_change":"2024-05-09T09:51:44.536280+0000","last_active":"2024-05-09T09:51:44.536280+0000","last_peered":"2024-05-09T09:51:44.536280+0000","last_clean":"2024-05-09T09:51:44.536280+0000","last_became_active":"2024-05-09T09:47:12.203424+0000","last_became_peered":"2024-05-09T09:47:12.203424+0000","last_unstale":"2024-05-09T09:51:44.536280+0000","last_undegraded":"2024-05-09T09:51:44.536280+0000","last_fullsized":"2024-05-09T09:51:44.536280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-09T09:51:44.535998+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-09T09:51:44.535998+0000","last_clean_scrub_stamp":"2024-05-09T09:51:44.535998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:58:50.456307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:25.488693+0000","last_change":"2024-05-09T09:51:25.488693+0000","last_active":"2024-05-09T09:51:25.488693+0000","last_peered":"2024-05-09T09:51:25.488693+0000","last_clean":"2024-05-09T09:51:25.488693+0000","last_became_active":"2024-05-09T09:47:14.186711+0000","last_became_peered":"2024-05-09T09:47:14.186711+0000","last_unstale":"2024-05-09T09:51:25.488693+0000","last_undegraded":"2024-05-09T09:51:25.488693+0000","last_fullsized":"2024-05-09T09:51:25.488693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:25.488447+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:25.488447+0000","last_clean_scrub_stamp":"2024-05-09T09:51:25.488447+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:56:25.287354+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:17.400209+0000","last_change":"2024-05-09T09:51:17.400209+0000","last_active":"2024-05-09T09:51:17.400209+0000","last_peered":"2024-05-09T09:51:17.400209+0000","last_clean":"2024-05-09T09:51:17.400209+0000","last_became_active":"2024-05-09T09:47:12.205320+0000","last_became_peered":"2024-05-09T09:47:12.205320+0000","last_unstale":"2024-05-09T09:51:17.400209+0000","last_undegraded":"2024-05-09T09:51:17.400209+0000","last_fullsized":"2024-05-09T09:51:17.400209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:17.399927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:17.399927+0000","last_clean_scrub_stamp":"2024-05-09T09:51:17.399927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T21:34:56.092455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:38.212465+0000","last_change":"2024-05-09T09:51:38.212529+0000","last_active":"2024-05-09T09:51:38.212465+0000","last_peered":"2024-05-09T09:51:38.212465+0000","last_clean":"2024-05-09T09:51:38.212465+0000","last_became_active":"2024-05-09T09:47:14.177955+0000","last_became_peered":"2024-05-09T09:47:14.177955+0000","last_unstale":"2024-05-09T09:51:38.212465+0000","last_undegraded":"2024-05-09T09:51:38.212465+0000","last_fullsized":"2024-05-09T09:51:38.212465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-09T09:51:38.212277+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-09T09:51:38.212277+0000","last_clean_scrub_stamp":"2024-05-09T09:51:38.212277+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:36:25.679596+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:52.501866+0000","last_change":"2024-05-09T09:51:52.501866+0000","last_active":"2024-05-09T09:51:52.501866+0000","last_peered":"2024-05-09T09:51:52.501866+0000","last_clean":"2024-05-09T09:51:52.501866+0000","last_became_active":"2024-05-09T09:47:12.201790+0000","last_became_peered":"2024-05-09T09:47:12.201790+0000","last_unstale":"2024-05-09T09:51:52.501866+0000","last_undegraded":"2024-05-09T09:51:52.501866+0000","last_fullsized":"2024-05-09T09:51:52.501866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-09T09:51:52.501565+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-09T09:51:52.501565+0000","last_clean_scrub_stamp":"2024-05-09T09:51:52.501565+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:54:17.100717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:48.437592+0000","last_change":"2024-05-09T09:51:48.437592+0000","last_active":"2024-05-09T09:51:48.437592+0000","last_peered":"2024-05-09T09:51:48.437592+0000","last_clean":"2024-05-09T09:51:48.437592+0000","last_became_active":"2024-05-09T09:47:12.203435+0000","last_became_peered":"2024-05-09T09:47:12.203435+0000","last_unstale":"2024-05-09T09:51:48.437592+0000","last_undegraded":"2024-05-09T09:51:48.437592+0000","last_fullsized":"2024-05-09T09:51:48.437592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-09T09:51:48.437314+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-09T09:51:48.437314+0000","last_clean_scrub_stamp":"2024-05-09T09:51:48.437314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:08:50.430772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:30.272514+0000","last_change":"2024-05-09T09:51:30.272514+0000","last_active":"2024-05-09T09:51:30.272514+0000","last_peered":"2024-05-09T09:51:30.272514+0000","last_clean":"2024-05-09T09:51:30.272514+0000","last_became_active":"2024-05-09T09:47:14.178142+0000","last_became_peered":"2024-05-09T09:47:14.178142+0000","last_unstale":"2024-05-09T09:51:30.272514+0000","last_undegraded":"2024-05-09T09:51:30.272514+0000","last_fullsized":"2024-05-09T09:51:30.272514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-09T09:51:30.272229+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-09T09:51:30.272229+0000","last_clean_scrub_stamp":"2024-05-09T09:51:30.272229+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:37:34.451434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:21.278372+0000","last_change":"2024-05-09T09:51:21.278372+0000","last_active":"2024-05-09T09:51:21.278372+0000","last_peered":"2024-05-09T09:51:21.278372+0000","last_clean":"2024-05-09T09:51:21.278372+0000","last_became_active":"2024-05-09T09:47:12.205216+0000","last_became_peered":"2024-05-09T09:47:12.205216+0000","last_unstale":"2024-05-09T09:51:21.278372+0000","last_undegraded":"2024-05-09T09:51:21.278372+0000","last_fullsized":"2024-05-09T09:51:21.278372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T09:51:21.278009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T09:51:21.278009+0000","last_clean_scrub_stamp":"2024-05-09T09:51:21.278009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:28:18.321440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'12","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T09:51:20.318209+0000","last_change":"2024-05-09T09:51:20.318209+0000","last_active":"2024-05-09T09:51:20.318209+0000","last_peered":"2024-05-09T09:51:20.318209+0000","last_clean":"2024-05-09T09:51:20.318209+0000","last_became_active":"2024-05-09T09:47:14.174123+0000","last_became_peered":"2024-05-09T09:47:14.174123+0000","last_unstale":"2024-05-09T09:51:20.318209+0000","last_undegraded":"2024-05-09T09:51:20.318209+0000","last_fullsized":"2024-05-09T09:51:20.318209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-09T09:51:20.317917+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-09T09:51:20.317917+0000","last_clean_scrub_stamp":"2024-05-09T09:51:20.317917+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:08:14.769747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3894,"ondisk_log_size":3894,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1628,"num_read_kb":1518,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705732,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35792,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336048,"statfs":{"total":96636764160,"available":96600113152,"internally_reserved":0,"allocated":466944,"data_stored":146615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705734,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":995328,"data_stored":734132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705732,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1011712,"data_stored":733627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705733,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35760,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336080,"statfs":{"total":96636764160,"available":96600145920,"internally_reserved":0,"allocated":434176,"data_stored":145588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T09:52:27.061 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-09T09:52:27.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.206+0000 7efdbc602640 1 Processor -- start 2024-05-09T09:52:27.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.206+0000 7efdbc602640 1 -- start start 2024-05-09T09:52:27.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.206+0000 7efdbc602640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efdb412c890 0x7efdb412cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:52:27.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.206+0000 7efdbc602640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdb412d740 con 0x7efdb412d2f0 2024-05-09T09:52:27.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.206+0000 7efdbc602640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7efdb40958a0 con 0x7efdb412c890 2024-05-09T09:52:27.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.206+0000 7efdba39e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efdb412c890 0x7efdb412cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:52:27.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.206+0000 7efdb9b9d640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7efdb412d2f0 0x7efdb4129390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:55794/0 (socket says 172.21.15.110:55794) 2024-05-09T09:52:27.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.206+0000 7efdb9b9d640 1 -- 172.21.15.110:0/836100690 learned_addr learned my addr 172.21.15.110:0/836100690 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T09:52:27.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.210+0000 7efdba39e640 1 -- 172.21.15.110:0/836100690 >> v1:172.21.15.110:6789/0 conn(0x7efdb412d2f0 legacy=0x7efdb4129390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:52:27.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.210+0000 7efdba39e640 1 -- 172.21.15.110:0/836100690 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb40963a0 con 0x7efdb412c890 2024-05-09T09:52:27.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.210+0000 7efdb939c640 1 -- 172.21.15.110:0/836100690 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 210236679 0 0) 0x7efdb412d740 con 0x7efdb412d2f0 2024-05-09T09:52:27.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.210+0000 7efdba39e640 1 --2- 172.21.15.110:0/836100690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efdb412c890 0x7efdb412cdb0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009740 tx=0x7efdb001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810af6fce990ea65 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:52:27.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.210+0000 7efdb939c640 1 -- 172.21.15.110:0/836100690 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdb00b0070 con 0x7efdb412c890 2024-05-09T09:52:27.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.210+0000 7efdb939c640 1 -- 172.21.15.110:0/836100690 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb00ab530 con 0x7efdb412c890 2024-05-09T09:52:27.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.210+0000 7efdb939c640 1 -- 172.21.15.110:0/836100690 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdb00ab830 con 0x7efdb412c890 2024-05-09T09:52:27.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.210+0000 7efdbc602640 1 -- 172.21.15.110:0/836100690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efdb412c890 msgr2=0x7efdb412cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:52:27.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.210+0000 7efdbc602640 1 --2- 172.21.15.110:0/836100690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efdb412c890 0x7efdb412cdb0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009740 tx=0x7efdb001c400 comp rx=0 tx=0).stop 2024-05-09T09:52:27.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.210+0000 7efdbc602640 1 -- 172.21.15.110:0/836100690 shutdown_connections 2024-05-09T09:52:27.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.210+0000 7efdbc602640 1 --2- 172.21.15.110:0/836100690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efdb412c890 0x7efdb412cdb0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:52:27.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.210+0000 7efdbc602640 1 -- 172.21.15.110:0/836100690 >> 172.21.15.110:0/836100690 conn(0x7efdb409ae00 msgr2=0x7efdb409b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:52:27.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.210+0000 7efdbc602640 1 -- 172.21.15.110:0/836100690 shutdown_connections 2024-05-09T09:52:27.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.210+0000 7efdbc602640 1 -- 172.21.15.110:0/836100690 wait complete. 2024-05-09T09:52:27.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.214+0000 7efdbc602640 1 Processor -- start 2024-05-09T09:52:27.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.214+0000 7efdbc602640 1 -- start start 2024-05-09T09:52:27.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.214+0000 7efdbc602640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efdb412c890 0x7efdb406d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:52:27.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.214+0000 7efdbc602640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7efdb41355f0 con 0x7efdb412c890 2024-05-09T09:52:27.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.214+0000 7efdba39e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efdb412c890 0x7efdb406d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:52:27.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.214+0000 7efdba39e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efdb412c890 0x7efdb406d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50766/0 (socket says 172.21.15.110:50766) 2024-05-09T09:52:27.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.214+0000 7efdba39e640 1 -- 172.21.15.110:0/3075347785 learned_addr learned my addr 172.21.15.110:0/3075347785 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T09:52:27.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.214+0000 7efdba39e640 1 -- 172.21.15.110:0/3075347785 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb4124320 con 0x7efdb412c890 2024-05-09T09:52:27.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.214+0000 7efdba39e640 1 --2- 172.21.15.110:0/3075347785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efdb412c890 0x7efdb406d2a0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7efdb001a030 tx=0x7efdb001ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:52:27.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.214+0000 7efdaaffd640 1 -- 172.21.15.110:0/3075347785 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdb00b0050 con 0x7efdb412c890 2024-05-09T09:52:27.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.214+0000 7efdaaffd640 1 -- 172.21.15.110:0/3075347785 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb00b1040 con 0x7efdb412c890 2024-05-09T09:52:27.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.214+0000 7efdaaffd640 1 -- 172.21.15.110:0/3075347785 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdb00b5930 con 0x7efdb412c890 2024-05-09T09:52:27.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.214+0000 7efdbc602640 1 -- 172.21.15.110:0/3075347785 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdb4131fb0 con 0x7efdb412c890 2024-05-09T09:52:27.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.214+0000 7efdbc602640 1 -- 172.21.15.110:0/3075347785 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdb406eba0 con 0x7efdb412c890 2024-05-09T09:52:27.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.214+0000 7efdbc602640 1 -- 172.21.15.110:0/3075347785 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdb4063710 con 0x7efdb412c890 2024-05-09T09:52:27.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.214+0000 7efdaaffd640 1 -- 172.21.15.110:0/3075347785 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 44324+0+0 (secure 0 0 0) 0x7efdb00be030 con 0x7efdb412c890 2024-05-09T09:52:27.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.214+0000 7efdaaffd640 1 --2- 172.21.15.110:0/3075347785 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efd98036310 0x7efd980387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T09:52:27.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.214+0000 7efdaaffd640 1 -- 172.21.15.110:0/3075347785 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6336+0+0 (secure 0 0 0) 0x7efdb00bc070 con 0x7efdb412c890 2024-05-09T09:52:27.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.214+0000 7efdb9b9d640 1 --2- 172.21.15.110:0/3075347785 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efd98036310 0x7efd980387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T09:52:27.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.214+0000 7efdb9b9d640 1 --2- 172.21.15.110:0/3075347785 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efd98036310 0x7efd980387d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7efda4007fd0 tx=0x7efda4007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T09:52:27.223 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.218+0000 7efdaaffd640 1 -- 172.21.15.110:0/3075347785 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efdb00c5020 con 0x7efdb412c890 2024-05-09T09:52:27.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.382+0000 7efdbc602640 1 -- 172.21.15.110:0/3075347785 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7efdb4067fd0 con 0x7efdb412c890 2024-05-09T09:52:27.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.386+0000 7efdaaffd640 1 -- 172.21.15.110:0/3075347785 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7efdb4124320 con 0x7efdb412c890 2024-05-09T09:52:27.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.386+0000 7efdaaffd640 1 -- 172.21.15.110:0/3075347785 <== mon.0 v2:172.21.15.110:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7efdb00e9080 con 0x7efdb412c890 2024-05-09T09:52:27.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.386+0000 7efdbc602640 1 -- 172.21.15.110:0/3075347785 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efd98036310 msgr2=0x7efd980387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:52:27.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.386+0000 7efdbc602640 1 --2- 172.21.15.110:0/3075347785 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efd98036310 0x7efd980387d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7efda4007fd0 tx=0x7efda4007980 comp rx=0 tx=0).stop 2024-05-09T09:52:27.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.386+0000 7efdbc602640 1 -- 172.21.15.110:0/3075347785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efdb412c890 msgr2=0x7efdb406d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T09:52:27.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.386+0000 7efdbc602640 1 --2- 172.21.15.110:0/3075347785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efdb412c890 0x7efdb406d2a0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7efdb001a030 tx=0x7efdb001ac40 comp rx=0 tx=0).stop 2024-05-09T09:52:27.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.386+0000 7efdbc602640 1 -- 172.21.15.110:0/3075347785 shutdown_connections 2024-05-09T09:52:27.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.386+0000 7efdbc602640 1 --2- 172.21.15.110:0/3075347785 >> [v2:172.21.15.157:6824/2765519551,v1:172.21.15.157:6825/2765519551] conn(0x7efd98036310 0x7efd980387d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:52:27.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.386+0000 7efdbc602640 1 --2- 172.21.15.110:0/3075347785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efdb412c890 0x7efdb406d2a0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T09:52:27.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.386+0000 7efdbc602640 1 -- 172.21.15.110:0/3075347785 >> 172.21.15.110:0/3075347785 conn(0x7efdb409ae00 msgr2=0x7efdb412b480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T09:52:27.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.386+0000 7efdbc602640 1 -- 172.21.15.110:0/3075347785 shutdown_connections 2024-05-09T09:52:27.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T09:52:27.386+0000 7efdbc602640 1 -- 172.21.15.110:0/3075347785 wait complete. 2024-05-09T09:52:27.407 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-09T09:52:27.407 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-09T09:52:27.407 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-09T09:52:27.407 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T09:52:27.501 INFO:tasks.ceph.osd.0:Stopped 2024-05-09T09:52:27.501 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-09T09:52:27.501 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T09:52:27.589 INFO:tasks.ceph.osd.1:Stopped 2024-05-09T09:52:27.589 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-09T09:52:27.589 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T09:52:27.682 INFO:tasks.ceph.osd.2:Stopped 2024-05-09T09:52:27.683 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-09T09:52:27.683 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T09:52:27.774 INFO:tasks.ceph.osd.3:Stopped 2024-05-09T09:52:27.774 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-09T09:52:27.774 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-09T09:52:27.774 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T09:52:27.803 INFO:tasks.ceph.mgr.x:Stopped 2024-05-09T09:52:27.804 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-09T09:52:27.804 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-09T09:52:27.804 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T09:52:27.829 INFO:tasks.ceph.mon.a:Stopped 2024-05-09T09:52:27.829 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-09T09:52:27.829 DEBUG:teuthology.orchestra.run.smithi110:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-05-09T09:52:27.891 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi110.front.sepia.ceph.com 2024-05-09T09:52:27.891 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-09T09:52:28.133 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi157.front.sepia.ceph.com 2024-05-09T09:52:28.133 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-09T09:52:28.366 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi157.front.sepia.ceph.com 2024-05-09T09:52:28.366 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-09T09:52:28.568 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi157.front.sepia.ceph.com 2024-05-09T09:52:28.569 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-09T09:52:28.735 INFO:tasks.ceph:Archiving mon data... 2024-05-09T09:52:28.736 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi/7699626/data/mon.a.tgz 2024-05-09T09:52:28.737 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-05-09T09:52:28.743 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.stTNCAHwg7 2024-05-09T09:52:28.743 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.stTNCAHwg7 2024-05-09T09:52:28.866 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.stTNCAHwg7 2024-05-09T09:52:28.933 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.stTNCAHwg7 is 267KB 2024-05-09T09:52:29.001 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.stTNCAHwg7 2024-05-09T09:52:29.008 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-09T09:52:29.008 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-09T09:52:29.056 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-09T09:52:29.113 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-09T09:52:29.124 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-09T09:52:29.124 INFO:tasks.ceph:Archiving crash dumps... 2024-05-09T09:52:29.271 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/crash to /home/teuthworker/archive/kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi/7699626/remote/smithi110/crash 2024-05-09T09:52:29.275 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-09T09:52:29.291 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/crash to /home/teuthworker/archive/kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi/7699626/remote/smithi157/crash 2024-05-09T09:52:29.293 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-09T09:52:29.307 INFO:tasks.ceph:Compressing logs... 2024-05-09T09:52:29.307 DEBUG:teuthology.orchestra.run.smithi110:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-09T09:52:29.333 DEBUG:teuthology.orchestra.run.smithi157:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-09T09:52:29.364 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23797.log 2024-05-09T09:52:29.365 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23403.log 2024-05-09T09:52:29.365 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23821.log 2024-05-09T09:52:29.365 INFO:teuthology.orchestra.run.smithi110.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23797.log.gz 2024-05-09T09:52:29.365 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23742.log 2024-05-09T09:52:29.398 INFO:teuthology.orchestra.run.smithi110.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.23403.log.gz 2024-05-09T09:52:29.399 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23559.log 2024-05-09T09:52:29.399 INFO:teuthology.orchestra.run.smithi110.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23821.log.gz 2024-05-09T09:52:29.399 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21630.log 2024-05-09T09:52:29.399 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23742.log: /var/log/ceph/ceph-client.admin.23559.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-09T09:52:29.399 INFO:teuthology.orchestra.run.smithi110.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.23559.log.gz 2024-05-09T09:52:29.399 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.21630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22961.log 2024-05-09T09:52:29.399 INFO:teuthology.orchestra.run.smithi110.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.23742.log.gz 2024-05-09T09:52:29.399 INFO:teuthology.orchestra.run.smithi110.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.21630.log.gz 2024-05-09T09:52:29.399 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23261.log 2024-05-09T09:52:29.399 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.22961.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.22961.log.gz 2024-05-09T09:52:29.399 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23057.log 2024-05-09T09:52:29.399 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23377.log 2024-05-09T09:52:29.399 INFO:teuthology.orchestra.run.smithi110.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.23261.log.gz 2024-05-09T09:52:29.400 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22741.log 2024-05-09T09:52:29.400 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23377.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23057.log.gz 2024-05-09T09:52:29.400 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23313.log 2024-05-09T09:52:29.400 INFO:teuthology.orchestra.run.smithi110.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.23377.log.gz 2024-05-09T09:52:29.400 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.22741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23663.log 2024-05-09T09:52:29.400 INFO:teuthology.orchestra.run.smithi110.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.22741.log.gz 2024-05-09T09:52:29.400 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23313.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-09T09:52:29.400 INFO:teuthology.orchestra.run.smithi110.stderr: 86.2%/var/log/ceph/ceph-client.admin.23663.log: -- replaced with /var/log/ceph/ceph-client.admin.23313.log.gz 2024-05-09T09:52:29.400 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23715.log 2024-05-09T09:52:29.400 INFO:teuthology.orchestra.run.smithi110.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.23663.log.gz 2024-05-09T09:52:29.400 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22950.log 2024-05-09T09:52:29.400 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21594.log 2024-05-09T09:52:29.400 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.22950.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.23715.log.gz 2024-05-09T09:52:29.400 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23429.log 2024-05-09T09:52:29.401 INFO:teuthology.orchestra.run.smithi110.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.22950.log.gz 2024-05-09T09:52:29.401 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.21594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22857.log 2024-05-09T09:52:29.401 INFO:teuthology.orchestra.run.smithi110.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.21594.log.gz 2024-05-09T09:52:29.401 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23169.log 2024-05-09T09:52:29.401 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23429.log: /var/log/ceph/ceph-client.admin.22857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22819.log 2024-05-09T09:52:29.401 INFO:teuthology.orchestra.run.smithi110.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.23429.log.gz 2024-05-09T09:52:29.401 INFO:teuthology.orchestra.run.smithi110.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.22857.log.gz 2024-05-09T09:52:29.401 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23637.log 2024-05-09T09:52:29.401 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.22819.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.23169.log.gz 2024-05-09T09:52:29.401 INFO:teuthology.orchestra.run.smithi110.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.22819.log.gz 2024-05-09T09:52:29.401 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23771.log 2024-05-09T09:52:29.401 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22960.log 2024-05-09T09:52:29.401 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23771.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.23637.log.gz 2024-05-09T09:52:29.401 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23165.log 2024-05-09T09:52:29.401 INFO:teuthology.orchestra.run.smithi110.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.23771.log.gz 2024-05-09T09:52:29.402 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23611.log 2024-05-09T09:52:29.402 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.22960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22690.log 2024-05-09T09:52:29.402 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23165.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.22960.log.gz 2024-05-09T09:52:29.402 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23611.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23165.log.gz 2024-05-09T09:52:29.402 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23061.log 2024-05-09T09:52:29.402 INFO:teuthology.orchestra.run.smithi110.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.23611.log.gz 2024-05-09T09:52:29.402 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.22690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23455.log 2024-05-09T09:52:29.402 INFO:teuthology.orchestra.run.smithi110.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.22690.log.gz 2024-05-09T09:52:29.402 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23689.log 2024-05-09T09:52:29.402 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23056.log 2024-05-09T09:52:29.402 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23455.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.23061.log.gz 2024-05-09T09:52:29.402 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23689.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20279.log 2024-05-09T09:52:29.402 INFO:teuthology.orchestra.run.smithi110.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.23455.log.gz 2024-05-09T09:52:29.403 INFO:teuthology.orchestra.run.smithi110.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.23689.log.gz 2024-05-09T09:52:29.403 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23157.log 2024-05-09T09:52:29.403 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph.tmp-client.admin.20279.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.23056.log.gz 2024-05-09T09:52:29.403 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-09T09:52:29.403 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20279.log.gz 2024-05-09T09:52:29.403 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23164.log 2024-05-09T09:52:29.403 INFO:teuthology.orchestra.run.smithi110.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.23157.log.gz 2024-05-09T09:52:29.403 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23351.log 2024-05-09T09:52:29.403 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23507.log 2024-05-09T09:52:29.403 INFO:teuthology.orchestra.run.smithi110.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.23164.log.gz 2024-05-09T09:52:29.403 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21522.log 2024-05-09T09:52:29.403 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23507.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.23351.log.gz 2024-05-09T09:52:29.403 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23533.log 2024-05-09T09:52:29.403 INFO:teuthology.orchestra.run.smithi110.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.23507.log.gz 2024-05-09T09:52:29.403 INFO:teuthology.orchestra.run.smithi110.stderr: 86.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-09T09:52:29.404 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.21522.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-09T09:52:29.404 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23533.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.21522.log.gz 2024-05-09T09:52:29.404 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22855.log 2024-05-09T09:52:29.404 INFO:teuthology.orchestra.run.smithi110.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.23533.log.gz 2024-05-09T09:52:29.404 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22715.log 2024-05-09T09:52:29.404 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph.audit.log: gzip/var/log/ceph/ceph-client.admin.22855.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.23585.log 2024-05-09T09:52:29.404 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.22715.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.22855.log.gz 2024-05-09T09:52:29.404 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23065.log 2024-05-09T09:52:29.404 INFO:teuthology.orchestra.run.smithi110.stderr: 88.3% 86.0% -- replaced with /var/log/ceph/ceph.audit.log.gz -- replaced with /var/log/ceph/ceph-client.admin.22715.log.gz 2024-05-09T09:52:29.404 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-05-09T09:52:29.405 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23287.log 2024-05-09T09:52:29.405 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23065.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.23585.log.gz 2024-05-09T09:52:29.405 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22652.log 2024-05-09T09:52:29.405 INFO:teuthology.orchestra.run.smithi110.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.23065.log.gz 2024-05-09T09:52:29.405 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22793.log 2024-05-09T09:52:29.405 INFO:teuthology.orchestra.run.smithi110.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.23287.log.gz 2024-05-09T09:52:29.405 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.22652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23481.log 2024-05-09T09:52:29.405 INFO:teuthology.orchestra.run.smithi110.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.22652.log.gz 2024-05-09T09:52:29.405 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.22793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22767.log 2024-05-09T09:52:29.405 INFO:teuthology.orchestra.run.smithi110.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.22793.log.gz 2024-05-09T09:52:29.405 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.23481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22853.log 2024-05-09T09:52:29.405 INFO:teuthology.orchestra.run.smithi110.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.23481.log.gz 2024-05-09T09:52:29.405 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.22767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22852.log 2024-05-09T09:52:29.405 INFO:teuthology.orchestra.run.smithi110.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.22767.log.gz 2024-05-09T09:52:29.405 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.22853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22953.log 2024-05-09T09:52:29.406 INFO:teuthology.orchestra.run.smithi110.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.22853.log.gz 2024-05-09T09:52:29.406 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.22852.log: /var/log/ceph/ceph-client.admin.22953.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.22852.log.gz 2024-05-09T09:52:29.406 INFO:teuthology.orchestra.run.smithi110.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.22953.log.gz 2024-05-09T09:52:29.424 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60267.log 2024-05-09T09:52:29.424 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70297.log 2024-05-09T09:52:29.424 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.60267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78529.log 2024-05-09T09:52:29.424 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.70297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83839.log 2024-05-09T09:52:29.424 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.78529.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-05-09T09:52:29.424 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.83839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44337.log 2024-05-09T09:52:29.424 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79709.log 2024-05-09T09:52:29.425 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.44337.log: gzip -5 --verbose -- 91.4% -- replaced with /var/log/ceph/ceph-client.0.70297.log.gz 2024-05-09T09:52:29.425 INFO:teuthology.orchestra.run.smithi157.stderr: /var/log/ceph/ceph-client.0.79119.log 2024-05-09T09:52:29.425 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.79709.log: 93.4% -- replaced with /var/log/ceph/ceph-client.0.60267.log.gz 2024-05-09T09:52:29.425 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36077.log 2024-05-09T09:52:29.425 INFO:teuthology.orchestra.run.smithi157.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.78529.log.gz 2024-05-09T09:52:29.425 INFO:teuthology.orchestra.run.smithi157.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.83839.log.gz 2024-05-09T09:52:29.425 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.79119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43747.log 2024-05-09T09:52:29.425 INFO:teuthology.orchestra.run.smithi157.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.44337.log.gz 2024-05-09T09:52:29.425 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.36077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55547.log 2024-05-09T09:52:29.425 INFO:teuthology.orchestra.run.smithi157.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.79709.log.gz 2024-05-09T09:52:29.425 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5/var/log/ceph/ceph-client.0.43747.log: --verbose -- /var/log/ceph/ceph-client.0.36667.log 2024-05-09T09:52:29.425 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.55547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61447.log 2024-05-09T09:52:29.425 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.36667.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.79119.log.gz 2024-05-09T09:52:29.426 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68527.log 2024-05-09T09:52:29.426 INFO:teuthology.orchestra.run.smithi157.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.36077.log.gz 2024-05-09T09:52:29.426 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.61447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54367.log 2024-05-09T09:52:29.426 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.68527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70889.log 2024-05-09T09:52:29.426 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.54367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63807.log 2024-05-09T09:52:29.426 INFO:teuthology.orchestra.run.smithi157.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55547.log.gz 2024-05-09T09:52:29.426 INFO:teuthology.orchestra.run.smithi157.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.43747.log.gz 2024-05-09T09:52:29.426 INFO:teuthology.orchestra.run.smithi157.stderr: 91.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57317.log 2024-05-09T09:52:29.426 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-client.0.36667.log.gz 2024-05-09T09:52:29.426 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.70889.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.61447.log.gz 2024-05-09T09:52:29.426 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.63807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31947.log 2024-05-09T09:52:29.426 INFO:teuthology.orchestra.run.smithi157.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.68527.log.gz 2024-05-09T09:52:29.426 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77361.log 2024-05-09T09:52:29.427 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.57317.log: /var/log/ceph/ceph-client.0.31947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27697.log 2024-05-09T09:52:29.427 INFO:teuthology.orchestra.run.smithi157.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.54367.log.gz 2024-05-09T09:52:29.427 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.77361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54957.log 2024-05-09T09:52:29.427 INFO:teuthology.orchestra.run.smithi157.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.70889.log.gz 2024-05-09T09:52:29.427 INFO:teuthology.orchestra.run.smithi157.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.63807.log.gz 2024-05-09T09:52:29.427 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56137.log 2024-05-09T09:52:29.427 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.27697.log: 90.5% -- replaced with /var/log/ceph/ceph-client.0.77361.log.gz 2024-05-09T09:52:29.427 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52597.log 2024-05-09T09:52:29.427 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.54957.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.27697.log.gz 2024-05-09T09:52:29.427 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69117.log 2024-05-09T09:52:29.427 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.56137.log: 92.0% -- replaced with /var/log/ceph/ceph-client.0.31947.log.gz 2024-05-09T09:52:29.427 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.52597.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-09T09:52:29.427 INFO:teuthology.orchestra.run.smithi157.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.57317.log.gz 2024-05-09T09:52:29.427 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.69117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53187.log 2024-05-09T09:52:29.428 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47287.log 2024-05-09T09:52:29.428 INFO:teuthology.orchestra.run.smithi157.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.54957.log.gz 2024-05-09T09:52:29.428 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.53187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39027.log 2024-05-09T09:52:29.428 INFO:teuthology.orchestra.run.smithi157.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.56137.log.gz 2024-05-09T09:52:29.428 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43157.log 2024-05-09T09:52:29.428 INFO:teuthology.orchestra.run.smithi157.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.52597.log.gz 2024-05-09T09:52:29.428 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.47287.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.69117.log.gz 2024-05-09T09:52:29.428 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.39027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63217.log 2024-05-09T09:52:29.428 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.43157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59677.log 2024-05-09T09:52:29.428 INFO:teuthology.orchestra.run.smithi157.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.53187.log.gz/var/log/ceph/ceph-client.0.63217.log: 2024-05-09T09:52:29.428 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42567.log 2024-05-09T09:52:29.428 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35487.log 2024-05-09T09:52:29.428 INFO:teuthology.orchestra.run.smithi157.stderr: 91.6%/var/log/ceph/ceph-client.0.59677.log: -- replaced with /var/log/ceph/ceph-client.0.47287.log.gz 2024-05-09T09:52:29.428 INFO:teuthology.orchestra.run.smithi157.stderr: 91.5%/var/log/ceph/ceph-client.0.42567.log: -- replaced with /var/log/ceph/ceph-client.0.39027.log.gz 2024-05-09T09:52:29.429 INFO:teuthology.orchestra.run.smithi157.stderr: 91.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46697.log 2024-05-09T09:52:29.429 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-client.0.43157.log.gz 2024-05-09T09:52:29.429 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.35487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50827.log 2024-05-09T09:52:29.429 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45517.log 2024-05-09T09:52:29.429 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.46697.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.63217.log.gz/var/log/ceph/ceph-client.0.50827.log: 2024-05-09T09:52:29.429 INFO:teuthology.orchestra.run.smithi157.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.42567.log.gz 2024-05-09T09:52:29.429 INFO:teuthology.orchestra.run.smithi157.stderr: 92.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85019.log 2024-05-09T09:52:29.429 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-client.0.59677.log.gz 91.8% -- replaced with /var/log/ceph/ceph-client.0.35487.log.gz 2024-05-09T09:52:29.429 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-05-09T09:52:29.429 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.45517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67347.log 2024-05-09T09:52:29.429 INFO:teuthology.orchestra.run.smithi157.stderr: 91.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72659.log 2024-05-09T09:52:29.429 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-client.0.46697.log.gz/var/log/ceph/ceph-client.0.85019.log: 2024-05-09T09:52:29.429 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.67347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52007.log 2024-05-09T09:52:29.429 INFO:teuthology.orchestra.run.smithi157.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.50827.log.gz 2024-05-09T09:52:29.430 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30773.log 2024-05-09T09:52:29.430 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.72659.log: /var/log/ceph/ceph-client.0.52007.log: 91.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58497.log 2024-05-09T09:52:29.430 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-client.0.45517.log.gz 2024-05-09T09:52:29.430 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.30773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86199.log 2024-05-09T09:52:29.430 INFO:teuthology.orchestra.run.smithi157.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.85019.log.gz 2024-05-09T09:52:29.430 INFO:teuthology.orchestra.run.smithi157.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.67347.log.gz/var/log/ceph/ceph-client.0.58497.log: 2024-05-09T09:52:29.430 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23881.log 2024-05-09T09:52:29.430 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.86199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86795.log 2024-05-09T09:52:29.430 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.23881.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.52007.log.gz 2024-05-09T09:52:29.430 INFO:teuthology.orchestra.run.smithi157.stderr: 85.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.23881.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.27673.log 2024-05-09T09:52:29.430 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-05-09T09:52:29.430 INFO:teuthology.orchestra.run.smithi157.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.72659.log.gz 2024-05-09T09:52:29.430 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.86795.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.58497.log.gz 2024-05-09T09:52:29.430 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82659.log 2024-05-09T09:52:29.431 INFO:teuthology.orchestra.run.smithi157.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.30773.log.gz 2024-05-09T09:52:29.431 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71479.log 2024-05-09T09:52:29.431 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.27673.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.86199.log.gz 2024-05-09T09:52:29.431 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.82659.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.27673.log.gz 2024-05-09T09:52:29.431 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77945.log 2024-05-09T09:52:29.431 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.71479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85609.log 2024-05-09T09:52:29.431 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.77945.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-09T09:52:29.431 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.85609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33717.log 2024-05-09T09:52:29.431 INFO:teuthology.orchestra.run.smithi157.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.0.77945.log.gz/var/log/ceph/ceph-osd.3.log: 2024-05-09T09:52:29.431 INFO:teuthology.orchestra.run.smithi157.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.82659.log.gz 2024-05-09T09:52:29.431 INFO:teuthology.orchestra.run.smithi157.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.71479.log.gz 2024-05-09T09:52:29.431 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33127.log 2024-05-09T09:52:29.431 INFO:teuthology.orchestra.run.smithi157.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.0.86795.log.gz 2024-05-09T09:52:29.431 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.33717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51417.log 2024-05-09T09:52:29.431 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40797.log 2024-05-09T09:52:29.432 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.33127.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.85609.log.gz 2024-05-09T09:52:29.432 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.51417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76193.log 2024-05-09T09:52:29.432 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.40797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39617.log 2024-05-09T09:52:29.432 INFO:teuthology.orchestra.run.smithi157.stderr: 91.7%/var/log/ceph/ceph-client.0.76193.log: -- replaced with /var/log/ceph/ceph-client.0.33717.log.gz 2024-05-09T09:52:29.432 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62037.log 2024-05-09T09:52:29.432 INFO:teuthology.orchestra.run.smithi157.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.33127.log.gz 2024-05-09T09:52:29.432 INFO:teuthology.orchestra.run.smithi157.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.51417.log.gz 2024-05-09T09:52:29.432 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.39617.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.40797.log.gz 2024-05-09T09:52:29.432 INFO:teuthology.orchestra.run.smithi157.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.76193.log.gz 2024-05-09T09:52:29.432 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76777.log 2024-05-09T09:52:29.432 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.62037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65577.log 2024-05-09T09:52:29.432 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.76777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41977.log 2024-05-09T09:52:29.432 INFO:teuthology.orchestra.run.smithi157.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.39617.log.gz 2024-05-09T09:52:29.432 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.65577.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-09T09:52:29.432 INFO:teuthology.orchestra.run.smithi157.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.0.76777.log.gz 2024-05-09T09:52:29.433 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.41977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64987.log 2024-05-09T09:52:29.433 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.1.log: 91.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34897.log 2024-05-09T09:52:29.433 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-client.0.62037.log.gz 2024-05-09T09:52:29.433 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.64987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60857.log 2024-05-09T09:52:29.433 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.34897.log: 92.0% -- replaced with /var/log/ceph/ceph-client.0.65577.log.gz 91.7% -- replaced with /var/log/ceph/ceph-client.0.41977.log.gz 2024-05-09T09:52:29.433 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-05-09T09:52:29.433 INFO:teuthology.orchestra.run.smithi157.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.34897.log.gz 2024-05-09T09:52:29.433 INFO:teuthology.orchestra.run.smithi157.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.64987.log.gz 2024-05-09T09:52:29.433 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66757.log 2024-05-09T09:52:29.433 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.60857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44927.log 2024-05-09T09:52:29.433 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.66757.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-09T09:52:29.433 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.44927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27721.log 2024-05-09T09:52:29.433 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mgr.x.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.66757.log.gz 2024-05-09T09:52:29.433 INFO:teuthology.orchestra.run.smithi157.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.60857.log.gz 2024-05-09T09:52:29.433 INFO:teuthology.orchestra.run.smithi157.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.44927.log.gz 2024-05-09T09:52:29.434 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46107.log 2024-05-09T09:52:29.434 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.27721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49647.log 2024-05-09T09:52:29.434 INFO:teuthology.orchestra.run.smithi157.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.27721.log.gz 2024-05-09T09:52:29.434 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.46107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41387.log 2024-05-09T09:52:29.434 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66167.log 2024-05-09T09:52:29.434 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.49647.log: /var/log/ceph/ceph-client.0.41387.log: 92.0% -- replaced with /var/log/ceph/ceph-client.0.46107.log.gz 2024-05-09T09:52:29.434 INFO:teuthology.orchestra.run.smithi157.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.49647.log.gz 2024-05-09T09:52:29.434 INFO:teuthology.orchestra.run.smithi157.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.41387.log.gz 2024-05-09T09:52:29.434 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75609.log 2024-05-09T09:52:29.434 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.66167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73249.log 2024-05-09T09:52:29.434 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.75609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67937.log 2024-05-09T09:52:29.434 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.73249.log: 90.7% -- replaced with /var/log/ceph/ceph-client.0.75609.log.gz 2024-05-09T09:52:29.434 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27745.log 2024-05-09T09:52:29.434 INFO:teuthology.orchestra.run.smithi157.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.66167.log.gz 2024-05-09T09:52:29.435 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.67937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30183.log 2024-05-09T09:52:29.435 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.27745.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.73249.log.gz 2024-05-09T09:52:29.435 INFO:teuthology.orchestra.run.smithi157.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.27745.log.gz 2024-05-09T09:52:29.435 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62627.log 2024-05-09T09:52:29.435 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49057.log 2024-05-09T09:52:29.435 INFO:teuthology.orchestra.run.smithi157.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.67937.log.gz 2024-05-09T09:52:29.435 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.30183.log: /var/log/ceph/ceph-client.0.62627.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.30183.log.gz 2024-05-09T09:52:29.435 INFO:teuthology.orchestra.run.smithi157.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.62627.log.gz 2024-05-09T09:52:29.435 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23857.log 2024-05-09T09:52:29.435 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.49057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27649.log 2024-05-09T09:52:29.435 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.23857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56727.log 2024-05-09T09:52:29.435 INFO:teuthology.orchestra.run.smithi157.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.23857.log.gz 2024-05-09T09:52:29.435 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.27649.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.27649.log.gz 2024-05-09T09:52:29.435 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57907.log 2024-05-09T09:52:29.436 INFO:teuthology.orchestra.run.smithi157.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.49057.log.gz 2024-05-09T09:52:29.436 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-05-09T09:52:29.436 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.56727.log: /var/log/ceph/ceph-client.0.57907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73839.log 2024-05-09T09:52:29.436 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ops-log-ceph-client.0.log: 91.8% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-05-09T09:52:29.436 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83249.log 2024-05-09T09:52:29.436 INFO:teuthology.orchestra.run.smithi157.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.57907.log.gz/var/log/ceph/ceph-client.0.73839.log: 2024-05-09T09:52:29.436 INFO:teuthology.orchestra.run.smithi157.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.56727.log.gz 2024-05-09T09:52:29.436 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50237.log 2024-05-09T09:52:29.436 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74429.log 2024-05-09T09:52:29.436 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.83249.log: /var/log/ceph/ceph-client.0.50237.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.73839.log.gz 2024-05-09T09:52:29.436 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48467.log 2024-05-09T09:52:29.436 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.74429.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.50237.log.gz 2024-05-09T09:52:29.436 INFO:teuthology.orchestra.run.smithi157.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.83249.log.gz 2024-05-09T09:52:29.436 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23809.log 2024-05-09T09:52:29.437 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37257.log 2024-05-09T09:52:29.437 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.48467.log: /var/log/ceph/ceph-client.admin.23809.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.23809.log.gz 2024-05-09T09:52:29.437 INFO:teuthology.orchestra.run.smithi157.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.74429.log.gz 2024-05-09T09:52:29.446 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.29003.log 2024-05-09T09:52:29.446 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.37257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81479.log 2024-05-09T09:52:29.446 INFO:teuthology.orchestra.run.smithi157.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.48467.log.gz 2024-05-09T09:52:29.446 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.29003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53777.log 2024-05-09T09:52:29.446 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.81479.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37257.log.gz 2024-05-09T09:52:29.446 INFO:teuthology.orchestra.run.smithi157.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.29003.log.gz 2024-05-09T09:52:29.446 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38437.log 2024-05-09T09:52:29.446 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.53777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59087.log 2024-05-09T09:52:29.447 INFO:teuthology.orchestra.run.smithi157.stderr: 91.4%/var/log/ceph/ceph-client.0.38437.log: -- replaced with /var/log/ceph/ceph-client.0.81479.log.gz 2024-05-09T09:52:29.447 INFO:teuthology.orchestra.run.smithi157.stderr: 92.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72069.log 2024-05-09T09:52:29.447 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-05-09T09:52:29.447 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.59087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47877.log 2024-05-09T09:52:29.447 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.72069.log: 91.5% 91.4% -- replaced with /var/log/ceph/ceph-client.0.38437.log.gz 2024-05-09T09:52:29.447 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-client.0.53777.log.gz 2024-05-09T09:52:29.447 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23833.log 2024-05-09T09:52:29.447 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.47877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75019.log 2024-05-09T09:52:29.447 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.23833.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.59087.log.gz 2024-05-09T09:52:29.447 INFO:teuthology.orchestra.run.smithi157.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.23833.log.gz 2024-05-09T09:52:29.447 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.28413.log 2024-05-09T09:52:29.447 INFO:teuthology.orchestra.run.smithi157.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.72069.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.80889.log 2024-05-09T09:52:29.447 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-05-09T09:52:29.447 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.75019.log: /var/log/ceph/ceph-client.0.28413.log: 91.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37847.log 2024-05-09T09:52:29.448 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-client.0.47877.log.gz 2024-05-09T09:52:29.448 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.80889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40207.log 2024-05-09T09:52:29.448 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.37847.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.75019.log.gz 2024-05-09T09:52:29.448 INFO:teuthology.orchestra.run.smithi157.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.0.28413.log.gz 2024-05-09T09:52:29.448 INFO:teuthology.orchestra.run.smithi157.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.37847.log.gz 2024-05-09T09:52:29.448 INFO:teuthology.orchestra.run.smithi157.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.80889.log.gz 2024-05-09T09:52:29.448 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31363.log 2024-05-09T09:52:29.448 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.40207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32537.log 2024-05-09T09:52:29.448 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.31363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64397.log 2024-05-09T09:52:29.448 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.32537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82069.log 2024-05-09T09:52:29.448 INFO:teuthology.orchestra.run.smithi157.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.0.31363.log.gz 2024-05-09T09:52:29.448 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.64397.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.40207.log.gz 2024-05-09T09:52:29.448 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80299.log 2024-05-09T09:52:29.448 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.82069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84429.log 2024-05-09T09:52:29.448 INFO:teuthology.orchestra.run.smithi157.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.32537.log.gz 2024-05-09T09:52:29.449 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.80299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34307.log 2024-05-09T09:52:29.449 INFO:teuthology.orchestra.run.smithi157.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.64397.log.gz 2024-05-09T09:52:29.449 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.84429.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.82069.log.gz 2024-05-09T09:52:29.449 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.29593.log 2024-05-09T09:52:29.449 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.34307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69707.log 2024-05-09T09:52:29.449 INFO:teuthology.orchestra.run.smithi157.stderr: 91.4%/var/log/ceph/ceph-client.0.29593.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.80299.log.gz 2024-05-09T09:52:29.449 INFO:teuthology.orchestra.run.smithi157.stderr: -- replaced with /var/log/ceph/ceph-client.0.84429.log.gz 2024-05-09T09:52:29.449 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.0.69707.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.34307.log.gz 2024-05-09T09:52:29.449 INFO:teuthology.orchestra.run.smithi157.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.29593.log.gz 2024-05-09T09:52:29.449 INFO:teuthology.orchestra.run.smithi157.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.69707.log.gz 2024-05-09T09:52:29.458 INFO:teuthology.orchestra.run.smithi157.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-09T09:52:29.565 INFO:teuthology.orchestra.run.smithi110.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-09T09:52:30.440 INFO:teuthology.orchestra.run.smithi157.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-09T09:52:30.543 INFO:teuthology.orchestra.run.smithi110.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-09T09:52:30.544 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-05-09T09:52:30.545 INFO:teuthology.orchestra.run.smithi110.stderr:real 0m1.209s 2024-05-09T09:52:30.545 INFO:teuthology.orchestra.run.smithi110.stderr:user 0m1.388s 2024-05-09T09:52:30.545 INFO:teuthology.orchestra.run.smithi110.stderr:sys 0m0.069s 2024-05-09T09:52:30.586 INFO:teuthology.orchestra.run.smithi157.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-09T09:52:30.689 INFO:teuthology.orchestra.run.smithi157.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-09T09:52:30.690 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-05-09T09:52:30.690 INFO:teuthology.orchestra.run.smithi157.stderr:real 0m1.337s 2024-05-09T09:52:30.690 INFO:teuthology.orchestra.run.smithi157.stderr:user 0m3.767s 2024-05-09T09:52:30.690 INFO:teuthology.orchestra.run.smithi157.stderr:sys 0m0.208s 2024-05-09T09:52:30.691 INFO:tasks.ceph:Archiving logs... 2024-05-09T09:52:30.691 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/log/ceph to /home/teuthworker/archive/kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi/7699626/remote/smithi110/log 2024-05-09T09:52:30.692 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T09:52:30.919 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/log/ceph to /home/teuthworker/archive/kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi/7699626/remote/smithi157/log 2024-05-09T09:52:30.920 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T09:52:31.484 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-09T09:52:31.496 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-09T09:52:31.497 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T09:52:31.499 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T09:52:31.561 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-09T09:52:31.570 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-09T09:52:31.570 DEBUG:teuthology.orchestra.run.smithi110:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T09:52:31.573 DEBUG:teuthology.orchestra.run.smithi157:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T09:52:31.584 INFO:teuthology.orchestra.run.smithi110.stdout: remote refid st t when poll reach delay offset jitter 2024-05-09T09:52:31.584 INFO:teuthology.orchestra.run.smithi110.stdout:============================================================================== 2024-05-09T09:52:31.584 INFO:teuthology.orchestra.run.smithi110.stdout:+hv01.front.sepi 67.205.162.81 3 u 27 64 377 0.086 -1.203 0.983 2024-05-09T09:52:31.584 INFO:teuthology.orchestra.run.smithi110.stdout:+hv02.front.sepi 63.231.80.2 3 u 28 64 377 0.067 +1.266 1.737 2024-05-09T09:52:31.585 INFO:teuthology.orchestra.run.smithi110.stdout:*hv03.front.sepi 74.6.168.72 3 u 27 64 377 0.089 -1.028 1.008 2024-05-09T09:52:31.585 INFO:teuthology.orchestra.run.smithi110.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-09T09:52:31.585 INFO:teuthology.orchestra.run.smithi157.stdout: remote refid st t when poll reach delay offset jitter 2024-05-09T09:52:31.585 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================== 2024-05-09T09:52:31.585 INFO:teuthology.orchestra.run.smithi157.stdout:+hv01.front.sepi 67.205.162.81 3 u 19 64 377 0.089 -0.302 1.595 2024-05-09T09:52:31.585 INFO:teuthology.orchestra.run.smithi157.stdout:*hv02.front.sepi 63.231.80.2 3 u 21 64 377 0.077 +0.521 1.246 2024-05-09T09:52:31.585 INFO:teuthology.orchestra.run.smithi157.stdout:+hv03.front.sepi 74.6.168.72 3 u 26 64 377 0.067 -2.404 1.378 2024-05-09T09:52:31.585 INFO:teuthology.orchestra.run.smithi157.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-09T09:52:31.586 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-09T09:52:31.648 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-09T09:52:31.648 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-09T09:52:31.660 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-09T09:52:31.725 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-09T09:52:31.734 INFO:teuthology.task.internal:Duration was 913.625222 seconds 2024-05-09T09:52:31.735 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-09T09:52:31.744 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-09T09:52:31.744 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T09:52:31.747 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T09:52:31.784 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-09T09:52:31.784 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi110.front.sepia.ceph.com 2024-05-09T09:52:31.784 DEBUG:teuthology.orchestra.run.smithi110:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T09:52:31.837 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi157.front.sepia.ceph.com 2024-05-09T09:52:31.837 DEBUG:teuthology.orchestra.run.smithi157:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T09:52:31.847 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-09T09:52:31.847 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T09:52:31.881 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T09:52:31.915 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-09T09:52:31.915 DEBUG:teuthology.orchestra.run.smithi110:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T09:52:31.949 DEBUG:teuthology.orchestra.run.smithi157:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T09:52:32.013 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-09T09:52:32.023 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-09T09:52:32.023 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T09:52:32.033 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T09:52:32.044 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-09T09:52:32.056 DEBUG:teuthology.orchestra.run.smithi110:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T09:52:32.077 DEBUG:teuthology.orchestra.run.smithi157:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T09:52:32.084 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = core 2024-05-09T09:52:32.094 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = core 2024-05-09T09:52:32.119 DEBUG:teuthology.orchestra.run.smithi110:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T09:52:32.155 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T09:52:32.155 DEBUG:teuthology.orchestra.run.smithi157:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T09:52:32.168 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T09:52:32.169 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-09T09:52:32.184 INFO:teuthology.task.internal:Transferring archived files... 2024-05-09T09:52:32.185 DEBUG:teuthology.misc:Transferring archived files from smithi110:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi/7699626/remote/smithi110 2024-05-09T09:52:32.185 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T09:52:32.222 DEBUG:teuthology.misc:Transferring archived files from smithi157:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/kkeithle-2024-05-09_09:15:11-rgw-wip-kkeithley-zipper-ec-distro-default-smithi/7699626/remote/smithi157 2024-05-09T09:52:32.223 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T09:52:32.246 INFO:teuthology.task.internal:Removing archive directory... 2024-05-09T09:52:32.246 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T09:52:32.261 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T09:52:32.290 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-09T09:52:32.307 INFO:teuthology.task.internal:Not uploading archives. 2024-05-09T09:52:32.307 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-09T09:52:32.331 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-09T09:52:32.331 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T09:52:32.333 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T09:52:32.337 INFO:teuthology.orchestra.run.smithi110.stdout: 658623 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 09:52 /home/ubuntu/cephtest 2024-05-09T09:52:32.340 INFO:teuthology.orchestra.run.smithi157.stdout: 658464 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 09:52 /home/ubuntu/cephtest 2024-05-09T09:52:32.341 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-09T09:52:32.358 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-09T09:52:32.429 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} duration: 913.6252222061157 flavor: default owner: scheduled_kkeithle@teuthology success: true 2024-05-09T09:52:32.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-09T09:52:32.495 INFO:teuthology.run:pass